2024-04-20T10:45:45.934 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-20T10:45:45.935 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi --owner scheduled_rishabh@teuthology --verbose --archive /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489 --description fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} -- /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/orig.config.yaml 2024-04-20T10:45:45.992 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T10:45:46.076 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489 branch: wip-rishabh-testing-20240416.193735 description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} email: null first_in_suite: false job_id: '7664489' kernel: client: sha1: distro flavor: default kdb: true sha1: 806ec36b21129f113ce356c007dd59694d340b37 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240416.193735 ceph: cephfs: fs: - name: a - name: b session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - Replacing daemon mds sha1: a8c84f5997950fd7d008204839253291d52e6eda ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: cephfs_name: a client.1: cephfs_name: b install: ceph: flavor: default sha1: a8c84f5997950fd7d008204839253291d52e6eda kclient: client.0: cephfs_name: a client.1: cephfs_name: b syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240416.193735 sha1: a8c84f5997950fd7d008204839253291d52e6eda owner: scheduled_rishabh@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 7954 sha1: a8c84f5997950fd7d008204839253291d52e6eda sleep_before_teardown: 0 subset: 364/512 suite: fs suite_branch: wip-rishabh-testing-20240416.193735 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a8c84f5997950fd7d008204839253291d52e6eda syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi090.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5Cj+mtvOPieUGE7GbcpFhhFOv1qvqSu8tfaDquPmMItF8xlUzjJqlzKugveSdw6p3a4kBvuUxC0sbz24f4qDE= smithi175.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUF9EsH1y9jeXNWrwI8tkgnBHSs7KpHjr5adpGfSye0sD169iuzklP5EtfdByu7mUlrODHc38Vku1jvBHkKyss= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - mds_thrash: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-20_09:50:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-20T10:45:46.076 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa; will attempt to use it 2024-04-20T10:45:46.077 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks 2024-04-20T10:45:46.077 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-20T10:45:46.079 INFO:teuthology.task.internal:Checking packages... 2024-04-20T10:45:46.102 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a8c84f5997950fd7d008204839253291d52e6eda' 2024-04-20T10:45:46.102 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-20T10:45:46.102 INFO:teuthology.packaging:ref: None 2024-04-20T10:45:46.102 INFO:teuthology.packaging:tag: None 2024-04-20T10:45:46.102 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240416.193735 2024-04-20T10:45:46.102 INFO:teuthology.packaging:sha1: a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:45:46.102 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240416.193735 2024-04-20T10:45:46.324 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3133.ga8c84f59 2024-04-20T10:45:46.325 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-20T10:45:46.333 INFO:teuthology.task.internal:no buildpackages task found 2024-04-20T10:45:46.333 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-20T10:45:46.350 INFO:teuthology.task.internal:Saving configuration 2024-04-20T10:45:46.370 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-20T10:45:46.377 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-20T10:45:46.401 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi090.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 10:40:08.893932', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5Cj+mtvOPieUGE7GbcpFhhFOv1qvqSu8tfaDquPmMItF8xlUzjJqlzKugveSdw6p3a4kBvuUxC0sbz24f4qDE='} 2024-04-20T10:45:46.421 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi175.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-20 10:40:08.895752', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUF9EsH1y9jeXNWrwI8tkgnBHSs7KpHjr5adpGfSye0sD169iuzklP5EtfdByu7mUlrODHc38Vku1jvBHkKyss='} 2024-04-20T10:45:46.421 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-20T10:45:46.429 INFO:teuthology.task.internal:roles: ubuntu@smithi090.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-20T10:45:46.429 INFO:teuthology.task.internal:roles: ubuntu@smithi175.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-04-20T10:45:46.429 INFO:teuthology.run_tasks:Running task console_log... 2024-04-20T10:45:46.502 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f6b81b59160>, signals=[15]) 2024-04-20T10:45:46.503 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-20T10:45:46.510 INFO:teuthology.task.internal:Opening connections... 2024-04-20T10:45:46.510 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T10:45:46.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T10:45:46.591 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T10:45:46.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T10:45:46.667 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-20T10:45:46.675 DEBUG:teuthology.orchestra.run.smithi090:> uname -m 2024-04-20T10:45:46.692 INFO:teuthology.orchestra.run.smithi090.stdout:x86_64 2024-04-20T10:45:46.693 DEBUG:teuthology.orchestra.run.smithi090:> cat /etc/os-release 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:NAME="CentOS Stream" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION="9" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:ID="centos" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:ID_LIKE="rhel fedora" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:VERSION_ID="9" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:PLATFORM_ID="platform:el9" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:ANSI_COLOR="0;31" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:LOGO="fedora-logo-icon" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:HOME_URL="https://centos.org/" 2024-04-20T10:45:46.749 INFO:teuthology.orchestra.run.smithi090.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T10:45:46.750 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T10:45:46.750 INFO:teuthology.orchestra.run.smithi090.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T10:45:46.750 INFO:teuthology.lock.ops:Updating smithi090.front.sepia.ceph.com on lock server 2024-04-20T10:45:46.779 DEBUG:teuthology.orchestra.run.smithi175:> uname -m 2024-04-20T10:45:46.797 INFO:teuthology.orchestra.run.smithi175.stdout:x86_64 2024-04-20T10:45:46.797 DEBUG:teuthology.orchestra.run.smithi175:> cat /etc/os-release 2024-04-20T10:45:46.853 INFO:teuthology.orchestra.run.smithi175.stdout:NAME="CentOS Stream" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION="9" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:ID="centos" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:ID_LIKE="rhel fedora" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:VERSION_ID="9" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:PLATFORM_ID="platform:el9" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:ANSI_COLOR="0;31" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:LOGO="fedora-logo-icon" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:HOME_URL="https://centos.org/" 2024-04-20T10:45:46.854 INFO:teuthology.orchestra.run.smithi175.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-20T10:45:46.855 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-20T10:45:46.855 INFO:teuthology.orchestra.run.smithi175.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-20T10:45:46.855 INFO:teuthology.lock.ops:Updating smithi175.front.sepia.ceph.com on lock server 2024-04-20T10:45:46.879 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-20T10:45:46.890 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-20T10:45:46.898 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-20T10:45:46.899 DEBUG:teuthology.orchestra.run.smithi090:> test '!' -e /home/ubuntu/cephtest 2024-04-20T10:45:46.902 DEBUG:teuthology.orchestra.run.smithi175:> test '!' -e /home/ubuntu/cephtest 2024-04-20T10:45:46.919 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-20T10:45:46.927 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-20T10:45:46.928 DEBUG:teuthology.orchestra.run.smithi090:> test -z $(ls -A /var/lib/ceph) 2024-04-20T10:45:46.959 DEBUG:teuthology.orchestra.run.smithi175:> test -z $(ls -A /var/lib/ceph) 2024-04-20T10:45:47.070 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-20T10:45:47.132 INFO:teuthology.run_tasks:Running task kernel... 2024-04-20T10:45:47.155 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'} 2024-04-20T10:45:47.155 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}} 2024-04-20T10:45:47.155 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-04-20T10:45:47.156 DEBUG:teuthology.orchestra.run.smithi090:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T10:45:47.157 DEBUG:teuthology.orchestra.run.smithi175:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-20T10:45:47.173 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T10:45:47.174 DEBUG:teuthology.orchestra.run.smithi090:> uname -r 2024-04-20T10:45:47.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T10:45:47.175 DEBUG:teuthology.orchestra.run.smithi175:> uname -r 2024-04-20T10:45:47.231 INFO:teuthology.orchestra.run.smithi090.stdout:5.14.0-437.el9.x86_64 2024-04-20T10:45:47.232 INFO:teuthology.task.kernel:Running kernel on smithi090: 5.14.0-437.el9.x86_64 2024-04-20T10:45:47.232 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum install -y kernel 2024-04-20T10:45:47.233 INFO:teuthology.orchestra.run.smithi175.stdout:5.14.0-437.el9.x86_64 2024-04-20T10:45:47.234 INFO:teuthology.task.kernel:Running kernel on smithi175: 5.14.0-437.el9.x86_64 2024-04-20T10:45:47.234 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum install -y kernel 2024-04-20T10:45:49.701 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-04-20T10:45:49.769 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-20T10:45:51.487 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-04-20T10:45:51.527 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-20T10:45:55.489 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-20T10:45:56.002 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 7.2 MB/s | 6.2 MB 00:00 2024-04-20T10:45:57.578 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 16 kB 00:00 2024-04-20T10:45:57.807 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-04-20T10:45:58.990 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-20T10:45:59.000 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-04-20T10:46:03.976 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-20T10:46:04.071 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-20T10:46:05.907 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-20T10:46:05.907 INFO:teuthology.orchestra.run.smithi090.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-20T10:46:06.010 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-20T10:46:06.010 INFO:teuthology.orchestra.run.smithi175.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-20T10:46:06.014 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-04-20T10:46:06.015 INFO:teuthology.orchestra.run.smithi090.stdout:Nothing to do. 2024-04-20T10:46:06.015 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-04-20T10:46:06.113 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-20T10:46:06.114 INFO:teuthology.orchestra.run.smithi175.stdout:Nothing to do. 2024-04-20T10:46:06.114 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-20T10:46:06.117 DEBUG:teuthology.orchestra.run.smithi090:> echo no | sudo yum reinstall kernel || true 2024-04-20T10:46:06.234 DEBUG:teuthology.orchestra.run.smithi175:> echo no | sudo yum reinstall kernel || true 2024-04-20T10:46:06.616 INFO:teuthology.orchestra.run.smithi090.stdout:Last metadata expiration check: 0:00:03 ago on Sat 20 Apr 2024 10:46:03 AM UTC. 2024-04-20T10:46:06.736 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:02 ago on Sat 20 Apr 2024 10:46:04 AM UTC. 2024-04-20T10:46:06.773 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-04-20T10:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-04-20T10:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout: Package Architecture Version Repository Size 2024-04-20T10:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-04-20T10:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout:Reinstalling: 2024-04-20T10:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-20T10:46:06.791 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-04-20T10:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-04-20T10:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 255 k 2024-04-20T10:46:06.792 INFO:teuthology.orchestra.run.smithi090.stdout:Installed size: 0 2024-04-20T10:46:06.792 INFO:teuthology.orchestra.run.smithi090.stderr:Operation aborted. 2024-04-20T10:46:06.856 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-20T10:46:06.875 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-20T10:46:06.875 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 255 k 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-04-20T10:46:06.876 INFO:teuthology.orchestra.run.smithi175.stderr:Operation aborted. 2024-04-20T10:46:06.877 INFO:teuthology.orchestra.run.smithi090.stdout:Is this ok [y/N]: 2024-04-20T10:46:06.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum reinstall -y kernel || true 2024-04-20T10:46:06.937 INFO:teuthology.orchestra.run.smithi175.stdout:Is this ok [y/N]: 2024-04-20T10:46:06.938 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum reinstall -y kernel || true 2024-04-20T10:46:07.367 INFO:teuthology.orchestra.run.smithi090.stdout:Last metadata expiration check: 0:00:04 ago on Sat 20 Apr 2024 10:46:03 AM UTC. 2024-04-20T10:46:07.434 INFO:teuthology.orchestra.run.smithi175.stdout:Last metadata expiration check: 0:00:03 ago on Sat 20 Apr 2024 10:46:04 AM UTC. 2024-04-20T10:46:07.482 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-04-20T10:46:07.482 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout: Package Architecture Version Repository Size 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout:Reinstalling: 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout:================================================================================ 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 255 k 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout:Installed size: 0 2024-04-20T10:46:07.483 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-04-20T10:46:07.550 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout: Package Architecture Version Repository Size 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalling: 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-20T10:46:07.551 INFO:teuthology.orchestra.run.smithi175.stdout:================================================================================ 2024-04-20T10:46:07.552 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:46:07.552 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 255 k 2024-04-20T10:46:07.552 INFO:teuthology.orchestra.run.smithi175.stdout:Installed size: 0 2024-04-20T10:46:07.552 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-20T10:46:07.772 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-437.el9.x86_64.rpm 2.6 MB/s | 255 kB 00:00 2024-04-20T10:46:07.772 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-20T10:46:07.772 INFO:teuthology.orchestra.run.smithi175.stdout:Total 1.1 MB/s | 255 kB 00:00 2024-04-20T10:46:07.794 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-20T10:46:07.837 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-437.el9.x86_64.rpm 1.0 MB/s | 255 kB 00:00 2024-04-20T10:46:07.837 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-04-20T10:46:07.837 INFO:teuthology.orchestra.run.smithi090.stdout:Total 720 kB/s | 255 kB 00:00 2024-04-20T10:46:07.856 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-04-20T10:46:07.985 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-20T10:46:07.985 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-20T10:46:07.990 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-20T10:46:07.991 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-20T10:46:08.059 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-04-20T10:46:08.059 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-04-20T10:46:08.064 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-04-20T10:46:08.064 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-04-20T10:46:08.126 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-20T10:46:08.189 INFO:teuthology.orchestra.run.smithi175.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-20T10:46:08.190 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T10:46:08.196 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-04-20T10:46:08.271 INFO:teuthology.orchestra.run.smithi090.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-20T10:46:08.272 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T10:46:08.801 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T10:46:08.801 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-20T10:46:09.218 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T10:46:09.219 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-20T10:46:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T10:46:09.453 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:46:09.454 INFO:teuthology.orchestra.run.smithi175.stdout:Reinstalled: 2024-04-20T10:46:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-20T10:46:09.454 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:46:09.454 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-20T10:46:09.625 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q kernel | sort -rV | head -n 1 2024-04-20T10:46:09.672 INFO:teuthology.orchestra.run.smithi175.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-20T10:46:09.672 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-20T10:46:09.672 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-20T10:46:09.672 DEBUG:teuthology.parallel:result is None 2024-04-20T10:46:10.005 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-20T10:46:10.005 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:46:10.005 INFO:teuthology.orchestra.run.smithi090.stdout:Reinstalled: 2024-04-20T10:46:10.005 INFO:teuthology.orchestra.run.smithi090.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-20T10:46:10.005 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:46:10.005 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-04-20T10:46:10.233 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q kernel | sort -rV | head -n 1 2024-04-20T10:46:10.279 INFO:teuthology.orchestra.run.smithi090.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-20T10:46:10.279 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-20T10:46:10.279 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-20T10:46:10.279 DEBUG:teuthology.parallel:result is None 2024-04-20T10:46:10.279 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-20T10:46:10.286 INFO:teuthology.task.internal:Creating test directory... 2024-04-20T10:46:10.287 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T10:46:10.289 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-20T10:46:10.304 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-20T10:46:10.313 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-20T10:46:10.321 INFO:teuthology.task.internal:Creating archive directory... 2024-04-20T10:46:10.322 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T10:46:10.344 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-20T10:46:10.369 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-20T10:46:10.376 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-20T10:46:10.376 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T10:46:10.407 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-20T10:46:10.437 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T10:46:10.444 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T10:46:10.450 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T10:46:10.468 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-20T10:46:10.469 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-20T10:46:10.477 INFO:teuthology.task.internal:Configuring sudo... 2024-04-20T10:46:10.477 DEBUG:teuthology.orchestra.run.smithi090:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T10:46:10.494 DEBUG:teuthology.orchestra.run.smithi175:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-20T10:46:10.533 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-20T10:46:10.544 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-20T10:46:10.545 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T10:46:10.557 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-20T10:46:10.588 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T10:46:10.649 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T10:46:10.700 DEBUG:teuthology.orchestra.run.smithi090:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T10:46:10.780 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T10:46:10.821 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:46:10.821 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T10:46:10.884 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T10:46:10.927 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-20T10:46:10.972 DEBUG:teuthology.orchestra.run.smithi175:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T10:46:11.046 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-20T10:46:11.091 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:46:11.091 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-20T10:46:11.154 DEBUG:teuthology.orchestra.run.smithi090:> sudo service rsyslog restart 2024-04-20T10:46:11.156 DEBUG:teuthology.orchestra.run.smithi175:> sudo service rsyslog restart 2024-04-20T10:46:11.190 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T10:46:11.244 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T10:46:11.618 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-20T10:46:11.627 INFO:teuthology.task.internal:Starting timer... 2024-04-20T10:46:11.627 INFO:teuthology.run_tasks:Running task pcp... 2024-04-20T10:46:11.727 INFO:teuthology.run_tasks:Running task selinux... 2024-04-20T10:46:11.737 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-04-20T10:46:11.737 DEBUG:teuthology.orchestra.run.smithi090:> sudo service auditd rotate 2024-04-20T10:46:11.795 INFO:teuthology.orchestra.run.smithi090.stdout:Rotating logs: 2024-04-20T10:46:11.796 DEBUG:teuthology.orchestra.run.smithi175:> sudo service auditd rotate 2024-04-20T10:46:11.836 INFO:teuthology.orchestra.run.smithi175.stdout:Rotating logs: 2024-04-20T10:46:11.838 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-20T10:46:11.838 DEBUG:teuthology.orchestra.run.smithi090:> /usr/sbin/getenforce 2024-04-20T10:46:11.866 INFO:teuthology.orchestra.run.smithi090.stdout:Permissive 2024-04-20T10:46:11.867 DEBUG:teuthology.orchestra.run.smithi175:> /usr/sbin/getenforce 2024-04-20T10:46:11.901 INFO:teuthology.orchestra.run.smithi175.stdout:Permissive 2024-04-20T10:46:11.901 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi090.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi175.front.sepia.ceph.com': 'permissive'} 2024-04-20T10:46:11.901 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T10:46:11.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T10:46:11.931 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T10:46:11.964 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T10:46:11.965 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-20T10:46:11.965 DEBUG:teuthology.orchestra.run.smithi090:> sudo /usr/sbin/setenforce permissive 2024-04-20T10:46:11.994 DEBUG:teuthology.orchestra.run.smithi175:> sudo /usr/sbin/setenforce permissive 2024-04-20T10:46:12.028 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-20T10:46:12.038 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-20T10:46:12.045 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-20T10:46:12.171 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-20T10:46:12.188 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-20T10:46:12.190 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi090.front.sepia.ceph.com,smithi175.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-20T10:47:53.844 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi090.front.sepia.ceph.com'), Remote(name='ubuntu@smithi175.front.sepia.ceph.com')] 2024-04-20T10:47:53.846 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-20T10:47:53.847 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi090.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T10:47:53.920 DEBUG:teuthology.orchestra.run.smithi090:> true 2024-04-20T10:47:54.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi090.front.sepia.ceph.com' 2024-04-20T10:47:54.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-20T10:47:54.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi175.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-20T10:47:54.073 DEBUG:teuthology.orchestra.run.smithi175:> true 2024-04-20T10:47:54.153 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi175.front.sepia.ceph.com' 2024-04-20T10:47:54.153 INFO:teuthology.run_tasks:Running task clock... 2024-04-20T10:47:54.164 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-20T10:47:54.165 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T10:47:54.165 DEBUG:teuthology.orchestra.run.smithi090:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T10:47:54.167 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-20T10:47:54.168 DEBUG:teuthology.orchestra.run.smithi175:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T10:47:54.191 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T10:47:54.204 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T10:47:54.221 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-20T10:47:54.226 INFO:teuthology.orchestra.run.smithi090.stderr:sudo: ntpd: command not found 2024-04-20T10:47:54.234 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-20T10:47:54.236 INFO:teuthology.orchestra.run.smithi090.stdout:506 Cannot talk to daemon 2024-04-20T10:47:54.249 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T10:47:54.257 INFO:teuthology.orchestra.run.smithi175.stderr:sudo: ntpd: command not found 2024-04-20T10:47:54.262 INFO:teuthology.orchestra.run.smithi090.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T10:47:54.267 INFO:teuthology.orchestra.run.smithi175.stdout:506 Cannot talk to daemon 2024-04-20T10:47:54.280 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-20T10:47:54.293 INFO:teuthology.orchestra.run.smithi175.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-20T10:47:54.315 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-04-20T10:47:54.319 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T10:47:54.319 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-04-20T10:47:54.319 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.319 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.319 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.319 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.346 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-20T10:47:54.349 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T10:47:54.349 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-20T10:47:54.349 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.350 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.350 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.350 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T10:47:54.351 INFO:teuthology.run_tasks:Running task install... 2024-04-20T10:47:54.359 DEBUG:teuthology.task.install:project ceph 2024-04-20T10:47:54.359 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}} 2024-04-20T10:47:54.359 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'} 2024-04-20T10:47:54.359 INFO:teuthology.task.install:Using flavor: default 2024-04-20T10:47:54.365 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-20T10:47:54.365 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-20T10:47:54.365 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T10:47:54.366 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:47:54.368 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'tag': None, 'wait_for_package': False} 2024-04-20T10:47:54.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:47:54.512 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-20T10:47:54.513 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-20T10:47:54.586 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/ 2024-04-20T10:47:54.587 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3133.ga8c84f59 2024-04-20T10:47:54.786 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T10:47:54.786 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:47:54.786 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T10:47:54.811 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-20T10:47:54.812 DEBUG:teuthology.orchestra.run.smithi090:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T10:47:54.875 DEBUG:teuthology.orchestra.run.smithi090:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T10:47:54.924 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240416.193735/a8c84f5997950fd7d008204839253291d52e6eda/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-20T10:47:54.924 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:47:54.924 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-20T10:47:54.948 DEBUG:teuthology.orchestra.run.smithi090:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T10:47:54.950 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-20T10:47:54.950 DEBUG:teuthology.orchestra.run.smithi175:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a8c84f5997950fd7d008204839253291d52e6eda/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-20T10:47:55.011 INFO:teuthology.orchestra.run.smithi090.stdout:check_obsoletes = 1 2024-04-20T10:47:55.013 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum clean all 2024-04-20T10:47:55.015 DEBUG:teuthology.orchestra.run.smithi175:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-20T10:47:55.089 DEBUG:teuthology.orchestra.run.smithi175:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-20T10:47:55.153 INFO:teuthology.orchestra.run.smithi175.stdout:check_obsoletes = 1 2024-04-20T10:47:55.155 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum clean all 2024-04-20T10:47:55.236 INFO:teuthology.orchestra.run.smithi090.stdout:48 files removed 2024-04-20T10:47:55.263 DEBUG:teuthology.orchestra.run.smithi090:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-20T10:47:55.381 INFO:teuthology.orchestra.run.smithi175.stdout:48 files removed 2024-04-20T10:47:55.408 DEBUG:teuthology.orchestra.run.smithi175:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-20T10:47:56.380 INFO:teuthology.orchestra.run.smithi090.stdout:ceph packages for x86_64 97 kB/s | 84 kB 00:00 2024-04-20T10:47:56.508 INFO:teuthology.orchestra.run.smithi175.stdout:ceph packages for x86_64 99 kB/s | 84 kB 00:00 2024-04-20T10:47:57.214 INFO:teuthology.orchestra.run.smithi090.stdout:ceph noarch packages 15 kB/s | 12 kB 00:00 2024-04-20T10:47:57.308 INFO:teuthology.orchestra.run.smithi175.stdout:ceph noarch packages 15 kB/s | 12 kB 00:00 2024-04-20T10:47:57.998 INFO:teuthology.orchestra.run.smithi090.stdout:ceph source packages 2.5 kB/s | 1.9 kB 00:00 2024-04-20T10:47:58.050 INFO:teuthology.orchestra.run.smithi175.stdout:ceph source packages 2.7 kB/s | 1.9 kB 00:00 2024-04-20T10:47:58.617 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.0 MB 00:00 2024-04-20T10:47:59.673 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.0 MB 00:01 2024-04-20T10:48:00.452 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-04-20T10:48:02.356 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-04-20T10:48:05.269 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - CRB 4.6 MB/s | 6.2 MB 00:01 2024-04-20T10:48:06.534 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.2 MB 00:00 2024-04-20T10:48:07.719 INFO:teuthology.orchestra.run.smithi175.stdout:CentOS Stream 9 - Extras packages 12 kB/s | 16 kB 00:01 2024-04-20T10:48:07.987 INFO:teuthology.orchestra.run.smithi090.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-20T10:48:09.666 INFO:teuthology.orchestra.run.smithi090.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-20T10:48:09.823 INFO:teuthology.orchestra.run.smithi175.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:01 2024-04-20T10:48:14.731 INFO:teuthology.orchestra.run.smithi090.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-04-20T10:48:14.778 INFO:teuthology.orchestra.run.smithi175.stdout:lab-extras 22 kB/s | 1.7 kB 00:00 2024-04-20T10:48:16.899 INFO:teuthology.orchestra.run.smithi090.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T10:48:16.900 INFO:teuthology.orchestra.run.smithi090.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T10:48:16.910 INFO:teuthology.orchestra.run.smithi090.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-20T10:48:16.911 INFO:teuthology.orchestra.run.smithi090.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-20T10:48:16.912 INFO:teuthology.orchestra.run.smithi090.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T10:48:16.913 INFO:teuthology.orchestra.run.smithi090.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T10:48:16.914 INFO:teuthology.orchestra.run.smithi090.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T10:48:16.916 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-20T10:48:16.917 INFO:teuthology.orchestra.run.smithi090.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T10:48:16.945 INFO:teuthology.orchestra.run.smithi175.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T10:48:16.946 INFO:teuthology.orchestra.run.smithi175.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-20T10:48:16.957 INFO:teuthology.orchestra.run.smithi175.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-20T10:48:16.958 INFO:teuthology.orchestra.run.smithi175.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-20T10:48:16.959 INFO:teuthology.orchestra.run.smithi175.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-20T10:48:16.960 INFO:teuthology.orchestra.run.smithi175.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-20T10:48:16.961 INFO:teuthology.orchestra.run.smithi175.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-20T10:48:16.964 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-20T10:48:16.964 INFO:teuthology.orchestra.run.smithi175.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-20T10:48:16.975 INFO:teuthology.orchestra.run.smithi090.stdout:Dependencies resolved. 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: Package Arch Version Repository Size 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout:Installing: 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-20T10:48:16.985 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-20T10:48:16.986 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-20T10:48:16.987 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrading: 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout:Installing dependencies: 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T10:48:16.988 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T10:48:16.989 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T10:48:16.990 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T10:48:16.991 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T10:48:16.992 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T10:48:16.993 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T10:48:16.994 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T10:48:16.995 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout:Installing weak dependencies: 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-20T10:48:16.996 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:48:16.997 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction Summary 2024-04-20T10:48:16.997 INFO:teuthology.orchestra.run.smithi090.stdout:======================================================================================= 2024-04-20T10:48:16.997 INFO:teuthology.orchestra.run.smithi090.stdout:Install 148 Packages 2024-04-20T10:48:16.997 INFO:teuthology.orchestra.run.smithi090.stdout:Upgrade 2 Packages 2024-04-20T10:48:16.997 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:48:16.997 INFO:teuthology.orchestra.run.smithi090.stdout:Total download size: 218 M 2024-04-20T10:48:16.997 INFO:teuthology.orchestra.run.smithi090.stdout:Downloading Packages: 2024-04-20T10:48:17.024 INFO:teuthology.orchestra.run.smithi175.stdout:Dependencies resolved. 2024-04-20T10:48:17.033 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-20T10:48:17.033 INFO:teuthology.orchestra.run.smithi175.stdout: Package Arch Version Repository Size 2024-04-20T10:48:17.033 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-20T10:48:17.033 INFO:teuthology.orchestra.run.smithi175.stdout:Installing: 2024-04-20T10:48:17.033 INFO:teuthology.orchestra.run.smithi175.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-20T10:48:17.033 INFO:teuthology.orchestra.run.smithi175.stdout: ceph x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 6.6 k 2024-04-20T10:48:17.033 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 893 k 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 145 k 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 1.5 M 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 142 k 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 3.5 M 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 7.4 M 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 49 k 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 11 M 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 49 M 2024-04-20T10:48:17.034 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 273 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 763 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 225 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 27 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 18 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 32 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 748 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 126 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-20T10:48:17.035 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 162 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 321 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 299 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 99 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 85 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 170 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrading: 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: librados2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.4 M 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 3.1 M 2024-04-20T10:48:17.036 INFO:teuthology.orchestra.run.smithi175.stdout:Installing dependencies: 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 21 M 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 34 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 2.4 M 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 249 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 4.7 M 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 17 M 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3133.ga8c84f59.el9 ceph-noarch 16 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 25 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-20T10:48:17.037 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 163 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 501 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-20T10:48:17.038 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2 x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 5.4 M 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-20T10:48:17.039 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 45 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common x86_64 2:19.0.0-3133.ga8c84f59.el9 ceph 135 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-20T10:48:17.040 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-20T10:48:17.041 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-20T10:48:17.042 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-20T10:48:17.043 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-20T10:48:17.044 INFO:teuthology.orchestra.run.smithi175.stdout:Installing weak dependencies: 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction Summary 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout:======================================================================================= 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout:Install 148 Packages 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout:Upgrade 2 Packages 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:48:17.045 INFO:teuthology.orchestra.run.smithi175.stdout:Total download size: 218 M 2024-04-20T10:48:17.046 INFO:teuthology.orchestra.run.smithi175.stdout:Downloading Packages: 2024-04-20T10:48:17.771 INFO:teuthology.orchestra.run.smithi175.stdout:(1/150): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-04-20T10:48:18.041 INFO:teuthology.orchestra.run.smithi090.stdout:(1/150): ceph-19.0.0-3133.ga8c84f59.el9.x86_64. 23 kB/s | 6.6 kB 00:00 2024-04-20T10:48:18.188 INFO:teuthology.orchestra.run.smithi175.stdout:(2/150): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 9.3 MB/s | 5.4 MB 00:00 2024-04-20T10:48:18.213 INFO:teuthology.orchestra.run.smithi175.stdout:(3/150): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 2.0 MB/s | 893 kB 00:00 2024-04-20T10:48:18.238 INFO:teuthology.orchestra.run.smithi175.stdout:(4/150): ceph-immutable-object-cache-19.0.0-313 2.8 MB/s | 145 kB 00:00 2024-04-20T10:48:18.397 INFO:teuthology.orchestra.run.smithi175.stdout:(5/150): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 9.5 MB/s | 1.5 MB 00:00 2024-04-20T10:48:18.814 INFO:teuthology.orchestra.run.smithi175.stdout:(6/150): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 11 MB/s | 4.7 MB 00:00 2024-04-20T10:48:18.873 INFO:teuthology.orchestra.run.smithi175.stdout:(7/150): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 3.6 MB/s | 2.4 MB 00:00 2024-04-20T10:48:18.983 INFO:teuthology.orchestra.run.smithi090.stdout:(2/150): ceph-base-19.0.0-3133.ga8c84f59.el9.x8 4.4 MB/s | 5.4 MB 00:01 2024-04-20T10:48:19.067 INFO:teuthology.orchestra.run.smithi090.stdout:(3/150): ceph-immutable-object-cache-19.0.0-313 1.7 MB/s | 145 kB 00:00 2024-04-20T10:48:19.167 INFO:teuthology.orchestra.run.smithi090.stdout:(4/150): ceph-fuse-19.0.0-3133.ga8c84f59.el9.x8 793 kB/s | 893 kB 00:01 2024-04-20T10:48:19.518 INFO:teuthology.orchestra.run.smithi090.stdout:(5/150): ceph-mds-19.0.0-3133.ga8c84f59.el9.x86 5.2 MB/s | 2.4 MB 00:00 2024-04-20T10:48:20.202 INFO:teuthology.orchestra.run.smithi090.stdout:(6/150): ceph-mon-19.0.0-3133.ga8c84f59.el9.x86 6.9 MB/s | 4.7 MB 00:00 2024-04-20T10:48:20.318 INFO:teuthology.orchestra.run.smithi090.stdout:(7/150): ceph-mgr-19.0.0-3133.ga8c84f59.el9.x86 1.3 MB/s | 1.5 MB 00:01 2024-04-20T10:48:20.331 INFO:teuthology.orchestra.run.smithi175.stdout:(8/150): ceph-osd-19.0.0-3133.ga8c84f59.el9.x86 11 MB/s | 17 MB 00:01 2024-04-20T10:48:20.390 INFO:teuthology.orchestra.run.smithi175.stdout:(9/150): ceph-selinux-19.0.0-3133.ga8c84f59.el9 433 kB/s | 25 kB 00:00 2024-04-20T10:48:22.289 INFO:teuthology.orchestra.run.smithi175.stdout:(10/150): ceph-radosgw-19.0.0-3133.ga8c84f59.el 3.1 MB/s | 11 MB 00:03 2024-04-20T10:48:22.398 INFO:teuthology.orchestra.run.smithi175.stdout:(11/150): cephfs-mirror-19.0.0-3133.ga8c84f59.e 2.0 MB/s | 225 kB 00:00 2024-04-20T10:48:22.490 INFO:teuthology.orchestra.run.smithi175.stdout:(12/150): cephfs-shell-19.0.0-3133.ga8c84f59.el 295 kB/s | 27 kB 00:00 2024-04-20T10:48:22.565 INFO:teuthology.orchestra.run.smithi175.stdout:(13/150): libcephfs-devel-19.0.0-3133.ga8c84f59 423 kB/s | 32 kB 00:00 2024-04-20T10:48:22.832 INFO:teuthology.orchestra.run.smithi175.stdout:(14/150): libcephfs2-19.0.0-3133.ga8c84f59.el9. 2.7 MB/s | 748 kB 00:00 2024-04-20T10:48:22.957 INFO:teuthology.orchestra.run.smithi175.stdout:(15/150): libcephsqlite-19.0.0-3133.ga8c84f59.e 1.3 MB/s | 163 kB 00:00 2024-04-20T10:48:23.033 INFO:teuthology.orchestra.run.smithi175.stdout:(16/150): librados-devel-19.0.0-3133.ga8c84f59. 1.6 MB/s | 126 kB 00:00 2024-04-20T10:48:23.069 INFO:teuthology.orchestra.run.smithi090.stdout:(8/150): ceph-osd-19.0.0-3133.ga8c84f59.el9.x86 5.9 MB/s | 17 MB 00:02 2024-04-20T10:48:23.152 INFO:teuthology.orchestra.run.smithi090.stdout:(9/150): ceph-selinux-19.0.0-3133.ga8c84f59.el9 303 kB/s | 25 kB 00:00 2024-04-20T10:48:23.199 INFO:teuthology.orchestra.run.smithi175.stdout:(17/150): libradosstriper1-19.0.0-3133.ga8c84f5 2.9 MB/s | 501 kB 00:00 2024-04-20T10:48:23.287 INFO:teuthology.orchestra.run.smithi090.stdout:(10/150): ceph-radosgw-19.0.0-3133.ga8c84f59.el 3.6 MB/s | 11 MB 00:02 2024-04-20T10:48:23.516 INFO:teuthology.orchestra.run.smithi175.stdout:(18/150): ceph-common-19.0.0-3133.ga8c84f59.el9 3.6 MB/s | 21 MB 00:05 2024-04-20T10:48:23.567 INFO:teuthology.orchestra.run.smithi175.stdout:(19/150): python3-ceph-argparse-19.0.0-3133.ga8 911 kB/s | 45 kB 00:00 2024-04-20T10:48:23.579 INFO:teuthology.orchestra.run.smithi090.stdout:(11/150): ceph-common-19.0.0-3133.ga8c84f59.el9 3.6 MB/s | 21 MB 00:05 2024-04-20T10:48:23.604 INFO:teuthology.orchestra.run.smithi090.stdout:(12/150): cephfs-mirror-19.0.0-3133.ga8c84f59.e 709 kB/s | 225 kB 00:00 2024-04-20T10:48:23.659 INFO:teuthology.orchestra.run.smithi175.stdout:(20/150): python3-ceph-common-19.0.0-3133.ga8c8 1.4 MB/s | 135 kB 00:00 2024-04-20T10:48:23.671 INFO:teuthology.orchestra.run.smithi090.stdout:(13/150): cephfs-shell-19.0.0-3133.ga8c84f59.el 295 kB/s | 27 kB 00:00 2024-04-20T10:48:23.697 INFO:teuthology.orchestra.run.smithi090.stdout:(14/150): libcephfs-devel-19.0.0-3133.ga8c84f59 345 kB/s | 32 kB 00:00 2024-04-20T10:48:23.759 INFO:teuthology.orchestra.run.smithi175.stdout:(21/150): python3-cephfs-19.0.0-3133.ga8c84f59. 1.6 MB/s | 162 kB 00:00 2024-04-20T10:48:23.797 INFO:teuthology.orchestra.run.smithi090.stdout:(15/150): libcephsqlite-19.0.0-3133.ga8c84f59.e 1.6 MB/s | 163 kB 00:00 2024-04-20T10:48:23.847 INFO:teuthology.orchestra.run.smithi090.stdout:(16/150): libcephfs2-19.0.0-3133.ga8c84f59.el9. 4.2 MB/s | 748 kB 00:00 2024-04-20T10:48:23.889 INFO:teuthology.orchestra.run.smithi090.stdout:(17/150): librados-devel-19.0.0-3133.ga8c84f59. 1.3 MB/s | 126 kB 00:00 2024-04-20T10:48:23.934 INFO:teuthology.orchestra.run.smithi175.stdout:(22/150): python3-rados-19.0.0-3133.ga8c84f59.e 1.8 MB/s | 321 kB 00:00 2024-04-20T10:48:23.965 INFO:teuthology.orchestra.run.smithi090.stdout:(18/150): libradosstriper1-19.0.0-3133.ga8c84f5 4.2 MB/s | 501 kB 00:00 2024-04-20T10:48:24.057 INFO:teuthology.orchestra.run.smithi090.stdout:(19/150): python3-ceph-argparse-19.0.0-3133.ga8 493 kB/s | 45 kB 00:00 2024-04-20T10:48:24.059 INFO:teuthology.orchestra.run.smithi175.stdout:(23/150): python3-rbd-19.0.0-3133.ga8c84f59.el9 2.3 MB/s | 299 kB 00:00 2024-04-20T10:48:24.165 INFO:teuthology.orchestra.run.smithi090.stdout:(20/150): python3-ceph-common-19.0.0-3133.ga8c8 1.2 MB/s | 135 kB 00:00 2024-04-20T10:48:24.185 INFO:teuthology.orchestra.run.smithi175.stdout:(24/150): python3-rgw-19.0.0-3133.ga8c84f59.el9 796 kB/s | 99 kB 00:00 2024-04-20T10:48:24.249 INFO:teuthology.orchestra.run.smithi090.stdout:(21/150): python3-cephfs-19.0.0-3133.ga8c84f59. 1.9 MB/s | 162 kB 00:00 2024-04-20T10:48:24.260 INFO:teuthology.orchestra.run.smithi175.stdout:(25/150): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 1.1 MB/s | 85 kB 00:00 2024-04-20T10:48:24.350 INFO:teuthology.orchestra.run.smithi090.stdout:(22/150): python3-rados-19.0.0-3133.ga8c84f59.e 3.1 MB/s | 321 kB 00:00 2024-04-20T10:48:24.351 INFO:teuthology.orchestra.run.smithi175.stdout:(26/150): librgw2-19.0.0-3133.ga8c84f59.el9.x86 4.7 MB/s | 5.4 MB 00:01 2024-04-20T10:48:24.436 INFO:teuthology.orchestra.run.smithi175.stdout:(27/150): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 2.0 MB/s | 170 kB 00:00 2024-04-20T10:48:24.450 INFO:teuthology.orchestra.run.smithi090.stdout:(23/150): python3-rbd-19.0.0-3133.ga8c84f59.el9 2.9 MB/s | 299 kB 00:00 2024-04-20T10:48:24.494 INFO:teuthology.orchestra.run.smithi175.stdout:(28/150): ceph-grafana-dashboards-19.0.0-3133.g 589 kB/s | 34 kB 00:00 2024-04-20T10:48:24.542 INFO:teuthology.orchestra.run.smithi090.stdout:(24/150): python3-rgw-19.0.0-3133.ga8c84f59.el9 1.1 MB/s | 99 kB 00:00 2024-04-20T10:48:24.561 INFO:teuthology.orchestra.run.smithi175.stdout:(29/150): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 2.1 MB/s | 142 kB 00:00 2024-04-20T10:48:24.642 INFO:teuthology.orchestra.run.smithi090.stdout:(25/150): rbd-fuse-19.0.0-3133.ga8c84f59.el9.x8 850 kB/s | 85 kB 00:00 2024-04-20T10:48:25.017 INFO:teuthology.orchestra.run.smithi090.stdout:(26/150): librgw2-19.0.0-3133.ga8c84f59.el9.x86 4.8 MB/s | 5.4 MB 00:01 2024-04-20T10:48:25.109 INFO:teuthology.orchestra.run.smithi090.stdout:(27/150): rbd-nbd-19.0.0-3133.ga8c84f59.el9.x86 1.8 MB/s | 170 kB 00:00 2024-04-20T10:48:25.168 INFO:teuthology.orchestra.run.smithi090.stdout:(28/150): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 5.9 MB/s | 3.1 MB 00:00 2024-04-20T10:48:25.193 INFO:teuthology.orchestra.run.smithi090.stdout:(29/150): ceph-grafana-dashboards-19.0.0-3133.g 409 kB/s | 34 kB 00:00 2024-04-20T10:48:25.252 INFO:teuthology.orchestra.run.smithi090.stdout:(30/150): ceph-mgr-cephadm-19.0.0-3133.ga8c84f5 1.7 MB/s | 142 kB 00:00 2024-04-20T10:48:25.428 INFO:teuthology.orchestra.run.smithi175.stdout:(30/150): rbd-mirror-19.0.0-3133.ga8c84f59.el9. 2.6 MB/s | 3.1 MB 00:01 2024-04-20T10:48:25.495 INFO:teuthology.orchestra.run.smithi175.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3133.ga8c84 3.8 MB/s | 3.5 MB 00:00 2024-04-20T10:48:25.670 INFO:teuthology.orchestra.run.smithi175.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3133.ga8 1.4 MB/s | 249 kB 00:00 2024-04-20T10:48:25.754 INFO:teuthology.orchestra.run.smithi175.stdout:(33/150): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 593 kB/s | 49 kB 00:00 2024-04-20T10:48:25.837 INFO:teuthology.orchestra.run.smithi175.stdout:(34/150): ceph-prometheus-alerts-19.0.0-3133.ga 197 kB/s | 16 kB 00:00 2024-04-20T10:48:25.953 INFO:teuthology.orchestra.run.smithi090.stdout:(31/150): ceph-mgr-dashboard-19.0.0-3133.ga8c84 4.7 MB/s | 3.5 MB 00:00 2024-04-20T10:48:26.044 INFO:teuthology.orchestra.run.smithi090.stdout:(32/150): ceph-mgr-modules-core-19.0.0-3133.ga8 2.7 MB/s | 249 kB 00:00 2024-04-20T10:48:26.120 INFO:teuthology.orchestra.run.smithi090.stdout:(33/150): ceph-mgr-rook-19.0.0-3133.ga8c84f59.e 657 kB/s | 49 kB 00:00 2024-04-20T10:48:26.220 INFO:teuthology.orchestra.run.smithi090.stdout:(34/150): ceph-mgr-diskprediction-local-19.0.0- 7.6 MB/s | 7.4 MB 00:00 2024-04-20T10:48:26.246 INFO:teuthology.orchestra.run.smithi090.stdout:(35/150): ceph-prometheus-alerts-19.0.0-3133.ga 130 kB/s | 16 kB 00:00 2024-04-20T10:48:26.297 INFO:teuthology.orchestra.run.smithi090.stdout:(36/150): ceph-volume-19.0.0-3133.ga8c84f59.el9 3.5 MB/s | 273 kB 00:00 2024-04-20T10:48:26.346 INFO:teuthology.orchestra.run.smithi175.stdout:(35/150): ceph-test-19.0.0-3133.ga8c84f59.el9.x 8.2 MB/s | 49 MB 00:05 2024-04-20T10:48:26.371 INFO:teuthology.orchestra.run.smithi175.stdout:(36/150): ceph-volume-19.0.0-3133.ga8c84f59.el9 512 kB/s | 273 kB 00:00 2024-04-20T10:48:26.381 INFO:teuthology.orchestra.run.smithi090.stdout:(37/150): cephadm-19.0.0-3133.ga8c84f59.el9.noa 5.6 MB/s | 763 kB 00:00 2024-04-20T10:48:26.406 INFO:teuthology.orchestra.run.smithi090.stdout:(38/150): cephfs-top-19.0.0-3133.ga8c84f59.el9. 168 kB/s | 18 kB 00:00 2024-04-20T10:48:26.421 INFO:teuthology.orchestra.run.smithi175.stdout:(37/150): cephfs-top-19.0.0-3133.ga8c84f59.el9. 366 kB/s | 18 kB 00:00 2024-04-20T10:48:26.455 INFO:teuthology.orchestra.run.smithi175.stdout:(38/150): cephadm-19.0.0-3133.ga8c84f59.el9.noa 6.9 MB/s | 763 kB 00:00 2024-04-20T10:48:26.547 INFO:teuthology.orchestra.run.smithi175.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 643 kB/s | 80 kB 00:00 2024-04-20T10:48:26.622 INFO:teuthology.orchestra.run.smithi175.stdout:(40/150): libgfortran-11.4.1-3.el9.x86_64.rpm 4.7 MB/s | 803 kB 00:00 2024-04-20T10:48:26.647 INFO:teuthology.orchestra.run.smithi175.stdout:(41/150): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-04-20T10:48:26.673 INFO:teuthology.orchestra.run.smithi175.stdout:(42/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-04-20T10:48:26.715 INFO:teuthology.orchestra.run.smithi175.stdout:(43/150): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-04-20T10:48:26.740 INFO:teuthology.orchestra.run.smithi175.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-04-20T10:48:26.765 INFO:teuthology.orchestra.run.smithi175.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-20T10:48:26.791 INFO:teuthology.orchestra.run.smithi175.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-20T10:48:26.816 INFO:teuthology.orchestra.run.smithi175.stdout:(47/150): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-20T10:48:26.983 INFO:teuthology.orchestra.run.smithi175.stdout:(48/150): automake-1.16.2-8.el9.noarch.rpm 3.5 MB/s | 689 kB 00:00 2024-04-20T10:48:27.033 INFO:teuthology.orchestra.run.smithi175.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 4.3 MB/s | 943 kB 00:00 2024-04-20T10:48:27.058 INFO:teuthology.orchestra.run.smithi175.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 1.4 MB/s | 107 kB 00:00 2024-04-20T10:48:27.083 INFO:teuthology.orchestra.run.smithi175.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-04-20T10:48:27.123 INFO:teuthology.orchestra.run.smithi090.stdout:(39/150): fuse-2.9.9-15.el9.x86_64.rpm 108 kB/s | 80 kB 00:00 2024-04-20T10:48:27.175 INFO:teuthology.orchestra.run.smithi175.stdout:(52/150): ceph-mgr-diskprediction-local-19.0.0- 4.2 MB/s | 7.4 MB 00:01 2024-04-20T10:48:27.201 INFO:teuthology.orchestra.run.smithi175.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 2.2 MB/s | 313 kB 00:00 2024-04-20T10:48:27.226 INFO:teuthology.orchestra.run.smithi175.stdout:(54/150): flexiblas-3.0.4-8.el9.x86_64.rpm 230 kB/s | 33 kB 00:00 2024-04-20T10:48:27.267 INFO:teuthology.orchestra.run.smithi175.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 269 kB/s | 11 kB 00:00 2024-04-20T10:48:27.293 INFO:teuthology.orchestra.run.smithi175.stdout:(56/150): flexiblas-openblas-openmp-3.0.4-8.el9 198 kB/s | 18 kB 00:00 2024-04-20T10:48:27.318 INFO:teuthology.orchestra.run.smithi175.stdout:(57/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-20T10:48:27.377 INFO:teuthology.orchestra.run.smithi175.stdout:(58/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-04-20T10:48:27.402 INFO:teuthology.orchestra.run.smithi175.stdout:(59/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-04-20T10:48:27.436 INFO:teuthology.orchestra.run.smithi175.stdout:(60/150): libtool-2.4.6-45.el9.x86_64.rpm 9.7 MB/s | 582 kB 00:00 2024-04-20T10:48:27.470 INFO:teuthology.orchestra.run.smithi175.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 379 kB/s | 25 kB 00:00 2024-04-20T10:48:27.495 INFO:teuthology.orchestra.run.smithi175.stdout:(62/150): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-04-20T10:48:27.520 INFO:teuthology.orchestra.run.smithi175.stdout:(63/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 565 kB/s | 47 kB 00:00 2024-04-20T10:48:27.545 INFO:teuthology.orchestra.run.smithi175.stdout:(64/150): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-20T10:48:27.562 INFO:teuthology.orchestra.run.smithi175.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 846 kB/s | 35 kB 00:00 2024-04-20T10:48:27.587 INFO:teuthology.orchestra.run.smithi175.stdout:(66/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-04-20T10:48:27.713 INFO:teuthology.orchestra.run.smithi175.stdout:(67/150): openblas-openmp-0.3.21-2.el9.x86_64.r 28 MB/s | 4.7 MB 00:00 2024-04-20T10:48:27.754 INFO:teuthology.orchestra.run.smithi175.stdout:(68/150): postgresql-13.14-1.el9.x86_64.rpm 9.5 MB/s | 1.6 MB 00:00 2024-04-20T10:48:27.855 INFO:teuthology.orchestra.run.smithi175.stdout:(69/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 14 MB/s | 4.1 MB 00:00 2024-04-20T10:48:27.897 INFO:teuthology.orchestra.run.smithi175.stdout:(70/150): postgresql-private-libs-13.14-1.el9.x 940 kB/s | 133 kB 00:00 2024-04-20T10:48:27.939 INFO:teuthology.orchestra.run.smithi175.stdout:(71/150): postgresql-contrib-13.14-1.el9.x86_64 3.9 MB/s | 911 kB 00:00 2024-04-20T10:48:28.007 INFO:teuthology.orchestra.run.smithi175.stdout:(72/150): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-04-20T10:48:28.031 INFO:teuthology.orchestra.run.smithi175.stdout:(73/150): python3-attrs-20.3.0-7.el9.noarch.rpm 954 kB/s | 87 kB 00:00 2024-04-20T10:48:28.040 INFO:teuthology.orchestra.run.smithi090.stdout:(40/150): libquadmath-11.4.1-3.el9.x86_64.rpm 213 kB/s | 195 kB 00:00 2024-04-20T10:48:28.074 INFO:teuthology.orchestra.run.smithi090.stdout:(41/150): libgfortran-11.4.1-3.el9.x86_64.rpm 482 kB/s | 803 kB 00:01 2024-04-20T10:48:28.106 INFO:teuthology.orchestra.run.smithi175.stdout:(74/150): postgresql-server-13.14-1.el9.x86_64. 23 MB/s | 5.8 MB 00:00 2024-04-20T10:48:28.132 INFO:teuthology.orchestra.run.smithi175.stdout:(75/150): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-04-20T10:48:28.157 INFO:teuthology.orchestra.run.smithi175.stdout:(76/150): python3-jinja2-2.11.3-5.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-04-20T10:48:28.182 INFO:teuthology.orchestra.run.smithi175.stdout:(77/150): python3-jsonpatch-1.21-16.el9.noarch. 513 kB/s | 26 kB 00:00 2024-04-20T10:48:28.207 INFO:teuthology.orchestra.run.smithi175.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-20T10:48:28.232 INFO:teuthology.orchestra.run.smithi175.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-04-20T10:48:28.258 INFO:teuthology.orchestra.run.smithi175.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-04-20T10:48:28.317 INFO:teuthology.orchestra.run.smithi175.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-04-20T10:48:28.392 INFO:teuthology.orchestra.run.smithi175.stdout:(82/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-04-20T10:48:28.467 INFO:teuthology.orchestra.run.smithi175.stdout:(83/150): python3-babel-2.9.1-2.el9.noarch.rpm 13 MB/s | 6.0 MB 00:00 2024-04-20T10:48:28.492 INFO:teuthology.orchestra.run.smithi175.stdout:(84/150): python3-packaging-20.9-5.el9.noarch.r 771 kB/s | 77 kB 00:00 2024-04-20T10:48:28.517 INFO:teuthology.orchestra.run.smithi175.stdout:(85/150): python3-prettytable-0.7.2-27.el9.noar 844 kB/s | 42 kB 00:00 2024-04-20T10:48:28.543 INFO:teuthology.orchestra.run.smithi175.stdout:(86/150): python3-oauthlib-3.1.1-5.el9.noarch.r 983 kB/s | 222 kB 00:00 2024-04-20T10:48:28.568 INFO:teuthology.orchestra.run.smithi175.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-04-20T10:48:28.593 INFO:teuthology.orchestra.run.smithi175.stdout:(88/150): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 269 kB 00:00 2024-04-20T10:48:28.618 INFO:teuthology.orchestra.run.smithi175.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-20T10:48:28.644 INFO:teuthology.orchestra.run.smithi175.stdout:(90/150): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-04-20T10:48:28.679 INFO:teuthology.orchestra.run.smithi175.stdout:(91/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.0 MB/s | 279 kB 00:00 2024-04-20T10:48:28.703 INFO:teuthology.orchestra.run.smithi175.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 708 kB/s | 42 kB 00:00 2024-04-20T10:48:28.728 INFO:teuthology.orchestra.run.smithi175.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 906 kB/s | 44 kB 00:00 2024-04-20T10:48:28.753 INFO:teuthology.orchestra.run.smithi175.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-04-20T10:48:28.779 INFO:teuthology.orchestra.run.smithi175.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 718 kB/s | 36 kB 00:00 2024-04-20T10:48:28.804 INFO:teuthology.orchestra.run.smithi175.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-04-20T10:48:28.829 INFO:teuthology.orchestra.run.smithi175.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 5.9 MB/s | 305 kB 00:00 2024-04-20T10:48:28.854 INFO:teuthology.orchestra.run.smithi175.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-04-20T10:48:28.880 INFO:teuthology.orchestra.run.smithi175.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-04-20T10:48:28.882 INFO:teuthology.orchestra.run.smithi090.stdout:(42/150): ceph-test-19.0.0-3133.ga8c84f59.el9.x 8.6 MB/s | 49 MB 00:05 2024-04-20T10:48:28.905 INFO:teuthology.orchestra.run.smithi175.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-04-20T10:48:28.930 INFO:teuthology.orchestra.run.smithi175.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 894 kB/s | 45 kB 00:00 2024-04-20T10:48:28.997 INFO:teuthology.orchestra.run.smithi175.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 242 kB/s | 22 kB 00:00 2024-04-20T10:48:29.081 INFO:teuthology.orchestra.run.smithi175.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 5.6 MB/s | 863 kB 00:00 2024-04-20T10:48:29.356 INFO:teuthology.orchestra.run.smithi175.stdout:(104/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 22 MB/s | 16 MB 00:00 2024-04-20T10:48:29.508 INFO:teuthology.orchestra.run.smithi090.stdout:(43/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 173 kB/s | 253 kB 00:01 2024-04-20T10:48:29.606 INFO:teuthology.orchestra.run.smithi175.stdout:(105/150): grpc-data-1.46.7-10.el9.noarch.rpm 78 kB/s | 19 kB 00:00 2024-04-20T10:48:29.633 INFO:teuthology.orchestra.run.smithi090.stdout:(44/150): python3-ply-3.11-14.el9.noarch.rpm 142 kB/s | 106 kB 00:00 2024-04-20T10:48:29.640 INFO:teuthology.orchestra.run.smithi175.stdout:(106/150): gperftools-libs-2.9.1-2.el9.x86_64.r 577 kB/s | 309 kB 00:00 2024-04-20T10:48:29.715 INFO:teuthology.orchestra.run.smithi175.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 346 kB/s | 26 kB 00:00 2024-04-20T10:48:29.765 INFO:teuthology.orchestra.run.smithi175.stdout:(108/150): abseil-cpp-20211102.0-3.el9.x86_64.r 714 kB/s | 548 kB 00:00 2024-04-20T10:48:29.791 INFO:teuthology.orchestra.run.smithi175.stdout:(109/150): liboath-2.6.7-2.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-04-20T10:48:29.874 INFO:teuthology.orchestra.run.smithi175.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 620 kB/s | 67 kB 00:00 2024-04-20T10:48:29.899 INFO:teuthology.orchestra.run.smithi175.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-04-20T10:48:30.033 INFO:teuthology.orchestra.run.smithi175.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-04-20T10:48:30.092 INFO:teuthology.orchestra.run.smithi175.stdout:(113/150): libarrow-9.0.0-10.el9.x86_64.rpm 9.1 MB/s | 4.4 MB 00:00 2024-04-20T10:48:30.117 INFO:teuthology.orchestra.run.smithi175.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 520 kB/s | 43 kB 00:00 2024-04-20T10:48:30.159 INFO:teuthology.orchestra.run.smithi175.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 482 kB/s | 32 kB 00:00 2024-04-20T10:48:30.184 INFO:teuthology.orchestra.run.smithi175.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 224 kB/s | 15 kB 00:00 2024-04-20T10:48:30.235 INFO:teuthology.orchestra.run.smithi175.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-20T10:48:30.268 INFO:teuthology.orchestra.run.smithi175.stdout:(118/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.1 MB/s | 838 kB 00:00 2024-04-20T10:48:30.293 INFO:teuthology.orchestra.run.smithi175.stdout:(119/150): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-04-20T10:48:30.308 INFO:teuthology.orchestra.run.smithi090.stdout:(45/150): python3-pycparser-2.20-6.el9.noarch.r 169 kB/s | 135 kB 00:00 2024-04-20T10:48:30.327 INFO:teuthology.orchestra.run.smithi175.stdout:(120/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-20T10:48:30.352 INFO:teuthology.orchestra.run.smithi175.stdout:(121/150): python3-colorama-0.4.4-12.el9.noarch 421 kB/s | 35 kB 00:00 2024-04-20T10:48:30.386 INFO:teuthology.orchestra.run.smithi175.stdout:(122/150): python3-google-auth-2.28.2-1.el9.noa 2.1 MB/s | 203 kB 00:00 2024-04-20T10:48:30.400 INFO:teuthology.orchestra.run.smithi090.stdout:(46/150): python3-requests-2.25.1-8.el9.noarch. 163 kB/s | 125 kB 00:00 2024-04-20T10:48:30.436 INFO:teuthology.orchestra.run.smithi175.stdout:(123/150): python3-grpcio-1.46.7-10.el9.x86_64. 19 MB/s | 2.0 MB 00:00 2024-04-20T10:48:30.461 INFO:teuthology.orchestra.run.smithi175.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-20T10:48:30.487 INFO:teuthology.orchestra.run.smithi175.stdout:(125/150): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-04-20T10:48:30.512 INFO:teuthology.orchestra.run.smithi175.stdout:(126/150): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-20T10:48:30.537 INFO:teuthology.orchestra.run.smithi175.stdout:(127/150): python3-jaraco-collections-3.0.0-8.e 307 kB/s | 23 kB 00:00 2024-04-20T10:48:30.562 INFO:teuthology.orchestra.run.smithi175.stdout:(128/150): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-04-20T10:48:30.587 INFO:teuthology.orchestra.run.smithi175.stdout:(129/150): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-04-20T10:48:30.621 INFO:teuthology.orchestra.run.smithi175.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 12 MB/s | 1.0 MB 00:00 2024-04-20T10:48:30.646 INFO:teuthology.orchestra.run.smithi175.stdout:(131/150): python3-logutils-0.3.5-21.el9.noarch 552 kB/s | 46 kB 00:00 2024-04-20T10:48:30.667 INFO:teuthology.orchestra.run.smithi090.stdout:(47/150): automake-1.16.2-8.el9.noarch.rpm 2.5 MB/s | 689 kB 00:00 2024-04-20T10:48:30.672 INFO:teuthology.orchestra.run.smithi175.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 940 kB/s | 79 kB 00:00 2024-04-20T10:48:30.697 INFO:teuthology.orchestra.run.smithi175.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 763 kB/s | 58 kB 00:00 2024-04-20T10:48:30.709 INFO:teuthology.orchestra.run.smithi090.stdout:(48/150): python3-cryptography-36.0.1-4.el9.x86 476 kB/s | 1.2 MB 00:02 2024-04-20T10:48:30.739 INFO:teuthology.orchestra.run.smithi175.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 246 kB/s | 16 kB 00:00 2024-04-20T10:48:30.772 INFO:teuthology.orchestra.run.smithi175.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-20T10:48:30.797 INFO:teuthology.orchestra.run.smithi175.stdout:(136/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-04-20T10:48:30.823 INFO:teuthology.orchestra.run.smithi175.stdout:(137/150): python3-pyperclip-1.8.2-2.el9.noarch 337 kB/s | 28 kB 00:00 2024-04-20T10:48:30.848 INFO:teuthology.orchestra.run.smithi175.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-04-20T10:48:30.893 INFO:teuthology.orchestra.run.smithi090.stdout:(49/150): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-04-20T10:48:30.918 INFO:teuthology.orchestra.run.smithi090.stdout:(50/150): boost-program-options-1.75.0-8.el9.x8 513 kB/s | 107 kB 00:00 2024-04-20T10:48:30.924 INFO:teuthology.orchestra.run.smithi175.stdout:(139/150): python3-rsa-4.9-2.el9.noarch.rpm 588 kB/s | 59 kB 00:00 2024-04-20T10:48:30.943 INFO:teuthology.orchestra.run.smithi090.stdout:(51/150): elfutils-libelf-devel-0.190-2.el9.x86 427 kB/s | 21 kB 00:00 2024-04-20T10:48:30.949 INFO:teuthology.orchestra.run.smithi175.stdout:(140/150): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-04-20T10:48:30.974 INFO:teuthology.orchestra.run.smithi175.stdout:(141/150): python3-routes-2.5.1-5.el9.noarch.rp 1.0 MB/s | 188 kB 00:00 2024-04-20T10:48:30.994 INFO:teuthology.orchestra.run.smithi090.stdout:(52/150): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-04-20T10:48:30.999 INFO:teuthology.orchestra.run.smithi175.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 677 kB/s | 51 kB 00:00 2024-04-20T10:48:31.024 INFO:teuthology.orchestra.run.smithi175.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-20T10:48:31.029 INFO:teuthology.orchestra.run.smithi090.stdout:(53/150): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-04-20T10:48:31.058 INFO:teuthology.orchestra.run.smithi175.stdout:(144/150): python3-websocket-client-1.2.3-2.el9 1.0 MB/s | 90 kB 00:00 2024-04-20T10:48:31.078 INFO:teuthology.orchestra.run.smithi090.stdout:(54/150): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-04-20T10:48:31.083 INFO:teuthology.orchestra.run.smithi175.stdout:(145/150): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-04-20T10:48:31.109 INFO:teuthology.orchestra.run.smithi175.stdout:(146/150): python3-zc-lockfile-2.0-10.el9.noarc 239 kB/s | 20 kB 00:00 2024-04-20T10:48:31.128 INFO:teuthology.orchestra.run.smithi090.stdout:(55/150): libaio-devel-0.3.111-13.el9.x86_64.rp 223 kB/s | 11 kB 00:00 2024-04-20T10:48:31.184 INFO:teuthology.orchestra.run.smithi175.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 1.5 MB/s | 192 kB 00:00 2024-04-20T10:48:31.187 INFO:teuthology.orchestra.run.smithi090.stdout:(56/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-20T10:48:31.226 INFO:teuthology.orchestra.run.smithi175.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-04-20T10:48:31.245 INFO:teuthology.orchestra.run.smithi090.stdout:(57/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 776 kB/s | 45 kB 00:00 2024-04-20T10:48:31.279 INFO:teuthology.orchestra.run.smithi090.stdout:(58/150): python3-urllib3-1.26.5-5.el9.noarch.r 221 kB/s | 215 kB 00:00 2024-04-20T10:48:31.406 INFO:teuthology.orchestra.run.smithi090.stdout:(59/150): librdkafka-1.6.1-102.el9.x86_64.rpm 4.0 MB/s | 662 kB 00:00 2024-04-20T10:48:31.464 INFO:teuthology.orchestra.run.smithi090.stdout:(60/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 6.4 MB/s | 3.0 MB 00:00 2024-04-20T10:48:31.484 INFO:teuthology.orchestra.run.smithi175.stdout:(149/150): librbd1-19.0.0-3133.ga8c84f59.el9.x8 10 MB/s | 3.1 MB 00:00 2024-04-20T10:48:31.490 INFO:teuthology.orchestra.run.smithi090.stdout:(61/150): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-04-20T10:48:31.523 INFO:teuthology.orchestra.run.smithi090.stdout:(62/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-04-20T10:48:31.566 INFO:teuthology.orchestra.run.smithi090.stdout:(63/150): libtool-2.4.6-45.el9.x86_64.rpm 2.0 MB/s | 582 kB 00:00 2024-04-20T10:48:31.599 INFO:teuthology.orchestra.run.smithi090.stdout:(64/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-04-20T10:48:31.609 INFO:teuthology.orchestra.run.smithi175.stdout:(150/150): librados2-19.0.0-3133.ga8c84f59.el9. 6.8 MB/s | 3.4 MB 00:00 2024-04-20T10:48:31.617 INFO:teuthology.orchestra.run.smithi175.stdout:-------------------------------------------------------------------------------- 2024-04-20T10:48:31.617 INFO:teuthology.orchestra.run.smithi175.stdout:Total 15 MB/s | 218 MB 00:14 2024-04-20T10:48:31.624 INFO:teuthology.orchestra.run.smithi090.stdout:(65/150): openblas-0.3.21-2.el9.x86_64.rpm 600 kB/s | 35 kB 00:00 2024-04-20T10:48:31.650 INFO:teuthology.orchestra.run.smithi090.stdout:(66/150): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-20T10:48:31.900 INFO:teuthology.orchestra.run.smithi090.stdout:(67/150): postgresql-13.14-1.el9.x86_64.rpm 6.4 MB/s | 1.6 MB 00:00 2024-04-20T10:48:32.051 INFO:teuthology.orchestra.run.smithi090.stdout:(68/150): postgresql-contrib-13.14-1.el9.x86_64 5.9 MB/s | 911 kB 00:00 2024-04-20T10:48:32.118 INFO:teuthology.orchestra.run.smithi090.stdout:(69/150): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-20T10:48:32.359 INFO:teuthology.orchestra.run.smithi090.stdout:(70/150): openssl-devel-3.0.7-27.el9.x86_64.rpm 5.6 MB/s | 4.1 MB 00:00 2024-04-20T10:48:32.435 INFO:teuthology.orchestra.run.smithi090.stdout:(71/150): openblas-openmp-0.3.21-2.el9.x86_64.r 5.7 MB/s | 4.7 MB 00:00 2024-04-20T10:48:32.493 INFO:teuthology.orchestra.run.smithi090.stdout:(72/150): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-20T10:48:32.594 INFO:teuthology.orchestra.run.smithi090.stdout:(73/150): protobuf-3.14.0-13.el9.x86_64.rpm 4.3 MB/s | 1.0 MB 00:00 2024-04-20T10:48:32.672 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction check 2024-04-20T10:48:32.686 INFO:teuthology.orchestra.run.smithi090.stdout:(74/150): python3-devel-3.9.18-3.el9.x86_64.rpm 2.6 MB/s | 244 kB 00:00 2024-04-20T10:48:32.769 INFO:teuthology.orchestra.run.smithi090.stdout:(75/150): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-04-20T10:48:32.799 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction check succeeded. 2024-04-20T10:48:32.799 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction test 2024-04-20T10:48:32.828 INFO:teuthology.orchestra.run.smithi090.stdout:(76/150): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-04-20T10:48:32.937 INFO:teuthology.orchestra.run.smithi090.stdout:(77/150): postgresql-server-13.14-1.el9.x86_64. 7.1 MB/s | 5.8 MB 00:00 2024-04-20T10:48:32.962 INFO:teuthology.orchestra.run.smithi090.stdout:(78/150): python3-jsonpointer-2.0-4.el9.noarch. 143 kB/s | 19 kB 00:00 2024-04-20T10:48:32.995 INFO:teuthology.orchestra.run.smithi090.stdout:(79/150): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-04-20T10:48:33.021 INFO:teuthology.orchestra.run.smithi090.stdout:(80/150): python3-markupsafe-1.1.1-12.el9.x86_6 593 kB/s | 35 kB 00:00 2024-04-20T10:48:33.105 INFO:teuthology.orchestra.run.smithi090.stdout:(81/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-20T10:48:33.163 INFO:teuthology.orchestra.run.smithi090.stdout:(82/150): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-20T10:48:33.222 INFO:teuthology.orchestra.run.smithi090.stdout:(83/150): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-20T10:48:33.280 INFO:teuthology.orchestra.run.smithi090.stdout:(84/150): python3-prettytable-0.7.2-27.el9.noar 724 kB/s | 42 kB 00:00 2024-04-20T10:48:33.365 INFO:teuthology.orchestra.run.smithi090.stdout:(85/150): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 269 kB 00:00 2024-04-20T10:48:33.458 INFO:teuthology.orchestra.run.smithi090.stdout:(86/150): python3-babel-2.9.1-2.el9.noarch.rpm 6.2 MB/s | 6.0 MB 00:00 2024-04-20T10:48:33.483 INFO:teuthology.orchestra.run.smithi090.stdout:(87/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-04-20T10:48:33.567 INFO:teuthology.orchestra.run.smithi090.stdout:(88/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.9 MB/s | 5.1 MB 00:00 2024-04-20T10:48:33.592 INFO:teuthology.orchestra.run.smithi090.stdout:(89/150): python3-pytz-2021.1-5.el9.noarch.rpm 469 kB/s | 51 kB 00:00 2024-04-20T10:48:33.625 INFO:teuthology.orchestra.run.smithi090.stdout:(90/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.6 MB/s | 279 kB 00:00 2024-04-20T10:48:33.651 INFO:teuthology.orchestra.run.smithi090.stdout:(91/150): python3-requests-oauthlib-1.3.0-12.el 641 kB/s | 54 kB 00:00 2024-04-20T10:48:33.685 INFO:teuthology.orchestra.run.smithi090.stdout:(92/150): python3-toml-0.10.2-6.el9.noarch.rpm 713 kB/s | 42 kB 00:00 2024-04-20T10:48:33.710 INFO:teuthology.orchestra.run.smithi090.stdout:(93/150): python3-wcwidth-0.2.5-8.el9.noarch.rp 753 kB/s | 44 kB 00:00 2024-04-20T10:48:33.743 INFO:teuthology.orchestra.run.smithi090.stdout:(94/150): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-04-20T10:48:33.769 INFO:teuthology.orchestra.run.smithi090.stdout:(95/150): qatlib-service-24.02.0-1.el9.x86_64.r 611 kB/s | 36 kB 00:00 2024-04-20T10:48:33.802 INFO:teuthology.orchestra.run.smithi090.stdout:(96/150): qatzip-libs-1.2.0-1.el9.x86_64.rpm 809 kB/s | 47 kB 00:00 2024-04-20T10:48:33.828 INFO:teuthology.orchestra.run.smithi090.stdout:(97/150): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-20T10:48:33.862 INFO:teuthology.orchestra.run.smithi090.stdout:(98/150): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-04-20T10:48:33.895 INFO:teuthology.orchestra.run.smithi090.stdout:(99/150): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.4 MB/s | 94 kB 00:00 2024-04-20T10:48:33.920 INFO:teuthology.orchestra.run.smithi090.stdout:(100/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-20T10:48:33.954 INFO:teuthology.orchestra.run.smithi090.stdout:(101/150): zlib-devel-1.2.11-41.el9.x86_64.rpm 766 kB/s | 45 kB 00:00 2024-04-20T10:48:33.980 INFO:teuthology.orchestra.run.smithi090.stdout:(102/150): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-04-20T10:48:34.080 INFO:teuthology.orchestra.run.smithi090.stdout:(103/150): protobuf-compiler-3.14.0-13.el9.x86_ 6.7 MB/s | 863 kB 00:00 2024-04-20T10:48:34.430 INFO:teuthology.orchestra.run.smithi090.stdout:(104/150): gperftools-libs-2.9.1-2.el9.x86_64.r 882 kB/s | 309 kB 00:00 2024-04-20T10:48:34.464 INFO:teuthology.orchestra.run.smithi090.stdout:(105/150): abseil-cpp-20211102.0-3.el9.x86_64.r 1.1 MB/s | 548 kB 00:00 2024-04-20T10:48:34.506 INFO:teuthology.orchestra.run.smithi090.stdout:(106/150): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-04-20T10:48:34.521 INFO:teuthology.orchestra.run.smithi175.stdout:Transaction test succeeded. 2024-04-20T10:48:34.521 INFO:teuthology.orchestra.run.smithi175.stdout:Running transaction 2024-04-20T10:48:34.581 INFO:teuthology.orchestra.run.smithi090.stdout:(107/150): libarrow-doc-9.0.0-10.el9.noarch.rpm 345 kB/s | 26 kB 00:00 2024-04-20T10:48:34.665 INFO:teuthology.orchestra.run.smithi090.stdout:(108/150): liboath-2.6.7-2.el9.x86_64.rpm 583 kB/s | 49 kB 00:00 2024-04-20T10:48:34.765 INFO:teuthology.orchestra.run.smithi090.stdout:(109/150): libarrow-9.0.0-10.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-04-20T10:48:34.791 INFO:teuthology.orchestra.run.smithi090.stdout:(110/150): libunwind-1.6.2-1.el9.x86_64.rpm 533 kB/s | 67 kB 00:00 2024-04-20T10:48:34.842 INFO:teuthology.orchestra.run.smithi090.stdout:(111/150): luarocks-3.9.2-1.el9.noarch.rpm 1.9 MB/s | 151 kB 00:00 2024-04-20T10:48:34.926 INFO:teuthology.orchestra.run.smithi090.stdout:(112/150): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-04-20T10:48:34.976 INFO:teuthology.orchestra.run.smithi090.stdout:(113/150): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.4 MB/s | 838 kB 00:00 2024-04-20T10:48:35.001 INFO:teuthology.orchestra.run.smithi090.stdout:(114/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 577 kB/s | 43 kB 00:00 2024-04-20T10:48:35.043 INFO:teuthology.orchestra.run.smithi090.stdout:(115/150): python3-cachetools-4.2.4-1.el9.noarc 481 kB/s | 32 kB 00:00 2024-04-20T10:48:35.069 INFO:teuthology.orchestra.run.smithi090.stdout:(116/150): python3-certifi-2021.10.8-2.el9.noar 223 kB/s | 15 kB 00:00 2024-04-20T10:48:35.119 INFO:teuthology.orchestra.run.smithi090.stdout:(117/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.2 MB/s | 172 kB 00:00 2024-04-20T10:48:35.153 INFO:teuthology.orchestra.run.smithi090.stdout:(118/150): python3-cherrypy-18.6.1-2.el9.noarch 4.2 MB/s | 358 kB 00:00 2024-04-20T10:48:35.195 INFO:teuthology.orchestra.run.smithi090.stdout:(119/150): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.9 MB/s | 303 kB 00:00 2024-04-20T10:48:35.220 INFO:teuthology.orchestra.run.smithi090.stdout:(120/150): python3-colorama-0.4.4-12.el9.noarch 528 kB/s | 35 kB 00:00 2024-04-20T10:48:35.270 INFO:teuthology.orchestra.run.smithi090.stdout:(121/150): python3-google-auth-2.28.2-1.el9.noa 2.6 MB/s | 203 kB 00:00 2024-04-20T10:48:35.337 INFO:teuthology.orchestra.run.smithi090.stdout:(122/150): python3-grpcio-1.46.7-10.el9.x86_64. 17 MB/s | 2.0 MB 00:00 2024-04-20T10:48:35.362 INFO:teuthology.orchestra.run.smithi090.stdout:(123/150): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-04-20T10:48:35.413 INFO:teuthology.orchestra.run.smithi090.stdout:(124/150): python3-jaraco-8.2.1-3.el9.noarch.rp 142 kB/s | 11 kB 00:00 2024-04-20T10:48:35.438 INFO:teuthology.orchestra.run.smithi090.stdout:(125/150): python3-jaraco-classes-3.2.1-5.el9.n 234 kB/s | 18 kB 00:00 2024-04-20T10:48:35.631 INFO:teuthology.orchestra.run.smithi090.stdout:(126/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:02 2024-04-20T10:48:35.656 INFO:teuthology.orchestra.run.smithi090.stdout:(127/150): python3-jaraco-collections-3.0.0-8.e 96 kB/s | 23 kB 00:00 2024-04-20T10:48:35.681 INFO:teuthology.orchestra.run.smithi090.stdout:(128/150): python3-jaraco-functools-3.5.0-2.el9 80 kB/s | 19 kB 00:00 2024-04-20T10:48:35.756 INFO:teuthology.orchestra.run.smithi090.stdout:(129/150): python3-logutils-0.3.5-21.el9.noarch 620 kB/s | 46 kB 00:00 2024-04-20T10:48:35.798 INFO:teuthology.orchestra.run.smithi090.stdout:(130/150): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-20T10:48:35.823 INFO:teuthology.orchestra.run.smithi090.stdout:(131/150): python3-jaraco-text-3.2.0-6.el9.noar 102 kB/s | 20 kB 00:00 2024-04-20T10:48:35.849 INFO:teuthology.orchestra.run.smithi090.stdout:(132/150): python3-more-itertools-8.12.0-2.el9. 854 kB/s | 79 kB 00:00 2024-04-20T10:48:35.874 INFO:teuthology.orchestra.run.smithi090.stdout:(133/150): python3-natsort-7.1.1-5.el9.noarch.r 763 kB/s | 58 kB 00:00 2024-04-20T10:48:36.040 INFO:teuthology.orchestra.run.smithi090.stdout:(134/150): python3-portend-3.1.0-2.el9.noarch.r 86 kB/s | 16 kB 00:00 2024-04-20T10:48:36.143 INFO:teuthology.orchestra.run.smithi090.stdout:(135/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 335 kB/s | 90 kB 00:00 2024-04-20T10:48:36.168 INFO:teuthology.orchestra.run.smithi090.stdout:(136/150): python3-pyperclip-1.8.2-2.el9.noarch 220 kB/s | 28 kB 00:00 2024-04-20T10:48:36.193 INFO:teuthology.orchestra.run.smithi090.stdout:(137/150): python3-pecan-1.4.2-3.el9.noarch.rpm 737 kB/s | 272 kB 00:00 2024-04-20T10:48:36.227 INFO:teuthology.orchestra.run.smithi090.stdout:(138/150): python3-repoze-lru-0.7-16.el9.noarch 367 kB/s | 31 kB 00:00 2024-04-20T10:48:36.261 INFO:teuthology.orchestra.run.smithi090.stdout:(139/150): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-04-20T10:48:36.286 INFO:teuthology.orchestra.run.smithi090.stdout:(140/150): python3-rsa-4.9-2.el9.noarch.rpm 641 kB/s | 59 kB 00:00 2024-04-20T10:48:36.311 INFO:teuthology.orchestra.run.smithi090.stdout:(141/150): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2024-04-20T10:48:36.337 INFO:teuthology.orchestra.run.smithi090.stdout:(142/150): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-04-20T10:48:36.362 INFO:teuthology.orchestra.run.smithi090.stdout:(143/150): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-20T10:48:36.387 INFO:teuthology.orchestra.run.smithi090.stdout:(144/150): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-20T10:48:36.482 INFO:teuthology.orchestra.run.smithi090.stdout:(145/150): python3-zc-lockfile-2.0-10.el9.noarc 166 kB/s | 20 kB 00:00 2024-04-20T10:48:36.513 INFO:teuthology.orchestra.run.smithi090.stdout:(146/150): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-04-20T10:48:36.538 INFO:teuthology.orchestra.run.smithi090.stdout:(147/150): re2-20211101-3.el9.x86_64.rpm 1.2 MB/s | 192 kB 00:00 2024-04-20T10:48:36.672 INFO:teuthology.orchestra.run.smithi090.stdout:(148/150): thrift-0.15.0-2.el9.x86_64.rpm 8.4 MB/s | 1.6 MB 00:00 2024-04-20T10:48:36.897 INFO:teuthology.orchestra.run.smithi090.stdout:(149/150): librbd1-19.0.0-3133.ga8c84f59.el9.x8 8.8 MB/s | 3.1 MB 00:00 2024-04-20T10:48:37.081 INFO:teuthology.orchestra.run.smithi090.stdout:(150/150): librados2-19.0.0-3133.ga8c84f59.el9. 6.0 MB/s | 3.4 MB 00:00 2024-04-20T10:48:37.084 INFO:teuthology.orchestra.run.smithi090.stdout:-------------------------------------------------------------------------------- 2024-04-20T10:48:37.084 INFO:teuthology.orchestra.run.smithi090.stdout:Total 11 MB/s | 218 MB 00:20 2024-04-20T10:48:38.135 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction check 2024-04-20T10:48:38.260 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction check succeeded. 2024-04-20T10:48:38.260 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction test 2024-04-20T10:48:39.965 INFO:teuthology.orchestra.run.smithi090.stdout:Transaction test succeeded. 2024-04-20T10:48:40.003 INFO:teuthology.orchestra.run.smithi090.stdout:Running transaction 2024-04-20T10:48:40.395 INFO:teuthology.orchestra.run.smithi175.stdout: Preparing : 1/1 2024-04-20T10:48:40.462 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-20T10:48:40.495 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-20T10:48:40.538 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-20T10:48:40.868 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-20T10:48:40.979 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T10:48:41.102 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T10:48:41.130 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T10:48:41.205 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T10:48:41.247 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T10:48:41.276 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-20T10:48:41.301 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-20T10:48:41.454 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-20T10:48:41.507 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-20T10:48:41.605 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T10:48:41.638 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T10:48:41.669 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T10:48:41.732 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T10:48:41.753 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T10:48:41.779 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T10:48:42.088 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T10:48:42.121 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T10:48:42.227 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-20T10:48:42.353 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-20T10:48:42.386 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-20T10:48:42.421 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-20T10:48:42.495 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-20T10:48:42.528 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-20T10:48:42.571 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-20T10:48:42.612 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-20T10:48:42.640 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-20T10:48:42.710 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-20T10:48:42.763 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-20T10:48:42.793 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-20T10:48:42.837 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-20T10:48:42.913 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-20T10:48:42.947 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 30/152 2024-04-20T10:48:42.991 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 31/152 2024-04-20T10:48:43.019 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 32/152 2024-04-20T10:48:43.090 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-20T10:48:43.134 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-20T10:48:43.210 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-20T10:48:43.354 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-20T10:48:43.412 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-20T10:48:43.951 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-20T10:48:44.041 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-20T10:48:44.069 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-20T10:48:44.112 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-20T10:48:44.150 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 42/152 2024-04-20T10:48:44.187 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-20T10:48:44.247 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-20T10:48:44.320 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-20T10:48:44.352 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-20T10:48:44.389 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-20T10:48:44.436 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-20T10:48:44.472 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-20T10:48:44.515 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-20T10:48:44.574 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-20T10:48:44.713 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-20T10:48:44.754 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-20T10:48:44.783 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-20T10:48:44.825 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-20T10:48:44.921 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-20T10:48:44.958 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-20T10:48:44.998 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-20T10:48:45.024 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-20T10:48:45.048 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-20T10:48:45.145 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-20T10:48:45.278 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-20T10:48:45.314 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-20T10:48:45.342 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-20T10:48:45.376 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-20T10:48:45.420 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-20T10:48:45.458 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-20T10:48:45.498 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-20T10:48:45.527 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-20T10:48:45.562 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-20T10:48:45.595 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-20T10:48:45.629 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-20T10:48:45.662 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-20T10:48:45.751 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-20T10:48:45.816 INFO:teuthology.orchestra.run.smithi090.stdout: Preparing : 1/1 2024-04-20T10:48:45.901 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/152 2024-04-20T10:48:45.935 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/152 2024-04-20T10:48:45.953 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-20T10:48:45.987 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/152 2024-04-20T10:48:45.991 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-20T10:48:46.040 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-20T10:48:46.148 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-20T10:48:46.202 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-20T10:48:46.356 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 4/152 2024-04-20T10:48:46.446 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T10:48:46.567 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 5/152 2024-04-20T10:48:46.597 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T10:48:46.688 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T10:48:46.731 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T10:48:46.768 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 8/152 2024-04-20T10:48:46.802 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 9/152 2024-04-20T10:48:46.936 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-20T10:48:46.965 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/152 2024-04-20T10:48:46.989 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-20T10:48:47.023 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-20T10:48:47.034 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-13.14-1.el9.x86_64 11/152 2024-04-20T10:48:47.063 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T10:48:47.124 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-20T10:48:47.166 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T10:48:47.181 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-20T10:48:47.189 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T10:48:47.252 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 13/152 2024-04-20T10:48:47.269 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-20T10:48:47.282 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T10:48:47.305 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 14/152 2024-04-20T10:48:47.316 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-20T10:48:47.493 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-20T10:48:47.530 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-20T10:48:47.591 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T10:48:47.608 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-20T10:48:47.624 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 15/152 2024-04-20T10:48:47.732 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : re2-1:20211101-3.el9.x86_64 16/152 2024-04-20T10:48:47.830 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 17/152 2024-04-20T10:48:47.866 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 18/152 2024-04-20T10:48:47.910 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : liboath-2.6.7-2.el9.x86_64 19/152 2024-04-20T10:48:47.984 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 20/152 2024-04-20T10:48:48.018 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 21/152 2024-04-20T10:48:48.070 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 22/152 2024-04-20T10:48:48.110 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 23/152 2024-04-20T10:48:48.147 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-5.4.4-4.el9.x86_64 24/152 2024-04-20T10:48:48.224 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 25/152 2024-04-20T10:48:48.271 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-20T10:48:48.286 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 26/152 2024-04-20T10:48:48.318 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 27/152 2024-04-20T10:48:48.353 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 28/152 2024-04-20T10:48:48.389 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-20T10:48:48.431 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 29/152 2024-04-20T10:48:48.473 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 30/152 2024-04-20T10:48:48.516 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 31/152 2024-04-20T10:48:48.545 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 32/152 2024-04-20T10:48:48.617 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/152 2024-04-20T10:48:48.660 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/152 2024-04-20T10:48:48.735 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 35/152 2024-04-20T10:48:48.879 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/152 2024-04-20T10:48:48.930 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/152 2024-04-20T10:48:49.461 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/152 2024-04-20T10:48:49.578 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/152 2024-04-20T10:48:49.614 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 40/152 2024-04-20T10:48:49.640 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-20T10:48:49.649 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 41/152 2024-04-20T10:48:49.687 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 42/152 2024-04-20T10:48:49.718 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-20T10:48:49.729 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/152 2024-04-20T10:48:49.745 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-20T10:48:49.778 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-20T10:48:49.792 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/152 2024-04-20T10:48:49.867 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/152 2024-04-20T10:48:49.905 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/152 2024-04-20T10:48:49.943 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/152 2024-04-20T10:48:49.991 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/152 2024-04-20T10:48:50.034 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/152 2024-04-20T10:48:50.086 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/152 2024-04-20T10:48:50.092 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-20T10:48:50.132 INFO:teuthology.orchestra.run.smithi175.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T10:48:50.137 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/152 2024-04-20T10:48:50.214 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T10:48:50.245 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 98/152 2024-04-20T10:48:50.281 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-20T10:48:50.285 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/152 2024-04-20T10:48:50.334 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/152 2024-04-20T10:48:50.364 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/152 2024-04-20T10:48:50.406 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/152 2024-04-20T10:48:50.503 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/152 2024-04-20T10:48:50.540 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 57/152 2024-04-20T10:48:50.580 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/152 2024-04-20T10:48:50.614 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/152 2024-04-20T10:48:50.639 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/152 2024-04-20T10:48:50.715 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 61/152 2024-04-20T10:48:50.760 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-20T10:48:50.793 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T10:48:50.851 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 62/152 2024-04-20T10:48:50.864 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T10:48:50.886 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 102/152 2024-04-20T10:48:50.890 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 63/152 2024-04-20T10:48:50.918 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 64/152 2024-04-20T10:48:50.953 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 65/152 2024-04-20T10:48:50.997 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : uuid-1.6.2-55.el9.x86_64 66/152 2024-04-20T10:48:51.035 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 67/152 2024-04-20T10:48:51.074 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 68/152 2024-04-20T10:48:51.105 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 69/152 2024-04-20T10:48:51.139 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 70/152 2024-04-20T10:48:51.165 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 71/152 2024-04-20T10:48:51.206 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 72/152 2024-04-20T10:48:51.242 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 73/152 2024-04-20T10:48:51.330 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 74/152 2024-04-20T10:48:51.381 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 75/152 2024-04-20T10:48:51.421 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 76/152 2024-04-20T10:48:51.468 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 77/152 2024-04-20T10:48:51.568 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-packaging-20.9-5.el9.noarch 78/152 2024-04-20T10:48:51.623 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 79/152 2024-04-20T10:48:52.363 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 80/152 2024-04-20T10:48:52.430 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 81/152 2024-04-20T10:48:52.464 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 82/152 2024-04-20T10:48:52.574 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 83/152 2024-04-20T10:48:52.631 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 84/152 2024-04-20T10:48:52.719 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 85/152 2024-04-20T10:48:52.749 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 86/152 2024-04-20T10:48:52.920 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/152 2024-04-20T10:48:52.956 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/152 2024-04-20T10:48:53.045 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/152 2024-04-20T10:48:53.140 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T10:48:53.182 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T10:48:53.718 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/152 2024-04-20T10:48:53.727 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T10:48:53.769 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T10:48:53.842 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/152 2024-04-20T10:48:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T10:48:53.860 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T10:48:53.860 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T10:48:53.860 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:48:53.903 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T10:48:55.097 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/152 2024-04-20T10:48:55.175 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/152 2024-04-20T10:48:55.204 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 94/152 2024-04-20T10:48:55.237 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 95/152 2024-04-20T10:48:55.549 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/152 2024-04-20T10:48:55.601 INFO:teuthology.orchestra.run.smithi090.stdout: Upgrading : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T10:48:55.691 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 97/152 2024-04-20T10:48:55.723 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 98/152 2024-04-20T10:48:55.767 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/152 2024-04-20T10:48:56.248 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 100/152 2024-04-20T10:48:56.279 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T10:48:56.351 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 101/152 2024-04-20T10:48:56.373 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 102/152 2024-04-20T10:48:58.680 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T10:48:58.739 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T10:48:59.276 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 103/152 2024-04-20T10:48:59.318 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T10:48:59.408 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 104/152 2024-04-20T10:48:59.408 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-20T10:48:59.409 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-20T10:48:59.409 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:48:59.436 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /sys 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /proc 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /mnt 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /var/tmp 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /home 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /root 2024-04-20T10:49:05.146 INFO:teuthology.orchestra.run.smithi175.stdout:skipping the directory /tmp 2024-04-20T10:49:05.147 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:05.321 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T10:49:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T10:49:05.338 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:05.338 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-20T10:49:05.338 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:06.816 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T10:49:06.841 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T10:49:06.841 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:06.841 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T10:49:06.841 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T10:49:06.841 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T10:49:06.841 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:07.058 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T10:49:07.081 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T10:49:07.082 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:07.082 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T10:49:07.082 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T10:49:07.082 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T10:49:07.082 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:07.517 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T10:49:07.540 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T10:49:07.540 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:07.540 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T10:49:07.540 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T10:49:07.540 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T10:49:07.540 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:07.638 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-20T10:49:07.696 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-20T10:49:07.750 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-20T10:49:07.935 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-20T10:49:07.984 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-20T10:49:08.062 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-20T10:49:08.149 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-20T10:49:08.282 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-20T10:49:08.318 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-20T10:49:08.349 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-20T10:49:08.377 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-20T10:49:08.821 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T10:49:08.850 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T10:49:08.882 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 122/152 2024-04-20T10:49:08.935 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 123/152 2024-04-20T10:49:08.964 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T10:49:10.003 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T10:49:10.033 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T10:49:10.997 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T10:49:11.033 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T10:49:11.135 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T10:49:11.315 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 127/152 2024-04-20T10:49:11.369 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T10:49:11.392 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T10:49:11.393 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:11.393 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T10:49:11.393 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T10:49:11.393 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T10:49:11.393 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:11.436 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T10:49:11.447 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T10:49:11.548 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/152 2024-04-20T10:49:11.593 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/152 2024-04-20T10:49:12.526 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-20T10:49:12.555 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T10:49:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T10:49:12.578 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:12.578 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T10:49:12.578 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T10:49:12.578 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T10:49:12.578 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:12.622 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T10:49:12.628 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 105/152 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /sys 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /proc 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /mnt 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /var/tmp 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /home 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /root 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout:skipping the directory /tmp 2024-04-20T10:49:12.629 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T10:49:12.644 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:12.644 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T10:49:12.644 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:12.690 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T10:49:12.712 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T10:49:12.712 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:12.712 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-20T10:49:12.713 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T10:49:12.713 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T10:49:12.713 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:12.812 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T10:49:12.830 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 106/152 2024-04-20T10:49:12.830 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:12.830 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-20T10:49:12.830 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:13.024 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T10:49:13.046 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T10:49:13.046 INFO:teuthology.orchestra.run.smithi175.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:13.046 INFO:teuthology.orchestra.run.smithi175.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T10:49:13.046 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T10:49:13.047 INFO:teuthology.orchestra.run.smithi175.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T10:49:13.047 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:14.325 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T10:49:14.350 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 107/152 2024-04-20T10:49:14.350 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:14.351 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-20T10:49:14.351 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T10:49:14.351 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-20T10:49:14.351 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:14.575 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T10:49:14.598 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 108/152 2024-04-20T10:49:14.598 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:14.598 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-20T10:49:14.598 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T10:49:14.598 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-20T10:49:14.599 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:15.044 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T10:49:15.067 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 109/152 2024-04-20T10:49:15.067 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:15.067 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-20T10:49:15.067 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T10:49:15.067 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-20T10:49:15.067 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:15.175 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : automake-1.16.2-8.el9.noarch 110/152 2024-04-20T10:49:15.231 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-ply-3.11-14.el9.noarch 111/152 2024-04-20T10:49:15.286 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 112/152 2024-04-20T10:49:15.480 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 113/152 2024-04-20T10:49:15.529 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 114/152 2024-04-20T10:49:15.598 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 115/152 2024-04-20T10:49:15.698 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 116/152 2024-04-20T10:49:15.836 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 117/152 2024-04-20T10:49:15.880 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 118/152 2024-04-20T10:49:15.921 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 119/152 2024-04-20T10:49:15.949 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : fuse-2.9.9-15.el9.x86_64 120/152 2024-04-20T10:49:16.393 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T10:49:16.424 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 121/152 2024-04-20T10:49:16.457 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 122/152 2024-04-20T10:49:16.518 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 123/152 2024-04-20T10:49:16.548 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T10:49:17.584 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 124/152 2024-04-20T10:49:17.625 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T10:49:17.643 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 137/152 2024-04-20T10:49:17.684 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 138/152 2024-04-20T10:49:17.725 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 139/152 2024-04-20T10:49:17.757 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-20T10:49:17.785 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-20T10:49:17.958 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 142/152 2024-04-20T10:49:17.997 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-20T10:49:18.027 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 144/152 2024-04-20T10:49:18.589 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 125/152 2024-04-20T10:49:18.644 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T10:49:18.667 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T10:49:18.691 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T10:49:18.711 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T10:49:18.770 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 126/152 2024-04-20T10:49:18.931 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 127/152 2024-04-20T10:49:18.953 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T10:49:18.975 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 128/152 2024-04-20T10:49:18.976 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:18.976 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-20T10:49:18.976 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T10:49:18.976 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-20T10:49:18.976 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:19.020 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T10:49:19.031 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 129/152 2024-04-20T10:49:19.130 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 130/152 2024-04-20T10:49:19.178 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 131/152 2024-04-20T10:49:19.491 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 146/152 2024-04-20T10:49:19.578 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-20T10:49:19.619 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-20T10:49:19.700 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-20T10:49:19.732 INFO:teuthology.orchestra.run.smithi175.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-20T10:49:19.732 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T10:49:19.841 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T10:49:19.841 INFO:teuthology.orchestra.run.smithi175.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T10:49:20.094 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libtool-2.4.6-45.el9.x86_64 132/152 2024-04-20T10:49:20.141 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T10:49:20.164 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 133/152 2024-04-20T10:49:20.164 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:20.164 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-20T10:49:20.164 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T10:49:20.164 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-20T10:49:20.164 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:20.209 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T10:49:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 134/152 2024-04-20T10:49:20.230 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:20.230 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-20T10:49:20.230 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:20.276 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T10:49:20.300 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 135/152 2024-04-20T10:49:20.300 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:20.300 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-20T10:49:20.300 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T10:49:20.300 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-20T10:49:20.300 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:20.602 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T10:49:20.624 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 136/152 2024-04-20T10:49:20.625 INFO:teuthology.orchestra.run.smithi090.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-20T10:49:20.625 INFO:teuthology.orchestra.run.smithi090.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-20T10:49:20.625 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T10:49:20.625 INFO:teuthology.orchestra.run.smithi090.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-20T10:49:20.625 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:25.249 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 137/152 2024-04-20T10:49:25.291 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 138/152 2024-04-20T10:49:25.340 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 139/152 2024-04-20T10:49:25.372 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 140/152 2024-04-20T10:49:25.408 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 141/152 2024-04-20T10:49:25.589 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 142/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/152 2024-04-20T10:49:25.610 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/152 2024-04-20T10:49:25.611 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/152 2024-04-20T10:49:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/152 2024-04-20T10:49:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/152 2024-04-20T10:49:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/152 2024-04-20T10:49:25.612 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/152 2024-04-20T10:49:25.623 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-20T10:49:25.624 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-20T10:49:25.625 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-20T10:49:25.626 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-20T10:49:25.627 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-20T10:49:25.628 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-20T10:49:25.629 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-20T10:49:25.630 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-20T10:49:25.631 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-20T10:49:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-20T10:49:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-20T10:49:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/152 2024-04-20T10:49:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-20T10:49:25.632 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/152 2024-04-20T10:49:25.639 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 143/152 2024-04-20T10:49:25.669 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 144/152 2024-04-20T10:49:26.290 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T10:49:26.336 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T10:49:26.356 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 145/152 2024-04-20T10:49:27.143 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 146/152 2024-04-20T10:49:27.244 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 147/152 2024-04-20T10:49:27.285 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/152 2024-04-20T10:49:27.371 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/152 2024-04-20T10:49:27.399 INFO:teuthology.orchestra.run.smithi090.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/152 2024-04-20T10:49:27.400 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T10:49:27.484 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 151/152 2024-04-20T10:49:27.484 INFO:teuthology.orchestra.run.smithi090.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T10:49:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T10:49:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:27.680 INFO:teuthology.orchestra.run.smithi175.stdout:Upgraded: 2024-04-20T10:49:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.680 INFO:teuthology.orchestra.run.smithi175.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout:Installed: 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: automake-1.16.2-8.el9.noarch 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: bison-3.7.4-5.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.681 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.682 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: flex-2.6.4-9.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.683 INFO:teuthology.orchestra.run.smithi175.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T10:49:27.684 INFO:teuthology.orchestra.run.smithi175.stdout: lua-5.4.4-4.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-13.14-1.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-20T10:49:27.685 INFO:teuthology.orchestra.run.smithi175.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T10:49:27.686 INFO:teuthology.orchestra.run.smithi175.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T10:49:27.687 INFO:teuthology.orchestra.run.smithi175.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T10:49:27.688 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T10:49:27.689 INFO:teuthology.orchestra.run.smithi175.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-20T10:49:27.690 INFO:teuthology.orchestra.run.smithi175.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T10:49:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-20T10:49:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-20T10:49:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T10:49:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-20T10:49:27.691 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:27.691 INFO:teuthology.orchestra.run.smithi175.stdout:Complete! 2024-04-20T10:49:28.033 DEBUG:teuthology.parallel:result is None 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 1/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 3/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 4/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3133.ga8c84 5/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 6/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 7/152 2024-04-20T10:49:35.619 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 8/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 9/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 10/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 11/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 12/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 13/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 14/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_ 15/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 16/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 17/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_6 18/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86 19/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 20/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el 21/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9. 22/152 2024-04-20T10:49:35.620 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_6 23/152 2024-04-20T10:49:35.621 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 24/152 2024-04-20T10:49:35.621 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 25/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 26/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 27/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 28/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 29/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59. 30/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noa 31/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.n 32/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c 33/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el 34/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 35/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.e 36/152 2024-04-20T10:49:35.632 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 37/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 38/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 39/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/152 2024-04-20T10:49:35.633 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/152 2024-04-20T10:49:35.634 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 68/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/152 2024-04-20T10:49:35.635 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/152 2024-04-20T10:49:35.636 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/152 2024-04-20T10:49:35.637 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/152 2024-04-20T10:49:35.638 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 122/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/152 2024-04-20T10:49:35.639 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/152 2024-04-20T10:49:35.640 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/152 2024-04-20T10:49:35.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/152 2024-04-20T10:49:35.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/152 2024-04-20T10:49:35.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/152 2024-04-20T10:49:35.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 149/152 2024-04-20T10:49:35.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/152 2024-04-20T10:49:35.641 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 151/152 2024-04-20T10:49:37.713 INFO:teuthology.orchestra.run.smithi090.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/152 2024-04-20T10:49:37.713 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:37.713 INFO:teuthology.orchestra.run.smithi090.stdout:Upgraded: 2024-04-20T10:49:37.713 INFO:teuthology.orchestra.run.smithi090.stdout: librados2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: librbd1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout:Installed: 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: automake-1.16.2-8.el9.noarch 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: bison-3.7.4-5.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-base-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-grafana-dashboards-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-immutable-object-cache-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mds-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.714 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-dashboard-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-modules-core-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mgr-rook-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-mon-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-osd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-prometheus-alerts-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-radosgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-selinux-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-test-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: ceph-volume-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: cephadm-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.715 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-shell-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: cephfs-top-2:19.0.0-3133.ga8c84f59.el9.noarch 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: flex-2.6.4-9.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: libcephfs2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.716 INFO:teuthology.orchestra.run.smithi090.stdout: libcephsqlite-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: librados-devel-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libradosstriper1-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: librgw2-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-20T10:49:37.717 INFO:teuthology.orchestra.run.smithi090.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: lua-5.4.4-4.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-13.14-1.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-20T10:49:37.718 INFO:teuthology.orchestra.run.smithi090.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-argparse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ceph-common-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cephfs-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-20T10:49:37.719 INFO:teuthology.orchestra.run.smithi090.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-20T10:49:37.720 INFO:teuthology.orchestra.run.smithi090.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-ply-3.11-14.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-20T10:49:37.721 INFO:teuthology.orchestra.run.smithi090.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rados-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-20T10:49:37.722 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rgw-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-20T10:49:37.723 INFO:teuthology.orchestra.run.smithi090.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-fuse-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-mirror-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: rbd-nbd-2:19.0.0-3133.ga8c84f59.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: re2-1:20211101-3.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-20T10:49:37.724 INFO:teuthology.orchestra.run.smithi090.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-20T10:49:37.725 INFO:teuthology.orchestra.run.smithi090.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-20T10:49:37.725 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:37.725 INFO:teuthology.orchestra.run.smithi090.stdout:Complete! 2024-04-20T10:49:38.111 DEBUG:teuthology.parallel:result is None 2024-04-20T10:49:38.112 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:49:38.262 DEBUG:teuthology.orchestra.run.smithi090:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T10:49:38.284 INFO:teuthology.orchestra.run.smithi090.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-20T10:49:38.285 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-20T10:49:38.285 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-20T10:49:38.287 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:49:38.507 DEBUG:teuthology.orchestra.run.smithi175:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-20T10:49:38.533 INFO:teuthology.orchestra.run.smithi175.stdout:19.0.0-3133.ga8c84f59.el9 2024-04-20T10:49:38.533 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3133.ga8c84f59.el9 2024-04-20T10:49:38.533 INFO:teuthology.task.install:The correct ceph version 19.0.0-3133.ga8c84f59 is installed. 2024-04-20T10:49:38.535 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-20T10:49:38.535 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:38.535 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T10:49:38.561 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:38.561 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-20T10:49:38.602 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-20T10:49:38.602 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:38.602 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T10:49:38.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T10:49:38.689 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:38.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/daemon-helper 2024-04-20T10:49:38.716 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-20T10:49:38.780 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-20T10:49:38.780 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:38.780 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T10:49:38.803 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T10:49:38.866 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:38.866 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-20T10:49:38.889 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-20T10:49:38.953 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-20T10:49:38.953 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:38.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T10:49:38.976 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T10:49:39.042 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:39.043 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/usr/bin/stdin-killer 2024-04-20T10:49:39.066 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-20T10:49:39.130 INFO:teuthology.run_tasks:Running task ceph... 2024-04-20T10:49:39.218 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-20T10:49:39.219 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 777 /var/log/ceph 2024-04-20T10:49:39.221 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 777 /var/log/ceph 2024-04-20T10:49:39.244 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-20T10:49:39.244 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-20T10:49:39.285 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-20T10:49:39.308 INFO:tasks.ceph:Creating extra log directories... 2024-04-20T10:49:39.308 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-20T10:49:39.348 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-20T10:49:39.378 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-20T10:49:39.378 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-20T10:49:39.378 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-20T10:49:39.378 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:39.378 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-20T10:49:39.425 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-20T10:49:39.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-20T10:49:39.572 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:39.572 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-20T10:49:39.586 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-20T10:49:39.694 DEBUG:teuthology.orchestra.run.smithi175:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-20T10:49:39.739 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-20T10:49:39.739 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-20T10:49:39.739 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489', 'branch': 'wip-rishabh-testing-20240416.193735', 'description': 'fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7664489', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-rishabh-testing-20240416.193735'}, 'ceph': {'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'ceph-fuse': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'kclient': {'client.0': {'cephfs_name': 'a'}, 'client.1': {'cephfs_name': 'b'}, 'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-rishabh-testing-20240416.193735', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 7954, 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'sleep_before_teardown': 0, 'subset': '364/512', 'suite': 'fs', 'suite_branch': 'wip-rishabh-testing-20240416.193735', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi090.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN5Cj+mtvOPieUGE7GbcpFhhFOv1qvqSu8tfaDquPmMItF8xlUzjJqlzKugveSdw6p3a4kBvuUxC0sbz24f4qDE=', 'smithi175.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCUF9EsH1y9jeXNWrwI8tkgnBHSs7KpHjr5adpGfSye0sD169iuzklP5EtfdByu7mUlrODHc38Vku1jvBHkKyss='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': '806ec36b21129f113ce356c007dd59694d340b37'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'fs': [{'name': 'a'}, {'name': 'b'}], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'Replacing daemon mds'], 'sha1': 'a8c84f5997950fd7d008204839253291d52e6eda', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'mds_thrash': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-20_09:50:15', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-20T10:49:39.740 DEBUG:teuthology.orchestra.run.smithi090:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-20T10:49:39.742 DEBUG:teuthology.orchestra.run.smithi175:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-20T10:49:39.788 DEBUG:teuthology.orchestra.run.smithi090:> sudo install -d -m0777 -- /var/run/ceph 2024-04-20T10:49:39.797 DEBUG:teuthology.orchestra.run.smithi175:> sudo install -d -m0777 -- /var/run/ceph 2024-04-20T10:49:39.851 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:39.852 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T10:49:39.876 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T10:49:39.876 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_1 2024-04-20T10:49:39.931 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T10:49:39.931 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:39.931 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 663 Links: 1 2024-04-20T10:49:39.931 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:39.932 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:39.932 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-20 10:49:28.020201598 +0000 2024-04-20T10:49:39.932 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-20 10:47:34.402643621 +0000 2024-04-20T10:49:39.932 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-20 10:47:34.402643621 +0000 2024-04-20T10:49:39.932 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-20 10:47:34.402643621 +0000 2024-04-20T10:49:39.932 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T10:49:39.993 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-20T10:49:39.994 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-20T10:49:39.994 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000192082 s, 2.7 MB/s 2024-04-20T10:49:39.995 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T10:49:40.050 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_2 2024-04-20T10:49:40.105 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T10:49:40.105 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:40.106 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-20T10:49:40.106 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:40.106 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:40.106 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-20 10:49:28.020201598 +0000 2024-04-20T10:49:40.106 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-20 10:47:34.737639354 +0000 2024-04-20T10:49:40.106 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-20 10:47:34.737639354 +0000 2024-04-20T10:49:40.106 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-20 10:47:34.737639354 +0000 2024-04-20T10:49:40.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T10:49:40.167 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-20T10:49:40.167 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-20T10:49:40.167 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000187038 s, 2.7 MB/s 2024-04-20T10:49:40.168 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T10:49:40.224 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_3 2024-04-20T10:49:40.279 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T10:49:40.279 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:40.279 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-04-20T10:49:40.279 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:40.279 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:40.280 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-20 10:49:28.021201584 +0000 2024-04-20T10:49:40.280 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-20 10:47:35.064635188 +0000 2024-04-20T10:49:40.280 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-20 10:47:35.064635188 +0000 2024-04-20T10:49:40.280 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-20 10:47:35.064635188 +0000 2024-04-20T10:49:40.280 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T10:49:40.341 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-20T10:49:40.341 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-20T10:49:40.341 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000187391 s, 2.7 MB/s 2024-04-20T10:49:40.343 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T10:49:40.398 DEBUG:teuthology.orchestra.run.smithi090:> stat /dev/vg_nvme/lv_4 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 5h/5d Inode: 721 Links: 1 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 2024-04-20 10:49:28.021201584 +0000 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-20 10:47:35.395630972 +0000 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-20 10:47:35.395630972 +0000 2024-04-20T10:49:40.453 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-20 10:47:35.395630972 +0000 2024-04-20T10:49:40.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T10:49:40.515 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records in 2024-04-20T10:49:40.515 INFO:teuthology.orchestra.run.smithi090.stderr:1+0 records out 2024-04-20T10:49:40.515 INFO:teuthology.orchestra.run.smithi090.stderr:512 bytes copied, 0.000228279 s, 2.2 MB/s 2024-04-20T10:49:40.516 DEBUG:teuthology.orchestra.run.smithi090:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T10:49:40.573 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:40.573 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:40.573 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/scratch_devs of=/dev/stdout 2024-04-20T10:49:40.590 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-20T10:49:40.590 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_1 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-20 10:49:20.329793648 +0000 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-20 10:47:34.668706007 +0000 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-20 10:47:34.668706007 +0000 2024-04-20T10:49:40.646 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-20 10:47:34.668706007 +0000 2024-04-20T10:49:40.647 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-20T10:49:40.709 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-20T10:49:40.709 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-20T10:49:40.709 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000192683 s, 2.7 MB/s 2024-04-20T10:49:40.710 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-20T10:49:40.766 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_2 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-20 10:49:20.329793648 +0000 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-20 10:47:35.018700882 +0000 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-20 10:47:35.018700882 +0000 2024-04-20T10:49:40.822 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-20 10:47:35.018700882 +0000 2024-04-20T10:49:40.823 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-20T10:49:40.884 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-20T10:49:40.884 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-20T10:49:40.884 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000218877 s, 2.3 MB/s 2024-04-20T10:49:40.885 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-20T10:49:40.943 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_3 2024-04-20T10:49:40.997 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 702 Links: 1 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-20 10:49:20.329793648 +0000 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-20 10:47:35.347696065 +0000 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-20 10:47:35.347696065 +0000 2024-04-20T10:49:40.998 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-20 10:47:35.347696065 +0000 2024-04-20T10:49:40.998 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-20T10:49:41.059 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-20T10:49:41.060 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-20T10:49:41.060 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000185471 s, 2.8 MB/s 2024-04-20T10:49:41.061 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-20T10:49:41.116 DEBUG:teuthology.orchestra.run.smithi175:> stat /dev/vg_nvme/lv_4 2024-04-20T10:49:41.170 INFO:teuthology.orchestra.run.smithi175.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-20T10:49:41.170 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-20T10:49:41.171 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-04-20T10:49:41.171 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:49:41.171 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:device_t:s0 2024-04-20T10:49:41.171 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 2024-04-20 10:49:20.330793633 +0000 2024-04-20T10:49:41.171 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-20 10:47:35.686691101 +0000 2024-04-20T10:49:41.171 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-20 10:47:35.686691101 +0000 2024-04-20T10:49:41.171 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-20 10:47:35.686691101 +0000 2024-04-20T10:49:41.171 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-20T10:49:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records in 2024-04-20T10:49:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:1+0 records out 2024-04-20T10:49:41.232 INFO:teuthology.orchestra.run.smithi175.stderr:512 bytes copied, 0.000199936 s, 2.6 MB/s 2024-04-20T10:49:41.233 DEBUG:teuthology.orchestra.run.smithi175:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-20T10:49:41.289 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:41.289 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-20T10:49:41.289 INFO:tasks.ceph:Generating config... 2024-04-20T10:49:41.290 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-20T10:49:41.291 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-20T10:49:41.291 INFO:tasks.ceph:[client] debug client = 20 2024-04-20T10:49:41.291 INFO:tasks.ceph:[client] debug ms = 1 2024-04-20T10:49:41.291 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-20T10:49:41.291 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-20T10:49:41.291 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-20T10:49:41.291 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-20T10:49:41.291 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-20T10:49:41.291 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-20T10:49:41.291 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-20T10:49:41.291 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-20T10:49:41.291 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-20T10:49:41.291 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-20T10:49:41.292 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-20T10:49:41.293 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-20T10:49:41.293 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-20T10:49:41.293 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-20T10:49:41.293 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-20T10:49:41.293 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-20T10:49:41.294 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-20T10:49:41.297 INFO:tasks.ceph:Setting up mon.a... 2024-04-20T10:49:41.297 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-20T10:49:41.346 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.keyring 2024-04-20T10:49:41.348 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-20T10:49:41.388 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T10:49:41.452 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.90'), ('mon.b', '172.21.15.175'), ('mon.c', '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]')] 2024-04-20T10:49:41.453 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.90,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-20T10:49:41.453 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:41.454 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-20T10:49:41.507 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.90 --add b 172.21.15.175 --addv c '[v2:172.21.15.175:3301,v1:172.21.15.175:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:41.592 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:41.592 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: generated fsid 83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c 2024-04-20T10:49:41.592 INFO:teuthology.orchestra.run.smithi090.stdout:setting min_mon_release = quincy 2024-04-20T10:49:41.592 INFO:teuthology.orchestra.run.smithi090.stdout:epoch 0 2024-04-20T10:49:41.592 INFO:teuthology.orchestra.run.smithi090.stdout:fsid 83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:last_changed 2024-04-20T10:49:41.593546+0000 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:created 2024-04-20T10:49:41.593546+0000 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:min_mon_release 17 (quincy) 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:election_strategy: 1 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:0: [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] mon.a 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:1: [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] mon.b 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:2: [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] mon.c 2024-04-20T10:49:41.593 INFO:teuthology.orchestra.run.smithi090.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-20T10:49:41.595 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-20T10:49:41.610 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c... 2024-04-20T10:49:41.611 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-20T10:49:41.652 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-20T10:49:41.690 INFO:teuthology.orchestra.run.smithi090.stdout:[global] 2024-04-20T10:49:41.690 INFO:teuthology.orchestra.run.smithi090.stdout: chdir = "" 2024-04-20T10:49:41.690 INFO:teuthology.orchestra.run.smithi090.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-20T10:49:41.690 INFO:teuthology.orchestra.run.smithi090.stdout: auth supported = cephx 2024-04-20T10:49:41.690 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.690 INFO:teuthology.orchestra.run.smithi090.stdout: filestore xattr use omap = true 2024-04-20T10:49:41.690 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon clock drift allowed = 1.000 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: osd crush chooseleaf type = 0 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: auth debug = true 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on old message = true 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on bug = true 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: mon pg warn max object skew = 0 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: # disable pg_autoscaler by default for new pools 2024-04-20T10:49:41.691 INFO:teuthology.orchestra.run.smithi090.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-20T10:49:41.692 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.692 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default size = 2 2024-04-20T10:49:41.692 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.692 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow primary affinity = true 2024-04-20T10:49:41.692 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd allow pg remap = true 2024-04-20T10:49:41.692 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on legacy crush tunables = false 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on crush straw calc version zero = false 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on no sortbitwise = false 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on osd down out interval zero = false 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon warn on too few osds = false 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon_allow_pool_size_one = true 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: osd default data pool replay window = 5 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.693 INFO:teuthology.orchestra.run.smithi090.stdout: mon allow pool delete = true 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: mon cluster log file level = debug 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: debug asserts on shutdown = true 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: mon health detail to clog = false 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: mon host = "172.21.15.90,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: ms die on skipped message = False 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: fsid = 83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout:[osd] 2024-04-20T10:49:41.694 INFO:teuthology.orchestra.run.smithi090.stdout: osd journal size = 100 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub load threshold = 5.0 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd scrub max interval = 600 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd mclock profile = high_recovery_ops 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd recover clone overlap = true 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd recovery max chunk = 1048576 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug shutdown = true 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug op order = true 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug verify stray on activate = true 2024-04-20T10:49:41.695 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug trim objects = true 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: osd open classes on start = true 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug pg log writeout = true 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: osd deep scrub update digest min age = 30 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: osd map max advance = 10 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: journal zero on create = true 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: filestore ondisk finisher threads = 3 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: filestore apply finisher threads = 3 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: bdev debug aio = true 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: osd debug misdirected ops = true 2024-04-20T10:49:41.696 INFO:teuthology.orchestra.run.smithi090.stdout: bdev async discard = True 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: bdev enable discard = True 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore allocator = bitmap 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore block size = 96636764160 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: bluestore fsck on mount = True 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluefs = 1/20 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: debug bluestore = 1/20 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: debug osd = 20 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: debug rocksdb = 4/10 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: mon client directed command retry = 5 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd backfillfull_ratio = 0.85 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd full ratio = 0.9 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd nearfull ratio = 0.8 2024-04-20T10:49:41.697 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay max = 1 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay probability = 0.005 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay type = client mds 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject socket failures = 2500 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: osd blocked scrub grace period = 3600 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: osd failsafe full ratio = 0.95 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: osd max markdown count = 1000 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: osd objectstore = bluestore 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr] 2024-04-20T10:49:41.698 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug mgr = 20 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: mgr/telemetry/nag = false 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout:[mon] 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug mon = 20 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug paxos = 20 2024-04-20T10:49:41.699 INFO:teuthology.orchestra.run.smithi090.stdout: debug auth = 20 2024-04-20T10:49:41.700 INFO:teuthology.orchestra.run.smithi090.stdout: mon data avail warn = 5 2024-04-20T10:49:41.700 INFO:teuthology.orchestra.run.smithi090.stdout: mon mgr mkfs grace = 240 2024-04-20T10:49:41.700 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min pgs per osd = 4 2024-04-20T10:49:41.700 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd reporter subtree level = osd 2024-04-20T10:49:41.700 INFO:teuthology.orchestra.run.smithi090.stdout: mon osd prime pg temp = true 2024-04-20T10:49:41.700 INFO:teuthology.orchestra.run.smithi090.stdout: mon reweight min bytes per osd = 10 2024-04-20T10:49:41.701 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.701 INFO:teuthology.orchestra.run.smithi090.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-20T10:49:41.701 INFO:teuthology.orchestra.run.smithi090.stdout: auth mon ticket ttl = 660 # 11m 2024-04-20T10:49:41.701 INFO:teuthology.orchestra.run.smithi090.stdout: auth service ticket ttl = 240 # 4m 2024-04-20T10:49:41.701 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: # don't complain about insecure global_id in the test suite 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: # 1m isn't quite enough 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: mon_down_mkfs_grace = 2m 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: mon_warn_on_filestore_osds = false 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: mon down mkfs grace = 300 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: mon op complaint time = 120 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout:[client] 2024-04-20T10:49:41.702 INFO:teuthology.orchestra.run.smithi090.stdout: rgw cache enabled = true 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable ops log = true 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: rgw enable usage log = true 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: client mount timeout = 600 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: client_shutdown_timeout = 120 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: debug client = 20 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.a] 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.b] 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout:[mon.c] 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-04-20T10:49:41.703 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout:[mds] 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds = 20 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: debug mds balancer = 20 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: debug ms = 1 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal fragment size max = 10000 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal merge size = 5 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split bits = 3 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds bal split size = 100 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug frag = True 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds debug scatterstat = True 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds op complaint time = 180 2024-04-20T10:49:41.704 INFO:teuthology.orchestra.run.smithi090.stdout: mds verify scatter = True 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: mon client directed command retry = 5 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay max = 1 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay probability = 0.005 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject delay type = client mds osd 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: ms inject socket failures = 2500 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: osd op complaint time = 180 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: rados mon op timeout = 900 2024-04-20T10:49:41.705 INFO:teuthology.orchestra.run.smithi090.stdout: rados osd op timeout = 900 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout:[global] 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: chdir = "" 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: auth supported = cephx 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: filestore xattr use omap = true 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: mon clock drift allowed = 1.000 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: osd crush chooseleaf type = 0 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: auth debug = true 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.707 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on old message = true 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on bug = true 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: mon pg warn max object skew = 0 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: # disable pg_autoscaler by default for new pools 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default size = 2 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow primary affinity = true 2024-04-20T10:49:41.708 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd allow pg remap = true 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on legacy crush tunables = false 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on crush straw calc version zero = false 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on no sortbitwise = false 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on osd down out interval zero = false 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon warn on too few osds = false 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon_allow_pool_size_one = true 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: osd default data pool replay window = 5 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon allow pool delete = true 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.709 INFO:teuthology.orchestra.run.smithi175.stdout: mon cluster log file level = debug 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: debug asserts on shutdown = true 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: mon health detail to clog = false 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: mon host = "172.21.15.90,172.21.15.175,[v2:172.21.15.175:3301,v1:172.21.15.175:6790]" 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: ms die on skipped message = False 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: fsid = 83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout:[osd] 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: osd journal size = 100 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub load threshold = 5.0 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: osd scrub max interval = 600 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: osd mclock profile = high_recovery_ops 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.710 INFO:teuthology.orchestra.run.smithi175.stdout: osd recover clone overlap = true 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd recovery max chunk = 1048576 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug shutdown = true 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug op order = true 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug verify stray on activate = true 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug trim objects = true 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd open classes on start = true 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug pg log writeout = true 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd deep scrub update digest min age = 30 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: osd map max advance = 10 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.711 INFO:teuthology.orchestra.run.smithi175.stdout: journal zero on create = true 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: filestore ondisk finisher threads = 3 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: filestore apply finisher threads = 3 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: bdev debug aio = true 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: osd debug misdirected ops = true 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: bdev async discard = True 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: bdev enable discard = True 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore allocator = bitmap 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore block size = 96636764160 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: bluestore fsck on mount = True 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluefs = 1/20 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: debug bluestore = 1/20 2024-04-20T10:49:41.712 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: debug osd = 20 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: debug rocksdb = 4/10 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: mon client directed command retry = 5 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd backfillfull_ratio = 0.85 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd full ratio = 0.9 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd nearfull ratio = 0.8 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject delay max = 1 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject delay probability = 0.005 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject delay type = client mds 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject socket failures = 2500 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: osd blocked scrub grace period = 3600 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: osd failsafe full ratio = 0.95 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: osd max markdown count = 1000 2024-04-20T10:49:41.713 INFO:teuthology.orchestra.run.smithi175.stdout: osd objectstore = bluestore 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr] 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: debug mgr = 20 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: mgr/telemetry/nag = false 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout:[mon] 2024-04-20T10:49:41.714 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: debug mon = 20 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: debug paxos = 20 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: debug auth = 20 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: mon data avail warn = 5 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: mon mgr mkfs grace = 240 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min pgs per osd = 4 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd reporter subtree level = osd 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: mon osd prime pg temp = true 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: mon reweight min bytes per osd = 10 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: auth mon ticket ttl = 660 # 11m 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: auth service ticket ttl = 240 # 4m 2024-04-20T10:49:41.715 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: # don't complain about insecure global_id in the test suite 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: # 1m isn't quite enough 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: mon_down_mkfs_grace = 2m 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: mon_warn_on_filestore_osds = false 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: mon down mkfs grace = 300 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: mon op complaint time = 120 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout: 2024-04-20T10:49:41.716 INFO:teuthology.orchestra.run.smithi175.stdout:[client] 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: rgw cache enabled = true 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable ops log = true 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: rgw enable usage log = true 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: client mount timeout = 600 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: client_shutdown_timeout = 120 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: debug client = 20 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.a] 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.b] 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout:[mon.c] 2024-04-20T10:49:41.717 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout:[mds] 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds = 20 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: debug mds balancer = 20 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: debug ms = 1 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal fragment size max = 10000 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal merge size = 5 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split bits = 3 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: mds bal split size = 100 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug frag = True 2024-04-20T10:49:41.718 INFO:teuthology.orchestra.run.smithi175.stdout: mds debug scatterstat = True 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: mds op complaint time = 180 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: mds verify scatter = True 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: mon client directed command retry = 5 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject delay max = 1 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject delay probability = 0.005 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject delay type = client mds osd 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: ms inject socket failures = 2500 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: osd op complaint time = 180 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: rados mon op timeout = 900 2024-04-20T10:49:41.719 INFO:teuthology.orchestra.run.smithi175.stdout: rados osd op timeout = 900 2024-04-20T10:49:41.719 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-20T10:49:41.720 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-20T10:49:41.799 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-20T10:49:41.799 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:41.799 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-20T10:49:41.814 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:41.814 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-20T10:49:41.869 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T10:49:41.869 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:41.869 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-20T10:49:41.869 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T10:49:41.941 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:49:41.942 DEBUG:teuthology.orchestra.run.smithi090:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:41.996 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T10:49:41.996 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:41.996 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-20T10:49:41.996 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-20T10:49:42.030 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:49:42.030 DEBUG:teuthology.orchestra.run.smithi175:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:42.084 INFO:tasks.ceph:Setting up mon nodes... 2024-04-20T10:49:42.084 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-20T10:49:42.084 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-20T10:49:42.132 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-20T10:49:42.135 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-20T10:49:42.246 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-20T10:49:42.248 INFO:tasks.ceph:Setting up mds nodes... 2024-04-20T10:49:42.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-20T10:49:42.298 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-20T10:49:42.300 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-20T10:49:42.323 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-20T10:49:42.410 INFO:teuthology.orchestra.run.smithi090.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-20T10:49:42.413 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-20T10:49:42.437 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-20T10:49:42.485 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-20T10:49:42.488 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-20T10:49:42.511 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-20T10:49:42.600 INFO:teuthology.orchestra.run.smithi175.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-20T10:49:42.603 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-20T10:49:42.625 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-20T10:49:42.625 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-20T10:49:42.663 INFO:teuthology.orchestra.run.smithi090.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-20T10:49:42.675 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-20T10:49:42.713 INFO:teuthology.orchestra.run.smithi175.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-20T10:49:42.725 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-20T10:49:42.725 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi090.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi175.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-20T10:49:42.726 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-20T10:49:42.749 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:42.750 INFO:tasks.ceph:role: osd.0 2024-04-20T10:49:42.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T10:49:42.750 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-20T10:49:42.820 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:49:42.820 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:49:42.820 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:49:42.820 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:49:42.820 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:49:42.821 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:49:42.821 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:49:42.821 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:49:42.821 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:49:42.821 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:49:43.337 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-20T10:49:43.339 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-20T10:49:43.340 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-20T10:49:43.465 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-20T10:49:43.495 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-20T10:49:43.558 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:43.558 INFO:tasks.ceph:role: osd.1 2024-04-20T10:49:43.558 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T10:49:43.559 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-20T10:49:43.629 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:49:43.629 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:49:43.629 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:49:43.629 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:49:43.629 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:49:43.629 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:49:43.630 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:49:43.630 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:49:43.630 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:49:43.630 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:49:44.081 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-20T10:49:44.083 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-20T10:49:44.083 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-20T10:49:44.167 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-20T10:49:44.234 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-20T10:49:44.300 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:44.300 INFO:tasks.ceph:role: osd.2 2024-04-20T10:49:44.300 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T10:49:44.301 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-20T10:49:44.371 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:49:44.372 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:49:44.888 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-20T10:49:44.890 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-20T10:49:44.890 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-20T10:49:45.021 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-20T10:49:45.050 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-20T10:49:45.112 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:45.113 INFO:tasks.ceph:role: osd.3 2024-04-20T10:49:45.113 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T10:49:45.113 DEBUG:teuthology.orchestra.run.smithi090:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-20T10:49:45.183 INFO:teuthology.orchestra.run.smithi090.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:49:45.184 INFO:teuthology.orchestra.run.smithi090.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:49:45.700 INFO:teuthology.orchestra.run.smithi090.stdout:Discarding blocks...Done. 2024-04-20T10:49:45.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi090.front.sepia.ceph.com -o noatime 2024-04-20T10:49:45.702 DEBUG:teuthology.orchestra.run.smithi090:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-20T10:49:45.854 DEBUG:teuthology.orchestra.run.smithi090:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-20T10:49:45.886 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:45.995+0000 7f4a4e7a7640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-20T10:49:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:45.995+0000 7f4a4e7a7640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-20T10:49:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:45.996+0000 7f4a4e7a7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T10:49:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:45.996+0000 7f4a4e7a7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T10:49:45.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:45.996+0000 7f4a4e7a7640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-20T10:49:45.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:45.996+0000 7f4a4e7a7640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-20T10:49:48.847 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-20T10:49:48.875 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:48.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:48.964+0000 7fdb6f207640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-20T10:49:48.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:48.965+0000 7fdb6f207640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-20T10:49:48.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:48.965+0000 7fdb6f207640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T10:49:48.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:48.965+0000 7fdb6f207640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T10:49:48.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:48.965+0000 7fdb6f207640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-20T10:49:48.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:48.965+0000 7fdb6f207640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-20T10:49:51.830 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-20T10:49:51.858 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:51.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:51.946+0000 7f24c0f01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-20T10:49:51.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:51.946+0000 7f24c0f01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-20T10:49:51.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:51.946+0000 7f24c0f01640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T10:49:51.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:51.946+0000 7f24c0f01640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T10:49:51.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:51.946+0000 7f24c0f01640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-20T10:49:51.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:51.947+0000 7f24c0f01640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-20T10:49:54.795 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-20T10:49:54.822 DEBUG:teuthology.orchestra.run.smithi090:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:49:54.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:54.905+0000 7f55ffe15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-20T10:49:54.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:54.906+0000 7f55ffe15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-20T10:49:54.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:54.906+0000 7f55ffe15640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T10:49:54.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:54.906+0000 7f55ffe15640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T10:49:54.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:54.906+0000 7f55ffe15640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-20T10:49:54.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:49:54.906+0000 7f55ffe15640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-20T10:49:57.761 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-20T10:49:57.830 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-20T10:49:57.859 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:57.860 INFO:tasks.ceph:role: osd.4 2024-04-20T10:49:57.860 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T10:49:57.860 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-20T10:49:57.934 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:49:57.934 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:49:57.935 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:49:58.455 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-20T10:49:58.457 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-20T10:49:58.457 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-20T10:49:58.607 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-20T10:49:58.643 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-20T10:49:58.710 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:58.710 INFO:tasks.ceph:role: osd.5 2024-04-20T10:49:58.710 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T10:49:58.711 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-20T10:49:58.782 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:49:58.782 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:49:58.782 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:49:58.782 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:49:58.783 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:49:58.783 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:49:58.783 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:49:58.783 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:49:58.783 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:49:58.783 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:49:59.224 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-20T10:49:59.227 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-20T10:49:59.227 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-20T10:49:59.310 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-20T10:49:59.380 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-20T10:49:59.443 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T10:49:59.443 INFO:tasks.ceph:role: osd.6 2024-04-20T10:49:59.443 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T10:49:59.444 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-20T10:49:59.514 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:49:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:49:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:49:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:49:59.514 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:49:59.514 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:49:59.515 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:49:59.515 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:49:59.515 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:49:59.515 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:50:00.006 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-20T10:50:00.008 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-20T10:50:00.009 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-20T10:50:00.127 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-20T10:50:00.154 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-20T10:50:00.217 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-20T10:50:00.217 INFO:tasks.ceph:role: osd.7 2024-04-20T10:50:00.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T10:50:00.217 DEBUG:teuthology.orchestra.run.smithi175:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: = sunit=0 swidth=0 blks 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-20T10:50:00.289 INFO:teuthology.orchestra.run.smithi175.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-20T10:50:00.792 INFO:teuthology.orchestra.run.smithi175.stdout:Discarding blocks...Done. 2024-04-20T10:50:00.794 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi175.front.sepia.ceph.com -o noatime 2024-04-20T10:50:00.794 DEBUG:teuthology.orchestra.run.smithi175:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-20T10:50:00.920 DEBUG:teuthology.orchestra.run.smithi175:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-20T10:50:00.951 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:50:01.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:01.038+0000 7f6cb6463640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-20T10:50:01.038 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:01.038+0000 7f6cb6463640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-20T10:50:01.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:01.038+0000 7f6cb6463640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T10:50:01.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:01.038+0000 7f6cb6463640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T10:50:01.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:01.038+0000 7f6cb6463640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-20T10:50:01.039 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:01.039+0000 7f6cb6463640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-20T10:50:03.891 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-20T10:50:03.915 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:50:04.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:03.999+0000 7f2353816640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-20T10:50:04.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:03.999+0000 7f2353816640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-20T10:50:04.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:03.999+0000 7f2353816640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T10:50:04.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:03.999+0000 7f2353816640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T10:50:04.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:03.999+0000 7f2353816640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-20T10:50:04.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:04.000+0000 7f2353816640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-20T10:50:06.848 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-20T10:50:06.915 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:50:07.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:06.999+0000 7f72f2d01640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-20T10:50:07.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:07.000+0000 7f72f2d01640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-20T10:50:07.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:07.000+0000 7f72f2d01640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-20T10:50:07.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:07.000+0000 7f72f2d01640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-20T10:50:07.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:07.000+0000 7f72f2d01640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-20T10:50:07.000 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:07.000+0000 7f72f2d01640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-20T10:50:09.741 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:50:09.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:50:09.851 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-20T10:50:09.876 DEBUG:teuthology.orchestra.run.smithi175:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:50:09.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:09.962+0000 7ff01380e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-20T10:50:09.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:09.963+0000 7ff01380e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-20T10:50:09.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:09.963+0000 7ff01380e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-20T10:50:09.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:09.963+0000 7ff01380e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-20T10:50:09.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:09.963+0000 7ff01380e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-20T10:50:09.963 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:09.963+0000 7ff01380e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-20T10:50:12.816 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-20T10:50:12.844 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-20T10:50:12.844 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:12.844 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-20T10:50:12.873 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:12.874 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-20T10:50:12.942 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:12.942 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-20T10:50:13.008 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:13.008 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-20T10:50:13.075 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:13.075 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-20T10:50:13.140 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:13.140 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-20T10:50:13.204 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:13.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-20T10:50:13.269 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.269 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-20T10:50:13.297 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.298 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-20T10:50:13.366 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.366 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-20T10:50:13.433 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.433 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-20T10:50:13.500 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-20T10:50:13.566 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.567 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-20T10:50:13.632 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.632 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-20T10:50:13.696 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:13.716 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-20T10:50:13.734 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:13.735 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-20T10:50:13.752 INFO:tasks.ceph:Adding keys to all mons... 2024-04-20T10:50:13.752 DEBUG:teuthology.orchestra.run.smithi090:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-20T10:50:13.777 DEBUG:teuthology.orchestra.run.smithi175:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-20T10:50:13.799 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.y] 2024-04-20T10:50:13.799 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNmM0v7BxAAy8l/scrQOGkqrWZuLRfpyA== 2024-04-20T10:50:13.799 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.a] 2024-04-20T10:50:13.799 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNmckHUERAAngxZuxpABgKToO0cjxqNCQ== 2024-04-20T10:50:13.799 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.c] 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNmOQ6OGBAAxL9dYwdJWCuUteNJB+gZdg== 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.0] 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDJnSNmHad2OxAAe4zTNtRfDb7TY1z6EWo4tQ== 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.1] 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDMnSNmr42eORAAOgAq3u9MhuqM40/V8CD7rg== 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.2] 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDPnSNmlOhyOBAAOxl4c/OPdVUpjNKsCoUrbg== 2024-04-20T10:50:13.800 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.3] 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDSnSNmDz0KNhAA8MNGoZXNODQmanlTYlO3Sg== 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout:[mgr.x] 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNmeJu9DhAAJXD1p6wa2HcoKE61g6LQuQ== 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.b] 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNmK90BHRAAeE/9XSMWxLDKukVAEhTO+A== 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout:[mds.d] 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNm66PbIxAAzK2v8tW3xxak5TDrN6OsKQ== 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.4] 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDZnSNmNjxUAhAA2LNOn/IB7A8KlrUSsBewXw== 2024-04-20T10:50:13.801 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.5] 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDcnSNmZkcFABAAFXtlAMa8ukP4jsEdzmJz/Q== 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.6] 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDfnSNmvxYLABAApGoxZSB+BvpLp98MUjJMQA== 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout:[osd.7] 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDhnSNm4aFvORAAiRwqYL+B9pRAq9iDzvbHJQ== 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout:[client.0] 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNmygmgJxAA1IRcYwmpVSrJ5Ocde7z9Ew== 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout:[client.1] 2024-04-20T10:50:13.802 INFO:teuthology.orchestra.run.smithi090.stdout: key = AQDGnSNmT5qaKhAA1pFbr8+Rqg3MlQAVJamzQw== 2024-04-20T10:50:13.815 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.y] 2024-04-20T10:50:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNmM0v7BxAAy8l/scrQOGkqrWZuLRfpyA== 2024-04-20T10:50:13.815 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.a] 2024-04-20T10:50:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNmckHUERAAngxZuxpABgKToO0cjxqNCQ== 2024-04-20T10:50:13.815 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.c] 2024-04-20T10:50:13.815 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNmOQ6OGBAAxL9dYwdJWCuUteNJB+gZdg== 2024-04-20T10:50:13.815 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.0] 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDJnSNmHad2OxAAe4zTNtRfDb7TY1z6EWo4tQ== 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.1] 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDMnSNmr42eORAAOgAq3u9MhuqM40/V8CD7rg== 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.2] 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDPnSNmlOhyOBAAOxl4c/OPdVUpjNKsCoUrbg== 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.3] 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDSnSNmDz0KNhAA8MNGoZXNODQmanlTYlO3Sg== 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout:[mgr.x] 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNmeJu9DhAAJXD1p6wa2HcoKE61g6LQuQ== 2024-04-20T10:50:13.816 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.b] 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNmK90BHRAAeE/9XSMWxLDKukVAEhTO+A== 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout:[mds.d] 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNm66PbIxAAzK2v8tW3xxak5TDrN6OsKQ== 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.4] 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDZnSNmNjxUAhAA2LNOn/IB7A8KlrUSsBewXw== 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.5] 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDcnSNmZkcFABAAFXtlAMa8ukP4jsEdzmJz/Q== 2024-04-20T10:50:13.817 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.6] 2024-04-20T10:50:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDfnSNmvxYLABAApGoxZSB+BvpLp98MUjJMQA== 2024-04-20T10:50:13.818 INFO:teuthology.orchestra.run.smithi175.stdout:[osd.7] 2024-04-20T10:50:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDhnSNm4aFvORAAiRwqYL+B9pRAq9iDzvbHJQ== 2024-04-20T10:50:13.818 INFO:teuthology.orchestra.run.smithi175.stdout:[client.0] 2024-04-20T10:50:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNmygmgJxAA1IRcYwmpVSrJ5Ocde7z9Ew== 2024-04-20T10:50:13.818 INFO:teuthology.orchestra.run.smithi175.stdout:[client.1] 2024-04-20T10:50:13.818 INFO:teuthology.orchestra.run.smithi175.stdout: key = AQDGnSNmT5qaKhAA1pFbr8+Rqg3MlQAVJamzQw== 2024-04-20T10:50:13.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T10:50:13.846 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T10:50:13.909 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:13.912 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:13.964 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:13.966 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:14.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.020 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.069 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.072 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.122 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.171 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.174 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T10:50:14.225 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-20T10:50:14.272 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:14.275 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:14.328 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:14.330 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-20T10:50:14.382 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.384 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.432 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.434 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.484 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.487 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.535 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.538 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-20T10:50:14.587 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T10:50:14.589 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T10:50:14.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T10:50:14.644 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-20T10:50:14.696 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-20T10:50:14.697 DEBUG:teuthology.orchestra.run.smithi090:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-20T10:50:14.720 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-20T10:50:14.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-20T10:50:14.836 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-20T10:50:14.861 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-20T10:50:14.957 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-20T10:50:14.980 DEBUG:teuthology.orchestra.run.smithi175:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-20T10:50:15.043 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-20T10:50:15.139 DEBUG:teuthology.orchestra.run.smithi175:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-20T10:50:15.162 DEBUG:teuthology.orchestra.run.smithi090:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:50:15.165 DEBUG:teuthology.orchestra.run.smithi175:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-20T10:50:15.218 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-20T10:50:15.219 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-20T10:50:15.219 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-20T10:50:15.222 INFO:tasks.ceph.mon.a:Started 2024-04-20T10:50:15.222 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-20T10:50:15.222 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-20T10:50:15.260 INFO:tasks.ceph.mon.b:Started 2024-04-20T10:50:15.261 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-20T10:50:15.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-20T10:50:15.263 INFO:tasks.ceph.mon.c:Started 2024-04-20T10:50:15.263 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-20T10:50:15.264 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-20T10:50:15.267 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-20T10:50:15.269 INFO:tasks.ceph.mgr.y:Started 2024-04-20T10:50:15.269 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-20T10:50:15.270 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-20T10:50:15.272 INFO:tasks.ceph.mgr.x:Started 2024-04-20T10:50:15.272 INFO:tasks.ceph:Setting crush tunables to default 2024-04-20T10:50:15.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph osd crush tunables default 2024-04-20T10:50:15.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.371+0000 7ff78d996640 1 Processor -- start 2024-04-20T10:50:15.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.371+0000 7ff78d996640 1 -- start start 2024-04-20T10:50:15.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff78d996640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 0x7ff788153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:15.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff78d996640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 0x7ff7880c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff78d996640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 0x7ff78806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff78d996640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff788071fa0 con 0x7ff788150c00 2024-04-20T10:50:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff78d996640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff788153500 con 0x7ff78806ca40 2024-04-20T10:50:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff78d996640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff78806ced0 con 0x7ff78806f330 2024-04-20T10:50:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff786ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 0x7ff788153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff786ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 0x7ff788153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52296/0 (socket says 172.21.15.90:52296) 2024-04-20T10:50:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff786ffd640 1 -- 172.21.15.90:0/2645985534 learned_addr learned my addr 172.21.15.90:0/2645985534 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff7877fe640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 0x7ff78806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff786ffd640 1 -- 172.21.15.90:0/2645985534 >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 msgr2=0x7ff788153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-20T10:50:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff786ffd640 1 -- 172.21.15.90:0/2645985534 >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 msgr2=0x7ff788153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-20T10:50:15.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff786ffd640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 0x7ff788153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T10:50:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff77ffff640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 0x7ff7880c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff786ffd640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 0x7ff788153fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T10:50:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff77ffff640 1 -- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 msgr2=0x7ff7880c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-20T10:50:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff77ffff640 1 -- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 msgr2=0x7ff7880c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-20T10:50:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff7877fe640 1 -- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 msgr2=0x7ff78806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-20T10:50:15.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff77ffff640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 0x7ff7880c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T10:50:15.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff7877fe640 1 -- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 msgr2=0x7ff78806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-20T10:50:15.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff7877fe640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 0x7ff78806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T10:50:15.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff77ffff640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 0x7ff7880c3b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T10:50:15.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.372+0000 7ff7877fe640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 0x7ff78806d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T10:50:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff786ffd640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.90:3300/0 conn(0x7ff788150c00 0x7ff788153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff7877fe640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 0x7ff78806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff77ffff640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 0x7ff7880c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff786ffd640 1 -- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 msgr2=0x7ff78806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff786ffd640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 0x7ff78806d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff786ffd640 1 -- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 msgr2=0x7ff7880c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff786ffd640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 0x7ff7880c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.573+0000 7ff786ffd640 1 -- 172.21.15.90:0/2645985534 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7881537a0 con 0x7ff788150c00 2024-04-20T10:50:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.574+0000 7ff786ffd640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff788153fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff788071a30 tx=0x7ff77802e7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e7aa458b1c251b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.574+0000 7ff7867fc640 1 -- 172.21.15.90:0/2645985534 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778034710 con 0x7ff788150c00 2024-04-20T10:50:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.574+0000 7ff7867fc640 1 -- 172.21.15.90:0/2645985534 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7780348b0 con 0x7ff788150c00 2024-04-20T10:50:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.574+0000 7ff7867fc640 1 -- 172.21.15.90:0/2645985534 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff778034ca0 con 0x7ff788150c00 2024-04-20T10:50:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 -- 172.21.15.90:0/2645985534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 msgr2=0x7ff788153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:15.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff788153fa0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff788071a30 tx=0x7ff77802e7b0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 -- 172.21.15.90:0/2645985534 shutdown_connections 2024-04-20T10:50:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 --2- 172.21.15.90:0/2645985534 >> v2:172.21.15.175:3300/0 conn(0x7ff78806ca40 0x7ff7880c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff78806f330 0x7ff78806d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 --2- 172.21.15.90:0/2645985534 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff788153fa0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 -- 172.21.15.90:0/2645985534 >> 172.21.15.90:0/2645985534 conn(0x7ff7880c9100 msgr2=0x7ff7880c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 -- 172.21.15.90:0/2645985534 shutdown_connections 2024-04-20T10:50:15.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.575+0000 7ff78d996640 1 -- 172.21.15.90:0/2645985534 wait complete. 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 Processor -- start 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 -- start start 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78806f330 0x7ff788141470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff7881419b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7880acda0 0x7ff78814c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff7880c4040 con 0x7ff788150c00 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff78806d1b0 con 0x7ff78806f330 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.576+0000 7ff78d996640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff7880c41c0 con 0x7ff7880acda0 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff7881419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff7881419b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38084/0 (socket says 172.21.15.90:38084) 2024-04-20T10:50:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 -- 172.21.15.90:0/1304354110 learned_addr learned my addr 172.21.15.90:0/1304354110 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff786ffd640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78806f330 0x7ff788141470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff7877fe640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7880acda0 0x7ff78814c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 -- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7880acda0 msgr2=0x7ff78814c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7880acda0 0x7ff78814c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 -- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78806f330 msgr2=0x7ff788141470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78806f330 0x7ff788141470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 -- 172.21.15.90:0/1304354110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff78814d410 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff786ffd640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78806f330 0x7ff788141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff77ffff640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff7881419b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff77000b730 tx=0x7ff77000bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff784ff9640 1 -- 172.21.15.90:0/1304354110 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770018070 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff784ff9640 1 -- 172.21.15.90:0/1304354110 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff770010830 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff78814d6f0 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff784ff9640 1 -- 172.21.15.90:0/1304354110 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff770010c00 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.577+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7880af090 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.578+0000 7ff784ff9640 1 -- 172.21.15.90:0/1304354110 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff77001b070 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.578+0000 7ff784ff9640 1 -- 172.21.15.90:0/1304354110 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff770014770 con 0x7ff788150c00 2024-04-20T10:50:15.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.578+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff788076150 con 0x7ff788150c00 2024-04-20T10:50:15.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.581+0000 7ff784ff9640 1 -- 172.21.15.90:0/1304354110 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7ff770014970 con 0x7ff788150c00 2024-04-20T10:50:15.634 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:15.633+0000 7fcfe5221040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T10:50:15.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.644+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7ff788072170 con 0x7ff788150c00 2024-04-20T10:50:15.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.646+0000 7ff784ff9640 1 -- 172.21.15.90:0/1304354110 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7ff770014b50 con 0x7ff788150c00 2024-04-20T10:50:15.646 INFO:teuthology.orchestra.run.smithi090.stderr:adjusted tunables profile to default 2024-04-20T10:50:15.646 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:15.646+0000 7fcbc4e38040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-20T10:50:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 msgr2=0x7ff7881419b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff7881419b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff77000b730 tx=0x7ff77000bbf0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 shutdown_connections 2024-04-20T10:50:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff7880acda0 0x7ff78814c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff788150c00 0x7ff7881419b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 --2- 172.21.15.90:0/1304354110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff78806f330 0x7ff788141470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 >> 172.21.15.90:0/1304354110 conn(0x7ff7880c9100 msgr2=0x7ff78814dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 shutdown_connections 2024-04-20T10:50:15.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:15.647+0000 7ff78d996640 1 -- 172.21.15.90:0/1304354110 wait complete. 2024-04-20T10:50:15.658 INFO:tasks.ceph:check_enable_crimson: False 2024-04-20T10:50:15.658 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-20T10:50:15.658 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:15.658 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-20T10:50:15.683 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:15.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-20T10:50:15.747 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:15.747 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-20T10:50:15.798 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:15.797+0000 7fcfe5221040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T10:50:15.803 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:15.803+0000 7fcbc4e38040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-20T10:50:15.812 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:50:15.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-20T10:50:15.851 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:15.850+0000 7fcfe5221040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T10:50:15.858 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:15.858+0000 7fcbc4e38040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-20T10:50:15.875 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:15.875 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-20T10:50:15.899 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:15.899 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-20T10:50:15.964 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:15.964 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-20T10:50:16.027 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:50:16.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-20T10:50:16.091 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new a07588d6-ff96-4dbd-8b92-3610a5577245 0 2024-04-20T10:50:16.105 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:16.105+0000 7fcbc4e38040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T10:50:16.111 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:16.110+0000 7fcfe5221040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-20T10:50:16.149 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:16.149+0000 7fcbc4e38040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T10:50:16.159 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:16.158+0000 7fcfe5221040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-20T10:50:16.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.207+0000 7efe02df4640 1 Processor -- start 2024-04-20T10:50:16.208 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.207+0000 7efe02df4640 1 -- start start 2024-04-20T10:50:16.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe02df4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc151b10 0x7efdfc0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe02df4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efdfc0c51d0 0x7efdfc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe02df4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdfc1587c0 con 0x7efdfc0adc10 2024-04-20T10:50:16.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe02df4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7efdfc0c4d40 con 0x7efdfc0c51d0 2024-04-20T10:50:16.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe02df4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc151ef0 con 0x7efdfc151b10 2024-04-20T10:50:16.210 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe00b90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc151b10 0x7efdfc0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe00b90640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc151b10 0x7efdfc0ad6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:57946/0 (socket says 172.21.15.175:57946) 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe00b90640 1 -- 172.21.15.175:0/3628272944 learned_addr learned my addr 172.21.15.175:0/3628272944 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efdfbfff640 1 --2- 172.21.15.175:0/3628272944 >> v2:172.21.15.90:3300/0 conn(0x7efdfc0c51d0 0x7efdfc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe00b90640 1 -- 172.21.15.175:0/3628272944 >> v2:172.21.15.90:3300/0 conn(0x7efdfc0c51d0 msgr2=0x7efdfc157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe00b90640 1 --2- 172.21.15.175:0/3628272944 >> v2:172.21.15.90:3300/0 conn(0x7efdfc0c51d0 0x7efdfc157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe00b90640 1 -- 172.21.15.175:0/3628272944 >> v1:172.21.15.90:6789/0 conn(0x7efdfc0adc10 legacy=0x7efdfc157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.208+0000 7efe00b90640 1 -- 172.21.15.175:0/3628272944 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc0c46f0 con 0x7efdfc151b10 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.209+0000 7efe00b90640 1 --2- 172.21.15.175:0/3628272944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc151b10 0x7efdfc0ad6d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009870 tx=0x7efdf002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0dff5063b22aef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.209+0000 7efdfb7fe640 1 -- 172.21.15.175:0/3628272944 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf00317c0 con 0x7efdfc151b10 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.209+0000 7efdfb7fe640 1 -- 172.21.15.175:0/3628272944 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdf0037070 con 0x7efdfc151b10 2024-04-20T10:50:16.211 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.209+0000 7efdfb7fe640 1 -- 172.21.15.175:0/3628272944 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf0031b80 con 0x7efdfc151b10 2024-04-20T10:50:16.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 -- 172.21.15.175:0/3628272944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc151b10 msgr2=0x7efdfc0ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 --2- 172.21.15.175:0/3628272944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc151b10 0x7efdfc0ad6d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efdf0009870 tx=0x7efdf002b860 comp rx=0 tx=0).stop 2024-04-20T10:50:16.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 -- 172.21.15.175:0/3628272944 shutdown_connections 2024-04-20T10:50:16.212 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 --2- 172.21.15.175:0/3628272944 >> v2:172.21.15.90:3300/0 conn(0x7efdfc0c51d0 0x7efdfc157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 --2- 172.21.15.175:0/3628272944 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc151b10 0x7efdfc0ad6d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 -- 172.21.15.175:0/3628272944 >> 172.21.15.175:0/3628272944 conn(0x7efdfc0c9100 msgr2=0x7efdfc0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 -- 172.21.15.175:0/3628272944 shutdown_connections 2024-04-20T10:50:16.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.210+0000 7efe02df4640 1 -- 172.21.15.175:0/3628272944 wait complete. 2024-04-20T10:50:16.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.211+0000 7efe02df4640 1 Processor -- start 2024-04-20T10:50:16.213 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.211+0000 7efe02df4640 1 -- start start 2024-04-20T10:50:16.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe02df4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdfc0adc10 0x7efdfc0c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe02df4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc0c51d0 0x7efdfc147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe02df4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdfc151b10 0x7efdfc148000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe02df4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc06bab0 con 0x7efdfc151b10 2024-04-20T10:50:16.216 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe02df4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc06b930 con 0x7efdfc0adc10 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe02df4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc06bc30 con 0x7efdfc0c51d0 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc0c51d0 0x7efdfc147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc0c51d0 0x7efdfc147ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:57956/0 (socket says 172.21.15.175:57956) 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 -- 172.21.15.175:0/3903694002 learned_addr learned my addr 172.21.15.175:0/3903694002 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe00b90640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdfc0adc10 0x7efdfc0c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe01391640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdfc151b10 0x7efdfc148000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 -- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdfc0adc10 msgr2=0x7efdfc0c27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdfc0adc10 0x7efdfc0c27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 -- 172.21.15.175:0/3903694002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdfc151b10 msgr2=0x7efdfc148000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdfc151b10 0x7efdfc148000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efdfbfff640 1 -- 172.21.15.175:0/3903694002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc14f080 con 0x7efdfc0c51d0 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.212+0000 7efe00b90640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdfc0adc10 0x7efdfc0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efdfbfff640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc0c51d0 0x7efdfc147ac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efde800d830 tx=0x7efde800dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.217 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efdf97fa640 1 -- 172.21.15.175:0/3903694002 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde800b6c0 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efdf97fa640 1 -- 172.21.15.175:0/3903694002 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efde8019070 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc14d6e0 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efdf97fa640 1 -- 172.21.15.175:0/3903694002 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efde800bac0 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc14dca0 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efdf97fa640 1 -- 172.21.15.175:0/3903694002 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7efde800bc60 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.213+0000 7efdf97fa640 1 -- 172.21.15.175:0/3903694002 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7efde80145b0 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.214+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc076150 con 0x7efdfc0c51d0 2024-04-20T10:50:16.218 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.216+0000 7efdf97fa640 1 -- 172.21.15.175:0/3903694002 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7efde8014a70 con 0x7efdfc0c51d0 2024-04-20T10:50:16.290 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.289+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a07588d6-ff96-4dbd-8b92-3610a5577245", "id": 0} v 0) -- 0x7efdfc0ac970 con 0x7efdfc0c51d0 2024-04-20T10:50:16.293 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.292+0000 7efdf97fa640 1 -- 172.21.15.175:0/3903694002 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a07588d6-ff96-4dbd-8b92-3610a5577245", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7efde8014d80 con 0x7efdfc0c51d0 2024-04-20T10:50:16.293 INFO:teuthology.orchestra.run.smithi175.stdout:0 2024-04-20T10:50:16.294 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc0c51d0 msgr2=0x7efdfc147ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc0c51d0 0x7efdfc147ac0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efde800d830 tx=0x7efde800dcf0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 shutdown_connections 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efdfc151b10 0x7efdfc148000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efdfc0c51d0 0x7efdfc147ac0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 --2- 172.21.15.175:0/3903694002 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efdfc0adc10 0x7efdfc0c27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 >> 172.21.15.175:0/3903694002 conn(0x7efdfc0c9100 msgr2=0x7efdfc150060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 shutdown_connections 2024-04-20T10:50:16.295 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.293+0000 7efe02df4640 1 -- 172.21.15.175:0/3903694002 wait complete. 2024-04-20T10:50:16.305 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 42a8c936-eb5c-49d3-867f-e693d91be8e1 1 2024-04-20T10:50:16.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec58a74640 1 Processor -- start 2024-04-20T10:50:16.402 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec58a74640 1 -- start start 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec58a74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec58a74640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fec5406f330 0x7fec5406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec58a74640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fec54071fa0 con 0x7fec5406ca40 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec58a74640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fec540c4210 con 0x7fec5406f330 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec58a74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fec54153500 con 0x7fec54150c00 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.401+0000 7fec5259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.402+0000 7fec5259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:57970/0 (socket says 172.21.15.175:57970) 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.402+0000 7fec5259c640 1 -- 172.21.15.175:0/2903489674 learned_addr learned my addr 172.21.15.175:0/2903489674 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.402+0000 7fec52d9d640 1 --2- 172.21.15.175:0/2903489674 >> v2:172.21.15.90:3300/0 conn(0x7fec5406f330 0x7fec5406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.402+0000 7fec5259c640 1 -- 172.21.15.175:0/2903489674 >> v2:172.21.15.90:3300/0 conn(0x7fec5406f330 msgr2=0x7fec5406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.402+0000 7fec5259c640 1 --2- 172.21.15.175:0/2903489674 >> v2:172.21.15.90:3300/0 conn(0x7fec5406f330 0x7fec5406d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.402+0000 7fec5259c640 1 -- 172.21.15.175:0/2903489674 >> v1:172.21.15.90:6789/0 conn(0x7fec5406ca40 legacy=0x7fec540c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.404 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.402+0000 7fec5259c640 1 -- 172.21.15.175:0/2903489674 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec5406ced0 con 0x7fec54150c00 2024-04-20T10:50:16.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec5259c640 1 --2- 172.21.15.175:0/2903489674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54153fa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fec44009870 tx=0x7fec4402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc769a20ab2a3f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec51d9b640 1 -- 172.21.15.175:0/2903489674 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44034070 con 0x7fec54150c00 2024-04-20T10:50:16.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec51d9b640 1 -- 172.21.15.175:0/2903489674 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44030840 con 0x7fec54150c00 2024-04-20T10:50:16.405 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec51d9b640 1 -- 172.21.15.175:0/2903489674 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44030c10 con 0x7fec54150c00 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 -- 172.21.15.175:0/2903489674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 msgr2=0x7fec54153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 --2- 172.21.15.175:0/2903489674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54153fa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fec44009870 tx=0x7fec4402b980 comp rx=0 tx=0).stop 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 -- 172.21.15.175:0/2903489674 shutdown_connections 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 --2- 172.21.15.175:0/2903489674 >> v2:172.21.15.90:3300/0 conn(0x7fec5406f330 0x7fec5406d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 --2- 172.21.15.175:0/2903489674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54153fa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 -- 172.21.15.175:0/2903489674 >> 172.21.15.175:0/2903489674 conn(0x7fec540c9100 msgr2=0x7fec540c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 -- 172.21.15.175:0/2903489674 shutdown_connections 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.403+0000 7fec58a74640 1 -- 172.21.15.175:0/2903489674 wait complete. 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 Processor -- start 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 -- start start 2024-04-20T10:50:16.408 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5406f330 0x7fec5414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54156690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec5414f230 0x7fec54156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fec5406d1b0 con 0x7fec5414f230 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fec54153a80 con 0x7fec5406f330 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec58a74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fec54072fb0 con 0x7fec54150c00 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec5259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5406f330 0x7fec5414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec5259c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5406f330 0x7fec5414c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49090/0 (socket says 172.21.15.175:49090) 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec5259c640 1 -- 172.21.15.175:0/2221029549 learned_addr learned my addr 172.21.15.175:0/2221029549 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.405+0000 7fec4bfff640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54156690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec52d9d640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec5414f230 0x7fec54156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec5259c640 1 -- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 msgr2=0x7fec54156690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec5259c640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54156690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec5259c640 1 -- 172.21.15.175:0/2221029549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec5414f230 msgr2=0x7fec54156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.409 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec5259c640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec5414f230 0x7fec54156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec5259c640 1 -- 172.21.15.175:0/2221029549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec541ec890 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec5259c640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5406f330 0x7fec5414c430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec44000c00 tx=0x7fec440046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec4affd640 1 -- 172.21.15.175:0/2221029549 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44034040 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec4affd640 1 -- 172.21.15.175:0/2221029549 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fec44039d90 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec541ecb70 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec4affd640 1 -- 172.21.15.175:0/2221029549 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec44043630 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec541ed130 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec4affd640 1 -- 172.21.15.175:0/2221029549 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fec4404a060 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.406+0000 7fec4affd640 1 -- 172.21.15.175:0/2221029549 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fec4404c800 con 0x7fec5406f330 2024-04-20T10:50:16.410 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.407+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec54076150 con 0x7fec5406f330 2024-04-20T10:50:16.411 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.409+0000 7fec4affd640 1 -- 172.21.15.175:0/2221029549 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fec44051020 con 0x7fec5406f330 2024-04-20T10:50:16.482 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.481+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "42a8c936-eb5c-49d3-867f-e693d91be8e1", "id": 1} v 0) -- 0x7fec54072170 con 0x7fec5406f330 2024-04-20T10:50:16.488 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec4affd640 1 -- 172.21.15.175:0/2221029549 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "42a8c936-eb5c-49d3-867f-e693d91be8e1", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fec4403e070 con 0x7fec5406f330 2024-04-20T10:50:16.489 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5406f330 msgr2=0x7fec5414c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5406f330 0x7fec5414c430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fec44000c00 tx=0x7fec440046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 shutdown_connections 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fec5414f230 0x7fec54156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fec54150c00 0x7fec54156690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 --2- 172.21.15.175:0/2221029549 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fec5406f330 0x7fec5414c430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 >> 172.21.15.175:0/2221029549 conn(0x7fec540c9100 msgr2=0x7fec540c3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 shutdown_connections 2024-04-20T10:50:16.490 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.488+0000 7fec58a74640 1 -- 172.21.15.175:0/2221029549 wait complete. 2024-04-20T10:50:16.500 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 1e9b2774-f6ee-468d-82ea-d8a62711c355 2 2024-04-20T10:50:16.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.598+0000 7fba8833d640 1 Processor -- start 2024-04-20T10:50:16.599 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.598+0000 7fba8833d640 1 -- start start 2024-04-20T10:50:16.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba8833d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fba800c5580 0x7fba800ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.600 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba8833d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba800c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba8833d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba80071570 con 0x7fba80153ce0 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba8833d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fba800717e0 con 0x7fba800c5580 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba8833d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fba800c3ba0 con 0x7fba800c43a0 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba868da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba800c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba860d9640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fba80153ce0 0x7fba8015a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45426/0 (socket says 172.21.15.175:45426) 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba860d9640 1 -- 172.21.15.175:0/2682373611 learned_addr learned my addr 172.21.15.175:0/2682373611 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba858d8640 1 --2- 172.21.15.175:0/2682373611 >> v2:172.21.15.90:3300/0 conn(0x7fba800c5580 0x7fba800ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba850d7640 1 -- 172.21.15.175:0/2682373611 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2280518788 0 0) 0x7fba80071570 con 0x7fba80153ce0 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba850d7640 1 -- 172.21.15.175:0/2682373611 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba6c003520 con 0x7fba80153ce0 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba868da640 1 -- 172.21.15.175:0/2682373611 >> v2:172.21.15.90:3300/0 conn(0x7fba800c5580 msgr2=0x7fba800ad690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba868da640 1 --2- 172.21.15.175:0/2682373611 >> v2:172.21.15.90:3300/0 conn(0x7fba800c5580 0x7fba800ad690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba868da640 1 -- 172.21.15.175:0/2682373611 >> v1:172.21.15.175:6789/0 conn(0x7fba80153ce0 legacy=0x7fba8015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.599+0000 7fba868da640 1 -- 172.21.15.175:0/2682373611 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba800c3e80 con 0x7fba800c43a0 2024-04-20T10:50:16.601 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.600+0000 7fba868da640 1 --2- 172.21.15.175:0/2682373611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba800c2530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba78009d90 tx=0x7fba7802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93fc4fa4e3b2d809 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.600+0000 7fba850d7640 1 -- 172.21.15.175:0/2682373611 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78039070 con 0x7fba800c43a0 2024-04-20T10:50:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.600+0000 7fba850d7640 1 -- 172.21.15.175:0/2682373611 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7802cc50 con 0x7fba800c43a0 2024-04-20T10:50:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.600+0000 7fba850d7640 1 -- 172.21.15.175:0/2682373611 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba78034440 con 0x7fba800c43a0 2024-04-20T10:50:16.605 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.600+0000 7fba8833d640 1 -- 172.21.15.175:0/2682373611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 msgr2=0x7fba800c2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.600+0000 7fba8833d640 1 --2- 172.21.15.175:0/2682373611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba800c2530 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fba78009d90 tx=0x7fba7802bea0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.601+0000 7fba8833d640 1 -- 172.21.15.175:0/2682373611 shutdown_connections 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.601+0000 7fba8833d640 1 --2- 172.21.15.175:0/2682373611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba800c2530 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.601+0000 7fba8833d640 1 --2- 172.21.15.175:0/2682373611 >> v2:172.21.15.90:3300/0 conn(0x7fba800c5580 0x7fba800ad690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.601+0000 7fba8833d640 1 -- 172.21.15.175:0/2682373611 >> 172.21.15.175:0/2682373611 conn(0x7fba800c9100 msgr2=0x7fba800c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.601+0000 7fba8833d640 1 -- 172.21.15.175:0/2682373611 shutdown_connections 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.601+0000 7fba8833d640 1 -- 172.21.15.175:0/2682373611 wait complete. 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 Processor -- start 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 -- start start 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba80157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba800c5580 0x7fba801ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba80153ce0 0x7fba8014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.606 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fba800c4830 con 0x7fba800c5580 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba80071ac0 con 0x7fba80153ce0 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba8833d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fba800c49b0 con 0x7fba800c43a0 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba860d9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba80157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba868da640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba80153ce0 0x7fba8014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba860d9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba80157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:57996/0 (socket says 172.21.15.175:57996) 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.602+0000 7fba860d9640 1 -- 172.21.15.175:0/687825616 learned_addr learned my addr 172.21.15.175:0/687825616 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba858d8640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba800c5580 0x7fba801ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba860d9640 1 -- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba80153ce0 msgr2=0x7fba8014fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba860d9640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba80153ce0 0x7fba8014fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba860d9640 1 -- 172.21.15.175:0/687825616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba800c5580 msgr2=0x7fba801ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba860d9640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba800c5580 0x7fba801ec8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba860d9640 1 -- 172.21.15.175:0/687825616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba80157dd0 con 0x7fba800c43a0 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba868da640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba80153ce0 0x7fba8014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:16.607 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba860d9640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba80157890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00c3c0 tx=0x7fba7c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba76ffd640 1 -- 172.21.15.175:0/687825616 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c017070 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba76ffd640 1 -- 172.21.15.175:0/687825616 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba7c005ce0 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba800c8eb0 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba76ffd640 1 -- 172.21.15.175:0/687825616 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba7c0072f0 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba800c7de0 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba76ffd640 1 -- 172.21.15.175:0/687825616 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fba7c01a070 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.603+0000 7fba76ffd640 1 -- 172.21.15.175:0/687825616 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fba7c012820 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.604+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba800ad1c0 con 0x7fba800c43a0 2024-04-20T10:50:16.608 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.606+0000 7fba76ffd640 1 -- 172.21.15.175:0/687825616 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fba800ad1c0 con 0x7fba800c43a0 2024-04-20T10:50:16.679 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.678+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1e9b2774-f6ee-468d-82ea-d8a62711c355", "id": 2} v 0) -- 0x7fba80076150 con 0x7fba800c43a0 2024-04-20T10:50:16.684 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.684+0000 7fba76ffd640 1 -- 172.21.15.175:0/687825616 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1e9b2774-f6ee-468d-82ea-d8a62711c355", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fba7c021070 con 0x7fba800c43a0 2024-04-20T10:50:16.685 INFO:teuthology.orchestra.run.smithi175.stdout:2 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.684+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 msgr2=0x7fba80157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.684+0000 7fba8833d640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba80157890 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fba7c00c3c0 tx=0x7fba7c00c880 comp rx=0 tx=0).stop 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.685+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 shutdown_connections 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.685+0000 7fba8833d640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba80153ce0 0x7fba8014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.685+0000 7fba8833d640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba800c5580 0x7fba801ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.685+0000 7fba8833d640 1 --2- 172.21.15.175:0/687825616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba800c43a0 0x7fba80157890 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.685+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 >> 172.21.15.175:0/687825616 conn(0x7fba800c9100 msgr2=0x7fba80150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.685+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 shutdown_connections 2024-04-20T10:50:16.686 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.685+0000 7fba8833d640 1 -- 172.21.15.175:0/687825616 wait complete. 2024-04-20T10:50:16.697 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 1dc528a5-b13b-4300-8ca4-8bc6af207152 3 2024-04-20T10:50:16.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.793+0000 7f7679559640 1 Processor -- start 2024-04-20T10:50:16.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.793+0000 7f7679559640 1 -- start start 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7679559640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f76740ab730 0x7f76741568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7679559640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740c9ee0 0x7f7674156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7679559640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767415a720 con 0x7f7674153ef0 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7679559640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f767415ac80 con 0x7f76740ab730 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7679559640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f767415a9a0 con 0x7f76740c9ee0 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f76737fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740c9ee0 0x7f7674156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7672ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f7674153ef0 0x7f76740c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45440/0 (socket says 172.21.15.175:45440) 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f76737fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740c9ee0 0x7f7674156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58010/0 (socket says 172.21.15.175:58010) 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7672ffd640 1 -- 172.21.15.175:0/1565567052 learned_addr learned my addr 172.21.15.175:0/1565567052 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-20T10:50:16.797 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f76727fc640 1 --2- 172.21.15.175:0/1565567052 >> v2:172.21.15.90:3300/0 conn(0x7f76740ab730 0x7f76741568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f7671ffb640 1 -- 172.21.15.175:0/1565567052 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3331702770 0 0) 0x7f7668001110 con 0x7f7674153ef0 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f76737fe640 1 -- 172.21.15.175:0/1565567052 >> v2:172.21.15.90:3300/0 conn(0x7f76740ab730 msgr2=0x7f76741568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f76737fe640 1 --2- 172.21.15.175:0/1565567052 >> v2:172.21.15.90:3300/0 conn(0x7f76740ab730 0x7f76741568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f76737fe640 1 -- 172.21.15.175:0/1565567052 >> v1:172.21.15.175:6789/0 conn(0x7f7674153ef0 legacy=0x7f76740c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.794+0000 7f76737fe640 1 -- 172.21.15.175:0/1565567052 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76740c6a90 con 0x7f76740c9ee0 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.795+0000 7f76737fe640 1 --2- 172.21.15.175:0/1565567052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740c9ee0 0x7f7674156e00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c02bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef3b1fae688bb35 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.795+0000 7f7671ffb640 1 -- 172.21.15.175:0/1565567052 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c039070 con 0x7f76740c9ee0 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.795+0000 7f7671ffb640 1 -- 172.21.15.175:0/1565567052 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f766c02cb30 con 0x7f76740c9ee0 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.795+0000 7f7671ffb640 1 -- 172.21.15.175:0/1565567052 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766c034440 con 0x7f76740c9ee0 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 -- 172.21.15.175:0/1565567052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740c9ee0 msgr2=0x7f7674156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 --2- 172.21.15.175:0/1565567052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740c9ee0 0x7f7674156e00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f766c009d90 tx=0x7f766c02bd80 comp rx=0 tx=0).stop 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 -- 172.21.15.175:0/1565567052 shutdown_connections 2024-04-20T10:50:16.798 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 --2- 172.21.15.175:0/1565567052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740c9ee0 0x7f7674156e00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 --2- 172.21.15.175:0/1565567052 >> v2:172.21.15.90:3300/0 conn(0x7f76740ab730 0x7f76741568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 -- 172.21.15.175:0/1565567052 >> 172.21.15.175:0/1565567052 conn(0x7f76740cbfe0 msgr2=0x7f76740cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 -- 172.21.15.175:0/1565567052 shutdown_connections 2024-04-20T10:50:16.799 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.796+0000 7f7679559640 1 -- 172.21.15.175:0/1565567052 wait complete. 2024-04-20T10:50:16.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.797+0000 7f7679559640 1 Processor -- start 2024-04-20T10:50:16.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.797+0000 7f7679559640 1 -- start start 2024-04-20T10:50:16.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740ab730 0x7f7674159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76740c9ee0 0x7f76741544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7674153ef0 0x7f7674154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76740c9280 con 0x7f7674153ef0 2024-04-20T10:50:16.801 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76740c9100 con 0x7f76740c9ee0 2024-04-20T10:50:16.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f76740bf800 con 0x7f76740ab730 2024-04-20T10:50:16.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740ab730 0x7f7674159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f76727fc640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76740c9ee0 0x7f76741544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740ab730 0x7f7674159270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58012/0 (socket says 172.21.15.175:58012) 2024-04-20T10:50:16.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 -- 172.21.15.175:0/3076763808 learned_addr learned my addr 172.21.15.175:0/3076763808 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f76737fe640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7674153ef0 0x7f7674154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.802 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 -- 172.21.15.175:0/3076763808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76740c9ee0 msgr2=0x7f76741544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76740c9ee0 0x7f76741544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 -- 172.21.15.175:0/3076763808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7674153ef0 msgr2=0x7f7674154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7674153ef0 0x7f7674154a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 -- 172.21.15.175:0/3076763808 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76741ec710 con 0x7f76740ab730 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7672ffd640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740ab730 0x7f7674159270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f766800c400 tx=0x7f766800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f765b7fe640 1 -- 172.21.15.175:0/3076763808 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7668017070 con 0x7f76740ab730 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f765b7fe640 1 -- 172.21.15.175:0/3076763808 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7668005ce0 con 0x7f76740ab730 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767414ec90 con 0x7f76740ab730 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f765b7fe640 1 -- 172.21.15.175:0/3076763808 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7668007310 con 0x7f76740ab730 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.798+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76741eccb0 con 0x7f76740ab730 2024-04-20T10:50:16.803 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.799+0000 7f765b7fe640 1 -- 172.21.15.175:0/3076763808 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f766801a070 con 0x7f76740ab730 2024-04-20T10:50:16.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.799+0000 7f765b7fe640 1 -- 172.21.15.175:0/3076763808 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f7668012890 con 0x7f76740ab730 2024-04-20T10:50:16.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.799+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7674076150 con 0x7f76740ab730 2024-04-20T10:50:16.804 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.801+0000 7f765b7fe640 1 -- 172.21.15.175:0/3076763808 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f7668021070 con 0x7f76740ab730 2024-04-20T10:50:16.875 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.874+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1dc528a5-b13b-4300-8ca4-8bc6af207152", "id": 3} v 0) -- 0x7f767406d070 con 0x7f76740ab730 2024-04-20T10:50:16.878 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.877+0000 7f765b7fe640 1 -- 172.21.15.175:0/3076763808 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1dc528a5-b13b-4300-8ca4-8bc6af207152", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f767415a720 con 0x7f76740ab730 2024-04-20T10:50:16.878 INFO:teuthology.orchestra.run.smithi175.stdout:3 2024-04-20T10:50:16.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740ab730 msgr2=0x7f7674159270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.879 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740ab730 0x7f7674159270 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f766800c400 tx=0x7f766800c8c0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 shutdown_connections 2024-04-20T10:50:16.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7674153ef0 0x7f7674154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76740c9ee0 0x7f76741544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 --2- 172.21.15.175:0/3076763808 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76740ab730 0x7f7674159270 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 >> 172.21.15.175:0/3076763808 conn(0x7f76740cbfe0 msgr2=0x7f76740acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 shutdown_connections 2024-04-20T10:50:16.880 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.878+0000 7f7679559640 1 -- 172.21.15.175:0/3076763808 wait complete. 2024-04-20T10:50:16.881 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:16.880+0000 7fcfe5221040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T10:50:16.882 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:16.882+0000 7fcbc4e38040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-20T10:50:16.890 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 6acb3675-3d74-4153-974e-346ad3ab5b8c 4 2024-04-20T10:50:16.968 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:16.968+0000 7fcbc4e38040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T10:50:16.973 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:16.972+0000 7fcfe5221040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-20T10:50:16.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.987+0000 7f9efa37e640 1 Processor -- start 2024-04-20T10:50:16.988 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.987+0000 7f9efa37e640 1 -- start start 2024-04-20T10:50:16.989 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9efa37e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ef4150c00 0x7f9ef4153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9efa37e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ef406f330 0x7f9ef406d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9efa37e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ef4071fa0 con 0x7f9ef406ca40 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9efa37e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9ef40c4210 con 0x7f9ef4150c00 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9efa37e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9ef4153500 con 0x7f9ef406f330 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef891b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ef406f330 0x7f9ef406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef891b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ef406f330 0x7f9ef406d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49118/0 (socket says 172.21.15.175:49118) 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef891b640 1 -- 172.21.15.175:0/3192930711 learned_addr learned my addr 172.21.15.175:0/3192930711 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef3fff640 1 --2- 172.21.15.175:0/3192930711 >> v2:172.21.15.90:3300/0 conn(0x7f9ef4150c00 0x7f9ef4153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef891b640 1 -- 172.21.15.175:0/3192930711 >> v2:172.21.15.90:3300/0 conn(0x7f9ef4150c00 msgr2=0x7f9ef4153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef891b640 1 --2- 172.21.15.175:0/3192930711 >> v2:172.21.15.90:3300/0 conn(0x7f9ef4150c00 0x7f9ef4153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef891b640 1 -- 172.21.15.175:0/3192930711 >> v1:172.21.15.90:6789/0 conn(0x7f9ef406ca40 legacy=0x7f9ef40c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.990 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.988+0000 7f9ef891b640 1 -- 172.21.15.175:0/3192930711 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef406ced0 con 0x7f9ef406f330 2024-04-20T10:50:16.991 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.989+0000 7f9ef891b640 1 --2- 172.21.15.175:0/3192930711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef406f330 0x7f9ef406d450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4072f30 tx=0x7f9eec02e180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34e91ef89678970 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.989+0000 7f9ef2ffd640 1 -- 172.21.15.175:0/3192930711 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec00b0d0 con 0x7f9ef406f330 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.989+0000 7f9ef2ffd640 1 -- 172.21.15.175:0/3192930711 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eec00b270 con 0x7f9ef406f330 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.989+0000 7f9ef2ffd640 1 -- 172.21.15.175:0/3192930711 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eec009600 con 0x7f9ef406f330 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 -- 172.21.15.175:0/3192930711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef406f330 msgr2=0x7f9ef406d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 --2- 172.21.15.175:0/3192930711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef406f330 0x7f9ef406d450 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4072f30 tx=0x7f9eec02e180 comp rx=0 tx=0).stop 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 -- 172.21.15.175:0/3192930711 shutdown_connections 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 --2- 172.21.15.175:0/3192930711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef406f330 0x7f9ef406d450 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 --2- 172.21.15.175:0/3192930711 >> v2:172.21.15.90:3300/0 conn(0x7f9ef4150c00 0x7f9ef4153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 -- 172.21.15.175:0/3192930711 >> 172.21.15.175:0/3192930711 conn(0x7f9ef40c9100 msgr2=0x7f9ef40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 -- 172.21.15.175:0/3192930711 shutdown_connections 2024-04-20T10:50:16.992 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.990+0000 7f9efa37e640 1 -- 172.21.15.175:0/3192930711 wait complete. 2024-04-20T10:50:16.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.992+0000 7f9efa37e640 1 Processor -- start 2024-04-20T10:50:16.993 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.992+0000 7f9efa37e640 1 -- start start 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9efa37e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef406f330 0x7f9ef4156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9efa37e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef4150c00 0x7f9ef41de500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9efa37e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ef41dd7d0 0x7f9ef41dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9efa37e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef406d1b0 con 0x7f9ef406f330 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9efa37e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef4153a80 con 0x7f9ef4150c00 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9efa37e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ef4072fb0 con 0x7f9ef41dd7d0 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9ef891b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ef41dd7d0 0x7f9ef41dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9ef37fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef4150c00 0x7f9ef41de500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9ef891b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ef41dd7d0 0x7f9ef41dea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58020/0 (socket says 172.21.15.175:58020) 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9ef891b640 1 -- 172.21.15.175:0/687007903 learned_addr learned my addr 172.21.15.175:0/687007903 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.993+0000 7f9ef3fff640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef406f330 0x7f9ef4156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef37fe640 1 -- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ef41dd7d0 msgr2=0x7f9ef41dea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.996 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef37fe640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ef41dd7d0 0x7f9ef41dea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef37fe640 1 -- 172.21.15.175:0/687007903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef406f330 msgr2=0x7f9ef4156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef37fe640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef406f330 0x7f9ef4156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef37fe640 1 -- 172.21.15.175:0/687007903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef41dca30 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef891b640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ef41dd7d0 0x7f9ef41dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef37fe640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef4150c00 0x7f9ef41de500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4071df0 tx=0x7f9ee400c7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef0ff9640 1 -- 172.21.15.175:0/687007903 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee40052d0 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef0ff9640 1 -- 172.21.15.175:0/687007903 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ee4005490 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef41ebb40 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef0ff9640 1 -- 172.21.15.175:0/687007903 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4007260 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef41dcfd0 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef0ff9640 1 -- 172.21.15.175:0/687007903 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9ee4007400 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.994+0000 7f9ef0ff9640 1 -- 172.21.15.175:0/687007903 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f9ee4011590 con 0x7f9ef4150c00 2024-04-20T10:50:16.997 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.995+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef4151020 con 0x7f9ef4150c00 2024-04-20T10:50:16.998 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:16.997+0000 7f9ef0ff9640 1 -- 172.21.15.175:0/687007903 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f9ef4151020 con 0x7f9ef4150c00 2024-04-20T10:50:17.010 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:17.011+0000 7fcbc4e38040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T10:50:17.020 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:17.019+0000 7fcfe5221040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-20T10:50:17.070 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.070+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6acb3675-3d74-4153-974e-346ad3ab5b8c", "id": 4} v 0) -- 0x7f9ef4071a60 con 0x7f9ef4150c00 2024-04-20T10:50:17.077 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.075+0000 7f9ef0ff9640 1 -- 172.21.15.175:0/687007903 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6acb3675-3d74-4153-974e-346ad3ab5b8c", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f9ef4071a60 con 0x7f9ef4150c00 2024-04-20T10:50:17.077 INFO:teuthology.orchestra.run.smithi175.stdout:4 2024-04-20T10:50:17.078 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.076+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef4150c00 msgr2=0x7f9ef41de500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.076+0000 7f9efa37e640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef4150c00 0x7f9ef41de500 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4071df0 tx=0x7f9ee400c7a0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.076+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 shutdown_connections 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.076+0000 7f9efa37e640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ef41dd7d0 0x7f9ef41dea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.076+0000 7f9efa37e640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ef4150c00 0x7f9ef41de500 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.076+0000 7f9efa37e640 1 --2- 172.21.15.175:0/687007903 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ef406f330 0x7f9ef4156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.076+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 >> 172.21.15.175:0/687007903 conn(0x7f9ef40c9100 msgr2=0x7f9ef40c4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.077+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 shutdown_connections 2024-04-20T10:50:17.079 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.077+0000 7f9efa37e640 1 -- 172.21.15.175:0/687007903 wait complete. 2024-04-20T10:50:17.088 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 35d2c8ae-cec8-4953-944c-85613e117aac 5 2024-04-20T10:50:17.181 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:17.181+0000 7fcbc4e38040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T10:50:17.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.184+0000 7fb6d63f4640 1 Processor -- start 2024-04-20T10:50:17.185 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.184+0000 7fb6d63f4640 1 -- start start 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6d63f4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d006ca40 0x7fb6d0153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6d63f4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb6d006f330 0x7fb6d006d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6d63f4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6d0071fa0 con 0x7fb6d0150c00 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6d63f4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb6d00c4210 con 0x7fb6d006f330 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6d63f4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d0153500 con 0x7fb6d006ca40 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d006ca40 0x7fb6d0153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6cffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fb6d0150c00 0x7fb6d00c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45452/0 (socket says 172.21.15.175:45452) 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6cffff640 1 -- 172.21.15.175:0/1057065914 learned_addr learned my addr 172.21.15.175:0/1057065914 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6d4991640 1 --2- 172.21.15.175:0/1057065914 >> v2:172.21.15.90:3300/0 conn(0x7fb6d006f330 0x7fb6d006d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6ceffd640 1 -- 172.21.15.175:0/1057065914 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831563512 0 0) 0x7fb6d0071fa0 con 0x7fb6d0150c00 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6ceffd640 1 -- 172.21.15.175:0/1057065914 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6b8003520 con 0x7fb6d0150c00 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6cf7fe640 1 -- 172.21.15.175:0/1057065914 >> v2:172.21.15.90:3300/0 conn(0x7fb6d006f330 msgr2=0x7fb6d006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:17.187 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6cf7fe640 1 --2- 172.21.15.175:0/1057065914 >> v2:172.21.15.90:3300/0 conn(0x7fb6d006f330 0x7fb6d006d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6cf7fe640 1 -- 172.21.15.175:0/1057065914 >> v1:172.21.15.175:6789/0 conn(0x7fb6d0150c00 legacy=0x7fb6d00c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.188 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.185+0000 7fb6cf7fe640 1 -- 172.21.15.175:0/1057065914 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d006ced0 con 0x7fb6d006ca40 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.186+0000 7fb6cf7fe640 1 --2- 172.21.15.175:0/1057065914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d006ca40 0x7fb6d0153fa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00097a0 tx=0x7fb6c002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6142703b9ca48fb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6ceffd640 1 -- 172.21.15.175:0/1057065914 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0035020 con 0x7fb6d006ca40 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6ceffd640 1 -- 172.21.15.175:0/1057065914 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c0031830 con 0x7fb6d006ca40 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6ceffd640 1 -- 172.21.15.175:0/1057065914 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0031c00 con 0x7fb6d006ca40 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 -- 172.21.15.175:0/1057065914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d006ca40 msgr2=0x7fb6d0153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 --2- 172.21.15.175:0/1057065914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d006ca40 0x7fb6d0153fa0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb6c00097a0 tx=0x7fb6c002b8d0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 -- 172.21.15.175:0/1057065914 shutdown_connections 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 --2- 172.21.15.175:0/1057065914 >> v2:172.21.15.90:3300/0 conn(0x7fb6d006f330 0x7fb6d006d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 --2- 172.21.15.175:0/1057065914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d006ca40 0x7fb6d0153fa0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.189 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 -- 172.21.15.175:0/1057065914 >> 172.21.15.175:0/1057065914 conn(0x7fb6d00c9100 msgr2=0x7fb6d00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 -- 172.21.15.175:0/1057065914 shutdown_connections 2024-04-20T10:50:17.190 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.187+0000 7fb6d63f4640 1 -- 172.21.15.175:0/1057065914 wait complete. 2024-04-20T10:50:17.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.188+0000 7fb6d63f4640 1 Processor -- start 2024-04-20T10:50:17.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d63f4640 1 -- start start 2024-04-20T10:50:17.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d63f4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6d006f330 0x7fb6d0146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d63f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6d0150c00 0x7fb6d0141950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d63f4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d01476f0 0x7fb6d0141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.192 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d63f4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d006d1b0 con 0x7fb6d006f330 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d63f4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d0153a80 con 0x7fb6d0150c00 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d63f4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d0072fb0 con 0x7fb6d01476f0 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6d0150c00 0x7fb6d0141950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d4991640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d01476f0 0x7fb6d0141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d4991640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d01476f0 0x7fb6d0141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58046/0 (socket says 172.21.15.175:58046) 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6cf7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6d0150c00 0x7fb6d0141950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49136/0 (socket says 172.21.15.175:49136) 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6d4991640 1 -- 172.21.15.175:0/4237638209 learned_addr learned my addr 172.21.15.175:0/4237638209 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.189+0000 7fb6cffff640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6d006f330 0x7fb6d0146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6cf7fe640 1 -- 172.21.15.175:0/4237638209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d01476f0 msgr2=0x7fb6d0141e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6cf7fe640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d01476f0 0x7fb6d0141e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6cf7fe640 1 -- 172.21.15.175:0/4237638209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6d006f330 msgr2=0x7fb6d0146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6cf7fe640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6d006f330 0x7fb6d0146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6cf7fe640 1 -- 172.21.15.175:0/4237638209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d01ee440 con 0x7fb6d0150c00 2024-04-20T10:50:17.193 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6cf7fe640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6d0150c00 0x7fb6d0141950 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00c4390 tx=0x7fb6c00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6ccff9640 1 -- 172.21.15.175:0/4237638209 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c0035040 con 0x7fb6d0150c00 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6ccff9640 1 -- 172.21.15.175:0/4237638209 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6c003f070 con 0x7fb6d0150c00 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6ccff9640 1 -- 172.21.15.175:0/4237638209 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6c003bb60 con 0x7fb6d0150c00 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d014d160 con 0x7fb6d0150c00 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d01ee160 con 0x7fb6d0150c00 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6ccff9640 1 -- 172.21.15.175:0/4237638209 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb6c0038020 con 0x7fb6d0150c00 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.190+0000 7fb6ccff9640 1 -- 172.21.15.175:0/4237638209 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fb6c003a9b0 con 0x7fb6d0150c00 2024-04-20T10:50:17.194 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.191+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d0076150 con 0x7fb6d0150c00 2024-04-20T10:50:17.195 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.193+0000 7fb6ccff9640 1 -- 172.21.15.175:0/4237638209 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fb6c003bde0 con 0x7fb6d0150c00 2024-04-20T10:50:17.197 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:17.196+0000 7fcfe5221040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-20T10:50:17.236 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:17.236+0000 7fcbc4e38040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T10:50:17.265 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.264+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "35d2c8ae-cec8-4953-944c-85613e117aac", "id": 5} v 0) -- 0x7fb6d0072170 con 0x7fb6d0150c00 2024-04-20T10:50:17.270 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.270+0000 7fb6ccff9640 1 -- 172.21.15.175:0/4237638209 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "35d2c8ae-cec8-4953-944c-85613e117aac", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fb6c003ac00 con 0x7fb6d0150c00 2024-04-20T10:50:17.271 INFO:teuthology.orchestra.run.smithi175.stdout:5 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6d0150c00 msgr2=0x7fb6d0141950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6d0150c00 0x7fb6d0141950 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb6d00c4390 tx=0x7fb6c00046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 shutdown_connections 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6d01476f0 0x7fb6d0141e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6d0150c00 0x7fb6d0141950 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 --2- 172.21.15.175:0/4237638209 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6d006f330 0x7fb6d0146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 >> 172.21.15.175:0/4237638209 conn(0x7fb6d00c9100 msgr2=0x7fb6d0157240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 shutdown_connections 2024-04-20T10:50:17.272 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.271+0000 7fb6d63f4640 1 -- 172.21.15.175:0/4237638209 wait complete. 2024-04-20T10:50:17.273 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:17.272+0000 7fcfe5221040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-20T10:50:17.282 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 49788201-a1e7-4a1b-830c-2f68b8d70636 6 2024-04-20T10:50:17.288 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:17.288+0000 7fcbc4e38040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T10:50:17.330 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:17.329+0000 7fcfe5221040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-20T10:50:17.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.378+0000 7f76128f2640 1 Processor -- start 2024-04-20T10:50:17.379 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.378+0000 7f76128f2640 1 -- start start 2024-04-20T10:50:17.380 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f76128f2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f760c150c00 0x7f760c153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f76128f2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760c071fa0 con 0x7f760c06f330 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f76128f2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f760c153500 con 0x7f760c06ca40 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f76128f2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f760c0c4210 con 0x7f760c150c00 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f760bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f760c150c00 0x7f760c153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f760bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f760c150c00 0x7f760c153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49152/0 (socket says 172.21.15.175:49152) 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f760bfff640 1 -- 172.21.15.175:0/578379680 learned_addr learned my addr 172.21.15.175:0/578379680 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f760bfff640 1 -- 172.21.15.175:0/578379680 >> v1:172.21.15.175:6789/0 conn(0x7f760c06ca40 legacy=0x7f760c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f760bfff640 1 -- 172.21.15.175:0/578379680 >> v1:172.21.15.90:6789/0 conn(0x7f760c06f330 legacy=0x7f760c06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.381 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.379+0000 7f760bfff640 1 -- 172.21.15.175:0/578379680 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c06ced0 con 0x7f760c150c00 2024-04-20T10:50:17.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.380+0000 7f760bfff640 1 --2- 172.21.15.175:0/578379680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c150c00 0x7f760c153fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f760c0c4390 tx=0x7f760002ba10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab607169e3ecc39f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.380+0000 7f760affd640 1 -- 172.21.15.175:0/578379680 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760002f830 con 0x7f760c150c00 2024-04-20T10:50:17.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.380+0000 7f760affd640 1 -- 172.21.15.175:0/578379680 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f760002f9d0 con 0x7f760c150c00 2024-04-20T10:50:17.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.380+0000 7f760affd640 1 -- 172.21.15.175:0/578379680 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760002fda0 con 0x7f760c150c00 2024-04-20T10:50:17.382 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.381+0000 7f76128f2640 1 -- 172.21.15.175:0/578379680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c150c00 msgr2=0x7f760c153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.381+0000 7f76128f2640 1 --2- 172.21.15.175:0/578379680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c150c00 0x7f760c153fa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f760c0c4390 tx=0x7f760002ba10 comp rx=0 tx=0).stop 2024-04-20T10:50:17.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.381+0000 7f76128f2640 1 -- 172.21.15.175:0/578379680 shutdown_connections 2024-04-20T10:50:17.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.381+0000 7f76128f2640 1 --2- 172.21.15.175:0/578379680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c150c00 0x7f760c153fa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.381+0000 7f76128f2640 1 -- 172.21.15.175:0/578379680 >> 172.21.15.175:0/578379680 conn(0x7f760c0c9100 msgr2=0x7f760c0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.381+0000 7f76128f2640 1 -- 172.21.15.175:0/578379680 shutdown_connections 2024-04-20T10:50:17.383 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.381+0000 7f76128f2640 1 -- 172.21.15.175:0/578379680 wait complete. 2024-04-20T10:50:17.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.382+0000 7f76128f2640 1 Processor -- start 2024-04-20T10:50:17.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.382+0000 7f76128f2640 1 -- start start 2024-04-20T10:50:17.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f76128f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c06f330 0x7f760c0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f76128f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f760c150c00 0x7f760c1f0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f76128f2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f760c142de0 0x7f760c0c2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f76128f2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f760c06d1b0 con 0x7f760c142de0 2024-04-20T10:50:17.386 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f76128f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f760c153a80 con 0x7f760c06f330 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f76128f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f760c06db60 con 0x7f760c150c00 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c06f330 0x7f760c0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c06f330 0x7f760c0c8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49162/0 (socket says 172.21.15.175:49162) 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f760c150c00 0x7f760c1f0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 -- 172.21.15.175:0/1459072564 learned_addr learned my addr 172.21.15.175:0/1459072564 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f7610e8f640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f760c142de0 0x7f760c0c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 -- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f760c150c00 msgr2=0x7f760c1f0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f760c150c00 0x7f760c1f0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 -- 172.21.15.175:0/1459072564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f760c142de0 msgr2=0x7f760c0c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f760c142de0 0x7f760c0c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 -- 172.21.15.175:0/1459072564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f760c0c8dc0 con 0x7f760c06f330 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760b7fe640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f760c150c00 0x7f760c1f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f760bfff640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c06f330 0x7f760c0c8730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f760002ba50 tx=0x7f7600004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f7608ff9640 1 -- 172.21.15.175:0/1459072564 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f760002f800 con 0x7f760c06f330 2024-04-20T10:50:17.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f7608ff9640 1 -- 172.21.15.175:0/1459072564 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7600046070 con 0x7f760c06f330 2024-04-20T10:50:17.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f760c1447d0 con 0x7f760c06f330 2024-04-20T10:50:17.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.383+0000 7f7608ff9640 1 -- 172.21.15.175:0/1459072564 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7600041640 con 0x7f760c06f330 2024-04-20T10:50:17.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.384+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f760c1444d0 con 0x7f760c06f330 2024-04-20T10:50:17.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.384+0000 7f7608ff9640 1 -- 172.21.15.175:0/1459072564 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7600040070 con 0x7f760c06f330 2024-04-20T10:50:17.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.384+0000 7f7608ff9640 1 -- 172.21.15.175:0/1459072564 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f760004bb40 con 0x7f760c06f330 2024-04-20T10:50:17.388 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.384+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f760c076150 con 0x7f760c06f330 2024-04-20T10:50:17.389 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.388+0000 7f7608ff9640 1 -- 172.21.15.175:0/1459072564 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f7600033030 con 0x7f760c06f330 2024-04-20T10:50:17.400 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:17.400+0000 7fcbc4e38040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T10:50:17.449 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:17.448+0000 7fcfe5221040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-20T10:50:17.461 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.460+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd new", "uuid": "49788201-a1e7-4a1b-830c-2f68b8d70636", "id": 6} v 0) -- 0x7f760c06e2c0 con 0x7f760c06f330 2024-04-20T10:50:17.467 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.466+0000 7f7608ff9640 1 -- 172.21.15.175:0/1459072564 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "49788201-a1e7-4a1b-830c-2f68b8d70636", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f760002f9a0 con 0x7f760c06f330 2024-04-20T10:50:17.467 INFO:teuthology.orchestra.run.smithi175.stdout:6 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c06f330 msgr2=0x7f760c0c8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c06f330 0x7f760c0c8730 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f760002ba50 tx=0x7f7600004730 comp rx=0 tx=0).stop 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 shutdown_connections 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f760c142de0 0x7f760c0c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f760c150c00 0x7f760c1f0640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 --2- 172.21.15.175:0/1459072564 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f760c06f330 0x7f760c0c8730 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 >> 172.21.15.175:0/1459072564 conn(0x7f760c0c9100 msgr2=0x7f760c14dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.468 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 shutdown_connections 2024-04-20T10:50:17.469 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.467+0000 7f76128f2640 1 -- 172.21.15.175:0/1459072564 wait complete. 2024-04-20T10:50:17.478 DEBUG:teuthology.orchestra.run.smithi175:> sudo ceph --cluster ceph osd new 8e6f132c-266c-43ef-890e-c25373f724e6 7 2024-04-20T10:50:17.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f6109a06640 1 Processor -- start 2024-04-20T10:50:17.576 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f6109a06640 1 -- start start 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f6109a06640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6104151f50 0x7f61041551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f6109a06640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6104158780 con 0x7f6104072860 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f6109a06640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61041546d0 con 0x7f61040c45c0 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f6109a06640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f61040ad010 con 0x7f6104151f50 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f61027fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f61040c45c0 0x7f6104151840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.175:45464/0 (socket says 172.21.15.175:45464) 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.575+0000 7f61027fc640 1 -- 172.21.15.175:0/712124056 learned_addr learned my addr 172.21.15.175:0/712124056 (peer_addr_for_me v1:172.21.15.175:0/0) 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.576+0000 7f61037fe640 1 --2- 172.21.15.175:0/712124056 >> v2:172.21.15.90:3300/0 conn(0x7f6104151f50 0x7f61041551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.578 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.576+0000 7f6101ffb640 1 -- 172.21.15.175:0/712124056 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136875548 0 0) 0x7f61041546d0 con 0x7f61040c45c0 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.576+0000 7f6101ffb640 1 -- 172.21.15.175:0/712124056 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60ec003520 con 0x7f61040c45c0 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.576+0000 7f61037fe640 1 -- 172.21.15.175:0/712124056 >> v1:172.21.15.175:6789/0 conn(0x7f61040c45c0 legacy=0x7f6104151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.576+0000 7f61037fe640 1 -- 172.21.15.175:0/712124056 >> v1:172.21.15.90:6789/0 conn(0x7f6104072860 legacy=0x7f61040ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.576+0000 7f61037fe640 1 -- 172.21.15.175:0/712124056 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61041549b0 con 0x7f6104151f50 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.577+0000 7f61037fe640 1 --2- 172.21.15.175:0/712124056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6104151f50 0x7f61041551b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009d90 tx=0x7f60fc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128ea91f5dc8564b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.577+0000 7f6101ffb640 1 -- 172.21.15.175:0/712124056 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc039070 con 0x7f6104151f50 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.577+0000 7f6101ffb640 1 -- 172.21.15.175:0/712124056 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc02cc60 con 0x7f6104151f50 2024-04-20T10:50:17.579 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.577+0000 7f6101ffb640 1 -- 172.21.15.175:0/712124056 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc034660 con 0x7f6104151f50 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.577+0000 7f6109a06640 1 -- 172.21.15.175:0/712124056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6104151f50 msgr2=0x7f61041551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.577+0000 7f6109a06640 1 --2- 172.21.15.175:0/712124056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6104151f50 0x7f61041551b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009d90 tx=0x7f60fc02beb0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.578+0000 7f6109a06640 1 -- 172.21.15.175:0/712124056 shutdown_connections 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.578+0000 7f6109a06640 1 --2- 172.21.15.175:0/712124056 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6104151f50 0x7f61041551b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.578+0000 7f6109a06640 1 -- 172.21.15.175:0/712124056 >> 172.21.15.175:0/712124056 conn(0x7f6104067de0 msgr2=0x7f61040ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.578+0000 7f6109a06640 1 -- 172.21.15.175:0/712124056 shutdown_connections 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.578+0000 7f6109a06640 1 -- 172.21.15.175:0/712124056 wait complete. 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.579+0000 7f6109a06640 1 Processor -- start 2024-04-20T10:50:17.580 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.579+0000 7f6109a06640 1 -- start start 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.579+0000 7f6109a06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6104072860 0x7f61040c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.579+0000 7f6109a06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61040c45c0 0x7f610414df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.579+0000 7f6109a06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6104151f50 0x7f610414e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6109a06640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6104158a60 con 0x7f61040c45c0 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6109a06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6104158530 con 0x7f6104072860 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6109a06640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f61040abbb0 con 0x7f6104151f50 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6104151f50 0x7f610414e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.583 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6104072860 0x7f61040c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6102ffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6104072860 0x7f61040c0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.175:49166/0 (socket says 172.21.15.175:49166) 2024-04-20T10:50:17.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6104151f50 0x7f610414e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.175:58068/0 (socket says 172.21.15.175:58068) 2024-04-20T10:50:17.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6102ffd640 1 -- 172.21.15.175:0/2144664592 learned_addr learned my addr 172.21.15.175:0/2144664592 (peer_addr_for_me v2:172.21.15.175:0/0) 2024-04-20T10:50:17.584 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61027fc640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61040c45c0 0x7f610414df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 -- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6104072860 msgr2=0x7f61040c0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6104072860 0x7f61040c0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 -- 172.21.15.175:0/2144664592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61040c45c0 msgr2=0x7f610414df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61040c45c0 0x7f610414df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.585 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 -- 172.21.15.175:0/2144664592 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61040bf270 con 0x7f6104151f50 2024-04-20T10:50:17.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6102ffd640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6104072860 0x7f61040c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:17.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f61037fe640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6104151f50 0x7f610414e440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f61040cae60 tx=0x7f60fc004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f60ebfff640 1 -- 172.21.15.175:0/2144664592 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc039050 con 0x7f6104151f50 2024-04-20T10:50:17.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f60ebfff640 1 -- 172.21.15.175:0/2144664592 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60fc045070 con 0x7f6104151f50 2024-04-20T10:50:17.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61040bf550 con 0x7f6104151f50 2024-04-20T10:50:17.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f60ebfff640 1 -- 172.21.15.175:0/2144664592 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc009450 con 0x7f6104151f50 2024-04-20T10:50:17.586 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.580+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f61040bfb10 con 0x7f6104151f50 2024-04-20T10:50:17.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.581+0000 7f60ebfff640 1 -- 172.21.15.175:0/2144664592 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f60fc03e850 con 0x7f6104151f50 2024-04-20T10:50:17.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.581+0000 7f60ebfff640 1 -- 172.21.15.175:0/2144664592 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f60fc040450 con 0x7f6104151f50 2024-04-20T10:50:17.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.582+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6104076150 con 0x7f6104151f50 2024-04-20T10:50:17.587 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.584+0000 7f60ebfff640 1 -- 172.21.15.175:0/2144664592 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7f60fc04a460 con 0x7f6104151f50 2024-04-20T10:50:17.656 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.654+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8e6f132c-266c-43ef-890e-c25373f724e6", "id": 7} v 0) -- 0x7f6104154640 con 0x7f6104151f50 2024-04-20T10:50:17.663 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.662+0000 7f60ebfff640 1 -- 172.21.15.175:0/2144664592 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8e6f132c-266c-43ef-890e-c25373f724e6", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f60fc03ec30 con 0x7f6104151f50 2024-04-20T10:50:17.663 INFO:teuthology.orchestra.run.smithi175.stdout:7 2024-04-20T10:50:17.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6104151f50 msgr2=0x7f610414e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6104151f50 0x7f610414e440 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f61040cae60 tx=0x7f60fc004a40 comp rx=0 tx=0).stop 2024-04-20T10:50:17.664 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 shutdown_connections 2024-04-20T10:50:17.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6104151f50 0x7f610414e440 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f61040c45c0 0x7f610414df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 --2- 172.21.15.175:0/2144664592 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6104072860 0x7f61040c0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 >> 172.21.15.175:0/2144664592 conn(0x7f6104067de0 msgr2=0x7f6104070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 shutdown_connections 2024-04-20T10:50:17.665 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:50:17.663+0000 7f6109a06640 1 -- 172.21.15.175:0/2144664592 wait complete. 2024-04-20T10:50:17.675 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-20T10:50:17.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-20T10:50:17.677 INFO:tasks.ceph.osd.0:Started 2024-04-20T10:50:17.678 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-20T10:50:17.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-20T10:50:17.679 INFO:tasks.ceph.osd.1:Started 2024-04-20T10:50:17.680 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-20T10:50:17.680 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-20T10:50:17.682 INFO:tasks.ceph.osd.2:Started 2024-04-20T10:50:17.682 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-20T10:50:17.682 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-20T10:50:17.684 INFO:tasks.ceph.osd.3:Started 2024-04-20T10:50:17.685 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-20T10:50:17.685 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-20T10:50:17.687 INFO:tasks.ceph.osd.4:Started 2024-04-20T10:50:17.687 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-20T10:50:17.687 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-20T10:50:17.689 INFO:tasks.ceph.osd.5:Started 2024-04-20T10:50:17.689 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-20T10:50:17.689 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-20T10:50:17.691 INFO:tasks.ceph.osd.6:Started 2024-04-20T10:50:17.691 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-20T10:50:17.691 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-20T10:50:17.693 INFO:tasks.ceph.osd.7:Started 2024-04-20T10:50:17.694 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:17.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.809+0000 7ff993723640 1 Processor -- start 2024-04-20T10:50:17.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.809+0000 7ff993723640 1 -- start start 2024-04-20T10:50:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff993723640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff993723640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff98c0ab730 0x7ff98c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff993723640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff98c15a720 con 0x7ff98c0c9ee0 2024-04-20T10:50:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff993723640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff98c15ac80 con 0x7ff98c0ab730 2024-04-20T10:50:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff993723640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff98c15a9a0 con 0x7ff98c153ef0 2024-04-20T10:50:17.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff990cbe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff98c0ab730 0x7ff98c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff990cbe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff98c0ab730 0x7ff98c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38116/0 (socket says 172.21.15.90:38116) 2024-04-20T10:50:17.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff990cbe640 1 -- 172.21.15.90:0/3230564755 learned_addr learned my addr 172.21.15.90:0/3230564755 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:17.811 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff9914bf640 1 --2- 172.21.15.90:0/3230564755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff990cbe640 1 -- 172.21.15.90:0/3230564755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 msgr2=0x7ff98c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff990cbe640 1 --2- 172.21.15.90:0/3230564755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff990cbe640 1 -- 172.21.15.90:0/3230564755 >> v1:172.21.15.175:6789/0 conn(0x7ff98c0c9ee0 legacy=0x7ff98c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.810+0000 7ff990cbe640 1 -- 172.21.15.90:0/3230564755 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c0c6a90 con 0x7ff98c0ab730 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.811+0000 7ff990cbe640 1 --2- 172.21.15.90:0/3230564755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c1568c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009870 tx=0x7ff97c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea60e897574572d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.811+0000 7ff983fff640 1 -- 172.21.15.90:0/3230564755 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0317c0 con 0x7ff98c0ab730 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.811+0000 7ff983fff640 1 -- 172.21.15.90:0/3230564755 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97c037070 con 0x7ff98c0ab730 2024-04-20T10:50:17.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.811+0000 7ff983fff640 1 -- 172.21.15.90:0/3230564755 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c031b80 con 0x7ff98c0ab730 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 -- 172.21.15.90:0/3230564755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 msgr2=0x7ff98c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 --2- 172.21.15.90:0/3230564755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c1568c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7ff97c009870 tx=0x7ff97c02b860 comp rx=0 tx=0).stop 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 -- 172.21.15.90:0/3230564755 shutdown_connections 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 --2- 172.21.15.90:0/3230564755 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c1568c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 --2- 172.21.15.90:0/3230564755 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 -- 172.21.15.90:0/3230564755 >> 172.21.15.90:0/3230564755 conn(0x7ff98c0cbfe0 msgr2=0x7ff98c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 -- 172.21.15.90:0/3230564755 shutdown_connections 2024-04-20T10:50:17.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.812+0000 7ff993723640 1 -- 172.21.15.90:0/3230564755 wait complete. 2024-04-20T10:50:17.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.813+0000 7ff993723640 1 Processor -- start 2024-04-20T10:50:17.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.813+0000 7ff993723640 1 -- start start 2024-04-20T10:50:17.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.813+0000 7ff993723640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c0c0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff993723640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c0c9ee0 0x7ff98c0bfd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff993723640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff993723640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c0bf800 con 0x7ff98c0ab730 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff993723640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff98c157510 con 0x7ff98c0c9ee0 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff993723640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff98c0c2a00 con 0x7ff98c153ef0 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c0c0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c0c0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38122/0 (socket says 172.21.15.90:38122) 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 -- 172.21.15.90:0/2758348962 learned_addr learned my addr 172.21.15.90:0/2758348962 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff990cbe640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c0c9ee0 0x7ff98c0bfd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff991cc0640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 -- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 msgr2=0x7ff98c0b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 -- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c0c9ee0 msgr2=0x7ff98c0bfd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c0c9ee0 0x7ff98c0bfd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 -- 172.21.15.90:0/2758348962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff98c0c2ce0 con 0x7ff98c0ab730 2024-04-20T10:50:17.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff9914bf640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c0c0700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff98800e9b0 tx=0x7ff98800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff981ffb640 1 -- 172.21.15.90:0/2758348962 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff988017070 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff981ffb640 1 -- 172.21.15.90:0/2758348962 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff98800c9a0 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff98c0b0f70 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.814+0000 7ff981ffb640 1 -- 172.21.15.90:0/2758348962 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff98800cd90 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.815+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff98c0b0c60 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.815+0000 7ff981ffb640 1 -- 172.21.15.90:0/2758348962 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff98801a070 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.815+0000 7ff981ffb640 1 -- 172.21.15.90:0/2758348962 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7ff9880134c0 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.815+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff98c076150 con 0x7ff98c0ab730 2024-04-20T10:50:17.817 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:17.816+0000 7fcbc4e38040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T10:50:17.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.819+0000 7ff981ffb640 1 -- 172.21.15.90:0/2758348962 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7ff9880136c0 con 0x7ff98c0ab730 2024-04-20T10:50:17.872 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:17.871+0000 7fcfe5221040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-20T10:50:17.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.880+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff98c151bb0 con 0x7ff98c0ab730 2024-04-20T10:50:17.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.881+0000 7ff981ffb640 1 -- 172.21.15.90:0/2758348962 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7ff9880138a0 con 0x7ff98c0ab730 2024-04-20T10:50:17.882 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:17.882 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":10,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:17.657215+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:17.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 msgr2=0x7ff98c0c0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c0c0700 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff98800e9b0 tx=0x7ff98800ee70 comp rx=0 tx=0).stop 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 shutdown_connections 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff98c153ef0 0x7ff98c0b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff98c0c9ee0 0x7ff98c0bfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 --2- 172.21.15.90:0/2758348962 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff98c0ab730 0x7ff98c0c0700 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 >> 172.21.15.90:0/2758348962 conn(0x7ff98c0cbfe0 msgr2=0x7ff98c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 shutdown_connections 2024-04-20T10:50:17.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:17.882+0000 7ff993723640 1 -- 172.21.15.90:0/2758348962 wait complete. 2024-04-20T10:50:17.893 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-20T10:50:17.893 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-20T10:50:18.081 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.081+0000 7fcbc4e38040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T10:50:18.130 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.129+0000 7fcfe5221040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-20T10:50:18.133 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.134+0000 7fcbc4e38040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T10:50:18.181 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.180+0000 7fcfe5221040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-20T10:50:18.249 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.249+0000 7fcbc4e38040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T10:50:18.275 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-20T10:50:18.275+0000 7fe1f422e640 -1 Falling back to public interface 2024-04-20T10:50:18.295 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-20T10:50:18.295+0000 7f9a20807640 -1 Falling back to public interface 2024-04-20T10:50:18.296 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-20T10:50:18.295+0000 7fee466d5640 -1 Falling back to public interface 2024-04-20T10:50:18.297 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.296+0000 7fcfe5221040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-20T10:50:18.298 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-20T10:50:18.298+0000 7fb6a2f6a640 -1 Falling back to public interface 2024-04-20T10:50:18.300 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-20T10:50:18.299+0000 7fc1ca430640 -1 Falling back to public interface 2024-04-20T10:50:18.302 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-20T10:50:18.302+0000 7f2e955dc640 -1 Falling back to public interface 2024-04-20T10:50:18.307 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-20T10:50:18.306+0000 7f34a2ed9640 -1 Falling back to public interface 2024-04-20T10:50:18.321 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-20T10:50:18.321+0000 7fb21c210640 -1 Falling back to public interface 2024-04-20T10:50:18.546 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.546+0000 7fcbc4e38040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T10:50:18.583 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.582+0000 7fcfe5221040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-20T10:50:18.595 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.595+0000 7fcbc4e38040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T10:50:18.631 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.630+0000 7fcfe5221040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-20T10:50:18.698 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:18.754 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.754+0000 7fcbc4e38040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T10:50:18.784 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.783+0000 7fcfe5221040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-20T10:50:18.787 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.787+0000 7fadef50e640 1 Processor -- start 2024-04-20T10:50:18.788 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.788+0000 7fadef50e640 1 -- start start 2024-04-20T10:50:18.789 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.788+0000 7fadef50e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade81507f0 0x7fade8072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:18.789 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.788+0000 7fadef50e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade815ac30 con 0x7fade80c60c0 2024-04-20T10:50:18.789 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.788+0000 7fadef50e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fade8072660 con 0x7fade8157240 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.788+0000 7fadef50e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fade8159db0 con 0x7fade81507f0 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7fadedaab640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fade80c60c0 0x7fade80c4560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:42490/0 (socket says 172.21.15.90:42490) 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7fadedaab640 1 -- 172.21.15.90:0/1696623519 learned_addr learned my addr 172.21.15.90:0/1696623519 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faded2aa640 1 --2- 172.21.15.90:0/1696623519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade81507f0 0x7fade8072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faddffff640 1 -- 172.21.15.90:0/1696623519 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687502078 0 0) 0x7fade815ac30 con 0x7fade80c60c0 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faddffff640 1 -- 172.21.15.90:0/1696623519 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd4003520 con 0x7fade80c60c0 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faddffff640 1 -- 172.21.15.90:0/1696623519 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509558874 0 0) 0x7fade8072660 con 0x7fade8157240 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faddffff640 1 -- 172.21.15.90:0/1696623519 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fade815ac30 con 0x7fade8157240 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faded2aa640 1 -- 172.21.15.90:0/1696623519 >> v1:172.21.15.175:6789/0 conn(0x7fade8157240 legacy=0x7fade815a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faded2aa640 1 -- 172.21.15.90:0/1696623519 >> v1:172.21.15.90:6789/0 conn(0x7fade80c60c0 legacy=0x7fade80c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:18.790 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.789+0000 7faded2aa640 1 -- 172.21.15.90:0/1696623519 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade8072940 con 0x7fade81507f0 2024-04-20T10:50:18.792 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.790+0000 7faded2aa640 1 --2- 172.21.15.90:0/1696623519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade81507f0 0x7fade8072030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fade40097d0 tx=0x7fade402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ec108b04b5a74e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:18.792 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.790+0000 7faddffff640 1 -- 172.21.15.90:0/1696623519 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4035020 con 0x7fade81507f0 2024-04-20T10:50:18.792 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.790+0000 7faddffff640 1 -- 172.21.15.90:0/1696623519 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4031890 con 0x7fade81507f0 2024-04-20T10:50:18.792 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.790+0000 7faddffff640 1 -- 172.21.15.90:0/1696623519 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4031c60 con 0x7fade81507f0 2024-04-20T10:50:18.792 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.791+0000 7fadef50e640 1 -- 172.21.15.90:0/1696623519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade81507f0 msgr2=0x7fade8072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.791+0000 7fadef50e640 1 --2- 172.21.15.90:0/1696623519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade81507f0 0x7fade8072030 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fade40097d0 tx=0x7fade402b930 comp rx=0 tx=0).stop 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.791+0000 7fadef50e640 1 -- 172.21.15.90:0/1696623519 shutdown_connections 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.791+0000 7fadef50e640 1 --2- 172.21.15.90:0/1696623519 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade81507f0 0x7fade8072030 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.791+0000 7fadef50e640 1 -- 172.21.15.90:0/1696623519 >> 172.21.15.90:0/1696623519 conn(0x7fade80ab670 msgr2=0x7fade80aba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.791+0000 7fadef50e640 1 -- 172.21.15.90:0/1696623519 shutdown_connections 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.791+0000 7fadef50e640 1 -- 172.21.15.90:0/1696623519 wait complete. 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.792+0000 7fadef50e640 1 Processor -- start 2024-04-20T10:50:18.793 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.792+0000 7fadef50e640 1 -- start start 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.792+0000 7fadef50e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade80c60c0 0x7fade81efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.792+0000 7fadef50e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade81507f0 0x7fade814aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadef50e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade8157240 0x7fade814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadef50e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fade81576c0 con 0x7fade80c60c0 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadef50e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fade815a090 con 0x7fade81507f0 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadef50e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fade8150bd0 con 0x7fade8157240 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade80c60c0 0x7fade81efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade80c60c0 0x7fade81efb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:38124/0 (socket says 172.21.15.90:38124) 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 -- 172.21.15.90:0/2542693971 learned_addr learned my addr 172.21.15.90:0/2542693971 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadecaa9640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade81507f0 0x7fade814aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:18.796 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadedaab640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade8157240 0x7fade814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 -- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade8157240 msgr2=0x7fade814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade8157240 0x7fade814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 -- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade81507f0 msgr2=0x7fade814aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade81507f0 0x7fade814aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 -- 172.21.15.90:0/2542693971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade806de20 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7faded2aa640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade80c60c0 0x7fade81efb20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fade40098f0 tx=0x7fade40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadddffb640 1 -- 172.21.15.90:0/2542693971 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4035040 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadddffb640 1 -- 172.21.15.90:0/2542693971 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade4030d20 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadddffb640 1 -- 172.21.15.90:0/2542693971 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade4006e10 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.793+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade814b940 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.794+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade81f0360 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.794+0000 7fadddffb640 1 -- 172.21.15.90:0/2542693971 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fade4038020 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.794+0000 7fadddffb640 1 -- 172.21.15.90:0/2542693971 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fade403bd80 con 0x7fade80c60c0 2024-04-20T10:50:18.797 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.794+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fade81f0740 con 0x7fade80c60c0 2024-04-20T10:50:18.798 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.798+0000 7fadddffb640 1 -- 172.21.15.90:0/2542693971 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73276 (secure 0 0 0) 0x7fade81f0740 con 0x7fade80c60c0 2024-04-20T10:50:18.863 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.859+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fade804fcf0 con 0x7fade80c60c0 2024-04-20T10:50:18.863 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.860+0000 7fadddffb640 1 -- 172.21.15.90:0/2542693971 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fade402d040 con 0x7fade80c60c0 2024-04-20T10:50:18.863 INFO:teuthology.misc.health.smithi090.stdout: 2024-04-20T10:50:18.863 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":10,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:17.657215+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade80c60c0 msgr2=0x7fade81efb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade80c60c0 0x7fade81efb20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fade40098f0 tx=0x7fade40046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 shutdown_connections 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fade8157240 0x7fade814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fade81507f0 0x7fade814aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 --2- 172.21.15.90:0/2542693971 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fade80c60c0 0x7fade81efb20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 >> 172.21.15.90:0/2542693971 conn(0x7fade80ab670 msgr2=0x7fade8072e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 shutdown_connections 2024-04-20T10:50:18.864 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:18.861+0000 7fadef50e640 1 -- 172.21.15.90:0/2542693971 wait complete. 2024-04-20T10:50:18.870 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-20T10:50:18.897 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.897+0000 7fcbc4e38040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T10:50:18.922 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.921+0000 7fcfe5221040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-20T10:50:18.946 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:18.946+0000 7fcbc4e38040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T10:50:18.971 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:18.970+0000 7fcfe5221040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-20T10:50:19.014 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:19.014+0000 7fcbc4e38040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T10:50:19.039 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:19.038+0000 7fcfe5221040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-20T10:50:19.059 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:19.059+0000 7fcbc4e38040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T10:50:19.084 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:19.083+0000 7fcfe5221040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-20T10:50:19.536 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:19.536+0000 7fcbc4e38040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T10:50:19.560 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:19.559+0000 7fcfe5221040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-20T10:50:19.652 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:19.652+0000 7fcbc4e38040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T10:50:19.678 INFO:tasks.ceph.mgr.x.smithi175.stderr:2024-04-20T10:50:19.677+0000 7fcfe5221040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-20T10:50:20.666 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:20.666+0000 7fcb659d9640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-20T10:50:20.667 INFO:tasks.ceph.mgr.y.smithi090.stderr:2024-04-20T10:50:20.666+0000 7fcb659d9640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-20T10:50:21.744 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-20T10:50:21.744+0000 7fe1f422e640 -1 osd.0 0 log_to_monitors true 2024-04-20T10:50:21.793 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-20T10:50:21.793+0000 7fc1ca430640 -1 osd.7 0 log_to_monitors true 2024-04-20T10:50:21.795 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-20T10:50:21.795+0000 7f34a2ed9640 -1 osd.6 0 log_to_monitors true 2024-04-20T10:50:21.803 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-20T10:50:21.804+0000 7f9a20807640 -1 osd.3 0 log_to_monitors true 2024-04-20T10:50:21.810 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-20T10:50:21.810+0000 7fee466d5640 -1 osd.4 0 log_to_monitors true 2024-04-20T10:50:21.823 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-20T10:50:21.823+0000 7fb6a2f6a640 -1 osd.2 0 log_to_monitors true 2024-04-20T10:50:21.830 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-20T10:50:21.830+0000 7f2e955dc640 -1 osd.1 0 log_to_monitors true 2024-04-20T10:50:21.831 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-20T10:50:21.831+0000 7fb21c210640 -1 osd.5 0 log_to_monitors true 2024-04-20T10:50:25.500 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-20T10:50:25.500+0000 7fee4266b640 -1 osd.4 0 waiting for initial osdmap 2024-04-20T10:50:25.513 INFO:tasks.ceph.osd.4.smithi175.stderr:2024-04-20T10:50:25.513+0000 7fee3a48b640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:25.677 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:25.707 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-20T10:50:25.707+0000 7fc1c59c3640 -1 osd.7 0 waiting for initial osdmap 2024-04-20T10:50:25.712 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-20T10:50:25.712+0000 7fb217b54640 -1 osd.5 0 waiting for initial osdmap 2024-04-20T10:50:25.721 INFO:tasks.ceph.osd.7.smithi175.stderr:2024-04-20T10:50:25.721+0000 7fc1bd7e3640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:25.726 INFO:tasks.ceph.osd.5.smithi175.stderr:2024-04-20T10:50:25.727+0000 7fb20f974640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:25.790 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-20T10:50:25.790+0000 7fe1ef7b2640 -1 osd.0 0 waiting for initial osdmap 2024-04-20T10:50:25.793 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-20T10:50:25.793+0000 7f9a1c79d640 -1 osd.3 0 waiting for initial osdmap 2024-04-20T10:50:25.805 INFO:tasks.ceph.osd.0.smithi090.stderr:2024-04-20T10:50:25.805+0000 7fe1e75d2640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:25.807 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.807+0000 7f3e2ad46640 1 Processor -- start 2024-04-20T10:50:25.807 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.807+0000 7f3e2ad46640 1 -- start start 2024-04-20T10:50:25.809 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.808+0000 7f3e2ad46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e240ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:25.809 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.808+0000 7f3e2ad46640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3e24151e60 0x7f3e240c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:25.809 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.808+0000 7f3e2ad46640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e24067b70 con 0x7f3e24151a00 2024-04-20T10:50:25.809 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.808+0000 7f3e2ad46640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3e241522f0 con 0x7f3e24151e60 2024-04-20T10:50:25.809 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.808+0000 7f3e2ad46640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3e24067640 con 0x7f3e240ad640 2024-04-20T10:50:25.810 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e28ae2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e240ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:25.810 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e292e3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3e24151e60 0x7f3e240c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:25.810 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e28ae2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e240ab8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:53444/0 (socket says 172.21.15.90:53444) 2024-04-20T10:50:25.810 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e28ae2640 1 -- 172.21.15.90:0/1021846214 learned_addr learned my addr 172.21.15.90:0/1021846214 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:25.810 INFO:tasks.ceph.osd.3.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f9a145bd640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e28ae2640 1 -- 172.21.15.90:0/1021846214 >> v2:172.21.15.175:3300/0 conn(0x7f3e24151e60 msgr2=0x7f3e240c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e28ae2640 1 --2- 172.21.15.90:0/1021846214 >> v2:172.21.15.175:3300/0 conn(0x7f3e24151e60 0x7f3e240c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e28ae2640 1 -- 172.21.15.90:0/1021846214 >> v1:172.21.15.175:6789/0 conn(0x7f3e24151a00 legacy=0x7f3e240c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.809+0000 7f3e28ae2640 1 -- 172.21.15.90:0/1021846214 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e241589c0 con 0x7f3e240ad640 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.810+0000 7f3e28ae2640 1 --2- 172.21.15.90:0/1021846214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e240ab8e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e2002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8b899ee6c21a3ccd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.810+0000 7f3e1b7fe640 1 -- 172.21.15.90:0/1021846214 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e200317c0 con 0x7f3e240ad640 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.810+0000 7f3e1b7fe640 1 -- 172.21.15.90:0/1021846214 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e20037070 con 0x7f3e240ad640 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.810+0000 7f3e1b7fe640 1 -- 172.21.15.90:0/1021846214 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e20031b80 con 0x7f3e240ad640 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.811+0000 7f3e2ad46640 1 -- 172.21.15.90:0/1021846214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 msgr2=0x7f3e240ab8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.811+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/1021846214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e240ab8e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3e20009870 tx=0x7f3e2002b860 comp rx=0 tx=0).stop 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.812+0000 7f3e2ad46640 1 -- 172.21.15.90:0/1021846214 shutdown_connections 2024-04-20T10:50:25.812 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.812+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/1021846214 >> v2:172.21.15.175:3300/0 conn(0x7f3e24151e60 0x7f3e240c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:25.813 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.812+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/1021846214 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e240ab8e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:25.813 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.812+0000 7f3e2ad46640 1 -- 172.21.15.90:0/1021846214 >> 172.21.15.90:0/1021846214 conn(0x7f3e240aa5e0 msgr2=0x7f3e240aa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:25.813 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.812+0000 7f3e2ad46640 1 -- 172.21.15.90:0/1021846214 shutdown_connections 2024-04-20T10:50:25.813 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.812+0000 7f3e2ad46640 1 -- 172.21.15.90:0/1021846214 wait complete. 2024-04-20T10:50:25.813 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-20T10:50:25.812+0000 7f2e91572640 -1 osd.1 0 waiting for initial osdmap 2024-04-20T10:50:25.815 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.813+0000 7f3e2ad46640 1 Processor -- start 2024-04-20T10:50:25.815 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.813+0000 7f3e2ad46640 1 -- start start 2024-04-20T10:50:25.815 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e2ad46640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e241efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:25.815 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e2ad46640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e24151a00 0x7f3e24150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:25.815 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e2ad46640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e24151e60 0x7f3e24151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:25.815 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e28ae2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e241efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e28ae2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e241efbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:53452/0 (socket says 172.21.15.90:53452) 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e1bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e24151a00 0x7f3e24150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e1bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e24151a00 0x7f3e24150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48184/0 (socket says 172.21.15.90:48184) 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e28ae2640 1 -- 172.21.15.90:0/2544274985 learned_addr learned my addr 172.21.15.90:0/2544274985 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3e240c7940 con 0x7f3e24151a00 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3e240c67d0 con 0x7f3e24151e60 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3e240adfe0 con 0x7f3e240ad640 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e292e3640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e24151e60 0x7f3e24151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e292e3640 1 -- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 msgr2=0x7f3e241efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.814+0000 7f3e292e3640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e241efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.815+0000 7f3e292e3640 1 -- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e24151a00 msgr2=0x7f3e24150c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.815+0000 7f3e292e3640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e24151a00 0x7f3e24150c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.815+0000 7f3e292e3640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e240bdaa0 con 0x7f3e24151e60 2024-04-20T10:50:25.816 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.815+0000 7f3e1bfff640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e24151a00 0x7f3e24150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:25.817 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.815+0000 7f3e292e3640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e24151e60 0x7f3e24151140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00ebd0 tx=0x7f3e1c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:25.817 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.816+0000 7f3e197fa640 1 -- 172.21.15.90:0/2544274985 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c018020 con 0x7f3e24151e60 2024-04-20T10:50:25.818 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.816+0000 7f3e197fa640 1 -- 172.21.15.90:0/2544274985 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e1c00cd20 con 0x7f3e24151e60 2024-04-20T10:50:25.818 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.816+0000 7f3e197fa640 1 -- 172.21.15.90:0/2544274985 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e1c0146c0 con 0x7f3e24151e60 2024-04-20T10:50:25.818 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.816+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e24152d20 con 0x7f3e24151e60 2024-04-20T10:50:25.818 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.816+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e24073820 con 0x7f3e24151e60 2024-04-20T10:50:25.818 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.817+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e04005290 con 0x7f3e24151e60 2024-04-20T10:50:25.818 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-20T10:50:25.818+0000 7fb69ef00640 -1 osd.2 0 waiting for initial osdmap 2024-04-20T10:50:25.819 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.818+0000 7f3e197fa640 1 -- 172.21.15.90:0/2544274985 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f3e1c005d10 con 0x7f3e24151e60 2024-04-20T10:50:25.819 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.819+0000 7f3e197fa640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3e1006c860 0x7f3e1006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:25.819 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.819+0000 7f3e197fa640 1 -- 172.21.15.90:0/2544274985 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7f3e1c08b820 con 0x7f3e24151e60 2024-04-20T10:50:25.819 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.819+0000 7f3e28ae2640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3e1006c860 0x7f3e1006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:25.819 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.819+0000 7f3e28ae2640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3e1006c860 0x7f3e1006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3e200090b0 tx=0x7f3e2003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:25.824 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-20T10:50:25.824+0000 7f349ee6f640 -1 osd.6 0 waiting for initial osdmap 2024-04-20T10:50:25.826 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:25.826+0000 7f3e197fa640 1 -- 172.21.15.90:0/2544274985 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3e1c022030 con 0x7f3e24151e60 2024-04-20T10:50:25.829 INFO:tasks.ceph.osd.1.smithi090.stderr:2024-04-20T10:50:25.830+0000 7f2e89392640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:25.834 INFO:tasks.ceph.osd.2.smithi090.stderr:2024-04-20T10:50:25.835+0000 7fb696d20640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:25.840 INFO:tasks.ceph.osd.6.smithi175.stderr:2024-04-20T10:50:25.840+0000 7f3496c8f640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-20T10:50:26.004 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.004+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3e04005580 con 0x7f3e24151e60 2024-04-20T10:50:26.005 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.005+0000 7f3e197fa640 1 -- 172.21.15.90:0/2544274985 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f3e1c010040 con 0x7f3e24151e60 2024-04-20T10:50:26.005 INFO:teuthology.misc.health.smithi090.stdout: 2024-04-20T10:50:26.005 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":12,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:23.667373+0000","last_up_change":"0.000000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:26.007 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3e1006c860 msgr2=0x7f3e1006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:26.007 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3e1006c860 0x7f3e1006ed20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3e200090b0 tx=0x7f3e2003d040 comp rx=0 tx=0).stop 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e24151e60 msgr2=0x7f3e24151140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e24151e60 0x7f3e24151140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c00ebd0 tx=0x7f3e1c00c490 comp rx=0 tx=0).stop 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 shutdown_connections 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3e1006c860 0x7f3e1006ed20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3e24151e60 0x7f3e24151140 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3e24151a00 0x7f3e24150c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 --2- 172.21.15.90:0/2544274985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3e240ad640 0x7f3e241efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 >> 172.21.15.90:0/2544274985 conn(0x7f3e240aa5e0 msgr2=0x7f3e240aa9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 shutdown_connections 2024-04-20T10:50:26.008 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:26.007+0000 7f3e2ad46640 1 -- 172.21.15.90:0/2544274985 wait complete. 2024-04-20T10:50:26.017 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-20T10:50:32.824 DEBUG:teuthology.orchestra.run.smithi090:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:32.926 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.926+0000 7faf585b6640 1 Processor -- start 2024-04-20T10:50:32.926 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.926+0000 7faf585b6640 1 -- start start 2024-04-20T10:50:32.928 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf585b6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faf5006eec0 0x7faf50157b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:32.928 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf585b6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faf5006ff80 0x7faf500c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:32.928 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf585b6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf500ac4a0 con 0x7faf50151d20 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf585b6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7faf500ab5e0 con 0x7faf5006eec0 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf585b6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faf500ac250 con 0x7faf5006ff80 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf55b51640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faf5006eec0 0x7faf50157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf56352640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7faf50151d20 0x7faf500c62e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:34080/0 (socket says 172.21.15.90:34080) 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf56352640 1 -- 172.21.15.90:0/395780451 learned_addr learned my addr 172.21.15.90:0/395780451 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf56b53640 1 --2- 172.21.15.90:0/395780451 >> v2:172.21.15.175:3300/0 conn(0x7faf5006ff80 0x7faf500c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf55b51640 1 -- 172.21.15.90:0/395780451 >> v2:172.21.15.175:3300/0 conn(0x7faf5006ff80 msgr2=0x7faf500c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf55b51640 1 --2- 172.21.15.90:0/395780451 >> v2:172.21.15.175:3300/0 conn(0x7faf5006ff80 0x7faf500c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf55b51640 1 -- 172.21.15.90:0/395780451 >> v1:172.21.15.90:6789/0 conn(0x7faf50151d20 legacy=0x7faf500c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf55350640 1 -- 172.21.15.90:0/395780451 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469576231 0 0) 0x7faf500ac4a0 con 0x7faf50151d20 2024-04-20T10:50:32.929 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf55b51640 1 -- 172.21.15.90:0/395780451 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf500ac780 con 0x7faf5006eec0 2024-04-20T10:50:32.930 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.927+0000 7faf56b53640 1 --2- 172.21.15.90:0/395780451 >> v2:172.21.15.175:3300/0 conn(0x7faf5006ff80 0x7faf500c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:32.930 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.928+0000 7faf55b51640 1 --2- 172.21.15.90:0/395780451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50157b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf50158c50 tx=0x7faf4002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d38533504dcee6a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:32.930 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.928+0000 7faf55350640 1 -- 172.21.15.90:0/395780451 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf400315a0 con 0x7faf5006eec0 2024-04-20T10:50:32.930 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.928+0000 7faf55350640 1 -- 172.21.15.90:0/395780451 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf40037070 con 0x7faf5006eec0 2024-04-20T10:50:32.930 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.928+0000 7faf55350640 1 -- 172.21.15.90:0/395780451 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf40031960 con 0x7faf5006eec0 2024-04-20T10:50:32.933 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 -- 172.21.15.90:0/395780451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 msgr2=0x7faf50157b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 --2- 172.21.15.90:0/395780451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50157b50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7faf50158c50 tx=0x7faf4002b840 comp rx=0 tx=0).stop 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 -- 172.21.15.90:0/395780451 shutdown_connections 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 --2- 172.21.15.90:0/395780451 >> v2:172.21.15.175:3300/0 conn(0x7faf5006ff80 0x7faf500c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 --2- 172.21.15.90:0/395780451 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50157b50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 -- 172.21.15.90:0/395780451 >> 172.21.15.90:0/395780451 conn(0x7faf50067640 msgr2=0x7faf50067a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 -- 172.21.15.90:0/395780451 shutdown_connections 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.929+0000 7faf585b6640 1 -- 172.21.15.90:0/395780451 wait complete. 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.930+0000 7faf585b6640 1 Processor -- start 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.930+0000 7faf585b6640 1 -- start start 2024-04-20T10:50:32.934 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf585b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf585b6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf5006ff80 0x7faf500c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf585b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf50151d20 0x7faf501ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf585b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faf500acd40 con 0x7faf5006eec0 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf585b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faf500c5e50 con 0x7faf50151d20 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf585b6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faf500c70d0 con 0x7faf5006ff80 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50153330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48240/0 (socket says 172.21.15.90:48240) 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 -- 172.21.15.90:0/2997678149 learned_addr learned my addr 172.21.15.90:0/2997678149 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56b53640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf50151d20 0x7faf501ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:32.935 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf55b51640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf5006ff80 0x7faf500c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 -- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf5006ff80 msgr2=0x7faf500c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf5006ff80 0x7faf500c3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 -- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf50151d20 msgr2=0x7faf501ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf50151d20 0x7faf501ed5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 -- 172.21.15.90:0/2997678149 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf500c8300 con 0x7faf5006eec0 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.931+0000 7faf56352640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50153330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00c430 tx=0x7faf4c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.932+0000 7faf46ffd640 1 -- 172.21.15.90:0/2997678149 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0074e0 con 0x7faf5006eec0 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.932+0000 7faf46ffd640 1 -- 172.21.15.90:0/2997678149 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c0047e0 con 0x7faf5006eec0 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.932+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf501ee090 con 0x7faf5006eec0 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.932+0000 7faf46ffd640 1 -- 172.21.15.90:0/2997678149 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c004bd0 con 0x7faf5006eec0 2024-04-20T10:50:32.936 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.932+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf500bf2a0 con 0x7faf5006eec0 2024-04-20T10:50:32.937 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.933+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf50151430 con 0x7faf5006eec0 2024-04-20T10:50:32.937 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.933+0000 7faf46ffd640 1 -- 172.21.15.90:0/2997678149 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faf4c011070 con 0x7faf5006eec0 2024-04-20T10:50:32.937 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.933+0000 7faf46ffd640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faf3406c8f0 0x7faf3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:32.937 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.933+0000 7faf55b51640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faf3406c8f0 0x7faf3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:32.937 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.934+0000 7faf46ffd640 1 -- 172.21.15.90:0/2997678149 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7faf4c08b430 con 0x7faf5006eec0 2024-04-20T10:50:32.937 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.934+0000 7faf55b51640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faf3406c8f0 0x7faf3406edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf40036000 tx=0x7faf4003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:32.938 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:32.938+0000 7faf46ffd640 1 -- 172.21.15.90:0/2997678149 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faf50151430 con 0x7faf5006eec0 2024-04-20T10:50:33.112 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.112+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf5004fcf0 con 0x7faf5006eec0 2024-04-20T10:50:33.113 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.113+0000 7faf46ffd640 1 -- 172.21.15.90:0/2997678149 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7faf4c00e280 con 0x7faf5006eec0 2024-04-20T10:50:33.113 INFO:teuthology.misc.health.smithi090.stdout: 2024-04-20T10:50:33.113 INFO:teuthology.misc.health.smithi090.stdout:{"epoch":17,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:30.526955+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:33.115 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faf3406c8f0 msgr2=0x7faf3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.115 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faf3406c8f0 0x7faf3406edb0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf40036000 tx=0x7faf4003d040 comp rx=0 tx=0).stop 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 msgr2=0x7faf50153330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50153330 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00c430 tx=0x7faf4c00c8f0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 shutdown_connections 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faf3406c8f0 0x7faf3406edb0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faf50151d20 0x7faf501ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faf5006ff80 0x7faf500c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 --2- 172.21.15.90:0/2997678149 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faf5006eec0 0x7faf50153330 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 >> 172.21.15.90:0/2997678149 conn(0x7faf50067640 msgr2=0x7faf5014ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 shutdown_connections 2024-04-20T10:50:33.116 INFO:teuthology.misc.health.smithi090.stderr:2024-04-20T10:50:33.115+0000 7faf585b6640 1 -- 172.21.15.90:0/2997678149 wait complete. 2024-04-20T10:50:33.125 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-20T10:50:33.125 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-20T10:50:33.125 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-20T10:50:33.126 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-20T10:50:33.128 INFO:tasks.ceph.mds.a:Started 2024-04-20T10:50:33.128 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-20T10:50:33.128 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-20T10:50:33.130 INFO:tasks.ceph.mds.c:Started 2024-04-20T10:50:33.130 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-20T10:50:33.130 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-20T10:50:33.132 INFO:tasks.ceph.mds.b:Started 2024-04-20T10:50:33.133 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-20T10:50:33.133 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-20T10:50:33.135 INFO:tasks.ceph.mds.d:Started 2024-04-20T10:50:33.135 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-20T10:50:33.135 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:33.200 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-20T10:50:33.201 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-04-20T10:50:33.216 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-20T10:50:33.217 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-04-20T10:50:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.235+0000 7f2c0406d640 1 Processor -- start 2024-04-20T10:50:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0406d640 1 -- start start 2024-04-20T10:50:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0406d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc153ef0 0x7f2bfc0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0406d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2bfc0c9ee0 0x7f2bfc156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0260a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2bfc0c9ee0 0x7f2bfc156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0406d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bfc15a720 con 0x7f2bfc0ab730 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0406d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2bfc15ac80 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0406d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2bfc15a9a0 con 0x7f2bfc153ef0 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0260a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2bfc0c9ee0 0x7f2bfc156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48272/0 (socket says 172.21.15.90:48272) 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.236+0000 7f2c0260a640 1 -- 172.21.15.90:0/3111877096 learned_addr learned my addr 172.21.15.90:0/3111877096 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.237+0000 7f2c01e09640 1 --2- 172.21.15.90:0/3111877096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc153ef0 0x7f2bfc0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.237+0000 7f2c0260a640 1 -- 172.21.15.90:0/3111877096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc153ef0 msgr2=0x7f2bfc0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.237+0000 7f2c0260a640 1 --2- 172.21.15.90:0/3111877096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc153ef0 0x7f2bfc0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.237+0000 7f2c0260a640 1 -- 172.21.15.90:0/3111877096 >> v1:172.21.15.90:6789/0 conn(0x7f2bfc0ab730 legacy=0x7f2bfc1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.237+0000 7f2c00e07640 1 -- 172.21.15.90:0/3111877096 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2250495698 0 0) 0x7f2bec001110 con 0x7f2bfc0ab730 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.237+0000 7f2c0260a640 1 -- 172.21.15.90:0/3111877096 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc0c6a90 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.237+0000 7f2c0260a640 1 --2- 172.21.15.90:0/3111877096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc156fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009e50 tx=0x7f2bf402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e5fd29e30b1b1d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c00e07640 1 -- 172.21.15.90:0/3111877096 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf402c9e0 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c00e07640 1 -- 172.21.15.90:0/3111877096 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bf402cb80 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c00e07640 1 -- 172.21.15.90:0/3111877096 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf40343f0 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 -- 172.21.15.90:0/3111877096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 msgr2=0x7f2bfc156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 --2- 172.21.15.90:0/3111877096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc156fd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009e50 tx=0x7f2bf402be40 comp rx=0 tx=0).stop 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 -- 172.21.15.90:0/3111877096 shutdown_connections 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 --2- 172.21.15.90:0/3111877096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc156fd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 --2- 172.21.15.90:0/3111877096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc153ef0 0x7f2bfc0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 -- 172.21.15.90:0/3111877096 >> 172.21.15.90:0/3111877096 conn(0x7f2bfc0cbfe0 msgr2=0x7f2bfc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:33.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 -- 172.21.15.90:0/3111877096 shutdown_connections 2024-04-20T10:50:33.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.238+0000 7f2c0406d640 1 -- 172.21.15.90:0/3111877096 wait complete. 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.239+0000 7f2c0406d640 1 Processor -- start 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.239+0000 7f2c0406d640 1 -- start start 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0406d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc0ab730 0x7f2bfc0aa7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0406d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc0aace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0406d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bfc153ef0 0x7f2bfc1ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0406d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc0bf800 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0406d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc157510 con 0x7f2bfc153ef0 2024-04-20T10:50:33.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0406d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2bfc159a10 con 0x7f2bfc0ab730 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc0aace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc0aace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48274/0 (socket says 172.21.15.90:48274) 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 -- 172.21.15.90:0/2412556597 learned_addr learned my addr 172.21.15.90:0/2412556597 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01e09640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc0ab730 0x7f2bfc0aa7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0260a640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bfc153ef0 0x7f2bfc1ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 -- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc0ab730 msgr2=0x7f2bfc0aa7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc0ab730 0x7f2bfc0aa7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 -- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bfc153ef0 msgr2=0x7f2bfc1ef780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bfc153ef0 0x7f2bfc1ef780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c01608640 1 -- 172.21.15.90:0/2412556597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc0ab220 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.240+0000 7f2c0260a640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bfc153ef0 0x7f2bfc1ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.241+0000 7f2c01608640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc0aace0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c410 tx=0x7f2bec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.241+0000 7f2bf27fc640 1 -- 172.21.15.90:0/2412556597 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec017070 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.241+0000 7f2bf27fc640 1 -- 172.21.15.90:0/2412556597 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2bec0052d0 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.241+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc0af3f0 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.241+0000 7f2bf27fc640 1 -- 172.21.15.90:0/2412556597 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bec003850 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.241+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc0af110 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.242+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bfc076150 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.242+0000 7f2bf27fc640 1 -- 172.21.15.90:0/2412556597 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2bec01a070 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.243+0000 7f2bf27fc640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2be006c8f0 0x7f2be006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.243+0000 7f2bf27fc640 1 -- 172.21.15.90:0/2412556597 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2bec08ca10 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.243+0000 7f2c01e09640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2be006c8f0 0x7f2be006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.243+0000 7f2c01e09640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2be006c8f0 0x7f2be006edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8006fd0 tx=0x7f2bf8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.247+0000 7f2bf27fc640 1 -- 172.21.15.90:0/2412556597 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2bfc15a720 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.425+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2bfc06d070 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.425+0000 7f2bf27fc640 1 -- 172.21.15.90:0/2412556597 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f2bec058ff0 con 0x7f2bfc0c9ee0 2024-04-20T10:50:33.426 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:33.426 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":17,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:30.526955+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:33.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2be006c8f0 msgr2=0x7f2be006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2be006c8f0 0x7f2be006edb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8006fd0 tx=0x7f2bf8008040 comp rx=0 tx=0).stop 2024-04-20T10:50:33.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 msgr2=0x7f2bfc0aace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc0aace0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2bec00c410 tx=0x7f2bec00c8d0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 shutdown_connections 2024-04-20T10:50:33.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2be006c8f0 0x7f2be006edb0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2bfc153ef0 0x7f2bfc1ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2bfc0c9ee0 0x7f2bfc0aace0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.427+0000 7f2c0406d640 1 --2- 172.21.15.90:0/2412556597 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2bfc0ab730 0x7f2bfc0aa7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.428+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 >> 172.21.15.90:0/2412556597 conn(0x7f2bfc0cbfe0 msgr2=0x7f2bfc0ca660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:33.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.428+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 shutdown_connections 2024-04-20T10:50:33.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.428+0000 7f2c0406d640 1 -- 172.21.15.90:0/2412556597 wait complete. 2024-04-20T10:50:33.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:50:33.439 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:50:33.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.537+0000 7f6633274640 1 Processor -- start 2024-04-20T10:50:33.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.537+0000 7f6633274640 1 -- start start 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6633274640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f662c153ee0 0x7f662c157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6633274640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c0ab710 0x7f662c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6633274640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f662c0adce0 con 0x7f662c0c6f20 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6633274640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f662c0adfc0 con 0x7f662c153ee0 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6633274640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f662c0ae2a0 con 0x7f662c0ab710 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6631811640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f662c0c6f20 0x7f662c06c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:34116/0 (socket says 172.21.15.90:34116) 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6631811640 1 -- 172.21.15.90:0/168772620 learned_addr learned my addr 172.21.15.90:0/168772620 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f663080f640 1 --2- 172.21.15.90:0/168772620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c0ab710 0x7f662c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6631010640 1 --2- 172.21.15.90:0/168772620 >> v2:172.21.15.175:3300/0 conn(0x7f662c153ee0 0x7f662c157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6623fff640 1 -- 172.21.15.90:0/168772620 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435467519 0 0) 0x7f662c0adce0 con 0x7f662c0c6f20 2024-04-20T10:50:33.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6623fff640 1 -- 172.21.15.90:0/168772620 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6618003520 con 0x7f662c0c6f20 2024-04-20T10:50:33.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6623fff640 1 -- 172.21.15.90:0/168772620 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116774240 0 0) 0x7f6618003520 con 0x7f662c0c6f20 2024-04-20T10:50:33.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f663080f640 1 -- 172.21.15.90:0/168772620 >> v2:172.21.15.175:3300/0 conn(0x7f662c153ee0 msgr2=0x7f662c157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:33.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f663080f640 1 --2- 172.21.15.90:0/168772620 >> v2:172.21.15.175:3300/0 conn(0x7f662c153ee0 0x7f662c157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f663080f640 1 -- 172.21.15.90:0/168772620 >> v1:172.21.15.90:6789/0 conn(0x7f662c0c6f20 legacy=0x7f662c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f663080f640 1 -- 172.21.15.90:0/168772620 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c0bf7d0 con 0x7f662c0ab710 2024-04-20T10:50:33.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.538+0000 7f6631010640 1 --2- 172.21.15.90:0/168772620 >> v2:172.21.15.175:3300/0 conn(0x7f662c153ee0 0x7f662c157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:33.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.539+0000 7f663080f640 1 --2- 172.21.15.90:0/168772620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c0ab710 0x7f662c0c69e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f661c0097a0 tx=0x7f661c02b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=960744bc9648b96c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6623fff640 1 -- 172.21.15.90:0/168772620 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c037070 con 0x7f662c0ab710 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6623fff640 1 -- 172.21.15.90:0/168772620 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f661c030510 con 0x7f662c0ab710 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6623fff640 1 -- 172.21.15.90:0/168772620 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c02be60 con 0x7f662c0ab710 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 -- 172.21.15.90:0/168772620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c0ab710 msgr2=0x7f662c0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 --2- 172.21.15.90:0/168772620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c0ab710 0x7f662c0c69e0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f661c0097a0 tx=0x7f661c02b660 comp rx=0 tx=0).stop 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 -- 172.21.15.90:0/168772620 shutdown_connections 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 --2- 172.21.15.90:0/168772620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c0ab710 0x7f662c0c69e0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 --2- 172.21.15.90:0/168772620 >> v2:172.21.15.175:3300/0 conn(0x7f662c153ee0 0x7f662c157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 -- 172.21.15.90:0/168772620 >> 172.21.15.90:0/168772620 conn(0x7f662c0cc060 msgr2=0x7f662c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 -- 172.21.15.90:0/168772620 shutdown_connections 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.540+0000 7f6633274640 1 -- 172.21.15.90:0/168772620 wait complete. 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.541+0000 7f6633274640 1 Processor -- start 2024-04-20T10:50:33.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.542+0000 7f6633274640 1 -- start start 2024-04-20T10:50:33.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.542+0000 7f6633274640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f662c0ab710 0x7f662c0caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.542+0000 7f6633274640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f662c0c6f20 0x7f662c0c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.542+0000 7f6633274640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c153ee0 0x7f662c0c21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.542+0000 7f6633274640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f662c06cfb0 con 0x7f662c0ab710 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.542+0000 7f6633274640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f662c06ce30 con 0x7f662c0c6f20 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6633274640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f662c06d130 con 0x7f662c153ee0 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f662c0ab710 0x7f662c0caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f662c0ab710 0x7f662c0caf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48286/0 (socket says 172.21.15.90:48286) 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 -- 172.21.15.90:0/2485056453 learned_addr learned my addr 172.21.15.90:0/2485056453 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631811640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c153ee0 0x7f662c0c21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f663080f640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f662c0c6f20 0x7f662c0c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 -- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c153ee0 msgr2=0x7f662c0c21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c153ee0 0x7f662c0c21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 -- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f662c0c6f20 msgr2=0x7f662c0c1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f662c0c6f20 0x7f662c0c1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 -- 172.21.15.90:0/2485056453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c1f0210 con 0x7f662c0ab710 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6631010640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f662c0ab710 0x7f662c0caf40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f662800ebe0 tx=0x7f662800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.543+0000 7f6621ffb640 1 -- 172.21.15.90:0/2485056453 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6628017070 con 0x7f662c0ab710 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.544+0000 7f6621ffb640 1 -- 172.21.15.90:0/2485056453 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f662800cc30 con 0x7f662c0ab710 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.544+0000 7f6621ffb640 1 -- 172.21.15.90:0/2485056453 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6628013470 con 0x7f662c0ab710 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.544+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662c1f04b0 con 0x7f662c0ab710 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.544+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662c0cb480 con 0x7f662c0ab710 2024-04-20T10:50:33.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.545+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662c076150 con 0x7f662c0ab710 2024-04-20T10:50:33.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.545+0000 7f6621ffb640 1 -- 172.21.15.90:0/2485056453 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f662801a070 con 0x7f662c0ab710 2024-04-20T10:50:33.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.545+0000 7f6621ffb640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.545+0000 7f6621ffb640 1 -- 172.21.15.90:0/2485056453 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f662808b720 con 0x7f662c0ab710 2024-04-20T10:50:33.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.545+0000 7f663080f640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.546+0000 7f663080f640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f661006c8f0 0x7f661006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f661c034000 tx=0x7f661c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.550+0000 7f6621ffb640 1 -- 172.21.15.90:0/2485056453 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6628059850 con 0x7f662c0ab710 2024-04-20T10:50:33.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.724+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f662c0ab4f0 con 0x7f662c0ab710 2024-04-20T10:50:33.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.725+0000 7f6621ffb640 1 -- 172.21.15.90:0/2485056453 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f662805db50 con 0x7f662c0ab710 2024-04-20T10:50:33.725 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:50:33.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f661006c8f0 msgr2=0x7f661006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f661006c8f0 0x7f661006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f661c034000 tx=0x7f661c008030 comp rx=0 tx=0).stop 2024-04-20T10:50:33.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f662c0ab710 msgr2=0x7f662c0caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f662c0ab710 0x7f662c0caf40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f662800ebe0 tx=0x7f662800c520 comp rx=0 tx=0).stop 2024-04-20T10:50:33.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 shutdown_connections 2024-04-20T10:50:33.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f661006c8f0 0x7f661006edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f662c153ee0 0x7f662c0c21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f662c0c6f20 0x7f662c0c1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 --2- 172.21.15.90:0/2485056453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f662c0ab710 0x7f662c0caf40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 >> 172.21.15.90:0/2485056453 conn(0x7f662c0cc060 msgr2=0x7f662c0aecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:33.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 shutdown_connections 2024-04-20T10:50:33.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.727+0000 7f6633274640 1 -- 172.21.15.90:0/2485056453 wait complete. 2024-04-20T10:50:33.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:50:33.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.835+0000 7f56fb950640 1 Processor -- start 2024-04-20T10:50:33.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.835+0000 7f56fb950640 1 -- start start 2024-04-20T10:50:33.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.836+0000 7f56fb950640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f56f4151f50 0x7f56f41551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.836+0000 7f56fb950640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f4158780 con 0x7f56f4072860 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.836+0000 7f56fb950640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f41546d0 con 0x7f56f40c45c0 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.836+0000 7f56fb950640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f56f40ad010 con 0x7f56f4151f50 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.836+0000 7f56f96ec640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f56f4072860 0x7f56f40ab4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:34120/0 (socket says 172.21.15.90:34120) 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.836+0000 7f56f96ec640 1 -- 172.21.15.90:0/2152586110 learned_addr learned my addr 172.21.15.90:0/2152586110 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f9eed640 1 --2- 172.21.15.90:0/2152586110 >> v2:172.21.15.175:3300/0 conn(0x7f56f4151f50 0x7f56f41551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1880707777 0 0) 0x7f56f4158780 con 0x7f56f4072860 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e0003520 con 0x7f56f4072860 2024-04-20T10:50:33.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 860079810 0 0) 0x7f56e0003520 con 0x7f56f4072860 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 >> v2:172.21.15.175:3300/0 conn(0x7f56f4151f50 msgr2=0x7f56f41551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 --2- 172.21.15.90:0/2152586110 >> v2:172.21.15.175:3300/0 conn(0x7f56f4151f50 0x7f56f41551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 >> v1:172.21.15.175:6789/0 conn(0x7f56f40c45c0 legacy=0x7f56f4151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f41549b0 con 0x7f56f4072860 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f56f00019f0 con 0x7f56f4072860 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 >> v1:172.21.15.90:6789/0 conn(0x7f56f4072860 legacy=0x7f56f40ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e0004800 0x7f56e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e00051c0 0x7f56e000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56f40ad010 con 0x7f56e00039b0 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56e000c160 con 0x7f56e0004800 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f56e000c360 con 0x7f56e00051c0 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f96ec640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f8eeb640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e0004800 0x7f56e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f9eed640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e00051c0 0x7f56e000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f96ec640 1 -- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e00051c0 msgr2=0x7f56e000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f96ec640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56e00051c0 0x7f56e000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f96ec640 1 -- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e0004800 msgr2=0x7f56e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f96ec640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e0004800 0x7f56e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f96ec640 1 -- 172.21.15.90:0/2152586110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e0003520 con 0x7f56e00039b0 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f9eed640 1 -- 172.21.15.90:0/2152586110 reap_dead start 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.837+0000 7f56f8eeb640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56e0004800 0x7f56e0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.838+0000 7f56f96ec640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56e0003dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56f000a840 tx=0x7f56e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41478dd07c7d362 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.838+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f000a460 con 0x7f56e00039b0 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.838+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f0034650 con 0x7f56e00039b0 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.838+0000 7f56ebfff640 1 -- 172.21.15.90:0/2152586110 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0034a40 con 0x7f56e00039b0 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.839+0000 7f56fb950640 1 -- 172.21.15.90:0/2152586110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 msgr2=0x7f56e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.839+0000 7f56fb950640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56e0003dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56f000a840 tx=0x7f56e0005830 comp rx=0 tx=0).stop 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.839+0000 7f56fb950640 1 -- 172.21.15.90:0/2152586110 shutdown_connections 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.839+0000 7f56fb950640 1 --2- 172.21.15.90:0/2152586110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56e0003dd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.839+0000 7f56fb950640 1 -- 172.21.15.90:0/2152586110 >> 172.21.15.90:0/2152586110 conn(0x7f56f4067de0 msgr2=0x7f56f40ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.839+0000 7f56fb950640 1 -- 172.21.15.90:0/2152586110 shutdown_connections 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.839+0000 7f56fb950640 1 -- 172.21.15.90:0/2152586110 wait complete. 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 Processor -- start 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 -- start start 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56f41ef330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56f40c41c0 0x7f56f406e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56f40aef60 0x7f56f41533f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4158a60 con 0x7f56e00039b0 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f56f4158530 con 0x7f56f40aef60 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.840+0000 7f56fb950640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f56f4072c40 con 0x7f56f40c41c0 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56f41ef330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56f41ef330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48306/0 (socket says 172.21.15.90:48306) 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 -- 172.21.15.90:0/1380939404 learned_addr learned my addr 172.21.15.90:0/1380939404 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 -- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56f40c41c0 msgr2=0x7f56f406e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f9eed640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56f40aef60 0x7f56f41533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f8eeb640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56f40c41c0 0x7f56f406e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56f40c41c0 0x7f56f406e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 -- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56f40aef60 msgr2=0x7f56f41533f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56f40aef60 0x7f56f41533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 -- 172.21.15.90:0/1380939404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f40c3780 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56f96ec640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56f41ef330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56f000a960 tx=0x7f56f4154b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56e9ffb640 1 -- 172.21.15.90:0/1380939404 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0034800 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56e9ffb640 1 -- 172.21.15.90:0/1380939404 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56f0044070 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56f40c3a60 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56e9ffb640 1 -- 172.21.15.90:0/1380939404 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56f0034ba0 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.841+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56f40ae760 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.842+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56f4076150 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.843+0000 7f56e9ffb640 1 -- 172.21.15.90:0/1380939404 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f56f0049460 con 0x7f56e00039b0 2024-04-20T10:50:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.843+0000 7f56e9ffb640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f56d806c920 0x7f56d806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:33.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.843+0000 7f56e9ffb640 1 -- 172.21.15.90:0/1380939404 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f56f00adde0 con 0x7f56e00039b0 2024-04-20T10:50:33.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.843+0000 7f56f8eeb640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f56d806c920 0x7f56d806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:33.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.844+0000 7f56f8eeb640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f56d806c920 0x7f56d806ede0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56f414a2e0 tx=0x7f56e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:33.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:33.847+0000 7f56e9ffb640 1 -- 172.21.15.90:0/1380939404 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f56f0032380 con 0x7f56e00039b0 2024-04-20T10:50:34.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.059+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f56f406e810 con 0x7f56e00039b0 2024-04-20T10:50:34.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.060+0000 7f56e9ffb640 1 -- 172.21.15.90:0/1380939404 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f56f007c5f0 con 0x7f56e00039b0 2024-04-20T10:50:34.060 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:34.060 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-20T10:50:34.060 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 2 2024-04-20T10:50:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f56d806c920 msgr2=0x7f56d806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f56d806c920 0x7f56d806ede0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f56f414a2e0 tx=0x7f56e4009040 comp rx=0 tx=0).stop 2024-04-20T10:50:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 msgr2=0x7f56f41ef330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56f41ef330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f56f000a960 tx=0x7f56f4154b80 comp rx=0 tx=0).stop 2024-04-20T10:50:34.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 shutdown_connections 2024-04-20T10:50:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f56d806c920 0x7f56d806ede0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f56f40aef60 0x7f56f41533f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f56f40c41c0 0x7f56f406e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 --2- 172.21.15.90:0/1380939404 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f56e00039b0 0x7f56f41ef330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 >> 172.21.15.90:0/1380939404 conn(0x7f56f4067de0 msgr2=0x7f56f40c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 shutdown_connections 2024-04-20T10:50:34.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:34.062+0000 7f56fb950640 1 -- 172.21.15.90:0/1380939404 wait complete. 2024-04-20T10:50:36.073 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:50:36.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.180+0000 7f8a82281640 1 Processor -- start 2024-04-20T10:50:36.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a82281640 1 -- start start 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a82281640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a82281640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a7c0ab730 0x7f8a7c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a82281640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7c15a720 con 0x7f8a7c0c9ee0 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a82281640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8a7c15ac80 con 0x7f8a7c0ab730 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a82281640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c15a9a0 con 0x7f8a7c153ef0 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a7b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a7c0ab730 0x7f8a7c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a7b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a7c0ab730 0x7f8a7c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54058/0 (socket says 172.21.15.90:54058) 2024-04-20T10:50:36.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a7b7fe640 1 -- 172.21.15.90:0/247550838 learned_addr learned my addr 172.21.15.90:0/247550838 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:36.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.181+0000 7f8a7bfff640 1 --2- 172.21.15.90:0/247550838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.182+0000 7f8a7b7fe640 1 -- 172.21.15.90:0/247550838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 msgr2=0x7f8a7c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:36.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.182+0000 7f8a7b7fe640 1 --2- 172.21.15.90:0/247550838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.182+0000 7f8a7b7fe640 1 -- 172.21.15.90:0/247550838 >> v1:172.21.15.175:6789/0 conn(0x7f8a7c0c9ee0 legacy=0x7f8a7c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.182+0000 7f8a7b7fe640 1 -- 172.21.15.90:0/247550838 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c0c6a90 con 0x7f8a7c0ab730 2024-04-20T10:50:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.182+0000 7f8a7b7fe640 1 --2- 172.21.15.90:0/247550838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1568c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009870 tx=0x7f8a7002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=748af75cccc2196 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a7affd640 1 -- 172.21.15.90:0/247550838 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a700317c0 con 0x7f8a7c0ab730 2024-04-20T10:50:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a7affd640 1 -- 172.21.15.90:0/247550838 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a70037070 con 0x7f8a7c0ab730 2024-04-20T10:50:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a7affd640 1 -- 172.21.15.90:0/247550838 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a70031b80 con 0x7f8a7c0ab730 2024-04-20T10:50:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 -- 172.21.15.90:0/247550838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 msgr2=0x7f8a7c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 --2- 172.21.15.90:0/247550838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1568c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8a70009870 tx=0x7f8a7002b860 comp rx=0 tx=0).stop 2024-04-20T10:50:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 -- 172.21.15.90:0/247550838 shutdown_connections 2024-04-20T10:50:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 --2- 172.21.15.90:0/247550838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1568c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 --2- 172.21.15.90:0/247550838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 -- 172.21.15.90:0/247550838 >> 172.21.15.90:0/247550838 conn(0x7f8a7c0cbfe0 msgr2=0x7f8a7c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 -- 172.21.15.90:0/247550838 shutdown_connections 2024-04-20T10:50:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.183+0000 7f8a82281640 1 -- 172.21.15.90:0/247550838 wait complete. 2024-04-20T10:50:36.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.184+0000 7f8a82281640 1 Processor -- start 2024-04-20T10:50:36.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a82281640 1 -- start start 2024-04-20T10:50:36.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a82281640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1f0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a82281640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c0c9ee0 0x7f8a7c1ec160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a82281640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a82281640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c0bf800 con 0x7f8a7c0ab730 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a82281640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a7c157510 con 0x7f8a7c0c9ee0 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a82281640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a7c0c2930 con 0x7f8a7c153ef0 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1f0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a7bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1f0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54064/0 (socket says 172.21.15.90:54064) 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.185+0000 7f8a7bfff640 1 -- 172.21.15.90:0/4141666746 learned_addr learned my addr 172.21.15.90:0/4141666746 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a7bfff640 1 -- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 msgr2=0x7f8a7c0c5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a8081e640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a7b7fe640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c0c9ee0 0x7f8a7c1ec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a7bfff640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a7bfff640 1 -- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c0c9ee0 msgr2=0x7f8a7c1ec160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a7bfff640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c0c9ee0 0x7f8a7c1ec160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a7bfff640 1 -- 172.21.15.90:0/4141666746 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a7c150b20 con 0x7f8a7c0ab730 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a7bfff640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1f0250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00e9e0 tx=0x7f8a6c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a78ff9640 1 -- 172.21.15.90:0/4141666746 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c017070 con 0x7f8a7c0ab730 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a78ff9640 1 -- 172.21.15.90:0/4141666746 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a6c00c9d0 con 0x7f8a7c0ab730 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a7c1ef770 con 0x7f8a7c0ab730 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a78ff9640 1 -- 172.21.15.90:0/4141666746 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c00cdc0 con 0x7f8a7c0ab730 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.186+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a7c1efd30 con 0x7f8a7c0ab730 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.187+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a7c076150 con 0x7f8a7c0ab730 2024-04-20T10:50:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.188+0000 7f8a78ff9640 1 -- 172.21.15.90:0/4141666746 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a6c01a070 con 0x7f8a7c0ab730 2024-04-20T10:50:36.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.188+0000 7f8a78ff9640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a6806c920 0x7f8a6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.188+0000 7f8a78ff9640 1 -- 172.21.15.90:0/4141666746 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8a6c08bac0 con 0x7f8a7c0ab730 2024-04-20T10:50:36.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.188+0000 7f8a7b7fe640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a6806c920 0x7f8a6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.188+0000 7f8a7b7fe640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a6806c920 0x7f8a6806ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a70036000 tx=0x7f8a70008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.193+0000 7f8a78ff9640 1 -- 172.21.15.90:0/4141666746 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8a6c05a2d0 con 0x7f8a7c0ab730 2024-04-20T10:50:36.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.407+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a7c152730 con 0x7f8a7c0ab730 2024-04-20T10:50:36.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.407+0000 7f8a78ff9640 1 -- 172.21.15.90:0/4141666746 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f8a6c059bd0 con 0x7f8a7c0ab730 2024-04-20T10:50:36.408 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:36.408 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4299,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-20T10:50:36.408 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 3 2024-04-20T10:50:36.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a6806c920 msgr2=0x7f8a6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a6806c920 0x7f8a6806ede0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8a70036000 tx=0x7f8a70008030 comp rx=0 tx=0).stop 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 msgr2=0x7f8a7c1f0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1f0250 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c00e9e0 tx=0x7f8a6c00eea0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 shutdown_connections 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a6806c920 0x7f8a6806ede0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a7c153ef0 0x7f8a7c0c5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a7c0c9ee0 0x7f8a7c1ec160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 --2- 172.21.15.90:0/4141666746 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a7c0ab730 0x7f8a7c1f0250 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 >> 172.21.15.90:0/4141666746 conn(0x7f8a7c0cbfe0 msgr2=0x7f8a7c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 shutdown_connections 2024-04-20T10:50:36.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.409+0000 7f8a82281640 1 -- 172.21.15.90:0/4141666746 wait complete. 2024-04-20T10:50:36.420 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:36.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.516+0000 7f2fcb7e6640 1 Processor -- start 2024-04-20T10:50:36.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.516+0000 7f2fcb7e6640 1 -- start start 2024-04-20T10:50:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fcb7e6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fc4153ee0 0x7f2fc4157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fcb7e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40ab710 0x7f2fc40c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fcb7e6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fc40adce0 con 0x7f2fc40c6f20 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fcb7e6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2fc40adfc0 con 0x7f2fc4153ee0 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fcb7e6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc40ae2a0 con 0x7f2fc40ab710 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc9582640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fc4153ee0 0x7f2fc4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc8d81640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40ab710 0x7f2fc40c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc9582640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2fc4153ee0 0x7f2fc4157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:42088/0 (socket says 172.21.15.90:42088) 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc9582640 1 -- 172.21.15.90:0/1170012481 learned_addr learned my addr 172.21.15.90:0/1170012481 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc9d83640 1 --1- 172.21.15.90:0/1170012481 >> v1:172.21.15.175:6789/0 conn(0x7f2fc40c6f20 0x7f2fc406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:43298/0 (socket says 172.21.15.90:43298) 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc8d81640 1 -- 172.21.15.90:0/1170012481 >> v2:172.21.15.175:3300/0 conn(0x7f2fc4153ee0 msgr2=0x7f2fc4157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc8d81640 1 --2- 172.21.15.90:0/1170012481 >> v2:172.21.15.175:3300/0 conn(0x7f2fc4153ee0 0x7f2fc4157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc8d81640 1 -- 172.21.15.90:0/1170012481 >> v1:172.21.15.175:6789/0 conn(0x7f2fc40c6f20 legacy=0x7f2fc406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.517+0000 7f2fc8d81640 1 -- 172.21.15.90:0/1170012481 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc40bf7d0 con 0x7f2fc40ab710 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.518+0000 7f2fc8d81640 1 --2- 172.21.15.90:0/1170012481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40ab710 0x7f2fc40c69e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40097a0 tx=0x7f2fb402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ca12e96c17128db server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.518+0000 7f2fbbfff640 1 -- 172.21.15.90:0/1170012481 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4038070 con 0x7f2fc40ab710 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.518+0000 7f2fbbfff640 1 -- 172.21.15.90:0/1170012481 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fb4031700 con 0x7f2fc40ab710 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.518+0000 7f2fbbfff640 1 -- 172.21.15.90:0/1170012481 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb4031ad0 con 0x7f2fc40ab710 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/1170012481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40ab710 msgr2=0x7f2fc40c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/1170012481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40ab710 0x7f2fc40c69e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2fb40097a0 tx=0x7f2fb402b7a0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/1170012481 shutdown_connections 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/1170012481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40ab710 0x7f2fc40c69e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/1170012481 >> v2:172.21.15.175:3300/0 conn(0x7f2fc4153ee0 0x7f2fc4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/1170012481 >> 172.21.15.90:0/1170012481 conn(0x7f2fc40cc060 msgr2=0x7f2fc40cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:36.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/1170012481 shutdown_connections 2024-04-20T10:50:36.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.519+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/1170012481 wait complete. 2024-04-20T10:50:36.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.520+0000 7f2fcb7e6640 1 Processor -- start 2024-04-20T10:50:36.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.520+0000 7f2fcb7e6640 1 -- start start 2024-04-20T10:50:36.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fcb7e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40ab710 0x7f2fc40c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fcb7e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40c6f20 0x7f2fc4152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fcb7e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc4153ee0 0x7f2fc4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fcb7e6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc406cff0 con 0x7f2fc4153ee0 2024-04-20T10:50:36.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fcb7e6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc406ce70 con 0x7f2fc40ab710 2024-04-20T10:50:36.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fcb7e6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc406d170 con 0x7f2fc40c6f20 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc4153ee0 0x7f2fc4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc4153ee0 0x7f2fc4153210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54070/0 (socket says 172.21.15.90:54070) 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 -- 172.21.15.90:0/787174412 learned_addr learned my addr 172.21.15.90:0/787174412 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9582640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40ab710 0x7f2fc40c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc8d81640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40c6f20 0x7f2fc4152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 -- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40c6f20 msgr2=0x7f2fc4152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40c6f20 0x7f2fc4152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 -- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40ab710 msgr2=0x7f2fc40c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40ab710 0x7f2fc40c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 -- 172.21.15.90:0/787174412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc41e3a20 con 0x7f2fc4153ee0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fc9d83640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc4153ee0 0x7f2fc4153210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c760 tx=0x7f2fbc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fb9ffb640 1 -- 172.21.15.90:0/787174412 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc017070 con 0x7f2fc4153ee0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fb9ffb640 1 -- 172.21.15.90:0/787174412 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fbc00a640 con 0x7f2fc4153ee0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc415a130 con 0x7f2fc4153ee0 2024-04-20T10:50:36.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.521+0000 7f2fb9ffb640 1 -- 172.21.15.90:0/787174412 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc00a9f0 con 0x7f2fc4153ee0 2024-04-20T10:50:36.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.522+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc415a6f0 con 0x7f2fc4153ee0 2024-04-20T10:50:36.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.523+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc4076150 con 0x7f2fc4153ee0 2024-04-20T10:50:36.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.523+0000 7f2fb9ffb640 1 -- 172.21.15.90:0/787174412 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fbc01a070 con 0x7f2fc4153ee0 2024-04-20T10:50:36.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.523+0000 7f2fb9ffb640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2fa806c8f0 0x7f2fa806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.523+0000 7f2fc9582640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2fa806c8f0 0x7f2fa806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.523+0000 7f2fb9ffb640 1 -- 172.21.15.90:0/787174412 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2fbc08ac10 con 0x7f2fc4153ee0 2024-04-20T10:50:36.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.524+0000 7f2fc9582640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2fa806c8f0 0x7f2fa806edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40b1d90 tx=0x7f2fc0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.528+0000 7f2fb9ffb640 1 -- 172.21.15.90:0/787174412 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2fbc058dd0 con 0x7f2fc4153ee0 2024-04-20T10:50:36.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.703+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fc40c2e10 con 0x7f2fc4153ee0 2024-04-20T10:50:36.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.704+0000 7f2fb9ffb640 1 -- 172.21.15.90:0/787174412 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12884 (secure 0 0 0) 0x7f2fbc05d0d0 con 0x7f2fc4153ee0 2024-04-20T10:50:36.704 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:36.705 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":17,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:30.526955+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2fa806c8f0 msgr2=0x7f2fa806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2fa806c8f0 0x7f2fa806edb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40b1d90 tx=0x7f2fc0009240 comp rx=0 tx=0).stop 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc4153ee0 msgr2=0x7f2fc4153210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc4153ee0 0x7f2fc4153210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c760 tx=0x7f2fbc00cc20 comp rx=0 tx=0).stop 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 shutdown_connections 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2fa806c8f0 0x7f2fa806edb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fc4153ee0 0x7f2fc4153210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fc40c6f20 0x7f2fc4152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 --2- 172.21.15.90:0/787174412 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fc40ab710 0x7f2fc40c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 >> 172.21.15.90:0/787174412 conn(0x7f2fc40cc060 msgr2=0x7f2fc40ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 shutdown_connections 2024-04-20T10:50:36.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.706+0000 7f2fcb7e6640 1 -- 172.21.15.90:0/787174412 wait complete. 2024-04-20T10:50:36.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:50:36.718 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:50:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.818+0000 7f1895f04640 1 Processor -- start 2024-04-20T10:50:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.818+0000 7f1895f04640 1 -- start start 2024-04-20T10:50:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f1895f04640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 0x7f1890156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f1895f04640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189015a720 con 0x7f18900ab730 2024-04-20T10:50:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f1895f04640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f189015ac80 con 0x7f1890153ef0 2024-04-20T10:50:36.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f1895f04640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f189015a9a0 con 0x7f18900c9ee0 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f1887fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f18900ab730 0x7f18901568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53196/0 (socket says 172.21.15.90:53196) 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f1887fff640 1 -- 172.21.15.90:0/3415544925 learned_addr learned my addr 172.21.15.90:0/3415544925 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f188ffff640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 0x7f1890156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 774446768 0 0) 0x7f1878001110 con 0x7f18900ab730 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f187c003520 con 0x7f18900ab730 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.819+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4247689206 0 0) 0x7f187c003520 con 0x7f18900ab730 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 msgr2=0x7f1890156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 0x7f1890156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 >> v1:172.21.15.175:6789/0 conn(0x7f1890153ef0 legacy=0x7f18900c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18900c6a90 con 0x7f18900ab730 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f1878001860 con 0x7f18900ab730 2024-04-20T10:50:36.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 >> v1:172.21.15.90:6789/0 conn(0x7f18900ab730 legacy=0x7f18901568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 0x7f187c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f187c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f187c004d40 0x7f187c0051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f189015a9a0 con 0x7f187c003fb0 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f187c00bc50 con 0x7f187c004d40 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f187c00be50 con 0x7f18900c9ee0 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f1887fff640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f187c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188f7fe640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 0x7f187c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f188ffff640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f187c004d40 0x7f187c0051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f1887fff640 1 -- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 msgr2=0x7f187c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f1887fff640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900c9ee0 0x7f187c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f1887fff640 1 -- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f187c004d40 msgr2=0x7f187c0051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f1887fff640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f187c004d40 0x7f187c0051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.820+0000 7f1887fff640 1 -- 172.21.15.90:0/3415544925 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f187c003520 con 0x7f187c003fb0 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f1887fff640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f187c004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18901578e0 tx=0x7f187c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661cc939bf4c481b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1878007e30 con 0x7f187c003fb0 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1878030070 con 0x7f187c003fb0 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f188effd640 1 -- 172.21.15.90:0/3415544925 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f187802cdd0 con 0x7f187c003fb0 2024-04-20T10:50:36.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f1895f04640 1 -- 172.21.15.90:0/3415544925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 msgr2=0x7f187c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f1895f04640 1 --2- 172.21.15.90:0/3415544925 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f187c004800 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f18901578e0 tx=0x7f187c005830 comp rx=0 tx=0).stop 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f188ffff640 1 -- 172.21.15.90:0/3415544925 reap_dead start 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f1895f04640 1 -- 172.21.15.90:0/3415544925 shutdown_connections 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f1895f04640 1 -- 172.21.15.90:0/3415544925 >> 172.21.15.90:0/3415544925 conn(0x7f18900cbfe0 msgr2=0x7f18900cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f1895f04640 1 -- 172.21.15.90:0/3415544925 shutdown_connections 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.821+0000 7f1895f04640 1 -- 172.21.15.90:0/3415544925 wait complete. 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 Processor -- start 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 -- start start 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f18901ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900bfac0 0x7f18901efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18900c4b10 0x7f18900c4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18900c9280 con 0x7f187c003fb0 2024-04-20T10:50:36.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18900c9100 con 0x7f18900c4b10 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f1895f04640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f18900bf800 con 0x7f18900bfac0 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f188f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f18901ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f188f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f18901ef6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54096/0 (socket says 172.21.15.90:54096) 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.823+0000 7f188f7fe640 1 -- 172.21.15.90:0/3181267300 learned_addr learned my addr 172.21.15.90:0/3181267300 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188f7fe640 1 -- 172.21.15.90:0/3181267300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900bfac0 msgr2=0x7f18901efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188f7fe640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900bfac0 0x7f18901efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188f7fe640 1 -- 172.21.15.90:0/3181267300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18900c4b10 msgr2=0x7f18900c4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188f7fe640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18900c4b10 0x7f18900c4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188f7fe640 1 -- 172.21.15.90:0/3181267300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18901f0230 con 0x7f187c003fb0 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188f7fe640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f18901ef6f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f188000f820 tx=0x7f188000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188cff9640 1 -- 172.21.15.90:0/3181267300 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18800050d0 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188cff9640 1 -- 172.21.15.90:0/3181267300 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1880018070 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18900af610 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f188cff9640 1 -- 172.21.15.90:0/3181267300 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1880005490 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.824+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18900bff50 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.825+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1890076150 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.825+0000 7f188cff9640 1 -- 172.21.15.90:0/3181267300 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f188000d6b0 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.826+0000 7f188cff9640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f187006c8f0 0x7f187006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.826+0000 7f1887fff640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f187006c8f0 0x7f187006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.826+0000 7f188cff9640 1 -- 172.21.15.90:0/3181267300 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f188008b5a0 con 0x7f187c003fb0 2024-04-20T10:50:36.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.826+0000 7f1887fff640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f187006c8f0 0x7f187006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f1878007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:36.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:36.830+0000 7f188cff9640 1 -- 172.21.15.90:0/3181267300 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1880059db0 con 0x7f187c003fb0 2024-04-20T10:50:37.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.006+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1890154840 con 0x7f187c003fb0 2024-04-20T10:50:37.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.007+0000 7f188cff9640 1 -- 172.21.15.90:0/3181267300 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f18800596b0 con 0x7f187c003fb0 2024-04-20T10:50:37.007 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.008+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f187006c8f0 msgr2=0x7f187006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.008+0000 7f1895f04640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f187006c8f0 0x7f187006edb0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1878034000 tx=0x7f1878007000 comp rx=0 tx=0).stop 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.008+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 msgr2=0x7f18901ef6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.008+0000 7f1895f04640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f18901ef6f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f188000f820 tx=0x7f188000fce0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.008+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 shutdown_connections 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.008+0000 7f1895f04640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f187006c8f0 0x7f187006edb0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.009+0000 7f1895f04640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18900c4b10 0x7f18900c4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.009+0000 7f1895f04640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18900bfac0 0x7f18901efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.009+0000 7f1895f04640 1 --2- 172.21.15.90:0/3181267300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f187c003fb0 0x7f18901ef6f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.009+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 >> 172.21.15.90:0/3181267300 conn(0x7f18900cbfe0 msgr2=0x7f1890155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:37.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.009+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 shutdown_connections 2024-04-20T10:50:37.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.009+0000 7f1895f04640 1 -- 172.21.15.90:0/3181267300 wait complete. 2024-04-20T10:50:37.019 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-20T10:50:37.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.115+0000 7fd8fe474640 1 Processor -- start 2024-04-20T10:50:37.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.115+0000 7fd8fe474640 1 -- start start 2024-04-20T10:50:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8fe474640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd8f8153c50 0x7fd8f815a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8fe474640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f80c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8fe474640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f8071650 con 0x7fd8f80c5520 2024-04-20T10:50:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8fe474640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f80718f0 con 0x7fd8f8153c50 2024-04-20T10:50:37.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8fe474640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80c3ca0 con 0x7fd8f80ad640 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8f7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd8f8153c50 0x7fd8f815a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8f7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd8f8153c50 0x7fd8f815a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54104/0 (socket says 172.21.15.90:54104) 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8f7fff640 1 -- 172.21.15.90:0/1512234806 learned_addr learned my addr 172.21.15.90:0/1512234806 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8f7fff640 1 -- 172.21.15.90:0/1512234806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 msgr2=0x7fd8f80c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.116+0000 7fd8fca11640 1 --2- 172.21.15.90:0/1512234806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f80c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.117+0000 7fd8f7fff640 1 --2- 172.21.15.90:0/1512234806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f80c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.117+0000 7fd8f7fff640 1 -- 172.21.15.90:0/1512234806 >> v1:172.21.15.175:6789/0 conn(0x7fd8f80c5520 legacy=0x7fd8f80c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.117+0000 7fd8f7fff640 1 -- 172.21.15.90:0/1512234806 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f80c3f80 con 0x7fd8f8153c50 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.117+0000 7fd8f7fff640 1 --2- 172.21.15.90:0/1512234806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f815a710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009870 tx=0x7fd8e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d17107b16321ea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.117+0000 7fd8f6ffd640 1 -- 172.21.15.90:0/1512234806 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8035020 con 0x7fd8f8153c50 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.117+0000 7fd8f6ffd640 1 -- 172.21.15.90:0/1512234806 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e8031640 con 0x7fd8f8153c50 2024-04-20T10:50:37.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.117+0000 7fd8f6ffd640 1 -- 172.21.15.90:0/1512234806 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e802d040 con 0x7fd8f8153c50 2024-04-20T10:50:37.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 -- 172.21.15.90:0/1512234806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 msgr2=0x7fd8f815a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 --2- 172.21.15.90:0/1512234806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f815a710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009870 tx=0x7fd8e802b8f0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 -- 172.21.15.90:0/1512234806 shutdown_connections 2024-04-20T10:50:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 --2- 172.21.15.90:0/1512234806 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f80c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 --2- 172.21.15.90:0/1512234806 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f815a710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 -- 172.21.15.90:0/1512234806 >> 172.21.15.90:0/1512234806 conn(0x7fd8f80c9100 msgr2=0x7fd8f80c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 -- 172.21.15.90:0/1512234806 shutdown_connections 2024-04-20T10:50:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.118+0000 7fd8fe474640 1 -- 172.21.15.90:0/1512234806 wait complete. 2024-04-20T10:50:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.119+0000 7fd8fe474640 1 Processor -- start 2024-04-20T10:50:37.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.119+0000 7fd8fe474640 1 -- start start 2024-04-20T10:50:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fe474640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f8156960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fe474640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f80c5520 0x7fd8f814bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fe474640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f814c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fe474640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f81541b0 con 0x7fd8f8153c50 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fe474640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f8154030 con 0x7fd8f80c5520 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fe474640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f80c49e0 con 0x7fd8f80ad640 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f814c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f814c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54112/0 (socket says 172.21.15.90:54112) 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 -- 172.21.15.90:0/3291955676 learned_addr learned my addr 172.21.15.90:0/3291955676 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8f7fff640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f8156960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 -- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 msgr2=0x7fd8f8156960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f8156960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 -- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f80c5520 msgr2=0x7fd8f814bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8f77fe640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f80c5520 0x7fd8f814bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f80c5520 0x7fd8f814bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 -- 172.21.15.90:0/3291955676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f8152880 con 0x7fd8f8153c50 2024-04-20T10:50:37.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8f7fff640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f8156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.120+0000 7fd8fca11640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f814c040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000cd50 tx=0x7fd8f000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.121+0000 7fd8f4ff9640 1 -- 172.21.15.90:0/3291955676 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0003b90 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.121+0000 7fd8f4ff9640 1 -- 172.21.15.90:0/3291955676 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8f0003d30 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.121+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f81525a0 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.121+0000 7fd8f4ff9640 1 -- 172.21.15.90:0/3291955676 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0004240 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.121+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f8156ea0 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.122+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f8076150 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.122+0000 7fd8f4ff9640 1 -- 172.21.15.90:0/3291955676 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd8f00043e0 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.122+0000 7fd8f4ff9640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd8e406c920 0x7fd8e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.123+0000 7fd8f4ff9640 1 -- 172.21.15.90:0/3291955676 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fd8f008c1d0 con 0x7fd8f8153c50 2024-04-20T10:50:37.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.123+0000 7fd8f7fff640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd8e406c920 0x7fd8e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.123+0000 7fd8f7fff640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd8e406c920 0x7fd8e406ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8036000 tx=0x7fd8e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:37.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.127+0000 7fd8f4ff9640 1 -- 172.21.15.90:0/3291955676 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd8f8152880 con 0x7fd8f8153c50 2024-04-20T10:50:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.303+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fd8f8152a60 con 0x7fd8f8153c50 2024-04-20T10:50:37.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.303+0000 7fd8f4ff9640 1 -- 172.21.15.90:0/3291955676 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fd8f005a950 con 0x7fd8f8153c50 2024-04-20T10:50:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:37.304 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-04-20T10:50:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-20T10:50:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-04-20T10:50:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-04-20T10:50:37.304 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-20T10:50:37.304 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-04-20T10:50:37.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd8e406c920 msgr2=0x7fd8e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd8e406c920 0x7fd8e406ede0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8036000 tx=0x7fd8e8008030 comp rx=0 tx=0).stop 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 msgr2=0x7fd8f814c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f814c040 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000cd50 tx=0x7fd8f000a660 comp rx=0 tx=0).stop 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 shutdown_connections 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd8e406c920 0x7fd8e406ede0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd8f8153c50 0x7fd8f814c040 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8f80c5520 0x7fd8f814bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 --2- 172.21.15.90:0/3291955676 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd8f80ad640 0x7fd8f8156960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 >> 172.21.15.90:0/3291955676 conn(0x7fd8f80c9100 msgr2=0x7fd8f80c8490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 shutdown_connections 2024-04-20T10:50:37.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.305+0000 7fd8fe474640 1 -- 172.21.15.90:0/3291955676 wait complete. 2024-04-20T10:50:37.316 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'a' 2024-04-20T10:50:37.316 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_metadata --pg_num_min 64 2024-04-20T10:50:37.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.416+0000 7f6e43ac0640 1 Processor -- start 2024-04-20T10:50:37.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.416+0000 7f6e43ac0640 1 -- start start 2024-04-20T10:50:37.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e43ac0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e43ac0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e3c0c4ec0 0x7f6e3c15a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e43ac0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e3c0c54b0 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e43ac0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6e3c0abf60 con 0x7f6e3c0c4ec0 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e43ac0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c159ca0 con 0x7f6e3c153bf0 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4105b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e3c0c4ec0 0x7f6e3c15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4185c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4105b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e3c0c4ec0 0x7f6e3c15a130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:42134/0 (socket says 172.21.15.90:42134) 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4105b640 1 -- 172.21.15.90:0/2995020787 learned_addr learned my addr 172.21.15.90:0/2995020787 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4205d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f6e3c0c3b20 0x7f6e3c15a670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:43332/0 (socket says 172.21.15.90:43332) 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4185c640 1 -- 172.21.15.90:0/2995020787 >> v2:172.21.15.175:3300/0 conn(0x7f6e3c0c4ec0 msgr2=0x7f6e3c15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4185c640 1 --2- 172.21.15.90:0/2995020787 >> v2:172.21.15.175:3300/0 conn(0x7f6e3c0c4ec0 0x7f6e3c15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4185c640 1 -- 172.21.15.90:0/2995020787 >> v1:172.21.15.175:6789/0 conn(0x7f6e3c0c3b20 legacy=0x7f6e3c15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.417+0000 7f6e4185c640 1 -- 172.21.15.90:0/2995020787 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c0acb60 con 0x7f6e3c153bf0 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.418+0000 7f6e4185c640 1 --2- 172.21.15.90:0/2995020787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c0c35e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e380097a0 tx=0x7f6e3802b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c00a1d43afe9557c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.418+0000 7f6e4085a640 1 -- 172.21.15.90:0/2995020787 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e380315a0 con 0x7f6e3c153bf0 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e4085a640 1 -- 172.21.15.90:0/2995020787 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e38037070 con 0x7f6e3c153bf0 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e4085a640 1 -- 172.21.15.90:0/2995020787 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38031960 con 0x7f6e3c153bf0 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 -- 172.21.15.90:0/2995020787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 msgr2=0x7f6e3c0c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/2995020787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c0c35e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f6e380097a0 tx=0x7f6e3802b840 comp rx=0 tx=0).stop 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 -- 172.21.15.90:0/2995020787 shutdown_connections 2024-04-20T10:50:37.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/2995020787 >> v2:172.21.15.175:3300/0 conn(0x7f6e3c0c4ec0 0x7f6e3c15a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/2995020787 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c0c35e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 -- 172.21.15.90:0/2995020787 >> 172.21.15.90:0/2995020787 conn(0x7f6e3c067e90 msgr2=0x7f6e3c0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:37.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 -- 172.21.15.90:0/2995020787 shutdown_connections 2024-04-20T10:50:37.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.419+0000 7f6e43ac0640 1 -- 172.21.15.90:0/2995020787 wait complete. 2024-04-20T10:50:37.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.420+0000 7f6e43ac0640 1 Processor -- start 2024-04-20T10:50:37.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.420+0000 7f6e43ac0640 1 -- start start 2024-04-20T10:50:37.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e43ac0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e3c0c3b20 0x7f6e3c1efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e43ac0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e3c0c4ec0 0x7f6e3c150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e43ac0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c150d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e43ac0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c0ac160 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e43ac0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e3c1566b0 con 0x7f6e3c0c4ec0 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e43ac0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e3c153fd0 con 0x7f6e3c153bf0 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e3c0c3b20 0x7f6e3c1efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e3c0c3b20 0x7f6e3c1efa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54124/0 (socket says 172.21.15.90:54124) 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 -- 172.21.15.90:0/1545191153 learned_addr learned my addr 172.21.15.90:0/1545191153 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4205d640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c150d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4105b640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e3c0c4ec0 0x7f6e3c150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 -- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 msgr2=0x7f6e3c150d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c150d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 -- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e3c0c4ec0 msgr2=0x7f6e3c150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e3c0c4ec0 0x7f6e3c150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 -- 172.21.15.90:0/1545191153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e3c1512b0 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.421+0000 7f6e4185c640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e3c0c3b20 0x7f6e3c1efa10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e38000c00 tx=0x7f6e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.422+0000 7f6e327fc640 1 -- 172.21.15.90:0/1545191153 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38032630 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.422+0000 7f6e327fc640 1 -- 172.21.15.90:0/1545191153 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e380327f0 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.422+0000 7f6e327fc640 1 -- 172.21.15.90:0/1545191153 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e38032be0 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.422+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e3c1f0360 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.422+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e3c06db50 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.422+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e3c06d660 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.423+0000 7f6e327fc640 1 -- 172.21.15.90:0/1545191153 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e3804d3f0 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.423+0000 7f6e327fc640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e2006c8f0 0x7f6e2006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.423+0000 7f6e327fc640 1 -- 172.21.15.90:0/1545191153 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f6e3802f030 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.423+0000 7f6e4105b640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e2006c8f0 0x7f6e2006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:37.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.424+0000 7f6e4105b640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e2006c8f0 0x7f6e2006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0af170 tx=0x7f6e2c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:37.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.427+0000 7f6e327fc640 1 -- 172.21.15.90:0/1545191153 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6e38040070 con 0x7f6e3c0c3b20 2024-04-20T10:50:37.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:37.602+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64} v 0) -- 0x7f6e3c0761f0 con 0x7f6e3c0c3b20 2024-04-20T10:50:38.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.558+0000 7f6e327fc640 1 -- 172.21.15.90:0/1545191153 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_metadata", "pg_num_min": 64}]=0 pool 'a_metadata' created v18) ==== 128+0+0 (secure 0 0 0) 0x7f6e3807b260 con 0x7f6e3c0c3b20 2024-04-20T10:50:38.558 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_metadata' created 2024-04-20T10:50:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e2006c8f0 msgr2=0x7f6e2006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e2006c8f0 0x7f6e2006edb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0af170 tx=0x7f6e2c009240 comp rx=0 tx=0).stop 2024-04-20T10:50:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e3c0c3b20 msgr2=0x7f6e3c1efa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e3c0c3b20 0x7f6e3c1efa10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6e38000c00 tx=0x7f6e380046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 shutdown_connections 2024-04-20T10:50:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e2006c8f0 0x7f6e2006edb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e3c153bf0 0x7f6e3c150d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e3c0c4ec0 0x7f6e3c150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 --2- 172.21.15.90:0/1545191153 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e3c0c3b20 0x7f6e3c1efa10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 >> 172.21.15.90:0/1545191153 conn(0x7f6e3c067e90 msgr2=0x7f6e3c155c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:38.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 shutdown_connections 2024-04-20T10:50:38.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.561+0000 7f6e43ac0640 1 -- 172.21.15.90:0/1545191153 wait complete. 2024-04-20T10:50:38.577 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create a_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-20T10:50:38.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.687+0000 7fc446fa4640 1 Processor -- start 2024-04-20T10:50:38.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.687+0000 7fc446fa4640 1 -- start start 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc446fa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4400c6c70 0x7fc4401538e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc446fa4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc44006c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc446fa4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc440157330 con 0x7fc4400c9f80 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc446fa4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc440157610 con 0x7fc4400c6c70 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc446fa4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc4400adde0 con 0x7fc4400ca490 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc444d40640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4400c6c70 0x7fc4401538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc444d40640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4400c6c70 0x7fc4401538e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54138/0 (socket says 172.21.15.90:54138) 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc444d40640 1 -- 172.21.15.90:0/1771285647 learned_addr learned my addr 172.21.15.90:0/1771285647 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc445541640 1 --2- 172.21.15.90:0/1771285647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc44006c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc444d40640 1 -- 172.21.15.90:0/1771285647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 msgr2=0x7fc44006c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc444d40640 1 --2- 172.21.15.90:0/1771285647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc44006c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc444d40640 1 -- 172.21.15.90:0/1771285647 >> v1:172.21.15.175:6789/0 conn(0x7fc4400c9f80 legacy=0x7fc44006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.688+0000 7fc444d40640 1 -- 172.21.15.90:0/1771285647 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4400ae0c0 con 0x7fc4400c6c70 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc444d40640 1 --2- 172.21.15.90:0/1771285647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc4401538e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b45c44a55c621a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc43f7fe640 1 -- 172.21.15.90:0/1771285647 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4340317c0 con 0x7fc4400c6c70 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc43f7fe640 1 -- 172.21.15.90:0/1771285647 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc434037070 con 0x7fc4400c6c70 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc43f7fe640 1 -- 172.21.15.90:0/1771285647 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434031b80 con 0x7fc4400c6c70 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 -- 172.21.15.90:0/1771285647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 msgr2=0x7fc4401538e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 --2- 172.21.15.90:0/1771285647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc4401538e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc43402b860 comp rx=0 tx=0).stop 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 -- 172.21.15.90:0/1771285647 shutdown_connections 2024-04-20T10:50:38.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 --2- 172.21.15.90:0/1771285647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc44006c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 --2- 172.21.15.90:0/1771285647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc4401538e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 -- 172.21.15.90:0/1771285647 >> 172.21.15.90:0/1771285647 conn(0x7fc4400cc080 msgr2=0x7fc4400cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:38.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 -- 172.21.15.90:0/1771285647 shutdown_connections 2024-04-20T10:50:38.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.689+0000 7fc446fa4640 1 -- 172.21.15.90:0/1771285647 wait complete. 2024-04-20T10:50:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.690+0000 7fc446fa4640 1 Processor -- start 2024-04-20T10:50:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc446fa4640 1 -- start start 2024-04-20T10:50:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc446fa4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc440149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc446fa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4400c9f80 0x7fc44015a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc446fa4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc4401ed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc446fa4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc44006db30 con 0x7fc4400c6c70 2024-04-20T10:50:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc446fa4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc44006ced0 con 0x7fc4400c9f80 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc446fa4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc4400c7050 con 0x7fc4400ca490 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc444d40640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc440149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc444d40640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc440149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54142/0 (socket says 172.21.15.90:54142) 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.691+0000 7fc444d40640 1 -- 172.21.15.90:0/2674191750 learned_addr learned my addr 172.21.15.90:0/2674191750 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc43ffff640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4400c9f80 0x7fc44015a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc445541640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc4401ed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc444d40640 1 -- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 msgr2=0x7fc4401ed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc444d40640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc4401ed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc444d40640 1 -- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4400c9f80 msgr2=0x7fc44015a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc444d40640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4400c9f80 0x7fc44015a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc444d40640 1 -- 172.21.15.90:0/2674191750 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4401585b0 con 0x7fc4400c6c70 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc444d40640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc440149860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc4340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc43d7fa640 1 -- 172.21.15.90:0/2674191750 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434032650 con 0x7fc4400c6c70 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc43d7fa640 1 -- 172.21.15.90:0/2674191750 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4340327f0 con 0x7fc4400c6c70 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc440158890 con 0x7fc4400c6c70 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc43d7fa640 1 -- 172.21.15.90:0/2674191750 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434032be0 con 0x7fc4400c6c70 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.692+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc440158e50 con 0x7fc4400c6c70 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.693+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc440076150 con 0x7fc4400c6c70 2024-04-20T10:50:38.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.693+0000 7fc43d7fa640 1 -- 172.21.15.90:0/2674191750 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc43404d3f0 con 0x7fc4400c6c70 2024-04-20T10:50:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.694+0000 7fc43d7fa640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc42406c920 0x7fc42406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.694+0000 7fc43d7fa640 1 -- 172.21.15.90:0/2674191750 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5222+0+0 (secure 0 0 0) 0x7fc4340ad2d0 con 0x7fc4400c6c70 2024-04-20T10:50:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.694+0000 7fc43ffff640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc42406c920 0x7fc42406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.694+0000 7fc43ffff640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc42406c920 0x7fc42406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4401584e0 tx=0x7fc42c007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.698+0000 7fc43d7fa640 1 -- 172.21.15.90:0/2674191750 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc434040070 con 0x7fc4400c6c70 2024-04-20T10:50:38.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:38.873+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc4400c8100 con 0x7fc4400c6c70 2024-04-20T10:50:39.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.559+0000 7fc43d7fa640 1 -- 172.21.15.90:0/2674191750 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "a_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'a_data' created v19) ==== 160+0+0 (secure 0 0 0) 0x7fc43407b320 con 0x7fc4400c6c70 2024-04-20T10:50:39.560 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_data' created 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc42406c920 msgr2=0x7fc42406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc42406c920 0x7fc42406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc4401584e0 tx=0x7fc42c007e30 comp rx=0 tx=0).stop 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 msgr2=0x7fc440149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc440149860 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc434009870 tx=0x7fc4340046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 shutdown_connections 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc42406c920 0x7fc42406ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4400ca490 0x7fc4401ed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4400c9f80 0x7fc44015a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 --2- 172.21.15.90:0/2674191750 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4400c6c70 0x7fc440149860 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 >> 172.21.15.90:0/2674191750 conn(0x7fc4400cc080 msgr2=0x7fc440156780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 shutdown_connections 2024-04-20T10:50:39.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.562+0000 7fc446fa4640 1 -- 172.21.15.90:0/2674191750 wait complete. 2024-04-20T10:50:39.582 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new a a_metadata a_data 2024-04-20T10:50:39.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.684+0000 7f8f04fa4640 1 Processor -- start 2024-04-20T10:50:39.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.684+0000 7f8f04fa4640 1 -- start start 2024-04-20T10:50:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8f04fa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8f0006d120 0x7f8f00156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8f04fa4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00150460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8f04fa4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f000c9410 con 0x7f8f000c6e70 2024-04-20T10:50:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8f04fa4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8f0006c580 con 0x7f8f0006d120 2024-04-20T10:50:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8f04fa4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8f000c9c30 con 0x7f8f000c8c90 2024-04-20T10:50:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8ef7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8f0006d120 0x7f8f00156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:39.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8efe59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8f000c6e70 0x7f8f0006ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53200/0 (socket says 172.21.15.90:53200) 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8ef7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8f0006d120 0x7f8f00156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54152/0 (socket says 172.21.15.90:54152) 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8efe59c640 1 -- 172.21.15.90:0/413213748 learned_addr learned my addr 172.21.15.90:0/413213748 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8efed9d640 1 --2- 172.21.15.90:0/413213748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8ef7fff640 1 -- 172.21.15.90:0/413213748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 msgr2=0x7f8f00150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8ef7fff640 1 --2- 172.21.15.90:0/413213748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8ef7fff640 1 -- 172.21.15.90:0/413213748 >> v1:172.21.15.90:6789/0 conn(0x7f8f000c6e70 legacy=0x7f8f0006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8ef7fff640 1 -- 172.21.15.90:0/413213748 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000c96b0 con 0x7f8f0006d120 2024-04-20T10:50:39.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.685+0000 7f8efdd9b640 1 -- 172.21.15.90:0/413213748 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 637520022 0 0) 0x7f8f000c9410 con 0x7f8f000c6e70 2024-04-20T10:50:39.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.686+0000 7f8ef7fff640 1 --2- 172.21.15.90:0/413213748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f0006d120 0x7f8f00156a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097a0 tx=0x7f8ee802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b171635bd0a18fcc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.686+0000 7f8efdd9b640 1 -- 172.21.15.90:0/413213748 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee80315a0 con 0x7f8f0006d120 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.686+0000 7f8efdd9b640 1 -- 172.21.15.90:0/413213748 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee8037070 con 0x7f8f0006d120 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.686+0000 7f8efdd9b640 1 -- 172.21.15.90:0/413213748 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8031960 con 0x7f8f0006d120 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.686+0000 7f8f04fa4640 1 -- 172.21.15.90:0/413213748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f0006d120 msgr2=0x7f8f00156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.686+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/413213748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f0006d120 0x7f8f00156a50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097a0 tx=0x7f8ee802b840 comp rx=0 tx=0).stop 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.687+0000 7f8f04fa4640 1 -- 172.21.15.90:0/413213748 shutdown_connections 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.687+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/413213748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.687+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/413213748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f0006d120 0x7f8f00156a50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.687+0000 7f8f04fa4640 1 -- 172.21.15.90:0/413213748 >> 172.21.15.90:0/413213748 conn(0x7f8f000addb0 msgr2=0x7f8f000ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.687+0000 7f8f04fa4640 1 -- 172.21.15.90:0/413213748 shutdown_connections 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.687+0000 7f8f04fa4640 1 -- 172.21.15.90:0/413213748 wait complete. 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 Processor -- start 2024-04-20T10:50:39.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 -- start start 2024-04-20T10:50:39.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f0006d120 0x7f8f001f0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:39.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f000c6e70 0x7f8f00159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000ca3a0 con 0x7f8f000c6e70 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f000c9100 con 0x7f8f0006d120 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8f04fa4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8f000ca520 con 0x7f8f000c8c90 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.688+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f000c6e70 0x7f8f00159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f000c6e70 0x7f8f00159b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54158/0 (socket says 172.21.15.90:54158) 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 -- 172.21.15.90:0/1319591685 learned_addr learned my addr 172.21.15.90:0/1319591685 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8efed9d640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 -- 172.21.15.90:0/1319591685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 msgr2=0x7f8f00153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 -- 172.21.15.90:0/1319591685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f0006d120 msgr2=0x7f8f001f0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f0006d120 0x7f8f001f0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 -- 172.21.15.90:0/1319591685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f000c20c0 con 0x7f8f000c6e70 2024-04-20T10:50:39.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef7fff640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f000c6e70 0x7f8f00159b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097a0 tx=0x7f8ee80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:39.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef6ffd640 1 -- 172.21.15.90:0/1319591685 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8004230 con 0x7f8f000c6e70 2024-04-20T10:50:39.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef6ffd640 1 -- 172.21.15.90:0/1319591685 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ee80043d0 con 0x7f8f000c6e70 2024-04-20T10:50:39.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8ef6ffd640 1 -- 172.21.15.90:0/1319591685 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ee8003850 con 0x7f8f000c6e70 2024-04-20T10:50:39.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f000c23a0 con 0x7f8f000c6e70 2024-04-20T10:50:39.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.689+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f001ec2c0 con 0x7f8f000c6e70 2024-04-20T10:50:39.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.690+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f00076150 con 0x7f8f000c6e70 2024-04-20T10:50:39.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.691+0000 7f8ef6ffd640 1 -- 172.21.15.90:0/1319591685 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ee80039f0 con 0x7f8f000c6e70 2024-04-20T10:50:39.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.691+0000 7f8ef6ffd640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ee006c8f0 0x7f8ee006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:39.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.691+0000 7f8efe59c640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ee006c8f0 0x7f8ee006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:39.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.691+0000 7f8ef6ffd640 1 -- 172.21.15.90:0/1319591685 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5599+0+0 (secure 0 0 0) 0x7f8ee802f030 con 0x7f8f000c6e70 2024-04-20T10:50:39.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.692+0000 7f8efe59c640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ee006c8f0 0x7f8ee006edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0007fd0 tx=0x7f8ef0007920 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:39.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.696+0000 7f8ef6ffd640 1 -- 172.21.15.90:0/1319591685 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8ee8041070 con 0x7f8f000c6e70 2024-04-20T10:50:39.813 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:50:39.815 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:50:39.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:39.914+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"} v 0) -- 0x7f8f000c30f0 con 0x7f8f000c6e70 2024-04-20T10:50:40.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.582+0000 7f8ef6ffd640 1 -- 172.21.15.90:0/1319591685 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "a", "metadata": "a_metadata", "data": "a_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 157+0+0 (secure 0 0 0) 0x7f8ee807beb0 con 0x7f8f000c6e70 2024-04-20T10:50:40.584 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 2 and data pool 3 2024-04-20T10:50:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.588+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ee006c8f0 msgr2=0x7f8ee006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.588+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ee006c8f0 0x7f8ee006edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0007fd0 tx=0x7f8ef0007920 comp rx=0 tx=0).stop 2024-04-20T10:50:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.588+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f000c6e70 msgr2=0x7f8f00159b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.588+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f000c6e70 0x7f8f00159b90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8ee80097a0 tx=0x7f8ee80046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.589+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 shutdown_connections 2024-04-20T10:50:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.589+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ee006c8f0 0x7f8ee006edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.589+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f000c8c90 0x7f8f00153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.589+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f000c6e70 0x7f8f00159b90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.589+0000 7f8f04fa4640 1 --2- 172.21.15.90:0/1319591685 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f0006d120 0x7f8f001f0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.589+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 >> 172.21.15.90:0/1319591685 conn(0x7f8f000addb0 msgr2=0x7f8f000cbda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:40.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.590+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 shutdown_connections 2024-04-20T10:50:40.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.590+0000 7f8f04fa4640 1 -- 172.21.15.90:0/1319591685 wait complete. 2024-04-20T10:50:40.610 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.707+0000 7f779e477640 1 Processor -- start 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.707+0000 7f779e477640 1 -- start start 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f779e477640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798156f20 0x7f7798153630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f779e477640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77980c6870 con 0x7f77980701c0 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f779e477640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f779815a050 con 0x7f779815ab30 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f779e477640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f77980ab630 con 0x7f7798156f20 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f7797fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f77980701c0 0x7f7798073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53212/0 (socket says 172.21.15.90:53212) 2024-04-20T10:50:40.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f7797fff640 1 -- 172.21.15.90:0/1282219228 learned_addr learned my addr 172.21.15.90:0/1282219228 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f779ca14640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798156f20 0x7f7798153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760595884 0 0) 0x7f77980c6870 con 0x7f77980701c0 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7780003520 con 0x7f77980701c0 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675810177 0 0) 0x7f779815a050 con 0x7f779815ab30 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.708+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77980c6870 con 0x7f779815ab30 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4145137647 0 0) 0x7f7780003520 con 0x7f77980701c0 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798156f20 msgr2=0x7f7798153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798156f20 0x7f7798153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 >> v1:172.21.15.175:6789/0 conn(0x7f779815ab30 legacy=0x7f7798156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779815a330 con 0x7f77980701c0 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f7788001670 con 0x7f77980701c0 2024-04-20T10:50:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 >> v1:172.21.15.90:6789/0 conn(0x7f77980701c0 legacy=0x7f7798073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7780003b70 0x7f7780003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f7780004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77800051c0 0x7f778000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f778000bf00 con 0x7f7780004800 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f778000c080 con 0x7f77800051c0 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f778000c200 con 0x7f7780003b70 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f77977fe640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f7780004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f7797fff640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7780003b70 0x7f7780003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f779ca14640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77800051c0 0x7f778000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f77977fe640 1 -- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7780003b70 msgr2=0x7f7780003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f77977fe640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7780003b70 0x7f7780003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f77977fe640 1 -- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77800051c0 msgr2=0x7f778000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f77977fe640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77800051c0 0x7f778000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.709+0000 7f77977fe640 1 -- 172.21.15.90:0/1282219228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7780003520 con 0x7f7780004800 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f77977fe640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f7780004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f778c0018a0 tx=0x7f7780005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a078a10c1d4a635 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c037070 con 0x7f7780004800 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778c0052d0 con 0x7f7780004800 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f7796ffd640 1 -- 172.21.15.90:0/1282219228 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778c0014f0 con 0x7f7780004800 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f779e477640 1 -- 172.21.15.90:0/1282219228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 msgr2=0x7f7780004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f779e477640 1 --2- 172.21.15.90:0/1282219228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f7780004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f778c0018a0 tx=0x7f7780005830 comp rx=0 tx=0).stop 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f779ca14640 1 -- 172.21.15.90:0/1282219228 reap_dead start 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f779e477640 1 -- 172.21.15.90:0/1282219228 shutdown_connections 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f779e477640 1 -- 172.21.15.90:0/1282219228 >> 172.21.15.90:0/1282219228 conn(0x7f77980676c0 msgr2=0x7f7798067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:40.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f779e477640 1 -- 172.21.15.90:0/1282219228 shutdown_connections 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.710+0000 7f779e477640 1 -- 172.21.15.90:0/1282219228 wait complete. 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.711+0000 7f779e477640 1 Processor -- start 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f779e477640 1 -- start start 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f779e477640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f77981ec8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f779e477640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77981ecdf0 0x7f7798158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f779e477640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798159450 0x7f77981efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f779e477640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77980705a0 con 0x7f7780004800 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f779e477640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7798159e00 con 0x7f77981ecdf0 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f779e477640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7798073810 con 0x7f7798159450 2024-04-20T10:50:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f7797fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f77981ec8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f7797fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f77981ec8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54178/0 (socket says 172.21.15.90:54178) 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.712+0000 7f7797fff640 1 -- 172.21.15.90:0/829779375 learned_addr learned my addr 172.21.15.90:0/829779375 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f77977fe640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77981ecdf0 0x7f7798158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f779ca14640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798159450 0x7f77981efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7797fff640 1 -- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798159450 msgr2=0x7f77981efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7797fff640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798159450 0x7f77981efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7797fff640 1 -- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77981ecdf0 msgr2=0x7f7798158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7797fff640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77981ecdf0 0x7f7798158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7797fff640 1 -- 172.21.15.90:0/829779375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f779806f7b0 con 0x7f7780004800 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f77977fe640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77981ecdf0 0x7f7798158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f779ca14640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798159450 0x7f77981efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7797fff640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f77981ec8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7788007370 tx=0x7f7788007830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7794ff9640 1 -- 172.21.15.90:0/829779375 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778801a070 con 0x7f7780004800 2024-04-20T10:50:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7794ff9640 1 -- 172.21.15.90:0/829779375 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f778800f8e0 con 0x7f7780004800 2024-04-20T10:50:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f7794ff9640 1 -- 172.21.15.90:0/829779375 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f778800fcd0 con 0x7f7780004800 2024-04-20T10:50:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f779806cc70 con 0x7f7780004800 2024-04-20T10:50:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.713+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77981ec0e0 con 0x7f7780004800 2024-04-20T10:50:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.714+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77981ef6b0 con 0x7f7780004800 2024-04-20T10:50:40.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.714+0000 7f7794ff9640 1 -- 172.21.15.90:0/829779375 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f778801d070 con 0x7f7780004800 2024-04-20T10:50:40.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.715+0000 7f7794ff9640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f778406c8f0 0x7f778406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:40.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.715+0000 7f77977fe640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f778406c8f0 0x7f778406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:40.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.715+0000 7f7794ff9640 1 -- 172.21.15.90:0/829779375 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f778808b440 con 0x7f7780004800 2024-04-20T10:50:40.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.715+0000 7f77977fe640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f778406c8f0 0x7f778406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f778c034000 tx=0x7f778c031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:40.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.719+0000 7f7794ff9640 1 -- 172.21.15.90:0/829779375 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7788059910 con 0x7f7780004800 2024-04-20T10:50:40.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.895+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f779806f980 con 0x7f7780004800 2024-04-20T10:50:40.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.896+0000 7f7794ff9640 1 -- 172.21.15.90:0/829779375 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16598 (secure 0 0 0) 0x7f7788059210 con 0x7f7780004800 2024-04-20T10:50:40.896 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:40.897 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:39.915291+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f778406c8f0 msgr2=0x7f778406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f778406c8f0 0x7f778406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f778c034000 tx=0x7f778c031000 comp rx=0 tx=0).stop 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 msgr2=0x7f77981ec8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f77981ec8b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7788007370 tx=0x7f7788007830 comp rx=0 tx=0).stop 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 shutdown_connections 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f778406c8f0 0x7f778406edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7798159450 0x7f77981efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77981ecdf0 0x7f7798158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 --2- 172.21.15.90:0/829779375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7780004800 0x7f77981ec8b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 >> 172.21.15.90:0/829779375 conn(0x7f77980676c0 msgr2=0x7f77981523e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 shutdown_connections 2024-04-20T10:50:40.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:40.898+0000 7f779e477640 1 -- 172.21.15.90:0/829779375 wait complete. 2024-04-20T10:50:40.910 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:41.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.006+0000 7f0d2da25640 1 Processor -- start 2024-04-20T10:50:41.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.006+0000 7f0d2da25640 1 -- start start 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d2da25640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d28153ef0 0x7f0d280c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d2da25640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d280ab730 0x7f0d281568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d2da25640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d280c9ee0 0x7f0d28156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d2da25640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2815a720 con 0x7f0d280c9ee0 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d2da25640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0d2815ac80 con 0x7f0d28153ef0 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d2da25640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d2815a9a0 con 0x7f0d280ab730 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d280c9ee0 0x7f0d28156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0d280c9ee0 0x7f0d28156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54192/0 (socket says 172.21.15.90:54192) 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 -- 172.21.15.90:0/865282569 learned_addr learned my addr 172.21.15.90:0/865282569 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d1ffff640 1 --2- 172.21.15.90:0/865282569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d280ab730 0x7f0d281568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d26ffd640 1 --2- 172.21.15.90:0/865282569 >> v2:172.21.15.175:3300/0 conn(0x7f0d28153ef0 0x7f0d280c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 -- 172.21.15.90:0/865282569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d280ab730 msgr2=0x7f0d281568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 --2- 172.21.15.90:0/865282569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d280ab730 0x7f0d281568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 -- 172.21.15.90:0/865282569 >> v2:172.21.15.175:3300/0 conn(0x7f0d28153ef0 msgr2=0x7f0d280c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 --2- 172.21.15.90:0/865282569 >> v2:172.21.15.175:3300/0 conn(0x7f0d28153ef0 0x7f0d280c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.007+0000 7f0d277fe640 1 -- 172.21.15.90:0/865282569 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d280c6a90 con 0x7f0d280c9ee0 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.008+0000 7f0d277fe640 1 --2- 172.21.15.90:0/865282569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c9ee0 0x7f0d28156e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d280aec60 tx=0x7f0d2002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6163e636c5b01b65 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.008+0000 7f0d267fc640 1 -- 172.21.15.90:0/865282569 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2002c950 con 0x7f0d280c9ee0 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.008+0000 7f0d267fc640 1 -- 172.21.15.90:0/865282569 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d2002caf0 con 0x7f0d280c9ee0 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.008+0000 7f0d267fc640 1 -- 172.21.15.90:0/865282569 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200343f0 con 0x7f0d280c9ee0 2024-04-20T10:50:41.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.008+0000 7f0d2da25640 1 -- 172.21.15.90:0/865282569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c9ee0 msgr2=0x7f0d28156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.008+0000 7f0d2da25640 1 --2- 172.21.15.90:0/865282569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c9ee0 0x7f0d28156e00 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0d280aec60 tx=0x7f0d2002bdb0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.009+0000 7f0d2da25640 1 -- 172.21.15.90:0/865282569 shutdown_connections 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.009+0000 7f0d2da25640 1 --2- 172.21.15.90:0/865282569 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280c9ee0 0x7f0d28156e00 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.009+0000 7f0d2da25640 1 --2- 172.21.15.90:0/865282569 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d280ab730 0x7f0d281568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.009+0000 7f0d2da25640 1 --2- 172.21.15.90:0/865282569 >> v2:172.21.15.175:3300/0 conn(0x7f0d28153ef0 0x7f0d280c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.009+0000 7f0d2da25640 1 -- 172.21.15.90:0/865282569 >> 172.21.15.90:0/865282569 conn(0x7f0d280cbfe0 msgr2=0x7f0d280cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.009+0000 7f0d2da25640 1 -- 172.21.15.90:0/865282569 shutdown_connections 2024-04-20T10:50:41.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.009+0000 7f0d2da25640 1 -- 172.21.15.90:0/865282569 wait complete. 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 Processor -- start 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 -- start start 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280ab730 0x7f0d280c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d280c9ee0 0x7f0d280c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d28153ef0 0x7f0d280c12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d280bf800 con 0x7f0d280ab730 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d28157340 con 0x7f0d280c9ee0 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d2da25640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d28068d70 con 0x7f0d28153ef0 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d26ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280ab730 0x7f0d280c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d26ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280ab730 0x7f0d280c56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54194/0 (socket says 172.21.15.90:54194) 2024-04-20T10:50:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.010+0000 7f0d26ffd640 1 -- 172.21.15.90:0/2206179801 learned_addr learned my addr 172.21.15.90:0/2206179801 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d277fe640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d28153ef0 0x7f0d280c12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d1ffff640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d280c9ee0 0x7f0d280c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d26ffd640 1 -- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d28153ef0 msgr2=0x7f0d280c12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d26ffd640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d28153ef0 0x7f0d280c12c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d26ffd640 1 -- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d280c9ee0 msgr2=0x7f0d280c0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d26ffd640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d280c9ee0 0x7f0d280c0d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d26ffd640 1 -- 172.21.15.90:0/2206179801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d281ed430 con 0x7f0d280ab730 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d26ffd640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280ab730 0x7f0d280c56e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800d5f0 tx=0x7f0d1800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d24ff9640 1 -- 172.21.15.90:0/2206179801 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d180125f0 con 0x7f0d280ab730 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d24ff9640 1 -- 172.21.15.90:0/2206179801 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d18019070 con 0x7f0d280ab730 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d281ed710 con 0x7f0d280ab730 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d24ff9640 1 -- 172.21.15.90:0/2206179801 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d180129d0 con 0x7f0d280ab730 2024-04-20T10:50:41.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.011+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d280ae670 con 0x7f0d280ab730 2024-04-20T10:50:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.012+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d280ac460 con 0x7f0d280ab730 2024-04-20T10:50:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.012+0000 7f0d24ff9640 1 -- 172.21.15.90:0/2206179801 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d18012b70 con 0x7f0d280ab730 2024-04-20T10:50:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.013+0000 7f0d24ff9640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d0806c8f0 0x7f0d0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.013+0000 7f0d1ffff640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d0806c8f0 0x7f0d0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.013+0000 7f0d24ff9640 1 -- 172.21.15.90:0/2206179801 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7f0d1808bf30 con 0x7f0d280ab730 2024-04-20T10:50:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.013+0000 7f0d1ffff640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d0806c8f0 0x7f0d0806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d280ab2e0 tx=0x7f0d10008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.017+0000 7f0d24ff9640 1 -- 172.21.15.90:0/2206179801 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0d280ac460 con 0x7f0d280ab730 2024-04-20T10:50:41.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.192+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d28076150 con 0x7f0d280ab730 2024-04-20T10:50:41.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.193+0000 7f0d24ff9640 1 -- 172.21.15.90:0/2206179801 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+16598 (secure 0 0 0) 0x7f0d1805a400 con 0x7f0d280ab730 2024-04-20T10:50:41.193 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:41.193 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:39.915291+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d0806c8f0 msgr2=0x7f0d0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d0806c8f0 0x7f0d0806edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f0d280ab2e0 tx=0x7f0d10008040 comp rx=0 tx=0).stop 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280ab730 msgr2=0x7f0d280c56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280ab730 0x7f0d280c56e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0d1800d5f0 tx=0x7f0d1800dab0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 shutdown_connections 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d0806c8f0 0x7f0d0806edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d28153ef0 0x7f0d280c12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d280c9ee0 0x7f0d280c0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 --2- 172.21.15.90:0/2206179801 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d280ab730 0x7f0d280c56e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 >> 172.21.15.90:0/2206179801 conn(0x7f0d280cbfe0 msgr2=0x7f0d281550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 shutdown_connections 2024-04-20T10:50:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.195+0000 7f0d2da25640 1 -- 172.21.15.90:0/2206179801 wait complete. 2024-04-20T10:50:41.206 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a standby_count_wanted 0 2024-04-20T10:50:41.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.304+0000 7fa3049f4640 1 Processor -- start 2024-04-20T10:50:41.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.304+0000 7fa3049f4640 1 -- start start 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa3049f4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa3000c27a0 0x7fa3001570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa3049f4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3000adab0 con 0x7fa3000ad640 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa3049f4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa300071690 con 0x7fa3000c54d0 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa3049f4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa300071970 con 0x7fa3000c27a0 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa2fed9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa3000ad640 0x7fa300153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53214/0 (socket says 172.21.15.90:53214) 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa2fed9d640 1 -- 172.21.15.90:0/763675682 learned_addr learned my addr 172.21.15.90:0/763675682 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479708299 0 0) 0x7fa3000adab0 con 0x7fa3000ad640 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e8003520 con 0x7fa3000ad640 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.305+0000 7fa2fe59c640 1 --2- 172.21.15.90:0/763675682 >> v2:172.21.15.175:3300/0 conn(0x7fa3000c27a0 0x7fa3001570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2379289169 0 0) 0x7fa2e8003520 con 0x7fa3000ad640 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 >> v2:172.21.15.175:3300/0 conn(0x7fa3000c27a0 msgr2=0x7fa3001570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:41.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 --2- 172.21.15.90:0/763675682 >> v2:172.21.15.175:3300/0 conn(0x7fa3000c27a0 0x7fa3001570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 >> v1:172.21.15.175:6789/0 conn(0x7fa3000c54d0 legacy=0x7fa30015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa300159ce0 con 0x7fa3000ad640 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fa2f8001670 con 0x7fa3000ad640 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 >> v1:172.21.15.90:6789/0 conn(0x7fa3000ad640 legacy=0x7fa300153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2e80039b0 0x7fa2e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8004800 0x7fa2e8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2e80051c0 0x7fa2e800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa300071970 con 0x7fa2e80051c0 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e800c060 con 0x7fa2e8004800 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2e800c260 con 0x7fa2e80039b0 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fed9d640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2e80051c0 0x7fa2e800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fdd9b640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8004800 0x7fa2e8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fe59c640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2e80039b0 0x7fa2e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fed9d640 1 -- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2e80039b0 msgr2=0x7fa2e8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:41.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fed9d640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2e80039b0 0x7fa2e8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fed9d640 1 -- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8004800 msgr2=0x7fa2e8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:41.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fed9d640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e8004800 0x7fa2e8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.306+0000 7fa2fed9d640 1 -- 172.21.15.90:0/763675682 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e8003520 con 0x7fa2e80051c0 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.307+0000 7fa2fed9d640 1 -- 172.21.15.90:0/763675682 reap_dead start 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.307+0000 7fa2fed9d640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2e80051c0 0x7fa2e800b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800c240 tx=0x7fa2e8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ff8dc7ed6f6bb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.307+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8007cf0 con 0x7fa2e80051c0 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.307+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f8030070 con 0x7fa2e80051c0 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.307+0000 7fa2fd59a640 1 -- 172.21.15.90:0/763675682 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8005d30 con 0x7fa2e80051c0 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.307+0000 7fa3049f4640 1 -- 172.21.15.90:0/763675682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2e80051c0 msgr2=0x7fa2e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.307+0000 7fa3049f4640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2e80051c0 0x7fa2e800b9c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa2f800c240 tx=0x7fa2e8005830 comp rx=0 tx=0).stop 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.308+0000 7fa3049f4640 1 -- 172.21.15.90:0/763675682 shutdown_connections 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.308+0000 7fa3049f4640 1 --2- 172.21.15.90:0/763675682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2e80051c0 0x7fa2e800b9c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.308+0000 7fa3049f4640 1 -- 172.21.15.90:0/763675682 >> 172.21.15.90:0/763675682 conn(0x7fa3000c9100 msgr2=0x7fa3000c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:41.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.308+0000 7fa3049f4640 1 -- 172.21.15.90:0/763675682 shutdown_connections 2024-04-20T10:50:41.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.308+0000 7fa3049f4640 1 -- 172.21.15.90:0/763675682 wait complete. 2024-04-20T10:50:41.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.309+0000 7fa3049f4640 1 Processor -- start 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.309+0000 7fa3049f4640 1 -- start start 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.309+0000 7fa3049f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e80051c0 0x7fa30014b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.309+0000 7fa3049f4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3001ec3e0 0x7fa3001ec860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa3049f4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3001ecda0 0x7fa3000c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa3049f4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa3000c2b80 con 0x7fa3001ecda0 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa3049f4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa30006f510 con 0x7fa2e80051c0 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa3049f4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa3000c2d00 con 0x7fa3001ec3e0 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3001ecda0 0x7fa3000c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3001ecda0 0x7fa3000c6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54200/0 (socket says 172.21.15.90:54200) 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 -- 172.21.15.90:0/2526665506 learned_addr learned my addr 172.21.15.90:0/2526665506 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fe59c640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e80051c0 0x7fa30014b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fdd9b640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3001ec3e0 0x7fa3001ec860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 -- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3001ec3e0 msgr2=0x7fa3001ec860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3001ec3e0 0x7fa3001ec860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 -- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e80051c0 msgr2=0x7fa30014b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e80051c0 0x7fa30014b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 -- 172.21.15.90:0/2526665506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3000721e0 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2fed9d640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3001ecda0 0x7fa3000c6f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2f802c540 tx=0x7fa300071860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2eeffd640 1 -- 172.21.15.90:0/2526665506 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8007cf0 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2eeffd640 1 -- 172.21.15.90:0/2526665506 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2f8004bf0 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3001f05b0 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa2eeffd640 1 -- 172.21.15.90:0/2526665506 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8001c30 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.310+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30014b760 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.311+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3000741f0 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.312+0000 7fa2eeffd640 1 -- 172.21.15.90:0/2526665506 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2f8007070 con 0x7fa3001ecda0 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.312+0000 7fa2eeffd640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e006c920 0x7fa2e006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.312+0000 7fa2eeffd640 1 -- 172.21.15.90:0/2526665506 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5689+0+0 (secure 0 0 0) 0x7fa2f80acaf0 con 0x7fa3001ecda0 2024-04-20T10:50:41.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.312+0000 7fa2fe59c640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e006c920 0x7fa2e006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.312+0000 7fa2fe59c640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e006c920 0x7fa2e006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3001ed510 tx=0x7fa2f000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.316+0000 7fa2eeffd640 1 -- 172.21.15.90:0/2526665506 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa3000741f0 con 0x7fa3001ecda0 2024-04-20T10:50:41.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.530+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa3000ae5d0 con 0x7fa3001ecda0 2024-04-20T10:50:41.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.583+0000 7fa2eeffd640 1 -- 172.21.15.90:0/2526665506 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 113+0+0 (secure 0 0 0) 0x7fa3000ae5d0 con 0x7fa3001ecda0 2024-04-20T10:50:41.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e006c920 msgr2=0x7fa2e006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e006c920 0x7fa2e006ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa3001ed510 tx=0x7fa2f000b040 comp rx=0 tx=0).stop 2024-04-20T10:50:41.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3001ecda0 msgr2=0x7fa3000c6f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3001ecda0 0x7fa3000c6f00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa2f802c540 tx=0x7fa300071860 comp rx=0 tx=0).stop 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 shutdown_connections 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e006c920 0x7fa2e006ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa3001ecda0 0x7fa3000c6f00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa3001ec3e0 0x7fa3001ec860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 --2- 172.21.15.90:0/2526665506 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2e80051c0 0x7fa30014b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 >> 172.21.15.90:0/2526665506 conn(0x7fa3000c9100 msgr2=0x7fa3000c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 shutdown_connections 2024-04-20T10:50:41.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.585+0000 7fa3049f4640 1 -- 172.21.15.90:0/2526665506 wait complete. 2024-04-20T10:50:41.596 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-20T10:50:41.597 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a allow_standby_replay false 2024-04-20T10:50:41.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.696+0000 7f1658e9a640 1 Processor -- start 2024-04-20T10:50:41.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.696+0000 7f1658e9a640 1 -- start start 2024-04-20T10:50:41.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1658e9a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f16540ab710 0x7f1654157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1658e9a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16540adce0 con 0x7f1654153ee0 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1658e9a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16540adfc0 con 0x7f165406c4d0 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1658e9a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f16540ae2a0 con 0x7f16540ab710 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1651d9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f16540ab710 0x7f1654157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f165259c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1654153ee0 0x7f16540c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53222/0 (socket says 172.21.15.90:53222) 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f165259c640 1 -- 172.21.15.90:0/2489040639 learned_addr learned my addr 172.21.15.90:0/2489040639 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1651d9b640 1 -- 172.21.15.90:0/2489040639 >> v1:172.21.15.175:6789/0 conn(0x7f165406c4d0 legacy=0x7f165406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1651d9b640 1 -- 172.21.15.90:0/2489040639 >> v1:172.21.15.90:6789/0 conn(0x7f1654153ee0 legacy=0x7f16540c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f1651d9b640 1 -- 172.21.15.90:0/2489040639 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16540c70f0 con 0x7f16540ab710 2024-04-20T10:50:41.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.697+0000 7f165159a640 1 -- 172.21.15.90:0/2489040639 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383043634 0 0) 0x7f16540adce0 con 0x7f1654153ee0 2024-04-20T10:50:41.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.698+0000 7f1651d9b640 1 --2- 172.21.15.90:0/2489040639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654157190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16480097a0 tx=0x7f164802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69e91f4ee86a2eb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.698+0000 7f165159a640 1 -- 172.21.15.90:0/2489040639 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648038070 con 0x7f16540ab710 2024-04-20T10:50:41.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.698+0000 7f165159a640 1 -- 172.21.15.90:0/2489040639 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1648031700 con 0x7f16540ab710 2024-04-20T10:50:41.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.698+0000 7f165159a640 1 -- 172.21.15.90:0/2489040639 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648031ad0 con 0x7f16540ab710 2024-04-20T10:50:41.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.699+0000 7f1658e9a640 1 -- 172.21.15.90:0/2489040639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 msgr2=0x7f1654157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.699+0000 7f1658e9a640 1 --2- 172.21.15.90:0/2489040639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654157190 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f16480097a0 tx=0x7f164802b7a0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.699+0000 7f1658e9a640 1 -- 172.21.15.90:0/2489040639 shutdown_connections 2024-04-20T10:50:41.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.699+0000 7f1658e9a640 1 --2- 172.21.15.90:0/2489040639 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654157190 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.699+0000 7f1658e9a640 1 -- 172.21.15.90:0/2489040639 >> 172.21.15.90:0/2489040639 conn(0x7f16540cc060 msgr2=0x7f16540cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:41.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.699+0000 7f1658e9a640 1 -- 172.21.15.90:0/2489040639 shutdown_connections 2024-04-20T10:50:41.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.699+0000 7f1658e9a640 1 -- 172.21.15.90:0/2489040639 wait complete. 2024-04-20T10:50:41.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.700+0000 7f1658e9a640 1 Processor -- start 2024-04-20T10:50:41.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.700+0000 7f1658e9a640 1 -- start start 2024-04-20T10:50:41.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165406c4d0 0x7f16540c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1654153ee0 0x7f16541ef880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f165406d190 con 0x7f16540ab710 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f165406d010 con 0x7f1654153ee0 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f16540caf70 con 0x7f165406c4d0 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654152e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54224/0 (socket says 172.21.15.90:54224) 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 -- 172.21.15.90:0/3600187280 learned_addr learned my addr 172.21.15.90:0/3600187280 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f165259c640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165406c4d0 0x7f16540c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1652d9d640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1654153ee0 0x7f16541ef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 -- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165406c4d0 msgr2=0x7f16540c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165406c4d0 0x7f16540c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 -- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1654153ee0 msgr2=0x7f16541ef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:41.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1654153ee0 0x7f16541ef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 -- 172.21.15.90:0/3600187280 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16540c2860 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1651d9b640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654152e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f16480098c0 tx=0x7f16480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1642ffd640 1 -- 172.21.15.90:0/3600187280 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648043070 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1642ffd640 1 -- 172.21.15.90:0/3600187280 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1648033a30 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16540c2b40 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1642ffd640 1 -- 172.21.15.90:0/3600187280 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1648038040 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.701+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16540c0860 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.703+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1654076150 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.703+0000 7f1642ffd640 1 -- 172.21.15.90:0/3600187280 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1648046070 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.703+0000 7f1642ffd640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f163406c920 0x7f163406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.703+0000 7f1642ffd640 1 -- 172.21.15.90:0/3600187280 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f16480ad800 con 0x7f16540ab710 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.703+0000 7f165259c640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f163406c920 0x7f163406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:41.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.704+0000 7f165259c640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f163406c920 0x7f163406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1644007fd0 tx=0x7f1644007de0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:41.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.707+0000 7f1642ffd640 1 -- 172.21.15.90:0/3600187280 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1648030070 con 0x7f16540ab710 2024-04-20T10:50:41.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:41.919+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f16540ab4f0 con 0x7f16540ab710 2024-04-20T10:50:42.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.596+0000 7f1642ffd640 1 -- 172.21.15.90:0/3600187280 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 117+0+0 (secure 0 0 0) 0x7f1648033e20 con 0x7f16540ab710 2024-04-20T10:50:42.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f163406c920 msgr2=0x7f163406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f163406c920 0x7f163406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1644007fd0 tx=0x7f1644007de0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 msgr2=0x7f1654152e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654152e20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f16480098c0 tx=0x7f16480046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 shutdown_connections 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f163406c920 0x7f163406ede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1654153ee0 0x7f16541ef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f16540ab710 0x7f1654152e20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 --2- 172.21.15.90:0/3600187280 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f165406c4d0 0x7f16540c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 >> 172.21.15.90:0/3600187280 conn(0x7f16540cc060 msgr2=0x7f16540b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:42.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 shutdown_connections 2024-04-20T10:50:42.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.599+0000 7f1658e9a640 1 -- 172.21.15.90:0/3600187280 wait complete. 2024-04-20T10:50:42.611 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set a session_timeout 300 2024-04-20T10:50:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.712+0000 7fcb46a43640 1 Processor -- start 2024-04-20T10:50:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.712+0000 7fcb46a43640 1 -- start start 2024-04-20T10:50:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb46a43640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fcb400701c0 0x7fcb40073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb46a43640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb40156f20 0x7fcb40153630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb46a43640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb400c6870 con 0x7fcb4015ab30 2024-04-20T10:50:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb46a43640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fcb400ab630 con 0x7fcb40156f20 2024-04-20T10:50:42.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb46a43640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fcb40159e00 con 0x7fcb400701c0 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb44fe0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb40156f20 0x7fcb40153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb44fe0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb40156f20 0x7fcb40153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54234/0 (socket says 172.21.15.90:54234) 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb3f7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fcb4015ab30 0x7fcb40156810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53230/0 (socket says 172.21.15.90:53230) 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb44fe0640 1 -- 172.21.15.90:0/3570200590 learned_addr learned my addr 172.21.15.90:0/3570200590 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb3ffff640 1 --2- 172.21.15.90:0/3570200590 >> v2:172.21.15.175:3300/0 conn(0x7fcb400701c0 0x7fcb40073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb44fe0640 1 -- 172.21.15.90:0/3570200590 >> v2:172.21.15.175:3300/0 conn(0x7fcb400701c0 msgr2=0x7fcb40073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb44fe0640 1 --2- 172.21.15.90:0/3570200590 >> v2:172.21.15.175:3300/0 conn(0x7fcb400701c0 0x7fcb40073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb44fe0640 1 -- 172.21.15.90:0/3570200590 >> v1:172.21.15.90:6789/0 conn(0x7fcb4015ab30 legacy=0x7fcb40156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb44fe0640 1 -- 172.21.15.90:0/3570200590 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4015a050 con 0x7fcb40156f20 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.713+0000 7fcb3effd640 1 -- 172.21.15.90:0/3570200590 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2346635483 0 0) 0x7fcb400c6870 con 0x7fcb4015ab30 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.714+0000 7fcb44fe0640 1 --2- 172.21.15.90:0/3570200590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40156f20 0x7fcb40153630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb400c55f0 tx=0x7fcb3802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3f749c21064a0b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:42.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.714+0000 7fcb3effd640 1 -- 172.21.15.90:0/3570200590 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3802ca80 con 0x7fcb40156f20 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.714+0000 7fcb3effd640 1 -- 172.21.15.90:0/3570200590 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3802cc20 con 0x7fcb40156f20 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.714+0000 7fcb3effd640 1 -- 172.21.15.90:0/3570200590 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb380343f0 con 0x7fcb40156f20 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 -- 172.21.15.90:0/3570200590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40156f20 msgr2=0x7fcb40153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3570200590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40156f20 0x7fcb40153630 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcb400c55f0 tx=0x7fcb3802bee0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 -- 172.21.15.90:0/3570200590 shutdown_connections 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3570200590 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb40156f20 0x7fcb40153630 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3570200590 >> v2:172.21.15.175:3300/0 conn(0x7fcb400701c0 0x7fcb40073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 -- 172.21.15.90:0/3570200590 >> 172.21.15.90:0/3570200590 conn(0x7fcb400676c0 msgr2=0x7fcb40067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 -- 172.21.15.90:0/3570200590 shutdown_connections 2024-04-20T10:50:42.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.715+0000 7fcb46a43640 1 -- 172.21.15.90:0/3570200590 wait complete. 2024-04-20T10:50:42.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.716+0000 7fcb46a43640 1 Processor -- start 2024-04-20T10:50:42.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.716+0000 7fcb46a43640 1 -- start start 2024-04-20T10:50:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb46a43640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb400701c0 0x7fcb401ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb46a43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb4015ab30 0x7fcb40073370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb46a43640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb4006ccc0 0x7fcb40155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb46a43640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb400705a0 con 0x7fcb400701c0 2024-04-20T10:50:42.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb46a43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4015a610 con 0x7fcb4015ab30 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb46a43640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcb400c6470 con 0x7fcb4006ccc0 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb400701c0 0x7fcb401ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb400701c0 0x7fcb401ebe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54248/0 (socket says 172.21.15.90:54248) 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 -- 172.21.15.90:0/3380602680 learned_addr learned my addr 172.21.15.90:0/3380602680 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3f7fe640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb4015ab30 0x7fcb40073370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb44fe0640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb4006ccc0 0x7fcb40155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 -- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb4006ccc0 msgr2=0x7fcb40155550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb4006ccc0 0x7fcb40155550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 -- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb4015ab30 msgr2=0x7fcb40073370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb4015ab30 0x7fcb40073370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 -- 172.21.15.90:0/3380602680 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb401e9ac0 con 0x7fcb400701c0 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3f7fe640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb4015ab30 0x7fcb40073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:42.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb44fe0640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb4006ccc0 0x7fcb40155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.717+0000 7fcb3ffff640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb400701c0 0x7fcb401ebe20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000d800 tx=0x7fcb3000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.718+0000 7fcb3cff9640 1 -- 172.21.15.90:0/3380602680 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000b6c0 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.718+0000 7fcb3cff9640 1 -- 172.21.15.90:0/3380602680 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb30019070 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.718+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb401ec450 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.718+0000 7fcb3cff9640 1 -- 172.21.15.90:0/3380602680 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000ba80 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.718+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb401eca10 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.719+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb40076150 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.719+0000 7fcb3cff9640 1 -- 172.21.15.90:0/3380602680 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb3000bc20 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.719+0000 7fcb3cff9640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.719+0000 7fcb3cff9640 1 -- 172.21.15.90:0/3380602680 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fcb3008bfc0 con 0x7fcb400701c0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.719+0000 7fcb3f7fe640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:42.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.720+0000 7fcb3f7fe640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb40073b30 tx=0x7fcb34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:42.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.724+0000 7fcb3cff9640 1 -- 172.21.15.90:0/3380602680 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fcb3001c360 con 0x7fcb400701c0 2024-04-20T10:50:42.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:42.939+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"} v 0) -- 0x7fcb40072ee0 con 0x7fcb400701c0 2024-04-20T10:50:43.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.598+0000 7fcb3cff9640 1 -- 172.21.15.90:0/3380602680 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "a", "var": "session_timeout", "val": "300"}]=0 v7) ==== 110+0+0 (secure 0 0 0) 0x7fcb3005a490 con 0x7fcb400701c0 2024-04-20T10:50:43.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.600+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb2c06c8f0 msgr2=0x7fcb2c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:43.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.600+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcb40073b30 tx=0x7fcb34009040 comp rx=0 tx=0).stop 2024-04-20T10:50:43.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.600+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb400701c0 msgr2=0x7fcb401ebe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:43.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.600+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb400701c0 0x7fcb401ebe20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000d800 tx=0x7fcb3000dcc0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 shutdown_connections 2024-04-20T10:50:43.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb2c06c8f0 0x7fcb2c06edb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb4006ccc0 0x7fcb40155550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb4015ab30 0x7fcb40073370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 --2- 172.21.15.90:0/3380602680 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb400701c0 0x7fcb401ebe20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 >> 172.21.15.90:0/3380602680 conn(0x7fcb400676c0 msgr2=0x7fcb400abaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:43.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 shutdown_connections 2024-04-20T10:50:43.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.601+0000 7fcb46a43640 1 -- 172.21.15.90:0/3380602680 wait complete. 2024-04-20T10:50:43.614 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'a' 2024-04-20T10:50:43.614 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:50:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.715+0000 7f354fa06640 1 Processor -- start 2024-04-20T10:50:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.715+0000 7f354fa06640 1 -- start start 2024-04-20T10:50:43.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354fa06640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3548072860 0x7f35481551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354fa06640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3548073120 0x7f3548151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354fa06640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3548158780 con 0x7f35480c45c0 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354fa06640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f35480ad010 con 0x7f3548072860 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354fa06640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3548158530 con 0x7f3548073120 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354d7a2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3548072860 0x7f35481551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354d7a2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3548072860 0x7f35481551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54256/0 (socket says 172.21.15.90:54256) 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.716+0000 7f354d7a2640 1 -- 172.21.15.90:0/2843861775 learned_addr learned my addr 172.21.15.90:0/2843861775 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.717+0000 7f354dfa3640 1 --2- 172.21.15.90:0/2843861775 >> v2:172.21.15.175:3300/0 conn(0x7f3548073120 0x7f3548151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.717+0000 7f354d7a2640 1 -- 172.21.15.90:0/2843861775 >> v2:172.21.15.175:3300/0 conn(0x7f3548073120 msgr2=0x7f3548151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.717+0000 7f354d7a2640 1 --2- 172.21.15.90:0/2843861775 >> v2:172.21.15.175:3300/0 conn(0x7f3548073120 0x7f3548151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.717+0000 7f354d7a2640 1 -- 172.21.15.90:0/2843861775 >> v1:172.21.15.175:6789/0 conn(0x7f35480c45c0 legacy=0x7f35480ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:43.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.717+0000 7f354d7a2640 1 -- 172.21.15.90:0/2843861775 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35481546d0 con 0x7f3548072860 2024-04-20T10:50:43.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.717+0000 7f354d7a2640 1 --2- 172.21.15.90:0/2843861775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3548072860 0x7f35481551b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f35480c4dd0 tx=0x7f354402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f7fdb42c84d55a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:43.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.717+0000 7f353ffff640 1 -- 172.21.15.90:0/2843861775 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354402e070 con 0x7f3548072860 2024-04-20T10:50:43.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f353ffff640 1 -- 172.21.15.90:0/2843861775 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3544037070 con 0x7f3548072860 2024-04-20T10:50:43.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f353ffff640 1 -- 172.21.15.90:0/2843861775 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3544031a00 con 0x7f3548072860 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 -- 172.21.15.90:0/2843861775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3548072860 msgr2=0x7f35481551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 --2- 172.21.15.90:0/2843861775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3548072860 0x7f35481551b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f35480c4dd0 tx=0x7f354402b880 comp rx=0 tx=0).stop 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 -- 172.21.15.90:0/2843861775 shutdown_connections 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 --2- 172.21.15.90:0/2843861775 >> v2:172.21.15.175:3300/0 conn(0x7f3548073120 0x7f3548151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 --2- 172.21.15.90:0/2843861775 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3548072860 0x7f35481551b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 -- 172.21.15.90:0/2843861775 >> 172.21.15.90:0/2843861775 conn(0x7f3548067de0 msgr2=0x7f35480ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 -- 172.21.15.90:0/2843861775 shutdown_connections 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.718+0000 7f354fa06640 1 -- 172.21.15.90:0/2843861775 wait complete. 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.719+0000 7f354fa06640 1 Processor -- start 2024-04-20T10:50:43.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.719+0000 7f354fa06640 1 -- start start 2024-04-20T10:50:43.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354fa06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3548072860 0x7f35481de010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:43.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354fa06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3548073120 0x7f35480aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:43.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354fa06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35480c45c0 0x7f35481e9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:43.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354fa06640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3548154c90 con 0x7f35480c45c0 2024-04-20T10:50:43.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354fa06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3548158a60 con 0x7f3548072860 2024-04-20T10:50:43.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354fa06640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35480abbb0 con 0x7f3548073120 2024-04-20T10:50:43.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35480c45c0 0x7f35481e9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35480c45c0 0x7f35481e9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54270/0 (socket says 172.21.15.90:54270) 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 -- 172.21.15.90:0/2670142863 learned_addr learned my addr 172.21.15.90:0/2670142863 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354d7a2640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3548072860 0x7f35481de010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354cfa1640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3548073120 0x7f35480aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 -- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3548073120 msgr2=0x7f35480aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3548073120 0x7f35480aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 -- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3548072860 msgr2=0x7f35481de010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3548072860 0x7f35481de010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 -- 172.21.15.90:0/2670142863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35481ed3e0 con 0x7f35480c45c0 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354cfa1640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3548073120 0x7f35480aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.720+0000 7f354dfa3640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35480c45c0 0x7f35481e9e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3540007e40 tx=0x7f354000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:43.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.721+0000 7f353dffb640 1 -- 172.21.15.90:0/2670142863 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540014620 con 0x7f35480c45c0 2024-04-20T10:50:43.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.721+0000 7f353dffb640 1 -- 172.21.15.90:0/2670142863 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3540019070 con 0x7f35480c45c0 2024-04-20T10:50:43.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.721+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35481ed6c0 con 0x7f35480c45c0 2024-04-20T10:50:43.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.721+0000 7f353dffb640 1 -- 172.21.15.90:0/2670142863 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3540014a20 con 0x7f35480c45c0 2024-04-20T10:50:43.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.721+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35481edc80 con 0x7f35480c45c0 2024-04-20T10:50:43.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.722+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3548076150 con 0x7f35480c45c0 2024-04-20T10:50:43.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.722+0000 7f353dffb640 1 -- 172.21.15.90:0/2670142863 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3540014bc0 con 0x7f35480c45c0 2024-04-20T10:50:43.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.723+0000 7f353dffb640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f352c06c920 0x7f352c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:43.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.723+0000 7f354d7a2640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f352c06c920 0x7f352c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:43.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.723+0000 7f353dffb640 1 -- 172.21.15.90:0/2670142863 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f354008c3c0 con 0x7f35480c45c0 2024-04-20T10:50:43.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.723+0000 7f354d7a2640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f352c06c920 0x7f352c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3544036000 tx=0x7f354403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:43.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.727+0000 7f353dffb640 1 -- 172.21.15.90:0/2670142863 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f354005a890 con 0x7f35480c45c0 2024-04-20T10:50:43.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.938+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35480ab540 con 0x7f35480c45c0 2024-04-20T10:50:43.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.938+0000 7f353dffb640 1 -- 172.21.15.90:0/2670142863 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5195 (secure 0 0 0) 0x7f354005a190 con 0x7f35480c45c0 2024-04-20T10:50:43.941 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:43.941 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1}]} 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 7 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f352c06c920 msgr2=0x7f352c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f352c06c920 0x7f352c06ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3544036000 tx=0x7f354403d040 comp rx=0 tx=0).stop 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35480c45c0 msgr2=0x7f35481e9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35480c45c0 0x7f35481e9e70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3540007e40 tx=0x7f354000e4b0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 shutdown_connections 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f352c06c920 0x7f352c06ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35480c45c0 0x7f35481e9e70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3548073120 0x7f35480aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 --2- 172.21.15.90:0/2670142863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3548072860 0x7f35481de010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 >> 172.21.15.90:0/2670142863 conn(0x7f3548067de0 msgr2=0x7f35480c9600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 shutdown_connections 2024-04-20T10:50:43.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:43.940+0000 7f354fa06640 1 -- 172.21.15.90:0/2670142863 wait complete. 2024-04-20T10:50:43.951 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:44.050 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.048+0000 7f59adf15640 1 Processor -- start 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.048+0000 7f59adf15640 1 -- start start 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59adf15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59a8153ef0 0x7f59a80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59adf15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80c9ee0 0x7f59a8156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59adf15640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a815a720 con 0x7f59a80ab730 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59adf15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f59a815ac80 con 0x7f59a8153ef0 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59adf15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59a815a9a0 con 0x7f59a80c9ee0 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59a77fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59a8153ef0 0x7f59a80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80c9ee0 0x7f59a8156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59a77fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59a8153ef0 0x7f59a80c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:42268/0 (socket says 172.21.15.90:42268) 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59a77fe640 1 -- 172.21.15.90:0/176891559 learned_addr learned my addr 172.21.15.90:0/176891559 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.049+0000 7f59a6ffd640 1 --1- 172.21.15.90:0/176891559 >> v1:172.21.15.175:6789/0 conn(0x7f59a80ab730 0x7f59a81568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:43376/0 (socket says 172.21.15.90:43376) 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.050+0000 7f59a77fe640 1 -- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80c9ee0 msgr2=0x7f59a8156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.050+0000 7f59a77fe640 1 --2- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80c9ee0 0x7f59a8156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.050+0000 7f59a77fe640 1 -- 172.21.15.90:0/176891559 >> v1:172.21.15.175:6789/0 conn(0x7f59a80ab730 legacy=0x7f59a81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.050+0000 7f59a77fe640 1 -- 172.21.15.90:0/176891559 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a80c6a90 con 0x7f59a8153ef0 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.050+0000 7f59a7fff640 1 --2- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80c9ee0 0x7f59a8156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.050+0000 7f59a77fe640 1 --2- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a8153ef0 0x7f59a80c89f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5998009870 tx=0x7f599802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83918354fe46c812 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.050+0000 7f59a67fc640 1 -- 172.21.15.90:0/176891559 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980317c0 con 0x7f59a8153ef0 2024-04-20T10:50:44.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59a67fc640 1 -- 172.21.15.90:0/176891559 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5998037070 con 0x7f59a8153ef0 2024-04-20T10:50:44.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59a67fc640 1 -- 172.21.15.90:0/176891559 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5998031b80 con 0x7f59a8153ef0 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 -- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a8153ef0 msgr2=0x7f59a80c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 --2- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a8153ef0 0x7f59a80c89f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5998009870 tx=0x7f599802b860 comp rx=0 tx=0).stop 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 -- 172.21.15.90:0/176891559 shutdown_connections 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 --2- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80c9ee0 0x7f59a8156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 --2- 172.21.15.90:0/176891559 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a8153ef0 0x7f59a80c89f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 -- 172.21.15.90:0/176891559 >> 172.21.15.90:0/176891559 conn(0x7f59a80cbfe0 msgr2=0x7f59a80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 -- 172.21.15.90:0/176891559 shutdown_connections 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.051+0000 7f59adf15640 1 -- 172.21.15.90:0/176891559 wait complete. 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.052+0000 7f59adf15640 1 Processor -- start 2024-04-20T10:50:44.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.052+0000 7f59adf15640 1 -- start start 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59adf15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80ab730 0x7f59a80c1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59adf15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80c9ee0 0x7f59a81e3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59adf15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a8153ef0 0x7f59a81e35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59adf15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59a80bf800 con 0x7f59a8153ef0 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59adf15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59a8157510 con 0x7f59a80c9ee0 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59adf15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59a81dfdb0 con 0x7f59a80ab730 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a8153ef0 0x7f59a81e35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a8153ef0 0x7f59a81e35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54286/0 (socket says 172.21.15.90:54286) 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 -- 172.21.15.90:0/1355768348 learned_addr learned my addr 172.21.15.90:0/1355768348 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a6ffd640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80c9ee0 0x7f59a81e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a77fe640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80ab730 0x7f59a80c1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 -- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80ab730 msgr2=0x7f59a80c1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80ab730 0x7f59a80c1920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 -- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80c9ee0 msgr2=0x7f59a81e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80c9ee0 0x7f59a81e3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.053+0000 7f59a7fff640 1 -- 172.21.15.90:0/1355768348 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a80c4750 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.054+0000 7f59a7fff640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a8153ef0 0x7f59a81e35d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59a000efc0 tx=0x7f59a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.054+0000 7f598ffff640 1 -- 172.21.15.90:0/1355768348 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0018030 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.054+0000 7f598ffff640 1 -- 172.21.15.90:0/1355768348 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a000cdf0 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.054+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a81e0650 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.054+0000 7f598ffff640 1 -- 172.21.15.90:0/1355768348 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0003bb0 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.054+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a81e0000 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.055+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a80abe90 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.055+0000 7f598ffff640 1 -- 172.21.15.90:0/1355768348 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59a0005d10 con 0x7f59a8153ef0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.056+0000 7f598ffff640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f599406c8f0 0x7f599406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.056+0000 7f59a77fe640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f599406c8f0 0x7f599406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.056+0000 7f598ffff640 1 -- 172.21.15.90:0/1355768348 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f59a008c400 con 0x7f59a8153ef0 2024-04-20T10:50:44.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.056+0000 7f59a77fe640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f599406c8f0 0x7f599406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5998036000 tx=0x7f599803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.060+0000 7f598ffff640 1 -- 172.21.15.90:0/1355768348 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f59a80abe90 con 0x7f59a8153ef0 2024-04-20T10:50:44.212 INFO:tasks.ceph.mds.d.smithi175.stderr:2024-04-20T10:50:44.212+0000 7fcc23df2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:50:44.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.239+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59a8076150 con 0x7f59a8153ef0 2024-04-20T10:50:44.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.240+0000 7f598ffff640 1 -- 172.21.15.90:0/1355768348 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16585 (secure 0 0 0) 0x7f59a0022070 con 0x7f59a8153ef0 2024-04-20T10:50:44.241 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:44.241 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:41.575679+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.242+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f599406c8f0 msgr2=0x7f599406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.242+0000 7f59adf15640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f599406c8f0 0x7f599406edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5998036000 tx=0x7f599803d040 comp rx=0 tx=0).stop 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a8153ef0 msgr2=0x7f59a81e35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a8153ef0 0x7f59a81e35d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f59a000efc0 tx=0x7f59a000c490 comp rx=0 tx=0).stop 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 shutdown_connections 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f599406c8f0 0x7f599406edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59a8153ef0 0x7f59a81e35d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59a80c9ee0 0x7f59a81e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 --2- 172.21.15.90:0/1355768348 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59a80ab730 0x7f59a80c1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 >> 172.21.15.90:0/1355768348 conn(0x7f59a80cbfe0 msgr2=0x7f59a80cb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:44.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 shutdown_connections 2024-04-20T10:50:44.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.243+0000 7f59adf15640 1 -- 172.21.15.90:0/1355768348 wait complete. 2024-04-20T10:50:44.256 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-20T10:50:44.256 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:50:44.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.353+0000 7fafd52d2640 1 Processor -- start 2024-04-20T10:50:44.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.353+0000 7fafd52d2640 1 -- start start 2024-04-20T10:50:44.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafd52d2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fafd0153ef0 0x7fafd00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafd52d2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fafd00ab730 0x7fafd01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafd52d2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd00c9ee0 0x7fafd0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafd52d2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fafd015a720 con 0x7fafd0153ef0 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafd52d2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fafd015ac80 con 0x7fafd00ab730 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafd52d2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fafd015a9a0 con 0x7fafd00c9ee0 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fafd0153ef0 0x7fafd00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fafd0153ef0 0x7fafd00c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54302/0 (socket says 172.21.15.90:54302) 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 -- 172.21.15.90:0/687035320 learned_addr learned my addr 172.21.15.90:0/687035320 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 -- 172.21.15.90:0/687035320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd00c9ee0 msgr2=0x7fafd0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 --2- 172.21.15.90:0/687035320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd00c9ee0 0x7fafd0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 -- 172.21.15.90:0/687035320 >> v2:172.21.15.175:3300/0 conn(0x7fafd00ab730 msgr2=0x7fafd01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 --2- 172.21.15.90:0/687035320 >> v2:172.21.15.175:3300/0 conn(0x7fafd00ab730 0x7fafd01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.354+0000 7fafceffd640 1 -- 172.21.15.90:0/687035320 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd00c6a90 con 0x7fafd0153ef0 2024-04-20T10:50:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.355+0000 7fafceffd640 1 --2- 172.21.15.90:0/687035320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd0153ef0 0x7fafd00c89f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fafd00b2190 tx=0x7fafc002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27bf91d985032171 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.355+0000 7fafce7fc640 1 -- 172.21.15.90:0/687035320 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0038070 con 0x7fafd0153ef0 2024-04-20T10:50:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.355+0000 7fafce7fc640 1 -- 172.21.15.90:0/687035320 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc002f050 con 0x7fafd0153ef0 2024-04-20T10:50:44.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.355+0000 7fafce7fc640 1 -- 172.21.15.90:0/687035320 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0031970 con 0x7fafd0153ef0 2024-04-20T10:50:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 -- 172.21.15.90:0/687035320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd0153ef0 msgr2=0x7fafd00c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 --2- 172.21.15.90:0/687035320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd0153ef0 0x7fafd00c89f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fafd00b2190 tx=0x7fafc002b7f0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 -- 172.21.15.90:0/687035320 shutdown_connections 2024-04-20T10:50:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 --2- 172.21.15.90:0/687035320 >> v2:172.21.15.175:3300/0 conn(0x7fafd00ab730 0x7fafd01568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 --2- 172.21.15.90:0/687035320 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd00c9ee0 0x7fafd0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 --2- 172.21.15.90:0/687035320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd0153ef0 0x7fafd00c89f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 -- 172.21.15.90:0/687035320 >> 172.21.15.90:0/687035320 conn(0x7fafd00cbfe0 msgr2=0x7fafd00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 -- 172.21.15.90:0/687035320 shutdown_connections 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.356+0000 7fafd52d2640 1 -- 172.21.15.90:0/687035320 wait complete. 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.357+0000 7fafd52d2640 1 Processor -- start 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.357+0000 7fafd52d2640 1 -- start start 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00ab730 0x7fafd0150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafd00c9ee0 0x7fafd01efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd0153ef0 0x7fafd01f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fafd00bf800 con 0x7fafd00ab730 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fafd0157340 con 0x7fafd00c9ee0 2024-04-20T10:50:44.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fafd00c30b0 con 0x7fafd0153ef0 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00ab730 0x7fafd0150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00ab730 0x7fafd0150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54318/0 (socket says 172.21.15.90:54318) 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 -- 172.21.15.90:0/4256837292 learned_addr learned my addr 172.21.15.90:0/4256837292 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafcf7fe640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd0153ef0 0x7fafd01f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafc7fff640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafd00c9ee0 0x7fafd01efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 -- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd0153ef0 msgr2=0x7fafd01f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd0153ef0 0x7fafd01f0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 -- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafd00c9ee0 msgr2=0x7fafd01efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafd00c9ee0 0x7fafd01efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 -- 172.21.15.90:0/4256837292 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd01595f0 con 0x7fafd00ab730 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafc7fff640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafd00c9ee0 0x7fafd01efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafcf7fe640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd0153ef0 0x7fafd01f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafceffd640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00ab730 0x7fafd0150770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fafc0000c00 tx=0x7fafc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafc77fe640 1 -- 172.21.15.90:0/4256837292 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0043070 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafc77fe640 1 -- 172.21.15.90:0/4256837292 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafc003f890 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafd00c59a0 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafc77fe640 1 -- 172.21.15.90:0/4256837292 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafc0038040 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.358+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafd01f07e0 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.359+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafd00695c0 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.360+0000 7fafc77fe640 1 -- 172.21.15.90:0/4256837292 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fafc0046070 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.360+0000 7fafc77fe640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fafb006c8f0 0x7fafb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.360+0000 7fafc77fe640 1 -- 172.21.15.90:0/4256837292 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fafc00adab0 con 0x7fafd00ab730 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.360+0000 7fafc7fff640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fafb006c8f0 0x7fafb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.361+0000 7fafc7fff640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fafb006c8f0 0x7fafb006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafd00c9860 tx=0x7fafb8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.364+0000 7fafc77fe640 1 -- 172.21.15.90:0/4256837292 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fafd00695c0 con 0x7fafd00ab730 2024-04-20T10:50:44.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.536+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fafd0076150 con 0x7fafb006c8f0 2024-04-20T10:50:44.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.543+0000 7fafc77fe640 1 -- 172.21.15.90:0/4256837292 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251904 (secure 0 0 0) 0x7fafd0076150 con 0x7fafb006c8f0 2024-04-20T10:50:44.545 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:44.560 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:50:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fafb006c8f0 msgr2=0x7fafb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fafb006c8f0 0x7fafb006edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fafd00c9860 tx=0x7fafb8008040 comp rx=0 tx=0).stop 2024-04-20T10:50:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00ab730 msgr2=0x7fafd0150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00ab730 0x7fafd0150770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fafc0000c00 tx=0x7fafc00046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 shutdown_connections 2024-04-20T10:50:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fafb006c8f0 0x7fafb006edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fafd0153ef0 0x7fafd01f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fafd00c9ee0 0x7fafd01efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 --2- 172.21.15.90:0/4256837292 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fafd00ab730 0x7fafd0150770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 >> 172.21.15.90:0/4256837292 conn(0x7fafd00cbfe0 msgr2=0x7fafd01568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:44.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 shutdown_connections 2024-04-20T10:50:44.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.546+0000 7fafd52d2640 1 -- 172.21.15.90:0/4256837292 wait complete. 2024-04-20T10:50:44.565 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-20T10:50:43.663899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1739556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.104178"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.600570+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:40.600570+0000","last_peered":"2024-04-20T10:50:40.600570+0000","last_clean":"2024-04-20T10:50:40.600570+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:40.600570+0000","last_undegraded":"2024-04-20T10:50:40.600570+0000","last_fullsized":"2024-04-20T10:50:40.600570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:10.650093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579038+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:41.579038+0000","last_peered":"2024-04-20T10:50:41.579038+0000","last_clean":"2024-04-20T10:50:41.579038+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:41.579038+0000","last_undegraded":"2024-04-20T10:50:41.579038+0000","last_fullsized":"2024-04-20T10:50:41.579038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598649+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:40.598649+0000","last_peered":"2024-04-20T10:50:40.598649+0000","last_clean":"2024-04-20T10:50:40.598649+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:40.598649+0000","last_undegraded":"2024-04-20T10:50:40.598649+0000","last_fullsized":"2024-04-20T10:50:40.598649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:08:23.392468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580595+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:41.580595+0000","last_peered":"2024-04-20T10:50:41.580595+0000","last_clean":"2024-04-20T10:50:41.580595+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:41.580595+0000","last_undegraded":"2024-04-20T10:50:41.580595+0000","last_fullsized":"2024-04-20T10:50:41.580595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598392+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:40.598392+0000","last_peered":"2024-04-20T10:50:40.598392+0000","last_clean":"2024-04-20T10:50:40.598392+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:40.598392+0000","last_undegraded":"2024-04-20T10:50:40.598392+0000","last_fullsized":"2024-04-20T10:50:40.598392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:07:25.034028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580212+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:41.580212+0000","last_peered":"2024-04-20T10:50:41.580212+0000","last_clean":"2024-04-20T10:50:41.580212+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:41.580212+0000","last_undegraded":"2024-04-20T10:50:41.580212+0000","last_fullsized":"2024-04-20T10:50:41.580212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598362+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:40.598362+0000","last_peered":"2024-04-20T10:50:40.598362+0000","last_clean":"2024-04-20T10:50:40.598362+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:40.598362+0000","last_undegraded":"2024-04-20T10:50:40.598362+0000","last_fullsized":"2024-04-20T10:50:40.598362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:02:10.705266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612199+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:40.612199+0000","last_peered":"2024-04-20T10:50:40.612199+0000","last_clean":"2024-04-20T10:50:40.612199+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:40.612199+0000","last_undegraded":"2024-04-20T10:50:40.612199+0000","last_fullsized":"2024-04-20T10:50:40.612199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:53:08.893786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603274+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:40.603274+0000","last_peered":"2024-04-20T10:50:40.603274+0000","last_clean":"2024-04-20T10:50:40.603274+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:40.603274+0000","last_undegraded":"2024-04-20T10:50:40.603274+0000","last_fullsized":"2024-04-20T10:50:40.603274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:24:55.537924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593088+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:41.593088+0000","last_peered":"2024-04-20T10:50:41.593088+0000","last_clean":"2024-04-20T10:50:41.593088+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:41.593088+0000","last_undegraded":"2024-04-20T10:50:41.593088+0000","last_fullsized":"2024-04-20T10:50:41.593088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592895+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:41.592895+0000","last_peered":"2024-04-20T10:50:41.592895+0000","last_clean":"2024-04-20T10:50:41.592895+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:41.592895+0000","last_undegraded":"2024-04-20T10:50:41.592895+0000","last_fullsized":"2024-04-20T10:50:41.592895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601841+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:40.601841+0000","last_peered":"2024-04-20T10:50:40.601841+0000","last_clean":"2024-04-20T10:50:40.601841+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:40.601841+0000","last_undegraded":"2024-04-20T10:50:40.601841+0000","last_fullsized":"2024-04-20T10:50:40.601841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:41:36.990953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.611882+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:40.611882+0000","last_peered":"2024-04-20T10:50:40.611882+0000","last_clean":"2024-04-20T10:50:40.611882+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:40.611882+0000","last_undegraded":"2024-04-20T10:50:40.611882+0000","last_fullsized":"2024-04-20T10:50:40.611882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:14:12.230238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602666+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:40.602666+0000","last_peered":"2024-04-20T10:50:40.602666+0000","last_clean":"2024-04-20T10:50:40.602666+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:40.602666+0000","last_undegraded":"2024-04-20T10:50:40.602666+0000","last_fullsized":"2024-04-20T10:50:40.602666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:55:16.223669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578966+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:41.578966+0000","last_peered":"2024-04-20T10:50:41.578966+0000","last_clean":"2024-04-20T10:50:41.578966+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:41.578966+0000","last_undegraded":"2024-04-20T10:50:41.578966+0000","last_fullsized":"2024-04-20T10:50:41.578966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579942+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:41.579942+0000","last_peered":"2024-04-20T10:50:41.579942+0000","last_clean":"2024-04-20T10:50:41.579942+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:41.579942+0000","last_undegraded":"2024-04-20T10:50:41.579942+0000","last_fullsized":"2024-04-20T10:50:41.579942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580605+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:41.580605+0000","last_peered":"2024-04-20T10:50:41.580605+0000","last_clean":"2024-04-20T10:50:41.580605+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:41.580605+0000","last_undegraded":"2024-04-20T10:50:41.580605+0000","last_fullsized":"2024-04-20T10:50:41.580605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601341+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:40.601341+0000","last_peered":"2024-04-20T10:50:40.601341+0000","last_clean":"2024-04-20T10:50:40.601341+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:40.601341+0000","last_undegraded":"2024-04-20T10:50:40.601341+0000","last_fullsized":"2024-04-20T10:50:40.601341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:47:58.168181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610949+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:40.610949+0000","last_peered":"2024-04-20T10:50:40.610949+0000","last_clean":"2024-04-20T10:50:40.610949+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:40.610949+0000","last_undegraded":"2024-04-20T10:50:40.610949+0000","last_fullsized":"2024-04-20T10:50:40.610949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:15.812292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593175+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:41.593175+0000","last_peered":"2024-04-20T10:50:41.593175+0000","last_clean":"2024-04-20T10:50:41.593175+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:41.593175+0000","last_undegraded":"2024-04-20T10:50:41.593175+0000","last_fullsized":"2024-04-20T10:50:41.593175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603189+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:40.603189+0000","last_peered":"2024-04-20T10:50:40.603189+0000","last_clean":"2024-04-20T10:50:40.603189+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:40.603189+0000","last_undegraded":"2024-04-20T10:50:40.603189+0000","last_fullsized":"2024-04-20T10:50:40.603189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:56:25.798865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580405+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:41.580405+0000","last_peered":"2024-04-20T10:50:41.580405+0000","last_clean":"2024-04-20T10:50:41.580405+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:41.580405+0000","last_undegraded":"2024-04-20T10:50:41.580405+0000","last_fullsized":"2024-04-20T10:50:41.580405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.595987+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:40.595987+0000","last_peered":"2024-04-20T10:50:40.595987+0000","last_clean":"2024-04-20T10:50:40.595987+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:40.595987+0000","last_undegraded":"2024-04-20T10:50:40.595987+0000","last_fullsized":"2024-04-20T10:50:40.595987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:16.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580037+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:41.580037+0000","last_peered":"2024-04-20T10:50:41.580037+0000","last_clean":"2024-04-20T10:50:41.580037+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:41.580037+0000","last_undegraded":"2024-04-20T10:50:41.580037+0000","last_fullsized":"2024-04-20T10:50:41.580037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612144+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:40.612144+0000","last_peered":"2024-04-20T10:50:40.612144+0000","last_clean":"2024-04-20T10:50:40.612144+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:40.612144+0000","last_undegraded":"2024-04-20T10:50:40.612144+0000","last_fullsized":"2024-04-20T10:50:40.612144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:17:22.749774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593090+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:41.593090+0000","last_peered":"2024-04-20T10:50:41.593090+0000","last_clean":"2024-04-20T10:50:41.593090+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:41.593090+0000","last_undegraded":"2024-04-20T10:50:41.593090+0000","last_fullsized":"2024-04-20T10:50:41.593090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579020+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:41.579020+0000","last_peered":"2024-04-20T10:50:41.579020+0000","last_clean":"2024-04-20T10:50:41.579020+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:41.579020+0000","last_undegraded":"2024-04-20T10:50:41.579020+0000","last_fullsized":"2024-04-20T10:50:41.579020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612296+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:40.612296+0000","last_peered":"2024-04-20T10:50:40.612296+0000","last_clean":"2024-04-20T10:50:40.612296+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:40.612296+0000","last_undegraded":"2024-04-20T10:50:40.612296+0000","last_fullsized":"2024-04-20T10:50:40.612296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:27.773887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603267+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:40.603267+0000","last_peered":"2024-04-20T10:50:40.603267+0000","last_clean":"2024-04-20T10:50:40.603267+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:40.603267+0000","last_undegraded":"2024-04-20T10:50:40.603267+0000","last_fullsized":"2024-04-20T10:50:40.603267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:44.088684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580395+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:41.580395+0000","last_peered":"2024-04-20T10:50:41.580395+0000","last_clean":"2024-04-20T10:50:41.580395+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:41.580395+0000","last_undegraded":"2024-04-20T10:50:41.580395+0000","last_fullsized":"2024-04-20T10:50:41.580395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609258+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:40.609258+0000","last_peered":"2024-04-20T10:50:40.609258+0000","last_clean":"2024-04-20T10:50:40.609258+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:40.609258+0000","last_undegraded":"2024-04-20T10:50:40.609258+0000","last_fullsized":"2024-04-20T10:50:40.609258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:51.706862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592719+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:41.592719+0000","last_peered":"2024-04-20T10:50:41.592719+0000","last_clean":"2024-04-20T10:50:41.592719+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:41.592719+0000","last_undegraded":"2024-04-20T10:50:41.592719+0000","last_fullsized":"2024-04-20T10:50:41.592719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.585608+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:40.585608+0000","last_peered":"2024-04-20T10:50:40.585608+0000","last_clean":"2024-04-20T10:50:40.585608+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:40.585608+0000","last_undegraded":"2024-04-20T10:50:40.585608+0000","last_fullsized":"2024-04-20T10:50:40.585608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:14:19.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612058+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:40.612058+0000","last_peered":"2024-04-20T10:50:40.612058+0000","last_clean":"2024-04-20T10:50:40.612058+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:40.612058+0000","last_undegraded":"2024-04-20T10:50:40.612058+0000","last_fullsized":"2024-04-20T10:50:40.612058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603913+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:40.603913+0000","last_peered":"2024-04-20T10:50:40.603913+0000","last_clean":"2024-04-20T10:50:40.603913+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:40.603913+0000","last_undegraded":"2024-04-20T10:50:40.603913+0000","last_fullsized":"2024-04-20T10:50:40.603913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:18:29.198809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592939+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:41.592939+0000","last_peered":"2024-04-20T10:50:41.592939+0000","last_clean":"2024-04-20T10:50:41.592939+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:41.592939+0000","last_undegraded":"2024-04-20T10:50:41.592939+0000","last_fullsized":"2024-04-20T10:50:41.592939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.589083+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:40.589083+0000","last_peered":"2024-04-20T10:50:40.589083+0000","last_clean":"2024-04-20T10:50:40.589083+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:40.589083+0000","last_undegraded":"2024-04-20T10:50:40.589083+0000","last_fullsized":"2024-04-20T10:50:40.589083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609119+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:40.609119+0000","last_peered":"2024-04-20T10:50:40.609119+0000","last_clean":"2024-04-20T10:50:40.609119+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:40.609119+0000","last_undegraded":"2024-04-20T10:50:40.609119+0000","last_fullsized":"2024-04-20T10:50:40.609119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:05:59.300524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580145+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:41.580145+0000","last_peered":"2024-04-20T10:50:41.580145+0000","last_clean":"2024-04-20T10:50:41.580145+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:41.580145+0000","last_undegraded":"2024-04-20T10:50:41.580145+0000","last_fullsized":"2024-04-20T10:50:41.580145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578797+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:41.578797+0000","last_peered":"2024-04-20T10:50:41.578797+0000","last_clean":"2024-04-20T10:50:41.578797+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:41.578797+0000","last_undegraded":"2024-04-20T10:50:41.578797+0000","last_fullsized":"2024-04-20T10:50:41.578797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592996+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:41.592996+0000","last_peered":"2024-04-20T10:50:41.592996+0000","last_clean":"2024-04-20T10:50:41.592996+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:41.592996+0000","last_undegraded":"2024-04-20T10:50:41.592996+0000","last_fullsized":"2024-04-20T10:50:41.592996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580369+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:41.580369+0000","last_peered":"2024-04-20T10:50:41.580369+0000","last_clean":"2024-04-20T10:50:41.580369+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:41.580369+0000","last_undegraded":"2024-04-20T10:50:41.580369+0000","last_fullsized":"2024-04-20T10:50:41.580369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580466+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:41.580466+0000","last_peered":"2024-04-20T10:50:41.580466+0000","last_clean":"2024-04-20T10:50:41.580466+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:41.580466+0000","last_undegraded":"2024-04-20T10:50:41.580466+0000","last_fullsized":"2024-04-20T10:50:41.580466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603257+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:40.603257+0000","last_peered":"2024-04-20T10:50:40.603257+0000","last_clean":"2024-04-20T10:50:40.603257+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:40.603257+0000","last_undegraded":"2024-04-20T10:50:40.603257+0000","last_fullsized":"2024-04-20T10:50:40.603257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:42:48.417847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578964+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:41.578964+0000","last_peered":"2024-04-20T10:50:41.578964+0000","last_clean":"2024-04-20T10:50:41.578964+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:41.578964+0000","last_undegraded":"2024-04-20T10:50:41.578964+0000","last_fullsized":"2024-04-20T10:50:41.578964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602335+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:40.602335+0000","last_peered":"2024-04-20T10:50:40.602335+0000","last_clean":"2024-04-20T10:50:40.602335+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:40.602335+0000","last_undegraded":"2024-04-20T10:50:40.602335+0000","last_fullsized":"2024-04-20T10:50:40.602335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:15:39.493500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593151+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:50:41.593151+0000","last_peered":"2024-04-20T10:50:41.593151+0000","last_clean":"2024-04-20T10:50:41.593151+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:50:41.593151+0000","last_undegraded":"2024-04-20T10:50:41.593151+0000","last_fullsized":"2024-04-20T10:50:41.593151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598414+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:40.598414+0000","last_peered":"2024-04-20T10:50:40.598414+0000","last_clean":"2024-04-20T10:50:40.598414+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:40.598414+0000","last_undegraded":"2024-04-20T10:50:40.598414+0000","last_fullsized":"2024-04-20T10:50:40.598414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:10:38.929514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.608264+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:40.608264+0000","last_peered":"2024-04-20T10:50:40.608264+0000","last_clean":"2024-04-20T10:50:40.608264+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:40.608264+0000","last_undegraded":"2024-04-20T10:50:40.608264+0000","last_fullsized":"2024-04-20T10:50:40.608264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602700+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:40.602700+0000","last_peered":"2024-04-20T10:50:40.602700+0000","last_clean":"2024-04-20T10:50:40.602700+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:40.602700+0000","last_undegraded":"2024-04-20T10:50:40.602700+0000","last_fullsized":"2024-04-20T10:50:40.602700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:03:03.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580751+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:41.580751+0000","last_peered":"2024-04-20T10:50:41.580751+0000","last_clean":"2024-04-20T10:50:41.580751+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:41.580751+0000","last_undegraded":"2024-04-20T10:50:41.580751+0000","last_fullsized":"2024-04-20T10:50:41.580751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610889+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:40.610889+0000","last_peered":"2024-04-20T10:50:40.610889+0000","last_clean":"2024-04-20T10:50:40.610889+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:40.610889+0000","last_undegraded":"2024-04-20T10:50:40.610889+0000","last_fullsized":"2024-04-20T10:50:40.610889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:00:34.632356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592606+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:41.592606+0000","last_peered":"2024-04-20T10:50:41.592606+0000","last_clean":"2024-04-20T10:50:41.592606+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:41.592606+0000","last_undegraded":"2024-04-20T10:50:41.592606+0000","last_fullsized":"2024-04-20T10:50:41.592606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592753+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:41.592753+0000","last_peered":"2024-04-20T10:50:41.592753+0000","last_clean":"2024-04-20T10:50:41.592753+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:41.592753+0000","last_undegraded":"2024-04-20T10:50:41.592753+0000","last_fullsized":"2024-04-20T10:50:41.592753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603529+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:40.603529+0000","last_peered":"2024-04-20T10:50:40.603529+0000","last_clean":"2024-04-20T10:50:40.603529+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:40.603529+0000","last_undegraded":"2024-04-20T10:50:40.603529+0000","last_fullsized":"2024-04-20T10:50:40.603529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610790+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:40.610790+0000","last_peered":"2024-04-20T10:50:40.610790+0000","last_clean":"2024-04-20T10:50:40.610790+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:40.610790+0000","last_undegraded":"2024-04-20T10:50:40.610790+0000","last_fullsized":"2024-04-20T10:50:40.610790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:03:55.465136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.606156+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:40.606156+0000","last_peered":"2024-04-20T10:50:40.606156+0000","last_clean":"2024-04-20T10:50:40.606156+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:40.606156+0000","last_undegraded":"2024-04-20T10:50:40.606156+0000","last_fullsized":"2024-04-20T10:50:40.606156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.613446+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:40.613446+0000","last_peered":"2024-04-20T10:50:40.613446+0000","last_clean":"2024-04-20T10:50:40.613446+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:40.613446+0000","last_undegraded":"2024-04-20T10:50:40.613446+0000","last_fullsized":"2024-04-20T10:50:40.613446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:10.667256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612380+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:40.612380+0000","last_peered":"2024-04-20T10:50:40.612380+0000","last_clean":"2024-04-20T10:50:40.612380+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:40.612380+0000","last_undegraded":"2024-04-20T10:50:40.612380+0000","last_fullsized":"2024-04-20T10:50:40.612380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.613439+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:40.613439+0000","last_peered":"2024-04-20T10:50:40.613439+0000","last_clean":"2024-04-20T10:50:40.613439+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:40.613439+0000","last_undegraded":"2024-04-20T10:50:40.613439+0000","last_fullsized":"2024-04-20T10:50:40.613439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:26:27.289099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579067+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:41.579067+0000","last_peered":"2024-04-20T10:50:41.579067+0000","last_clean":"2024-04-20T10:50:41.579067+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:41.579067+0000","last_undegraded":"2024-04-20T10:50:41.579067+0000","last_fullsized":"2024-04-20T10:50:41.579067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580554+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:41.580554+0000","last_peered":"2024-04-20T10:50:41.580554+0000","last_clean":"2024-04-20T10:50:41.580554+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:41.580554+0000","last_undegraded":"2024-04-20T10:50:41.580554+0000","last_fullsized":"2024-04-20T10:50:41.580554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.586391+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:40.586391+0000","last_peered":"2024-04-20T10:50:40.586391+0000","last_clean":"2024-04-20T10:50:40.586391+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:40.586391+0000","last_undegraded":"2024-04-20T10:50:40.586391+0000","last_fullsized":"2024-04-20T10:50:40.586391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610929+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:40.610929+0000","last_peered":"2024-04-20T10:50:40.610929+0000","last_clean":"2024-04-20T10:50:40.610929+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:40.610929+0000","last_undegraded":"2024-04-20T10:50:40.610929+0000","last_fullsized":"2024-04-20T10:50:40.610929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:16:19.460042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.584290+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:40.584290+0000","last_peered":"2024-04-20T10:50:40.584290+0000","last_clean":"2024-04-20T10:50:40.584290+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:40.584290+0000","last_undegraded":"2024-04-20T10:50:40.584290+0000","last_fullsized":"2024-04-20T10:50:40.584290+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580428+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:41.580428+0000","last_peered":"2024-04-20T10:50:41.580428+0000","last_clean":"2024-04-20T10:50:41.580428+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:41.580428+0000","last_undegraded":"2024-04-20T10:50:41.580428+0000","last_fullsized":"2024-04-20T10:50:41.580428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612180+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:40.612180+0000","last_peered":"2024-04-20T10:50:40.612180+0000","last_clean":"2024-04-20T10:50:40.612180+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:40.612180+0000","last_undegraded":"2024-04-20T10:50:40.612180+0000","last_fullsized":"2024-04-20T10:50:40.612180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:51:06.500268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.584235+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:40.584235+0000","last_peered":"2024-04-20T10:50:40.584235+0000","last_clean":"2024-04-20T10:50:40.584235+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:40.584235+0000","last_undegraded":"2024-04-20T10:50:40.584235+0000","last_fullsized":"2024-04-20T10:50:40.584235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603370+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:40.603370+0000","last_peered":"2024-04-20T10:50:40.603370+0000","last_clean":"2024-04-20T10:50:40.603370+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:40.603370+0000","last_undegraded":"2024-04-20T10:50:40.603370+0000","last_fullsized":"2024-04-20T10:50:40.603370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:48:45.214102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.586591+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:40.586591+0000","last_peered":"2024-04-20T10:50:40.586591+0000","last_clean":"2024-04-20T10:50:40.586591+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:40.586591+0000","last_undegraded":"2024-04-20T10:50:40.586591+0000","last_fullsized":"2024-04-20T10:50:40.586591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578827+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:41.578827+0000","last_peered":"2024-04-20T10:50:41.578827+0000","last_clean":"2024-04-20T10:50:41.578827+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:41.578827+0000","last_undegraded":"2024-04-20T10:50:41.578827+0000","last_fullsized":"2024-04-20T10:50:41.578827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580736+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:41.580736+0000","last_peered":"2024-04-20T10:50:41.580736+0000","last_clean":"2024-04-20T10:50:41.580736+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:41.580736+0000","last_undegraded":"2024-04-20T10:50:41.580736+0000","last_fullsized":"2024-04-20T10:50:41.580736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601511+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:40.601511+0000","last_peered":"2024-04-20T10:50:40.601511+0000","last_clean":"2024-04-20T10:50:40.601511+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:40.601511+0000","last_undegraded":"2024-04-20T10:50:40.601511+0000","last_fullsized":"2024-04-20T10:50:40.601511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:42.296210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578848+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:41.578848+0000","last_peered":"2024-04-20T10:50:41.578848+0000","last_clean":"2024-04-20T10:50:41.578848+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:41.578848+0000","last_undegraded":"2024-04-20T10:50:41.578848+0000","last_fullsized":"2024-04-20T10:50:41.578848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580759+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:41.580759+0000","last_peered":"2024-04-20T10:50:41.580759+0000","last_clean":"2024-04-20T10:50:41.580759+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:41.580759+0000","last_undegraded":"2024-04-20T10:50:41.580759+0000","last_fullsized":"2024-04-20T10:50:41.580759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.586019+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:40.586019+0000","last_peered":"2024-04-20T10:50:40.586019+0000","last_clean":"2024-04-20T10:50:40.586019+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:40.586019+0000","last_undegraded":"2024-04-20T10:50:40.586019+0000","last_fullsized":"2024-04-20T10:50:40.586019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578871+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:41.578871+0000","last_peered":"2024-04-20T10:50:41.578871+0000","last_clean":"2024-04-20T10:50:41.578871+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:41.578871+0000","last_undegraded":"2024-04-20T10:50:41.578871+0000","last_fullsized":"2024-04-20T10:50:41.578871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.590155+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:41.590155+0000","last_peered":"2024-04-20T10:50:41.590155+0000","last_clean":"2024-04-20T10:50:41.590155+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:41.590155+0000","last_undegraded":"2024-04-20T10:50:41.590155+0000","last_fullsized":"2024-04-20T10:50:41.590155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609135+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:40.609135+0000","last_peered":"2024-04-20T10:50:40.609135+0000","last_clean":"2024-04-20T10:50:40.609135+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:40.609135+0000","last_undegraded":"2024-04-20T10:50:40.609135+0000","last_fullsized":"2024-04-20T10:50:40.609135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:00:24.794868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593052+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:41.593052+0000","last_peered":"2024-04-20T10:50:41.593052+0000","last_clean":"2024-04-20T10:50:41.593052+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:41.593052+0000","last_undegraded":"2024-04-20T10:50:41.593052+0000","last_fullsized":"2024-04-20T10:50:41.593052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602461+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:40.602461+0000","last_peered":"2024-04-20T10:50:40.602461+0000","last_clean":"2024-04-20T10:50:40.602461+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:40.602461+0000","last_undegraded":"2024-04-20T10:50:40.602461+0000","last_fullsized":"2024-04-20T10:50:40.602461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:13:31.265468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.584080+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:40.584080+0000","last_peered":"2024-04-20T10:50:40.584080+0000","last_clean":"2024-04-20T10:50:40.584080+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:40.584080+0000","last_undegraded":"2024-04-20T10:50:40.584080+0000","last_fullsized":"2024-04-20T10:50:40.584080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601490+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:40.601490+0000","last_peered":"2024-04-20T10:50:40.601490+0000","last_clean":"2024-04-20T10:50:40.601490+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:40.601490+0000","last_undegraded":"2024-04-20T10:50:40.601490+0000","last_fullsized":"2024-04-20T10:50:40.601490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:52:53.272692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578887+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:41.578887+0000","last_peered":"2024-04-20T10:50:41.578887+0000","last_clean":"2024-04-20T10:50:41.578887+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:41.578887+0000","last_undegraded":"2024-04-20T10:50:41.578887+0000","last_fullsized":"2024-04-20T10:50:41.578887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609225+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:40.609225+0000","last_peered":"2024-04-20T10:50:40.609225+0000","last_clean":"2024-04-20T10:50:40.609225+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:40.609225+0000","last_undegraded":"2024-04-20T10:50:40.609225+0000","last_fullsized":"2024-04-20T10:50:40.609225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:41:06.166058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578921+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:41.578921+0000","last_peered":"2024-04-20T10:50:41.578921+0000","last_clean":"2024-04-20T10:50:41.578921+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:41.578921+0000","last_undegraded":"2024-04-20T10:50:41.578921+0000","last_fullsized":"2024-04-20T10:50:41.578921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609256+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:40.609256+0000","last_peered":"2024-04-20T10:50:40.609256+0000","last_clean":"2024-04-20T10:50:40.609256+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:40.609256+0000","last_undegraded":"2024-04-20T10:50:40.609256+0000","last_fullsized":"2024-04-20T10:50:40.609256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:58:26.901499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.611236+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:40.611236+0000","last_peered":"2024-04-20T10:50:40.611236+0000","last_clean":"2024-04-20T10:50:40.611236+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:40.611236+0000","last_undegraded":"2024-04-20T10:50:40.611236+0000","last_fullsized":"2024-04-20T10:50:40.611236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592711+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:41.592711+0000","last_peered":"2024-04-20T10:50:41.592711+0000","last_clean":"2024-04-20T10:50:41.592711+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:41.592711+0000","last_undegraded":"2024-04-20T10:50:41.592711+0000","last_fullsized":"2024-04-20T10:50:41.592711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580594+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:41.580594+0000","last_peered":"2024-04-20T10:50:41.580594+0000","last_clean":"2024-04-20T10:50:41.580594+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:41.580594+0000","last_undegraded":"2024-04-20T10:50:41.580594+0000","last_fullsized":"2024-04-20T10:50:41.580594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.613759+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:40.613759+0000","last_peered":"2024-04-20T10:50:40.613759+0000","last_clean":"2024-04-20T10:50:40.613759+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:40.613759+0000","last_undegraded":"2024-04-20T10:50:40.613759+0000","last_fullsized":"2024-04-20T10:50:40.613759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580344+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:41.580344+0000","last_peered":"2024-04-20T10:50:41.580344+0000","last_clean":"2024-04-20T10:50:41.580344+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:41.580344+0000","last_undegraded":"2024-04-20T10:50:41.580344+0000","last_fullsized":"2024-04-20T10:50:41.580344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610704+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:40.610704+0000","last_peered":"2024-04-20T10:50:40.610704+0000","last_clean":"2024-04-20T10:50:40.610704+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:40.610704+0000","last_undegraded":"2024-04-20T10:50:40.610704+0000","last_fullsized":"2024-04-20T10:50:40.610704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609192+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:40.609192+0000","last_peered":"2024-04-20T10:50:40.609192+0000","last_clean":"2024-04-20T10:50:40.609192+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:40.609192+0000","last_undegraded":"2024-04-20T10:50:40.609192+0000","last_fullsized":"2024-04-20T10:50:40.609192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:17:20.763141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612077+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:40.612077+0000","last_peered":"2024-04-20T10:50:40.612077+0000","last_clean":"2024-04-20T10:50:40.612077+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:40.612077+0000","last_undegraded":"2024-04-20T10:50:40.612077+0000","last_fullsized":"2024-04-20T10:50:40.612077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612047+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:40.612047+0000","last_peered":"2024-04-20T10:50:40.612047+0000","last_clean":"2024-04-20T10:50:40.612047+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:40.612047+0000","last_undegraded":"2024-04-20T10:50:40.612047+0000","last_fullsized":"2024-04-20T10:50:40.612047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:52:10.954745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.611044+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:40.611044+0000","last_peered":"2024-04-20T10:50:40.611044+0000","last_clean":"2024-04-20T10:50:40.611044+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:40.611044+0000","last_undegraded":"2024-04-20T10:50:40.611044+0000","last_fullsized":"2024-04-20T10:50:40.611044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":660200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:50:44.573 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:50:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.670+0000 7fdaeb323640 1 Processor -- start 2024-04-20T10:50:44.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.670+0000 7fdaeb323640 1 -- start start 2024-04-20T10:50:44.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdaeb323640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae4153ee0 0x7fdae4157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdaeb323640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdae406c4d0 0x7fdae406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdaeb323640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdae40adce0 con 0x7fdae40ab710 2024-04-20T10:50:44.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdaeb323640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdae40adfc0 con 0x7fdae406c4d0 2024-04-20T10:50:44.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdaeb323640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdae40ae2a0 con 0x7fdae4153ee0 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae90bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae4153ee0 0x7fdae4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae98c0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdae406c4d0 0x7fdae406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae90bf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae4153ee0 0x7fdae4157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:36636/0 (socket says 172.21.15.90:36636) 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae90bf640 1 -- 172.21.15.90:0/4013694433 learned_addr learned my addr 172.21.15.90:0/4013694433 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae88be640 1 --1- 172.21.15.90:0/4013694433 >> v1:172.21.15.175:6789/0 conn(0x7fdae40ab710 0x7fdae40c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:43378/0 (socket says 172.21.15.90:43378) 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae90bf640 1 -- 172.21.15.90:0/4013694433 >> v2:172.21.15.175:3300/0 conn(0x7fdae406c4d0 msgr2=0x7fdae406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae90bf640 1 --2- 172.21.15.90:0/4013694433 >> v2:172.21.15.175:3300/0 conn(0x7fdae406c4d0 0x7fdae406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae90bf640 1 -- 172.21.15.90:0/4013694433 >> v1:172.21.15.175:6789/0 conn(0x7fdae40ab710 legacy=0x7fdae40c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae90bf640 1 -- 172.21.15.90:0/4013694433 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae40c70f0 con 0x7fdae4153ee0 2024-04-20T10:50:44.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.671+0000 7fdae98c0640 1 --2- 172.21.15.90:0/4013694433 >> v2:172.21.15.175:3300/0 conn(0x7fdae406c4d0 0x7fdae406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.672+0000 7fdae90bf640 1 --2- 172.21.15.90:0/4013694433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae4153ee0 0x7fdae4157190 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009870 tx=0x7fdae002b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a7d1084a79c38dd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.672+0000 7fdadbfff640 1 -- 172.21.15.90:0/4013694433 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae00317c0 con 0x7fdae4153ee0 2024-04-20T10:50:44.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.672+0000 7fdadbfff640 1 -- 172.21.15.90:0/4013694433 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae0037070 con 0x7fdae4153ee0 2024-04-20T10:50:44.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.672+0000 7fdadbfff640 1 -- 172.21.15.90:0/4013694433 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0031b80 con 0x7fdae4153ee0 2024-04-20T10:50:44.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 -- 172.21.15.90:0/4013694433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae4153ee0 msgr2=0x7fdae4157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 --2- 172.21.15.90:0/4013694433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae4153ee0 0x7fdae4157190 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdae0009870 tx=0x7fdae002b860 comp rx=0 tx=0).stop 2024-04-20T10:50:44.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 -- 172.21.15.90:0/4013694433 shutdown_connections 2024-04-20T10:50:44.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 --2- 172.21.15.90:0/4013694433 >> v2:172.21.15.175:3300/0 conn(0x7fdae406c4d0 0x7fdae406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 --2- 172.21.15.90:0/4013694433 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae4153ee0 0x7fdae4157190 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 -- 172.21.15.90:0/4013694433 >> 172.21.15.90:0/4013694433 conn(0x7fdae40cc060 msgr2=0x7fdae40cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:44.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 -- 172.21.15.90:0/4013694433 shutdown_connections 2024-04-20T10:50:44.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.673+0000 7fdaeb323640 1 -- 172.21.15.90:0/4013694433 wait complete. 2024-04-20T10:50:44.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.674+0000 7fdaeb323640 1 Processor -- start 2024-04-20T10:50:44.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.674+0000 7fdaeb323640 1 -- start start 2024-04-20T10:50:44.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdaeb323640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae406c4d0 0x7fdae40c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdaeb323640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae40ab710 0x7fdae4158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdaeb323640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae4153ee0 0x7fdae41ec100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdaeb323640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdae406cfe0 con 0x7fdae406c4d0 2024-04-20T10:50:44.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdaeb323640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdae406ce60 con 0x7fdae4153ee0 2024-04-20T10:50:44.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdaeb323640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdae406d160 con 0x7fdae40ab710 2024-04-20T10:50:44.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae406c4d0 0x7fdae40c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae406c4d0 0x7fdae40c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54324/0 (socket says 172.21.15.90:54324) 2024-04-20T10:50:44.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 -- 172.21.15.90:0/3487245070 learned_addr learned my addr 172.21.15.90:0/3487245070 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:44.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae88be640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae40ab710 0x7fdae4158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae98c0640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae4153ee0 0x7fdae41ec100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 -- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae40ab710 msgr2=0x7fdae4158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae40ab710 0x7fdae4158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 -- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae4153ee0 msgr2=0x7fdae41ec100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae4153ee0 0x7fdae41ec100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 -- 172.21.15.90:0/3487245070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdae41577c0 con 0x7fdae406c4d0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdae90bf640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae406c4d0 0x7fdae40c4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdae002b8a0 tx=0x7fdae00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdad9ffb640 1 -- 172.21.15.90:0/3487245070 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0032650 con 0x7fdae406c4d0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdad9ffb640 1 -- 172.21.15.90:0/3487245070 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdae0032830 con 0x7fdae406c4d0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdae4157aa0 con 0x7fdae406c4d0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.675+0000 7fdad9ffb640 1 -- 172.21.15.90:0/3487245070 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae0032c20 con 0x7fdae406c4d0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.676+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdae40c1410 con 0x7fdae406c4d0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.677+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdae4157c70 con 0x7fdae406c4d0 2024-04-20T10:50:44.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.677+0000 7fdad9ffb640 1 -- 172.21.15.90:0/3487245070 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdae004c060 con 0x7fdae406c4d0 2024-04-20T10:50:44.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.677+0000 7fdad9ffb640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdac806c8f0 0x7fdac806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:44.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.678+0000 7fdae88be640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdac806c8f0 0x7fdac806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:44.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.678+0000 7fdad9ffb640 1 -- 172.21.15.90:0/3487245070 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fdae00ad010 con 0x7fdae406c4d0 2024-04-20T10:50:44.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.678+0000 7fdae88be640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdac806c8f0 0x7fdac806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdae40c0ce0 tx=0x7fdad4007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:44.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.682+0000 7fdad9ffb640 1 -- 172.21.15.90:0/3487245070 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdae0040070 con 0x7fdae406c4d0 2024-04-20T10:50:44.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.852+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdae4076150 con 0x7fdac806c8f0 2024-04-20T10:50:44.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.857+0000 7fdad9ffb640 1 -- 172.21.15.90:0/3487245070 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251904 (secure 0 0 0) 0x7fdae4076150 con 0x7fdac806c8f0 2024-04-20T10:50:44.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:44.867 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdac806c8f0 msgr2=0x7fdac806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdac806c8f0 0x7fdac806edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdae40c0ce0 tx=0x7fdad4007e80 comp rx=0 tx=0).stop 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae406c4d0 msgr2=0x7fdae40c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae406c4d0 0x7fdae40c4e10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdae002b8a0 tx=0x7fdae00046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 shutdown_connections 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdac806c8f0 0x7fdac806edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdae4153ee0 0x7fdae41ec100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdae40ab710 0x7fdae4158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 --2- 172.21.15.90:0/3487245070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdae406c4d0 0x7fdae40c4e10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 >> 172.21.15.90:0/3487245070 conn(0x7fdae40cc060 msgr2=0x7fdae41565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 shutdown_connections 2024-04-20T10:50:44.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:44.860+0000 7fdaeb323640 1 -- 172.21.15.90:0/3487245070 wait complete. 2024-04-20T10:50:44.873 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-20T10:50:43.663899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":77,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218984,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755736,"statfs":{"total":773094113280,"available":772869873664,"internally_reserved":0,"allocated":2891776,"data_stored":1739556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.104178"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.600570+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:40.600570+0000","last_peered":"2024-04-20T10:50:40.600570+0000","last_clean":"2024-04-20T10:50:40.600570+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:40.600570+0000","last_undegraded":"2024-04-20T10:50:40.600570+0000","last_fullsized":"2024-04-20T10:50:40.600570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:10.650093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579038+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:41.579038+0000","last_peered":"2024-04-20T10:50:41.579038+0000","last_clean":"2024-04-20T10:50:41.579038+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:41.579038+0000","last_undegraded":"2024-04-20T10:50:41.579038+0000","last_fullsized":"2024-04-20T10:50:41.579038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598649+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:40.598649+0000","last_peered":"2024-04-20T10:50:40.598649+0000","last_clean":"2024-04-20T10:50:40.598649+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:40.598649+0000","last_undegraded":"2024-04-20T10:50:40.598649+0000","last_fullsized":"2024-04-20T10:50:40.598649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:08:23.392468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580595+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:41.580595+0000","last_peered":"2024-04-20T10:50:41.580595+0000","last_clean":"2024-04-20T10:50:41.580595+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:41.580595+0000","last_undegraded":"2024-04-20T10:50:41.580595+0000","last_fullsized":"2024-04-20T10:50:41.580595+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598392+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:40.598392+0000","last_peered":"2024-04-20T10:50:40.598392+0000","last_clean":"2024-04-20T10:50:40.598392+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:40.598392+0000","last_undegraded":"2024-04-20T10:50:40.598392+0000","last_fullsized":"2024-04-20T10:50:40.598392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:07:25.034028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580212+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:41.580212+0000","last_peered":"2024-04-20T10:50:41.580212+0000","last_clean":"2024-04-20T10:50:41.580212+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:41.580212+0000","last_undegraded":"2024-04-20T10:50:41.580212+0000","last_fullsized":"2024-04-20T10:50:41.580212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598362+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:40.598362+0000","last_peered":"2024-04-20T10:50:40.598362+0000","last_clean":"2024-04-20T10:50:40.598362+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:40.598362+0000","last_undegraded":"2024-04-20T10:50:40.598362+0000","last_fullsized":"2024-04-20T10:50:40.598362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:02:10.705266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612199+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:40.612199+0000","last_peered":"2024-04-20T10:50:40.612199+0000","last_clean":"2024-04-20T10:50:40.612199+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:40.612199+0000","last_undegraded":"2024-04-20T10:50:40.612199+0000","last_fullsized":"2024-04-20T10:50:40.612199+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:53:08.893786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603274+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:40.603274+0000","last_peered":"2024-04-20T10:50:40.603274+0000","last_clean":"2024-04-20T10:50:40.603274+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:40.603274+0000","last_undegraded":"2024-04-20T10:50:40.603274+0000","last_fullsized":"2024-04-20T10:50:40.603274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:24:55.537924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593088+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:41.593088+0000","last_peered":"2024-04-20T10:50:41.593088+0000","last_clean":"2024-04-20T10:50:41.593088+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:41.593088+0000","last_undegraded":"2024-04-20T10:50:41.593088+0000","last_fullsized":"2024-04-20T10:50:41.593088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592895+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:41.592895+0000","last_peered":"2024-04-20T10:50:41.592895+0000","last_clean":"2024-04-20T10:50:41.592895+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:41.592895+0000","last_undegraded":"2024-04-20T10:50:41.592895+0000","last_fullsized":"2024-04-20T10:50:41.592895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601841+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:40.601841+0000","last_peered":"2024-04-20T10:50:40.601841+0000","last_clean":"2024-04-20T10:50:40.601841+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:40.601841+0000","last_undegraded":"2024-04-20T10:50:40.601841+0000","last_fullsized":"2024-04-20T10:50:40.601841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:41:36.990953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.611882+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:40.611882+0000","last_peered":"2024-04-20T10:50:40.611882+0000","last_clean":"2024-04-20T10:50:40.611882+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:40.611882+0000","last_undegraded":"2024-04-20T10:50:40.611882+0000","last_fullsized":"2024-04-20T10:50:40.611882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:14:12.230238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602666+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:40.602666+0000","last_peered":"2024-04-20T10:50:40.602666+0000","last_clean":"2024-04-20T10:50:40.602666+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:40.602666+0000","last_undegraded":"2024-04-20T10:50:40.602666+0000","last_fullsized":"2024-04-20T10:50:40.602666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:55:16.223669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578966+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:41.578966+0000","last_peered":"2024-04-20T10:50:41.578966+0000","last_clean":"2024-04-20T10:50:41.578966+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:41.578966+0000","last_undegraded":"2024-04-20T10:50:41.578966+0000","last_fullsized":"2024-04-20T10:50:41.578966+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579942+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:41.579942+0000","last_peered":"2024-04-20T10:50:41.579942+0000","last_clean":"2024-04-20T10:50:41.579942+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:41.579942+0000","last_undegraded":"2024-04-20T10:50:41.579942+0000","last_fullsized":"2024-04-20T10:50:41.579942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580605+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:41.580605+0000","last_peered":"2024-04-20T10:50:41.580605+0000","last_clean":"2024-04-20T10:50:41.580605+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:41.580605+0000","last_undegraded":"2024-04-20T10:50:41.580605+0000","last_fullsized":"2024-04-20T10:50:41.580605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601341+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:40.601341+0000","last_peered":"2024-04-20T10:50:40.601341+0000","last_clean":"2024-04-20T10:50:40.601341+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:40.601341+0000","last_undegraded":"2024-04-20T10:50:40.601341+0000","last_fullsized":"2024-04-20T10:50:40.601341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:47:58.168181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610949+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:40.610949+0000","last_peered":"2024-04-20T10:50:40.610949+0000","last_clean":"2024-04-20T10:50:40.610949+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:40.610949+0000","last_undegraded":"2024-04-20T10:50:40.610949+0000","last_fullsized":"2024-04-20T10:50:40.610949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:15.812292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593175+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:41.593175+0000","last_peered":"2024-04-20T10:50:41.593175+0000","last_clean":"2024-04-20T10:50:41.593175+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:41.593175+0000","last_undegraded":"2024-04-20T10:50:41.593175+0000","last_fullsized":"2024-04-20T10:50:41.593175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603189+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:40.603189+0000","last_peered":"2024-04-20T10:50:40.603189+0000","last_clean":"2024-04-20T10:50:40.603189+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:40.603189+0000","last_undegraded":"2024-04-20T10:50:40.603189+0000","last_fullsized":"2024-04-20T10:50:40.603189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:56:25.798865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580405+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:41.580405+0000","last_peered":"2024-04-20T10:50:41.580405+0000","last_clean":"2024-04-20T10:50:41.580405+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:41.580405+0000","last_undegraded":"2024-04-20T10:50:41.580405+0000","last_fullsized":"2024-04-20T10:50:41.580405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.595987+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:40.595987+0000","last_peered":"2024-04-20T10:50:40.595987+0000","last_clean":"2024-04-20T10:50:40.595987+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:40.595987+0000","last_undegraded":"2024-04-20T10:50:40.595987+0000","last_fullsized":"2024-04-20T10:50:40.595987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:16.842784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580037+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:41.580037+0000","last_peered":"2024-04-20T10:50:41.580037+0000","last_clean":"2024-04-20T10:50:41.580037+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:41.580037+0000","last_undegraded":"2024-04-20T10:50:41.580037+0000","last_fullsized":"2024-04-20T10:50:41.580037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612144+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:40.612144+0000","last_peered":"2024-04-20T10:50:40.612144+0000","last_clean":"2024-04-20T10:50:40.612144+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:40.612144+0000","last_undegraded":"2024-04-20T10:50:40.612144+0000","last_fullsized":"2024-04-20T10:50:40.612144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:17:22.749774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593090+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:41.593090+0000","last_peered":"2024-04-20T10:50:41.593090+0000","last_clean":"2024-04-20T10:50:41.593090+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:41.593090+0000","last_undegraded":"2024-04-20T10:50:41.593090+0000","last_fullsized":"2024-04-20T10:50:41.593090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579020+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:41.579020+0000","last_peered":"2024-04-20T10:50:41.579020+0000","last_clean":"2024-04-20T10:50:41.579020+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:41.579020+0000","last_undegraded":"2024-04-20T10:50:41.579020+0000","last_fullsized":"2024-04-20T10:50:41.579020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612296+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:40.612296+0000","last_peered":"2024-04-20T10:50:40.612296+0000","last_clean":"2024-04-20T10:50:40.612296+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:40.612296+0000","last_undegraded":"2024-04-20T10:50:40.612296+0000","last_fullsized":"2024-04-20T10:50:40.612296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:27.773887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603267+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:40.603267+0000","last_peered":"2024-04-20T10:50:40.603267+0000","last_clean":"2024-04-20T10:50:40.603267+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:40.603267+0000","last_undegraded":"2024-04-20T10:50:40.603267+0000","last_fullsized":"2024-04-20T10:50:40.603267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:44.088684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580395+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:41.580395+0000","last_peered":"2024-04-20T10:50:41.580395+0000","last_clean":"2024-04-20T10:50:41.580395+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:41.580395+0000","last_undegraded":"2024-04-20T10:50:41.580395+0000","last_fullsized":"2024-04-20T10:50:41.580395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609258+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:40.609258+0000","last_peered":"2024-04-20T10:50:40.609258+0000","last_clean":"2024-04-20T10:50:40.609258+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:40.609258+0000","last_undegraded":"2024-04-20T10:50:40.609258+0000","last_fullsized":"2024-04-20T10:50:40.609258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:51.706862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592719+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:41.592719+0000","last_peered":"2024-04-20T10:50:41.592719+0000","last_clean":"2024-04-20T10:50:41.592719+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:41.592719+0000","last_undegraded":"2024-04-20T10:50:41.592719+0000","last_fullsized":"2024-04-20T10:50:41.592719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.585608+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:40.585608+0000","last_peered":"2024-04-20T10:50:40.585608+0000","last_clean":"2024-04-20T10:50:40.585608+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:40.585608+0000","last_undegraded":"2024-04-20T10:50:40.585608+0000","last_fullsized":"2024-04-20T10:50:40.585608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:14:19.126271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612058+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:40.612058+0000","last_peered":"2024-04-20T10:50:40.612058+0000","last_clean":"2024-04-20T10:50:40.612058+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:40.612058+0000","last_undegraded":"2024-04-20T10:50:40.612058+0000","last_fullsized":"2024-04-20T10:50:40.612058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603913+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:40.603913+0000","last_peered":"2024-04-20T10:50:40.603913+0000","last_clean":"2024-04-20T10:50:40.603913+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:40.603913+0000","last_undegraded":"2024-04-20T10:50:40.603913+0000","last_fullsized":"2024-04-20T10:50:40.603913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:18:29.198809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592939+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:41.592939+0000","last_peered":"2024-04-20T10:50:41.592939+0000","last_clean":"2024-04-20T10:50:41.592939+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:41.592939+0000","last_undegraded":"2024-04-20T10:50:41.592939+0000","last_fullsized":"2024-04-20T10:50:41.592939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.589083+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:40.589083+0000","last_peered":"2024-04-20T10:50:40.589083+0000","last_clean":"2024-04-20T10:50:40.589083+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:40.589083+0000","last_undegraded":"2024-04-20T10:50:40.589083+0000","last_fullsized":"2024-04-20T10:50:40.589083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609119+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:40.609119+0000","last_peered":"2024-04-20T10:50:40.609119+0000","last_clean":"2024-04-20T10:50:40.609119+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:40.609119+0000","last_undegraded":"2024-04-20T10:50:40.609119+0000","last_fullsized":"2024-04-20T10:50:40.609119+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:05:59.300524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580145+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:41.580145+0000","last_peered":"2024-04-20T10:50:41.580145+0000","last_clean":"2024-04-20T10:50:41.580145+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:41.580145+0000","last_undegraded":"2024-04-20T10:50:41.580145+0000","last_fullsized":"2024-04-20T10:50:41.580145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578797+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:41.578797+0000","last_peered":"2024-04-20T10:50:41.578797+0000","last_clean":"2024-04-20T10:50:41.578797+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:41.578797+0000","last_undegraded":"2024-04-20T10:50:41.578797+0000","last_fullsized":"2024-04-20T10:50:41.578797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592996+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:41.592996+0000","last_peered":"2024-04-20T10:50:41.592996+0000","last_clean":"2024-04-20T10:50:41.592996+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:41.592996+0000","last_undegraded":"2024-04-20T10:50:41.592996+0000","last_fullsized":"2024-04-20T10:50:41.592996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580369+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:41.580369+0000","last_peered":"2024-04-20T10:50:41.580369+0000","last_clean":"2024-04-20T10:50:41.580369+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:41.580369+0000","last_undegraded":"2024-04-20T10:50:41.580369+0000","last_fullsized":"2024-04-20T10:50:41.580369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580466+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:41.580466+0000","last_peered":"2024-04-20T10:50:41.580466+0000","last_clean":"2024-04-20T10:50:41.580466+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:41.580466+0000","last_undegraded":"2024-04-20T10:50:41.580466+0000","last_fullsized":"2024-04-20T10:50:41.580466+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603257+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:40.603257+0000","last_peered":"2024-04-20T10:50:40.603257+0000","last_clean":"2024-04-20T10:50:40.603257+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:40.603257+0000","last_undegraded":"2024-04-20T10:50:40.603257+0000","last_fullsized":"2024-04-20T10:50:40.603257+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:42:48.417847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":17,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578964+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:41.578964+0000","last_peered":"2024-04-20T10:50:41.578964+0000","last_clean":"2024-04-20T10:50:41.578964+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:41.578964+0000","last_undegraded":"2024-04-20T10:50:41.578964+0000","last_fullsized":"2024-04-20T10:50:41.578964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602335+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:40.602335+0000","last_peered":"2024-04-20T10:50:40.602335+0000","last_clean":"2024-04-20T10:50:40.602335+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:40.602335+0000","last_undegraded":"2024-04-20T10:50:40.602335+0000","last_fullsized":"2024-04-20T10:50:40.602335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:15:39.493500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593151+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:50:41.593151+0000","last_peered":"2024-04-20T10:50:41.593151+0000","last_clean":"2024-04-20T10:50:41.593151+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:50:41.593151+0000","last_undegraded":"2024-04-20T10:50:41.593151+0000","last_fullsized":"2024-04-20T10:50:41.593151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.598414+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:40.598414+0000","last_peered":"2024-04-20T10:50:40.598414+0000","last_clean":"2024-04-20T10:50:40.598414+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:40.598414+0000","last_undegraded":"2024-04-20T10:50:40.598414+0000","last_fullsized":"2024-04-20T10:50:40.598414+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:10:38.929514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.608264+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:40.608264+0000","last_peered":"2024-04-20T10:50:40.608264+0000","last_clean":"2024-04-20T10:50:40.608264+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:40.608264+0000","last_undegraded":"2024-04-20T10:50:40.608264+0000","last_fullsized":"2024-04-20T10:50:40.608264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602700+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:40.602700+0000","last_peered":"2024-04-20T10:50:40.602700+0000","last_clean":"2024-04-20T10:50:40.602700+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:40.602700+0000","last_undegraded":"2024-04-20T10:50:40.602700+0000","last_fullsized":"2024-04-20T10:50:40.602700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:03:03.879935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580751+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:41.580751+0000","last_peered":"2024-04-20T10:50:41.580751+0000","last_clean":"2024-04-20T10:50:41.580751+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:41.580751+0000","last_undegraded":"2024-04-20T10:50:41.580751+0000","last_fullsized":"2024-04-20T10:50:41.580751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610889+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:40.610889+0000","last_peered":"2024-04-20T10:50:40.610889+0000","last_clean":"2024-04-20T10:50:40.610889+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:40.610889+0000","last_undegraded":"2024-04-20T10:50:40.610889+0000","last_fullsized":"2024-04-20T10:50:40.610889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:00:34.632356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592606+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:41.592606+0000","last_peered":"2024-04-20T10:50:41.592606+0000","last_clean":"2024-04-20T10:50:41.592606+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:41.592606+0000","last_undegraded":"2024-04-20T10:50:41.592606+0000","last_fullsized":"2024-04-20T10:50:41.592606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592753+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:41.592753+0000","last_peered":"2024-04-20T10:50:41.592753+0000","last_clean":"2024-04-20T10:50:41.592753+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:41.592753+0000","last_undegraded":"2024-04-20T10:50:41.592753+0000","last_fullsized":"2024-04-20T10:50:41.592753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603529+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:40.603529+0000","last_peered":"2024-04-20T10:50:40.603529+0000","last_clean":"2024-04-20T10:50:40.603529+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:40.603529+0000","last_undegraded":"2024-04-20T10:50:40.603529+0000","last_fullsized":"2024-04-20T10:50:40.603529+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610790+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:40.610790+0000","last_peered":"2024-04-20T10:50:40.610790+0000","last_clean":"2024-04-20T10:50:40.610790+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:40.610790+0000","last_undegraded":"2024-04-20T10:50:40.610790+0000","last_fullsized":"2024-04-20T10:50:40.610790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:03:55.465136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.606156+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:40.606156+0000","last_peered":"2024-04-20T10:50:40.606156+0000","last_clean":"2024-04-20T10:50:40.606156+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:40.606156+0000","last_undegraded":"2024-04-20T10:50:40.606156+0000","last_fullsized":"2024-04-20T10:50:40.606156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.613446+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:40.613446+0000","last_peered":"2024-04-20T10:50:40.613446+0000","last_clean":"2024-04-20T10:50:40.613446+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:40.613446+0000","last_undegraded":"2024-04-20T10:50:40.613446+0000","last_fullsized":"2024-04-20T10:50:40.613446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:10.667256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612380+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:40.612380+0000","last_peered":"2024-04-20T10:50:40.612380+0000","last_clean":"2024-04-20T10:50:40.612380+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:40.612380+0000","last_undegraded":"2024-04-20T10:50:40.612380+0000","last_fullsized":"2024-04-20T10:50:40.612380+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.613439+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:40.613439+0000","last_peered":"2024-04-20T10:50:40.613439+0000","last_clean":"2024-04-20T10:50:40.613439+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:40.613439+0000","last_undegraded":"2024-04-20T10:50:40.613439+0000","last_fullsized":"2024-04-20T10:50:40.613439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:26:27.289099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.579067+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:41.579067+0000","last_peered":"2024-04-20T10:50:41.579067+0000","last_clean":"2024-04-20T10:50:41.579067+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:41.579067+0000","last_undegraded":"2024-04-20T10:50:41.579067+0000","last_fullsized":"2024-04-20T10:50:41.579067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580554+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:41.580554+0000","last_peered":"2024-04-20T10:50:41.580554+0000","last_clean":"2024-04-20T10:50:41.580554+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:41.580554+0000","last_undegraded":"2024-04-20T10:50:41.580554+0000","last_fullsized":"2024-04-20T10:50:41.580554+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.586391+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:40.586391+0000","last_peered":"2024-04-20T10:50:40.586391+0000","last_clean":"2024-04-20T10:50:40.586391+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:40.586391+0000","last_undegraded":"2024-04-20T10:50:40.586391+0000","last_fullsized":"2024-04-20T10:50:40.586391+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610929+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:40.610929+0000","last_peered":"2024-04-20T10:50:40.610929+0000","last_clean":"2024-04-20T10:50:40.610929+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:40.610929+0000","last_undegraded":"2024-04-20T10:50:40.610929+0000","last_fullsized":"2024-04-20T10:50:40.610929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:16:19.460042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":168,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.584290+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:40.584290+0000","last_peered":"2024-04-20T10:50:40.584290+0000","last_clean":"2024-04-20T10:50:40.584290+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:40.584290+0000","last_undegraded":"2024-04-20T10:50:40.584290+0000","last_fullsized":"2024-04-20T10:50:40.584290+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580428+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:41.580428+0000","last_peered":"2024-04-20T10:50:41.580428+0000","last_clean":"2024-04-20T10:50:41.580428+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:41.580428+0000","last_undegraded":"2024-04-20T10:50:41.580428+0000","last_fullsized":"2024-04-20T10:50:41.580428+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612180+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:40.612180+0000","last_peered":"2024-04-20T10:50:40.612180+0000","last_clean":"2024-04-20T10:50:40.612180+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:40.612180+0000","last_undegraded":"2024-04-20T10:50:40.612180+0000","last_fullsized":"2024-04-20T10:50:40.612180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:51:06.500268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.584235+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:40.584235+0000","last_peered":"2024-04-20T10:50:40.584235+0000","last_clean":"2024-04-20T10:50:40.584235+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:40.584235+0000","last_undegraded":"2024-04-20T10:50:40.584235+0000","last_fullsized":"2024-04-20T10:50:40.584235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.603370+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:40.603370+0000","last_peered":"2024-04-20T10:50:40.603370+0000","last_clean":"2024-04-20T10:50:40.603370+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:40.603370+0000","last_undegraded":"2024-04-20T10:50:40.603370+0000","last_fullsized":"2024-04-20T10:50:40.603370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:48:45.214102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.586591+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:40.586591+0000","last_peered":"2024-04-20T10:50:40.586591+0000","last_clean":"2024-04-20T10:50:40.586591+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:40.586591+0000","last_undegraded":"2024-04-20T10:50:40.586591+0000","last_fullsized":"2024-04-20T10:50:40.586591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578827+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:41.578827+0000","last_peered":"2024-04-20T10:50:41.578827+0000","last_clean":"2024-04-20T10:50:41.578827+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:41.578827+0000","last_undegraded":"2024-04-20T10:50:41.578827+0000","last_fullsized":"2024-04-20T10:50:41.578827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580736+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:41.580736+0000","last_peered":"2024-04-20T10:50:41.580736+0000","last_clean":"2024-04-20T10:50:41.580736+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:41.580736+0000","last_undegraded":"2024-04-20T10:50:41.580736+0000","last_fullsized":"2024-04-20T10:50:41.580736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601511+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:40.601511+0000","last_peered":"2024-04-20T10:50:40.601511+0000","last_clean":"2024-04-20T10:50:40.601511+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:40.601511+0000","last_undegraded":"2024-04-20T10:50:40.601511+0000","last_fullsized":"2024-04-20T10:50:40.601511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:42.296210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578848+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:41.578848+0000","last_peered":"2024-04-20T10:50:41.578848+0000","last_clean":"2024-04-20T10:50:41.578848+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:41.578848+0000","last_undegraded":"2024-04-20T10:50:41.578848+0000","last_fullsized":"2024-04-20T10:50:41.578848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580759+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:41.580759+0000","last_peered":"2024-04-20T10:50:41.580759+0000","last_clean":"2024-04-20T10:50:41.580759+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:41.580759+0000","last_undegraded":"2024-04-20T10:50:41.580759+0000","last_fullsized":"2024-04-20T10:50:41.580759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.586019+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:40.586019+0000","last_peered":"2024-04-20T10:50:40.586019+0000","last_clean":"2024-04-20T10:50:40.586019+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:40.586019+0000","last_undegraded":"2024-04-20T10:50:40.586019+0000","last_fullsized":"2024-04-20T10:50:40.586019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578871+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:41.578871+0000","last_peered":"2024-04-20T10:50:41.578871+0000","last_clean":"2024-04-20T10:50:41.578871+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:41.578871+0000","last_undegraded":"2024-04-20T10:50:41.578871+0000","last_fullsized":"2024-04-20T10:50:41.578871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":15,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.590155+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:41.590155+0000","last_peered":"2024-04-20T10:50:41.590155+0000","last_clean":"2024-04-20T10:50:41.590155+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:41.590155+0000","last_undegraded":"2024-04-20T10:50:41.590155+0000","last_fullsized":"2024-04-20T10:50:41.590155+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609135+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:40.609135+0000","last_peered":"2024-04-20T10:50:40.609135+0000","last_clean":"2024-04-20T10:50:40.609135+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:40.609135+0000","last_undegraded":"2024-04-20T10:50:40.609135+0000","last_fullsized":"2024-04-20T10:50:40.609135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:00:24.794868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":16,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.593052+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:41.593052+0000","last_peered":"2024-04-20T10:50:41.593052+0000","last_clean":"2024-04-20T10:50:41.593052+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:41.593052+0000","last_undegraded":"2024-04-20T10:50:41.593052+0000","last_fullsized":"2024-04-20T10:50:41.593052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.602461+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:40.602461+0000","last_peered":"2024-04-20T10:50:40.602461+0000","last_clean":"2024-04-20T10:50:40.602461+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:40.602461+0000","last_undegraded":"2024-04-20T10:50:40.602461+0000","last_fullsized":"2024-04-20T10:50:40.602461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:13:31.265468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.584080+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:40.584080+0000","last_peered":"2024-04-20T10:50:40.584080+0000","last_clean":"2024-04-20T10:50:40.584080+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:40.584080+0000","last_undegraded":"2024-04-20T10:50:40.584080+0000","last_fullsized":"2024-04-20T10:50:40.584080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.601490+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:40.601490+0000","last_peered":"2024-04-20T10:50:40.601490+0000","last_clean":"2024-04-20T10:50:40.601490+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:40.601490+0000","last_undegraded":"2024-04-20T10:50:40.601490+0000","last_fullsized":"2024-04-20T10:50:40.601490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:52:53.272692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578887+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:41.578887+0000","last_peered":"2024-04-20T10:50:41.578887+0000","last_clean":"2024-04-20T10:50:41.578887+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:41.578887+0000","last_undegraded":"2024-04-20T10:50:41.578887+0000","last_fullsized":"2024-04-20T10:50:41.578887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609225+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:40.609225+0000","last_peered":"2024-04-20T10:50:40.609225+0000","last_clean":"2024-04-20T10:50:40.609225+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:40.609225+0000","last_undegraded":"2024-04-20T10:50:40.609225+0000","last_fullsized":"2024-04-20T10:50:40.609225+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:41:06.166058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.578921+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:41.578921+0000","last_peered":"2024-04-20T10:50:41.578921+0000","last_clean":"2024-04-20T10:50:41.578921+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:41.578921+0000","last_undegraded":"2024-04-20T10:50:41.578921+0000","last_fullsized":"2024-04-20T10:50:41.578921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609256+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:40.609256+0000","last_peered":"2024-04-20T10:50:40.609256+0000","last_clean":"2024-04-20T10:50:40.609256+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:40.609256+0000","last_undegraded":"2024-04-20T10:50:40.609256+0000","last_fullsized":"2024-04-20T10:50:40.609256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:58:26.901499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.611236+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:40.611236+0000","last_peered":"2024-04-20T10:50:40.611236+0000","last_clean":"2024-04-20T10:50:40.611236+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:40.611236+0000","last_undegraded":"2024-04-20T10:50:40.611236+0000","last_fullsized":"2024-04-20T10:50:40.611236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.592711+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:41.592711+0000","last_peered":"2024-04-20T10:50:41.592711+0000","last_clean":"2024-04-20T10:50:41.592711+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:41.592711+0000","last_undegraded":"2024-04-20T10:50:41.592711+0000","last_fullsized":"2024-04-20T10:50:41.592711+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580594+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:41.580594+0000","last_peered":"2024-04-20T10:50:41.580594+0000","last_clean":"2024-04-20T10:50:41.580594+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:41.580594+0000","last_undegraded":"2024-04-20T10:50:41.580594+0000","last_fullsized":"2024-04-20T10:50:41.580594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.613759+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:40.613759+0000","last_peered":"2024-04-20T10:50:40.613759+0000","last_clean":"2024-04-20T10:50:40.613759+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:40.613759+0000","last_undegraded":"2024-04-20T10:50:40.613759+0000","last_fullsized":"2024-04-20T10:50:40.613759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-20T10:50:41.580344+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:41.580344+0000","last_peered":"2024-04-20T10:50:41.580344+0000","last_clean":"2024-04-20T10:50:41.580344+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:41.580344+0000","last_undegraded":"2024-04-20T10:50:41.580344+0000","last_fullsized":"2024-04-20T10:50:41.580344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.610704+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:40.610704+0000","last_peered":"2024-04-20T10:50:40.610704+0000","last_clean":"2024-04-20T10:50:40.610704+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:40.610704+0000","last_undegraded":"2024-04-20T10:50:40.610704+0000","last_fullsized":"2024-04-20T10:50:40.610704+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.609192+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:40.609192+0000","last_peered":"2024-04-20T10:50:40.609192+0000","last_clean":"2024-04-20T10:50:40.609192+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:40.609192+0000","last_undegraded":"2024-04-20T10:50:40.609192+0000","last_fullsized":"2024-04-20T10:50:40.609192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:17:20.763141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612077+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:40.612077+0000","last_peered":"2024-04-20T10:50:40.612077+0000","last_clean":"2024-04-20T10:50:40.612077+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:40.612077+0000","last_undegraded":"2024-04-20T10:50:40.612077+0000","last_fullsized":"2024-04-20T10:50:40.612077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.612047+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:40.612047+0000","last_peered":"2024-04-20T10:50:40.612047+0000","last_clean":"2024-04-20T10:50:40.612047+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:40.612047+0000","last_undegraded":"2024-04-20T10:50:40.612047+0000","last_fullsized":"2024-04-20T10:50:40.612047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:52:10.954745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-20T10:50:40.611044+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:40.611044+0000","last_peered":"2024-04-20T10:50:40.611044+0000","last_clean":"2024-04-20T10:50:40.611044+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:40.611044+0000","last_undegraded":"2024-04-20T10:50:40.611044+0000","last_fullsized":"2024-04-20T10:50:40.611044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27804,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344036,"statfs":{"total":96636764160,"available":96608292864,"internally_reserved":0,"allocated":802816,"data_stored":660200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":69340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":69376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":70862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":204800,"data_stored":69250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":69410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":660256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:50:44.877 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-20T10:50:44.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:45.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.014+0000 7f4a1d1ed640 1 Processor -- start 2024-04-20T10:50:45.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.014+0000 7f4a1d1ed640 1 -- start start 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1d1ed640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4a180ac2b0 0x7f4a180ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1d1ed640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a180c4600 0x7f4a180c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1d1ed640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a180acaa0 con 0x7f4a18153d60 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1d1ed640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4a180acdf0 con 0x7f4a180c4600 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1d1ed640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4a1815a750 con 0x7f4a180ac2b0 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1759e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a180c4600 0x7f4a180c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1759e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a180c4600 0x7f4a180c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54334/0 (socket says 172.21.15.90:54334) 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1759e640 1 -- 172.21.15.90:0/718677450 learned_addr learned my addr 172.21.15.90:0/718677450 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.015+0000 7f4a1659c640 1 --2- 172.21.15.90:0/718677450 >> v2:172.21.15.175:3300/0 conn(0x7f4a180ac2b0 0x7f4a180ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.016+0000 7f4a1759e640 1 -- 172.21.15.90:0/718677450 >> v2:172.21.15.175:3300/0 conn(0x7f4a180ac2b0 msgr2=0x7f4a180ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.016+0000 7f4a1759e640 1 --2- 172.21.15.90:0/718677450 >> v2:172.21.15.175:3300/0 conn(0x7f4a180ac2b0 0x7f4a180ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.016+0000 7f4a15d9b640 1 -- 172.21.15.90:0/718677450 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087758108 0 0) 0x7f4a180acaa0 con 0x7f4a18153d60 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.016+0000 7f4a1759e640 1 -- 172.21.15.90:0/718677450 >> v1:172.21.15.175:6789/0 conn(0x7f4a18153d60 legacy=0x7f4a180c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.016+0000 7f4a1759e640 1 -- 172.21.15.90:0/718677450 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1815aa30 con 0x7f4a180c4600 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.016+0000 7f4a1759e640 1 --2- 172.21.15.90:0/718677450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c35e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a18073690 tx=0x7f4a1002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c49c2ccec2f7c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a15d9b640 1 -- 172.21.15.90:0/718677450 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1002c9f0 con 0x7f4a180c4600 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a15d9b640 1 -- 172.21.15.90:0/718677450 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1002cb90 con 0x7f4a180c4600 2024-04-20T10:50:45.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a15d9b640 1 -- 172.21.15.90:0/718677450 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a100343f0 con 0x7f4a180c4600 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/718677450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 msgr2=0x7f4a180c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/718677450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c35e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4a18073690 tx=0x7f4a1002be50 comp rx=0 tx=0).stop 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/718677450 shutdown_connections 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/718677450 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c35e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/718677450 >> v2:172.21.15.175:3300/0 conn(0x7f4a180ac2b0 0x7f4a180ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/718677450 >> 172.21.15.90:0/718677450 conn(0x7f4a18067de0 msgr2=0x7f4a180ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/718677450 shutdown_connections 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.017+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/718677450 wait complete. 2024-04-20T10:50:45.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.018+0000 7f4a1d1ed640 1 Processor -- start 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.018+0000 7f4a1d1ed640 1 -- start start 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1d1ed640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a180ac2b0 0x7f4a1814fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1d1ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1d1ed640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a18153d60 0x7f4a181ebd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1d1ed640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18070fa0 con 0x7f4a180c4600 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1d1ed640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a18070e20 con 0x7f4a180ac2b0 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1d1ed640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4a180c3b20 con 0x7f4a18153d60 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54350/0 (socket says 172.21.15.90:54350) 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1659c640 1 -- 172.21.15.90:0/1300304928 learned_addr learned my addr 172.21.15.90:0/1300304928 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1759e640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a18153d60 0x7f4a181ebd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a16d9d640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a180ac2b0 0x7f4a1814fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1659c640 1 -- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a18153d60 msgr2=0x7f4a181ebd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.019+0000 7f4a1659c640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a18153d60 0x7f4a181ebd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f4a1659c640 1 -- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a180ac2b0 msgr2=0x7f4a1814fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f4a1659c640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a180ac2b0 0x7f4a1814fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f4a1659c640 1 -- 172.21.15.90:0/1300304928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1814e0e0 con 0x7f4a180c4600 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f4a1659c640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c8df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00e980 tx=0x7f4a0c00ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f49ff7fe640 1 -- 172.21.15.90:0/1300304928 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c017070 con 0x7f4a180c4600 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f49ff7fe640 1 -- 172.21.15.90:0/1300304928 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00ca00 con 0x7f4a180c4600 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a181ef230 con 0x7f4a180c4600 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f49ff7fe640 1 -- 172.21.15.90:0/1300304928 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c00cdd0 con 0x7f4a180c4600 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.020+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a181ef7f0 con 0x7f4a180c4600 2024-04-20T10:50:45.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.021+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a18076150 con 0x7f4a180c4600 2024-04-20T10:50:45.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.021+0000 7f49ff7fe640 1 -- 172.21.15.90:0/1300304928 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a0c01a070 con 0x7f4a180c4600 2024-04-20T10:50:45.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.022+0000 7f49ff7fe640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a0406c920 0x7f4a0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.022+0000 7f4a16d9d640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a0406c920 0x7f4a0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.022+0000 7f49ff7fe640 1 -- 172.21.15.90:0/1300304928 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f4a0c08ba20 con 0x7f4a180c4600 2024-04-20T10:50:45.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.022+0000 7f4a16d9d640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a0406c920 0x7f4a0406ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a08007fd0 tx=0x7f4a08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.026+0000 7f49ff7fe640 1 -- 172.21.15.90:0/1300304928 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4a0c059ef0 con 0x7f4a180c4600 2024-04-20T10:50:45.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.203+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a180c43e0 con 0x7f4a180c4600 2024-04-20T10:50:45.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.204+0000 7f49ff7fe640 1 -- 172.21.15.90:0/1300304928 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16585 (secure 0 0 0) 0x7f4a0c0597f0 con 0x7f4a180c4600 2024-04-20T10:50:45.205 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:45.205 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":21,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:41.575679+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:45.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a0406c920 msgr2=0x7f4a0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a0406c920 0x7f4a0406ede0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a08007fd0 tx=0x7f4a08009040 comp rx=0 tx=0).stop 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 msgr2=0x7f4a180c8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c8df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c00e980 tx=0x7f4a0c00ee40 comp rx=0 tx=0).stop 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 shutdown_connections 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a0406c920 0x7f4a0406ede0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a18153d60 0x7f4a181ebd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a180c4600 0x7f4a180c8df0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 --2- 172.21.15.90:0/1300304928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a180ac2b0 0x7f4a1814fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 >> 172.21.15.90:0/1300304928 conn(0x7f4a18067de0 msgr2=0x7f4a180c4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 shutdown_connections 2024-04-20T10:50:45.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.206+0000 7f4a1d1ed640 1 -- 172.21.15.90:0/1300304928 wait complete. 2024-04-20T10:50:45.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:50:45.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:50:45.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.318+0000 7fe474c21640 1 Processor -- start 2024-04-20T10:50:45.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.318+0000 7fe474c21640 1 -- start start 2024-04-20T10:50:45.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe474c21640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 0x7fe470157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe474c21640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4700adce0 con 0x7fe470153ee0 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe474c21640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4700adfc0 con 0x7fe47006c4d0 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe474c21640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe4700ae2a0 con 0x7fe4700ab710 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe46e59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe470153ee0 0x7fe4700c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53232/0 (socket says 172.21.15.90:53232) 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe46e59c640 1 -- 172.21.15.90:0/589302488 learned_addr learned my addr 172.21.15.90:0/589302488 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4185535689 0 0) 0x7fe4700adce0 con 0x7fe470153ee0 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe45c003520 con 0x7fe470153ee0 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.319+0000 7fe46dd9b640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 0x7fe470157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3737477152 0 0) 0x7fe45c003520 con 0x7fe470153ee0 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 msgr2=0x7fe470157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 0x7fe470157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 >> v1:172.21.15.175:6789/0 conn(0x7fe47006c4d0 legacy=0x7fe47006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4700c70f0 con 0x7fe470153ee0 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fe4600019f0 con 0x7fe470153ee0 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 >> v1:172.21.15.90:6789/0 conn(0x7fe470153ee0 legacy=0x7fe4700c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45c0039e0 0x7fe45c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45c004800 0x7fe45c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 0x7fe45c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe4700ae2a0 con 0x7fe45c0039e0 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe45c005520 con 0x7fe45c004800 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe45c00bf00 con 0x7fe4700ab710 2024-04-20T10:50:45.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46e59c640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45c0039e0 0x7fe45c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46dd9b640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45c004800 0x7fe45c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46ed9d640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 0x7fe45c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46e59c640 1 -- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 msgr2=0x7fe45c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46e59c640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4700ab710 0x7fe45c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46e59c640 1 -- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45c004800 msgr2=0x7fe45c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46e59c640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe45c004800 0x7fe45c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.320+0000 7fe46e59c640 1 -- 172.21.15.90:0/589302488 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45c003520 con 0x7fe45c0039e0 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe46e59c640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45c0039e0 0x7fe45c003de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe46000a920 tx=0x7fe45c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26e9cf2b6499d04a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe46000a4c0 con 0x7fe45c0039e0 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe460034650 con 0x7fe45c0039e0 2024-04-20T10:50:45.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe46d59a640 1 -- 172.21.15.90:0/589302488 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe460034a40 con 0x7fe45c0039e0 2024-04-20T10:50:45.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe474c21640 1 -- 172.21.15.90:0/589302488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45c0039e0 msgr2=0x7fe45c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe474c21640 1 --2- 172.21.15.90:0/589302488 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe45c0039e0 0x7fe45c003de0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe46000a920 tx=0x7fe45c005830 comp rx=0 tx=0).stop 2024-04-20T10:50:45.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe46ed9d640 1 -- 172.21.15.90:0/589302488 reap_dead start 2024-04-20T10:50:45.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe474c21640 1 -- 172.21.15.90:0/589302488 shutdown_connections 2024-04-20T10:50:45.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.321+0000 7fe474c21640 1 -- 172.21.15.90:0/589302488 >> 172.21.15.90:0/589302488 conn(0x7fe4700cc060 msgr2=0x7fe4700cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:45.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.322+0000 7fe474c21640 1 -- 172.21.15.90:0/589302488 shutdown_connections 2024-04-20T10:50:45.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.322+0000 7fe474c21640 1 -- 172.21.15.90:0/589302488 wait complete. 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 Processor -- start 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 -- start start 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe45c0039e0 0x7fe4700c23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4700c0980 0x7fe4700c1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe470152ef0 0x7fe4700c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe47006d1b0 con 0x7fe470152ef0 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe47006d030 con 0x7fe4700c0980 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.323+0000 7fe474c21640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe470157190 con 0x7fe45c0039e0 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe470152ef0 0x7fe4700c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe470152ef0 0x7fe4700c50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:54368/0 (socket says 172.21.15.90:54368) 2024-04-20T10:50:45.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 -- 172.21.15.90:0/1106226387 learned_addr learned my addr 172.21.15.90:0/1106226387 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46e59c640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe45c0039e0 0x7fe4700c23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46dd9b640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4700c0980 0x7fe4700c1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 -- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe45c0039e0 msgr2=0x7fe4700c23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe45c0039e0 0x7fe4700c23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 -- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4700c0980 msgr2=0x7fe4700c1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4700c0980 0x7fe4700c1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 -- 172.21.15.90:0/1106226387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4700c28e0 con 0x7fe470152ef0 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe46ed9d640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe470152ef0 0x7fe4700c50a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4700cd080 tx=0x7fe46800e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe466ffd640 1 -- 172.21.15.90:0/1106226387 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468014480 con 0x7fe470152ef0 2024-04-20T10:50:45.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe466ffd640 1 -- 172.21.15.90:0/1106226387 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe468019070 con 0x7fe470152ef0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe470152ca0 con 0x7fe470152ef0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe466ffd640 1 -- 172.21.15.90:0/1106226387 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe468014860 con 0x7fe470152ef0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.324+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4700c0460 con 0x7fe470152ef0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.325+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4700c0660 con 0x7fe470152ef0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.325+0000 7fe466ffd640 1 -- 172.21.15.90:0/1106226387 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe468014a00 con 0x7fe470152ef0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.326+0000 7fe466ffd640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe45006c8f0 0x7fe45006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.326+0000 7fe466ffd640 1 -- 172.21.15.90:0/1106226387 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fe46808b860 con 0x7fe470152ef0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.326+0000 7fe46e59c640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe45006c8f0 0x7fe45006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.326+0000 7fe46e59c640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe45006c8f0 0x7fe45006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe460034000 tx=0x7fe46002f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.330+0000 7fe466ffd640 1 -- 172.21.15.90:0/1106226387 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe4680112e0 con 0x7fe470152ef0 2024-04-20T10:50:45.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.503+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe470076150 con 0x7fe470152ef0 2024-04-20T10:50:45.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.504+0000 7fe466ffd640 1 -- 172.21.15.90:0/1106226387 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (secure 0 0 0) 0x7fe468059d30 con 0x7fe470152ef0 2024-04-20T10:50:45.504 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe45006c8f0 msgr2=0x7fe45006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe45006c8f0 0x7fe45006edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe460034000 tx=0x7fe46002f000 comp rx=0 tx=0).stop 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe470152ef0 msgr2=0x7fe4700c50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe470152ef0 0x7fe4700c50a0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe4700cd080 tx=0x7fe46800e670 comp rx=0 tx=0).stop 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 shutdown_connections 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe45006c8f0 0x7fe45006edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe470152ef0 0x7fe4700c50a0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4700c0980 0x7fe4700c1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 --2- 172.21.15.90:0/1106226387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe45c0039e0 0x7fe4700c23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.505+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 >> 172.21.15.90:0/1106226387 conn(0x7fe4700cc060 msgr2=0x7fe4700c9e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:45.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.506+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 shutdown_connections 2024-04-20T10:50:45.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.506+0000 7fe474c21640 1 -- 172.21.15.90:0/1106226387 wait complete. 2024-04-20T10:50:45.516 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:50:45.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.616+0000 7f7375d04640 1 Processor -- start 2024-04-20T10:50:45.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.616+0000 7f7375d04640 1 -- start start 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f7375d04640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f73700ca010 0x7f73700c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f7375d04640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f73700c6f60 0x7f737006c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f7375d04640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73701401f0 con 0x7f737013fe10 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f7375d04640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f73700c8ab0 con 0x7f73700c6f60 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f7375d04640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f737006c370 con 0x7f73700ca010 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f73700c6f60 0x7f737006c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f73700c6f60 0x7f737006c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36896/0 (socket says 172.21.15.90:36896) 2024-04-20T10:50:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736ffff640 1 -- 172.21.15.90:0/77529689 learned_addr learned my addr 172.21.15.90:0/77529689 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736effd640 1 --2- 172.21.15.90:0/77529689 >> v2:172.21.15.175:3300/0 conn(0x7f73700ca010 0x7f73700c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736ffff640 1 -- 172.21.15.90:0/77529689 >> v2:172.21.15.175:3300/0 conn(0x7f73700ca010 msgr2=0x7f73700c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736ffff640 1 --2- 172.21.15.90:0/77529689 >> v2:172.21.15.175:3300/0 conn(0x7f73700ca010 0x7f73700c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736ffff640 1 -- 172.21.15.90:0/77529689 >> v1:172.21.15.175:6789/0 conn(0x7f737013fe10 legacy=0x7f737015a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.617+0000 7f736ffff640 1 -- 172.21.15.90:0/77529689 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73700c8d00 con 0x7f73700c6f60 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.618+0000 7f736ffff640 1 --2- 172.21.15.90:0/77529689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73700c6f60 0x7f737006c800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73700686a0 tx=0x7f736802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0be679f661409a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.618+0000 7f736e7fc640 1 -- 172.21.15.90:0/77529689 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736802c960 con 0x7f73700c6f60 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.618+0000 7f736e7fc640 1 -- 172.21.15.90:0/77529689 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736802cb00 con 0x7f73700c6f60 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.618+0000 7f736e7fc640 1 -- 172.21.15.90:0/77529689 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73680343f0 con 0x7f73700c6f60 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 -- 172.21.15.90:0/77529689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73700c6f60 msgr2=0x7f737006c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 --2- 172.21.15.90:0/77529689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73700c6f60 0x7f737006c800 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73700686a0 tx=0x7f736802bdc0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 -- 172.21.15.90:0/77529689 shutdown_connections 2024-04-20T10:50:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 --2- 172.21.15.90:0/77529689 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f73700c6f60 0x7f737006c800 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 --2- 172.21.15.90:0/77529689 >> v2:172.21.15.175:3300/0 conn(0x7f73700ca010 0x7f73700c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 -- 172.21.15.90:0/77529689 >> 172.21.15.90:0/77529689 conn(0x7f73700adcd0 msgr2=0x7f73700ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:45.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 -- 172.21.15.90:0/77529689 shutdown_connections 2024-04-20T10:50:45.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.619+0000 7f7375d04640 1 -- 172.21.15.90:0/77529689 wait complete. 2024-04-20T10:50:45.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.620+0000 7f7375d04640 1 Processor -- start 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.620+0000 7f7375d04640 1 -- start start 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7375d04640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f73700c6f60 0x7f73701ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7375d04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73700ca010 0x7f73700c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7375d04640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737013fe10 0x7f73701ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7375d04640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f73700caba0 con 0x7f737013fe10 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7375d04640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f73700c92c0 con 0x7f73700ca010 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7375d04640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f73700cad20 con 0x7f73700c6f60 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737013fe10 0x7f73701ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737013fe10 0x7f73701ec1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36912/0 (socket says 172.21.15.90:36912) 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 -- 172.21.15.90:0/3795061723 learned_addr learned my addr 172.21.15.90:0/3795061723 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736effd640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73700ca010 0x7f73700c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736f7fe640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f73700c6f60 0x7f73701ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 -- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f73700c6f60 msgr2=0x7f73701ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f73700c6f60 0x7f73701ed630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 -- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73700ca010 msgr2=0x7f73700c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73700ca010 0x7f73700c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 -- 172.21.15.90:0/3795061723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73700c3b50 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736f7fe640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f73700c6f60 0x7f73701ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f736ffff640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737013fe10 0x7f73701ec1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7368036040 tx=0x7f7368004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7357fff640 1 -- 172.21.15.90:0/3795061723 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7368043020 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7357fff640 1 -- 172.21.15.90:0/3795061723 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f736803e450 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.621+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73700c5d90 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.622+0000 7f7357fff640 1 -- 172.21.15.90:0/3795061723 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f736803e820 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.622+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73701f04c0 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.623+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7370076150 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.623+0000 7f7357fff640 1 -- 172.21.15.90:0/3795061723 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7368046020 con 0x7f737013fe10 2024-04-20T10:50:45.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.623+0000 7f7357fff640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f735c06c8f0 0x7f735c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.623+0000 7f7357fff640 1 -- 172.21.15.90:0/3795061723 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f73680ae2e0 con 0x7f737013fe10 2024-04-20T10:50:45.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.623+0000 7f736f7fe640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f735c06c8f0 0x7f735c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.624+0000 7f736f7fe640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f735c06c8f0 0x7f735c06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7360006fd0 tx=0x7f7360008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.628+0000 7f7357fff640 1 -- 172.21.15.90:0/3795061723 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f736804d030 con 0x7f737013fe10 2024-04-20T10:50:45.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.804+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f737006d310 con 0x7f737013fe10 2024-04-20T10:50:45.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.804+0000 7f7357fff640 1 -- 172.21.15.90:0/3795061723 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v21) ==== 99+0+11 (secure 0 0 0) 0x7f73700c3b50 con 0x7f737013fe10 2024-04-20T10:50:45.805 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f735c06c8f0 msgr2=0x7f735c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f735c06c8f0 0x7f735c06edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7360006fd0 tx=0x7f7360008040 comp rx=0 tx=0).stop 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737013fe10 msgr2=0x7f73701ec1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737013fe10 0x7f73701ec1c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7368036040 tx=0x7f7368004a40 comp rx=0 tx=0).stop 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 shutdown_connections 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f735c06c8f0 0x7f735c06edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f737013fe10 0x7f73701ec1c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f73700ca010 0x7f73700c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 --2- 172.21.15.90:0/3795061723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f73700c6f60 0x7f73701ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 >> 172.21.15.90:0/3795061723 conn(0x7f73700adcd0 msgr2=0x7f73700c2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:45.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 shutdown_connections 2024-04-20T10:50:45.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.806+0000 7f7375d04640 1 -- 172.21.15.90:0/3795061723 wait complete. 2024-04-20T10:50:45.817 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:50:45.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.915+0000 7fa3816df640 1 Processor -- start 2024-04-20T10:50:45.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.915+0000 7fa3816df640 1 -- start start 2024-04-20T10:50:45.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa3816df640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa37c157d90 0x7fa37c0aee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa3816df640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa37c06b930 0x7fa37c0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa3816df640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa37c0acc70 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa3816df640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa37c0ae160 con 0x7fa37c157d90 2024-04-20T10:50:45.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa3816df640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa37c0ae3b0 con 0x7fa37c06b930 2024-04-20T10:50:45.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37affd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa37c157d90 0x7fa37c0aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37b7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa37c0ac6b0 0x7fa37c14e190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32904/0 (socket says 172.21.15.90:32904) 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37affd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa37c157d90 0x7fa37c0aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36914/0 (socket says 172.21.15.90:36914) 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37b7fe640 1 -- 172.21.15.90:0/476427198 learned_addr learned my addr 172.21.15.90:0/476427198 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37a7fc640 1 --2- 172.21.15.90:0/476427198 >> v2:172.21.15.175:3300/0 conn(0x7fa37c06b930 0x7fa37c0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37affd640 1 -- 172.21.15.90:0/476427198 >> v2:172.21.15.175:3300/0 conn(0x7fa37c06b930 msgr2=0x7fa37c0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37affd640 1 --2- 172.21.15.90:0/476427198 >> v2:172.21.15.175:3300/0 conn(0x7fa37c06b930 0x7fa37c0c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37affd640 1 -- 172.21.15.90:0/476427198 >> v1:172.21.15.90:6789/0 conn(0x7fa37c0ac6b0 legacy=0x7fa37c14e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa379ffb640 1 -- 172.21.15.90:0/476427198 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643831760 0 0) 0x7fa37c0acc70 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37affd640 1 -- 172.21.15.90:0/476427198 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c0ae690 con 0x7fa37c157d90 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.916+0000 7fa37a7fc640 1 --2- 172.21.15.90:0/476427198 >> v2:172.21.15.175:3300/0 conn(0x7fa37c06b930 0x7fa37c0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.917+0000 7fa37affd640 1 --2- 172.21.15.90:0/476427198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c157d90 0x7fa37c0aee90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0ae2e0 tx=0x7fa36c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4f740095572ec8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.917+0000 7fa379ffb640 1 -- 172.21.15.90:0/476427198 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c039070 con 0x7fa37c157d90 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.917+0000 7fa379ffb640 1 -- 172.21.15.90:0/476427198 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa36c02cbd0 con 0x7fa37c157d90 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.917+0000 7fa379ffb640 1 -- 172.21.15.90:0/476427198 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa36c034440 con 0x7fa37c157d90 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 -- 172.21.15.90:0/476427198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c157d90 msgr2=0x7fa37c0aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 --2- 172.21.15.90:0/476427198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c157d90 0x7fa37c0aee90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa37c0ae2e0 tx=0x7fa36c02be20 comp rx=0 tx=0).stop 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 -- 172.21.15.90:0/476427198 shutdown_connections 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 --2- 172.21.15.90:0/476427198 >> v2:172.21.15.175:3300/0 conn(0x7fa37c06b930 0x7fa37c0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 --2- 172.21.15.90:0/476427198 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c157d90 0x7fa37c0aee90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 -- 172.21.15.90:0/476427198 >> 172.21.15.90:0/476427198 conn(0x7fa37c0c9100 msgr2=0x7fa37c0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 -- 172.21.15.90:0/476427198 shutdown_connections 2024-04-20T10:50:45.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.918+0000 7fa3816df640 1 -- 172.21.15.90:0/476427198 wait complete. 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.919+0000 7fa3816df640 1 Processor -- start 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.919+0000 7fa3816df640 1 -- start start 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3816df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c06b930 0x7fa37c1ea3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3816df640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0ac6b0 0x7fa37c1ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3816df640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa37c157d90 0x7fa37c148d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3816df640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c14e8a0 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3816df640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa37c1589b0 con 0x7fa37c06b930 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3816df640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa37c14ea20 con 0x7fa37c157d90 2024-04-20T10:50:45.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0ac6b0 0x7fa37c1ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0ac6b0 0x7fa37c1ed900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36930/0 (socket says 172.21.15.90:36930) 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 -- 172.21.15.90:0/4109499783 learned_addr learned my addr 172.21.15.90:0/4109499783 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37b7fe640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa37c157d90 0x7fa37c148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37affd640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c06b930 0x7fa37c1ea3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 -- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa37c157d90 msgr2=0x7fa37c148d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa37c157d90 0x7fa37c148d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 -- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c06b930 msgr2=0x7fa37c1ea3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:45.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c06b930 0x7fa37c1ea3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 -- 172.21.15.90:0/4109499783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa37c1ede40 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa37a7fc640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0ac6b0 0x7fa37c1ed900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa37000c820 tx=0x7fa37000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3637fe640 1 -- 172.21.15.90:0/4109499783 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370015070 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.920+0000 7fa3637fe640 1 -- 172.21.15.90:0/4109499783 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa370007a30 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.921+0000 7fa3637fe640 1 -- 172.21.15.90:0/4109499783 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa370007e00 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.921+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa37c0c7fe0 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.921+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa37c1524d0 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.921+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa37c076150 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.922+0000 7fa3637fe640 1 -- 172.21.15.90:0/4109499783 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa370018070 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.922+0000 7fa3637fe640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa36806c8f0 0x7fa36806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.922+0000 7fa3637fe640 1 -- 172.21.15.90:0/4109499783 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7fa37008ba80 con 0x7fa37c0ac6b0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.922+0000 7fa37affd640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa36806c8f0 0x7fa36806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:45.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.923+0000 7fa37affd640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa36806c8f0 0x7fa36806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa36c036000 tx=0x7fa36c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:45.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:45.927+0000 7fa3637fe640 1 -- 172.21.15.90:0/4109499783 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa37c1ede40 con 0x7fa37c0ac6b0 2024-04-20T10:50:46.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.099+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fa37c149260 con 0x7fa37c0ac6b0 2024-04-20T10:50:46.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.100+0000 7fa3637fe640 1 -- 172.21.15.90:0/4109499783 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v21) ==== 95+0+11 (secure 0 0 0) 0x7fa370059f50 con 0x7fa37c0ac6b0 2024-04-20T10:50:46.100 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:50:46.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa36806c8f0 msgr2=0x7fa36806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa36806c8f0 0x7fa36806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa36c036000 tx=0x7fa36c030000 comp rx=0 tx=0).stop 2024-04-20T10:50:46.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0ac6b0 msgr2=0x7fa37c1ed900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0ac6b0 0x7fa37c1ed900 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa37000c820 tx=0x7fa37000cc20 comp rx=0 tx=0).stop 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 shutdown_connections 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa36806c8f0 0x7fa36806edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa37c157d90 0x7fa37c148d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa37c0ac6b0 0x7fa37c1ed900 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 --2- 172.21.15.90:0/4109499783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa37c06b930 0x7fa37c1ea3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 >> 172.21.15.90:0/4109499783 conn(0x7fa37c0c9100 msgr2=0x7fa37c0ad430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 shutdown_connections 2024-04-20T10:50:46.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.102+0000 7fa3816df640 1 -- 172.21.15.90:0/4109499783 wait complete. 2024-04-20T10:50:46.113 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-20T10:50:46.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.209+0000 7f399af11640 1 Processor -- start 2024-04-20T10:50:46.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.209+0000 7f399af11640 1 -- start start 2024-04-20T10:50:46.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f399af11640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f3994158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f399af11640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39940c6040 0x7f39940c64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f399af11640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39940704c0 con 0x7f3994151b40 2024-04-20T10:50:46.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f399af11640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3994073800 con 0x7f39940c6040 2024-04-20T10:50:46.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f399af11640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f39940731b0 con 0x7f399406ff90 2024-04-20T10:50:46.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f3993fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f3994158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f39994ae640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39940c6040 0x7f39940c64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f3993fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f3994158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:34328/0 (socket says 172.21.15.90:34328) 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f39994ae640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39940c6040 0x7f39940c64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:54550/0 (socket says 172.21.15.90:54550) 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f3993fff640 1 -- 172.21.15.90:0/3615981335 learned_addr learned my addr 172.21.15.90:0/3615981335 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f39994ae640 1 -- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 msgr2=0x7f3994158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f39994ae640 1 --2- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f3994158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f39994ae640 1 -- 172.21.15.90:0/3615981335 >> v1:172.21.15.175:6789/0 conn(0x7f3994151b40 legacy=0x7f3994157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f39994ae640 1 -- 172.21.15.90:0/3615981335 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3994073490 con 0x7f39940c6040 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f39937fe640 1 -- 172.21.15.90:0/3615981335 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043369671 0 0) 0x7f39940704c0 con 0x7f3994151b40 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.210+0000 7f3993fff640 1 --2- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f3994158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.211+0000 7f39994ae640 1 --2- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 0x7f39940c64f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f398c009d90 tx=0x7f398c02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2ed68569509f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:46.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.211+0000 7f39937fe640 1 -- 172.21.15.90:0/3615981335 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c039070 con 0x7f39940c6040 2024-04-20T10:50:46.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.211+0000 7f39937fe640 1 -- 172.21.15.90:0/3615981335 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c02cb30 con 0x7f39940c6040 2024-04-20T10:50:46.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.211+0000 7f39937fe640 1 -- 172.21.15.90:0/3615981335 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c034440 con 0x7f39940c6040 2024-04-20T10:50:46.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 -- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 msgr2=0x7f39940c64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 --2- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 0x7f39940c64f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f398c009d90 tx=0x7f398c02bd80 comp rx=0 tx=0).stop 2024-04-20T10:50:46.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 -- 172.21.15.90:0/3615981335 shutdown_connections 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 --2- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 0x7f39940c64f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 --2- 172.21.15.90:0/3615981335 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f3994158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 -- 172.21.15.90:0/3615981335 >> 172.21.15.90:0/3615981335 conn(0x7f39940676c0 msgr2=0x7f3994067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 -- 172.21.15.90:0/3615981335 shutdown_connections 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.212+0000 7f399af11640 1 -- 172.21.15.90:0/3615981335 wait complete. 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.213+0000 7f399af11640 1 Processor -- start 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.213+0000 7f399af11640 1 -- start start 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f399414c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 0x7f3994152630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994151b40 0x7f3994152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39941520a0 con 0x7f3994151b40 2024-04-20T10:50:46.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3994151f20 con 0x7f39940c6040 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f399406f600 con 0x7f399406ff90 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994151b40 0x7f3994152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994151b40 0x7f3994152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36946/0 (socket says 172.21.15.90:36946) 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 -- 172.21.15.90:0/1682802322 learned_addr learned my addr 172.21.15.90:0/1682802322 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f3993fff640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 0x7f3994152630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f3998cad640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f399414c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 -- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 msgr2=0x7f399414c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f399414c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 -- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 msgr2=0x7f3994152630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 0x7f3994152630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 -- 172.21.15.90:0/1682802322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3994147da0 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39994ae640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994151b40 0x7f3994152b70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f398c009d90 tx=0x7f398c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39917fa640 1 -- 172.21.15.90:0/1682802322 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c039050 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39917fa640 1 -- 172.21.15.90:0/1682802322 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c045070 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3994147ac0 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f39917fa640 1 -- 172.21.15.90:0/1682802322 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c009450 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.214+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39941486c0 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.215+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3994076150 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.216+0000 7f39917fa640 1 -- 172.21.15.90:0/1682802322 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f398c03e850 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.216+0000 7f39917fa640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f397806c8f0 0x7f397806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.216+0000 7f3998cad640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f397806c8f0 0x7f397806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.216+0000 7f39917fa640 1 -- 172.21.15.90:0/1682802322 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f398c0ae700 con 0x7f3994151b40 2024-04-20T10:50:46.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.217+0000 7f3998cad640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f397806c8f0 0x7f397806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3988000f60 tx=0x7f3988009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:46.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.220+0000 7f39917fa640 1 -- 172.21.15.90:0/1682802322 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f398c07c6a0 con 0x7f3994151b40 2024-04-20T10:50:46.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.399+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f39940c4450 con 0x7f3994151b40 2024-04-20T10:50:46.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.399+0000 7f39917fa640 1 -- 172.21.15.90:0/1682802322 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v21) ==== 84+0+197 (secure 0 0 0) 0x7f398c0809a0 con 0x7f3994151b40 2024-04-20T10:50:46.402 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:46.402 INFO:teuthology.orchestra.run.smithi090.stdout:[ 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 1, 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": ".mgr" 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 2, 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "a_metadata" 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: }, 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: { 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: "poolnum": 3, 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: "poolname": "a_data" 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout: } 2024-04-20T10:50:46.403 INFO:teuthology.orchestra.run.smithi090.stdout:] 2024-04-20T10:50:46.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f397806c8f0 msgr2=0x7f397806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f397806c8f0 0x7f397806edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3988000f60 tx=0x7f3988009040 comp rx=0 tx=0).stop 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994151b40 msgr2=0x7f3994152b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994151b40 0x7f3994152b70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f398c009d90 tx=0x7f398c004a40 comp rx=0 tx=0).stop 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 shutdown_connections 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f397806c8f0 0x7f397806edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3994151b40 0x7f3994152b70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39940c6040 0x7f3994152630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 --2- 172.21.15.90:0/1682802322 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f399406ff90 0x7f399414c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 >> 172.21.15.90:0/1682802322 conn(0x7f39940676c0 msgr2=0x7f3994067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 shutdown_connections 2024-04-20T10:50:46.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.401+0000 7f399af11640 1 -- 172.21.15.90:0/1682802322 wait complete. 2024-04-20T10:50:46.412 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'b' 2024-04-20T10:50:46.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_metadata --pg_num_min 64 2024-04-20T10:50:46.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.512+0000 7f30ee825640 1 Processor -- start 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.512+0000 7f30ee825640 1 -- start start 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30ee825640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f30e8151d40 0x7f30e80726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30ee825640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e8155050 con 0x7f30e80c6710 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30ee825640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e8155330 con 0x7f30e80c45e0 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30ee825640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f30e80c4b40 con 0x7f30e8151d40 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30e7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f30e8151d40 0x7f30e80726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30e7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f30e8151d40 0x7f30e80726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36948/0 (socket says 172.21.15.90:36948) 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30e77fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f30e80c6710 0x7f30e80ab6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32914/0 (socket says 172.21.15.90:32914) 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30e7fff640 1 -- 172.21.15.90:0/1985031514 learned_addr learned my addr 172.21.15.90:0/1985031514 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30e7fff640 1 -- 172.21.15.90:0/1985031514 >> v1:172.21.15.175:6789/0 conn(0x7f30e80c45e0 legacy=0x7f30e80abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30e7fff640 1 -- 172.21.15.90:0/1985031514 >> v1:172.21.15.90:6789/0 conn(0x7f30e80c6710 legacy=0x7f30e80ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.513+0000 7f30e7fff640 1 -- 172.21.15.90:0/1985031514 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e80c4d90 con 0x7f30e8151d40 2024-04-20T10:50:46.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30e7fff640 1 --2- 172.21.15.90:0/1985031514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e80726f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009870 tx=0x7f30d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841e1fdf1b06a686 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:46.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30e6ffd640 1 -- 172.21.15.90:0/1985031514 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8035020 con 0x7f30e8151d40 2024-04-20T10:50:46.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30e6ffd640 1 -- 172.21.15.90:0/1985031514 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30d8031870 con 0x7f30e8151d40 2024-04-20T10:50:46.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30e6ffd640 1 -- 172.21.15.90:0/1985031514 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8031c40 con 0x7f30e8151d40 2024-04-20T10:50:46.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30ee825640 1 -- 172.21.15.90:0/1985031514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 msgr2=0x7f30e80726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30ee825640 1 --2- 172.21.15.90:0/1985031514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e80726f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009870 tx=0x7f30d802b910 comp rx=0 tx=0).stop 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30ee825640 1 -- 172.21.15.90:0/1985031514 shutdown_connections 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30ee825640 1 --2- 172.21.15.90:0/1985031514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e80726f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.514+0000 7f30ee825640 1 -- 172.21.15.90:0/1985031514 >> 172.21.15.90:0/1985031514 conn(0x7f30e80ca140 msgr2=0x7f30e80ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.515+0000 7f30ee825640 1 -- 172.21.15.90:0/1985031514 shutdown_connections 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.515+0000 7f30ee825640 1 -- 172.21.15.90:0/1985031514 wait complete. 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 Processor -- start 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 -- start start 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e80c45e0 0x7f30e80c37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30e80c6710 0x7f30e8157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e806d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80c5100 con 0x7f30e8151d40 2024-04-20T10:50:46.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30e80acba0 con 0x7f30e80c45e0 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.516+0000 7f30ee825640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f30e8072c30 con 0x7f30e80c6710 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e806d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e806d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36960/0 (socket says 172.21.15.90:36960) 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 -- 172.21.15.90:0/364283410 learned_addr learned my addr 172.21.15.90:0/364283410 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30e7fff640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e80c45e0 0x7f30e80c37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30e77fe640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30e80c6710 0x7f30e8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 -- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30e80c6710 msgr2=0x7f30e8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30e80c6710 0x7f30e8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 -- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e80c45e0 msgr2=0x7f30e80c37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e80c45e0 0x7f30e80c37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 -- 172.21.15.90:0/364283410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e81ec450 con 0x7f30e8151d40 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ecdc2640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e806d5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c730 tx=0x7f30e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:46.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30e4ff9640 1 -- 172.21.15.90:0/364283410 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e0003b70 con 0x7f30e8151d40 2024-04-20T10:50:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30e4ff9640 1 -- 172.21.15.90:0/364283410 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e0003d10 con 0x7f30e8151d40 2024-04-20T10:50:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e806cae0 con 0x7f30e8151d40 2024-04-20T10:50:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30e4ff9640 1 -- 172.21.15.90:0/364283410 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e000aa90 con 0x7f30e8151d40 2024-04-20T10:50:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.517+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e80c3d20 con 0x7f30e8151d40 2024-04-20T10:50:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.518+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e80761f0 con 0x7f30e8151d40 2024-04-20T10:50:46.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.518+0000 7f30e4ff9640 1 -- 172.21.15.90:0/364283410 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30e000ac30 con 0x7f30e8151d40 2024-04-20T10:50:46.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.519+0000 7f30e4ff9640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30d406c8f0 0x7f30d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.519+0000 7f30e4ff9640 1 -- 172.21.15.90:0/364283410 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5689+0+0 (secure 0 0 0) 0x7f30e008b960 con 0x7f30e8151d40 2024-04-20T10:50:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.519+0000 7f30e7fff640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30d406c8f0 0x7f30d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.519+0000 7f30e7fff640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30d406c8f0 0x7f30d406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30d8036000 tx=0x7f30d803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:46.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.523+0000 7f30e4ff9640 1 -- 172.21.15.90:0/364283410 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f30e0059e30 con 0x7f30e8151d40 2024-04-20T10:50:46.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:46.699+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64} v 0) -- 0x7f30e806e980 con 0x7f30e8151d40 2024-04-20T10:50:47.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.617+0000 7f30e4ff9640 1 -- 172.21.15.90:0/364283410 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_metadata", "pg_num_min": 64}]=0 pool 'b_metadata' created v22) ==== 128+0+0 (secure 0 0 0) 0x7f30e0059730 con 0x7f30e8151d40 2024-04-20T10:50:47.618 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_metadata' created 2024-04-20T10:50:47.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30d406c8f0 msgr2=0x7f30d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30d406c8f0 0x7f30d406edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f30d8036000 tx=0x7f30d803c040 comp rx=0 tx=0).stop 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 msgr2=0x7f30e806d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e806d5c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30e000c730 tx=0x7f30e000cbf0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 shutdown_connections 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30d406c8f0 0x7f30d406edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e8151d40 0x7f30e806d5c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30e80c6710 0x7f30e8157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 --2- 172.21.15.90:0/364283410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e80c45e0 0x7f30e80c37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 >> 172.21.15.90:0/364283410 conn(0x7f30e80ca140 msgr2=0x7f30e8150690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 shutdown_connections 2024-04-20T10:50:47.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.620+0000 7f30ee825640 1 -- 172.21.15.90:0/364283410 wait complete. 2024-04-20T10:50:47.636 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create b_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-20T10:50:47.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.742+0000 7f8ff88c8640 1 Processor -- start 2024-04-20T10:50:47.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.742+0000 7f8ff88c8640 1 -- start start 2024-04-20T10:50:47.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff88c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8ff40bf7f0 0x7f8ff4159d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:47.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff88c8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8ff40ca060 0x7f8ff415a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:47.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff88c8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ff41572c0 con 0x7f8ff41506b0 2024-04-20T10:50:47.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff88c8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff41575a0 con 0x7f8ff40ca060 2024-04-20T10:50:47.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff88c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8ff40c6ae0 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff2d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8ff40ca060 0x7f8ff415a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff2d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8ff40ca060 0x7f8ff415a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36976/0 (socket says 172.21.15.90:36976) 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff2d9d640 1 -- 172.21.15.90:0/2366289203 learned_addr learned my addr 172.21.15.90:0/2366289203 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff1d9b640 1 --2- 172.21.15.90:0/2366289203 >> v2:172.21.15.175:3300/0 conn(0x7f8ff40bf7f0 0x7f8ff4159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff2d9d640 1 -- 172.21.15.90:0/2366289203 >> v2:172.21.15.175:3300/0 conn(0x7f8ff40bf7f0 msgr2=0x7f8ff4159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff2d9d640 1 --2- 172.21.15.90:0/2366289203 >> v2:172.21.15.175:3300/0 conn(0x7f8ff40bf7f0 0x7f8ff4159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff2d9d640 1 -- 172.21.15.90:0/2366289203 >> v1:172.21.15.175:6789/0 conn(0x7f8ff41506b0 legacy=0x7f8ff40c8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff2d9d640 1 -- 172.21.15.90:0/2366289203 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff40c6dc0 con 0x7f8ff40ca060 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.743+0000 7f8ff1d9b640 1 --2- 172.21.15.90:0/2366289203 >> v2:172.21.15.175:3300/0 conn(0x7f8ff40bf7f0 0x7f8ff4159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.744+0000 7f8ff2d9d640 1 --2- 172.21.15.90:0/2366289203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40ca060 0x7f8ff415a260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009e50 tx=0x7f8fec02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c6e402da2b77cb5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:47.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.744+0000 7f8ff159a640 1 -- 172.21.15.90:0/2366289203 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec02c9f0 con 0x7f8ff40ca060 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.744+0000 7f8ff159a640 1 -- 172.21.15.90:0/2366289203 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fec02cb90 con 0x7f8ff40ca060 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.744+0000 7f8ff159a640 1 -- 172.21.15.90:0/2366289203 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fec0343f0 con 0x7f8ff40ca060 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2366289203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40ca060 msgr2=0x7f8ff415a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2366289203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40ca060 0x7f8ff415a260 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8fec009e50 tx=0x7f8fec02be50 comp rx=0 tx=0).stop 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2366289203 shutdown_connections 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2366289203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40ca060 0x7f8ff415a260 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2366289203 >> v2:172.21.15.175:3300/0 conn(0x7f8ff40bf7f0 0x7f8ff4159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2366289203 >> 172.21.15.90:0/2366289203 conn(0x7f8ff40adcd0 msgr2=0x7f8ff40ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2366289203 shutdown_connections 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.745+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2366289203 wait complete. 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.746+0000 7f8ff88c8640 1 Processor -- start 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.746+0000 7f8ff88c8640 1 -- start start 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40bf7f0 0x7f8ff414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ff40ca060 0x7f8ff41ee9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:47.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff41506b0 0x7f8ff40c2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff406d480 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ff406d300 con 0x7f8ff41506b0 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ff4150a90 con 0x7f8ff40ca060 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40bf7f0 0x7f8ff414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40bf7f0 0x7f8ff414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36984/0 (socket says 172.21.15.90:36984) 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 -- 172.21.15.90:0/2733491816 learned_addr learned my addr 172.21.15.90:0/2733491816 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 -- 172.21.15.90:0/2733491816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ff40ca060 msgr2=0x7f8ff41ee9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:47.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ff40ca060 0x7f8ff41ee9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 -- 172.21.15.90:0/2733491816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff41506b0 msgr2=0x7f8ff40c2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:47.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff41506b0 0x7f8ff40c2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:47.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 -- 172.21.15.90:0/2733491816 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ff40c1020 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff259c640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40bf7f0 0x7f8ff414a530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c3f0 tx=0x7f8fe400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:47.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8fe2ffd640 1 -- 172.21.15.90:0/2733491816 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe40052d0 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8fe2ffd640 1 -- 172.21.15.90:0/2733491816 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fe4005490 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ff40c1300 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8fe2ffd640 1 -- 172.21.15.90:0/2733491816 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fe4007260 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.747+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ff40c18c0 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.748+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ff4076150 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.749+0000 7f8fe2ffd640 1 -- 172.21.15.90:0/2733491816 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fe4007400 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.749+0000 7f8fe2ffd640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8fd406c8f0 0x7f8fd406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.750+0000 7f8ff1d9b640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8fd406c8f0 0x7f8fd406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.750+0000 7f8fe2ffd640 1 -- 172.21.15.90:0/2733491816 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6054+0+0 (secure 0 0 0) 0x7f8fe408b0c0 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.750+0000 7f8ff1d9b640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8fd406c8f0 0x7f8fd406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8006fd0 tx=0x7f8fe8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:47.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.754+0000 7f8fe2ffd640 1 -- 172.21.15.90:0/2733491816 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8fe4059420 con 0x7f8ff40bf7f0 2024-04-20T10:50:47.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:47.931+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f8ff406d070 con 0x7f8ff40bf7f0 2024-04-20T10:50:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.623+0000 7f8fe2ffd640 1 -- 172.21.15.90:0/2733491816 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "b_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'b_data' created v23) ==== 160+0+0 (secure 0 0 0) 0x7f8fe4058d20 con 0x7f8ff40bf7f0 2024-04-20T10:50:48.623 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_data' created 2024-04-20T10:50:48.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.627+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8fd406c8f0 msgr2=0x7f8fd406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:48.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.627+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8fd406c8f0 0x7f8fd406edb0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8fe8006fd0 tx=0x7f8fe8008040 comp rx=0 tx=0).stop 2024-04-20T10:50:48.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.627+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40bf7f0 msgr2=0x7f8ff414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:48.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.627+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40bf7f0 0x7f8ff414a530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8fe400c3f0 tx=0x7f8fe400c8b0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.629+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 shutdown_connections 2024-04-20T10:50:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.629+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8fd406c8f0 0x7f8fd406edb0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.629+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ff41506b0 0x7f8ff40c2300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.629+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ff40ca060 0x7f8ff41ee9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.629+0000 7f8ff88c8640 1 --2- 172.21.15.90:0/2733491816 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ff40bf7f0 0x7f8ff414a530 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.629+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 >> 172.21.15.90:0/2733491816 conn(0x7f8ff40adcd0 msgr2=0x7f8ff40ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.635+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 shutdown_connections 2024-04-20T10:50:48.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.635+0000 7f8ff88c8640 1 -- 172.21.15.90:0/2733491816 wait complete. 2024-04-20T10:50:48.654 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new b b_metadata b_data 2024-04-20T10:50:48.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.755+0000 7f9263c4e640 1 Processor -- start 2024-04-20T10:50:48.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f9263c4e640 1 -- start start 2024-04-20T10:50:48.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f9263c4e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f925c0ad720 0x7f925c155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:48.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f9263c4e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f925c06e210 0x7f925c073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f9263c4e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f925c06d450 con 0x7f925c0705c0 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f9263c4e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f925c06dd80 con 0x7f925c06e210 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f9263c4e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f925c06d730 con 0x7f925c0ad720 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f92611e9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f925c06e210 0x7f925c073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f92621eb640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f925c0705c0 0x7f925c0c3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32926/0 (socket says 172.21.15.90:32926) 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f92611e9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f925c06e210 0x7f925c073430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36992/0 (socket says 172.21.15.90:36992) 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.756+0000 7f92621eb640 1 -- 172.21.15.90:0/763404424 learned_addr learned my addr 172.21.15.90:0/763404424 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.757+0000 7f92619ea640 1 --2- 172.21.15.90:0/763404424 >> v2:172.21.15.175:3300/0 conn(0x7f925c0ad720 0x7f925c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.757+0000 7f92611e9640 1 -- 172.21.15.90:0/763404424 >> v2:172.21.15.175:3300/0 conn(0x7f925c0ad720 msgr2=0x7f925c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.757+0000 7f92611e9640 1 --2- 172.21.15.90:0/763404424 >> v2:172.21.15.175:3300/0 conn(0x7f925c0ad720 0x7f925c155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.757+0000 7f92611e9640 1 -- 172.21.15.90:0/763404424 >> v1:172.21.15.90:6789/0 conn(0x7f925c0705c0 legacy=0x7f925c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.757+0000 7f92609e8640 1 -- 172.21.15.90:0/763404424 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252417374 0 0) 0x7f925c06d450 con 0x7f925c0705c0 2024-04-20T10:50:48.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.757+0000 7f92611e9640 1 -- 172.21.15.90:0/763404424 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925c06da10 con 0x7f925c06e210 2024-04-20T10:50:48.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.757+0000 7f92611e9640 1 --2- 172.21.15.90:0/763404424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c06e210 0x7f925c073430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f925c070110 tx=0x7f925802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd82bcb1ee8ed50 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:48.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f92609e8640 1 -- 172.21.15.90:0/763404424 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92580315a0 con 0x7f925c06e210 2024-04-20T10:50:48.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f92609e8640 1 -- 172.21.15.90:0/763404424 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9258037070 con 0x7f925c06e210 2024-04-20T10:50:48.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f92609e8640 1 -- 172.21.15.90:0/763404424 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9258031960 con 0x7f925c06e210 2024-04-20T10:50:48.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 -- 172.21.15.90:0/763404424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c06e210 msgr2=0x7f925c073430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 --2- 172.21.15.90:0/763404424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c06e210 0x7f925c073430 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f925c070110 tx=0x7f925802b840 comp rx=0 tx=0).stop 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 -- 172.21.15.90:0/763404424 shutdown_connections 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 --2- 172.21.15.90:0/763404424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c06e210 0x7f925c073430 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 --2- 172.21.15.90:0/763404424 >> v2:172.21.15.175:3300/0 conn(0x7f925c0ad720 0x7f925c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 -- 172.21.15.90:0/763404424 >> 172.21.15.90:0/763404424 conn(0x7f925c0c8080 msgr2=0x7f925c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 -- 172.21.15.90:0/763404424 shutdown_connections 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.758+0000 7f9263c4e640 1 -- 172.21.15.90:0/763404424 wait complete. 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.759+0000 7f9263c4e640 1 Processor -- start 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.759+0000 7f9263c4e640 1 -- start start 2024-04-20T10:50:48.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f9263c4e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f925c06e210 0x7f925c0c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f9263c4e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f925c0705c0 0x7f925c0ab330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f9263c4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0ad720 0x7f925c0ab870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f9263c4e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f925c0c3dc0 con 0x7f925c0ad720 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f9263c4e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f925c0c3c40 con 0x7f925c0705c0 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f9263c4e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f925c070b30 con 0x7f925c06e210 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0ad720 0x7f925c0ab870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0ad720 0x7f925c0ab870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36998/0 (socket says 172.21.15.90:36998) 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 -- 172.21.15.90:0/918165064 learned_addr learned my addr 172.21.15.90:0/918165064 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92619ea640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f925c06e210 0x7f925c0c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92611e9640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f925c0705c0 0x7f925c0ab330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 -- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f925c06e210 msgr2=0x7f925c0c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f925c06e210 0x7f925c0c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 -- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f925c0705c0 msgr2=0x7f925c0ab330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f925c0705c0 0x7f925c0ab330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.760+0000 7f92621eb640 1 -- 172.21.15.90:0/918165064 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925c1e1670 con 0x7f925c0ad720 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.761+0000 7f92621eb640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0ad720 0x7f925c0ab870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f925400c7d0 tx=0x7f925400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.761+0000 7f92527fc640 1 -- 172.21.15.90:0/918165064 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254018070 con 0x7f925c0ad720 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.761+0000 7f92527fc640 1 -- 172.21.15.90:0/918165064 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f925400a640 con 0x7f925c0ad720 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.761+0000 7f92527fc640 1 -- 172.21.15.90:0/918165064 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925400aa70 con 0x7f925c0ad720 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.761+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f925c0acf90 con 0x7f925c0ad720 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.761+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f925c0accb0 con 0x7f925c0ad720 2024-04-20T10:50:48.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.762+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925c076150 con 0x7f925c0ad720 2024-04-20T10:50:48.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.762+0000 7f92527fc640 1 -- 172.21.15.90:0/918165064 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f925400ac10 con 0x7f925c0ad720 2024-04-20T10:50:48.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.763+0000 7f92527fc640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f924006c8f0 0x7f924006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:48.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.763+0000 7f92527fc640 1 -- 172.21.15.90:0/918165064 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6431+0+0 (secure 0 0 0) 0x7f925408b4a0 con 0x7f925c0ad720 2024-04-20T10:50:48.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.763+0000 7f92619ea640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f924006c8f0 0x7f924006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:48.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.763+0000 7f92619ea640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f924006c8f0 0x7f924006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f924c006fd0 tx=0x7f924c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:48.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.767+0000 7f92527fc640 1 -- 172.21.15.90:0/918165064 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f925c1e1670 con 0x7f925c0ad720 2024-04-20T10:50:48.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:48.981+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"} v 0) -- 0x7f925c0c1c60 con 0x7f925c0ad720 2024-04-20T10:50:49.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.624+0000 7f92527fc640 1 -- 172.21.15.90:0/918165064 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "b", "metadata": "b_metadata", "data": "b_data"}]=0 new fs with metadata pool 4 and data pool 5 v8) ==== 157+0+0 (secure 0 0 0) 0x7f9254059600 con 0x7f925c0ad720 2024-04-20T10:50:49.625 INFO:teuthology.orchestra.run.smithi090.stderr:new fs with metadata pool 4 and data pool 5 2024-04-20T10:50:49.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.631+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f924006c8f0 msgr2=0x7f924006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.632+0000 7f9263c4e640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f924006c8f0 0x7f924006edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f924c006fd0 tx=0x7f924c008040 comp rx=0 tx=0).stop 2024-04-20T10:50:49.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.632+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0ad720 msgr2=0x7f925c0ab870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.632+0000 7f9263c4e640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0ad720 0x7f925c0ab870 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f925400c7d0 tx=0x7f925400cc90 comp rx=0 tx=0).stop 2024-04-20T10:50:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.637+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 shutdown_connections 2024-04-20T10:50:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.637+0000 7f9263c4e640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f924006c8f0 0x7f924006edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.637+0000 7f9263c4e640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f925c0ad720 0x7f925c0ab870 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.638+0000 7f9263c4e640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f925c0705c0 0x7f925c0ab330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.638+0000 7f9263c4e640 1 --2- 172.21.15.90:0/918165064 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f925c06e210 0x7f925c0c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.638+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 >> 172.21.15.90:0/918165064 conn(0x7f925c0c8080 msgr2=0x7f925c0c4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:49.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.641+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 shutdown_connections 2024-04-20T10:50:49.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.642+0000 7f9263c4e640 1 -- 172.21.15.90:0/918165064 wait complete. 2024-04-20T10:50:49.663 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:49.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.760+0000 7fce627ef640 1 Processor -- start 2024-04-20T10:50:49.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.760+0000 7fce627ef640 1 -- start start 2024-04-20T10:50:49.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce627ef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c153ef0 0x7fce5c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:49.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce627ef640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce5c0ab730 0x7fce5c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:49.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce627ef640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce5c15a720 con 0x7fce5c0c9ee0 2024-04-20T10:50:49.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce627ef640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fce5c15ac80 con 0x7fce5c0ab730 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce627ef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c15a9a0 con 0x7fce5c153ef0 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5b7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fce5c0ab730 0x7fce5c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c153ef0 0x7fce5c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce60d8c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fce5c0c9ee0 0x7fce5c156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:59196/0 (socket says 172.21.15.90:59196) 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce60d8c640 1 -- 172.21.15.90:0/3658953394 learned_addr learned my addr 172.21.15.90:0/3658953394 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5b7fe640 1 -- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c153ef0 msgr2=0x7fce5c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5b7fe640 1 --2- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c153ef0 0x7fce5c0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5b7fe640 1 -- 172.21.15.90:0/3658953394 >> v1:172.21.15.175:6789/0 conn(0x7fce5c0c9ee0 legacy=0x7fce5c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5affd640 1 -- 172.21.15.90:0/3658953394 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1167016272 0 0) 0x7fce54001490 con 0x7fce5c0c9ee0 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5b7fe640 1 -- 172.21.15.90:0/3658953394 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c0c6a90 con 0x7fce5c0ab730 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.761+0000 7fce5bfff640 1 --2- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c153ef0 0x7fce5c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.762+0000 7fce5b7fe640 1 --2- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 0x7fce5c1568c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce500097a0 tx=0x7fce5002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bad86e3bc2fb5e31 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.762+0000 7fce5affd640 1 -- 172.21.15.90:0/3658953394 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce50038070 con 0x7fce5c0ab730 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.762+0000 7fce5affd640 1 -- 172.21.15.90:0/3658953394 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce50031700 con 0x7fce5c0ab730 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.762+0000 7fce5affd640 1 -- 172.21.15.90:0/3658953394 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce50031ad0 con 0x7fce5c0ab730 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 -- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 msgr2=0x7fce5c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 --2- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 0x7fce5c1568c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fce500097a0 tx=0x7fce5002b7a0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 -- 172.21.15.90:0/3658953394 shutdown_connections 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 --2- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 0x7fce5c1568c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 --2- 172.21.15.90:0/3658953394 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c153ef0 0x7fce5c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 -- 172.21.15.90:0/3658953394 >> 172.21.15.90:0/3658953394 conn(0x7fce5c0cbfe0 msgr2=0x7fce5c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:49.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 -- 172.21.15.90:0/3658953394 shutdown_connections 2024-04-20T10:50:49.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.763+0000 7fce627ef640 1 -- 172.21.15.90:0/3658953394 wait complete. 2024-04-20T10:50:49.769 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.764+0000 7fce627ef640 1 Processor -- start 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.764+0000 7fce627ef640 1 -- start start 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce627ef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 0x7fce5c1509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce627ef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c0c9ee0 0x7fce5c155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce627ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c153ef0 0x7fce5c156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce627ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c0bf800 con 0x7fce5c153ef0 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce627ef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c157510 con 0x7fce5c0ab730 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce627ef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c155740 con 0x7fce5c0c9ee0 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c153ef0 0x7fce5c156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c153ef0 0x7fce5c156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37002/0 (socket says 172.21.15.90:37002) 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 -- 172.21.15.90:0/2416214988 learned_addr learned my addr 172.21.15.90:0/2416214988 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce5b7fe640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c0c9ee0 0x7fce5c155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:49.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce5bfff640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 0x7fce5c1509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 -- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c0c9ee0 msgr2=0x7fce5c155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c0c9ee0 0x7fce5c155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 -- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 msgr2=0x7fce5c1509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 0x7fce5c1509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 -- 172.21.15.90:0/2416214988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c0aec40 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.765+0000 7fce60d8c640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c153ef0 0x7fce5c156110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce5400cb20 tx=0x7fce540021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.766+0000 7fce58ff9640 1 -- 172.21.15.90:0/2416214988 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce5400ac00 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.766+0000 7fce58ff9640 1 -- 172.21.15.90:0/2416214988 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce5400adc0 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.766+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce5c0aa7b0 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.766+0000 7fce58ff9640 1 -- 172.21.15.90:0/2416214988 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce54012640 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.766+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce5c0aaa70 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.767+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce5c076150 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.767+0000 7fce58ff9640 1 -- 172.21.15.90:0/2416214988 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce540127e0 con 0x7fce5c153ef0 2024-04-20T10:50:49.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.767+0000 7fce58ff9640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce4806c8f0 0x7fce4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:49.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.768+0000 7fce58ff9640 1 -- 172.21.15.90:0/2416214988 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7fce5408c260 con 0x7fce5c153ef0 2024-04-20T10:50:49.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.768+0000 7fce5bfff640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce4806c8f0 0x7fce4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:49.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.768+0000 7fce5bfff640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce4806c8f0 0x7fce4806edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009560 tx=0x7fce4c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:49.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.772+0000 7fce58ff9640 1 -- 172.21.15.90:0/2416214988 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fce5c15a720 con 0x7fce5c153ef0 2024-04-20T10:50:49.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.948+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fce5c156650 con 0x7fce5c153ef0 2024-04-20T10:50:49.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.949+0000 7fce58ff9640 1 -- 172.21.15.90:0/2416214988 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20356 (secure 0 0 0) 0x7fce54059da0 con 0x7fce5c153ef0 2024-04-20T10:50:49.950 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:49.950 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:48.983022+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce4806c8f0 msgr2=0x7fce4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce4806c8f0 0x7fce4806edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fce4c009560 tx=0x7fce4c009190 comp rx=0 tx=0).stop 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c153ef0 msgr2=0x7fce5c156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c153ef0 0x7fce5c156110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fce5400cb20 tx=0x7fce540021c0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 shutdown_connections 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce4806c8f0 0x7fce4806edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c153ef0 0x7fce5c156110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce5c0c9ee0 0x7fce5c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 --2- 172.21.15.90:0/2416214988 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0ab730 0x7fce5c1509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.951+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 >> 172.21.15.90:0/2416214988 conn(0x7fce5c0cbfe0 msgr2=0x7fce5c1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:49.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.952+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 shutdown_connections 2024-04-20T10:50:49.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:49.952+0000 7fce627ef640 1 -- 172.21.15.90:0/2416214988 wait complete. 2024-04-20T10:50:49.963 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:50.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.058+0000 7f0884ddb640 1 Processor -- start 2024-04-20T10:50:50.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.058+0000 7f0884ddb640 1 -- start start 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f0884ddb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08800c5520 0x7f088015a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f0884ddb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08800ad640 0x7f08800c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f0884ddb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0880071650 con 0x7f0880153c50 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f0884ddb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f08800718f0 con 0x7f08800ad640 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f0884ddb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f08800c3ca0 con 0x7f08800c5520 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f087ed9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08800ad640 0x7f08800c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f087ed9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08800ad640 0x7f08800c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37012/0 (socket says 172.21.15.90:37012) 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f087ed9d640 1 -- 172.21.15.90:0/1969463296 learned_addr learned my addr 172.21.15.90:0/1969463296 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.059+0000 7f087e59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0880153c50 0x7f08800c2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32928/0 (socket says 172.21.15.90:32928) 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087ed9d640 1 -- 172.21.15.90:0/1969463296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08800c5520 msgr2=0x7f088015a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087ed9d640 1 --2- 172.21.15.90:0/1969463296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08800c5520 0x7f088015a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087ed9d640 1 -- 172.21.15.90:0/1969463296 >> v1:172.21.15.90:6789/0 conn(0x7f0880153c50 legacy=0x7f08800c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087ed9d640 1 -- 172.21.15.90:0/1969463296 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08800c3f80 con 0x7f08800ad640 2024-04-20T10:50:50.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087dd9b640 1 -- 172.21.15.90:0/1969463296 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603020868 0 0) 0x7f0880071650 con 0x7f0880153c50 2024-04-20T10:50:50.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087ed9d640 1 --2- 172.21.15.90:0/1969463296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08800c44a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0878009e50 tx=0x7f087802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae59ee206af59a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:50.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087dd9b640 1 -- 172.21.15.90:0/1969463296 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087802cb00 con 0x7f08800ad640 2024-04-20T10:50:50.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087dd9b640 1 -- 172.21.15.90:0/1969463296 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087802cca0 con 0x7f08800ad640 2024-04-20T10:50:50.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.060+0000 7f087dd9b640 1 -- 172.21.15.90:0/1969463296 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878034610 con 0x7f08800ad640 2024-04-20T10:50:50.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 -- 172.21.15.90:0/1969463296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 msgr2=0x7f08800c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1969463296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08800c44a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0878009e50 tx=0x7f087802bf60 comp rx=0 tx=0).stop 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 -- 172.21.15.90:0/1969463296 shutdown_connections 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1969463296 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08800c44a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1969463296 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f08800c5520 0x7f088015a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 -- 172.21.15.90:0/1969463296 >> 172.21.15.90:0/1969463296 conn(0x7f08800c9100 msgr2=0x7f08800c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 -- 172.21.15.90:0/1969463296 shutdown_connections 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.061+0000 7f0884ddb640 1 -- 172.21.15.90:0/1969463296 wait complete. 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.062+0000 7f0884ddb640 1 Processor -- start 2024-04-20T10:50:50.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.062+0000 7f0884ddb640 1 -- start start 2024-04-20T10:50:50.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0884ddb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08801567c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0884ddb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800c5520 0x7f088006dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0884ddb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0880153c50 0x7f08801efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0884ddb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08801541b0 con 0x7f08800ad640 2024-04-20T10:50:50.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0884ddb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0880154030 con 0x7f08800c5520 2024-04-20T10:50:50.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0884ddb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f08800c49e0 con 0x7f0880153c50 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08801567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08801567c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37028/0 (socket says 172.21.15.90:37028) 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 -- 172.21.15.90:0/1652099703 learned_addr learned my addr 172.21.15.90:0/1652099703 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087ed9d640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0880153c50 0x7f08801efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 -- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0880153c50 msgr2=0x7f08801efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0877fff640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800c5520 0x7f088006dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0880153c50 0x7f08801efa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 -- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800c5520 msgr2=0x7f088006dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800c5520 0x7f088006dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f087e59c640 1 -- 172.21.15.90:0/1652099703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0880156ea0 con 0x7f08800ad640 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.063+0000 7f0877fff640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800c5520 0x7f088006dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.064+0000 7f087e59c640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08801567c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f087000c430 tx=0x7f087000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.064+0000 7f0876ffd640 1 -- 172.21.15.90:0/1652099703 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700074e0 con 0x7f08800ad640 2024-04-20T10:50:50.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.064+0000 7f0876ffd640 1 -- 172.21.15.90:0/1652099703 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08700047e0 con 0x7f08800ad640 2024-04-20T10:50:50.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.064+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088014e960 con 0x7f08800ad640 2024-04-20T10:50:50.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.064+0000 7f0876ffd640 1 -- 172.21.15.90:0/1652099703 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870004bd0 con 0x7f08800ad640 2024-04-20T10:50:50.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.064+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088006e2b0 con 0x7f08800ad640 2024-04-20T10:50:50.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.065+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0880076150 con 0x7f08800ad640 2024-04-20T10:50:50.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.065+0000 7f0876ffd640 1 -- 172.21.15.90:0/1652099703 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0870011070 con 0x7f08800ad640 2024-04-20T10:50:50.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.065+0000 7f0876ffd640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.066+0000 7f0876ffd640 1 -- 172.21.15.90:0/1652099703 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f087008bb40 con 0x7f08800ad640 2024-04-20T10:50:50.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.066+0000 7f0877fff640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.066+0000 7f0877fff640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0868006fd0 tx=0x7f0868008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:50.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.070+0000 7f0876ffd640 1 -- 172.21.15.90:0/1652099703 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0870059c40 con 0x7f08800ad640 2024-04-20T10:50:50.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.246+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f088006f340 con 0x7f08800ad640 2024-04-20T10:50:50.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.248+0000 7f0876ffd640 1 -- 172.21.15.90:0/1652099703 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+20356 (secure 0 0 0) 0x7f0870059540 con 0x7f08800ad640 2024-04-20T10:50:50.249 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:50.250 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":24,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:48.983022+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:50.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.249+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 msgr2=0x7f086006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.249+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0868006fd0 tx=0x7f0868008040 comp rx=0 tx=0).stop 2024-04-20T10:50:50.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 msgr2=0x7f08801567c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08801567c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f087000c430 tx=0x7f087000c8f0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 shutdown_connections 2024-04-20T10:50:50.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0880153c50 0x7f08801efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800c5520 0x7f088006dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 --2- 172.21.15.90:0/1652099703 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800ad640 0x7f08801567c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 >> 172.21.15.90:0/1652099703 conn(0x7f08800c9100 msgr2=0x7f08800c2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:50.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 shutdown_connections 2024-04-20T10:50:50.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.250+0000 7f0884ddb640 1 -- 172.21.15.90:0/1652099703 wait complete. 2024-04-20T10:50:50.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b standby_count_wanted 0 2024-04-20T10:50:50.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.361+0000 7f359082c640 1 Processor -- start 2024-04-20T10:50:50.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.361+0000 7f359082c640 1 -- start start 2024-04-20T10:50:50.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f359082c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f358c157190 0x7f358c06cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f359082c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f358c0adce0 con 0x7f358c153ee0 2024-04-20T10:50:50.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f359082c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f358c0adfc0 con 0x7f358c0ab710 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f359082c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f358c0ae2a0 con 0x7f358c157190 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358ad9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f358c157190 0x7f358c06cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358a59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f358c153ee0 0x7f358c0c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32932/0 (socket says 172.21.15.90:32932) 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358a59c640 1 -- 172.21.15.90:0/326934478 learned_addr learned my addr 172.21.15.90:0/326934478 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358959a640 1 -- 172.21.15.90:0/326934478 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635948909 0 0) 0x7f358c0adce0 con 0x7f358c153ee0 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358959a640 1 -- 172.21.15.90:0/326934478 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3574003520 con 0x7f358c153ee0 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358ad9d640 1 -- 172.21.15.90:0/326934478 >> v1:172.21.15.175:6789/0 conn(0x7f358c0ab710 legacy=0x7f358c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:50.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358ad9d640 1 -- 172.21.15.90:0/326934478 >> v1:172.21.15.90:6789/0 conn(0x7f358c153ee0 legacy=0x7f358c0c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.362+0000 7f358ad9d640 1 -- 172.21.15.90:0/326934478 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c06d120 con 0x7f358c157190 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.363+0000 7f358ad9d640 1 --2- 172.21.15.90:0/326934478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c157190 0x7f358c06cbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3584009d90 tx=0x7f358402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3aed72468a4a38d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.363+0000 7f358959a640 1 -- 172.21.15.90:0/326934478 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584039070 con 0x7f358c157190 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.363+0000 7f358959a640 1 -- 172.21.15.90:0/326934478 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f358402cb40 con 0x7f358c157190 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.363+0000 7f358959a640 1 -- 172.21.15.90:0/326934478 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3584034440 con 0x7f358c157190 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.364+0000 7f359082c640 1 -- 172.21.15.90:0/326934478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c157190 msgr2=0x7f358c06cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.364+0000 7f359082c640 1 --2- 172.21.15.90:0/326934478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c157190 0x7f358c06cbe0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3584009d90 tx=0x7f358402bd90 comp rx=0 tx=0).stop 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.364+0000 7f359082c640 1 -- 172.21.15.90:0/326934478 shutdown_connections 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.364+0000 7f359082c640 1 --2- 172.21.15.90:0/326934478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c157190 0x7f358c06cbe0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.364+0000 7f359082c640 1 -- 172.21.15.90:0/326934478 >> 172.21.15.90:0/326934478 conn(0x7f358c0cc060 msgr2=0x7f358c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.364+0000 7f359082c640 1 -- 172.21.15.90:0/326934478 shutdown_connections 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.364+0000 7f359082c640 1 -- 172.21.15.90:0/326934478 wait complete. 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.365+0000 7f359082c640 1 Processor -- start 2024-04-20T10:50:50.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.365+0000 7f359082c640 1 -- start start 2024-04-20T10:50:50.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c0ab710 0x7f358c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358c153ee0 0x7f358c1ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f358c157190 0x7f358c1edc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f358c0bf950 con 0x7f358c0ab710 2024-04-20T10:50:50.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f358c0bf7d0 con 0x7f358c153ee0 2024-04-20T10:50:50.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f358c0caf70 con 0x7f358c157190 2024-04-20T10:50:50.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c0ab710 0x7f358c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c0ab710 0x7f358c0c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37034/0 (socket says 172.21.15.90:37034) 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 -- 172.21.15.90:0/112148188 learned_addr learned my addr 172.21.15.90:0/112148188 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f3589d9b640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358c153ee0 0x7f358c1ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 -- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f358c157190 msgr2=0x7f358c1edc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f358c157190 0x7f358c1edc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 -- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358c153ee0 msgr2=0x7f358c1ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358c153ee0 0x7f358c1ed710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 -- 172.21.15.90:0/112148188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c1ec2a0 con 0x7f358c0ab710 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f3589d9b640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358c153ee0 0x7f358c1ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f358a59c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c0ab710 0x7f358c0c4190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c430 tx=0x7f357c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f357affd640 1 -- 172.21.15.90:0/112148188 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c017070 con 0x7f358c0ab710 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f357affd640 1 -- 172.21.15.90:0/112148188 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f357c005ce0 con 0x7f358c0ab710 2024-04-20T10:50:50.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f357affd640 1 -- 172.21.15.90:0/112148188 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357c0072f0 con 0x7f358c0ab710 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358c0c61a0 con 0x7f358c0ab710 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.366+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358c1ec840 con 0x7f358c0ab710 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.367+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358c076150 con 0x7f358c0ab710 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.368+0000 7f357affd640 1 -- 172.21.15.90:0/112148188 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f357c01a070 con 0x7f358c0ab710 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.368+0000 7f357affd640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356c06c8f0 0x7f356c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.368+0000 7f357affd640 1 -- 172.21.15.90:0/112148188 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6521+0+0 (secure 0 0 0) 0x7f357c08b2d0 con 0x7f358c0ab710 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.368+0000 7f3589d9b640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356c06c8f0 0x7f356c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.369+0000 7f3589d9b640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356c06c8f0 0x7f356c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f358c0ae7c0 tx=0x7f3580009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:50.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.373+0000 7f357affd640 1 -- 172.21.15.90:0/112148188 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f357c059460 con 0x7f358c0ab710 2024-04-20T10:50:50.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:50.583+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f358c157930 con 0x7f358c0ab710 2024-04-20T10:50:51.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.305+0000 7f357affd640 1 -- 172.21.15.90:0/112148188 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "standby_count_wanted", "val": "0"}]=0 v10) ==== 113+0+0 (secure 0 0 0) 0x7f357c058d60 con 0x7f358c0ab710 2024-04-20T10:50:51.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356c06c8f0 msgr2=0x7f356c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356c06c8f0 0x7f356c06edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f358c0ae7c0 tx=0x7f3580009040 comp rx=0 tx=0).stop 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c0ab710 msgr2=0x7f358c0c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c0ab710 0x7f358c0c4190 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f357c00c430 tx=0x7f357c00c8f0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 shutdown_connections 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356c06c8f0 0x7f356c06edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f358c157190 0x7f358c1edc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f358c153ee0 0x7f358c1ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 --2- 172.21.15.90:0/112148188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f358c0ab710 0x7f358c0c4190 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 >> 172.21.15.90:0/112148188 conn(0x7f358c0cc060 msgr2=0x7f358c0cb300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 shutdown_connections 2024-04-20T10:50:51.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.307+0000 7f359082c640 1 -- 172.21.15.90:0/112148188 wait complete. 2024-04-20T10:50:51.321 DEBUG:tasks.cephfs.filesystem:fs_config: {'session_timeout': 300} 2024-04-20T10:50:51.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b allow_standby_replay false 2024-04-20T10:50:51.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.429+0000 7fa536f9d640 1 Processor -- start 2024-04-20T10:50:51.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.429+0000 7fa536f9d640 1 -- start start 2024-04-20T10:50:51.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.429+0000 7fa536f9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5300ab710 0x7fa530157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.429+0000 7fa536f9d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5300adce0 con 0x7fa530153ee0 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa536f9d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5300adfc0 con 0x7fa53006c4d0 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa536f9d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa5300ae2a0 con 0x7fa5300ab710 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa534d39640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa530153ee0 0x7fa5300c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32938/0 (socket says 172.21.15.90:32938) 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa534d39640 1 -- 172.21.15.90:0/3494557151 learned_addr learned my addr 172.21.15.90:0/3494557151 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3609937864 0 0) 0x7fa5300adce0 con 0x7fa530153ee0 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa51c003520 con 0x7fa530153ee0 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3494557151 >> v2:172.21.15.175:3300/0 conn(0x7fa5300ab710 0x7fa530157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3120223337 0 0) 0x7fa51c003520 con 0x7fa530153ee0 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 >> v2:172.21.15.175:3300/0 conn(0x7fa5300ab710 msgr2=0x7fa530157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:51.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 --2- 172.21.15.90:0/3494557151 >> v2:172.21.15.175:3300/0 conn(0x7fa5300ab710 0x7fa530157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 >> v1:172.21.15.175:6789/0 conn(0x7fa53006c4d0 legacy=0x7fa53006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5300c70f0 con 0x7fa530153ee0 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fa5280019f0 con 0x7fa530153ee0 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 >> v1:172.21.15.90:6789/0 conn(0x7fa530153ee0 legacy=0x7fa5300c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c0039b0 0x7fa51c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa51c004800 0x7fa51c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c0053c0 0x7fa51c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5300ae2a0 con 0x7fa51c004800 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa51c00c250 con 0x7fa51c0039b0 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa51c00c450 con 0x7fa51c0053c0 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3494557151 >> v2:172.21.15.175:3300/0 conn(0x7fa5300ab710 0x7fa530157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa51c004800 0x7fa51c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa534d39640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c0039b0 0x7fa51c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.430+0000 7fa53553a640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c0053c0 0x7fa51c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52ffff640 1 -- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c0053c0 msgr2=0x7fa51c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c0053c0 0x7fa51c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52ffff640 1 -- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c0039b0 msgr2=0x7fa51c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa51c0039b0 0x7fa51c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52ffff640 1 -- 172.21.15.90:0/3494557151 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51c003520 con 0x7fa51c004800 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa53553a640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c0053c0 0x7fa51c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa53553a640 1 -- 172.21.15.90:0/3494557151 reap_dead start 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa51c004800 0x7fa51c004c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa5180098a0 tx=0x7fa51c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3e2cb018d743f3c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa518034070 con 0x7fa51c004800 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa518030610 con 0x7fa51c004800 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.431+0000 7fa52f7fe640 1 -- 172.21.15.90:0/3494557151 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa51800f040 con 0x7fa51c004800 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.432+0000 7fa536f9d640 1 -- 172.21.15.90:0/3494557151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa51c004800 msgr2=0x7fa51c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:51.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.432+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa51c004800 0x7fa51c004c80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa5180098a0 tx=0x7fa51c005830 comp rx=0 tx=0).stop 2024-04-20T10:50:51.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.432+0000 7fa536f9d640 1 -- 172.21.15.90:0/3494557151 shutdown_connections 2024-04-20T10:50:51.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.432+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3494557151 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa51c004800 0x7fa51c004c80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.432+0000 7fa536f9d640 1 -- 172.21.15.90:0/3494557151 >> 172.21.15.90:0/3494557151 conn(0x7fa5300cc060 msgr2=0x7fa5300cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:51.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.432+0000 7fa536f9d640 1 -- 172.21.15.90:0/3494557151 shutdown_connections 2024-04-20T10:50:51.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.432+0000 7fa536f9d640 1 -- 172.21.15.90:0/3494557151 wait complete. 2024-04-20T10:50:51.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.433+0000 7fa536f9d640 1 Processor -- start 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.433+0000 7fa536f9d640 1 -- start start 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa536f9d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c004800 0x7fa5301e9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa536f9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa530158ea0 0x7fa5301efd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa536f9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5300c5270 0x7fa5300c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa536f9d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa530157310 con 0x7fa5300c5270 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa536f9d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa530157190 con 0x7fa530158ea0 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa536f9d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa530157490 con 0x7fa51c004800 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5300c5270 0x7fa5300c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5300c5270 0x7fa5300c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37050/0 (socket says 172.21.15.90:37050) 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 -- 172.21.15.90:0/3171147124 learned_addr learned my addr 172.21.15.90:0/3171147124 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:51.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa534d39640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c004800 0x7fa5301e9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa530158ea0 0x7fa5301efd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 -- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c004800 msgr2=0x7fa5301e9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c004800 0x7fa5301e9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 -- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa530158ea0 msgr2=0x7fa5301efd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa530158ea0 0x7fa5301efd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 -- 172.21.15.90:0/3171147124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa530159430 con 0x7fa5300c5270 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa534d39640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c004800 0x7fa5301e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa52ffff640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa530158ea0 0x7fa5301efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.434+0000 7fa53553a640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5300c5270 0x7fa5300c56f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5301576d0 tx=0x7fa52000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.435+0000 7fa52d7fa640 1 -- 172.21.15.90:0/3171147124 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa520019070 con 0x7fa5300c5270 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.435+0000 7fa52d7fa640 1 -- 172.21.15.90:0/3171147124 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa52000ee50 con 0x7fa5300c5270 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.435+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5300c0290 con 0x7fa5300c5270 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.435+0000 7fa52d7fa640 1 -- 172.21.15.90:0/3171147124 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5200035f0 con 0x7fa5300c5270 2024-04-20T10:50:51.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.435+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5300c0850 con 0x7fa5300c5270 2024-04-20T10:50:51.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.436+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa530076150 con 0x7fa5300c5270 2024-04-20T10:50:51.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.436+0000 7fa52d7fa640 1 -- 172.21.15.90:0/3171147124 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa520003790 con 0x7fa5300c5270 2024-04-20T10:50:51.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.436+0000 7fa52d7fa640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa51006c920 0x7fa51006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:51.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.437+0000 7fa52d7fa640 1 -- 172.21.15.90:0/3171147124 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fa52008aea0 con 0x7fa5300c5270 2024-04-20T10:50:51.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.437+0000 7fa534d39640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa51006c920 0x7fa51006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:51.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.437+0000 7fa534d39640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa51006c920 0x7fa51006ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa528002230 tx=0x7fa528006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:51.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.441+0000 7fa52d7fa640 1 -- 172.21.15.90:0/3171147124 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa520059030 con 0x7fa5300c5270 2024-04-20T10:50:51.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:51.655+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fa53015aa60 con 0x7fa5300c5270 2024-04-20T10:50:52.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.649+0000 7fa52d7fa640 1 -- 172.21.15.90:0/3171147124 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 117+0+0 (secure 0 0 0) 0x7fa520058930 con 0x7fa5300c5270 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa51006c920 msgr2=0x7fa51006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa51006c920 0x7fa51006ede0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa528002230 tx=0x7fa528006040 comp rx=0 tx=0).stop 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5300c5270 msgr2=0x7fa5300c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5300c5270 0x7fa5300c56f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa5301576d0 tx=0x7fa52000e820 comp rx=0 tx=0).stop 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 shutdown_connections 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa51006c920 0x7fa51006ede0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5300c5270 0x7fa5300c56f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa530158ea0 0x7fa5301efd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 --2- 172.21.15.90:0/3171147124 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa51c004800 0x7fa5301e9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 >> 172.21.15.90:0/3171147124 conn(0x7fa5300cc060 msgr2=0x7fa5300ca7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 shutdown_connections 2024-04-20T10:50:52.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.652+0000 7fa536f9d640 1 -- 172.21.15.90:0/3171147124 wait complete. 2024-04-20T10:50:52.666 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set b session_timeout 300 2024-04-20T10:50:52.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.769+0000 7f9b495c7640 1 Processor -- start 2024-04-20T10:50:52.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.769+0000 7f9b495c7640 1 -- start start 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b495c7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b440ab730 0x7f9b441568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b495c7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9b440c9ee0 0x7f9b44156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b495c7640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4415a720 con 0x7f9b44153ef0 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b495c7640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4415ac80 con 0x7f9b440ab730 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b495c7640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9b4415a9a0 con 0x7f9b440c9ee0 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b3bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b440ab730 0x7f9b441568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b42ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9b44153ef0 0x7f9b440c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32948/0 (socket says 172.21.15.90:32948) 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b3bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b440ab730 0x7f9b441568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37058/0 (socket says 172.21.15.90:37058) 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b42ffd640 1 -- 172.21.15.90:0/3247602266 learned_addr learned my addr 172.21.15.90:0/3247602266 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b437fe640 1 --2- 172.21.15.90:0/3247602266 >> v2:172.21.15.175:3300/0 conn(0x7f9b440c9ee0 0x7f9b44156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:52.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b3bfff640 1 -- 172.21.15.90:0/3247602266 >> v2:172.21.15.175:3300/0 conn(0x7f9b440c9ee0 msgr2=0x7f9b44156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b3bfff640 1 --2- 172.21.15.90:0/3247602266 >> v2:172.21.15.175:3300/0 conn(0x7f9b440c9ee0 0x7f9b44156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b3bfff640 1 -- 172.21.15.90:0/3247602266 >> v1:172.21.15.90:6789/0 conn(0x7f9b44153ef0 legacy=0x7f9b440c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b3bfff640 1 -- 172.21.15.90:0/3247602266 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b440c6a90 con 0x7f9b440ab730 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.770+0000 7f9b437fe640 1 --2- 172.21.15.90:0/3247602266 >> v2:172.21.15.175:3300/0 conn(0x7f9b440c9ee0 0x7f9b44156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.771+0000 7f9b3bfff640 1 --2- 172.21.15.90:0/3247602266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441568c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b441578b0 tx=0x7f9b2c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c99e38c03ecc975 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.771+0000 7f9b427fc640 1 -- 172.21.15.90:0/3247602266 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c038070 con 0x7f9b440ab730 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.771+0000 7f9b427fc640 1 -- 172.21.15.90:0/3247602266 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2c031710 con 0x7f9b440ab730 2024-04-20T10:50:52.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.771+0000 7f9b427fc640 1 -- 172.21.15.90:0/3247602266 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c031ae0 con 0x7f9b440ab730 2024-04-20T10:50:52.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.771+0000 7f9b495c7640 1 -- 172.21.15.90:0/3247602266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 msgr2=0x7f9b441568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:52.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.771+0000 7f9b495c7640 1 --2- 172.21.15.90:0/3247602266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441568c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9b441578b0 tx=0x7f9b2c02b7b0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.772+0000 7f9b495c7640 1 -- 172.21.15.90:0/3247602266 shutdown_connections 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.772+0000 7f9b495c7640 1 --2- 172.21.15.90:0/3247602266 >> v2:172.21.15.175:3300/0 conn(0x7f9b440c9ee0 0x7f9b44156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.772+0000 7f9b495c7640 1 --2- 172.21.15.90:0/3247602266 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441568c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.772+0000 7f9b495c7640 1 -- 172.21.15.90:0/3247602266 >> 172.21.15.90:0/3247602266 conn(0x7f9b440cbfe0 msgr2=0x7f9b440cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.772+0000 7f9b495c7640 1 -- 172.21.15.90:0/3247602266 shutdown_connections 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.772+0000 7f9b495c7640 1 -- 172.21.15.90:0/3247602266 wait complete. 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 Processor -- start 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 -- start start 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b440c9ee0 0x7f9b441edba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b44153ef0 0x7f9b44150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b440c9280 con 0x7f9b440ab730 2024-04-20T10:50:52.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b440c9100 con 0x7f9b440c9ee0 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b495c7640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9b440bf800 con 0x7f9b44153ef0 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.773+0000 7f9b42ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441ed660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37072/0 (socket says 172.21.15.90:37072) 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 -- 172.21.15.90:0/13307492 learned_addr learned my addr 172.21.15.90:0/13307492 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 -- 172.21.15.90:0/13307492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b44153ef0 msgr2=0x7f9b44150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b3bfff640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b440c9ee0 0x7f9b441edba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b44153ef0 0x7f9b44150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 -- 172.21.15.90:0/13307492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b440c9ee0 msgr2=0x7f9b441edba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b440c9ee0 0x7f9b441edba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 -- 172.21.15.90:0/13307492 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b44159930 con 0x7f9b440ab730 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b42ffd640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441ed660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c3f0 tx=0x7f9b3400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b3b7fe640 1 -- 172.21.15.90:0/13307492 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b34017070 con 0x7f9b440ab730 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b3b7fe640 1 -- 172.21.15.90:0/13307492 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b34005ce0 con 0x7f9b440ab730 2024-04-20T10:50:52.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b3b7fe640 1 -- 172.21.15.90:0/13307492 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b340072f0 con 0x7f9b440ab730 2024-04-20T10:50:52.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b440c1310 con 0x7f9b440ab730 2024-04-20T10:50:52.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.774+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b440c18d0 con 0x7f9b440ab730 2024-04-20T10:50:52.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.775+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b440695c0 con 0x7f9b440ab730 2024-04-20T10:50:52.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.776+0000 7f9b3b7fe640 1 -- 172.21.15.90:0/13307492 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b3401a070 con 0x7f9b440ab730 2024-04-20T10:50:52.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.776+0000 7f9b3b7fe640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b2406c8f0 0x7f9b2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:52.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.776+0000 7f9b3bfff640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b2406c8f0 0x7f9b2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:52.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.776+0000 7f9b3b7fe640 1 -- 172.21.15.90:0/13307492 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9b3408b170 con 0x7f9b440ab730 2024-04-20T10:50:52.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.776+0000 7f9b3bfff640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b2406c8f0 0x7f9b2406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c035000 tx=0x7f9b2c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:52.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.780+0000 7f9b3b7fe640 1 -- 172.21.15.90:0/13307492 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9b440695c0 con 0x7f9b440ab730 2024-04-20T10:50:52.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:52.990+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"} v 0) -- 0x7f9b44152680 con 0x7f9b440ab730 2024-04-20T10:50:53.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.650+0000 7f9b3b7fe640 1 -- 172.21.15.90:0/13307492 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "b", "var": "session_timeout", "val": "300"}]=0 v12) ==== 110+0+0 (secure 0 0 0) 0x7f9b4415a720 con 0x7f9b440ab730 2024-04-20T10:50:53.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b2406c8f0 msgr2=0x7f9b2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b2406c8f0 0x7f9b2406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c035000 tx=0x7f9b2c008030 comp rx=0 tx=0).stop 2024-04-20T10:50:53.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 msgr2=0x7f9b441ed660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441ed660 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f9b3400c3f0 tx=0x7f9b3400c8b0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 shutdown_connections 2024-04-20T10:50:53.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b2406c8f0 0x7f9b2406edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b44153ef0 0x7f9b44150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b440c9ee0 0x7f9b441edba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 --2- 172.21.15.90:0/13307492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b440ab730 0x7f9b441ed660 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 >> 172.21.15.90:0/13307492 conn(0x7f9b440cbfe0 msgr2=0x7f9b440cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:53.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 shutdown_connections 2024-04-20T10:50:53.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.653+0000 7f9b495c7640 1 -- 172.21.15.90:0/13307492 wait complete. 2024-04-20T10:50:53.668 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'b' 2024-04-20T10:50:53.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:50:53.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.770+0000 7fc16f1bd640 1 Processor -- start 2024-04-20T10:50:53.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.770+0000 7fc16f1bd640 1 -- start start 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc16f1bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 0x7fc1680c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc16f1bd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1680c7100 con 0x7fc168153df0 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc16f1bd640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16806c160 con 0x7fc16815a810 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc16f1bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1680ca690 con 0x7fc16806cc40 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc16cf59640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc168153df0 0x7fc1680c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32964/0 (socket says 172.21.15.90:32964) 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc16cf59640 1 -- 172.21.15.90:0/3527986416 learned_addr learned my addr 172.21.15.90:0/3527986416 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc167fff640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 0x7fc1680c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292566689 0 0) 0x7fc1680c7100 con 0x7fc168153df0 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc158003520 con 0x7fc168153df0 2024-04-20T10:50:53.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1979541328 0 0) 0x7fc158003520 con 0x7fc168153df0 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 msgr2=0x7fc1680c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 0x7fc1680c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 >> v1:172.21.15.175:6789/0 conn(0x7fc16815a810 legacy=0x7fc1680c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16806c440 con 0x7fc168153df0 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fc15c001670 con 0x7fc168153df0 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 >> v1:172.21.15.90:6789/0 conn(0x7fc168153df0 legacy=0x7fc1680c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1580039e0 0x7fc158003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 0x7fc158004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc158004d40 0x7fc1580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1680ca690 con 0x7fc158004d40 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc15800bb80 con 0x7fc1580039e0 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.771+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc15800bd80 con 0x7fc16806cc40 2024-04-20T10:50:53.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16d75a640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc158004d40 0x7fc1580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16cf59640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1580039e0 0x7fc158003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc167fff640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 0x7fc158004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16d75a640 1 -- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 msgr2=0x7fc158004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16d75a640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16806cc40 0x7fc158004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16d75a640 1 -- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1580039e0 msgr2=0x7fc158003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16d75a640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc1580039e0 0x7fc158003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16d75a640 1 -- 172.21.15.90:0/3527986416 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc158003520 con 0x7fc158004d40 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.772+0000 7fc16d75a640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc158004d40 0x7fc1580051c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc160001e50 tx=0x7fc158005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5623d28f3b51438 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc160001a70 con 0x7fc158004d40 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc160003b70 con 0x7fc158004d40 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc1677fe640 1 -- 172.21.15.90:0/3527986416 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1600050d0 con 0x7fc158004d40 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc16f1bd640 1 -- 172.21.15.90:0/3527986416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc158004d40 msgr2=0x7fc1580051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc16f1bd640 1 --2- 172.21.15.90:0/3527986416 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc158004d40 0x7fc1580051c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc160001e50 tx=0x7fc158005830 comp rx=0 tx=0).stop 2024-04-20T10:50:53.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc16d75a640 1 -- 172.21.15.90:0/3527986416 reap_dead start 2024-04-20T10:50:53.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc16f1bd640 1 -- 172.21.15.90:0/3527986416 shutdown_connections 2024-04-20T10:50:53.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc16f1bd640 1 -- 172.21.15.90:0/3527986416 >> 172.21.15.90:0/3527986416 conn(0x7fc1680adbd0 msgr2=0x7fc1680adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:53.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc16f1bd640 1 -- 172.21.15.90:0/3527986416 shutdown_connections 2024-04-20T10:50:53.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.773+0000 7fc16f1bd640 1 -- 172.21.15.90:0/3527986416 wait complete. 2024-04-20T10:50:53.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.774+0000 7fc16f1bd640 1 Processor -- start 2024-04-20T10:50:53.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.774+0000 7fc16f1bd640 1 -- start start 2024-04-20T10:50:53.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16f1bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1681ef810 0x7fc1681509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16f1bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16814fa00 0x7fc1681efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16f1bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc168154db0 0x7fc168155260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16f1bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc1681541d0 con 0x7fc1681ef810 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16f1bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc16806c7b0 con 0x7fc168154db0 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16f1bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc1680c73e0 con 0x7fc16814fa00 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1681ef810 0x7fc1681509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1681ef810 0x7fc1681509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37104/0 (socket says 172.21.15.90:37104) 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 -- 172.21.15.90:0/327078148 learned_addr learned my addr 172.21.15.90:0/327078148 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16d75a640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc168154db0 0x7fc168155260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc167fff640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16814fa00 0x7fc1681efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 -- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16814fa00 msgr2=0x7fc1681efbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16814fa00 0x7fc1681efbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 -- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc168154db0 msgr2=0x7fc168155260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc168154db0 0x7fc168155260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.775+0000 7fc16cf59640 1 -- 172.21.15.90:0/327078148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16814ec40 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.776+0000 7fc16cf59640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1681ef810 0x7fc1681509e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc15c007fa0 tx=0x7fc15c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.776+0000 7fc1657fa640 1 -- 172.21.15.90:0/327078148 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c007740 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.776+0000 7fc1657fa640 1 -- 172.21.15.90:0/327078148 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c018070 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.776+0000 7fc1657fa640 1 -- 172.21.15.90:0/327078148 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c00fbd0 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.776+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc16814ef20 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.776+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc16814f4e0 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.777+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc16814f6e0 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.777+0000 7fc1657fa640 1 -- 172.21.15.90:0/327078148 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc15c01d460 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.777+0000 7fc1657fa640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc14c06cac0 0x7fc14c06ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.778+0000 7fc1657fa640 1 -- 172.21.15.90:0/327078148 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fc15c08beb0 con 0x7fc1681ef810 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.778+0000 7fc167fff640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc14c06cac0 0x7fc14c06ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.778+0000 7fc167fff640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc14c06cac0 0x7fc14c06ef80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1680c3040 tx=0x7fc154008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:53.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.782+0000 7fc1657fa640 1 -- 172.21.15.90:0/327078148 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc16814f6e0 con 0x7fc1681ef810 2024-04-20T10:50:53.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.993+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc168076150 con 0x7fc1681ef810 2024-04-20T10:50:53.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.994+0000 7fc1657fa640 1 -- 172.21.15.90:0/327078148 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fc15c05a070 con 0x7fc1681ef810 2024-04-20T10:50:53.995 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:53.995 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:50:53.995 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:50:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc14c06cac0 msgr2=0x7fc14c06ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc14c06cac0 0x7fc14c06ef80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc1680c3040 tx=0x7fc154008040 comp rx=0 tx=0).stop 2024-04-20T10:50:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1681ef810 msgr2=0x7fc1681509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1681ef810 0x7fc1681509e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc15c007fa0 tx=0x7fc15c0074f0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 shutdown_connections 2024-04-20T10:50:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc14c06cac0 0x7fc14c06ef80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc168154db0 0x7fc168155260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc16814fa00 0x7fc1681efbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 --2- 172.21.15.90:0/327078148 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc1681ef810 0x7fc1681509e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:53.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 >> 172.21.15.90:0/327078148 conn(0x7fc1680adbd0 msgr2=0x7fc1680cba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:53.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 shutdown_connections 2024-04-20T10:50:53.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:53.996+0000 7fc16f1bd640 1 -- 172.21.15.90:0/327078148 wait complete. 2024-04-20T10:50:54.008 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:54.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.103+0000 7f48da862640 1 Processor -- start 2024-04-20T10:50:54.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.103+0000 7f48da862640 1 -- start start 2024-04-20T10:50:54.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48da862640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48d4073810 0x7f48d4154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48da862640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4157710 0x7f48d40c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48da862640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f48d40ad0c0 0x7f48d40ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48da862640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f48d41569e0 con 0x7f48d4073810 2024-04-20T10:50:54.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48da862640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f48d4157280 con 0x7f48d40ad0c0 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48da862640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f48d40c40d0 con 0x7f48d4157710 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48d4073810 0x7f48d4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f48d4073810 0x7f48d4154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37106/0 (socket says 172.21.15.90:37106) 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 -- 172.21.15.90:0/2522294904 learned_addr learned my addr 172.21.15.90:0/2522294904 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d8dff640 1 --2- 172.21.15.90:0/2522294904 >> v2:172.21.15.175:3300/0 conn(0x7f48d40ad0c0 0x7f48d40ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d37fe640 1 --2- 172.21.15.90:0/2522294904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4157710 0x7f48d40c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 -- 172.21.15.90:0/2522294904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4157710 msgr2=0x7f48d40c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 --2- 172.21.15.90:0/2522294904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4157710 0x7f48d40c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 -- 172.21.15.90:0/2522294904 >> v2:172.21.15.175:3300/0 conn(0x7f48d40ad0c0 msgr2=0x7f48d40ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 --2- 172.21.15.90:0/2522294904 >> v2:172.21.15.175:3300/0 conn(0x7f48d40ad0c0 0x7f48d40ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d3fff640 1 -- 172.21.15.90:0/2522294904 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d40c4370 con 0x7f48d4073810 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d37fe640 1 --2- 172.21.15.90:0/2522294904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4157710 0x7f48d40c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:54.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.104+0000 7f48d8dff640 1 --2- 172.21.15.90:0/2522294904 >> v2:172.21.15.175:3300/0 conn(0x7f48d40ad0c0 0x7f48d40ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:54.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.105+0000 7f48d3fff640 1 --2- 172.21.15.90:0/2522294904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4073810 0x7f48d4154000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f48d40702f0 tx=0x7f48bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6a4be37b8fa8a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.105+0000 7f48d2ffd640 1 -- 172.21.15.90:0/2522294904 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc02e070 con 0x7f48d4073810 2024-04-20T10:50:54.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.105+0000 7f48d2ffd640 1 -- 172.21.15.90:0/2522294904 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48bc037070 con 0x7f48d4073810 2024-04-20T10:50:54.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.105+0000 7f48d2ffd640 1 -- 172.21.15.90:0/2522294904 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48bc031a00 con 0x7f48d4073810 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 -- 172.21.15.90:0/2522294904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4073810 msgr2=0x7f48d4154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 --2- 172.21.15.90:0/2522294904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4073810 0x7f48d4154000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f48d40702f0 tx=0x7f48bc02b880 comp rx=0 tx=0).stop 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 -- 172.21.15.90:0/2522294904 shutdown_connections 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 --2- 172.21.15.90:0/2522294904 >> v2:172.21.15.175:3300/0 conn(0x7f48d40ad0c0 0x7f48d40ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 --2- 172.21.15.90:0/2522294904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4157710 0x7f48d40c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 --2- 172.21.15.90:0/2522294904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4073810 0x7f48d4154000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 -- 172.21.15.90:0/2522294904 >> 172.21.15.90:0/2522294904 conn(0x7f48d40c8080 msgr2=0x7f48d40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 -- 172.21.15.90:0/2522294904 shutdown_connections 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.106+0000 7f48da862640 1 -- 172.21.15.90:0/2522294904 wait complete. 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.107+0000 7f48da862640 1 Processor -- start 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.107+0000 7f48da862640 1 -- start start 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48da862640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4073810 0x7f48d40c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48da862640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d40ad0c0 0x7f48d414d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48da862640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4157710 0x7f48d41e0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48da862640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4073bf0 con 0x7f48d4157710 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48da862640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f48d4156f10 con 0x7f48d40ad0c0 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48da862640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f48d40abbb0 con 0x7f48d4073810 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4157710 0x7f48d41e0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4157710 0x7f48d41e0e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37118/0 (socket says 172.21.15.90:37118) 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 -- 172.21.15.90:0/207446407 learned_addr learned my addr 172.21.15.90:0/207446407 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d37fe640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d40ad0c0 0x7f48d414d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d3fff640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4073810 0x7f48d40c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 -- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4073810 msgr2=0x7f48d40c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4073810 0x7f48d40c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 -- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d40ad0c0 msgr2=0x7f48d414d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d40ad0c0 0x7f48d414d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 -- 172.21.15.90:0/207446407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d414dcd0 con 0x7f48d4157710 2024-04-20T10:50:54.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.108+0000 7f48d8dff640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4157710 0x7f48d41e0e60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00cea0 tx=0x7f48cc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.109+0000 7f48d0ff9640 1 -- 172.21.15.90:0/207446407 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc003b90 con 0x7f48d4157710 2024-04-20T10:50:54.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.109+0000 7f48d0ff9640 1 -- 172.21.15.90:0/207446407 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48cc003d50 con 0x7f48d4157710 2024-04-20T10:50:54.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.109+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d40c1a20 con 0x7f48d4157710 2024-04-20T10:50:54.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.109+0000 7f48d0ff9640 1 -- 172.21.15.90:0/207446407 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc004260 con 0x7f48d4157710 2024-04-20T10:50:54.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.109+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d4071920 con 0x7f48d4157710 2024-04-20T10:50:54.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.110+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d4071b20 con 0x7f48d4157710 2024-04-20T10:50:54.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.110+0000 7f48d0ff9640 1 -- 172.21.15.90:0/207446407 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f48cc004400 con 0x7f48d4157710 2024-04-20T10:50:54.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.110+0000 7f48d0ff9640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f48b406c8f0 0x7f48b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.111+0000 7f48d0ff9640 1 -- 172.21.15.90:0/207446407 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f48cc08c7f0 con 0x7f48d4157710 2024-04-20T10:50:54.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.111+0000 7f48d3fff640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f48b406c8f0 0x7f48b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.111+0000 7f48d3fff640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f48b406c8f0 0x7f48b406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f48bc036000 tx=0x7f48bc03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.115+0000 7f48d0ff9640 1 -- 172.21.15.90:0/207446407 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f48d4071b20 con 0x7f48d4157710 2024-04-20T10:50:54.212 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-04-20T10:50:54.210+0000 7fc40a8aa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:50:54.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.291+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f48d4071430 con 0x7f48d4157710 2024-04-20T10:50:54.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.292+0000 7f48d0ff9640 1 -- 172.21.15.90:0/207446407 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f48d414dcd0 con 0x7f48d4157710 2024-04-20T10:50:54.294 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:54.294 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f48b406c8f0 msgr2=0x7f48b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f48b406c8f0 0x7f48b406edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f48bc036000 tx=0x7f48bc03d040 comp rx=0 tx=0).stop 2024-04-20T10:50:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4157710 msgr2=0x7f48d41e0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4157710 0x7f48d41e0e60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f48cc00cea0 tx=0x7f48cc00cf90 comp rx=0 tx=0).stop 2024-04-20T10:50:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 shutdown_connections 2024-04-20T10:50:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f48b406c8f0 0x7f48b406edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f48d4157710 0x7f48d41e0e60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f48d40ad0c0 0x7f48d414d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 --2- 172.21.15.90:0/207446407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f48d4073810 0x7f48d40c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 >> 172.21.15.90:0/207446407 conn(0x7f48d40c8080 msgr2=0x7f48d4152510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:54.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 shutdown_connections 2024-04-20T10:50:54.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.294+0000 7f48da862640 1 -- 172.21.15.90:0/207446407 wait complete. 2024-04-20T10:50:54.307 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-20T10:50:54.307 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:50:54.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.402+0000 7f9bf9ec1640 1 Processor -- start 2024-04-20T10:50:54.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.402+0000 7f9bf9ec1640 1 -- start start 2024-04-20T10:50:54.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.403+0000 7f9bf9ec1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf406ca40 0x7f9bf4153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.403+0000 7f9bf9ec1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf4071fa0 con 0x7f9bf4150c00 2024-04-20T10:50:54.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.403+0000 7f9bf9ec1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bf4153500 con 0x7f9bf406f330 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.403+0000 7f9bf9ec1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf40c4210 con 0x7f9bf406ca40 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.403+0000 7f9bf37fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9bf4150c00 0x7f9bf40c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32978/0 (socket says 172.21.15.90:32978) 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.403+0000 7f9bf37fe640 1 -- 172.21.15.90:0/3033920332 learned_addr learned my addr 172.21.15.90:0/3033920332 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.403+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971890570 0 0) 0x7f9bf4071fa0 con 0x7f9bf4150c00 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bdc003520 con 0x7f9bf4150c00 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf2ffd640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf406ca40 0x7f9bf4153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4034326870 0 0) 0x7f9bdc003520 con 0x7f9bf4150c00 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf406ca40 msgr2=0x7f9bf4153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf406ca40 0x7f9bf4153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 >> v1:172.21.15.175:6789/0 conn(0x7f9bf406f330 legacy=0x7f9bf406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf406ced0 con 0x7f9bf4150c00 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f9be4001670 con 0x7f9bf4150c00 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 >> v1:172.21.15.90:6789/0 conn(0x7f9bf4150c00 legacy=0x7f9bf40c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0039e0 0x7f9bdc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc004800 0x7f9bdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0051c0 0x7f9bdc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf40c4210 con 0x7f9bdc0051c0 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc00bf60 con 0x7f9bdc004800 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc00c160 con 0x7f9bdc0039e0 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf3fff640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0051c0 0x7f9bdc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf37fe640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0039e0 0x7f9bdc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf2ffd640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc004800 0x7f9bdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0039e0 msgr2=0x7f9bdc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf3fff640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0039e0 0x7f9bdc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc004800 msgr2=0x7f9bdc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:54.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf3fff640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc004800 0x7f9bdc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.404+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3033920332 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc003520 con 0x7f9bdc0051c0 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.405+0000 7f9bf3fff640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0051c0 0x7f9bdc00b9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9bec004480 tx=0x7f9bdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562154eef41a3908 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.405+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec034070 con 0x7f9bdc0051c0 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.405+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec030400 con 0x7f9bdc0051c0 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.405+0000 7f9bf27fc640 1 -- 172.21.15.90:0/3033920332 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec004080 con 0x7f9bdc0051c0 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.406+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3033920332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0051c0 msgr2=0x7f9bdc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.406+0000 7f9bf9ec1640 1 --2- 172.21.15.90:0/3033920332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0051c0 0x7f9bdc00b9c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9bec004480 tx=0x7f9bdc005830 comp rx=0 tx=0).stop 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.406+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3033920332 reap_dead start 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.406+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3033920332 shutdown_connections 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.406+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3033920332 >> 172.21.15.90:0/3033920332 conn(0x7f9bf40c9100 msgr2=0x7f9bf40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.406+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3033920332 shutdown_connections 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.406+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3033920332 wait complete. 2024-04-20T10:50:54.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.407+0000 7f9bf9ec1640 1 Processor -- start 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.407+0000 7f9bf9ec1640 1 -- start start 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.407+0000 7f9bf9ec1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bf40c27a0 0x7f9bf41f00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.407+0000 7f9bf9ec1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf40ac1b0 0x7f9bf40ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf9ec1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bf41545c0 0x7f9bf41469a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf9ec1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf406d1b0 con 0x7f9bf41545c0 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf9ec1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9bf4153a80 con 0x7f9bf40c27a0 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf9ec1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9bf406db60 con 0x7f9bf40ac1b0 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bf41545c0 0x7f9bf41469a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bf41545c0 0x7f9bf41469a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37144/0 (socket says 172.21.15.90:37144) 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3460987389 learned_addr learned my addr 172.21.15.90:0/3460987389 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf37fe640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bf40c27a0 0x7f9bf41f00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf2ffd640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf40ac1b0 0x7f9bf40ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf40ac1b0 msgr2=0x7f9bf40ad990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf40ac1b0 0x7f9bf40ad990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bf40c27a0 msgr2=0x7f9bf41f00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bf40c27a0 0x7f9bf41f00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 -- 172.21.15.90:0/3460987389 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bf41ecb80 con 0x7f9bf41545c0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf3fff640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bf41545c0 0x7f9bf41469a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0041f0 tx=0x7f9bec003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bdbfff640 1 -- 172.21.15.90:0/3460987389 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec047070 con 0x7f9bf41545c0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bdbfff640 1 -- 172.21.15.90:0/3460987389 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bec030d60 con 0x7f9bf41545c0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bf41ece60 con 0x7f9bf41545c0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bdbfff640 1 -- 172.21.15.90:0/3460987389 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bec034040 con 0x7f9bf41545c0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.408+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bf41efb80 con 0x7f9bf41545c0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.409+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf41efd80 con 0x7f9bf41545c0 2024-04-20T10:50:54.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.410+0000 7f9bdbfff640 1 -- 172.21.15.90:0/3460987389 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bec04a070 con 0x7f9bf41545c0 2024-04-20T10:50:54.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.410+0000 7f9bdbfff640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9be006c8f0 0x7f9be006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.410+0000 7f9bdbfff640 1 -- 172.21.15.90:0/3460987389 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9bec0acf90 con 0x7f9bf41545c0 2024-04-20T10:50:54.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.410+0000 7f9bf37fe640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9be006c8f0 0x7f9be006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.410+0000 7f9bf37fe640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9be006c8f0 0x7f9be006edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9be4007d90 tx=0x7f9be4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.414+0000 7f9bdbfff640 1 -- 172.21.15.90:0/3460987389 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9bf41efd80 con 0x7f9bf41545c0 2024-04-20T10:50:54.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.587+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bf41f05e0 con 0x7f9be006c8f0 2024-04-20T10:50:54.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.599+0000 7f9bdbfff640 1 -- 172.21.15.90:0/3460987389 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490416 (secure 0 0 0) 0x7f9be4007680 con 0x7f9be006c8f0 2024-04-20T10:50:54.608 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:54.611 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:50:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9be006c8f0 msgr2=0x7f9be006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9be006c8f0 0x7f9be006edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9be4007d90 tx=0x7f9be4009040 comp rx=0 tx=0).stop 2024-04-20T10:50:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bf41545c0 msgr2=0x7f9bf41469a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bf41545c0 0x7f9bf41469a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0041f0 tx=0x7f9bec003a70 comp rx=0 tx=0).stop 2024-04-20T10:50:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 shutdown_connections 2024-04-20T10:50:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9be006c8f0 0x7f9be006edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bf41545c0 0x7f9bf41469a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bf40ac1b0 0x7f9bf40ad990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 --2- 172.21.15.90:0/3460987389 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bf40c27a0 0x7f9bf41f00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 >> 172.21.15.90:0/3460987389 conn(0x7f9bf40c9100 msgr2=0x7f9bf414e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:54.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 shutdown_connections 2024-04-20T10:50:54.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.603+0000 7f9bf9ec1640 1 -- 172.21.15.90:0/3460987389 wait complete. 2024-04-20T10:50:54.615 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-20T10:50:53.665544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":369,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3308,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3387392,"data_stored":1986297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000915"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646500+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:50:50.646500+0000","last_peered":"2024-04-20T10:50:50.646500+0000","last_clean":"2024-04-20T10:50:50.646500+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:50:50.646500+0000","last_undegraded":"2024-04-20T10:50:50.646500+0000","last_fullsized":"2024-04-20T10:50:50.646500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647942+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:50.647942+0000","last_peered":"2024-04-20T10:50:50.647942+0000","last_clean":"2024-04-20T10:50:50.647942+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:50.647942+0000","last_undegraded":"2024-04-20T10:50:50.647942+0000","last_fullsized":"2024-04-20T10:50:50.647942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647361+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:50:50.647361+0000","last_peered":"2024-04-20T10:50:50.647361+0000","last_clean":"2024-04-20T10:50:50.647361+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:50:50.647361+0000","last_undegraded":"2024-04-20T10:50:50.647361+0000","last_fullsized":"2024-04-20T10:50:50.647361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918471+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:50:50.918471+0000","last_peered":"2024-04-20T10:50:50.918471+0000","last_clean":"2024-04-20T10:50:50.918471+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:50:50.918471+0000","last_undegraded":"2024-04-20T10:50:50.918471+0000","last_fullsized":"2024-04-20T10:50:50.918471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648170+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:50.648170+0000","last_peered":"2024-04-20T10:50:50.648170+0000","last_clean":"2024-04-20T10:50:50.648170+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:50.648170+0000","last_undegraded":"2024-04-20T10:50:50.648170+0000","last_fullsized":"2024-04-20T10:50:50.648170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918903+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:50.918903+0000","last_peered":"2024-04-20T10:50:50.918903+0000","last_clean":"2024-04-20T10:50:50.918903+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:50.918903+0000","last_undegraded":"2024-04-20T10:50:50.918903+0000","last_fullsized":"2024-04-20T10:50:50.918903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646446+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:50:50.646446+0000","last_peered":"2024-04-20T10:50:50.646446+0000","last_clean":"2024-04-20T10:50:50.646446+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:50:50.646446+0000","last_undegraded":"2024-04-20T10:50:50.646446+0000","last_fullsized":"2024-04-20T10:50:50.646446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918478+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:50:50.918478+0000","last_peered":"2024-04-20T10:50:50.918478+0000","last_clean":"2024-04-20T10:50:50.918478+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:50:50.918478+0000","last_undegraded":"2024-04-20T10:50:50.918478+0000","last_fullsized":"2024-04-20T10:50:50.918478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920014+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:50.920014+0000","last_peered":"2024-04-20T10:50:50.920014+0000","last_clean":"2024-04-20T10:50:50.920014+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:50.920014+0000","last_undegraded":"2024-04-20T10:50:50.920014+0000","last_fullsized":"2024-04-20T10:50:50.920014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918841+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:50.918841+0000","last_peered":"2024-04-20T10:50:50.918841+0000","last_clean":"2024-04-20T10:50:50.918841+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:50.918841+0000","last_undegraded":"2024-04-20T10:50:50.918841+0000","last_fullsized":"2024-04-20T10:50:50.918841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646788+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:50:50.646788+0000","last_peered":"2024-04-20T10:50:50.646788+0000","last_clean":"2024-04-20T10:50:50.646788+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:50:50.646788+0000","last_undegraded":"2024-04-20T10:50:50.646788+0000","last_fullsized":"2024-04-20T10:50:50.646788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918243+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:50:50.918243+0000","last_peered":"2024-04-20T10:50:50.918243+0000","last_clean":"2024-04-20T10:50:50.918243+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:50:50.918243+0000","last_undegraded":"2024-04-20T10:50:50.918243+0000","last_fullsized":"2024-04-20T10:50:50.918243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919668+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:50.919668+0000","last_peered":"2024-04-20T10:50:50.919668+0000","last_clean":"2024-04-20T10:50:50.919668+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:50.919668+0000","last_undegraded":"2024-04-20T10:50:50.919668+0000","last_fullsized":"2024-04-20T10:50:50.919668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919525+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:50.919525+0000","last_peered":"2024-04-20T10:50:50.919525+0000","last_clean":"2024-04-20T10:50:50.919525+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:50.919525+0000","last_undegraded":"2024-04-20T10:50:50.919525+0000","last_fullsized":"2024-04-20T10:50:50.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646886+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:50:50.646886+0000","last_peered":"2024-04-20T10:50:50.646886+0000","last_clean":"2024-04-20T10:50:50.646886+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:50:50.646886+0000","last_undegraded":"2024-04-20T10:50:50.646886+0000","last_fullsized":"2024-04-20T10:50:50.646886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919828+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:50:50.919828+0000","last_peered":"2024-04-20T10:50:50.919828+0000","last_clean":"2024-04-20T10:50:50.919828+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:50:50.919828+0000","last_undegraded":"2024-04-20T10:50:50.919828+0000","last_fullsized":"2024-04-20T10:50:50.919828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647374+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:50:50.647374+0000","last_peered":"2024-04-20T10:50:50.647374+0000","last_clean":"2024-04-20T10:50:50.647374+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:50:50.647374+0000","last_undegraded":"2024-04-20T10:50:50.647374+0000","last_fullsized":"2024-04-20T10:50:50.647374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919489+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:50:50.919489+0000","last_peered":"2024-04-20T10:50:50.919489+0000","last_clean":"2024-04-20T10:50:50.919489+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:50:50.919489+0000","last_undegraded":"2024-04-20T10:50:50.919489+0000","last_fullsized":"2024-04-20T10:50:50.919489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647710+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:50.647710+0000","last_peered":"2024-04-20T10:50:50.647710+0000","last_clean":"2024-04-20T10:50:50.647710+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:50.647710+0000","last_undegraded":"2024-04-20T10:50:50.647710+0000","last_fullsized":"2024-04-20T10:50:50.647710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:07.016612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918599+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:50.918599+0000","last_peered":"2024-04-20T10:50:50.918599+0000","last_clean":"2024-04-20T10:50:50.918599+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:50.918599+0000","last_undegraded":"2024-04-20T10:50:50.918599+0000","last_fullsized":"2024-04-20T10:50:50.918599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647233+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:50:50.647233+0000","last_peered":"2024-04-20T10:50:50.647233+0000","last_clean":"2024-04-20T10:50:50.647233+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:50:50.647233+0000","last_undegraded":"2024-04-20T10:50:50.647233+0000","last_fullsized":"2024-04-20T10:50:50.647233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647083+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:50:50.647083+0000","last_peered":"2024-04-20T10:50:50.647083+0000","last_clean":"2024-04-20T10:50:50.647083+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:50:50.647083+0000","last_undegraded":"2024-04-20T10:50:50.647083+0000","last_fullsized":"2024-04-20T10:50:50.647083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647704+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:50.647704+0000","last_peered":"2024-04-20T10:50:50.647704+0000","last_clean":"2024-04-20T10:50:50.647704+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:50.647704+0000","last_undegraded":"2024-04-20T10:50:50.647704+0000","last_fullsized":"2024-04-20T10:50:50.647704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918767+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:50.918767+0000","last_peered":"2024-04-20T10:50:50.918767+0000","last_clean":"2024-04-20T10:50:50.918767+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:50.918767+0000","last_undegraded":"2024-04-20T10:50:50.918767+0000","last_fullsized":"2024-04-20T10:50:50.918767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919440+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:50:50.919440+0000","last_peered":"2024-04-20T10:50:50.919440+0000","last_clean":"2024-04-20T10:50:50.919440+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:50:50.919440+0000","last_undegraded":"2024-04-20T10:50:50.919440+0000","last_fullsized":"2024-04-20T10:50:50.919440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919258+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:50:50.919258+0000","last_peered":"2024-04-20T10:50:50.919258+0000","last_clean":"2024-04-20T10:50:50.919258+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:50:50.919258+0000","last_undegraded":"2024-04-20T10:50:50.919258+0000","last_fullsized":"2024-04-20T10:50:50.919258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647487+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:50.647487+0000","last_peered":"2024-04-20T10:50:50.647487+0000","last_clean":"2024-04-20T10:50:50.647487+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:50.647487+0000","last_undegraded":"2024-04-20T10:50:50.647487+0000","last_fullsized":"2024-04-20T10:50:50.647487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918378+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:50.918378+0000","last_peered":"2024-04-20T10:50:50.918378+0000","last_clean":"2024-04-20T10:50:50.918378+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:50.918378+0000","last_undegraded":"2024-04-20T10:50:50.918378+0000","last_fullsized":"2024-04-20T10:50:50.918378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647210+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:50:50.647210+0000","last_peered":"2024-04-20T10:50:50.647210+0000","last_clean":"2024-04-20T10:50:50.647210+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:50:50.647210+0000","last_undegraded":"2024-04-20T10:50:50.647210+0000","last_fullsized":"2024-04-20T10:50:50.647210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647499+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:50:50.647499+0000","last_peered":"2024-04-20T10:50:50.647499+0000","last_clean":"2024-04-20T10:50:50.647499+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:50:50.647499+0000","last_undegraded":"2024-04-20T10:50:50.647499+0000","last_fullsized":"2024-04-20T10:50:50.647499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919297+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:50.919297+0000","last_peered":"2024-04-20T10:50:50.919297+0000","last_clean":"2024-04-20T10:50:50.919297+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:50.919297+0000","last_undegraded":"2024-04-20T10:50:50.919297+0000","last_fullsized":"2024-04-20T10:50:50.919297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904955+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:50.904955+0000","last_peered":"2024-04-20T10:50:50.904955+0000","last_clean":"2024-04-20T10:50:50.904955+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:50.904955+0000","last_undegraded":"2024-04-20T10:50:50.904955+0000","last_fullsized":"2024-04-20T10:50:50.904955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647061+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:50:50.647061+0000","last_peered":"2024-04-20T10:50:50.647061+0000","last_clean":"2024-04-20T10:50:50.647061+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:50:50.647061+0000","last_undegraded":"2024-04-20T10:50:50.647061+0000","last_fullsized":"2024-04-20T10:50:50.647061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646640+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:50:50.646640+0000","last_peered":"2024-04-20T10:50:50.646640+0000","last_clean":"2024-04-20T10:50:50.646640+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:50:50.646640+0000","last_undegraded":"2024-04-20T10:50:50.646640+0000","last_fullsized":"2024-04-20T10:50:50.646640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647815+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:50.647815+0000","last_peered":"2024-04-20T10:50:50.647815+0000","last_clean":"2024-04-20T10:50:50.647815+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:50.647815+0000","last_undegraded":"2024-04-20T10:50:50.647815+0000","last_fullsized":"2024-04-20T10:50:50.647815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919903+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:50.919903+0000","last_peered":"2024-04-20T10:50:50.919903+0000","last_clean":"2024-04-20T10:50:50.919903+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:50.919903+0000","last_undegraded":"2024-04-20T10:50:50.919903+0000","last_fullsized":"2024-04-20T10:50:50.919903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647184+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:50:50.647184+0000","last_peered":"2024-04-20T10:50:50.647184+0000","last_clean":"2024-04-20T10:50:50.647184+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:50:50.647184+0000","last_undegraded":"2024-04-20T10:50:50.647184+0000","last_fullsized":"2024-04-20T10:50:50.647184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904364+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:50:50.904364+0000","last_peered":"2024-04-20T10:50:50.904364+0000","last_clean":"2024-04-20T10:50:50.904364+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:50:50.904364+0000","last_undegraded":"2024-04-20T10:50:50.904364+0000","last_fullsized":"2024-04-20T10:50:50.904364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919960+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:50.919960+0000","last_peered":"2024-04-20T10:50:50.919960+0000","last_clean":"2024-04-20T10:50:50.919960+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:50.919960+0000","last_undegraded":"2024-04-20T10:50:50.919960+0000","last_fullsized":"2024-04-20T10:50:50.919960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920149+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:50.920149+0000","last_peered":"2024-04-20T10:50:50.920149+0000","last_clean":"2024-04-20T10:50:50.920149+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:50.920149+0000","last_undegraded":"2024-04-20T10:50:50.920149+0000","last_fullsized":"2024-04-20T10:50:50.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919053+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:50:50.919053+0000","last_peered":"2024-04-20T10:50:50.919053+0000","last_clean":"2024-04-20T10:50:50.919053+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:50:50.919053+0000","last_undegraded":"2024-04-20T10:50:50.919053+0000","last_fullsized":"2024-04-20T10:50:50.919053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919594+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:50.919594+0000","last_peered":"2024-04-20T10:50:50.919594+0000","last_clean":"2024-04-20T10:50:50.919594+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:50.919594+0000","last_undegraded":"2024-04-20T10:50:50.919594+0000","last_fullsized":"2024-04-20T10:50:50.919594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919993+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:50.919993+0000","last_peered":"2024-04-20T10:50:50.919993+0000","last_clean":"2024-04-20T10:50:50.919993+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:50.919993+0000","last_undegraded":"2024-04-20T10:50:50.919993+0000","last_fullsized":"2024-04-20T10:50:50.919993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918452+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:50:50.918452+0000","last_peered":"2024-04-20T10:50:50.918452+0000","last_clean":"2024-04-20T10:50:50.918452+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:50:50.918452+0000","last_undegraded":"2024-04-20T10:50:50.918452+0000","last_fullsized":"2024-04-20T10:50:50.918452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918934+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:50:50.918934+0000","last_peered":"2024-04-20T10:50:50.918934+0000","last_clean":"2024-04-20T10:50:50.918934+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:50:50.918934+0000","last_undegraded":"2024-04-20T10:50:50.918934+0000","last_fullsized":"2024-04-20T10:50:50.918934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647503+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:50.647503+0000","last_peered":"2024-04-20T10:50:50.647503+0000","last_clean":"2024-04-20T10:50:50.647503+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:50.647503+0000","last_undegraded":"2024-04-20T10:50:50.647503+0000","last_fullsized":"2024-04-20T10:50:50.647503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919438+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:50.919438+0000","last_peered":"2024-04-20T10:50:50.919438+0000","last_clean":"2024-04-20T10:50:50.919438+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:50.919438+0000","last_undegraded":"2024-04-20T10:50:50.919438+0000","last_fullsized":"2024-04-20T10:50:50.919438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918697+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:50:50.918697+0000","last_peered":"2024-04-20T10:50:50.918697+0000","last_clean":"2024-04-20T10:50:50.918697+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:50:50.918697+0000","last_undegraded":"2024-04-20T10:50:50.918697+0000","last_fullsized":"2024-04-20T10:50:50.918697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918186+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:50.918186+0000","last_peered":"2024-04-20T10:50:50.918186+0000","last_clean":"2024-04-20T10:50:50.918186+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:50.918186+0000","last_undegraded":"2024-04-20T10:50:50.918186+0000","last_fullsized":"2024-04-20T10:50:50.918186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919238+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:50.919238+0000","last_peered":"2024-04-20T10:50:50.919238+0000","last_clean":"2024-04-20T10:50:50.919238+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:50.919238+0000","last_undegraded":"2024-04-20T10:50:50.919238+0000","last_fullsized":"2024-04-20T10:50:50.919238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919687+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:50:50.919687+0000","last_peered":"2024-04-20T10:50:50.919687+0000","last_clean":"2024-04-20T10:50:50.919687+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:50:50.919687+0000","last_undegraded":"2024-04-20T10:50:50.919687+0000","last_fullsized":"2024-04-20T10:50:50.919687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918605+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:50.918605+0000","last_peered":"2024-04-20T10:50:50.918605+0000","last_clean":"2024-04-20T10:50:50.918605+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:50.918605+0000","last_undegraded":"2024-04-20T10:50:50.918605+0000","last_fullsized":"2024-04-20T10:50:50.918605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918474+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:50.918474+0000","last_peered":"2024-04-20T10:50:50.918474+0000","last_clean":"2024-04-20T10:50:50.918474+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:50.918474+0000","last_undegraded":"2024-04-20T10:50:50.918474+0000","last_fullsized":"2024-04-20T10:50:50.918474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919237+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:50:50.919237+0000","last_peered":"2024-04-20T10:50:50.919237+0000","last_clean":"2024-04-20T10:50:50.919237+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:50:50.919237+0000","last_undegraded":"2024-04-20T10:50:50.919237+0000","last_fullsized":"2024-04-20T10:50:50.919237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919239+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:50:50.919239+0000","last_peered":"2024-04-20T10:50:50.919239+0000","last_clean":"2024-04-20T10:50:50.919239+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:50:50.919239+0000","last_undegraded":"2024-04-20T10:50:50.919239+0000","last_fullsized":"2024-04-20T10:50:50.919239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647940+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:50.647940+0000","last_peered":"2024-04-20T10:50:50.647940+0000","last_clean":"2024-04-20T10:50:50.647940+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:50.647940+0000","last_undegraded":"2024-04-20T10:50:50.647940+0000","last_fullsized":"2024-04-20T10:50:50.647940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918168+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:50.918168+0000","last_peered":"2024-04-20T10:50:50.918168+0000","last_clean":"2024-04-20T10:50:50.918168+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:50.918168+0000","last_undegraded":"2024-04-20T10:50:50.918168+0000","last_fullsized":"2024-04-20T10:50:50.918168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918735+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:50.918735+0000","last_peered":"2024-04-20T10:50:50.918735+0000","last_clean":"2024-04-20T10:50:50.918735+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:50.918735+0000","last_undegraded":"2024-04-20T10:50:50.918735+0000","last_fullsized":"2024-04-20T10:50:50.918735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904495+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:50:50.904495+0000","last_peered":"2024-04-20T10:50:50.904495+0000","last_clean":"2024-04-20T10:50:50.904495+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:50:50.904495+0000","last_undegraded":"2024-04-20T10:50:50.904495+0000","last_fullsized":"2024-04-20T10:50:50.904495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920137+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:50:50.920137+0000","last_peered":"2024-04-20T10:50:50.920137+0000","last_clean":"2024-04-20T10:50:50.920137+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:50:50.920137+0000","last_undegraded":"2024-04-20T10:50:50.920137+0000","last_fullsized":"2024-04-20T10:50:50.920137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919949+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:50.919949+0000","last_peered":"2024-04-20T10:50:50.919949+0000","last_clean":"2024-04-20T10:50:50.919949+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:50.919949+0000","last_undegraded":"2024-04-20T10:50:50.919949+0000","last_fullsized":"2024-04-20T10:50:50.919949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920093+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:50.920093+0000","last_peered":"2024-04-20T10:50:50.920093+0000","last_clean":"2024-04-20T10:50:50.920093+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:50.920093+0000","last_undegraded":"2024-04-20T10:50:50.920093+0000","last_fullsized":"2024-04-20T10:50:50.920093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904372+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:50:50.904372+0000","last_peered":"2024-04-20T10:50:50.904372+0000","last_clean":"2024-04-20T10:50:50.904372+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:50:50.904372+0000","last_undegraded":"2024-04-20T10:50:50.904372+0000","last_fullsized":"2024-04-20T10:50:50.904372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918546+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:50:50.918546+0000","last_peered":"2024-04-20T10:50:50.918546+0000","last_clean":"2024-04-20T10:50:50.918546+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:50:50.918546+0000","last_undegraded":"2024-04-20T10:50:50.918546+0000","last_fullsized":"2024-04-20T10:50:50.918546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919184+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:50.919184+0000","last_peered":"2024-04-20T10:50:50.919184+0000","last_clean":"2024-04-20T10:50:50.919184+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:50.919184+0000","last_undegraded":"2024-04-20T10:50:50.919184+0000","last_fullsized":"2024-04-20T10:50:50.919184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920068+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:50.920068+0000","last_peered":"2024-04-20T10:50:50.920068+0000","last_clean":"2024-04-20T10:50:50.920068+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:50.920068+0000","last_undegraded":"2024-04-20T10:50:50.920068+0000","last_fullsized":"2024-04-20T10:50:50.920068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918899+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:50:50.918899+0000","last_peered":"2024-04-20T10:50:50.918899+0000","last_clean":"2024-04-20T10:50:50.918899+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:50:50.918899+0000","last_undegraded":"2024-04-20T10:50:50.918899+0000","last_fullsized":"2024-04-20T10:50:50.918899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918088+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:50:50.918088+0000","last_peered":"2024-04-20T10:50:50.918088+0000","last_clean":"2024-04-20T10:50:50.918088+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:50:50.918088+0000","last_undegraded":"2024-04-20T10:50:50.918088+0000","last_fullsized":"2024-04-20T10:50:50.918088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920183+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:50.920183+0000","last_peered":"2024-04-20T10:50:50.920183+0000","last_clean":"2024-04-20T10:50:50.920183+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:50.920183+0000","last_undegraded":"2024-04-20T10:50:50.920183+0000","last_fullsized":"2024-04-20T10:50:50.920183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918853+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:50.918853+0000","last_peered":"2024-04-20T10:50:50.918853+0000","last_clean":"2024-04-20T10:50:50.918853+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:50.918853+0000","last_undegraded":"2024-04-20T10:50:50.918853+0000","last_fullsized":"2024-04-20T10:50:50.918853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918057+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:50:50.918057+0000","last_peered":"2024-04-20T10:50:50.918057+0000","last_clean":"2024-04-20T10:50:50.918057+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:50:50.918057+0000","last_undegraded":"2024-04-20T10:50:50.918057+0000","last_fullsized":"2024-04-20T10:50:50.918057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919612+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:50:50.919612+0000","last_peered":"2024-04-20T10:50:50.919612+0000","last_clean":"2024-04-20T10:50:50.919612+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:50:50.919612+0000","last_undegraded":"2024-04-20T10:50:50.919612+0000","last_fullsized":"2024-04-20T10:50:50.919612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647644+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:50.647644+0000","last_peered":"2024-04-20T10:50:50.647644+0000","last_clean":"2024-04-20T10:50:50.647644+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:50.647644+0000","last_undegraded":"2024-04-20T10:50:50.647644+0000","last_fullsized":"2024-04-20T10:50:50.647644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646587+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:50:50.646587+0000","last_peered":"2024-04-20T10:50:50.646587+0000","last_clean":"2024-04-20T10:50:50.646587+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:50:50.646587+0000","last_undegraded":"2024-04-20T10:50:50.646587+0000","last_fullsized":"2024-04-20T10:50:50.646587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647705+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:50:50.647705+0000","last_peered":"2024-04-20T10:50:50.647705+0000","last_clean":"2024-04-20T10:50:50.647705+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:50:50.647705+0000","last_undegraded":"2024-04-20T10:50:50.647705+0000","last_fullsized":"2024-04-20T10:50:50.647705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918736+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:50.918736+0000","last_peered":"2024-04-20T10:50:50.918736+0000","last_clean":"2024-04-20T10:50:50.918736+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:50.918736+0000","last_undegraded":"2024-04-20T10:50:50.918736+0000","last_fullsized":"2024-04-20T10:50:50.918736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918257+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:50.918257+0000","last_peered":"2024-04-20T10:50:50.918257+0000","last_clean":"2024-04-20T10:50:50.918257+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:50.918257+0000","last_undegraded":"2024-04-20T10:50:50.918257+0000","last_fullsized":"2024-04-20T10:50:50.918257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919316+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:50:50.919316+0000","last_peered":"2024-04-20T10:50:50.919316+0000","last_clean":"2024-04-20T10:50:50.919316+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:50:50.919316+0000","last_undegraded":"2024-04-20T10:50:50.919316+0000","last_fullsized":"2024-04-20T10:50:50.919316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918977+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:50:50.918977+0000","last_peered":"2024-04-20T10:50:50.918977+0000","last_clean":"2024-04-20T10:50:50.918977+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:50:50.918977+0000","last_undegraded":"2024-04-20T10:50:50.918977+0000","last_fullsized":"2024-04-20T10:50:50.918977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904080+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:50.904080+0000","last_peered":"2024-04-20T10:50:50.904080+0000","last_clean":"2024-04-20T10:50:50.904080+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:50.904080+0000","last_undegraded":"2024-04-20T10:50:50.904080+0000","last_fullsized":"2024-04-20T10:50:50.904080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904487+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:50.904487+0000","last_peered":"2024-04-20T10:50:50.904487+0000","last_clean":"2024-04-20T10:50:50.904487+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:50.904487+0000","last_undegraded":"2024-04-20T10:50:50.904487+0000","last_fullsized":"2024-04-20T10:50:50.904487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647768+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:50:50.647768+0000","last_peered":"2024-04-20T10:50:50.647768+0000","last_clean":"2024-04-20T10:50:50.647768+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:50:50.647768+0000","last_undegraded":"2024-04-20T10:50:50.647768+0000","last_fullsized":"2024-04-20T10:50:50.647768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918820+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:50:50.918820+0000","last_peered":"2024-04-20T10:50:50.918820+0000","last_clean":"2024-04-20T10:50:50.918820+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:50:50.918820+0000","last_undegraded":"2024-04-20T10:50:50.918820+0000","last_fullsized":"2024-04-20T10:50:50.918820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919283+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:50.919283+0000","last_peered":"2024-04-20T10:50:50.919283+0000","last_clean":"2024-04-20T10:50:50.919283+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:50.919283+0000","last_undegraded":"2024-04-20T10:50:50.919283+0000","last_fullsized":"2024-04-20T10:50:50.919283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919373+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:50.919373+0000","last_peered":"2024-04-20T10:50:50.919373+0000","last_clean":"2024-04-20T10:50:50.919373+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:50.919373+0000","last_undegraded":"2024-04-20T10:50:50.919373+0000","last_fullsized":"2024-04-20T10:50:50.919373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648175+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:50:50.648175+0000","last_peered":"2024-04-20T10:50:50.648175+0000","last_clean":"2024-04-20T10:50:50.648175+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:50:50.648175+0000","last_undegraded":"2024-04-20T10:50:50.648175+0000","last_fullsized":"2024-04-20T10:50:50.648175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648149+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:50:50.648149+0000","last_peered":"2024-04-20T10:50:50.648149+0000","last_clean":"2024-04-20T10:50:50.648149+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:50:50.648149+0000","last_undegraded":"2024-04-20T10:50:50.648149+0000","last_fullsized":"2024-04-20T10:50:50.648149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918773+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:50.918773+0000","last_peered":"2024-04-20T10:50:50.918773+0000","last_clean":"2024-04-20T10:50:50.918773+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:50.918773+0000","last_undegraded":"2024-04-20T10:50:50.918773+0000","last_fullsized":"2024-04-20T10:50:50.918773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919619+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:50.919619+0000","last_peered":"2024-04-20T10:50:50.919619+0000","last_clean":"2024-04-20T10:50:50.919619+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:50.919619+0000","last_undegraded":"2024-04-20T10:50:50.919619+0000","last_fullsized":"2024-04-20T10:50:50.919619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919480+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:50:50.919480+0000","last_peered":"2024-04-20T10:50:50.919480+0000","last_clean":"2024-04-20T10:50:50.919480+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:50:50.919480+0000","last_undegraded":"2024-04-20T10:50:50.919480+0000","last_fullsized":"2024-04-20T10:50:50.919480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647622+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:50:50.647622+0000","last_peered":"2024-04-20T10:50:50.647622+0000","last_clean":"2024-04-20T10:50:50.647622+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:50:50.647622+0000","last_undegraded":"2024-04-20T10:50:50.647622+0000","last_fullsized":"2024-04-20T10:50:50.647622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919782+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:50.919782+0000","last_peered":"2024-04-20T10:50:50.919782+0000","last_clean":"2024-04-20T10:50:50.919782+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:50.919782+0000","last_undegraded":"2024-04-20T10:50:50.919782+0000","last_fullsized":"2024-04-20T10:50:50.919782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904433+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:50:50.904433+0000","last_peered":"2024-04-20T10:50:50.904433+0000","last_clean":"2024-04-20T10:50:50.904433+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:50:50.904433+0000","last_undegraded":"2024-04-20T10:50:50.904433+0000","last_fullsized":"2024-04-20T10:50:50.904433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918370+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:50:50.918370+0000","last_peered":"2024-04-20T10:50:50.918370+0000","last_clean":"2024-04-20T10:50:50.918370+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:50:50.918370+0000","last_undegraded":"2024-04-20T10:50:50.918370+0000","last_fullsized":"2024-04-20T10:50:50.918370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918531+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:50:50.918531+0000","last_peered":"2024-04-20T10:50:50.918531+0000","last_clean":"2024-04-20T10:50:50.918531+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:50:50.918531+0000","last_undegraded":"2024-04-20T10:50:50.918531+0000","last_fullsized":"2024-04-20T10:50:50.918531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647604+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:50.647604+0000","last_peered":"2024-04-20T10:50:50.647604+0000","last_clean":"2024-04-20T10:50:50.647604+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:50.647604+0000","last_undegraded":"2024-04-20T10:50:50.647604+0000","last_fullsized":"2024-04-20T10:50:50.647604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647241+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:50:50.647241+0000","last_peered":"2024-04-20T10:50:50.647241+0000","last_clean":"2024-04-20T10:50:50.647241+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:50:50.647241+0000","last_undegraded":"2024-04-20T10:50:50.647241+0000","last_fullsized":"2024-04-20T10:50:50.647241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904476+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:50:50.904476+0000","last_peered":"2024-04-20T10:50:50.904476+0000","last_clean":"2024-04-20T10:50:50.904476+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:50:50.904476+0000","last_undegraded":"2024-04-20T10:50:50.904476+0000","last_fullsized":"2024-04-20T10:50:50.904476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919071+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:50.919071+0000","last_peered":"2024-04-20T10:50:50.919071+0000","last_clean":"2024-04-20T10:50:50.919071+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:50.919071+0000","last_undegraded":"2024-04-20T10:50:50.919071+0000","last_fullsized":"2024-04-20T10:50:50.919071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919039+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:50.919039+0000","last_peered":"2024-04-20T10:50:50.919039+0000","last_clean":"2024-04-20T10:50:50.919039+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:50.919039+0000","last_undegraded":"2024-04-20T10:50:50.919039+0000","last_fullsized":"2024-04-20T10:50:50.919039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647348+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:50:50.647348+0000","last_peered":"2024-04-20T10:50:50.647348+0000","last_clean":"2024-04-20T10:50:50.647348+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:50:50.647348+0000","last_undegraded":"2024-04-20T10:50:50.647348+0000","last_fullsized":"2024-04-20T10:50:50.647348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918201+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:50:50.918201+0000","last_peered":"2024-04-20T10:50:50.918201+0000","last_clean":"2024-04-20T10:50:50.918201+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:50:50.918201+0000","last_undegraded":"2024-04-20T10:50:50.918201+0000","last_fullsized":"2024-04-20T10:50:50.918201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919011+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:50.919011+0000","last_peered":"2024-04-20T10:50:50.919011+0000","last_clean":"2024-04-20T10:50:50.919011+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:50.919011+0000","last_undegraded":"2024-04-20T10:50:50.919011+0000","last_fullsized":"2024-04-20T10:50:50.919011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904919+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:50.904919+0000","last_peered":"2024-04-20T10:50:50.904919+0000","last_clean":"2024-04-20T10:50:50.904919+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:50.904919+0000","last_undegraded":"2024-04-20T10:50:50.904919+0000","last_fullsized":"2024-04-20T10:50:50.904919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647257+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:50:50.647257+0000","last_peered":"2024-04-20T10:50:50.647257+0000","last_clean":"2024-04-20T10:50:50.647257+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:50:50.647257+0000","last_undegraded":"2024-04-20T10:50:50.647257+0000","last_fullsized":"2024-04-20T10:50:50.647257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904798+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:50:50.904798+0000","last_peered":"2024-04-20T10:50:50.904798+0000","last_clean":"2024-04-20T10:50:50.904798+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:50:50.904798+0000","last_undegraded":"2024-04-20T10:50:50.904798+0000","last_fullsized":"2024-04-20T10:50:50.904798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919143+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:50:50.919143+0000","last_peered":"2024-04-20T10:50:50.919143+0000","last_clean":"2024-04-20T10:50:50.919143+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:50:50.919143+0000","last_undegraded":"2024-04-20T10:50:50.919143+0000","last_fullsized":"2024-04-20T10:50:50.919143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918587+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:50.918587+0000","last_peered":"2024-04-20T10:50:50.918587+0000","last_clean":"2024-04-20T10:50:50.918587+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:50.918587+0000","last_undegraded":"2024-04-20T10:50:50.918587+0000","last_fullsized":"2024-04-20T10:50:50.918587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918226+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:50.918226+0000","last_peered":"2024-04-20T10:50:50.918226+0000","last_clean":"2024-04-20T10:50:50.918226+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:50.918226+0000","last_undegraded":"2024-04-20T10:50:50.918226+0000","last_fullsized":"2024-04-20T10:50:50.918226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919055+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:50:50.919055+0000","last_peered":"2024-04-20T10:50:50.919055+0000","last_clean":"2024-04-20T10:50:50.919055+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:50:50.919055+0000","last_undegraded":"2024-04-20T10:50:50.919055+0000","last_fullsized":"2024-04-20T10:50:50.919055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904885+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:50:50.904885+0000","last_peered":"2024-04-20T10:50:50.904885+0000","last_clean":"2024-04-20T10:50:50.904885+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:50:50.904885+0000","last_undegraded":"2024-04-20T10:50:50.904885+0000","last_fullsized":"2024-04-20T10:50:50.904885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647617+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:50.647617+0000","last_peered":"2024-04-20T10:50:50.647617+0000","last_clean":"2024-04-20T10:50:50.647617+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:50.647617+0000","last_undegraded":"2024-04-20T10:50:50.647617+0000","last_fullsized":"2024-04-20T10:50:50.647617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647427+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:50.647427+0000","last_peered":"2024-04-20T10:50:50.647427+0000","last_clean":"2024-04-20T10:50:50.647427+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:50.647427+0000","last_undegraded":"2024-04-20T10:50:50.647427+0000","last_fullsized":"2024-04-20T10:50:50.647427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919353+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:50:50.919353+0000","last_peered":"2024-04-20T10:50:50.919353+0000","last_clean":"2024-04-20T10:50:50.919353+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:50:50.919353+0000","last_undegraded":"2024-04-20T10:50:50.919353+0000","last_fullsized":"2024-04-20T10:50:50.919353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904598+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:50.904598+0000","last_peered":"2024-04-20T10:50:50.904598+0000","last_clean":"2024-04-20T10:50:50.904598+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:50.904598+0000","last_undegraded":"2024-04-20T10:50:50.904598+0000","last_fullsized":"2024-04-20T10:50:50.904598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919448+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:50.919448+0000","last_peered":"2024-04-20T10:50:50.919448+0000","last_clean":"2024-04-20T10:50:50.919448+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:50.919448+0000","last_undegraded":"2024-04-20T10:50:50.919448+0000","last_fullsized":"2024-04-20T10:50:50.919448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919923+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:50:50.919923+0000","last_peered":"2024-04-20T10:50:50.919923+0000","last_clean":"2024-04-20T10:50:50.919923+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:50:50.919923+0000","last_undegraded":"2024-04-20T10:50:50.919923+0000","last_fullsized":"2024-04-20T10:50:50.919923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646954+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:50:50.646954+0000","last_peered":"2024-04-20T10:50:50.646954+0000","last_clean":"2024-04-20T10:50:50.646954+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:50:50.646954+0000","last_undegraded":"2024-04-20T10:50:50.646954+0000","last_fullsized":"2024-04-20T10:50:50.646954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647875+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:50.647875+0000","last_peered":"2024-04-20T10:50:50.647875+0000","last_clean":"2024-04-20T10:50:50.647875+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:50.647875+0000","last_undegraded":"2024-04-20T10:50:50.647875+0000","last_fullsized":"2024-04-20T10:50:50.647875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647129+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:50.647129+0000","last_peered":"2024-04-20T10:50:50.647129+0000","last_clean":"2024-04-20T10:50:50.647129+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:50.647129+0000","last_undegraded":"2024-04-20T10:50:50.647129+0000","last_fullsized":"2024-04-20T10:50:50.647129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648051+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:50:50.648051+0000","last_peered":"2024-04-20T10:50:50.648051+0000","last_clean":"2024-04-20T10:50:50.648051+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:50:50.648051+0000","last_undegraded":"2024-04-20T10:50:50.648051+0000","last_fullsized":"2024-04-20T10:50:50.648051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648041+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:50:50.648041+0000","last_peered":"2024-04-20T10:50:50.648041+0000","last_clean":"2024-04-20T10:50:50.648041+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:50:50.648041+0000","last_undegraded":"2024-04-20T10:50:50.648041+0000","last_fullsized":"2024-04-20T10:50:50.648041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904067+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:50.904067+0000","last_peered":"2024-04-20T10:50:50.904067+0000","last_clean":"2024-04-20T10:50:50.904067+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:50.904067+0000","last_undegraded":"2024-04-20T10:50:50.904067+0000","last_fullsized":"2024-04-20T10:50:50.904067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919274+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:50:50.919274+0000","last_peered":"2024-04-20T10:50:50.919274+0000","last_clean":"2024-04-20T10:50:50.919274+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:50:50.919274+0000","last_undegraded":"2024-04-20T10:50:50.919274+0000","last_fullsized":"2024-04-20T10:50:50.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918980+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:50.918980+0000","last_peered":"2024-04-20T10:50:50.918980+0000","last_clean":"2024-04-20T10:50:50.918980+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:50.918980+0000","last_undegraded":"2024-04-20T10:50:50.918980+0000","last_fullsized":"2024-04-20T10:50:50.918980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918617+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:50:50.918617+0000","last_peered":"2024-04-20T10:50:50.918617+0000","last_clean":"2024-04-20T10:50:50.918617+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:50:50.918617+0000","last_undegraded":"2024-04-20T10:50:50.918617+0000","last_fullsized":"2024-04-20T10:50:50.918617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919308+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:50.919308+0000","last_peered":"2024-04-20T10:50:50.919308+0000","last_clean":"2024-04-20T10:50:50.919308+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:50.919308+0000","last_undegraded":"2024-04-20T10:50:50.919308+0000","last_fullsized":"2024-04-20T10:50:50.919308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919405+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:50.919405+0000","last_peered":"2024-04-20T10:50:50.919405+0000","last_clean":"2024-04-20T10:50:50.919405+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:50.919405+0000","last_undegraded":"2024-04-20T10:50:50.919405+0000","last_fullsized":"2024-04-20T10:50:50.919405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918338+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:50:50.918338+0000","last_peered":"2024-04-20T10:50:50.918338+0000","last_clean":"2024-04-20T10:50:50.918338+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:50:50.918338+0000","last_undegraded":"2024-04-20T10:50:50.918338+0000","last_fullsized":"2024-04-20T10:50:50.918338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648264+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:50.648264+0000","last_peered":"2024-04-20T10:50:50.648264+0000","last_clean":"2024-04-20T10:50:50.648264+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:50.648264+0000","last_undegraded":"2024-04-20T10:50:50.648264+0000","last_fullsized":"2024-04-20T10:50:50.648264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647153+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:50:50.647153+0000","last_peered":"2024-04-20T10:50:50.647153+0000","last_clean":"2024-04-20T10:50:50.647153+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:50:50.647153+0000","last_undegraded":"2024-04-20T10:50:50.647153+0000","last_fullsized":"2024-04-20T10:50:50.647153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919569+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:50.919569+0000","last_peered":"2024-04-20T10:50:50.919569+0000","last_clean":"2024-04-20T10:50:50.919569+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:50.919569+0000","last_undegraded":"2024-04-20T10:50:50.919569+0000","last_fullsized":"2024-04-20T10:50:50.919569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904775+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:50.904775+0000","last_peered":"2024-04-20T10:50:50.904775+0000","last_clean":"2024-04-20T10:50:50.904775+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:50.904775+0000","last_undegraded":"2024-04-20T10:50:50.904775+0000","last_fullsized":"2024-04-20T10:50:50.904775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904299+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:50:50.904299+0000","last_peered":"2024-04-20T10:50:50.904299+0000","last_clean":"2024-04-20T10:50:50.904299+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:50:50.904299+0000","last_undegraded":"2024-04-20T10:50:50.904299+0000","last_fullsized":"2024-04-20T10:50:50.904299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647767+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:50.647767+0000","last_peered":"2024-04-20T10:50:50.647767+0000","last_clean":"2024-04-20T10:50:50.647767+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:50.647767+0000","last_undegraded":"2024-04-20T10:50:50.647767+0000","last_fullsized":"2024-04-20T10:50:50.647767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647843+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:50:50.647843+0000","last_peered":"2024-04-20T10:50:50.647843+0000","last_clean":"2024-04-20T10:50:50.647843+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:50:50.647843+0000","last_undegraded":"2024-04-20T10:50:50.647843+0000","last_fullsized":"2024-04-20T10:50:50.647843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918116+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:50.918116+0000","last_peered":"2024-04-20T10:50:50.918116+0000","last_clean":"2024-04-20T10:50:50.918116+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:50.918116+0000","last_undegraded":"2024-04-20T10:50:50.918116+0000","last_fullsized":"2024-04-20T10:50:50.918116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920306+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:50:50.920306+0000","last_peered":"2024-04-20T10:50:50.920306+0000","last_clean":"2024-04-20T10:50:50.920306+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:50:50.920306+0000","last_undegraded":"2024-04-20T10:50:50.920306+0000","last_fullsized":"2024-04-20T10:50:50.920306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647324+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:50.647324+0000","last_peered":"2024-04-20T10:50:50.647324+0000","last_clean":"2024-04-20T10:50:50.647324+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:50.647324+0000","last_undegraded":"2024-04-20T10:50:50.647324+0000","last_fullsized":"2024-04-20T10:50:50.647324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919821+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:50:50.919821+0000","last_peered":"2024-04-20T10:50:50.919821+0000","last_clean":"2024-04-20T10:50:50.919821+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:50:50.919821+0000","last_undegraded":"2024-04-20T10:50:50.919821+0000","last_fullsized":"2024-04-20T10:50:50.919821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919185+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:50.919185+0000","last_peered":"2024-04-20T10:50:50.919185+0000","last_clean":"2024-04-20T10:50:50.919185+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:50.919185+0000","last_undegraded":"2024-04-20T10:50:50.919185+0000","last_fullsized":"2024-04-20T10:50:50.919185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647822+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:50:50.647822+0000","last_peered":"2024-04-20T10:50:50.647822+0000","last_clean":"2024-04-20T10:50:50.647822+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:50:50.647822+0000","last_undegraded":"2024-04-20T10:50:50.647822+0000","last_fullsized":"2024-04-20T10:50:50.647822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919221+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:50.919221+0000","last_peered":"2024-04-20T10:50:50.919221+0000","last_clean":"2024-04-20T10:50:50.919221+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:50.919221+0000","last_undegraded":"2024-04-20T10:50:50.919221+0000","last_fullsized":"2024-04-20T10:50:50.919221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646687+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:50:50.646687+0000","last_peered":"2024-04-20T10:50:50.646687+0000","last_clean":"2024-04-20T10:50:50.646687+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:50:50.646687+0000","last_undegraded":"2024-04-20T10:50:50.646687+0000","last_fullsized":"2024-04-20T10:50:50.646687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904324+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:50.904324+0000","last_peered":"2024-04-20T10:50:50.904324+0000","last_clean":"2024-04-20T10:50:50.904324+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:50.904324+0000","last_undegraded":"2024-04-20T10:50:50.904324+0000","last_fullsized":"2024-04-20T10:50:50.904324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646680+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:50:50.646680+0000","last_peered":"2024-04-20T10:50:50.646680+0000","last_clean":"2024-04-20T10:50:50.646680+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:50:50.646680+0000","last_undegraded":"2024-04-20T10:50:50.646680+0000","last_fullsized":"2024-04-20T10:50:50.646680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920058+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:50.920058+0000","last_peered":"2024-04-20T10:50:50.920058+0000","last_clean":"2024-04-20T10:50:50.920058+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:50.920058+0000","last_undegraded":"2024-04-20T10:50:50.920058+0000","last_fullsized":"2024-04-20T10:50:50.920058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918048+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:50:50.918048+0000","last_peered":"2024-04-20T10:50:50.918048+0000","last_clean":"2024-04-20T10:50:50.918048+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:50:50.918048+0000","last_undegraded":"2024-04-20T10:50:50.918048+0000","last_fullsized":"2024-04-20T10:50:50.918048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918749+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:50.918749+0000","last_peered":"2024-04-20T10:50:50.918749+0000","last_clean":"2024-04-20T10:50:50.918749+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:50.918749+0000","last_undegraded":"2024-04-20T10:50:50.918749+0000","last_fullsized":"2024-04-20T10:50:50.918749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918281+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:50:50.918281+0000","last_peered":"2024-04-20T10:50:50.918281+0000","last_clean":"2024-04-20T10:50:50.918281+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:50:50.918281+0000","last_undegraded":"2024-04-20T10:50:50.918281+0000","last_fullsized":"2024-04-20T10:50:50.918281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919598+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:50.919598+0000","last_peered":"2024-04-20T10:50:50.919598+0000","last_clean":"2024-04-20T10:50:50.919598+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:50.919598+0000","last_undegraded":"2024-04-20T10:50:50.919598+0000","last_fullsized":"2024-04-20T10:50:50.919598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919839+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:50:50.919839+0000","last_peered":"2024-04-20T10:50:50.919839+0000","last_clean":"2024-04-20T10:50:50.919839+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:50:50.919839+0000","last_undegraded":"2024-04-20T10:50:50.919839+0000","last_fullsized":"2024-04-20T10:50:50.919839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918109+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:50.918109+0000","last_peered":"2024-04-20T10:50:50.918109+0000","last_clean":"2024-04-20T10:50:50.918109+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:50.918109+0000","last_undegraded":"2024-04-20T10:50:50.918109+0000","last_fullsized":"2024-04-20T10:50:50.918109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647462+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:50:50.647462+0000","last_peered":"2024-04-20T10:50:50.647462+0000","last_clean":"2024-04-20T10:50:50.647462+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:50:50.647462+0000","last_undegraded":"2024-04-20T10:50:50.647462+0000","last_fullsized":"2024-04-20T10:50:50.647462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918682+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:50.918682+0000","last_peered":"2024-04-20T10:50:50.918682+0000","last_clean":"2024-04-20T10:50:50.918682+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:50.918682+0000","last_undegraded":"2024-04-20T10:50:50.918682+0000","last_fullsized":"2024-04-20T10:50:50.918682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918787+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:50:50.918787+0000","last_peered":"2024-04-20T10:50:50.918787+0000","last_clean":"2024-04-20T10:50:50.918787+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:50:50.918787+0000","last_undegraded":"2024-04-20T10:50:50.918787+0000","last_fullsized":"2024-04-20T10:50:50.918787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918739+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:50.918739+0000","last_peered":"2024-04-20T10:50:50.918739+0000","last_clean":"2024-04-20T10:50:50.918739+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:50.918739+0000","last_undegraded":"2024-04-20T10:50:50.918739+0000","last_fullsized":"2024-04-20T10:50:50.918739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647651+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:50.647651+0000","last_peered":"2024-04-20T10:50:50.647651+0000","last_clean":"2024-04-20T10:50:50.647651+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:50.647651+0000","last_undegraded":"2024-04-20T10:50:50.647651+0000","last_fullsized":"2024-04-20T10:50:50.647651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647567+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:50.647567+0000","last_peered":"2024-04-20T10:50:50.647567+0000","last_clean":"2024-04-20T10:50:50.647567+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:50.647567+0000","last_undegraded":"2024-04-20T10:50:50.647567+0000","last_fullsized":"2024-04-20T10:50:50.647567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919983+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:50:50.919983+0000","last_peered":"2024-04-20T10:50:50.919983+0000","last_clean":"2024-04-20T10:50:50.919983+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:50:50.919983+0000","last_undegraded":"2024-04-20T10:50:50.919983+0000","last_fullsized":"2024-04-20T10:50:50.919983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918676+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:50:50.918676+0000","last_peered":"2024-04-20T10:50:50.918676+0000","last_clean":"2024-04-20T10:50:50.918676+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:50:50.918676+0000","last_undegraded":"2024-04-20T10:50:50.918676+0000","last_fullsized":"2024-04-20T10:50:50.918676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904771+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:50.904771+0000","last_peered":"2024-04-20T10:50:50.904771+0000","last_clean":"2024-04-20T10:50:50.904771+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:50.904771+0000","last_undegraded":"2024-04-20T10:50:50.904771+0000","last_fullsized":"2024-04-20T10:50:50.904771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918237+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:50:50.918237+0000","last_peered":"2024-04-20T10:50:50.918237+0000","last_clean":"2024-04-20T10:50:50.918237+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:50:50.918237+0000","last_undegraded":"2024-04-20T10:50:50.918237+0000","last_fullsized":"2024-04-20T10:50:50.918237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920158+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:50.920158+0000","last_peered":"2024-04-20T10:50:50.920158+0000","last_clean":"2024-04-20T10:50:50.920158+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:50.920158+0000","last_undegraded":"2024-04-20T10:50:50.920158+0000","last_fullsized":"2024-04-20T10:50:50.920158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647709+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:50:50.647709+0000","last_peered":"2024-04-20T10:50:50.647709+0000","last_clean":"2024-04-20T10:50:50.647709+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:50:50.647709+0000","last_undegraded":"2024-04-20T10:50:50.647709+0000","last_fullsized":"2024-04-20T10:50:50.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647411+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:50.647411+0000","last_peered":"2024-04-20T10:50:50.647411+0000","last_clean":"2024-04-20T10:50:50.647411+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:50.647411+0000","last_undegraded":"2024-04-20T10:50:50.647411+0000","last_fullsized":"2024-04-20T10:50:50.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904808+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:50:50.904808+0000","last_peered":"2024-04-20T10:50:50.904808+0000","last_clean":"2024-04-20T10:50:50.904808+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:50:50.904808+0000","last_undegraded":"2024-04-20T10:50:50.904808+0000","last_fullsized":"2024-04-20T10:50:50.904808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918551+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:50.918551+0000","last_peered":"2024-04-20T10:50:50.918551+0000","last_clean":"2024-04-20T10:50:50.918551+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:50.918551+0000","last_undegraded":"2024-04-20T10:50:50.918551+0000","last_fullsized":"2024-04-20T10:50:50.918551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919755+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:50:50.919755+0000","last_peered":"2024-04-20T10:50:50.919755+0000","last_clean":"2024-04-20T10:50:50.919755+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:50:50.919755+0000","last_undegraded":"2024-04-20T10:50:50.919755+0000","last_fullsized":"2024-04-20T10:50:50.919755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919134+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:50.919134+0000","last_peered":"2024-04-20T10:50:50.919134+0000","last_clean":"2024-04-20T10:50:50.919134+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:50.919134+0000","last_undegraded":"2024-04-20T10:50:50.919134+0000","last_fullsized":"2024-04-20T10:50:50.919134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919397+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:50:50.919397+0000","last_peered":"2024-04-20T10:50:50.919397+0000","last_clean":"2024-04-20T10:50:50.919397+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:50:50.919397+0000","last_undegraded":"2024-04-20T10:50:50.919397+0000","last_fullsized":"2024-04-20T10:50:50.919397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919182+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:50.919182+0000","last_peered":"2024-04-20T10:50:50.919182+0000","last_clean":"2024-04-20T10:50:50.919182+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:50.919182+0000","last_undegraded":"2024-04-20T10:50:50.919182+0000","last_fullsized":"2024-04-20T10:50:50.919182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919141+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:50.919141+0000","last_peered":"2024-04-20T10:50:50.919141+0000","last_clean":"2024-04-20T10:50:50.919141+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:50.919141+0000","last_undegraded":"2024-04-20T10:50:50.919141+0000","last_fullsized":"2024-04-20T10:50:50.919141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919836+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:50:50.919836+0000","last_peered":"2024-04-20T10:50:50.919836+0000","last_clean":"2024-04-20T10:50:50.919836+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:50:50.919836+0000","last_undegraded":"2024-04-20T10:50:50.919836+0000","last_fullsized":"2024-04-20T10:50:50.919836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919036+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:50.919036+0000","last_peered":"2024-04-20T10:50:50.919036+0000","last_clean":"2024-04-20T10:50:50.919036+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:50.919036+0000","last_undegraded":"2024-04-20T10:50:50.919036+0000","last_fullsized":"2024-04-20T10:50:50.919036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918038+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:50:50.918038+0000","last_peered":"2024-04-20T10:50:50.918038+0000","last_clean":"2024-04-20T10:50:50.918038+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:50:50.918038+0000","last_undegraded":"2024-04-20T10:50:50.918038+0000","last_fullsized":"2024-04-20T10:50:50.918038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919810+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:50.919810+0000","last_peered":"2024-04-20T10:50:50.919810+0000","last_clean":"2024-04-20T10:50:50.919810+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:50.919810+0000","last_undegraded":"2024-04-20T10:50:50.919810+0000","last_fullsized":"2024-04-20T10:50:50.919810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918353+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:50:50.918353+0000","last_peered":"2024-04-20T10:50:50.918353+0000","last_clean":"2024-04-20T10:50:50.918353+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:50:50.918353+0000","last_undegraded":"2024-04-20T10:50:50.918353+0000","last_fullsized":"2024-04-20T10:50:50.918353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920113+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:50.920113+0000","last_peered":"2024-04-20T10:50:50.920113+0000","last_clean":"2024-04-20T10:50:50.920113+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:50.920113+0000","last_undegraded":"2024-04-20T10:50:50.920113+0000","last_fullsized":"2024-04-20T10:50:50.920113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":687865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":106160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":97587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":98619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":687831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:50:54.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:50:54.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.751+0000 7f3cf9dce640 1 Processor -- start 2024-04-20T10:50:54.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.751+0000 7f3cf9dce640 1 -- start start 2024-04-20T10:50:54.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.751+0000 7f3cf9dce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cf40c45c0 0x7f3cf41551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.751+0000 7f3cf9dce640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf4158780 con 0x7f3cf4073120 2024-04-20T10:50:54.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.751+0000 7f3cf9dce640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cf41546d0 con 0x7f3cf4072860 2024-04-20T10:50:54.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.751+0000 7f3cf9dce640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3cf40ad010 con 0x7f3cf40c45c0 2024-04-20T10:50:54.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.751+0000 7f3cf2ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cf40c45c0 0x7f3cf41551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.752+0000 7f3cf2ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3cf40c45c0 0x7f3cf41551b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37150/0 (socket says 172.21.15.90:37150) 2024-04-20T10:50:54.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.752+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/1091678492 learned_addr learned my addr 172.21.15.90:0/1091678492 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:54.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.752+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/1091678492 >> v1:172.21.15.175:6789/0 conn(0x7f3cf4072860 legacy=0x7f3cf40ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:54.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.752+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/1091678492 >> v1:172.21.15.90:6789/0 conn(0x7f3cf4073120 legacy=0x7f3cf4151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.752+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/1091678492 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf41549b0 con 0x7f3cf40c45c0 2024-04-20T10:50:54.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.752+0000 7f3cf27fc640 1 -- 172.21.15.90:0/1091678492 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142242461 0 0) 0x7f3cf4158780 con 0x7f3cf4073120 2024-04-20T10:50:54.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.752+0000 7f3cf2ffd640 1 --2- 172.21.15.90:0/1091678492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf40c45c0 0x7f3cf41551b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68030fa0a1e358d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf27fc640 1 -- 172.21.15.90:0/1091678492 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4035020 con 0x7f3cf40c45c0 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf27fc640 1 -- 172.21.15.90:0/1091678492 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce4031870 con 0x7f3cf40c45c0 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf27fc640 1 -- 172.21.15.90:0/1091678492 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4031c40 con 0x7f3cf40c45c0 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf9dce640 1 -- 172.21.15.90:0/1091678492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf40c45c0 msgr2=0x7f3cf41551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/1091678492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf40c45c0 0x7f3cf41551b0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4009870 tx=0x7f3ce402b910 comp rx=0 tx=0).stop 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf9dce640 1 -- 172.21.15.90:0/1091678492 shutdown_connections 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/1091678492 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf40c45c0 0x7f3cf41551b0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf9dce640 1 -- 172.21.15.90:0/1091678492 >> 172.21.15.90:0/1091678492 conn(0x7f3cf4067de0 msgr2=0x7f3cf40ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf9dce640 1 -- 172.21.15.90:0/1091678492 shutdown_connections 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.753+0000 7f3cf9dce640 1 -- 172.21.15.90:0/1091678492 wait complete. 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.754+0000 7f3cf9dce640 1 Processor -- start 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf9dce640 1 -- start start 2024-04-20T10:50:54.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf9dce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4072860 0x7f3cf40c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf9dce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf4073120 0x7f3cf41ec140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf9dce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cf40c45c0 0x7f3cf41ec680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf9dce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf4158a60 con 0x7f3cf4073120 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf9dce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cf4158530 con 0x7f3cf4072860 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf9dce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3cf40abbb0 con 0x7f3cf40c45c0 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf4073120 0x7f3cf41ec140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf2ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf4073120 0x7f3cf41ec140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37152/0 (socket says 172.21.15.90:37152) 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/2892592125 learned_addr learned my addr 172.21.15.90:0/2892592125 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf37fe640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4072860 0x7f3cf40c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf3fff640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cf40c45c0 0x7f3cf41ec680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cf40c45c0 msgr2=0x7f3cf41ec680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf2ffd640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cf40c45c0 0x7f3cf41ec680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4072860 msgr2=0x7f3cf40c3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.755+0000 7f3cf2ffd640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4072860 0x7f3cf40c3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cf2ffd640 1 -- 172.21.15.90:0/2892592125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cf406e470 con 0x7f3cf4073120 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cf3fff640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cf40c45c0 0x7f3cf41ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cf37fe640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4072860 0x7f3cf40c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cf2ffd640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf4073120 0x7f3cf41ec140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c00 tx=0x7f3ce40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cdbfff640 1 -- 172.21.15.90:0/2892592125 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce403ad60 con 0x7f3cf4073120 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cdbfff640 1 -- 172.21.15.90:0/2892592125 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ce40443f0 con 0x7f3cf4073120 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cf41effc0 con 0x7f3cf4073120 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cdbfff640 1 -- 172.21.15.90:0/2892592125 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40447e0 con 0x7f3cf4073120 2024-04-20T10:50:54.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.756+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cf406e100 con 0x7f3cf4073120 2024-04-20T10:50:54.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.757+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cf4076150 con 0x7f3cf4073120 2024-04-20T10:50:54.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.757+0000 7f3cdbfff640 1 -- 172.21.15.90:0/2892592125 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ce404b060 con 0x7f3cf4073120 2024-04-20T10:50:54.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.758+0000 7f3cdbfff640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ce006c920 0x7f3ce006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:54.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.758+0000 7f3cdbfff640 1 -- 172.21.15.90:0/2892592125 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3ce40ae020 con 0x7f3cf4073120 2024-04-20T10:50:54.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.758+0000 7f3cf37fe640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ce006c920 0x7f3ce006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:54.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.758+0000 7f3cf37fe640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ce006c920 0x7f3ce006ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40c4080 tx=0x7f3ce8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:54.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.762+0000 7f3cdbfff640 1 -- 172.21.15.90:0/2892592125 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3ce403f070 con 0x7f3cf4073120 2024-04-20T10:50:54.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.934+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3cf41efd70 con 0x7f3ce006c920 2024-04-20T10:50:54.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.945+0000 7f3cdbfff640 1 -- 172.21.15.90:0/2892592125 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490416 (secure 0 0 0) 0x7f3cf41efd70 con 0x7f3ce006c920 2024-04-20T10:50:54.952 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:54.955 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:50:54.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ce006c920 msgr2=0x7f3ce006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ce006c920 0x7f3ce006ede0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40c4080 tx=0x7f3ce8008040 comp rx=0 tx=0).stop 2024-04-20T10:50:54.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf4073120 msgr2=0x7f3cf41ec140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:54.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf4073120 0x7f3cf41ec140 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3ce4000c00 tx=0x7f3ce40046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 shutdown_connections 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ce006c920 0x7f3ce006ede0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cf40c45c0 0x7f3cf41ec680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cf4073120 0x7f3cf41ec140 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 --2- 172.21.15.90:0/2892592125 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cf4072860 0x7f3cf40c3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.949+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 >> 172.21.15.90:0/2892592125 conn(0x7f3cf4067de0 msgr2=0x7f3cf4152130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.950+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 shutdown_connections 2024-04-20T10:50:54.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:54.950+0000 7f3cf9dce640 1 -- 172.21.15.90:0/2892592125 wait complete. 2024-04-20T10:50:54.961 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-20T10:50:53.665544+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":369,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219480,"kb_used_data":3308,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755240,"statfs":{"total":773094113280,"available":772869365760,"internally_reserved":0,"allocated":3387392,"data_stored":1986297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000915"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646500+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:50:50.646500+0000","last_peered":"2024-04-20T10:50:50.646500+0000","last_clean":"2024-04-20T10:50:50.646500+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:50:50.646500+0000","last_undegraded":"2024-04-20T10:50:50.646500+0000","last_fullsized":"2024-04-20T10:50:50.646500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647942+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:50.647942+0000","last_peered":"2024-04-20T10:50:50.647942+0000","last_clean":"2024-04-20T10:50:50.647942+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:50.647942+0000","last_undegraded":"2024-04-20T10:50:50.647942+0000","last_fullsized":"2024-04-20T10:50:50.647942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647361+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:50:50.647361+0000","last_peered":"2024-04-20T10:50:50.647361+0000","last_clean":"2024-04-20T10:50:50.647361+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:50:50.647361+0000","last_undegraded":"2024-04-20T10:50:50.647361+0000","last_fullsized":"2024-04-20T10:50:50.647361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918471+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:50:50.918471+0000","last_peered":"2024-04-20T10:50:50.918471+0000","last_clean":"2024-04-20T10:50:50.918471+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:50:50.918471+0000","last_undegraded":"2024-04-20T10:50:50.918471+0000","last_fullsized":"2024-04-20T10:50:50.918471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648170+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:50.648170+0000","last_peered":"2024-04-20T10:50:50.648170+0000","last_clean":"2024-04-20T10:50:50.648170+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:50.648170+0000","last_undegraded":"2024-04-20T10:50:50.648170+0000","last_fullsized":"2024-04-20T10:50:50.648170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918903+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:50.918903+0000","last_peered":"2024-04-20T10:50:50.918903+0000","last_clean":"2024-04-20T10:50:50.918903+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:50.918903+0000","last_undegraded":"2024-04-20T10:50:50.918903+0000","last_fullsized":"2024-04-20T10:50:50.918903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646446+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:50:50.646446+0000","last_peered":"2024-04-20T10:50:50.646446+0000","last_clean":"2024-04-20T10:50:50.646446+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:50:50.646446+0000","last_undegraded":"2024-04-20T10:50:50.646446+0000","last_fullsized":"2024-04-20T10:50:50.646446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918478+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:50:50.918478+0000","last_peered":"2024-04-20T10:50:50.918478+0000","last_clean":"2024-04-20T10:50:50.918478+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:50:50.918478+0000","last_undegraded":"2024-04-20T10:50:50.918478+0000","last_fullsized":"2024-04-20T10:50:50.918478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920014+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:50.920014+0000","last_peered":"2024-04-20T10:50:50.920014+0000","last_clean":"2024-04-20T10:50:50.920014+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:50.920014+0000","last_undegraded":"2024-04-20T10:50:50.920014+0000","last_fullsized":"2024-04-20T10:50:50.920014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918841+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:50.918841+0000","last_peered":"2024-04-20T10:50:50.918841+0000","last_clean":"2024-04-20T10:50:50.918841+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:50.918841+0000","last_undegraded":"2024-04-20T10:50:50.918841+0000","last_fullsized":"2024-04-20T10:50:50.918841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646788+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:50:50.646788+0000","last_peered":"2024-04-20T10:50:50.646788+0000","last_clean":"2024-04-20T10:50:50.646788+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:50:50.646788+0000","last_undegraded":"2024-04-20T10:50:50.646788+0000","last_fullsized":"2024-04-20T10:50:50.646788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918243+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:50:50.918243+0000","last_peered":"2024-04-20T10:50:50.918243+0000","last_clean":"2024-04-20T10:50:50.918243+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:50:50.918243+0000","last_undegraded":"2024-04-20T10:50:50.918243+0000","last_fullsized":"2024-04-20T10:50:50.918243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919668+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:50.919668+0000","last_peered":"2024-04-20T10:50:50.919668+0000","last_clean":"2024-04-20T10:50:50.919668+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:50.919668+0000","last_undegraded":"2024-04-20T10:50:50.919668+0000","last_fullsized":"2024-04-20T10:50:50.919668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919525+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:50.919525+0000","last_peered":"2024-04-20T10:50:50.919525+0000","last_clean":"2024-04-20T10:50:50.919525+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:50.919525+0000","last_undegraded":"2024-04-20T10:50:50.919525+0000","last_fullsized":"2024-04-20T10:50:50.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646886+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:50:50.646886+0000","last_peered":"2024-04-20T10:50:50.646886+0000","last_clean":"2024-04-20T10:50:50.646886+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:50:50.646886+0000","last_undegraded":"2024-04-20T10:50:50.646886+0000","last_fullsized":"2024-04-20T10:50:50.646886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919828+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:50:50.919828+0000","last_peered":"2024-04-20T10:50:50.919828+0000","last_clean":"2024-04-20T10:50:50.919828+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:50:50.919828+0000","last_undegraded":"2024-04-20T10:50:50.919828+0000","last_fullsized":"2024-04-20T10:50:50.919828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647374+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:50:50.647374+0000","last_peered":"2024-04-20T10:50:50.647374+0000","last_clean":"2024-04-20T10:50:50.647374+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:50:50.647374+0000","last_undegraded":"2024-04-20T10:50:50.647374+0000","last_fullsized":"2024-04-20T10:50:50.647374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919489+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:50:50.919489+0000","last_peered":"2024-04-20T10:50:50.919489+0000","last_clean":"2024-04-20T10:50:50.919489+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:50:50.919489+0000","last_undegraded":"2024-04-20T10:50:50.919489+0000","last_fullsized":"2024-04-20T10:50:50.919489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647710+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:50.647710+0000","last_peered":"2024-04-20T10:50:50.647710+0000","last_clean":"2024-04-20T10:50:50.647710+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:50.647710+0000","last_undegraded":"2024-04-20T10:50:50.647710+0000","last_fullsized":"2024-04-20T10:50:50.647710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:07.016612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918599+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:50.918599+0000","last_peered":"2024-04-20T10:50:50.918599+0000","last_clean":"2024-04-20T10:50:50.918599+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:50.918599+0000","last_undegraded":"2024-04-20T10:50:50.918599+0000","last_fullsized":"2024-04-20T10:50:50.918599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647233+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:50:50.647233+0000","last_peered":"2024-04-20T10:50:50.647233+0000","last_clean":"2024-04-20T10:50:50.647233+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:50:50.647233+0000","last_undegraded":"2024-04-20T10:50:50.647233+0000","last_fullsized":"2024-04-20T10:50:50.647233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647083+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:50:50.647083+0000","last_peered":"2024-04-20T10:50:50.647083+0000","last_clean":"2024-04-20T10:50:50.647083+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:50:50.647083+0000","last_undegraded":"2024-04-20T10:50:50.647083+0000","last_fullsized":"2024-04-20T10:50:50.647083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647704+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:50.647704+0000","last_peered":"2024-04-20T10:50:50.647704+0000","last_clean":"2024-04-20T10:50:50.647704+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:50.647704+0000","last_undegraded":"2024-04-20T10:50:50.647704+0000","last_fullsized":"2024-04-20T10:50:50.647704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918767+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:50.918767+0000","last_peered":"2024-04-20T10:50:50.918767+0000","last_clean":"2024-04-20T10:50:50.918767+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:50.918767+0000","last_undegraded":"2024-04-20T10:50:50.918767+0000","last_fullsized":"2024-04-20T10:50:50.918767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919440+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:50:50.919440+0000","last_peered":"2024-04-20T10:50:50.919440+0000","last_clean":"2024-04-20T10:50:50.919440+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:50:50.919440+0000","last_undegraded":"2024-04-20T10:50:50.919440+0000","last_fullsized":"2024-04-20T10:50:50.919440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919258+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:50:50.919258+0000","last_peered":"2024-04-20T10:50:50.919258+0000","last_clean":"2024-04-20T10:50:50.919258+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:50:50.919258+0000","last_undegraded":"2024-04-20T10:50:50.919258+0000","last_fullsized":"2024-04-20T10:50:50.919258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647487+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:50.647487+0000","last_peered":"2024-04-20T10:50:50.647487+0000","last_clean":"2024-04-20T10:50:50.647487+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:50.647487+0000","last_undegraded":"2024-04-20T10:50:50.647487+0000","last_fullsized":"2024-04-20T10:50:50.647487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918378+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:50.918378+0000","last_peered":"2024-04-20T10:50:50.918378+0000","last_clean":"2024-04-20T10:50:50.918378+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:50.918378+0000","last_undegraded":"2024-04-20T10:50:50.918378+0000","last_fullsized":"2024-04-20T10:50:50.918378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647210+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:50:50.647210+0000","last_peered":"2024-04-20T10:50:50.647210+0000","last_clean":"2024-04-20T10:50:50.647210+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:50:50.647210+0000","last_undegraded":"2024-04-20T10:50:50.647210+0000","last_fullsized":"2024-04-20T10:50:50.647210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647499+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:50:50.647499+0000","last_peered":"2024-04-20T10:50:50.647499+0000","last_clean":"2024-04-20T10:50:50.647499+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:50:50.647499+0000","last_undegraded":"2024-04-20T10:50:50.647499+0000","last_fullsized":"2024-04-20T10:50:50.647499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919297+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:50.919297+0000","last_peered":"2024-04-20T10:50:50.919297+0000","last_clean":"2024-04-20T10:50:50.919297+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:50.919297+0000","last_undegraded":"2024-04-20T10:50:50.919297+0000","last_fullsized":"2024-04-20T10:50:50.919297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904955+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:50.904955+0000","last_peered":"2024-04-20T10:50:50.904955+0000","last_clean":"2024-04-20T10:50:50.904955+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:50.904955+0000","last_undegraded":"2024-04-20T10:50:50.904955+0000","last_fullsized":"2024-04-20T10:50:50.904955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647061+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:50:50.647061+0000","last_peered":"2024-04-20T10:50:50.647061+0000","last_clean":"2024-04-20T10:50:50.647061+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:50:50.647061+0000","last_undegraded":"2024-04-20T10:50:50.647061+0000","last_fullsized":"2024-04-20T10:50:50.647061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646640+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:50:50.646640+0000","last_peered":"2024-04-20T10:50:50.646640+0000","last_clean":"2024-04-20T10:50:50.646640+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:50:50.646640+0000","last_undegraded":"2024-04-20T10:50:50.646640+0000","last_fullsized":"2024-04-20T10:50:50.646640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647815+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:50.647815+0000","last_peered":"2024-04-20T10:50:50.647815+0000","last_clean":"2024-04-20T10:50:50.647815+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:50.647815+0000","last_undegraded":"2024-04-20T10:50:50.647815+0000","last_fullsized":"2024-04-20T10:50:50.647815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919903+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:50.919903+0000","last_peered":"2024-04-20T10:50:50.919903+0000","last_clean":"2024-04-20T10:50:50.919903+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:50.919903+0000","last_undegraded":"2024-04-20T10:50:50.919903+0000","last_fullsized":"2024-04-20T10:50:50.919903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647184+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:50:50.647184+0000","last_peered":"2024-04-20T10:50:50.647184+0000","last_clean":"2024-04-20T10:50:50.647184+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:50:50.647184+0000","last_undegraded":"2024-04-20T10:50:50.647184+0000","last_fullsized":"2024-04-20T10:50:50.647184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904364+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:50:50.904364+0000","last_peered":"2024-04-20T10:50:50.904364+0000","last_clean":"2024-04-20T10:50:50.904364+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:50:50.904364+0000","last_undegraded":"2024-04-20T10:50:50.904364+0000","last_fullsized":"2024-04-20T10:50:50.904364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919960+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:50.919960+0000","last_peered":"2024-04-20T10:50:50.919960+0000","last_clean":"2024-04-20T10:50:50.919960+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:50.919960+0000","last_undegraded":"2024-04-20T10:50:50.919960+0000","last_fullsized":"2024-04-20T10:50:50.919960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920149+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:50.920149+0000","last_peered":"2024-04-20T10:50:50.920149+0000","last_clean":"2024-04-20T10:50:50.920149+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:50.920149+0000","last_undegraded":"2024-04-20T10:50:50.920149+0000","last_fullsized":"2024-04-20T10:50:50.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919053+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:50:50.919053+0000","last_peered":"2024-04-20T10:50:50.919053+0000","last_clean":"2024-04-20T10:50:50.919053+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:50:50.919053+0000","last_undegraded":"2024-04-20T10:50:50.919053+0000","last_fullsized":"2024-04-20T10:50:50.919053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919594+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:50.919594+0000","last_peered":"2024-04-20T10:50:50.919594+0000","last_clean":"2024-04-20T10:50:50.919594+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:50.919594+0000","last_undegraded":"2024-04-20T10:50:50.919594+0000","last_fullsized":"2024-04-20T10:50:50.919594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919993+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:50.919993+0000","last_peered":"2024-04-20T10:50:50.919993+0000","last_clean":"2024-04-20T10:50:50.919993+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:50.919993+0000","last_undegraded":"2024-04-20T10:50:50.919993+0000","last_fullsized":"2024-04-20T10:50:50.919993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918452+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:50:50.918452+0000","last_peered":"2024-04-20T10:50:50.918452+0000","last_clean":"2024-04-20T10:50:50.918452+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:50:50.918452+0000","last_undegraded":"2024-04-20T10:50:50.918452+0000","last_fullsized":"2024-04-20T10:50:50.918452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918934+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:50:50.918934+0000","last_peered":"2024-04-20T10:50:50.918934+0000","last_clean":"2024-04-20T10:50:50.918934+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:50:50.918934+0000","last_undegraded":"2024-04-20T10:50:50.918934+0000","last_fullsized":"2024-04-20T10:50:50.918934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647503+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:50.647503+0000","last_peered":"2024-04-20T10:50:50.647503+0000","last_clean":"2024-04-20T10:50:50.647503+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:50.647503+0000","last_undegraded":"2024-04-20T10:50:50.647503+0000","last_fullsized":"2024-04-20T10:50:50.647503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919438+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:50.919438+0000","last_peered":"2024-04-20T10:50:50.919438+0000","last_clean":"2024-04-20T10:50:50.919438+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:50.919438+0000","last_undegraded":"2024-04-20T10:50:50.919438+0000","last_fullsized":"2024-04-20T10:50:50.919438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918697+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:50:50.918697+0000","last_peered":"2024-04-20T10:50:50.918697+0000","last_clean":"2024-04-20T10:50:50.918697+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:50:50.918697+0000","last_undegraded":"2024-04-20T10:50:50.918697+0000","last_fullsized":"2024-04-20T10:50:50.918697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918186+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:50.918186+0000","last_peered":"2024-04-20T10:50:50.918186+0000","last_clean":"2024-04-20T10:50:50.918186+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:50.918186+0000","last_undegraded":"2024-04-20T10:50:50.918186+0000","last_fullsized":"2024-04-20T10:50:50.918186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919238+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:50.919238+0000","last_peered":"2024-04-20T10:50:50.919238+0000","last_clean":"2024-04-20T10:50:50.919238+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:50.919238+0000","last_undegraded":"2024-04-20T10:50:50.919238+0000","last_fullsized":"2024-04-20T10:50:50.919238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919687+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:50:50.919687+0000","last_peered":"2024-04-20T10:50:50.919687+0000","last_clean":"2024-04-20T10:50:50.919687+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:50:50.919687+0000","last_undegraded":"2024-04-20T10:50:50.919687+0000","last_fullsized":"2024-04-20T10:50:50.919687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918605+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:50.918605+0000","last_peered":"2024-04-20T10:50:50.918605+0000","last_clean":"2024-04-20T10:50:50.918605+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:50.918605+0000","last_undegraded":"2024-04-20T10:50:50.918605+0000","last_fullsized":"2024-04-20T10:50:50.918605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918474+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:50.918474+0000","last_peered":"2024-04-20T10:50:50.918474+0000","last_clean":"2024-04-20T10:50:50.918474+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:50.918474+0000","last_undegraded":"2024-04-20T10:50:50.918474+0000","last_fullsized":"2024-04-20T10:50:50.918474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919237+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:50:50.919237+0000","last_peered":"2024-04-20T10:50:50.919237+0000","last_clean":"2024-04-20T10:50:50.919237+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:50:50.919237+0000","last_undegraded":"2024-04-20T10:50:50.919237+0000","last_fullsized":"2024-04-20T10:50:50.919237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919239+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:50:50.919239+0000","last_peered":"2024-04-20T10:50:50.919239+0000","last_clean":"2024-04-20T10:50:50.919239+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:50:50.919239+0000","last_undegraded":"2024-04-20T10:50:50.919239+0000","last_fullsized":"2024-04-20T10:50:50.919239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647940+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:50.647940+0000","last_peered":"2024-04-20T10:50:50.647940+0000","last_clean":"2024-04-20T10:50:50.647940+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:50.647940+0000","last_undegraded":"2024-04-20T10:50:50.647940+0000","last_fullsized":"2024-04-20T10:50:50.647940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918168+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:50.918168+0000","last_peered":"2024-04-20T10:50:50.918168+0000","last_clean":"2024-04-20T10:50:50.918168+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:50.918168+0000","last_undegraded":"2024-04-20T10:50:50.918168+0000","last_fullsized":"2024-04-20T10:50:50.918168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918735+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:50.918735+0000","last_peered":"2024-04-20T10:50:50.918735+0000","last_clean":"2024-04-20T10:50:50.918735+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:50.918735+0000","last_undegraded":"2024-04-20T10:50:50.918735+0000","last_fullsized":"2024-04-20T10:50:50.918735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904495+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:50:50.904495+0000","last_peered":"2024-04-20T10:50:50.904495+0000","last_clean":"2024-04-20T10:50:50.904495+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:50:50.904495+0000","last_undegraded":"2024-04-20T10:50:50.904495+0000","last_fullsized":"2024-04-20T10:50:50.904495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920137+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:50:50.920137+0000","last_peered":"2024-04-20T10:50:50.920137+0000","last_clean":"2024-04-20T10:50:50.920137+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:50:50.920137+0000","last_undegraded":"2024-04-20T10:50:50.920137+0000","last_fullsized":"2024-04-20T10:50:50.920137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919949+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:50.919949+0000","last_peered":"2024-04-20T10:50:50.919949+0000","last_clean":"2024-04-20T10:50:50.919949+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:50.919949+0000","last_undegraded":"2024-04-20T10:50:50.919949+0000","last_fullsized":"2024-04-20T10:50:50.919949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920093+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:50.920093+0000","last_peered":"2024-04-20T10:50:50.920093+0000","last_clean":"2024-04-20T10:50:50.920093+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:50.920093+0000","last_undegraded":"2024-04-20T10:50:50.920093+0000","last_fullsized":"2024-04-20T10:50:50.920093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904372+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:50:50.904372+0000","last_peered":"2024-04-20T10:50:50.904372+0000","last_clean":"2024-04-20T10:50:50.904372+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:50:50.904372+0000","last_undegraded":"2024-04-20T10:50:50.904372+0000","last_fullsized":"2024-04-20T10:50:50.904372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918546+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:50:50.918546+0000","last_peered":"2024-04-20T10:50:50.918546+0000","last_clean":"2024-04-20T10:50:50.918546+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:50:50.918546+0000","last_undegraded":"2024-04-20T10:50:50.918546+0000","last_fullsized":"2024-04-20T10:50:50.918546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919184+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:50.919184+0000","last_peered":"2024-04-20T10:50:50.919184+0000","last_clean":"2024-04-20T10:50:50.919184+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:50.919184+0000","last_undegraded":"2024-04-20T10:50:50.919184+0000","last_fullsized":"2024-04-20T10:50:50.919184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920068+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:50.920068+0000","last_peered":"2024-04-20T10:50:50.920068+0000","last_clean":"2024-04-20T10:50:50.920068+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:50.920068+0000","last_undegraded":"2024-04-20T10:50:50.920068+0000","last_fullsized":"2024-04-20T10:50:50.920068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918899+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:50:50.918899+0000","last_peered":"2024-04-20T10:50:50.918899+0000","last_clean":"2024-04-20T10:50:50.918899+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:50:50.918899+0000","last_undegraded":"2024-04-20T10:50:50.918899+0000","last_fullsized":"2024-04-20T10:50:50.918899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918088+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:50:50.918088+0000","last_peered":"2024-04-20T10:50:50.918088+0000","last_clean":"2024-04-20T10:50:50.918088+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:50:50.918088+0000","last_undegraded":"2024-04-20T10:50:50.918088+0000","last_fullsized":"2024-04-20T10:50:50.918088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920183+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:50.920183+0000","last_peered":"2024-04-20T10:50:50.920183+0000","last_clean":"2024-04-20T10:50:50.920183+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:50.920183+0000","last_undegraded":"2024-04-20T10:50:50.920183+0000","last_fullsized":"2024-04-20T10:50:50.920183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918853+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:50.918853+0000","last_peered":"2024-04-20T10:50:50.918853+0000","last_clean":"2024-04-20T10:50:50.918853+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:50.918853+0000","last_undegraded":"2024-04-20T10:50:50.918853+0000","last_fullsized":"2024-04-20T10:50:50.918853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918057+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:50:50.918057+0000","last_peered":"2024-04-20T10:50:50.918057+0000","last_clean":"2024-04-20T10:50:50.918057+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:50:50.918057+0000","last_undegraded":"2024-04-20T10:50:50.918057+0000","last_fullsized":"2024-04-20T10:50:50.918057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919612+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:50:50.919612+0000","last_peered":"2024-04-20T10:50:50.919612+0000","last_clean":"2024-04-20T10:50:50.919612+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:50:50.919612+0000","last_undegraded":"2024-04-20T10:50:50.919612+0000","last_fullsized":"2024-04-20T10:50:50.919612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647644+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:50.647644+0000","last_peered":"2024-04-20T10:50:50.647644+0000","last_clean":"2024-04-20T10:50:50.647644+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:50.647644+0000","last_undegraded":"2024-04-20T10:50:50.647644+0000","last_fullsized":"2024-04-20T10:50:50.647644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646587+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:50:50.646587+0000","last_peered":"2024-04-20T10:50:50.646587+0000","last_clean":"2024-04-20T10:50:50.646587+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:50:50.646587+0000","last_undegraded":"2024-04-20T10:50:50.646587+0000","last_fullsized":"2024-04-20T10:50:50.646587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647705+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:50:50.647705+0000","last_peered":"2024-04-20T10:50:50.647705+0000","last_clean":"2024-04-20T10:50:50.647705+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:50:50.647705+0000","last_undegraded":"2024-04-20T10:50:50.647705+0000","last_fullsized":"2024-04-20T10:50:50.647705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918736+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:50.918736+0000","last_peered":"2024-04-20T10:50:50.918736+0000","last_clean":"2024-04-20T10:50:50.918736+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:50.918736+0000","last_undegraded":"2024-04-20T10:50:50.918736+0000","last_fullsized":"2024-04-20T10:50:50.918736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918257+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:50.918257+0000","last_peered":"2024-04-20T10:50:50.918257+0000","last_clean":"2024-04-20T10:50:50.918257+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:50.918257+0000","last_undegraded":"2024-04-20T10:50:50.918257+0000","last_fullsized":"2024-04-20T10:50:50.918257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919316+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:50:50.919316+0000","last_peered":"2024-04-20T10:50:50.919316+0000","last_clean":"2024-04-20T10:50:50.919316+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:50:50.919316+0000","last_undegraded":"2024-04-20T10:50:50.919316+0000","last_fullsized":"2024-04-20T10:50:50.919316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918977+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:50:50.918977+0000","last_peered":"2024-04-20T10:50:50.918977+0000","last_clean":"2024-04-20T10:50:50.918977+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:50:50.918977+0000","last_undegraded":"2024-04-20T10:50:50.918977+0000","last_fullsized":"2024-04-20T10:50:50.918977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904080+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:50.904080+0000","last_peered":"2024-04-20T10:50:50.904080+0000","last_clean":"2024-04-20T10:50:50.904080+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:50.904080+0000","last_undegraded":"2024-04-20T10:50:50.904080+0000","last_fullsized":"2024-04-20T10:50:50.904080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904487+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:50.904487+0000","last_peered":"2024-04-20T10:50:50.904487+0000","last_clean":"2024-04-20T10:50:50.904487+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:50.904487+0000","last_undegraded":"2024-04-20T10:50:50.904487+0000","last_fullsized":"2024-04-20T10:50:50.904487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647768+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:50:50.647768+0000","last_peered":"2024-04-20T10:50:50.647768+0000","last_clean":"2024-04-20T10:50:50.647768+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:50:50.647768+0000","last_undegraded":"2024-04-20T10:50:50.647768+0000","last_fullsized":"2024-04-20T10:50:50.647768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918820+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:50:50.918820+0000","last_peered":"2024-04-20T10:50:50.918820+0000","last_clean":"2024-04-20T10:50:50.918820+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:50:50.918820+0000","last_undegraded":"2024-04-20T10:50:50.918820+0000","last_fullsized":"2024-04-20T10:50:50.918820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919283+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:50.919283+0000","last_peered":"2024-04-20T10:50:50.919283+0000","last_clean":"2024-04-20T10:50:50.919283+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:50.919283+0000","last_undegraded":"2024-04-20T10:50:50.919283+0000","last_fullsized":"2024-04-20T10:50:50.919283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919373+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:50.919373+0000","last_peered":"2024-04-20T10:50:50.919373+0000","last_clean":"2024-04-20T10:50:50.919373+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:50.919373+0000","last_undegraded":"2024-04-20T10:50:50.919373+0000","last_fullsized":"2024-04-20T10:50:50.919373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648175+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:50:50.648175+0000","last_peered":"2024-04-20T10:50:50.648175+0000","last_clean":"2024-04-20T10:50:50.648175+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:50:50.648175+0000","last_undegraded":"2024-04-20T10:50:50.648175+0000","last_fullsized":"2024-04-20T10:50:50.648175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648149+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:50:50.648149+0000","last_peered":"2024-04-20T10:50:50.648149+0000","last_clean":"2024-04-20T10:50:50.648149+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:50:50.648149+0000","last_undegraded":"2024-04-20T10:50:50.648149+0000","last_fullsized":"2024-04-20T10:50:50.648149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918773+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:50.918773+0000","last_peered":"2024-04-20T10:50:50.918773+0000","last_clean":"2024-04-20T10:50:50.918773+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:50.918773+0000","last_undegraded":"2024-04-20T10:50:50.918773+0000","last_fullsized":"2024-04-20T10:50:50.918773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919619+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:50.919619+0000","last_peered":"2024-04-20T10:50:50.919619+0000","last_clean":"2024-04-20T10:50:50.919619+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:50.919619+0000","last_undegraded":"2024-04-20T10:50:50.919619+0000","last_fullsized":"2024-04-20T10:50:50.919619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919480+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:50:50.919480+0000","last_peered":"2024-04-20T10:50:50.919480+0000","last_clean":"2024-04-20T10:50:50.919480+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:50:50.919480+0000","last_undegraded":"2024-04-20T10:50:50.919480+0000","last_fullsized":"2024-04-20T10:50:50.919480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647622+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:50:50.647622+0000","last_peered":"2024-04-20T10:50:50.647622+0000","last_clean":"2024-04-20T10:50:50.647622+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:50:50.647622+0000","last_undegraded":"2024-04-20T10:50:50.647622+0000","last_fullsized":"2024-04-20T10:50:50.647622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919782+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:50.919782+0000","last_peered":"2024-04-20T10:50:50.919782+0000","last_clean":"2024-04-20T10:50:50.919782+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:50.919782+0000","last_undegraded":"2024-04-20T10:50:50.919782+0000","last_fullsized":"2024-04-20T10:50:50.919782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904433+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:50:50.904433+0000","last_peered":"2024-04-20T10:50:50.904433+0000","last_clean":"2024-04-20T10:50:50.904433+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:50:50.904433+0000","last_undegraded":"2024-04-20T10:50:50.904433+0000","last_fullsized":"2024-04-20T10:50:50.904433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918370+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:50:50.918370+0000","last_peered":"2024-04-20T10:50:50.918370+0000","last_clean":"2024-04-20T10:50:50.918370+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:50:50.918370+0000","last_undegraded":"2024-04-20T10:50:50.918370+0000","last_fullsized":"2024-04-20T10:50:50.918370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918531+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:50:50.918531+0000","last_peered":"2024-04-20T10:50:50.918531+0000","last_clean":"2024-04-20T10:50:50.918531+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:50:50.918531+0000","last_undegraded":"2024-04-20T10:50:50.918531+0000","last_fullsized":"2024-04-20T10:50:50.918531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647604+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:50.647604+0000","last_peered":"2024-04-20T10:50:50.647604+0000","last_clean":"2024-04-20T10:50:50.647604+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:50.647604+0000","last_undegraded":"2024-04-20T10:50:50.647604+0000","last_fullsized":"2024-04-20T10:50:50.647604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647241+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:50:50.647241+0000","last_peered":"2024-04-20T10:50:50.647241+0000","last_clean":"2024-04-20T10:50:50.647241+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:50:50.647241+0000","last_undegraded":"2024-04-20T10:50:50.647241+0000","last_fullsized":"2024-04-20T10:50:50.647241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904476+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:50:50.904476+0000","last_peered":"2024-04-20T10:50:50.904476+0000","last_clean":"2024-04-20T10:50:50.904476+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:50:50.904476+0000","last_undegraded":"2024-04-20T10:50:50.904476+0000","last_fullsized":"2024-04-20T10:50:50.904476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919071+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:50.919071+0000","last_peered":"2024-04-20T10:50:50.919071+0000","last_clean":"2024-04-20T10:50:50.919071+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:50.919071+0000","last_undegraded":"2024-04-20T10:50:50.919071+0000","last_fullsized":"2024-04-20T10:50:50.919071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919039+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:50.919039+0000","last_peered":"2024-04-20T10:50:50.919039+0000","last_clean":"2024-04-20T10:50:50.919039+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:50.919039+0000","last_undegraded":"2024-04-20T10:50:50.919039+0000","last_fullsized":"2024-04-20T10:50:50.919039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647348+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:50:50.647348+0000","last_peered":"2024-04-20T10:50:50.647348+0000","last_clean":"2024-04-20T10:50:50.647348+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:50:50.647348+0000","last_undegraded":"2024-04-20T10:50:50.647348+0000","last_fullsized":"2024-04-20T10:50:50.647348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918201+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:50:50.918201+0000","last_peered":"2024-04-20T10:50:50.918201+0000","last_clean":"2024-04-20T10:50:50.918201+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:50:50.918201+0000","last_undegraded":"2024-04-20T10:50:50.918201+0000","last_fullsized":"2024-04-20T10:50:50.918201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919011+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:50.919011+0000","last_peered":"2024-04-20T10:50:50.919011+0000","last_clean":"2024-04-20T10:50:50.919011+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:50.919011+0000","last_undegraded":"2024-04-20T10:50:50.919011+0000","last_fullsized":"2024-04-20T10:50:50.919011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904919+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:50.904919+0000","last_peered":"2024-04-20T10:50:50.904919+0000","last_clean":"2024-04-20T10:50:50.904919+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:50.904919+0000","last_undegraded":"2024-04-20T10:50:50.904919+0000","last_fullsized":"2024-04-20T10:50:50.904919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647257+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:50:50.647257+0000","last_peered":"2024-04-20T10:50:50.647257+0000","last_clean":"2024-04-20T10:50:50.647257+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:50:50.647257+0000","last_undegraded":"2024-04-20T10:50:50.647257+0000","last_fullsized":"2024-04-20T10:50:50.647257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904798+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:50:50.904798+0000","last_peered":"2024-04-20T10:50:50.904798+0000","last_clean":"2024-04-20T10:50:50.904798+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:50:50.904798+0000","last_undegraded":"2024-04-20T10:50:50.904798+0000","last_fullsized":"2024-04-20T10:50:50.904798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919143+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:50:50.919143+0000","last_peered":"2024-04-20T10:50:50.919143+0000","last_clean":"2024-04-20T10:50:50.919143+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:50:50.919143+0000","last_undegraded":"2024-04-20T10:50:50.919143+0000","last_fullsized":"2024-04-20T10:50:50.919143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918587+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:50.918587+0000","last_peered":"2024-04-20T10:50:50.918587+0000","last_clean":"2024-04-20T10:50:50.918587+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:50.918587+0000","last_undegraded":"2024-04-20T10:50:50.918587+0000","last_fullsized":"2024-04-20T10:50:50.918587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918226+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:50.918226+0000","last_peered":"2024-04-20T10:50:50.918226+0000","last_clean":"2024-04-20T10:50:50.918226+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:50.918226+0000","last_undegraded":"2024-04-20T10:50:50.918226+0000","last_fullsized":"2024-04-20T10:50:50.918226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919055+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:50:50.919055+0000","last_peered":"2024-04-20T10:50:50.919055+0000","last_clean":"2024-04-20T10:50:50.919055+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:50:50.919055+0000","last_undegraded":"2024-04-20T10:50:50.919055+0000","last_fullsized":"2024-04-20T10:50:50.919055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904885+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:50:50.904885+0000","last_peered":"2024-04-20T10:50:50.904885+0000","last_clean":"2024-04-20T10:50:50.904885+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:50:50.904885+0000","last_undegraded":"2024-04-20T10:50:50.904885+0000","last_fullsized":"2024-04-20T10:50:50.904885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647617+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:50.647617+0000","last_peered":"2024-04-20T10:50:50.647617+0000","last_clean":"2024-04-20T10:50:50.647617+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:50.647617+0000","last_undegraded":"2024-04-20T10:50:50.647617+0000","last_fullsized":"2024-04-20T10:50:50.647617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647427+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:50.647427+0000","last_peered":"2024-04-20T10:50:50.647427+0000","last_clean":"2024-04-20T10:50:50.647427+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:50.647427+0000","last_undegraded":"2024-04-20T10:50:50.647427+0000","last_fullsized":"2024-04-20T10:50:50.647427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919353+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:50:50.919353+0000","last_peered":"2024-04-20T10:50:50.919353+0000","last_clean":"2024-04-20T10:50:50.919353+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:50:50.919353+0000","last_undegraded":"2024-04-20T10:50:50.919353+0000","last_fullsized":"2024-04-20T10:50:50.919353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904598+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:50.904598+0000","last_peered":"2024-04-20T10:50:50.904598+0000","last_clean":"2024-04-20T10:50:50.904598+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:50.904598+0000","last_undegraded":"2024-04-20T10:50:50.904598+0000","last_fullsized":"2024-04-20T10:50:50.904598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919448+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:50.919448+0000","last_peered":"2024-04-20T10:50:50.919448+0000","last_clean":"2024-04-20T10:50:50.919448+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:50.919448+0000","last_undegraded":"2024-04-20T10:50:50.919448+0000","last_fullsized":"2024-04-20T10:50:50.919448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919923+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:50:50.919923+0000","last_peered":"2024-04-20T10:50:50.919923+0000","last_clean":"2024-04-20T10:50:50.919923+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:50:50.919923+0000","last_undegraded":"2024-04-20T10:50:50.919923+0000","last_fullsized":"2024-04-20T10:50:50.919923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646954+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:50:50.646954+0000","last_peered":"2024-04-20T10:50:50.646954+0000","last_clean":"2024-04-20T10:50:50.646954+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:50:50.646954+0000","last_undegraded":"2024-04-20T10:50:50.646954+0000","last_fullsized":"2024-04-20T10:50:50.646954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647875+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:50.647875+0000","last_peered":"2024-04-20T10:50:50.647875+0000","last_clean":"2024-04-20T10:50:50.647875+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:50.647875+0000","last_undegraded":"2024-04-20T10:50:50.647875+0000","last_fullsized":"2024-04-20T10:50:50.647875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647129+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:50.647129+0000","last_peered":"2024-04-20T10:50:50.647129+0000","last_clean":"2024-04-20T10:50:50.647129+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:50.647129+0000","last_undegraded":"2024-04-20T10:50:50.647129+0000","last_fullsized":"2024-04-20T10:50:50.647129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648051+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:50:50.648051+0000","last_peered":"2024-04-20T10:50:50.648051+0000","last_clean":"2024-04-20T10:50:50.648051+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:50:50.648051+0000","last_undegraded":"2024-04-20T10:50:50.648051+0000","last_fullsized":"2024-04-20T10:50:50.648051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648041+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:50:50.648041+0000","last_peered":"2024-04-20T10:50:50.648041+0000","last_clean":"2024-04-20T10:50:50.648041+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:50:50.648041+0000","last_undegraded":"2024-04-20T10:50:50.648041+0000","last_fullsized":"2024-04-20T10:50:50.648041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904067+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:50.904067+0000","last_peered":"2024-04-20T10:50:50.904067+0000","last_clean":"2024-04-20T10:50:50.904067+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:50.904067+0000","last_undegraded":"2024-04-20T10:50:50.904067+0000","last_fullsized":"2024-04-20T10:50:50.904067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919274+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:50:50.919274+0000","last_peered":"2024-04-20T10:50:50.919274+0000","last_clean":"2024-04-20T10:50:50.919274+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:50:50.919274+0000","last_undegraded":"2024-04-20T10:50:50.919274+0000","last_fullsized":"2024-04-20T10:50:50.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918980+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:50.918980+0000","last_peered":"2024-04-20T10:50:50.918980+0000","last_clean":"2024-04-20T10:50:50.918980+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:50.918980+0000","last_undegraded":"2024-04-20T10:50:50.918980+0000","last_fullsized":"2024-04-20T10:50:50.918980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918617+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:50:50.918617+0000","last_peered":"2024-04-20T10:50:50.918617+0000","last_clean":"2024-04-20T10:50:50.918617+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:50:50.918617+0000","last_undegraded":"2024-04-20T10:50:50.918617+0000","last_fullsized":"2024-04-20T10:50:50.918617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919308+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:50.919308+0000","last_peered":"2024-04-20T10:50:50.919308+0000","last_clean":"2024-04-20T10:50:50.919308+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:50.919308+0000","last_undegraded":"2024-04-20T10:50:50.919308+0000","last_fullsized":"2024-04-20T10:50:50.919308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919405+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:50.919405+0000","last_peered":"2024-04-20T10:50:50.919405+0000","last_clean":"2024-04-20T10:50:50.919405+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:50.919405+0000","last_undegraded":"2024-04-20T10:50:50.919405+0000","last_fullsized":"2024-04-20T10:50:50.919405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918338+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:50:50.918338+0000","last_peered":"2024-04-20T10:50:50.918338+0000","last_clean":"2024-04-20T10:50:50.918338+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:50:50.918338+0000","last_undegraded":"2024-04-20T10:50:50.918338+0000","last_fullsized":"2024-04-20T10:50:50.918338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648264+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:50.648264+0000","last_peered":"2024-04-20T10:50:50.648264+0000","last_clean":"2024-04-20T10:50:50.648264+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:50.648264+0000","last_undegraded":"2024-04-20T10:50:50.648264+0000","last_fullsized":"2024-04-20T10:50:50.648264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647153+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:50:50.647153+0000","last_peered":"2024-04-20T10:50:50.647153+0000","last_clean":"2024-04-20T10:50:50.647153+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:50:50.647153+0000","last_undegraded":"2024-04-20T10:50:50.647153+0000","last_fullsized":"2024-04-20T10:50:50.647153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919569+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:50.919569+0000","last_peered":"2024-04-20T10:50:50.919569+0000","last_clean":"2024-04-20T10:50:50.919569+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:50.919569+0000","last_undegraded":"2024-04-20T10:50:50.919569+0000","last_fullsized":"2024-04-20T10:50:50.919569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904775+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:50.904775+0000","last_peered":"2024-04-20T10:50:50.904775+0000","last_clean":"2024-04-20T10:50:50.904775+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:50.904775+0000","last_undegraded":"2024-04-20T10:50:50.904775+0000","last_fullsized":"2024-04-20T10:50:50.904775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904299+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:50:50.904299+0000","last_peered":"2024-04-20T10:50:50.904299+0000","last_clean":"2024-04-20T10:50:50.904299+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:50:50.904299+0000","last_undegraded":"2024-04-20T10:50:50.904299+0000","last_fullsized":"2024-04-20T10:50:50.904299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647767+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:50.647767+0000","last_peered":"2024-04-20T10:50:50.647767+0000","last_clean":"2024-04-20T10:50:50.647767+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:50.647767+0000","last_undegraded":"2024-04-20T10:50:50.647767+0000","last_fullsized":"2024-04-20T10:50:50.647767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647843+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:50:50.647843+0000","last_peered":"2024-04-20T10:50:50.647843+0000","last_clean":"2024-04-20T10:50:50.647843+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:50:50.647843+0000","last_undegraded":"2024-04-20T10:50:50.647843+0000","last_fullsized":"2024-04-20T10:50:50.647843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918116+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:50.918116+0000","last_peered":"2024-04-20T10:50:50.918116+0000","last_clean":"2024-04-20T10:50:50.918116+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:50.918116+0000","last_undegraded":"2024-04-20T10:50:50.918116+0000","last_fullsized":"2024-04-20T10:50:50.918116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920306+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:50:50.920306+0000","last_peered":"2024-04-20T10:50:50.920306+0000","last_clean":"2024-04-20T10:50:50.920306+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:50:50.920306+0000","last_undegraded":"2024-04-20T10:50:50.920306+0000","last_fullsized":"2024-04-20T10:50:50.920306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647324+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:50.647324+0000","last_peered":"2024-04-20T10:50:50.647324+0000","last_clean":"2024-04-20T10:50:50.647324+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:50.647324+0000","last_undegraded":"2024-04-20T10:50:50.647324+0000","last_fullsized":"2024-04-20T10:50:50.647324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919821+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:50:50.919821+0000","last_peered":"2024-04-20T10:50:50.919821+0000","last_clean":"2024-04-20T10:50:50.919821+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:50:50.919821+0000","last_undegraded":"2024-04-20T10:50:50.919821+0000","last_fullsized":"2024-04-20T10:50:50.919821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919185+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:50.919185+0000","last_peered":"2024-04-20T10:50:50.919185+0000","last_clean":"2024-04-20T10:50:50.919185+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:50.919185+0000","last_undegraded":"2024-04-20T10:50:50.919185+0000","last_fullsized":"2024-04-20T10:50:50.919185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647822+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:50:50.647822+0000","last_peered":"2024-04-20T10:50:50.647822+0000","last_clean":"2024-04-20T10:50:50.647822+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:50:50.647822+0000","last_undegraded":"2024-04-20T10:50:50.647822+0000","last_fullsized":"2024-04-20T10:50:50.647822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919221+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:50.919221+0000","last_peered":"2024-04-20T10:50:50.919221+0000","last_clean":"2024-04-20T10:50:50.919221+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:50.919221+0000","last_undegraded":"2024-04-20T10:50:50.919221+0000","last_fullsized":"2024-04-20T10:50:50.919221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646687+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:50:50.646687+0000","last_peered":"2024-04-20T10:50:50.646687+0000","last_clean":"2024-04-20T10:50:50.646687+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:50:50.646687+0000","last_undegraded":"2024-04-20T10:50:50.646687+0000","last_fullsized":"2024-04-20T10:50:50.646687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904324+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:50.904324+0000","last_peered":"2024-04-20T10:50:50.904324+0000","last_clean":"2024-04-20T10:50:50.904324+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:50.904324+0000","last_undegraded":"2024-04-20T10:50:50.904324+0000","last_fullsized":"2024-04-20T10:50:50.904324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646680+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:50:50.646680+0000","last_peered":"2024-04-20T10:50:50.646680+0000","last_clean":"2024-04-20T10:50:50.646680+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:50:50.646680+0000","last_undegraded":"2024-04-20T10:50:50.646680+0000","last_fullsized":"2024-04-20T10:50:50.646680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920058+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:50.920058+0000","last_peered":"2024-04-20T10:50:50.920058+0000","last_clean":"2024-04-20T10:50:50.920058+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:50.920058+0000","last_undegraded":"2024-04-20T10:50:50.920058+0000","last_fullsized":"2024-04-20T10:50:50.920058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918048+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:50:50.918048+0000","last_peered":"2024-04-20T10:50:50.918048+0000","last_clean":"2024-04-20T10:50:50.918048+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:50:50.918048+0000","last_undegraded":"2024-04-20T10:50:50.918048+0000","last_fullsized":"2024-04-20T10:50:50.918048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918749+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:50.918749+0000","last_peered":"2024-04-20T10:50:50.918749+0000","last_clean":"2024-04-20T10:50:50.918749+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:50.918749+0000","last_undegraded":"2024-04-20T10:50:50.918749+0000","last_fullsized":"2024-04-20T10:50:50.918749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918281+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:50:50.918281+0000","last_peered":"2024-04-20T10:50:50.918281+0000","last_clean":"2024-04-20T10:50:50.918281+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:50:50.918281+0000","last_undegraded":"2024-04-20T10:50:50.918281+0000","last_fullsized":"2024-04-20T10:50:50.918281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919598+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:50.919598+0000","last_peered":"2024-04-20T10:50:50.919598+0000","last_clean":"2024-04-20T10:50:50.919598+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:50.919598+0000","last_undegraded":"2024-04-20T10:50:50.919598+0000","last_fullsized":"2024-04-20T10:50:50.919598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919839+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:50:50.919839+0000","last_peered":"2024-04-20T10:50:50.919839+0000","last_clean":"2024-04-20T10:50:50.919839+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:50:50.919839+0000","last_undegraded":"2024-04-20T10:50:50.919839+0000","last_fullsized":"2024-04-20T10:50:50.919839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918109+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:50.918109+0000","last_peered":"2024-04-20T10:50:50.918109+0000","last_clean":"2024-04-20T10:50:50.918109+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:50.918109+0000","last_undegraded":"2024-04-20T10:50:50.918109+0000","last_fullsized":"2024-04-20T10:50:50.918109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647462+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:50:50.647462+0000","last_peered":"2024-04-20T10:50:50.647462+0000","last_clean":"2024-04-20T10:50:50.647462+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:50:50.647462+0000","last_undegraded":"2024-04-20T10:50:50.647462+0000","last_fullsized":"2024-04-20T10:50:50.647462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918682+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:50.918682+0000","last_peered":"2024-04-20T10:50:50.918682+0000","last_clean":"2024-04-20T10:50:50.918682+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:50.918682+0000","last_undegraded":"2024-04-20T10:50:50.918682+0000","last_fullsized":"2024-04-20T10:50:50.918682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918787+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:50:50.918787+0000","last_peered":"2024-04-20T10:50:50.918787+0000","last_clean":"2024-04-20T10:50:50.918787+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:50:50.918787+0000","last_undegraded":"2024-04-20T10:50:50.918787+0000","last_fullsized":"2024-04-20T10:50:50.918787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918739+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:50.918739+0000","last_peered":"2024-04-20T10:50:50.918739+0000","last_clean":"2024-04-20T10:50:50.918739+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:50.918739+0000","last_undegraded":"2024-04-20T10:50:50.918739+0000","last_fullsized":"2024-04-20T10:50:50.918739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647651+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:50.647651+0000","last_peered":"2024-04-20T10:50:50.647651+0000","last_clean":"2024-04-20T10:50:50.647651+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:50.647651+0000","last_undegraded":"2024-04-20T10:50:50.647651+0000","last_fullsized":"2024-04-20T10:50:50.647651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647567+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:50.647567+0000","last_peered":"2024-04-20T10:50:50.647567+0000","last_clean":"2024-04-20T10:50:50.647567+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:50.647567+0000","last_undegraded":"2024-04-20T10:50:50.647567+0000","last_fullsized":"2024-04-20T10:50:50.647567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919983+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:50:50.919983+0000","last_peered":"2024-04-20T10:50:50.919983+0000","last_clean":"2024-04-20T10:50:50.919983+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:50:50.919983+0000","last_undegraded":"2024-04-20T10:50:50.919983+0000","last_fullsized":"2024-04-20T10:50:50.919983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918676+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:50:50.918676+0000","last_peered":"2024-04-20T10:50:50.918676+0000","last_clean":"2024-04-20T10:50:50.918676+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:50:50.918676+0000","last_undegraded":"2024-04-20T10:50:50.918676+0000","last_fullsized":"2024-04-20T10:50:50.918676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904771+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:50.904771+0000","last_peered":"2024-04-20T10:50:50.904771+0000","last_clean":"2024-04-20T10:50:50.904771+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:50.904771+0000","last_undegraded":"2024-04-20T10:50:50.904771+0000","last_fullsized":"2024-04-20T10:50:50.904771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918237+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:50:50.918237+0000","last_peered":"2024-04-20T10:50:50.918237+0000","last_clean":"2024-04-20T10:50:50.918237+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:50:50.918237+0000","last_undegraded":"2024-04-20T10:50:50.918237+0000","last_fullsized":"2024-04-20T10:50:50.918237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920158+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:50.920158+0000","last_peered":"2024-04-20T10:50:50.920158+0000","last_clean":"2024-04-20T10:50:50.920158+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:50.920158+0000","last_undegraded":"2024-04-20T10:50:50.920158+0000","last_fullsized":"2024-04-20T10:50:50.920158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647709+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:50:50.647709+0000","last_peered":"2024-04-20T10:50:50.647709+0000","last_clean":"2024-04-20T10:50:50.647709+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:50:50.647709+0000","last_undegraded":"2024-04-20T10:50:50.647709+0000","last_fullsized":"2024-04-20T10:50:50.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647411+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:50.647411+0000","last_peered":"2024-04-20T10:50:50.647411+0000","last_clean":"2024-04-20T10:50:50.647411+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:50.647411+0000","last_undegraded":"2024-04-20T10:50:50.647411+0000","last_fullsized":"2024-04-20T10:50:50.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904808+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:50:50.904808+0000","last_peered":"2024-04-20T10:50:50.904808+0000","last_clean":"2024-04-20T10:50:50.904808+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:50:50.904808+0000","last_undegraded":"2024-04-20T10:50:50.904808+0000","last_fullsized":"2024-04-20T10:50:50.904808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918551+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:50.918551+0000","last_peered":"2024-04-20T10:50:50.918551+0000","last_clean":"2024-04-20T10:50:50.918551+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:50.918551+0000","last_undegraded":"2024-04-20T10:50:50.918551+0000","last_fullsized":"2024-04-20T10:50:50.918551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919755+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:50:50.919755+0000","last_peered":"2024-04-20T10:50:50.919755+0000","last_clean":"2024-04-20T10:50:50.919755+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:50:50.919755+0000","last_undegraded":"2024-04-20T10:50:50.919755+0000","last_fullsized":"2024-04-20T10:50:50.919755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919134+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:50.919134+0000","last_peered":"2024-04-20T10:50:50.919134+0000","last_clean":"2024-04-20T10:50:50.919134+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:50.919134+0000","last_undegraded":"2024-04-20T10:50:50.919134+0000","last_fullsized":"2024-04-20T10:50:50.919134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919397+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:50:50.919397+0000","last_peered":"2024-04-20T10:50:50.919397+0000","last_clean":"2024-04-20T10:50:50.919397+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:50:50.919397+0000","last_undegraded":"2024-04-20T10:50:50.919397+0000","last_fullsized":"2024-04-20T10:50:50.919397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919182+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:50.919182+0000","last_peered":"2024-04-20T10:50:50.919182+0000","last_clean":"2024-04-20T10:50:50.919182+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:50.919182+0000","last_undegraded":"2024-04-20T10:50:50.919182+0000","last_fullsized":"2024-04-20T10:50:50.919182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919141+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:50.919141+0000","last_peered":"2024-04-20T10:50:50.919141+0000","last_clean":"2024-04-20T10:50:50.919141+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:50.919141+0000","last_undegraded":"2024-04-20T10:50:50.919141+0000","last_fullsized":"2024-04-20T10:50:50.919141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919836+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:50:50.919836+0000","last_peered":"2024-04-20T10:50:50.919836+0000","last_clean":"2024-04-20T10:50:50.919836+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:50:50.919836+0000","last_undegraded":"2024-04-20T10:50:50.919836+0000","last_fullsized":"2024-04-20T10:50:50.919836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919036+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:50.919036+0000","last_peered":"2024-04-20T10:50:50.919036+0000","last_clean":"2024-04-20T10:50:50.919036+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:50.919036+0000","last_undegraded":"2024-04-20T10:50:50.919036+0000","last_fullsized":"2024-04-20T10:50:50.919036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918038+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:50:50.918038+0000","last_peered":"2024-04-20T10:50:50.918038+0000","last_clean":"2024-04-20T10:50:50.918038+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:50:50.918038+0000","last_undegraded":"2024-04-20T10:50:50.918038+0000","last_fullsized":"2024-04-20T10:50:50.918038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919810+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:50.919810+0000","last_peered":"2024-04-20T10:50:50.919810+0000","last_clean":"2024-04-20T10:50:50.919810+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:50.919810+0000","last_undegraded":"2024-04-20T10:50:50.919810+0000","last_fullsized":"2024-04-20T10:50:50.919810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918353+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:50:50.918353+0000","last_peered":"2024-04-20T10:50:50.918353+0000","last_clean":"2024-04-20T10:50:50.918353+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:50:50.918353+0000","last_undegraded":"2024-04-20T10:50:50.918353+0000","last_fullsized":"2024-04-20T10:50:50.918353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920113+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:50.920113+0000","last_peered":"2024-04-20T10:50:50.920113+0000","last_clean":"2024-04-20T10:50:50.920113+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:50.920113+0000","last_undegraded":"2024-04-20T10:50:50.920113+0000","last_fullsized":"2024-04-20T10:50:50.920113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":856064,"data_stored":687865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":106160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":97587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":96895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":98619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":687831,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:50:54.968 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-20T10:50:54.969 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-20T10:50:54.969 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-20T10:50:54.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-20T10:50:54.970 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-20T10:50:55.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f128499f640 1 Processor -- start 2024-04-20T10:50:55.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f128499f640 1 -- start start 2024-04-20T10:50:55.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f128499f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1280153ee0 0x7f1280157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f128499f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128006c2f0 con 0x7f128006be60 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f128499f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f128006c5d0 con 0x7f128006d390 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f128499f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f12801542c0 con 0x7f1280153ee0 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f127f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1280153ee0 0x7f1280157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f127f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1280153ee0 0x7f1280157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37168/0 (socket says 172.21.15.90:37168) 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f127effd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f128006be60 0x7f12800c67b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32990/0 (socket says 172.21.15.90:32990) 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.098+0000 7f127f7fe640 1 -- 172.21.15.90:0/1118208318 learned_addr learned my addr 172.21.15.90:0/1118208318 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.099+0000 7f127f7fe640 1 -- 172.21.15.90:0/1118208318 >> v1:172.21.15.175:6789/0 conn(0x7f128006d390 legacy=0x7f1280157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.099+0000 7f127f7fe640 1 -- 172.21.15.90:0/1118208318 >> v1:172.21.15.90:6789/0 conn(0x7f128006be60 legacy=0x7f12800c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.099+0000 7f127f7fe640 1 -- 172.21.15.90:0/1118208318 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f128006c8b0 con 0x7f1280153ee0 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.099+0000 7f127f7fe640 1 --2- 172.21.15.90:0/1118208318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1280153ee0 0x7f1280157100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1270009870 tx=0x7f127002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bd6fa7971340 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f127e7fc640 1 -- 172.21.15.90:0/1118208318 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270035020 con 0x7f1280153ee0 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f127e7fc640 1 -- 172.21.15.90:0/1118208318 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1270031870 con 0x7f1280153ee0 2024-04-20T10:50:55.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f127e7fc640 1 -- 172.21.15.90:0/1118208318 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270031c40 con 0x7f1280153ee0 2024-04-20T10:50:55.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f128499f640 1 -- 172.21.15.90:0/1118208318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1280153ee0 msgr2=0x7f1280157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f128499f640 1 --2- 172.21.15.90:0/1118208318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1280153ee0 0x7f1280157100 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1270009870 tx=0x7f127002b910 comp rx=0 tx=0).stop 2024-04-20T10:50:55.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f128499f640 1 -- 172.21.15.90:0/1118208318 shutdown_connections 2024-04-20T10:50:55.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f128499f640 1 --2- 172.21.15.90:0/1118208318 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1280153ee0 0x7f1280157100 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f128499f640 1 -- 172.21.15.90:0/1118208318 >> 172.21.15.90:0/1118208318 conn(0x7f12800cbe30 msgr2=0x7f12800cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f128499f640 1 -- 172.21.15.90:0/1118208318 shutdown_connections 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.100+0000 7f128499f640 1 -- 172.21.15.90:0/1118208318 wait complete. 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.101+0000 7f128499f640 1 Processor -- start 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.101+0000 7f128499f640 1 -- start start 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f128499f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f128006d390 0x7f12800c27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f128499f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1280153ee0 0x7f12800c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f128499f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800beff0 0x7f12800c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f128499f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f12800c6ec0 con 0x7f128006d390 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f128499f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f12800ccb40 con 0x7f12800beff0 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f128499f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f12800c7040 con 0x7f1280153ee0 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f128006d390 0x7f12800c27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f128006d390 0x7f12800c27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37174/0 (socket says 172.21.15.90:37174) 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 -- 172.21.15.90:0/4063781084 learned_addr learned my addr 172.21.15.90:0/4063781084 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127ffff640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800beff0 0x7f12800c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 -- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1280153ee0 msgr2=0x7f12800c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127effd640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1280153ee0 0x7f12800c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1280153ee0 0x7f12800c0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 -- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800beff0 msgr2=0x7f12800c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800beff0 0x7f12800c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127f7fe640 1 -- 172.21.15.90:0/4063781084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12801e0430 con 0x7f128006d390 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127ffff640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800beff0 0x7f12800c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.102+0000 7f127effd640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1280153ee0 0x7f12800c0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.103+0000 7f127f7fe640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f128006d390 0x7f12800c27c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1270009870 tx=0x7f12700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.103+0000 7f1267fff640 1 -- 172.21.15.90:0/4063781084 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270040070 con 0x7f128006d390 2024-04-20T10:50:55.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.103+0000 7f1267fff640 1 -- 172.21.15.90:0/4063781084 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f127003a420 con 0x7f128006d390 2024-04-20T10:50:55.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.103+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12801dfb90 con 0x7f128006d390 2024-04-20T10:50:55.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.103+0000 7f1267fff640 1 -- 172.21.15.90:0/4063781084 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1270035040 con 0x7f128006d390 2024-04-20T10:50:55.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.103+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12801e0150 con 0x7f128006d390 2024-04-20T10:50:55.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.104+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1280076070 con 0x7f128006d390 2024-04-20T10:50:55.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.104+0000 7f1267fff640 1 -- 172.21.15.90:0/4063781084 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f127004b060 con 0x7f128006d390 2024-04-20T10:50:55.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.104+0000 7f1267fff640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f126c06c920 0x7f126c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.104+0000 7f1267fff640 1 -- 172.21.15.90:0/4063781084 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f12700addc0 con 0x7f128006d390 2024-04-20T10:50:55.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.105+0000 7f127effd640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f126c06c920 0x7f126c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.105+0000 7f127effd640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f126c06c920 0x7f126c06ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12800c5fd0 tx=0x7f1274009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.109+0000 7f1267fff640 1 -- 172.21.15.90:0/4063781084 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f12801e0430 con 0x7f128006d390 2024-04-20T10:50:55.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.328+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f12800cc920 con 0x7f128006d390 2024-04-20T10:50:55.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.331+0000 7f1267fff640 1 -- 172.21.15.90:0/4063781084 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174135 (secure 0 0 0) 0x7f127002f320 con 0x7f128006d390 2024-04-20T10:50:55.334 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:55.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.333+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f126c06c920 msgr2=0x7f126c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.333+0000 7f128499f640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f126c06c920 0x7f126c06ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f12800c5fd0 tx=0x7f1274009040 comp rx=0 tx=0).stop 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.333+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f128006d390 msgr2=0x7f12800c27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.333+0000 7f128499f640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f128006d390 0x7f12800c27c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1270009870 tx=0x7f12700046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 shutdown_connections 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f126c06c920 0x7f126c06ede0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f12800beff0 0x7f12800c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1280153ee0 0x7f12800c0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 --2- 172.21.15.90:0/4063781084 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f128006d390 0x7f12800c27c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 >> 172.21.15.90:0/4063781084 conn(0x7f12800cbe30 msgr2=0x7f12800cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 shutdown_connections 2024-04-20T10:50:55.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.334+0000 7f128499f640 1 -- 172.21.15.90:0/4063781084 wait complete. 2024-04-20T10:50:55.346 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6832","nonce":1738105048},{"type":"v1","addr":"172.21.15.90:6833","nonce":1738105048}]},"active_addr":"172.21.15.90:6833/1738105048","active_change":"2024-04-20T10:50:19.654904+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":3615342474}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":1671684230}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":664029922}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.90:0","nonce":801668152}]}]} 2024-04-20T10:50:55.350 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-20T10:50:55.351 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-20T10:50:55.351 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:55.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.446+0000 7f495fde6640 1 Processor -- start 2024-04-20T10:50:55.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.446+0000 7f495fde6640 1 -- start start 2024-04-20T10:50:55.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495fde6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f49580c6a00 0x7f495815a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495fde6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49580c6e50 con 0x7f495806cc40 2024-04-20T10:50:55.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495fde6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49580c7100 con 0x7f4958153df0 2024-04-20T10:50:55.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495fde6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f49580ca690 con 0x7f49580c6a00 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495d381640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f495806cc40 0x7f49580c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56574/0 (socket says 172.21.15.90:56574) 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495d381640 1 -- 172.21.15.90:0/1637422480 learned_addr learned my addr 172.21.15.90:0/1637422480 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495e383640 1 --2- 172.21.15.90:0/1637422480 >> v2:172.21.15.175:3300/0 conn(0x7f49580c6a00 0x7f495815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495cb80640 1 -- 172.21.15.90:0/1637422480 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341146163 0 0) 0x7f49580c6e50 con 0x7f495806cc40 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495cb80640 1 -- 172.21.15.90:0/1637422480 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4944003520 con 0x7f495806cc40 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495cb80640 1 -- 172.21.15.90:0/1637422480 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1157621829 0 0) 0x7f4944003520 con 0x7f495806cc40 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495e383640 1 -- 172.21.15.90:0/1637422480 >> v1:172.21.15.175:6789/0 conn(0x7f4958153df0 legacy=0x7f49580c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495e383640 1 -- 172.21.15.90:0/1637422480 >> v1:172.21.15.90:6789/0 conn(0x7f495806cc40 legacy=0x7f49580c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.447+0000 7f495e383640 1 -- 172.21.15.90:0/1637422480 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495806c160 con 0x7f49580c6a00 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.448+0000 7f495e383640 1 --2- 172.21.15.90:0/1637422480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 0x7f495815a810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4950009d90 tx=0x7f495002bcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b77513dbf17e2c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.448+0000 7f495cb80640 1 -- 172.21.15.90:0/1637422480 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950039070 con 0x7f49580c6a00 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.448+0000 7f495cb80640 1 -- 172.21.15.90:0/1637422480 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495002c820 con 0x7f49580c6a00 2024-04-20T10:50:55.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495cb80640 1 -- 172.21.15.90:0/1637422480 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4948001670 con 0x7f49580c6a00 2024-04-20T10:50:55.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495fde6640 1 -- 172.21.15.90:0/1637422480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 msgr2=0x7f495815a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495fde6640 1 --2- 172.21.15.90:0/1637422480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 0x7f495815a810 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4950009d90 tx=0x7f495002bcf0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495fde6640 1 -- 172.21.15.90:0/1637422480 shutdown_connections 2024-04-20T10:50:55.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495fde6640 1 --2- 172.21.15.90:0/1637422480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 0x7f495815a810 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495fde6640 1 -- 172.21.15.90:0/1637422480 >> 172.21.15.90:0/1637422480 conn(0x7f49580adbd0 msgr2=0x7f49580adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:55.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495fde6640 1 -- 172.21.15.90:0/1637422480 shutdown_connections 2024-04-20T10:50:55.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.449+0000 7f495fde6640 1 -- 172.21.15.90:0/1637422480 wait complete. 2024-04-20T10:50:55.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.450+0000 7f495fde6640 1 Processor -- start 2024-04-20T10:50:55.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.450+0000 7f495fde6640 1 -- start start 2024-04-20T10:50:55.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495fde6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f495806cc40 0x7f49580c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495fde6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 0x7f49580c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495fde6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4958153df0 0x7f49581ef480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495fde6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f495806c7b0 con 0x7f4958153df0 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495fde6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f49581541d0 con 0x7f49580c6a00 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495fde6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f49580c73e0 con 0x7f495806cc40 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4958153df0 0x7f49581ef480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4958153df0 0x7f49581ef480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58840/0 (socket says 172.21.15.90:58840) 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 -- 172.21.15.90:0/2701817491 learned_addr learned my addr 172.21.15.90:0/2701817491 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495d381640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 0x7f49580c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495db82640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f495806cc40 0x7f49580c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 -- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f495806cc40 msgr2=0x7f49580c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f495806cc40 0x7f49580c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 -- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 msgr2=0x7f49580c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 0x7f49580c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 -- 172.21.15.90:0/2701817491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49580c5010 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495db82640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f495806cc40 0x7f49580c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f495e383640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4958153df0 0x7f49581ef480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4950037040 tx=0x7f4950004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f494e7fc640 1 -- 172.21.15.90:0/2701817491 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950044020 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f494e7fc640 1 -- 172.21.15.90:0/2701817491 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f495002ce50 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.451+0000 7f494e7fc640 1 -- 172.21.15.90:0/2701817491 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4950039040 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.452+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495814b370 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.452+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49580c5290 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.452+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4958076150 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.453+0000 7f494e7fc640 1 -- 172.21.15.90:0/2701817491 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4950047020 con 0x7f4958153df0 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.453+0000 7f494e7fc640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f493c06c8f0 0x7f493c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.453+0000 7f495db82640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f493c06c8f0 0x7f493c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.453+0000 7f494e7fc640 1 -- 172.21.15.90:0/2701817491 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f49500ae300 con 0x7f4958153df0 2024-04-20T10:50:55.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.454+0000 7f495db82640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f493c06c8f0 0x7f493c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4954000f60 tx=0x7f4954009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.457+0000 7f494e7fc640 1 -- 172.21.15.90:0/2701817491 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f495004e070 con 0x7f4958153df0 2024-04-20T10:50:55.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.638+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f495806d950 con 0x7f4958153df0 2024-04-20T10:50:55.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.639+0000 7f494e7fc640 1 -- 172.21.15.90:0/2701817491 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f49580c5010 con 0x7f4958153df0 2024-04-20T10:50:55.641 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:55.641 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f493c06c8f0 msgr2=0x7f493c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f493c06c8f0 0x7f493c06edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4954000f60 tx=0x7f4954009040 comp rx=0 tx=0).stop 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4958153df0 msgr2=0x7f49581ef480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4958153df0 0x7f49581ef480 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4950037040 tx=0x7f4950004a40 comp rx=0 tx=0).stop 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 shutdown_connections 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f493c06c8f0 0x7f493c06edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4958153df0 0x7f49581ef480 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f49580c6a00 0x7f49580c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 --2- 172.21.15.90:0/2701817491 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f495806cc40 0x7f49580c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 >> 172.21.15.90:0/2701817491 conn(0x7f49580adbd0 msgr2=0x7f49580c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 shutdown_connections 2024-04-20T10:50:55.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.641+0000 7f495fde6640 1 -- 172.21.15.90:0/2701817491 wait complete. 2024-04-20T10:50:55.653 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-20T10:50:55.654 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:55.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.749+0000 7f0c4f211640 1 Processor -- start 2024-04-20T10:50:55.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.749+0000 7f0c4f211640 1 -- start start 2024-04-20T10:50:55.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4f211640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c48153ee0 0x7f0c48157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4f211640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c480adce0 con 0x7f0c4806c4d0 2024-04-20T10:50:55.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4f211640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c480adfc0 con 0x7f0c480ab710 2024-04-20T10:50:55.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4f211640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0c480ae2a0 con 0x7f0c48153ee0 2024-04-20T10:50:55.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4cfad640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c48153ee0 0x7f0c48157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4cfad640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0c48153ee0 0x7f0c48157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58844/0 (socket says 172.21.15.90:58844) 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4cfad640 1 -- 172.21.15.90:0/4182871172 learned_addr learned my addr 172.21.15.90:0/4182871172 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4d7ae640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0c4806c4d0 0x7f0c4806c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56582/0 (socket says 172.21.15.90:56582) 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4cfad640 1 -- 172.21.15.90:0/4182871172 >> v1:172.21.15.175:6789/0 conn(0x7f0c480ab710 legacy=0x7f0c480c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4cfad640 1 -- 172.21.15.90:0/4182871172 >> v1:172.21.15.90:6789/0 conn(0x7f0c4806c4d0 legacy=0x7f0c4806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c477fe640 1 -- 172.21.15.90:0/4182871172 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316941045 0 0) 0x7f0c480adce0 con 0x7f0c4806c4d0 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.750+0000 7f0c4cfad640 1 -- 172.21.15.90:0/4182871172 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c480c70f0 con 0x7f0c48153ee0 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.751+0000 7f0c4cfad640 1 --2- 172.21.15.90:0/4182871172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c48153ee0 0x7f0c48157190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d35b54cad5a222 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.751+0000 7f0c477fe640 1 -- 172.21.15.90:0/4182871172 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3802e070 con 0x7f0c48153ee0 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.751+0000 7f0c477fe640 1 -- 172.21.15.90:0/4182871172 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c38037070 con 0x7f0c48153ee0 2024-04-20T10:50:55.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.751+0000 7f0c477fe640 1 -- 172.21.15.90:0/4182871172 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38031a00 con 0x7f0c48153ee0 2024-04-20T10:50:55.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.752+0000 7f0c4f211640 1 -- 172.21.15.90:0/4182871172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c48153ee0 msgr2=0x7f0c48157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.752+0000 7f0c4f211640 1 --2- 172.21.15.90:0/4182871172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c48153ee0 0x7f0c48157190 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009870 tx=0x7f0c3802b880 comp rx=0 tx=0).stop 2024-04-20T10:50:55.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.752+0000 7f0c4f211640 1 -- 172.21.15.90:0/4182871172 shutdown_connections 2024-04-20T10:50:55.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.752+0000 7f0c4f211640 1 --2- 172.21.15.90:0/4182871172 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c48153ee0 0x7f0c48157190 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.752+0000 7f0c4f211640 1 -- 172.21.15.90:0/4182871172 >> 172.21.15.90:0/4182871172 conn(0x7f0c480cc060 msgr2=0x7f0c480cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.752+0000 7f0c4f211640 1 -- 172.21.15.90:0/4182871172 shutdown_connections 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.752+0000 7f0c4f211640 1 -- 172.21.15.90:0/4182871172 wait complete. 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.753+0000 7f0c4f211640 1 Processor -- start 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.753+0000 7f0c4f211640 1 -- start start 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4f211640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c4806c4d0 0x7f0c480c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4f211640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c480ab710 0x7f0c481ecfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4f211640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48153ee0 0x7f0c480c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4f211640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4806d190 con 0x7f0c480ab710 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4f211640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0c4806d010 con 0x7f0c48153ee0 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4f211640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0c480caf70 con 0x7f0c4806c4d0 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c480ab710 0x7f0c481ecfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c480ab710 0x7f0c481ecfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58850/0 (socket says 172.21.15.90:58850) 2024-04-20T10:50:55.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 -- 172.21.15.90:0/3381285315 learned_addr learned my addr 172.21.15.90:0/3381285315 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4d7ae640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48153ee0 0x7f0c480c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c4cfad640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c4806c4d0 0x7f0c480c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 -- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c4806c4d0 msgr2=0x7f0c480c17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c4806c4d0 0x7f0c480c17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 -- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48153ee0 msgr2=0x7f0c480c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48153ee0 0x7f0c480c5780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 -- 172.21.15.90:0/3381285315 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c480c1d00 con 0x7f0c480ab710 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c47fff640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c480ab710 0x7f0c481ecfc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c460 tx=0x7f0c3c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.754+0000 7f0c457fa640 1 -- 172.21.15.90:0/3381285315 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c016020 con 0x7f0c480ab710 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.755+0000 7f0c457fa640 1 -- 172.21.15.90:0/3381285315 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3c012870 con 0x7f0c480ab710 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.755+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c481ed500 con 0x7f0c480ab710 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.755+0000 7f0c457fa640 1 -- 172.21.15.90:0/3381285315 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3c012c60 con 0x7f0c480ab710 2024-04-20T10:50:55.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.755+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c481f0830 con 0x7f0c480ab710 2024-04-20T10:50:55.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.755+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c480ad2f0 con 0x7f0c480ab710 2024-04-20T10:50:55.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.756+0000 7f0c457fa640 1 -- 172.21.15.90:0/3381285315 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0c3c019020 con 0x7f0c480ab710 2024-04-20T10:50:55.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.756+0000 7f0c457fa640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0c3406c8f0 0x7f0c3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:55.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.756+0000 7f0c457fa640 1 -- 172.21.15.90:0/3381285315 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f0c3c08b820 con 0x7f0c480ab710 2024-04-20T10:50:55.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.756+0000 7f0c4cfad640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0c3406c8f0 0x7f0c3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:55.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.757+0000 7f0c4cfad640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0c3406c8f0 0x7f0c3406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c38036000 tx=0x7f0c38008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:55.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.761+0000 7f0c457fa640 1 -- 172.21.15.90:0/3381285315 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0c480ad2f0 con 0x7f0c480ab710 2024-04-20T10:50:55.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.936+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c480adcb0 con 0x7f0c480ab710 2024-04-20T10:50:55.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.938+0000 7f0c457fa640 1 -- 172.21.15.90:0/3381285315 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f0c480adcb0 con 0x7f0c480ab710 2024-04-20T10:50:55.939 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:55.939 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:55.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0c3406c8f0 msgr2=0x7f0c3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0c3406c8f0 0x7f0c3406edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c38036000 tx=0x7f0c38008030 comp rx=0 tx=0).stop 2024-04-20T10:50:55.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c480ab710 msgr2=0x7f0c481ecfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:55.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c480ab710 0x7f0c481ecfc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c00c460 tx=0x7f0c3c00c920 comp rx=0 tx=0).stop 2024-04-20T10:50:55.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 shutdown_connections 2024-04-20T10:50:55.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0c3406c8f0 0x7f0c3406edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0c48153ee0 0x7f0c480c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0c480ab710 0x7f0c481ecfc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 --2- 172.21.15.90:0/3381285315 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0c4806c4d0 0x7f0c480c17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:55.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 >> 172.21.15.90:0/3381285315 conn(0x7f0c480cc060 msgr2=0x7f0c480af8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:55.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 shutdown_connections 2024-04-20T10:50:55.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:55.940+0000 7f0c4f211640 1 -- 172.21.15.90:0/3381285315 wait complete. 2024-04-20T10:50:55.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-20T10:50:55.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-20T10:50:55.953 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-20T10:50:55.954 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-20T10:50:55.954 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-20T10:50:55.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-20T10:50:55.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-20T10:50:55.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-20T10:50:56.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.118+0000 7fbaf90ab640 1 Processor -- start 2024-04-20T10:50:56.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.119+0000 7fbaf90ab640 1 -- start start 2024-04-20T10:50:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.119+0000 7faab4ec1640 1 Processor -- start 2024-04-20T10:50:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.119+0000 7faab4ec1640 1 -- start start 2024-04-20T10:50:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.119+0000 7f7f61270640 1 Processor -- start 2024-04-20T10:50:56.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7f7f61270640 1 -- start start 2024-04-20T10:50:56.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf90ab640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaf40681b0 0x7fbaf4153440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faab4ec1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7faaa80dbfd0 0x7faaa803e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faab4ec1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faaa80070b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf90ab640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf40c4230 con 0x7fbaf40c3ce0 2024-04-20T10:50:56.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf90ab640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf4155e80 con 0x7fbaf4156960 2024-04-20T10:50:56.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf90ab640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf4156160 con 0x7fbaf40681b0 2024-04-20T10:50:56.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faab4ec1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faaa8031160 con 0x7faaa803ecd0 2024-04-20T10:50:56.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faab4ec1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7faaa80075f0 con 0x7faaa80dbfd0 2024-04-20T10:50:56.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7f02502b2640 1 Processor -- start 2024-04-20T10:50:56.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faab4ec1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faaa804aa60 con 0x7faaa800b0c0 2024-04-20T10:50:56.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7f02502b2640 1 -- start start 2024-04-20T10:50:56.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faaadd9b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7faaa803ecd0 0x7faaa80069a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39888/0 (socket says 172.21.15.90:39888) 2024-04-20T10:50:56.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faaadd9b640 1 -- 172.21.15.90:0/3033935350 learned_addr learned my addr 172.21.15.90:0/3033935350 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7faaae59c640 1 --2- 172.21.15.90:0/3033935350 >> v2:172.21.15.175:3300/0 conn(0x7faaa80dbfd0 0x7faaa803e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f61270640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f5c153d60 0x7f7f5c06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f61270640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c0c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7faaaed9d640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faaa80070b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f61270640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5c0c3ec0 con 0x7f7f5c06e950 2024-04-20T10:50:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f61270640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7f5c06e4c0 con 0x7f7f5c153d60 2024-04-20T10:50:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f61270640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5c0c41a0 con 0x7f7f5c067ad0 2024-04-20T10:50:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f5bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f5c153d60 0x7f7f5c06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f5bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7f5c153d60 0x7f7f5c06d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:59870/0 (socket says 172.21.15.90:59870) 2024-04-20T10:50:56.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f5bfff640 1 -- 172.21.15.90:0/4218396574 learned_addr learned my addr 172.21.15.90:0/4218396574 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaf40681b0 0x7fbaf4153440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf88aa640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbaf40c3ce0 0x7fbaf40a6cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56598/0 (socket says 172.21.15.90:56598) 2024-04-20T10:50:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f5bfff640 1 -- 172.21.15.90:0/4218396574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 msgr2=0x7f7f5c0c3060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T10:50:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f5bfff640 1 --2- 172.21.15.90:0/4218396574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c0c3060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f5bfff640 1 -- 172.21.15.90:0/4218396574 >> v1:172.21.15.90:6789/0 conn(0x7f7f5c06e950 legacy=0x7f7f5c154140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7f7f5bfff640 1 -- 172.21.15.90:0/4218396574 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c06e150 con 0x7f7f5c153d60 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf88aa640 1 -- 172.21.15.90:0/998543852 learned_addr learned my addr 172.21.15.90:0/998543852 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.120+0000 7fbaf3fff640 1 --1- 172.21.15.90:0/998543852 >> v1:172.21.15.175:6789/0 conn(0x7fbaf4156960 0x7fbaf40ab3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39876/0 (socket says 172.21.15.90:39876) 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1269910811 0 0) 0x7fbaf4155e80 con 0x7fbaf4156960 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbadc003520 con 0x7fbaf4156960 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1780631944 0 0) 0x7fbadc003520 con 0x7fbaf4156960 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 >> v2:172.21.15.175:3300/0 conn(0x7fbaf40681b0 msgr2=0x7fbaf4153440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 --2- 172.21.15.90:0/998543852 >> v2:172.21.15.175:3300/0 conn(0x7fbaf40681b0 0x7fbaf4153440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 >> v1:172.21.15.90:6789/0 conn(0x7fbaf40c3ce0 legacy=0x7fbaf40a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf4156440 con 0x7fbaf4156960 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fbaec001670 con 0x7fbaf4156960 2024-04-20T10:50:56.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 >> v1:172.21.15.175:6789/0 conn(0x7fbaf4156960 legacy=0x7fbaf40ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.121+0000 7fbaf2ffd640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbadc003a00 0x7fbadc003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf2ffd640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbadc004800 0x7fbadc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf2ffd640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc0052e0 0x7fbadc0141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf4156160 con 0x7fbadc004800 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbadc0149f0 con 0x7fbadc0052e0 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbadc014bf0 con 0x7fbadc003a00 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7f024e04e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f02480c4100 0x7f02481564c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56620/0 (socket says 172.21.15.90:56620) 2024-04-20T10:50:56.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf37fe640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbadc004800 0x7fbadc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf88aa640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc0052e0 0x7fbadc0141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7f024e04e640 1 -- 172.21.15.90:0/2498166347 learned_addr learned my addr 172.21.15.90:0/2498166347 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbadc003a00 0x7fbadc003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963018657 0 0) 0x7faaa8031160 con 0x7faaa803ecd0 2024-04-20T10:50:56.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa98003520 con 0x7faaa803ecd0 2024-04-20T10:50:56.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7f02502b2640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02480ab4a0 0x7f02481534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1994842268 0 0) 0x7faa98003520 con 0x7faaa803ecd0 2024-04-20T10:50:56.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 msgr2=0x7faaa80070b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faaa80070b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 >> v2:172.21.15.175:3300/0 conn(0x7faaa80dbfd0 msgr2=0x7faaa803e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f7f5bfff640 1 --2- 172.21.15.90:0/4218396574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c153d60 0x7f7f5c06d9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c06e640 tx=0x7f7f5402bc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da49916e3eb305d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 --2- 172.21.15.90:0/3033935350 >> v2:172.21.15.175:3300/0 conn(0x7faaa80dbfd0 0x7faaa803e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa8031420 con 0x7faaa803ecd0 2024-04-20T10:50:56.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf3fff640 1 -- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc0052e0 msgr2=0x7fbadc0141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc0052e0 0x7fbadc0141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf3fff640 1 -- 172.21.15.90:0/998543852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbadc004800 msgr2=0x7fbadc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbadc004800 0x7fbadc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.122+0000 7fbaf3fff640 1 -- 172.21.15.90:0/998543852 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbadc003520 con 0x7fbadc003a00 2024-04-20T10:50:56.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7fbaf88aa640 1 -- 172.21.15.90:0/998543852 reap_dead start 2024-04-20T10:50:56.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7faab00635c0 con 0x7faaa803ecd0 2024-04-20T10:50:56.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0248156d10 con 0x7f02480c4100 2024-04-20T10:50:56.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f024e84f640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02480ab4a0 0x7f02481534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaae59c640 1 --2- 172.21.15.90:0/3033935350 >> v2:172.21.15.175:3300/0 conn(0x7faaa80dbfd0 0x7faaa803e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f7f5affd640 1 -- 172.21.15.90:0/4218396574 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5402c7b0 con 0x7f7f5c153d60 2024-04-20T10:50:56.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaaed9d640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faaa80070b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f85de973640 1 Processor -- start 2024-04-20T10:50:56.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 >> v1:172.21.15.175:6789/0 conn(0x7faaa803ecd0 legacy=0x7faaa80069a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f7f5affd640 1 -- 172.21.15.90:0/4218396574 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f5402c950 con 0x7f7f5c153d60 2024-04-20T10:50:56.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f7f5affd640 1 -- 172.21.15.90:0/4218396574 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f5402cd20 con 0x7f7f5c153d60 2024-04-20T10:50:56.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa980039b0 0x7faa98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa98004310 0x7faa98004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0248156ff0 con 0x7f02480c5100 2024-04-20T10:50:56.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f85de973640 1 -- start start 2024-04-20T10:50:56.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faa98004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faaa80075f0 con 0x7faa98004310 2024-04-20T10:50:56.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaadd9b640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa98004310 0x7faa98004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faaa804aa60 con 0x7faa980039b0 2024-04-20T10:50:56.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa98005660 con 0x7faaa800b0c0 2024-04-20T10:50:56.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaaed9d640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faa98004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbadc003a00 0x7fbadc003e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbaec007f60 tx=0x7fbadc005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d63a4ec4432cbe89 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaae59c640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa980039b0 0x7faa98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02481572d0 con 0x7f02480ab4a0 2024-04-20T10:50:56.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 963585399 0 0) 0x7f0248156ff0 con 0x7f02480c5100 2024-04-20T10:50:56.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7f3b42ec1640 1 Processor -- start 2024-04-20T10:50:56.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0234003520 con 0x7f02480c5100 2024-04-20T10:50:56.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec007b80 con 0x7fbadc003a00 2024-04-20T10:50:56.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec030070 con 0x7fbadc003a00 2024-04-20T10:50:56.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7fbaf2ffd640 1 -- 172.21.15.90:0/998543852 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec007550 con 0x7fbadc003a00 2024-04-20T10:50:56.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979570617 0 0) 0x7f0248156d10 con 0x7f02480c4100 2024-04-20T10:50:56.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaaed9d640 1 -- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa980039b0 msgr2=0x7faa98003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f7f61270640 1 -- 172.21.15.90:0/4218396574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c153d60 msgr2=0x7f7f5c06d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaaed9d640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa980039b0 0x7faa98003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0248156ff0 con 0x7f02480c4100 2024-04-20T10:50:56.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaaed9d640 1 -- 172.21.15.90:0/3033935350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa98004310 msgr2=0x7faa98004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 <== mon.1 v1:172.21.15.175:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 930508768 0 0) 0x7f0234003520 con 0x7f02480c5100 2024-04-20T10:50:56.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02480ab4a0 msgr2=0x7f02481534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02480ab4a0 0x7f02481534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 >> v1:172.21.15.90:6789/0 conn(0x7f02480c4100 legacy=0x7f02481564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 --> v1:172.21.15.175:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0248159cc0 con 0x7f02480c5100 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 <== mon.1 v1:172.21.15.175:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f0238001670 con 0x7f02480c5100 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 >> v1:172.21.15.175:6789/0 conn(0x7f02480c5100 legacy=0x7f024815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0234003b40 0x7f0234003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0234004800 0x7f0234004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaaed9d640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa98004310 0x7faa98004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f7f61270640 1 --2- 172.21.15.90:0/4218396574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c153d60 0x7f7f5c06d9f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c06e640 tx=0x7f7f5402bc90 comp rx=0 tx=0).stop 2024-04-20T10:50:56.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f7f61270640 1 -- 172.21.15.90:0/4218396574 shutdown_connections 2024-04-20T10:50:56.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f7f61270640 1 --2- 172.21.15.90:0/4218396574 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c0c3060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7faaaed9d640 1 -- 172.21.15.90:0/3033935350 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa98003520 con 0x7faaa800b0c0 2024-04-20T10:50:56.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f7f61270640 1 --2- 172.21.15.90:0/4218396574 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c153d60 0x7f7f5c06d9f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f7f61270640 1 -- 172.21.15.90:0/4218396574 >> 172.21.15.90:0/4218396574 conn(0x7f7f5c068130 msgr2=0x7f7f5c06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f85de973640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f85d003f030 0x7f85d00474d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f85de973640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d00df7d0 con 0x7f85d0006660 2024-04-20T10:50:56.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f85de973640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d00e1f40 con 0x7f85d00484a0 2024-04-20T10:50:56.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f85de973640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f85d00dc2e0 con 0x7f85d003f030 2024-04-20T10:50:56.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f7f61270640 1 -- 172.21.15.90:0/4218396574 shutdown_connections 2024-04-20T10:50:56.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f7f61270640 1 -- 172.21.15.90:0/4218396574 wait complete. 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7fb74734a640 1 Processor -- start 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.123+0000 7fb74734a640 1 -- start start 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7fb74734a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015b870 0x7fb74006d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7fb74734a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb740073960 0x7fb74015e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7fb74734a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7400c36e0 0x7fb74015e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb74734a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb7400c3130 con 0x7fb740073960 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb74734a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb7400c45e0 con 0x7fb7400c36e0 2024-04-20T10:50:56.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb74734a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb7400adf10 con 0x7fb74015b870 2024-04-20T10:50:56.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f85de172640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f85d003f030 0x7f85d00474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f85dd971640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f85d00484a0 0x7f85d00e2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39904/0 (socket says 172.21.15.90:39904) 2024-04-20T10:50:56.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f85dd971640 1 -- 172.21.15.90:0/3875195905 learned_addr learned my addr 172.21.15.90:0/3875195905 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7400c36e0 0x7fb74015e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7400c36e0 0x7fb74015e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:59900/0 (socket says 172.21.15.90:59900) 2024-04-20T10:50:56.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 -- 172.21.15.90:0/2469318539 learned_addr learned my addr 172.21.15.90:0/2469318539 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f3b42ec1640 1 -- start start 2024-04-20T10:50:56.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7faaadd9b640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa98004310 0x7faa98004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:56.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234005210 0x7f02340141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567033920 0 0) 0x7f85d00df7d0 con 0x7f85d0006660 2024-04-20T10:50:56.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7faaaed9d640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faa98004e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009c90 tx=0x7faa98005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a34426f311a4d34 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85c4003520 con 0x7f85d0006660 2024-04-20T10:50:56.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02481572d0 con 0x7f0234003b40 2024-04-20T10:50:56.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0234014920 con 0x7f0234005210 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0234014b20 con 0x7f0234004800 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.124+0000 7f024d84d640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0234004800 0x7f0234004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f024e84f640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234005210 0x7f02340141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f024d84d640 1 -- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234005210 msgr2=0x7f02340141d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f024d84d640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234005210 0x7f02340141d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f024d84d640 1 -- 172.21.15.90:0/2498166347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0234003b40 msgr2=0x7f0234003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f024d84d640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0234003b40 0x7f0234003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f024d84d640 1 -- 172.21.15.90:0/2498166347 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0234003520 con 0x7f0234004800 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7f024e84f640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0234005210 0x7f02340141d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:56.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4039070 con 0x7faaa800b0c0 2024-04-20T10:50:56.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa402c9b0 con 0x7faaa800b0c0 2024-04-20T10:50:56.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 -- 172.21.15.90:0/2469318539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015b870 msgr2=0x7fb74006d350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T10:50:56.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 --2- 172.21.15.90:0/2469318539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015b870 0x7fb74006d350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 -- 172.21.15.90:0/2469318539 >> v2:172.21.15.90:3300/0 conn(0x7fb740073960 msgr2=0x7fb74015e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 --2- 172.21.15.90:0/2469318539 >> v2:172.21.15.90:3300/0 conn(0x7fb740073960 0x7fb74015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.125+0000 7fb7458e7640 1 -- 172.21.15.90:0/2469318539 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7400ae180 con 0x7fb7400c36e0 2024-04-20T10:50:56.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f024d84d640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0234004800 0x7f0234004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0238007ef0 tx=0x7f0234005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=672a29476551373c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7fb7458e7640 1 --2- 172.21.15.90:0/2469318539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7400c36e0 0x7fb74015e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb738009e80 tx=0x7fb73802be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33991942422f0cf3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484369987 0 0) 0x7f85d00e1f40 con 0x7f85d00484a0 2024-04-20T10:50:56.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85d00df7d0 con 0x7f85d00484a0 2024-04-20T10:50:56.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3753860251 0 0) 0x7f85c4003520 con 0x7f85d0006660 2024-04-20T10:50:56.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 >> v2:172.21.15.90:3300/0 conn(0x7f85d003f030 msgr2=0x7f85d00474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238039070 con 0x7f0234004800 2024-04-20T10:50:56.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f3b42ec1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3b3c0c4390 0x7f3b3c152700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7fbaf90ab640 1 -- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbadc003a00 msgr2=0x7fbadc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7fbaf90ab640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbadc003a00 0x7fbadc003e20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fbaec007f60 tx=0x7fbadc005830 comp rx=0 tx=0).stop 2024-04-20T10:50:56.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7fb737fff640 1 -- 172.21.15.90:0/2469318539 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73802ca10 con 0x7fb7400c36e0 2024-04-20T10:50:56.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023802c900 con 0x7f0234004800 2024-04-20T10:50:56.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.126+0000 7f3b42ec1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c073b30 con 0x7f3b3c0c8b70 2024-04-20T10:50:56.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b42ec1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3c0c3880 con 0x7f3b3c072e80 2024-04-20T10:50:56.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b42ec1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3b3c06d350 con 0x7f3b3c0c4390 2024-04-20T10:50:56.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f024d04c640 1 -- 172.21.15.90:0/2498166347 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0238007b10 con 0x7f0234004800 2024-04-20T10:50:56.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f7f61270640 1 Processor -- start 2024-04-20T10:50:56.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7fb737fff640 1 -- 172.21.15.90:0/2469318539 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb73802cbb0 con 0x7fb7400c36e0 2024-04-20T10:50:56.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7fb737fff640 1 -- 172.21.15.90:0/2469318539 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7380343f0 con 0x7fb7400c36e0 2024-04-20T10:50:56.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b3bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3b3c0c4390 0x7f3b3c152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b4145e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3b3c0c8b70 0x7f3b3c15d080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56636/0 (socket says 172.21.15.90:56636) 2024-04-20T10:50:56.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b3bfff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3b3c0c4390 0x7f3b3c152700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:59922/0 (socket says 172.21.15.90:59922) 2024-04-20T10:50:56.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b4145e640 1 -- 172.21.15.90:0/1182256703 learned_addr learned my addr 172.21.15.90:0/1182256703 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7faaad59a640 1 -- 172.21.15.90:0/3033935350 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4009860 con 0x7faaa800b0c0 2024-04-20T10:50:56.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f7f61270640 1 -- start start 2024-04-20T10:50:56.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 --2- 172.21.15.90:0/3875195905 >> v2:172.21.15.90:3300/0 conn(0x7f85d003f030 0x7f85d00474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 >> v1:172.21.15.175:6789/0 conn(0x7f85d00484a0 legacy=0x7f85d00e2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d00df4f0 con 0x7f85d0006660 2024-04-20T10:50:56.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f85d4001670 con 0x7f85d0006660 2024-04-20T10:50:56.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 >> v1:172.21.15.90:6789/0 conn(0x7f85d0006660 legacy=0x7f85d0007b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004bd0 0x7f85c4004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7faab4ec1640 1 -- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 msgr2=0x7faa98004e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7faab4ec1640 1 --2- 172.21.15.90:0/3033935350 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa800b0c0 0x7faa98004e70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009c90 tx=0x7faa98005830 comp rx=0 tx=0).stop 2024-04-20T10:50:56.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7faaaed9d640 1 -- 172.21.15.90:0/3033935350 reap_dead start 2024-04-20T10:50:56.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c40037a0 0x7f85c4003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c4004160 0x7f85c400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85d00dc2e0 con 0x7f85c4004bd0 2024-04-20T10:50:56.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85c400c040 con 0x7f85c4004160 2024-04-20T10:50:56.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f85c400c240 con 0x7f85c40037a0 2024-04-20T10:50:56.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85de172640 1 --2- 172.21.15.90:0/3875195905 >> v2:172.21.15.90:3300/0 conn(0x7f85d003f030 0x7f85d00474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7faab4ec1640 1 -- 172.21.15.90:0/3033935350 shutdown_connections 2024-04-20T10:50:56.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7faab4ec1640 1 -- 172.21.15.90:0/3033935350 >> 172.21.15.90:0/3033935350 conn(0x7faaa8005e80 msgr2=0x7faaa8006290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f85de172640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c4004160 0x7f85c400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b3bfff640 1 -- 172.21.15.90:0/1182256703 >> v1:172.21.15.175:6789/0 conn(0x7f3b3c072e80 legacy=0x7f3b3c06dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b3bfff640 1 -- 172.21.15.90:0/1182256703 >> v1:172.21.15.90:6789/0 conn(0x7f3b3c0c8b70 legacy=0x7f3b3c15d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.127+0000 7f3b3bfff640 1 -- 172.21.15.90:0/1182256703 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c0c3b20 con 0x7f3b3c0c4390 2024-04-20T10:50:56.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0234004800 msgr2=0x7f0234004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f02502b2640 1 --2- 172.21.15.90:0/2498166347 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0234004800 0x7f0234004c80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f0238007ef0 tx=0x7f0234005830 comp rx=0 tx=0).stop 2024-04-20T10:50:56.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 -- 172.21.15.90:0/2469318539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7400c36e0 msgr2=0x7fb74015e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 --2- 172.21.15.90:0/2469318539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7400c36e0 0x7fb74015e770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb738009e80 tx=0x7fb73802be70 comp rx=0 tx=0).stop 2024-04-20T10:50:56.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 -- 172.21.15.90:0/2469318539 shutdown_connections 2024-04-20T10:50:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 --2- 172.21.15.90:0/2469318539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7400c36e0 0x7fb74015e770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 --2- 172.21.15.90:0/2469318539 >> v2:172.21.15.90:3300/0 conn(0x7fb740073960 0x7fb74015e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 --2- 172.21.15.90:0/2469318539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015b870 0x7fb74006d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 -- 172.21.15.90:0/2469318539 >> 172.21.15.90:0/2469318539 conn(0x7fb7400c8080 msgr2=0x7fb7400c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f024e84f640 1 -- 172.21.15.90:0/2498166347 reap_dead start 2024-04-20T10:50:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85dd971640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004bd0 0x7f85c4004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85dd170640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c40037a0 0x7f85c4003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f61270640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c1ed1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f61270640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c06e950 0x7f7f5c14b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f61270640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c153d60 0x7f7f5c14bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f61270640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c0c3c60 con 0x7f7f5c153d60 2024-04-20T10:50:56.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f61270640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7f5c0c3ae0 con 0x7f7f5c06e950 2024-04-20T10:50:56.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f61270640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7f5c0c35a0 con 0x7f7f5c067ad0 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85de172640 1 -- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c40037a0 msgr2=0x7f85c4003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85de172640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c40037a0 0x7f85c4003c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85de172640 1 -- 172.21.15.90:0/3875195905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004bd0 msgr2=0x7f85c4004fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85de172640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004bd0 0x7f85c4004fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85de172640 1 -- 172.21.15.90:0/3875195905 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d00df4f0 con 0x7f85c4004160 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f85dd971640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004bd0 0x7f85c4004fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 -- 172.21.15.90:0/2469318539 shutdown_connections 2024-04-20T10:50:56.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fb74734a640 1 -- 172.21.15.90:0/2469318539 wait complete. 2024-04-20T10:50:56.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c1ed1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f5b7fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c06e950 0x7f7f5c14b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fbaf90ab640 1 -- 172.21.15.90:0/998543852 shutdown_connections 2024-04-20T10:50:56.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f5bfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c1ed1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37134/0 (socket says 172.21.15.90:37134) 2024-04-20T10:50:56.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f5bfff640 1 -- 172.21.15.90:0/379843396 learned_addr learned my addr 172.21.15.90:0/379843396 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f7f60a6f640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c153d60 0x7f7f5c14bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7faab4ec1640 1 -- 172.21.15.90:0/3033935350 shutdown_connections 2024-04-20T10:50:56.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7faab4ec1640 1 -- 172.21.15.90:0/3033935350 wait complete. 2024-04-20T10:50:56.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7f3b3bfff640 1 --2- 172.21.15.90:0/1182256703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 0x7f3b3c152700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0c8fe0 tx=0x7f3b2c02b770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=895de356c07b52f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fbaf90ab640 1 --2- 172.21.15.90:0/998543852 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbadc003a00 0x7fbadc003e20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fbaf90ab640 1 -- 172.21.15.90:0/998543852 >> 172.21.15.90:0/998543852 conn(0x7fbaf40676c0 msgr2=0x7fbaf4067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fbaf90ab640 1 -- 172.21.15.90:0/998543852 shutdown_connections 2024-04-20T10:50:56.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.128+0000 7fbaf90ab640 1 -- 172.21.15.90:0/998543852 wait complete. 2024-04-20T10:50:56.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 shutdown_connections 2024-04-20T10:50:56.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 >> 172.21.15.90:0/2498166347 conn(0x7f0248067d50 msgr2=0x7f02480c9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 shutdown_connections 2024-04-20T10:50:56.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f02502b2640 1 -- 172.21.15.90:0/2498166347 wait complete. 2024-04-20T10:50:56.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f7f5bfff640 1 -- 172.21.15.90:0/379843396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c06e950 msgr2=0x7f7f5c14b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f7f5bfff640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7f5c06e950 0x7f7f5c14b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f85de172640 1 -- 172.21.15.90:0/3875195905 reap_dead start 2024-04-20T10:50:56.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f7f5bfff640 1 -- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c153d60 msgr2=0x7f7f5c14bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f7f5bfff640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c153d60 0x7f7f5c14bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f7f5bfff640 1 -- 172.21.15.90:0/379843396 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5c156c90 con 0x7f7f5c067ad0 2024-04-20T10:50:56.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f7f60a6f640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7f5c153d60 0x7f7f5c14bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f3b3b7fe640 1 -- 172.21.15.90:0/1182256703 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c039070 con 0x7f3b3c0c4390 2024-04-20T10:50:56.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f3b3b7fe640 1 -- 172.21.15.90:0/1182256703 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c030070 con 0x7f3b3c0c4390 2024-04-20T10:50:56.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f3b3b7fe640 1 -- 172.21.15.90:0/1182256703 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0318f0 con 0x7f3b3c0c4390 2024-04-20T10:50:56.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f85de172640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c4004160 0x7f85c400b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009c90 tx=0x7f85c4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74dda404b301b891 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f7f5bfff640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c1ed1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f540093e0 tx=0x7f7f54004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7fb74734a640 1 Processor -- start 2024-04-20T10:50:56.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7fb74734a640 1 -- start start 2024-04-20T10:50:56.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1182256703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 msgr2=0x7f3b3c152700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f3b42ec1640 1 --2- 172.21.15.90:0/1182256703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 0x7f3b3c152700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b3c0c8fe0 tx=0x7f3b2c02b770 comp rx=0 tx=0).stop 2024-04-20T10:50:56.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f54042c60 con 0x7f7f5c067ad0 2024-04-20T10:50:56.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f54042e00 con 0x7f7f5c067ad0 2024-04-20T10:50:56.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f540078e0 con 0x7f7f5c067ad0 2024-04-20T10:50:56.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8009860 con 0x7f85c4004160 2024-04-20T10:50:56.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.129+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c8004020 con 0x7f85c4004160 2024-04-20T10:50:56.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f85dc96f640 1 -- 172.21.15.90:0/3875195905 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8004410 con 0x7f85c4004160 2024-04-20T10:50:56.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7fbaf90ab640 1 Processor -- start 2024-04-20T10:50:56.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1182256703 shutdown_connections 2024-04-20T10:50:56.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f3b42ec1640 1 --2- 172.21.15.90:0/1182256703 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 0x7f3b3c152700 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1182256703 >> 172.21.15.90:0/1182256703 conn(0x7f3b3c0c8080 msgr2=0x7f3b3c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f7f61270640 1 -- 172.21.15.90:0/379843396 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5c1edac0 con 0x7f7f5c067ad0 2024-04-20T10:50:56.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f7f61270640 1 -- 172.21.15.90:0/379843396 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f5c14d530 con 0x7f7f5c067ad0 2024-04-20T10:50:56.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1182256703 shutdown_connections 2024-04-20T10:50:56.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7faab4ec1640 1 Processor -- start 2024-04-20T10:50:56.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f85de973640 1 -- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c4004160 msgr2=0x7f85c400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f85de973640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c4004160 0x7f85c400b9c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009c90 tx=0x7f85c4005830 comp rx=0 tx=0).stop 2024-04-20T10:50:56.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fbaf90ab640 1 -- start start 2024-04-20T10:50:56.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7faab4ec1640 1 -- start start 2024-04-20T10:50:56.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7f85de973640 1 -- 172.21.15.90:0/3875195905 shutdown_connections 2024-04-20T10:50:56.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7f85de973640 1 --2- 172.21.15.90:0/3875195905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c4004160 0x7f85c400b9c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7f85de973640 1 -- 172.21.15.90:0/3875195905 >> 172.21.15.90:0/3875195905 conn(0x7f85d002db90 msgr2=0x7f85d002df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1182256703 wait complete. 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7fb74734a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb740073960 0x7fb74015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb74734a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7400c36e0 0x7fb7401478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb74734a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015b870 0x7fb740146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb74734a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7400c4110 con 0x7fb7400c36e0 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb74734a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb74015bc50 con 0x7fb740073960 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb74734a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb7400c4290 con 0x7fb74015b870 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7fdaaee06640 1 Processor -- start 2024-04-20T10:50:56.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.130+0000 7fdaaee06640 1 -- start start 2024-04-20T10:50:56.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb7450e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb740073960 0x7fb74015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb7448e5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7400c36e0 0x7fb7401478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb7448e5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7400c36e0 0x7fb7401478c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58920/0 (socket says 172.21.15.90:58920) 2024-04-20T10:50:56.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fb7448e5640 1 -- 172.21.15.90:0/4191040210 learned_addr learned my addr 172.21.15.90:0/4191040210 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fdaaee06640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdaa806d440 0x7fdaa80677a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7f5c1edd00 con 0x7f7f5c067ad0 2024-04-20T10:50:56.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7f02502b2640 1 Processor -- start 2024-04-20T10:50:56.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7f02502b2640 1 -- start start 2024-04-20T10:50:56.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb7448e5640 1 -- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015b870 msgr2=0x7fb740146440 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T10:50:56.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb7448e5640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb74015b870 0x7fb740146440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb7448e5640 1 -- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb740073960 msgr2=0x7fb74015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb7448e5640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb740073960 0x7fb74015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb7448e5640 1 -- 172.21.15.90:0/4191040210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7400c2be0 con 0x7fb7400c36e0 2024-04-20T10:50:56.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fdaaee06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa80c4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fdaaee06640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa806f040 con 0x7fdaa80c8070 2024-04-20T10:50:56.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fdaaee06640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdaa8151850 con 0x7fdaa806d440 2024-04-20T10:50:56.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.131+0000 7fdaaee06640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa80c4040 con 0x7fdaa80c44d0 2024-04-20T10:50:56.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fdaacba2640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fdaa80c8070 0x7fdaa815df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39932/0 (socket says 172.21.15.90:39932) 2024-04-20T10:50:56.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fdaacba2640 1 -- 172.21.15.90:0/2387234743 learned_addr learned my addr 172.21.15.90:0/2387234743 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7f3b42ec1640 1 Processor -- start 2024-04-20T10:50:56.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb7448e5640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7400c36e0 0x7fb7401478c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00b410 tx=0x7fb73c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fdaad3a3640 1 --2- 172.21.15.90:0/2387234743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa80c4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7f3b42ec1640 1 -- start start 2024-04-20T10:50:56.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf90ab640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003a00 0x7fbaf4154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf90ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaf40bd7e0 0x7fbaf40c0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7faab4ec1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80dc900 0x7faaa81746d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7faab4ec1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faaa80e11e0 0x7faaa8177850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf90ab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf40bdc60 0x7fbaf41eae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7faab4ec1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8177d90 0x7faaa8170fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7faab4ec1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faaa8009690 con 0x7faaa80e11e0 2024-04-20T10:50:56.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7faab4ec1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faaa804b3c0 con 0x7faaa8177d90 2024-04-20T10:50:56.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf90ab640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf406e3c0 con 0x7fbaf40bd7e0 2024-04-20T10:50:56.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf90ab640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf406e240 con 0x7fbadc003a00 2024-04-20T10:50:56.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf90ab640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf406e540 con 0x7fbaf40bdc60 2024-04-20T10:50:56.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c015020 con 0x7fb7400c36e0 2024-04-20T10:50:56.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb73c011850 con 0x7fb7400c36e0 2024-04-20T10:50:56.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb73c011c40 con 0x7fb7400c36e0 2024-04-20T10:50:56.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7faab4ec1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faaa80dc3b0 con 0x7faaa80dc900 2024-04-20T10:50:56.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaf40bd7e0 0x7fbaf40c0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaf40bd7e0 0x7fbaf40c0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58934/0 (socket says 172.21.15.90:58934) 2024-04-20T10:50:56.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf37fe640 1 -- 172.21.15.90:0/463602375 learned_addr learned my addr 172.21.15.90:0/463602375 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fdaad3a3640 1 -- 172.21.15.90:0/2387234743 >> v2:172.21.15.175:3300/0 conn(0x7fdaa806d440 msgr2=0x7fdaa80677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7f85de973640 1 -- 172.21.15.90:0/3875195905 shutdown_connections 2024-04-20T10:50:56.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7faaadd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faaa80e11e0 0x7faaa8177850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fdaa7fff640 1 --2- 172.21.15.90:0/2387234743 >> v2:172.21.15.175:3300/0 conn(0x7fdaa806d440 0x7fdaa80677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7fdaad3a3640 1 --2- 172.21.15.90:0/2387234743 >> v2:172.21.15.175:3300/0 conn(0x7fdaa806d440 0x7fdaa80677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7fdaad3a3640 1 -- 172.21.15.90:0/2387234743 >> v1:172.21.15.175:6789/0 conn(0x7fdaa80c8070 legacy=0x7fdaa815df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7faaadd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faaa80e11e0 0x7faaa8177850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58948/0 (socket says 172.21.15.90:58948) 2024-04-20T10:50:56.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7faaaed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8177d90 0x7faaa8170fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7faaadd9b640 1 -- 172.21.15.90:0/2313218692 learned_addr learned my addr 172.21.15.90:0/2313218692 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003a00 0x7fbaf4154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7fbaf88aa640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf40bdc60 0x7fbaf41eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7400c7920 con 0x7fb7400c36e0 2024-04-20T10:50:56.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.132+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb740147e00 con 0x7fb7400c36e0 2024-04-20T10:50:56.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7fdaad3a3640 1 -- 172.21.15.90:0/2387234743 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa806f320 con 0x7fdaa80c44d0 2024-04-20T10:50:56.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7fdaa7fff640 1 --2- 172.21.15.90:0/2387234743 >> v2:172.21.15.175:3300/0 conn(0x7fdaa806d440 0x7fdaa80677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:56.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7faaae59c640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80dc900 0x7faaa81746d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f02502b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0234004800 0x7f024814b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f02502b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02481e7c70 0x7f024814be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f02502b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0248154eb0 0x7f0248155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f85de973640 1 -- 172.21.15.90:0/3875195905 wait complete. 2024-04-20T10:50:56.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f3b42ec1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b3c072e80 0x7f3b3c1de870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f02502b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02480c4660 con 0x7f0234004800 2024-04-20T10:50:56.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f02502b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02480c44e0 con 0x7f02481e7c70 2024-04-20T10:50:56.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f02502b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02481534c0 con 0x7f0248154eb0 2024-04-20T10:50:56.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f024e84f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0248154eb0 0x7f0248155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f024e84f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0248154eb0 0x7f0248155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37178/0 (socket says 172.21.15.90:37178) 2024-04-20T10:50:56.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.133+0000 7f024e84f640 1 -- 172.21.15.90:0/2121911945 learned_addr learned my addr 172.21.15.90:0/2121911945 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b42ec1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 0x7f3b3c1dbd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b40c5d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b3c072e80 0x7f3b3c1de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b40c5d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b3c072e80 0x7f3b3c1de870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58954/0 (socket says 172.21.15.90:58954) 2024-04-20T10:50:56.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024d84d640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02481e7c70 0x7f024814be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fbaf3fff640 1 -- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf40bdc60 msgr2=0x7fbaf41eae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbaf40bdc60 0x7fbaf41eae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fbaf3fff640 1 -- 172.21.15.90:0/463602375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaf40bd7e0 msgr2=0x7fbaf40c0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaf40bd7e0 0x7fbaf40c0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fbaf3fff640 1 -- 172.21.15.90:0/463602375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf40beea0 con 0x7fbadc003a00 2024-04-20T10:50:56.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b3bfff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 0x7f3b3c1dbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024e84f640 1 -- 172.21.15.90:0/2121911945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02481e7c70 msgr2=0x7f024814be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024e84f640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02481e7c70 0x7f024814be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024e84f640 1 -- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0234004800 msgr2=0x7f024814b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024e84f640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0234004800 0x7f024814b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024e84f640 1 -- 172.21.15.90:0/2121911945 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02481544d0 con 0x7f0248154eb0 2024-04-20T10:50:56.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024d84d640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02481e7c70 0x7f024814be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:56.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b40c5d640 1 -- 172.21.15.90:0/1022936793 learned_addr learned my addr 172.21.15.90:0/1022936793 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7f54007a80 con 0x7f7f5c067ad0 2024-04-20T10:50:56.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb720001030 con 0x7fb7400c36e0 2024-04-20T10:50:56.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b42ec1640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b3c0c8b70 0x7f3b3c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c06e1d0 con 0x7f3b3c072e80 2024-04-20T10:50:56.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fdaad3a3640 1 --2- 172.21.15.90:0/2387234743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa80c4980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda900097a0 tx=0x7fda9002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95c75d53d0655b76 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7faaaed9d640 1 -- 172.21.15.90:0/2313218692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80dc900 msgr2=0x7faaa81746d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7faaaed9d640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faaa80dc900 0x7faaa81746d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7faaaed9d640 1 -- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faaa80e11e0 msgr2=0x7faaa8177850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7faaaed9d640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faaa80e11e0 0x7faaa8177850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7faaaed9d640 1 -- 172.21.15.90:0/2313218692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaa80d9810 con 0x7faaa8177d90 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c06d5a0 con 0x7f3b3c0c4390 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3b3c0ab100 con 0x7f3b3c0c8b70 2024-04-20T10:50:56.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fdaa77fe640 1 -- 172.21.15.90:0/2387234743 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda90035020 con 0x7fdaa80c44d0 2024-04-20T10:50:56.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fdaa77fe640 1 -- 172.21.15.90:0/2387234743 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda90031830 con 0x7fdaa80c44d0 2024-04-20T10:50:56.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7fdaa77fe640 1 -- 172.21.15.90:0/2387234743 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda90031c00 con 0x7fdaa80c44d0 2024-04-20T10:50:56.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.134+0000 7f024e84f640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0248154eb0 0x7f0248155310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f02400098c0 tx=0x7f0240009d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240019070 con 0x7f0248154eb0 2024-04-20T10:50:56.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7faaaed9d640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8177d90 0x7faaa8170fc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa980057e0 tx=0x7faaa4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f7f58ff9640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7f4806c8f0 0x7f7f4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b4145e640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b3c0c8b70 0x7f3b3c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b3bfff640 1 -- 172.21.15.90:0/1022936793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b3c0c8b70 msgr2=0x7f3b3c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b3bfff640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3b3c0c8b70 0x7f3b3c152150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b3bfff640 1 -- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b3c072e80 msgr2=0x7f3b3c1de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b3bfff640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b3c072e80 0x7f3b3c1de870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0240007cc0 con 0x7f0248154eb0 2024-04-20T10:50:56.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0240014640 con 0x7f0248154eb0 2024-04-20T10:50:56.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b3bfff640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c1516b0 con 0x7f3b3c0c4390 2024-04-20T10:50:56.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b40c5d640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3b3c072e80 0x7f3b3c1de870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f02502b2640 1 -- 172.21.15.90:0/2121911945 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02481547b0 con 0x7f0248154eb0 2024-04-20T10:50:56.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f7f5b7fe640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7f4806c8f0 0x7f7f4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4039040 con 0x7faaa8177d90 2024-04-20T10:50:56.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f3b3bfff640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 0x7f3b3c1dbd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c033000 tx=0x7f3b2c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f7f540b6b30 con 0x7f7f5c067ad0 2024-04-20T10:50:56.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7fbaf3fff640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003a00 0x7fbaf4154c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbadc014dc0 tx=0x7fbaf40ab1d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f7f58ff9640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7f7f48077180 0x7f7f480795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 --> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f54050e50 con 0x7f7f48077180 2024-04-20T10:50:56.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7f540b6f20 con 0x7f7f5c067ad0 2024-04-20T10:50:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7fdaaee06640 1 -- 172.21.15.90:0/2387234743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 msgr2=0x7fdaa80c4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7fdaaee06640 1 --2- 172.21.15.90:0/2387234743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa80c4980 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fda900097a0 tx=0x7fda9002b8d0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7fdaaee06640 1 -- 172.21.15.90:0/2387234743 shutdown_connections 2024-04-20T10:50:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7fdaaee06640 1 --2- 172.21.15.90:0/2387234743 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa80c4980 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7fdaaee06640 1 --2- 172.21.15.90:0/2387234743 >> v2:172.21.15.175:3300/0 conn(0x7fdaa806d440 0x7fdaa80677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7fdaaee06640 1 -- 172.21.15.90:0/2387234743 >> 172.21.15.90:0/2387234743 conn(0x7fdaa80aa660 msgr2=0x7fdaa80aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f02502b2640 1 -- 172.21.15.90:0/2121911945 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0248155850 con 0x7f0248154eb0 2024-04-20T10:50:56.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0224001030 con 0x7f0248154eb0 2024-04-20T10:50:56.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaa80d8f70 con 0x7faaa8177d90 2024-04-20T10:50:56.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaa80d9530 con 0x7faaa8177d90 2024-04-20T10:50:56.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faaa40093e0 con 0x7faaa8177d90 2024-04-20T10:50:56.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c044070 con 0x7f3b3c0c4390 2024-04-20T10:50:56.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c034890 con 0x7f3b3c0c4390 2024-04-20T10:50:56.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c039040 con 0x7f3b3c0c4390 2024-04-20T10:50:56.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c1e9190 con 0x7f3b3c0c4390 2024-04-20T10:50:56.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c151c30 con 0x7f3b3c0c4390 2024-04-20T10:50:56.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f7f5b7fe640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7f4806c8f0 0x7f7f4806edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f50006fd0 tx=0x7f7f50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb73c018020 con 0x7fb7400c36e0 2024-04-20T10:50:56.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.135+0000 7f85de973640 1 Processor -- start 2024-04-20T10:50:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7f85de973640 1 -- start start 2024-04-20T10:50:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f7f60a6f640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7f7f48077180 0x7f7f480795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7fb735ffb640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb72406c9f0 0x7fb72406eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0049e0 con 0x7fbadc003a00 2024-04-20T10:50:56.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fdaaee06640 1 -- 172.21.15.90:0/2387234743 shutdown_connections 2024-04-20T10:50:56.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaa4009860 con 0x7faaa8177d90 2024-04-20T10:50:56.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.136+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb73c08c1f0 con 0x7fb7400c36e0 2024-04-20T10:50:56.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fb735ffb640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7fb724077280 0x7fb7240796a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec004b80 con 0x7fbadc003a00 2024-04-20T10:50:56.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85de973640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004160 0x7f85d00d99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85de973640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d0045950 0x7f85d00446f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85de973640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d0044c30 0x7f85d002c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 --> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb724079d50 con 0x7fb724077280 2024-04-20T10:50:56.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fb73c08c5e0 con 0x7fb7400c36e0 2024-04-20T10:50:56.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85de973640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85d000bd20 con 0x7f85c4004160 2024-04-20T10:50:56.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85de973640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85d00df2a0 con 0x7f85d0045950 2024-04-20T10:50:56.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85de973640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f85d000bea0 con 0x7f85d0044c30 2024-04-20T10:50:56.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f7f60a6f640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7f7f48077180 0x7f7f480795a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fb7458e7640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7fb724077280 0x7fb7240796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f024001c070 con 0x7f0248154eb0 2024-04-20T10:50:56.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f023effd640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f022c06c9f0 0x7f022c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f024008b920 con 0x7f0248154eb0 2024-04-20T10:50:56.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f024e04e640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f022c06c9f0 0x7f022c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b3c076150 con 0x7f3b3c0c4390 2024-04-20T10:50:56.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b2c047070 con 0x7f3b3c0c4390 2024-04-20T10:50:56.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== osd.3 v2:172.21.15.90:6808/3826442785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7f54050e50 con 0x7f7f48077180 2024-04-20T10:50:56.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf41e7c00 con 0x7fbadc003a00 2024-04-20T10:50:56.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf41e81c0 con 0x7fbadc003a00 2024-04-20T10:50:56.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec02c730 con 0x7fbadc003a00 2024-04-20T10:50:56.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fb7450e6640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb72406c9f0 0x7fb72406eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7fb7450e6640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb72406c9f0 0x7fb72406eeb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb730006fd0 tx=0x7fb7300090e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7fdaaee06640 1 -- 172.21.15.90:0/2387234743 wait complete. 2024-04-20T10:50:56.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85dd971640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004160 0x7f85d00d99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85dd971640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004160 0x7f85d00d99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58964/0 (socket says 172.21.15.90:58964) 2024-04-20T10:50:56.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.137+0000 7f85dd971640 1 -- 172.21.15.90:0/2886168822 learned_addr learned my addr 172.21.15.90:0/2886168822 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f85dd170640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d0045950 0x7f85d00446f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f85de172640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d0044c30 0x7f85d002c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7fdaaee06640 1 Processor -- start 2024-04-20T10:50:56.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7fdaaee06640 1 -- start start 2024-04-20T10:50:56.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbaf4076070 con 0x7fbadc003a00 2024-04-20T10:50:56.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f3b397fa640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3b2806c9c0 0x7f3b2806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa94001030 con 0x7faaa8177d90 2024-04-20T10:50:56.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faaa4048030 con 0x7faaa8177d90 2024-04-20T10:50:56.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f024e04e640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f022c06c9f0 0x7f022c06eeb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0244007fd0 tx=0x7f02440079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3b2c0adbd0 con 0x7f3b3c0c4390 2024-04-20T10:50:56.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f3b397fa640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7f3b28077250 0x7f3b28079670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f023effd640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f022c077280 0x7f022c0796a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 --> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f024000be50 con 0x7f022c077280 2024-04-20T10:50:56.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7fb7458e7640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7fb724077280 0x7fb7240796a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7faa9effd640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faa9006c9f0 0x7faa9006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f024008bd10 con 0x7f0248154eb0 2024-04-20T10:50:56.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b2c04ee80 con 0x7f3b28077250 2024-04-20T10:50:56.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3b2c0b2280 con 0x7f3b3c0c4390 2024-04-20T10:50:56.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f3b40c5d640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3b2806c9c0 0x7f3b2806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f3b4145e640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7f3b28077250 0x7f3b28079670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f85dd971640 1 -- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d0044c30 msgr2=0x7f85d002c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f85dd971640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d0044c30 0x7f85d002c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.138+0000 7f85dd971640 1 -- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d0045950 msgr2=0x7f85d00446f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f85dd971640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d0045950 0x7f85d00446f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7f85dd971640 1 -- 172.21.15.90:0/2886168822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d0178040 con 0x7f85c4004160 2024-04-20T10:50:56.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.139+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7faaa40acf50 con 0x7faaa8177d90 2024-04-20T10:50:56.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f85dd971640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004160 0x7f85d00d99e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f85d80692d0 tx=0x7f85d80745c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7faa9effd640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7faa90077280 0x7faa900796a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 --> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faaa4045e50 con 0x7faa90077280 2024-04-20T10:50:56.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7faaa40b2580 con 0x7faaa8177d90 2024-04-20T10:50:56.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f3b4145e640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7f3b28077250 0x7f3b28079670 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7faaae59c640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faa9006c9f0 0x7faa9006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbaec02c8d0 con 0x7fbadc003a00 2024-04-20T10:50:56.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== osd.5 v2:172.21.15.175:6824/1056337988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb724079d50 con 0x7fb724077280 2024-04-20T10:50:56.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaaee06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa81f11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaaee06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaa80c8070 0x7fdaa814e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaaee06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaa814ac90 0x7fdaa814b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaaee06640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa815e620 con 0x7fdaa814ac90 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaaee06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa815eb90 con 0x7fdaa80c8070 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaaee06640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa815e7a0 con 0x7fdaa80c44d0 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8068f90 con 0x7f85c4004160 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85d806b930 con 0x7f85c4004160 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d806bae0 con 0x7f85c4004160 2024-04-20T10:50:56.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f3b40c5d640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3b2806c9c0 0x7f3b2806ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b30004430 tx=0x7f3b30007ef0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fbaf0ff9640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbae006c9f0 0x7fbae006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f85de973640 1 -- 172.21.15.90:0/2886168822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d002efb0 con 0x7f85c4004160 2024-04-20T10:50:56.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7f85de973640 1 -- 172.21.15.90:0/2886168822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d00da2b0 con 0x7f85c4004160 2024-04-20T10:50:56.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaa7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaa80c8070 0x7fdaa814e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaa7fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaa80c8070 0x7fdaa814e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60002/0 (socket says 172.21.15.90:60002) 2024-04-20T10:50:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaa7fff640 1 -- 172.21.15.90:0/2485043548 learned_addr learned my addr 172.21.15.90:0/2485043548 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaad3a3640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaa814ac90 0x7fdaa814b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7fdaacba2640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa81f11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.141+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbaec0ad3f0 con 0x7fbadc003a00 2024-04-20T10:50:56.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.141+0000 7fbaf0ff9640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fbae0077280 0x7fbae00796a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.141+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 --> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbaec00bf30 con 0x7fbae0077280 2024-04-20T10:50:56.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.141+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fbaec0b4050 con 0x7fbadc003a00 2024-04-20T10:50:56.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.140+0000 7faaadd9b640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7faa90077280 0x7faa900796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.141+0000 7faaadd9b640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7faa90077280 0x7faa900796a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.141+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== osd.2 v2:172.21.15.90:6816/460939980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3b2c04ee80 con 0x7f3b28077250 2024-04-20T10:50:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.141+0000 7fbaf37fe640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbae006c9f0 0x7fbae006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7f85de973640 1 -- 172.21.15.90:0/2886168822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f85d0046210 con 0x7f85c4004160 2024-04-20T10:50:56.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7faaae59c640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faa9006c9f0 0x7faa9006eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faaa80ddf00 tx=0x7faaa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fdaacba2640 1 -- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaa80c8070 msgr2=0x7fdaa814e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fdaacba2640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdaa80c8070 0x7fdaa814e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fdaacba2640 1 -- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaa814ac90 msgr2=0x7fdaa814b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fdaacba2640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdaa814ac90 0x7fdaa814b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fdaacba2640 1 -- 172.21.15.90:0/2485043548 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa814ea30 con 0x7fdaa80c44d0 2024-04-20T10:50:56.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fbaf37fe640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbae006c9f0 0x7fbae006eeb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40731d0 tx=0x7fbae8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7f024d84d640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f022c077280 0x7f022c0796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fdaacba2640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa81f11b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda9800bd60 tx=0x7fda9800be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7fbaf88aa640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fbae0077280 0x7fbae00796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.142+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== osd.1 v2:172.21.15.90:6824/1234006559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faaa4045e50 con 0x7faa90077280 2024-04-20T10:50:56.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.143+0000 7f024d84d640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f022c077280 0x7f022c0796a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.143+0000 7fbaf88aa640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fbae0077280 0x7fbae00796a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.143+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98011710 con 0x7fdaa80c44d0 2024-04-20T10:50:56.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.143+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda980118d0 con 0x7fdaa80c44d0 2024-04-20T10:50:56.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.144+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== osd.0 v2:172.21.15.90:6800/1699315385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f024000be50 con 0x7f022c077280 2024-04-20T10:50:56.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.144+0000 7fdaaee06640 1 -- 172.21.15.90:0/2485043548 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa8151c50 con 0x7fdaa80c44d0 2024-04-20T10:50:56.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.144+0000 7fdaaee06640 1 -- 172.21.15.90:0/2485043548 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa8152210 con 0x7fdaa80c44d0 2024-04-20T10:50:56.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.144+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda98011cc0 con 0x7fdaa80c44d0 2024-04-20T10:50:56.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.144+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85d806bc80 con 0x7f85c4004160 2024-04-20T10:50:56.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.144+0000 7f85ce7fc640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85bc06c8f0 0x7f85bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== osd.4 v2:172.21.15.175:6800/1431656962 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbaec00bf30 con 0x7fbae0077280 2024-04-20T10:50:56.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7f85dd170640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85bc06c8f0 0x7f85bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f85d8107f30 con 0x7f85c4004160 2024-04-20T10:50:56.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7f85ce7fc640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f85bc077180 0x7f85bc0795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 --> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f85bc079c50 con 0x7f85bc077180 2024-04-20T10:50:56.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f85d810a530 con 0x7f85c4004160 2024-04-20T10:50:56.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7fdaaee06640 1 -- 172.21.15.90:0/2485043548 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdaa8151a00 con 0x7fdaa80c44d0 2024-04-20T10:50:56.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.145+0000 7f85dd170640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85bc06c8f0 0x7f85bc06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f85d00de710 tx=0x7f85d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.146+0000 7f85de172640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f85bc077180 0x7f85bc0795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.146+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda9801c400 con 0x7fdaa80c44d0 2024-04-20T10:50:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.146+0000 7fdaa57fa640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda8806c940 0x7fda8806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.146+0000 7f85de172640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f85bc077180 0x7f85bc0795a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.146+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fda9808ca20 con 0x7fdaa80c44d0 2024-04-20T10:50:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.147+0000 7fdaa57fa640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fda880771e0 0x7fda88079600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.147+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 --> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda88079cb0 con 0x7fda880771e0 2024-04-20T10:50:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.147+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fda980912a0 con 0x7fdaa80c44d0 2024-04-20T10:50:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.147+0000 7fdaa7fff640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda8806c940 0x7fda8806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.147+0000 7fdaad3a3640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fda880771e0 0x7fda88079600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.147+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== osd.7 v2:172.21.15.175:6808/2312344703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f85bc079c50 con 0x7f85bc077180 2024-04-20T10:50:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.148+0000 7fdaad3a3640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fda880771e0 0x7fda88079600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.148+0000 7fdaa7fff640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda8806c940 0x7fda8806ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80aee30 tx=0x7fdaa0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.148+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== osd.6 v2:172.21.15.175:6816/3312370671 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fda88079cb0 con 0x7fda880771e0 2024-04-20T10:50:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.172+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 --> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa94002dd0 con 0x7faa90077280 2024-04-20T10:50:56.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.173+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 --> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb720002d50 con 0x7fb724077280 2024-04-20T10:50:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.173+0000 7faa9effd640 1 -- 172.21.15.90:0/2313218692 <== osd.1 v2:172.21.15.90:6824/1234006559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faa94002dd0 con 0x7faa90077280 2024-04-20T10:50:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.172+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 --> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7f5c14c120 con 0x7f7f48077180 2024-04-20T10:50:56.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.173+0000 7fb735ffb640 1 -- 172.21.15.90:0/4191040210 <== osd.5 v2:172.21.15.175:6824/1056337988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb720002d50 con 0x7fb724077280 2024-04-20T10:50:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.173+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7faa90077280 msgr2=0x7faa900796a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.173+0000 7faab4ec1640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7faa90077280 0x7faa900796a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7f7f58ff9640 1 -- 172.21.15.90:0/379843396 <== osd.3 v2:172.21.15.90:6808/3826442785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7f5c14c120 con 0x7f7f48077180 2024-04-20T10:50:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 --> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b3c0ac990 con 0x7f3b28077250 2024-04-20T10:50:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faa9006c9f0 msgr2=0x7faa9006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7faa9006c9f0 0x7faa9006eeb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faaa80ddf00 tx=0x7faaa0008040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8177d90 msgr2=0x7faaa8170fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 --2- 172.21.15.90:0/2313218692 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faaa8177d90 0x7faaa8170fc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7faa980057e0 tx=0x7faaa4004730 comp rx=0 tx=0).stop 2024-04-20T10:50:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faaaed9d640 1 -- 172.21.15.90:0/2313218692 reap_dead start 2024-04-20T10:50:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 shutdown_connections 2024-04-20T10:50:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 >> 172.21.15.90:0/2313218692 conn(0x7faaa8005e80 msgr2=0x7faaa80dd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7f7f48077180 msgr2=0x7f7f480795a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7f7f427fc640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7f7f48077180 0x7f7f480795a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7f3b397fa640 1 -- 172.21.15.90:0/1022936793 <== osd.2 v2:172.21.15.90:6816/460939980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b3c0ac990 con 0x7f3b28077250 2024-04-20T10:50:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 shutdown_connections 2024-04-20T10:50:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7faab4ec1640 1 -- 172.21.15.90:0/2313218692 wait complete. 2024-04-20T10:50:56.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7f4806c8f0 msgr2=0x7f7f4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.174+0000 7f7f427fc640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7f4806c8f0 0x7f7f4806edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7f50006fd0 tx=0x7f7f50008040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 msgr2=0x7f7f5c1ed1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f7f427fc640 1 --2- 172.21.15.90:0/379843396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7f5c067ad0 0x7f7f5c1ed1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7f540093e0 tx=0x7f7f54004a40 comp rx=0 tx=0).stop 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f7f60a6f640 1 -- 172.21.15.90:0/379843396 reap_dead start 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7f3b28077250 msgr2=0x7f3b28079670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7f3b28077250 0x7f3b28079670 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 shutdown_connections 2024-04-20T10:50:56.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 >> 172.21.15.90:0/379843396 conn(0x7f7f5c068130 msgr2=0x7f7f5c151af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7fb724077280 msgr2=0x7fb7240796a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7fb74734a640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7fb724077280 0x7fb7240796a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3b2806c9c0 msgr2=0x7f3b2806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3b2806c9c0 0x7f3b2806ee80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3b30004430 tx=0x7f3b30007ef0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 msgr2=0x7f3b3c1dbd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 --2- 172.21.15.90:0/1022936793 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3b3c0c4390 0x7f3b3c1dbd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c033000 tx=0x7f3b2c0046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b4145e640 1 -- 172.21.15.90:0/1022936793 reap_dead start 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 shutdown_connections 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 >> 172.21.15.90:0/1022936793 conn(0x7f3b3c0c8080 msgr2=0x7f3b3c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 shutdown_connections 2024-04-20T10:50:56.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.175+0000 7f3b42ec1640 1 -- 172.21.15.90:0/1022936793 wait complete. 2024-04-20T10:50:56.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb72406c9f0 msgr2=0x7fb72406eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7fb74734a640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb72406c9f0 0x7fb72406eeb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb730006fd0 tx=0x7fb7300090e0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7400c36e0 msgr2=0x7fb7401478c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7fb74734a640 1 --2- 172.21.15.90:0/4191040210 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7400c36e0 0x7fb7401478c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb73c00b410 tx=0x7fb73c00b8d0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 --> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0224002dd0 con 0x7f022c077280 2024-04-20T10:50:56.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7f023effd640 1 -- 172.21.15.90:0/2121911945 <== osd.0 v2:172.21.15.90:6800/1699315385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0224002dd0 con 0x7f022c077280 2024-04-20T10:50:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 shutdown_connections 2024-04-20T10:50:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7f7f427fc640 1 -- 172.21.15.90:0/379843396 wait complete. 2024-04-20T10:50:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7fb7458e7640 1 -- 172.21.15.90:0/4191040210 reap_dead start 2024-04-20T10:50:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 shutdown_connections 2024-04-20T10:50:56.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.176+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 >> 172.21.15.90:0/4191040210 conn(0x7fb7400c8080 msgr2=0x7fb7400c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 shutdown_connections 2024-04-20T10:50:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f022c077280 msgr2=0x7f022c0796a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7f023cff9640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f022c077280 0x7f022c0796a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f022c06c9f0 msgr2=0x7f022c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7f023cff9640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f022c06c9f0 0x7f022c06eeb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0244007fd0 tx=0x7f02440079e0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7fb74734a640 1 -- 172.21.15.90:0/4191040210 wait complete. 2024-04-20T10:50:56.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0248154eb0 msgr2=0x7f0248155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7f023cff9640 1 --2- 172.21.15.90:0/2121911945 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0248154eb0 0x7f0248155310 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f02400098c0 tx=0x7f0240009d80 comp rx=0 tx=0).stop 2024-04-20T10:50:56.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.177+0000 7f024e84f640 1 -- 172.21.15.90:0/2121911945 reap_dead start 2024-04-20T10:50:56.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.178+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 shutdown_connections 2024-04-20T10:50:56.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.178+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 >> 172.21.15.90:0/2121911945 conn(0x7f0248067d50 msgr2=0x7f024814dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.178+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 --> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbaf40c3ac0 con 0x7fbae0077280 2024-04-20T10:50:56.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.178+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 shutdown_connections 2024-04-20T10:50:56.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.178+0000 7f023cff9640 1 -- 172.21.15.90:0/2121911945 wait complete. 2024-04-20T10:50:56.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.179+0000 7fbaf0ff9640 1 -- 172.21.15.90:0/463602375 <== osd.4 v2:172.21.15.175:6800/1431656962 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbaf40c3ac0 con 0x7fbae0077280 2024-04-20T10:50:56.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.179+0000 7fdaaee06640 1 -- 172.21.15.90:0/2485043548 --> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdaa8076150 con 0x7fda880771e0 2024-04-20T10:50:56.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.179+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fbae0077280 msgr2=0x7fbae00796a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.179+0000 7fbaf90ab640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fbae0077280 0x7fbae00796a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbae006c9f0 msgr2=0x7fbae006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbae006c9f0 0x7fbae006eeb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbaf40731d0 tx=0x7fbae8009190 comp rx=0 tx=0).stop 2024-04-20T10:50:56.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003a00 msgr2=0x7fbaf4154c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 --2- 172.21.15.90:0/463602375 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbadc003a00 0x7fbaf4154c10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbadc014dc0 tx=0x7fbaf40ab1d0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fdaa57fa640 1 -- 172.21.15.90:0/2485043548 <== osd.6 v2:172.21.15.175:6816/3312370671 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdaa8076150 con 0x7fda880771e0 2024-04-20T10:50:56.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf88aa640 1 -- 172.21.15.90:0/463602375 reap_dead start 2024-04-20T10:50:56.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 shutdown_connections 2024-04-20T10:50:56.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 >> 172.21.15.90:0/463602375 conn(0x7fbaf40676c0 msgr2=0x7fbaf41500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 shutdown_connections 2024-04-20T10:50:56.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fbaf90ab640 1 -- 172.21.15.90:0/463602375 wait complete. 2024-04-20T10:50:56.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fda9effd640 1 -- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fda880771e0 msgr2=0x7fda88079600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.180+0000 7fda9effd640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fda880771e0 0x7fda88079600 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 -- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda8806c940 msgr2=0x7fda8806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda8806c940 0x7fda8806ee00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80aee30 tx=0x7fdaa0008040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7f85de973640 1 -- 172.21.15.90:0/2886168822 --> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f85d00057e0 con 0x7f85bc077180 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 -- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 msgr2=0x7fdaa81f11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 --2- 172.21.15.90:0/2485043548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdaa80c44d0 0x7fdaa81f11b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fda9800bd60 tx=0x7fda9800be50 comp rx=0 tx=0).stop 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fdaad3a3640 1 -- 172.21.15.90:0/2485043548 reap_dead start 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 -- 172.21.15.90:0/2485043548 shutdown_connections 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 -- 172.21.15.90:0/2485043548 >> 172.21.15.90:0/2485043548 conn(0x7fdaa80aa660 msgr2=0x7fdaa815c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 -- 172.21.15.90:0/2485043548 shutdown_connections 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7fda9effd640 1 -- 172.21.15.90:0/2485043548 wait complete. 2024-04-20T10:50:56.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.181+0000 7f85ce7fc640 1 -- 172.21.15.90:0/2886168822 <== osd.7 v2:172.21.15.175:6808/2312344703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f85d00057e0 con 0x7f85bc077180 2024-04-20T10:50:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.182+0000 7f85bbfff640 1 -- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f85bc077180 msgr2=0x7f85bc0795a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.182+0000 7f85bbfff640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f85bc077180 0x7f85bc0795a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.183+0000 7f85bbfff640 1 -- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85bc06c8f0 msgr2=0x7f85bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.183+0000 7f85bbfff640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85bc06c8f0 0x7f85bc06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f85d00de710 tx=0x7f85d4009040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.183+0000 7f85bbfff640 1 -- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004160 msgr2=0x7f85d00d99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.183+0000 7f85bbfff640 1 --2- 172.21.15.90:0/2886168822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c4004160 0x7f85d00d99e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f85d80692d0 tx=0x7f85d80745c0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.183+0000 7f85de172640 1 -- 172.21.15.90:0/2886168822 reap_dead start 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.184+0000 7f85bbfff640 1 -- 172.21.15.90:0/2886168822 shutdown_connections 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.184+0000 7f85bbfff640 1 -- 172.21.15.90:0/2886168822 >> 172.21.15.90:0/2886168822 conn(0x7f85d002db90 msgr2=0x7f85d00050c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.184+0000 7f85bbfff640 1 -- 172.21.15.90:0/2886168822 shutdown_connections 2024-04-20T10:50:56.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.184+0000 7f85bbfff640 1 -- 172.21.15.90:0/2886168822 wait complete. 2024-04-20T10:50:56.255 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:56.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-20T10:50:56.256 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-20T10:50:56.256 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-20T10:50:56.257 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-20T10:50:56.257 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-20T10:50:56.258 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2024-04-20T10:50:56.259 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-20T10:50:56.259 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-20T10:50:56.260 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-20T10:50:56.260 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:56.260 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-20T10:50:56.261 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-20T10:50:56.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-20T10:50:56.262 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:56.263 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-20T10:50:56.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.459+0000 7fdee4832640 1 Processor -- start 2024-04-20T10:50:56.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.460+0000 7fdee4832640 1 -- start start 2024-04-20T10:50:56.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.460+0000 7fa5aeca5640 1 Processor -- start 2024-04-20T10:50:56.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.460+0000 7fa5aeca5640 1 -- start start 2024-04-20T10:50:56.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7fdee4832640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0151390 0x7fdee00c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7f8548a06640 1 Processor -- start 2024-04-20T10:50:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7fdee4832640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdee00c64f0 0x7fdee015b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7fdee4832640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee00724f0 con 0x7fdee0070b20 2024-04-20T10:50:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7fdee4832640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdee00727d0 con 0x7fdee00c64f0 2024-04-20T10:50:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7fdee4832640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdee0072ab0 con 0x7fdee0151390 2024-04-20T10:50:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7f8548a06640 1 -- start start 2024-04-20T10:50:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.461+0000 7fa5aeca5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa5a00db800 0x7fa5a00dbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5aeca5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa5a00e2c80 0x7fa5a00e5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5aca41640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa5a00d7ad0 0x7fa5a0046150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56652/0 (socket says 172.21.15.90:56652) 2024-04-20T10:50:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5aeca5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5a0007080 con 0x7fa5a00d7ad0 2024-04-20T10:50:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fdede59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0151390 0x7fdee00c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7f82c35b2640 1 Processor -- start 2024-04-20T10:50:56.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5aca41640 1 -- 172.21.15.90:0/1333751776 learned_addr learned my addr 172.21.15.90:0/1333751776 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5a7fff640 1 --2- 172.21.15.90:0/1333751776 >> v2:172.21.15.90:3300/0 conn(0x7fa5a00db800 0x7fa5a00dbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fdede59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0151390 0x7fdee00c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37210/0 (socket says 172.21.15.90:37210) 2024-04-20T10:50:56.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fdede59c640 1 -- 172.21.15.90:0/3079116609 learned_addr learned my addr 172.21.15.90:0/3079116609 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa433bef640 1 Processor -- start 2024-04-20T10:50:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fdeded9d640 1 --2- 172.21.15.90:0/3079116609 >> v2:172.21.15.175:3300/0 conn(0x7fdee00c64f0 0x7fdee015b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5ad242640 1 --2- 172.21.15.90:0/1333751776 >> v2:172.21.15.175:3300/0 conn(0x7fa5a00e2c80 0x7fa5a00e5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5aeca5640 1 -- 172.21.15.90:0/1333751776 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a0007340 con 0x7fa5a00db800 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa5aeca5640 1 -- 172.21.15.90:0/1333751776 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa5a00da420 con 0x7fa5a00e2c80 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fa5ad242640 1 -- 172.21.15.90:0/1333751776 >> v2:172.21.15.90:3300/0 conn(0x7fa5a00db800 msgr2=0x7fa5a00dbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fa5a77fe640 1 -- 172.21.15.90:0/1333751776 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732440419 0 0) 0x7fa5a0007080 con 0x7fa5a00d7ad0 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fa5ad242640 1 --2- 172.21.15.90:0/1333751776 >> v2:172.21.15.90:3300/0 conn(0x7fa5a00db800 0x7fa5a00dbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fa5ad242640 1 -- 172.21.15.90:0/1333751776 >> v1:172.21.15.90:6789/0 conn(0x7fa5a00d7ad0 legacy=0x7fa5a0046150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fa5ad242640 1 -- 172.21.15.90:0/1333751776 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a00da700 con 0x7fa5a00e2c80 2024-04-20T10:50:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa5a7fff640 1 --2- 172.21.15.90:0/1333751776 >> v2:172.21.15.90:3300/0 conn(0x7fa5a00db800 0x7fa5a00dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fdede59c640 1 -- 172.21.15.90:0/3079116609 >> v2:172.21.15.175:3300/0 conn(0x7fdee00c64f0 msgr2=0x7fdee015b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fdede59c640 1 --2- 172.21.15.90:0/3079116609 >> v2:172.21.15.175:3300/0 conn(0x7fdee00c64f0 0x7fdee015b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fdede59c640 1 -- 172.21.15.90:0/3079116609 >> v1:172.21.15.90:6789/0 conn(0x7fdee0070b20 legacy=0x7fdee015ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7fdede59c640 1 -- 172.21.15.90:0/3079116609 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee0072d90 con 0x7fdee0151390 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7f8548a06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 0x7f85440a8410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7f854259c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f85440676c0 0x7f85440a7d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39948/0 (socket says 172.21.15.90:39948) 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7f854259c640 1 -- 172.21.15.90:0/314537555 learned_addr learned my addr 172.21.15.90:0/314537555 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85440c85c0 con 0x7f85440682f0 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874488009 0 0) 0x7f85440c85c0 con 0x7f85440682f0 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85440c88a0 con 0x7f85440676c0 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f854414daa0 con 0x7f85440c80c0 2024-04-20T10:50:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7f8541d9b640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 0x7f85440a8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f852c003520 con 0x7f85440682f0 2024-04-20T10:50:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596090956 0 0) 0x7f85440c88a0 con 0x7f85440676c0 2024-04-20T10:50:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7fa433bef640 1 -- start start 2024-04-20T10:50:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa433bef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42400d7b0 0x7fa424040990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa433bef640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa424040ed0 0x7fa42400c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa433bef640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4240df0e0 con 0x7fa4240dbeb0 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa433bef640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa42400be40 con 0x7fa424040ed0 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa433bef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa4240491d0 con 0x7fa42400d7b0 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa43198b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa4240dbeb0 0x7fa4240de900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56666/0 (socket says 172.21.15.90:56666) 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa43198b640 1 -- 172.21.15.90:0/2590544625 learned_addr learned my addr 172.21.15.90:0/2590544625 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa43118a640 1 --2- 172.21.15.90:0/2590544625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42400d7b0 0x7fa424040990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.462+0000 7efe254c2640 1 Processor -- start 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7efe254c2640 1 -- start start 2024-04-20T10:50:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7efe254c2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efe1803ff70 0x7efe1800b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.463+0000 7f82c35b2640 1 -- start start 2024-04-20T10:50:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f82c35b2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f82bc150c00 0x7f82bc153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f82c35b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc06ca40 0x7f82bc0c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f82c35b2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82bc071fa0 con 0x7f82bc06f330 2024-04-20T10:50:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f82c35b2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f82bc153500 con 0x7f82bc150c00 2024-04-20T10:50:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f82c35b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82bc06ced0 con 0x7f82bc06ca40 2024-04-20T10:50:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fdeded9d640 1 --2- 172.21.15.90:0/3079116609 >> v2:172.21.15.175:3300/0 conn(0x7fdee00c64f0 0x7fdee015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85440c85c0 con 0x7f85440676c0 2024-04-20T10:50:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7efe1ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7efe180cdb50 0x7efe18008c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39954/0 (socket says 172.21.15.90:39954) 2024-04-20T10:50:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7efe1ffff640 1 -- 172.21.15.90:0/2601902919 learned_addr learned my addr 172.21.15.90:0/2601902919 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe180d7a90 con 0x7efe1804a7e0 2024-04-20T10:50:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe180d7d70 con 0x7efe180cdb50 2024-04-20T10:50:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7efe180478b0 con 0x7efe1803ff70 2024-04-20T10:50:56.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa43118a640 1 -- 172.21.15.90:0/2590544625 >> v2:172.21.15.90:3300/0 conn(0x7fa424040ed0 msgr2=0x7fa42400c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa43118a640 1 --2- 172.21.15.90:0/2590544625 >> v2:172.21.15.90:3300/0 conn(0x7fa424040ed0 0x7fa42400c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa43118a640 1 -- 172.21.15.90:0/2590544625 >> v1:172.21.15.90:6789/0 conn(0x7fa4240dbeb0 legacy=0x7fa4240de900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa43118a640 1 -- 172.21.15.90:0/2590544625 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4240df3c0 con 0x7fa42400d7b0 2024-04-20T10:50:56.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fa5ad242640 1 --2- 172.21.15.90:0/1333751776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00e5070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8050210 tx=0x7fa5a80a7f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8291261184724708 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7fdede59c640 1 --2- 172.21.15.90:0/3079116609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0151390 0x7fdee00c5fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fded0009870 tx=0x7fded002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c39663c3fe897bc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2382887986 0 0) 0x7f852c003520 con 0x7f85440682f0 2024-04-20T10:50:56.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 msgr2=0x7f85440a8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 0x7f85440a8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 >> v1:172.21.15.175:6789/0 conn(0x7f85440676c0 legacy=0x7f85440a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f53a33a4640 1 Processor -- start 2024-04-20T10:50:56.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f53a33a4640 1 -- start start 2024-04-20T10:50:56.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1796189459 0 0) 0x7efe180d7d70 con 0x7efe180cdb50 2024-04-20T10:50:56.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe10003520 con 0x7efe180cdb50 2024-04-20T10:50:56.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f82c1b4f640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f82bc06f330 0x7f82bc06d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56668/0 (socket says 172.21.15.90:56668) 2024-04-20T10:50:56.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.464+0000 7f82c1b4f640 1 -- 172.21.15.90:0/2054110814 learned_addr learned my addr 172.21.15.90:0/2054110814 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7fa5a77fe640 1 -- 172.21.15.90:0/1333751776 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80b5070 con 0x7fa5a00e2c80 2024-04-20T10:50:56.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7fdedd59a640 1 -- 172.21.15.90:0/3079116609 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0035020 con 0x7fdee0151390 2024-04-20T10:50:56.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f82c0b4d640 1 --2- 172.21.15.90:0/2054110814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc06ca40 0x7f82bc0c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f82c134e640 1 --2- 172.21.15.90:0/2054110814 >> v2:172.21.15.90:3300/0 conn(0x7f82bc150c00 0x7f82bc153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7fa5a77fe640 1 -- 172.21.15.90:0/1333751776 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a80a8e10 con 0x7fa5a00e2c80 2024-04-20T10:50:56.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7fa5a77fe640 1 -- 172.21.15.90:0/1333751776 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80b0640 con 0x7fa5a00e2c80 2024-04-20T10:50:56.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7fdedd59a640 1 -- 172.21.15.90:0/3079116609 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded0031870 con 0x7fdee0151390 2024-04-20T10:50:56.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7fdedd59a640 1 -- 172.21.15.90:0/3079116609 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0031c80 con 0x7fdee0151390 2024-04-20T10:50:56.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85440c4da0 con 0x7f85440682f0 2024-04-20T10:50:56.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690424337 0 0) 0x7efe180d7a90 con 0x7efe1804a7e0 2024-04-20T10:50:56.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe180d7d70 con 0x7efe1804a7e0 2024-04-20T10:50:56.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1f7fe640 1 --2- 172.21.15.90:0/2601902919 >> v2:172.21.15.90:3300/0 conn(0x7efe1803ff70 0x7efe1800b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f853c001a20 con 0x7f85440682f0 2024-04-20T10:50:56.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f8541d9b640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 0x7f85440a8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 >> v1:172.21.15.90:6789/0 conn(0x7f85440682f0 legacy=0x7f854415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f852c003ba0 0x7f852c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 0x7f852c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3305264292 0 0) 0x7efe180d7d70 con 0x7efe1804a7e0 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 >> v2:172.21.15.90:3300/0 conn(0x7efe1803ff70 msgr2=0x7efe1800b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 --2- 172.21.15.90:0/2601902919 >> v2:172.21.15.90:3300/0 conn(0x7efe1803ff70 0x7efe1800b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 >> v1:172.21.15.175:6789/0 conn(0x7efe180cdb50 legacy=0x7efe18008c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854259c640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f852c003ba0 0x7f852c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f854159a640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852c004d40 0x7f852c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f854414daa0 con 0x7f852c004d40 2024-04-20T10:50:56.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f852c00bb20 con 0x7f852c003ba0 2024-04-20T10:50:56.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18047260 con 0x7efe1804a7e0 2024-04-20T10:50:56.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7efe200635c0 con 0x7efe1804a7e0 2024-04-20T10:50:56.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 >> v1:172.21.15.90:6789/0 conn(0x7efe1804a7e0 legacy=0x7efe1800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10003b40 0x7efe10003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe10004800 0x7efe10004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f82c134e640 1 -- 172.21.15.90:0/2054110814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc06ca40 msgr2=0x7f82bc0c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f82c134e640 1 --2- 172.21.15.90:0/2054110814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc06ca40 0x7f82bc0c3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7f82c134e640 1 -- 172.21.15.90:0/2054110814 >> v1:172.21.15.90:6789/0 conn(0x7f82bc06f330 legacy=0x7f82bc06d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f8541d9b640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 0x7f852c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f852c00bd20 con 0x7f85440c80c0 2024-04-20T10:50:56.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f82c134e640 1 -- 172.21.15.90:0/2054110814 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc1537a0 con 0x7f82bc150c00 2024-04-20T10:50:56.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe180478b0 con 0x7efe10004800 2024-04-20T10:50:56.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe1000bfe0 con 0x7efe10003b40 2024-04-20T10:50:56.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.465+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efe1000c1e0 con 0x7efe100051c0 2024-04-20T10:50:56.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe24cc1640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fa43118a640 1 --2- 172.21.15.90:0/2590544625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42400d7b0 0x7fa424040990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa4200097a0 tx=0x7fa42002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52ce1623e4e82df1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fa5aeca5640 1 -- 172.21.15.90:0/1333751776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00e2c80 msgr2=0x7fa5a00e5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/1333751776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00e5070 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8050210 tx=0x7fa5a80a7f60 comp rx=0 tx=0).stop 2024-04-20T10:50:56.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fac4c274640 1 Processor -- start 2024-04-20T10:50:56.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe1f7fe640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe10004800 0x7efe10004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fdee4832640 1 -- 172.21.15.90:0/3079116609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0151390 msgr2=0x7fdee00c5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a33a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f539403eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a33a4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53940e2550 0x7f53940e29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a33a4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53940474e0 con 0x7f53940dfd90 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a33a4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5394046960 con 0x7f53940e2550 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a33a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53940477c0 con 0x7f539403e7a0 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a093f640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f53940dfd90 0x7f53940df320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39968/0 (socket says 172.21.15.90:39968) 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a093f640 1 -- 172.21.15.90:0/74097055 learned_addr learned my addr 172.21.15.90:0/74097055 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a1140640 1 --2- 172.21.15.90:0/74097055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f539403eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a1941640 1 --2- 172.21.15.90:0/74097055 >> v2:172.21.15.175:3300/0 conn(0x7f53940e2550 0x7f53940e29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f5393fff640 1 -- 172.21.15.90:0/74097055 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193516170 0 0) 0x7f53940474e0 con 0x7f53940dfd90 2024-04-20T10:50:56.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fdee4832640 1 --2- 172.21.15.90:0/3079116609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0151390 0x7fdee00c5fb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fded0009870 tx=0x7fded002b910 comp rx=0 tx=0).stop 2024-04-20T10:50:56.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fa430989640 1 -- 172.21.15.90:0/2590544625 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420038070 con 0x7fa42400d7b0 2024-04-20T10:50:56.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fa430989640 1 -- 172.21.15.90:0/2590544625 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa420031700 con 0x7fa42400d7b0 2024-04-20T10:50:56.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fa430989640 1 -- 172.21.15.90:0/2590544625 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420031ad0 con 0x7fa42400d7b0 2024-04-20T10:50:56.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7fdee4832640 1 -- 172.21.15.90:0/3079116609 shutdown_connections 2024-04-20T10:50:56.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f8542d9d640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852c004d40 0x7f852c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fdee4832640 1 --2- 172.21.15.90:0/3079116609 >> v2:172.21.15.175:3300/0 conn(0x7fdee00c64f0 0x7fdee015b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fdee4832640 1 --2- 172.21.15.90:0/3079116609 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0151390 0x7fdee00c5fb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fdee4832640 1 -- 172.21.15.90:0/3079116609 >> 172.21.15.90:0/3079116609 conn(0x7fdee00c9ec0 msgr2=0x7fdee00ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f8542d9d640 1 -- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 msgr2=0x7f852c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f8542d9d640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85440c80c0 0x7f852c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f8542d9d640 1 -- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f852c003ba0 msgr2=0x7f852c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7f82c134e640 1 --2- 172.21.15.90:0/2054110814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc150c00 0x7f82bc153fa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82b80097a0 tx=0x7f82b802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f1019add7cd3077 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f8542d9d640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f852c003ba0 0x7f852c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f8542d9d640 1 -- 172.21.15.90:0/314537555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f852c003520 con 0x7f852c004d40 2024-04-20T10:50:56.490 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fdee4832640 1 -- 172.21.15.90:0/3079116609 shutdown_connections 2024-04-20T10:50:56.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe1ffff640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10003b40 0x7efe10003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fdee4832640 1 -- 172.21.15.90:0/3079116609 wait complete. 2024-04-20T10:50:56.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7f82b3fff640 1 -- 172.21.15.90:0/2054110814 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8037070 con 0x7f82bc150c00 2024-04-20T10:50:56.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe24cc1640 1 -- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10003b40 msgr2=0x7efe10003f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe24cc1640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe10003b40 0x7efe10003f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe24cc1640 1 -- 172.21.15.90:0/2601902919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe10004800 msgr2=0x7efe10004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe24cc1640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe10004800 0x7efe10004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 -- 172.21.15.90:0/2590544625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42400d7b0 msgr2=0x7fa424040990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 --2- 172.21.15.90:0/2590544625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42400d7b0 0x7fa424040990 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa4200097a0 tx=0x7fa42002b7a0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7efe24cc1640 1 -- 172.21.15.90:0/2601902919 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18047260 con 0x7efe100051c0 2024-04-20T10:50:56.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7f82b3fff640 1 -- 172.21.15.90:0/2054110814 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b8030710 con 0x7f82bc150c00 2024-04-20T10:50:56.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7f82b3fff640 1 -- 172.21.15.90:0/2054110814 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8030ae0 con 0x7f82bc150c00 2024-04-20T10:50:56.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 -- 172.21.15.90:0/2590544625 shutdown_connections 2024-04-20T10:50:56.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 --2- 172.21.15.90:0/2590544625 >> v2:172.21.15.90:3300/0 conn(0x7fa424040ed0 0x7fa42400c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 --2- 172.21.15.90:0/2590544625 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa42400d7b0 0x7fa424040990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 -- 172.21.15.90:0/2590544625 >> 172.21.15.90:0/2590544625 conn(0x7fa42402f4b0 msgr2=0x7fa42402f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7efe24cc1640 1 -- 172.21.15.90:0/2601902919 reap_dead start 2024-04-20T10:50:56.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fac4c274640 1 -- start start 2024-04-20T10:50:56.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa5aeca5640 1 -- 172.21.15.90:0/1333751776 shutdown_connections 2024-04-20T10:50:56.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/1333751776 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00e5070 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/1333751776 >> v2:172.21.15.90:3300/0 conn(0x7fa5a00db800 0x7fa5a00dbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa5aeca5640 1 -- 172.21.15.90:0/1333751776 >> 172.21.15.90:0/1333751776 conn(0x7fa5a0005e90 msgr2=0x7fa5a00062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 -- 172.21.15.90:0/2590544625 shutdown_connections 2024-04-20T10:50:56.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f5393fff640 1 -- 172.21.15.90:0/74097055 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5388003520 con 0x7f53940dfd90 2024-04-20T10:50:56.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a1140640 1 -- 172.21.15.90:0/74097055 >> v2:172.21.15.175:3300/0 conn(0x7f53940e2550 msgr2=0x7f53940e29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:56.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a1140640 1 --2- 172.21.15.90:0/74097055 >> v2:172.21.15.175:3300/0 conn(0x7f53940e2550 0x7f53940e29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a1140640 1 -- 172.21.15.90:0/74097055 >> v1:172.21.15.175:6789/0 conn(0x7f53940dfd90 legacy=0x7f53940df320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.466+0000 7f53a1140640 1 -- 172.21.15.90:0/74097055 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5394047aa0 con 0x7f539403e7a0 2024-04-20T10:50:56.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7f53a1941640 1 --2- 172.21.15.90:0/74097055 >> v2:172.21.15.175:3300/0 conn(0x7f53940e2550 0x7f53940e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:56.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7f8542d9d640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852c004d40 0x7f852c0051c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f853c0021f0 tx=0x7f852c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb946d6f8ceb7483 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7efe24cc1640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe1000b9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe20050210 tx=0x7efe10005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b53410420578d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f53a1140640 1 --2- 172.21.15.90:0/74097055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f539403eb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6ece0b0b77e10e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c00e470 con 0x7f852c004d40 2024-04-20T10:50:56.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7fa5aeca5640 1 -- 172.21.15.90:0/1333751776 shutdown_connections 2024-04-20T10:50:56.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7fa5aeca5640 1 -- 172.21.15.90:0/1333751776 wait complete. 2024-04-20T10:50:56.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c00e0d0 con 0x7f852c004d40 2024-04-20T10:50:56.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f5393fff640 1 -- 172.21.15.90:0/74097055 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398035020 con 0x7f539403e7a0 2024-04-20T10:50:56.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f5393fff640 1 -- 172.21.15.90:0/74097055 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5398031810 con 0x7f539403e7a0 2024-04-20T10:50:56.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f854159a640 1 -- 172.21.15.90:0/314537555 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c006da0 con 0x7f852c004d40 2024-04-20T10:50:56.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f82c35b2640 1 -- 172.21.15.90:0/2054110814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc150c00 msgr2=0x7f82bc153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7f82c35b2640 1 --2- 172.21.15.90:0/2054110814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc150c00 0x7f82bc153fa0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f82b80097a0 tx=0x7f82b802b710 comp rx=0 tx=0).stop 2024-04-20T10:50:56.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.467+0000 7fa433bef640 1 -- 172.21.15.90:0/2590544625 wait complete. 2024-04-20T10:50:56.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f82c35b2640 1 -- 172.21.15.90:0/2054110814 shutdown_connections 2024-04-20T10:50:56.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f82c35b2640 1 --2- 172.21.15.90:0/2054110814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc06ca40 0x7f82bc0c3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f82c35b2640 1 --2- 172.21.15.90:0/2054110814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc150c00 0x7f82bc153fa0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f82c35b2640 1 -- 172.21.15.90:0/2054110814 >> 172.21.15.90:0/2054110814 conn(0x7f82bc0c9100 msgr2=0x7f82bc0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fdee4832640 1 Processor -- start 2024-04-20T10:50:56.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852c004d40 msgr2=0x7f852c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f8548a06640 1 --2- 172.21.15.90:0/314537555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f852c004d40 0x7f852c0051c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f853c0021f0 tx=0x7f852c005830 comp rx=0 tx=0).stop 2024-04-20T10:50:56.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f5393fff640 1 -- 172.21.15.90:0/74097055 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5398031be0 con 0x7f539403e7a0 2024-04-20T10:50:56.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4c274640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac44073360 0x7fac440c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fdee4832640 1 -- start start 2024-04-20T10:50:56.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fa433bef640 1 Processor -- start 2024-04-20T10:50:56.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fa433bef640 1 -- start start 2024-04-20T10:50:56.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 -- 172.21.15.90:0/74097055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 msgr2=0x7f539403eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 --2- 172.21.15.90:0/74097055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f539403eb80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802b8b0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe200b6070 con 0x7efe100051c0 2024-04-20T10:50:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe200b1480 con 0x7efe100051c0 2024-04-20T10:50:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.468+0000 7efe1effd640 1 -- 172.21.15.90:0/2601902919 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe20068860 con 0x7efe100051c0 2024-04-20T10:50:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4c274640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac440c3630 con 0x7fac440aac60 2024-04-20T10:50:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4c274640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac440c3070 con 0x7fac440ab040 2024-04-20T10:50:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4c274640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fac4406de40 con 0x7fac44073360 2024-04-20T10:50:56.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4980f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac44073360 0x7fac440c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 -- 172.21.15.90:0/74097055 shutdown_connections 2024-04-20T10:50:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4980f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fac44073360 0x7fac440c3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60070/0 (socket says 172.21.15.90:60070) 2024-04-20T10:50:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4a811640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fac440ab040 0x7fac440c6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39970/0 (socket says 172.21.15.90:39970) 2024-04-20T10:50:56.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 msgr2=0x7efe1000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fac4a811640 1 -- 172.21.15.90:0/1501333026 learned_addr learned my addr 172.21.15.90:0/1501333026 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:56.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7efe254c2640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe1000b9c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7efe20050210 tx=0x7efe10005830 comp rx=0 tx=0).stop 2024-04-20T10:50:56.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 --2- 172.21.15.90:0/74097055 >> v2:172.21.15.175:3300/0 conn(0x7f53940e2550 0x7f53940e29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7fa5aeca5640 1 Processor -- start 2024-04-20T10:50:56.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 shutdown_connections 2024-04-20T10:50:56.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7efe254c2640 1 --2- 172.21.15.90:0/2601902919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe1000b9c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 >> 172.21.15.90:0/2601902919 conn(0x7efe18049360 msgr2=0x7efe18049770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 --2- 172.21.15.90:0/74097055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f539403eb80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 -- 172.21.15.90:0/74097055 >> 172.21.15.90:0/74097055 conn(0x7f5394048250 msgr2=0x7f5394048660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa5aeca5640 1 -- start start 2024-04-20T10:50:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7f82c35b2640 1 -- 172.21.15.90:0/2054110814 shutdown_connections 2024-04-20T10:50:56.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 -- 172.21.15.90:0/74097055 shutdown_connections 2024-04-20T10:50:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.469+0000 7f53a33a4640 1 -- 172.21.15.90:0/74097055 wait complete. 2024-04-20T10:50:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fac4900e640 1 -- 172.21.15.90:0/1501333026 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3968385004 0 0) 0x7fac440c3070 con 0x7fac440ab040 2024-04-20T10:50:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa433bef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42400d7b0 0x7fa4240d8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fac4900e640 1 -- 172.21.15.90:0/1501333026 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac30003520 con 0x7fac440ab040 2024-04-20T10:50:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa433bef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa424040ed0 0x7fa4240d90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fac4980f640 1 -- 172.21.15.90:0/1501333026 >> v1:172.21.15.175:6789/0 conn(0x7fac440ab040 legacy=0x7fac440c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fac4980f640 1 -- 172.21.15.90:0/1501333026 >> v1:172.21.15.90:6789/0 conn(0x7fac440aac60 legacy=0x7fac440c6630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-20T10:50:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdee4832640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0070b20 0x7fdee015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa433bef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4240dbeb0 0x7fa424043700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fac4980f640 1 -- 172.21.15.90:0/1501333026 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac440c3350 con 0x7fac44073360 2024-04-20T10:50:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdee4832640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee00c64f0 0x7fdee015de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa433bef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa4240dc290 con 0x7fa424040ed0 2024-04-20T10:50:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa43198b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42400d7b0 0x7fa4240d8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdee4832640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdee0151390 0x7fdee00ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa433bef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa42400c090 con 0x7fa42400d7b0 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa43198b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42400d7b0 0x7fa4240d8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60084/0 (socket says 172.21.15.90:60084) 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa43198b640 1 -- 172.21.15.90:0/3714970803 learned_addr learned my addr 172.21.15.90:0/3714970803 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa433bef640 1 -- 172.21.15.90:0/3714970803 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa42400caf0 con 0x7fa4240dbeb0 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdee4832640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdee0151770 con 0x7fdee0151390 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdee4832640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdee00c4930 con 0x7fdee00c64f0 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdee4832640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdee01518f0 con 0x7fdee0070b20 2024-04-20T10:50:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7f8542d9d640 1 -- 172.21.15.90:0/314537555 reap_dead start 2024-04-20T10:50:56.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdede59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0070b20 0x7fdee015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdeddd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee00c64f0 0x7fdee015de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdeddd9b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee00c64f0 0x7fdee015de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60086/0 (socket says 172.21.15.90:60086) 2024-04-20T10:50:56.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdede59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0070b20 0x7fdee015d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37288/0 (socket says 172.21.15.90:37288) 2024-04-20T10:50:56.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fdeddd9b640 1 -- 172.21.15.90:0/708321705 learned_addr learned my addr 172.21.15.90:0/708321705 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 shutdown_connections 2024-04-20T10:50:56.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 >> 172.21.15.90:0/314537555 conn(0x7f85440aaa50 msgr2=0x7f85440aae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7fa43218c640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4240dbeb0 0x7fa424043700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 shutdown_connections 2024-04-20T10:50:56.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.470+0000 7f8548a06640 1 -- 172.21.15.90:0/314537555 wait complete. 2024-04-20T10:50:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa43198b640 1 -- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4240dbeb0 msgr2=0x7fa424043700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa43198b640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4240dbeb0 0x7fa424043700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa43198b640 1 -- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa424040ed0 msgr2=0x7fa4240d90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa43198b640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa424040ed0 0x7fa4240d90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 shutdown_connections 2024-04-20T10:50:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdede59c640 1 -- 172.21.15.90:0/708321705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee00c64f0 msgr2=0x7fdee015de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdede59c640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee00c64f0 0x7fdee015de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdede59c640 1 -- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdee0151390 msgr2=0x7fdee00ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa43198b640 1 -- 172.21.15.90:0/3714970803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4240d2c70 con 0x7fa42400d7b0 2024-04-20T10:50:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdede59c640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdee0151390 0x7fdee00ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdede59c640 1 -- 172.21.15.90:0/708321705 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee015c010 con 0x7fdee0070b20 2024-04-20T10:50:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7efe254c2640 1 -- 172.21.15.90:0/2601902919 wait complete. 2024-04-20T10:50:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7f82c35b2640 1 -- 172.21.15.90:0/2054110814 wait complete. 2024-04-20T10:50:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa5aeca5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00d7ad0 0x7fa5a0173270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa43198b640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42400d7b0 0x7fa4240d8b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c4b0 tx=0x7fa42800c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdede59c640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0070b20 0x7fdee015d0b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fded0033000 tx=0x7fded00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa41e7fc640 1 -- 172.21.15.90:0/3714970803 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428017070 con 0x7fa42400d7b0 2024-04-20T10:50:56.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fac4980f640 1 --2- 172.21.15.90:0/1501333026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440c3fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac340097a0 tx=0x7fac3402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5148046759139664 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa433bef640 1 -- 172.21.15.90:0/3714970803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa424042120 con 0x7fa42400d7b0 2024-04-20T10:50:56.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa5aeca5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5a00db800 0x7fa5a00c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa5aeca5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa5aeca5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a00dc1a0 con 0x7fa5a00e2c80 2024-04-20T10:50:56.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa5aeca5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5a00dacc0 con 0x7fa5a00d7ad0 2024-04-20T10:50:56.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa5aeca5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5a00d7eb0 con 0x7fa5a00db800 2024-04-20T10:50:56.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fa433bef640 1 -- 172.21.15.90:0/3714970803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4240db150 con 0x7fa42400d7b0 2024-04-20T10:50:56.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdeceffd640 1 -- 172.21.15.90:0/708321705 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0041070 con 0x7fdee0070b20 2024-04-20T10:50:56.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdeceffd640 1 -- 172.21.15.90:0/708321705 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fded003b430 con 0x7fdee0070b20 2024-04-20T10:50:56.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7fdeceffd640 1 -- 172.21.15.90:0/708321705 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded0035040 con 0x7fdee0070b20 2024-04-20T10:50:56.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee015c2f0 con 0x7fdee0070b20 2024-04-20T10:50:56.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee015c8b0 con 0x7fdee0070b20 2024-04-20T10:50:56.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00c8ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59050/0 (socket says 172.21.15.90:59050) 2024-04-20T10:50:56.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 -- 172.21.15.90:0/2206668014 learned_addr learned my addr 172.21.15.90:0/2206668014 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7f53a33a4640 1 Processor -- start 2024-04-20T10:50:56.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.471+0000 7f53a33a4640 1 -- start start 2024-04-20T10:50:56.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5aca41640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00d7ad0 0x7fa5a0173270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa41e7fc640 1 -- 172.21.15.90:0/3714970803 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa428005ce0 con 0x7fa42400d7b0 2024-04-20T10:50:56.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 -- 172.21.15.90:0/2206668014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5a00db800 msgr2=0x7fa5a00c8ab0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T10:50:56.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa41e7fc640 1 -- 172.21.15.90:0/3714970803 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa428007270 con 0x7fa42400d7b0 2024-04-20T10:50:56.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f8548a06640 1 Processor -- start 2024-04-20T10:50:56.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7efe254c2640 1 Processor -- start 2024-04-20T10:50:56.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7fac4900e640 1 -- 172.21.15.90:0/1501333026 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34038070 con 0x7fac44073360 2024-04-20T10:50:56.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f8548a06640 1 -- start start 2024-04-20T10:50:56.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7fac4900e640 1 -- 172.21.15.90:0/1501333026 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac34031700 con 0x7fac44073360 2024-04-20T10:50:56.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f82c35b2640 1 Processor -- start 2024-04-20T10:50:56.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f82c35b2640 1 -- start start 2024-04-20T10:50:56.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5a00db800 0x7fa5a00c8ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 -- 172.21.15.90:0/2206668014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00d7ad0 msgr2=0x7fa5a0173270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00d7ad0 0x7fa5a0173270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7fa5ad242640 1 -- 172.21.15.90:0/2206668014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5a00d2c50 con 0x7fa5a00e2c80 2024-04-20T10:50:56.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fdeceffd640 1 -- 172.21.15.90:0/708321705 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fded004c060 con 0x7fdee0070b20 2024-04-20T10:50:56.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fac4c274640 1 -- 172.21.15.90:0/1501333026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 msgr2=0x7fac440c3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fac4c274640 1 --2- 172.21.15.90:0/1501333026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440c3fe0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac340097a0 tx=0x7fac3402b7a0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8548a06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854406cd20 0x7f85441491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fac4900e640 1 -- 172.21.15.90:0/1501333026 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac34031ad0 con 0x7fac44073360 2024-04-20T10:50:56.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7efe254c2640 1 -- start start 2024-04-20T10:50:56.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe254c2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe180d6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8548a06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85441475a0 0x7f85441e89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fa433bef640 1 -- 172.21.15.90:0/3714970803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa414005290 con 0x7fa42400d7b0 2024-04-20T10:50:56.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8548a06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f854414bec0 0x7f85440acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7f53a33a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f5394044ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7f53a33a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940dfd90 0x7f53940d73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7f53a33a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53940e2550 0x7f53940d78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7f53a33a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f539400b9a0 con 0x7f53940dfd90 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7f53a33a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53940e2030 con 0x7f53940e2550 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.472+0000 7f53a33a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f539400bb20 con 0x7f539403e7a0 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f53a093f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940dfd90 0x7f53940d73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f53a093f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940dfd90 0x7f53940d73a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59064/0 (socket says 172.21.15.90:59064) 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f53a093f640 1 -- 172.21.15.90:0/3352060660 learned_addr learned my addr 172.21.15.90:0/3352060660 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.473+0000 7f53a093f640 1 -- 172.21.15.90:0/3352060660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 msgr2=0x7f5394044ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T10:50:56.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8548a06640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f854406ddb0 con 0x7f854406cd20 2024-04-20T10:50:56.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8548a06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85440c4a30 con 0x7f854414bec0 2024-04-20T10:50:56.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe254c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe1817d7c0 0x7efe18044c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe1ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe180d6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe1ffff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe180d6990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37316/0 (socket says 172.21.15.90:37316) 2024-04-20T10:50:56.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe1ffff640 1 -- 172.21.15.90:0/3978681466 learned_addr learned my addr 172.21.15.90:0/3978681466 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fac4c274640 1 -- 172.21.15.90:0/1501333026 shutdown_connections 2024-04-20T10:50:56.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fac4c274640 1 --2- 172.21.15.90:0/1501333026 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440c3fe0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe254c2640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe180d8320 0x7efe180451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fac4c274640 1 -- 172.21.15.90:0/1501333026 >> 172.21.15.90:0/1501333026 conn(0x7fac440c46b0 msgr2=0x7fac440c4a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fa5ad242640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00c8ff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80516a0 tx=0x7fa5a8069980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efe1800cb20 con 0x7efe1817d7c0 2024-04-20T10:50:56.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8542d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f854414bec0 0x7f85440acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efe18008c10 con 0x7efe180d8320 2024-04-20T10:50:56.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fa5a57fa640 1 -- 172.21.15.90:0/2206668014 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80b5050 con 0x7fa5a00e2c80 2024-04-20T10:50:56.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fa5a57fa640 1 -- 172.21.15.90:0/2206668014 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5a80b6040 con 0x7fa5a00e2c80 2024-04-20T10:50:56.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fa5a57fa640 1 -- 172.21.15.90:0/2206668014 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80bc650 con 0x7fa5a00e2c80 2024-04-20T10:50:56.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fac4c274640 1 -- 172.21.15.90:0/1501333026 shutdown_connections 2024-04-20T10:50:56.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efe1817d330 con 0x7efe100051c0 2024-04-20T10:50:56.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7efe24cc1640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe180d8320 0x7efe180451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7efe1f7fe640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe1817d7c0 0x7efe18044c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fac4c274640 1 -- 172.21.15.90:0/1501333026 wait complete. 2024-04-20T10:50:56.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5a00d3410 con 0x7fa5a00e2c80 2024-04-20T10:50:56.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5a00d2ef0 con 0x7fa5a00e2c80 2024-04-20T10:50:56.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7f53a093f640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f5394044ce0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7f53a093f640 1 -- 172.21.15.90:0/3352060660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53940e2550 msgr2=0x7f53940d78e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T10:50:56.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7f53a093f640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53940e2550 0x7f53940d78e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7f53a093f640 1 -- 172.21.15.90:0/3352060660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5394175320 con 0x7f53940dfd90 2024-04-20T10:50:56.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f82c35b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc06f330 0x7f82bc14aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7efe24cc1640 1 -- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 msgr2=0x7efe180d6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7f82c134e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc06f330 0x7f82bc14aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7efe24cc1640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe180d6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7efe24cc1640 1 -- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe1817d7c0 msgr2=0x7efe18044c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7f53a093f640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940dfd90 0x7f53940d73a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f539c050f60 tx=0x7f539c069700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7efe24cc1640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe1817d7c0 0x7efe18044c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7efe24cc1640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe18180a70 con 0x7efe180d8320 2024-04-20T10:50:56.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7efe1f7fe640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe1817d7c0 0x7efe18044c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8542d9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f854414bec0 0x7f85440acb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60100/0 (socket says 172.21.15.90:60100) 2024-04-20T10:50:56.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7efe24cc1640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe180d8320 0x7efe180451c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe20065840 tx=0x7efe2006a550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7f8542d9d640 1 -- 172.21.15.90:0/2168396863 learned_addr learned my addr 172.21.15.90:0/2168396863 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7f854259c640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854406cd20 0x7f85441491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f854406df30 con 0x7f85441475a0 2024-04-20T10:50:56.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f8541d9b640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85441475a0 0x7f85441e89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c134e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc06f330 0x7f82bc14aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59086/0 (socket says 172.21.15.90:59086) 2024-04-20T10:50:56.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c35b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc150c00 0x7f82bc1ec890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c35b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82bc1544e0 0x7f82bc146a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c35b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc06db60 con 0x7f82bc06f330 2024-04-20T10:50:56.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c35b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82bc06d1b0 con 0x7f82bc1544e0 2024-04-20T10:50:56.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c35b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82bc06dce0 con 0x7f82bc150c00 2024-04-20T10:50:56.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f5391ffb640 1 -- 172.21.15.90:0/3352060660 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c06bb30 con 0x7f53940dfd90 2024-04-20T10:50:56.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f5391ffb640 1 -- 172.21.15.90:0/3352060660 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f539c06bcf0 con 0x7f53940dfd90 2024-04-20T10:50:56.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f5391ffb640 1 -- 172.21.15.90:0/3352060660 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f539c069de0 con 0x7f53940dfd90 2024-04-20T10:50:56.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c134e640 1 -- 172.21.15.90:0/1843179770 learned_addr learned my addr 172.21.15.90:0/1843179770 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c0b4d640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc150c00 0x7f82bc1ec890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec4005290 con 0x7fdee0070b20 2024-04-20T10:50:56.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fdeceffd640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdec006c9c0 0x7fdec006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fdeceffd640 1 -- 172.21.15.90:0/708321705 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fded00adc60 con 0x7fdee0070b20 2024-04-20T10:50:56.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.474+0000 7fdeddd9b640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdec006c9c0 0x7fdec006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fdeddd9b640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdec006c9c0 0x7fdec006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fded8000b60 tx=0x7fded800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.475+0000 7fa41e7fc640 1 -- 172.21.15.90:0/3714970803 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa42801a070 con 0x7fa42400d7b0 2024-04-20T10:50:56.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7fa41e7fc640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa41006c8f0 0x7fa41006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7fa41e7fc640 1 -- 172.21.15.90:0/3714970803 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fa42808b060 con 0x7fa42400d7b0 2024-04-20T10:50:56.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f8542d9d640 1 -- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85441475a0 msgr2=0x7f85441e89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7fa43118a640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa41006c8f0 0x7fa41006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f8542d9d640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85441475a0 0x7f85441e89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f8542d9d640 1 -- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854406cd20 msgr2=0x7f85441491d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f8542d9d640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854406cd20 0x7f85441491d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f8542d9d640 1 -- 172.21.15.90:0/2168396863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85441ec4d0 con 0x7f854414bec0 2024-04-20T10:50:56.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7f854259c640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854406cd20 0x7f85441491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c1b4f640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82bc1544e0 0x7f82bc146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7fac4c274640 1 Processor -- start 2024-04-20T10:50:56.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c134e640 1 -- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc150c00 msgr2=0x7f82bc1ec890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c134e640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc150c00 0x7f82bc1ec890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c134e640 1 -- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82bc1544e0 msgr2=0x7f82bc146a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c134e640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82bc1544e0 0x7f82bc146a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f82c134e640 1 -- 172.21.15.90:0/1843179770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82bc14cd30 con 0x7f82bc06f330 2024-04-20T10:50:56.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7f82c1b4f640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82bc1544e0 0x7f82bc146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:56.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7fac4c274640 1 -- start start 2024-04-20T10:50:56.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7f8541d9b640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85441475a0 0x7f85441e89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:56.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5a0005390 con 0x7fa5a00e2c80 2024-04-20T10:50:56.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7fa5a57fa640 1 -- 172.21.15.90:0/2206668014 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5a80c3030 con 0x7fa5a00e2c80 2024-04-20T10:50:56.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7f8542d9d640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f854414bec0 0x7f85440acb90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f853c034f20 tx=0x7f85441532a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5394178840 con 0x7f53940dfd90 2024-04-20T10:50:56.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.476+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5394174840 con 0x7f53940dfd90 2024-04-20T10:50:56.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7fa5a57fa640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa58c06c9f0 0x7fa58c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7fa5a57fa640 1 -- 172.21.15.90:0/2206668014 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fa5a8129ec0 con 0x7fa5a00e2c80 2024-04-20T10:50:56.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7fa5aca41640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa58c06c9f0 0x7fa58c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7fa43118a640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa41006c8f0 0x7fa41006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa420035000 tx=0x7fa420030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.477+0000 7f82c134e640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc06f330 0x7f82bc14aea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f82b80098c0 tx=0x7f82b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fa5aca41640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa58c06c9f0 0x7fa58c06eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa59c007fd0 tx=0x7fa59c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4c274640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4c274640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440aac60 0x7fac441f95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5394005390 con 0x7f53940dfd90 2024-04-20T10:50:56.548 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4c274640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac440ab040 0x7fac441f9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4c274640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac440c5e30 con 0x7fac440ab040 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4c274640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac440ab4d0 con 0x7fac44073360 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4c274640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fac440c6110 con 0x7fac440aac60 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4980f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440aac60 0x7fac441f95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4a010640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4980f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440aac60 0x7fac441f95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37342/0 (socket says 172.21.15.90:37342) 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4980f640 1 -- 172.21.15.90:0/594253771 learned_addr learned my addr 172.21.15.90:0/594253771 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.478+0000 7fac4a811640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac440ab040 0x7fac441f9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.549 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7f5391ffb640 1 -- 172.21.15.90:0/3352060660 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f539c069f80 con 0x7f53940dfd90 2024-04-20T10:50:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4a811640 1 -- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440aac60 msgr2=0x7fac441f95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4a811640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440aac60 0x7fac441f95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4a811640 1 -- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 msgr2=0x7fac440a8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4a811640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440a8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4a811640 1 -- 172.21.15.90:0/594253771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac440703f0 con 0x7fac440ab040 2024-04-20T10:50:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4980f640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440aac60 0x7fac441f95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4a010640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440a8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:50:56.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7fac4a811640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac440ab040 0x7fac441f9af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00ca70 tx=0x7fac3c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7f5391ffb640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f538006c9c0 0x7f538006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7f5391ffb640 1 -- 172.21.15.90:0/3352060660 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f539c107e90 con 0x7f53940dfd90 2024-04-20T10:50:56.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.479+0000 7f53a1140640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f538006c9c0 0x7f538006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.480+0000 7f53a1140640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f538006c9c0 0x7f538006ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5398036000 tx=0x7f5398008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.482+0000 7fac3affd640 1 -- 172.21.15.90:0/594253771 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c017070 con 0x7fac440ab040 2024-04-20T10:50:56.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.482+0000 7f82b1ffb640 1 -- 172.21.15.90:0/1843179770 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8041020 con 0x7f82bc06f330 2024-04-20T10:50:56.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.482+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac440706d0 con 0x7fac440ab040 2024-04-20T10:50:56.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.482+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82bc1ec0b0 con 0x7f82bc06f330 2024-04-20T10:50:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.482+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac441fd450 con 0x7fac440ab040 2024-04-20T10:50:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.482+0000 7fa5a57fa640 1 -- 172.21.15.90:0/2206668014 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa5a80ca020 con 0x7fa5a00e2c80 2024-04-20T10:50:56.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.483+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82bc0ac7d0 con 0x7f82bc06f330 2024-04-20T10:50:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.483+0000 7fdeceffd640 1 -- 172.21.15.90:0/708321705 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fded007be10 con 0x7fdee0070b20 2024-04-20T10:50:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.483+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac4406a060 con 0x7fac440ab040 2024-04-20T10:50:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.484+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82bc076150 con 0x7f82bc06f330 2024-04-20T10:50:56.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.484+0000 7f8532ffd640 1 -- 172.21.15.90:0/2168396863 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c0039a0 con 0x7f854414bec0 2024-04-20T10:50:56.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7f8532ffd640 1 -- 172.21.15.90:0/2168396863 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f853c003b40 con 0x7f854414bec0 2024-04-20T10:50:56.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7efe1cff9640 1 -- 172.21.15.90:0/3978681466 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe200b6040 con 0x7efe180d8320 2024-04-20T10:50:56.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7efe1cff9640 1 -- 172.21.15.90:0/3978681466 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe200b1840 con 0x7efe180d8320 2024-04-20T10:50:56.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7efe1cff9640 1 -- 172.21.15.90:0/3978681466 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe200b1bf0 con 0x7efe180d8320 2024-04-20T10:50:56.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe18180d50 con 0x7efe180d8320 2024-04-20T10:50:56.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7f8532ffd640 1 -- 172.21.15.90:0/2168396863 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c003cf0 con 0x7f854414bec0 2024-04-20T10:50:56.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85441ec1f0 con 0x7f854414bec0 2024-04-20T10:50:56.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85441e8480 con 0x7f854414bec0 2024-04-20T10:50:56.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.485+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1817cfc0 con 0x7efe180d8320 2024-04-20T10:50:56.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.486+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85441e8680 con 0x7f854414bec0 2024-04-20T10:50:56.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.486+0000 7fa41e7fc640 1 -- 172.21.15.90:0/3714970803 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa428058b00 con 0x7fa42400d7b0 2024-04-20T10:50:56.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.487+0000 7efe1cff9640 1 -- 172.21.15.90:0/3978681466 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe200c6060 con 0x7efe180d8320 2024-04-20T10:50:56.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.487+0000 7f8532ffd640 1 -- 172.21.15.90:0/2168396863 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f853c04d020 con 0x7f854414bec0 2024-04-20T10:50:56.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.487+0000 7f8532ffd640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f852406c920 0x7f852406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.487+0000 7efe1cff9640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe0406c970 0x7efe0406ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.487+0000 7f8532ffd640 1 -- 172.21.15.90:0/2168396863 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f853c0b5e00 con 0x7f854414bec0 2024-04-20T10:50:56.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.488+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe00005290 con 0x7efe180d8320 2024-04-20T10:50:56.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.488+0000 7f854259c640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f852406c920 0x7f852406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.488+0000 7efe1ffff640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe0406c970 0x7efe0406ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.488+0000 7f854259c640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f852406c920 0x7f852406ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8534004840 tx=0x7f85340011b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.488+0000 7efe1cff9640 1 -- 172.21.15.90:0/3978681466 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7efe20128df0 con 0x7efe180d8320 2024-04-20T10:50:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.489+0000 7efe1ffff640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe0406c970 0x7efe0406ee30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe180d5010 tx=0x7efe0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.490+0000 7fac3affd640 1 -- 172.21.15.90:0/594253771 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac3c00ab70 con 0x7fac440ab040 2024-04-20T10:50:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.490+0000 7fac3affd640 1 -- 172.21.15.90:0/594253771 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3c021060 con 0x7fac440ab040 2024-04-20T10:50:56.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.490+0000 7f5391ffb640 1 -- 172.21.15.90:0/3352060660 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f539c0d6000 con 0x7f53940dfd90 2024-04-20T10:50:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.490+0000 7f82b1ffb640 1 -- 172.21.15.90:0/1843179770 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82b8030710 con 0x7f82bc06f330 2024-04-20T10:50:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.490+0000 7f82b1ffb640 1 -- 172.21.15.90:0/1843179770 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82b8037040 con 0x7f82bc06f330 2024-04-20T10:50:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.492+0000 7f8532ffd640 1 -- 172.21.15.90:0/2168396863 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f85441e8680 con 0x7f854414bec0 2024-04-20T10:50:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.493+0000 7f82b1ffb640 1 -- 172.21.15.90:0/1843179770 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f82b8044020 con 0x7f82bc06f330 2024-04-20T10:50:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.493+0000 7f82b1ffb640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.493+0000 7f82b1ffb640 1 -- 172.21.15.90:0/1843179770 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f82b80add40 con 0x7f82bc06f330 2024-04-20T10:50:56.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.493+0000 7fac3affd640 1 -- 172.21.15.90:0/594253771 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac3c01a070 con 0x7fac440ab040 2024-04-20T10:50:56.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.493+0000 7fac3affd640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac2806c8f0 0x7fac2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:56.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.493+0000 7fac3affd640 1 -- 172.21.15.90:0/594253771 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fac3c08bf50 con 0x7fac440ab040 2024-04-20T10:50:56.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.494+0000 7f82c0b4d640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.494+0000 7fac4a010640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac2806c8f0 0x7fac2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.495+0000 7fac4a010640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac2806c8f0 0x7fac2806edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac40009d00 tx=0x7fac40009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.495+0000 7f82c0b4d640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f82a006c8f0 0x7f82a006edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0c8f50 tx=0x7f82b400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:56.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.498+0000 7efe1cff9640 1 -- 172.21.15.90:0/3978681466 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7efe200f6910 con 0x7efe180d8320 2024-04-20T10:50:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.502+0000 7f82b1ffb640 1 -- 172.21.15.90:0/1843179770 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f82b804b030 con 0x7f82bc06f330 2024-04-20T10:50:56.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.511+0000 7fac3affd640 1 -- 172.21.15.90:0/594253771 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fac4406a060 con 0x7fac440ab040 2024-04-20T10:50:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.908+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdec4005580 con 0x7fdee0070b20 2024-04-20T10:50:56.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.909+0000 7fdeceffd640 1 -- 172.21.15.90:0/708321705 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fded007b710 con 0x7fdee0070b20 2024-04-20T10:50:56.910 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:56.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.911+0000 7fa433bef640 1 -- 172.21.15.90:0/3714970803 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa414005580 con 0x7fa42400d7b0 2024-04-20T10:50:56.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.911+0000 7fa41e7fc640 1 -- 172.21.15.90:0/3714970803 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa42805ce00 con 0x7fa42400d7b0 2024-04-20T10:50:56.912 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.912+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdec006c9c0 msgr2=0x7fdec006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.912+0000 7fdee4832640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdec006c9c0 0x7fdec006ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fded8000b60 tx=0x7fded800b040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.912+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fa5a00d30c0 con 0x7fa5a00e2c80 2024-04-20T10:50:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.912+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0070b20 msgr2=0x7fdee015d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.912+0000 7fdee4832640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0070b20 0x7fdee015d0b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fded0033000 tx=0x7fded00046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.912+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 shutdown_connections 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fdee4832640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdec006c9c0 0x7fdec006ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fdee4832640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdee0151390 0x7fdee00ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fdee4832640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdee00c64f0 0x7fdee015de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fdee4832640 1 --2- 172.21.15.90:0/708321705 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdee0070b20 0x7fdee015d0b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 >> 172.21.15.90:0/708321705 conn(0x7fdee00c9ec0 msgr2=0x7fdee00af950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 shutdown_connections 2024-04-20T10:50:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fa5a57fa640 1 -- 172.21.15.90:0/2206668014 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa5a80f8030 con 0x7fa5a00e2c80 2024-04-20T10:50:56.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.913+0000 7fdee4832640 1 -- 172.21.15.90:0/708321705 wait complete. 2024-04-20T10:50:56.916 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 -- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa41006c8f0 msgr2=0x7fa41006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa41006c8f0 0x7fa41006edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa420035000 tx=0x7fa420030000 comp rx=0 tx=0).stop 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 -- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42400d7b0 msgr2=0x7fa4240d8b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42400d7b0 0x7fa4240d8b80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa42800c4b0 tx=0x7fa42800c970 comp rx=0 tx=0).stop 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 -- 172.21.15.90:0/3714970803 shutdown_connections 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa41006c8f0 0x7fa41006edb0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa4240dbeb0 0x7fa424043700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa424040ed0 0x7fa4240d90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 --2- 172.21.15.90:0/3714970803 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa42400d7b0 0x7fa4240d8b80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 -- 172.21.15.90:0/3714970803 >> 172.21.15.90:0/3714970803 conn(0x7fa42402f4b0 msgr2=0x7fa4240de780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 -- 172.21.15.90:0/3714970803 shutdown_connections 2024-04-20T10:50:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.915+0000 7fa40ffff640 1 -- 172.21.15.90:0/3714970803 wait complete. 2024-04-20T10:50:56.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.916+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa58c06c9f0 msgr2=0x7fa58c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.916+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa58c06c9f0 0x7fa58c06eeb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa59c007fd0 tx=0x7fa59c009040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5a00e2c80 msgr2=0x7fa5a00c8ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00c8ff0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80516a0 tx=0x7fa5a8069980 comp rx=0 tx=0).stop 2024-04-20T10:50:56.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 shutdown_connections 2024-04-20T10:50:56.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f5394007430 con 0x7f53940dfd90 2024-04-20T10:50:56.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa58c06c9f0 0x7fa58c06eeb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5a00e2c80 0x7fa5a00c8ff0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5a00db800 0x7fa5a00c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 --2- 172.21.15.90:0/2206668014 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5a00d7ad0 0x7fa5a0173270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 >> 172.21.15.90:0/2206668014 conn(0x7fa5a0005e90 msgr2=0x7fa5a00cb700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 shutdown_connections 2024-04-20T10:50:56.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.917+0000 7fa5aeca5640 1 -- 172.21.15.90:0/2206668014 wait complete. 2024-04-20T10:50:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.918+0000 7f5391ffb640 1 -- 172.21.15.90:0/3352060660 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f539c0d5900 con 0x7f53940dfd90 2024-04-20T10:50:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.918+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f8544068c20 con 0x7f854414bec0 2024-04-20T10:50:56.921 INFO:teuthology.orchestra.run.smithi090.stdout:55834574854 2024-04-20T10:50:56.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.918+0000 7f8532ffd640 1 -- 172.21.15.90:0/2168396863 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f853c083810 con 0x7f854414bec0 2024-04-20T10:50:56.922 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.921+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f538006c9c0 msgr2=0x7f538006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.922+0000 7f53a33a4640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f538006c9c0 0x7f538006ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5398036000 tx=0x7f5398008030 comp rx=0 tx=0).stop 2024-04-20T10:50:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.922+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940dfd90 msgr2=0x7f53940d73a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.922+0000 7f53a33a4640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940dfd90 0x7f53940d73a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f539c050f60 tx=0x7f539c069700 comp rx=0 tx=0).stop 2024-04-20T10:50:56.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.922+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f852406c920 msgr2=0x7f852406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.922+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 shutdown_connections 2024-04-20T10:50:56.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.922+0000 7f8548a06640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f852406c920 0x7f852406ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8534004840 tx=0x7f85340011b0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f53a33a4640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f538006c9c0 0x7f538006ee80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7efe00005580 con 0x7efe180d8320 2024-04-20T10:50:56.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f854414bec0 msgr2=0x7f85440acb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.925 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f854414bec0 0x7f85440acb90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f853c034f20 tx=0x7f85441532a0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f53a33a4640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53940e2550 0x7f53940d78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 shutdown_connections 2024-04-20T10:50:56.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f53a33a4640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53940dfd90 0x7f53940d73a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f852406c920 0x7f852406ede0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f854414bec0 0x7f85440acb90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85441475a0 0x7f85441e89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 --2- 172.21.15.90:0/2168396863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f854406cd20 0x7f85441491d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 >> 172.21.15.90:0/2168396863 conn(0x7f85440aaa50 msgr2=0x7f8544151960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f53a33a4640 1 --2- 172.21.15.90:0/3352060660 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f539403e7a0 0x7f5394044ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 >> 172.21.15.90:0/3352060660 conn(0x7f5394048250 msgr2=0x7f5394049e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 shutdown_connections 2024-04-20T10:50:56.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7f8548a06640 1 -- 172.21.15.90:0/2168396863 wait complete. 2024-04-20T10:50:56.928 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2024-04-20T10:50:56.928 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.923+0000 7efe1cff9640 1 -- 172.21.15.90:0/3978681466 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe200fac10 con 0x7efe180d8320 2024-04-20T10:50:56.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.924+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 shutdown_connections 2024-04-20T10:50:56.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.924+0000 7f53a33a4640 1 -- 172.21.15.90:0/3352060660 wait complete. 2024-04-20T10:50:56.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.925+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f82bc072170 con 0x7f82bc06f330 2024-04-20T10:50:56.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.926+0000 7f82b1ffb640 1 -- 172.21.15.90:0/1843179770 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f82bc072170 con 0x7f82bc06f330 2024-04-20T10:50:56.930 INFO:teuthology.orchestra.run.smithi090.stdout:55834574855 2024-04-20T10:50:56.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe0406c970 msgr2=0x7efe0406ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe0406c970 0x7efe0406ee30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efe180d5010 tx=0x7efe0c009040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe180d8320 msgr2=0x7efe180451c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe180d8320 0x7efe180451c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe20065840 tx=0x7efe2006a550 comp rx=0 tx=0).stop 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 shutdown_connections 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe0406c970 0x7efe0406ee30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efe180d8320 0x7efe180451c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efe1817d7c0 0x7efe18044c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 --2- 172.21.15.90:0/3978681466 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efe100051c0 0x7efe180d6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.927+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 >> 172.21.15.90:0/3978681466 conn(0x7efe18049360 msgr2=0x7efe1804b440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.928+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 shutdown_connections 2024-04-20T10:50:56.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.928+0000 7efe254c2640 1 -- 172.21.15.90:0/3978681466 wait complete. 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.930+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f82a006c8f0 msgr2=0x7f82a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.930+0000 7f82c35b2640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f82a006c8f0 0x7f82a006edb0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f82bc0c8f50 tx=0x7f82b400b040 comp rx=0 tx=0).stop 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc06f330 msgr2=0x7f82bc14aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc06f330 0x7f82bc14aea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f82b80098c0 tx=0x7f82b80046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 shutdown_connections 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f82a006c8f0 0x7f82a006edb0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82bc1544e0 0x7f82bc146a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82bc150c00 0x7f82bc1ec890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 --2- 172.21.15.90:0/1843179770 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82bc06f330 0x7f82bc14aea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 >> 172.21.15.90:0/1843179770 conn(0x7f82bc0c9100 msgr2=0x7f82bc0c48c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 shutdown_connections 2024-04-20T10:50:56.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.931+0000 7f82c35b2640 1 -- 172.21.15.90:0/1843179770 wait complete. 2024-04-20T10:50:56.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.935+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fac44076070 con 0x7fac440ab040 2024-04-20T10:50:56.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2024-04-20T10:50:56.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.936+0000 7fac3affd640 1 -- 172.21.15.90:0/594253771 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fac3c059a70 con 0x7fac440ab040 2024-04-20T10:50:56.938 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:56.939 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-20T10:50:56.940 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2024-04-20T10:50:56.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac2806c8f0 msgr2=0x7fac2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac2806c8f0 0x7fac2806edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fac40009d00 tx=0x7fac40009060 comp rx=0 tx=0).stop 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac440ab040 msgr2=0x7fac441f9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac440ab040 0x7fac441f9af0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00ca70 tx=0x7fac3c00cf30 comp rx=0 tx=0).stop 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 shutdown_connections 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac2806c8f0 0x7fac2806edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac440ab040 0x7fac441f9af0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac440aac60 0x7fac441f95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 --2- 172.21.15.90:0/594253771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac44073360 0x7fac440a8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 >> 172.21.15.90:0/594253771 conn(0x7fac440c46b0 msgr2=0x7fac440c1750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.940+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 shutdown_connections 2024-04-20T10:50:56.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:56.941+0000 7fac4c274640 1 -- 172.21.15.90:0/594253771 wait complete. 2024-04-20T10:50:56.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2024-04-20T10:50:56.947 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-04-20T10:50:56.949 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.6 2024-04-20T10:50:56.951 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2024-04-20T10:50:56.955 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.4 2024-04-20T10:50:57.938 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-20T10:50:57.939 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-20T10:50:57.940 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-20T10:50:57.947 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-20T10:50:57.948 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-20T10:50:57.949 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-20T10:50:57.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-20T10:50:57.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-20T10:50:58.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.097+0000 7f02f9ee0640 1 Processor -- start 2024-04-20T10:50:58.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.097+0000 7f02f9ee0640 1 -- start start 2024-04-20T10:50:58.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.098+0000 7f02f9ee0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02f4073420 0x7f02f406e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.098+0000 7f02f9ee0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f415bba0 0x7f02f40ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.098+0000 7f02f9ee0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02f40c42a0 con 0x7f02f40aa780 2024-04-20T10:50:58.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.098+0000 7f02f9ee0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f02f40acae0 con 0x7f02f4073420 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.098+0000 7f02f9ee0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02f40c4860 con 0x7f02f415bba0 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02f4073420 0x7f02f406e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f02f4073420 0x7f02f406e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60138/0 (socket says 172.21.15.90:60138) 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f37fe640 1 -- 172.21.15.90:0/3715787373 learned_addr learned my addr 172.21.15.90:0/3715787373 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f3fff640 1 --2- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f415bba0 0x7f02f40ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f27fc640 1 -- 172.21.15.90:0/3715787373 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3959131107 0 0) 0x7f02f40c42a0 con 0x7f02f40aa780 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f27fc640 1 -- 172.21.15.90:0/3715787373 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02dc003520 con 0x7f02f40aa780 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f37fe640 1 -- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f415bba0 msgr2=0x7f02f40ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f37fe640 1 --2- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f415bba0 0x7f02f40ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f37fe640 1 -- 172.21.15.90:0/3715787373 >> v1:172.21.15.175:6789/0 conn(0x7f02f40aa780 legacy=0x7f02f415b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.099+0000 7f02f37fe640 1 -- 172.21.15.90:0/3715787373 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f40c4580 con 0x7f02f4073420 2024-04-20T10:50:58.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.100+0000 7f02f37fe640 1 --2- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 0x7f02f406e200 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009e50 tx=0x7f02ec02bf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c6d0341a02f2ce5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.101+0000 7f02f27fc640 1 -- 172.21.15.90:0/3715787373 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec02caa0 con 0x7f02f4073420 2024-04-20T10:50:58.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.101+0000 7f02f27fc640 1 -- 172.21.15.90:0/3715787373 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02ec02cc40 con 0x7f02f4073420 2024-04-20T10:50:58.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.101+0000 7f02f27fc640 1 -- 172.21.15.90:0/3715787373 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02ec034610 con 0x7f02f4073420 2024-04-20T10:50:58.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7f02f9ee0640 1 -- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 msgr2=0x7f02f406e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7f02f9ee0640 1 --2- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 0x7f02f406e200 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f02ec009e50 tx=0x7f02ec02bf00 comp rx=0 tx=0).stop 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.100+0000 7fc489e81640 1 Processor -- start 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.100+0000 7fc489e81640 1 -- start start 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc489e81640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4840c6ab0 0x7fc4840c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc489e81640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc4840ca030 0x7fc48415ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc489e81640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4840ca9b0 con 0x7fc48415b370 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc489e81640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc4840c8b40 con 0x7fc4840ca030 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc489e81640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc48415f030 con 0x7fc4840c6ab0 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc483fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc48415b370 0x7fc48406c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:39996/0 (socket says 172.21.15.90:39996) 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc483fff640 1 -- 172.21.15.90:0/1735752437 learned_addr learned my addr 172.21.15.90:0/1735752437 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:58.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc4837fe640 1 --2- 172.21.15.90:0/1735752437 >> v2:172.21.15.175:3300/0 conn(0x7fc4840c6ab0 0x7fc4840c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc482ffd640 1 --2- 172.21.15.90:0/1735752437 >> v2:172.21.15.90:3300/0 conn(0x7fc4840ca030 0x7fc48415ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc4837fe640 1 -- 172.21.15.90:0/1735752437 >> v2:172.21.15.90:3300/0 conn(0x7fc4840ca030 msgr2=0x7fc48415ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc4837fe640 1 --2- 172.21.15.90:0/1735752437 >> v2:172.21.15.90:3300/0 conn(0x7fc4840ca030 0x7fc48415ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc4837fe640 1 -- 172.21.15.90:0/1735752437 >> v1:172.21.15.175:6789/0 conn(0x7fc48415b370 legacy=0x7fc48406c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.103+0000 7fc4837fe640 1 -- 172.21.15.90:0/1735752437 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4840c8d90 con 0x7fc4840c6ab0 2024-04-20T10:50:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.102+0000 7fc4827fc640 1 -- 172.21.15.90:0/1735752437 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3100376298 0 0) 0x7fc4840ca9b0 con 0x7fc48415b370 2024-04-20T10:50:58.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.103+0000 7fc482ffd640 1 --2- 172.21.15.90:0/1735752437 >> v2:172.21.15.90:3300/0 conn(0x7fc4840ca030 0x7fc48415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:58.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.103+0000 7f8940c77640 1 Processor -- start 2024-04-20T10:50:58.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.103+0000 7f02f9ee0640 1 -- 172.21.15.90:0/3715787373 shutdown_connections 2024-04-20T10:50:58.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.103+0000 7f02f9ee0640 1 --2- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f415bba0 0x7f02f40ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.103+0000 7f02f9ee0640 1 --2- 172.21.15.90:0/3715787373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 0x7f02f406e200 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.103+0000 7f02f9ee0640 1 -- 172.21.15.90:0/3715787373 >> 172.21.15.90:0/3715787373 conn(0x7f02f40c8080 msgr2=0x7f02f40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.104+0000 7f8940c77640 1 -- start start 2024-04-20T10:50:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.104+0000 7fc4837fe640 1 --2- 172.21.15.90:0/1735752437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4840c6ab0 0x7fc4840c6e90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc484073030 tx=0x7fc47802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d1eab741c9c99e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.104+0000 7f02f9ee0640 1 -- 172.21.15.90:0/3715787373 shutdown_connections 2024-04-20T10:50:58.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.104+0000 7fc4827fc640 1 -- 172.21.15.90:0/1735752437 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4780315a0 con 0x7fc4840c6ab0 2024-04-20T10:50:58.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.104+0000 7fc4827fc640 1 -- 172.21.15.90:0/1735752437 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc478037070 con 0x7fc4840c6ab0 2024-04-20T10:50:58.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.104+0000 7fc4827fc640 1 -- 172.21.15.90:0/1735752437 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4780315a0 con 0x7fc4840c6ab0 2024-04-20T10:50:58.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.104+0000 7f02f9ee0640 1 -- 172.21.15.90:0/3715787373 wait complete. 2024-04-20T10:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.105+0000 7f8940c77640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f893c0c9ee0 0x7f893c156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.105+0000 7f8940c77640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893c15a720 con 0x7f893c0ab730 2024-04-20T10:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.105+0000 7f893a59c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f893c153ef0 0x7f893c0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:40004/0 (socket says 172.21.15.90:40004) 2024-04-20T10:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.105+0000 7f893a59c640 1 -- 172.21.15.90:0/2503707305 learned_addr learned my addr 172.21.15.90:0/2503707305 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.105+0000 7f893ad9d640 1 --2- 172.21.15.90:0/2503707305 >> v2:172.21.15.175:3300/0 conn(0x7f893c0c9ee0 0x7f893c156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7f8940c77640 1 -- 172.21.15.90:0/2503707305 --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f893c15ac80 con 0x7f893c153ef0 2024-04-20T10:50:58.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7f8940c77640 1 -- 172.21.15.90:0/2503707305 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f893c15a9a0 con 0x7f893c0c9ee0 2024-04-20T10:50:58.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7fc489e81640 1 -- 172.21.15.90:0/1735752437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4840c6ab0 msgr2=0x7fc4840c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7fc489e81640 1 --2- 172.21.15.90:0/1735752437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4840c6ab0 0x7fc4840c6e90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc484073030 tx=0x7fc47802b840 comp rx=0 tx=0).stop 2024-04-20T10:50:58.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7f02f9ee0640 1 Processor -- start 2024-04-20T10:50:58.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602285943 0 0) 0x7f893c15ac80 con 0x7f893c153ef0 2024-04-20T10:50:58.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8928003520 con 0x7f893c153ef0 2024-04-20T10:50:58.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7fc489e81640 1 -- 172.21.15.90:0/1735752437 shutdown_connections 2024-04-20T10:50:58.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7fc489e81640 1 --2- 172.21.15.90:0/1735752437 >> v2:172.21.15.90:3300/0 conn(0x7fc4840ca030 0x7fc48415ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7fc489e81640 1 --2- 172.21.15.90:0/1735752437 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4840c6ab0 0x7fc4840c6e90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7fc489e81640 1 -- 172.21.15.90:0/1735752437 >> 172.21.15.90:0/1735752437 conn(0x7fc4840ade20 msgr2=0x7fc4840ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7fc489e81640 1 -- 172.21.15.90:0/1735752437 shutdown_connections 2024-04-20T10:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7fc489e81640 1 -- 172.21.15.90:0/1735752437 wait complete. 2024-04-20T10:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 737574926 0 0) 0x7f8924001110 con 0x7f893c0ab730 2024-04-20T10:50:58.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f893c15ac80 con 0x7f893c0ab730 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1449682131 0 0) 0x7f893c15ac80 con 0x7f893c0ab730 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 >> v2:172.21.15.175:3300/0 conn(0x7f893c0c9ee0 msgr2=0x7f893c156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 --2- 172.21.15.90:0/2503707305 >> v2:172.21.15.175:3300/0 conn(0x7f893c0c9ee0 0x7f893c156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 >> v1:172.21.15.175:6789/0 conn(0x7f893c153ef0 legacy=0x7f893c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c0c6a90 con 0x7f893c0ab730 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f8924001820 con 0x7f893c0ab730 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 >> v1:172.21.15.90:6789/0 conn(0x7f893c0ab730 legacy=0x7f893c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8928003b80 0x7f8928003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f8928004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8928005260 0x7f892800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f893c15a9a0 con 0x7f8928003b80 2024-04-20T10:50:58.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f892800c1b0 con 0x7f8928004800 2024-04-20T10:50:58.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f892800c3b0 con 0x7f8928005260 2024-04-20T10:50:58.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.106+0000 7f02f9ee0640 1 -- start start 2024-04-20T10:50:58.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f02f9ee0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 0x7f02f415cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f02f9ee0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f40aa780 0x7f02f40c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f02f9ee0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02f415c1a0 0x7f02f41f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f02f9ee0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f02f40ac2e0 con 0x7f02f415c1a0 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f02f9ee0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f02f40ac650 con 0x7f02f4073420 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.107+0000 7f02f9ee0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f02f4073800 con 0x7f02f40aa780 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f40aa780 0x7f02f40c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f40aa780 0x7f02f40c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37376/0 (socket says 172.21.15.90:37376) 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 -- 172.21.15.90:0/1396442423 learned_addr learned my addr 172.21.15.90:0/1396442423 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f3fff640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02f415c1a0 0x7f02f41f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 -- 172.21.15.90:0/1396442423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 msgr2=0x7f02f415cf00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 0x7f02f415cf00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 -- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02f415c1a0 msgr2=0x7f02f41f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02f415c1a0 0x7f02f41f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f02f2ffd640 1 -- 172.21.15.90:0/1396442423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f40bd9b0 con 0x7f02f40aa780 2024-04-20T10:50:58.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f02f2ffd640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f40aa780 0x7f02f40c6ac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c450 tx=0x7f02e400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f02dbfff640 1 -- 172.21.15.90:0/1396442423 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e40052d0 con 0x7f02f40aa780 2024-04-20T10:50:58.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f02f9ee0640 1 -- 172.21.15.90:0/1396442423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f415d440 con 0x7f02f40aa780 2024-04-20T10:50:58.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f02f9ee0640 1 -- 172.21.15.90:0/1396442423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f41f3b90 con 0x7f02f40aa780 2024-04-20T10:50:58.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.110+0000 7f02dbfff640 1 -- 172.21.15.90:0/1396442423 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02e4005470 con 0x7f02f40aa780 2024-04-20T10:50:58.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7f02dbfff640 1 -- 172.21.15.90:0/1396442423 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02e4012830 con 0x7f02f40aa780 2024-04-20T10:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7fc489e81640 1 Processor -- start 2024-04-20T10:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.110+0000 7fc489e81640 1 -- start start 2024-04-20T10:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc489e81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4840c6ab0 0x7fc484153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc489e81640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840ca030 0x7fc48415d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc489e81640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48415b370 0x7fc48415c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc489e81640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc48415ec50 con 0x7fc4840c6ab0 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc489e81640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840c9350 con 0x7fc48415b370 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc489e81640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc48415edd0 con 0x7fc4840ca030 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc483fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48415b370 0x7fc48415c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc4837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4840c6ab0 0x7fc484153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc483fff640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48415b370 0x7fc48415c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60182/0 (socket says 172.21.15.90:60182) 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc483fff640 1 -- 172.21.15.90:0/2359097918 learned_addr learned my addr 172.21.15.90:0/2359097918 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc482ffd640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840ca030 0x7fc48415d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc482ffd640 1 -- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48415b370 msgr2=0x7fc48415c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.111+0000 7fc482ffd640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48415b370 0x7fc48415c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.112+0000 7fc482ffd640 1 -- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4840c6ab0 msgr2=0x7fc484153c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.112+0000 7fc482ffd640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4840c6ab0 0x7fc484153c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.112+0000 7fc482ffd640 1 -- 172.21.15.90:0/2359097918 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48412ce30 con 0x7fc4840ca030 2024-04-20T10:50:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.112+0000 7fc482ffd640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840ca030 0x7fc48415d920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4840ca490 tx=0x7fc47400ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.112+0000 7f02f9ee0640 1 -- 172.21.15.90:0/1396442423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02d4005290 con 0x7f02f40aa780 2024-04-20T10:50:58.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.112+0000 7fc46bfff640 1 -- 172.21.15.90:0/2359097918 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474017070 con 0x7fc4840ca030 2024-04-20T10:50:58.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.113+0000 7f02dbfff640 1 -- 172.21.15.90:0/1396442423 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f02e40129d0 con 0x7f02f40aa780 2024-04-20T10:50:58.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.113+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48412d0d0 con 0x7fc4840ca030 2024-04-20T10:50:58.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.113+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48412d690 con 0x7fc4840ca030 2024-04-20T10:50:58.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7f02dbfff640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f02e006c940 0x7f02e006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7fc46bfff640 1 -- 172.21.15.90:0/2359097918 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47400c6d0 con 0x7fc4840ca030 2024-04-20T10:50:58.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7fc46bfff640 1 -- 172.21.15.90:0/2359097918 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47400f040 con 0x7fc4840ca030 2024-04-20T10:50:58.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc484076150 con 0x7fc4840ca030 2024-04-20T10:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.108+0000 7f8933fff640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f8928004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f893ad9d640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8928005260 0x7f892800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f893a59c640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8928003b80 0x7f8928003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7f02f37fe640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f02e006c940 0x7f02e006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f8933fff640 1 -- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8928005260 msgr2=0x7f892800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f8933fff640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8928005260 0x7f892800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f8933fff640 1 -- 172.21.15.90:0/2503707305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8928003b80 msgr2=0x7f8928003fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f8933fff640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8928003b80 0x7f8928003fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.109+0000 7f8933fff640 1 -- 172.21.15.90:0/2503707305 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c0c6a90 con 0x7f8928004800 2024-04-20T10:50:58.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.112+0000 7f8933fff640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f8928004c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8924007fd0 tx=0x7f8928005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b376fa7c4294e2c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.113+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924007e30 con 0x7f8928004800 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.113+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f892403dc00 con 0x7f8928004800 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7f8940c77640 1 -- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 msgr2=0x7f8928004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7f893ad9d640 1 -- 172.21.15.90:0/2503707305 reap_dead start 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7f8939d9b640 1 -- 172.21.15.90:0/2503707305 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924007e30 con 0x7f8928004800 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.114+0000 7f8940c77640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f8928004c80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8924007fd0 tx=0x7f8928005830 comp rx=0 tx=0).stop 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.115+0000 7f8940c77640 1 -- 172.21.15.90:0/2503707305 shutdown_connections 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.115+0000 7f8940c77640 1 --2- 172.21.15.90:0/2503707305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f8928004c80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.115+0000 7f02dbfff640 1 -- 172.21.15.90:0/1396442423 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f02e408ba30 con 0x7f02f40aa780 2024-04-20T10:50:58.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.115+0000 7f8940c77640 1 -- 172.21.15.90:0/2503707305 >> 172.21.15.90:0/2503707305 conn(0x7f893c0cbfe0 msgr2=0x7f893c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.115+0000 7f02f37fe640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f02e006c940 0x7f02e006ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f02ec035000 tx=0x7f02ec030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.115+0000 7f8940c77640 1 -- 172.21.15.90:0/2503707305 shutdown_connections 2024-04-20T10:50:58.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.115+0000 7f8940c77640 1 -- 172.21.15.90:0/2503707305 wait complete. 2024-04-20T10:50:58.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.117+0000 7f8940c77640 1 Processor -- start 2024-04-20T10:50:58.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.117+0000 7f8940c77640 1 -- start start 2024-04-20T10:50:58.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.118+0000 7f8940c77640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f893c0b1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f8940c77640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f893c157b40 0x7f893c1eb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f02dbfff640 1 -- 172.21.15.90:0/1396442423 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f02e4059b20 con 0x7f02f40aa780 2024-04-20T10:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f893a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f893c0b1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f893a59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f893c0b1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60192/0 (socket says 172.21.15.90:60192) 2024-04-20T10:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f8933fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f893c157b40 0x7f893c1eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f8933fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f893c157b40 0x7f893c1eb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59178/0 (socket says 172.21.15.90:59178) 2024-04-20T10:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f893a59c640 1 -- 172.21.15.90:0/3360650383 learned_addr learned my addr 172.21.15.90:0/3360650383 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f8940c77640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f893c0beda0 0x7f893c1e86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f893c0c9100 con 0x7f893c157b40 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f893c157510 con 0x7f8928004800 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f893c0c9280 con 0x7f893c0beda0 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.119+0000 7f893ad9d640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f893c0beda0 0x7f893c1e86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.120+0000 7f8933fff640 1 -- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f893c0beda0 msgr2=0x7f893c1e86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.120+0000 7f8933fff640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f893c0beda0 0x7f893c1e86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.120+0000 7f8933fff640 1 -- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 msgr2=0x7f893c0b1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.120+0000 7f8933fff640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f893c0b1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.120+0000 7f8933fff640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893c0ab3e0 con 0x7f893c157b40 2024-04-20T10:50:58.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.120+0000 7fc46bfff640 1 -- 172.21.15.90:0/2359097918 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc47401a070 con 0x7fc4840ca030 2024-04-20T10:50:58.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.121+0000 7fc46bfff640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc47006c940 0x7fc47006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.121+0000 7fc46bfff640 1 -- 172.21.15.90:0/2359097918 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fc47408be00 con 0x7fc4840ca030 2024-04-20T10:50:58.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.121+0000 7fc4837fe640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc47006c940 0x7fc47006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.122+0000 7f8933fff640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f893c157b40 0x7f893c1eb510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8924043000 tx=0x7f8924001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.122+0000 7fc4837fe640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc47006c940 0x7fc47006ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc478036000 tx=0x7fc478008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.122+0000 7f8932ffd640 1 -- 172.21.15.90:0/3360650383 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924053020 con 0x7f893c157b40 2024-04-20T10:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.122+0000 7f8932ffd640 1 -- 172.21.15.90:0/3360650383 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8924005070 con 0x7f893c157b40 2024-04-20T10:50:58.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.122+0000 7f8932ffd640 1 -- 172.21.15.90:0/3360650383 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8924005420 con 0x7f893c157b40 2024-04-20T10:50:58.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.123+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893c1ebc10 con 0x7f893c157b40 2024-04-20T10:50:58.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.124+0000 7fc46bfff640 1 -- 172.21.15.90:0/2359097918 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc474059920 con 0x7fc4840ca030 2024-04-20T10:50:58.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.124+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f893c1ec1d0 con 0x7f893c157b40 2024-04-20T10:50:58.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.125+0000 7f8932ffd640 1 -- 172.21.15.90:0/3360650383 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8924056020 con 0x7f893c157b40 2024-04-20T10:50:58.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.126+0000 7f8932ffd640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f891c06c970 0x7f891c06ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.126+0000 7f893a59c640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f891c06c970 0x7f891c06ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.127+0000 7f8932ffd640 1 -- 172.21.15.90:0/3360650383 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f892403dbb0 con 0x7f893c157b40 2024-04-20T10:50:58.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.128+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f893c1ec410 con 0x7f893c157b40 2024-04-20T10:50:58.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.129+0000 7f893a59c640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f891c06c970 0x7f891c06ee30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f892c004d00 tx=0x7f892c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.138+0000 7f8932ffd640 1 -- 172.21.15.90:0/3360650383 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f892405d070 con 0x7f893c157b40 2024-04-20T10:50:58.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.155+0000 7fd9cf59e640 1 Processor -- start 2024-04-20T10:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.156+0000 7f1a9abaf640 1 Processor -- start 2024-04-20T10:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.156+0000 7f1a9abaf640 1 -- start start 2024-04-20T10:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.155+0000 7fd9cf59e640 1 -- start start 2024-04-20T10:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.156+0000 7fd9cf59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd9d0153440 0x7fd9d00a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.156+0000 7fd9cf59e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d00c4230 con 0x7fd9d0156960 2024-04-20T10:50:58.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.156+0000 7fd9cf59e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9d0155e80 con 0x7fd9d00c3ce0 2024-04-20T10:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.156+0000 7fd9cf59e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd9d0153820 con 0x7fd9d0153440 2024-04-20T10:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7f1d167fa640 1 Processor -- start 2024-04-20T10:50:58.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7fd9cdd9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd9d0156960 0x7fd9d00ab3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56688/0 (socket says 172.21.15.90:56688) 2024-04-20T10:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7fd9cdd9b640 1 -- 172.21.15.90:0/293579214 learned_addr learned my addr 172.21.15.90:0/293579214 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7fd9ce59c640 1 --2- 172.21.15.90:0/293579214 >> v2:172.21.15.90:3300/0 conn(0x7fd9d0153440 0x7fd9d00a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7f1a9abaf640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a8c00d970 0x7f1a8c007f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7f1a9abaf640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8c0df780 con 0x7f1a8c0dbf40 2024-04-20T10:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7f1a9abaf640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8c009790 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7f1a9abaf640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1a8c0df240 con 0x7f1a8c00d970 2024-04-20T10:50:58.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7fd9cd59a640 1 -- 172.21.15.90:0/293579214 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373352873 0 0) 0x7fd9d00c4230 con 0x7fd9d0156960 2024-04-20T10:50:58.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1a993ac640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a8c00d970 0x7f1a8c007f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1a993ac640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1a8c00d970 0x7f1a8c007f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60208/0 (socket says 172.21.15.90:60208) 2024-04-20T10:50:58.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1a993ac640 1 -- 172.21.15.90:0/1133883610 learned_addr learned my addr 172.21.15.90:0/1133883610 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7fd9cd59a640 1 -- 172.21.15.90:0/293579214 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9b8003520 con 0x7fd9d0156960 2024-04-20T10:50:58.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7fd9cd59a640 1 -- 172.21.15.90:0/293579214 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527288065 0 0) 0x7fd9d0155e80 con 0x7fd9d00c3ce0 2024-04-20T10:50:58.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7fd9cd59a640 1 -- 172.21.15.90:0/293579214 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9d00c4230 con 0x7fd9d00c3ce0 2024-04-20T10:50:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1c04255640 1 Processor -- start 2024-04-20T10:50:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1c04255640 1 -- start start 2024-04-20T10:50:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1a993ac640 1 -- 172.21.15.90:0/1133883610 >> v1:172.21.15.175:6789/0 conn(0x7f1a8c00cfb0 legacy=0x7f1a8c008450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-20T10:50:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1a993ac640 1 -- 172.21.15.90:0/1133883610 >> v1:172.21.15.90:6789/0 conn(0x7f1a8c0dbf40 legacy=0x7f1a8c0409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.157+0000 7f1d167fa640 1 -- start start 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d167fa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d167fa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1d0804dff0 0x7f1d0804e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d167fa640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1d0804dae0 0x7f1d0804ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d167fa640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f1d0800f9d0 con 0x7f1d0804dff0 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d167fa640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1d0804f250 con 0x7f1d0804dae0 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d167fa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1d080da4b0 con 0x7f1d080d7ae0 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d157f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d157f8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37404/0 (socket says 172.21.15.90:37404) 2024-04-20T10:50:58.161 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d157f8640 1 -- 172.21.15.90:0/2938531586 learned_addr learned my addr 172.21.15.90:0/2938531586 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7f1d15ff9640 1 --2- 172.21.15.90:0/2938531586 >> v2:172.21.15.175:3300/0 conn(0x7f1d0804dae0 0x7f1d0804ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7eff24c9a640 1 Processor -- start 2024-04-20T10:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7fd9ce59c640 1 -- 172.21.15.90:0/293579214 >> v1:172.21.15.175:6789/0 conn(0x7fd9d00c3ce0 legacy=0x7fd9d015d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7fd9ce59c640 1 -- 172.21.15.90:0/293579214 >> v1:172.21.15.90:6789/0 conn(0x7fd9d0156960 legacy=0x7fd9d00ab3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7fd9ce59c640 1 -- 172.21.15.90:0/293579214 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d0156160 con 0x7fd9d0153440 2024-04-20T10:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.159+0000 7f1a993ac640 1 -- 172.21.15.90:0/1133883610 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c0df4a0 con 0x7f1a8c00d970 2024-04-20T10:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.158+0000 7eff24c9a640 1 -- start start 2024-04-20T10:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.159+0000 7f1d15ff9640 1 -- 172.21.15.90:0/2938531586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 msgr2=0x7f1d080071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.159+0000 7f1d15ff9640 1 --2- 172.21.15.90:0/2938531586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.159+0000 7f1d15ff9640 1 -- 172.21.15.90:0/2938531586 >> v2:172.21.15.90:3300/0 conn(0x7f1d0804dff0 msgr2=0x7f1d0804e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.159+0000 7f1d15ff9640 1 --2- 172.21.15.90:0/2938531586 >> v2:172.21.15.90:3300/0 conn(0x7f1d0804dff0 0x7f1d0804e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.159+0000 7f1d15ff9640 1 -- 172.21.15.90:0/2938531586 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d080da790 con 0x7f1d0804dae0 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c04255640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1bf40d7860 0x7f1bf40d3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c04255640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1bf40d3d80 0x7f1bf40465a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7eff24c9a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff200aa010 0x7eff2015e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7eff24c9a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff200bf530 con 0x7eff200c45e0 2024-04-20T10:50:58.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7eff24c9a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2006f270 con 0x7eff2015e770 2024-04-20T10:50:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7eff24c9a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7eff200c49c0 con 0x7eff200aa010 2024-04-20T10:50:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c01ff1640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1bf4004b00 0x7f1bf40d6d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56692/0 (socket says 172.21.15.90:56692) 2024-04-20T10:50:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c01ff1640 1 -- 172.21.15.90:0/3549648651 learned_addr learned my addr 172.21.15.90:0/3549648651 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1a993ac640 1 --2- 172.21.15.90:0/1133883610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c00d970 0x7f1a8c007f10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a94050aa0 tx=0x7f1a940a7ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fcaf3d3c37017e51 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7fd9ce59c640 1 --2- 172.21.15.90:0/293579214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0153440 0x7fd9d00a6cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009a00 tx=0x7fd9c402baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a64e1d7e0d8bc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c027f2640 1 --2- 172.21.15.90:0/3549648651 >> v2:172.21.15.175:3300/0 conn(0x7f1bf40d3d80 0x7f1bf40465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bf40d7cc0 con 0x7f1bf4004b00 2024-04-20T10:50:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf4006e00 con 0x7f1bf40d7860 2024-04-20T10:50:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1bf4007330 con 0x7f1bf40d3d80 2024-04-20T10:50:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1a98bab640 1 -- 172.21.15.90:0/1133883610 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940b5070 con 0x7f1a8c00d970 2024-04-20T10:50:58.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1a98bab640 1 -- 172.21.15.90:0/1133883610 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a940a8d90 con 0x7f1a8c00d970 2024-04-20T10:50:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7eff1dd9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff200aa010 0x7eff2015e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7eff1dd9b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7eff200aa010 0x7eff2015e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60244/0 (socket says 172.21.15.90:60244) 2024-04-20T10:50:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7eff1dd9b640 1 -- 172.21.15.90:0/474562989 learned_addr learned my addr 172.21.15.90:0/474562989 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1a98bab640 1 -- 172.21.15.90:0/1133883610 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a940b0640 con 0x7f1a8c00d970 2024-04-20T10:50:58.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7fd9cd59a640 1 -- 172.21.15.90:0/293579214 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c402d650 con 0x7fd9d0153440 2024-04-20T10:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7eff1dd9b640 1 -- 172.21.15.90:0/474562989 >> v1:172.21.15.175:6789/0 conn(0x7eff2015e770 legacy=0x7eff2015eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7fd9cd59a640 1 -- 172.21.15.90:0/293579214 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c402d7f0 con 0x7fd9d0153440 2024-04-20T10:50:58.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7f1a9abaf640 1 -- 172.21.15.90:0/1133883610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c00d970 msgr2=0x7f1a8c007f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7f1d15ff9640 1 --2- 172.21.15.90:0/2938531586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 0x7f1d0804ed10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d100516a0 tx=0x7f1d100a7eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3fba6a8450655c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c017f0640 1 --2- 172.21.15.90:0/3549648651 >> v2:172.21.15.90:3300/0 conn(0x7f1bf40d7860 0x7f1bf40d3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c027f2640 1 -- 172.21.15.90:0/3549648651 >> v2:172.21.15.90:3300/0 conn(0x7f1bf40d7860 msgr2=0x7f1bf40d3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c027f2640 1 --2- 172.21.15.90:0/3549648651 >> v2:172.21.15.90:3300/0 conn(0x7f1bf40d7860 0x7f1bf40d3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c027f2640 1 -- 172.21.15.90:0/3549648651 >> v1:172.21.15.90:6789/0 conn(0x7f1bf4004b00 legacy=0x7f1bf40d6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.160+0000 7f1c027f2640 1 -- 172.21.15.90:0/3549648651 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf40d6510 con 0x7f1bf40d3d80 2024-04-20T10:50:58.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7f1c017f0640 1 --2- 172.21.15.90:0/3549648651 >> v2:172.21.15.90:3300/0 conn(0x7f1bf40d7860 0x7f1bf40d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:58.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7eff1dd9b640 1 -- 172.21.15.90:0/474562989 >> v1:172.21.15.90:6789/0 conn(0x7eff200c45e0 legacy=0x7eff200a9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7eff1dd9b640 1 -- 172.21.15.90:0/474562989 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff200bf250 con 0x7eff200aa010 2024-04-20T10:50:58.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.161+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/1133883610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c00d970 0x7f1a8c007f10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1a94050aa0 tx=0x7f1a940a7ee0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1c027f2640 1 --2- 172.21.15.90:0/3549648651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf40465a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc050210 tx=0x7f1bfc0a7fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54ae45be2811c061 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1d07fff640 1 -- 172.21.15.90:0/2938531586 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d100b5070 con 0x7f1d0804dae0 2024-04-20T10:50:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1d07fff640 1 -- 172.21.15.90:0/2938531586 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d100a8ca0 con 0x7f1d0804dae0 2024-04-20T10:50:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7fd9cd59a640 1 -- 172.21.15.90:0/293579214 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c402dba0 con 0x7fd9d0153440 2024-04-20T10:50:58.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7eff1dd9b640 1 --2- 172.21.15.90:0/474562989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 0x7eff2015e230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff14009870 tx=0x7eff1402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1074743d592564cf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1c00fef640 1 -- 172.21.15.90:0/3549648651 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0b5070 con 0x7f1bf40d3d80 2024-04-20T10:50:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1c00fef640 1 -- 172.21.15.90:0/3549648651 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0a8e50 con 0x7f1bf40d3d80 2024-04-20T10:50:58.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1c00fef640 1 -- 172.21.15.90:0/3549648651 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0b0640 con 0x7f1bf40d3d80 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7fd9cf59e640 1 -- 172.21.15.90:0/293579214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0153440 msgr2=0x7fd9d00a6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/293579214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0153440 0x7fd9d00a6cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009a00 tx=0x7fd9c402baa0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7fd9cf59e640 1 -- 172.21.15.90:0/293579214 shutdown_connections 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/293579214 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0153440 0x7fd9d00a6cf0 secure :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4009a00 tx=0x7fd9c402baa0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7fd9cf59e640 1 -- 172.21.15.90:0/293579214 >> 172.21.15.90:0/293579214 conn(0x7fd9d00676c0 msgr2=0x7fd9d0067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7eff1d59a640 1 -- 172.21.15.90:0/474562989 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14035020 con 0x7eff200aa010 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7eff1d59a640 1 -- 172.21.15.90:0/474562989 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff14031870 con 0x7eff200aa010 2024-04-20T10:50:58.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7eff1d59a640 1 -- 172.21.15.90:0/474562989 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14031c40 con 0x7eff200aa010 2024-04-20T10:50:58.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 -- 172.21.15.90:0/2938531586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 msgr2=0x7f1d0804ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1a9abaf640 1 -- 172.21.15.90:0/1133883610 shutdown_connections 2024-04-20T10:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/1133883610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c00d970 0x7f1a8c007f10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1a9abaf640 1 -- 172.21.15.90:0/1133883610 >> 172.21.15.90:0/1133883610 conn(0x7f1a8c02f5b0 msgr2=0x7f1a8c02f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1a9abaf640 1 -- 172.21.15.90:0/1133883610 shutdown_connections 2024-04-20T10:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.162+0000 7f1a9abaf640 1 -- 172.21.15.90:0/1133883610 wait complete. 2024-04-20T10:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 msgr2=0x7f1bf40465a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1c04255640 1 --2- 172.21.15.90:0/3549648651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf40465a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc050210 tx=0x7f1bfc0a7fa0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 --2- 172.21.15.90:0/2938531586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 0x7f1d0804ed10 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1d100516a0 tx=0x7f1d100a7eb0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 shutdown_connections 2024-04-20T10:50:58.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1c04255640 1 --2- 172.21.15.90:0/3549648651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf40465a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1c04255640 1 --2- 172.21.15.90:0/3549648651 >> v2:172.21.15.90:3300/0 conn(0x7f1bf40d7860 0x7f1bf40d3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 >> 172.21.15.90:0/3549648651 conn(0x7f1bf40062e0 msgr2=0x7f1bf40066f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 -- 172.21.15.90:0/2938531586 shutdown_connections 2024-04-20T10:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 --2- 172.21.15.90:0/2938531586 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 0x7f1d0804ed10 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 --2- 172.21.15.90:0/2938531586 >> v2:172.21.15.90:3300/0 conn(0x7f1d0804dff0 0x7f1d0804e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 --2- 172.21.15.90:0/2938531586 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 -- 172.21.15.90:0/2938531586 >> 172.21.15.90:0/2938531586 conn(0x7f1d0804c660 msgr2=0x7f1d0804ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 -- 172.21.15.90:0/2938531586 shutdown_connections 2024-04-20T10:50:58.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1a9abaf640 1 Processor -- start 2024-04-20T10:50:58.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7eff24c9a640 1 -- 172.21.15.90:0/474562989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 msgr2=0x7eff2015e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7eff24c9a640 1 --2- 172.21.15.90:0/474562989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 0x7eff2015e230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7eff14009870 tx=0x7eff1402b910 comp rx=0 tx=0).stop 2024-04-20T10:50:58.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 shutdown_connections 2024-04-20T10:50:58.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7f1d167fa640 1 -- 172.21.15.90:0/2938531586 wait complete. 2024-04-20T10:50:58.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7fd9cf59e640 1 -- 172.21.15.90:0/293579214 shutdown_connections 2024-04-20T10:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.163+0000 7fd9cf59e640 1 -- 172.21.15.90:0/293579214 wait complete. 2024-04-20T10:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7f1a9abaf640 1 -- start start 2024-04-20T10:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7eff24c9a640 1 -- 172.21.15.90:0/474562989 shutdown_connections 2024-04-20T10:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7eff24c9a640 1 --2- 172.21.15.90:0/474562989 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 0x7eff2015e230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7eff24c9a640 1 -- 172.21.15.90:0/474562989 >> 172.21.15.90:0/474562989 conn(0x7eff2006b930 msgr2=0x7eff2006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7f1c04255640 1 -- 172.21.15.90:0/3549648651 wait complete. 2024-04-20T10:50:58.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7eff24c9a640 1 -- 172.21.15.90:0/474562989 shutdown_connections 2024-04-20T10:50:58.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7fd9cf59e640 1 Processor -- start 2024-04-20T10:50:58.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a9abaf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a8c00cfb0 0x7f1a8c04e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a9abaf640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a8c00d970 0x7f1a8c04c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a9abaf640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c0dbf40 0x7f1a8c0d83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a9abaf640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c041260 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a9abaf640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1a8c0410e0 con 0x7f1a8c0dbf40 2024-04-20T10:50:58.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a9abaf640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1a8c0090a0 con 0x7f1a8c00d970 2024-04-20T10:50:58.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1d167fa640 1 Processor -- start 2024-04-20T10:50:58.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a99bad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a8c00cfb0 0x7f1a8c04e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a99bad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a8c00cfb0 0x7f1a8c04e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59218/0 (socket says 172.21.15.90:59218) 2024-04-20T10:50:58.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7f1a99bad640 1 -- 172.21.15.90:0/330838886 learned_addr learned my addr 172.21.15.90:0/330838886 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1c04255640 1 Processor -- start 2024-04-20T10:50:58.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1c04255640 1 -- start start 2024-04-20T10:50:58.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1a99bad640 1 -- 172.21.15.90:0/330838886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a8c00d970 msgr2=0x7f1a8c04c540 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T10:50:58.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1a99bad640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a8c00d970 0x7f1a8c04c540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1a99bad640 1 -- 172.21.15.90:0/330838886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c0dbf40 msgr2=0x7f1a8c0d83d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T10:50:58.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1a99bad640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c0dbf40 0x7f1a8c0d83d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1a99bad640 1 -- 172.21.15.90:0/330838886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8c175510 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.165+0000 7fd9cf59e640 1 -- start start 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cf59e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d00c3ce0 0x7fd9d00a6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cf59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0156960 0x7fd9d0141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cf59e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d0150140 0x7fd9d01421b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cf59e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00c76e0 con 0x7fd9d0156960 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cf59e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd9d00c7560 con 0x7fd9d00c3ce0 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cf59e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd9d00abac0 con 0x7fd9d0150140 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9ce59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d00c3ce0 0x7fd9d00a6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.164+0000 7eff24c9a640 1 -- 172.21.15.90:0/474562989 wait complete. 2024-04-20T10:50:58.184 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7eff24c9a640 1 Processor -- start 2024-04-20T10:50:58.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cdd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0156960 0x7fd9d0141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cdd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0156960 0x7fd9d0141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59228/0 (socket says 172.21.15.90:59228) 2024-04-20T10:50:58.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9cdd9b640 1 -- 172.21.15.90:0/362737467 learned_addr learned my addr 172.21.15.90:0/362737467 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7fd9ced9d640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d0150140 0x7fd9d01421b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1c04255640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bf4004b00 0x7f1bf400a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1c04255640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf4041450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1a99bad640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a8c00cfb0 0x7f1a8c04e3b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c400 tx=0x7f1a9000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7fd9cdd9b640 1 -- 172.21.15.90:0/362737467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d0150140 msgr2=0x7fd9d01421b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7fd9cdd9b640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d0150140 0x7fd9d01421b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7fd9cdd9b640 1 -- 172.21.15.90:0/362737467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d00c3ce0 msgr2=0x7fd9d00a6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7fd9cdd9b640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d00c3ce0 0x7fd9d00a6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7fd9cdd9b640 1 -- 172.21.15.90:0/362737467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9d01426f0 con 0x7fd9d0156960 2024-04-20T10:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7f1d167fa640 1 -- start start 2024-04-20T10:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d167fa640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 0x7f1d08046cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d167fa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0804dff0 0x7f1d081705d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1c04255640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf40d7860 0x7f1bf4041990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d167fa640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080de1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d167fa640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1d080db270 con 0x7f1d0804dff0 2024-04-20T10:50:58.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1c017f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf4041450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d167fa640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1d080dad50 con 0x7f1d0804dae0 2024-04-20T10:50:58.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d167fa640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1d0804e4b0 con 0x7f1d080d7ae0 2024-04-20T10:50:58.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1c01ff1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bf4004b00 0x7f1bf400a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1c01ff1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bf4004b00 0x7f1bf400a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59242/0 (socket says 172.21.15.90:59242) 2024-04-20T10:50:58.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d14ff7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0804dff0 0x7f1d081705d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.167+0000 7f1d14ff7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0804dff0 0x7f1d081705d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59236/0 (socket says 172.21.15.90:59236) 2024-04-20T10:50:58.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1d14ff7640 1 -- 172.21.15.90:0/3859867146 learned_addr learned my addr 172.21.15.90:0/3859867146 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.166+0000 7eff24c9a640 1 -- start start 2024-04-20T10:50:58.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff24c9a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 0x7eff200c1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff24c9a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200c45e0 0x7eff20154500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7fd9cdd9b640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0156960 0x7fd9d0141c70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000c4b0 tx=0x7fd9c000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff24c9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff2015e770 0x7eff20154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff24c9a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff200beee0 con 0x7eff2015e770 2024-04-20T10:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff24c9a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff2006ef00 con 0x7eff200aa010 2024-04-20T10:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff24c9a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff2006e5d0 con 0x7eff200c45e0 2024-04-20T10:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c027f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf40d7860 0x7f1bf4041990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c027f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf40d7860 0x7f1bf4041990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37450/0 (socket says 172.21.15.90:37450) 2024-04-20T10:50:58.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c017f0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf4041450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60284/0 (socket says 172.21.15.90:60284) 2024-04-20T10:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c01ff1640 1 -- 172.21.15.90:0/609756983 learned_addr learned my addr 172.21.15.90:0/609756983 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf4009be0 con 0x7f1bf4004b00 2024-04-20T10:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1bf4009a60 con 0x7f1bf40d3d80 2024-04-20T10:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1bf402e4d0 con 0x7f1bf40d7860 2024-04-20T10:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1a8a7fc640 1 -- 172.21.15.90:0/330838886 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a900052d0 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1d157f8640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 0x7f1d08046cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1d15ff9640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080de1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7fd9beffd640 1 -- 172.21.15.90:0/362737467 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0005ce0 con 0x7fd9d0156960 2024-04-20T10:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9d00702b0 con 0x7fd9d0156960 2024-04-20T10:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9d0070570 con 0x7fd9d0156960 2024-04-20T10:50:58.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7fd9beffd640 1 -- 172.21.15.90:0/362737467 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9c0007070 con 0x7fd9d0156960 2024-04-20T10:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c027f2640 1 -- 172.21.15.90:0/609756983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 msgr2=0x7f1bf4041450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c027f2640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf4041450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c027f2640 1 -- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bf4004b00 msgr2=0x7f1bf400a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c027f2640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bf4004b00 0x7f1bf400a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1c027f2640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bf40456a0 con 0x7f1bf40d7860 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff1ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff2015e770 0x7eff20154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff1ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff2015e770 0x7eff20154a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59256/0 (socket says 172.21.15.90:59256) 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff1ed9d640 1 -- 172.21.15.90:0/917311387 learned_addr learned my addr 172.21.15.90:0/917311387 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff1dd9b640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200c45e0 0x7eff20154500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7eff1e59c640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 0x7eff200c1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7eff1dd9b640 1 -- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 msgr2=0x7eff200c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7eff1dd9b640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 0x7eff200c1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7eff1dd9b640 1 -- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff2015e770 msgr2=0x7eff20154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7eff1dd9b640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff2015e770 0x7eff20154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7eff1dd9b640 1 -- 172.21.15.90:0/917311387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff200addb0 con 0x7eff200c45e0 2024-04-20T10:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8c0e28e0 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.168+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a8c04bef0 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1a8a7fc640 1 -- 172.21.15.90:0/330838886 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a90005470 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1a8a7fc640 1 -- 172.21.15.90:0/330838886 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a90007260 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1d14ff7640 1 -- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 msgr2=0x7f1d080de1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1d14ff7640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080de1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1d14ff7640 1 -- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 msgr2=0x7f1d08046cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1d14ff7640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 0x7f1d08046cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1d14ff7640 1 -- 172.21.15.90:0/3859867146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d08048cc0 con 0x7f1d0804dff0 2024-04-20T10:50:58.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.169+0000 7f1d15ff9640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080de1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:58.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a8c0dc4a0 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7f1d14ff7640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0804dff0 0x7f1d081705d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000b4d0 tx=0x7f1d0000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7eff1dd9b640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200c45e0 0x7eff20154500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff2006d5c0 tx=0x7eff140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7eff0effd640 1 -- 172.21.15.90:0/917311387 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14040070 con 0x7eff200c45e0 2024-04-20T10:50:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7f1c027f2640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf40d7860 0x7f1bf4041990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc050aa0 tx=0x7f1bfc069980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7eff0effd640 1 -- 172.21.15.90:0/917311387 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1403a420 con 0x7eff200c45e0 2024-04-20T10:50:58.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7eff0effd640 1 -- 172.21.15.90:0/917311387 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff14035040 con 0x7eff200c45e0 2024-04-20T10:50:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff200ae090 con 0x7eff200c45e0 2024-04-20T10:50:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7eff201599f0 con 0x7eff200c45e0 2024-04-20T10:50:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7f1bf27fc640 1 -- 172.21.15.90:0/609756983 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0bf020 con 0x7f1bf40d7860 2024-04-20T10:50:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7f1bf27fc640 1 -- 172.21.15.90:0/609756983 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bfc0bb620 con 0x7f1bf40d7860 2024-04-20T10:50:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7fd9beffd640 1 -- 172.21.15.90:0/362737467 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9c0007420 con 0x7fd9d0156960 2024-04-20T10:50:58.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.170+0000 7fd9beffd640 1 -- 172.21.15.90:0/362737467 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd9c00075c0 con 0x7fd9d0156960 2024-04-20T10:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bf40d50e0 con 0x7f1bf40d7860 2024-04-20T10:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9b4005290 con 0x7fd9d0156960 2024-04-20T10:50:58.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bf41740a0 con 0x7f1bf40d7860 2024-04-20T10:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7f1bf27fc640 1 -- 172.21.15.90:0/609756983 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc0b5040 con 0x7f1bf40d7860 2024-04-20T10:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7f1d05ffb640 1 -- 172.21.15.90:0/3859867146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00014070 con 0x7f1d0804dff0 2024-04-20T10:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7f1d05ffb640 1 -- 172.21.15.90:0/3859867146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d00010870 con 0x7f1d0804dff0 2024-04-20T10:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7f1d05ffb640 1 -- 172.21.15.90:0/3859867146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00010c60 con 0x7f1d0804dff0 2024-04-20T10:50:58.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7fd9beffd640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd9b006ca20 0x7fd9b006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.171+0000 7fd9ce59c640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd9b006ca20 0x7fd9b006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.172+0000 7fd9beffd640 1 -- 172.21.15.90:0/362737467 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fd9c008bab0 con 0x7fd9d0156960 2024-04-20T10:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.172+0000 7fd9ce59c640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd9b006ca20 0x7fd9b006eee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4036000 tx=0x7fd9c4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.173+0000 7f1bf27fc640 1 -- 172.21.15.90:0/609756983 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bfc0c2020 con 0x7f1bf40d7860 2024-04-20T10:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.173+0000 7f1bf27fc640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1be006c9f0 0x7f1be006eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.173+0000 7f1bf27fc640 1 -- 172.21.15.90:0/609756983 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f1bfc12a260 con 0x7f1bf40d7860 2024-04-20T10:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.173+0000 7eff0effd640 1 -- 172.21.15.90:0/917311387 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff14038020 con 0x7eff200c45e0 2024-04-20T10:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.173+0000 7eff0effd640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff0006c9c0 0x7eff0006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.173+0000 7eff0effd640 1 -- 172.21.15.90:0/917311387 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7eff140ad660 con 0x7eff200c45e0 2024-04-20T10:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.172+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d08048fa0 con 0x7f1d0804dff0 2024-04-20T10:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.173+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d08049a40 con 0x7f1d0804dff0 2024-04-20T10:50:58.203 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.174+0000 7f1c01ff1640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1be006c9f0 0x7f1be006eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.174+0000 7eff1e59c640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff0006c9c0 0x7eff0006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.174+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf0005290 con 0x7f1d0804dff0 2024-04-20T10:50:58.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.174+0000 7f1c01ff1640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1be006c9f0 0x7f1be006eeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8005880 tx=0x7f1bf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.175+0000 7eff1e59c640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff0006c9c0 0x7eff0006ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff20158210 tx=0x7eff10009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.175+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff04005290 con 0x7eff200c45e0 2024-04-20T10:50:58.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.175+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bf40057e0 con 0x7f1bf40d7860 2024-04-20T10:50:58.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.175+0000 7f1a8a7fc640 1 -- 172.21.15.90:0/330838886 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a90007400 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.176+0000 7f1a8a7fc640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1a7806c940 0x7f1a7806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.176+0000 7f1a993ac640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1a7806c940 0x7f1a7806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.176+0000 7f1a993ac640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1a7806c940 0x7f1a7806ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00f810 tx=0x7f1a9406f030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.179+0000 7fd9beffd640 1 -- 172.21.15.90:0/362737467 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd9c0059b90 con 0x7fd9d0156960 2024-04-20T10:50:58.206 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.179+0000 7f1a8a7fc640 1 -- 172.21.15.90:0/330838886 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f1a900573b0 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.181+0000 7f1d05ffb640 1 -- 172.21.15.90:0/3859867146 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d00017070 con 0x7f1d0804dff0 2024-04-20T10:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.181+0000 7eff0effd640 1 -- 172.21.15.90:0/917311387 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7eff1407b180 con 0x7eff200c45e0 2024-04-20T10:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.182+0000 7f1d05ffb640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1cf406c940 0x7f1cf406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.182+0000 7f1d157f8640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1cf406c940 0x7f1cf406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.183+0000 7f1d157f8640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1cf406c940 0x7f1cf406ee00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007840 tx=0x7f1d0c009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.184+0000 7f1bf27fc640 1 -- 172.21.15.90:0/609756983 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1bfc0c9070 con 0x7f1bf40d7860 2024-04-20T10:50:58.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.186+0000 7f1d05ffb640 1 -- 172.21.15.90:0/3859867146 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f1d00057bc0 con 0x7f1d0804dff0 2024-04-20T10:50:58.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.187+0000 7f1a8a7fc640 1 -- 172.21.15.90:0/330838886 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1a8c0dc4a0 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.196+0000 7f1d05ffb640 1 -- 172.21.15.90:0/3859867146 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1d00059b20 con 0x7f1d0804dff0 2024-04-20T10:50:58.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.511+0000 7f02f9ee0640 1 -- 172.21.15.90:0/1396442423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f02d4005580 con 0x7f02f40aa780 2024-04-20T10:50:58.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.512+0000 7f02dbfff640 1 -- 172.21.15.90:0/1396442423 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f02e4059420 con 0x7f02f40aa780 2024-04-20T10:50:58.512 INFO:teuthology.orchestra.run.smithi090.stdout:55834574858 2024-04-20T10:50:58.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f02e006c940 msgr2=0x7f02e006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f02e006c940 0x7f02e006ee00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f02ec035000 tx=0x7f02ec030000 comp rx=0 tx=0).stop 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1396442423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f40aa780 msgr2=0x7f02f40c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f40aa780 0x7f02f40c6ac0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f02e400c450 tx=0x7f02e400c910 comp rx=0 tx=0).stop 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1396442423 shutdown_connections 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f02e006c940 0x7f02e006ee00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f02f415c1a0 0x7f02f41f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f02f40aa780 0x7f02f40c6ac0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 --2- 172.21.15.90:0/1396442423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f02f4073420 0x7f02f415cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.515+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1396442423 >> 172.21.15.90:0/1396442423 conn(0x7f02f40c8080 msgr2=0x7f02f40c4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.516+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1396442423 shutdown_connections 2024-04-20T10:50:58.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.516+0000 7f02d9ffb640 1 -- 172.21.15.90:0/1396442423 wait complete. 2024-04-20T10:50:58.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.2 2024-04-20T10:50:58.533 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.545+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fc4841556c0 con 0x7fc4840ca030 2024-04-20T10:50:58.546 INFO:teuthology.orchestra.run.smithi090.stdout:55834574858 2024-04-20T10:50:58.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.546+0000 7fc46bfff640 1 -- 172.21.15.90:0/2359097918 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc47405dc20 con 0x7fc4840ca030 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc47006c940 msgr2=0x7fc47006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc47006c940 0x7fc47006ee00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc478036000 tx=0x7fc478008030 comp rx=0 tx=0).stop 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840ca030 msgr2=0x7fc48415d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840ca030 0x7fc48415d920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4840ca490 tx=0x7fc47400ec70 comp rx=0 tx=0).stop 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 shutdown_connections 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc47006c940 0x7fc47006ee00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc48415b370 0x7fc48415c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4840ca030 0x7fc48415d920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 --2- 172.21.15.90:0/2359097918 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc4840c6ab0 0x7fc484153c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 >> 172.21.15.90:0/2359097918 conn(0x7fc4840ade20 msgr2=0x7fc484166a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 shutdown_connections 2024-04-20T10:50:58.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.549+0000 7fc489e81640 1 -- 172.21.15.90:0/2359097918 wait complete. 2024-04-20T10:50:58.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.558+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1a8c007f10 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.558+0000 7f1a8a7fc640 1 -- 172.21.15.90:0/330838886 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a8c007f10 con 0x7f1a8c00cfb0 2024-04-20T10:50:58.558 INFO:teuthology.orchestra.run.smithi090.stdout:55834574856 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.560+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1a7806c940 msgr2=0x7f1a7806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.560+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1a7806c940 0x7f1a7806ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1a8c00f810 tx=0x7f1a9406f030 comp rx=0 tx=0).stop 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.560+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a8c00cfb0 msgr2=0x7f1a8c04e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.560+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a8c00cfb0 0x7f1a8c04e3b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000c400 tx=0x7f1a9000c8c0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 shutdown_connections 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1a7806c940 0x7f1a7806ee00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1a8c0dbf40 0x7f1a8c0d83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1a8c00d970 0x7f1a8c04c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 --2- 172.21.15.90:0/330838886 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1a8c00cfb0 0x7f1a8c04e3b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 >> 172.21.15.90:0/330838886 conn(0x7f1a8c02f5b0 msgr2=0x7f1a8c0409d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 shutdown_connections 2024-04-20T10:50:58.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.561+0000 7f1a9abaf640 1 -- 172.21.15.90:0/330838886 wait complete. 2024-04-20T10:50:58.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.562+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f893c076150 con 0x7f893c157b40 2024-04-20T10:50:58.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.563+0000 7f8932ffd640 1 -- 172.21.15.90:0/3360650383 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f893c15a720 con 0x7f893c157b40 2024-04-20T10:50:58.563 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-20T10:50:58.566 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.0 2024-04-20T10:50:58.566 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f891c06c970 msgr2=0x7f891c06ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f891c06c970 0x7f891c06ee30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f892c004d00 tx=0x7f892c009040 comp rx=0 tx=0).stop 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f893c157b40 msgr2=0x7f893c1eb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f893c157b40 0x7f893c1eb510 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8924043000 tx=0x7f8924001b70 comp rx=0 tx=0).stop 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 shutdown_connections 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f891c06c970 0x7f891c06ee30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f893c0beda0 0x7f893c1e86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f893c157b40 0x7f893c1eb510 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 --2- 172.21.15.90:0/3360650383 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8928004800 0x7f893c0b1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.566+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 >> 172.21.15.90:0/3360650383 conn(0x7f893c0cbfe0 msgr2=0x7f893c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.567+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 shutdown_connections 2024-04-20T10:50:58.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.567+0000 7f8940c77640 1 -- 172.21.15.90:0/3360650383 wait complete. 2024-04-20T10:50:58.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574856 for osd.5 2024-04-20T10:50:58.577 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.580 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.1 2024-04-20T10:50:58.580 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.599+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd9b4005580 con 0x7fd9d0156960 2024-04-20T10:50:58.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.600+0000 7fd9beffd640 1 -- 172.21.15.90:0/362737467 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd9c0059490 con 0x7fd9d0156960 2024-04-20T10:50:58.600 INFO:teuthology.orchestra.run.smithi090.stdout:55834574858 2024-04-20T10:50:58.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.602+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7eff04005580 con 0x7eff200c45e0 2024-04-20T10:50:58.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd9b006ca20 msgr2=0x7fd9b006eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd9b006ca20 0x7fd9b006eee0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd9c4036000 tx=0x7fd9c4008030 comp rx=0 tx=0).stop 2024-04-20T10:50:58.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0156960 msgr2=0x7fd9d0141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0156960 0x7fd9d0141c70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd9c000c4b0 tx=0x7fd9c000c970 comp rx=0 tx=0).stop 2024-04-20T10:50:58.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 shutdown_connections 2024-04-20T10:50:58.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd9b006ca20 0x7fd9b006eee0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd9d0150140 0x7fd9d01421b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd9d0156960 0x7fd9d0141c70 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 --2- 172.21.15.90:0/362737467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd9d00c3ce0 0x7fd9d00a6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 >> 172.21.15.90:0/362737467 conn(0x7fd9d00676c0 msgr2=0x7fd9d00a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7eff0effd640 1 -- 172.21.15.90:0/917311387 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7eff1407f480 con 0x7eff200c45e0 2024-04-20T10:50:58.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 shutdown_connections 2024-04-20T10:50:58.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.603+0000 7fd9cf59e640 1 -- 172.21.15.90:0/362737467 wait complete. 2024-04-20T10:50:58.605 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-20T10:50:58.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff0006c9c0 msgr2=0x7eff0006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff0006c9c0 0x7eff0006ee80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7eff20158210 tx=0x7eff10009060 comp rx=0 tx=0).stop 2024-04-20T10:50:58.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200c45e0 msgr2=0x7eff20154500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200c45e0 0x7eff20154500 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7eff2006d5c0 tx=0x7eff140046c0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 shutdown_connections 2024-04-20T10:50:58.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff0006c9c0 0x7eff0006ee80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff2015e770 0x7eff20154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff200c45e0 0x7eff20154500 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 --2- 172.21.15.90:0/917311387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff200aa010 0x7eff200c1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 >> 172.21.15.90:0/917311387 conn(0x7eff2006b930 msgr2=0x7eff2015c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 shutdown_connections 2024-04-20T10:50:58.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.606+0000 7eff24c9a640 1 -- 172.21.15.90:0/917311387 wait complete. 2024-04-20T10:50:58.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.608+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1bf4045d20 con 0x7f1bf40d7860 2024-04-20T10:50:58.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.608+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1cf0005850 con 0x7f1d0804dff0 2024-04-20T10:50:58.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.609+0000 7f1d05ffb640 1 -- 172.21.15.90:0/3859867146 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1d0005de20 con 0x7f1d0804dff0 2024-04-20T10:50:58.609 INFO:teuthology.orchestra.run.smithi090.stdout:55834574857 2024-04-20T10:50:58.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.609+0000 7f1bf27fc640 1 -- 172.21.15.90:0/609756983 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bfc0f83d0 con 0x7f1bf40d7860 2024-04-20T10:50:58.609 INFO:teuthology.orchestra.run.smithi090.stdout:55834574858 2024-04-20T10:50:58.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1cf406c940 msgr2=0x7f1cf406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1cf406c940 0x7f1cf406ee00 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1d08007840 tx=0x7f1d0c009240 comp rx=0 tx=0).stop 2024-04-20T10:50:58.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0804dff0 msgr2=0x7f1d081705d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0804dff0 0x7f1d081705d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1d0000b4d0 tx=0x7f1d0000b990 comp rx=0 tx=0).stop 2024-04-20T10:50:58.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 shutdown_connections 2024-04-20T10:50:58.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1cf406c940 0x7f1cf406ee00 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1d080d7ae0 0x7f1d080de1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1d0804dff0 0x7f1d081705d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 --2- 172.21.15.90:0/3859867146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1d0804dae0 0x7f1d08046cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 >> 172.21.15.90:0/3859867146 conn(0x7f1d0804c660 msgr2=0x7f1d0800ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 shutdown_connections 2024-04-20T10:50:58.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.611+0000 7f1d167fa640 1 -- 172.21.15.90:0/3859867146 wait complete. 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1be006c9f0 msgr2=0x7f1be006eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1be006c9f0 0x7f1be006eeb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bf8005880 tx=0x7f1bf8009040 comp rx=0 tx=0).stop 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf40d7860 msgr2=0x7f1bf4041990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf40d7860 0x7f1bf4041990 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc050aa0 tx=0x7f1bfc069980 comp rx=0 tx=0).stop 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 shutdown_connections 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1be006c9f0 0x7f1be006eeb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1bf40d7860 0x7f1bf4041990 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1bf40d3d80 0x7f1bf4041450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 --2- 172.21.15.90:0/609756983 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1bf4004b00 0x7f1bf400a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 >> 172.21.15.90:0/609756983 conn(0x7f1bf40062e0 msgr2=0x7f1bf402d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 shutdown_connections 2024-04-20T10:50:58.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.612+0000 7f1c04255640 1 -- 172.21.15.90:0/609756983 wait complete. 2024-04-20T10:50:58.616 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.4 2024-04-20T10:50:58.616 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.6 2024-04-20T10:50:58.624 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574857 for osd.7 2024-04-20T10:50:58.625 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574858 for osd.3 2024-04-20T10:50:58.627 DEBUG:teuthology.parallel:result is None 2024-04-20T10:50:58.627 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-20T10:50:58.628 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:50:58.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.763+0000 7f757c811640 1 Processor -- start 2024-04-20T10:50:58.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.763+0000 7f757c811640 1 -- start start 2024-04-20T10:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757c811640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7578154040 0x7f75780c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757c811640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f75780730e0 0x7f7578073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757c811640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75780af590 con 0x7f7578159e00 2024-04-20T10:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757c811640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f75780acb20 con 0x7f7578154040 2024-04-20T10:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757c811640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f75780acd70 con 0x7f75780730e0 2024-04-20T10:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7578154040 0x7f75780c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.765 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7578154040 0x7f75780c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59270/0 (socket says 172.21.15.90:59270) 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757659c640 1 -- 172.21.15.90:0/646393000 learned_addr learned my addr 172.21.15.90:0/646393000 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f756ffff640 1 --2- 172.21.15.90:0/646393000 >> v2:172.21.15.175:3300/0 conn(0x7f75780730e0 0x7f7578073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757659c640 1 -- 172.21.15.90:0/646393000 >> v2:172.21.15.175:3300/0 conn(0x7f75780730e0 msgr2=0x7f7578073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757659c640 1 --2- 172.21.15.90:0/646393000 >> v2:172.21.15.175:3300/0 conn(0x7f75780730e0 0x7f7578073520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757659c640 1 -- 172.21.15.90:0/646393000 >> v1:172.21.15.175:6789/0 conn(0x7f7578159e00 legacy=0x7f757815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.764+0000 7f757659c640 1 -- 172.21.15.90:0/646393000 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75780c6400 con 0x7f7578154040 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.765+0000 7f757659c640 1 --2- 172.21.15.90:0/646393000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578154040 0x7f75780c4bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75780c4a80 tx=0x7f756802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbaf71de4807ae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.765+0000 7f7575d9b640 1 -- 172.21.15.90:0/646393000 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568038070 con 0x7f7578154040 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.765+0000 7f7575d9b640 1 -- 172.21.15.90:0/646393000 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f756802f050 con 0x7f7578154040 2024-04-20T10:50:58.766 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.765+0000 7f7575d9b640 1 -- 172.21.15.90:0/646393000 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7568031970 con 0x7f7578154040 2024-04-20T10:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 -- 172.21.15.90:0/646393000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578154040 msgr2=0x7f75780c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 --2- 172.21.15.90:0/646393000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578154040 0x7f75780c4bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f75780c4a80 tx=0x7f756802b7f0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 -- 172.21.15.90:0/646393000 shutdown_connections 2024-04-20T10:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 --2- 172.21.15.90:0/646393000 >> v2:172.21.15.175:3300/0 conn(0x7f75780730e0 0x7f7578073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 --2- 172.21.15.90:0/646393000 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578154040 0x7f75780c4bb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 -- 172.21.15.90:0/646393000 >> 172.21.15.90:0/646393000 conn(0x7f75780676c0 msgr2=0x7f7578067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 -- 172.21.15.90:0/646393000 shutdown_connections 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.766+0000 7f757c811640 1 -- 172.21.15.90:0/646393000 wait complete. 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.767+0000 7f757c811640 1 Processor -- start 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.767+0000 7f757c811640 1 -- start start 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75780730e0 0x7f75781552d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7578154040 0x7f757806fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578159e00 0x7f75781ec510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f75780af020 con 0x7f7578159e00 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f75780aeea0 con 0x7f7578154040 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7578070520 con 0x7f75780730e0 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578159e00 0x7f75781ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578159e00 0x7f75781ec510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59274/0 (socket says 172.21.15.90:59274) 2024-04-20T10:50:58.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 -- 172.21.15.90:0/540280059 learned_addr learned my addr 172.21.15.90:0/540280059 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f756ffff640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7578154040 0x7f757806fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757659c640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75780730e0 0x7f75781552d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 -- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75780730e0 msgr2=0x7f75781552d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75780730e0 0x7f75781552d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 -- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7578154040 msgr2=0x7f757806fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7578154040 0x7f757806fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 -- 172.21.15.90:0/540280059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7578155810 con 0x7f7578159e00 2024-04-20T10:50:58.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f756ffff640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7578154040 0x7f757806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757659c640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75780730e0 0x7f75781552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f7576d9d640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578159e00 0x7f75781ec510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f757000b970 tx=0x7f757000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f756effd640 1 -- 172.21.15.90:0/540280059 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570019070 con 0x7f7578159e00 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f756effd640 1 -- 172.21.15.90:0/540280059 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f757000cb40 con 0x7f7578159e00 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7578155ab0 con 0x7f7578159e00 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f756effd640 1 -- 172.21.15.90:0/540280059 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7570014440 con 0x7f7578159e00 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.768+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757806eca0 con 0x7f7578159e00 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.769+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7578076150 con 0x7f7578159e00 2024-04-20T10:50:58.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.770+0000 7f756effd640 1 -- 172.21.15.90:0/540280059 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f757001c070 con 0x7f7578159e00 2024-04-20T10:50:58.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.770+0000 7f756effd640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f755806c8f0 0x7f755806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:58.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.770+0000 7f756effd640 1 -- 172.21.15.90:0/540280059 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f757008ba30 con 0x7f7578159e00 2024-04-20T10:50:58.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.770+0000 7f757659c640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f755806c8f0 0x7f755806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:58.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.771+0000 7f757659c640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f755806c8f0 0x7f755806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7568035000 tx=0x7f7568008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:58.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.775+0000 7f756effd640 1 -- 172.21.15.90:0/540280059 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7570059bc0 con 0x7f7578159e00 2024-04-20T10:50:58.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.946+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7578072ec0 con 0x7f755806c8f0 2024-04-20T10:50:58.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.957+0000 7f756effd640 1 -- 172.21.15.90:0/540280059 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490307 (secure 0 0 0) 0x7f7578072ec0 con 0x7f755806c8f0 2024-04-20T10:50:58.962 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:58.965 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f755806c8f0 msgr2=0x7f755806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f755806c8f0 0x7f755806edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7568035000 tx=0x7f7568008030 comp rx=0 tx=0).stop 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578159e00 msgr2=0x7f75781ec510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578159e00 0x7f75781ec510 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f757000b970 tx=0x7f757000be30 comp rx=0 tx=0).stop 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 shutdown_connections 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f755806c8f0 0x7f755806edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7578159e00 0x7f75781ec510 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7578154040 0x7f757806fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.960+0000 7f757c811640 1 --2- 172.21.15.90:0/540280059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f75780730e0 0x7f75781552d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:58.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.961+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 >> 172.21.15.90:0/540280059 conn(0x7f75780676c0 msgr2=0x7f7578067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:58.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.961+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 shutdown_connections 2024-04-20T10:50:58.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:58.961+0000 7f757c811640 1 -- 172.21.15.90:0/540280059 wait complete. 2024-04-20T10:50:58.972 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-20T10:50:57.666667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3448832,"data_stored":2021832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.040417"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646500+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:50:50.646500+0000","last_peered":"2024-04-20T10:50:50.646500+0000","last_clean":"2024-04-20T10:50:50.646500+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:50:50.646500+0000","last_undegraded":"2024-04-20T10:50:50.646500+0000","last_fullsized":"2024-04-20T10:50:50.646500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647942+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:50.647942+0000","last_peered":"2024-04-20T10:50:50.647942+0000","last_clean":"2024-04-20T10:50:50.647942+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:50.647942+0000","last_undegraded":"2024-04-20T10:50:50.647942+0000","last_fullsized":"2024-04-20T10:50:50.647942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647361+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:50:50.647361+0000","last_peered":"2024-04-20T10:50:50.647361+0000","last_clean":"2024-04-20T10:50:50.647361+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:50:50.647361+0000","last_undegraded":"2024-04-20T10:50:50.647361+0000","last_fullsized":"2024-04-20T10:50:50.647361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918471+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:50:50.918471+0000","last_peered":"2024-04-20T10:50:50.918471+0000","last_clean":"2024-04-20T10:50:50.918471+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:50:50.918471+0000","last_undegraded":"2024-04-20T10:50:50.918471+0000","last_fullsized":"2024-04-20T10:50:50.918471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648170+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:50.648170+0000","last_peered":"2024-04-20T10:50:50.648170+0000","last_clean":"2024-04-20T10:50:50.648170+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:50.648170+0000","last_undegraded":"2024-04-20T10:50:50.648170+0000","last_fullsized":"2024-04-20T10:50:50.648170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918903+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:50.918903+0000","last_peered":"2024-04-20T10:50:50.918903+0000","last_clean":"2024-04-20T10:50:50.918903+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:50.918903+0000","last_undegraded":"2024-04-20T10:50:50.918903+0000","last_fullsized":"2024-04-20T10:50:50.918903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646446+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:50:50.646446+0000","last_peered":"2024-04-20T10:50:50.646446+0000","last_clean":"2024-04-20T10:50:50.646446+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:50:50.646446+0000","last_undegraded":"2024-04-20T10:50:50.646446+0000","last_fullsized":"2024-04-20T10:50:50.646446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918478+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:50:50.918478+0000","last_peered":"2024-04-20T10:50:50.918478+0000","last_clean":"2024-04-20T10:50:50.918478+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:50:50.918478+0000","last_undegraded":"2024-04-20T10:50:50.918478+0000","last_fullsized":"2024-04-20T10:50:50.918478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920014+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:50.920014+0000","last_peered":"2024-04-20T10:50:50.920014+0000","last_clean":"2024-04-20T10:50:50.920014+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:50.920014+0000","last_undegraded":"2024-04-20T10:50:50.920014+0000","last_fullsized":"2024-04-20T10:50:50.920014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918841+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:50.918841+0000","last_peered":"2024-04-20T10:50:50.918841+0000","last_clean":"2024-04-20T10:50:50.918841+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:50.918841+0000","last_undegraded":"2024-04-20T10:50:50.918841+0000","last_fullsized":"2024-04-20T10:50:50.918841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646788+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:50:50.646788+0000","last_peered":"2024-04-20T10:50:50.646788+0000","last_clean":"2024-04-20T10:50:50.646788+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:50:50.646788+0000","last_undegraded":"2024-04-20T10:50:50.646788+0000","last_fullsized":"2024-04-20T10:50:50.646788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918243+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:50:50.918243+0000","last_peered":"2024-04-20T10:50:50.918243+0000","last_clean":"2024-04-20T10:50:50.918243+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:50:50.918243+0000","last_undegraded":"2024-04-20T10:50:50.918243+0000","last_fullsized":"2024-04-20T10:50:50.918243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919668+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:50.919668+0000","last_peered":"2024-04-20T10:50:50.919668+0000","last_clean":"2024-04-20T10:50:50.919668+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:50.919668+0000","last_undegraded":"2024-04-20T10:50:50.919668+0000","last_fullsized":"2024-04-20T10:50:50.919668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919525+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:50.919525+0000","last_peered":"2024-04-20T10:50:50.919525+0000","last_clean":"2024-04-20T10:50:50.919525+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:50.919525+0000","last_undegraded":"2024-04-20T10:50:50.919525+0000","last_fullsized":"2024-04-20T10:50:50.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646886+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:50:50.646886+0000","last_peered":"2024-04-20T10:50:50.646886+0000","last_clean":"2024-04-20T10:50:50.646886+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:50:50.646886+0000","last_undegraded":"2024-04-20T10:50:50.646886+0000","last_fullsized":"2024-04-20T10:50:50.646886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919828+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:50:50.919828+0000","last_peered":"2024-04-20T10:50:50.919828+0000","last_clean":"2024-04-20T10:50:50.919828+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:50:50.919828+0000","last_undegraded":"2024-04-20T10:50:50.919828+0000","last_fullsized":"2024-04-20T10:50:50.919828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647374+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:50:50.647374+0000","last_peered":"2024-04-20T10:50:50.647374+0000","last_clean":"2024-04-20T10:50:50.647374+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:50:50.647374+0000","last_undegraded":"2024-04-20T10:50:50.647374+0000","last_fullsized":"2024-04-20T10:50:50.647374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919489+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:50:50.919489+0000","last_peered":"2024-04-20T10:50:50.919489+0000","last_clean":"2024-04-20T10:50:50.919489+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:50:50.919489+0000","last_undegraded":"2024-04-20T10:50:50.919489+0000","last_fullsized":"2024-04-20T10:50:50.919489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647710+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:50.647710+0000","last_peered":"2024-04-20T10:50:50.647710+0000","last_clean":"2024-04-20T10:50:50.647710+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:50.647710+0000","last_undegraded":"2024-04-20T10:50:50.647710+0000","last_fullsized":"2024-04-20T10:50:50.647710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:07.016612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918599+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:50.918599+0000","last_peered":"2024-04-20T10:50:50.918599+0000","last_clean":"2024-04-20T10:50:50.918599+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:50.918599+0000","last_undegraded":"2024-04-20T10:50:50.918599+0000","last_fullsized":"2024-04-20T10:50:50.918599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647233+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:50:50.647233+0000","last_peered":"2024-04-20T10:50:50.647233+0000","last_clean":"2024-04-20T10:50:50.647233+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:50:50.647233+0000","last_undegraded":"2024-04-20T10:50:50.647233+0000","last_fullsized":"2024-04-20T10:50:50.647233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647083+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:50:50.647083+0000","last_peered":"2024-04-20T10:50:50.647083+0000","last_clean":"2024-04-20T10:50:50.647083+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:50:50.647083+0000","last_undegraded":"2024-04-20T10:50:50.647083+0000","last_fullsized":"2024-04-20T10:50:50.647083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647704+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:50.647704+0000","last_peered":"2024-04-20T10:50:50.647704+0000","last_clean":"2024-04-20T10:50:50.647704+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:50.647704+0000","last_undegraded":"2024-04-20T10:50:50.647704+0000","last_fullsized":"2024-04-20T10:50:50.647704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918767+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:50.918767+0000","last_peered":"2024-04-20T10:50:50.918767+0000","last_clean":"2024-04-20T10:50:50.918767+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:50.918767+0000","last_undegraded":"2024-04-20T10:50:50.918767+0000","last_fullsized":"2024-04-20T10:50:50.918767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919440+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:50:50.919440+0000","last_peered":"2024-04-20T10:50:50.919440+0000","last_clean":"2024-04-20T10:50:50.919440+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:50:50.919440+0000","last_undegraded":"2024-04-20T10:50:50.919440+0000","last_fullsized":"2024-04-20T10:50:50.919440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919258+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:50:50.919258+0000","last_peered":"2024-04-20T10:50:50.919258+0000","last_clean":"2024-04-20T10:50:50.919258+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:50:50.919258+0000","last_undegraded":"2024-04-20T10:50:50.919258+0000","last_fullsized":"2024-04-20T10:50:50.919258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647487+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:50.647487+0000","last_peered":"2024-04-20T10:50:50.647487+0000","last_clean":"2024-04-20T10:50:50.647487+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:50.647487+0000","last_undegraded":"2024-04-20T10:50:50.647487+0000","last_fullsized":"2024-04-20T10:50:50.647487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918378+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:50.918378+0000","last_peered":"2024-04-20T10:50:50.918378+0000","last_clean":"2024-04-20T10:50:50.918378+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:50.918378+0000","last_undegraded":"2024-04-20T10:50:50.918378+0000","last_fullsized":"2024-04-20T10:50:50.918378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647210+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:50:50.647210+0000","last_peered":"2024-04-20T10:50:50.647210+0000","last_clean":"2024-04-20T10:50:50.647210+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:50:50.647210+0000","last_undegraded":"2024-04-20T10:50:50.647210+0000","last_fullsized":"2024-04-20T10:50:50.647210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647499+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:50:50.647499+0000","last_peered":"2024-04-20T10:50:50.647499+0000","last_clean":"2024-04-20T10:50:50.647499+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:50:50.647499+0000","last_undegraded":"2024-04-20T10:50:50.647499+0000","last_fullsized":"2024-04-20T10:50:50.647499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919297+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:50.919297+0000","last_peered":"2024-04-20T10:50:50.919297+0000","last_clean":"2024-04-20T10:50:50.919297+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:50.919297+0000","last_undegraded":"2024-04-20T10:50:50.919297+0000","last_fullsized":"2024-04-20T10:50:50.919297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904955+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:50.904955+0000","last_peered":"2024-04-20T10:50:50.904955+0000","last_clean":"2024-04-20T10:50:50.904955+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:50.904955+0000","last_undegraded":"2024-04-20T10:50:50.904955+0000","last_fullsized":"2024-04-20T10:50:50.904955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647061+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:50:50.647061+0000","last_peered":"2024-04-20T10:50:50.647061+0000","last_clean":"2024-04-20T10:50:50.647061+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:50:50.647061+0000","last_undegraded":"2024-04-20T10:50:50.647061+0000","last_fullsized":"2024-04-20T10:50:50.647061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646640+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:50:50.646640+0000","last_peered":"2024-04-20T10:50:50.646640+0000","last_clean":"2024-04-20T10:50:50.646640+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:50:50.646640+0000","last_undegraded":"2024-04-20T10:50:50.646640+0000","last_fullsized":"2024-04-20T10:50:50.646640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647815+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:50.647815+0000","last_peered":"2024-04-20T10:50:50.647815+0000","last_clean":"2024-04-20T10:50:50.647815+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:50.647815+0000","last_undegraded":"2024-04-20T10:50:50.647815+0000","last_fullsized":"2024-04-20T10:50:50.647815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919903+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:50.919903+0000","last_peered":"2024-04-20T10:50:50.919903+0000","last_clean":"2024-04-20T10:50:50.919903+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:50.919903+0000","last_undegraded":"2024-04-20T10:50:50.919903+0000","last_fullsized":"2024-04-20T10:50:50.919903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647184+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:50:50.647184+0000","last_peered":"2024-04-20T10:50:50.647184+0000","last_clean":"2024-04-20T10:50:50.647184+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:50:50.647184+0000","last_undegraded":"2024-04-20T10:50:50.647184+0000","last_fullsized":"2024-04-20T10:50:50.647184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904364+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:50:50.904364+0000","last_peered":"2024-04-20T10:50:50.904364+0000","last_clean":"2024-04-20T10:50:50.904364+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:50:50.904364+0000","last_undegraded":"2024-04-20T10:50:50.904364+0000","last_fullsized":"2024-04-20T10:50:50.904364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919960+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:50.919960+0000","last_peered":"2024-04-20T10:50:50.919960+0000","last_clean":"2024-04-20T10:50:50.919960+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:50.919960+0000","last_undegraded":"2024-04-20T10:50:50.919960+0000","last_fullsized":"2024-04-20T10:50:50.919960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920149+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:50.920149+0000","last_peered":"2024-04-20T10:50:50.920149+0000","last_clean":"2024-04-20T10:50:50.920149+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:50.920149+0000","last_undegraded":"2024-04-20T10:50:50.920149+0000","last_fullsized":"2024-04-20T10:50:50.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919053+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:50:50.919053+0000","last_peered":"2024-04-20T10:50:50.919053+0000","last_clean":"2024-04-20T10:50:50.919053+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:50:50.919053+0000","last_undegraded":"2024-04-20T10:50:50.919053+0000","last_fullsized":"2024-04-20T10:50:50.919053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919594+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:50.919594+0000","last_peered":"2024-04-20T10:50:50.919594+0000","last_clean":"2024-04-20T10:50:50.919594+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:50.919594+0000","last_undegraded":"2024-04-20T10:50:50.919594+0000","last_fullsized":"2024-04-20T10:50:50.919594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919993+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:50.919993+0000","last_peered":"2024-04-20T10:50:50.919993+0000","last_clean":"2024-04-20T10:50:50.919993+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:50.919993+0000","last_undegraded":"2024-04-20T10:50:50.919993+0000","last_fullsized":"2024-04-20T10:50:50.919993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918452+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:50:50.918452+0000","last_peered":"2024-04-20T10:50:50.918452+0000","last_clean":"2024-04-20T10:50:50.918452+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:50:50.918452+0000","last_undegraded":"2024-04-20T10:50:50.918452+0000","last_fullsized":"2024-04-20T10:50:50.918452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918934+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:50:50.918934+0000","last_peered":"2024-04-20T10:50:50.918934+0000","last_clean":"2024-04-20T10:50:50.918934+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:50:50.918934+0000","last_undegraded":"2024-04-20T10:50:50.918934+0000","last_fullsized":"2024-04-20T10:50:50.918934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647503+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:50.647503+0000","last_peered":"2024-04-20T10:50:50.647503+0000","last_clean":"2024-04-20T10:50:50.647503+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:50.647503+0000","last_undegraded":"2024-04-20T10:50:50.647503+0000","last_fullsized":"2024-04-20T10:50:50.647503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919438+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:50.919438+0000","last_peered":"2024-04-20T10:50:50.919438+0000","last_clean":"2024-04-20T10:50:50.919438+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:50.919438+0000","last_undegraded":"2024-04-20T10:50:50.919438+0000","last_fullsized":"2024-04-20T10:50:50.919438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918697+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:50:50.918697+0000","last_peered":"2024-04-20T10:50:50.918697+0000","last_clean":"2024-04-20T10:50:50.918697+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:50:50.918697+0000","last_undegraded":"2024-04-20T10:50:50.918697+0000","last_fullsized":"2024-04-20T10:50:50.918697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918186+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:50.918186+0000","last_peered":"2024-04-20T10:50:50.918186+0000","last_clean":"2024-04-20T10:50:50.918186+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:50.918186+0000","last_undegraded":"2024-04-20T10:50:50.918186+0000","last_fullsized":"2024-04-20T10:50:50.918186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919238+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:50.919238+0000","last_peered":"2024-04-20T10:50:50.919238+0000","last_clean":"2024-04-20T10:50:50.919238+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:50.919238+0000","last_undegraded":"2024-04-20T10:50:50.919238+0000","last_fullsized":"2024-04-20T10:50:50.919238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919687+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:50:50.919687+0000","last_peered":"2024-04-20T10:50:50.919687+0000","last_clean":"2024-04-20T10:50:50.919687+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:50:50.919687+0000","last_undegraded":"2024-04-20T10:50:50.919687+0000","last_fullsized":"2024-04-20T10:50:50.919687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918605+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:50.918605+0000","last_peered":"2024-04-20T10:50:50.918605+0000","last_clean":"2024-04-20T10:50:50.918605+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:50.918605+0000","last_undegraded":"2024-04-20T10:50:50.918605+0000","last_fullsized":"2024-04-20T10:50:50.918605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918474+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:50.918474+0000","last_peered":"2024-04-20T10:50:50.918474+0000","last_clean":"2024-04-20T10:50:50.918474+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:50.918474+0000","last_undegraded":"2024-04-20T10:50:50.918474+0000","last_fullsized":"2024-04-20T10:50:50.918474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919237+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:50:50.919237+0000","last_peered":"2024-04-20T10:50:50.919237+0000","last_clean":"2024-04-20T10:50:50.919237+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:50:50.919237+0000","last_undegraded":"2024-04-20T10:50:50.919237+0000","last_fullsized":"2024-04-20T10:50:50.919237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919239+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:50:50.919239+0000","last_peered":"2024-04-20T10:50:50.919239+0000","last_clean":"2024-04-20T10:50:50.919239+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:50:50.919239+0000","last_undegraded":"2024-04-20T10:50:50.919239+0000","last_fullsized":"2024-04-20T10:50:50.919239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647940+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:50.647940+0000","last_peered":"2024-04-20T10:50:50.647940+0000","last_clean":"2024-04-20T10:50:50.647940+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:50.647940+0000","last_undegraded":"2024-04-20T10:50:50.647940+0000","last_fullsized":"2024-04-20T10:50:50.647940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918168+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:50.918168+0000","last_peered":"2024-04-20T10:50:50.918168+0000","last_clean":"2024-04-20T10:50:50.918168+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:50.918168+0000","last_undegraded":"2024-04-20T10:50:50.918168+0000","last_fullsized":"2024-04-20T10:50:50.918168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918735+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:50.918735+0000","last_peered":"2024-04-20T10:50:50.918735+0000","last_clean":"2024-04-20T10:50:50.918735+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:50.918735+0000","last_undegraded":"2024-04-20T10:50:50.918735+0000","last_fullsized":"2024-04-20T10:50:50.918735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904495+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:50:50.904495+0000","last_peered":"2024-04-20T10:50:50.904495+0000","last_clean":"2024-04-20T10:50:50.904495+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:50:50.904495+0000","last_undegraded":"2024-04-20T10:50:50.904495+0000","last_fullsized":"2024-04-20T10:50:50.904495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920137+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:50:50.920137+0000","last_peered":"2024-04-20T10:50:50.920137+0000","last_clean":"2024-04-20T10:50:50.920137+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:50:50.920137+0000","last_undegraded":"2024-04-20T10:50:50.920137+0000","last_fullsized":"2024-04-20T10:50:50.920137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919949+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:50.919949+0000","last_peered":"2024-04-20T10:50:50.919949+0000","last_clean":"2024-04-20T10:50:50.919949+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:50.919949+0000","last_undegraded":"2024-04-20T10:50:50.919949+0000","last_fullsized":"2024-04-20T10:50:50.919949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920093+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:50.920093+0000","last_peered":"2024-04-20T10:50:50.920093+0000","last_clean":"2024-04-20T10:50:50.920093+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:50.920093+0000","last_undegraded":"2024-04-20T10:50:50.920093+0000","last_fullsized":"2024-04-20T10:50:50.920093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904372+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:50:50.904372+0000","last_peered":"2024-04-20T10:50:50.904372+0000","last_clean":"2024-04-20T10:50:50.904372+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:50:50.904372+0000","last_undegraded":"2024-04-20T10:50:50.904372+0000","last_fullsized":"2024-04-20T10:50:50.904372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918546+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:50:50.918546+0000","last_peered":"2024-04-20T10:50:50.918546+0000","last_clean":"2024-04-20T10:50:50.918546+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:50:50.918546+0000","last_undegraded":"2024-04-20T10:50:50.918546+0000","last_fullsized":"2024-04-20T10:50:50.918546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919184+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:50.919184+0000","last_peered":"2024-04-20T10:50:50.919184+0000","last_clean":"2024-04-20T10:50:50.919184+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:50.919184+0000","last_undegraded":"2024-04-20T10:50:50.919184+0000","last_fullsized":"2024-04-20T10:50:50.919184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920068+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:50.920068+0000","last_peered":"2024-04-20T10:50:50.920068+0000","last_clean":"2024-04-20T10:50:50.920068+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:50.920068+0000","last_undegraded":"2024-04-20T10:50:50.920068+0000","last_fullsized":"2024-04-20T10:50:50.920068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918899+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:50:50.918899+0000","last_peered":"2024-04-20T10:50:50.918899+0000","last_clean":"2024-04-20T10:50:50.918899+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:50:50.918899+0000","last_undegraded":"2024-04-20T10:50:50.918899+0000","last_fullsized":"2024-04-20T10:50:50.918899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918088+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:50:50.918088+0000","last_peered":"2024-04-20T10:50:50.918088+0000","last_clean":"2024-04-20T10:50:50.918088+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:50:50.918088+0000","last_undegraded":"2024-04-20T10:50:50.918088+0000","last_fullsized":"2024-04-20T10:50:50.918088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920183+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:50.920183+0000","last_peered":"2024-04-20T10:50:50.920183+0000","last_clean":"2024-04-20T10:50:50.920183+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:50.920183+0000","last_undegraded":"2024-04-20T10:50:50.920183+0000","last_fullsized":"2024-04-20T10:50:50.920183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918853+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:50.918853+0000","last_peered":"2024-04-20T10:50:50.918853+0000","last_clean":"2024-04-20T10:50:50.918853+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:50.918853+0000","last_undegraded":"2024-04-20T10:50:50.918853+0000","last_fullsized":"2024-04-20T10:50:50.918853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918057+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:50:50.918057+0000","last_peered":"2024-04-20T10:50:50.918057+0000","last_clean":"2024-04-20T10:50:50.918057+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:50:50.918057+0000","last_undegraded":"2024-04-20T10:50:50.918057+0000","last_fullsized":"2024-04-20T10:50:50.918057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919612+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:50:50.919612+0000","last_peered":"2024-04-20T10:50:50.919612+0000","last_clean":"2024-04-20T10:50:50.919612+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:50:50.919612+0000","last_undegraded":"2024-04-20T10:50:50.919612+0000","last_fullsized":"2024-04-20T10:50:50.919612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647644+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:50.647644+0000","last_peered":"2024-04-20T10:50:50.647644+0000","last_clean":"2024-04-20T10:50:50.647644+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:50.647644+0000","last_undegraded":"2024-04-20T10:50:50.647644+0000","last_fullsized":"2024-04-20T10:50:50.647644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646587+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:50:50.646587+0000","last_peered":"2024-04-20T10:50:50.646587+0000","last_clean":"2024-04-20T10:50:50.646587+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:50:50.646587+0000","last_undegraded":"2024-04-20T10:50:50.646587+0000","last_fullsized":"2024-04-20T10:50:50.646587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647705+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:50:50.647705+0000","last_peered":"2024-04-20T10:50:50.647705+0000","last_clean":"2024-04-20T10:50:50.647705+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:50:50.647705+0000","last_undegraded":"2024-04-20T10:50:50.647705+0000","last_fullsized":"2024-04-20T10:50:50.647705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918736+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:50.918736+0000","last_peered":"2024-04-20T10:50:50.918736+0000","last_clean":"2024-04-20T10:50:50.918736+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:50.918736+0000","last_undegraded":"2024-04-20T10:50:50.918736+0000","last_fullsized":"2024-04-20T10:50:50.918736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918257+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:50.918257+0000","last_peered":"2024-04-20T10:50:50.918257+0000","last_clean":"2024-04-20T10:50:50.918257+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:50.918257+0000","last_undegraded":"2024-04-20T10:50:50.918257+0000","last_fullsized":"2024-04-20T10:50:50.918257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919316+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:50:50.919316+0000","last_peered":"2024-04-20T10:50:50.919316+0000","last_clean":"2024-04-20T10:50:50.919316+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:50:50.919316+0000","last_undegraded":"2024-04-20T10:50:50.919316+0000","last_fullsized":"2024-04-20T10:50:50.919316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918977+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:50:50.918977+0000","last_peered":"2024-04-20T10:50:50.918977+0000","last_clean":"2024-04-20T10:50:50.918977+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:50:50.918977+0000","last_undegraded":"2024-04-20T10:50:50.918977+0000","last_fullsized":"2024-04-20T10:50:50.918977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904080+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:50.904080+0000","last_peered":"2024-04-20T10:50:50.904080+0000","last_clean":"2024-04-20T10:50:50.904080+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:50.904080+0000","last_undegraded":"2024-04-20T10:50:50.904080+0000","last_fullsized":"2024-04-20T10:50:50.904080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904487+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:50.904487+0000","last_peered":"2024-04-20T10:50:50.904487+0000","last_clean":"2024-04-20T10:50:50.904487+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:50.904487+0000","last_undegraded":"2024-04-20T10:50:50.904487+0000","last_fullsized":"2024-04-20T10:50:50.904487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647768+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:50:50.647768+0000","last_peered":"2024-04-20T10:50:50.647768+0000","last_clean":"2024-04-20T10:50:50.647768+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:50:50.647768+0000","last_undegraded":"2024-04-20T10:50:50.647768+0000","last_fullsized":"2024-04-20T10:50:50.647768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918820+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:50:50.918820+0000","last_peered":"2024-04-20T10:50:50.918820+0000","last_clean":"2024-04-20T10:50:50.918820+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:50:50.918820+0000","last_undegraded":"2024-04-20T10:50:50.918820+0000","last_fullsized":"2024-04-20T10:50:50.918820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919283+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:50.919283+0000","last_peered":"2024-04-20T10:50:50.919283+0000","last_clean":"2024-04-20T10:50:50.919283+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:50.919283+0000","last_undegraded":"2024-04-20T10:50:50.919283+0000","last_fullsized":"2024-04-20T10:50:50.919283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919373+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:50.919373+0000","last_peered":"2024-04-20T10:50:50.919373+0000","last_clean":"2024-04-20T10:50:50.919373+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:50.919373+0000","last_undegraded":"2024-04-20T10:50:50.919373+0000","last_fullsized":"2024-04-20T10:50:50.919373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648175+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:50:50.648175+0000","last_peered":"2024-04-20T10:50:50.648175+0000","last_clean":"2024-04-20T10:50:50.648175+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:50:50.648175+0000","last_undegraded":"2024-04-20T10:50:50.648175+0000","last_fullsized":"2024-04-20T10:50:50.648175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648149+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:50:50.648149+0000","last_peered":"2024-04-20T10:50:50.648149+0000","last_clean":"2024-04-20T10:50:50.648149+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:50:50.648149+0000","last_undegraded":"2024-04-20T10:50:50.648149+0000","last_fullsized":"2024-04-20T10:50:50.648149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918773+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:50.918773+0000","last_peered":"2024-04-20T10:50:50.918773+0000","last_clean":"2024-04-20T10:50:50.918773+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:50.918773+0000","last_undegraded":"2024-04-20T10:50:50.918773+0000","last_fullsized":"2024-04-20T10:50:50.918773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919619+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:50.919619+0000","last_peered":"2024-04-20T10:50:50.919619+0000","last_clean":"2024-04-20T10:50:50.919619+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:50.919619+0000","last_undegraded":"2024-04-20T10:50:50.919619+0000","last_fullsized":"2024-04-20T10:50:50.919619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919480+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:50:50.919480+0000","last_peered":"2024-04-20T10:50:50.919480+0000","last_clean":"2024-04-20T10:50:50.919480+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:50:50.919480+0000","last_undegraded":"2024-04-20T10:50:50.919480+0000","last_fullsized":"2024-04-20T10:50:50.919480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647622+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:50:50.647622+0000","last_peered":"2024-04-20T10:50:50.647622+0000","last_clean":"2024-04-20T10:50:50.647622+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:50:50.647622+0000","last_undegraded":"2024-04-20T10:50:50.647622+0000","last_fullsized":"2024-04-20T10:50:50.647622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919782+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:50.919782+0000","last_peered":"2024-04-20T10:50:50.919782+0000","last_clean":"2024-04-20T10:50:50.919782+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:50.919782+0000","last_undegraded":"2024-04-20T10:50:50.919782+0000","last_fullsized":"2024-04-20T10:50:50.919782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904433+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:50:50.904433+0000","last_peered":"2024-04-20T10:50:50.904433+0000","last_clean":"2024-04-20T10:50:50.904433+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:50:50.904433+0000","last_undegraded":"2024-04-20T10:50:50.904433+0000","last_fullsized":"2024-04-20T10:50:50.904433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918370+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:50:50.918370+0000","last_peered":"2024-04-20T10:50:50.918370+0000","last_clean":"2024-04-20T10:50:50.918370+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:50:50.918370+0000","last_undegraded":"2024-04-20T10:50:50.918370+0000","last_fullsized":"2024-04-20T10:50:50.918370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918531+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:50:50.918531+0000","last_peered":"2024-04-20T10:50:50.918531+0000","last_clean":"2024-04-20T10:50:50.918531+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:50:50.918531+0000","last_undegraded":"2024-04-20T10:50:50.918531+0000","last_fullsized":"2024-04-20T10:50:50.918531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647604+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:50.647604+0000","last_peered":"2024-04-20T10:50:50.647604+0000","last_clean":"2024-04-20T10:50:50.647604+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:50.647604+0000","last_undegraded":"2024-04-20T10:50:50.647604+0000","last_fullsized":"2024-04-20T10:50:50.647604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647241+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:50:50.647241+0000","last_peered":"2024-04-20T10:50:50.647241+0000","last_clean":"2024-04-20T10:50:50.647241+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:50:50.647241+0000","last_undegraded":"2024-04-20T10:50:50.647241+0000","last_fullsized":"2024-04-20T10:50:50.647241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904476+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:50:50.904476+0000","last_peered":"2024-04-20T10:50:50.904476+0000","last_clean":"2024-04-20T10:50:50.904476+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:50:50.904476+0000","last_undegraded":"2024-04-20T10:50:50.904476+0000","last_fullsized":"2024-04-20T10:50:50.904476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919071+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:50.919071+0000","last_peered":"2024-04-20T10:50:50.919071+0000","last_clean":"2024-04-20T10:50:50.919071+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:50.919071+0000","last_undegraded":"2024-04-20T10:50:50.919071+0000","last_fullsized":"2024-04-20T10:50:50.919071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919039+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:50.919039+0000","last_peered":"2024-04-20T10:50:50.919039+0000","last_clean":"2024-04-20T10:50:50.919039+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:50.919039+0000","last_undegraded":"2024-04-20T10:50:50.919039+0000","last_fullsized":"2024-04-20T10:50:50.919039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647348+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:50:50.647348+0000","last_peered":"2024-04-20T10:50:50.647348+0000","last_clean":"2024-04-20T10:50:50.647348+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:50:50.647348+0000","last_undegraded":"2024-04-20T10:50:50.647348+0000","last_fullsized":"2024-04-20T10:50:50.647348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918201+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:50:50.918201+0000","last_peered":"2024-04-20T10:50:50.918201+0000","last_clean":"2024-04-20T10:50:50.918201+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:50:50.918201+0000","last_undegraded":"2024-04-20T10:50:50.918201+0000","last_fullsized":"2024-04-20T10:50:50.918201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919011+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:50.919011+0000","last_peered":"2024-04-20T10:50:50.919011+0000","last_clean":"2024-04-20T10:50:50.919011+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:50.919011+0000","last_undegraded":"2024-04-20T10:50:50.919011+0000","last_fullsized":"2024-04-20T10:50:50.919011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904919+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:50.904919+0000","last_peered":"2024-04-20T10:50:50.904919+0000","last_clean":"2024-04-20T10:50:50.904919+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:50.904919+0000","last_undegraded":"2024-04-20T10:50:50.904919+0000","last_fullsized":"2024-04-20T10:50:50.904919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647257+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:50:50.647257+0000","last_peered":"2024-04-20T10:50:50.647257+0000","last_clean":"2024-04-20T10:50:50.647257+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:50:50.647257+0000","last_undegraded":"2024-04-20T10:50:50.647257+0000","last_fullsized":"2024-04-20T10:50:50.647257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904798+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:50:50.904798+0000","last_peered":"2024-04-20T10:50:50.904798+0000","last_clean":"2024-04-20T10:50:50.904798+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:50:50.904798+0000","last_undegraded":"2024-04-20T10:50:50.904798+0000","last_fullsized":"2024-04-20T10:50:50.904798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919143+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:50:50.919143+0000","last_peered":"2024-04-20T10:50:50.919143+0000","last_clean":"2024-04-20T10:50:50.919143+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:50:50.919143+0000","last_undegraded":"2024-04-20T10:50:50.919143+0000","last_fullsized":"2024-04-20T10:50:50.919143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918587+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:50.918587+0000","last_peered":"2024-04-20T10:50:50.918587+0000","last_clean":"2024-04-20T10:50:50.918587+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:50.918587+0000","last_undegraded":"2024-04-20T10:50:50.918587+0000","last_fullsized":"2024-04-20T10:50:50.918587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918226+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:50.918226+0000","last_peered":"2024-04-20T10:50:50.918226+0000","last_clean":"2024-04-20T10:50:50.918226+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:50.918226+0000","last_undegraded":"2024-04-20T10:50:50.918226+0000","last_fullsized":"2024-04-20T10:50:50.918226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919055+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:50:50.919055+0000","last_peered":"2024-04-20T10:50:50.919055+0000","last_clean":"2024-04-20T10:50:50.919055+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:50:50.919055+0000","last_undegraded":"2024-04-20T10:50:50.919055+0000","last_fullsized":"2024-04-20T10:50:50.919055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904885+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:50:50.904885+0000","last_peered":"2024-04-20T10:50:50.904885+0000","last_clean":"2024-04-20T10:50:50.904885+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:50:50.904885+0000","last_undegraded":"2024-04-20T10:50:50.904885+0000","last_fullsized":"2024-04-20T10:50:50.904885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647617+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:50.647617+0000","last_peered":"2024-04-20T10:50:50.647617+0000","last_clean":"2024-04-20T10:50:50.647617+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:50.647617+0000","last_undegraded":"2024-04-20T10:50:50.647617+0000","last_fullsized":"2024-04-20T10:50:50.647617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647427+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:50.647427+0000","last_peered":"2024-04-20T10:50:50.647427+0000","last_clean":"2024-04-20T10:50:50.647427+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:50.647427+0000","last_undegraded":"2024-04-20T10:50:50.647427+0000","last_fullsized":"2024-04-20T10:50:50.647427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919353+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:50:50.919353+0000","last_peered":"2024-04-20T10:50:50.919353+0000","last_clean":"2024-04-20T10:50:50.919353+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:50:50.919353+0000","last_undegraded":"2024-04-20T10:50:50.919353+0000","last_fullsized":"2024-04-20T10:50:50.919353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904598+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:50.904598+0000","last_peered":"2024-04-20T10:50:50.904598+0000","last_clean":"2024-04-20T10:50:50.904598+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:50.904598+0000","last_undegraded":"2024-04-20T10:50:50.904598+0000","last_fullsized":"2024-04-20T10:50:50.904598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919448+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:50.919448+0000","last_peered":"2024-04-20T10:50:50.919448+0000","last_clean":"2024-04-20T10:50:50.919448+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:50.919448+0000","last_undegraded":"2024-04-20T10:50:50.919448+0000","last_fullsized":"2024-04-20T10:50:50.919448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919923+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:50:50.919923+0000","last_peered":"2024-04-20T10:50:50.919923+0000","last_clean":"2024-04-20T10:50:50.919923+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:50:50.919923+0000","last_undegraded":"2024-04-20T10:50:50.919923+0000","last_fullsized":"2024-04-20T10:50:50.919923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646954+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:50:50.646954+0000","last_peered":"2024-04-20T10:50:50.646954+0000","last_clean":"2024-04-20T10:50:50.646954+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:50:50.646954+0000","last_undegraded":"2024-04-20T10:50:50.646954+0000","last_fullsized":"2024-04-20T10:50:50.646954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647875+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:50.647875+0000","last_peered":"2024-04-20T10:50:50.647875+0000","last_clean":"2024-04-20T10:50:50.647875+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:50.647875+0000","last_undegraded":"2024-04-20T10:50:50.647875+0000","last_fullsized":"2024-04-20T10:50:50.647875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647129+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:50.647129+0000","last_peered":"2024-04-20T10:50:50.647129+0000","last_clean":"2024-04-20T10:50:50.647129+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:50.647129+0000","last_undegraded":"2024-04-20T10:50:50.647129+0000","last_fullsized":"2024-04-20T10:50:50.647129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648051+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:50:50.648051+0000","last_peered":"2024-04-20T10:50:50.648051+0000","last_clean":"2024-04-20T10:50:50.648051+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:50:50.648051+0000","last_undegraded":"2024-04-20T10:50:50.648051+0000","last_fullsized":"2024-04-20T10:50:50.648051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648041+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:50:50.648041+0000","last_peered":"2024-04-20T10:50:50.648041+0000","last_clean":"2024-04-20T10:50:50.648041+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:50:50.648041+0000","last_undegraded":"2024-04-20T10:50:50.648041+0000","last_fullsized":"2024-04-20T10:50:50.648041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904067+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:50.904067+0000","last_peered":"2024-04-20T10:50:50.904067+0000","last_clean":"2024-04-20T10:50:50.904067+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:50.904067+0000","last_undegraded":"2024-04-20T10:50:50.904067+0000","last_fullsized":"2024-04-20T10:50:50.904067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919274+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:50:50.919274+0000","last_peered":"2024-04-20T10:50:50.919274+0000","last_clean":"2024-04-20T10:50:50.919274+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:50:50.919274+0000","last_undegraded":"2024-04-20T10:50:50.919274+0000","last_fullsized":"2024-04-20T10:50:50.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918980+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:50.918980+0000","last_peered":"2024-04-20T10:50:50.918980+0000","last_clean":"2024-04-20T10:50:50.918980+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:50.918980+0000","last_undegraded":"2024-04-20T10:50:50.918980+0000","last_fullsized":"2024-04-20T10:50:50.918980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918617+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:50:50.918617+0000","last_peered":"2024-04-20T10:50:50.918617+0000","last_clean":"2024-04-20T10:50:50.918617+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:50:50.918617+0000","last_undegraded":"2024-04-20T10:50:50.918617+0000","last_fullsized":"2024-04-20T10:50:50.918617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919308+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:50.919308+0000","last_peered":"2024-04-20T10:50:50.919308+0000","last_clean":"2024-04-20T10:50:50.919308+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:50.919308+0000","last_undegraded":"2024-04-20T10:50:50.919308+0000","last_fullsized":"2024-04-20T10:50:50.919308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919405+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:50.919405+0000","last_peered":"2024-04-20T10:50:50.919405+0000","last_clean":"2024-04-20T10:50:50.919405+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:50.919405+0000","last_undegraded":"2024-04-20T10:50:50.919405+0000","last_fullsized":"2024-04-20T10:50:50.919405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918338+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:50:50.918338+0000","last_peered":"2024-04-20T10:50:50.918338+0000","last_clean":"2024-04-20T10:50:50.918338+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:50:50.918338+0000","last_undegraded":"2024-04-20T10:50:50.918338+0000","last_fullsized":"2024-04-20T10:50:50.918338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648264+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:50.648264+0000","last_peered":"2024-04-20T10:50:50.648264+0000","last_clean":"2024-04-20T10:50:50.648264+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:50.648264+0000","last_undegraded":"2024-04-20T10:50:50.648264+0000","last_fullsized":"2024-04-20T10:50:50.648264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647153+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:50:50.647153+0000","last_peered":"2024-04-20T10:50:50.647153+0000","last_clean":"2024-04-20T10:50:50.647153+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:50:50.647153+0000","last_undegraded":"2024-04-20T10:50:50.647153+0000","last_fullsized":"2024-04-20T10:50:50.647153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919569+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:50.919569+0000","last_peered":"2024-04-20T10:50:50.919569+0000","last_clean":"2024-04-20T10:50:50.919569+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:50.919569+0000","last_undegraded":"2024-04-20T10:50:50.919569+0000","last_fullsized":"2024-04-20T10:50:50.919569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904775+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:50.904775+0000","last_peered":"2024-04-20T10:50:50.904775+0000","last_clean":"2024-04-20T10:50:50.904775+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:50.904775+0000","last_undegraded":"2024-04-20T10:50:50.904775+0000","last_fullsized":"2024-04-20T10:50:50.904775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904299+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:50:50.904299+0000","last_peered":"2024-04-20T10:50:50.904299+0000","last_clean":"2024-04-20T10:50:50.904299+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:50:50.904299+0000","last_undegraded":"2024-04-20T10:50:50.904299+0000","last_fullsized":"2024-04-20T10:50:50.904299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647767+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:50.647767+0000","last_peered":"2024-04-20T10:50:50.647767+0000","last_clean":"2024-04-20T10:50:50.647767+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:50.647767+0000","last_undegraded":"2024-04-20T10:50:50.647767+0000","last_fullsized":"2024-04-20T10:50:50.647767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647843+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:50:50.647843+0000","last_peered":"2024-04-20T10:50:50.647843+0000","last_clean":"2024-04-20T10:50:50.647843+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:50:50.647843+0000","last_undegraded":"2024-04-20T10:50:50.647843+0000","last_fullsized":"2024-04-20T10:50:50.647843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918116+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:50.918116+0000","last_peered":"2024-04-20T10:50:50.918116+0000","last_clean":"2024-04-20T10:50:50.918116+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:50.918116+0000","last_undegraded":"2024-04-20T10:50:50.918116+0000","last_fullsized":"2024-04-20T10:50:50.918116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920306+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:50:50.920306+0000","last_peered":"2024-04-20T10:50:50.920306+0000","last_clean":"2024-04-20T10:50:50.920306+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:50:50.920306+0000","last_undegraded":"2024-04-20T10:50:50.920306+0000","last_fullsized":"2024-04-20T10:50:50.920306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647324+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:50.647324+0000","last_peered":"2024-04-20T10:50:50.647324+0000","last_clean":"2024-04-20T10:50:50.647324+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:50.647324+0000","last_undegraded":"2024-04-20T10:50:50.647324+0000","last_fullsized":"2024-04-20T10:50:50.647324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919821+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:50:50.919821+0000","last_peered":"2024-04-20T10:50:50.919821+0000","last_clean":"2024-04-20T10:50:50.919821+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:50:50.919821+0000","last_undegraded":"2024-04-20T10:50:50.919821+0000","last_fullsized":"2024-04-20T10:50:50.919821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919185+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:50.919185+0000","last_peered":"2024-04-20T10:50:50.919185+0000","last_clean":"2024-04-20T10:50:50.919185+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:50.919185+0000","last_undegraded":"2024-04-20T10:50:50.919185+0000","last_fullsized":"2024-04-20T10:50:50.919185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647822+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:50:50.647822+0000","last_peered":"2024-04-20T10:50:50.647822+0000","last_clean":"2024-04-20T10:50:50.647822+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:50:50.647822+0000","last_undegraded":"2024-04-20T10:50:50.647822+0000","last_fullsized":"2024-04-20T10:50:50.647822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919221+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:50.919221+0000","last_peered":"2024-04-20T10:50:50.919221+0000","last_clean":"2024-04-20T10:50:50.919221+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:50.919221+0000","last_undegraded":"2024-04-20T10:50:50.919221+0000","last_fullsized":"2024-04-20T10:50:50.919221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646687+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:50:50.646687+0000","last_peered":"2024-04-20T10:50:50.646687+0000","last_clean":"2024-04-20T10:50:50.646687+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:50:50.646687+0000","last_undegraded":"2024-04-20T10:50:50.646687+0000","last_fullsized":"2024-04-20T10:50:50.646687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904324+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:50.904324+0000","last_peered":"2024-04-20T10:50:50.904324+0000","last_clean":"2024-04-20T10:50:50.904324+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:50.904324+0000","last_undegraded":"2024-04-20T10:50:50.904324+0000","last_fullsized":"2024-04-20T10:50:50.904324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646680+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:50:50.646680+0000","last_peered":"2024-04-20T10:50:50.646680+0000","last_clean":"2024-04-20T10:50:50.646680+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:50:50.646680+0000","last_undegraded":"2024-04-20T10:50:50.646680+0000","last_fullsized":"2024-04-20T10:50:50.646680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920058+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:50.920058+0000","last_peered":"2024-04-20T10:50:50.920058+0000","last_clean":"2024-04-20T10:50:50.920058+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:50.920058+0000","last_undegraded":"2024-04-20T10:50:50.920058+0000","last_fullsized":"2024-04-20T10:50:50.920058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918048+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:50:50.918048+0000","last_peered":"2024-04-20T10:50:50.918048+0000","last_clean":"2024-04-20T10:50:50.918048+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:50:50.918048+0000","last_undegraded":"2024-04-20T10:50:50.918048+0000","last_fullsized":"2024-04-20T10:50:50.918048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918749+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:50.918749+0000","last_peered":"2024-04-20T10:50:50.918749+0000","last_clean":"2024-04-20T10:50:50.918749+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:50.918749+0000","last_undegraded":"2024-04-20T10:50:50.918749+0000","last_fullsized":"2024-04-20T10:50:50.918749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918281+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:50:50.918281+0000","last_peered":"2024-04-20T10:50:50.918281+0000","last_clean":"2024-04-20T10:50:50.918281+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:50:50.918281+0000","last_undegraded":"2024-04-20T10:50:50.918281+0000","last_fullsized":"2024-04-20T10:50:50.918281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919598+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:50.919598+0000","last_peered":"2024-04-20T10:50:50.919598+0000","last_clean":"2024-04-20T10:50:50.919598+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:50.919598+0000","last_undegraded":"2024-04-20T10:50:50.919598+0000","last_fullsized":"2024-04-20T10:50:50.919598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919839+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:50:50.919839+0000","last_peered":"2024-04-20T10:50:50.919839+0000","last_clean":"2024-04-20T10:50:50.919839+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:50:50.919839+0000","last_undegraded":"2024-04-20T10:50:50.919839+0000","last_fullsized":"2024-04-20T10:50:50.919839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918109+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:50.918109+0000","last_peered":"2024-04-20T10:50:50.918109+0000","last_clean":"2024-04-20T10:50:50.918109+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:50.918109+0000","last_undegraded":"2024-04-20T10:50:50.918109+0000","last_fullsized":"2024-04-20T10:50:50.918109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647462+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:50:50.647462+0000","last_peered":"2024-04-20T10:50:50.647462+0000","last_clean":"2024-04-20T10:50:50.647462+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:50:50.647462+0000","last_undegraded":"2024-04-20T10:50:50.647462+0000","last_fullsized":"2024-04-20T10:50:50.647462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918682+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:50.918682+0000","last_peered":"2024-04-20T10:50:50.918682+0000","last_clean":"2024-04-20T10:50:50.918682+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:50.918682+0000","last_undegraded":"2024-04-20T10:50:50.918682+0000","last_fullsized":"2024-04-20T10:50:50.918682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918787+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:50:50.918787+0000","last_peered":"2024-04-20T10:50:50.918787+0000","last_clean":"2024-04-20T10:50:50.918787+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:50:50.918787+0000","last_undegraded":"2024-04-20T10:50:50.918787+0000","last_fullsized":"2024-04-20T10:50:50.918787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918739+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:50.918739+0000","last_peered":"2024-04-20T10:50:50.918739+0000","last_clean":"2024-04-20T10:50:50.918739+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:50.918739+0000","last_undegraded":"2024-04-20T10:50:50.918739+0000","last_fullsized":"2024-04-20T10:50:50.918739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647651+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:50.647651+0000","last_peered":"2024-04-20T10:50:50.647651+0000","last_clean":"2024-04-20T10:50:50.647651+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:50.647651+0000","last_undegraded":"2024-04-20T10:50:50.647651+0000","last_fullsized":"2024-04-20T10:50:50.647651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647567+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:50.647567+0000","last_peered":"2024-04-20T10:50:50.647567+0000","last_clean":"2024-04-20T10:50:50.647567+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:50.647567+0000","last_undegraded":"2024-04-20T10:50:50.647567+0000","last_fullsized":"2024-04-20T10:50:50.647567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919983+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:50:50.919983+0000","last_peered":"2024-04-20T10:50:50.919983+0000","last_clean":"2024-04-20T10:50:50.919983+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:50:50.919983+0000","last_undegraded":"2024-04-20T10:50:50.919983+0000","last_fullsized":"2024-04-20T10:50:50.919983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918676+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:50:50.918676+0000","last_peered":"2024-04-20T10:50:50.918676+0000","last_clean":"2024-04-20T10:50:50.918676+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:50:50.918676+0000","last_undegraded":"2024-04-20T10:50:50.918676+0000","last_fullsized":"2024-04-20T10:50:50.918676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904771+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:50.904771+0000","last_peered":"2024-04-20T10:50:50.904771+0000","last_clean":"2024-04-20T10:50:50.904771+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:50.904771+0000","last_undegraded":"2024-04-20T10:50:50.904771+0000","last_fullsized":"2024-04-20T10:50:50.904771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918237+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:50:50.918237+0000","last_peered":"2024-04-20T10:50:50.918237+0000","last_clean":"2024-04-20T10:50:50.918237+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:50:50.918237+0000","last_undegraded":"2024-04-20T10:50:50.918237+0000","last_fullsized":"2024-04-20T10:50:50.918237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920158+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:50.920158+0000","last_peered":"2024-04-20T10:50:50.920158+0000","last_clean":"2024-04-20T10:50:50.920158+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:50.920158+0000","last_undegraded":"2024-04-20T10:50:50.920158+0000","last_fullsized":"2024-04-20T10:50:50.920158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647709+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:50:50.647709+0000","last_peered":"2024-04-20T10:50:50.647709+0000","last_clean":"2024-04-20T10:50:50.647709+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:50:50.647709+0000","last_undegraded":"2024-04-20T10:50:50.647709+0000","last_fullsized":"2024-04-20T10:50:50.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647411+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:50.647411+0000","last_peered":"2024-04-20T10:50:50.647411+0000","last_clean":"2024-04-20T10:50:50.647411+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:50.647411+0000","last_undegraded":"2024-04-20T10:50:50.647411+0000","last_fullsized":"2024-04-20T10:50:50.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904808+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:50:50.904808+0000","last_peered":"2024-04-20T10:50:50.904808+0000","last_clean":"2024-04-20T10:50:50.904808+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:50:50.904808+0000","last_undegraded":"2024-04-20T10:50:50.904808+0000","last_fullsized":"2024-04-20T10:50:50.904808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918551+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:50.918551+0000","last_peered":"2024-04-20T10:50:50.918551+0000","last_clean":"2024-04-20T10:50:50.918551+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:50.918551+0000","last_undegraded":"2024-04-20T10:50:50.918551+0000","last_fullsized":"2024-04-20T10:50:50.918551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919755+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:50:50.919755+0000","last_peered":"2024-04-20T10:50:50.919755+0000","last_clean":"2024-04-20T10:50:50.919755+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:50:50.919755+0000","last_undegraded":"2024-04-20T10:50:50.919755+0000","last_fullsized":"2024-04-20T10:50:50.919755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919134+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:50.919134+0000","last_peered":"2024-04-20T10:50:50.919134+0000","last_clean":"2024-04-20T10:50:50.919134+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:50.919134+0000","last_undegraded":"2024-04-20T10:50:50.919134+0000","last_fullsized":"2024-04-20T10:50:50.919134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919397+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:50:50.919397+0000","last_peered":"2024-04-20T10:50:50.919397+0000","last_clean":"2024-04-20T10:50:50.919397+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:50:50.919397+0000","last_undegraded":"2024-04-20T10:50:50.919397+0000","last_fullsized":"2024-04-20T10:50:50.919397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919182+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:50.919182+0000","last_peered":"2024-04-20T10:50:50.919182+0000","last_clean":"2024-04-20T10:50:50.919182+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:50.919182+0000","last_undegraded":"2024-04-20T10:50:50.919182+0000","last_fullsized":"2024-04-20T10:50:50.919182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919141+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:50.919141+0000","last_peered":"2024-04-20T10:50:50.919141+0000","last_clean":"2024-04-20T10:50:50.919141+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:50.919141+0000","last_undegraded":"2024-04-20T10:50:50.919141+0000","last_fullsized":"2024-04-20T10:50:50.919141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919836+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:50:50.919836+0000","last_peered":"2024-04-20T10:50:50.919836+0000","last_clean":"2024-04-20T10:50:50.919836+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:50:50.919836+0000","last_undegraded":"2024-04-20T10:50:50.919836+0000","last_fullsized":"2024-04-20T10:50:50.919836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919036+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:50.919036+0000","last_peered":"2024-04-20T10:50:50.919036+0000","last_clean":"2024-04-20T10:50:50.919036+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:50.919036+0000","last_undegraded":"2024-04-20T10:50:50.919036+0000","last_fullsized":"2024-04-20T10:50:50.919036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918038+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:50:50.918038+0000","last_peered":"2024-04-20T10:50:50.918038+0000","last_clean":"2024-04-20T10:50:50.918038+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:50:50.918038+0000","last_undegraded":"2024-04-20T10:50:50.918038+0000","last_fullsized":"2024-04-20T10:50:50.918038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919810+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:50.919810+0000","last_peered":"2024-04-20T10:50:50.919810+0000","last_clean":"2024-04-20T10:50:50.919810+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:50.919810+0000","last_undegraded":"2024-04-20T10:50:50.919810+0000","last_fullsized":"2024-04-20T10:50:50.919810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918353+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:50:50.918353+0000","last_peered":"2024-04-20T10:50:50.918353+0000","last_clean":"2024-04-20T10:50:50.918353+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:50:50.918353+0000","last_undegraded":"2024-04-20T10:50:50.918353+0000","last_fullsized":"2024-04-20T10:50:50.918353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920113+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:50.920113+0000","last_peered":"2024-04-20T10:50:50.920113+0000","last_clean":"2024-04-20T10:50:50.920113+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:50.920113+0000","last_undegraded":"2024-04-20T10:50:50.920113+0000","last_fullsized":"2024-04-20T10:50:50.920113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":106160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:50:58.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:50:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.108+0000 7f5d964eb640 1 Processor -- start 2024-04-20T10:50:59.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.108+0000 7f5d964eb640 1 -- start start 2024-04-20T10:50:59.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d964eb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d9014e810 0x7f5d90154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d964eb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d90154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d964eb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5d90155170 0x7f5d900c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d964eb640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5d9014ebf0 con 0x7f5d9014e810 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d964eb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5d90070730 con 0x7f5d90155170 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d964eb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9006feb0 con 0x7f5d90073030 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d9014e810 0x7f5d90154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5d9014e810 0x7f5d90154610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59280/0 (socket says 172.21.15.90:59280) 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 -- 172.21.15.90:0/1575454792 learned_addr learned my addr 172.21.15.90:0/1575454792 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 -- 172.21.15.90:0/1575454792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 msgr2=0x7f5d90154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d94a88640 1 --2- 172.21.15.90:0/1575454792 >> v2:172.21.15.175:3300/0 conn(0x7f5d90155170 0x7f5d900c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8f7fe640 1 --2- 172.21.15.90:0/1575454792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d90154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 --2- 172.21.15.90:0/1575454792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d90154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 -- 172.21.15.90:0/1575454792 >> v2:172.21.15.175:3300/0 conn(0x7f5d90155170 msgr2=0x7f5d900c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 --2- 172.21.15.90:0/1575454792 >> v2:172.21.15.175:3300/0 conn(0x7f5d90155170 0x7f5d900c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.109+0000 7f5d8ffff640 1 -- 172.21.15.90:0/1575454792 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d90073530 con 0x7f5d9014e810 2024-04-20T10:50:59.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.110+0000 7f5d8f7fe640 1 --2- 172.21.15.90:0/1575454792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d90154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.110+0000 7f5d94a88640 1 --2- 172.21.15.90:0/1575454792 >> v2:172.21.15.175:3300/0 conn(0x7f5d90155170 0x7f5d900c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:50:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.110+0000 7f5d8ffff640 1 --2- 172.21.15.90:0/1575454792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d9014e810 0x7f5d90154610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d900c79e0 tx=0x7f5d8002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182364ac96bfb9c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.110+0000 7f5d8effd640 1 -- 172.21.15.90:0/1575454792 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80035020 con 0x7f5d9014e810 2024-04-20T10:50:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.110+0000 7f5d8effd640 1 -- 172.21.15.90:0/1575454792 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8002d040 con 0x7f5d9014e810 2024-04-20T10:50:59.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.110+0000 7f5d8effd640 1 -- 172.21.15.90:0/1575454792 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d80031a80 con 0x7f5d9014e810 2024-04-20T10:50:59.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 -- 172.21.15.90:0/1575454792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d9014e810 msgr2=0x7f5d90154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 --2- 172.21.15.90:0/1575454792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d9014e810 0x7f5d90154610 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d900c79e0 tx=0x7f5d8002b900 comp rx=0 tx=0).stop 2024-04-20T10:50:59.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 -- 172.21.15.90:0/1575454792 shutdown_connections 2024-04-20T10:50:59.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 --2- 172.21.15.90:0/1575454792 >> v2:172.21.15.175:3300/0 conn(0x7f5d90155170 0x7f5d900c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 --2- 172.21.15.90:0/1575454792 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d90154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 --2- 172.21.15.90:0/1575454792 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d9014e810 0x7f5d90154610 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 -- 172.21.15.90:0/1575454792 >> 172.21.15.90:0/1575454792 conn(0x7f5d900676c0 msgr2=0x7f5d90067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 -- 172.21.15.90:0/1575454792 shutdown_connections 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.111+0000 7f5d964eb640 1 -- 172.21.15.90:0/1575454792 wait complete. 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.112+0000 7f5d964eb640 1 Processor -- start 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.112+0000 7f5d964eb640 1 -- start start 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d964eb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d901491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d964eb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d9014e810 0x7f5d901489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d964eb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d90155170 0x7f5d9006dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d964eb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5d9006f650 con 0x7f5d90155170 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d964eb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5d90070450 con 0x7f5d9014e810 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d964eb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5d900c65b0 con 0x7f5d90073030 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d90155170 0x7f5d9006dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d90155170 0x7f5d9006dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59286/0 (socket says 172.21.15.90:59286) 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 -- 172.21.15.90:0/2436093747 learned_addr learned my addr 172.21.15.90:0/2436093747 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:59.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d8f7fe640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d9014e810 0x7f5d901489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d8ffff640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d901491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 -- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 msgr2=0x7f5d901491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d901491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 -- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d9014e810 msgr2=0x7f5d901489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d9014e810 0x7f5d901489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 -- 172.21.15.90:0/2436093747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d9006d220 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.113+0000 7f5d94a88640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d90155170 0x7f5d9006dd10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800cef0 tx=0x7f5d8800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.114+0000 7f5d8cff9640 1 -- 172.21.15.90:0/2436093747 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8801a070 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.114+0000 7f5d8cff9640 1 -- 172.21.15.90:0/2436093747 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d8800d860 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.114+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d90148ee0 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.114+0000 7f5d8cff9640 1 -- 172.21.15.90:0/2436093747 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800dc50 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.114+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d9014c1a0 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.115+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d90076150 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.115+0000 7f5d8cff9640 1 -- 172.21.15.90:0/2436093747 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5d8801d070 con 0x7f5d90155170 2024-04-20T10:50:59.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.115+0000 7f5d8cff9640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5d7c06c8f0 0x7f5d7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.116+0000 7f5d8cff9640 1 -- 172.21.15.90:0/2436093747 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f5d8808c600 con 0x7f5d90155170 2024-04-20T10:50:59.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.116+0000 7f5d8ffff640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5d7c06c8f0 0x7f5d7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.116+0000 7f5d8ffff640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5d7c06c8f0 0x7f5d7c06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d80036000 tx=0x7f5d8003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.120+0000 7f5d8cff9640 1 -- 172.21.15.90:0/2436093747 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5d8805a850 con 0x7f5d90155170 2024-04-20T10:50:59.293 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.293+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5d90151eb0 con 0x7f5d7c06c8f0 2024-04-20T10:50:59.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.303+0000 7f5d8cff9640 1 -- 172.21.15.90:0/2436093747 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490307 (secure 0 0 0) 0x7f5d90151eb0 con 0x7f5d7c06c8f0 2024-04-20T10:50:59.309 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:59.312 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:50:59.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5d7c06c8f0 msgr2=0x7f5d7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5d7c06c8f0 0x7f5d7c06edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d80036000 tx=0x7f5d8003c040 comp rx=0 tx=0).stop 2024-04-20T10:50:59.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d90155170 msgr2=0x7f5d9006dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d90155170 0x7f5d9006dd10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800cef0 tx=0x7f5d8800a710 comp rx=0 tx=0).stop 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 shutdown_connections 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5d7c06c8f0 0x7f5d7c06edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5d90155170 0x7f5d9006dd10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5d9014e810 0x7f5d901489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 --2- 172.21.15.90:0/2436093747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5d90073030 0x7f5d901491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.307+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 >> 172.21.15.90:0/2436093747 conn(0x7f5d900676c0 msgr2=0x7f5d90067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.308+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 shutdown_connections 2024-04-20T10:50:59.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.308+0000 7f5d964eb640 1 -- 172.21.15.90:0/2436093747 wait complete. 2024-04-20T10:50:59.318 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-04-20T10:50:57.666667+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595188,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":249,"num_write_kb":2444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219560,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755160,"statfs":{"total":773094113280,"available":772869283840,"internally_reserved":0,"allocated":3448832,"data_stored":2021832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.040417"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646500+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:50:50.646500+0000","last_peered":"2024-04-20T10:50:50.646500+0000","last_clean":"2024-04-20T10:50:50.646500+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:50:50.646500+0000","last_undegraded":"2024-04-20T10:50:50.646500+0000","last_fullsized":"2024-04-20T10:50:50.646500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647942+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:50.647942+0000","last_peered":"2024-04-20T10:50:50.647942+0000","last_clean":"2024-04-20T10:50:50.647942+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:50.647942+0000","last_undegraded":"2024-04-20T10:50:50.647942+0000","last_fullsized":"2024-04-20T10:50:50.647942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647361+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:50:50.647361+0000","last_peered":"2024-04-20T10:50:50.647361+0000","last_clean":"2024-04-20T10:50:50.647361+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:50:50.647361+0000","last_undegraded":"2024-04-20T10:50:50.647361+0000","last_fullsized":"2024-04-20T10:50:50.647361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918471+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:50:50.918471+0000","last_peered":"2024-04-20T10:50:50.918471+0000","last_clean":"2024-04-20T10:50:50.918471+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:50:50.918471+0000","last_undegraded":"2024-04-20T10:50:50.918471+0000","last_fullsized":"2024-04-20T10:50:50.918471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648170+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:50.648170+0000","last_peered":"2024-04-20T10:50:50.648170+0000","last_clean":"2024-04-20T10:50:50.648170+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:50.648170+0000","last_undegraded":"2024-04-20T10:50:50.648170+0000","last_fullsized":"2024-04-20T10:50:50.648170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918903+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:50.918903+0000","last_peered":"2024-04-20T10:50:50.918903+0000","last_clean":"2024-04-20T10:50:50.918903+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:50.918903+0000","last_undegraded":"2024-04-20T10:50:50.918903+0000","last_fullsized":"2024-04-20T10:50:50.918903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646446+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:50:50.646446+0000","last_peered":"2024-04-20T10:50:50.646446+0000","last_clean":"2024-04-20T10:50:50.646446+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:50:50.646446+0000","last_undegraded":"2024-04-20T10:50:50.646446+0000","last_fullsized":"2024-04-20T10:50:50.646446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918478+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:50:50.918478+0000","last_peered":"2024-04-20T10:50:50.918478+0000","last_clean":"2024-04-20T10:50:50.918478+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:50:50.918478+0000","last_undegraded":"2024-04-20T10:50:50.918478+0000","last_fullsized":"2024-04-20T10:50:50.918478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920014+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:50.920014+0000","last_peered":"2024-04-20T10:50:50.920014+0000","last_clean":"2024-04-20T10:50:50.920014+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:50.920014+0000","last_undegraded":"2024-04-20T10:50:50.920014+0000","last_fullsized":"2024-04-20T10:50:50.920014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918841+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:50.918841+0000","last_peered":"2024-04-20T10:50:50.918841+0000","last_clean":"2024-04-20T10:50:50.918841+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:50.918841+0000","last_undegraded":"2024-04-20T10:50:50.918841+0000","last_fullsized":"2024-04-20T10:50:50.918841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646788+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:50:50.646788+0000","last_peered":"2024-04-20T10:50:50.646788+0000","last_clean":"2024-04-20T10:50:50.646788+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:50:50.646788+0000","last_undegraded":"2024-04-20T10:50:50.646788+0000","last_fullsized":"2024-04-20T10:50:50.646788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918243+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:50:50.918243+0000","last_peered":"2024-04-20T10:50:50.918243+0000","last_clean":"2024-04-20T10:50:50.918243+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:50:50.918243+0000","last_undegraded":"2024-04-20T10:50:50.918243+0000","last_fullsized":"2024-04-20T10:50:50.918243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919668+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:50.919668+0000","last_peered":"2024-04-20T10:50:50.919668+0000","last_clean":"2024-04-20T10:50:50.919668+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:50.919668+0000","last_undegraded":"2024-04-20T10:50:50.919668+0000","last_fullsized":"2024-04-20T10:50:50.919668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919525+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:50.919525+0000","last_peered":"2024-04-20T10:50:50.919525+0000","last_clean":"2024-04-20T10:50:50.919525+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:50.919525+0000","last_undegraded":"2024-04-20T10:50:50.919525+0000","last_fullsized":"2024-04-20T10:50:50.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646886+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:50:50.646886+0000","last_peered":"2024-04-20T10:50:50.646886+0000","last_clean":"2024-04-20T10:50:50.646886+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:50:50.646886+0000","last_undegraded":"2024-04-20T10:50:50.646886+0000","last_fullsized":"2024-04-20T10:50:50.646886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919828+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:50:50.919828+0000","last_peered":"2024-04-20T10:50:50.919828+0000","last_clean":"2024-04-20T10:50:50.919828+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:50:50.919828+0000","last_undegraded":"2024-04-20T10:50:50.919828+0000","last_fullsized":"2024-04-20T10:50:50.919828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647374+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:50:50.647374+0000","last_peered":"2024-04-20T10:50:50.647374+0000","last_clean":"2024-04-20T10:50:50.647374+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:50:50.647374+0000","last_undegraded":"2024-04-20T10:50:50.647374+0000","last_fullsized":"2024-04-20T10:50:50.647374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919489+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:50:50.919489+0000","last_peered":"2024-04-20T10:50:50.919489+0000","last_clean":"2024-04-20T10:50:50.919489+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:50:50.919489+0000","last_undegraded":"2024-04-20T10:50:50.919489+0000","last_fullsized":"2024-04-20T10:50:50.919489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647710+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:50.647710+0000","last_peered":"2024-04-20T10:50:50.647710+0000","last_clean":"2024-04-20T10:50:50.647710+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:50.647710+0000","last_undegraded":"2024-04-20T10:50:50.647710+0000","last_fullsized":"2024-04-20T10:50:50.647710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:07.016612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918599+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:50.918599+0000","last_peered":"2024-04-20T10:50:50.918599+0000","last_clean":"2024-04-20T10:50:50.918599+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:50.918599+0000","last_undegraded":"2024-04-20T10:50:50.918599+0000","last_fullsized":"2024-04-20T10:50:50.918599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647233+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:50:50.647233+0000","last_peered":"2024-04-20T10:50:50.647233+0000","last_clean":"2024-04-20T10:50:50.647233+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:50:50.647233+0000","last_undegraded":"2024-04-20T10:50:50.647233+0000","last_fullsized":"2024-04-20T10:50:50.647233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647083+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:50:50.647083+0000","last_peered":"2024-04-20T10:50:50.647083+0000","last_clean":"2024-04-20T10:50:50.647083+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:50:50.647083+0000","last_undegraded":"2024-04-20T10:50:50.647083+0000","last_fullsized":"2024-04-20T10:50:50.647083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647704+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:50.647704+0000","last_peered":"2024-04-20T10:50:50.647704+0000","last_clean":"2024-04-20T10:50:50.647704+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:50.647704+0000","last_undegraded":"2024-04-20T10:50:50.647704+0000","last_fullsized":"2024-04-20T10:50:50.647704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918767+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:50.918767+0000","last_peered":"2024-04-20T10:50:50.918767+0000","last_clean":"2024-04-20T10:50:50.918767+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:50.918767+0000","last_undegraded":"2024-04-20T10:50:50.918767+0000","last_fullsized":"2024-04-20T10:50:50.918767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919440+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:50:50.919440+0000","last_peered":"2024-04-20T10:50:50.919440+0000","last_clean":"2024-04-20T10:50:50.919440+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:50:50.919440+0000","last_undegraded":"2024-04-20T10:50:50.919440+0000","last_fullsized":"2024-04-20T10:50:50.919440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919258+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:50:50.919258+0000","last_peered":"2024-04-20T10:50:50.919258+0000","last_clean":"2024-04-20T10:50:50.919258+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:50:50.919258+0000","last_undegraded":"2024-04-20T10:50:50.919258+0000","last_fullsized":"2024-04-20T10:50:50.919258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647487+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:50.647487+0000","last_peered":"2024-04-20T10:50:50.647487+0000","last_clean":"2024-04-20T10:50:50.647487+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:50.647487+0000","last_undegraded":"2024-04-20T10:50:50.647487+0000","last_fullsized":"2024-04-20T10:50:50.647487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918378+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:50.918378+0000","last_peered":"2024-04-20T10:50:50.918378+0000","last_clean":"2024-04-20T10:50:50.918378+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:50.918378+0000","last_undegraded":"2024-04-20T10:50:50.918378+0000","last_fullsized":"2024-04-20T10:50:50.918378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647210+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:50:50.647210+0000","last_peered":"2024-04-20T10:50:50.647210+0000","last_clean":"2024-04-20T10:50:50.647210+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:50:50.647210+0000","last_undegraded":"2024-04-20T10:50:50.647210+0000","last_fullsized":"2024-04-20T10:50:50.647210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647499+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:50:50.647499+0000","last_peered":"2024-04-20T10:50:50.647499+0000","last_clean":"2024-04-20T10:50:50.647499+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:50:50.647499+0000","last_undegraded":"2024-04-20T10:50:50.647499+0000","last_fullsized":"2024-04-20T10:50:50.647499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919297+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:50.919297+0000","last_peered":"2024-04-20T10:50:50.919297+0000","last_clean":"2024-04-20T10:50:50.919297+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:50.919297+0000","last_undegraded":"2024-04-20T10:50:50.919297+0000","last_fullsized":"2024-04-20T10:50:50.919297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904955+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:50.904955+0000","last_peered":"2024-04-20T10:50:50.904955+0000","last_clean":"2024-04-20T10:50:50.904955+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:50.904955+0000","last_undegraded":"2024-04-20T10:50:50.904955+0000","last_fullsized":"2024-04-20T10:50:50.904955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647061+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:50:50.647061+0000","last_peered":"2024-04-20T10:50:50.647061+0000","last_clean":"2024-04-20T10:50:50.647061+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:50:50.647061+0000","last_undegraded":"2024-04-20T10:50:50.647061+0000","last_fullsized":"2024-04-20T10:50:50.647061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646640+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:50:50.646640+0000","last_peered":"2024-04-20T10:50:50.646640+0000","last_clean":"2024-04-20T10:50:50.646640+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:50:50.646640+0000","last_undegraded":"2024-04-20T10:50:50.646640+0000","last_fullsized":"2024-04-20T10:50:50.646640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647815+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:50.647815+0000","last_peered":"2024-04-20T10:50:50.647815+0000","last_clean":"2024-04-20T10:50:50.647815+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:50.647815+0000","last_undegraded":"2024-04-20T10:50:50.647815+0000","last_fullsized":"2024-04-20T10:50:50.647815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919903+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:50.919903+0000","last_peered":"2024-04-20T10:50:50.919903+0000","last_clean":"2024-04-20T10:50:50.919903+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:50.919903+0000","last_undegraded":"2024-04-20T10:50:50.919903+0000","last_fullsized":"2024-04-20T10:50:50.919903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647184+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:50:50.647184+0000","last_peered":"2024-04-20T10:50:50.647184+0000","last_clean":"2024-04-20T10:50:50.647184+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:50:50.647184+0000","last_undegraded":"2024-04-20T10:50:50.647184+0000","last_fullsized":"2024-04-20T10:50:50.647184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904364+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:50:50.904364+0000","last_peered":"2024-04-20T10:50:50.904364+0000","last_clean":"2024-04-20T10:50:50.904364+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:50:50.904364+0000","last_undegraded":"2024-04-20T10:50:50.904364+0000","last_fullsized":"2024-04-20T10:50:50.904364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919960+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:50.919960+0000","last_peered":"2024-04-20T10:50:50.919960+0000","last_clean":"2024-04-20T10:50:50.919960+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:50.919960+0000","last_undegraded":"2024-04-20T10:50:50.919960+0000","last_fullsized":"2024-04-20T10:50:50.919960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920149+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:50.920149+0000","last_peered":"2024-04-20T10:50:50.920149+0000","last_clean":"2024-04-20T10:50:50.920149+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:50.920149+0000","last_undegraded":"2024-04-20T10:50:50.920149+0000","last_fullsized":"2024-04-20T10:50:50.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919053+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:50:50.919053+0000","last_peered":"2024-04-20T10:50:50.919053+0000","last_clean":"2024-04-20T10:50:50.919053+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:50:50.919053+0000","last_undegraded":"2024-04-20T10:50:50.919053+0000","last_fullsized":"2024-04-20T10:50:50.919053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919594+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:50.919594+0000","last_peered":"2024-04-20T10:50:50.919594+0000","last_clean":"2024-04-20T10:50:50.919594+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:50.919594+0000","last_undegraded":"2024-04-20T10:50:50.919594+0000","last_fullsized":"2024-04-20T10:50:50.919594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919993+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:50.919993+0000","last_peered":"2024-04-20T10:50:50.919993+0000","last_clean":"2024-04-20T10:50:50.919993+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:50.919993+0000","last_undegraded":"2024-04-20T10:50:50.919993+0000","last_fullsized":"2024-04-20T10:50:50.919993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918452+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:50:50.918452+0000","last_peered":"2024-04-20T10:50:50.918452+0000","last_clean":"2024-04-20T10:50:50.918452+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:50:50.918452+0000","last_undegraded":"2024-04-20T10:50:50.918452+0000","last_fullsized":"2024-04-20T10:50:50.918452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918934+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:50:50.918934+0000","last_peered":"2024-04-20T10:50:50.918934+0000","last_clean":"2024-04-20T10:50:50.918934+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:50:50.918934+0000","last_undegraded":"2024-04-20T10:50:50.918934+0000","last_fullsized":"2024-04-20T10:50:50.918934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647503+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:50.647503+0000","last_peered":"2024-04-20T10:50:50.647503+0000","last_clean":"2024-04-20T10:50:50.647503+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:50.647503+0000","last_undegraded":"2024-04-20T10:50:50.647503+0000","last_fullsized":"2024-04-20T10:50:50.647503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919438+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:50.919438+0000","last_peered":"2024-04-20T10:50:50.919438+0000","last_clean":"2024-04-20T10:50:50.919438+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:50.919438+0000","last_undegraded":"2024-04-20T10:50:50.919438+0000","last_fullsized":"2024-04-20T10:50:50.919438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918697+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:50:50.918697+0000","last_peered":"2024-04-20T10:50:50.918697+0000","last_clean":"2024-04-20T10:50:50.918697+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:50:50.918697+0000","last_undegraded":"2024-04-20T10:50:50.918697+0000","last_fullsized":"2024-04-20T10:50:50.918697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918186+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:50.918186+0000","last_peered":"2024-04-20T10:50:50.918186+0000","last_clean":"2024-04-20T10:50:50.918186+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:50.918186+0000","last_undegraded":"2024-04-20T10:50:50.918186+0000","last_fullsized":"2024-04-20T10:50:50.918186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919238+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:50.919238+0000","last_peered":"2024-04-20T10:50:50.919238+0000","last_clean":"2024-04-20T10:50:50.919238+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:50.919238+0000","last_undegraded":"2024-04-20T10:50:50.919238+0000","last_fullsized":"2024-04-20T10:50:50.919238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919687+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:50:50.919687+0000","last_peered":"2024-04-20T10:50:50.919687+0000","last_clean":"2024-04-20T10:50:50.919687+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:50:50.919687+0000","last_undegraded":"2024-04-20T10:50:50.919687+0000","last_fullsized":"2024-04-20T10:50:50.919687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918605+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:50.918605+0000","last_peered":"2024-04-20T10:50:50.918605+0000","last_clean":"2024-04-20T10:50:50.918605+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:50.918605+0000","last_undegraded":"2024-04-20T10:50:50.918605+0000","last_fullsized":"2024-04-20T10:50:50.918605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918474+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:50.918474+0000","last_peered":"2024-04-20T10:50:50.918474+0000","last_clean":"2024-04-20T10:50:50.918474+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:50.918474+0000","last_undegraded":"2024-04-20T10:50:50.918474+0000","last_fullsized":"2024-04-20T10:50:50.918474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919237+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:50:50.919237+0000","last_peered":"2024-04-20T10:50:50.919237+0000","last_clean":"2024-04-20T10:50:50.919237+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:50:50.919237+0000","last_undegraded":"2024-04-20T10:50:50.919237+0000","last_fullsized":"2024-04-20T10:50:50.919237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919239+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:50:50.919239+0000","last_peered":"2024-04-20T10:50:50.919239+0000","last_clean":"2024-04-20T10:50:50.919239+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:50:50.919239+0000","last_undegraded":"2024-04-20T10:50:50.919239+0000","last_fullsized":"2024-04-20T10:50:50.919239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647940+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:50.647940+0000","last_peered":"2024-04-20T10:50:50.647940+0000","last_clean":"2024-04-20T10:50:50.647940+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:50.647940+0000","last_undegraded":"2024-04-20T10:50:50.647940+0000","last_fullsized":"2024-04-20T10:50:50.647940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918168+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:50.918168+0000","last_peered":"2024-04-20T10:50:50.918168+0000","last_clean":"2024-04-20T10:50:50.918168+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:50.918168+0000","last_undegraded":"2024-04-20T10:50:50.918168+0000","last_fullsized":"2024-04-20T10:50:50.918168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918735+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:50.918735+0000","last_peered":"2024-04-20T10:50:50.918735+0000","last_clean":"2024-04-20T10:50:50.918735+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:50.918735+0000","last_undegraded":"2024-04-20T10:50:50.918735+0000","last_fullsized":"2024-04-20T10:50:50.918735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904495+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:50:50.904495+0000","last_peered":"2024-04-20T10:50:50.904495+0000","last_clean":"2024-04-20T10:50:50.904495+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:50:50.904495+0000","last_undegraded":"2024-04-20T10:50:50.904495+0000","last_fullsized":"2024-04-20T10:50:50.904495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920137+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:50:50.920137+0000","last_peered":"2024-04-20T10:50:50.920137+0000","last_clean":"2024-04-20T10:50:50.920137+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:50:50.920137+0000","last_undegraded":"2024-04-20T10:50:50.920137+0000","last_fullsized":"2024-04-20T10:50:50.920137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919949+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:50.919949+0000","last_peered":"2024-04-20T10:50:50.919949+0000","last_clean":"2024-04-20T10:50:50.919949+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:50.919949+0000","last_undegraded":"2024-04-20T10:50:50.919949+0000","last_fullsized":"2024-04-20T10:50:50.919949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920093+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:50.920093+0000","last_peered":"2024-04-20T10:50:50.920093+0000","last_clean":"2024-04-20T10:50:50.920093+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:50.920093+0000","last_undegraded":"2024-04-20T10:50:50.920093+0000","last_fullsized":"2024-04-20T10:50:50.920093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904372+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:50:50.904372+0000","last_peered":"2024-04-20T10:50:50.904372+0000","last_clean":"2024-04-20T10:50:50.904372+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:50:50.904372+0000","last_undegraded":"2024-04-20T10:50:50.904372+0000","last_fullsized":"2024-04-20T10:50:50.904372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918546+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:50:50.918546+0000","last_peered":"2024-04-20T10:50:50.918546+0000","last_clean":"2024-04-20T10:50:50.918546+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:50:50.918546+0000","last_undegraded":"2024-04-20T10:50:50.918546+0000","last_fullsized":"2024-04-20T10:50:50.918546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919184+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:50.919184+0000","last_peered":"2024-04-20T10:50:50.919184+0000","last_clean":"2024-04-20T10:50:50.919184+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:50.919184+0000","last_undegraded":"2024-04-20T10:50:50.919184+0000","last_fullsized":"2024-04-20T10:50:50.919184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920068+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:50.920068+0000","last_peered":"2024-04-20T10:50:50.920068+0000","last_clean":"2024-04-20T10:50:50.920068+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:50.920068+0000","last_undegraded":"2024-04-20T10:50:50.920068+0000","last_fullsized":"2024-04-20T10:50:50.920068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918899+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:50:50.918899+0000","last_peered":"2024-04-20T10:50:50.918899+0000","last_clean":"2024-04-20T10:50:50.918899+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:50:50.918899+0000","last_undegraded":"2024-04-20T10:50:50.918899+0000","last_fullsized":"2024-04-20T10:50:50.918899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918088+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:50:50.918088+0000","last_peered":"2024-04-20T10:50:50.918088+0000","last_clean":"2024-04-20T10:50:50.918088+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:50:50.918088+0000","last_undegraded":"2024-04-20T10:50:50.918088+0000","last_fullsized":"2024-04-20T10:50:50.918088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920183+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:50.920183+0000","last_peered":"2024-04-20T10:50:50.920183+0000","last_clean":"2024-04-20T10:50:50.920183+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:50.920183+0000","last_undegraded":"2024-04-20T10:50:50.920183+0000","last_fullsized":"2024-04-20T10:50:50.920183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918853+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:50.918853+0000","last_peered":"2024-04-20T10:50:50.918853+0000","last_clean":"2024-04-20T10:50:50.918853+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:50.918853+0000","last_undegraded":"2024-04-20T10:50:50.918853+0000","last_fullsized":"2024-04-20T10:50:50.918853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918057+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:50:50.918057+0000","last_peered":"2024-04-20T10:50:50.918057+0000","last_clean":"2024-04-20T10:50:50.918057+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:50:50.918057+0000","last_undegraded":"2024-04-20T10:50:50.918057+0000","last_fullsized":"2024-04-20T10:50:50.918057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919612+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:50:50.919612+0000","last_peered":"2024-04-20T10:50:50.919612+0000","last_clean":"2024-04-20T10:50:50.919612+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:50:50.919612+0000","last_undegraded":"2024-04-20T10:50:50.919612+0000","last_fullsized":"2024-04-20T10:50:50.919612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647644+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:50.647644+0000","last_peered":"2024-04-20T10:50:50.647644+0000","last_clean":"2024-04-20T10:50:50.647644+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:50.647644+0000","last_undegraded":"2024-04-20T10:50:50.647644+0000","last_fullsized":"2024-04-20T10:50:50.647644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646587+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:50:50.646587+0000","last_peered":"2024-04-20T10:50:50.646587+0000","last_clean":"2024-04-20T10:50:50.646587+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:50:50.646587+0000","last_undegraded":"2024-04-20T10:50:50.646587+0000","last_fullsized":"2024-04-20T10:50:50.646587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647705+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:50:50.647705+0000","last_peered":"2024-04-20T10:50:50.647705+0000","last_clean":"2024-04-20T10:50:50.647705+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:50:50.647705+0000","last_undegraded":"2024-04-20T10:50:50.647705+0000","last_fullsized":"2024-04-20T10:50:50.647705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918736+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:50.918736+0000","last_peered":"2024-04-20T10:50:50.918736+0000","last_clean":"2024-04-20T10:50:50.918736+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:50.918736+0000","last_undegraded":"2024-04-20T10:50:50.918736+0000","last_fullsized":"2024-04-20T10:50:50.918736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918257+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:50.918257+0000","last_peered":"2024-04-20T10:50:50.918257+0000","last_clean":"2024-04-20T10:50:50.918257+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:50.918257+0000","last_undegraded":"2024-04-20T10:50:50.918257+0000","last_fullsized":"2024-04-20T10:50:50.918257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919316+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:50:50.919316+0000","last_peered":"2024-04-20T10:50:50.919316+0000","last_clean":"2024-04-20T10:50:50.919316+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:50:50.919316+0000","last_undegraded":"2024-04-20T10:50:50.919316+0000","last_fullsized":"2024-04-20T10:50:50.919316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918977+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:50:50.918977+0000","last_peered":"2024-04-20T10:50:50.918977+0000","last_clean":"2024-04-20T10:50:50.918977+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:50:50.918977+0000","last_undegraded":"2024-04-20T10:50:50.918977+0000","last_fullsized":"2024-04-20T10:50:50.918977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904080+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:50.904080+0000","last_peered":"2024-04-20T10:50:50.904080+0000","last_clean":"2024-04-20T10:50:50.904080+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:50.904080+0000","last_undegraded":"2024-04-20T10:50:50.904080+0000","last_fullsized":"2024-04-20T10:50:50.904080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904487+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:50.904487+0000","last_peered":"2024-04-20T10:50:50.904487+0000","last_clean":"2024-04-20T10:50:50.904487+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:50.904487+0000","last_undegraded":"2024-04-20T10:50:50.904487+0000","last_fullsized":"2024-04-20T10:50:50.904487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647768+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:50:50.647768+0000","last_peered":"2024-04-20T10:50:50.647768+0000","last_clean":"2024-04-20T10:50:50.647768+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:50:50.647768+0000","last_undegraded":"2024-04-20T10:50:50.647768+0000","last_fullsized":"2024-04-20T10:50:50.647768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918820+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:50:50.918820+0000","last_peered":"2024-04-20T10:50:50.918820+0000","last_clean":"2024-04-20T10:50:50.918820+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:50:50.918820+0000","last_undegraded":"2024-04-20T10:50:50.918820+0000","last_fullsized":"2024-04-20T10:50:50.918820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919283+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:50.919283+0000","last_peered":"2024-04-20T10:50:50.919283+0000","last_clean":"2024-04-20T10:50:50.919283+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:50.919283+0000","last_undegraded":"2024-04-20T10:50:50.919283+0000","last_fullsized":"2024-04-20T10:50:50.919283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919373+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:50.919373+0000","last_peered":"2024-04-20T10:50:50.919373+0000","last_clean":"2024-04-20T10:50:50.919373+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:50.919373+0000","last_undegraded":"2024-04-20T10:50:50.919373+0000","last_fullsized":"2024-04-20T10:50:50.919373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"24'6","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648175+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:50:50.648175+0000","last_peered":"2024-04-20T10:50:50.648175+0000","last_clean":"2024-04-20T10:50:50.648175+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:50:50.648175+0000","last_undegraded":"2024-04-20T10:50:50.648175+0000","last_fullsized":"2024-04-20T10:50:50.648175+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648149+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:50:50.648149+0000","last_peered":"2024-04-20T10:50:50.648149+0000","last_clean":"2024-04-20T10:50:50.648149+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:50:50.648149+0000","last_undegraded":"2024-04-20T10:50:50.648149+0000","last_fullsized":"2024-04-20T10:50:50.648149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918773+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:50.918773+0000","last_peered":"2024-04-20T10:50:50.918773+0000","last_clean":"2024-04-20T10:50:50.918773+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:50.918773+0000","last_undegraded":"2024-04-20T10:50:50.918773+0000","last_fullsized":"2024-04-20T10:50:50.918773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919619+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:50.919619+0000","last_peered":"2024-04-20T10:50:50.919619+0000","last_clean":"2024-04-20T10:50:50.919619+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:50.919619+0000","last_undegraded":"2024-04-20T10:50:50.919619+0000","last_fullsized":"2024-04-20T10:50:50.919619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919480+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:50:50.919480+0000","last_peered":"2024-04-20T10:50:50.919480+0000","last_clean":"2024-04-20T10:50:50.919480+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:50:50.919480+0000","last_undegraded":"2024-04-20T10:50:50.919480+0000","last_fullsized":"2024-04-20T10:50:50.919480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647622+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:50:50.647622+0000","last_peered":"2024-04-20T10:50:50.647622+0000","last_clean":"2024-04-20T10:50:50.647622+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:50:50.647622+0000","last_undegraded":"2024-04-20T10:50:50.647622+0000","last_fullsized":"2024-04-20T10:50:50.647622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919782+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:50.919782+0000","last_peered":"2024-04-20T10:50:50.919782+0000","last_clean":"2024-04-20T10:50:50.919782+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:50.919782+0000","last_undegraded":"2024-04-20T10:50:50.919782+0000","last_fullsized":"2024-04-20T10:50:50.919782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904433+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:50:50.904433+0000","last_peered":"2024-04-20T10:50:50.904433+0000","last_clean":"2024-04-20T10:50:50.904433+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:50:50.904433+0000","last_undegraded":"2024-04-20T10:50:50.904433+0000","last_fullsized":"2024-04-20T10:50:50.904433+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918370+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:50:50.918370+0000","last_peered":"2024-04-20T10:50:50.918370+0000","last_clean":"2024-04-20T10:50:50.918370+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:50:50.918370+0000","last_undegraded":"2024-04-20T10:50:50.918370+0000","last_fullsized":"2024-04-20T10:50:50.918370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918531+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:50:50.918531+0000","last_peered":"2024-04-20T10:50:50.918531+0000","last_clean":"2024-04-20T10:50:50.918531+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:50:50.918531+0000","last_undegraded":"2024-04-20T10:50:50.918531+0000","last_fullsized":"2024-04-20T10:50:50.918531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647604+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:50.647604+0000","last_peered":"2024-04-20T10:50:50.647604+0000","last_clean":"2024-04-20T10:50:50.647604+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:50.647604+0000","last_undegraded":"2024-04-20T10:50:50.647604+0000","last_fullsized":"2024-04-20T10:50:50.647604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647241+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:50:50.647241+0000","last_peered":"2024-04-20T10:50:50.647241+0000","last_clean":"2024-04-20T10:50:50.647241+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:50:50.647241+0000","last_undegraded":"2024-04-20T10:50:50.647241+0000","last_fullsized":"2024-04-20T10:50:50.647241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904476+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:50:50.904476+0000","last_peered":"2024-04-20T10:50:50.904476+0000","last_clean":"2024-04-20T10:50:50.904476+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:50:50.904476+0000","last_undegraded":"2024-04-20T10:50:50.904476+0000","last_fullsized":"2024-04-20T10:50:50.904476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919071+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:50.919071+0000","last_peered":"2024-04-20T10:50:50.919071+0000","last_clean":"2024-04-20T10:50:50.919071+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:50.919071+0000","last_undegraded":"2024-04-20T10:50:50.919071+0000","last_fullsized":"2024-04-20T10:50:50.919071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919039+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:50.919039+0000","last_peered":"2024-04-20T10:50:50.919039+0000","last_clean":"2024-04-20T10:50:50.919039+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:50.919039+0000","last_undegraded":"2024-04-20T10:50:50.919039+0000","last_fullsized":"2024-04-20T10:50:50.919039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647348+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:50:50.647348+0000","last_peered":"2024-04-20T10:50:50.647348+0000","last_clean":"2024-04-20T10:50:50.647348+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:50:50.647348+0000","last_undegraded":"2024-04-20T10:50:50.647348+0000","last_fullsized":"2024-04-20T10:50:50.647348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918201+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:50:50.918201+0000","last_peered":"2024-04-20T10:50:50.918201+0000","last_clean":"2024-04-20T10:50:50.918201+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:50:50.918201+0000","last_undegraded":"2024-04-20T10:50:50.918201+0000","last_fullsized":"2024-04-20T10:50:50.918201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919011+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:50.919011+0000","last_peered":"2024-04-20T10:50:50.919011+0000","last_clean":"2024-04-20T10:50:50.919011+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:50.919011+0000","last_undegraded":"2024-04-20T10:50:50.919011+0000","last_fullsized":"2024-04-20T10:50:50.919011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904919+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:50.904919+0000","last_peered":"2024-04-20T10:50:50.904919+0000","last_clean":"2024-04-20T10:50:50.904919+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:50.904919+0000","last_undegraded":"2024-04-20T10:50:50.904919+0000","last_fullsized":"2024-04-20T10:50:50.904919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647257+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:50:50.647257+0000","last_peered":"2024-04-20T10:50:50.647257+0000","last_clean":"2024-04-20T10:50:50.647257+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:50:50.647257+0000","last_undegraded":"2024-04-20T10:50:50.647257+0000","last_fullsized":"2024-04-20T10:50:50.647257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904798+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:50:50.904798+0000","last_peered":"2024-04-20T10:50:50.904798+0000","last_clean":"2024-04-20T10:50:50.904798+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:50:50.904798+0000","last_undegraded":"2024-04-20T10:50:50.904798+0000","last_fullsized":"2024-04-20T10:50:50.904798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919143+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:50:50.919143+0000","last_peered":"2024-04-20T10:50:50.919143+0000","last_clean":"2024-04-20T10:50:50.919143+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:50:50.919143+0000","last_undegraded":"2024-04-20T10:50:50.919143+0000","last_fullsized":"2024-04-20T10:50:50.919143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918587+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:50.918587+0000","last_peered":"2024-04-20T10:50:50.918587+0000","last_clean":"2024-04-20T10:50:50.918587+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:50.918587+0000","last_undegraded":"2024-04-20T10:50:50.918587+0000","last_fullsized":"2024-04-20T10:50:50.918587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918226+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:50.918226+0000","last_peered":"2024-04-20T10:50:50.918226+0000","last_clean":"2024-04-20T10:50:50.918226+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:50.918226+0000","last_undegraded":"2024-04-20T10:50:50.918226+0000","last_fullsized":"2024-04-20T10:50:50.918226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919055+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:50:50.919055+0000","last_peered":"2024-04-20T10:50:50.919055+0000","last_clean":"2024-04-20T10:50:50.919055+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:50:50.919055+0000","last_undegraded":"2024-04-20T10:50:50.919055+0000","last_fullsized":"2024-04-20T10:50:50.919055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904885+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:50:50.904885+0000","last_peered":"2024-04-20T10:50:50.904885+0000","last_clean":"2024-04-20T10:50:50.904885+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:50:50.904885+0000","last_undegraded":"2024-04-20T10:50:50.904885+0000","last_fullsized":"2024-04-20T10:50:50.904885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647617+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:50.647617+0000","last_peered":"2024-04-20T10:50:50.647617+0000","last_clean":"2024-04-20T10:50:50.647617+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:50.647617+0000","last_undegraded":"2024-04-20T10:50:50.647617+0000","last_fullsized":"2024-04-20T10:50:50.647617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647427+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:50.647427+0000","last_peered":"2024-04-20T10:50:50.647427+0000","last_clean":"2024-04-20T10:50:50.647427+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:50.647427+0000","last_undegraded":"2024-04-20T10:50:50.647427+0000","last_fullsized":"2024-04-20T10:50:50.647427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919353+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:50:50.919353+0000","last_peered":"2024-04-20T10:50:50.919353+0000","last_clean":"2024-04-20T10:50:50.919353+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:50:50.919353+0000","last_undegraded":"2024-04-20T10:50:50.919353+0000","last_fullsized":"2024-04-20T10:50:50.919353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904598+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:50.904598+0000","last_peered":"2024-04-20T10:50:50.904598+0000","last_clean":"2024-04-20T10:50:50.904598+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:50.904598+0000","last_undegraded":"2024-04-20T10:50:50.904598+0000","last_fullsized":"2024-04-20T10:50:50.904598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919448+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:50.919448+0000","last_peered":"2024-04-20T10:50:50.919448+0000","last_clean":"2024-04-20T10:50:50.919448+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:50.919448+0000","last_undegraded":"2024-04-20T10:50:50.919448+0000","last_fullsized":"2024-04-20T10:50:50.919448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919923+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:50:50.919923+0000","last_peered":"2024-04-20T10:50:50.919923+0000","last_clean":"2024-04-20T10:50:50.919923+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:50:50.919923+0000","last_undegraded":"2024-04-20T10:50:50.919923+0000","last_fullsized":"2024-04-20T10:50:50.919923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646954+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:50:50.646954+0000","last_peered":"2024-04-20T10:50:50.646954+0000","last_clean":"2024-04-20T10:50:50.646954+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:50:50.646954+0000","last_undegraded":"2024-04-20T10:50:50.646954+0000","last_fullsized":"2024-04-20T10:50:50.646954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647875+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:50.647875+0000","last_peered":"2024-04-20T10:50:50.647875+0000","last_clean":"2024-04-20T10:50:50.647875+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:50.647875+0000","last_undegraded":"2024-04-20T10:50:50.647875+0000","last_fullsized":"2024-04-20T10:50:50.647875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647129+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:50.647129+0000","last_peered":"2024-04-20T10:50:50.647129+0000","last_clean":"2024-04-20T10:50:50.647129+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:50.647129+0000","last_undegraded":"2024-04-20T10:50:50.647129+0000","last_fullsized":"2024-04-20T10:50:50.647129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648051+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:50:50.648051+0000","last_peered":"2024-04-20T10:50:50.648051+0000","last_clean":"2024-04-20T10:50:50.648051+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:50:50.648051+0000","last_undegraded":"2024-04-20T10:50:50.648051+0000","last_fullsized":"2024-04-20T10:50:50.648051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648041+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:50:50.648041+0000","last_peered":"2024-04-20T10:50:50.648041+0000","last_clean":"2024-04-20T10:50:50.648041+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:50:50.648041+0000","last_undegraded":"2024-04-20T10:50:50.648041+0000","last_fullsized":"2024-04-20T10:50:50.648041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904067+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:50.904067+0000","last_peered":"2024-04-20T10:50:50.904067+0000","last_clean":"2024-04-20T10:50:50.904067+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:50.904067+0000","last_undegraded":"2024-04-20T10:50:50.904067+0000","last_fullsized":"2024-04-20T10:50:50.904067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919274+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:50:50.919274+0000","last_peered":"2024-04-20T10:50:50.919274+0000","last_clean":"2024-04-20T10:50:50.919274+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:50:50.919274+0000","last_undegraded":"2024-04-20T10:50:50.919274+0000","last_fullsized":"2024-04-20T10:50:50.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918980+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:50.918980+0000","last_peered":"2024-04-20T10:50:50.918980+0000","last_clean":"2024-04-20T10:50:50.918980+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:50.918980+0000","last_undegraded":"2024-04-20T10:50:50.918980+0000","last_fullsized":"2024-04-20T10:50:50.918980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918617+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:50:50.918617+0000","last_peered":"2024-04-20T10:50:50.918617+0000","last_clean":"2024-04-20T10:50:50.918617+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:50:50.918617+0000","last_undegraded":"2024-04-20T10:50:50.918617+0000","last_fullsized":"2024-04-20T10:50:50.918617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919308+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:50.919308+0000","last_peered":"2024-04-20T10:50:50.919308+0000","last_clean":"2024-04-20T10:50:50.919308+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:50.919308+0000","last_undegraded":"2024-04-20T10:50:50.919308+0000","last_fullsized":"2024-04-20T10:50:50.919308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919405+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:50.919405+0000","last_peered":"2024-04-20T10:50:50.919405+0000","last_clean":"2024-04-20T10:50:50.919405+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:50.919405+0000","last_undegraded":"2024-04-20T10:50:50.919405+0000","last_fullsized":"2024-04-20T10:50:50.919405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918338+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:50:50.918338+0000","last_peered":"2024-04-20T10:50:50.918338+0000","last_clean":"2024-04-20T10:50:50.918338+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:50:50.918338+0000","last_undegraded":"2024-04-20T10:50:50.918338+0000","last_fullsized":"2024-04-20T10:50:50.918338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648264+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:50.648264+0000","last_peered":"2024-04-20T10:50:50.648264+0000","last_clean":"2024-04-20T10:50:50.648264+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:50.648264+0000","last_undegraded":"2024-04-20T10:50:50.648264+0000","last_fullsized":"2024-04-20T10:50:50.648264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647153+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:50:50.647153+0000","last_peered":"2024-04-20T10:50:50.647153+0000","last_clean":"2024-04-20T10:50:50.647153+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:50:50.647153+0000","last_undegraded":"2024-04-20T10:50:50.647153+0000","last_fullsized":"2024-04-20T10:50:50.647153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919569+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:50.919569+0000","last_peered":"2024-04-20T10:50:50.919569+0000","last_clean":"2024-04-20T10:50:50.919569+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:50.919569+0000","last_undegraded":"2024-04-20T10:50:50.919569+0000","last_fullsized":"2024-04-20T10:50:50.919569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904775+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:50.904775+0000","last_peered":"2024-04-20T10:50:50.904775+0000","last_clean":"2024-04-20T10:50:50.904775+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:50.904775+0000","last_undegraded":"2024-04-20T10:50:50.904775+0000","last_fullsized":"2024-04-20T10:50:50.904775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904299+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:50:50.904299+0000","last_peered":"2024-04-20T10:50:50.904299+0000","last_clean":"2024-04-20T10:50:50.904299+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:50:50.904299+0000","last_undegraded":"2024-04-20T10:50:50.904299+0000","last_fullsized":"2024-04-20T10:50:50.904299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647767+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:50.647767+0000","last_peered":"2024-04-20T10:50:50.647767+0000","last_clean":"2024-04-20T10:50:50.647767+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:50.647767+0000","last_undegraded":"2024-04-20T10:50:50.647767+0000","last_fullsized":"2024-04-20T10:50:50.647767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647843+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:50:50.647843+0000","last_peered":"2024-04-20T10:50:50.647843+0000","last_clean":"2024-04-20T10:50:50.647843+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:50:50.647843+0000","last_undegraded":"2024-04-20T10:50:50.647843+0000","last_fullsized":"2024-04-20T10:50:50.647843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918116+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:50.918116+0000","last_peered":"2024-04-20T10:50:50.918116+0000","last_clean":"2024-04-20T10:50:50.918116+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:50.918116+0000","last_undegraded":"2024-04-20T10:50:50.918116+0000","last_fullsized":"2024-04-20T10:50:50.918116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920306+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:50:50.920306+0000","last_peered":"2024-04-20T10:50:50.920306+0000","last_clean":"2024-04-20T10:50:50.920306+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:50:50.920306+0000","last_undegraded":"2024-04-20T10:50:50.920306+0000","last_fullsized":"2024-04-20T10:50:50.920306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647324+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:50.647324+0000","last_peered":"2024-04-20T10:50:50.647324+0000","last_clean":"2024-04-20T10:50:50.647324+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:50.647324+0000","last_undegraded":"2024-04-20T10:50:50.647324+0000","last_fullsized":"2024-04-20T10:50:50.647324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919821+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:50:50.919821+0000","last_peered":"2024-04-20T10:50:50.919821+0000","last_clean":"2024-04-20T10:50:50.919821+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:50:50.919821+0000","last_undegraded":"2024-04-20T10:50:50.919821+0000","last_fullsized":"2024-04-20T10:50:50.919821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919185+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:50.919185+0000","last_peered":"2024-04-20T10:50:50.919185+0000","last_clean":"2024-04-20T10:50:50.919185+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:50.919185+0000","last_undegraded":"2024-04-20T10:50:50.919185+0000","last_fullsized":"2024-04-20T10:50:50.919185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647822+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:50:50.647822+0000","last_peered":"2024-04-20T10:50:50.647822+0000","last_clean":"2024-04-20T10:50:50.647822+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:50:50.647822+0000","last_undegraded":"2024-04-20T10:50:50.647822+0000","last_fullsized":"2024-04-20T10:50:50.647822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919221+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:50.919221+0000","last_peered":"2024-04-20T10:50:50.919221+0000","last_clean":"2024-04-20T10:50:50.919221+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:50.919221+0000","last_undegraded":"2024-04-20T10:50:50.919221+0000","last_fullsized":"2024-04-20T10:50:50.919221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646687+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:50:50.646687+0000","last_peered":"2024-04-20T10:50:50.646687+0000","last_clean":"2024-04-20T10:50:50.646687+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:50:50.646687+0000","last_undegraded":"2024-04-20T10:50:50.646687+0000","last_fullsized":"2024-04-20T10:50:50.646687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904324+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:50.904324+0000","last_peered":"2024-04-20T10:50:50.904324+0000","last_clean":"2024-04-20T10:50:50.904324+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:50.904324+0000","last_undegraded":"2024-04-20T10:50:50.904324+0000","last_fullsized":"2024-04-20T10:50:50.904324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646680+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:50:50.646680+0000","last_peered":"2024-04-20T10:50:50.646680+0000","last_clean":"2024-04-20T10:50:50.646680+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:50:50.646680+0000","last_undegraded":"2024-04-20T10:50:50.646680+0000","last_fullsized":"2024-04-20T10:50:50.646680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920058+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:50.920058+0000","last_peered":"2024-04-20T10:50:50.920058+0000","last_clean":"2024-04-20T10:50:50.920058+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:50.920058+0000","last_undegraded":"2024-04-20T10:50:50.920058+0000","last_fullsized":"2024-04-20T10:50:50.920058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918048+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:50:50.918048+0000","last_peered":"2024-04-20T10:50:50.918048+0000","last_clean":"2024-04-20T10:50:50.918048+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:50:50.918048+0000","last_undegraded":"2024-04-20T10:50:50.918048+0000","last_fullsized":"2024-04-20T10:50:50.918048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918749+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:50.918749+0000","last_peered":"2024-04-20T10:50:50.918749+0000","last_clean":"2024-04-20T10:50:50.918749+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:50.918749+0000","last_undegraded":"2024-04-20T10:50:50.918749+0000","last_fullsized":"2024-04-20T10:50:50.918749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918281+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:50:50.918281+0000","last_peered":"2024-04-20T10:50:50.918281+0000","last_clean":"2024-04-20T10:50:50.918281+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:50:50.918281+0000","last_undegraded":"2024-04-20T10:50:50.918281+0000","last_fullsized":"2024-04-20T10:50:50.918281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919598+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:50.919598+0000","last_peered":"2024-04-20T10:50:50.919598+0000","last_clean":"2024-04-20T10:50:50.919598+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:50.919598+0000","last_undegraded":"2024-04-20T10:50:50.919598+0000","last_fullsized":"2024-04-20T10:50:50.919598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919839+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:50:50.919839+0000","last_peered":"2024-04-20T10:50:50.919839+0000","last_clean":"2024-04-20T10:50:50.919839+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:50:50.919839+0000","last_undegraded":"2024-04-20T10:50:50.919839+0000","last_fullsized":"2024-04-20T10:50:50.919839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918109+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:50.918109+0000","last_peered":"2024-04-20T10:50:50.918109+0000","last_clean":"2024-04-20T10:50:50.918109+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:50.918109+0000","last_undegraded":"2024-04-20T10:50:50.918109+0000","last_fullsized":"2024-04-20T10:50:50.918109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647462+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:50:50.647462+0000","last_peered":"2024-04-20T10:50:50.647462+0000","last_clean":"2024-04-20T10:50:50.647462+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:50:50.647462+0000","last_undegraded":"2024-04-20T10:50:50.647462+0000","last_fullsized":"2024-04-20T10:50:50.647462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918682+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:50.918682+0000","last_peered":"2024-04-20T10:50:50.918682+0000","last_clean":"2024-04-20T10:50:50.918682+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:50.918682+0000","last_undegraded":"2024-04-20T10:50:50.918682+0000","last_fullsized":"2024-04-20T10:50:50.918682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918787+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:50:50.918787+0000","last_peered":"2024-04-20T10:50:50.918787+0000","last_clean":"2024-04-20T10:50:50.918787+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:50:50.918787+0000","last_undegraded":"2024-04-20T10:50:50.918787+0000","last_fullsized":"2024-04-20T10:50:50.918787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918739+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:50.918739+0000","last_peered":"2024-04-20T10:50:50.918739+0000","last_clean":"2024-04-20T10:50:50.918739+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:50.918739+0000","last_undegraded":"2024-04-20T10:50:50.918739+0000","last_fullsized":"2024-04-20T10:50:50.918739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647651+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:50.647651+0000","last_peered":"2024-04-20T10:50:50.647651+0000","last_clean":"2024-04-20T10:50:50.647651+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:50.647651+0000","last_undegraded":"2024-04-20T10:50:50.647651+0000","last_fullsized":"2024-04-20T10:50:50.647651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647567+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:50.647567+0000","last_peered":"2024-04-20T10:50:50.647567+0000","last_clean":"2024-04-20T10:50:50.647567+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:50.647567+0000","last_undegraded":"2024-04-20T10:50:50.647567+0000","last_fullsized":"2024-04-20T10:50:50.647567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919983+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:50:50.919983+0000","last_peered":"2024-04-20T10:50:50.919983+0000","last_clean":"2024-04-20T10:50:50.919983+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:50:50.919983+0000","last_undegraded":"2024-04-20T10:50:50.919983+0000","last_fullsized":"2024-04-20T10:50:50.919983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918676+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:50:50.918676+0000","last_peered":"2024-04-20T10:50:50.918676+0000","last_clean":"2024-04-20T10:50:50.918676+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:50:50.918676+0000","last_undegraded":"2024-04-20T10:50:50.918676+0000","last_fullsized":"2024-04-20T10:50:50.918676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904771+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:50.904771+0000","last_peered":"2024-04-20T10:50:50.904771+0000","last_clean":"2024-04-20T10:50:50.904771+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:50.904771+0000","last_undegraded":"2024-04-20T10:50:50.904771+0000","last_fullsized":"2024-04-20T10:50:50.904771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918237+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:50:50.918237+0000","last_peered":"2024-04-20T10:50:50.918237+0000","last_clean":"2024-04-20T10:50:50.918237+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:50:50.918237+0000","last_undegraded":"2024-04-20T10:50:50.918237+0000","last_fullsized":"2024-04-20T10:50:50.918237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920158+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:50.920158+0000","last_peered":"2024-04-20T10:50:50.920158+0000","last_clean":"2024-04-20T10:50:50.920158+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:50.920158+0000","last_undegraded":"2024-04-20T10:50:50.920158+0000","last_fullsized":"2024-04-20T10:50:50.920158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647709+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:50:50.647709+0000","last_peered":"2024-04-20T10:50:50.647709+0000","last_clean":"2024-04-20T10:50:50.647709+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:50:50.647709+0000","last_undegraded":"2024-04-20T10:50:50.647709+0000","last_fullsized":"2024-04-20T10:50:50.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647411+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:50.647411+0000","last_peered":"2024-04-20T10:50:50.647411+0000","last_clean":"2024-04-20T10:50:50.647411+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:50.647411+0000","last_undegraded":"2024-04-20T10:50:50.647411+0000","last_fullsized":"2024-04-20T10:50:50.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904808+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:50:50.904808+0000","last_peered":"2024-04-20T10:50:50.904808+0000","last_clean":"2024-04-20T10:50:50.904808+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:50:50.904808+0000","last_undegraded":"2024-04-20T10:50:50.904808+0000","last_fullsized":"2024-04-20T10:50:50.904808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918551+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:50.918551+0000","last_peered":"2024-04-20T10:50:50.918551+0000","last_clean":"2024-04-20T10:50:50.918551+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:50.918551+0000","last_undegraded":"2024-04-20T10:50:50.918551+0000","last_fullsized":"2024-04-20T10:50:50.918551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919755+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:50:50.919755+0000","last_peered":"2024-04-20T10:50:50.919755+0000","last_clean":"2024-04-20T10:50:50.919755+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:50:50.919755+0000","last_undegraded":"2024-04-20T10:50:50.919755+0000","last_fullsized":"2024-04-20T10:50:50.919755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919134+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:50.919134+0000","last_peered":"2024-04-20T10:50:50.919134+0000","last_clean":"2024-04-20T10:50:50.919134+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:50.919134+0000","last_undegraded":"2024-04-20T10:50:50.919134+0000","last_fullsized":"2024-04-20T10:50:50.919134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919397+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:50:50.919397+0000","last_peered":"2024-04-20T10:50:50.919397+0000","last_clean":"2024-04-20T10:50:50.919397+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:50:50.919397+0000","last_undegraded":"2024-04-20T10:50:50.919397+0000","last_fullsized":"2024-04-20T10:50:50.919397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919182+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:50.919182+0000","last_peered":"2024-04-20T10:50:50.919182+0000","last_clean":"2024-04-20T10:50:50.919182+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:50.919182+0000","last_undegraded":"2024-04-20T10:50:50.919182+0000","last_fullsized":"2024-04-20T10:50:50.919182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919141+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:50.919141+0000","last_peered":"2024-04-20T10:50:50.919141+0000","last_clean":"2024-04-20T10:50:50.919141+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:50.919141+0000","last_undegraded":"2024-04-20T10:50:50.919141+0000","last_fullsized":"2024-04-20T10:50:50.919141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919836+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:50:50.919836+0000","last_peered":"2024-04-20T10:50:50.919836+0000","last_clean":"2024-04-20T10:50:50.919836+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:50:50.919836+0000","last_undegraded":"2024-04-20T10:50:50.919836+0000","last_fullsized":"2024-04-20T10:50:50.919836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919036+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:50.919036+0000","last_peered":"2024-04-20T10:50:50.919036+0000","last_clean":"2024-04-20T10:50:50.919036+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:50.919036+0000","last_undegraded":"2024-04-20T10:50:50.919036+0000","last_fullsized":"2024-04-20T10:50:50.919036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918038+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:50:50.918038+0000","last_peered":"2024-04-20T10:50:50.918038+0000","last_clean":"2024-04-20T10:50:50.918038+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:50:50.918038+0000","last_undegraded":"2024-04-20T10:50:50.918038+0000","last_fullsized":"2024-04-20T10:50:50.918038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919810+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:50.919810+0000","last_peered":"2024-04-20T10:50:50.919810+0000","last_clean":"2024-04-20T10:50:50.919810+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:50.919810+0000","last_undegraded":"2024-04-20T10:50:50.919810+0000","last_fullsized":"2024-04-20T10:50:50.919810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918353+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:50:50.918353+0000","last_peered":"2024-04-20T10:50:50.918353+0000","last_clean":"2024-04-20T10:50:50.918353+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:50:50.918353+0000","last_undegraded":"2024-04-20T10:50:50.918353+0000","last_fullsized":"2024-04-20T10:50:50.918353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920113+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:50.920113+0000","last_peered":"2024-04-20T10:50:50.920113+0000","last_clean":"2024-04-20T10:50:50.920113+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:50.920113+0000","last_undegraded":"2024-04-20T10:50:50.920113+0000","last_fullsized":"2024-04-20T10:50:50.920113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":106160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":105726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:50:59.325 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-20T10:50:59.326 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-20T10:50:59.326 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-20T10:50:59.326 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-20T10:50:59.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2aad0e640 1 Processor -- start 2024-04-20T10:50:59.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2aad0e640 1 -- start start 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2aad0e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2a4157a70 0x7fb2a40ac170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2aad0e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a4073ba0 con 0x7fb2a4151b10 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2aad0e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2a41589a0 con 0x7fb2a4154480 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2aad0e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb2a4157ee0 con 0x7fb2a4157a70 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2a92ab640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2a4157a70 0x7fb2a40ac170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2a8aaa640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb2a4151b10 0x7fb2a40725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56718/0 (socket says 172.21.15.90:56718) 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2a8aaa640 1 -- 172.21.15.90:0/1380118578 learned_addr learned my addr 172.21.15.90:0/1380118578 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.455+0000 7fb2a92ab640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2a4157a70 0x7fb2a40ac170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59302/0 (socket says 172.21.15.90:59302) 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.456+0000 7fb2a92ab640 1 -- 172.21.15.90:0/1380118578 >> v1:172.21.15.175:6789/0 conn(0x7fb2a4154480 legacy=0x7fb2a40aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.456+0000 7fb2a92ab640 1 -- 172.21.15.90:0/1380118578 >> v1:172.21.15.90:6789/0 conn(0x7fb2a4151b10 legacy=0x7fb2a40725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.456+0000 7fb2a37fe640 1 -- 172.21.15.90:0/1380118578 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1488413526 0 0) 0x7fb2a4073ba0 con 0x7fb2a4151b10 2024-04-20T10:50:59.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.456+0000 7fb2a92ab640 1 -- 172.21.15.90:0/1380118578 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a4158100 con 0x7fb2a4157a70 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2a92ab640 1 --2- 172.21.15.90:0/1380118578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4157a70 0x7fb2a40ac170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2940097a0 tx=0x7fb29402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d008598469e3f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2a37fe640 1 -- 172.21.15.90:0/1380118578 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2940315a0 con 0x7fb2a4157a70 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2a37fe640 1 -- 172.21.15.90:0/1380118578 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb294037070 con 0x7fb2a4157a70 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2a37fe640 1 -- 172.21.15.90:0/1380118578 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb294031960 con 0x7fb2a4157a70 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2aad0e640 1 -- 172.21.15.90:0/1380118578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4157a70 msgr2=0x7fb2a40ac170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/1380118578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4157a70 0x7fb2a40ac170 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb2940097a0 tx=0x7fb29402b840 comp rx=0 tx=0).stop 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2aad0e640 1 -- 172.21.15.90:0/1380118578 shutdown_connections 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/1380118578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4157a70 0x7fb2a40ac170 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2aad0e640 1 -- 172.21.15.90:0/1380118578 >> 172.21.15.90:0/1380118578 conn(0x7fb2a40ca0a0 msgr2=0x7fb2a40ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2aad0e640 1 -- 172.21.15.90:0/1380118578 shutdown_connections 2024-04-20T10:50:59.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.457+0000 7fb2aad0e640 1 -- 172.21.15.90:0/1380118578 wait complete. 2024-04-20T10:50:59.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.458+0000 7fb2aad0e640 1 Processor -- start 2024-04-20T10:50:59.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.458+0000 7fb2aad0e640 1 -- start start 2024-04-20T10:50:59.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2aad0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4151b10 0x7fb2a40c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2aad0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a4154480 0x7fb2a414ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2aad0e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a4157a70 0x7fb2a4146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2aad0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a41586c0 con 0x7fb2a4151b10 2024-04-20T10:50:59.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2aad0e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a4151ef0 con 0x7fb2a4157a70 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2aad0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb2a40ab540 con 0x7fb2a4154480 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2a8aaa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4151b10 0x7fb2a40c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2a8aaa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4151b10 0x7fb2a40c8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59318/0 (socket says 172.21.15.90:59318) 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2a8aaa640 1 -- 172.21.15.90:0/3141685397 learned_addr learned my addr 172.21.15.90:0/3141685397 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2a92ab640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a4157a70 0x7fb2a4146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2a8aaa640 1 -- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a4154480 msgr2=0x7fb2a414ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.459+0000 7fb2a3fff640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a4154480 0x7fb2a414ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a8aaa640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a4154480 0x7fb2a414ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a8aaa640 1 -- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a4157a70 msgr2=0x7fb2a4146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a8aaa640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a4157a70 0x7fb2a4146df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a8aaa640 1 -- 172.21.15.90:0/3141685397 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a40c8ff0 con 0x7fb2a4151b10 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a8aaa640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4151b10 0x7fb2a40c8ab0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c890 tx=0x7fb29c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a17fa640 1 -- 172.21.15.90:0/3141685397 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c018070 con 0x7fb2a4151b10 2024-04-20T10:50:59.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a17fa640 1 -- 172.21.15.90:0/3141685397 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb29c00a640 con 0x7fb2a4151b10 2024-04-20T10:50:59.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a414bdb0 con 0x7fb2a4151b10 2024-04-20T10:50:59.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2a17fa640 1 -- 172.21.15.90:0/3141685397 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00aa30 con 0x7fb2a4151b10 2024-04-20T10:50:59.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.460+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a40c7fd0 con 0x7fb2a4151b10 2024-04-20T10:50:59.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.461+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a4076150 con 0x7fb2a4151b10 2024-04-20T10:50:59.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.461+0000 7fb2a17fa640 1 -- 172.21.15.90:0/3141685397 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb29c01b070 con 0x7fb2a4151b10 2024-04-20T10:50:59.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.462+0000 7fb2a17fa640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb29006c8f0 0x7fb29006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.462+0000 7fb2a3fff640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb29006c8f0 0x7fb29006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.462+0000 7fb2a17fa640 1 -- 172.21.15.90:0/3141685397 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb29c08b480 con 0x7fb2a4151b10 2024-04-20T10:50:59.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.462+0000 7fb2a3fff640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb29006c8f0 0x7fb29006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2a414b7c0 tx=0x7fb298009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.466+0000 7fb2a17fa640 1 -- 172.21.15.90:0/3141685397 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb29c059610 con 0x7fb2a4151b10 2024-04-20T10:50:59.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.680+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb2a40aba60 con 0x7fb2a4151b10 2024-04-20T10:50:59.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.680+0000 7fb2a17fa640 1 -- 172.21.15.90:0/3141685397 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb29c058f10 con 0x7fb2a4151b10 2024-04-20T10:50:59.680 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:59.681 INFO:teuthology.orchestra.run.smithi090.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-20T10:50:59.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb29006c8f0 msgr2=0x7fb29006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb29006c8f0 0x7fb29006edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb2a414b7c0 tx=0x7fb298009040 comp rx=0 tx=0).stop 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4151b10 msgr2=0x7fb2a40c8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4151b10 0x7fb2a40c8ab0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00c890 tx=0x7fb29c00cd50 comp rx=0 tx=0).stop 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 shutdown_connections 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb29006c8f0 0x7fb29006edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2a4157a70 0x7fb2a4146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2a4154480 0x7fb2a414ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 --2- 172.21.15.90:0/3141685397 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2a4151b10 0x7fb2a40c8ab0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 >> 172.21.15.90:0/3141685397 conn(0x7fb2a40ca0a0 msgr2=0x7fb2a4153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 shutdown_connections 2024-04-20T10:50:59.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.682+0000 7fb2aad0e640 1 -- 172.21.15.90:0/3141685397 wait complete. 2024-04-20T10:50:59.693 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-20T10:50:59.694 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:50:59.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.789+0000 7fbaa5159640 1 Processor -- start 2024-04-20T10:50:59.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.789+0000 7fbaa5159640 1 -- start start 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fbaa5159640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbaa015a510 0x7fbaa01621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fbaa5159640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa00af590 con 0x7fbaa0154040 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fbaa5159640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa00acd70 con 0x7fbaa00c4bb0 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fbaa5159640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbaa00acb20 con 0x7fbaa015a510 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9ed9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbaa0154040 0x7fbaa00730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56730/0 (socket says 172.21.15.90:56730) 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9ed9d640 1 -- 172.21.15.90:0/2678837542 learned_addr learned my addr 172.21.15.90:0/2678837542 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9f59e640 1 --2- 172.21.15.90:0/2678837542 >> v2:172.21.15.175:3300/0 conn(0x7fbaa015a510 0x7fbaa01621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3351330058 0 0) 0x7fbaa00af590 con 0x7fbaa0154040 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba8c003520 con 0x7fbaa0154040 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1000564801 0 0) 0x7fba8c003520 con 0x7fbaa0154040 2024-04-20T10:50:59.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 >> v2:172.21.15.175:3300/0 conn(0x7fbaa015a510 msgr2=0x7fbaa01621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 --2- 172.21.15.90:0/2678837542 >> v2:172.21.15.175:3300/0 conn(0x7fbaa015a510 0x7fbaa01621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 >> v1:172.21.15.175:6789/0 conn(0x7fbaa00c4bb0 legacy=0x7fbaa0159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa00c6400 con 0x7fbaa0154040 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fba90001670 con 0x7fbaa0154040 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 >> v1:172.21.15.90:6789/0 conn(0x7fbaa0154040 legacy=0x7fbaa00730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c0039b0 0x7fba8c003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c004800 0x7fba8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba8c005230 0x7fba8c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa00acb20 con 0x7fba8c005230 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fba8c00c190 con 0x7fba8c004800 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fba8c00c390 con 0x7fba8c0039b0 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.790+0000 7fba9f59e640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba8c005230 0x7fba8c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba97fff640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c004800 0x7fba8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9ed9d640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c0039b0 0x7fba8c003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9f59e640 1 -- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c0039b0 msgr2=0x7fba8c003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9f59e640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c0039b0 0x7fba8c003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9f59e640 1 -- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c004800 msgr2=0x7fba8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9f59e640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c004800 0x7fba8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9f59e640 1 -- 172.21.15.90:0/2678837542 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba8c003520 con 0x7fba8c005230 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba97fff640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fba8c004800 0x7fba8c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9f59e640 1 -- 172.21.15.90:0/2678837542 reap_dead start 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9f59e640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba8c005230 0x7fba8c00b9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba98009fc0 tx=0x7fba8c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226d6933f0ab80 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.791+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98009c10 con 0x7fba8c005230 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba9802cc60 con 0x7fba8c005230 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fba9e59c640 1 -- 172.21.15.90:0/2678837542 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98003bd0 con 0x7fba8c005230 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fbaa5159640 1 -- 172.21.15.90:0/2678837542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba8c005230 msgr2=0x7fba8c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fbaa5159640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba8c005230 0x7fba8c00b9c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fba98009fc0 tx=0x7fba8c005830 comp rx=0 tx=0).stop 2024-04-20T10:50:59.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fbaa5159640 1 -- 172.21.15.90:0/2678837542 shutdown_connections 2024-04-20T10:50:59.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fbaa5159640 1 --2- 172.21.15.90:0/2678837542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fba8c005230 0x7fba8c00b9c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fbaa5159640 1 -- 172.21.15.90:0/2678837542 >> 172.21.15.90:0/2678837542 conn(0x7fbaa00676c0 msgr2=0x7fbaa0067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:59.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fbaa5159640 1 -- 172.21.15.90:0/2678837542 shutdown_connections 2024-04-20T10:50:59.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.792+0000 7fbaa5159640 1 -- 172.21.15.90:0/2678837542 wait complete. 2024-04-20T10:50:59.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.793+0000 7fbaa5159640 1 Processor -- start 2024-04-20T10:50:59.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.793+0000 7fbaa5159640 1 -- start start 2024-04-20T10:50:59.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fbaa5159640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c005230 0x7fbaa01efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fbaa5159640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa01ec780 0x7fbaa006cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fbaa5159640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa014e990 0x7fbaa0149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fbaa5159640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa00af020 con 0x7fbaa014e990 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fbaa5159640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbaa00aeea0 con 0x7fbaa01ec780 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fbaa5159640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbaa0070520 con 0x7fba8c005230 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa014e990 0x7fbaa0149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa014e990 0x7fbaa0149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59340/0 (socket says 172.21.15.90:59340) 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 -- 172.21.15.90:0/3215704133 learned_addr learned my addr 172.21.15.90:0/3215704133 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 -- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c005230 msgr2=0x7fbaa01efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9ed9d640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c005230 0x7fbaa01efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba97fff640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa01ec780 0x7fbaa006cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c005230 0x7fbaa01efcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 -- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa01ec780 msgr2=0x7fbaa006cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa01ec780 0x7fbaa006cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.794+0000 7fba9f59e640 1 -- 172.21.15.90:0/3215704133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa006d010 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.795+0000 7fba9f59e640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa014e990 0x7fbaa0149ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba9800e200 tx=0x7fba98009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.795+0000 7fba977fe640 1 -- 172.21.15.90:0/3215704133 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98003990 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.795+0000 7fba977fe640 1 -- 172.21.15.90:0/3215704133 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba98044070 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.795+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa0152b50 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.795+0000 7fba977fe640 1 -- 172.21.15.90:0/3215704133 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba98003d50 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.795+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaa01ebf80 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.796+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaa0153070 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.796+0000 7fba977fe640 1 -- 172.21.15.90:0/3215704133 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba98005d10 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.796+0000 7fba977fe640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fba8006c920 0x7fba8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.797+0000 7fba9ed9d640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fba8006c920 0x7fba8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.797+0000 7fba977fe640 1 -- 172.21.15.90:0/3215704133 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fba980ae480 con 0x7fbaa014e990 2024-04-20T10:50:59.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.797+0000 7fba9ed9d640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fba8006c920 0x7fba8006ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba90001750 tx=0x7fba90001d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:50:59.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.801+0000 7fba977fe640 1 -- 172.21.15.90:0/3215704133 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fba9807c610 con 0x7fbaa014e990 2024-04-20T10:50:59.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.974+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbaa01ebd70 con 0x7fbaa014e990 2024-04-20T10:50:59.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.976+0000 7fba977fe640 1 -- 172.21.15.90:0/3215704133 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7fba9807bf10 con 0x7fbaa014e990 2024-04-20T10:50:59.976 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:50:59.976 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:50:59.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fba8006c920 msgr2=0x7fba8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fba8006c920 0x7fba8006ede0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fba90001750 tx=0x7fba90001d10 comp rx=0 tx=0).stop 2024-04-20T10:50:59.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa014e990 msgr2=0x7fbaa0149ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa014e990 0x7fbaa0149ac0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fba9800e200 tx=0x7fba98009750 comp rx=0 tx=0).stop 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 shutdown_connections 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fba8006c920 0x7fba8006ede0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbaa014e990 0x7fbaa0149ac0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbaa01ec780 0x7fbaa006cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 --2- 172.21.15.90:0/3215704133 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fba8c005230 0x7fbaa01efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 >> 172.21.15.90:0/3215704133 conn(0x7fbaa00676c0 msgr2=0x7fbaa0151010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 shutdown_connections 2024-04-20T10:50:59.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:50:59.978+0000 7fbaa5159640 1 -- 172.21.15.90:0/3215704133 wait complete. 2024-04-20T10:50:59.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:50:59.989 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:51:00.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.088+0000 7fe45f826640 1 Processor -- start 2024-04-20T10:51:00.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.088+0000 7fe45f826640 1 -- start start 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45f826640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe458153ef0 0x7fe4580c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45f826640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe4580ab730 0x7fe4581568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45f826640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe45815a720 con 0x7fe4580c9ee0 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45f826640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe45815ac80 con 0x7fe4580ab730 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45f826640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe45815a9a0 con 0x7fe458153ef0 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45cdc1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe4580ab730 0x7fe4581568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45ddc3640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe4580c9ee0 0x7fe458156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56740/0 (socket says 172.21.15.90:56740) 2024-04-20T10:51:00.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45ddc3640 1 -- 172.21.15.90:0/4275385923 learned_addr learned my addr 172.21.15.90:0/4275385923 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45d5c2640 1 --2- 172.21.15.90:0/4275385923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe458153ef0 0x7fe4580c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.089+0000 7fe45cdc1640 1 -- 172.21.15.90:0/4275385923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe458153ef0 msgr2=0x7fe4580c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe45cdc1640 1 --2- 172.21.15.90:0/4275385923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe458153ef0 0x7fe4580c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe45cdc1640 1 -- 172.21.15.90:0/4275385923 >> v1:172.21.15.90:6789/0 conn(0x7fe4580c9ee0 legacy=0x7fe458156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe45cdc1640 1 -- 172.21.15.90:0/4275385923 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4580c6a90 con 0x7fe4580ab730 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe44ffff640 1 -- 172.21.15.90:0/4275385923 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576314226 0 0) 0x7fe450001110 con 0x7fe4580c9ee0 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe45cdc1640 1 --2- 172.21.15.90:0/4275385923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4580ab730 0x7fe4581568c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4480097a0 tx=0x7fe44802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1d69078b42e9aa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe44ffff640 1 -- 172.21.15.90:0/4275385923 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448038070 con 0x7fe4580ab730 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe44ffff640 1 -- 172.21.15.90:0/4275385923 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe448031700 con 0x7fe4580ab730 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.090+0000 7fe44ffff640 1 -- 172.21.15.90:0/4275385923 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe448031ad0 con 0x7fe4580ab730 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 -- 172.21.15.90:0/4275385923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4580ab730 msgr2=0x7fe4581568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 --2- 172.21.15.90:0/4275385923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4580ab730 0x7fe4581568c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe4480097a0 tx=0x7fe44802b7a0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 -- 172.21.15.90:0/4275385923 shutdown_connections 2024-04-20T10:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 --2- 172.21.15.90:0/4275385923 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4580ab730 0x7fe4581568c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 --2- 172.21.15.90:0/4275385923 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe458153ef0 0x7fe4580c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 -- 172.21.15.90:0/4275385923 >> 172.21.15.90:0/4275385923 conn(0x7fe4580cbfe0 msgr2=0x7fe4580cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 -- 172.21.15.90:0/4275385923 shutdown_connections 2024-04-20T10:51:00.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.091+0000 7fe45f826640 1 -- 172.21.15.90:0/4275385923 wait complete. 2024-04-20T10:51:00.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.092+0000 7fe45f826640 1 Processor -- start 2024-04-20T10:51:00.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.092+0000 7fe45f826640 1 -- start start 2024-04-20T10:51:00.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45f826640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4580ab730 0x7fe4581594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45f826640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4580c9ee0 0x7fe458150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45f826640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe458153ef0 0x7fe458151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45f826640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe4580bf800 con 0x7fe458153ef0 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45f826640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe458157510 con 0x7fe4580ab730 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45f826640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe4581f0040 con 0x7fe4580c9ee0 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe458153ef0 0x7fe458151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe458153ef0 0x7fe458151310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59372/0 (socket says 172.21.15.90:59372) 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 -- 172.21.15.90:0/3794258647 learned_addr learned my addr 172.21.15.90:0/3794258647 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45cdc1640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4580c9ee0 0x7fe458150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 -- 172.21.15.90:0/3794258647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4580c9ee0 msgr2=0x7fe458150dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4580c9ee0 0x7fe458150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 -- 172.21.15.90:0/3794258647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4580ab730 msgr2=0x7fe4581594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4580ab730 0x7fe4581594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 -- 172.21.15.90:0/3794258647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4580c5ea0 con 0x7fe458153ef0 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45ddc3640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe458153ef0 0x7fe458151310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe45000c780 tx=0x7fe45000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe44dffb640 1 -- 172.21.15.90:0/3794258647 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe450005a70 con 0x7fe458153ef0 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe44dffb640 1 -- 172.21.15.90:0/3794258647 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe450005c30 con 0x7fe458153ef0 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe44dffb640 1 -- 172.21.15.90:0/3794258647 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4500072b0 con 0x7fe458153ef0 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.093+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4580c6180 con 0x7fe458153ef0 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.094+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe458159a10 con 0x7fe458153ef0 2024-04-20T10:51:00.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.094+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4581f0520 con 0x7fe458153ef0 2024-04-20T10:51:00.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.095+0000 7fe44dffb640 1 -- 172.21.15.90:0/3794258647 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe450007450 con 0x7fe458153ef0 2024-04-20T10:51:00.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.095+0000 7fe44dffb640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe43c06c8f0 0x7fe43c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.095+0000 7fe44dffb640 1 -- 172.21.15.90:0/3794258647 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fe45008ba30 con 0x7fe458153ef0 2024-04-20T10:51:00.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.095+0000 7fe45d5c2640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe43c06c8f0 0x7fe43c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.096+0000 7fe45d5c2640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe43c06c8f0 0x7fe43c06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe4540070b0 tx=0x7fe454007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.099+0000 7fe44dffb640 1 -- 172.21.15.90:0/3794258647 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe45815a720 con 0x7fe458153ef0 2024-04-20T10:51:00.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.272+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe45806d070 con 0x7fe458153ef0 2024-04-20T10:51:00.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.272+0000 7fe44dffb640 1 -- 172.21.15.90:0/3794258647 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fe450059bc0 con 0x7fe458153ef0 2024-04-20T10:51:00.272 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:51:00.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe43c06c8f0 msgr2=0x7fe43c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe43c06c8f0 0x7fe43c06edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fe4540070b0 tx=0x7fe454007040 comp rx=0 tx=0).stop 2024-04-20T10:51:00.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe458153ef0 msgr2=0x7fe458151310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe458153ef0 0x7fe458151310 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe45000c780 tx=0x7fe45000cc40 comp rx=0 tx=0).stop 2024-04-20T10:51:00.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 shutdown_connections 2024-04-20T10:51:00.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe43c06c8f0 0x7fe43c06edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe458153ef0 0x7fe458151310 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4580c9ee0 0x7fe458150dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 --2- 172.21.15.90:0/3794258647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4580ab730 0x7fe4581594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 >> 172.21.15.90:0/3794258647 conn(0x7fe4580cbfe0 msgr2=0x7fe458152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:00.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 shutdown_connections 2024-04-20T10:51:00.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.274+0000 7fe45f826640 1 -- 172.21.15.90:0/3794258647 wait complete. 2024-04-20T10:51:00.285 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:51:00.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.384+0000 7f3fac9fb640 1 Processor -- start 2024-04-20T10:51:00.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.384+0000 7f3fac9fb640 1 -- start start 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.384+0000 7f3fac9fb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa81519e0 0x7f3fa80c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.384+0000 7f3fac9fb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3fa80c32b0 0x7f3fa806de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.384+0000 7f3fac9fb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa8154550 con 0x7f3fa80708d0 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.384+0000 7f3fac9fb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f3fa8155160 con 0x7f3fa80c32b0 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.384+0000 7f3fac9fb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa8154830 con 0x7f3fa81519e0 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa81519e0 0x7f3fa80c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa6d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3fa80c32b0 0x7f3fa806de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa6d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3fa80c32b0 0x7f3fa806de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60396/0 (socket says 172.21.15.90:60396) 2024-04-20T10:51:00.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa659c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa81519e0 0x7f3fa80c2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:37546/0 (socket says 172.21.15.90:37546) 2024-04-20T10:51:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/3021279440 learned_addr learned my addr 172.21.15.90:0/3021279440 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3f9ffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f3fa80708d0 0x7f3fa806d6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:40074/0 (socket says 172.21.15.90:40074) 2024-04-20T10:51:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/3021279440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa81519e0 msgr2=0x7f3fa80c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa6d9d640 1 --2- 172.21.15.90:0/3021279440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa81519e0 0x7f3fa80c2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/3021279440 >> v1:172.21.15.175:6789/0 conn(0x7f3fa80708d0 legacy=0x7f3fa806d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.385+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/3021279440 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa8154b10 con 0x7f3fa80c32b0 2024-04-20T10:51:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.386+0000 7f3fa6d9d640 1 --2- 172.21.15.90:0/3021279440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 0x7f3fa806de00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009e50 tx=0x7f3fa002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f0bb231f592808b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.386+0000 7f3fa5d9b640 1 -- 172.21.15.90:0/3021279440 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa002cb00 con 0x7f3fa80c32b0 2024-04-20T10:51:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.386+0000 7f3fa5d9b640 1 -- 172.21.15.90:0/3021279440 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa002cca0 con 0x7f3fa80c32b0 2024-04-20T10:51:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.386+0000 7f3fa5d9b640 1 -- 172.21.15.90:0/3021279440 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0034610 con 0x7f3fa80c32b0 2024-04-20T10:51:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 -- 172.21.15.90:0/3021279440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 msgr2=0x7f3fa806de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/3021279440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 0x7f3fa806de00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0009e50 tx=0x7f3fa002bf60 comp rx=0 tx=0).stop 2024-04-20T10:51:00.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 -- 172.21.15.90:0/3021279440 shutdown_connections 2024-04-20T10:51:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/3021279440 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 0x7f3fa806de00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/3021279440 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa81519e0 0x7f3fa80c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 -- 172.21.15.90:0/3021279440 >> 172.21.15.90:0/3021279440 conn(0x7f3fa806bb10 msgr2=0x7f3fa806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 -- 172.21.15.90:0/3021279440 shutdown_connections 2024-04-20T10:51:00.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.387+0000 7f3fac9fb640 1 -- 172.21.15.90:0/3021279440 wait complete. 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.388+0000 7f3fac9fb640 1 Processor -- start 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.388+0000 7f3fac9fb640 1 -- start start 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fac9fb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa80708d0 0x7f3fa80c1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fac9fb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 0x7f3fa814c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fac9fb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa81519e0 0x7f3fa81555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fac9fb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa8151dc0 con 0x7f3fa81519e0 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fac9fb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3fa806e340 con 0x7f3fa80c32b0 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fac9fb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3fa80c5ab0 con 0x7f3fa80708d0 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa81519e0 0x7f3fa81555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa81519e0 0x7f3fa81555f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59384/0 (socket says 172.21.15.90:59384) 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/791025023 learned_addr learned my addr 172.21.15.90:0/791025023 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa659c640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa80708d0 0x7f3fa80c1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3f9ffff640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 0x7f3fa814c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa80708d0 msgr2=0x7f3fa80c1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa80708d0 0x7f3fa80c1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 msgr2=0x7f3fa814c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 0x7f3fa814c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 -- 172.21.15.90:0/791025023 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa80ad080 con 0x7f3fa81519e0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3fa6d9d640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa81519e0 0x7f3fa81555f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036040 tx=0x7f3fa0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3f9effd640 1 -- 172.21.15.90:0/791025023 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0043020 con 0x7f3fa81519e0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3f9effd640 1 -- 172.21.15.90:0/791025023 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fa002ce50 con 0x7f3fa81519e0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.389+0000 7f3f9effd640 1 -- 172.21.15.90:0/791025023 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa0009510 con 0x7f3fa81519e0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.390+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa80ad360 con 0x7f3fa81519e0 2024-04-20T10:51:00.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.390+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fa80ac2b0 con 0x7f3fa81519e0 2024-04-20T10:51:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.391+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fa8076150 con 0x7f3fa81519e0 2024-04-20T10:51:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.391+0000 7f3f9effd640 1 -- 172.21.15.90:0/791025023 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3fa0046020 con 0x7f3fa81519e0 2024-04-20T10:51:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.391+0000 7f3f9effd640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3f8806c8f0 0x7f3f8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.391+0000 7f3f9effd640 1 -- 172.21.15.90:0/791025023 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f3fa00ae3a0 con 0x7f3fa81519e0 2024-04-20T10:51:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.391+0000 7f3fa659c640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3f8806c8f0 0x7f3f8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.392+0000 7f3fa659c640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3f8806c8f0 0x7f3f8806edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009a30 tx=0x7f3f98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.396+0000 7f3f9effd640 1 -- 172.21.15.90:0/791025023 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3fa004d030 con 0x7f3fa81519e0 2024-04-20T10:51:00.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.570+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f3fa806eea0 con 0x7f3fa81519e0 2024-04-20T10:51:00.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.570+0000 7f3f9effd640 1 -- 172.21.15.90:0/791025023 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f3fa003c350 con 0x7f3fa81519e0 2024-04-20T10:51:00.570 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:00.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3f8806c8f0 msgr2=0x7f3f8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3f8806c8f0 0x7f3f8806edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3f98009a30 tx=0x7f3f98008040 comp rx=0 tx=0).stop 2024-04-20T10:51:00.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa81519e0 msgr2=0x7f3fa81555f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa81519e0 0x7f3fa81555f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3fa0036040 tx=0x7f3fa0004a40 comp rx=0 tx=0).stop 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 shutdown_connections 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3f8806c8f0 0x7f3f8806edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3fa81519e0 0x7f3fa81555f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3fa80c32b0 0x7f3fa814c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 --2- 172.21.15.90:0/791025023 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3fa80708d0 0x7f3fa80c1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 >> 172.21.15.90:0/791025023 conn(0x7f3fa806bb10 msgr2=0x7f3fa8070d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 shutdown_connections 2024-04-20T10:51:00.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.572+0000 7f3fac9fb640 1 -- 172.21.15.90:0/791025023 wait complete. 2024-04-20T10:51:00.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:51:00.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.683+0000 7fb7fcf04640 1 Processor -- start 2024-04-20T10:51:00.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.683+0000 7fb7fcf04640 1 -- start start 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7fcf04640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb7f80ab710 0x7fb7f8157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7fcf04640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb7f806c4d0 0x7fb7f806c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7fcf04640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7f80adce0 con 0x7fb7f8153ee0 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7fcf04640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f80adfc0 con 0x7fb7f80ab710 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7fcf04640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb7f80ae2a0 con 0x7fb7f806c4d0 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb7f8153ee0 0x7fb7f80c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56750/0 (socket says 172.21.15.90:56750) 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f659c640 1 -- 172.21.15.90:0/3071567708 learned_addr learned my addr 172.21.15.90:0/3071567708 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:00.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f5d9b640 1 --2- 172.21.15.90:0/3071567708 >> v2:172.21.15.90:3300/0 conn(0x7fb7f80ab710 0x7fb7f8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f559a640 1 -- 172.21.15.90:0/3071567708 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257382519 0 0) 0x7fb7f80adce0 con 0x7fb7f8153ee0 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f559a640 1 -- 172.21.15.90:0/3071567708 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7e0003520 con 0x7fb7f8153ee0 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f6d9d640 1 --2- 172.21.15.90:0/3071567708 >> v2:172.21.15.175:3300/0 conn(0x7fb7f806c4d0 0x7fb7f806c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f5d9b640 1 -- 172.21.15.90:0/3071567708 >> v2:172.21.15.175:3300/0 conn(0x7fb7f806c4d0 msgr2=0x7fb7f806c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f5d9b640 1 --2- 172.21.15.90:0/3071567708 >> v2:172.21.15.175:3300/0 conn(0x7fb7f806c4d0 0x7fb7f806c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f5d9b640 1 -- 172.21.15.90:0/3071567708 >> v1:172.21.15.90:6789/0 conn(0x7fb7f8153ee0 legacy=0x7fb7f80c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.684+0000 7fb7f5d9b640 1 -- 172.21.15.90:0/3071567708 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f80c70f0 con 0x7fb7f80ab710 2024-04-20T10:51:00.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.685+0000 7fb7f5d9b640 1 --2- 172.21.15.90:0/3071567708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f80ab710 0x7fb7f8157190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80c6520 tx=0x7fb7ec02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3380133f70239 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.685+0000 7fb7f559a640 1 -- 172.21.15.90:0/3071567708 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec038070 con 0x7fb7f80ab710 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.685+0000 7fb7f559a640 1 -- 172.21.15.90:0/3071567708 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7ec031710 con 0x7fb7f80ab710 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.685+0000 7fb7f559a640 1 -- 172.21.15.90:0/3071567708 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec031ae0 con 0x7fb7f80ab710 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 -- 172.21.15.90:0/3071567708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f80ab710 msgr2=0x7fb7f8157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/3071567708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f80ab710 0x7fb7f8157190 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7f80c6520 tx=0x7fb7ec02b7b0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 -- 172.21.15.90:0/3071567708 shutdown_connections 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/3071567708 >> v2:172.21.15.175:3300/0 conn(0x7fb7f806c4d0 0x7fb7f806c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/3071567708 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f80ab710 0x7fb7f8157190 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 -- 172.21.15.90:0/3071567708 >> 172.21.15.90:0/3071567708 conn(0x7fb7f80cc060 msgr2=0x7fb7f80cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:00.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 -- 172.21.15.90:0/3071567708 shutdown_connections 2024-04-20T10:51:00.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.686+0000 7fb7fcf04640 1 -- 172.21.15.90:0/3071567708 wait complete. 2024-04-20T10:51:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.687+0000 7fb7fcf04640 1 Processor -- start 2024-04-20T10:51:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.687+0000 7fb7fcf04640 1 -- start start 2024-04-20T10:51:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7fcf04640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f806c4d0 0x7fb7f8157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7fcf04640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f80ab710 0x7fb7f8152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7fcf04640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f8153ee0 0x7fb7f8153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7fcf04640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f806cfc0 con 0x7fb7f806c4d0 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7fcf04640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb7f806ce40 con 0x7fb7f8153ee0 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7fcf04640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb7f806d140 con 0x7fb7f80ab710 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f806c4d0 0x7fb7f8157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f806c4d0 0x7fb7f8157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59406/0 (socket says 172.21.15.90:59406) 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 -- 172.21.15.90:0/695956302 learned_addr learned my addr 172.21.15.90:0/695956302 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f5d9b640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f80ab710 0x7fb7f8152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f6d9d640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f8153ee0 0x7fb7f8153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 -- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f80ab710 msgr2=0x7fb7f8152bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f80ab710 0x7fb7f8152bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 -- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f8153ee0 msgr2=0x7fb7f8153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f8153ee0 0x7fb7f8153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 -- 172.21.15.90:0/695956302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7f8153650 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f6d9d640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f8153ee0 0x7fb7f8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7f659c640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f806c4d0 0x7fb7f8157a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c390 tx=0x7fb7e800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7e6ffd640 1 -- 172.21.15.90:0/695956302 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e8017070 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7e6ffd640 1 -- 172.21.15.90:0/695956302 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e8005ce0 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7e6ffd640 1 -- 172.21.15.90:0/695956302 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7e80072f0 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.688+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7f80c4dd0 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.689+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7f8158390 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.690+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7f80af480 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.690+0000 7fb7e6ffd640 1 -- 172.21.15.90:0/695956302 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb7e801a070 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.690+0000 7fb7e6ffd640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb7d806c8f0 0x7fb7d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.690+0000 7fb7f5d9b640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb7d806c8f0 0x7fb7d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.690+0000 7fb7e6ffd640 1 -- 172.21.15.90:0/695956302 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb7e808b210 con 0x7fb7f806c4d0 2024-04-20T10:51:00.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.691+0000 7fb7f5d9b640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb7d806c8f0 0x7fb7d806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec035000 tx=0x7fb7ec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.697+0000 7fb7e6ffd640 1 -- 172.21.15.90:0/695956302 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb7f80af480 con 0x7fb7f806c4d0 2024-04-20T10:51:00.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.872+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fb7f80c52f0 con 0x7fb7f806c4d0 2024-04-20T10:51:00.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.872+0000 7fb7e6ffd640 1 -- 172.21.15.90:0/695956302 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7fb7e80593a0 con 0x7fb7f806c4d0 2024-04-20T10:51:00.873 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb7d806c8f0 msgr2=0x7fb7d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb7d806c8f0 0x7fb7d806edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec035000 tx=0x7fb7ec008030 comp rx=0 tx=0).stop 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f806c4d0 msgr2=0x7fb7f8157a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f806c4d0 0x7fb7f8157a30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb7e800c390 tx=0x7fb7e800c850 comp rx=0 tx=0).stop 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 shutdown_connections 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb7d806c8f0 0x7fb7d806edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb7f8153ee0 0x7fb7f8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb7f80ab710 0x7fb7f8152bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 --2- 172.21.15.90:0/695956302 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb7f806c4d0 0x7fb7f8157a30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 >> 172.21.15.90:0/695956302 conn(0x7fb7f80cc060 msgr2=0x7fb7f80c9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 shutdown_connections 2024-04-20T10:51:00.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.874+0000 7fb7fcf04640 1 -- 172.21.15.90:0/695956302 wait complete. 2024-04-20T10:51:00.885 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:51:00.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.985+0000 7faa07421640 1 Processor -- start 2024-04-20T10:51:00.985 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.985+0000 7faa07421640 1 -- start start 2024-04-20T10:51:00.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa07421640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 0x7faa001621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa07421640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa000af590 con 0x7faa00154040 2024-04-20T10:51:00.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa07421640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa000acd70 con 0x7faa000c4bb0 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa07421640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa000acb20 con 0x7faa0015a510 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa051bd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7faa00154040 0x7faa000730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56752/0 (socket says 172.21.15.90:56752) 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa051bd640 1 -- 172.21.15.90:0/1296530458 learned_addr learned my addr 172.21.15.90:0/1296530458 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa059be640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 0x7faa001621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1431687748 0 0) 0x7faa000af590 con 0x7faa00154040 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa9ec003520 con 0x7faa00154040 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 554697425 0 0) 0x7fa9ec003520 con 0x7faa00154040 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 msgr2=0x7faa001621f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 0x7faa001621f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 >> v1:172.21.15.175:6789/0 conn(0x7faa000c4bb0 legacy=0x7faa00159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa000c6400 con 0x7faa00154040 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fa9fc001670 con 0x7faa00154040 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 >> v1:172.21.15.90:6789/0 conn(0x7faa00154040 legacy=0x7faa000730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.989 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7fa9ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9ec004800 0x7fa9ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 0x7fa9ec005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa000acb20 con 0x7fa9ec0039e0 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa9ec00baf0 con 0x7fa9ec004800 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa9ec00bcf0 con 0x7faa0015a510 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.986+0000 7faa051bd640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7fa9ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa049bc640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9ec004800 0x7fa9ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa059be640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 0x7fa9ec005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa051bd640 1 -- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 msgr2=0x7fa9ec005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:00.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa051bd640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 0x7fa9ec005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa051bd640 1 -- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9ec004800 msgr2=0x7fa9ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa051bd640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa9ec004800 0x7fa9ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa051bd640 1 -- 172.21.15.90:0/1296530458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9ec003520 con 0x7fa9ec0039e0 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa059be640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0015a510 0x7fa9ec005200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.987+0000 7faa051bd640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7fa9ec003dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c290 tx=0x7fa9ec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79079bc5e122401 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007d50 con 0x7fa9ec0039e0 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc030070 con 0x7fa9ec0039e0 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7fa9f7fff640 1 -- 172.21.15.90:0/1296530458 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc02cd80 con 0x7fa9ec0039e0 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7faa07421640 1 -- 172.21.15.90:0/1296530458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 msgr2=0x7fa9ec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7faa07421640 1 --2- 172.21.15.90:0/1296530458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7fa9ec003dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc00c290 tx=0x7fa9ec005830 comp rx=0 tx=0).stop 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7faa059be640 1 -- 172.21.15.90:0/1296530458 reap_dead start 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7faa07421640 1 -- 172.21.15.90:0/1296530458 shutdown_connections 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7faa07421640 1 -- 172.21.15.90:0/1296530458 >> 172.21.15.90:0/1296530458 conn(0x7faa000676c0 msgr2=0x7faa00067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7faa07421640 1 -- 172.21.15.90:0/1296530458 shutdown_connections 2024-04-20T10:51:00.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.988+0000 7faa07421640 1 -- 172.21.15.90:0/1296530458 wait complete. 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.989+0000 7faa07421640 1 Processor -- start 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.989+0000 7faa07421640 1 -- start start 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa07421640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7faa0006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa07421640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa00159410 0x7faa001ecaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa07421640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0014e990 0x7faa00158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa07421640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa00073970 con 0x7fa9ec0039e0 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa07421640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa000737f0 con 0x7faa00159410 2024-04-20T10:51:00.994 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa07421640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa000aeea0 con 0x7faa0014e990 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7faa0006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7faa0006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59420/0 (socket says 172.21.15.90:59420) 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 -- 172.21.15.90:0/2873088167 learned_addr learned my addr 172.21.15.90:0/2873088167 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 -- 172.21.15.90:0/2873088167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0014e990 msgr2=0x7faa00158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0014e990 0x7faa00158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 -- 172.21.15.90:0/2873088167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa00159410 msgr2=0x7faa001ecaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa00159410 0x7faa001ecaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 -- 172.21.15.90:0/2873088167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa001ed030 con 0x7fa9ec0039e0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.990+0000 7faa051bd640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7faa0006cfc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc000f60 tx=0x7fa9fc001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.991+0000 7fa9f5ffb640 1 -- 172.21.15.90:0/2873088167 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc007d50 con 0x7fa9ec0039e0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.991+0000 7fa9f5ffb640 1 -- 172.21.15.90:0/2873088167 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc0049f0 con 0x7fa9ec0039e0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.991+0000 7fa9f5ffb640 1 -- 172.21.15.90:0/2873088167 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc004de0 con 0x7fa9ec0039e0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.991+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa001598b0 con 0x7fa9ec0039e0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.991+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa00157c60 con 0x7fa9ec0039e0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.992+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa00159dd0 con 0x7fa9ec0039e0 2024-04-20T10:51:00.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.992+0000 7fa9f5ffb640 1 -- 172.21.15.90:0/2873088167 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa9fc007070 con 0x7fa9ec0039e0 2024-04-20T10:51:00.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.992+0000 7fa9f5ffb640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9e406c8f0 0x7fa9e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:00.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.993+0000 7fa9f5ffb640 1 -- 172.21.15.90:0/2873088167 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fa9fc0ad3d0 con 0x7fa9ec0039e0 2024-04-20T10:51:00.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.993+0000 7faa049bc640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9e406c8f0 0x7fa9e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:00.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.993+0000 7faa049bc640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9e406c8f0 0x7fa9e406edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa000aca30 tx=0x7fa9f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:00.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:00.997+0000 7fa9f5ffb640 1 -- 172.21.15.90:0/2873088167 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faa00159dd0 con 0x7fa9ec0039e0 2024-04-20T10:51:01.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.171+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7faa00076150 con 0x7fa9ec0039e0 2024-04-20T10:51:01.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.172+0000 7fa9f5ffb640 1 -- 172.21.15.90:0/2873088167 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7faa001ed030 con 0x7fa9ec0039e0 2024-04-20T10:51:01.172 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9e406c8f0 msgr2=0x7fa9e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9e406c8f0 0x7fa9e406edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7faa000aca30 tx=0x7fa9f0009040 comp rx=0 tx=0).stop 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 msgr2=0x7faa0006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7faa0006cfc0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc000f60 tx=0x7fa9fc001a40 comp rx=0 tx=0).stop 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 shutdown_connections 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9e406c8f0 0x7fa9e406edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa0014e990 0x7faa00158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa00159410 0x7faa001ecaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 --2- 172.21.15.90:0/2873088167 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa9ec0039e0 0x7faa0006cfc0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 >> 172.21.15.90:0/2873088167 conn(0x7faa000676c0 msgr2=0x7faa000ab4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 shutdown_connections 2024-04-20T10:51:01.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.174+0000 7faa07421640 1 -- 172.21.15.90:0/2873088167 wait complete. 2024-04-20T10:51:01.184 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:51:01.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.284+0000 7f7bd545c640 1 Processor -- start 2024-04-20T10:51:01.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.284+0000 7f7bd545c640 1 -- start start 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bd545c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7bd006cc40 0x7f7bd00c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bd545c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd00c7100 con 0x7f7bd0153df0 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bd545c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bd006c160 con 0x7f7bd015a810 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bd545c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7bd00ca690 con 0x7f7bd006cc40 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bceffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f7bd0153df0 0x7f7bd00c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56754/0 (socket says 172.21.15.90:56754) 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bceffd640 1 -- 172.21.15.90:0/3210455059 learned_addr learned my addr 172.21.15.90:0/3210455059 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bc67fc640 1 --2- 172.21.15.90:0/3210455059 >> v2:172.21.15.175:3300/0 conn(0x7f7bd006cc40 0x7f7bd00c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081032827 0 0) 0x7f7bd00c7100 con 0x7f7bd0153df0 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7bbc003520 con 0x7f7bd0153df0 2024-04-20T10:51:01.288 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3396978809 0 0) 0x7f7bbc003520 con 0x7f7bd0153df0 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 >> v2:172.21.15.175:3300/0 conn(0x7f7bd006cc40 msgr2=0x7f7bd00c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 --2- 172.21.15.90:0/3210455059 >> v2:172.21.15.175:3300/0 conn(0x7f7bd006cc40 0x7f7bd00c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 >> v1:172.21.15.175:6789/0 conn(0x7f7bd015a810 legacy=0x7f7bd00c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd006c440 con 0x7f7bd0153df0 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f7bc0001670 con 0x7f7bd0153df0 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 >> v1:172.21.15.90:6789/0 conn(0x7f7bd0153df0 legacy=0x7f7bd00c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.285+0000 7f7bce7fc640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bbc0039b0 0x7f7bbc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bce7fc640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bbc004800 0x7f7bbc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bce7fc640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0052e0 0x7f7bbc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd00ca690 con 0x7f7bbc0039b0 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc00c1b0 con 0x7f7bbc0052e0 2024-04-20T10:51:01.289 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7bbc00c3b0 con 0x7f7bbc004800 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bceffd640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bbc0039b0 0x7f7bbc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bc67fc640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bbc004800 0x7f7bbc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bcf7fe640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0052e0 0x7f7bbc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bceffd640 1 -- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bbc004800 msgr2=0x7f7bbc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bceffd640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bbc004800 0x7f7bbc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bceffd640 1 -- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0052e0 msgr2=0x7f7bbc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bceffd640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0052e0 0x7f7bbc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bcf7fe640 1 -- 172.21.15.90:0/3210455059 reap_dead start 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bceffd640 1 -- 172.21.15.90:0/3210455059 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc003520 con 0x7f7bbc0039b0 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.286+0000 7f7bc67fc640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bbc004800 0x7f7bbc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bceffd640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bbc0039b0 0x7f7bbc003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c210 tx=0x7f7bbc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdda02e59083aa7b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0007cf0 con 0x7f7bbc0039b0 2024-04-20T10:51:01.290 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc0030070 con 0x7f7bbc0039b0 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bce7fc640 1 -- 172.21.15.90:0/3210455059 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc0005d70 con 0x7f7bbc0039b0 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bd545c640 1 -- 172.21.15.90:0/3210455059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bbc0039b0 msgr2=0x7f7bbc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bd545c640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bbc0039b0 0x7f7bbc003dd0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f7bc000c210 tx=0x7f7bbc005830 comp rx=0 tx=0).stop 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bd545c640 1 -- 172.21.15.90:0/3210455059 shutdown_connections 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bd545c640 1 --2- 172.21.15.90:0/3210455059 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bbc0039b0 0x7f7bbc003dd0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bd545c640 1 -- 172.21.15.90:0/3210455059 >> 172.21.15.90:0/3210455059 conn(0x7f7bd00adbd0 msgr2=0x7f7bd00adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bd545c640 1 -- 172.21.15.90:0/3210455059 shutdown_connections 2024-04-20T10:51:01.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.287+0000 7f7bd545c640 1 -- 172.21.15.90:0/3210455059 wait complete. 2024-04-20T10:51:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.288+0000 7f7bd545c640 1 Processor -- start 2024-04-20T10:51:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bd545c640 1 -- start start 2024-04-20T10:51:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bd545c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0039b0 0x7f7bd0158fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bd545c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bd0154a70 0x7f7bd01557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bd545c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd01ef760 0x7f7bd0140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.294 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bd545c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd015ac60 con 0x7f7bd01ef760 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bd545c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7bd006c7b0 con 0x7f7bbc0039b0 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bd545c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7bd00c73e0 con 0x7f7bd0154a70 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd01ef760 0x7f7bd0140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bcf7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd01ef760 0x7f7bd0140040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59438/0 (socket says 172.21.15.90:59438) 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bcf7fe640 1 -- 172.21.15.90:0/1963421916 learned_addr learned my addr 172.21.15.90:0/1963421916 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bceffd640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0039b0 0x7f7bd0158fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.289+0000 7f7bc67fc640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bd0154a70 0x7f7bd01557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bcf7fe640 1 -- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bd0154a70 msgr2=0x7f7bd01557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bcf7fe640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bd0154a70 0x7f7bd01557c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bcf7fe640 1 -- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0039b0 msgr2=0x7f7bd0158fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bcf7fe640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0039b0 0x7f7bd0158fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bcf7fe640 1 -- 172.21.15.90:0/1963421916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bd01594f0 con 0x7f7bd01ef760 2024-04-20T10:51:01.295 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bceffd640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0039b0 0x7f7bd0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bcf7fe640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd01ef760 0x7f7bd0140040 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bd01577f0 tx=0x7f7bc800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bc7fff640 1 -- 172.21.15.90:0/1963421916 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8019070 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bc7fff640 1 -- 172.21.15.90:0/1963421916 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bc8006b50 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bc7fff640 1 -- 172.21.15.90:0/1963421916 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc8003970 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bd01effa0 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.290+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bd01587b0 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.291+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bd0076150 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.291+0000 7f7bc7fff640 1 -- 172.21.15.90:0/1963421916 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7bc801c070 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.292+0000 7f7bc7fff640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7bb006c920 0x7f7bb006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.292+0000 7f7bceffd640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7bb006c920 0x7f7bb006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.292+0000 7f7bc7fff640 1 -- 172.21.15.90:0/1963421916 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f7bc808b4c0 con 0x7f7bd01ef760 2024-04-20T10:51:01.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.292+0000 7f7bceffd640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7bb006c920 0x7f7bb006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0034000 tx=0x7f7bc0007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.296+0000 7f7bc7fff640 1 -- 172.21.15.90:0/1963421916 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7bc8059650 con 0x7f7bd01ef760 2024-04-20T10:51:01.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.471+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f7bd006d950 con 0x7f7bd01ef760 2024-04-20T10:51:01.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.471+0000 7f7bc7fff640 1 -- 172.21.15.90:0/1963421916 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7f7bc8058f50 con 0x7f7bd01ef760 2024-04-20T10:51:01.471 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:01.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7bb006c920 msgr2=0x7f7bb006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7bb006c920 0x7f7bb006ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0034000 tx=0x7f7bc0007000 comp rx=0 tx=0).stop 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd01ef760 msgr2=0x7f7bd0140040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd01ef760 0x7f7bd0140040 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f7bd01577f0 tx=0x7f7bc800ec10 comp rx=0 tx=0).stop 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 shutdown_connections 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7bb006c920 0x7f7bb006ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7bd01ef760 0x7f7bd0140040 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7bd0154a70 0x7f7bd01557c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 --2- 172.21.15.90:0/1963421916 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7bbc0039b0 0x7f7bd0158fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 >> 172.21.15.90:0/1963421916 conn(0x7f7bd00adbd0 msgr2=0x7f7bd00abb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 shutdown_connections 2024-04-20T10:51:01.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.473+0000 7f7bd545c640 1 -- 172.21.15.90:0/1963421916 wait complete. 2024-04-20T10:51:01.484 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:01.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.580+0000 7f4e2a915640 1 Processor -- start 2024-04-20T10:51:01.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.580+0000 7f4e2a915640 1 -- start start 2024-04-20T10:51:01.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.580+0000 7f4e2a915640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 0x7f4e24156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.580+0000 7f4e2a915640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4e240c4bb0 0x7f4e24156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.580+0000 7f4e2a915640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e240c6870 con 0x7f4e240701c0 2024-04-20T10:51:01.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.580+0000 7f4e2a915640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4e240ab630 con 0x7f4e240c4bb0 2024-04-20T10:51:01.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.580+0000 7f4e2a915640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4e24159e00 con 0x7f4e2415ab30 2024-04-20T10:51:01.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e23fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4e240701c0 0x7f4e24073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56762/0 (socket says 172.21.15.90:56762) 2024-04-20T10:51:01.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e23fff640 1 -- 172.21.15.90:0/1275607446 learned_addr learned my addr 172.21.15.90:0/1275607446 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e237fe640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 0x7f4e24156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4094891738 0 0) 0x7f4e240c6870 con 0x7f4e240701c0 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e28eb2640 1 --2- 172.21.15.90:0/1275607446 >> v2:172.21.15.175:3300/0 conn(0x7f4e240c4bb0 0x7f4e24156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e0c003520 con 0x7f4e240701c0 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 182103812 0 0) 0x7f4e0c003520 con 0x7f4e240701c0 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 msgr2=0x7f4e24156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 0x7f4e24156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 >> v2:172.21.15.175:3300/0 conn(0x7f4e240c4bb0 msgr2=0x7f4e24156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 --2- 172.21.15.90:0/1275607446 >> v2:172.21.15.175:3300/0 conn(0x7f4e240c4bb0 0x7f4e24156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e2415a050 con 0x7f4e240701c0 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f4e14001670 con 0x7f4e240701c0 2024-04-20T10:51:01.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 >> v1:172.21.15.90:6789/0 conn(0x7f4e240701c0 legacy=0x7f4e24073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 0x7f4e0c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e0c003f30 0x7f4e0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e0c004d40 0x7f4e0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e24159e00 con 0x7f4e0c004d40 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0c00b9c0 con 0x7f4e0c003f30 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0c00bb40 con 0x7f4e2415ab30 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e28eb2640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e0c004d40 0x7f4e0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e23fff640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 0x7f4e0c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e237fe640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e0c003f30 0x7f4e0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e28eb2640 1 -- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 msgr2=0x7f4e0c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e28eb2640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 0x7f4e0c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e28eb2640 1 -- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e0c003f30 msgr2=0x7f4e0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e28eb2640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e0c003f30 0x7f4e0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.581+0000 7f4e28eb2640 1 -- 172.21.15.90:0/1275607446 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0c003520 con 0x7f4e0c004d40 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.582+0000 7f4e23fff640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e2415ab30 0x7f4e0c0039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.582+0000 7f4e28eb2640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e0c004d40 0x7f4e0c0051c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009fc0 tx=0x7f4e0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6cc324494d8ce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.582+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c039070 con 0x7f4e0c004d40 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.582+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1c02cc40 con 0x7f4e0c004d40 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.582+0000 7f4e22ffd640 1 -- 172.21.15.90:0/1275607446 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1c009c10 con 0x7f4e0c004d40 2024-04-20T10:51:01.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.583+0000 7f4e2a915640 1 -- 172.21.15.90:0/1275607446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e0c004d40 msgr2=0x7f4e0c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.583+0000 7f4e2a915640 1 --2- 172.21.15.90:0/1275607446 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e0c004d40 0x7f4e0c0051c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4e1c009fc0 tx=0x7f4e0c005830 comp rx=0 tx=0).stop 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.583+0000 7f4e28eb2640 1 -- 172.21.15.90:0/1275607446 reap_dead start 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.583+0000 7f4e2a915640 1 -- 172.21.15.90:0/1275607446 shutdown_connections 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.583+0000 7f4e2a915640 1 -- 172.21.15.90:0/1275607446 >> 172.21.15.90:0/1275607446 conn(0x7f4e240676c0 msgr2=0x7f4e24067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.583+0000 7f4e2a915640 1 -- 172.21.15.90:0/1275607446 shutdown_connections 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.583+0000 7f4e2a915640 1 -- 172.21.15.90:0/1275607446 wait complete. 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.584+0000 7f4e2a915640 1 Processor -- start 2024-04-20T10:51:01.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.584+0000 7f4e2a915640 1 -- start start 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e2a915640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e0c004d40 0x7f4e2406e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e2a915640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2414fbc0 0x7f4e240c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e2a915640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2406d680 0x7f4e24155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e2a915640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4e240705a0 con 0x7f4e2414fbc0 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e2a915640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4e2415a610 con 0x7f4e2406d680 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e2a915640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4e24073810 con 0x7f4e0c004d40 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2414fbc0 0x7f4e240c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2414fbc0 0x7f4e240c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59452/0 (socket says 172.21.15.90:59452) 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 -- 172.21.15.90:0/1541899287 learned_addr learned my addr 172.21.15.90:0/1541899287 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e23fff640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e0c004d40 0x7f4e2406e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e28eb2640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2406d680 0x7f4e24155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 -- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e0c004d40 msgr2=0x7f4e2406e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e0c004d40 0x7f4e2406e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 -- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2406d680 msgr2=0x7f4e24155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2406d680 0x7f4e24155a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 -- 172.21.15.90:0/1541899287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e24159660 con 0x7f4e2414fbc0 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e237fe640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2414fbc0 0x7f4e240c9060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011930 tx=0x7f4e18011d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.585+0000 7f4e20ff9640 1 -- 172.21.15.90:0/1541899287 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e1800fa30 con 0x7f4e2414fbc0 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.586+0000 7f4e20ff9640 1 -- 172.21.15.90:0/1541899287 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e1800fbd0 con 0x7f4e2414fbc0 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.586+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e24159940 con 0x7f4e2414fbc0 2024-04-20T10:51:01.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.586+0000 7f4e20ff9640 1 -- 172.21.15.90:0/1541899287 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e18014440 con 0x7f4e2414fbc0 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.586+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e2406d160 con 0x7f4e2414fbc0 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.587+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e24076150 con 0x7f4e2414fbc0 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.587+0000 7f4e20ff9640 1 -- 172.21.15.90:0/1541899287 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4e18012040 con 0x7f4e2414fbc0 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.587+0000 7f4e20ff9640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e1006c920 0x7f4e1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.588+0000 7f4e20ff9640 1 -- 172.21.15.90:0/1541899287 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4e1808c400 con 0x7f4e2414fbc0 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.588+0000 7f4e23fff640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e1006c920 0x7f4e1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.588+0000 7f4e23fff640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e1006c920 0x7f4e1006ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4e140017e0 tx=0x7f4e14007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.592+0000 7f4e20ff9640 1 -- 172.21.15.90:0/1541899287 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4e18019030 con 0x7f4e2414fbc0 2024-04-20T10:51:01.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.805+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4e24159b10 con 0x7f4e2414fbc0 2024-04-20T10:51:01.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.806+0000 7f4e20ff9640 1 -- 172.21.15.90:0/1541899287 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f4e18059eb0 con 0x7f4e2414fbc0 2024-04-20T10:51:01.806 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:01.806 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:01.806 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.807+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e1006c920 msgr2=0x7f4e1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.807+0000 7f4e2a915640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e1006c920 0x7f4e1006ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4e140017e0 tx=0x7f4e14007040 comp rx=0 tx=0).stop 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.807+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2414fbc0 msgr2=0x7f4e240c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.807+0000 7f4e2a915640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2414fbc0 0x7f4e240c9060 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4e18011930 tx=0x7f4e18011d30 comp rx=0 tx=0).stop 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 shutdown_connections 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e1006c920 0x7f4e1006ede0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4e2406d680 0x7f4e24155a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4e2414fbc0 0x7f4e240c9060 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 --2- 172.21.15.90:0/1541899287 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4e0c004d40 0x7f4e2406e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 >> 172.21.15.90:0/1541899287 conn(0x7f4e240676c0 msgr2=0x7f4e240ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:01.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 shutdown_connections 2024-04-20T10:51:01.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.808+0000 7f4e2a915640 1 -- 172.21.15.90:0/1541899287 wait complete. 2024-04-20T10:51:01.819 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:01.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.915+0000 7f5dbef0d640 1 Processor -- start 2024-04-20T10:51:01.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.915+0000 7f5dbef0d640 1 -- start start 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbef0d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5db80c27a0 0x7f5db81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbef0d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5db80ad640 0x7f5db8153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbef0d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db80adab0 con 0x7f5db80c54d0 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbef0d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5db8071690 con 0x7f5db80ad640 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbef0d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5db8071970 con 0x7f5db80c27a0 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbd4aa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5db80ad640 0x7f5db8153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbd4aa640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5db80ad640 0x7f5db8153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59466/0 (socket says 172.21.15.90:59466) 2024-04-20T10:51:01.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/1150872843 learned_addr learned my addr 172.21.15.90:0/1150872843 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbcca9640 1 --2- 172.21.15.90:0/1150872843 >> v2:172.21.15.175:3300/0 conn(0x7f5db80c27a0 0x7f5db81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/1150872843 >> v2:172.21.15.175:3300/0 conn(0x7f5db80c27a0 msgr2=0x7f5db81570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbd4aa640 1 --2- 172.21.15.90:0/1150872843 >> v2:172.21.15.175:3300/0 conn(0x7f5db80c27a0 0x7f5db81570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/1150872843 >> v1:172.21.15.175:6789/0 conn(0x7f5db80c54d0 legacy=0x7f5db815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.916+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/1150872843 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db8159ce0 con 0x7f5db80ad640 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.917+0000 7f5dbd4aa640 1 --2- 172.21.15.90:0/1150872843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80ad640 0x7f5db8153730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5db80c3490 tx=0x7f5db002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd6b89d2c8cc3e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.917+0000 7f5daf7fe640 1 -- 172.21.15.90:0/1150872843 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db002cb20 con 0x7f5db80ad640 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.917+0000 7f5daf7fe640 1 -- 172.21.15.90:0/1150872843 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db002ccc0 con 0x7f5db80ad640 2024-04-20T10:51:01.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.917+0000 7f5daf7fe640 1 -- 172.21.15.90:0/1150872843 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0034610 con 0x7f5db80ad640 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 -- 172.21.15.90:0/1150872843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80ad640 msgr2=0x7f5db8153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/1150872843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80ad640 0x7f5db8153730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5db80c3490 tx=0x7f5db002bf80 comp rx=0 tx=0).stop 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 -- 172.21.15.90:0/1150872843 shutdown_connections 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/1150872843 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80ad640 0x7f5db8153730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/1150872843 >> v2:172.21.15.175:3300/0 conn(0x7f5db80c27a0 0x7f5db81570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 -- 172.21.15.90:0/1150872843 >> 172.21.15.90:0/1150872843 conn(0x7f5db80c9100 msgr2=0x7f5db80c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 -- 172.21.15.90:0/1150872843 shutdown_connections 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.918+0000 7f5dbef0d640 1 -- 172.21.15.90:0/1150872843 wait complete. 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.919+0000 7f5dbef0d640 1 Processor -- start 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.919+0000 7f5dbef0d640 1 -- start start 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.919+0000 7f5dbef0d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db80ad640 0x7f5db8148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.919+0000 7f5dbef0d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db80c27a0 0x7f5db81ec060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbef0d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80c54d0 0x7f5db8156320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbef0d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5db80c2b80 con 0x7f5db80c54d0 2024-04-20T10:51:01.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbef0d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5db806f510 con 0x7f5db80ad640 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbef0d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5db80c2d00 con 0x7f5db80c27a0 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80c54d0 0x7f5db8156320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80c54d0 0x7f5db8156320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59474/0 (socket says 172.21.15.90:59474) 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/3783982972 learned_addr learned my addr 172.21.15.90:0/3783982972 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbcca9640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db80ad640 0x7f5db8148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5daffff640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db80c27a0 0x7f5db81ec060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db80c27a0 msgr2=0x7f5db81ec060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db80c27a0 0x7f5db81ec060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db80ad640 msgr2=0x7f5db8148b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:01.922 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db80ad640 0x7f5db8148b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 -- 172.21.15.90:0/3783982972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db8159b10 con 0x7f5db80c54d0 2024-04-20T10:51:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbd4aa640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80c54d0 0x7f5db8156320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5db002c590 tx=0x7f5db0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dad7fa640 1 -- 172.21.15.90:0/3783982972 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0043020 con 0x7f5db80c54d0 2024-04-20T10:51:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dad7fa640 1 -- 172.21.15.90:0/3783982972 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db003e450 con 0x7f5db80c54d0 2024-04-20T10:51:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db81ec5a0 con 0x7f5db80c54d0 2024-04-20T10:51:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dad7fa640 1 -- 172.21.15.90:0/3783982972 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db0009510 con 0x7f5db80c54d0 2024-04-20T10:51:01.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.920+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db8148880 con 0x7f5db80c54d0 2024-04-20T10:51:01.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.921+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5db8076150 con 0x7f5db80c54d0 2024-04-20T10:51:01.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.922+0000 7f5dad7fa640 1 -- 172.21.15.90:0/3783982972 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5db0046020 con 0x7f5db80c54d0 2024-04-20T10:51:01.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.922+0000 7f5dad7fa640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5da406c8f0 0x7f5da406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:01.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.922+0000 7f5dbcca9640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5da406c8f0 0x7f5da406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:01.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.922+0000 7f5dad7fa640 1 -- 172.21.15.90:0/3783982972 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f5db00ae370 con 0x7f5db80c54d0 2024-04-20T10:51:01.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.922+0000 7f5dbcca9640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5da406c8f0 0x7f5da406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:01.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:01.926+0000 7f5dad7fa640 1 -- 172.21.15.90:0/3783982972 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5db004d070 con 0x7f5db80c54d0 2024-04-20T10:51:02.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.105+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5db80c52b0 con 0x7f5db80c54d0 2024-04-20T10:51:02.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.107+0000 7f5dad7fa640 1 -- 172.21.15.90:0/3783982972 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f5db007c3e0 con 0x7f5db80c54d0 2024-04-20T10:51:02.107 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:02.107 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5da406c8f0 msgr2=0x7f5da406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5da406c8f0 0x7f5da406edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5db4006fd0 tx=0x7f5db4008040 comp rx=0 tx=0).stop 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80c54d0 msgr2=0x7f5db8156320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80c54d0 0x7f5db8156320 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5db002c590 tx=0x7f5db0004a40 comp rx=0 tx=0).stop 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 shutdown_connections 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5da406c8f0 0x7f5da406edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5db80c54d0 0x7f5db8156320 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5db80c27a0 0x7f5db81ec060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 --2- 172.21.15.90:0/3783982972 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5db80ad640 0x7f5db8148b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 >> 172.21.15.90:0/3783982972 conn(0x7f5db80c9100 msgr2=0x7f5db80ae730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:02.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 shutdown_connections 2024-04-20T10:51:02.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.109+0000 7f5dbef0d640 1 -- 172.21.15.90:0/3783982972 wait complete. 2024-04-20T10:51:02.120 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:51:02.120 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:51:02.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.220+0000 7ff181dce640 1 Processor -- start 2024-04-20T10:51:02.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.220+0000 7ff181dce640 1 -- start start 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff181dce640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff17c0c6a00 0x7ff17c15a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff181dce640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17c0c6e50 con 0x7ff17c153df0 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff181dce640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff17c0c7100 con 0x7ff17c06cc40 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff181dce640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff17c0ca690 con 0x7ff17c0c6a00 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff17b7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff17c153df0 0x7ff17c0c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56766/0 (socket says 172.21.15.90:56766) 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff17b7fe640 1 -- 172.21.15.90:0/1283241159 learned_addr learned my addr 172.21.15.90:0/1283241159 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff17bfff640 1 --2- 172.21.15.90:0/1283241159 >> v2:172.21.15.175:3300/0 conn(0x7ff17c0c6a00 0x7ff17c15a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff17a7fc640 1 -- 172.21.15.90:0/1283241159 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749204707 0 0) 0x7ff17c0c6e50 con 0x7ff17c153df0 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff17a7fc640 1 -- 172.21.15.90:0/1283241159 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff164003520 con 0x7ff17c153df0 2024-04-20T10:51:02.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.221+0000 7ff17bfff640 1 -- 172.21.15.90:0/1283241159 >> v1:172.21.15.175:6789/0 conn(0x7ff17c06cc40 legacy=0x7ff17c0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.222+0000 7ff17bfff640 1 -- 172.21.15.90:0/1283241159 >> v1:172.21.15.90:6789/0 conn(0x7ff17c153df0 legacy=0x7ff17c0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.222+0000 7ff17bfff640 1 -- 172.21.15.90:0/1283241159 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17c06c160 con 0x7ff17c0c6a00 2024-04-20T10:51:02.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.222+0000 7ff17bfff640 1 --2- 172.21.15.90:0/1283241159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c0c6a00 0x7ff17c15a810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff174009d90 tx=0x7ff17402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41670a17a1f43afa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.222+0000 7ff17a7fc640 1 -- 172.21.15.90:0/1283241159 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174039070 con 0x7ff17c0c6a00 2024-04-20T10:51:02.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.222+0000 7ff17a7fc640 1 -- 172.21.15.90:0/1283241159 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff17402cbd0 con 0x7ff17c0c6a00 2024-04-20T10:51:02.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.222+0000 7ff17a7fc640 1 -- 172.21.15.90:0/1283241159 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff174034440 con 0x7ff17c0c6a00 2024-04-20T10:51:02.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.223+0000 7ff181dce640 1 -- 172.21.15.90:0/1283241159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c0c6a00 msgr2=0x7ff17c15a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.223+0000 7ff181dce640 1 --2- 172.21.15.90:0/1283241159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c0c6a00 0x7ff17c15a810 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff174009d90 tx=0x7ff17402be20 comp rx=0 tx=0).stop 2024-04-20T10:51:02.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.223+0000 7ff181dce640 1 -- 172.21.15.90:0/1283241159 shutdown_connections 2024-04-20T10:51:02.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.223+0000 7ff181dce640 1 --2- 172.21.15.90:0/1283241159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c0c6a00 0x7ff17c15a810 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.223+0000 7ff181dce640 1 -- 172.21.15.90:0/1283241159 >> 172.21.15.90:0/1283241159 conn(0x7ff17c0adbd0 msgr2=0x7ff17c0adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:02.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.223+0000 7ff181dce640 1 -- 172.21.15.90:0/1283241159 shutdown_connections 2024-04-20T10:51:02.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.223+0000 7ff181dce640 1 -- 172.21.15.90:0/1283241159 wait complete. 2024-04-20T10:51:02.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.224+0000 7ff181dce640 1 Processor -- start 2024-04-20T10:51:02.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.224+0000 7ff181dce640 1 -- start start 2024-04-20T10:51:02.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff181dce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c06cc40 0x7ff17c159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff181dce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17c0c6a00 0x7ff17c0c4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff181dce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff17c153df0 0x7ff17c0abf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff181dce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c06c7b0 con 0x7ff17c0c6a00 2024-04-20T10:51:02.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff181dce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c1541d0 con 0x7ff17c06cc40 2024-04-20T10:51:02.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff181dce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff17c0c73e0 con 0x7ff17c153df0 2024-04-20T10:51:02.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17c0c6a00 0x7ff17c0c4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17c0c6a00 0x7ff17c0c4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59480/0 (socket says 172.21.15.90:59480) 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 -- 172.21.15.90:0/3336158094 learned_addr learned my addr 172.21.15.90:0/3336158094 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17b7fe640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c06cc40 0x7ff17c159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 -- 172.21.15.90:0/3336158094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff17c153df0 msgr2=0x7ff17c0abf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff17c153df0 0x7ff17c0abf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 -- 172.21.15.90:0/3336158094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c06cc40 msgr2=0x7ff17c159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c06cc40 0x7ff17c159d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.225+0000 7ff17affd640 1 -- 172.21.15.90:0/3336158094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17c0c6000 con 0x7ff17c0c6a00 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.226+0000 7ff17affd640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17c0c6a00 0x7ff17c0c4220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c450 tx=0x7ff17000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.226+0000 7ff163fff640 1 -- 172.21.15.90:0/3336158094 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1700052d0 con 0x7ff17c0c6a00 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.226+0000 7ff163fff640 1 -- 172.21.15.90:0/3336158094 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff170005470 con 0x7ff17c0c6a00 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.226+0000 7ff163fff640 1 -- 172.21.15.90:0/3336158094 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff170012870 con 0x7ff17c0c6a00 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.226+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17c159500 con 0x7ff17c0c6a00 2024-04-20T10:51:02.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.226+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17c157d50 con 0x7ff17c0c6a00 2024-04-20T10:51:02.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.227+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17c076150 con 0x7ff17c0c6a00 2024-04-20T10:51:02.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.227+0000 7ff163fff640 1 -- 172.21.15.90:0/3336158094 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff170012a10 con 0x7ff17c0c6a00 2024-04-20T10:51:02.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.228+0000 7ff163fff640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff16806c920 0x7ff16806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.228+0000 7ff163fff640 1 -- 172.21.15.90:0/3336158094 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff17008bad0 con 0x7ff17c0c6a00 2024-04-20T10:51:02.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.228+0000 7ff17b7fe640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff16806c920 0x7ff16806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.228+0000 7ff17b7fe640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff16806c920 0x7ff16806ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0011e0 tx=0x7ff16c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.232+0000 7ff163fff640 1 -- 172.21.15.90:0/3336158094 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff170059bd0 con 0x7ff17c0c6a00 2024-04-20T10:51:02.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.409+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff17c0c61d0 con 0x7ff17c0c6a00 2024-04-20T10:51:02.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.409+0000 7ff163fff640 1 -- 172.21.15.90:0/3336158094 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7ff1700594d0 con 0x7ff17c0c6a00 2024-04-20T10:51:02.409 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff16806c920 msgr2=0x7ff16806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff16806c920 0x7ff16806ede0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0011e0 tx=0x7ff16c009040 comp rx=0 tx=0).stop 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17c0c6a00 msgr2=0x7ff17c0c4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17c0c6a00 0x7ff17c0c4220 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ff17000c450 tx=0x7ff17000c910 comp rx=0 tx=0).stop 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 shutdown_connections 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff16806c920 0x7ff16806ede0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff17c153df0 0x7ff17c0abf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff17c0c6a00 0x7ff17c0c4220 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 --2- 172.21.15.90:0/3336158094 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff17c06cc40 0x7ff17c159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 >> 172.21.15.90:0/3336158094 conn(0x7ff17c0adbd0 msgr2=0x7ff17c151860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:02.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 shutdown_connections 2024-04-20T10:51:02.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.411+0000 7ff181dce640 1 -- 172.21.15.90:0/3336158094 wait complete. 2024-04-20T10:51:02.423 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:51:02.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.522+0000 7efd6771e640 1 Processor -- start 2024-04-20T10:51:02.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.522+0000 7efd6771e640 1 -- start start 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.522+0000 7efd6771e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 0x7efd60157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.522+0000 7efd6771e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd600adce0 con 0x7efd6006c4d0 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.522+0000 7efd6771e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd600adfc0 con 0x7efd60153ee0 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.522+0000 7efd6771e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd600ae2a0 con 0x7efd600ab710 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7efd6006c4d0 0x7efd6006c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56770/0 (socket says 172.21.15.90:56770) 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 -- 172.21.15.90:0/1436173814 learned_addr learned my addr 172.21.15.90:0/1436173814 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146570747 0 0) 0x7efd600adce0 con 0x7efd6006c4d0 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd4c003520 con 0x7efd6006c4d0 2024-04-20T10:51:02.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd64cb9640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 0x7efd60157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3980189827 0 0) 0x7efd4c003520 con 0x7efd6006c4d0 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 msgr2=0x7efd60157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 0x7efd60157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 >> v1:172.21.15.175:6789/0 conn(0x7efd60153ee0 legacy=0x7efd600c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd600c70f0 con 0x7efd6006c4d0 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7efd5c001670 con 0x7efd6006c4d0 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 >> v1:172.21.15.90:6789/0 conn(0x7efd6006c4d0 legacy=0x7efd6006c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4c0039e0 0x7efd4c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 0x7efd4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd600ae2a0 con 0x7efd4c004d40 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd4c00bb80 con 0x7efd4c0039e0 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd4c00bd80 con 0x7efd600ab710 2024-04-20T10:51:02.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd654ba640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4c0039e0 0x7efd4c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd64cb9640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 0x7efd4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 -- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 msgr2=0x7efd4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600ab710 0x7efd4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 -- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4c0039e0 msgr2=0x7efd4c003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd4c0039e0 0x7efd4c003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.523+0000 7efd65cbb640 1 -- 172.21.15.90:0/1436173814 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd4c003520 con 0x7efd4c004d40 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.524+0000 7efd65cbb640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00c210 tx=0x7efd4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5db50facbd9a7e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.524+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c007d30 con 0x7efd4c004d40 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.524+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5c030070 con 0x7efd4c004d40 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.524+0000 7efd57fff640 1 -- 172.21.15.90:0/1436173814 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5c02cd60 con 0x7efd4c004d40 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.525+0000 7efd6771e640 1 -- 172.21.15.90:0/1436173814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c004d40 msgr2=0x7efd4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.525+0000 7efd6771e640 1 --2- 172.21.15.90:0/1436173814 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd4c004d40 0x7efd4c0051c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efd5c00c210 tx=0x7efd4c005830 comp rx=0 tx=0).stop 2024-04-20T10:51:02.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.525+0000 7efd65cbb640 1 -- 172.21.15.90:0/1436173814 reap_dead start 2024-04-20T10:51:02.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.525+0000 7efd6771e640 1 -- 172.21.15.90:0/1436173814 shutdown_connections 2024-04-20T10:51:02.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.525+0000 7efd6771e640 1 -- 172.21.15.90:0/1436173814 >> 172.21.15.90:0/1436173814 conn(0x7efd600cc060 msgr2=0x7efd600cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:02.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.525+0000 7efd6771e640 1 -- 172.21.15.90:0/1436173814 shutdown_connections 2024-04-20T10:51:02.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.525+0000 7efd6771e640 1 -- 172.21.15.90:0/1436173814 wait complete. 2024-04-20T10:51:02.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.526+0000 7efd6771e640 1 Processor -- start 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.526+0000 7efd6771e640 1 -- start start 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd6771e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4c004d40 0x7efd601ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd6771e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60158980 0x7efd600c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd6771e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600bf9e0 0x7efd600c03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd6771e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd6006d1b0 con 0x7efd60158980 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd6771e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd6006d030 con 0x7efd600bf9e0 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd6771e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd60157190 con 0x7efd4c004d40 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60158980 0x7efd600c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60158980 0x7efd600c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59504/0 (socket says 172.21.15.90:59504) 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 -- 172.21.15.90:0/4127265562 learned_addr learned my addr 172.21.15.90:0/4127265562 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:02.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd65cbb640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600bf9e0 0x7efd600c03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd654ba640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4c004d40 0x7efd601ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 -- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4c004d40 msgr2=0x7efd601ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4c004d40 0x7efd601ef850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 -- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600bf9e0 msgr2=0x7efd600c03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600bf9e0 0x7efd600c03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 -- 172.21.15.90:0/4127265562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd60152f20 con 0x7efd60158980 2024-04-20T10:51:02.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd654ba640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4c004d40 0x7efd601ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:02.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd64cb9640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60158980 0x7efd600c54e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efd50011910 tx=0x7efd50011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd55ffb640 1 -- 172.21.15.90:0/4127265562 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50019070 con 0x7efd60158980 2024-04-20T10:51:02.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd55ffb640 1 -- 172.21.15.90:0/4127265562 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd50004240 con 0x7efd60158980 2024-04-20T10:51:02.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd60159990 con 0x7efd60158980 2024-04-20T10:51:02.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.527+0000 7efd55ffb640 1 -- 172.21.15.90:0/4127265562 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd5000f8e0 con 0x7efd60158980 2024-04-20T10:51:02.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.528+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd60159c70 con 0x7efd60158980 2024-04-20T10:51:02.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.529+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd60159790 con 0x7efd60158980 2024-04-20T10:51:02.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.529+0000 7efd55ffb640 1 -- 172.21.15.90:0/4127265562 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd5001c070 con 0x7efd60158980 2024-04-20T10:51:02.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.529+0000 7efd55ffb640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4406c8f0 0x7efd4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.529+0000 7efd55ffb640 1 -- 172.21.15.90:0/4127265562 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7efd5008c370 con 0x7efd60158980 2024-04-20T10:51:02.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.529+0000 7efd654ba640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4406c8f0 0x7efd4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.530+0000 7efd654ba640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4406c8f0 0x7efd4406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd601ea120 tx=0x7efd58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.534+0000 7efd55ffb640 1 -- 172.21.15.90:0/4127265562 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7efd5005a470 con 0x7efd60158980 2024-04-20T10:51:02.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.712+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7efd60076150 con 0x7efd60158980 2024-04-20T10:51:02.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.713+0000 7efd55ffb640 1 -- 172.21.15.90:0/4127265562 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7efd50059d70 con 0x7efd60158980 2024-04-20T10:51:02.713 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4406c8f0 msgr2=0x7efd4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4406c8f0 0x7efd4406edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7efd601ea120 tx=0x7efd58009040 comp rx=0 tx=0).stop 2024-04-20T10:51:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60158980 msgr2=0x7efd600c54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60158980 0x7efd600c54e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efd50011910 tx=0x7efd50011dd0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 shutdown_connections 2024-04-20T10:51:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4406c8f0 0x7efd4406edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600bf9e0 0x7efd600c03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60158980 0x7efd600c54e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 --2- 172.21.15.90:0/4127265562 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd4c004d40 0x7efd601ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 >> 172.21.15.90:0/4127265562 conn(0x7efd600cc060 msgr2=0x7efd600ac9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 shutdown_connections 2024-04-20T10:51:02.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.715+0000 7efd6771e640 1 -- 172.21.15.90:0/4127265562 wait complete. 2024-04-20T10:51:02.726 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:51:02.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.825+0000 7fa2feea8640 1 Processor -- start 2024-04-20T10:51:02.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.825+0000 7fa2feea8640 1 -- start start 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2feea8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa2f8153c90 0x7fa2f806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2feea8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2f806f000 0x7fa2f8156780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2feea8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f80c3fd0 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2feea8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f80c4590 con 0x7fa2f8153c90 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2feea8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f80c42b0 con 0x7fa2f806f000 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2fcc44640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa2f8153c90 0x7fa2f806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2fd445640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa2f80ad4c0 0x7fa2f80c50b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56786/0 (socket says 172.21.15.90:56786) 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2fd445640 1 -- 172.21.15.90:0/2239969646 learned_addr learned my addr 172.21.15.90:0/2239969646 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2fcc44640 1 -- 172.21.15.90:0/2239969646 >> v2:172.21.15.175:3300/0 conn(0x7fa2f806f000 msgr2=0x7fa2f8156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2fcc44640 1 --2- 172.21.15.90:0/2239969646 >> v2:172.21.15.175:3300/0 conn(0x7fa2f806f000 0x7fa2f8156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2fcc44640 1 -- 172.21.15.90:0/2239969646 >> v1:172.21.15.90:6789/0 conn(0x7fa2f80ad4c0 legacy=0x7fa2f80c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2f77fe640 1 -- 172.21.15.90:0/2239969646 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3678741735 0 0) 0x7fa2f80c3fd0 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.826+0000 7fa2fcc44640 1 -- 172.21.15.90:0/2239969646 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f806e0e0 con 0x7fa2f8153c90 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.827+0000 7fa2fcc44640 1 --2- 172.21.15.90:0/2239969646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f8153c90 0x7fa2f806e8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80698d0 tx=0x7fa2e802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9311c4ce9e65b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.827+0000 7fa2f77fe640 1 -- 172.21.15.90:0/2239969646 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8038070 con 0x7fa2f8153c90 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.827+0000 7fa2f77fe640 1 -- 172.21.15.90:0/2239969646 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e8031710 con 0x7fa2f8153c90 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.827+0000 7fa2f77fe640 1 -- 172.21.15.90:0/2239969646 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8031ae0 con 0x7fa2f8153c90 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 -- 172.21.15.90:0/2239969646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f8153c90 msgr2=0x7fa2f806e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 --2- 172.21.15.90:0/2239969646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f8153c90 0x7fa2f806e8e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80698d0 tx=0x7fa2e802b7b0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 -- 172.21.15.90:0/2239969646 shutdown_connections 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 --2- 172.21.15.90:0/2239969646 >> v2:172.21.15.175:3300/0 conn(0x7fa2f806f000 0x7fa2f8156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 --2- 172.21.15.90:0/2239969646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f8153c90 0x7fa2f806e8e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 -- 172.21.15.90:0/2239969646 >> 172.21.15.90:0/2239969646 conn(0x7fa2f806bb10 msgr2=0x7fa2f806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 -- 172.21.15.90:0/2239969646 shutdown_connections 2024-04-20T10:51:02.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.828+0000 7fa2feea8640 1 -- 172.21.15.90:0/2239969646 wait complete. 2024-04-20T10:51:02.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.829+0000 7fa2feea8640 1 Processor -- start 2024-04-20T10:51:02.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.829+0000 7fa2feea8640 1 -- start start 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806f000 0x7fa2f814a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f80ad4c0 0x7fa2f81497f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f8153c90 0x7fa2f8149d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80c5940 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80c57c0 con 0x7fa2f806f000 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f8154070 con 0x7fa2f8153c90 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f80ad4c0 0x7fa2f81497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f80ad4c0 0x7fa2f81497f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59536/0 (socket says 172.21.15.90:59536) 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 -- 172.21.15.90:0/1844392696 learned_addr learned my addr 172.21.15.90:0/1844392696 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2fcc44640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806f000 0x7fa2f814a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2fd445640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f8153c90 0x7fa2f8149d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 -- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f8153c90 msgr2=0x7fa2f8149d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f8153c90 0x7fa2f8149d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 -- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806f000 msgr2=0x7fa2f814a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806f000 0x7fa2f814a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 -- 172.21.15.90:0/1844392696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f814e540 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2fd445640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f8153c90 0x7fa2f8149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f7fff640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f80ad4c0 0x7fa2f81497f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00b480 tx=0x7fa2ec00b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f57fa640 1 -- 172.21.15.90:0/1844392696 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec014070 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f57fa640 1 -- 172.21.15.90:0/1844392696 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2ec010870 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f814e820 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2f57fa640 1 -- 172.21.15.90:0/1844392696 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec010c60 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.830+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f814ede0 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.831+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f8076150 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.832+0000 7fa2f57fa640 1 -- 172.21.15.90:0/1844392696 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2ec017070 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.832+0000 7fa2f57fa640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e406c8f0 0x7fa2e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:02.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.832+0000 7fa2fcc44640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e406c8f0 0x7fa2e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:02.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.832+0000 7fa2f57fa640 1 -- 172.21.15.90:0/1844392696 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fa2ec08bbd0 con 0x7fa2f80ad4c0 2024-04-20T10:51:02.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.833+0000 7fa2fcc44640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e406c8f0 0x7fa2e406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8035000 tx=0x7fa2e8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:02.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:02.837+0000 7fa2f57fa640 1 -- 172.21.15.90:0/1844392696 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa2ec059710 con 0x7fa2f80ad4c0 2024-04-20T10:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.010+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fa2f80c3460 con 0x7fa2f80ad4c0 2024-04-20T10:51:03.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.011+0000 7fa2f57fa640 1 -- 172.21.15.90:0/1844392696 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7fa2ec05da10 con 0x7fa2f80ad4c0 2024-04-20T10:51:03.011 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.012+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e406c8f0 msgr2=0x7fa2e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.012+0000 7fa2feea8640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e406c8f0 0x7fa2e406edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8035000 tx=0x7fa2e8008030 comp rx=0 tx=0).stop 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.012+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f80ad4c0 msgr2=0x7fa2f81497f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.012+0000 7fa2feea8640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f80ad4c0 0x7fa2f81497f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00b480 tx=0x7fa2ec00b940 comp rx=0 tx=0).stop 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 shutdown_connections 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa2e406c8f0 0x7fa2e406edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2f8153c90 0x7fa2f8149d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2f80ad4c0 0x7fa2f81497f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 --2- 172.21.15.90:0/1844392696 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2f806f000 0x7fa2f814a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 >> 172.21.15.90:0/1844392696 conn(0x7fa2f806bb10 msgr2=0x7fa2f806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 shutdown_connections 2024-04-20T10:51:03.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.013+0000 7fa2feea8640 1 -- 172.21.15.90:0/1844392696 wait complete. 2024-04-20T10:51:03.024 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:51:03.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.122+0000 7f93bf7ce640 1 Processor -- start 2024-04-20T10:51:03.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.122+0000 7f93bf7ce640 1 -- start start 2024-04-20T10:51:03.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bf7ce640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93b80c7bf0 0x7f93b80c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bf7ce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f93b806ef90 0x7f93b8157170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bf7ce640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93b80c2880 con 0x7f93b80c1ce0 2024-04-20T10:51:03.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bf7ce640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f93b80c4480 con 0x7f93b806ef90 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bf7ce640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f93b81576b0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bcd69640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f93b806ef90 0x7f93b8157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bcd69640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f93b806ef90 0x7f93b8157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59546/0 (socket says 172.21.15.90:59546) 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.123+0000 7f93bcd69640 1 -- 172.21.15.90:0/4004415666 learned_addr learned my addr 172.21.15.90:0/4004415666 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93bcd69640 1 -- 172.21.15.90:0/4004415666 >> v2:172.21.15.175:3300/0 conn(0x7f93b80c7bf0 msgr2=0x7f93b80c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93bcd69640 1 --2- 172.21.15.90:0/4004415666 >> v2:172.21.15.175:3300/0 conn(0x7f93b80c7bf0 0x7f93b80c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93bcd69640 1 -- 172.21.15.90:0/4004415666 >> v1:172.21.15.90:6789/0 conn(0x7f93b80c1ce0 legacy=0x7f93b80c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93bcd69640 1 -- 172.21.15.90:0/4004415666 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b80c33e0 con 0x7f93b806ef90 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93affff640 1 -- 172.21.15.90:0/4004415666 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 196969872 0 0) 0x7f93b80c2880 con 0x7f93b80c1ce0 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93bcd69640 1 --2- 172.21.15.90:0/4004415666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b806ef90 0x7f93b8157170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93b8070cc0 tx=0x7f93a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=307ab2744cc9e834 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93affff640 1 -- 172.21.15.90:0/4004415666 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a802e070 con 0x7f93b806ef90 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93affff640 1 -- 172.21.15.90:0/4004415666 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93a8037070 con 0x7f93b806ef90 2024-04-20T10:51:03.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.124+0000 7f93affff640 1 -- 172.21.15.90:0/4004415666 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93a8031a00 con 0x7f93b806ef90 2024-04-20T10:51:03.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 -- 172.21.15.90:0/4004415666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b806ef90 msgr2=0x7f93b8157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/4004415666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b806ef90 0x7f93b8157170 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f93b8070cc0 tx=0x7f93a802b880 comp rx=0 tx=0).stop 2024-04-20T10:51:03.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 -- 172.21.15.90:0/4004415666 shutdown_connections 2024-04-20T10:51:03.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/4004415666 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b806ef90 0x7f93b8157170 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/4004415666 >> v2:172.21.15.175:3300/0 conn(0x7f93b80c7bf0 0x7f93b80c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 -- 172.21.15.90:0/4004415666 >> 172.21.15.90:0/4004415666 conn(0x7f93b80aa660 msgr2=0x7f93b80aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 -- 172.21.15.90:0/4004415666 shutdown_connections 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.125+0000 7f93bf7ce640 1 -- 172.21.15.90:0/4004415666 wait complete. 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.126+0000 7f93bf7ce640 1 Processor -- start 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.126+0000 7f93bf7ce640 1 -- start start 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bf7ce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b806ef90 0x7f93b8152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bf7ce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80c1ce0 0x7f93b81efb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bf7ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b80c7bf0 0x7f93b81f0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bf7ce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80c39a0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bf7ce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93b80c3ff0 con 0x7f93b80c1ce0 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bf7ce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f93b80c3c80 con 0x7f93b806ef90 2024-04-20T10:51:03.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b80c7bf0 0x7f93b81f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b80c7bf0 0x7f93b81f0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59562/0 (socket says 172.21.15.90:59562) 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 -- 172.21.15.90:0/3196201438 learned_addr learned my addr 172.21.15.90:0/3196201438 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bcd69640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80c1ce0 0x7f93b81efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bd56a640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b806ef90 0x7f93b8152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 -- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b806ef90 msgr2=0x7f93b8152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b806ef90 0x7f93b8152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 -- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80c1ce0 msgr2=0x7f93b81efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80c1ce0 0x7f93b81efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 -- 172.21.15.90:0/3196201438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93b81f0a80 con 0x7f93b80c7bf0 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bdd6b640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b80c7bf0 0x7f93b81f0080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c480 tx=0x7f93b000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93adffb640 1 -- 172.21.15.90:0/3196201438 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0005480 con 0x7f93b80c7bf0 2024-04-20T10:51:03.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93adffb640 1 -- 172.21.15.90:0/3196201438 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93b00035f0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93b81f07a0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.127+0000 7f93adffb640 1 -- 172.21.15.90:0/3196201438 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93b0003a00 con 0x7f93b80c7bf0 2024-04-20T10:51:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.128+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93b81594c0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.128+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93b8076150 con 0x7f93b80c7bf0 2024-04-20T10:51:03.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.129+0000 7f93adffb640 1 -- 172.21.15.90:0/3196201438 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93b0003ba0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.129+0000 7f93adffb640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f939c06ca90 0x7f939c06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.129+0000 7f93adffb640 1 -- 172.21.15.90:0/3196201438 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f93b008ba50 con 0x7f93b80c7bf0 2024-04-20T10:51:03.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.129+0000 7f93bd56a640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f939c06ca90 0x7f939c06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.130+0000 7f93bd56a640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f939c06ca90 0x7f939c06ef50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93b8150c20 tx=0x7f93b40094f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.134+0000 7f93adffb640 1 -- 172.21.15.90:0/3196201438 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f93b00182b0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.309+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f93b8073f70 con 0x7f93b80c7bf0 2024-04-20T10:51:03.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.310+0000 7f93adffb640 1 -- 172.21.15.90:0/3196201438 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f93b0059be0 con 0x7f93b80c7bf0 2024-04-20T10:51:03.310 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f939c06ca90 msgr2=0x7f939c06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f939c06ca90 0x7f939c06ef50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f93b8150c20 tx=0x7f93b40094f0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b80c7bf0 msgr2=0x7f93b81f0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b80c7bf0 0x7f93b81f0080 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f93b000c480 tx=0x7f93b000c940 comp rx=0 tx=0).stop 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 shutdown_connections 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f939c06ca90 0x7f939c06ef50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93b80c7bf0 0x7f93b81f0080 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93b80c1ce0 0x7f93b81efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 --2- 172.21.15.90:0/3196201438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93b806ef90 0x7f93b8152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.311+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 >> 172.21.15.90:0/3196201438 conn(0x7f93b80aa660 msgr2=0x7f93b81563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:03.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.312+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 shutdown_connections 2024-04-20T10:51:03.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.312+0000 7f93bf7ce640 1 -- 172.21.15.90:0/3196201438 wait complete. 2024-04-20T10:51:03.322 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:51:03.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f689d481640 1 Processor -- start 2024-04-20T10:51:03.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f689d481640 1 -- start start 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f689d481640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 0x7f6898156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f689d481640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689815a720 con 0x7f6898153ef0 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f689d481640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f689815ac80 con 0x7f68980ab730 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f689d481640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f689815a9a0 con 0x7f68980c9ee0 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f6896ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6898153ef0 0x7f68980c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56796/0 (socket says 172.21.15.90:56796) 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.422+0000 7f6896ffd640 1 -- 172.21.15.90:0/1436867470 learned_addr learned my addr 172.21.15.90:0/1436867470 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555365731 0 0) 0x7f6888001490 con 0x7f6898153ef0 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6880003520 con 0x7f6898153ef0 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f68977fe640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 0x7f6898156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 602628305 0 0) 0x7f6880003520 con 0x7f6898153ef0 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 msgr2=0x7f6898156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 0x7f6898156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 >> v1:172.21.15.175:6789/0 conn(0x7f68980ab730 legacy=0x7f68981568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68980c6a90 con 0x7f6898153ef0 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f6888001be0 con 0x7f6898153ef0 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 >> v1:172.21.15.90:6789/0 conn(0x7f6898153ef0 legacy=0x7f68980c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f6880003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6880004800 0x7f6880004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 0x7f688000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f689815a9a0 con 0x7f68800039e0 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6880005540 con 0x7f6880004800 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f688000bf00 con 0x7f68980c9ee0 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6896ffd640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f6880003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f68967fc640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6880004800 0x7f6880004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f68977fe640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 0x7f688000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6896ffd640 1 -- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 msgr2=0x7f688000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6896ffd640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 0x7f688000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6896ffd640 1 -- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6880004800 msgr2=0x7f6880004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6896ffd640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6880004800 0x7f6880004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f6896ffd640 1 -- 172.21.15.90:0/1436867470 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6880003520 con 0x7f68800039e0 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f68967fc640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6880004800 0x7f6880004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.423+0000 7f68977fe640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68980c9ee0 0x7f688000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.424+0000 7f6896ffd640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f6880003e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f688800aa20 tx=0x7f6880005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8adb0e5c3bea5b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.424+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688800a670 con 0x7f68800039e0 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.424+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6888034630 con 0x7f68800039e0 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.424+0000 7f6895ffb640 1 -- 172.21.15.90:0/1436867470 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888034a20 con 0x7f68800039e0 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.425+0000 7f689d481640 1 -- 172.21.15.90:0/1436867470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 msgr2=0x7f6880003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.425+0000 7f689d481640 1 --2- 172.21.15.90:0/1436867470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f6880003e00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f688800aa20 tx=0x7f6880005830 comp rx=0 tx=0).stop 2024-04-20T10:51:03.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.425+0000 7f68977fe640 1 -- 172.21.15.90:0/1436867470 reap_dead start 2024-04-20T10:51:03.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.425+0000 7f689d481640 1 -- 172.21.15.90:0/1436867470 shutdown_connections 2024-04-20T10:51:03.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.425+0000 7f689d481640 1 -- 172.21.15.90:0/1436867470 >> 172.21.15.90:0/1436867470 conn(0x7f68980cbfe0 msgr2=0x7f68980cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:03.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.425+0000 7f689d481640 1 -- 172.21.15.90:0/1436867470 shutdown_connections 2024-04-20T10:51:03.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.425+0000 7f689d481640 1 -- 172.21.15.90:0/1436867470 wait complete. 2024-04-20T10:51:03.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.426+0000 7f689d481640 1 Processor -- start 2024-04-20T10:51:03.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.426+0000 7f689d481640 1 -- start start 2024-04-20T10:51:03.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f68980acaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68980abb40 0x7f68981e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68981e3490 0x7f68981ee0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f68980c9280 con 0x7f68800039e0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f68980c9100 con 0x7f68980abb40 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f68980bf800 con 0x7f68981e3490 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f68980acaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f68980acaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59566/0 (socket says 172.21.15.90:59566) 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 -- 172.21.15.90:0/235582387 learned_addr learned my addr 172.21.15.90:0/235582387 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f68967fc640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68980abb40 0x7f68981e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f68977fe640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68981e3490 0x7f68981ee0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 -- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68981e3490 msgr2=0x7f68981ee0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68981e3490 0x7f68981ee0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 -- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68980abb40 msgr2=0x7f68981e2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68980abb40 0x7f68981e2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 -- 172.21.15.90:0/235582387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68980ae2d0 con 0x7f68800039e0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f6896ffd640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f68980acaf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f688800a0b0 tx=0x7f68980c7c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f687f7fe640 1 -- 172.21.15.90:0/235582387 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888044020 con 0x7f68800039e0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f687f7fe640 1 -- 172.21.15.90:0/235582387 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68880015d0 con 0x7f68800039e0 2024-04-20T10:51:03.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68980c5f60 con 0x7f68800039e0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f687f7fe640 1 -- 172.21.15.90:0/235582387 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6888004d60 con 0x7f68800039e0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.427+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68981ed8b0 con 0x7f68800039e0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.428+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6898076150 con 0x7f68800039e0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.429+0000 7f687f7fe640 1 -- 172.21.15.90:0/235582387 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6888047020 con 0x7f68800039e0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.429+0000 7f687f7fe640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f688406c920 0x7f688406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.429+0000 7f687f7fe640 1 -- 172.21.15.90:0/235582387 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f68880ae2c0 con 0x7f68800039e0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.429+0000 7f68967fc640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f688406c920 0x7f688406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.430+0000 7f68967fc640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f688406c920 0x7f688406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6898154ee0 tx=0x7f688c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.433+0000 7f687f7fe640 1 -- 172.21.15.90:0/235582387 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f688804e030 con 0x7f68800039e0 2024-04-20T10:51:03.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.609+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f689806d070 con 0x7f68800039e0 2024-04-20T10:51:03.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.609+0000 7f687f7fe640 1 -- 172.21.15.90:0/235582387 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7f689815a720 con 0x7f68800039e0 2024-04-20T10:51:03.610 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f688406c920 msgr2=0x7f688406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f688406c920 0x7f688406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6898154ee0 tx=0x7f688c009040 comp rx=0 tx=0).stop 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 msgr2=0x7f68980acaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f68980acaf0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f688800a0b0 tx=0x7f68980c7c30 comp rx=0 tx=0).stop 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 shutdown_connections 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f688406c920 0x7f688406ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68981e3490 0x7f68981ee0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68980abb40 0x7f68981e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 --2- 172.21.15.90:0/235582387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68800039e0 0x7f68980acaf0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.611+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 >> 172.21.15.90:0/235582387 conn(0x7f68980cbfe0 msgr2=0x7f6898156ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:03.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.612+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 shutdown_connections 2024-04-20T10:51:03.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.612+0000 7f689d481640 1 -- 172.21.15.90:0/235582387 wait complete. 2024-04-20T10:51:03.623 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:03.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.720+0000 7f94fece4640 1 Processor -- start 2024-04-20T10:51:03.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.720+0000 7f94fece4640 1 -- start start 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fece4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94f8151b40 0x7f94f8158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fece4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94f80c6040 0x7f94f80c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fece4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94f80704c0 con 0x7f94f806ff90 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fece4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f94f8073800 con 0x7f94f8151b40 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fece4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f94f80731b0 con 0x7f94f80c6040 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fca80640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94f8151b40 0x7f94f8158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fca80640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94f8151b40 0x7f94f8158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59582/0 (socket says 172.21.15.90:59582) 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94fca80640 1 -- 172.21.15.90:0/240298312 learned_addr learned my addr 172.21.15.90:0/240298312 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.721+0000 7f94f7fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f94f806ff90 0x7f94f8157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56806/0 (socket says 172.21.15.90:56806) 2024-04-20T10:51:03.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94fca80640 1 -- 172.21.15.90:0/240298312 >> v2:172.21.15.175:3300/0 conn(0x7f94f80c6040 msgr2=0x7f94f80c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94fca80640 1 --2- 172.21.15.90:0/240298312 >> v2:172.21.15.175:3300/0 conn(0x7f94f80c6040 0x7f94f80c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94fca80640 1 -- 172.21.15.90:0/240298312 >> v1:172.21.15.90:6789/0 conn(0x7f94f806ff90 legacy=0x7f94f8157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94fca80640 1 -- 172.21.15.90:0/240298312 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f8073490 con 0x7f94f8151b40 2024-04-20T10:51:03.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94f77fe640 1 -- 172.21.15.90:0/240298312 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 341904324 0 0) 0x7f94f80704c0 con 0x7f94f806ff90 2024-04-20T10:51:03.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94fca80640 1 --2- 172.21.15.90:0/240298312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f8151b40 0x7f94f8158810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94f806fd20 tx=0x7f94ec02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc4739ad5f583e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94f77fe640 1 -- 172.21.15.90:0/240298312 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec02e070 con 0x7f94f8151b40 2024-04-20T10:51:03.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94f77fe640 1 -- 172.21.15.90:0/240298312 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ec037070 con 0x7f94f8151b40 2024-04-20T10:51:03.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.722+0000 7f94f77fe640 1 -- 172.21.15.90:0/240298312 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec031a00 con 0x7f94f8151b40 2024-04-20T10:51:03.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 -- 172.21.15.90:0/240298312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f8151b40 msgr2=0x7f94f8158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 --2- 172.21.15.90:0/240298312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f8151b40 0x7f94f8158810 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f94f806fd20 tx=0x7f94ec02b880 comp rx=0 tx=0).stop 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 -- 172.21.15.90:0/240298312 shutdown_connections 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 --2- 172.21.15.90:0/240298312 >> v2:172.21.15.175:3300/0 conn(0x7f94f80c6040 0x7f94f80c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 --2- 172.21.15.90:0/240298312 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f8151b40 0x7f94f8158810 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 -- 172.21.15.90:0/240298312 >> 172.21.15.90:0/240298312 conn(0x7f94f80676c0 msgr2=0x7f94f8067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 -- 172.21.15.90:0/240298312 shutdown_connections 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.723+0000 7f94fece4640 1 -- 172.21.15.90:0/240298312 wait complete. 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.724+0000 7f94fece4640 1 Processor -- start 2024-04-20T10:51:03.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.724+0000 7f94fece4640 1 -- start start 2024-04-20T10:51:03.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fece4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f806ff90 0x7f94f80ada40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fece4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94f80c6040 0x7f94f81ea510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fece4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94f8151b40 0x7f94f81eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fece4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94f81520a0 con 0x7f94f806ff90 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fece4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94f8151f20 con 0x7f94f80c6040 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fece4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f94f806f600 con 0x7f94f8151b40 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f806ff90 0x7f94f80ada40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f806ff90 0x7f94f80ada40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59596/0 (socket says 172.21.15.90:59596) 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 -- 172.21.15.90:0/4188606681 learned_addr learned my addr 172.21.15.90:0/4188606681 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 -- 172.21.15.90:0/4188606681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94f8151b40 msgr2=0x7f94f81eaa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94f8151b40 0x7f94f81eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 -- 172.21.15.90:0/4188606681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94f80c6040 msgr2=0x7f94f81ea510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94f80c6040 0x7f94f81ea510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.725+0000 7f94fca80640 1 -- 172.21.15.90:0/4188606681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94f8152480 con 0x7f94f806ff90 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.726+0000 7f94fca80640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f806ff90 0x7f94f80ada40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000c00 tx=0x7f94ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.726+0000 7f94f57fa640 1 -- 172.21.15.90:0/4188606681 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec032880 con 0x7f94f806ff90 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.726+0000 7f94f57fa640 1 -- 172.21.15.90:0/4188606681 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94ec032a40 con 0x7f94f806ff90 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.726+0000 7f94f57fa640 1 -- 172.21.15.90:0/4188606681 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94ec032e30 con 0x7f94f806ff90 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.726+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94f8152760 con 0x7f94f806ff90 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.726+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94f81edd60 con 0x7f94f806ff90 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.727+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94f806fd80 con 0x7f94f806ff90 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.727+0000 7f94f57fa640 1 -- 172.21.15.90:0/4188606681 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94ec0453f0 con 0x7f94f806ff90 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.727+0000 7f94f57fa640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94dc06c920 0x7f94dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.728+0000 7f94f7fff640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94dc06c920 0x7f94dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:03.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.728+0000 7f94f57fa640 1 -- 172.21.15.90:0/4188606681 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f94ec0add90 con 0x7f94f806ff90 2024-04-20T10:51:03.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.728+0000 7f94f7fff640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94dc06c920 0x7f94dc06ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94f8150c00 tx=0x7f94e40079a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:03.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.732+0000 7f94f57fa640 1 -- 172.21.15.90:0/4188606681 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f94f806fd80 con 0x7f94f806ff90 2024-04-20T10:51:03.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.945+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94f8076150 con 0x7f94f806ff90 2024-04-20T10:51:03.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.945+0000 7f94f57fa640 1 -- 172.21.15.90:0/4188606681 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f94ec040070 con 0x7f94f806ff90 2024-04-20T10:51:03.946 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:03.946 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:03.946 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.947+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94dc06c920 msgr2=0x7f94dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.947+0000 7f94fece4640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94dc06c920 0x7f94dc06ede0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f94f8150c00 tx=0x7f94e40079a0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.947+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f806ff90 msgr2=0x7f94f80ada40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.947+0000 7f94fece4640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f806ff90 0x7f94f80ada40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f94ec000c00 tx=0x7f94ec0046c0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 shutdown_connections 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94dc06c920 0x7f94dc06ede0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94f8151b40 0x7f94f81eaa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94f80c6040 0x7f94f81ea510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 --2- 172.21.15.90:0/4188606681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94f806ff90 0x7f94f80ada40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 >> 172.21.15.90:0/4188606681 conn(0x7f94f80676c0 msgr2=0x7f94f81ddc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:03.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 shutdown_connections 2024-04-20T10:51:03.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:03.948+0000 7f94fece4640 1 -- 172.21.15.90:0/4188606681 wait complete. 2024-04-20T10:51:03.959 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.053+0000 7f76e72c1640 1 Processor -- start 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e72c1640 1 -- start start 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e72c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0151b10 0x7f76e0154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e72c1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f76e00aba60 0x7f76e00abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e72c1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e0073ba0 con 0x7f76e0157a70 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e72c1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f76e0157ed0 con 0x7f76e00aba60 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e72c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f76e0151ef0 con 0x7f76e0151b10 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e585e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f76e00aba60 0x7f76e00abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e585e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f76e00aba60 0x7f76e00abef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59600/0 (socket says 172.21.15.90:59600) 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e585e640 1 -- 172.21.15.90:0/3696253007 learned_addr learned my addr 172.21.15.90:0/3696253007 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.054+0000 7f76e485c640 1 --1- 172.21.15.90:0/3696253007 >> v1:172.21.15.90:6789/0 conn(0x7f76e0157a70 0x7f76e00725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56818/0 (socket says 172.21.15.90:56818) 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.055+0000 7f76e505d640 1 --2- 172.21.15.90:0/3696253007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0151b10 0x7f76e0154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.055+0000 7f76e585e640 1 -- 172.21.15.90:0/3696253007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0151b10 msgr2=0x7f76e0154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.055+0000 7f76e585e640 1 --2- 172.21.15.90:0/3696253007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0151b10 0x7f76e0154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.055+0000 7f76e585e640 1 -- 172.21.15.90:0/3696253007 >> v1:172.21.15.90:6789/0 conn(0x7f76e0157a70 legacy=0x7f76e00725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.055+0000 7f76d7fff640 1 -- 172.21.15.90:0/3696253007 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779383920 0 0) 0x7f76e0073ba0 con 0x7f76e0157a70 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.055+0000 7f76e585e640 1 -- 172.21.15.90:0/3696253007 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e01589a0 con 0x7f76e00aba60 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.055+0000 7f76e505d640 1 --2- 172.21.15.90:0/3696253007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0151b10 0x7f76e0154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e585e640 1 --2- 172.21.15.90:0/3696253007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00abef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009e50 tx=0x7f76dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d710d275c6b70f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76d7fff640 1 -- 172.21.15.90:0/3696253007 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc02ca70 con 0x7f76e00aba60 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76d7fff640 1 -- 172.21.15.90:0/3696253007 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76dc02cc10 con 0x7f76e00aba60 2024-04-20T10:51:04.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76d7fff640 1 -- 172.21.15.90:0/3696253007 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc0343f0 con 0x7f76e00aba60 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 -- 172.21.15.90:0/3696253007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 msgr2=0x7f76e00abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 --2- 172.21.15.90:0/3696253007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00abef0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f76dc009e50 tx=0x7f76dc02bed0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 -- 172.21.15.90:0/3696253007 shutdown_connections 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 --2- 172.21.15.90:0/3696253007 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00abef0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 --2- 172.21.15.90:0/3696253007 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0151b10 0x7f76e0154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 -- 172.21.15.90:0/3696253007 >> 172.21.15.90:0/3696253007 conn(0x7f76e00ca0a0 msgr2=0x7f76e00ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 -- 172.21.15.90:0/3696253007 shutdown_connections 2024-04-20T10:51:04.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.056+0000 7f76e72c1640 1 -- 172.21.15.90:0/3696253007 wait complete. 2024-04-20T10:51:04.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.057+0000 7f76e72c1640 1 Processor -- start 2024-04-20T10:51:04.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.057+0000 7f76e72c1640 1 -- start start 2024-04-20T10:51:04.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e72c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00ac9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e72c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e0151b10 0x7f76e0156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e72c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0157a70 0x7f76e0155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e72c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76e01586c0 con 0x7f76e00aba60 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e72c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76e01583e0 con 0x7f76e0151b10 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e72c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f76e00ab540 con 0x7f76e0157a70 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00ac9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00ac9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59606/0 (socket says 172.21.15.90:59606) 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 -- 172.21.15.90:0/2403485092 learned_addr learned my addr 172.21.15.90:0/2403485092 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e485c640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e0151b10 0x7f76e0156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e585e640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0157a70 0x7f76e0155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 -- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0157a70 msgr2=0x7f76e0155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0157a70 0x7f76e0155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 -- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e0151b10 msgr2=0x7f76e0156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e0151b10 0x7f76e0156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e505d640 1 -- 172.21.15.90:0/2403485092 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e0145300 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.058+0000 7f76e585e640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0157a70 0x7f76e0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.059+0000 7f76e505d640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00ac9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76d800e810 tx=0x7f76d800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.059+0000 7f76d5ffb640 1 -- 172.21.15.90:0/2403485092 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d800f040 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.059+0000 7f76d5ffb640 1 -- 172.21.15.90:0/2403485092 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d8004030 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.059+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e01eab80 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.059+0000 7f76d5ffb640 1 -- 172.21.15.90:0/2403485092 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8004400 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.059+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e00ad380 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.060+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e0076150 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.060+0000 7f76d5ffb640 1 -- 172.21.15.90:0/2403485092 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f76d800c6d0 con 0x7f76e00aba60 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.061+0000 7f76d5ffb640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f76c406c920 0x7f76c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.061+0000 7f76e485c640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f76c406c920 0x7f76c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.061+0000 7f76d5ffb640 1 -- 172.21.15.90:0/2403485092 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f76d808bb50 con 0x7f76e00aba60 2024-04-20T10:51:04.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.061+0000 7f76e485c640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f76c406c920 0x7f76c406ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76e00b0560 tx=0x7f76d0007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:04.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.065+0000 7f76d5ffb640 1 -- 172.21.15.90:0/2403485092 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f76d8017020 con 0x7f76e00aba60 2024-04-20T10:51:04.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.238+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f76e0073910 con 0x7f76e00aba60 2024-04-20T10:51:04.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.240+0000 7f76d5ffb640 1 -- 172.21.15.90:0/2403485092 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f76d8059ce0 con 0x7f76e00aba60 2024-04-20T10:51:04.240 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:04.240 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:04.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f76c406c920 msgr2=0x7f76c406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f76c406c920 0x7f76c406ede0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f76e00b0560 tx=0x7f76d0007c00 comp rx=0 tx=0).stop 2024-04-20T10:51:04.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 msgr2=0x7f76e00ac9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00ac9c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f76d800e810 tx=0x7f76d800ecd0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 shutdown_connections 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f76c406c920 0x7f76c406ede0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f76e0157a70 0x7f76e0155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76e0151b10 0x7f76e0156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 --2- 172.21.15.90:0/2403485092 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76e00aba60 0x7f76e00ac9c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 >> 172.21.15.90:0/2403485092 conn(0x7f76e00ca0a0 msgr2=0x7f76e00725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 shutdown_connections 2024-04-20T10:51:04.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.242+0000 7f76e72c1640 1 -- 172.21.15.90:0/2403485092 wait complete. 2024-04-20T10:51:04.253 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:04.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.349+0000 7fb30d152640 1 Processor -- start 2024-04-20T10:51:04.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.349+0000 7fb30d152640 1 -- start start 2024-04-20T10:51:04.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30d152640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3080c45c0 0x7fb3081551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30d152640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb308073120 0x7fb308151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30d152640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb308158780 con 0x7fb308072860 2024-04-20T10:51:04.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30d152640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb3080ad010 con 0x7fb308073120 2024-04-20T10:51:04.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30d152640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb308158530 con 0x7fb3080c45c0 2024-04-20T10:51:04.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30759e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb308073120 0x7fb308151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30759e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb308073120 0x7fb308151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59612/0 (socket says 172.21.15.90:59612) 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.350+0000 7fb30759e640 1 -- 172.21.15.90:0/1922674093 learned_addr learned my addr 172.21.15.90:0/1922674093 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb30759e640 1 -- 172.21.15.90:0/1922674093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3080c45c0 msgr2=0x7fb3081551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb30759e640 1 --2- 172.21.15.90:0/1922674093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3080c45c0 0x7fb3081551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb30759e640 1 -- 172.21.15.90:0/1922674093 >> v1:172.21.15.175:6789/0 conn(0x7fb308072860 legacy=0x7fb3080ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb30759e640 1 -- 172.21.15.90:0/1922674093 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3081546d0 con 0x7fb308073120 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb30759e640 1 --2- 172.21.15.90:0/1922674093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb308151840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb300009e50 tx=0x7fb30002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d367c2db383644 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb305d9b640 1 -- 172.21.15.90:0/1922674093 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30002c9e0 con 0x7fb308073120 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb305d9b640 1 -- 172.21.15.90:0/1922674093 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30002cb80 con 0x7fb308073120 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.351+0000 7fb305d9b640 1 -- 172.21.15.90:0/1922674093 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3000343f0 con 0x7fb308073120 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 -- 172.21.15.90:0/1922674093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 msgr2=0x7fb308151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 --2- 172.21.15.90:0/1922674093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb308151840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb300009e50 tx=0x7fb30002be40 comp rx=0 tx=0).stop 2024-04-20T10:51:04.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 -- 172.21.15.90:0/1922674093 shutdown_connections 2024-04-20T10:51:04.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 --2- 172.21.15.90:0/1922674093 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb308151840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 --2- 172.21.15.90:0/1922674093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3080c45c0 0x7fb3081551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 -- 172.21.15.90:0/1922674093 >> 172.21.15.90:0/1922674093 conn(0x7fb308067de0 msgr2=0x7fb3080ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:04.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 -- 172.21.15.90:0/1922674093 shutdown_connections 2024-04-20T10:51:04.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.352+0000 7fb30d152640 1 -- 172.21.15.90:0/1922674093 wait complete. 2024-04-20T10:51:04.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.353+0000 7fb30d152640 1 Processor -- start 2024-04-20T10:51:04.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.353+0000 7fb30d152640 1 -- start start 2024-04-20T10:51:04.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30d152640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb308072860 0x7fb308151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30d152640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb3080c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30d152640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3080c45c0 0x7fb30814ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30d152640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb308154c90 con 0x7fb308073120 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30d152640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb308158a60 con 0x7fb3080c45c0 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30d152640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb3080abbb0 con 0x7fb308072860 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb3080c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb3080c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59626/0 (socket says 172.21.15.90:59626) 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 -- 172.21.15.90:0/537928146 learned_addr learned my addr 172.21.15.90:0/537928146 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30759e640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3080c45c0 0x7fb30814ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb306d9d640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb308072860 0x7fb308151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 -- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb308072860 msgr2=0x7fb308151090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb308072860 0x7fb308151090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 -- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3080c45c0 msgr2=0x7fb30814ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3080c45c0 0x7fb30814ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30659c640 1 -- 172.21.15.90:0/537928146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3081edfe0 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb30759e640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3080c45c0 0x7fb30814ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.354+0000 7fb306d9d640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb308072860 0x7fb308151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.355+0000 7fb30659c640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb3080c5110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800b4a0 tx=0x7fb2f800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.355+0000 7fb2ef7fe640 1 -- 172.21.15.90:0/537928146 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8014070 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.355+0000 7fb2ef7fe640 1 -- 172.21.15.90:0/537928146 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2f8010610 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.355+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb308153f70 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.355+0000 7fb2ef7fe640 1 -- 172.21.15.90:0/537928146 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8010a00 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.355+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3080aefd0 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.356+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb308076150 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.356+0000 7fb2ef7fe640 1 -- 172.21.15.90:0/537928146 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2f8017070 con 0x7fb308073120 2024-04-20T10:51:04.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.356+0000 7fb2ef7fe640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2f406c920 0x7fb2f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:04.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.357+0000 7fb306d9d640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2f406c920 0x7fb2f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:04.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.357+0000 7fb2ef7fe640 1 -- 172.21.15.90:0/537928146 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb2f808b8d0 con 0x7fb308073120 2024-04-20T10:51:04.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.357+0000 7fb306d9d640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2f406c920 0x7fb2f406ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3080ac5f0 tx=0x7fb2fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:04.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.361+0000 7fb2ef7fe640 1 -- 172.21.15.90:0/537928146 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb2f80599d0 con 0x7fb308073120 2024-04-20T10:51:04.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.575+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb308070e80 con 0x7fb308073120 2024-04-20T10:51:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.576+0000 7fb2ef7fe640 1 -- 172.21.15.90:0/537928146 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fb2f80592d0 con 0x7fb308073120 2024-04-20T10:51:04.576 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:04.576 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:04.576 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2f406c920 msgr2=0x7fb2f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2f406c920 0x7fb2f406ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb3080ac5f0 tx=0x7fb2fc008040 comp rx=0 tx=0).stop 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 msgr2=0x7fb3080c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb3080c5110 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800b4a0 tx=0x7fb2f800b960 comp rx=0 tx=0).stop 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 shutdown_connections 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2f406c920 0x7fb2f406ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3080c45c0 0x7fb30814ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb308073120 0x7fb3080c5110 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 --2- 172.21.15.90:0/537928146 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb308072860 0x7fb308151090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:04.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 >> 172.21.15.90:0/537928146 conn(0x7fb308067de0 msgr2=0x7fb3080c7e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:04.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 shutdown_connections 2024-04-20T10:51:04.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:04.578+0000 7fb30d152640 1 -- 172.21.15.90:0/537928146 wait complete. 2024-04-20T10:51:04.991 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-20T10:50:39.915256+0000', 'modified': '2024-04-20T10:50:42.940935+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4299}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4299': {'gid': 4299, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.175:6835/2994051895', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.175:6834', 'nonce': 2994051895}, {'type': 'v1', 'addr': '172.21.15.175:6835', 'nonce': 2994051895}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'a', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4299, 'qdb_cluster': [4299]} 2024-04-20T10:51:04.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-20T10:51:04.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-20T10:51:05.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.091+0000 7ff2da54b640 1 Processor -- start 2024-04-20T10:51:05.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.091+0000 7ff2da54b640 1 -- start start 2024-04-20T10:51:05.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.091+0000 7ff2da54b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2d4072580 0x7ff2d40ae490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2da54b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d4073220 0x7ff2d40ac3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2da54b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2d40aeb70 con 0x7ff2d406f090 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2da54b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff2d4154a90 con 0x7ff2d4072580 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2da54b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d4154d70 con 0x7ff2d4073220 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d37fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff2d4072580 0x7ff2d40ae490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d8ae8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d4073220 0x7ff2d40ac3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d3fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7ff2d406f090 0x7ff2d4072b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:40152/0 (socket says 172.21.15.90:40152) 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d3fff640 1 -- 172.21.15.90:0/3424470262 learned_addr learned my addr 172.21.15.90:0/3424470262 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d37fe640 1 -- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d4073220 msgr2=0x7ff2d40ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d4073220 0x7ff2d40ac3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d37fe640 1 -- 172.21.15.90:0/3424470262 >> v1:172.21.15.175:6789/0 conn(0x7ff2d406f090 legacy=0x7ff2d4072b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d2ffd640 1 -- 172.21.15.90:0/3424470262 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 835015795 0 0) 0x7ff2d40aeb70 con 0x7ff2d406f090 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d37fe640 1 -- 172.21.15.90:0/3424470262 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d4154740 con 0x7ff2d4072580 2024-04-20T10:51:05.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.092+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d4073220 0x7ff2d40ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.093+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 0x7ff2d40ae490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097a0 tx=0x7ff2c802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6ff2bf65941dfeea server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.093+0000 7ff2d2ffd640 1 -- 172.21.15.90:0/3424470262 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8035020 con 0x7ff2d4072580 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.093+0000 7ff2d2ffd640 1 -- 172.21.15.90:0/3424470262 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c8031810 con 0x7ff2d4072580 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.093+0000 7ff2d2ffd640 1 -- 172.21.15.90:0/3424470262 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8031be0 con 0x7ff2d4072580 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 -- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 msgr2=0x7ff2d40ae490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 --2- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 0x7ff2d40ae490 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80097a0 tx=0x7ff2c802b8b0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 -- 172.21.15.90:0/3424470262 shutdown_connections 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 --2- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d4073220 0x7ff2d40ac3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 --2- 172.21.15.90:0/3424470262 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 0x7ff2d40ae490 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 -- 172.21.15.90:0/3424470262 >> 172.21.15.90:0/3424470262 conn(0x7ff2d40c9130 msgr2=0x7ff2d40c9510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 -- 172.21.15.90:0/3424470262 shutdown_connections 2024-04-20T10:51:05.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.094+0000 7ff2da54b640 1 -- 172.21.15.90:0/3424470262 wait complete. 2024-04-20T10:51:05.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.095+0000 7ff2da54b640 1 Processor -- start 2024-04-20T10:51:05.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.095+0000 7ff2da54b640 1 -- start start 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d406f090 0x7ff2d41ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 0x7ff2d406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d4073220 0x7ff2d41523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d406f5f0 con 0x7ff2d4073220 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d406f470 con 0x7ff2d4072580 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d40ac900 con 0x7ff2d406f090 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d4073220 0x7ff2d41523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d4073220 0x7ff2d41523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59630/0 (socket says 172.21.15.90:59630) 2024-04-20T10:51:05.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/2859889924 learned_addr learned my addr 172.21.15.90:0/2859889924 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 0x7ff2d406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d406f090 0x7ff2d41ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d406f090 msgr2=0x7ff2d41ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d406f090 0x7ff2d41ea970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 msgr2=0x7ff2d406d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 0x7ff2d406d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/2859889924 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2d406e290 con 0x7ff2d4073220 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d4073220 0x7ff2d41523c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00efc0 tx=0x7ff2cc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d0ff9640 1 -- 172.21.15.90:0/2859889924 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc018030 con 0x7ff2d4073220 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d0ff9640 1 -- 172.21.15.90:0/2859889924 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc00cd90 con 0x7ff2d4073220 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2d406e570 con 0x7ff2d4073220 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2d0ff9640 1 -- 172.21.15.90:0/2859889924 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc003bb0 con 0x7ff2d4073220 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.096+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2d4152900 con 0x7ff2d4073220 2024-04-20T10:51:05.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.098+0000 7ff2d0ff9640 1 -- 172.21.15.90:0/2859889924 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2cc01b070 con 0x7ff2d4073220 2024-04-20T10:51:05.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.098+0000 7ff2d0ff9640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff2c006c8f0 0x7ff2c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.098+0000 7ff2d0ff9640 1 -- 172.21.15.90:0/2859889924 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff2cc08c6c0 con 0x7ff2d4073220 2024-04-20T10:51:05.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.098+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff2c006c8f0 0x7ff2c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.099+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff2c006c8f0 0x7ff2c006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4000f60 tx=0x7ff2c4007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.099+0000 7ff2dd214740 1 Processor -- start 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.099+0000 7ff2dd214740 1 -- start start 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bba540 0x5643e2bba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bbb850 0x5643e2bf6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bf6bd0 0x5643e2bf4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2dd214740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5643e2acd290 con 0x5643e2bbb850 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5643e2b2aa40 con 0x5643e2bf6bd0 2024-04-20T10:51:05.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5643e2ae5a30 con 0x5643e2bba540 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bbb850 0x5643e2bf6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bbb850 0x5643e2bf6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59646/0 (socket says 172.21.15.90:59646) 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 -- 172.21.15.90:0/1987558110 learned_addr learned my addr 172.21.15.90:0/1987558110 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bf6bd0 0x5643e2bf4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bba540 0x5643e2bba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 -- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bba540 msgr2=0x5643e2bba920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bba540 0x5643e2bba920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 -- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bf6bd0 msgr2=0x5643e2bf4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bf6bd0 0x5643e2bf4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 -- 172.21.15.90:0/1987558110 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e2ad8c10 con 0x5643e2bbb850 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bbb850 0x5643e2bf6690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80098c0 tx=0x7ff2c8008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496ff8fd06c8c20f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2b9ffb640 1 -- 172.21.15.90:0/1987558110 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c804a070 con 0x5643e2bbb850 2024-04-20T10:51:05.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2b9ffb640 1 -- 172.21.15.90:0/1987558110 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c8031610 con 0x5643e2bbb850 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.100+0000 7ff2b9ffb640 1 -- 172.21.15.90:0/1987558110 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8035070 con 0x5643e2bbb850 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 -- 172.21.15.90:0/1987558110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bbb850 msgr2=0x5643e2bf6690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bbb850 0x5643e2bf6690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff2c80098c0 tx=0x7ff2c8008030 comp rx=0 tx=0).stop 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 -- 172.21.15.90:0/1987558110 shutdown_connections 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bf6bd0 0x5643e2bf4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bbb850 0x5643e2bf6690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 --2- 172.21.15.90:0/1987558110 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bba540 0x5643e2bba920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 -- 172.21.15.90:0/1987558110 >> 172.21.15.90:0/1987558110 conn(0x5643e2bb6e90 msgr2=0x5643e2bdb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 -- 172.21.15.90:0/1987558110 shutdown_connections 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.101+0000 7ff2dd214740 1 -- 172.21.15.90:0/1987558110 wait complete. 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 -- start start 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 Processor -- start 2024-04-20T10:51:05.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 0x5643e2bf1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c06c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 0x5643e2bda120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5643e2b24140 con 0x5643e2bf6bd0 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5643e2b1ee20 con 0x5643e2bd9ca0 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.102+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5643e2b2cd20 con 0x5643e2bbb850 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2dd214740 10 client.0 _ll_register_callbacks cb 0x5643e2b155c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c06c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c06c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59662/0 (socket says 172.21.15.90:59662) 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 -- 172.21.15.90:0/3385917399 learned_addr learned my addr 172.21.15.90:0/3385917399 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 0x5643e2bf1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 0x5643e2bda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 -- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 msgr2=0x5643e2bf1100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 0x5643e2bf1100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 -- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 msgr2=0x5643e2bda120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 0x5643e2bda120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 -- 172.21.15.90:0/3385917399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e28322d0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c06c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2c802bec0 tx=0x7ff2c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83921a70cbc58885 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3385917399 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c8053060 con 0x5643e2bf6bd0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3385917399 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff2c80319c0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2c8031610 con 0x5643e2bf6bd0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3385917399 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7ff2c8059050 con 0x5643e2bf6bd0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2dd214740 10 client.4818 fetch_fsmap learned FSMap version 12 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x5643e28fc6b0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.103+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3385917399 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2c8031610 con 0x5643e2bf6bd0 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3385917399 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 12) ==== 4130+0+0 (secure 0 0 0) 0x7ff2c805c020 con 0x5643e2bf6bd0 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2dd214740 10 client.4818 fetch_fsmap finished waiting for FSMap version 12 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2dd214740 10 client.4818 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2dd214740 20 client.4818 populate_metadata read hostname 'smithi090' 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 0x5643e2bf33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2dd214740 4 client.4818 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 --> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643e2aa6510 con 0x5643e2bf3010 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 0x5643e2bf33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2d3fff640 1 -- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 msgr2=0x5643e2bf33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 17 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2d3fff640 1 -- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 msgr2=0x5643e2bf33f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 0x5643e2bf33f0 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T10:51:05.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.104+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 0x5643e2bf33f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T10:51:05.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.305+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 0x5643e2bf33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.305+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 0x5643e2bf33f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe436dc680ae25d3 server_cookie=43c3eb43d806d81e in_seq=0 out_seq=0 2024-04-20T10:51:05.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.305+0000 7ff2b2ffd640 10 client.4818 ms_handle_connect on v2:172.21.15.175:6834/2994051895 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3385917399 <== mds.0 v2:172.21.15.175:6834/2994051895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5643e2aa6510 con 0x5643e2bf3010 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2b2ffd640 10 client.4818 handle_command_reply: tid=0 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 client.4818 shutdown 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 msgr2=0x5643e2c06c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c06c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff2c802bec0 tx=0x7ff2c8004730 comp rx=0 tx=0).stop 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 shutdown_connections 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 0x5643e2bda120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2bf3010 0x5643e2bf33f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c06c10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3385917399 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 0x5643e2bf1100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2b2ffd640 0 client.4818 ms_handle_reset on v2:172.21.15.175:6834/2994051895 2024-04-20T10:51:05.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 >> 172.21.15.90:0/3385917399 conn(0x5643e2bba540 msgr2=0x5643e2bf50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 shutdown_connections 2024-04-20T10:51:05.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.306+0000 7ff2dd214740 1 -- 172.21.15.90:0/3385917399 wait complete. 2024-04-20T10:51:05.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.307+0000 7ff2dd214740 20 client.4818 trim_cache size 0 max 16384 2024-04-20T10:51:05.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.324+0000 7ff2dd214740 1 Processor -- start 2024-04-20T10:51:05.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2dd214740 1 -- start start 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 0x5643e2bd9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 0x5643e2bf6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2bd7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2dd214740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41f8860 con 0x5643e2bf6bd0 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41f9900 con 0x5643e2bd9ca0 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2d41ee250 con 0x5643e2bbb850 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2d8ae8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2bd7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2d8ae8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2bd7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59664/0 (socket says 172.21.15.90:59664) 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/529895242 learned_addr learned my addr 172.21.15.90:0/529895242 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/529895242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 msgr2=0x5643e2bd9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.325+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/529895242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 0x5643e2bd9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/529895242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 msgr2=0x5643e2bf6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/529895242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 0x5643e2bf6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/529895242 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643e2bd7310 con 0x5643e2bf6bd0 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/529895242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2bd7a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c990 tx=0x7ff2cc05e5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e00f305a8a4bf5a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2b97fa640 1 -- 172.21.15.90:0/529895242 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc0567e0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2b97fa640 1 -- 172.21.15.90:0/529895242 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc05e0c0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2b97fa640 1 -- 172.21.15.90:0/529895242 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc056980 con 0x5643e2bf6bd0 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 -- 172.21.15.90:0/529895242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 msgr2=0x5643e2bd7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 --2- 172.21.15.90:0/529895242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2bd7a70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00c990 tx=0x7ff2cc05e5e0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 -- 172.21.15.90:0/529895242 shutdown_connections 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 --2- 172.21.15.90:0/529895242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2bd7a70 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 --2- 172.21.15.90:0/529895242 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bd9ca0 0x5643e2bf6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 --2- 172.21.15.90:0/529895242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bbb850 0x5643e2bd9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 -- 172.21.15.90:0/529895242 >> 172.21.15.90:0/529895242 conn(0x5643e2bba540 msgr2=0x5643e2bb0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 -- 172.21.15.90:0/529895242 shutdown_connections 2024-04-20T10:51:05.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.326+0000 7ff2dd214740 1 -- 172.21.15.90:0/529895242 wait complete. 2024-04-20T10:51:05.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.327+0000 7ff2dd214740 1 -- start start 2024-04-20T10:51:05.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.327+0000 7ff2dd214740 1 Processor -- start 2024-04-20T10:51:05.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bbb850 0x5643e2c3b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bd9ca0 0x5643e2beeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2dd214740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c75e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2dd214740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5643e2adc980 con 0x5643e2bf6bd0 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff2d41f7950 con 0x5643e2bbb850 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2dd214740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5643e2bee270 con 0x5643e2bd9ca0 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2dd214740 10 client.0 _ll_register_callbacks cb 0x7ff2c8048070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c75e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c75e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59678/0 (socket says 172.21.15.90:59678) 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/3328201221 learned_addr learned my addr 172.21.15.90:0/3328201221 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bbb850 0x5643e2c3b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d37fe640 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bd9ca0 0x5643e2beeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bd9ca0 msgr2=0x5643e2beeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bd9ca0 0x5643e2beeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bbb850 msgr2=0x5643e2c3b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bbb850 0x5643e2c3b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 -- 172.21.15.90:0/3328201221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643e2c39a80 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2d8ae8640 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c75e80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc059e70 tx=0x7ff2cc05a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e85a1b1345ef2c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.328+0000 7ff2b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3328201221 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2cc05e270 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3328201221 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff2cc055ec0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2cc05e0c0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3328201221 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7ff2cc056100 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 10 client.4824 fetch_fsmap learned FSMap version 12 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x5643e2c070c0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3328201221 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2cc05e0c0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3328201221 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 12) ==== 4130+0+0 (secure 0 0 0) 0x7ff2cc08ace0 con 0x5643e2bf6bd0 2024-04-20T10:51:05.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 10 client.4824 fetch_fsmap finished waiting for FSMap version 12 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 10 client.4824 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 20 client.4824 populate_metadata read hostname 'smithi090' 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2c73550 0x5643e2c790a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 4 client.4824 mds_command: new command op to 4299 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 --> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] -- command(tid 0: {"prefix": "status"}) -- 0x5643e2b2d530 con 0x5643e2c73550 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.329+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2c73550 0x5643e2c790a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2b2ffd640 10 client.4824 ms_handle_connect on v2:172.21.15.175:6834/2994051895 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2d3fff640 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2c73550 0x5643e2c790a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa1dd2326f48abd server_cookie=19140eee8370b7d1 in_seq=0 out_seq=0 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2b2ffd640 1 -- 172.21.15.90:0/3328201221 <== mds.0 v2:172.21.15.175:6834/2994051895 1 ==== command_reply(tid 0: 0 ) ==== 8+0+313 (crc 0 0 0) 0x5643e2b2d530 con 0x5643e2c73550 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2b2ffd640 10 client.4824 handle_command_reply: tid=0 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 client.4824 shutdown 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 msgr2=0x5643e2c75e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c75e80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc059e70 tx=0x7ff2cc05a070 comp rx=0 tx=0).stop 2024-04-20T10:51:05.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 shutdown_connections 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:6834/2994051895,v1:172.21.15.175:6835/2994051895] conn(0x5643e2c73550 0x5643e2c790a0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5643e2bf6bd0 0x5643e2c75e80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2b2ffd640 0 client.4824 ms_handle_reset on v2:172.21.15.175:6834/2994051895 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5643e2bd9ca0 0x5643e2beeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 --2- 172.21.15.90:0/3328201221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5643e2bbb850 0x5643e2c3b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 >> 172.21.15.90:0/3328201221 conn(0x5643e2bba540 msgr2=0x5643e2c06780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 shutdown_connections 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 1 -- 172.21.15.90:0/3328201221 wait complete. 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.330+0000 7ff2dd214740 20 client.4824 trim_cache size 0 max 16384 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:51:05.336 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c", 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4299, 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "a", 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 24.746554255, 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 7, 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 25, 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 21, 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 32.111875716 2024-04-20T10:51:05.337 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff2c006c8f0 msgr2=0x7ff2c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff2c006c8f0 0x7ff2c006edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff2c4000f60 tx=0x7ff2c4007d50 comp rx=0 tx=0).stop 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d4073220 msgr2=0x7ff2d41523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d4073220 0x7ff2d41523c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc00efc0 tx=0x7ff2cc00c490 comp rx=0 tx=0).stop 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 shutdown_connections 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff2c006c8f0 0x7ff2c006edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2d4073220 0x7ff2d41523c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2d4072580 0x7ff2d406d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 --2- 172.21.15.90:0/2859889924 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff2d406f090 0x7ff2d41ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 >> 172.21.15.90:0/2859889924 conn(0x7ff2d40c9130 msgr2=0x7ff2d4150fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 shutdown_connections 2024-04-20T10:51:05.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.331+0000 7ff2da54b640 1 -- 172.21.15.90:0/2859889924 wait complete. 2024-04-20T10:51:05.342 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:05.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.439+0000 7f712b950640 1 Processor -- start 2024-04-20T10:51:05.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.439+0000 7f712b950640 1 -- start start 2024-04-20T10:51:05.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.439+0000 7f712b950640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f712406ef90 0x7f71240c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.439+0000 7f712b950640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f71240c23f0 0x7f7124157170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f712b950640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71240c2880 con 0x7f71240c7bf0 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f712b950640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f71240c4480 con 0x7f712406ef90 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f712b950640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f71241576b0 con 0x7f71240c23f0 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7128eeb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f712406ef90 0x7f71240c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7128eeb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f712406ef90 0x7f71240c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44806/0 (socket says 172.21.15.90:44806) 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7128eeb640 1 -- 172.21.15.90:0/3085387824 learned_addr learned my addr 172.21.15.90:0/3085387824 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7129eed640 1 --2- 172.21.15.90:0/3085387824 >> v2:172.21.15.175:3300/0 conn(0x7f71240c23f0 0x7f7124157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7128eeb640 1 -- 172.21.15.90:0/3085387824 >> v2:172.21.15.175:3300/0 conn(0x7f71240c23f0 msgr2=0x7f7124157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7128eeb640 1 --2- 172.21.15.90:0/3085387824 >> v2:172.21.15.175:3300/0 conn(0x7f71240c23f0 0x7f7124157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7128eeb640 1 -- 172.21.15.90:0/3085387824 >> v1:172.21.15.175:6789/0 conn(0x7f71240c7bf0 legacy=0x7f71240c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7128eeb640 1 -- 172.21.15.90:0/3085387824 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71240c33e0 con 0x7f712406ef90 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.440+0000 7f7129eed640 1 --2- 172.21.15.90:0/3085387824 >> v2:172.21.15.175:3300/0 conn(0x7f71240c23f0 0x7f7124157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f7128eeb640 1 --2- 172.21.15.90:0/3085387824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f712406ef90 0x7f71240c7fd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f712415ad00 tx=0x7f712002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f753f4ad747d527c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f711bfff640 1 -- 172.21.15.90:0/3085387824 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120038070 con 0x7f712406ef90 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f711bfff640 1 -- 172.21.15.90:0/3085387824 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712002f050 con 0x7f712406ef90 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f711bfff640 1 -- 172.21.15.90:0/3085387824 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120031970 con 0x7f712406ef90 2024-04-20T10:51:05.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 -- 172.21.15.90:0/3085387824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f712406ef90 msgr2=0x7f71240c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 --2- 172.21.15.90:0/3085387824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f712406ef90 0x7f71240c7fd0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f712415ad00 tx=0x7f712002b7f0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 -- 172.21.15.90:0/3085387824 shutdown_connections 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 --2- 172.21.15.90:0/3085387824 >> v2:172.21.15.175:3300/0 conn(0x7f71240c23f0 0x7f7124157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 --2- 172.21.15.90:0/3085387824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f712406ef90 0x7f71240c7fd0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 -- 172.21.15.90:0/3085387824 >> 172.21.15.90:0/3085387824 conn(0x7f71240aa660 msgr2=0x7f71240aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 -- 172.21.15.90:0/3085387824 shutdown_connections 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.441+0000 7f712b950640 1 -- 172.21.15.90:0/3085387824 wait complete. 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.442+0000 7f712b950640 1 Processor -- start 2024-04-20T10:51:05.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f712b950640 1 -- start start 2024-04-20T10:51:05.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f712b950640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f712406ef90 0x7f71240a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f712b950640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71240c23f0 0x7f712414ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f712b950640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71240c7bf0 0x7f712414bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f712b950640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f71240c39a0 con 0x7f71240c23f0 2024-04-20T10:51:05.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f712b950640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f71240c3ff0 con 0x7f712406ef90 2024-04-20T10:51:05.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f712b950640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f71240c3c80 con 0x7f71240c7bf0 2024-04-20T10:51:05.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f7128eeb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71240c23f0 0x7f712414ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f7128eeb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71240c23f0 0x7f712414ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44812/0 (socket says 172.21.15.90:44812) 2024-04-20T10:51:05.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f7128eeb640 1 -- 172.21.15.90:0/2827206336 learned_addr learned my addr 172.21.15.90:0/2827206336 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f7129eed640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71240c7bf0 0x7f712414bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.443+0000 7f71296ec640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f712406ef90 0x7f71240a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7128eeb640 1 -- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71240c7bf0 msgr2=0x7f712414bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7128eeb640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71240c7bf0 0x7f712414bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7128eeb640 1 -- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f712406ef90 msgr2=0x7f71240a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7128eeb640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f712406ef90 0x7f71240a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7128eeb640 1 -- 172.21.15.90:0/2827206336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7124151910 con 0x7f71240c23f0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7128eeb640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71240c23f0 0x7f712414ba90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7120000c00 tx=0x7f71200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7119ffb640 1 -- 172.21.15.90:0/2827206336 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120043070 con 0x7f71240c23f0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7119ffb640 1 -- 172.21.15.90:0/2827206336 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f712003f890 con 0x7f71240c23f0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f7119ffb640 1 -- 172.21.15.90:0/2827206336 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7120038040 con 0x7f71240c23f0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7124151bf0 con 0x7f71240c23f0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.444+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71241521b0 con 0x7f71240c23f0 2024-04-20T10:51:05.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.445+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7124076150 con 0x7f71240c23f0 2024-04-20T10:51:05.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.445+0000 7f7119ffb640 1 -- 172.21.15.90:0/2827206336 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7120046070 con 0x7f71240c23f0 2024-04-20T10:51:05.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.446+0000 7f7119ffb640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f710806c8f0 0x7f710806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.446+0000 7f71296ec640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f710806c8f0 0x7f710806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.446+0000 7f7119ffb640 1 -- 172.21.15.90:0/2827206336 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f71200adf80 con 0x7f71240c23f0 2024-04-20T10:51:05.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.446+0000 7f71296ec640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f710806c8f0 0x7f710806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7114004ea0 tx=0x7f7114009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.450+0000 7f7119ffb640 1 -- 172.21.15.90:0/2827206336 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f712007c230 con 0x7f71240c23f0 2024-04-20T10:51:05.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.627+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f712414fa20 con 0x7f71240c23f0 2024-04-20T10:51:05.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.628+0000 7f7119ffb640 1 -- 172.21.15.90:0/2827206336 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f712007bb30 con 0x7f71240c23f0 2024-04-20T10:51:05.629 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:05.629 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f710806c8f0 msgr2=0x7f710806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f710806c8f0 0x7f710806edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7114004ea0 tx=0x7f7114009040 comp rx=0 tx=0).stop 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71240c23f0 msgr2=0x7f712414ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71240c23f0 0x7f712414ba90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7120000c00 tx=0x7f71200046c0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 shutdown_connections 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f710806c8f0 0x7f710806edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f71240c7bf0 0x7f712414bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f71240c23f0 0x7f712414ba90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 --2- 172.21.15.90:0/2827206336 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f712406ef90 0x7f71240a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.630+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 >> 172.21.15.90:0/2827206336 conn(0x7f71240aa660 msgr2=0x7f71240aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.631+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 shutdown_connections 2024-04-20T10:51:05.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.631+0000 7f712b950640 1 -- 172.21.15.90:0/2827206336 wait complete. 2024-04-20T10:51:05.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:51:05.643 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:51:05.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.744+0000 7f35e15d5640 1 Processor -- start 2024-04-20T10:51:05.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.744+0000 7f35e15d5640 1 -- start start 2024-04-20T10:51:05.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35e15d5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 0x7f35dc0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35e15d5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc0c7100 con 0x7f35dc15a810 2024-04-20T10:51:05.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35e15d5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35dc06c160 con 0x7f35dc153df0 2024-04-20T10:51:05.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35e15d5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc0ca690 con 0x7f35dc06cc40 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35db7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f35dc15a810 0x7f35dc0c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59836/0 (socket says 172.21.15.90:59836) 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35db7fe640 1 -- 172.21.15.90:0/3298468554 learned_addr learned my addr 172.21.15.90:0/3298468554 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35da7fc640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 0x7f35dc0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394468429 0 0) 0x7f35dc0c7100 con 0x7f35dc15a810 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c4003520 con 0x7f35dc15a810 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 259078362 0 0) 0x7f35c4003520 con 0x7f35dc15a810 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 msgr2=0x7f35dc0c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 0x7f35dc0c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 >> v1:172.21.15.175:6789/0 conn(0x7f35dc153df0 legacy=0x7f35dc0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc06c440 con 0x7f35dc15a810 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f35d40019f0 con 0x7f35dc15a810 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 >> v1:172.21.15.90:6789/0 conn(0x7f35dc15a810 legacy=0x7f35dc0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c40039e0 0x7f35c4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 0x7f35c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c4004d40 0x7f35c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc0ca690 con 0x7f35c40039e0 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35c400bb80 con 0x7f35c4004d40 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35c400bd80 con 0x7f35dc06cc40 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.745+0000 7f35daffd640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c40039e0 0x7f35c4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35da7fc640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 0x7f35c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35db7fe640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c4004d40 0x7f35c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35daffd640 1 -- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 msgr2=0x7f35c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35daffd640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc06cc40 0x7f35c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35daffd640 1 -- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c4004d40 msgr2=0x7f35c40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35daffd640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c4004d40 0x7f35c40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35daffd640 1 -- 172.21.15.90:0/3298468554 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35c4003520 con 0x7f35c40039e0 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.746+0000 7f35daffd640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c40039e0 0x7f35c4003e00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001750 tx=0x7f35c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb699657b47999c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc001370 con 0x7f35c40039e0 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35cc0052d0 con 0x7f35c40039e0 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35d9ffb640 1 -- 172.21.15.90:0/3298468554 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35cc003830 con 0x7f35c40039e0 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35e15d5640 1 -- 172.21.15.90:0/3298468554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c40039e0 msgr2=0x7f35c4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35e15d5640 1 --2- 172.21.15.90:0/3298468554 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35c40039e0 0x7f35c4003e00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f35cc001750 tx=0x7f35c4005830 comp rx=0 tx=0).stop 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35db7fe640 1 -- 172.21.15.90:0/3298468554 reap_dead start 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35e15d5640 1 -- 172.21.15.90:0/3298468554 shutdown_connections 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35e15d5640 1 -- 172.21.15.90:0/3298468554 >> 172.21.15.90:0/3298468554 conn(0x7f35dc0adbd0 msgr2=0x7f35dc0adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35e15d5640 1 -- 172.21.15.90:0/3298468554 shutdown_connections 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.747+0000 7f35e15d5640 1 -- 172.21.15.90:0/3298468554 wait complete. 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.748+0000 7f35e15d5640 1 Processor -- start 2024-04-20T10:51:05.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.748+0000 7f35e15d5640 1 -- start start 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35e15d5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c40039e0 0x7f35dc1efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35e15d5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc1ec8d0 0x7f35dc14f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35e15d5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35dc0ac350 0x7f35dc1556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35e15d5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc1541d0 con 0x7f35dc0ac350 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35e15d5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35dc06c7b0 con 0x7f35c40039e0 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35e15d5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35dc0c73e0 con 0x7f35dc1ec8d0 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35dc0ac350 0x7f35dc1556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35dc0ac350 0x7f35dc1556a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44842/0 (socket says 172.21.15.90:44842) 2024-04-20T10:51:05.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 -- 172.21.15.90:0/4116470281 learned_addr learned my addr 172.21.15.90:0/4116470281 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 -- 172.21.15.90:0/4116470281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc1ec8d0 msgr2=0x7f35dc14f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc1ec8d0 0x7f35dc14f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35daffd640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c40039e0 0x7f35dc1efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 -- 172.21.15.90:0/4116470281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c40039e0 msgr2=0x7f35dc1efe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c40039e0 0x7f35dc1efe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 -- 172.21.15.90:0/4116470281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35dc14f700 con 0x7f35dc0ac350 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.749+0000 7f35db7fe640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35dc0ac350 0x7f35dc1556a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35d4000f80 tx=0x7f35d4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.750+0000 7f35c37fe640 1 -- 172.21.15.90:0/4116470281 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d4017020 con 0x7f35dc0ac350 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.750+0000 7f35c37fe640 1 -- 172.21.15.90:0/4116470281 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d400ab20 con 0x7f35dc0ac350 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.750+0000 7f35c37fe640 1 -- 172.21.15.90:0/4116470281 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35d40133f0 con 0x7f35dc0ac350 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.750+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35dc14e1c0 con 0x7f35dc0ac350 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.750+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35dc1ec0d0 con 0x7f35dc0ac350 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.751+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35dc14e6e0 con 0x7f35dc0ac350 2024-04-20T10:51:05.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.751+0000 7f35c37fe640 1 -- 172.21.15.90:0/4116470281 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35d401a020 con 0x7f35dc0ac350 2024-04-20T10:51:05.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.751+0000 7f35c37fe640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f35c806c8f0 0x7f35c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:05.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.752+0000 7f35daffd640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f35c806c8f0 0x7f35c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:05.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.752+0000 7f35c37fe640 1 -- 172.21.15.90:0/4116470281 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f35d408c4d0 con 0x7f35dc0ac350 2024-04-20T10:51:05.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.752+0000 7f35daffd640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f35c806c8f0 0x7f35c806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35cc033000 tx=0x7f35cc009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:05.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.756+0000 7f35c37fe640 1 -- 172.21.15.90:0/4116470281 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f35dc14e6e0 con 0x7f35dc0ac350 2024-04-20T10:51:05.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.930+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f35dc1ebec0 con 0x7f35dc0ac350 2024-04-20T10:51:05.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.931+0000 7f35c37fe640 1 -- 172.21.15.90:0/4116470281 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f35d4021020 con 0x7f35dc0ac350 2024-04-20T10:51:05.931 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:51:05.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f35c806c8f0 msgr2=0x7f35c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f35c806c8f0 0x7f35c806edb0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f35cc033000 tx=0x7f35cc009030 comp rx=0 tx=0).stop 2024-04-20T10:51:05.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35dc0ac350 msgr2=0x7f35dc1556a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:05.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35dc0ac350 0x7f35dc1556a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f35d4000f80 tx=0x7f35d4007a90 comp rx=0 tx=0).stop 2024-04-20T10:51:05.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 shutdown_connections 2024-04-20T10:51:05.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f35c806c8f0 0x7f35c806edb0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35dc0ac350 0x7f35dc1556a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35dc1ec8d0 0x7f35dc14f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 --2- 172.21.15.90:0/4116470281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f35c40039e0 0x7f35dc1efe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:05.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 >> 172.21.15.90:0/4116470281 conn(0x7f35dc0adbd0 msgr2=0x7f35dc0cb650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:05.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 shutdown_connections 2024-04-20T10:51:05.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:05.933+0000 7f35e15d5640 1 -- 172.21.15.90:0/4116470281 wait complete. 2024-04-20T10:51:05.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:51:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.044+0000 7f6d6464e640 1 Processor -- start 2024-04-20T10:51:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.044+0000 7f6d6464e640 1 -- start start 2024-04-20T10:51:06.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d6464e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d5c073810 0x7f6d5c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d6464e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0ad0c0 0x7f6d5c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d6464e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c0c4370 con 0x7f6d5c157710 2024-04-20T10:51:06.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d6464e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6d5c1569e0 con 0x7f6d5c073810 2024-04-20T10:51:06.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d6464e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c157280 con 0x7f6d5c0ad0c0 2024-04-20T10:51:06.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d623ea640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d5c073810 0x7f6d5c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d623ea640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d5c073810 0x7f6d5c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44844/0 (socket says 172.21.15.90:44844) 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d623ea640 1 -- 172.21.15.90:0/4165188470 learned_addr learned my addr 172.21.15.90:0/4165188470 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d62beb640 1 --2- 172.21.15.90:0/4165188470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0ad0c0 0x7f6d5c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d623ea640 1 -- 172.21.15.90:0/4165188470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0ad0c0 msgr2=0x7f6d5c0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d623ea640 1 --2- 172.21.15.90:0/4165188470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0ad0c0 0x7f6d5c0ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d623ea640 1 -- 172.21.15.90:0/4165188470 >> v1:172.21.15.175:6789/0 conn(0x7f6d5c157710 legacy=0x7f6d5c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d623ea640 1 -- 172.21.15.90:0/4165188470 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c156c30 con 0x7f6d5c073810 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.045+0000 7f6d62beb640 1 --2- 172.21.15.90:0/4165188470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0ad0c0 0x7f6d5c0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.046+0000 7f6d623ea640 1 --2- 172.21.15.90:0/4165188470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c154000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009870 tx=0x7f6d5802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0932d4a3abbade2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.046+0000 7f6d613e8640 1 -- 172.21.15.90:0/4165188470 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58035020 con 0x7f6d5c073810 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.046+0000 7f6d613e8640 1 -- 172.21.15.90:0/4165188470 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d58031640 con 0x7f6d5c073810 2024-04-20T10:51:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.046+0000 7f6d613e8640 1 -- 172.21.15.90:0/4165188470 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5802d040 con 0x7f6d5c073810 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.046+0000 7f6d6464e640 1 -- 172.21.15.90:0/4165188470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 msgr2=0x7f6d5c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.046+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4165188470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c154000 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009870 tx=0x7f6d5802b8f0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.047+0000 7f6d6464e640 1 -- 172.21.15.90:0/4165188470 shutdown_connections 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.047+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4165188470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c0ad0c0 0x7f6d5c0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.047+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4165188470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c154000 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.047+0000 7f6d6464e640 1 -- 172.21.15.90:0/4165188470 >> 172.21.15.90:0/4165188470 conn(0x7f6d5c0c8080 msgr2=0x7f6d5c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.047+0000 7f6d6464e640 1 -- 172.21.15.90:0/4165188470 shutdown_connections 2024-04-20T10:51:06.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.047+0000 7f6d6464e640 1 -- 172.21.15.90:0/4165188470 wait complete. 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 Processor -- start 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 -- start start 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c1deb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d5c0ad0c0 0x7f6d5c1ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c157710 0x7f6d5c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c0abbb0 con 0x7f6d5c073810 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d5c073bf0 con 0x7f6d5c0ad0c0 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d6464e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d5c0abd30 con 0x7f6d5c157710 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d623ea640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c1deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d623ea640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c1deb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44848/0 (socket says 172.21.15.90:44848) 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.048+0000 7f6d623ea640 1 -- 172.21.15.90:0/4163206467 learned_addr learned my addr 172.21.15.90:0/4163206467 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d62beb640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c157710 0x7f6d5c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d61be9640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d5c0ad0c0 0x7f6d5c1ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d623ea640 1 -- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c157710 msgr2=0x7f6d5c0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d623ea640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c157710 0x7f6d5c0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d623ea640 1 -- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d5c0ad0c0 msgr2=0x7f6d5c1ecd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d623ea640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d5c0ad0c0 0x7f6d5c1ecd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d623ea640 1 -- 172.21.15.90:0/4163206467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c0730b0 con 0x7f6d5c073810 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d62beb640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c157710 0x7f6d5c0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d61be9640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d5c0ad0c0 0x7f6d5c1ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d623ea640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c1deb70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d58000c00 tx=0x7f6d580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d52ffd640 1 -- 172.21.15.90:0/4163206467 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58040070 con 0x7f6d5c073810 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d52ffd640 1 -- 172.21.15.90:0/4163206467 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d580399f0 con 0x7f6d5c073810 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c072af0 con 0x7f6d5c073810 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d52ffd640 1 -- 172.21.15.90:0/4163206467 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58035040 con 0x7f6d5c073810 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.049+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d5c1ec580 con 0x7f6d5c073810 2024-04-20T10:51:06.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.050+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d5c076150 con 0x7f6d5c073810 2024-04-20T10:51:06.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.050+0000 7f6d52ffd640 1 -- 172.21.15.90:0/4163206467 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d5804b060 con 0x7f6d5c073810 2024-04-20T10:51:06.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.051+0000 7f6d52ffd640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4006c8f0 0x7f6d4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.051+0000 7f6d61be9640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4006c8f0 0x7f6d4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.051+0000 7f6d52ffd640 1 -- 172.21.15.90:0/4163206467 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f6d580ad740 con 0x7f6d5c073810 2024-04-20T10:51:06.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.051+0000 7f6d61be9640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4006c8f0 0x7f6d4006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0ad830 tx=0x7f6d4c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.055+0000 7f6d52ffd640 1 -- 172.21.15.90:0/4163206467 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6d5807b8d0 con 0x7f6d5c073810 2024-04-20T10:51:06.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.229+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f6d5c0ab0e0 con 0x7f6d5c073810 2024-04-20T10:51:06.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.229+0000 7f6d52ffd640 1 -- 172.21.15.90:0/4163206467 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f6d5807b1d0 con 0x7f6d5c073810 2024-04-20T10:51:06.230 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:06.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4006c8f0 msgr2=0x7f6d4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4006c8f0 0x7f6d4006edb0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0ad830 tx=0x7f6d4c009040 comp rx=0 tx=0).stop 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 msgr2=0x7f6d5c1deb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c1deb70 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f6d58000c00 tx=0x7f6d580046c0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 shutdown_connections 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4006c8f0 0x7f6d4006edb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d5c157710 0x7f6d5c0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d5c0ad0c0 0x7f6d5c1ecd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 --2- 172.21.15.90:0/4163206467 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d5c073810 0x7f6d5c1deb70 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 >> 172.21.15.90:0/4163206467 conn(0x7f6d5c0c8080 msgr2=0x7f6d5c074f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 shutdown_connections 2024-04-20T10:51:06.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.231+0000 7f6d6464e640 1 -- 172.21.15.90:0/4163206467 wait complete. 2024-04-20T10:51:06.242 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:51:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb422c1640 1 Processor -- start 2024-04-20T10:51:06.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb422c1640 1 -- start start 2024-04-20T10:51:06.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb422c1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffb3c0c3740 0x7ffb3c0c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb422c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c072f90 0x7ffb3c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb422c1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb3c06ff00 con 0x7ffb3c0ab4a0 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb422c1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ffb3c072b00 con 0x7ffb3c0c3740 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb422c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3c0701e0 con 0x7ffb3c072f90 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb3bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffb3c0c3740 0x7ffb3c0c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb3bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffb3c0c3740 0x7ffb3c0c52b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44860/0 (socket says 172.21.15.90:44860) 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb3b7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ffb3c0ab4a0 0x7ffb3c157240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59840/0 (socket says 172.21.15.90:59840) 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.343+0000 7ffb3bfff640 1 -- 172.21.15.90:0/409348751 learned_addr learned my addr 172.21.15.90:0/409348751 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.344+0000 7ffb3bfff640 1 -- 172.21.15.90:0/409348751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c072f90 msgr2=0x7ffb3c153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.344+0000 7ffb4085e640 1 --2- 172.21.15.90:0/409348751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c072f90 0x7ffb3c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.344+0000 7ffb3bfff640 1 --2- 172.21.15.90:0/409348751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c072f90 0x7ffb3c153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.344+0000 7ffb3affd640 1 -- 172.21.15.90:0/409348751 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1816850487 0 0) 0x7ffb3c06ff00 con 0x7ffb3c0ab4a0 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.344+0000 7ffb3bfff640 1 -- 172.21.15.90:0/409348751 >> v1:172.21.15.90:6789/0 conn(0x7ffb3c0ab4a0 legacy=0x7ffb3c157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.344+0000 7ffb3bfff640 1 -- 172.21.15.90:0/409348751 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3c0704c0 con 0x7ffb3c0c3740 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.344+0000 7ffb3bfff640 1 --2- 172.21.15.90:0/409348751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c52b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009870 tx=0x7ffb2c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4819bbd2828e52e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb3affd640 1 -- 172.21.15.90:0/409348751 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c0317c0 con 0x7ffb3c0c3740 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb3affd640 1 -- 172.21.15.90:0/409348751 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb2c037070 con 0x7ffb3c0c3740 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb3affd640 1 -- 172.21.15.90:0/409348751 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c031b80 con 0x7ffb3c0c3740 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 -- 172.21.15.90:0/409348751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 msgr2=0x7ffb3c0c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 --2- 172.21.15.90:0/409348751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c52b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009870 tx=0x7ffb2c02b860 comp rx=0 tx=0).stop 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 -- 172.21.15.90:0/409348751 shutdown_connections 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 --2- 172.21.15.90:0/409348751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c072f90 0x7ffb3c153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 --2- 172.21.15.90:0/409348751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c52b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 -- 172.21.15.90:0/409348751 >> 172.21.15.90:0/409348751 conn(0x7ffb3c0ca0a0 msgr2=0x7ffb3c0ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:06.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 -- 172.21.15.90:0/409348751 shutdown_connections 2024-04-20T10:51:06.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.345+0000 7ffb422c1640 1 -- 172.21.15.90:0/409348751 wait complete. 2024-04-20T10:51:06.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.346+0000 7ffb422c1640 1 Processor -- start 2024-04-20T10:51:06.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.346+0000 7ffb422c1640 1 -- start start 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb422c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb3c072f90 0x7ffb3c1e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb422c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c0ab4a0 0x7ffb3c14c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb422c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb422c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c0735c0 con 0x7ffb3c0c3740 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb422c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffb3c073440 con 0x7ffb3c072f90 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb422c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffb3c0c3b20 con 0x7ffb3c0ab4a0 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c5db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44872/0 (socket says 172.21.15.90:44872) 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 -- 172.21.15.90:0/716048818 learned_addr learned my addr 172.21.15.90:0/716048818 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 -- 172.21.15.90:0/716048818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c0ab4a0 msgr2=0x7ffb3c14c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c0ab4a0 0x7ffb3c14c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 -- 172.21.15.90:0/716048818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb3c072f90 msgr2=0x7ffb3c1e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb3c072f90 0x7ffb3c1e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.347+0000 7ffb4085e640 1 -- 172.21.15.90:0/716048818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb3c157190 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.348+0000 7ffb4085e640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c5db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400cd70 tx=0x7ffb3400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.348+0000 7ffb38ff9640 1 -- 172.21.15.90:0/716048818 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb34003b90 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.348+0000 7ffb38ff9640 1 -- 172.21.15.90:0/716048818 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb34003d30 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.348+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb3c157470 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.348+0000 7ffb38ff9640 1 -- 172.21.15.90:0/716048818 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb34004240 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.348+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb3c0c62f0 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.349+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb3c0ac050 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.349+0000 7ffb38ff9640 1 -- 172.21.15.90:0/716048818 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb340043e0 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.350+0000 7ffb38ff9640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffb2806c8f0 0x7ffb2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.350+0000 7ffb38ff9640 1 -- 172.21.15.90:0/716048818 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ffb3408c910 con 0x7ffb3c0c3740 2024-04-20T10:51:06.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.350+0000 7ffb3bfff640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffb2806c8f0 0x7ffb2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.350+0000 7ffb3bfff640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffb2806c8f0 0x7ffb2806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c036000 tx=0x7ffb2c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.354+0000 7ffb38ff9640 1 -- 172.21.15.90:0/716048818 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ffb3c0ac050 con 0x7ffb3c0c3740 2024-04-20T10:51:06.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.532+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7ffb3c076150 con 0x7ffb3c0c3740 2024-04-20T10:51:06.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.532+0000 7ffb38ff9640 1 -- 172.21.15.90:0/716048818 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7ffb3405aaa0 con 0x7ffb3c0c3740 2024-04-20T10:51:06.532 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:06.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffb2806c8f0 msgr2=0x7ffb2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffb2806c8f0 0x7ffb2806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c036000 tx=0x7ffb2c030000 comp rx=0 tx=0).stop 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 msgr2=0x7ffb3c0c5db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c5db0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400cd70 tx=0x7ffb3400a660 comp rx=0 tx=0).stop 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 shutdown_connections 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffb2806c8f0 0x7ffb2806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffb3c0c3740 0x7ffb3c0c5db0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffb3c0ab4a0 0x7ffb3c14c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 --2- 172.21.15.90:0/716048818 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffb3c072f90 0x7ffb3c1e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 >> 172.21.15.90:0/716048818 conn(0x7ffb3c0ca0a0 msgr2=0x7ffb3c152690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 shutdown_connections 2024-04-20T10:51:06.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.534+0000 7ffb422c1640 1 -- 172.21.15.90:0/716048818 wait complete. 2024-04-20T10:51:06.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:51:06.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.644+0000 7fb09399d640 1 Processor -- start 2024-04-20T10:51:06.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.644+0000 7fb09399d640 1 -- start start 2024-04-20T10:51:06.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb09399d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb08c0c7fd0 0x7fb08c0c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb09399d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb08c0c8460 con 0x7fb08c06ef90 2024-04-20T10:51:06.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb09399d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb08c0c33e0 con 0x7fb08c0c7bf0 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb09399d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb08c0c4480 con 0x7fb08c0c7fd0 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb090f38640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb08c06ef90 0x7fb08c15ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59844/0 (socket says 172.21.15.90:59844) 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb090f38640 1 -- 172.21.15.90:0/1649768904 learned_addr learned my addr 172.21.15.90:0/1649768904 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb091f3a640 1 --2- 172.21.15.90:0/1649768904 >> v2:172.21.15.175:3300/0 conn(0x7fb08c0c7fd0 0x7fb08c0c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4252600003 0 0) 0x7fb07c001110 con 0x7fb08c06ef90 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb078003520 con 0x7fb08c06ef90 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1077428261 0 0) 0x7fb078003520 con 0x7fb08c06ef90 2024-04-20T10:51:06.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 >> v2:172.21.15.175:3300/0 conn(0x7fb08c0c7fd0 msgr2=0x7fb08c0c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb083fff640 1 --2- 172.21.15.90:0/1649768904 >> v2:172.21.15.175:3300/0 conn(0x7fb08c0c7fd0 0x7fb08c0c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.645+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 >> v1:172.21.15.175:6789/0 conn(0x7fb08c0c7bf0 legacy=0x7fb08c0c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c0c36c0 con 0x7fb08c06ef90 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fb07c001840 con 0x7fb08c06ef90 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 >> v1:172.21.15.90:6789/0 conn(0x7fb08c06ef90 legacy=0x7fb08c15ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb078003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb078004800 0x7fb078004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0780052e0 0x7fb07800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c0c4480 con 0x7fb0780039b0 2024-04-20T10:51:06.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb07800c1b0 con 0x7fb078004800 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb07800c3b0 con 0x7fb0780052e0 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091739640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb078003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb090f38640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb078004800 0x7fb078004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091f3a640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0780052e0 0x7fb07800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091739640 1 -- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0780052e0 msgr2=0x7fb07800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091739640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0780052e0 0x7fb07800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091739640 1 -- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb078004800 msgr2=0x7fb078004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091739640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb078004800 0x7fb078004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091739640 1 -- 172.21.15.90:0/1649768904 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb078003520 con 0x7fb0780039b0 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091f3a640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0780052e0 0x7fb07800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:06.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.646+0000 7fb091f3a640 1 -- 172.21.15.90:0/1649768904 reap_dead start 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb091739640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb078003dd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb088001720 tx=0x7fb078005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0257ab1f8be393 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088001370 con 0x7fb0780039b0 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0880052d0 con 0x7fb0780039b0 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb083fff640 1 -- 172.21.15.90:0/1649768904 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088003830 con 0x7fb0780039b0 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb09399d640 1 -- 172.21.15.90:0/1649768904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 msgr2=0x7fb078003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb09399d640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb078003dd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb088001720 tx=0x7fb078005830 comp rx=0 tx=0).stop 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb09399d640 1 -- 172.21.15.90:0/1649768904 shutdown_connections 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb09399d640 1 --2- 172.21.15.90:0/1649768904 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb078003dd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb09399d640 1 -- 172.21.15.90:0/1649768904 >> 172.21.15.90:0/1649768904 conn(0x7fb08c0aa660 msgr2=0x7fb08c0aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb09399d640 1 -- 172.21.15.90:0/1649768904 shutdown_connections 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.647+0000 7fb09399d640 1 -- 172.21.15.90:0/1649768904 wait complete. 2024-04-20T10:51:06.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.648+0000 7fb09399d640 1 Processor -- start 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb09399d640 1 -- start start 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb09399d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb08c14de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb09399d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c0a9ff0 0x7fb08c14ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb09399d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c0a7d00 0x7fb08c14bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb09399d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c0c3ff0 con 0x7fb0780039b0 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb09399d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb08c0c2930 con 0x7fb08c0a7d00 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb09399d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb08c0c3c80 con 0x7fb08c0a9ff0 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb091739640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb08c14de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb091739640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb08c14de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44888/0 (socket says 172.21.15.90:44888) 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb091739640 1 -- 172.21.15.90:0/2120534616 learned_addr learned my addr 172.21.15.90:0/2120534616 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb091f3a640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c0a7d00 0x7fb08c14bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.649+0000 7fb090f38640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c0a9ff0 0x7fb08c14ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb091739640 1 -- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c0a9ff0 msgr2=0x7fb08c14ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb091739640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c0a9ff0 0x7fb08c14ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb091739640 1 -- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c0a7d00 msgr2=0x7fb08c14bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb091739640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c0a7d00 0x7fb08c14bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb091739640 1 -- 172.21.15.90:0/2120534616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb08c1f0a30 con 0x7fb0780039b0 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb091f3a640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c0a7d00 0x7fb08c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb091739640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb08c14de90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb088000c00 tx=0x7fb088001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb081ffb640 1 -- 172.21.15.90:0/2120534616 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088041020 con 0x7fb0780039b0 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb081ffb640 1 -- 172.21.15.90:0/2120534616 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb088005480 con 0x7fb0780039b0 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb08c1efc70 con 0x7fb0780039b0 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb081ffb640 1 -- 172.21.15.90:0/2120534616 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb088007a30 con 0x7fb0780039b0 2024-04-20T10:51:06.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.650+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb08c1f0230 con 0x7fb0780039b0 2024-04-20T10:51:06.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.651+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb08c076150 con 0x7fb0780039b0 2024-04-20T10:51:06.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.651+0000 7fb081ffb640 1 -- 172.21.15.90:0/2120534616 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb088044020 con 0x7fb0780039b0 2024-04-20T10:51:06.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.652+0000 7fb081ffb640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb07006c8f0 0x7fb07006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.652+0000 7fb081ffb640 1 -- 172.21.15.90:0/2120534616 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb0880ad9d0 con 0x7fb0780039b0 2024-04-20T10:51:06.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.652+0000 7fb090f38640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb07006c8f0 0x7fb07006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.652+0000 7fb090f38640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb07006c8f0 0x7fb07006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb08c150590 tx=0x7fb07c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.656+0000 7fb081ffb640 1 -- 172.21.15.90:0/2120534616 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb08804b030 con 0x7fb0780039b0 2024-04-20T10:51:06.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.834+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fb08c06e5d0 con 0x7fb0780039b0 2024-04-20T10:51:06.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.834+0000 7fb081ffb640 1 -- 172.21.15.90:0/2120534616 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7fb0880303c0 con 0x7fb0780039b0 2024-04-20T10:51:06.835 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb07006c8f0 msgr2=0x7fb07006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb07006c8f0 0x7fb07006edb0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb08c150590 tx=0x7fb07c009040 comp rx=0 tx=0).stop 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 msgr2=0x7fb08c14de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb08c14de90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb088000c00 tx=0x7fb088001120 comp rx=0 tx=0).stop 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 shutdown_connections 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb07006c8f0 0x7fb07006edb0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb08c0a7d00 0x7fb08c14bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb08c0a9ff0 0x7fb08c14ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 --2- 172.21.15.90:0/2120534616 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0780039b0 0x7fb08c14de90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.836+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 >> 172.21.15.90:0/2120534616 conn(0x7fb08c0aa660 msgr2=0x7fb08c06da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:06.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.837+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 shutdown_connections 2024-04-20T10:51:06.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.837+0000 7fb09399d640 1 -- 172.21.15.90:0/2120534616 wait complete. 2024-04-20T10:51:06.848 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:51:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbac132b640 1 Processor -- start 2024-04-20T10:51:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbac132b640 1 -- start start 2024-04-20T10:51:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbac132b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbabc153ef0 0x7fbabc0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbac132b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbabc15a720 con 0x7fbabc0ab730 2024-04-20T10:51:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbac132b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbabc15ac80 con 0x7fbabc0c9ee0 2024-04-20T10:51:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbac132b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbabc15a9a0 con 0x7fbabc153ef0 2024-04-20T10:51:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbaba7fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbabc0ab730 0x7fbabc1568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59858/0 (socket says 172.21.15.90:59858) 2024-04-20T10:51:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.948+0000 7fbaba7fc640 1 -- 172.21.15.90:0/1041607407 learned_addr learned my addr 172.21.15.90:0/1041607407 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.949+0000 7fbabaffd640 1 --2- 172.21.15.90:0/1041607407 >> v2:172.21.15.175:3300/0 conn(0x7fbabc153ef0 0x7fbabc0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.949+0000 7fbab9ffb640 1 -- 172.21.15.90:0/1041607407 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723787809 0 0) 0x7fbab0001110 con 0x7fbabc0ab730 2024-04-20T10:51:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.949+0000 7fbab9ffb640 1 -- 172.21.15.90:0/1041607407 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaa4003520 con 0x7fbabc0ab730 2024-04-20T10:51:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.949+0000 7fbabaffd640 1 -- 172.21.15.90:0/1041607407 >> v1:172.21.15.175:6789/0 conn(0x7fbabc0c9ee0 legacy=0x7fbabc156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.949+0000 7fbabaffd640 1 -- 172.21.15.90:0/1041607407 >> v1:172.21.15.90:6789/0 conn(0x7fbabc0ab730 legacy=0x7fbabc1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.949+0000 7fbabaffd640 1 -- 172.21.15.90:0/1041607407 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc0c6a90 con 0x7fbabc153ef0 2024-04-20T10:51:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbabaffd640 1 --2- 172.21.15.90:0/1041607407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc153ef0 0x7fbabc0c89f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009d90 tx=0x7fbaac02be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=664af053eaa62574 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbab9ffb640 1 -- 172.21.15.90:0/1041607407 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac039070 con 0x7fbabc153ef0 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbab9ffb640 1 -- 172.21.15.90:0/1041607407 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaac02cbd0 con 0x7fbabc153ef0 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbab9ffb640 1 -- 172.21.15.90:0/1041607407 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac034440 con 0x7fbabc153ef0 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbac132b640 1 -- 172.21.15.90:0/1041607407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc153ef0 msgr2=0x7fbabc0c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbac132b640 1 --2- 172.21.15.90:0/1041607407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc153ef0 0x7fbabc0c89f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009d90 tx=0x7fbaac02be20 comp rx=0 tx=0).stop 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbac132b640 1 -- 172.21.15.90:0/1041607407 shutdown_connections 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbac132b640 1 --2- 172.21.15.90:0/1041607407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc153ef0 0x7fbabc0c89f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbac132b640 1 -- 172.21.15.90:0/1041607407 >> 172.21.15.90:0/1041607407 conn(0x7fbabc0cbfe0 msgr2=0x7fbabc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbac132b640 1 -- 172.21.15.90:0/1041607407 shutdown_connections 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.950+0000 7fbac132b640 1 -- 172.21.15.90:0/1041607407 wait complete. 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 Processor -- start 2024-04-20T10:51:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 -- start start 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbabc0ab730 0x7fbabc155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc0c9ee0 0x7fbabc1ec6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbabc153ef0 0x7fbabc1ecc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc0bf800 con 0x7fbabc0ab730 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbabc0c8f30 con 0x7fbabc0c9ee0 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbac132b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbabc0bfb10 con 0x7fbabc153ef0 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbabaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbabc0ab730 0x7fbabc155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbabaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbabc0ab730 0x7fbabc155880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44898/0 (socket says 172.21.15.90:44898) 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.952+0000 7fbabaffd640 1 -- 172.21.15.90:0/1216592897 learned_addr learned my addr 172.21.15.90:0/1216592897 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:06.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbaba7fc640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc0c9ee0 0x7fbabc1ec6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabb7fe640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbabc153ef0 0x7fbabc1ecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabaffd640 1 -- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbabc153ef0 msgr2=0x7fbabc1ecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabaffd640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbabc153ef0 0x7fbabc1ecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabaffd640 1 -- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc0c9ee0 msgr2=0x7fbabc1ec6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabaffd640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc0c9ee0 0x7fbabc1ec6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabaffd640 1 -- 172.21.15.90:0/1216592897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbabc1ed170 con 0x7fbabc0ab730 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbaba7fc640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc0c9ee0 0x7fbabc1ec6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabb7fe640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbabc153ef0 0x7fbabc1ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbabaffd640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbabc0ab730 0x7fbabc155880 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbaac037040 tx=0x7fbaac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbaa37fe640 1 -- 172.21.15.90:0/1216592897 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac039050 con 0x7fbabc0ab730 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbaa37fe640 1 -- 172.21.15.90:0/1216592897 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaac03a040 con 0x7fbabc0ab730 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbabc1ec1f0 con 0x7fbabc0ab730 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbaa37fe640 1 -- 172.21.15.90:0/1216592897 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaac009450 con 0x7fbabc0ab730 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.953+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbabc0c0040 con 0x7fbabc0ab730 2024-04-20T10:51:06.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.954+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbabc076150 con 0x7fbabc0ab730 2024-04-20T10:51:06.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.954+0000 7fbaa37fe640 1 -- 172.21.15.90:0/1216592897 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbaac047020 con 0x7fbabc0ab730 2024-04-20T10:51:06.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.955+0000 7fbaa37fe640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbaa806c8f0 0x7fbaa806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:06.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.955+0000 7fbaa37fe640 1 -- 172.21.15.90:0/1216592897 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fbaac0ae090 con 0x7fbabc0ab730 2024-04-20T10:51:06.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.955+0000 7fbaba7fc640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbaa806c8f0 0x7fbaa806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:06.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.955+0000 7fbaba7fc640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbaa806c8f0 0x7fbaa806edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbabc153330 tx=0x7fbab0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:06.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:06.959+0000 7fbaa37fe640 1 -- 172.21.15.90:0/1216592897 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbaac04e020 con 0x7fbabc0ab730 2024-04-20T10:51:07.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.133+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7fbabc06d070 con 0x7fbabc0ab730 2024-04-20T10:51:07.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.134+0000 7fbaa37fe640 1 -- 172.21.15.90:0/1216592897 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7fbabc1ed170 con 0x7fbabc0ab730 2024-04-20T10:51:07.134 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbaa806c8f0 msgr2=0x7fbaa806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbaa806c8f0 0x7fbaa806edb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbabc153330 tx=0x7fbab0009040 comp rx=0 tx=0).stop 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbabc0ab730 msgr2=0x7fbabc155880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbabc0ab730 0x7fbabc155880 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbaac037040 tx=0x7fbaac004a40 comp rx=0 tx=0).stop 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 shutdown_connections 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbaa806c8f0 0x7fbaa806edb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbabc153ef0 0x7fbabc1ecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbabc0c9ee0 0x7fbabc1ec6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 --2- 172.21.15.90:0/1216592897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbabc0ab730 0x7fbabc155880 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 >> 172.21.15.90:0/1216592897 conn(0x7fbabc0cbfe0 msgr2=0x7fbabc0cb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:07.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 shutdown_connections 2024-04-20T10:51:07.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.136+0000 7fbac132b640 1 -- 172.21.15.90:0/1216592897 wait complete. 2024-04-20T10:51:07.147 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:07.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.243+0000 7fce7a5ad640 1 Processor -- start 2024-04-20T10:51:07.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.243+0000 7fce7a5ad640 1 -- start start 2024-04-20T10:51:07.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.244+0000 7fce7a5ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 0x7fce740c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.244+0000 7fce7a5ad640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce74071570 con 0x7fce74153ce0 2024-04-20T10:51:07.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.244+0000 7fce7a5ad640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fce740717e0 con 0x7fce740c5580 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.244+0000 7fce7a5ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fce740c4ab0 con 0x7fce740ad690 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.244+0000 7fce73fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fce74153ce0 0x7fce7415a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59872/0 (socket says 172.21.15.90:59872) 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.244+0000 7fce73fff640 1 -- 172.21.15.90:0/3472674473 learned_addr learned my addr 172.21.15.90:0/3472674473 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.244+0000 7fce78b4a640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 0x7fce740c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1654315550 0 0) 0x7fce74071570 con 0x7fce74153ce0 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce5c003520 con 0x7fce74153ce0 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355005708 0 0) 0x7fce740717e0 con 0x7fce740c5580 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fce74071570 con 0x7fce740c5580 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 480499178 0 0) 0x7fce5c003520 con 0x7fce74153ce0 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 msgr2=0x7fce740c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 0x7fce740c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 >> v1:172.21.15.175:6789/0 conn(0x7fce740c5580 legacy=0x7fce740c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce740c3ba0 con 0x7fce74153ce0 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fce64001670 con 0x7fce74153ce0 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 >> v1:172.21.15.90:6789/0 conn(0x7fce74153ce0 legacy=0x7fce7415a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 0x7fce5c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0040d0 0x7fce5c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c004d40 0x7fce5c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce740c4ab0 con 0x7fce5c004d40 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce5c00baa0 con 0x7fce5c0040d0 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fce5c00bca0 con 0x7fce740ad690 2024-04-20T10:51:07.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce78b4a640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c004d40 0x7fce5c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce73fff640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 0x7fce5c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce737fe640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0040d0 0x7fce5c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce78b4a640 1 -- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 msgr2=0x7fce5c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce78b4a640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740ad690 0x7fce5c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce78b4a640 1 -- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0040d0 msgr2=0x7fce5c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce78b4a640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c0040d0 0x7fce5c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.245+0000 7fce78b4a640 1 -- 172.21.15.90:0/3472674473 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce5c003520 con 0x7fce5c004d40 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.246+0000 7fce78b4a640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c004d40 0x7fce5c0051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009fc0 tx=0x7fce5c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801c8941227e3ebe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.246+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c039070 con 0x7fce5c004d40 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.246+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce6c02cc20 con 0x7fce5c004d40 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.246+0000 7fce72ffd640 1 -- 172.21.15.90:0/3472674473 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6c009c10 con 0x7fce5c004d40 2024-04-20T10:51:07.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.247+0000 7fce7a5ad640 1 -- 172.21.15.90:0/3472674473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c004d40 msgr2=0x7fce5c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.247+0000 7fce7a5ad640 1 --2- 172.21.15.90:0/3472674473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce5c004d40 0x7fce5c0051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009fc0 tx=0x7fce5c005830 comp rx=0 tx=0).stop 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.247+0000 7fce78b4a640 1 -- 172.21.15.90:0/3472674473 reap_dead start 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.247+0000 7fce7a5ad640 1 -- 172.21.15.90:0/3472674473 shutdown_connections 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.247+0000 7fce7a5ad640 1 -- 172.21.15.90:0/3472674473 >> 172.21.15.90:0/3472674473 conn(0x7fce740c9100 msgr2=0x7fce740c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.247+0000 7fce7a5ad640 1 -- 172.21.15.90:0/3472674473 shutdown_connections 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.247+0000 7fce7a5ad640 1 -- 172.21.15.90:0/3472674473 wait complete. 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.248+0000 7fce7a5ad640 1 Processor -- start 2024-04-20T10:51:07.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.248+0000 7fce7a5ad640 1 -- start start 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c004d40 0x7fce74148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce74149450 0x7fce740c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740c7230 0x7fce74156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fce74071ac0 con 0x7fce74149450 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fce741540c0 con 0x7fce5c004d40 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fce740c2530 con 0x7fce740c7230 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce74149450 0x7fce740c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce74149450 0x7fce740c6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44918/0 (socket says 172.21.15.90:44918) 2024-04-20T10:51:07.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 -- 172.21.15.90:0/58435030 learned_addr learned my addr 172.21.15.90:0/58435030 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce73fff640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c004d40 0x7fce74148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce78b4a640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740c7230 0x7fce74156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 -- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740c7230 msgr2=0x7fce74156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740c7230 0x7fce74156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 -- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c004d40 msgr2=0x7fce74148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c004d40 0x7fce74148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 -- 172.21.15.90:0/58435030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7414a590 con 0x7fce74149450 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce78b4a640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740c7230 0x7fce74156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce737fe640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce74149450 0x7fce740c6cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce6800f770 tx=0x7fce6800fc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce70ff9640 1 -- 172.21.15.90:0/58435030 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6800fe80 con 0x7fce74149450 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce70ff9640 1 -- 172.21.15.90:0/58435030 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fce68018070 con 0x7fce74149450 2024-04-20T10:51:07.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce70ff9640 1 -- 172.21.15.90:0/58435030 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce6800d6d0 con 0x7fce74149450 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce741549b0 con 0x7fce74149450 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.249+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce74149bc0 con 0x7fce74149450 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.250+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce74076150 con 0x7fce74149450 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.251+0000 7fce70ff9640 1 -- 172.21.15.90:0/58435030 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fce6800d870 con 0x7fce74149450 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.251+0000 7fce70ff9640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce6006c920 0x7fce6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.251+0000 7fce70ff9640 1 -- 172.21.15.90:0/58435030 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fce6808bd50 con 0x7fce74149450 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.251+0000 7fce73fff640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce6006c920 0x7fce6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.252+0000 7fce73fff640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce6006c920 0x7fce6006ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce64007ce0 tx=0x7fce64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.255+0000 7fce70ff9640 1 -- 172.21.15.90:0/58435030 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fce6808f030 con 0x7fce74149450 2024-04-20T10:51:07.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.467+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fce74149d90 con 0x7fce74149450 2024-04-20T10:51:07.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.468+0000 7fce70ff9640 1 -- 172.21.15.90:0/58435030 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fce74149d90 con 0x7fce74149450 2024-04-20T10:51:07.468 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:07.469 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:07.469 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:07.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce6006c920 msgr2=0x7fce6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce6006c920 0x7fce6006ede0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce64007ce0 tx=0x7fce64009040 comp rx=0 tx=0).stop 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce74149450 msgr2=0x7fce740c6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce74149450 0x7fce740c6cf0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fce6800f770 tx=0x7fce6800fc30 comp rx=0 tx=0).stop 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 shutdown_connections 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fce6006c920 0x7fce6006ede0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fce740c7230 0x7fce74156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fce74149450 0x7fce740c6cf0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 --2- 172.21.15.90:0/58435030 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fce5c004d40 0x7fce74148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 >> 172.21.15.90:0/58435030 conn(0x7fce740c9100 msgr2=0x7fce74150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:07.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 shutdown_connections 2024-04-20T10:51:07.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.470+0000 7fce7a5ad640 1 -- 172.21.15.90:0/58435030 wait complete. 2024-04-20T10:51:07.482 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:07.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.579+0000 7f4d9d559640 1 Processor -- start 2024-04-20T10:51:07.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.579+0000 7f4d9d559640 1 -- start start 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d9d559640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d98153ef0 0x7f4d980c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d9d559640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980ab730 0x7f4d981568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d9d559640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d9815a720 con 0x7f4d980c9ee0 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d9d559640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4d9815ac80 con 0x7f4d98153ef0 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d9d559640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9815a9a0 con 0x7f4d980ab730 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d96ffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4d98153ef0 0x7f4d980c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d967fc640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980ab730 0x7f4d981568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d977fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4d980c9ee0 0x7f4d98156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:46506/0 (socket says 172.21.15.90:46506) 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d977fe640 1 -- 172.21.15.90:0/1506350318 learned_addr learned my addr 172.21.15.90:0/1506350318 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d96ffd640 1 -- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980ab730 msgr2=0x7f4d981568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:07.581 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d96ffd640 1 --2- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980ab730 0x7f4d981568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d96ffd640 1 -- 172.21.15.90:0/1506350318 >> v1:172.21.15.175:6789/0 conn(0x7f4d980c9ee0 legacy=0x7f4d98156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.580+0000 7f4d95ffb640 1 -- 172.21.15.90:0/1506350318 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1040380889 0 0) 0x7f4d90001490 con 0x7f4d980c9ee0 2024-04-20T10:51:07.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.581+0000 7f4d96ffd640 1 -- 172.21.15.90:0/1506350318 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d980c6a90 con 0x7f4d98153ef0 2024-04-20T10:51:07.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.581+0000 7f4d967fc640 1 --2- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980ab730 0x7f4d981568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.581+0000 7f4d96ffd640 1 --2- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d98153ef0 0x7f4d980c89f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d880097a0 tx=0x7f4d8802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=979dd58a17e7bef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.581+0000 7f4d95ffb640 1 -- 172.21.15.90:0/1506350318 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88038070 con 0x7f4d98153ef0 2024-04-20T10:51:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.581+0000 7f4d95ffb640 1 -- 172.21.15.90:0/1506350318 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d88031700 con 0x7f4d98153ef0 2024-04-20T10:51:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.581+0000 7f4d95ffb640 1 -- 172.21.15.90:0/1506350318 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d88031ad0 con 0x7f4d98153ef0 2024-04-20T10:51:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 -- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d98153ef0 msgr2=0x7f4d980c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 --2- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d98153ef0 0x7f4d980c89f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4d880097a0 tx=0x7f4d8802b7a0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 -- 172.21.15.90:0/1506350318 shutdown_connections 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 --2- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980ab730 0x7f4d981568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 --2- 172.21.15.90:0/1506350318 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d98153ef0 0x7f4d980c89f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 -- 172.21.15.90:0/1506350318 >> 172.21.15.90:0/1506350318 conn(0x7f4d980cbfe0 msgr2=0x7f4d980cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 -- 172.21.15.90:0/1506350318 shutdown_connections 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.582+0000 7f4d9d559640 1 -- 172.21.15.90:0/1506350318 wait complete. 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.583+0000 7f4d9d559640 1 Processor -- start 2024-04-20T10:51:07.584 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.583+0000 7f4d9d559640 1 -- start start 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d9d559640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d980ab730 0x7f4d981e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d9d559640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980c9ee0 0x7f4d981ecda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d9d559640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d98153ef0 0x7f4d980ad0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d9d559640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d980bf800 con 0x7f4d98153ef0 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d9d559640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d98157510 con 0x7f4d980ab730 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d9d559640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4d981e01c0 con 0x7f4d980c9ee0 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d98153ef0 0x7f4d980ad0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d98153ef0 0x7f4d980ad0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44934/0 (socket says 172.21.15.90:44934) 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 -- 172.21.15.90:0/166190234 learned_addr learned my addr 172.21.15.90:0/166190234 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d96ffd640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d980ab730 0x7f4d981e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d967fc640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980c9ee0 0x7f4d981ecda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 -- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980c9ee0 msgr2=0x7f4d981ecda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980c9ee0 0x7f4d981ecda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 -- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d980ab730 msgr2=0x7f4d981e0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d980ab730 0x7f4d981e0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.584+0000 7f4d977fe640 1 -- 172.21.15.90:0/166190234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d981dfee0 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.585+0000 7f4d977fe640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d98153ef0 0x7f4d980ad0e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000cb20 tx=0x7f4d900021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.585+0000 7f4d7f7fe640 1 -- 172.21.15.90:0/166190234 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000ac00 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.585+0000 7f4d7f7fe640 1 -- 172.21.15.90:0/166190234 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d9000adc0 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.585+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d981e28d0 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.585+0000 7f4d7f7fe640 1 -- 172.21.15.90:0/166190234 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90012640 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.585+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d98156550 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.586+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d98076150 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.586+0000 7f4d7f7fe640 1 -- 172.21.15.90:0/166190234 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d900127e0 con 0x7f4d98153ef0 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.586+0000 7f4d7f7fe640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d8406c8f0 0x7f4d8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.587+0000 7f4d7f7fe640 1 -- 172.21.15.90:0/166190234 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4d9008c270 con 0x7f4d98153ef0 2024-04-20T10:51:07.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.587+0000 7f4d96ffd640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d8406c8f0 0x7f4d8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.589 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.587+0000 7f4d96ffd640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d8406c8f0 0x7f4d8406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d88035000 tx=0x7f4d88008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.591+0000 7f4d7f7fe640 1 -- 172.21.15.90:0/166190234 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4d9815a720 con 0x7f4d98153ef0 2024-04-20T10:51:07.770 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.770+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4d980c2e70 con 0x7f4d98153ef0 2024-04-20T10:51:07.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.772+0000 7f4d7f7fe640 1 -- 172.21.15.90:0/166190234 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f4d90059db0 con 0x7f4d98153ef0 2024-04-20T10:51:07.772 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:07.772 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:07.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d8406c8f0 msgr2=0x7f4d8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d8406c8f0 0x7f4d8406edb0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4d88035000 tx=0x7f4d88008030 comp rx=0 tx=0).stop 2024-04-20T10:51:07.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d98153ef0 msgr2=0x7f4d980ad0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d98153ef0 0x7f4d980ad0e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000cb20 tx=0x7f4d900021c0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 shutdown_connections 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d8406c8f0 0x7f4d8406edb0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d98153ef0 0x7f4d980ad0e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d980c9ee0 0x7f4d981ecda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 --2- 172.21.15.90:0/166190234 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d980ab730 0x7f4d981e0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 >> 172.21.15.90:0/166190234 conn(0x7f4d980cbfe0 msgr2=0x7f4d980ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 shutdown_connections 2024-04-20T10:51:07.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.774+0000 7f4d9d559640 1 -- 172.21.15.90:0/166190234 wait complete. 2024-04-20T10:51:07.785 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:07.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.880+0000 7f8d63fb2640 1 Processor -- start 2024-04-20T10:51:07.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.881+0000 7f8d63fb2640 1 -- start start 2024-04-20T10:51:07.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.881+0000 7f8d63fb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c0c7bf0 0x7f8d5c0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.881+0000 7f8d63fb2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d5c06ef90 0x7f8d5c157170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.881+0000 7f8d63fb2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d5c0c2880 con 0x7f8d5c0c1ce0 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.881+0000 7f8d63fb2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8d5c0c4480 con 0x7f8d5c06ef90 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.881+0000 7f8d63fb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c1576b0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d61d4e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c0c7bf0 0x7f8d5c0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d6154d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d5c06ef90 0x7f8d5c157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d6154d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8d5c06ef90 0x7f8d5c157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:60772/0 (socket says 172.21.15.90:60772) 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d61d4e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c0c7bf0 0x7f8d5c0c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:42742/0 (socket says 172.21.15.90:42742) 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d6154d640 1 -- 172.21.15.90:0/1100588721 learned_addr learned my addr 172.21.15.90:0/1100588721 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d60d4c640 1 -- 172.21.15.90:0/1100588721 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110166945 0 0) 0x7f8d5c0c2880 con 0x7f8d5c0c1ce0 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d60d4c640 1 -- 172.21.15.90:0/1100588721 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d44003520 con 0x7f8d5c0c1ce0 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d6154d640 1 -- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c0c7bf0 msgr2=0x7f8d5c0c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d6154d640 1 --2- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c0c7bf0 0x7f8d5c0c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d6154d640 1 -- 172.21.15.90:0/1100588721 >> v1:172.21.15.175:6789/0 conn(0x7f8d5c0c1ce0 legacy=0x7f8d5c0c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d6154d640 1 -- 172.21.15.90:0/1100588721 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c0c33e0 con 0x7f8d5c06ef90 2024-04-20T10:51:07.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.882+0000 7f8d61d4e640 1 --2- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c0c7bf0 0x7f8d5c0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.883+0000 7f8d6154d640 1 --2- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c06ef90 0x7f8d5c157170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d500098a0 tx=0x7f8d5002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48c042bee9bc596f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.883+0000 7f8d60d4c640 1 -- 172.21.15.90:0/1100588721 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d500317c0 con 0x7f8d5c06ef90 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.883+0000 7f8d60d4c640 1 -- 172.21.15.90:0/1100588721 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d50037070 con 0x7f8d5c06ef90 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.883+0000 7f8d60d4c640 1 -- 172.21.15.90:0/1100588721 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d50031b60 con 0x7f8d5c06ef90 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.883+0000 7f8d63fb2640 1 -- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c06ef90 msgr2=0x7f8d5c157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.883+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c06ef90 0x7f8d5c157170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8d500098a0 tx=0x7f8d5002b860 comp rx=0 tx=0).stop 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.884+0000 7f8d63fb2640 1 -- 172.21.15.90:0/1100588721 shutdown_connections 2024-04-20T10:51:07.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.884+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c06ef90 0x7f8d5c157170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.884+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/1100588721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c0c7bf0 0x7f8d5c0c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.884+0000 7f8d63fb2640 1 -- 172.21.15.90:0/1100588721 >> 172.21.15.90:0/1100588721 conn(0x7f8d5c0aa660 msgr2=0x7f8d5c0aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:07.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.884+0000 7f8d63fb2640 1 -- 172.21.15.90:0/1100588721 shutdown_connections 2024-04-20T10:51:07.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.884+0000 7f8d63fb2640 1 -- 172.21.15.90:0/1100588721 wait complete. 2024-04-20T10:51:07.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 Processor -- start 2024-04-20T10:51:07.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 -- start start 2024-04-20T10:51:07.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c06ef90 0x7f8d5c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0c1ce0 0x7f8d5c152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5c0c7bf0 0x7f8d5c152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c0c39a0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8d5c0c3ff0 con 0x7f8d5c0c1ce0 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d63fb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8d5c0c3c80 con 0x7f8d5c06ef90 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.885+0000 7f8d6254f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5c0c7bf0 0x7f8d5c152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5c0c7bf0 0x7f8d5c152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44946/0 (socket says 172.21.15.90:44946) 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 -- 172.21.15.90:0/2914989844 learned_addr learned my addr 172.21.15.90:0/2914989844 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6154d640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0c1ce0 0x7f8d5c152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d61d4e640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c06ef90 0x7f8d5c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 -- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c06ef90 msgr2=0x7f8d5c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c06ef90 0x7f8d5c0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 -- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0c1ce0 msgr2=0x7f8d5c152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0c1ce0 0x7f8d5c152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:07.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 -- 172.21.15.90:0/2914989844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d5c151cb0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d6254f640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5c0c7bf0 0x7f8d5c152fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c790 tx=0x7f8d4c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d5a7fc640 1 -- 172.21.15.90:0/2914989844 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c003b70 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d5a7fc640 1 -- 172.21.15.90:0/2914989844 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d4c003d10 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d5c151f90 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d5a7fc640 1 -- 172.21.15.90:0/2914989844 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d4c00aa50 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.886+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d5c1519b0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.887+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d5c15a6a0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.888+0000 7f8d5a7fc640 1 -- 172.21.15.90:0/2914989844 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8d4c00abf0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.888+0000 7f8d5a7fc640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8d4806c8f0 0x7f8d4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.888+0000 7f8d5a7fc640 1 -- 172.21.15.90:0/2914989844 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f8d4c08bcd0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.888+0000 7f8d61d4e640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8d4806c8f0 0x7f8d4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:07.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.888+0000 7f8d61d4e640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8d4806c8f0 0x7f8d4806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009560 tx=0x7f8d54009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:07.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:07.892+0000 7f8d5a7fc640 1 -- 172.21.15.90:0/2914989844 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8d5c15a6a0 con 0x7f8d5c0c7bf0 2024-04-20T10:51:08.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.104+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d5c076150 con 0x7f8d5c0c7bf0 2024-04-20T10:51:08.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.104+0000 7f8d5a7fc640 1 -- 172.21.15.90:0/2914989844 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f8d4c059780 con 0x7f8d5c0c7bf0 2024-04-20T10:51:08.104 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:08.105 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:08.105 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8d4806c8f0 msgr2=0x7f8d4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8d4806c8f0 0x7f8d4806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d54009560 tx=0x7f8d54009190 comp rx=0 tx=0).stop 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5c0c7bf0 msgr2=0x7f8d5c152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5c0c7bf0 0x7f8d5c152fb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00c790 tx=0x7f8d4c00cc50 comp rx=0 tx=0).stop 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 shutdown_connections 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8d4806c8f0 0x7f8d4806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8d5c0c7bf0 0x7f8d5c152fb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8d5c0c1ce0 0x7f8d5c152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.106+0000 7f8d63fb2640 1 --2- 172.21.15.90:0/2914989844 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8d5c06ef90 0x7f8d5c0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.107+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 >> 172.21.15.90:0/2914989844 conn(0x7f8d5c0aa660 msgr2=0x7f8d5c14f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:08.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.107+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 shutdown_connections 2024-04-20T10:51:08.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.107+0000 7f8d63fb2640 1 -- 172.21.15.90:0/2914989844 wait complete. 2024-04-20T10:51:08.524 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-20T10:50:48.982985+0000', 'modified': '2024-04-20T10:50:52.992905+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'snap_rstat': True, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'c', 'rank': 0, 'incarnation': 8, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.90:6837/3822230008', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.90:6836', 'nonce': 3822230008}, {'type': 'v1', 'addr': '172.21.15.90:6837', 'nonce': 3822230008}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'b', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-04-20T10:51:08.526 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-20T10:51:08.527 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-20T10:51:08.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.625+0000 7f9cdb715640 1 Processor -- start 2024-04-20T10:51:08.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.625+0000 7f9cdb715640 1 -- start start 2024-04-20T10:51:08.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cdb715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 0x7f9cd40ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cdb715640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd4067a10 con 0x7f9cd40ae720 2024-04-20T10:51:08.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cdb715640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cd4067cf0 con 0x7f9cd40adee0 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cdb715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd40c86d0 con 0x7f9cd4151b40 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cd8cb0640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9cd40ae720 0x7f9cd40c3910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59888/0 (socket says 172.21.15.90:59888) 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/20933034 learned_addr learned my addr 172.21.15.90:0/20933034 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533915083 0 0) 0x7f9cd4067a10 con 0x7f9cd40ae720 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 0x7f9cd40ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9cc0003520 con 0x7f9cd40ae720 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3277190543 0 0) 0x7f9cc0003520 con 0x7f9cd40ae720 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 msgr2=0x7f9cd40ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 0x7f9cd40ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 >> v1:172.21.15.175:6789/0 conn(0x7f9cd40adee0 legacy=0x7f9cd4157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd4158430 con 0x7f9cd40ae720 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f9cc4001670 con 0x7f9cd40ae720 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 >> v1:172.21.15.90:6789/0 conn(0x7f9cd40ae720 legacy=0x7f9cd40c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc00039e0 0x7f9cc0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0004800 0x7f9cc0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 0x7f9cc0005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40c86d0 con 0x7f9cc0004800 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9cc000bb80 con 0x7f9cc00039e0 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9cc000bd80 con 0x7f9cd4151b40 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.626+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0004800 0x7f9cc0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 0x7f9cc0005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc00039e0 0x7f9cc0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 msgr2=0x7f9cc0005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 0x7f9cc0005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc00039e0 msgr2=0x7f9cc0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc00039e0 0x7f9cc0003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/20933034 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc0003520 con 0x7f9cc0004800 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cd4151b40 0x7f9cc0005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cc00039e0 0x7f9cc0003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.627+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0004800 0x7f9cc0004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c210 tx=0x7f9cc0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba007161fe6643f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4007cf0 con 0x7f9cc0004800 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc4030070 con 0x7f9cc0004800 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9ccbfff640 1 -- 172.21.15.90:0/20933034 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4005d30 con 0x7f9cc0004800 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9cdb715640 1 -- 172.21.15.90:0/20933034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0004800 msgr2=0x7f9cc0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9cdb715640 1 --2- 172.21.15.90:0/20933034 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cc0004800 0x7f9cc0004c80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c210 tx=0x7f9cc0005830 comp rx=0 tx=0).stop 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/20933034 reap_dead start 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9cdb715640 1 -- 172.21.15.90:0/20933034 shutdown_connections 2024-04-20T10:51:08.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9cdb715640 1 -- 172.21.15.90:0/20933034 >> 172.21.15.90:0/20933034 conn(0x7f9cd40aa660 msgr2=0x7f9cd40aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:08.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9cdb715640 1 -- 172.21.15.90:0/20933034 shutdown_connections 2024-04-20T10:51:08.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.628+0000 7f9cdb715640 1 -- 172.21.15.90:0/20933034 wait complete. 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.629+0000 7f9cdb715640 1 Processor -- start 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.629+0000 7f9cdb715640 1 -- start start 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cdb715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc0004800 0x7f9cd4156900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cdb715640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd4073d90 0x7f9cd41ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cdb715640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd41ee9a0 0x7f9cd41eacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cdb715640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd4158090 con 0x7f9cd4073d90 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cdb715640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd40ae390 con 0x7f9cd41ee9a0 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cdb715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd4158210 con 0x7f9cc0004800 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd4073d90 0x7f9cd41ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd4073d90 0x7f9cd41ea7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44968/0 (socket says 172.21.15.90:44968) 2024-04-20T10:51:08.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/165829548 learned_addr learned my addr 172.21.15.90:0/165829548 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:08.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd41ee9a0 0x7f9cd41eacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc0004800 0x7f9cd4156900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc0004800 msgr2=0x7f9cd4156900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc0004800 0x7f9cd4156900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd41ee9a0 msgr2=0x7f9cd41eacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd41ee9a0 0x7f9cd41eacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/165829548 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd41df890 con 0x7f9cd4073d90 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd41ee9a0 0x7f9cd41eacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.630+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd4073d90 0x7f9cd41ea7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c210 tx=0x7f9cd40c4020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.631+0000 7f9cc9ffb640 1 -- 172.21.15.90:0/165829548 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4001c30 con 0x7f9cd4073d90 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.631+0000 7f9cc9ffb640 1 -- 172.21.15.90:0/165829548 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cc402cca0 con 0x7f9cd4073d90 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.631+0000 7f9cc9ffb640 1 -- 172.21.15.90:0/165829548 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4007290 con 0x7f9cd4073d90 2024-04-20T10:51:08.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.631+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cd41edec0 con 0x7f9cd4073d90 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.631+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd414d280 con 0x7f9cd4073d90 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.632+0000 7f9cc9ffb640 1 -- 172.21.15.90:0/165829548 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cc4007430 con 0x7f9cd4073d90 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.633+0000 7f9cc9ffb640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9cb806c8f0 0x7f9cb806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.633+0000 7f9cc9ffb640 1 -- 172.21.15.90:0/165829548 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9cc40ad520 con 0x7f9cd4073d90 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.633+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9cb806c8f0 0x7f9cb806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.633+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9cb806c8f0 0x7f9cb806edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00099b0 tx=0x7f9cd0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 Processor -- start 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 -- start start 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecd83540 0x5634ecd83920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbf690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdbdc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5634ecc96290 con 0x5634ecdbfbd0 2024-04-20T10:51:08.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634eccf3a40 con 0x5634ecd83540 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5634eccaea30 con 0x5634ecd84850 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cd9cb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdbdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cd9cb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdbdc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44982/0 (socket says 172.21.15.90:44982) 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/3362002516 learned_addr learned my addr 172.21.15.90:0/3362002516 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecd83540 0x5634ecd83920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.634+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/3362002516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 msgr2=0x5634ecdbf690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbf690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/3362002516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecd83540 msgr2=0x5634ecd83920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecd83540 0x5634ecd83920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/3362002516 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ecca1c10 con 0x5634ecdbfbd0 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdbdc40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4075920 tx=0x7f9ccc0020d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed633ed767dc366e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cb6ffd640 1 -- 172.21.15.90:0/3362002516 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc003b80 con 0x5634ecdbfbd0 2024-04-20T10:51:08.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cb6ffd640 1 -- 172.21.15.90:0/3362002516 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc018070 con 0x5634ecdbfbd0 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cb6ffd640 1 -- 172.21.15.90:0/3362002516 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc0050d0 con 0x5634ecdbfbd0 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cde3e5740 1 -- 172.21.15.90:0/3362002516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 msgr2=0x5634ecdbdc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdbdc40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4075920 tx=0x7f9ccc0020d0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cde3e5740 1 -- 172.21.15.90:0/3362002516 shutdown_connections 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdbdc40 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbf690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/3362002516 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecd83540 0x5634ecd83920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.635+0000 7f9cde3e5740 1 -- 172.21.15.90:0/3362002516 >> 172.21.15.90:0/3362002516 conn(0x5634ecd7fe90 msgr2=0x5634ecda48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.636+0000 7f9cde3e5740 1 -- 172.21.15.90:0/3362002516 shutdown_connections 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.636+0000 7f9cde3e5740 1 -- 172.21.15.90:0/3362002516 wait complete. 2024-04-20T10:51:08.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.636+0000 7f9cde3e5740 1 -- start start 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.636+0000 7f9cde3e5740 1 Processor -- start 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecd9fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecdbc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5634ecced140 con 0x5634ecdbfbd0 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634ecce7e20 con 0x5634ecda5990 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5634eccf5d20 con 0x5634ecd84850 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cde3e5740 10 client.0 _ll_register_callbacks cb 0x5634eccde5c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdba430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44992/0 (socket says 172.21.15.90:44992) 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/2920458263 learned_addr learned my addr 172.21.15.90:0/2920458263 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:08.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecdbc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecd9fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 msgr2=0x5634ecd9fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecd9fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 msgr2=0x5634ecdbc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecdbc1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/2920458263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ec9fb2d0 con 0x5634ecdbfbd0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecd9fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdba430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40ab750 tx=0x7f9cc4034f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42486cd638d37f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.637+0000 7f9caffff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9caffff640 1 -- 172.21.15.90:0/2920458263 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cc40a7070 con 0x5634ecdbfbd0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9caffff640 1 -- 172.21.15.90:0/2920458263 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9cc40792b0 con 0x5634ecdbfbd0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ccc018070 con 0x5634ecdbfbd0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9caffff640 1 -- 172.21.15.90:0/2920458263 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f9cc4098050 con 0x5634ecdbfbd0 2024-04-20T10:51:08.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 10 client.4887 fetch_fsmap learned FSMap version 12 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x5634ecac56b0 con 0x5634ecdbfbd0 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9caffff640 1 -- 172.21.15.90:0/2920458263 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc018070 con 0x5634ecdbfbd0 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9caffff640 1 -- 172.21.15.90:0/2920458263 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 12) ==== 4130+0+0 (secure 0 0 0) 0x7f9cc40aa020 con 0x5634ecdbfbd0 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 10 client.4887 fetch_fsmap finished waiting for FSMap version 12 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 10 client.4887 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 20 client.4887 populate_metadata read hostname 'smithi090' 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecdd37a0 0x5634ecdd3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 4 client.4887 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 --> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5634ecc6f510 con 0x5634ecdd37a0 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecdd37a0 0x5634ecdd3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecdd37a0 0x5634ecdd3b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9301417fa2e38fb0 server_cookie=28151f85e53d5b26 in_seq=0 out_seq=0 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.638+0000 7f9caffff640 10 client.4887 ms_handle_connect on v2:172.21.15.90:6836/3822230008 2024-04-20T10:51:08.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9caffff640 1 -- 172.21.15.90:0/2920458263 <== mds.0 v2:172.21.15.90:6836/3822230008 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5634ecc6f510 con 0x5634ecdd37a0 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9caffff640 10 client.4887 handle_command_reply: tid=0 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 client.4887 shutdown 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 msgr2=0x5634ecdba430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdba430 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40ab750 tx=0x7f9cc4034f70 comp rx=0 tx=0).stop 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 shutdown_connections 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecdbc1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecdd37a0 0x5634ecdd3b80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecdba430 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2920458263 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecd9fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9caffff640 0 client.4887 ms_handle_reset on v2:172.21.15.90:6836/3822230008 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 >> 172.21.15.90:0/2920458263 conn(0x5634ecd83540 msgr2=0x5634ecdbe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.639+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 shutdown_connections 2024-04-20T10:51:08.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.640+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2920458263 wait complete. 2024-04-20T10:51:08.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.640+0000 7f9cde3e5740 20 client.4887 trim_cache size 0 max 16384 2024-04-20T10:51:08.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 Processor -- start 2024-04-20T10:51:08.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 -- start start 2024-04-20T10:51:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecd9f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecd9fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd41fa590 con 0x5634ecdbfbd0 2024-04-20T10:51:08.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9cd41de5b0 con 0x5634ecda5990 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd41f8610 con 0x5634ecd84850 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cd9cb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecd9fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cd9cb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecd9fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44998/0 (socket says 172.21.15.90:44998) 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.658+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/1511824677 learned_addr learned my addr 172.21.15.90:0/1511824677 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecd9f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 msgr2=0x5634ecdbefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 msgr2=0x5634ecd9f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecd9f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd9cb2640 1 -- 172.21.15.90:0/1511824677 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5634ecac56b0 con 0x5634ecdbfbd0 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecd9fe50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc002110 tx=0x7f9ccc00a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f487154bcf0ba51 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:08.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cb67fc640 1 -- 172.21.15.90:0/1511824677 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00f960 con 0x5634ecdbfbd0 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cb67fc640 1 -- 172.21.15.90:0/1511824677 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc018070 con 0x5634ecdbfbd0 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cb67fc640 1 -- 172.21.15.90:0/1511824677 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00fd60 con 0x5634ecdbfbd0 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cde3e5740 1 -- 172.21.15.90:0/1511824677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 msgr2=0x5634ecd9fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.659+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecd9fe50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc002110 tx=0x7f9ccc00a000 comp rx=0 tx=0).stop 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 -- 172.21.15.90:0/1511824677 shutdown_connections 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecdbfbd0 0x5634ecd9fe50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecda5990 0x5634ecd9f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/1511824677 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecd84850 0x5634ecdbefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 -- 172.21.15.90:0/1511824677 >> 172.21.15.90:0/1511824677 conn(0x5634ecd83540 msgr2=0x5634ecdcd350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 -- 172.21.15.90:0/1511824677 shutdown_connections 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 -- 172.21.15.90:0/1511824677 wait complete. 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 -- start start 2024-04-20T10:51:08.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.660+0000 7f9cde3e5740 1 Processor -- start 2024-04-20T10:51:08.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecd84850 0x5634ecdc2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecda5990 0x5634ece3cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cde3e5740 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecdbfbd0 0x5634ece368f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x5634ecdd08d0 con 0x5634ecd84850 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x5634ecca5980 con 0x5634ecdbfbd0 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cde3e5740 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x5634ecdd32a0 con 0x5634ecda5990 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cde3e5740 10 client.0 _ll_register_callbacks cb 0x7f9cc407ab80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecd84850 0x5634ecdc2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecd84850 0x5634ecdc2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45008/0 (socket says 172.21.15.90:45008) 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 -- 172.21.15.90:0/2886471116 learned_addr learned my addr 172.21.15.90:0/2886471116 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecdbfbd0 0x5634ece368f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecda5990 0x5634ece3cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 -- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecda5990 msgr2=0x5634ece3cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecda5990 0x5634ece3cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 -- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecdbfbd0 msgr2=0x5634ece368f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecdbfbd0 0x5634ece368f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 -- 172.21.15.90:0/2886471116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634ecdc0ce0 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd9cb2640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecdbfbd0 0x5634ece368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9cd94b1640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecd84850 0x5634ecdc2ef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0012be0 tx=0x7f9cd0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6877eb27902af1b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.661+0000 7f9caffff640 10 client.0 ms_handle_connect on v2:172.21.15.90:3300/0 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9caffff640 1 -- 172.21.15.90:0/2886471116 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0015b70 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9caffff640 1 -- 172.21.15.90:0/2886471116 <== mon.0 v2:172.21.15.90:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f9cd0015d10 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ccc018070 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9caffff640 1 -- 172.21.15.90:0/2886471116 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) ==== 24+0+0 (secure 0 0 0) 0x7f9cd0038050 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 10 client.4893 fetch_fsmap learned FSMap version 12 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) -- 0x5634ecdbca90 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9caffff640 1 -- 172.21.15.90:0/2886471116 <== mon.0 v2:172.21.15.90:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc018070 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9caffff640 1 -- 172.21.15.90:0/2886471116 <== mon.0 v2:172.21.15.90:3300/0 5 ==== fsmap(e 12) ==== 4130+0+0 (secure 0 0 0) 0x7f9cd003b020 con 0x5634ecd84850 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 10 client.4893 fetch_fsmap finished waiting for FSMap version 12 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 10 client.4893 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-20T10:51:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 20 client.4893 populate_metadata read hostname 'smithi090' 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 0x5634ecd81070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 4 client.4893 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 --> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] -- command(tid 0: {"prefix": "status"}) -- 0x5634eccf6530 con 0x5634ecd80c90 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 0x5634ecd81070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 msgr2=0x5634ecd81070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cd8cb0640 1 -- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 msgr2=0x5634ecd81070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 0x5634ecd81070 crc :-1 s=COMPRESSION_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-20T10:51:08.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.662+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 0x5634ecd81070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-20T10:51:08.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 0x5634ecd81070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:08.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cd8cb0640 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 0x5634ecd81070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81de3a32c206fada server_cookie=72e0c9643c0a62a2 in_seq=0 out_seq=0 2024-04-20T10:51:08.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9caffff640 10 client.4893 ms_handle_connect on v2:172.21.15.90:6836/3822230008 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9caffff640 1 -- 172.21.15.90:0/2886471116 <== mds.0 v2:172.21.15.90:6836/3822230008 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x5634eccf6530 con 0x5634ecd80c90 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9caffff640 10 client.4893 handle_command_reply: tid=0 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 client.4893 shutdown 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecd84850 msgr2=0x5634ecdc2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecd84850 0x5634ecdc2ef0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0012be0 tx=0x7f9cd0004730 comp rx=0 tx=0).stop 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 shutdown_connections 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x5634ecdbfbd0 0x5634ece368f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x5634ecda5990 0x5634ece3cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:6836/3822230008,v1:172.21.15.90:6837/3822230008] conn(0x5634ecd80c90 0x5634ecd81070 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 --2- 172.21.15.90:0/2886471116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x5634ecd84850 0x5634ecdc2ef0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9caffff640 0 client.4893 ms_handle_reset on v2:172.21.15.90:6836/3822230008 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.863+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 >> 172.21.15.90:0/2886471116 conn(0x5634ecd83540 msgr2=0x5634ecdbedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 shutdown_connections 2024-04-20T10:51:08.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cde3e5740 1 -- 172.21.15.90:0/2886471116 wait complete. 2024-04-20T10:51:08.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cde3e5740 20 client.4893 trim_cache size 0 max 16384 2024-04-20T10:51:08.866 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:51:08.866 INFO:teuthology.orchestra.run.smithi090.stdout: "cluster_fsid": "83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c", 2024-04-20T10:51:08.866 INFO:teuthology.orchestra.run.smithi090.stdout: "whoami": 0, 2024-04-20T10:51:08.866 INFO:teuthology.orchestra.run.smithi090.stdout: "id": 4287, 2024-04-20T10:51:08.866 INFO:teuthology.orchestra.run.smithi090.stdout: "want_state": "up:active", 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout: "state": "up:active", 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout: "fs_name": "b", 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout: "rank_uptime": 19.238413601000001, 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout: "mdsmap_epoch": 12, 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch": 25, 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout: "osdmap_epoch_barrier": 25, 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout: "uptime": 35.659985794999997 2024-04-20T10:51:08.867 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9cb806c8f0 msgr2=0x7f9cb806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9cb806c8f0 0x7f9cb806edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9cd00099b0 tx=0x7f9cd0008040 comp rx=0 tx=0).stop 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd4073d90 msgr2=0x7f9cd41ea7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd4073d90 0x7f9cd41ea7b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9cc400c210 tx=0x7f9cd40c4020 comp rx=0 tx=0).stop 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 shutdown_connections 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9cb806c8f0 0x7f9cb806edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9cd41ee9a0 0x7f9cd41eacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9cd4073d90 0x7f9cd41ea7b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 --2- 172.21.15.90:0/165829548 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9cc0004800 0x7f9cd4156900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:08.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 >> 172.21.15.90:0/165829548 conn(0x7f9cd40aa660 msgr2=0x7f9cd40a8920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:08.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 shutdown_connections 2024-04-20T10:51:08.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:08.864+0000 7f9cdb715640 1 -- 172.21.15.90:0/165829548 wait complete. 2024-04-20T10:51:08.875 INFO:teuthology.run_tasks:Running task sequential... 2024-04-20T10:51:08.886 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-20T10:51:08.886 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-20T10:51:08.886 INFO:teuthology.task.print:Enabling mgr modules 2024-04-20T10:51:08.886 INFO:teuthology.run_tasks:Running task kclient... 2024-04-20T10:51:08.910 INFO:tasks.kclient:Mounting kernel clients... 2024-04-20T10:51:08.910 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-04-20T10:51:08.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:08.911 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-04-20T10:51:08.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:08.927 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-04-20T10:51:08.992 INFO:teuthology.orchestra.run.smithi090.stderr:Cannot find device "ceph-brx" 2024-04-20T10:51:08.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T10:51:08.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:08.994 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-20T10:51:09.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:09.012 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-20T10:51:09.083 INFO:teuthology.orchestra.run.smithi175.stderr:Cannot find device "ceph-brx" 2024-04-20T10:51:09.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T10:51:09.085 INFO:tasks.kclient:client.0 config is {'syntax': 'v2', 'cephfs_name': 'a'} 2024-04-20T10:51:09.086 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T10:51:09.086 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:09.086 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T10:51:09.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.182+0000 7efead86d640 1 Processor -- start 2024-04-20T10:51:09.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.182+0000 7efead86d640 1 -- start start 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efead86d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efea8153df0 0x7efea806cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efead86d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efea815a810 0x7efea80c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efead86d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efea80c6e60 con 0x7efea80c6a00 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efead86d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7efea80ca690 con 0x7efea815a810 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efead86d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7efea806c7b0 con 0x7efea8153df0 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea77fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efea815a810 0x7efea80c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea67fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7efea80c6a00 0x7efea80c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59890/0 (socket says 172.21.15.90:59890) 2024-04-20T10:51:09.185 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea77fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efea815a810 0x7efea80c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45012/0 (socket says 172.21.15.90:45012) 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea67fc640 1 -- 172.21.15.90:0/3627828271 learned_addr learned my addr 172.21.15.90:0/3627828271 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea6ffd640 1 --2- 172.21.15.90:0/3627828271 >> v2:172.21.15.175:3300/0 conn(0x7efea8153df0 0x7efea806cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea77fe640 1 -- 172.21.15.90:0/3627828271 >> v2:172.21.15.175:3300/0 conn(0x7efea8153df0 msgr2=0x7efea806cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea77fe640 1 --2- 172.21.15.90:0/3627828271 >> v2:172.21.15.175:3300/0 conn(0x7efea8153df0 0x7efea806cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea77fe640 1 -- 172.21.15.90:0/3627828271 >> v1:172.21.15.90:6789/0 conn(0x7efea80c6a00 legacy=0x7efea80c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea77fe640 1 -- 172.21.15.90:0/3627828271 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea80c7100 con 0x7efea815a810 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea5ffb640 1 -- 172.21.15.90:0/3627828271 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887976868 0 0) 0x7efea80c6e60 con 0x7efea80c6a00 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.183+0000 7efea6ffd640 1 --2- 172.21.15.90:0/3627828271 >> v2:172.21.15.175:3300/0 conn(0x7efea8153df0 0x7efea806cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.184+0000 7efea77fe640 1 --2- 172.21.15.90:0/3627828271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea80c8a90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efea806c930 tx=0x7efea002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350cb99958a7ec96 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.184+0000 7efea5ffb640 1 -- 172.21.15.90:0/3627828271 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0039070 con 0x7efea815a810 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.184+0000 7efea5ffb640 1 -- 172.21.15.90:0/3627828271 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea002cb40 con 0x7efea815a810 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.184+0000 7efea5ffb640 1 -- 172.21.15.90:0/3627828271 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0034440 con 0x7efea815a810 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 -- 172.21.15.90:0/3627828271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 msgr2=0x7efea80c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:09.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 --2- 172.21.15.90:0/3627828271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea80c8a90 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efea806c930 tx=0x7efea002bd90 comp rx=0 tx=0).stop 2024-04-20T10:51:09.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 -- 172.21.15.90:0/3627828271 shutdown_connections 2024-04-20T10:51:09.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 --2- 172.21.15.90:0/3627828271 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea80c8a90 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 --2- 172.21.15.90:0/3627828271 >> v2:172.21.15.175:3300/0 conn(0x7efea8153df0 0x7efea806cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 -- 172.21.15.90:0/3627828271 >> 172.21.15.90:0/3627828271 conn(0x7efea80adbd0 msgr2=0x7efea80adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:09.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 -- 172.21.15.90:0/3627828271 shutdown_connections 2024-04-20T10:51:09.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.185+0000 7efead86d640 1 -- 172.21.15.90:0/3627828271 wait complete. 2024-04-20T10:51:09.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.186+0000 7efead86d640 1 Processor -- start 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.186+0000 7efead86d640 1 -- start start 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efea80c6a00 0x7efea8150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efea8153df0 0x7efea8154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea81ed040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efea81541d0 con 0x7efea815a810 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efea806c440 con 0x7efea8153df0 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efea815ac60 con 0x7efea80c6a00 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea81ed040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea81ed040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45020/0 (socket says 172.21.15.90:45020) 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 -- 172.21.15.90:0/522108004 learned_addr learned my addr 172.21.15.90:0/522108004 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea67fc640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efea8153df0 0x7efea8154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea6ffd640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efea80c6a00 0x7efea8150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:09.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 -- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efea80c6a00 msgr2=0x7efea8150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efea80c6a00 0x7efea8150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 -- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efea8153df0 msgr2=0x7efea8154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efea8153df0 0x7efea8154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 -- 172.21.15.90:0/522108004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efea814fd90 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efea77fe640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea81ed040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efea0009e50 tx=0x7efea0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efe8ffff640 1 -- 172.21.15.90:0/522108004 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0044020 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efe8ffff640 1 -- 172.21.15.90:0/522108004 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea003a040 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efea80c3310 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efe8ffff640 1 -- 172.21.15.90:0/522108004 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea0039050 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.187+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efea8150030 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.188+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efea8076150 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.189+0000 7efe8ffff640 1 -- 172.21.15.90:0/522108004 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efea0003b90 con 0x7efea815a810 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.189+0000 7efe8ffff640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe9406c8f0 0x7efe9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:09.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.189+0000 7efe8ffff640 1 -- 172.21.15.90:0/522108004 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7efea00ae5c0 con 0x7efea815a810 2024-04-20T10:51:09.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.189+0000 7efea6ffd640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe9406c8f0 0x7efe9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:09.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.190+0000 7efea6ffd640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe9406c8f0 0x7efe9406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe98006fd0 tx=0x7efe98008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:09.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.193+0000 7efe8ffff640 1 -- 172.21.15.90:0/522108004 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7efea004e020 con 0x7efea815a810 2024-04-20T10:51:09.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.403+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efea806d950 con 0x7efea815a810 2024-04-20T10:51:09.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.403+0000 7efe8ffff640 1 -- 172.21.15.90:0/522108004 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+116 (secure 0 0 0) 0x7efea007c6d0 con 0x7efea815a810 2024-04-20T10:51:09.403 INFO:teuthology.orchestra.run.smithi090.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-20T10:51:09.404 INFO:teuthology.orchestra.run.smithi090.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-20T10:51:09.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe9406c8f0 msgr2=0x7efe9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:09.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe9406c8f0 0x7efe9406edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efe98006fd0 tx=0x7efe98008040 comp rx=0 tx=0).stop 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 msgr2=0x7efea81ed040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea81ed040 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efea0009e50 tx=0x7efea0004a40 comp rx=0 tx=0).stop 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 shutdown_connections 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efe9406c8f0 0x7efe9406edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efea815a810 0x7efea81ed040 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efea8153df0 0x7efea8154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 --2- 172.21.15.90:0/522108004 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efea80c6a00 0x7efea8150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 >> 172.21.15.90:0/522108004 conn(0x7efea80adbd0 msgr2=0x7efea814c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 shutdown_connections 2024-04-20T10:51:09.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09.405+0000 7efead86d640 1 -- 172.21.15.90:0/522108004 wait complete. 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:Mounting Ceph FS a; just confirmed its presence on cluster 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi090.front.sepia.ceph.com 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:self.cephfs_name = a 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T10:51:09.416 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-20T10:51:09.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:09.417 DEBUG:teuthology.orchestra.run.smithi090:> ip addr 2024-04-20T10:51:09.431 INFO:teuthology.orchestra.run.smithi090.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T10:51:09.431 INFO:teuthology.orchestra.run.smithi090.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 ::1/128 scope host 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a8 brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f0 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:d8:a1:a9 brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:09.432 INFO:teuthology.orchestra.run.smithi090.stdout: altname enp7s0f1 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:66 brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout: link/ether 0c:c4:7a:8f:d7:67 brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout: inet 172.21.15.90/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft 42853sec preferred_lft 42853sec 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout: inet6 fe80::b913:523d:cf0e:c8e5/64 scope link noprefixroute 2024-04-20T10:51:09.433 INFO:teuthology.orchestra.run.smithi090.stdout: valid_lft forever preferred_lft forever 2024-04-20T10:51:09.433 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T10:51:09.434 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:09.434 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-04-20T10:51:09.434 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add name ceph-brx type bridge 2024-04-20T10:51:09.434 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr flush dev ceph-brx 2024-04-20T10:51:09.434 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set ceph-brx up 2024-04-20T10:51:09.434 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T10:51:09.434 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-04-20T10:51:09.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:09.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:09.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:09.636 DEBUG:teuthology.orchestra.run.smithi090:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T10:51:09.660 INFO:teuthology.orchestra.run.smithi090.stdout:1 2024-04-20T10:51:09.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:09.662 DEBUG:teuthology.orchestra.run.smithi090:> route 2024-04-20T10:51:09.737 INFO:teuthology.orchestra.run.smithi090.stdout:Kernel IP routing table 2024-04-20T10:51:09.737 INFO:teuthology.orchestra.run.smithi090.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T10:51:09.737 INFO:teuthology.orchestra.run.smithi090.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T10:51:09.737 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T10:51:09.738 INFO:teuthology.orchestra.run.smithi090.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T10:51:09.738 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:09.738 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-04-20T10:51:09.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T10:51:09.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T10:51:09.738 DEBUG:teuthology.orchestra.run.smithi090:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T10:51:09.738 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-04-20T10:51:09.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:09.967 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:51:09.969 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:51:10.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:10.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:10.015 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-04-20T10:51:10.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:10.070 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list-id 2024-04-20T10:51:10.125 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:10.125 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-04-20T10:51:10.125 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T10:51:10.125 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-20T10:51:10.125 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-04-20T10:51:10.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:10.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:10.242 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-20T10:51:10.243 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-04-20T10:51:10.291 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:10.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:10.380 DEBUG:teuthology.orchestra.run.smithi090:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:10.380 DEBUG:teuthology.orchestra.run.smithi090:> set -e 2024-04-20T10:51:10.380 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set brx.0 up 2024-04-20T10:51:10.380 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T10:51:10.380 DEBUG:teuthology.orchestra.run.smithi090:> ') 2024-04-20T10:51:10.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:10.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:10.455 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T10:51:10.455 DEBUG:teuthology.orchestra.run.smithi090:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:10.469 INFO:teuthology.orchestra.run.smithi090.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-20T10:51:10.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T10:51:10.470 DEBUG:teuthology.orchestra.run.smithi090:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:10.525 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.a=/ 2024-04-20T10:51:10.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:10.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.a=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-20T10:51:10.617 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-20T10:51:10.617 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-20T10:51:10.729 INFO:teuthology.orchestra.run.smithi090.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-20T10:51:10.729 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-20T10:51:10.729 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.175:3300,172.21.15.175:3301" 2024-04-20T10:51:10.729 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: trying mount with new device syntax: 0@83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c.a=/ 2024-04-20T10:51:10.729 INFO:teuthology.orchestra.run.smithi090.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.90:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2024-04-20T10:51:10.730 INFO:teuthology.orchestra.run.smithi090.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-20T10:51:10.730 INFO:teuthology.orchestra.run.smithi090.stdout: You just mounted a file system that supports labels which does not 2024-04-20T10:51:10.730 INFO:teuthology.orchestra.run.smithi090.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-20T10:51:10.730 INFO:teuthology.orchestra.run.smithi090.stdout: applications will generate AVC messages and not be allowed access to 2024-04-20T10:51:10.730 INFO:teuthology.orchestra.run.smithi090.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-20T10:51:10.732 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-20T10:51:10.732 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:10.732 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:10.756 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T10:51:10.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T10:51:10.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:10.857 INFO:teuthology.orchestra.run.smithi090.stdout:client4756 2024-04-20T10:51:10.857 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:51:10.857 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T10:51:10.872 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T10:51:10.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:10 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T10:51:11.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:11.508 INFO:teuthology.orchestra.run.smithi090.stdout:client4756 2024-04-20T10:51:11.509 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T10:51:11.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T10:51:11.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:11.574 INFO:teuthology.orchestra.run.smithi090.stdout:client4756 2024-04-20T10:51:11.575 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c.client4756/status') 2024-04-20T10:51:11.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:11.636 INFO:teuthology.orchestra.run.smithi090.stdout:instance: client.4756 (3)172.21.15.90:0/2321401235 2024-04-20T10:51:11.637 INFO:teuthology.orchestra.run.smithi090.stdout:blocklisted: false 2024-04-20T10:51:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records in 2024-04-20T10:51:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:0+1 records out 2024-04-20T10:51:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:70 bytes copied, 2.3207e-05 s, 3.0 MB/s 2024-04-20T10:51:11.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:11.644 INFO:tasks.kclient:client.1 config is {'syntax': 'v2', 'cephfs_name': 'b'} 2024-04-20T10:51:11.644 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-20T10:51:11.644 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:11.645 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-20T10:51:11.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.742+0000 7f77f51db640 1 Processor -- start 2024-04-20T10:51:11.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.742+0000 7f77f51db640 1 -- start start 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77f51db640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77f0151b10 0x7f77f00ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77f51db640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c51d0 0x7f77f0157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77f51db640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f01587c0 con 0x7f77f00adc10 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77f51db640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f77f00c4d40 con 0x7f77f0151b10 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77f51db640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f77f0151ef0 con 0x7f77f00c51d0 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77eed9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f77f0151b10 0x7f77f00ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77ee59c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c51d0 0x7f77f0157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.743+0000 7f77ef59e640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f77f00adc10 0x7f77f0157fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:46532/0 (socket says 172.21.15.90:46532) 2024-04-20T10:51:11.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.744+0000 7f77ef59e640 1 -- 172.21.15.90:0/1745457918 learned_addr learned my addr 172.21.15.90:0/1745457918 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.744+0000 7f77eed9d640 1 -- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c51d0 msgr2=0x7f77f0157a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.744+0000 7f77eed9d640 1 --2- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c51d0 0x7f77f0157a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.744+0000 7f77eed9d640 1 -- 172.21.15.90:0/1745457918 >> v1:172.21.15.175:6789/0 conn(0x7f77f00adc10 legacy=0x7f77f0157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.744+0000 7f77eed9d640 1 -- 172.21.15.90:0/1745457918 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f00c46f0 con 0x7f77f0151b10 2024-04-20T10:51:11.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.744+0000 7f77ee59c640 1 --2- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c51d0 0x7f77f0157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:11.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77eed9d640 1 --2- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f0151b10 0x7f77f00ad6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009d90 tx=0x7f77e002bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8fd73268b33bdc1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:11.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77edd9b640 1 -- 172.21.15.90:0/1745457918 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0039070 con 0x7f77f0151b10 2024-04-20T10:51:11.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77edd9b640 1 -- 172.21.15.90:0/1745457918 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e002cb30 con 0x7f77f0151b10 2024-04-20T10:51:11.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77edd9b640 1 -- 172.21.15.90:0/1745457918 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0034440 con 0x7f77f0151b10 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 -- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f0151b10 msgr2=0x7f77f00ad6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 --2- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f0151b10 0x7f77f00ad6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009d90 tx=0x7f77e002bd80 comp rx=0 tx=0).stop 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 -- 172.21.15.90:0/1745457918 shutdown_connections 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 --2- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c51d0 0x7f77f0157a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 --2- 172.21.15.90:0/1745457918 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f0151b10 0x7f77f00ad6d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 -- 172.21.15.90:0/1745457918 >> 172.21.15.90:0/1745457918 conn(0x7f77f00c9100 msgr2=0x7f77f00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 -- 172.21.15.90:0/1745457918 shutdown_connections 2024-04-20T10:51:11.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.745+0000 7f77f51db640 1 -- 172.21.15.90:0/1745457918 wait complete. 2024-04-20T10:51:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.747+0000 7f77f51db640 1 Processor -- start 2024-04-20T10:51:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.747+0000 7f77f51db640 1 -- start start 2024-04-20T10:51:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00adc10 0x7f77f014c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00c51d0 0x7f77f0147790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f0151b10 0x7f77f01eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:11.749 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77f006bab0 con 0x7f77f00adc10 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77f006b930 con 0x7f77f00c51d0 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f77f006bc30 con 0x7f77f0151b10 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00adc10 0x7f77f014c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00adc10 0x7f77f014c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45032/0 (socket says 172.21.15.90:45032) 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 -- 172.21.15.90:0/4288634897 learned_addr learned my addr 172.21.15.90:0/4288634897 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77ee59c640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00c51d0 0x7f77f0147790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77ef59e640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f0151b10 0x7f77f01eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 -- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f0151b10 msgr2=0x7f77f01eaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f0151b10 0x7f77f01eaad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 -- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00c51d0 msgr2=0x7f77f0147790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00c51d0 0x7f77f0147790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 -- 172.21.15.90:0/4288634897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f0154d20 con 0x7f77f00adc10 2024-04-20T10:51:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77eed9d640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00adc10 0x7f77f014c390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f77e0037040 tx=0x7f77e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77d77fe640 1 -- 172.21.15.90:0/4288634897 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0039050 con 0x7f77f00adc10 2024-04-20T10:51:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77d77fe640 1 -- 172.21.15.90:0/4288634897 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e0045070 con 0x7f77f00adc10 2024-04-20T10:51:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f0155000 con 0x7f77f00adc10 2024-04-20T10:51:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77d77fe640 1 -- 172.21.15.90:0/4288634897 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0009450 con 0x7f77f00adc10 2024-04-20T10:51:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.748+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f014c8d0 con 0x7f77f00adc10 2024-04-20T10:51:11.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.749+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f0076150 con 0x7f77f00adc10 2024-04-20T10:51:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.750+0000 7f77d77fe640 1 -- 172.21.15.90:0/4288634897 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77e003e850 con 0x7f77f00adc10 2024-04-20T10:51:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.750+0000 7f77d77fe640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77dc06c8f0 0x7f77dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.750+0000 7f77d77fe640 1 -- 172.21.15.90:0/4288634897 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f77e00aeab0 con 0x7f77f00adc10 2024-04-20T10:51:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.750+0000 7f77ee59c640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77dc06c8f0 0x7f77dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:11.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.751+0000 7f77ee59c640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77dc06c8f0 0x7f77dc06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009560 tx=0x7f77e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:11.754 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.755+0000 7f77d77fe640 1 -- 172.21.15.90:0/4288634897 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f77e007c710 con 0x7f77f00adc10 2024-04-20T10:51:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.967+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f77f00ac970 con 0x7f77f00adc10 2024-04-20T10:51:11.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.967+0000 7f77d77fe640 1 -- 172.21.15.90:0/4288634897 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) ==== 53+0+116 (secure 0 0 0) 0x7f77e0080a10 con 0x7f77f00adc10 2024-04-20T10:51:11.967 INFO:teuthology.orchestra.run.smithi090.stdout:name: a, metadata pool: a_metadata, data pools: [a_data ] 2024-04-20T10:51:11.968 INFO:teuthology.orchestra.run.smithi090.stdout:name: b, metadata pool: b_metadata, data pools: [b_data ] 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77dc06c8f0 msgr2=0x7f77dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77dc06c8f0 0x7f77dc06edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f77e4009560 tx=0x7f77e4009190 comp rx=0 tx=0).stop 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00adc10 msgr2=0x7f77f014c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00adc10 0x7f77f014c390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f77e0037040 tx=0x7f77e0004a40 comp rx=0 tx=0).stop 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 shutdown_connections 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77dc06c8f0 0x7f77dc06edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f0151b10 0x7f77f01eaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00c51d0 0x7f77f0147790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 --2- 172.21.15.90:0/4288634897 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00adc10 0x7f77f014c390 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 >> 172.21.15.90:0/4288634897 conn(0x7f77f00c9100 msgr2=0x7f77f00acb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:11.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 shutdown_connections 2024-04-20T10:51:11.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:11.969+0000 7f77f51db640 1 -- 172.21.15.90:0/4288634897 wait complete. 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:Mounting Ceph FS b; just confirmed its presence on cluster 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi175.front.sepia.ceph.com 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:self.cephfs_name = b 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-20T10:51:11.980 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-20T10:51:11.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:11.981 DEBUG:teuthology.orchestra.run.smithi175:> ip addr 2024-04-20T10:51:11.999 INFO:teuthology.orchestra.run.smithi175.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: inet 127.0.0.1/8 scope host lo 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 ::1/128 scope host 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ee brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f0 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T10:51:12.000 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:d9:39:ef brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout: altname enp7s0f1 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f0 brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout: link/ether 0c:c4:7a:88:71:f1 brd ff:ff:ff:ff:ff:ff 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout: inet 172.21.15.175/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft 42795sec preferred_lft 42795sec 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout: inet6 fe80::e31:98a1:ff5:3113/64 scope link noprefixroute 2024-04-20T10:51:12.001 INFO:teuthology.orchestra.run.smithi175.stdout: valid_lft forever preferred_lft forever 2024-04-20T10:51:12.001 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-20T10:51:12.002 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:12.002 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-20T10:51:12.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add name ceph-brx type bridge 2024-04-20T10:51:12.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr flush dev ceph-brx 2024-04-20T10:51:12.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set ceph-brx up 2024-04-20T10:51:12.002 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-20T10:51:12.002 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-20T10:51:12.093 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:12.199 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:12.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:12.206 DEBUG:teuthology.orchestra.run.smithi175:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-20T10:51:12.231 INFO:teuthology.orchestra.run.smithi175.stdout:1 2024-04-20T10:51:12.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:12.233 DEBUG:teuthology.orchestra.run.smithi175:> route 2024-04-20T10:51:12.299 INFO:teuthology.orchestra.run.smithi175.stdout:Kernel IP routing table 2024-04-20T10:51:12.299 INFO:teuthology.orchestra.run.smithi175.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-20T10:51:12.299 INFO:teuthology.orchestra.run.smithi175.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-20T10:51:12.299 INFO:teuthology.orchestra.run.smithi175.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-20T10:51:12.299 INFO:teuthology.orchestra.run.smithi175.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-20T10:51:12.300 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:12.300 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-20T10:51:12.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-20T10:51:12.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-20T10:51:12.300 DEBUG:teuthology.orchestra.run.smithi175:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-20T10:51:12.300 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-20T10:51:12.387 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:12.550 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:12.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:12.556 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-20T10:51:12.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:12.571 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list-id 2024-04-20T10:51:12.626 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:12.626 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-20T10:51:12.626 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T10:51:12.626 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-20T10:51:12.626 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-20T10:51:12.715 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:12.738 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:12.744 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-20T10:51:12.744 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:12.744 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-20T10:51:12.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-20T10:51:12.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-20T10:51:12.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-20T10:51:12.744 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-20T10:51:12.745 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-20T10:51:12.745 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-20T10:51:12.794 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:12.870 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:12.877 DEBUG:teuthology.orchestra.run.smithi175:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-20T10:51:12.877 DEBUG:teuthology.orchestra.run.smithi175:> set -e 2024-04-20T10:51:12.877 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set brx.0 up 2024-04-20T10:51:12.877 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link set dev brx.0 master ceph-brx 2024-04-20T10:51:12.877 DEBUG:teuthology.orchestra.run.smithi175:> ') 2024-04-20T10:51:12.925 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:12.946 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:12.952 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T10:51:12.952 DEBUG:teuthology.orchestra.run.smithi175:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:12.966 INFO:teuthology.orchestra.run.smithi175.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-20T10:51:12.966 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-20T10:51:12.966 DEBUG:teuthology.orchestra.run.smithi175:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:13.020 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.b=/ 2024-04-20T10:51:13.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:13.020 DEBUG:teuthology.orchestra.run.smithi175:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.b=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-20T10:51:13.106 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-20T10:51:13.106 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-20T10:51:13.207 INFO:teuthology.orchestra.run.smithi175.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-20T10:51:13.207 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-20T10:51:13.207 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: resolved to: "172.21.15.90:3300,172.21.15.175:3300,172.21.15.175:3301" 2024-04-20T10:51:13.207 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: trying mount with new device syntax: 1@83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c.b=/ 2024-04-20T10:51:13.208 INFO:teuthology.orchestra.run.smithi175.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.90:3300/172.21.15.175:3300/172.21.15.175:3301" will pass to kernel 2024-04-20T10:51:13.208 INFO:teuthology.orchestra.run.smithi175.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-04-20T10:51:13.208 INFO:teuthology.orchestra.run.smithi175.stdout: You just mounted a file system that supports labels which does not 2024-04-20T10:51:13.209 INFO:teuthology.orchestra.run.smithi175.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-20T10:51:13.209 INFO:teuthology.orchestra.run.smithi175.stdout: applications will generate AVC messages and not be allowed access to 2024-04-20T10:51:13.209 INFO:teuthology.orchestra.run.smithi175.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-20T10:51:13.210 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-20T10:51:13.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:51:13.211 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:13.235 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T10:51:13.326 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T10:51:13.332 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:13.338 INFO:teuthology.orchestra.run.smithi175.stdout:client4908 2024-04-20T10:51:13.338 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:51:13.338 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T10:51:13.353 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T10:51:13.444 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T10:51:13.450 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:13.455 INFO:teuthology.orchestra.run.smithi175.stdout:client4908 2024-04-20T10:51:13.456 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-20T10:51:13.506 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-20T10:51:13.513 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:13.518 INFO:teuthology.orchestra.run.smithi175.stdout:client4908 2024-04-20T10:51:13.518 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c.client4908/status') 2024-04-20T10:51:13.568 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-20T10:51:13.580 INFO:teuthology.orchestra.run.smithi175.stdout:instance: client.4908 (3)172.21.15.175:0/3891260556 2024-04-20T10:51:13.580 INFO:teuthology.orchestra.run.smithi175.stdout:blocklisted: false 2024-04-20T10:51:13.580 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records in 2024-04-20T10:51:13.581 INFO:teuthology.orchestra.run.smithi175.stderr:0+1 records out 2024-04-20T10:51:13.581 INFO:teuthology.orchestra.run.smithi175.stderr:71 bytes copied, 2.5479e-05 s, 2.8 MB/s 2024-04-20T10:51:13.581 INFO:teuthology.orchestra.run.smithi175.stderr:2024-04-20T10:51:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-20T10:51:13.587 INFO:teuthology.run_tasks:Running task mds_thrash... 2024-04-20T10:51:13.602 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:13.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.718+0000 7fa556a11640 1 Processor -- start 2024-04-20T10:51:13.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.718+0000 7fa556a11640 1 -- start start 2024-04-20T10:51:13.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa556a11640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55014e810 0x7fa550154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa556a11640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa550155170 0x7fa550154b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa556a11640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa55006feb0 con 0x7fa550073030 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa556a11640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa55014ebf0 con 0x7fa550155170 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa556a11640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa550070730 con 0x7fa55014e810 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa54f7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa550073030 0x7fa5500c6070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59904/0 (socket says 172.21.15.90:59904) 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa54f7fe640 1 -- 172.21.15.90:0/4102711985 learned_addr learned my addr 172.21.15.90:0/4102711985 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa554fae640 1 --2- 172.21.15.90:0/4102711985 >> v2:172.21.15.175:3300/0 conn(0x7fa550155170 0x7fa550154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa54ffff640 1 --2- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55014e810 0x7fa550154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa54effd640 1 -- 172.21.15.90:0/4102711985 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 242580145 0 0) 0x7fa55006feb0 con 0x7fa550073030 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa54effd640 1 -- 172.21.15.90:0/4102711985 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa538003520 con 0x7fa550073030 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa554fae640 1 -- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55014e810 msgr2=0x7fa550154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa554fae640 1 --2- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55014e810 0x7fa550154610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa554fae640 1 -- 172.21.15.90:0/4102711985 >> v1:172.21.15.90:6789/0 conn(0x7fa550073030 legacy=0x7fa5500c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:13.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa554fae640 1 -- 172.21.15.90:0/4102711985 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa550073530 con 0x7fa550155170 2024-04-20T10:51:13.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.719+0000 7fa54ffff640 1 --2- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55014e810 0x7fa550154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.720+0000 7fa554fae640 1 --2- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa550155170 0x7fa550154b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa548009d90 tx=0x7fa54802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71dc6c6cb53499e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.720+0000 7fa54effd640 1 -- 172.21.15.90:0/4102711985 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548039070 con 0x7fa550155170 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.720+0000 7fa54effd640 1 -- 172.21.15.90:0/4102711985 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa54802cc50 con 0x7fa550155170 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.720+0000 7fa54effd640 1 -- 172.21.15.90:0/4102711985 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548034440 con 0x7fa550155170 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 -- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa550155170 msgr2=0x7fa550154b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 --2- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa550155170 0x7fa550154b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa548009d90 tx=0x7fa54802bea0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 -- 172.21.15.90:0/4102711985 shutdown_connections 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 --2- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa550155170 0x7fa550154b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 --2- 172.21.15.90:0/4102711985 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa55014e810 0x7fa550154610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 -- 172.21.15.90:0/4102711985 >> 172.21.15.90:0/4102711985 conn(0x7fa5500676c0 msgr2=0x7fa550067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:13.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 -- 172.21.15.90:0/4102711985 shutdown_connections 2024-04-20T10:51:13.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.721+0000 7fa556a11640 1 -- 172.21.15.90:0/4102711985 wait complete. 2024-04-20T10:51:13.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.722+0000 7fa556a11640 1 Processor -- start 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.722+0000 7fa556a11640 1 -- start start 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa556a11640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550073030 0x7fa5501583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa556a11640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55014e810 0x7fa550156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa556a11640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa550155170 0x7fa550147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa556a11640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa55006f650 con 0x7fa550155170 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa556a11640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa550070450 con 0x7fa55014e810 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa556a11640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5500c6780 con 0x7fa550073030 2024-04-20T10:51:13.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa554fae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa550155170 0x7fa550147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:13.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa554fae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa550155170 0x7fa550147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45044/0 (socket says 172.21.15.90:45044) 2024-04-20T10:51:13.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa554fae640 1 -- 172.21.15.90:0/546549096 learned_addr learned my addr 172.21.15.90:0/546549096 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:13.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa54ffff640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550073030 0x7fa5501583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:13.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.723+0000 7fa54f7fe640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55014e810 0x7fa550156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:13.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa554fae640 1 -- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550073030 msgr2=0x7fa5501583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:13.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa554fae640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550073030 0x7fa5501583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa554fae640 1 -- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55014e810 msgr2=0x7fa550156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:13.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa554fae640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55014e810 0x7fa550156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa554fae640 1 -- 172.21.15.90:0/546549096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa550155b80 con 0x7fa550155170 2024-04-20T10:51:13.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa554fae640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa550155170 0x7fa550147b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa548009eb0 tx=0x7fa548004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:13.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa54cff9640 1 -- 172.21.15.90:0/546549096 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548039050 con 0x7fa550155170 2024-04-20T10:51:13.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa54cff9640 1 -- 172.21.15.90:0/546549096 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa548045070 con 0x7fa550155170 2024-04-20T10:51:13.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa54cff9640 1 -- 172.21.15.90:0/546549096 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548009450 con 0x7fa550155170 2024-04-20T10:51:13.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa550155e60 con 0x7fa550155170 2024-04-20T10:51:13.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.724+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa550156d80 con 0x7fa550155170 2024-04-20T10:51:13.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.725+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5500aea10 con 0x7fa550155170 2024-04-20T10:51:13.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.726+0000 7fa54cff9640 1 -- 172.21.15.90:0/546549096 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa54803e610 con 0x7fa550155170 2024-04-20T10:51:13.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.726+0000 7fa54cff9640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:13.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.727+0000 7fa54ffff640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:13.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.727+0000 7fa54cff9640 1 -- 172.21.15.90:0/546549096 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fa5480ac9b0 con 0x7fa550155170 2024-04-20T10:51:13.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.727+0000 7fa54ffff640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5501e85b0 tx=0x7fa540009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:13.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.732+0000 7fa54cff9640 1 -- 172.21.15.90:0/546549096 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa54807c2a0 con 0x7fa550155170 2024-04-20T10:51:13.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.907+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa550076150 con 0x7fa550155170 2024-04-20T10:51:13.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.909+0000 7fa54cff9640 1 -- 172.21.15.90:0/546549096 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7fa5480805a0 con 0x7fa550155170 2024-04-20T10:51:13.909 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:13.909 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:13.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 msgr2=0x7fa53c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:13.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa5501e85b0 tx=0x7fa540009190 comp rx=0 tx=0).stop 2024-04-20T10:51:13.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa550155170 msgr2=0x7fa550147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:13.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa550155170 0x7fa550147b60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa548009eb0 tx=0x7fa548004a40 comp rx=0 tx=0).stop 2024-04-20T10:51:13.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 shutdown_connections 2024-04-20T10:51:13.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa550155170 0x7fa550147b60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa55014e810 0x7fa550156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 --2- 172.21.15.90:0/546549096 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa550073030 0x7fa5501583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:13.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 >> 172.21.15.90:0/546549096 conn(0x7fa5500676c0 msgr2=0x7fa550154250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:13.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 shutdown_connections 2024-04-20T10:51:13.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:13.911+0000 7fa556a11640 1 -- 172.21.15.90:0/546549096 wait complete. 2024-04-20T10:51:13.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:51:13.923 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:51:14.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.021+0000 7f6d40d98640 1 Processor -- start 2024-04-20T10:51:14.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.021+0000 7f6d40d98640 1 -- start start 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d40d98640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d3c151b10 0x7f6d3c154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d40d98640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6d3c157a70 0x7f6d3c0725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d40d98640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d3c073ba0 con 0x7f6d3c072b30 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d40d98640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3c151ef0 con 0x7f6d3c151b10 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d40d98640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6d3c1589a0 con 0x7f6d3c157a70 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d3a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d3c151b10 0x7f6d3c154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d3a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d3c151b10 0x7f6d3c154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45048/0 (socket says 172.21.15.90:45048) 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.022+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3268461219 learned_addr learned my addr 172.21.15.90:0/3268461219 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.023+0000 7f6d39d9b640 1 --2- 172.21.15.90:0/3268461219 >> v2:172.21.15.175:3300/0 conn(0x7f6d3c157a70 0x7f6d3c0725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.023+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3268461219 >> v2:172.21.15.175:3300/0 conn(0x7f6d3c157a70 msgr2=0x7f6d3c0725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:14.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.023+0000 7f6d3a59c640 1 --2- 172.21.15.90:0/3268461219 >> v2:172.21.15.175:3300/0 conn(0x7f6d3c157a70 0x7f6d3c0725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.023+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3268461219 >> v1:172.21.15.175:6789/0 conn(0x7f6d3c072b30 legacy=0x7f6d3c0aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.023+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3268461219 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c158100 con 0x7f6d3c151b10 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.023+0000 7f6d3a59c640 1 --2- 172.21.15.90:0/3268461219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c151b10 0x7f6d3c154480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0c6b00 tx=0x7f6d2c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4558b9ee72f7f21 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.023+0000 7f6d3959a640 1 -- 172.21.15.90:0/3268461219 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c02cb20 con 0x7f6d3c151b10 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d3959a640 1 -- 172.21.15.90:0/3268461219 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c02ccc0 con 0x7f6d3c151b10 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d3959a640 1 -- 172.21.15.90:0/3268461219 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c034610 con 0x7f6d3c151b10 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 -- 172.21.15.90:0/3268461219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c151b10 msgr2=0x7f6d3c154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3268461219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c151b10 0x7f6d3c154480 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c0c6b00 tx=0x7f6d2c02bf80 comp rx=0 tx=0).stop 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 -- 172.21.15.90:0/3268461219 shutdown_connections 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3268461219 >> v2:172.21.15.175:3300/0 conn(0x7f6d3c157a70 0x7f6d3c0725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3268461219 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c151b10 0x7f6d3c154480 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 -- 172.21.15.90:0/3268461219 >> 172.21.15.90:0/3268461219 conn(0x7f6d3c0ca0a0 msgr2=0x7f6d3c0ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:14.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 -- 172.21.15.90:0/3268461219 shutdown_connections 2024-04-20T10:51:14.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.024+0000 7f6d40d98640 1 -- 172.21.15.90:0/3268461219 wait complete. 2024-04-20T10:51:14.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.025+0000 7f6d40d98640 1 Processor -- start 2024-04-20T10:51:14.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.025+0000 7f6d40d98640 1 -- start start 2024-04-20T10:51:14.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d40d98640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c072b30 0x7f6d3c0c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d40d98640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d3c151b10 0x7f6d3c0aeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d40d98640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d3c157a70 0x7f6d3c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d40d98640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c0ab540 con 0x7f6d3c072b30 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d40d98640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d3c1586c0 con 0x7f6d3c151b10 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d40d98640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d3c0ac170 con 0x7f6d3c157a70 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c072b30 0x7f6d3c0c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c072b30 0x7f6d3c0c3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45056/0 (socket says 172.21.15.90:45056) 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3048618224 learned_addr learned my addr 172.21.15.90:0/3048618224 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d39d9b640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d3c151b10 0x7f6d3c0aeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3ad9d640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d3c157a70 0x7f6d3c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d3c157a70 msgr2=0x7f6d3c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d3c157a70 0x7f6d3c0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d3c151b10 msgr2=0x7f6d3c0aeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d3c151b10 0x7f6d3c0aeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3a59c640 1 -- 172.21.15.90:0/3048618224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d3c1439a0 con 0x7f6d3c072b30 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d39d9b640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d3c151b10 0x7f6d3c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:14.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.026+0000 7f6d3ad9d640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d3c157a70 0x7f6d3c0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.027+0000 7f6d3a59c640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c072b30 0x7f6d3c0c3740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c036040 tx=0x7f6d2c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.027+0000 7f6d2affd640 1 -- 172.21.15.90:0/3048618224 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c043020 con 0x7f6d3c072b30 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.027+0000 7f6d2affd640 1 -- 172.21.15.90:0/3048618224 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d2c03e450 con 0x7f6d3c072b30 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.027+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d3c1558f0 con 0x7f6d3c072b30 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.027+0000 7f6d2affd640 1 -- 172.21.15.90:0/3048618224 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c009510 con 0x7f6d3c072b30 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.027+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d3c0c3c80 con 0x7f6d3c072b30 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.028+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d3c076150 con 0x7f6d3c072b30 2024-04-20T10:51:14.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.028+0000 7f6d2affd640 1 -- 172.21.15.90:0/3048618224 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d2c046020 con 0x7f6d3c072b30 2024-04-20T10:51:14.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.029+0000 7f6d2affd640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d1c06c8f0 0x7f6d1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.029+0000 7f6d2affd640 1 -- 172.21.15.90:0/3048618224 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f6d2c0ae670 con 0x7f6d3c072b30 2024-04-20T10:51:14.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.029+0000 7f6d39d9b640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d1c06c8f0 0x7f6d1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.029+0000 7f6d39d9b640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d1c06c8f0 0x7f6d1c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006fd0 tx=0x7f6d30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.033+0000 7f6d2affd640 1 -- 172.21.15.90:0/3048618224 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6d2c04d030 con 0x7f6d3c072b30 2024-04-20T10:51:14.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.209+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6d3c14c510 con 0x7f6d3c072b30 2024-04-20T10:51:14.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.209+0000 7f6d2affd640 1 -- 172.21.15.90:0/3048618224 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f6d2c07c800 con 0x7f6d3c072b30 2024-04-20T10:51:14.210 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d1c06c8f0 msgr2=0x7f6d1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d1c06c8f0 0x7f6d1c06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6d30006fd0 tx=0x7f6d30008040 comp rx=0 tx=0).stop 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c072b30 msgr2=0x7f6d3c0c3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c072b30 0x7f6d3c0c3740 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c036040 tx=0x7f6d2c004a40 comp rx=0 tx=0).stop 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 shutdown_connections 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d1c06c8f0 0x7f6d1c06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d3c157a70 0x7f6d3c0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d3c151b10 0x7f6d3c0aeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 --2- 172.21.15.90:0/3048618224 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d3c072b30 0x7f6d3c0c3740 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.211+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 >> 172.21.15.90:0/3048618224 conn(0x7f6d3c0ca0a0 msgr2=0x7f6d3c14f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.212+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 shutdown_connections 2024-04-20T10:51:14.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.212+0000 7f6d40d98640 1 -- 172.21.15.90:0/3048618224 wait complete. 2024-04-20T10:51:14.223 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:51:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dcd84e640 1 Processor -- start 2024-04-20T10:51:14.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dcd84e640 1 -- start start 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dcd84e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1dc8153ef0 0x7f1dc80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dcd84e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc815a720 con 0x7f1dc80c9ee0 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dcd84e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dc815ac80 con 0x7f1dc80ab730 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dcd84e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1dc815a9a0 con 0x7f1dc8153ef0 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dc77fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1dc80c9ee0 0x7f1dc8156fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59916/0 (socket says 172.21.15.90:59916) 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.325+0000 7f1dc77fe640 1 -- 172.21.15.90:0/3610728709 learned_addr learned my addr 172.21.15.90:0/3610728709 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc6ffd640 1 --2- 172.21.15.90:0/3610728709 >> v2:172.21.15.175:3300/0 conn(0x7f1dc8153ef0 0x7f1dc80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc5ffb640 1 -- 172.21.15.90:0/3610728709 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2416354895 0 0) 0x7f1dc0001490 con 0x7f1dc80c9ee0 2024-04-20T10:51:14.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc5ffb640 1 -- 172.21.15.90:0/3610728709 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1db0003520 con 0x7f1dc80c9ee0 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc5ffb640 1 -- 172.21.15.90:0/3610728709 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178306740 0 0) 0x7f1dc815ac80 con 0x7f1dc80ab730 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc5ffb640 1 -- 172.21.15.90:0/3610728709 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dc0001490 con 0x7f1dc80ab730 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc6ffd640 1 -- 172.21.15.90:0/3610728709 >> v1:172.21.15.175:6789/0 conn(0x7f1dc80ab730 legacy=0x7f1dc81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc6ffd640 1 -- 172.21.15.90:0/3610728709 >> v1:172.21.15.90:6789/0 conn(0x7f1dc80c9ee0 legacy=0x7f1dc8156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.326+0000 7f1dc6ffd640 1 -- 172.21.15.90:0/3610728709 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc80c6a90 con 0x7f1dc8153ef0 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dc6ffd640 1 --2- 172.21.15.90:0/3610728709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 0x7f1dc80c89f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097a0 tx=0x7f1db802b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b43087aaeb7c22c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dc5ffb640 1 -- 172.21.15.90:0/3610728709 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db80315a0 con 0x7f1dc8153ef0 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dc5ffb640 1 -- 172.21.15.90:0/3610728709 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db8037070 con 0x7f1dc8153ef0 2024-04-20T10:51:14.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dc5ffb640 1 -- 172.21.15.90:0/3610728709 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8031960 con 0x7f1dc8153ef0 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dcd84e640 1 -- 172.21.15.90:0/3610728709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 msgr2=0x7f1dc80c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/3610728709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 0x7f1dc80c89f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097a0 tx=0x7f1db802b840 comp rx=0 tx=0).stop 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dcd84e640 1 -- 172.21.15.90:0/3610728709 shutdown_connections 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/3610728709 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 0x7f1dc80c89f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.327+0000 7f1dcd84e640 1 -- 172.21.15.90:0/3610728709 >> 172.21.15.90:0/3610728709 conn(0x7f1dc80cbfe0 msgr2=0x7f1dc80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.328+0000 7f1dcd84e640 1 -- 172.21.15.90:0/3610728709 shutdown_connections 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.328+0000 7f1dcd84e640 1 -- 172.21.15.90:0/3610728709 wait complete. 2024-04-20T10:51:14.331 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 Processor -- start 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 -- start start 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc80ab730 0x7f1dc80c54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dc80c9ee0 0x7f1dc80aa810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 0x7f1dc80c1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc80bf800 con 0x7f1dc80ab730 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1dc80c8f30 con 0x7f1dc8153ef0 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dcd84e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1dc80c0400 con 0x7f1dc80c9ee0 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.329+0000 7f1dc6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc80ab730 0x7f1dc80c54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc80ab730 0x7f1dc80c54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45070/0 (socket says 172.21.15.90:45070) 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 -- 172.21.15.90:0/2172374557 learned_addr learned my addr 172.21.15.90:0/2172374557 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc67fc640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dc80c9ee0 0x7f1dc80aa810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc77fe640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 0x7f1dc80c1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 -- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dc80c9ee0 msgr2=0x7f1dc80aa810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dc80c9ee0 0x7f1dc80aa810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 -- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 msgr2=0x7f1dc80c1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 0x7f1dc80c1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 -- 172.21.15.90:0/2172374557 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dc80bfc40 con 0x7f1dc80ab730 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dc6ffd640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc80ab730 0x7f1dc80c54d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1db8034040 tx=0x7f1db80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1daffff640 1 -- 172.21.15.90:0/2172374557 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8032630 con 0x7f1dc80ab730 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1daffff640 1 -- 172.21.15.90:0/2172374557 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db8032810 con 0x7f1dc80ab730 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1daffff640 1 -- 172.21.15.90:0/2172374557 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8032c00 con 0x7f1dc80ab730 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dc80c5d00 con 0x7f1dc80ab730 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.330+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dc80c0090 con 0x7f1dc80ab730 2024-04-20T10:51:14.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.331+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dc8076150 con 0x7f1dc80ab730 2024-04-20T10:51:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.332+0000 7f1daffff640 1 -- 172.21.15.90:0/2172374557 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1db804d3f0 con 0x7f1dc80ab730 2024-04-20T10:51:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.332+0000 7f1daffff640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1db406c8f0 0x7f1db406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.332+0000 7f1daffff640 1 -- 172.21.15.90:0/2172374557 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f1db802f030 con 0x7f1dc80ab730 2024-04-20T10:51:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.332+0000 7f1dc67fc640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1db406c8f0 0x7f1db406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.333+0000 7f1dc67fc640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1db406c8f0 0x7f1db406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc007fd0 tx=0x7f1dbc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.336+0000 7f1daffff640 1 -- 172.21.15.90:0/2172374557 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1db8040070 con 0x7f1dc80ab730 2024-04-20T10:51:14.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.511+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f1dc81535b0 con 0x7f1dc80ab730 2024-04-20T10:51:14.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.512+0000 7f1daffff640 1 -- 172.21.15.90:0/2172374557 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f1db807b2b0 con 0x7f1dc80ab730 2024-04-20T10:51:14.512 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.513+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1db406c8f0 msgr2=0x7f1db406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.513+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1db406c8f0 0x7f1db406edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc007fd0 tx=0x7f1dbc009040 comp rx=0 tx=0).stop 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.513+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc80ab730 msgr2=0x7f1dc80c54d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.513+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc80ab730 0x7f1dc80c54d0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1db8034040 tx=0x7f1db80046c0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.513+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 shutdown_connections 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.513+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1db406c8f0 0x7f1db406edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.513+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1dc8153ef0 0x7f1dc80c1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.514+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1dc80c9ee0 0x7f1dc80aa810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.514+0000 7f1dcd84e640 1 --2- 172.21.15.90:0/2172374557 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1dc80ab730 0x7f1dc80c54d0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.514+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 >> 172.21.15.90:0/2172374557 conn(0x7f1dc80cbfe0 msgr2=0x7f1dc8151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:14.514 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.514+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 shutdown_connections 2024-04-20T10:51:14.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.514+0000 7f1dcd84e640 1 -- 172.21.15.90:0/2172374557 wait complete. 2024-04-20T10:51:14.525 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:51:14.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.624+0000 7ff42d715640 1 Processor -- start 2024-04-20T10:51:14.625 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.624+0000 7ff42d715640 1 -- start start 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff42d715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 0x7ff4280abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff42d715640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4280c4370 con 0x7ff428073810 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff42d715640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff428156c30 con 0x7ff428157710 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff42d715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff4281569e0 con 0x7ff428154000 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff426ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff428073810 0x7ff4280c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59922/0 (socket says 172.21.15.90:59922) 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff426ffd640 1 -- 172.21.15.90:0/1139006274 learned_addr learned my addr 172.21.15.90:0/1139006274 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff4277fe640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 0x7ff4280abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159595729 0 0) 0x7ff4280c4370 con 0x7ff428073810 2024-04-20T10:51:14.628 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff410003520 con 0x7ff428073810 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2489368 0 0) 0x7ff410003520 con 0x7ff428073810 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 msgr2=0x7ff4280abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 0x7ff4280abbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 >> v1:172.21.15.175:6789/0 conn(0x7ff428157710 legacy=0x7ff4280ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff428156f10 con 0x7ff428073810 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.625+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7ff4180019f0 con 0x7ff428073810 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 >> v1:172.21.15.90:6789/0 conn(0x7ff428073810 legacy=0x7ff4280c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff425ffb640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 0x7ff4100039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff425ffb640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff410004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff425ffb640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d40 0x7ff4100051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4281569e0 con 0x7ff410003f40 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff41000bad0 con 0x7ff410004d40 2024-04-20T10:51:14.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff41000bcd0 con 0x7ff428154000 2024-04-20T10:51:14.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff4267fc640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff410004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff426ffd640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 0x7ff4100039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff4277fe640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d40 0x7ff4100051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff4267fc640 1 -- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 msgr2=0x7ff4100039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff4267fc640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff428154000 0x7ff4100039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff4267fc640 1 -- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d40 msgr2=0x7ff4100051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff4267fc640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff410004d40 0x7ff4100051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.626+0000 7ff4267fc640 1 -- 172.21.15.90:0/1139006274 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff410003520 con 0x7ff410003f40 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff4267fc640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff410004800 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff428070110 tx=0x7ff410005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83a8453f2a1593cd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c001430 con 0x7ff410003f40 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41c032620 con 0x7ff410003f40 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff425ffb640 1 -- 172.21.15.90:0/1139006274 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff41c032a10 con 0x7ff410003f40 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff42d715640 1 -- 172.21.15.90:0/1139006274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 msgr2=0x7ff410004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff42d715640 1 --2- 172.21.15.90:0/1139006274 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff410004800 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff428070110 tx=0x7ff410005830 comp rx=0 tx=0).stop 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff4277fe640 1 -- 172.21.15.90:0/1139006274 reap_dead start 2024-04-20T10:51:14.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff42d715640 1 -- 172.21.15.90:0/1139006274 shutdown_connections 2024-04-20T10:51:14.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff42d715640 1 -- 172.21.15.90:0/1139006274 >> 172.21.15.90:0/1139006274 conn(0x7ff4280c8080 msgr2=0x7ff4280c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:14.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff42d715640 1 -- 172.21.15.90:0/1139006274 shutdown_connections 2024-04-20T10:51:14.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.627+0000 7ff42d715640 1 -- 172.21.15.90:0/1139006274 wait complete. 2024-04-20T10:51:14.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 Processor -- start 2024-04-20T10:51:14.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 -- start start 2024-04-20T10:51:14.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff428072770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4281e8e90 0x7ff4281e8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4280c7140 0x7ff428071ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff4280ad7d0 con 0x7ff410003f40 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff428157280 con 0x7ff4280c7140 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff42d715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff4280ad950 con 0x7ff4281e8e90 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff426ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff428072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff426ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff428072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45078/0 (socket says 172.21.15.90:45078) 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.629+0000 7ff426ffd640 1 -- 172.21.15.90:0/2344796765 learned_addr learned my addr 172.21.15.90:0/2344796765 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff4267fc640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4281e8e90 0x7ff4281e8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff4277fe640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4280c7140 0x7ff428071ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff426ffd640 1 -- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4281e8e90 msgr2=0x7ff4281e8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff426ffd640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4281e8e90 0x7ff4281e8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff426ffd640 1 -- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4280c7140 msgr2=0x7ff428071ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff426ffd640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4280c7140 0x7ff428071ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff426ffd640 1 -- 172.21.15.90:0/2344796765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff428072e30 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff4277fe640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4280c7140 0x7ff428071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff4267fc640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4281e8e90 0x7ff4281e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff426ffd640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff428072770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff418007770 tx=0x7ff41800a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff40f7fe640 1 -- 172.21.15.90:0/2344796765 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418017020 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff40f7fe640 1 -- 172.21.15.90:0/2344796765 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff41800ada0 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff428073110 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff40f7fe640 1 -- 172.21.15.90:0/2344796765 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff418013610 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.630+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4280715a0 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.631+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4280717a0 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.631+0000 7ff40f7fe640 1 -- 172.21.15.90:0/2344796765 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff41801a020 con 0x7ff410003f40 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.632+0000 7ff40f7fe640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff41406c8f0 0x7ff41406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.632+0000 7ff4267fc640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff41406c8f0 0x7ff41406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.632+0000 7ff40f7fe640 1 -- 172.21.15.90:0/2344796765 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff41808c8a0 con 0x7ff410003f40 2024-04-20T10:51:14.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.632+0000 7ff4267fc640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff41406c8f0 0x7ff41406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff41c035000 tx=0x7ff41c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.636+0000 7ff40f7fe640 1 -- 172.21.15.90:0/2344796765 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff4280717a0 con 0x7ff410003f40 2024-04-20T10:51:14.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.813+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7ff428076150 con 0x7ff410003f40 2024-04-20T10:51:14.813 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.813+0000 7ff40f7fe640 1 -- 172.21.15.90:0/2344796765 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7ff418021020 con 0x7ff410003f40 2024-04-20T10:51:14.813 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff41406c8f0 msgr2=0x7ff41406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff41406c8f0 0x7ff41406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff41c035000 tx=0x7ff41c030000 comp rx=0 tx=0).stop 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 msgr2=0x7ff428072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff428072770 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff418007770 tx=0x7ff41800a360 comp rx=0 tx=0).stop 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 shutdown_connections 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff41406c8f0 0x7ff41406edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff4280c7140 0x7ff428071ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff4281e8e90 0x7ff4281e8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 --2- 172.21.15.90:0/2344796765 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff410003f40 0x7ff428072770 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 >> 172.21.15.90:0/2344796765 conn(0x7ff4280c8080 msgr2=0x7ff4280c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 shutdown_connections 2024-04-20T10:51:14.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.815+0000 7ff42d715640 1 -- 172.21.15.90:0/2344796765 wait complete. 2024-04-20T10:51:14.826 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:51:14.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.926+0000 7f90efdd5640 1 Processor -- start 2024-04-20T10:51:14.926 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.926+0000 7f90efdd5640 1 -- start start 2024-04-20T10:51:14.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90efdd5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f90e80c6e70 0x7f90e8156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90efdd5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e80c9410 con 0x7f90e80c8c90 2024-04-20T10:51:14.929 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90efdd5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90e80c96b0 con 0x7f90e806d120 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90efdd5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f90e806c580 con 0x7f90e80c6e70 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ed370640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f90e80c8c90 0x7f90e806ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59932/0 (socket says 172.21.15.90:59932) 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ed370640 1 -- 172.21.15.90:0/3847301631 learned_addr learned my addr 172.21.15.90:0/3847301631 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496325 0 0) 0x7f90e80c9410 con 0x7f90e80c8c90 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90edb71640 1 --2- 172.21.15.90:0/3847301631 >> v2:172.21.15.175:3300/0 conn(0x7f90e80c6e70 0x7f90e8156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90d4003520 con 0x7f90e80c8c90 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1007546898 0 0) 0x7f90d4003520 con 0x7f90e80c8c90 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 >> v2:172.21.15.175:3300/0 conn(0x7f90e80c6e70 msgr2=0x7f90e8156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 --2- 172.21.15.90:0/3847301631 >> v2:172.21.15.175:3300/0 conn(0x7f90e80c6e70 0x7f90e8156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 >> v1:172.21.15.175:6789/0 conn(0x7f90e806d120 legacy=0x7f90e8150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e80c9950 con 0x7f90e80c8c90 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f90d8001670 con 0x7f90e80c8c90 2024-04-20T10:51:14.930 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 >> v1:172.21.15.90:6789/0 conn(0x7f90e80c8c90 legacy=0x7f90e806ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90d40039b0 0x7f90d4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90d4005210 0x7f90d400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90e806c580 con 0x7f90d4004800 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90d400c140 con 0x7f90d4005210 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.927+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f90d400c340 con 0x7f90d40039b0 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ed370640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90edb71640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90d40039b0 0x7f90d4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ee372640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90d4005210 0x7f90d400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ed370640 1 -- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90d40039b0 msgr2=0x7f90d4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ed370640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90d40039b0 0x7f90d4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ed370640 1 -- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90d4005210 msgr2=0x7f90d400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ed370640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90d4005210 0x7f90d400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ed370640 1 -- 172.21.15.90:0/3847301631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d4003520 con 0x7f90d4004800 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ee372640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90d4005210 0x7f90d400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.928+0000 7f90ee372640 1 -- 172.21.15.90:0/3847301631 reap_dead start 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90ed370640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90d4004c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c240 tx=0x7f90d4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59cd6d8f14733b0c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d8007d10 con 0x7f90d4004800 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90d8030070 con 0x7f90d4004800 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90ecb6f640 1 -- 172.21.15.90:0/3847301631 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d802cdc0 con 0x7f90d4004800 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90efdd5640 1 -- 172.21.15.90:0/3847301631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 msgr2=0x7f90d4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90d4004c80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f90d800c240 tx=0x7f90d4005830 comp rx=0 tx=0).stop 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90efdd5640 1 -- 172.21.15.90:0/3847301631 shutdown_connections 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3847301631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90d4004c80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.932 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90efdd5640 1 -- 172.21.15.90:0/3847301631 >> 172.21.15.90:0/3847301631 conn(0x7f90e80addb0 msgr2=0x7f90e80ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90efdd5640 1 -- 172.21.15.90:0/3847301631 shutdown_connections 2024-04-20T10:51:14.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.929+0000 7f90efdd5640 1 -- 172.21.15.90:0/3847301631 wait complete. 2024-04-20T10:51:14.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.930+0000 7f90efdd5640 1 Processor -- start 2024-04-20T10:51:14.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.930+0000 7f90efdd5640 1 -- start start 2024-04-20T10:51:14.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90efdd5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90e80b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90efdd5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90e80c12c0 0x7f90e81efcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90efdd5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e80c2380 0x7f90e81f01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90efdd5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f90e80ca3a0 con 0x7f90d4004800 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90efdd5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f90e80c9c30 con 0x7f90e80c2380 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90efdd5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f90e80ca520 con 0x7f90e80c12c0 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90e80b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90e80b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45106/0 (socket says 172.21.15.90:45106) 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 -- 172.21.15.90:0/3019293229 learned_addr learned my addr 172.21.15.90:0/3019293229 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90ed370640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90e80c12c0 0x7f90e81efcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90ee372640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e80c2380 0x7f90e81f01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 -- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90e80c12c0 msgr2=0x7f90e81efcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90e80c12c0 0x7f90e81efcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 -- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e80c2380 msgr2=0x7f90e81f01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:14.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e80c2380 0x7f90e81f01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90edb71640 1 -- 172.21.15.90:0/3019293229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90e80c17c0 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90ed370640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90e80c12c0 0x7f90e81efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.931+0000 7f90ee372640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e80c2380 0x7f90e81f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.932+0000 7f90edb71640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90e80b0060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f90e4011a70 tx=0x7f90e4011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.932+0000 7f90de7fc640 1 -- 172.21.15.90:0/3019293229 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e400fb50 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.932+0000 7f90de7fc640 1 -- 172.21.15.90:0/3019293229 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90e400fcf0 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.932+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90e80c1aa0 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.932+0000 7f90de7fc640 1 -- 172.21.15.90:0/3019293229 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90e400fea0 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.932+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90e80af580 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.933+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90e815af20 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.933+0000 7f90de7fc640 1 -- 172.21.15.90:0/3019293229 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f90e4012040 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.934+0000 7f90de7fc640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f90cc06c8f0 0x7f90cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.934+0000 7f90de7fc640 1 -- 172.21.15.90:0/3019293229 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f90e408c550 con 0x7f90d4004800 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.934+0000 7f90ed370640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f90cc06c8f0 0x7f90cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:14.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.934+0000 7f90ed370640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f90cc06c8f0 0x7f90cc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f90d8034000 tx=0x7f90d8009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:14.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:14.938+0000 7f90de7fc640 1 -- 172.21.15.90:0/3019293229 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f90e815af20 con 0x7f90d4004800 2024-04-20T10:51:15.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.110+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f90e8076150 con 0x7f90d4004800 2024-04-20T10:51:15.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.111+0000 7f90de7fc640 1 -- 172.21.15.90:0/3019293229 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f90e4019030 con 0x7f90d4004800 2024-04-20T10:51:15.111 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:15.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f90cc06c8f0 msgr2=0x7f90cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f90cc06c8f0 0x7f90cc06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f90d8034000 tx=0x7f90d8009030 comp rx=0 tx=0).stop 2024-04-20T10:51:15.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 msgr2=0x7f90e80b0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90e80b0060 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f90e4011a70 tx=0x7f90e4011f30 comp rx=0 tx=0).stop 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 shutdown_connections 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f90cc06c8f0 0x7f90cc06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f90e80c2380 0x7f90e81f01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f90e80c12c0 0x7f90e81efcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 --2- 172.21.15.90:0/3019293229 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f90d4004800 0x7f90e80b0060 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 >> 172.21.15.90:0/3019293229 conn(0x7f90e80addb0 msgr2=0x7f90e8154560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 shutdown_connections 2024-04-20T10:51:15.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.113+0000 7f90efdd5640 1 -- 172.21.15.90:0/3019293229 wait complete. 2024-04-20T10:51:15.124 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:51:15.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.223+0000 7f154d474640 1 Processor -- start 2024-04-20T10:51:15.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.223+0000 7f154d474640 1 -- start start 2024-04-20T10:51:15.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f154d474640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f154806deb0 0x7f1548152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f154d474640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f15480c3d40 0x7f154814fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f154d474640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1548150830 con 0x7f1548150380 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f154d474640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f15480ab0e0 con 0x7f15480c3d40 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f154d474640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f15480c2b20 con 0x7f154806deb0 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f15467fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f15480c3d40 0x7f154814fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f15477fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1548150380 0x7f15480c3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:59944/0 (socket says 172.21.15.90:59944) 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.224+0000 7f15477fe640 1 -- 172.21.15.90:0/3882674882 learned_addr learned my addr 172.21.15.90:0/3882674882 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f1546ffd640 1 --2- 172.21.15.90:0/3882674882 >> v2:172.21.15.175:3300/0 conn(0x7f154806deb0 0x7f1548152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f15467fc640 1 -- 172.21.15.90:0/3882674882 >> v2:172.21.15.175:3300/0 conn(0x7f154806deb0 msgr2=0x7f1548152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f15467fc640 1 --2- 172.21.15.90:0/3882674882 >> v2:172.21.15.175:3300/0 conn(0x7f154806deb0 0x7f1548152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f15467fc640 1 -- 172.21.15.90:0/3882674882 >> v1:172.21.15.90:6789/0 conn(0x7f1548150380 legacy=0x7f15480c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f1545ffb640 1 -- 172.21.15.90:0/3882674882 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3443811340 0 0) 0x7f1548150830 con 0x7f1548150380 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f15467fc640 1 -- 172.21.15.90:0/3882674882 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1548153250 con 0x7f15480c3d40 2024-04-20T10:51:15.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f1546ffd640 1 --2- 172.21.15.90:0/3882674882 >> v2:172.21.15.175:3300/0 conn(0x7f154806deb0 0x7f1548152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:15.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.225+0000 7f15467fc640 1 --2- 172.21.15.90:0/3882674882 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15480c3d40 0x7f154814fe40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f153c0097a0 tx=0x7f153c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12047bcc80a5c2bf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f1545ffb640 1 -- 172.21.15.90:0/3882674882 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c0315a0 con 0x7f15480c3d40 2024-04-20T10:51:15.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f1545ffb640 1 -- 172.21.15.90:0/3882674882 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153c037070 con 0x7f15480c3d40 2024-04-20T10:51:15.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f1545ffb640 1 -- 172.21.15.90:0/3882674882 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153c031960 con 0x7f15480c3d40 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 -- 172.21.15.90:0/3882674882 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15480c3d40 msgr2=0x7f154814fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 --2- 172.21.15.90:0/3882674882 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15480c3d40 0x7f154814fe40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f153c0097a0 tx=0x7f153c02b840 comp rx=0 tx=0).stop 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 -- 172.21.15.90:0/3882674882 shutdown_connections 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 --2- 172.21.15.90:0/3882674882 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f15480c3d40 0x7f154814fe40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 --2- 172.21.15.90:0/3882674882 >> v2:172.21.15.175:3300/0 conn(0x7f154806deb0 0x7f1548152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 -- 172.21.15.90:0/3882674882 >> 172.21.15.90:0/3882674882 conn(0x7f15480c8080 msgr2=0x7f15480c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 -- 172.21.15.90:0/3882674882 shutdown_connections 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.226+0000 7f154d474640 1 -- 172.21.15.90:0/3882674882 wait complete. 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.227+0000 7f154d474640 1 Processor -- start 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.227+0000 7f154d474640 1 -- start start 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f154d474640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f154806deb0 0x7f15480c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f154d474640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15480c3d40 0x7f1548070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f154d474640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1548150380 0x7f15481495b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f154d474640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f15480c4880 con 0x7f1548150380 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f154d474640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1548153810 con 0x7f154806deb0 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f154d474640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1548153af0 con 0x7f15480c3d40 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1548150380 0x7f15481495b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1548150380 0x7f15481495b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:45118/0 (socket says 172.21.15.90:45118) 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 -- 172.21.15.90:0/3990223883 learned_addr learned my addr 172.21.15.90:0/3990223883 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f1546ffd640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f154806deb0 0x7f15480c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15467fc640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15480c3d40 0x7f1548070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 -- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15480c3d40 msgr2=0x7f1548070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15480c3d40 0x7f1548070f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 -- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f154806deb0 msgr2=0x7f15480c77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f154806deb0 0x7f15480c77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15477fe640 1 -- 172.21.15.90:0/3990223883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15480c7d20 con 0x7f1548150380 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.228+0000 7f15467fc640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15480c3d40 0x7f1548070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.229+0000 7f15477fe640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1548150380 0x7f15481495b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f154000c440 tx=0x7f154000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.229+0000 7f152f7fe640 1 -- 172.21.15.90:0/3990223883 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15400074e0 con 0x7f1548150380 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.229+0000 7f152f7fe640 1 -- 172.21.15.90:0/3990223883 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15400047e0 con 0x7f1548150380 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.229+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154814bf70 con 0x7f1548150380 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.229+0000 7f152f7fe640 1 -- 172.21.15.90:0/3990223883 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1540004bd0 con 0x7f1548150380 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.229+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1548144af0 con 0x7f1548150380 2024-04-20T10:51:15.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.230+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1548076150 con 0x7f1548150380 2024-04-20T10:51:15.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.230+0000 7f152f7fe640 1 -- 172.21.15.90:0/3990223883 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1540011070 con 0x7f1548150380 2024-04-20T10:51:15.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.231+0000 7f152f7fe640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f153406c920 0x7f153406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.231+0000 7f152f7fe640 1 -- 172.21.15.90:0/3990223883 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f154008b8c0 con 0x7f1548150380 2024-04-20T10:51:15.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.231+0000 7f1546ffd640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f153406c920 0x7f153406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.231+0000 7f1546ffd640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f153406c920 0x7f153406ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15380075b0 tx=0x7f1538007540 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.235+0000 7f152f7fe640 1 -- 172.21.15.90:0/3990223883 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1540059a50 con 0x7f1548150380 2024-04-20T10:51:15.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.408+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f154814c140 con 0x7f1548150380 2024-04-20T10:51:15.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.409+0000 7f152f7fe640 1 -- 172.21.15.90:0/3990223883 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7f1540059350 con 0x7f1548150380 2024-04-20T10:51:15.410 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:15.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f153406c920 msgr2=0x7f153406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f153406c920 0x7f153406ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15380075b0 tx=0x7f1538007540 comp rx=0 tx=0).stop 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1548150380 msgr2=0x7f15481495b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1548150380 0x7f15481495b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f154000c440 tx=0x7f154000c900 comp rx=0 tx=0).stop 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 shutdown_connections 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f153406c920 0x7f153406ede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1548150380 0x7f15481495b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f15480c3d40 0x7f1548070f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 --2- 172.21.15.90:0/3990223883 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f154806deb0 0x7f15480c77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 >> 172.21.15.90:0/3990223883 conn(0x7f15480c8080 msgr2=0x7f15480c2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 shutdown_connections 2024-04-20T10:51:15.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.411+0000 7f154d474640 1 -- 172.21.15.90:0/3990223883 wait complete. 2024-04-20T10:51:15.422 INFO:tasks.mds_thrash:mds thrasher using random seed: 1713610275 2024-04-20T10:51:15.422 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.519+0000 7fb5a9ea0640 1 Processor -- start 2024-04-20T10:51:15.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.519+0000 7fb5a9ea0640 1 -- start start 2024-04-20T10:51:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a9ea0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a4153ee0 0x7fb5a4157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a9ea0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5a40ab710 0x7fb5a40c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a9ea0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a40adce0 con 0x7fb5a40c6f20 2024-04-20T10:51:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a9ea0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a40adfc0 con 0x7fb5a40ab710 2024-04-20T10:51:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a9ea0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a40ae2a0 con 0x7fb5a4153ee0 2024-04-20T10:51:15.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a2ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5a40ab710 0x7fb5a40c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a3fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb5a40c6f20 0x7fb5a406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50860/0 (socket says 172.21.15.90:50860) 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a2ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5a40ab710 0x7fb5a40c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48138/0 (socket says 172.21.15.90:48138) 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a3fff640 1 -- 172.21.15.90:0/3998581888 learned_addr learned my addr 172.21.15.90:0/3998581888 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a37fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a4153ee0 0x7fb5a4157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a27fc640 1 -- 172.21.15.90:0/3998581888 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763715895 0 0) 0x7fb5a40adce0 con 0x7fb5a40c6f20 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a27fc640 1 -- 172.21.15.90:0/3998581888 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb58c003520 con 0x7fb5a40c6f20 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a2ffd640 1 -- 172.21.15.90:0/3998581888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a4153ee0 msgr2=0x7fb5a4157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a2ffd640 1 --2- 172.21.15.90:0/3998581888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a4153ee0 0x7fb5a4157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a2ffd640 1 -- 172.21.15.90:0/3998581888 >> v1:172.21.15.90:6789/0 conn(0x7fb5a40c6f20 legacy=0x7fb5a406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a2ffd640 1 -- 172.21.15.90:0/3998581888 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a40bf7d0 con 0x7fb5a40ab710 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.520+0000 7fb5a37fe640 1 --2- 172.21.15.90:0/3998581888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a4153ee0 0x7fb5a4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.521+0000 7fb5a2ffd640 1 --2- 172.21.15.90:0/3998581888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a40ab710 0x7fb5a40c69e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5980097a0 tx=0x7fb59802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccf3f2a413e22b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.521+0000 7fb5a27fc640 1 -- 172.21.15.90:0/3998581888 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598039070 con 0x7fb5a40ab710 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.521+0000 7fb5a27fc640 1 -- 172.21.15.90:0/3998581888 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5980316f0 con 0x7fb5a40ab710 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.521+0000 7fb5a27fc640 1 -- 172.21.15.90:0/3998581888 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598031ac0 con 0x7fb5a40ab710 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/3998581888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a40ab710 msgr2=0x7fb5a40c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/3998581888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a40ab710 0x7fb5a40c69e0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb5980097a0 tx=0x7fb59802b790 comp rx=0 tx=0).stop 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/3998581888 shutdown_connections 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/3998581888 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a40ab710 0x7fb5a40c69e0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/3998581888 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a4153ee0 0x7fb5a4157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/3998581888 >> 172.21.15.90:0/3998581888 conn(0x7fb5a40cc060 msgr2=0x7fb5a40cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/3998581888 shutdown_connections 2024-04-20T10:51:15.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.522+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/3998581888 wait complete. 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.523+0000 7fb5a9ea0640 1 Processor -- start 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.523+0000 7fb5a9ea0640 1 -- start start 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a40ab710 0x7fb5a41592a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a40c6f20 0x7fb5a40c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4153ee0 0x7fb5a4152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a406cff0 con 0x7fb5a4153ee0 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a406ce70 con 0x7fb5a40c6f20 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a406d170 con 0x7fb5a40ab710 2024-04-20T10:51:15.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4153ee0 0x7fb5a4152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4153ee0 0x7fb5a4152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48152/0 (socket says 172.21.15.90:48152) 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 -- 172.21.15.90:0/1108589070 learned_addr learned my addr 172.21.15.90:0/1108589070 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a37fe640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a40ab710 0x7fb5a41592a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a2ffd640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a40c6f20 0x7fb5a40c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 -- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a40ab710 msgr2=0x7fb5a41592a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a40ab710 0x7fb5a41592a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 -- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a40c6f20 msgr2=0x7fb5a40c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a40c6f20 0x7fb5a40c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 -- 172.21.15.90:0/1108589070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a41f0260 con 0x7fb5a4153ee0 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a2ffd640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a40c6f20 0x7fb5a40c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a3fff640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4153ee0 0x7fb5a4152230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00cad0 tx=0x7fb59c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb58bfff640 1 -- 172.21.15.90:0/1108589070 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c017070 con 0x7fb5a4153ee0 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb58bfff640 1 -- 172.21.15.90:0/1108589070 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59c00ac30 con 0x7fb5a4153ee0 2024-04-20T10:51:15.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a4158260 con 0x7fb5a4153ee0 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb58bfff640 1 -- 172.21.15.90:0/1108589070 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c012400 con 0x7fb5a4153ee0 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.524+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a40b05b0 con 0x7fb5a4153ee0 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.526+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a4158050 con 0x7fb5a4153ee0 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.526+0000 7fb58bfff640 1 -- 172.21.15.90:0/1108589070 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb59c01a070 con 0x7fb5a4153ee0 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.526+0000 7fb58bfff640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb59006c8f0 0x7fb59006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.526+0000 7fb58bfff640 1 -- 172.21.15.90:0/1108589070 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb59c08bba0 con 0x7fb5a4153ee0 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.526+0000 7fb5a37fe640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb59006c8f0 0x7fb59006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.527+0000 7fb5a37fe640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb59006c8f0 0x7fb59006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40bf400 tx=0x7fb594008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.531+0000 7fb58bfff640 1 -- 172.21.15.90:0/1108589070 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb59c059d30 con 0x7fb5a4153ee0 2024-04-20T10:51:15.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.709+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb5a4076150 con 0x7fb5a4153ee0 2024-04-20T10:51:15.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.710+0000 7fb58bfff640 1 -- 172.21.15.90:0/1108589070 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7fb59c059630 con 0x7fb5a4153ee0 2024-04-20T10:51:15.711 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:15.711 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb59006c8f0 msgr2=0x7fb59006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb59006c8f0 0x7fb59006edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fb5a40bf400 tx=0x7fb594008040 comp rx=0 tx=0).stop 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4153ee0 msgr2=0x7fb5a4152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4153ee0 0x7fb5a4152230 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00cad0 tx=0x7fb59c00cf90 comp rx=0 tx=0).stop 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 shutdown_connections 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb59006c8f0 0x7fb59006edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a4153ee0 0x7fb5a4152230 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a40c6f20 0x7fb5a40c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 --2- 172.21.15.90:0/1108589070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a40ab710 0x7fb5a41592a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 >> 172.21.15.90:0/1108589070 conn(0x7fb5a40cc060 msgr2=0x7fb5a40cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 shutdown_connections 2024-04-20T10:51:15.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.712+0000 7fb5a9ea0640 1 -- 172.21.15.90:0/1108589070 wait complete. 2024-04-20T10:51:15.725 INFO:tasks.mds_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:51:15.725 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:51:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.824+0000 7f0e0e304640 1 Processor -- start 2024-04-20T10:51:15.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.824+0000 7f0e0e304640 1 -- start start 2024-04-20T10:51:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e0e304640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0e080c7fd0 0x7f0e080c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e0e304640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e080c8460 con 0x7f0e0806ef90 2024-04-20T10:51:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e0e304640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e080c33e0 con 0x7f0e080c7bf0 2024-04-20T10:51:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e0e304640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0e080c4480 con 0x7f0e080c7fd0 2024-04-20T10:51:15.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e077fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0e0806ef90 0x7f0e0815ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50866/0 (socket says 172.21.15.90:50866) 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e077fe640 1 -- 172.21.15.90:0/1723480651 learned_addr learned my addr 172.21.15.90:0/1723480651 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e0c8a1640 1 --2- 172.21.15.90:0/1723480651 >> v2:172.21.15.175:3300/0 conn(0x7f0e080c7fd0 0x7f0e080c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2441118390 0 0) 0x7f0dfc001110 con 0x7f0e0806ef90 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0df0003520 con 0x7f0e0806ef90 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 230097191 0 0) 0x7f0e080c33e0 con 0x7f0e080c7bf0 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dfc001110 con 0x7f0e080c7bf0 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3133044679 0 0) 0x7f0df0003520 con 0x7f0e0806ef90 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 >> v2:172.21.15.175:3300/0 conn(0x7f0e080c7fd0 msgr2=0x7f0e080c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 --2- 172.21.15.90:0/1723480651 >> v2:172.21.15.175:3300/0 conn(0x7f0e080c7fd0 0x7f0e080c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 >> v1:172.21.15.175:6789/0 conn(0x7f0e080c7bf0 legacy=0x7f0e080c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e080c36c0 con 0x7f0e0806ef90 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f0dfc001840 con 0x7f0e0806ef90 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 >> v1:172.21.15.90:6789/0 conn(0x7f0e0806ef90 legacy=0x7f0e0815ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df0003b40 0x7f0df0003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.825+0000 7f0e06ffd640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0df0004800 0x7f0df0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e06ffd640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0005230 0x7f0df000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e080c4480 con 0x7f0df0004800 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0df000c190 con 0x7f0df0003b40 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0df000c390 con 0x7f0df0005230 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e077fe640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0df0004800 0x7f0df0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e07fff640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df0003b40 0x7f0df0003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e0c8a1640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0005230 0x7f0df000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e077fe640 1 -- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0005230 msgr2=0x7f0df000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e077fe640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0005230 0x7f0df000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e077fe640 1 -- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df0003b40 msgr2=0x7f0df0003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e077fe640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0df0003b40 0x7f0df0003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e0c8a1640 1 -- 172.21.15.90:0/1723480651 reap_dead start 2024-04-20T10:51:15.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.826+0000 7f0e077fe640 1 -- 172.21.15.90:0/1723480651 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df0003520 con 0x7f0df0004800 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e077fe640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0df0004800 0x7f0df0004c80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c4c0 tx=0x7f0df0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7d46b7c16916b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc00c0e0 con 0x7f0df0004800 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc030070 con 0x7f0df0004800 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e06ffd640 1 -- 172.21.15.90:0/1723480651 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0058d0 con 0x7f0df0004800 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e0e304640 1 -- 172.21.15.90:0/1723480651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0df0004800 msgr2=0x7f0df0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e0e304640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0df0004800 0x7f0df0004c80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c4c0 tx=0x7f0df0005830 comp rx=0 tx=0).stop 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e0e304640 1 -- 172.21.15.90:0/1723480651 shutdown_connections 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e0e304640 1 --2- 172.21.15.90:0/1723480651 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0df0004800 0x7f0df0004c80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e0e304640 1 -- 172.21.15.90:0/1723480651 >> 172.21.15.90:0/1723480651 conn(0x7f0e080aa660 msgr2=0x7f0e080aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e0e304640 1 -- 172.21.15.90:0/1723480651 shutdown_connections 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.827+0000 7f0e0e304640 1 -- 172.21.15.90:0/1723480651 wait complete. 2024-04-20T10:51:15.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.828+0000 7f0e0e304640 1 Processor -- start 2024-04-20T10:51:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e0e304640 1 -- start start 2024-04-20T10:51:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e0e304640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0004800 0x7f0e0814c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e0e304640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08072e30 0x7f0e080adfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e0e304640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e080ae510 0x7f0e08072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e0e304640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0e080c3ff0 con 0x7f0e08072e30 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e0e304640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0e080c2930 con 0x7f0e080ae510 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e0e304640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0e080c3c80 con 0x7f0df0004800 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e077fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08072e30 0x7f0e080adfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e077fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08072e30 0x7f0e080adfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48162/0 (socket says 172.21.15.90:48162) 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.829+0000 7f0e077fe640 1 -- 172.21.15.90:0/2804951568 learned_addr learned my addr 172.21.15.90:0/2804951568 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e07fff640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0004800 0x7f0e0814c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e0c8a1640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e080ae510 0x7f0e08072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e077fe640 1 -- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0004800 msgr2=0x7f0e0814c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e077fe640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0004800 0x7f0e0814c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e077fe640 1 -- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e080ae510 msgr2=0x7f0e08072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e077fe640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e080ae510 0x7f0e08072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e077fe640 1 -- 172.21.15.90:0/2804951568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0814c550 con 0x7f0e08072e30 2024-04-20T10:51:15.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e07fff640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0004800 0x7f0e0814c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e077fe640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08072e30 0x7f0e080adfd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c4c0 tx=0x7f0dfc001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e04ff9640 1 -- 172.21.15.90:0/2804951568 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc007270 con 0x7f0e08072e30 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e04ff9640 1 -- 172.21.15.90:0/2804951568 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dfc007410 con 0x7f0e08072e30 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e080ab9a0 con 0x7f0e08072e30 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e04ff9640 1 -- 172.21.15.90:0/2804951568 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc0077e0 con 0x7f0e08072e30 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.830+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e080ac260 con 0x7f0e08072e30 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.831+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e080c4b10 con 0x7f0e08072e30 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.831+0000 7f0e04ff9640 1 -- 172.21.15.90:0/2804951568 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0dfc035470 con 0x7f0e08072e30 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.832+0000 7f0e04ff9640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0df406c8f0 0x7f0df406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:15.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.832+0000 7f0e04ff9640 1 -- 172.21.15.90:0/2804951568 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f0dfc0ad670 con 0x7f0e08072e30 2024-04-20T10:51:15.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.832+0000 7f0e07fff640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0df406c8f0 0x7f0df406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:15.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.832+0000 7f0e07fff640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0df406c8f0 0x7f0df406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0df80010e0 tx=0x7f0df8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:15.837 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:15.836+0000 7f0e04ff9640 1 -- 172.21.15.90:0/2804951568 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0e080c4b10 con 0x7f0e08072e30 2024-04-20T10:51:16.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.010+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0e080ac050 con 0x7f0e08072e30 2024-04-20T10:51:16.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.010+0000 7f0e04ff9640 1 -- 172.21.15.90:0/2804951568 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f0e080c8460 con 0x7f0e08072e30 2024-04-20T10:51:16.011 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:51:16.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0df406c8f0 msgr2=0x7f0df406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0df406c8f0 0x7f0df406edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0df80010e0 tx=0x7f0df8009040 comp rx=0 tx=0).stop 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08072e30 msgr2=0x7f0e080adfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08072e30 0x7f0e080adfd0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc00c4c0 tx=0x7f0dfc001b90 comp rx=0 tx=0).stop 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 shutdown_connections 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0df406c8f0 0x7f0df406edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0e080ae510 0x7f0e08072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0e08072e30 0x7f0e080adfd0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 --2- 172.21.15.90:0/2804951568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0df0004800 0x7f0e0814c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 >> 172.21.15.90:0/2804951568 conn(0x7f0e080aa660 msgr2=0x7f0e081543d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 shutdown_connections 2024-04-20T10:51:16.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.012+0000 7f0e0e304640 1 -- 172.21.15.90:0/2804951568 wait complete. 2024-04-20T10:51:16.024 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:51:16.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.123+0000 7f061bb4b640 1 Processor -- start 2024-04-20T10:51:16.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f061bb4b640 1 -- start start 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f061bb4b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0614157710 0x7f0614154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f061bb4b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06140ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f061bb4b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06140c4370 con 0x7f0614073810 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f061bb4b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f06141569e0 con 0x7f0614157710 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f061bb4b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0614157280 con 0x7f06140ad0c0 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f06190e6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0614157710 0x7f0614154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f06198e7640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0614073810 0x7f06140c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50872/0 (socket says 172.21.15.90:50872) 2024-04-20T10:51:16.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f06198e7640 1 -- 172.21.15.90:0/432874981 learned_addr learned my addr 172.21.15.90:0/432874981 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.124+0000 7f06190e6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0614157710 0x7f0614154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48176/0 (socket says 172.21.15.90:48176) 2024-04-20T10:51:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.125+0000 7f061a0e8640 1 --2- 172.21.15.90:0/432874981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06140ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.125+0000 7f06190e6640 1 -- 172.21.15.90:0/432874981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 msgr2=0x7f06140ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.125+0000 7f06190e6640 1 --2- 172.21.15.90:0/432874981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06140ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.125+0000 7f06190e6640 1 -- 172.21.15.90:0/432874981 >> v1:172.21.15.90:6789/0 conn(0x7f0614073810 legacy=0x7f06140c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.125+0000 7f06190e6640 1 -- 172.21.15.90:0/432874981 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0614156c30 con 0x7f0614157710 2024-04-20T10:51:16.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.125+0000 7f06188e5640 1 -- 172.21.15.90:0/432874981 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3153833398 0 0) 0x7f06140c4370 con 0x7f0614073810 2024-04-20T10:51:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.125+0000 7f06190e6640 1 --2- 172.21.15.90:0/432874981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f0614154000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06040097a0 tx=0x7f060402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a88f4f2211e616 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f06188e5640 1 -- 172.21.15.90:0/432874981 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06040315a0 con 0x7f0614157710 2024-04-20T10:51:16.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f06188e5640 1 -- 172.21.15.90:0/432874981 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0604037070 con 0x7f0614157710 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f06188e5640 1 -- 172.21.15.90:0/432874981 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0604031960 con 0x7f0614157710 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 -- 172.21.15.90:0/432874981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 msgr2=0x7f0614154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 --2- 172.21.15.90:0/432874981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f0614154000 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f06040097a0 tx=0x7f060402b840 comp rx=0 tx=0).stop 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 -- 172.21.15.90:0/432874981 shutdown_connections 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 --2- 172.21.15.90:0/432874981 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06140ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 --2- 172.21.15.90:0/432874981 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f0614154000 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 -- 172.21.15.90:0/432874981 >> 172.21.15.90:0/432874981 conn(0x7f06140c8080 msgr2=0x7f06140c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 -- 172.21.15.90:0/432874981 shutdown_connections 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.126+0000 7f061bb4b640 1 -- 172.21.15.90:0/432874981 wait complete. 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.127+0000 7f061bb4b640 1 Processor -- start 2024-04-20T10:51:16.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.127+0000 7f061bb4b640 1 -- start start 2024-04-20T10:51:16.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061bb4b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0614073810 0x7f06141de3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061bb4b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06141edb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061bb4b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f061414fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061bb4b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06140abbb0 con 0x7f0614157710 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061bb4b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0614073bf0 con 0x7f0614073810 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061bb4b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06140abd30 con 0x7f06140ad0c0 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f061414fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f061414fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48186/0 (socket says 172.21.15.90:48186) 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 -- 172.21.15.90:0/1477954057 learned_addr learned my addr 172.21.15.90:0/1477954057 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f06198e7640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0614073810 0x7f06141de3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f06190e6640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06141edb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 -- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 msgr2=0x7f06141edb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06141edb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 -- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0614073810 msgr2=0x7f06141de3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0614073810 0x7f06141de3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.128+0000 7f061a0e8640 1 -- 172.21.15.90:0/1477954057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06141de9d0 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.129+0000 7f061a0e8640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f061414fce0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f060c007e40 tx=0x7f060c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.129+0000 7f060a7fc640 1 -- 172.21.15.90:0/1477954057 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c014620 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.129+0000 7f060a7fc640 1 -- 172.21.15.90:0/1477954057 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060c019070 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.129+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06141decb0 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.129+0000 7f060a7fc640 1 -- 172.21.15.90:0/1477954057 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c014a20 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.129+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0614150220 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.130+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0614076150 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.130+0000 7f060a7fc640 1 -- 172.21.15.90:0/1477954057 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f060c014bc0 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.130+0000 7f060a7fc640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.131+0000 7f060a7fc640 1 -- 172.21.15.90:0/1477954057 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f060c08c560 con 0x7f0614157710 2024-04-20T10:51:16.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.131+0000 7f06198e7640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.131+0000 7f06198e7640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0610000f60 tx=0x7f0610007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.135+0000 7f060a7fc640 1 -- 172.21.15.90:0/1477954057 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f060c05a0a0 con 0x7f0614157710 2024-04-20T10:51:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.308+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f0614075340 con 0x7f0614157710 2024-04-20T10:51:16.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.309+0000 7f060a7fc640 1 -- 172.21.15.90:0/1477954057 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f060c05e3a0 con 0x7f0614157710 2024-04-20T10:51:16.309 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 msgr2=0x7f05f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0610000f60 tx=0x7f0610007d50 comp rx=0 tx=0).stop 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 msgr2=0x7f061414fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f061414fce0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f060c007e40 tx=0x7f060c00e4b0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 shutdown_connections 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0614157710 0x7f061414fce0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140ad0c0 0x7f06141edb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 --2- 172.21.15.90:0/1477954057 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0614073810 0x7f06141de3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 >> 172.21.15.90:0/1477954057 conn(0x7f06140c8080 msgr2=0x7f0614153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.310+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 shutdown_connections 2024-04-20T10:51:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.311+0000 7f061bb4b640 1 -- 172.21.15.90:0/1477954057 wait complete. 2024-04-20T10:51:16.321 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:51:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 Processor -- start 2024-04-20T10:51:16.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 -- start start 2024-04-20T10:51:16.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6e5006deb0 0x7f6e50152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6e500c3d40 0x7f6e5014fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6e500ab0e0 con 0x7f6e5006deb0 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6e50150830 con 0x7f6e500c3d40 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.421+0000 7f6e56899640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e500c2b20 con 0x7f6e50150380 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6e5006deb0 0x7f6e50152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6e5006deb0 0x7f6e50152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48198/0 (socket says 172.21.15.90:48198) 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 -- 172.21.15.90:0/2929230074 learned_addr learned my addr 172.21.15.90:0/2929230074 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4f7fe640 1 --2- 172.21.15.90:0/2929230074 >> v2:172.21.15.175:3300/0 conn(0x7f6e500c3d40 0x7f6e5014fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e54e36640 1 --2- 172.21.15.90:0/2929230074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 -- 172.21.15.90:0/2929230074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 msgr2=0x7f6e500c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:16.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 --2- 172.21.15.90:0/2929230074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 -- 172.21.15.90:0/2929230074 >> v2:172.21.15.175:3300/0 conn(0x7f6e500c3d40 msgr2=0x7f6e5014fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 --2- 172.21.15.90:0/2929230074 >> v2:172.21.15.175:3300/0 conn(0x7f6e500c3d40 0x7f6e5014fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.422+0000 7f6e4ffff640 1 -- 172.21.15.90:0/2929230074 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e50153250 con 0x7f6e5006deb0 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e4ffff640 1 --2- 172.21.15.90:0/2929230074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e50152b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e50070110 tx=0x7f6e4002e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74e6ad17d57d475 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e4effd640 1 -- 172.21.15.90:0/2929230074 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4003b070 con 0x7f6e5006deb0 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e4effd640 1 -- 172.21.15.90:0/2929230074 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4002ee00 con 0x7f6e5006deb0 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e4effd640 1 -- 172.21.15.90:0/2929230074 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e40036660 con 0x7f6e5006deb0 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 -- 172.21.15.90:0/2929230074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 msgr2=0x7f6e50152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 --2- 172.21.15.90:0/2929230074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e50152b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6e50070110 tx=0x7f6e4002e050 comp rx=0 tx=0).stop 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 -- 172.21.15.90:0/2929230074 shutdown_connections 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 --2- 172.21.15.90:0/2929230074 >> v2:172.21.15.175:3300/0 conn(0x7f6e500c3d40 0x7f6e5014fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 --2- 172.21.15.90:0/2929230074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 --2- 172.21.15.90:0/2929230074 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e50152b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 -- 172.21.15.90:0/2929230074 >> 172.21.15.90:0/2929230074 conn(0x7f6e500c8080 msgr2=0x7f6e500c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 -- 172.21.15.90:0/2929230074 shutdown_connections 2024-04-20T10:51:16.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.423+0000 7f6e56899640 1 -- 172.21.15.90:0/2929230074 wait complete. 2024-04-20T10:51:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.424+0000 7f6e56899640 1 Processor -- start 2024-04-20T10:51:16.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e56899640 1 -- start start 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e56899640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e501dd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e56899640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e500c3d40 0x7f6e501ef580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e56899640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e56899640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6e500c4880 con 0x7f6e5006deb0 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e56899640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6e50153810 con 0x7f6e500c3d40 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e56899640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6e50153af0 con 0x7f6e50150380 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e4ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e501dd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e4ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e501dd1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48204/0 (socket says 172.21.15.90:48204) 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.425+0000 7f6e4ffff640 1 -- 172.21.15.90:0/1103959479 learned_addr learned my addr 172.21.15.90:0/1103959479 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e54e36640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4f7fe640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e500c3d40 0x7f6e501ef580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4ffff640 1 -- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 msgr2=0x7f6e500c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4ffff640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4ffff640 1 -- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e500c3d40 msgr2=0x7f6e501ef580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4ffff640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e500c3d40 0x7f6e501ef580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4ffff640 1 -- 172.21.15.90:0/1103959479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e501526c0 con 0x7f6e5006deb0 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e54e36640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4f7fe640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e500c3d40 0x7f6e501ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4ffff640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e501dd1d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e4002e090 tx=0x7f6e40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4cff9640 1 -- 172.21.15.90:0/1103959479 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4003b070 con 0x7f6e5006deb0 2024-04-20T10:51:16.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4cff9640 1 -- 172.21.15.90:0/1103959479 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e4003d560 con 0x7f6e5006deb0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e4cff9640 1 -- 172.21.15.90:0/1103959479 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e4003d950 con 0x7f6e5006deb0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e501ddc20 con 0x7f6e5006deb0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.426+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e50152350 con 0x7f6e5006deb0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.427+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e501de140 con 0x7f6e5006deb0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.427+0000 7f6e4cff9640 1 -- 172.21.15.90:0/1103959479 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6e40048060 con 0x7f6e5006deb0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.428+0000 7f6e4cff9640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.428+0000 7f6e4cff9640 1 -- 172.21.15.90:0/1103959479 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f6e400ad870 con 0x7f6e5006deb0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.428+0000 7f6e4f7fe640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.428+0000 7f6e4f7fe640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e500ab6d0 tx=0x7f6e44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.432+0000 7f6e4cff9640 1 -- 172.21.15.90:0/1103959479 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6e501de140 con 0x7f6e5006deb0 2024-04-20T10:51:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.607+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f6e50153d20 con 0x7f6e5006deb0 2024-04-20T10:51:16.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.608+0000 7f6e4cff9640 1 -- 172.21.15.90:0/1103959479 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7f6e50153d20 con 0x7f6e5006deb0 2024-04-20T10:51:16.608 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e3c06c8f0 msgr2=0x7f6e3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e500ab6d0 tx=0x7f6e44008040 comp rx=0 tx=0).stop 2024-04-20T10:51:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 msgr2=0x7f6e501dd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e501dd1d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f6e4002e090 tx=0x7f6e40004730 comp rx=0 tx=0).stop 2024-04-20T10:51:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 shutdown_connections 2024-04-20T10:51:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6e3c06c8f0 0x7f6e3c06edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6e50150380 0x7f6e500c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6e500c3d40 0x7f6e501ef580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 --2- 172.21.15.90:0/1103959479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6e5006deb0 0x7f6e501dd1d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 >> 172.21.15.90:0/1103959479 conn(0x7f6e500c8080 msgr2=0x7f6e500abec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 shutdown_connections 2024-04-20T10:51:16.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.610+0000 7f6e56899640 1 -- 172.21.15.90:0/1103959479 wait complete. 2024-04-20T10:51:16.621 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:51:16.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.721+0000 7f4cb119f640 1 Processor -- start 2024-04-20T10:51:16.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.721+0000 7f4cb119f640 1 -- start start 2024-04-20T10:51:16.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cb119f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4cac150b70 0x7f4cac156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cb119f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac0c9410 con 0x7f4cac0c6e70 2024-04-20T10:51:16.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cb119f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cac0c96b0 con 0x7f4cac06d120 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cb119f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4cac06c580 con 0x7f4cac150b70 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cab59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4cac150b70 0x7f4cac156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4caad9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4cac0c6e70 0x7f4cac06ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50884/0 (socket says 172.21.15.90:50884) 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4caad9d640 1 -- 172.21.15.90:0/1818064164 learned_addr learned my addr 172.21.15.90:0/1818064164 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cab59e640 1 -- 172.21.15.90:0/1818064164 >> v1:172.21.15.175:6789/0 conn(0x7f4cac06d120 legacy=0x7f4cac150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cab59e640 1 -- 172.21.15.90:0/1818064164 >> v1:172.21.15.90:6789/0 conn(0x7f4cac0c6e70 legacy=0x7f4cac06ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/1818064164 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2180934845 0 0) 0x7f4cac0c9410 con 0x7f4cac0c6e70 2024-04-20T10:51:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.722+0000 7f4cab59e640 1 -- 172.21.15.90:0/1818064164 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac0c9950 con 0x7f4cac150b70 2024-04-20T10:51:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.723+0000 7f4cab59e640 1 --2- 172.21.15.90:0/1818064164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac150b70 0x7f4cac156a50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009d90 tx=0x7f4ca402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82610494d565a1b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.723+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/1818064164 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4039070 con 0x7f4cac150b70 2024-04-20T10:51:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.723+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/1818064164 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca402cc60 con 0x7f4cac150b70 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.723+0000 7f4ca9d9b640 1 -- 172.21.15.90:0/1818064164 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca4034660 con 0x7f4cac150b70 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.724+0000 7f4cb119f640 1 -- 172.21.15.90:0/1818064164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac150b70 msgr2=0x7f4cac156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.724+0000 7f4cb119f640 1 --2- 172.21.15.90:0/1818064164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac150b70 0x7f4cac156a50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4ca4009d90 tx=0x7f4ca402beb0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.724+0000 7f4cb119f640 1 -- 172.21.15.90:0/1818064164 shutdown_connections 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.724+0000 7f4cb119f640 1 --2- 172.21.15.90:0/1818064164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac150b70 0x7f4cac156a50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.724+0000 7f4cb119f640 1 -- 172.21.15.90:0/1818064164 >> 172.21.15.90:0/1818064164 conn(0x7f4cac0addb0 msgr2=0x7f4cac0ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.724+0000 7f4cb119f640 1 -- 172.21.15.90:0/1818064164 shutdown_connections 2024-04-20T10:51:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.724+0000 7f4cb119f640 1 -- 172.21.15.90:0/1818064164 wait complete. 2024-04-20T10:51:16.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.725+0000 7f4cb119f640 1 Processor -- start 2024-04-20T10:51:16.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.725+0000 7f4cb119f640 1 -- start start 2024-04-20T10:51:16.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cb119f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cac06d120 0x7f4cac0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cb119f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac0c6e70 0x7f4cac1ed810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cb119f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cac150b70 0x7f4cac0c1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cb119f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac0c9c30 con 0x7f4cac0c6e70 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cb119f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4cac0c7250 con 0x7f4cac06d120 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cb119f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4cac0c73d0 con 0x7f4cac150b70 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac0c6e70 0x7f4cac1ed810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac0c6e70 0x7f4cac1ed810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48220/0 (socket says 172.21.15.90:48220) 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 -- 172.21.15.90:0/2926965027 learned_addr learned my addr 172.21.15.90:0/2926965027 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caad9d640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cac06d120 0x7f4cac0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cab59e640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cac150b70 0x7f4cac0c1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 -- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cac150b70 msgr2=0x7f4cac0c1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cac150b70 0x7f4cac0c1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 -- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cac06d120 msgr2=0x7f4cac0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cac06d120 0x7f4cac0c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 -- 172.21.15.90:0/2926965027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cac0c5e70 con 0x7f4cac0c6e70 2024-04-20T10:51:16.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4caa59c640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac0c6e70 0x7f4cac1ed810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c4d0 tx=0x7f4ca000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4c937fe640 1 -- 172.21.15.90:0/2926965027 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca00052d0 con 0x7f4cac0c6e70 2024-04-20T10:51:16.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4c937fe640 1 -- 172.21.15.90:0/2926965027 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ca0005470 con 0x7f4cac0c6e70 2024-04-20T10:51:16.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cac0c1280 con 0x7f4cac0c6e70 2024-04-20T10:51:16.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.726+0000 7f4c937fe640 1 -- 172.21.15.90:0/2926965027 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0012850 con 0x7f4cac0c6e70 2024-04-20T10:51:16.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.727+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cac0c02e0 con 0x7f4cac0c6e70 2024-04-20T10:51:16.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.727+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cac076150 con 0x7f4cac0c6e70 2024-04-20T10:51:16.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.728+0000 7f4c937fe640 1 -- 172.21.15.90:0/2926965027 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ca00129f0 con 0x7f4cac0c6e70 2024-04-20T10:51:16.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.728+0000 7f4c937fe640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c9806c8f0 0x7f4c9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:16.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.728+0000 7f4c937fe640 1 -- 172.21.15.90:0/2926965027 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f4ca008b880 con 0x7f4cac0c6e70 2024-04-20T10:51:16.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.728+0000 7f4caad9d640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c9806c8f0 0x7f4c9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:16.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.729+0000 7f4caad9d640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c9806c8f0 0x7f4c9806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c007f70 tx=0x7f4c9c007f00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:16.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.733+0000 7f4c937fe640 1 -- 172.21.15.90:0/2926965027 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4ca00593c0 con 0x7f4cac0c6e70 2024-04-20T10:51:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.910+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f4cac0ca180 con 0x7f4cac0c6e70 2024-04-20T10:51:16.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.910+0000 7f4c937fe640 1 -- 172.21.15.90:0/2926965027 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7f4ca005d6c0 con 0x7f4cac0c6e70 2024-04-20T10:51:16.911 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c9806c8f0 msgr2=0x7f4c9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c9806c8f0 0x7f4c9806edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c007f70 tx=0x7f4c9c007f00 comp rx=0 tx=0).stop 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac0c6e70 msgr2=0x7f4cac1ed810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac0c6e70 0x7f4cac1ed810 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4ca000c4d0 tx=0x7f4ca000c990 comp rx=0 tx=0).stop 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 shutdown_connections 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c9806c8f0 0x7f4c9806edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4cac150b70 0x7f4cac0c1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4cac0c6e70 0x7f4cac1ed810 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 --2- 172.21.15.90:0/2926965027 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4cac06d120 0x7f4cac0c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.912+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 >> 172.21.15.90:0/2926965027 conn(0x7f4cac0addb0 msgr2=0x7f4cac06ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.913+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 shutdown_connections 2024-04-20T10:51:16.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:16.913+0000 7f4cb119f640 1 -- 172.21.15.90:0/2926965027 wait complete. 2024-04-20T10:51:16.923 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:51:17.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.022+0000 7feb43011640 1 Processor -- start 2024-04-20T10:51:17.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.022+0000 7feb43011640 1 -- start start 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.023+0000 7feb43011640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7feb3c154040 0x7feb3c0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.023+0000 7feb43011640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c15a510 0x7feb3c073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.023+0000 7feb43011640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3c0af590 con 0x7feb3c0730e0 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.023+0000 7feb43011640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7feb3c0acb20 con 0x7feb3c154040 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.023+0000 7feb43011640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feb3c0acd70 con 0x7feb3c15a510 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.023+0000 7feb415ae640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c15a510 0x7feb3c073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.024+0000 7feb3bfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7feb3c0730e0 0x7feb3c159e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34048/0 (socket says 172.21.15.90:34048) 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.024+0000 7feb3bfff640 1 -- 172.21.15.90:0/1875903723 learned_addr learned my addr 172.21.15.90:0/1875903723 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.024+0000 7feb40dad640 1 --2- 172.21.15.90:0/1875903723 >> v2:172.21.15.175:3300/0 conn(0x7feb3c154040 0x7feb3c0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.024+0000 7feb40dad640 1 -- 172.21.15.90:0/1875903723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c15a510 msgr2=0x7feb3c073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:17.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.024+0000 7feb40dad640 1 --2- 172.21.15.90:0/1875903723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c15a510 0x7feb3c073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.024+0000 7feb40dad640 1 -- 172.21.15.90:0/1875903723 >> v1:172.21.15.175:6789/0 conn(0x7feb3c0730e0 legacy=0x7feb3c159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.024+0000 7feb40dad640 1 -- 172.21.15.90:0/1875903723 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c0c6400 con 0x7feb3c154040 2024-04-20T10:51:17.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.025+0000 7feb40dad640 1 --2- 172.21.15.90:0/1875903723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 0x7feb3c0c4bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0097a0 tx=0x7feb2c02b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6118429f7b469ad server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.025+0000 7feb3b7fe640 1 -- 172.21.15.90:0/1875903723 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c038070 con 0x7feb3c154040 2024-04-20T10:51:17.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.025+0000 7feb3b7fe640 1 -- 172.21.15.90:0/1875903723 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb2c031700 con 0x7feb3c154040 2024-04-20T10:51:17.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.025+0000 7feb3b7fe640 1 -- 172.21.15.90:0/1875903723 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2c031ad0 con 0x7feb3c154040 2024-04-20T10:51:17.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 -- 172.21.15.90:0/1875903723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 msgr2=0x7feb3c0c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 --2- 172.21.15.90:0/1875903723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 0x7feb3c0c4bb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb2c0097a0 tx=0x7feb2c02b7a0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 -- 172.21.15.90:0/1875903723 shutdown_connections 2024-04-20T10:51:17.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 --2- 172.21.15.90:0/1875903723 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c15a510 0x7feb3c073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 --2- 172.21.15.90:0/1875903723 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 0x7feb3c0c4bb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 -- 172.21.15.90:0/1875903723 >> 172.21.15.90:0/1875903723 conn(0x7feb3c0676c0 msgr2=0x7feb3c067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:17.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 -- 172.21.15.90:0/1875903723 shutdown_connections 2024-04-20T10:51:17.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.026+0000 7feb43011640 1 -- 172.21.15.90:0/1875903723 wait complete. 2024-04-20T10:51:17.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.027+0000 7feb43011640 1 Processor -- start 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.027+0000 7feb43011640 1 -- start start 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb43011640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c0730e0 0x7feb3c0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb43011640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 0x7feb3c0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb43011640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb3c15a510 0x7feb3c1efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb43011640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c0af020 con 0x7feb3c15a510 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb43011640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feb3c0aeea0 con 0x7feb3c154040 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb43011640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feb3c070520 con 0x7feb3c0730e0 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb3c15a510 0x7feb3c1efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb3c15a510 0x7feb3c1efa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48232/0 (socket says 172.21.15.90:48232) 2024-04-20T10:51:17.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 -- 172.21.15.90:0/3201136688 learned_addr learned my addr 172.21.15.90:0/3201136688 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb3bfff640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 0x7feb3c0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb40dad640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c0730e0 0x7feb3c0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 -- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c0730e0 msgr2=0x7feb3c0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c0730e0 0x7feb3c0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 -- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 msgr2=0x7feb3c0c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 0x7feb3c0c8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 -- 172.21.15.90:0/3201136688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3c0c83e0 con 0x7feb3c15a510 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb415ae640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb3c15a510 0x7feb3c1efa50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb34009d30 tx=0x7feb3400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb397fa640 1 -- 172.21.15.90:0/3201136688 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34018020 con 0x7feb3c15a510 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb397fa640 1 -- 172.21.15.90:0/3201136688 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb34014480 con 0x7feb3c15a510 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3c1f0440 con 0x7feb3c15a510 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.028+0000 7feb397fa640 1 -- 172.21.15.90:0/3201136688 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb34014870 con 0x7feb3c15a510 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.029+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb3c0c8d50 con 0x7feb3c15a510 2024-04-20T10:51:17.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.030+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb3c076150 con 0x7feb3c15a510 2024-04-20T10:51:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.030+0000 7feb397fa640 1 -- 172.21.15.90:0/3201136688 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb34005d10 con 0x7feb3c15a510 2024-04-20T10:51:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.030+0000 7feb397fa640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feb2806c8f0 0x7feb2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.031+0000 7feb397fa640 1 -- 172.21.15.90:0/3201136688 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7feb3408c9b0 con 0x7feb3c15a510 2024-04-20T10:51:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.031+0000 7feb40dad640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feb2806c8f0 0x7feb2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.031+0000 7feb40dad640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feb2806c8f0 0x7feb2806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feb2c035000 tx=0x7feb2c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.035+0000 7feb397fa640 1 -- 172.21.15.90:0/3201136688 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7feb34022030 con 0x7feb3c15a510 2024-04-20T10:51:17.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.209+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7feb3c072ec0 con 0x7feb3c15a510 2024-04-20T10:51:17.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.209+0000 7feb397fa640 1 -- 172.21.15.90:0/3201136688 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v25) ==== 95+0+11 (secure 0 0 0) 0x7feb34010040 con 0x7feb3c15a510 2024-04-20T10:51:17.209 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feb2806c8f0 msgr2=0x7feb2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feb2806c8f0 0x7feb2806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feb2c035000 tx=0x7feb2c008030 comp rx=0 tx=0).stop 2024-04-20T10:51:17.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb3c15a510 msgr2=0x7feb3c1efa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb3c15a510 0x7feb3c1efa50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7feb34009d30 tx=0x7feb3400c490 comp rx=0 tx=0).stop 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 shutdown_connections 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feb2806c8f0 0x7feb2806edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feb3c15a510 0x7feb3c1efa50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feb3c154040 0x7feb3c0c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 --2- 172.21.15.90:0/3201136688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feb3c0730e0 0x7feb3c0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 >> 172.21.15.90:0/3201136688 conn(0x7feb3c0676c0 msgr2=0x7feb3c067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 shutdown_connections 2024-04-20T10:51:17.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.211+0000 7feb43011640 1 -- 172.21.15.90:0/3201136688 wait complete. 2024-04-20T10:51:17.222 INFO:tasks.mds_thrash:Wait for all MDSs to reach steady state... 2024-04-20T10:51:17.222 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:17.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.317+0000 7fb50b83e640 1 Processor -- start 2024-04-20T10:51:17.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb50b83e640 1 -- start start 2024-04-20T10:51:17.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb50b83e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb504153ef0 0x7fb5040c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb50b83e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb5040c9ee0 0x7fb504156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb50b83e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb50415a720 con 0x7fb5040ab730 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb50b83e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb50415ac80 con 0x7fb504153ef0 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb50b83e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb50415a9a0 con 0x7fb5040c9ee0 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb5095da640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb504153ef0 0x7fb5040c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb5095da640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb504153ef0 0x7fb5040c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48242/0 (socket says 172.21.15.90:48242) 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.318+0000 7fb5095da640 1 -- 172.21.15.90:0/3638881336 learned_addr learned my addr 172.21.15.90:0/3638881336 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb509ddb640 1 --2- 172.21.15.90:0/3638881336 >> v2:172.21.15.175:3300/0 conn(0x7fb5040c9ee0 0x7fb504156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb5095da640 1 -- 172.21.15.90:0/3638881336 >> v2:172.21.15.175:3300/0 conn(0x7fb5040c9ee0 msgr2=0x7fb504156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb5095da640 1 --2- 172.21.15.90:0/3638881336 >> v2:172.21.15.175:3300/0 conn(0x7fb5040c9ee0 0x7fb504156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb5095da640 1 -- 172.21.15.90:0/3638881336 >> v1:172.21.15.175:6789/0 conn(0x7fb5040ab730 legacy=0x7fb5041568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb5095da640 1 -- 172.21.15.90:0/3638881336 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5040c6a90 con 0x7fb504153ef0 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb509ddb640 1 --2- 172.21.15.90:0/3638881336 >> v2:172.21.15.175:3300/0 conn(0x7fb5040c9ee0 0x7fb504156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb5095da640 1 --2- 172.21.15.90:0/3638881336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb504153ef0 0x7fb5040c89f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb5041578b0 tx=0x7fb50002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3725516b097405cb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.319+0000 7fb4fbfff640 1 -- 172.21.15.90:0/3638881336 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500038070 con 0x7fb504153ef0 2024-04-20T10:51:17.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb4fbfff640 1 -- 172.21.15.90:0/3638881336 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb50002f050 con 0x7fb504153ef0 2024-04-20T10:51:17.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb4fbfff640 1 -- 172.21.15.90:0/3638881336 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb500031970 con 0x7fb504153ef0 2024-04-20T10:51:17.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 -- 172.21.15.90:0/3638881336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb504153ef0 msgr2=0x7fb5040c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 --2- 172.21.15.90:0/3638881336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb504153ef0 0x7fb5040c89f0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb5041578b0 tx=0x7fb50002b7f0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 -- 172.21.15.90:0/3638881336 shutdown_connections 2024-04-20T10:51:17.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 --2- 172.21.15.90:0/3638881336 >> v2:172.21.15.175:3300/0 conn(0x7fb5040c9ee0 0x7fb504156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 --2- 172.21.15.90:0/3638881336 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb504153ef0 0x7fb5040c89f0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 -- 172.21.15.90:0/3638881336 >> 172.21.15.90:0/3638881336 conn(0x7fb5040cbfe0 msgr2=0x7fb5040cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 -- 172.21.15.90:0/3638881336 shutdown_connections 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.320+0000 7fb50b83e640 1 -- 172.21.15.90:0/3638881336 wait complete. 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.321+0000 7fb50b83e640 1 Processor -- start 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.321+0000 7fb50b83e640 1 -- start start 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb50b83e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5040ab730 0x7fb504151310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb50b83e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5040c9ee0 0x7fb5041e1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb50b83e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb504153ef0 0x7fb5041ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb50b83e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5040bf800 con 0x7fb5040c9ee0 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb50b83e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb504157510 con 0x7fb5040ab730 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb50b83e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb5041f04d0 con 0x7fb504153ef0 2024-04-20T10:51:17.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5040c9ee0 0x7fb5041e1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5040c9ee0 0x7fb5041e1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48250/0 (socket says 172.21.15.90:48250) 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 -- 172.21.15.90:0/2733597195 learned_addr learned my addr 172.21.15.90:0/2733597195 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb509ddb640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb504153ef0 0x7fb5041ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb5095da640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5040ab730 0x7fb504151310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 -- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb504153ef0 msgr2=0x7fb5041ecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb504153ef0 0x7fb5041ecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 -- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5040ab730 msgr2=0x7fb504151310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5040ab730 0x7fb504151310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.322+0000 7fb508dd9640 1 -- 172.21.15.90:0/2733597195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5041e2190 con 0x7fb5040c9ee0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.323+0000 7fb508dd9640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5040c9ee0 0x7fb5041e1c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b3c0 tx=0x7fb4f400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.323+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/2733597195 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4011830 con 0x7fb5040c9ee0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.323+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/2733597195 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4f4016070 con 0x7fb5040c9ee0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.323+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5041ed480 con 0x7fb5040c9ee0 2024-04-20T10:51:17.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.323+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/2733597195 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4f4011c10 con 0x7fb5040c9ee0 2024-04-20T10:51:17.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.323+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5041ec740 con 0x7fb5040c9ee0 2024-04-20T10:51:17.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.324+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/2733597195 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb4f401b460 con 0x7fb5040c9ee0 2024-04-20T10:51:17.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.324+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5040cab00 con 0x7fb5040c9ee0 2024-04-20T10:51:17.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.324+0000 7fb4f9ffb640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb4e806c920 0x7fb4e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.325+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/2733597195 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb4f408b740 con 0x7fb5040c9ee0 2024-04-20T10:51:17.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.325+0000 7fb5095da640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb4e806c920 0x7fb4e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.325+0000 7fb5095da640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb4e806c920 0x7fb4e806ede0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb500035000 tx=0x7fb500008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.329+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/2733597195 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb5040cab00 con 0x7fb5040c9ee0 2024-04-20T10:51:17.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.543+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5041ec550 con 0x7fb5040c9ee0 2024-04-20T10:51:17.544 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.544+0000 7fb4f9ffb640 1 -- 172.21.15.90:0/2733597195 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fb4f4020020 con 0x7fb5040c9ee0 2024-04-20T10:51:17.544 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:17.544 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:17.544 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:17.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb4e806c920 msgr2=0x7fb4e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb4e806c920 0x7fb4e806ede0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb500035000 tx=0x7fb500008030 comp rx=0 tx=0).stop 2024-04-20T10:51:17.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5040c9ee0 msgr2=0x7fb5041e1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5040c9ee0 0x7fb5041e1c50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb4f400b3c0 tx=0x7fb4f400b880 comp rx=0 tx=0).stop 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 shutdown_connections 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb4e806c920 0x7fb4e806ede0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb504153ef0 0x7fb5041ecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5040c9ee0 0x7fb5041e1c50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 --2- 172.21.15.90:0/2733597195 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5040ab730 0x7fb504151310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 >> 172.21.15.90:0/2733597195 conn(0x7fb5040cbfe0 msgr2=0x7fb5040ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 shutdown_connections 2024-04-20T10:51:17.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.546+0000 7fb50b83e640 1 -- 172.21.15.90:0/2733597195 wait complete. 2024-04-20T10:51:17.557 INFO:tasks.mds_thrash:Ready to start thrashing 2024-04-20T10:51:17.557 INFO:tasks.mds_thrash.ceph_manager:waiting for clean 2024-04-20T10:51:17.557 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:51:17.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.654+0000 7f66d72b3640 1 Processor -- start 2024-04-20T10:51:17.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.654+0000 7f66d72b3640 1 -- start start 2024-04-20T10:51:17.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d72b3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66d0073810 0x7f66d0154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d72b3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f66d0157710 0x7f66d00c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d72b3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d00c40d0 con 0x7f66d00ad0c0 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d72b3640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f66d01569e0 con 0x7f66d0073810 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d72b3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f66d0157280 con 0x7f66d0157710 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d504f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66d0073810 0x7f66d0154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d5850640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f66d00ad0c0 0x7f66d00abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50888/0 (socket says 172.21.15.90:50888) 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d5850640 1 -- 172.21.15.90:0/2709555734 learned_addr learned my addr 172.21.15.90:0/2709555734 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.655+0000 7f66d484e640 1 --2- 172.21.15.90:0/2709555734 >> v2:172.21.15.175:3300/0 conn(0x7f66d0157710 0x7f66d00c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66d504f640 1 -- 172.21.15.90:0/2709555734 >> v2:172.21.15.175:3300/0 conn(0x7f66d0157710 msgr2=0x7f66d00c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66d504f640 1 --2- 172.21.15.90:0/2709555734 >> v2:172.21.15.175:3300/0 conn(0x7f66d0157710 0x7f66d00c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66d504f640 1 -- 172.21.15.90:0/2709555734 >> v1:172.21.15.90:6789/0 conn(0x7f66d00ad0c0 legacy=0x7f66d00abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66c7fff640 1 -- 172.21.15.90:0/2709555734 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565148925 0 0) 0x7f66d00c40d0 con 0x7f66d00ad0c0 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66d504f640 1 -- 172.21.15.90:0/2709555734 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d00c4370 con 0x7f66d0073810 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66d504f640 1 --2- 172.21.15.90:0/2709555734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0073810 0x7f66d0154000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66d00688d0 tx=0x7f66cc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e31e057c03948a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66c7fff640 1 -- 172.21.15.90:0/2709555734 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc039070 con 0x7f66d0073810 2024-04-20T10:51:17.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.656+0000 7f66c7fff640 1 -- 172.21.15.90:0/2709555734 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc02cbf0 con 0x7f66d0073810 2024-04-20T10:51:17.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66c7fff640 1 -- 172.21.15.90:0/2709555734 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc034440 con 0x7f66d0073810 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 -- 172.21.15.90:0/2709555734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0073810 msgr2=0x7f66d0154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 --2- 172.21.15.90:0/2709555734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0073810 0x7f66d0154000 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f66d00688d0 tx=0x7f66cc02be40 comp rx=0 tx=0).stop 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 -- 172.21.15.90:0/2709555734 shutdown_connections 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 --2- 172.21.15.90:0/2709555734 >> v2:172.21.15.175:3300/0 conn(0x7f66d0157710 0x7f66d00c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 --2- 172.21.15.90:0/2709555734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0073810 0x7f66d0154000 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 -- 172.21.15.90:0/2709555734 >> 172.21.15.90:0/2709555734 conn(0x7f66d00c8080 msgr2=0x7f66d00c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 -- 172.21.15.90:0/2709555734 shutdown_connections 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.657+0000 7f66d72b3640 1 -- 172.21.15.90:0/2709555734 wait complete. 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.658+0000 7f66d72b3640 1 Processor -- start 2024-04-20T10:51:17.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.658+0000 7f66d72b3640 1 -- start start 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d72b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0073810 0x7f66d00c1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d72b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ad0c0 0x7f66d0152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d72b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0157710 0x7f66d014f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d72b3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66d0073bf0 con 0x7f66d0157710 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d72b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66d0156f10 con 0x7f66d00ad0c0 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d72b3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66d00ac2c0 con 0x7f66d0073810 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0157710 0x7f66d014f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0157710 0x7f66d014f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48276/0 (socket says 172.21.15.90:48276) 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 -- 172.21.15.90:0/3047667396 learned_addr learned my addr 172.21.15.90:0/3047667396 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 -- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0073810 msgr2=0x7f66d00c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d504f640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0073810 0x7f66d00c1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d484e640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ad0c0 0x7f66d0152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0073810 0x7f66d00c1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 -- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ad0c0 msgr2=0x7f66d0152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ad0c0 0x7f66d0152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 -- 172.21.15.90:0/3047667396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d00c7760 con 0x7f66d0157710 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d484e640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ad0c0 0x7f66d0152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d504f640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0073810 0x7f66d00c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.659+0000 7f66d5850640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0157710 0x7f66d014f5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c3e0 tx=0x7f66c800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.660+0000 7f66c5ffb640 1 -- 172.21.15.90:0/3047667396 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8017070 con 0x7f66d0157710 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.660+0000 7f66c5ffb640 1 -- 172.21.15.90:0/3047667396 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c8005ce0 con 0x7f66d0157710 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.660+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d01535b0 con 0x7f66d0157710 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.660+0000 7f66c5ffb640 1 -- 172.21.15.90:0/3047667396 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c80072f0 con 0x7f66d0157710 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.660+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d00bdb50 con 0x7f66d0157710 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.661+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d0076150 con 0x7f66d0157710 2024-04-20T10:51:17.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.661+0000 7f66c5ffb640 1 -- 172.21.15.90:0/3047667396 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66c801a070 con 0x7f66d0157710 2024-04-20T10:51:17.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.661+0000 7f66c5ffb640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66b406c8f0 0x7f66b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:17.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.662+0000 7f66c5ffb640 1 -- 172.21.15.90:0/3047667396 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f66c808b1f0 con 0x7f66d0157710 2024-04-20T10:51:17.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.662+0000 7f66d504f640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66b406c8f0 0x7f66b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:17.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.662+0000 7f66d504f640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66b406c8f0 0x7f66b406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66cc036000 tx=0x7f66cc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:17.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.666+0000 7f66c5ffb640 1 -- 172.21.15.90:0/3047667396 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f66c80592f0 con 0x7f66d0157710 2024-04-20T10:51:17.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.839+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f66d00c8c40 con 0x7f66b406c8f0 2024-04-20T10:51:17.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.850+0000 7f66c5ffb640 1 -- 172.21.15.90:0/3047667396 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490302 (secure 0 0 0) 0x7f66d00c8c40 con 0x7f66b406c8f0 2024-04-20T10:51:17.856 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:17.859 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66b406c8f0 msgr2=0x7f66b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66b406c8f0 0x7f66b406edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f66cc036000 tx=0x7f66cc030000 comp rx=0 tx=0).stop 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0157710 msgr2=0x7f66d014f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0157710 0x7f66d014f5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f66c800c3e0 tx=0x7f66c800c8a0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 shutdown_connections 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66b406c8f0 0x7f66b406edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0157710 0x7f66d014f5a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ad0c0 0x7f66d0152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 --2- 172.21.15.90:0/3047667396 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0073810 0x7f66d00c1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 >> 172.21.15.90:0/3047667396 conn(0x7f66d00c8080 msgr2=0x7f66d01561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 shutdown_connections 2024-04-20T10:51:17.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:17.854+0000 7f66d72b3640 1 -- 172.21.15.90:0/3047667396 wait complete. 2024-04-20T10:51:17.865 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-20T10:51:17.671126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596687,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":254,"num_write_kb":2449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3448832,"data_stored":2024830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1499,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646500+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:50:50.646500+0000","last_peered":"2024-04-20T10:50:50.646500+0000","last_clean":"2024-04-20T10:50:50.646500+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:50:50.646500+0000","last_undegraded":"2024-04-20T10:50:50.646500+0000","last_fullsized":"2024-04-20T10:50:50.646500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647942+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:50.647942+0000","last_peered":"2024-04-20T10:50:50.647942+0000","last_clean":"2024-04-20T10:50:50.647942+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:50.647942+0000","last_undegraded":"2024-04-20T10:50:50.647942+0000","last_fullsized":"2024-04-20T10:50:50.647942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647361+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:50:50.647361+0000","last_peered":"2024-04-20T10:50:50.647361+0000","last_clean":"2024-04-20T10:50:50.647361+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:50:50.647361+0000","last_undegraded":"2024-04-20T10:50:50.647361+0000","last_fullsized":"2024-04-20T10:50:50.647361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918471+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:50:50.918471+0000","last_peered":"2024-04-20T10:50:50.918471+0000","last_clean":"2024-04-20T10:50:50.918471+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:50:50.918471+0000","last_undegraded":"2024-04-20T10:50:50.918471+0000","last_fullsized":"2024-04-20T10:50:50.918471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648170+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:50.648170+0000","last_peered":"2024-04-20T10:50:50.648170+0000","last_clean":"2024-04-20T10:50:50.648170+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:50.648170+0000","last_undegraded":"2024-04-20T10:50:50.648170+0000","last_fullsized":"2024-04-20T10:50:50.648170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918903+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:50.918903+0000","last_peered":"2024-04-20T10:50:50.918903+0000","last_clean":"2024-04-20T10:50:50.918903+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:50.918903+0000","last_undegraded":"2024-04-20T10:50:50.918903+0000","last_fullsized":"2024-04-20T10:50:50.918903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646446+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:50:50.646446+0000","last_peered":"2024-04-20T10:50:50.646446+0000","last_clean":"2024-04-20T10:50:50.646446+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:50:50.646446+0000","last_undegraded":"2024-04-20T10:50:50.646446+0000","last_fullsized":"2024-04-20T10:50:50.646446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918478+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:50:50.918478+0000","last_peered":"2024-04-20T10:50:50.918478+0000","last_clean":"2024-04-20T10:50:50.918478+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:50:50.918478+0000","last_undegraded":"2024-04-20T10:50:50.918478+0000","last_fullsized":"2024-04-20T10:50:50.918478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920014+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:50.920014+0000","last_peered":"2024-04-20T10:50:50.920014+0000","last_clean":"2024-04-20T10:50:50.920014+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:50.920014+0000","last_undegraded":"2024-04-20T10:50:50.920014+0000","last_fullsized":"2024-04-20T10:50:50.920014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918841+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:50.918841+0000","last_peered":"2024-04-20T10:50:50.918841+0000","last_clean":"2024-04-20T10:50:50.918841+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:50.918841+0000","last_undegraded":"2024-04-20T10:50:50.918841+0000","last_fullsized":"2024-04-20T10:50:50.918841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646788+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:50:50.646788+0000","last_peered":"2024-04-20T10:50:50.646788+0000","last_clean":"2024-04-20T10:50:50.646788+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:50:50.646788+0000","last_undegraded":"2024-04-20T10:50:50.646788+0000","last_fullsized":"2024-04-20T10:50:50.646788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918243+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:50:50.918243+0000","last_peered":"2024-04-20T10:50:50.918243+0000","last_clean":"2024-04-20T10:50:50.918243+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:50:50.918243+0000","last_undegraded":"2024-04-20T10:50:50.918243+0000","last_fullsized":"2024-04-20T10:50:50.918243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919668+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:50.919668+0000","last_peered":"2024-04-20T10:50:50.919668+0000","last_clean":"2024-04-20T10:50:50.919668+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:50.919668+0000","last_undegraded":"2024-04-20T10:50:50.919668+0000","last_fullsized":"2024-04-20T10:50:50.919668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919525+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:50.919525+0000","last_peered":"2024-04-20T10:50:50.919525+0000","last_clean":"2024-04-20T10:50:50.919525+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:50.919525+0000","last_undegraded":"2024-04-20T10:50:50.919525+0000","last_fullsized":"2024-04-20T10:50:50.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646886+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:50:50.646886+0000","last_peered":"2024-04-20T10:50:50.646886+0000","last_clean":"2024-04-20T10:50:50.646886+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:50:50.646886+0000","last_undegraded":"2024-04-20T10:50:50.646886+0000","last_fullsized":"2024-04-20T10:50:50.646886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919828+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:50:50.919828+0000","last_peered":"2024-04-20T10:50:50.919828+0000","last_clean":"2024-04-20T10:50:50.919828+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:50:50.919828+0000","last_undegraded":"2024-04-20T10:50:50.919828+0000","last_fullsized":"2024-04-20T10:50:50.919828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647374+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:50:50.647374+0000","last_peered":"2024-04-20T10:50:50.647374+0000","last_clean":"2024-04-20T10:50:50.647374+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:50:50.647374+0000","last_undegraded":"2024-04-20T10:50:50.647374+0000","last_fullsized":"2024-04-20T10:50:50.647374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919489+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:50:50.919489+0000","last_peered":"2024-04-20T10:50:50.919489+0000","last_clean":"2024-04-20T10:50:50.919489+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:50:50.919489+0000","last_undegraded":"2024-04-20T10:50:50.919489+0000","last_fullsized":"2024-04-20T10:50:50.919489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647710+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:50.647710+0000","last_peered":"2024-04-20T10:50:50.647710+0000","last_clean":"2024-04-20T10:50:50.647710+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:50.647710+0000","last_undegraded":"2024-04-20T10:50:50.647710+0000","last_fullsized":"2024-04-20T10:50:50.647710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:07.016612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918599+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:50.918599+0000","last_peered":"2024-04-20T10:50:50.918599+0000","last_clean":"2024-04-20T10:50:50.918599+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:50.918599+0000","last_undegraded":"2024-04-20T10:50:50.918599+0000","last_fullsized":"2024-04-20T10:50:50.918599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647233+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:50:50.647233+0000","last_peered":"2024-04-20T10:50:50.647233+0000","last_clean":"2024-04-20T10:50:50.647233+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:50:50.647233+0000","last_undegraded":"2024-04-20T10:50:50.647233+0000","last_fullsized":"2024-04-20T10:50:50.647233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647083+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:50:50.647083+0000","last_peered":"2024-04-20T10:50:50.647083+0000","last_clean":"2024-04-20T10:50:50.647083+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:50:50.647083+0000","last_undegraded":"2024-04-20T10:50:50.647083+0000","last_fullsized":"2024-04-20T10:50:50.647083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647704+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:50.647704+0000","last_peered":"2024-04-20T10:50:50.647704+0000","last_clean":"2024-04-20T10:50:50.647704+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:50.647704+0000","last_undegraded":"2024-04-20T10:50:50.647704+0000","last_fullsized":"2024-04-20T10:50:50.647704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918767+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:50.918767+0000","last_peered":"2024-04-20T10:50:50.918767+0000","last_clean":"2024-04-20T10:50:50.918767+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:50.918767+0000","last_undegraded":"2024-04-20T10:50:50.918767+0000","last_fullsized":"2024-04-20T10:50:50.918767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919440+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:50:50.919440+0000","last_peered":"2024-04-20T10:50:50.919440+0000","last_clean":"2024-04-20T10:50:50.919440+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:50:50.919440+0000","last_undegraded":"2024-04-20T10:50:50.919440+0000","last_fullsized":"2024-04-20T10:50:50.919440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919258+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:50:50.919258+0000","last_peered":"2024-04-20T10:50:50.919258+0000","last_clean":"2024-04-20T10:50:50.919258+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:50:50.919258+0000","last_undegraded":"2024-04-20T10:50:50.919258+0000","last_fullsized":"2024-04-20T10:50:50.919258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647487+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:50.647487+0000","last_peered":"2024-04-20T10:50:50.647487+0000","last_clean":"2024-04-20T10:50:50.647487+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:50.647487+0000","last_undegraded":"2024-04-20T10:50:50.647487+0000","last_fullsized":"2024-04-20T10:50:50.647487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918378+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:50.918378+0000","last_peered":"2024-04-20T10:50:50.918378+0000","last_clean":"2024-04-20T10:50:50.918378+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:50.918378+0000","last_undegraded":"2024-04-20T10:50:50.918378+0000","last_fullsized":"2024-04-20T10:50:50.918378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647210+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:50:50.647210+0000","last_peered":"2024-04-20T10:50:50.647210+0000","last_clean":"2024-04-20T10:50:50.647210+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:50:50.647210+0000","last_undegraded":"2024-04-20T10:50:50.647210+0000","last_fullsized":"2024-04-20T10:50:50.647210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647499+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:50:50.647499+0000","last_peered":"2024-04-20T10:50:50.647499+0000","last_clean":"2024-04-20T10:50:50.647499+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:50:50.647499+0000","last_undegraded":"2024-04-20T10:50:50.647499+0000","last_fullsized":"2024-04-20T10:50:50.647499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919297+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:50.919297+0000","last_peered":"2024-04-20T10:50:50.919297+0000","last_clean":"2024-04-20T10:50:50.919297+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:50.919297+0000","last_undegraded":"2024-04-20T10:50:50.919297+0000","last_fullsized":"2024-04-20T10:50:50.919297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904955+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:50.904955+0000","last_peered":"2024-04-20T10:50:50.904955+0000","last_clean":"2024-04-20T10:50:50.904955+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:50.904955+0000","last_undegraded":"2024-04-20T10:50:50.904955+0000","last_fullsized":"2024-04-20T10:50:50.904955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647061+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:50:50.647061+0000","last_peered":"2024-04-20T10:50:50.647061+0000","last_clean":"2024-04-20T10:50:50.647061+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:50:50.647061+0000","last_undegraded":"2024-04-20T10:50:50.647061+0000","last_fullsized":"2024-04-20T10:50:50.647061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646640+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:50:50.646640+0000","last_peered":"2024-04-20T10:50:50.646640+0000","last_clean":"2024-04-20T10:50:50.646640+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:50:50.646640+0000","last_undegraded":"2024-04-20T10:50:50.646640+0000","last_fullsized":"2024-04-20T10:50:50.646640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647815+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:50.647815+0000","last_peered":"2024-04-20T10:50:50.647815+0000","last_clean":"2024-04-20T10:50:50.647815+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:50.647815+0000","last_undegraded":"2024-04-20T10:50:50.647815+0000","last_fullsized":"2024-04-20T10:50:50.647815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919903+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:50.919903+0000","last_peered":"2024-04-20T10:50:50.919903+0000","last_clean":"2024-04-20T10:50:50.919903+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:50.919903+0000","last_undegraded":"2024-04-20T10:50:50.919903+0000","last_fullsized":"2024-04-20T10:50:50.919903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647184+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:50:50.647184+0000","last_peered":"2024-04-20T10:50:50.647184+0000","last_clean":"2024-04-20T10:50:50.647184+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:50:50.647184+0000","last_undegraded":"2024-04-20T10:50:50.647184+0000","last_fullsized":"2024-04-20T10:50:50.647184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904364+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:50:50.904364+0000","last_peered":"2024-04-20T10:50:50.904364+0000","last_clean":"2024-04-20T10:50:50.904364+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:50:50.904364+0000","last_undegraded":"2024-04-20T10:50:50.904364+0000","last_fullsized":"2024-04-20T10:50:50.904364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919960+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:50.919960+0000","last_peered":"2024-04-20T10:50:50.919960+0000","last_clean":"2024-04-20T10:50:50.919960+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:50.919960+0000","last_undegraded":"2024-04-20T10:50:50.919960+0000","last_fullsized":"2024-04-20T10:50:50.919960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920149+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:50.920149+0000","last_peered":"2024-04-20T10:50:50.920149+0000","last_clean":"2024-04-20T10:50:50.920149+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:50.920149+0000","last_undegraded":"2024-04-20T10:50:50.920149+0000","last_fullsized":"2024-04-20T10:50:50.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919053+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:50:50.919053+0000","last_peered":"2024-04-20T10:50:50.919053+0000","last_clean":"2024-04-20T10:50:50.919053+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:50:50.919053+0000","last_undegraded":"2024-04-20T10:50:50.919053+0000","last_fullsized":"2024-04-20T10:50:50.919053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919594+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:50.919594+0000","last_peered":"2024-04-20T10:50:50.919594+0000","last_clean":"2024-04-20T10:50:50.919594+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:50.919594+0000","last_undegraded":"2024-04-20T10:50:50.919594+0000","last_fullsized":"2024-04-20T10:50:50.919594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919993+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:50.919993+0000","last_peered":"2024-04-20T10:50:50.919993+0000","last_clean":"2024-04-20T10:50:50.919993+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:50.919993+0000","last_undegraded":"2024-04-20T10:50:50.919993+0000","last_fullsized":"2024-04-20T10:50:50.919993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918452+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:50:50.918452+0000","last_peered":"2024-04-20T10:50:50.918452+0000","last_clean":"2024-04-20T10:50:50.918452+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:50:50.918452+0000","last_undegraded":"2024-04-20T10:50:50.918452+0000","last_fullsized":"2024-04-20T10:50:50.918452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918934+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:50:50.918934+0000","last_peered":"2024-04-20T10:50:50.918934+0000","last_clean":"2024-04-20T10:50:50.918934+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:50:50.918934+0000","last_undegraded":"2024-04-20T10:50:50.918934+0000","last_fullsized":"2024-04-20T10:50:50.918934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647503+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:50.647503+0000","last_peered":"2024-04-20T10:50:50.647503+0000","last_clean":"2024-04-20T10:50:50.647503+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:50.647503+0000","last_undegraded":"2024-04-20T10:50:50.647503+0000","last_fullsized":"2024-04-20T10:50:50.647503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919438+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:50.919438+0000","last_peered":"2024-04-20T10:50:50.919438+0000","last_clean":"2024-04-20T10:50:50.919438+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:50.919438+0000","last_undegraded":"2024-04-20T10:50:50.919438+0000","last_fullsized":"2024-04-20T10:50:50.919438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918697+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:50:50.918697+0000","last_peered":"2024-04-20T10:50:50.918697+0000","last_clean":"2024-04-20T10:50:50.918697+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:50:50.918697+0000","last_undegraded":"2024-04-20T10:50:50.918697+0000","last_fullsized":"2024-04-20T10:50:50.918697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918186+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:50.918186+0000","last_peered":"2024-04-20T10:50:50.918186+0000","last_clean":"2024-04-20T10:50:50.918186+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:50.918186+0000","last_undegraded":"2024-04-20T10:50:50.918186+0000","last_fullsized":"2024-04-20T10:50:50.918186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919238+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:50.919238+0000","last_peered":"2024-04-20T10:50:50.919238+0000","last_clean":"2024-04-20T10:50:50.919238+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:50.919238+0000","last_undegraded":"2024-04-20T10:50:50.919238+0000","last_fullsized":"2024-04-20T10:50:50.919238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919687+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:50:50.919687+0000","last_peered":"2024-04-20T10:50:50.919687+0000","last_clean":"2024-04-20T10:50:50.919687+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:50:50.919687+0000","last_undegraded":"2024-04-20T10:50:50.919687+0000","last_fullsized":"2024-04-20T10:50:50.919687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918605+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:50.918605+0000","last_peered":"2024-04-20T10:50:50.918605+0000","last_clean":"2024-04-20T10:50:50.918605+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:50.918605+0000","last_undegraded":"2024-04-20T10:50:50.918605+0000","last_fullsized":"2024-04-20T10:50:50.918605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918474+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:50.918474+0000","last_peered":"2024-04-20T10:50:50.918474+0000","last_clean":"2024-04-20T10:50:50.918474+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:50.918474+0000","last_undegraded":"2024-04-20T10:50:50.918474+0000","last_fullsized":"2024-04-20T10:50:50.918474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919237+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:50:50.919237+0000","last_peered":"2024-04-20T10:50:50.919237+0000","last_clean":"2024-04-20T10:50:50.919237+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:50:50.919237+0000","last_undegraded":"2024-04-20T10:50:50.919237+0000","last_fullsized":"2024-04-20T10:50:50.919237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919239+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:50:50.919239+0000","last_peered":"2024-04-20T10:50:50.919239+0000","last_clean":"2024-04-20T10:50:50.919239+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:50:50.919239+0000","last_undegraded":"2024-04-20T10:50:50.919239+0000","last_fullsized":"2024-04-20T10:50:50.919239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647940+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:50.647940+0000","last_peered":"2024-04-20T10:50:50.647940+0000","last_clean":"2024-04-20T10:50:50.647940+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:50.647940+0000","last_undegraded":"2024-04-20T10:50:50.647940+0000","last_fullsized":"2024-04-20T10:50:50.647940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918168+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:50.918168+0000","last_peered":"2024-04-20T10:50:50.918168+0000","last_clean":"2024-04-20T10:50:50.918168+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:50.918168+0000","last_undegraded":"2024-04-20T10:50:50.918168+0000","last_fullsized":"2024-04-20T10:50:50.918168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918735+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:50.918735+0000","last_peered":"2024-04-20T10:50:50.918735+0000","last_clean":"2024-04-20T10:50:50.918735+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:50.918735+0000","last_undegraded":"2024-04-20T10:50:50.918735+0000","last_fullsized":"2024-04-20T10:50:50.918735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904495+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:50:50.904495+0000","last_peered":"2024-04-20T10:50:50.904495+0000","last_clean":"2024-04-20T10:50:50.904495+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:50:50.904495+0000","last_undegraded":"2024-04-20T10:50:50.904495+0000","last_fullsized":"2024-04-20T10:50:50.904495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920137+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:50:50.920137+0000","last_peered":"2024-04-20T10:50:50.920137+0000","last_clean":"2024-04-20T10:50:50.920137+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:50:50.920137+0000","last_undegraded":"2024-04-20T10:50:50.920137+0000","last_fullsized":"2024-04-20T10:50:50.920137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919949+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:50.919949+0000","last_peered":"2024-04-20T10:50:50.919949+0000","last_clean":"2024-04-20T10:50:50.919949+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:50.919949+0000","last_undegraded":"2024-04-20T10:50:50.919949+0000","last_fullsized":"2024-04-20T10:50:50.919949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920093+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:50.920093+0000","last_peered":"2024-04-20T10:50:50.920093+0000","last_clean":"2024-04-20T10:50:50.920093+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:50.920093+0000","last_undegraded":"2024-04-20T10:50:50.920093+0000","last_fullsized":"2024-04-20T10:50:50.920093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904372+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:50:50.904372+0000","last_peered":"2024-04-20T10:50:50.904372+0000","last_clean":"2024-04-20T10:50:50.904372+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:50:50.904372+0000","last_undegraded":"2024-04-20T10:50:50.904372+0000","last_fullsized":"2024-04-20T10:50:50.904372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918546+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:50:50.918546+0000","last_peered":"2024-04-20T10:50:50.918546+0000","last_clean":"2024-04-20T10:50:50.918546+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:50:50.918546+0000","last_undegraded":"2024-04-20T10:50:50.918546+0000","last_fullsized":"2024-04-20T10:50:50.918546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919184+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:50.919184+0000","last_peered":"2024-04-20T10:50:50.919184+0000","last_clean":"2024-04-20T10:50:50.919184+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:50.919184+0000","last_undegraded":"2024-04-20T10:50:50.919184+0000","last_fullsized":"2024-04-20T10:50:50.919184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920068+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:50.920068+0000","last_peered":"2024-04-20T10:50:50.920068+0000","last_clean":"2024-04-20T10:50:50.920068+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:50.920068+0000","last_undegraded":"2024-04-20T10:50:50.920068+0000","last_fullsized":"2024-04-20T10:50:50.920068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918899+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:50:50.918899+0000","last_peered":"2024-04-20T10:50:50.918899+0000","last_clean":"2024-04-20T10:50:50.918899+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:50:50.918899+0000","last_undegraded":"2024-04-20T10:50:50.918899+0000","last_fullsized":"2024-04-20T10:50:50.918899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918088+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:50:50.918088+0000","last_peered":"2024-04-20T10:50:50.918088+0000","last_clean":"2024-04-20T10:50:50.918088+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:50:50.918088+0000","last_undegraded":"2024-04-20T10:50:50.918088+0000","last_fullsized":"2024-04-20T10:50:50.918088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920183+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:50.920183+0000","last_peered":"2024-04-20T10:50:50.920183+0000","last_clean":"2024-04-20T10:50:50.920183+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:50.920183+0000","last_undegraded":"2024-04-20T10:50:50.920183+0000","last_fullsized":"2024-04-20T10:50:50.920183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918853+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:50.918853+0000","last_peered":"2024-04-20T10:50:50.918853+0000","last_clean":"2024-04-20T10:50:50.918853+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:50.918853+0000","last_undegraded":"2024-04-20T10:50:50.918853+0000","last_fullsized":"2024-04-20T10:50:50.918853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918057+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:50:50.918057+0000","last_peered":"2024-04-20T10:50:50.918057+0000","last_clean":"2024-04-20T10:50:50.918057+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:50:50.918057+0000","last_undegraded":"2024-04-20T10:50:50.918057+0000","last_fullsized":"2024-04-20T10:50:50.918057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919612+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:50:50.919612+0000","last_peered":"2024-04-20T10:50:50.919612+0000","last_clean":"2024-04-20T10:50:50.919612+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:50:50.919612+0000","last_undegraded":"2024-04-20T10:50:50.919612+0000","last_fullsized":"2024-04-20T10:50:50.919612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647644+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:50.647644+0000","last_peered":"2024-04-20T10:50:50.647644+0000","last_clean":"2024-04-20T10:50:50.647644+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:50.647644+0000","last_undegraded":"2024-04-20T10:50:50.647644+0000","last_fullsized":"2024-04-20T10:50:50.647644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646587+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:50:50.646587+0000","last_peered":"2024-04-20T10:50:50.646587+0000","last_clean":"2024-04-20T10:50:50.646587+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:50:50.646587+0000","last_undegraded":"2024-04-20T10:50:50.646587+0000","last_fullsized":"2024-04-20T10:50:50.646587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647705+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:50:50.647705+0000","last_peered":"2024-04-20T10:50:50.647705+0000","last_clean":"2024-04-20T10:50:50.647705+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:50:50.647705+0000","last_undegraded":"2024-04-20T10:50:50.647705+0000","last_fullsized":"2024-04-20T10:50:50.647705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918736+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:50.918736+0000","last_peered":"2024-04-20T10:50:50.918736+0000","last_clean":"2024-04-20T10:50:50.918736+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:50.918736+0000","last_undegraded":"2024-04-20T10:50:50.918736+0000","last_fullsized":"2024-04-20T10:50:50.918736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918257+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:50.918257+0000","last_peered":"2024-04-20T10:50:50.918257+0000","last_clean":"2024-04-20T10:50:50.918257+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:50.918257+0000","last_undegraded":"2024-04-20T10:50:50.918257+0000","last_fullsized":"2024-04-20T10:50:50.918257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919316+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:50:50.919316+0000","last_peered":"2024-04-20T10:50:50.919316+0000","last_clean":"2024-04-20T10:50:50.919316+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:50:50.919316+0000","last_undegraded":"2024-04-20T10:50:50.919316+0000","last_fullsized":"2024-04-20T10:50:50.919316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918977+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:50:50.918977+0000","last_peered":"2024-04-20T10:50:50.918977+0000","last_clean":"2024-04-20T10:50:50.918977+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:50:50.918977+0000","last_undegraded":"2024-04-20T10:50:50.918977+0000","last_fullsized":"2024-04-20T10:50:50.918977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904080+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:50.904080+0000","last_peered":"2024-04-20T10:50:50.904080+0000","last_clean":"2024-04-20T10:50:50.904080+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:50.904080+0000","last_undegraded":"2024-04-20T10:50:50.904080+0000","last_fullsized":"2024-04-20T10:50:50.904080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904487+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:50.904487+0000","last_peered":"2024-04-20T10:50:50.904487+0000","last_clean":"2024-04-20T10:50:50.904487+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:50.904487+0000","last_undegraded":"2024-04-20T10:50:50.904487+0000","last_fullsized":"2024-04-20T10:50:50.904487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647768+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:50:50.647768+0000","last_peered":"2024-04-20T10:50:50.647768+0000","last_clean":"2024-04-20T10:50:50.647768+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:50:50.647768+0000","last_undegraded":"2024-04-20T10:50:50.647768+0000","last_fullsized":"2024-04-20T10:50:50.647768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918820+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:50:50.918820+0000","last_peered":"2024-04-20T10:50:50.918820+0000","last_clean":"2024-04-20T10:50:50.918820+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:50:50.918820+0000","last_undegraded":"2024-04-20T10:50:50.918820+0000","last_fullsized":"2024-04-20T10:50:50.918820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919283+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:50.919283+0000","last_peered":"2024-04-20T10:50:50.919283+0000","last_clean":"2024-04-20T10:50:50.919283+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:50.919283+0000","last_undegraded":"2024-04-20T10:50:50.919283+0000","last_fullsized":"2024-04-20T10:50:50.919283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919373+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:50.919373+0000","last_peered":"2024-04-20T10:50:50.919373+0000","last_clean":"2024-04-20T10:50:50.919373+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:50.919373+0000","last_undegraded":"2024-04-20T10:50:50.919373+0000","last_fullsized":"2024-04-20T10:50:50.919373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:51:13.206557+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:51:13.206557+0000","last_peered":"2024-04-20T10:51:13.206557+0000","last_clean":"2024-04-20T10:51:13.206557+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:51:13.206557+0000","last_undegraded":"2024-04-20T10:51:13.206557+0000","last_fullsized":"2024-04-20T10:51:13.206557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648149+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:50:50.648149+0000","last_peered":"2024-04-20T10:50:50.648149+0000","last_clean":"2024-04-20T10:50:50.648149+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:50:50.648149+0000","last_undegraded":"2024-04-20T10:50:50.648149+0000","last_fullsized":"2024-04-20T10:50:50.648149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918773+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:50.918773+0000","last_peered":"2024-04-20T10:50:50.918773+0000","last_clean":"2024-04-20T10:50:50.918773+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:50.918773+0000","last_undegraded":"2024-04-20T10:50:50.918773+0000","last_fullsized":"2024-04-20T10:50:50.918773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919619+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:50.919619+0000","last_peered":"2024-04-20T10:50:50.919619+0000","last_clean":"2024-04-20T10:50:50.919619+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:50.919619+0000","last_undegraded":"2024-04-20T10:50:50.919619+0000","last_fullsized":"2024-04-20T10:50:50.919619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919480+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:50:50.919480+0000","last_peered":"2024-04-20T10:50:50.919480+0000","last_clean":"2024-04-20T10:50:50.919480+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:50:50.919480+0000","last_undegraded":"2024-04-20T10:50:50.919480+0000","last_fullsized":"2024-04-20T10:50:50.919480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647622+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:50:50.647622+0000","last_peered":"2024-04-20T10:50:50.647622+0000","last_clean":"2024-04-20T10:50:50.647622+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:50:50.647622+0000","last_undegraded":"2024-04-20T10:50:50.647622+0000","last_fullsized":"2024-04-20T10:50:50.647622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919782+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:50.919782+0000","last_peered":"2024-04-20T10:50:50.919782+0000","last_clean":"2024-04-20T10:50:50.919782+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:50.919782+0000","last_undegraded":"2024-04-20T10:50:50.919782+0000","last_fullsized":"2024-04-20T10:50:50.919782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:51:10.729406+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:51:10.729406+0000","last_peered":"2024-04-20T10:51:10.729406+0000","last_clean":"2024-04-20T10:51:10.729406+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:51:10.729406+0000","last_undegraded":"2024-04-20T10:51:10.729406+0000","last_fullsized":"2024-04-20T10:51:10.729406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918370+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:50:50.918370+0000","last_peered":"2024-04-20T10:50:50.918370+0000","last_clean":"2024-04-20T10:50:50.918370+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:50:50.918370+0000","last_undegraded":"2024-04-20T10:50:50.918370+0000","last_fullsized":"2024-04-20T10:50:50.918370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918531+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:50:50.918531+0000","last_peered":"2024-04-20T10:50:50.918531+0000","last_clean":"2024-04-20T10:50:50.918531+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:50:50.918531+0000","last_undegraded":"2024-04-20T10:50:50.918531+0000","last_fullsized":"2024-04-20T10:50:50.918531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647604+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:50.647604+0000","last_peered":"2024-04-20T10:50:50.647604+0000","last_clean":"2024-04-20T10:50:50.647604+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:50.647604+0000","last_undegraded":"2024-04-20T10:50:50.647604+0000","last_fullsized":"2024-04-20T10:50:50.647604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647241+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:50:50.647241+0000","last_peered":"2024-04-20T10:50:50.647241+0000","last_clean":"2024-04-20T10:50:50.647241+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:50:50.647241+0000","last_undegraded":"2024-04-20T10:50:50.647241+0000","last_fullsized":"2024-04-20T10:50:50.647241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904476+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:50:50.904476+0000","last_peered":"2024-04-20T10:50:50.904476+0000","last_clean":"2024-04-20T10:50:50.904476+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:50:50.904476+0000","last_undegraded":"2024-04-20T10:50:50.904476+0000","last_fullsized":"2024-04-20T10:50:50.904476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919071+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:50.919071+0000","last_peered":"2024-04-20T10:50:50.919071+0000","last_clean":"2024-04-20T10:50:50.919071+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:50.919071+0000","last_undegraded":"2024-04-20T10:50:50.919071+0000","last_fullsized":"2024-04-20T10:50:50.919071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919039+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:50.919039+0000","last_peered":"2024-04-20T10:50:50.919039+0000","last_clean":"2024-04-20T10:50:50.919039+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:50.919039+0000","last_undegraded":"2024-04-20T10:50:50.919039+0000","last_fullsized":"2024-04-20T10:50:50.919039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647348+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:50:50.647348+0000","last_peered":"2024-04-20T10:50:50.647348+0000","last_clean":"2024-04-20T10:50:50.647348+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:50:50.647348+0000","last_undegraded":"2024-04-20T10:50:50.647348+0000","last_fullsized":"2024-04-20T10:50:50.647348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918201+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:50:50.918201+0000","last_peered":"2024-04-20T10:50:50.918201+0000","last_clean":"2024-04-20T10:50:50.918201+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:50:50.918201+0000","last_undegraded":"2024-04-20T10:50:50.918201+0000","last_fullsized":"2024-04-20T10:50:50.918201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919011+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:50.919011+0000","last_peered":"2024-04-20T10:50:50.919011+0000","last_clean":"2024-04-20T10:50:50.919011+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:50.919011+0000","last_undegraded":"2024-04-20T10:50:50.919011+0000","last_fullsized":"2024-04-20T10:50:50.919011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904919+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:50.904919+0000","last_peered":"2024-04-20T10:50:50.904919+0000","last_clean":"2024-04-20T10:50:50.904919+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:50.904919+0000","last_undegraded":"2024-04-20T10:50:50.904919+0000","last_fullsized":"2024-04-20T10:50:50.904919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647257+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:50:50.647257+0000","last_peered":"2024-04-20T10:50:50.647257+0000","last_clean":"2024-04-20T10:50:50.647257+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:50:50.647257+0000","last_undegraded":"2024-04-20T10:50:50.647257+0000","last_fullsized":"2024-04-20T10:50:50.647257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904798+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:50:50.904798+0000","last_peered":"2024-04-20T10:50:50.904798+0000","last_clean":"2024-04-20T10:50:50.904798+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:50:50.904798+0000","last_undegraded":"2024-04-20T10:50:50.904798+0000","last_fullsized":"2024-04-20T10:50:50.904798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919143+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:50:50.919143+0000","last_peered":"2024-04-20T10:50:50.919143+0000","last_clean":"2024-04-20T10:50:50.919143+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:50:50.919143+0000","last_undegraded":"2024-04-20T10:50:50.919143+0000","last_fullsized":"2024-04-20T10:50:50.919143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918587+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:50.918587+0000","last_peered":"2024-04-20T10:50:50.918587+0000","last_clean":"2024-04-20T10:50:50.918587+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:50.918587+0000","last_undegraded":"2024-04-20T10:50:50.918587+0000","last_fullsized":"2024-04-20T10:50:50.918587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918226+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:50.918226+0000","last_peered":"2024-04-20T10:50:50.918226+0000","last_clean":"2024-04-20T10:50:50.918226+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:50.918226+0000","last_undegraded":"2024-04-20T10:50:50.918226+0000","last_fullsized":"2024-04-20T10:50:50.918226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919055+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:50:50.919055+0000","last_peered":"2024-04-20T10:50:50.919055+0000","last_clean":"2024-04-20T10:50:50.919055+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:50:50.919055+0000","last_undegraded":"2024-04-20T10:50:50.919055+0000","last_fullsized":"2024-04-20T10:50:50.919055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904885+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:50:50.904885+0000","last_peered":"2024-04-20T10:50:50.904885+0000","last_clean":"2024-04-20T10:50:50.904885+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:50:50.904885+0000","last_undegraded":"2024-04-20T10:50:50.904885+0000","last_fullsized":"2024-04-20T10:50:50.904885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647617+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:50.647617+0000","last_peered":"2024-04-20T10:50:50.647617+0000","last_clean":"2024-04-20T10:50:50.647617+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:50.647617+0000","last_undegraded":"2024-04-20T10:50:50.647617+0000","last_fullsized":"2024-04-20T10:50:50.647617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647427+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:50.647427+0000","last_peered":"2024-04-20T10:50:50.647427+0000","last_clean":"2024-04-20T10:50:50.647427+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:50.647427+0000","last_undegraded":"2024-04-20T10:50:50.647427+0000","last_fullsized":"2024-04-20T10:50:50.647427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919353+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:50:50.919353+0000","last_peered":"2024-04-20T10:50:50.919353+0000","last_clean":"2024-04-20T10:50:50.919353+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:50:50.919353+0000","last_undegraded":"2024-04-20T10:50:50.919353+0000","last_fullsized":"2024-04-20T10:50:50.919353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904598+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:50.904598+0000","last_peered":"2024-04-20T10:50:50.904598+0000","last_clean":"2024-04-20T10:50:50.904598+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:50.904598+0000","last_undegraded":"2024-04-20T10:50:50.904598+0000","last_fullsized":"2024-04-20T10:50:50.904598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919448+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:50.919448+0000","last_peered":"2024-04-20T10:50:50.919448+0000","last_clean":"2024-04-20T10:50:50.919448+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:50.919448+0000","last_undegraded":"2024-04-20T10:50:50.919448+0000","last_fullsized":"2024-04-20T10:50:50.919448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919923+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:50:50.919923+0000","last_peered":"2024-04-20T10:50:50.919923+0000","last_clean":"2024-04-20T10:50:50.919923+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:50:50.919923+0000","last_undegraded":"2024-04-20T10:50:50.919923+0000","last_fullsized":"2024-04-20T10:50:50.919923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646954+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:50:50.646954+0000","last_peered":"2024-04-20T10:50:50.646954+0000","last_clean":"2024-04-20T10:50:50.646954+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:50:50.646954+0000","last_undegraded":"2024-04-20T10:50:50.646954+0000","last_fullsized":"2024-04-20T10:50:50.646954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647875+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:50.647875+0000","last_peered":"2024-04-20T10:50:50.647875+0000","last_clean":"2024-04-20T10:50:50.647875+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:50.647875+0000","last_undegraded":"2024-04-20T10:50:50.647875+0000","last_fullsized":"2024-04-20T10:50:50.647875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647129+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:50.647129+0000","last_peered":"2024-04-20T10:50:50.647129+0000","last_clean":"2024-04-20T10:50:50.647129+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:50.647129+0000","last_undegraded":"2024-04-20T10:50:50.647129+0000","last_fullsized":"2024-04-20T10:50:50.647129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648051+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:50:50.648051+0000","last_peered":"2024-04-20T10:50:50.648051+0000","last_clean":"2024-04-20T10:50:50.648051+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:50:50.648051+0000","last_undegraded":"2024-04-20T10:50:50.648051+0000","last_fullsized":"2024-04-20T10:50:50.648051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648041+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:50:50.648041+0000","last_peered":"2024-04-20T10:50:50.648041+0000","last_clean":"2024-04-20T10:50:50.648041+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:50:50.648041+0000","last_undegraded":"2024-04-20T10:50:50.648041+0000","last_fullsized":"2024-04-20T10:50:50.648041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904067+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:50.904067+0000","last_peered":"2024-04-20T10:50:50.904067+0000","last_clean":"2024-04-20T10:50:50.904067+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:50.904067+0000","last_undegraded":"2024-04-20T10:50:50.904067+0000","last_fullsized":"2024-04-20T10:50:50.904067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919274+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:50:50.919274+0000","last_peered":"2024-04-20T10:50:50.919274+0000","last_clean":"2024-04-20T10:50:50.919274+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:50:50.919274+0000","last_undegraded":"2024-04-20T10:50:50.919274+0000","last_fullsized":"2024-04-20T10:50:50.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918980+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:50.918980+0000","last_peered":"2024-04-20T10:50:50.918980+0000","last_clean":"2024-04-20T10:50:50.918980+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:50.918980+0000","last_undegraded":"2024-04-20T10:50:50.918980+0000","last_fullsized":"2024-04-20T10:50:50.918980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918617+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:50:50.918617+0000","last_peered":"2024-04-20T10:50:50.918617+0000","last_clean":"2024-04-20T10:50:50.918617+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:50:50.918617+0000","last_undegraded":"2024-04-20T10:50:50.918617+0000","last_fullsized":"2024-04-20T10:50:50.918617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919308+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:50.919308+0000","last_peered":"2024-04-20T10:50:50.919308+0000","last_clean":"2024-04-20T10:50:50.919308+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:50.919308+0000","last_undegraded":"2024-04-20T10:50:50.919308+0000","last_fullsized":"2024-04-20T10:50:50.919308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919405+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:50.919405+0000","last_peered":"2024-04-20T10:50:50.919405+0000","last_clean":"2024-04-20T10:50:50.919405+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:50.919405+0000","last_undegraded":"2024-04-20T10:50:50.919405+0000","last_fullsized":"2024-04-20T10:50:50.919405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918338+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:50:50.918338+0000","last_peered":"2024-04-20T10:50:50.918338+0000","last_clean":"2024-04-20T10:50:50.918338+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:50:50.918338+0000","last_undegraded":"2024-04-20T10:50:50.918338+0000","last_fullsized":"2024-04-20T10:50:50.918338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648264+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:50.648264+0000","last_peered":"2024-04-20T10:50:50.648264+0000","last_clean":"2024-04-20T10:50:50.648264+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:50.648264+0000","last_undegraded":"2024-04-20T10:50:50.648264+0000","last_fullsized":"2024-04-20T10:50:50.648264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647153+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:50:50.647153+0000","last_peered":"2024-04-20T10:50:50.647153+0000","last_clean":"2024-04-20T10:50:50.647153+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:50:50.647153+0000","last_undegraded":"2024-04-20T10:50:50.647153+0000","last_fullsized":"2024-04-20T10:50:50.647153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919569+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:50.919569+0000","last_peered":"2024-04-20T10:50:50.919569+0000","last_clean":"2024-04-20T10:50:50.919569+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:50.919569+0000","last_undegraded":"2024-04-20T10:50:50.919569+0000","last_fullsized":"2024-04-20T10:50:50.919569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904775+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:50.904775+0000","last_peered":"2024-04-20T10:50:50.904775+0000","last_clean":"2024-04-20T10:50:50.904775+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:50.904775+0000","last_undegraded":"2024-04-20T10:50:50.904775+0000","last_fullsized":"2024-04-20T10:50:50.904775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904299+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:50:50.904299+0000","last_peered":"2024-04-20T10:50:50.904299+0000","last_clean":"2024-04-20T10:50:50.904299+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:50:50.904299+0000","last_undegraded":"2024-04-20T10:50:50.904299+0000","last_fullsized":"2024-04-20T10:50:50.904299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647767+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:50.647767+0000","last_peered":"2024-04-20T10:50:50.647767+0000","last_clean":"2024-04-20T10:50:50.647767+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:50.647767+0000","last_undegraded":"2024-04-20T10:50:50.647767+0000","last_fullsized":"2024-04-20T10:50:50.647767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647843+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:50:50.647843+0000","last_peered":"2024-04-20T10:50:50.647843+0000","last_clean":"2024-04-20T10:50:50.647843+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:50:50.647843+0000","last_undegraded":"2024-04-20T10:50:50.647843+0000","last_fullsized":"2024-04-20T10:50:50.647843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918116+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:50.918116+0000","last_peered":"2024-04-20T10:50:50.918116+0000","last_clean":"2024-04-20T10:50:50.918116+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:50.918116+0000","last_undegraded":"2024-04-20T10:50:50.918116+0000","last_fullsized":"2024-04-20T10:50:50.918116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920306+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:50:50.920306+0000","last_peered":"2024-04-20T10:50:50.920306+0000","last_clean":"2024-04-20T10:50:50.920306+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:50:50.920306+0000","last_undegraded":"2024-04-20T10:50:50.920306+0000","last_fullsized":"2024-04-20T10:50:50.920306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647324+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:50.647324+0000","last_peered":"2024-04-20T10:50:50.647324+0000","last_clean":"2024-04-20T10:50:50.647324+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:50.647324+0000","last_undegraded":"2024-04-20T10:50:50.647324+0000","last_fullsized":"2024-04-20T10:50:50.647324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919821+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:50:50.919821+0000","last_peered":"2024-04-20T10:50:50.919821+0000","last_clean":"2024-04-20T10:50:50.919821+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:50:50.919821+0000","last_undegraded":"2024-04-20T10:50:50.919821+0000","last_fullsized":"2024-04-20T10:50:50.919821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919185+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:50.919185+0000","last_peered":"2024-04-20T10:50:50.919185+0000","last_clean":"2024-04-20T10:50:50.919185+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:50.919185+0000","last_undegraded":"2024-04-20T10:50:50.919185+0000","last_fullsized":"2024-04-20T10:50:50.919185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647822+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:50:50.647822+0000","last_peered":"2024-04-20T10:50:50.647822+0000","last_clean":"2024-04-20T10:50:50.647822+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:50:50.647822+0000","last_undegraded":"2024-04-20T10:50:50.647822+0000","last_fullsized":"2024-04-20T10:50:50.647822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919221+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:50.919221+0000","last_peered":"2024-04-20T10:50:50.919221+0000","last_clean":"2024-04-20T10:50:50.919221+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:50.919221+0000","last_undegraded":"2024-04-20T10:50:50.919221+0000","last_fullsized":"2024-04-20T10:50:50.919221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646687+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:50:50.646687+0000","last_peered":"2024-04-20T10:50:50.646687+0000","last_clean":"2024-04-20T10:50:50.646687+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:50:50.646687+0000","last_undegraded":"2024-04-20T10:50:50.646687+0000","last_fullsized":"2024-04-20T10:50:50.646687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904324+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:50.904324+0000","last_peered":"2024-04-20T10:50:50.904324+0000","last_clean":"2024-04-20T10:50:50.904324+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:50.904324+0000","last_undegraded":"2024-04-20T10:50:50.904324+0000","last_fullsized":"2024-04-20T10:50:50.904324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646680+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:50:50.646680+0000","last_peered":"2024-04-20T10:50:50.646680+0000","last_clean":"2024-04-20T10:50:50.646680+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:50:50.646680+0000","last_undegraded":"2024-04-20T10:50:50.646680+0000","last_fullsized":"2024-04-20T10:50:50.646680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920058+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:50.920058+0000","last_peered":"2024-04-20T10:50:50.920058+0000","last_clean":"2024-04-20T10:50:50.920058+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:50.920058+0000","last_undegraded":"2024-04-20T10:50:50.920058+0000","last_fullsized":"2024-04-20T10:50:50.920058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918048+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:50:50.918048+0000","last_peered":"2024-04-20T10:50:50.918048+0000","last_clean":"2024-04-20T10:50:50.918048+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:50:50.918048+0000","last_undegraded":"2024-04-20T10:50:50.918048+0000","last_fullsized":"2024-04-20T10:50:50.918048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918749+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:50.918749+0000","last_peered":"2024-04-20T10:50:50.918749+0000","last_clean":"2024-04-20T10:50:50.918749+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:50.918749+0000","last_undegraded":"2024-04-20T10:50:50.918749+0000","last_fullsized":"2024-04-20T10:50:50.918749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918281+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:50:50.918281+0000","last_peered":"2024-04-20T10:50:50.918281+0000","last_clean":"2024-04-20T10:50:50.918281+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:50:50.918281+0000","last_undegraded":"2024-04-20T10:50:50.918281+0000","last_fullsized":"2024-04-20T10:50:50.918281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919598+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:50.919598+0000","last_peered":"2024-04-20T10:50:50.919598+0000","last_clean":"2024-04-20T10:50:50.919598+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:50.919598+0000","last_undegraded":"2024-04-20T10:50:50.919598+0000","last_fullsized":"2024-04-20T10:50:50.919598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919839+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:50:50.919839+0000","last_peered":"2024-04-20T10:50:50.919839+0000","last_clean":"2024-04-20T10:50:50.919839+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:50:50.919839+0000","last_undegraded":"2024-04-20T10:50:50.919839+0000","last_fullsized":"2024-04-20T10:50:50.919839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918109+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:50.918109+0000","last_peered":"2024-04-20T10:50:50.918109+0000","last_clean":"2024-04-20T10:50:50.918109+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:50.918109+0000","last_undegraded":"2024-04-20T10:50:50.918109+0000","last_fullsized":"2024-04-20T10:50:50.918109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647462+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:50:50.647462+0000","last_peered":"2024-04-20T10:50:50.647462+0000","last_clean":"2024-04-20T10:50:50.647462+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:50:50.647462+0000","last_undegraded":"2024-04-20T10:50:50.647462+0000","last_fullsized":"2024-04-20T10:50:50.647462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918682+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:50.918682+0000","last_peered":"2024-04-20T10:50:50.918682+0000","last_clean":"2024-04-20T10:50:50.918682+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:50.918682+0000","last_undegraded":"2024-04-20T10:50:50.918682+0000","last_fullsized":"2024-04-20T10:50:50.918682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918787+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:50:50.918787+0000","last_peered":"2024-04-20T10:50:50.918787+0000","last_clean":"2024-04-20T10:50:50.918787+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:50:50.918787+0000","last_undegraded":"2024-04-20T10:50:50.918787+0000","last_fullsized":"2024-04-20T10:50:50.918787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918739+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:50.918739+0000","last_peered":"2024-04-20T10:50:50.918739+0000","last_clean":"2024-04-20T10:50:50.918739+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:50.918739+0000","last_undegraded":"2024-04-20T10:50:50.918739+0000","last_fullsized":"2024-04-20T10:50:50.918739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647651+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:50.647651+0000","last_peered":"2024-04-20T10:50:50.647651+0000","last_clean":"2024-04-20T10:50:50.647651+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:50.647651+0000","last_undegraded":"2024-04-20T10:50:50.647651+0000","last_fullsized":"2024-04-20T10:50:50.647651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647567+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:50.647567+0000","last_peered":"2024-04-20T10:50:50.647567+0000","last_clean":"2024-04-20T10:50:50.647567+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:50.647567+0000","last_undegraded":"2024-04-20T10:50:50.647567+0000","last_fullsized":"2024-04-20T10:50:50.647567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919983+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:50:50.919983+0000","last_peered":"2024-04-20T10:50:50.919983+0000","last_clean":"2024-04-20T10:50:50.919983+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:50:50.919983+0000","last_undegraded":"2024-04-20T10:50:50.919983+0000","last_fullsized":"2024-04-20T10:50:50.919983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918676+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:50:50.918676+0000","last_peered":"2024-04-20T10:50:50.918676+0000","last_clean":"2024-04-20T10:50:50.918676+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:50:50.918676+0000","last_undegraded":"2024-04-20T10:50:50.918676+0000","last_fullsized":"2024-04-20T10:50:50.918676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904771+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:50.904771+0000","last_peered":"2024-04-20T10:50:50.904771+0000","last_clean":"2024-04-20T10:50:50.904771+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:50.904771+0000","last_undegraded":"2024-04-20T10:50:50.904771+0000","last_fullsized":"2024-04-20T10:50:50.904771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918237+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:50:50.918237+0000","last_peered":"2024-04-20T10:50:50.918237+0000","last_clean":"2024-04-20T10:50:50.918237+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:50:50.918237+0000","last_undegraded":"2024-04-20T10:50:50.918237+0000","last_fullsized":"2024-04-20T10:50:50.918237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920158+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:50.920158+0000","last_peered":"2024-04-20T10:50:50.920158+0000","last_clean":"2024-04-20T10:50:50.920158+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:50.920158+0000","last_undegraded":"2024-04-20T10:50:50.920158+0000","last_fullsized":"2024-04-20T10:50:50.920158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647709+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:50:50.647709+0000","last_peered":"2024-04-20T10:50:50.647709+0000","last_clean":"2024-04-20T10:50:50.647709+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:50:50.647709+0000","last_undegraded":"2024-04-20T10:50:50.647709+0000","last_fullsized":"2024-04-20T10:50:50.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647411+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:50.647411+0000","last_peered":"2024-04-20T10:50:50.647411+0000","last_clean":"2024-04-20T10:50:50.647411+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:50.647411+0000","last_undegraded":"2024-04-20T10:50:50.647411+0000","last_fullsized":"2024-04-20T10:50:50.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904808+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:50:50.904808+0000","last_peered":"2024-04-20T10:50:50.904808+0000","last_clean":"2024-04-20T10:50:50.904808+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:50:50.904808+0000","last_undegraded":"2024-04-20T10:50:50.904808+0000","last_fullsized":"2024-04-20T10:50:50.904808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918551+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:50.918551+0000","last_peered":"2024-04-20T10:50:50.918551+0000","last_clean":"2024-04-20T10:50:50.918551+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:50.918551+0000","last_undegraded":"2024-04-20T10:50:50.918551+0000","last_fullsized":"2024-04-20T10:50:50.918551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919755+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:50:50.919755+0000","last_peered":"2024-04-20T10:50:50.919755+0000","last_clean":"2024-04-20T10:50:50.919755+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:50:50.919755+0000","last_undegraded":"2024-04-20T10:50:50.919755+0000","last_fullsized":"2024-04-20T10:50:50.919755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919134+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:50.919134+0000","last_peered":"2024-04-20T10:50:50.919134+0000","last_clean":"2024-04-20T10:50:50.919134+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:50.919134+0000","last_undegraded":"2024-04-20T10:50:50.919134+0000","last_fullsized":"2024-04-20T10:50:50.919134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919397+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:50:50.919397+0000","last_peered":"2024-04-20T10:50:50.919397+0000","last_clean":"2024-04-20T10:50:50.919397+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:50:50.919397+0000","last_undegraded":"2024-04-20T10:50:50.919397+0000","last_fullsized":"2024-04-20T10:50:50.919397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919182+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:50.919182+0000","last_peered":"2024-04-20T10:50:50.919182+0000","last_clean":"2024-04-20T10:50:50.919182+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:50.919182+0000","last_undegraded":"2024-04-20T10:50:50.919182+0000","last_fullsized":"2024-04-20T10:50:50.919182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919141+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:50.919141+0000","last_peered":"2024-04-20T10:50:50.919141+0000","last_clean":"2024-04-20T10:50:50.919141+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:50.919141+0000","last_undegraded":"2024-04-20T10:50:50.919141+0000","last_fullsized":"2024-04-20T10:50:50.919141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919836+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:50:50.919836+0000","last_peered":"2024-04-20T10:50:50.919836+0000","last_clean":"2024-04-20T10:50:50.919836+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:50:50.919836+0000","last_undegraded":"2024-04-20T10:50:50.919836+0000","last_fullsized":"2024-04-20T10:50:50.919836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919036+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:50.919036+0000","last_peered":"2024-04-20T10:50:50.919036+0000","last_clean":"2024-04-20T10:50:50.919036+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:50.919036+0000","last_undegraded":"2024-04-20T10:50:50.919036+0000","last_fullsized":"2024-04-20T10:50:50.919036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918038+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:50:50.918038+0000","last_peered":"2024-04-20T10:50:50.918038+0000","last_clean":"2024-04-20T10:50:50.918038+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:50:50.918038+0000","last_undegraded":"2024-04-20T10:50:50.918038+0000","last_fullsized":"2024-04-20T10:50:50.918038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919810+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:50.919810+0000","last_peered":"2024-04-20T10:50:50.919810+0000","last_clean":"2024-04-20T10:50:50.919810+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:50.919810+0000","last_undegraded":"2024-04-20T10:50:50.919810+0000","last_fullsized":"2024-04-20T10:50:50.919810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918353+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:50:50.918353+0000","last_peered":"2024-04-20T10:50:50.918353+0000","last_clean":"2024-04-20T10:50:50.918353+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:50:50.918353+0000","last_undegraded":"2024-04-20T10:50:50.918353+0000","last_fullsized":"2024-04-20T10:50:50.918353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920113+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:50.920113+0000","last_peered":"2024-04-20T10:50:50.920113+0000","last_clean":"2024-04-20T10:50:50.920113+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:50.920113+0000","last_undegraded":"2024-04-20T10:50:50.920113+0000","last_fullsized":"2024-04-20T10:50:50.920113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3653,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":108677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":105982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:51:17.873 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:51:18.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.001+0000 7f184549a640 1 Processor -- start 2024-04-20T10:51:18.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.001+0000 7f184549a640 1 -- start start 2024-04-20T10:51:18.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f184549a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 0x7f184006cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f184549a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f18400c6a00 0x7f184015a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f184549a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18400c6e60 con 0x7f18400c9f80 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f184549a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f184015ad50 con 0x7f18400c6a00 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f184549a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f184006c7b0 con 0x7f1840153df0 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183f7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f18400c9f80 0x7f18400c8a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50900/0 (socket says 172.21.15.90:50900) 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183f7fe640 1 -- 172.21.15.90:0/2806711520 learned_addr learned my addr 172.21.15.90:0/2806711520 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972815835 0 0) 0x7f18400c6e60 con 0x7f18400c9f80 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1828003520 con 0x7f18400c9f80 2024-04-20T10:51:18.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183effd640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 0x7f184006cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183e7fc640 1 --2- 172.21.15.90:0/2806711520 >> v2:172.21.15.175:3300/0 conn(0x7f18400c6a00 0x7f184015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 796924873 0 0) 0x7f1828003520 con 0x7f18400c9f80 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 msgr2=0x7f184006cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 0x7f184006cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 >> v2:172.21.15.175:3300/0 conn(0x7f18400c6a00 msgr2=0x7f184015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 --2- 172.21.15.90:0/2806711520 >> v2:172.21.15.175:3300/0 conn(0x7f18400c6a00 0x7f184015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18400c7100 con 0x7f18400c9f80 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f18380019f0 con 0x7f18400c9f80 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 >> v1:172.21.15.90:6789/0 conn(0x7f18400c9f80 legacy=0x7f18400c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18280039b0 0x7f1828003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 0x7f1828004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1828004d40 0x7f18280051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f184006c7b0 con 0x7f18280039b0 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f182800bb50 con 0x7f1828004d40 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f182800bd50 con 0x7f1840153df0 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.002+0000 7f183effd640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18280039b0 0x7f1828003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183e7fc640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 0x7f1828004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183f7fe640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1828004d40 0x7f18280051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183effd640 1 -- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 msgr2=0x7f1828004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183effd640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840153df0 0x7f1828004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183effd640 1 -- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1828004d40 msgr2=0x7f18280051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:18.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183effd640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1828004d40 0x7f18280051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183effd640 1 -- 172.21.15.90:0/2806711520 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1828003520 con 0x7f18280039b0 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.003+0000 7f183f7fe640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1828004d40 0x7f18280051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f183effd640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18280039b0 0x7f1828003dd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f183000ba30 tx=0x7f1828005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23882c4874068e34 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1830036020 con 0x7f18280039b0 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1830032640 con 0x7f18280039b0 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f183dffb640 1 -- 172.21.15.90:0/2806711520 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183000b600 con 0x7f18280039b0 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f184549a640 1 -- 172.21.15.90:0/2806711520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18280039b0 msgr2=0x7f1828003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f184549a640 1 --2- 172.21.15.90:0/2806711520 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18280039b0 0x7f1828003dd0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f183000ba30 tx=0x7f1828005830 comp rx=0 tx=0).stop 2024-04-20T10:51:18.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f183f7fe640 1 -- 172.21.15.90:0/2806711520 reap_dead start 2024-04-20T10:51:18.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f184549a640 1 -- 172.21.15.90:0/2806711520 shutdown_connections 2024-04-20T10:51:18.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f184549a640 1 -- 172.21.15.90:0/2806711520 >> 172.21.15.90:0/2806711520 conn(0x7f18400adbd0 msgr2=0x7f18400adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:18.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f184549a640 1 -- 172.21.15.90:0/2806711520 shutdown_connections 2024-04-20T10:51:18.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.004+0000 7f184549a640 1 -- 172.21.15.90:0/2806711520 wait complete. 2024-04-20T10:51:18.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 Processor -- start 2024-04-20T10:51:18.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 -- start start 2024-04-20T10:51:18.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18280039b0 0x7f18401ec8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840148500 0x7f18401efb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18401f0040 0x7f18401ee970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18401541d0 con 0x7f18401f0040 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f184006c440 con 0x7f18280039b0 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f184549a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f18400c73e0 con 0x7f1840148500 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f183f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18401f0040 0x7f18401ee970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f183f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18401f0040 0x7f18401ee970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48292/0 (socket says 172.21.15.90:48292) 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.006+0000 7f183f7fe640 1 -- 172.21.15.90:0/3912840250 learned_addr learned my addr 172.21.15.90:0/3912840250 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183e7fc640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840148500 0x7f18401efb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183f7fe640 1 -- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840148500 msgr2=0x7f18401efb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183effd640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18280039b0 0x7f18401ec8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183f7fe640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840148500 0x7f18401efb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183f7fe640 1 -- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18280039b0 msgr2=0x7f18401ec8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183f7fe640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18280039b0 0x7f18401ec8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183f7fe640 1 -- 172.21.15.90:0/3912840250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18401ece30 con 0x7f18401f0040 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183effd640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18280039b0 0x7f18401ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f183f7fe640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18401f0040 0x7f18401ee970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1838000f80 tx=0x7f183800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f18277fe640 1 -- 172.21.15.90:0/3912840250 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f183800eb90 con 0x7f18401f0040 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f18277fe640 1 -- 172.21.15.90:0/3912840250 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f183800ed30 con 0x7f18401f0040 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1840150830 con 0x7f18401f0040 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f18277fe640 1 -- 172.21.15.90:0/3912840250 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18380146c0 con 0x7f18401f0040 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.007+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1840150df0 con 0x7f18401f0040 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.008+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1840076150 con 0x7f18401f0040 2024-04-20T10:51:18.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.008+0000 7f18277fe640 1 -- 172.21.15.90:0/3912840250 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1838014860 con 0x7f18401f0040 2024-04-20T10:51:18.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.009+0000 7f18277fe640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f182c06c920 0x7f182c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.009+0000 7f18277fe640 1 -- 172.21.15.90:0/3912840250 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f183808bc70 con 0x7f18401f0040 2024-04-20T10:51:18.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.009+0000 7f183effd640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f182c06c920 0x7f182c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.009+0000 7f183effd640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f182c06c920 0x7f182c06ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f183000ba00 tx=0x7f1830030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.013+0000 7f18277fe640 1 -- 172.21.15.90:0/3912840250 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1838059e00 con 0x7f18401f0040 2024-04-20T10:51:18.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.183+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f18401505e0 con 0x7f182c06c920 2024-04-20T10:51:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.193+0000 7f18277fe640 1 -- 172.21.15.90:0/3912840250 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490302 (secure 0 0 0) 0x7f18401505e0 con 0x7f182c06c920 2024-04-20T10:51:18.199 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:18.202 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:51:18.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f182c06c920 msgr2=0x7f182c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f182c06c920 0x7f182c06ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f183000ba00 tx=0x7f1830030000 comp rx=0 tx=0).stop 2024-04-20T10:51:18.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18401f0040 msgr2=0x7f18401ee970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18401f0040 0x7f18401ee970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f1838000f80 tx=0x7f183800e530 comp rx=0 tx=0).stop 2024-04-20T10:51:18.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 shutdown_connections 2024-04-20T10:51:18.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f182c06c920 0x7f182c06ede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18401f0040 0x7f18401ee970 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1840148500 0x7f18401efb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 --2- 172.21.15.90:0/3912840250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18280039b0 0x7f18401ec8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 >> 172.21.15.90:0/3912840250 conn(0x7f18400adbd0 msgr2=0x7f18400adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:18.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 shutdown_connections 2024-04-20T10:51:18.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.198+0000 7f184549a640 1 -- 172.21.15.90:0/3912840250 wait complete. 2024-04-20T10:51:18.209 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-20T10:51:17.671126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596687,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":254,"num_write_kb":2449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3448832,"data_stored":2024830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1499,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646500+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:50:50.646500+0000","last_peered":"2024-04-20T10:50:50.646500+0000","last_clean":"2024-04-20T10:50:50.646500+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:50:50.646500+0000","last_undegraded":"2024-04-20T10:50:50.646500+0000","last_fullsized":"2024-04-20T10:50:50.646500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647942+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:50.647942+0000","last_peered":"2024-04-20T10:50:50.647942+0000","last_clean":"2024-04-20T10:50:50.647942+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:50.647942+0000","last_undegraded":"2024-04-20T10:50:50.647942+0000","last_fullsized":"2024-04-20T10:50:50.647942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647361+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:50:50.647361+0000","last_peered":"2024-04-20T10:50:50.647361+0000","last_clean":"2024-04-20T10:50:50.647361+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:50:50.647361+0000","last_undegraded":"2024-04-20T10:50:50.647361+0000","last_fullsized":"2024-04-20T10:50:50.647361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918471+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:50:50.918471+0000","last_peered":"2024-04-20T10:50:50.918471+0000","last_clean":"2024-04-20T10:50:50.918471+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:50:50.918471+0000","last_undegraded":"2024-04-20T10:50:50.918471+0000","last_fullsized":"2024-04-20T10:50:50.918471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648170+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:50.648170+0000","last_peered":"2024-04-20T10:50:50.648170+0000","last_clean":"2024-04-20T10:50:50.648170+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:50.648170+0000","last_undegraded":"2024-04-20T10:50:50.648170+0000","last_fullsized":"2024-04-20T10:50:50.648170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918903+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:50.918903+0000","last_peered":"2024-04-20T10:50:50.918903+0000","last_clean":"2024-04-20T10:50:50.918903+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:50.918903+0000","last_undegraded":"2024-04-20T10:50:50.918903+0000","last_fullsized":"2024-04-20T10:50:50.918903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646446+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:50:50.646446+0000","last_peered":"2024-04-20T10:50:50.646446+0000","last_clean":"2024-04-20T10:50:50.646446+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:50:50.646446+0000","last_undegraded":"2024-04-20T10:50:50.646446+0000","last_fullsized":"2024-04-20T10:50:50.646446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918478+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:50:50.918478+0000","last_peered":"2024-04-20T10:50:50.918478+0000","last_clean":"2024-04-20T10:50:50.918478+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:50:50.918478+0000","last_undegraded":"2024-04-20T10:50:50.918478+0000","last_fullsized":"2024-04-20T10:50:50.918478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920014+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:50.920014+0000","last_peered":"2024-04-20T10:50:50.920014+0000","last_clean":"2024-04-20T10:50:50.920014+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:50.920014+0000","last_undegraded":"2024-04-20T10:50:50.920014+0000","last_fullsized":"2024-04-20T10:50:50.920014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918841+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:50.918841+0000","last_peered":"2024-04-20T10:50:50.918841+0000","last_clean":"2024-04-20T10:50:50.918841+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:50.918841+0000","last_undegraded":"2024-04-20T10:50:50.918841+0000","last_fullsized":"2024-04-20T10:50:50.918841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646788+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:50:50.646788+0000","last_peered":"2024-04-20T10:50:50.646788+0000","last_clean":"2024-04-20T10:50:50.646788+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:50:50.646788+0000","last_undegraded":"2024-04-20T10:50:50.646788+0000","last_fullsized":"2024-04-20T10:50:50.646788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918243+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:50:50.918243+0000","last_peered":"2024-04-20T10:50:50.918243+0000","last_clean":"2024-04-20T10:50:50.918243+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:50:50.918243+0000","last_undegraded":"2024-04-20T10:50:50.918243+0000","last_fullsized":"2024-04-20T10:50:50.918243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919668+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:50.919668+0000","last_peered":"2024-04-20T10:50:50.919668+0000","last_clean":"2024-04-20T10:50:50.919668+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:50.919668+0000","last_undegraded":"2024-04-20T10:50:50.919668+0000","last_fullsized":"2024-04-20T10:50:50.919668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919525+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:50.919525+0000","last_peered":"2024-04-20T10:50:50.919525+0000","last_clean":"2024-04-20T10:50:50.919525+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:50.919525+0000","last_undegraded":"2024-04-20T10:50:50.919525+0000","last_fullsized":"2024-04-20T10:50:50.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646886+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:50:50.646886+0000","last_peered":"2024-04-20T10:50:50.646886+0000","last_clean":"2024-04-20T10:50:50.646886+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:50:50.646886+0000","last_undegraded":"2024-04-20T10:50:50.646886+0000","last_fullsized":"2024-04-20T10:50:50.646886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919828+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:50:50.919828+0000","last_peered":"2024-04-20T10:50:50.919828+0000","last_clean":"2024-04-20T10:50:50.919828+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:50:50.919828+0000","last_undegraded":"2024-04-20T10:50:50.919828+0000","last_fullsized":"2024-04-20T10:50:50.919828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647374+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:50:50.647374+0000","last_peered":"2024-04-20T10:50:50.647374+0000","last_clean":"2024-04-20T10:50:50.647374+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:50:50.647374+0000","last_undegraded":"2024-04-20T10:50:50.647374+0000","last_fullsized":"2024-04-20T10:50:50.647374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919489+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:50:50.919489+0000","last_peered":"2024-04-20T10:50:50.919489+0000","last_clean":"2024-04-20T10:50:50.919489+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:50:50.919489+0000","last_undegraded":"2024-04-20T10:50:50.919489+0000","last_fullsized":"2024-04-20T10:50:50.919489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647710+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:50.647710+0000","last_peered":"2024-04-20T10:50:50.647710+0000","last_clean":"2024-04-20T10:50:50.647710+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:50.647710+0000","last_undegraded":"2024-04-20T10:50:50.647710+0000","last_fullsized":"2024-04-20T10:50:50.647710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:07.016612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918599+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:50.918599+0000","last_peered":"2024-04-20T10:50:50.918599+0000","last_clean":"2024-04-20T10:50:50.918599+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:50.918599+0000","last_undegraded":"2024-04-20T10:50:50.918599+0000","last_fullsized":"2024-04-20T10:50:50.918599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647233+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:50:50.647233+0000","last_peered":"2024-04-20T10:50:50.647233+0000","last_clean":"2024-04-20T10:50:50.647233+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:50:50.647233+0000","last_undegraded":"2024-04-20T10:50:50.647233+0000","last_fullsized":"2024-04-20T10:50:50.647233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647083+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:50:50.647083+0000","last_peered":"2024-04-20T10:50:50.647083+0000","last_clean":"2024-04-20T10:50:50.647083+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:50:50.647083+0000","last_undegraded":"2024-04-20T10:50:50.647083+0000","last_fullsized":"2024-04-20T10:50:50.647083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647704+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:50.647704+0000","last_peered":"2024-04-20T10:50:50.647704+0000","last_clean":"2024-04-20T10:50:50.647704+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:50.647704+0000","last_undegraded":"2024-04-20T10:50:50.647704+0000","last_fullsized":"2024-04-20T10:50:50.647704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918767+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:50.918767+0000","last_peered":"2024-04-20T10:50:50.918767+0000","last_clean":"2024-04-20T10:50:50.918767+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:50.918767+0000","last_undegraded":"2024-04-20T10:50:50.918767+0000","last_fullsized":"2024-04-20T10:50:50.918767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919440+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:50:50.919440+0000","last_peered":"2024-04-20T10:50:50.919440+0000","last_clean":"2024-04-20T10:50:50.919440+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:50:50.919440+0000","last_undegraded":"2024-04-20T10:50:50.919440+0000","last_fullsized":"2024-04-20T10:50:50.919440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919258+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:50:50.919258+0000","last_peered":"2024-04-20T10:50:50.919258+0000","last_clean":"2024-04-20T10:50:50.919258+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:50:50.919258+0000","last_undegraded":"2024-04-20T10:50:50.919258+0000","last_fullsized":"2024-04-20T10:50:50.919258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647487+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:50.647487+0000","last_peered":"2024-04-20T10:50:50.647487+0000","last_clean":"2024-04-20T10:50:50.647487+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:50.647487+0000","last_undegraded":"2024-04-20T10:50:50.647487+0000","last_fullsized":"2024-04-20T10:50:50.647487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918378+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:50.918378+0000","last_peered":"2024-04-20T10:50:50.918378+0000","last_clean":"2024-04-20T10:50:50.918378+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:50.918378+0000","last_undegraded":"2024-04-20T10:50:50.918378+0000","last_fullsized":"2024-04-20T10:50:50.918378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647210+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:50:50.647210+0000","last_peered":"2024-04-20T10:50:50.647210+0000","last_clean":"2024-04-20T10:50:50.647210+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:50:50.647210+0000","last_undegraded":"2024-04-20T10:50:50.647210+0000","last_fullsized":"2024-04-20T10:50:50.647210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647499+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:50:50.647499+0000","last_peered":"2024-04-20T10:50:50.647499+0000","last_clean":"2024-04-20T10:50:50.647499+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:50:50.647499+0000","last_undegraded":"2024-04-20T10:50:50.647499+0000","last_fullsized":"2024-04-20T10:50:50.647499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919297+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:50.919297+0000","last_peered":"2024-04-20T10:50:50.919297+0000","last_clean":"2024-04-20T10:50:50.919297+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:50.919297+0000","last_undegraded":"2024-04-20T10:50:50.919297+0000","last_fullsized":"2024-04-20T10:50:50.919297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904955+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:50.904955+0000","last_peered":"2024-04-20T10:50:50.904955+0000","last_clean":"2024-04-20T10:50:50.904955+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:50.904955+0000","last_undegraded":"2024-04-20T10:50:50.904955+0000","last_fullsized":"2024-04-20T10:50:50.904955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647061+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:50:50.647061+0000","last_peered":"2024-04-20T10:50:50.647061+0000","last_clean":"2024-04-20T10:50:50.647061+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:50:50.647061+0000","last_undegraded":"2024-04-20T10:50:50.647061+0000","last_fullsized":"2024-04-20T10:50:50.647061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646640+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:50:50.646640+0000","last_peered":"2024-04-20T10:50:50.646640+0000","last_clean":"2024-04-20T10:50:50.646640+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:50:50.646640+0000","last_undegraded":"2024-04-20T10:50:50.646640+0000","last_fullsized":"2024-04-20T10:50:50.646640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647815+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:50.647815+0000","last_peered":"2024-04-20T10:50:50.647815+0000","last_clean":"2024-04-20T10:50:50.647815+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:50.647815+0000","last_undegraded":"2024-04-20T10:50:50.647815+0000","last_fullsized":"2024-04-20T10:50:50.647815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919903+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:50.919903+0000","last_peered":"2024-04-20T10:50:50.919903+0000","last_clean":"2024-04-20T10:50:50.919903+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:50.919903+0000","last_undegraded":"2024-04-20T10:50:50.919903+0000","last_fullsized":"2024-04-20T10:50:50.919903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647184+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:50:50.647184+0000","last_peered":"2024-04-20T10:50:50.647184+0000","last_clean":"2024-04-20T10:50:50.647184+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:50:50.647184+0000","last_undegraded":"2024-04-20T10:50:50.647184+0000","last_fullsized":"2024-04-20T10:50:50.647184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904364+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:50:50.904364+0000","last_peered":"2024-04-20T10:50:50.904364+0000","last_clean":"2024-04-20T10:50:50.904364+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:50:50.904364+0000","last_undegraded":"2024-04-20T10:50:50.904364+0000","last_fullsized":"2024-04-20T10:50:50.904364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919960+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:50.919960+0000","last_peered":"2024-04-20T10:50:50.919960+0000","last_clean":"2024-04-20T10:50:50.919960+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:50.919960+0000","last_undegraded":"2024-04-20T10:50:50.919960+0000","last_fullsized":"2024-04-20T10:50:50.919960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920149+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:50.920149+0000","last_peered":"2024-04-20T10:50:50.920149+0000","last_clean":"2024-04-20T10:50:50.920149+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:50.920149+0000","last_undegraded":"2024-04-20T10:50:50.920149+0000","last_fullsized":"2024-04-20T10:50:50.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919053+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:50:50.919053+0000","last_peered":"2024-04-20T10:50:50.919053+0000","last_clean":"2024-04-20T10:50:50.919053+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:50:50.919053+0000","last_undegraded":"2024-04-20T10:50:50.919053+0000","last_fullsized":"2024-04-20T10:50:50.919053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919594+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:50.919594+0000","last_peered":"2024-04-20T10:50:50.919594+0000","last_clean":"2024-04-20T10:50:50.919594+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:50.919594+0000","last_undegraded":"2024-04-20T10:50:50.919594+0000","last_fullsized":"2024-04-20T10:50:50.919594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919993+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:50.919993+0000","last_peered":"2024-04-20T10:50:50.919993+0000","last_clean":"2024-04-20T10:50:50.919993+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:50.919993+0000","last_undegraded":"2024-04-20T10:50:50.919993+0000","last_fullsized":"2024-04-20T10:50:50.919993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918452+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:50:50.918452+0000","last_peered":"2024-04-20T10:50:50.918452+0000","last_clean":"2024-04-20T10:50:50.918452+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:50:50.918452+0000","last_undegraded":"2024-04-20T10:50:50.918452+0000","last_fullsized":"2024-04-20T10:50:50.918452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918934+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:50:50.918934+0000","last_peered":"2024-04-20T10:50:50.918934+0000","last_clean":"2024-04-20T10:50:50.918934+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:50:50.918934+0000","last_undegraded":"2024-04-20T10:50:50.918934+0000","last_fullsized":"2024-04-20T10:50:50.918934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647503+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:50.647503+0000","last_peered":"2024-04-20T10:50:50.647503+0000","last_clean":"2024-04-20T10:50:50.647503+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:50.647503+0000","last_undegraded":"2024-04-20T10:50:50.647503+0000","last_fullsized":"2024-04-20T10:50:50.647503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919438+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:50.919438+0000","last_peered":"2024-04-20T10:50:50.919438+0000","last_clean":"2024-04-20T10:50:50.919438+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:50.919438+0000","last_undegraded":"2024-04-20T10:50:50.919438+0000","last_fullsized":"2024-04-20T10:50:50.919438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918697+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:50:50.918697+0000","last_peered":"2024-04-20T10:50:50.918697+0000","last_clean":"2024-04-20T10:50:50.918697+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:50:50.918697+0000","last_undegraded":"2024-04-20T10:50:50.918697+0000","last_fullsized":"2024-04-20T10:50:50.918697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918186+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:50.918186+0000","last_peered":"2024-04-20T10:50:50.918186+0000","last_clean":"2024-04-20T10:50:50.918186+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:50.918186+0000","last_undegraded":"2024-04-20T10:50:50.918186+0000","last_fullsized":"2024-04-20T10:50:50.918186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919238+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:50.919238+0000","last_peered":"2024-04-20T10:50:50.919238+0000","last_clean":"2024-04-20T10:50:50.919238+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:50.919238+0000","last_undegraded":"2024-04-20T10:50:50.919238+0000","last_fullsized":"2024-04-20T10:50:50.919238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919687+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:50:50.919687+0000","last_peered":"2024-04-20T10:50:50.919687+0000","last_clean":"2024-04-20T10:50:50.919687+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:50:50.919687+0000","last_undegraded":"2024-04-20T10:50:50.919687+0000","last_fullsized":"2024-04-20T10:50:50.919687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918605+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:50.918605+0000","last_peered":"2024-04-20T10:50:50.918605+0000","last_clean":"2024-04-20T10:50:50.918605+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:50.918605+0000","last_undegraded":"2024-04-20T10:50:50.918605+0000","last_fullsized":"2024-04-20T10:50:50.918605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918474+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:50.918474+0000","last_peered":"2024-04-20T10:50:50.918474+0000","last_clean":"2024-04-20T10:50:50.918474+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:50.918474+0000","last_undegraded":"2024-04-20T10:50:50.918474+0000","last_fullsized":"2024-04-20T10:50:50.918474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919237+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:50:50.919237+0000","last_peered":"2024-04-20T10:50:50.919237+0000","last_clean":"2024-04-20T10:50:50.919237+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:50:50.919237+0000","last_undegraded":"2024-04-20T10:50:50.919237+0000","last_fullsized":"2024-04-20T10:50:50.919237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919239+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:50:50.919239+0000","last_peered":"2024-04-20T10:50:50.919239+0000","last_clean":"2024-04-20T10:50:50.919239+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:50:50.919239+0000","last_undegraded":"2024-04-20T10:50:50.919239+0000","last_fullsized":"2024-04-20T10:50:50.919239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647940+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:50.647940+0000","last_peered":"2024-04-20T10:50:50.647940+0000","last_clean":"2024-04-20T10:50:50.647940+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:50.647940+0000","last_undegraded":"2024-04-20T10:50:50.647940+0000","last_fullsized":"2024-04-20T10:50:50.647940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918168+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:50.918168+0000","last_peered":"2024-04-20T10:50:50.918168+0000","last_clean":"2024-04-20T10:50:50.918168+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:50.918168+0000","last_undegraded":"2024-04-20T10:50:50.918168+0000","last_fullsized":"2024-04-20T10:50:50.918168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918735+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:50.918735+0000","last_peered":"2024-04-20T10:50:50.918735+0000","last_clean":"2024-04-20T10:50:50.918735+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:50.918735+0000","last_undegraded":"2024-04-20T10:50:50.918735+0000","last_fullsized":"2024-04-20T10:50:50.918735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904495+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:50:50.904495+0000","last_peered":"2024-04-20T10:50:50.904495+0000","last_clean":"2024-04-20T10:50:50.904495+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:50:50.904495+0000","last_undegraded":"2024-04-20T10:50:50.904495+0000","last_fullsized":"2024-04-20T10:50:50.904495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920137+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:50:50.920137+0000","last_peered":"2024-04-20T10:50:50.920137+0000","last_clean":"2024-04-20T10:50:50.920137+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:50:50.920137+0000","last_undegraded":"2024-04-20T10:50:50.920137+0000","last_fullsized":"2024-04-20T10:50:50.920137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919949+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:50.919949+0000","last_peered":"2024-04-20T10:50:50.919949+0000","last_clean":"2024-04-20T10:50:50.919949+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:50.919949+0000","last_undegraded":"2024-04-20T10:50:50.919949+0000","last_fullsized":"2024-04-20T10:50:50.919949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920093+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:50.920093+0000","last_peered":"2024-04-20T10:50:50.920093+0000","last_clean":"2024-04-20T10:50:50.920093+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:50.920093+0000","last_undegraded":"2024-04-20T10:50:50.920093+0000","last_fullsized":"2024-04-20T10:50:50.920093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904372+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:50:50.904372+0000","last_peered":"2024-04-20T10:50:50.904372+0000","last_clean":"2024-04-20T10:50:50.904372+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:50:50.904372+0000","last_undegraded":"2024-04-20T10:50:50.904372+0000","last_fullsized":"2024-04-20T10:50:50.904372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918546+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:50:50.918546+0000","last_peered":"2024-04-20T10:50:50.918546+0000","last_clean":"2024-04-20T10:50:50.918546+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:50:50.918546+0000","last_undegraded":"2024-04-20T10:50:50.918546+0000","last_fullsized":"2024-04-20T10:50:50.918546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919184+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:50.919184+0000","last_peered":"2024-04-20T10:50:50.919184+0000","last_clean":"2024-04-20T10:50:50.919184+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:50.919184+0000","last_undegraded":"2024-04-20T10:50:50.919184+0000","last_fullsized":"2024-04-20T10:50:50.919184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920068+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:50.920068+0000","last_peered":"2024-04-20T10:50:50.920068+0000","last_clean":"2024-04-20T10:50:50.920068+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:50.920068+0000","last_undegraded":"2024-04-20T10:50:50.920068+0000","last_fullsized":"2024-04-20T10:50:50.920068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918899+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:50:50.918899+0000","last_peered":"2024-04-20T10:50:50.918899+0000","last_clean":"2024-04-20T10:50:50.918899+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:50:50.918899+0000","last_undegraded":"2024-04-20T10:50:50.918899+0000","last_fullsized":"2024-04-20T10:50:50.918899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918088+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:50:50.918088+0000","last_peered":"2024-04-20T10:50:50.918088+0000","last_clean":"2024-04-20T10:50:50.918088+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:50:50.918088+0000","last_undegraded":"2024-04-20T10:50:50.918088+0000","last_fullsized":"2024-04-20T10:50:50.918088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920183+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:50.920183+0000","last_peered":"2024-04-20T10:50:50.920183+0000","last_clean":"2024-04-20T10:50:50.920183+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:50.920183+0000","last_undegraded":"2024-04-20T10:50:50.920183+0000","last_fullsized":"2024-04-20T10:50:50.920183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918853+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:50.918853+0000","last_peered":"2024-04-20T10:50:50.918853+0000","last_clean":"2024-04-20T10:50:50.918853+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:50.918853+0000","last_undegraded":"2024-04-20T10:50:50.918853+0000","last_fullsized":"2024-04-20T10:50:50.918853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918057+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:50:50.918057+0000","last_peered":"2024-04-20T10:50:50.918057+0000","last_clean":"2024-04-20T10:50:50.918057+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:50:50.918057+0000","last_undegraded":"2024-04-20T10:50:50.918057+0000","last_fullsized":"2024-04-20T10:50:50.918057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919612+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:50:50.919612+0000","last_peered":"2024-04-20T10:50:50.919612+0000","last_clean":"2024-04-20T10:50:50.919612+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:50:50.919612+0000","last_undegraded":"2024-04-20T10:50:50.919612+0000","last_fullsized":"2024-04-20T10:50:50.919612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647644+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:50.647644+0000","last_peered":"2024-04-20T10:50:50.647644+0000","last_clean":"2024-04-20T10:50:50.647644+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:50.647644+0000","last_undegraded":"2024-04-20T10:50:50.647644+0000","last_fullsized":"2024-04-20T10:50:50.647644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646587+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:50:50.646587+0000","last_peered":"2024-04-20T10:50:50.646587+0000","last_clean":"2024-04-20T10:50:50.646587+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:50:50.646587+0000","last_undegraded":"2024-04-20T10:50:50.646587+0000","last_fullsized":"2024-04-20T10:50:50.646587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647705+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:50:50.647705+0000","last_peered":"2024-04-20T10:50:50.647705+0000","last_clean":"2024-04-20T10:50:50.647705+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:50:50.647705+0000","last_undegraded":"2024-04-20T10:50:50.647705+0000","last_fullsized":"2024-04-20T10:50:50.647705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918736+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:50.918736+0000","last_peered":"2024-04-20T10:50:50.918736+0000","last_clean":"2024-04-20T10:50:50.918736+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:50.918736+0000","last_undegraded":"2024-04-20T10:50:50.918736+0000","last_fullsized":"2024-04-20T10:50:50.918736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918257+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:50.918257+0000","last_peered":"2024-04-20T10:50:50.918257+0000","last_clean":"2024-04-20T10:50:50.918257+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:50.918257+0000","last_undegraded":"2024-04-20T10:50:50.918257+0000","last_fullsized":"2024-04-20T10:50:50.918257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919316+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:50:50.919316+0000","last_peered":"2024-04-20T10:50:50.919316+0000","last_clean":"2024-04-20T10:50:50.919316+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:50:50.919316+0000","last_undegraded":"2024-04-20T10:50:50.919316+0000","last_fullsized":"2024-04-20T10:50:50.919316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918977+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:50:50.918977+0000","last_peered":"2024-04-20T10:50:50.918977+0000","last_clean":"2024-04-20T10:50:50.918977+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:50:50.918977+0000","last_undegraded":"2024-04-20T10:50:50.918977+0000","last_fullsized":"2024-04-20T10:50:50.918977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904080+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:50.904080+0000","last_peered":"2024-04-20T10:50:50.904080+0000","last_clean":"2024-04-20T10:50:50.904080+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:50.904080+0000","last_undegraded":"2024-04-20T10:50:50.904080+0000","last_fullsized":"2024-04-20T10:50:50.904080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904487+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:50.904487+0000","last_peered":"2024-04-20T10:50:50.904487+0000","last_clean":"2024-04-20T10:50:50.904487+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:50.904487+0000","last_undegraded":"2024-04-20T10:50:50.904487+0000","last_fullsized":"2024-04-20T10:50:50.904487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647768+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:50:50.647768+0000","last_peered":"2024-04-20T10:50:50.647768+0000","last_clean":"2024-04-20T10:50:50.647768+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:50:50.647768+0000","last_undegraded":"2024-04-20T10:50:50.647768+0000","last_fullsized":"2024-04-20T10:50:50.647768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918820+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:50:50.918820+0000","last_peered":"2024-04-20T10:50:50.918820+0000","last_clean":"2024-04-20T10:50:50.918820+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:50:50.918820+0000","last_undegraded":"2024-04-20T10:50:50.918820+0000","last_fullsized":"2024-04-20T10:50:50.918820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919283+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:50.919283+0000","last_peered":"2024-04-20T10:50:50.919283+0000","last_clean":"2024-04-20T10:50:50.919283+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:50.919283+0000","last_undegraded":"2024-04-20T10:50:50.919283+0000","last_fullsized":"2024-04-20T10:50:50.919283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919373+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:50.919373+0000","last_peered":"2024-04-20T10:50:50.919373+0000","last_clean":"2024-04-20T10:50:50.919373+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:50.919373+0000","last_undegraded":"2024-04-20T10:50:50.919373+0000","last_fullsized":"2024-04-20T10:50:50.919373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:51:13.206557+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:51:13.206557+0000","last_peered":"2024-04-20T10:51:13.206557+0000","last_clean":"2024-04-20T10:51:13.206557+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:51:13.206557+0000","last_undegraded":"2024-04-20T10:51:13.206557+0000","last_fullsized":"2024-04-20T10:51:13.206557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648149+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:50:50.648149+0000","last_peered":"2024-04-20T10:50:50.648149+0000","last_clean":"2024-04-20T10:50:50.648149+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:50:50.648149+0000","last_undegraded":"2024-04-20T10:50:50.648149+0000","last_fullsized":"2024-04-20T10:50:50.648149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918773+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:50.918773+0000","last_peered":"2024-04-20T10:50:50.918773+0000","last_clean":"2024-04-20T10:50:50.918773+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:50.918773+0000","last_undegraded":"2024-04-20T10:50:50.918773+0000","last_fullsized":"2024-04-20T10:50:50.918773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919619+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:50.919619+0000","last_peered":"2024-04-20T10:50:50.919619+0000","last_clean":"2024-04-20T10:50:50.919619+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:50.919619+0000","last_undegraded":"2024-04-20T10:50:50.919619+0000","last_fullsized":"2024-04-20T10:50:50.919619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919480+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:50:50.919480+0000","last_peered":"2024-04-20T10:50:50.919480+0000","last_clean":"2024-04-20T10:50:50.919480+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:50:50.919480+0000","last_undegraded":"2024-04-20T10:50:50.919480+0000","last_fullsized":"2024-04-20T10:50:50.919480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647622+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:50:50.647622+0000","last_peered":"2024-04-20T10:50:50.647622+0000","last_clean":"2024-04-20T10:50:50.647622+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:50:50.647622+0000","last_undegraded":"2024-04-20T10:50:50.647622+0000","last_fullsized":"2024-04-20T10:50:50.647622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919782+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:50.919782+0000","last_peered":"2024-04-20T10:50:50.919782+0000","last_clean":"2024-04-20T10:50:50.919782+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:50.919782+0000","last_undegraded":"2024-04-20T10:50:50.919782+0000","last_fullsized":"2024-04-20T10:50:50.919782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:51:10.729406+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:51:10.729406+0000","last_peered":"2024-04-20T10:51:10.729406+0000","last_clean":"2024-04-20T10:51:10.729406+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:51:10.729406+0000","last_undegraded":"2024-04-20T10:51:10.729406+0000","last_fullsized":"2024-04-20T10:51:10.729406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918370+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:50:50.918370+0000","last_peered":"2024-04-20T10:50:50.918370+0000","last_clean":"2024-04-20T10:50:50.918370+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:50:50.918370+0000","last_undegraded":"2024-04-20T10:50:50.918370+0000","last_fullsized":"2024-04-20T10:50:50.918370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918531+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:50:50.918531+0000","last_peered":"2024-04-20T10:50:50.918531+0000","last_clean":"2024-04-20T10:50:50.918531+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:50:50.918531+0000","last_undegraded":"2024-04-20T10:50:50.918531+0000","last_fullsized":"2024-04-20T10:50:50.918531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647604+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:50.647604+0000","last_peered":"2024-04-20T10:50:50.647604+0000","last_clean":"2024-04-20T10:50:50.647604+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:50.647604+0000","last_undegraded":"2024-04-20T10:50:50.647604+0000","last_fullsized":"2024-04-20T10:50:50.647604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647241+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:50:50.647241+0000","last_peered":"2024-04-20T10:50:50.647241+0000","last_clean":"2024-04-20T10:50:50.647241+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:50:50.647241+0000","last_undegraded":"2024-04-20T10:50:50.647241+0000","last_fullsized":"2024-04-20T10:50:50.647241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904476+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:50:50.904476+0000","last_peered":"2024-04-20T10:50:50.904476+0000","last_clean":"2024-04-20T10:50:50.904476+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:50:50.904476+0000","last_undegraded":"2024-04-20T10:50:50.904476+0000","last_fullsized":"2024-04-20T10:50:50.904476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919071+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:50.919071+0000","last_peered":"2024-04-20T10:50:50.919071+0000","last_clean":"2024-04-20T10:50:50.919071+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:50.919071+0000","last_undegraded":"2024-04-20T10:50:50.919071+0000","last_fullsized":"2024-04-20T10:50:50.919071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919039+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:50.919039+0000","last_peered":"2024-04-20T10:50:50.919039+0000","last_clean":"2024-04-20T10:50:50.919039+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:50.919039+0000","last_undegraded":"2024-04-20T10:50:50.919039+0000","last_fullsized":"2024-04-20T10:50:50.919039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647348+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:50:50.647348+0000","last_peered":"2024-04-20T10:50:50.647348+0000","last_clean":"2024-04-20T10:50:50.647348+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:50:50.647348+0000","last_undegraded":"2024-04-20T10:50:50.647348+0000","last_fullsized":"2024-04-20T10:50:50.647348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918201+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:50:50.918201+0000","last_peered":"2024-04-20T10:50:50.918201+0000","last_clean":"2024-04-20T10:50:50.918201+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:50:50.918201+0000","last_undegraded":"2024-04-20T10:50:50.918201+0000","last_fullsized":"2024-04-20T10:50:50.918201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919011+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:50.919011+0000","last_peered":"2024-04-20T10:50:50.919011+0000","last_clean":"2024-04-20T10:50:50.919011+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:50.919011+0000","last_undegraded":"2024-04-20T10:50:50.919011+0000","last_fullsized":"2024-04-20T10:50:50.919011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904919+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:50.904919+0000","last_peered":"2024-04-20T10:50:50.904919+0000","last_clean":"2024-04-20T10:50:50.904919+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:50.904919+0000","last_undegraded":"2024-04-20T10:50:50.904919+0000","last_fullsized":"2024-04-20T10:50:50.904919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647257+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:50:50.647257+0000","last_peered":"2024-04-20T10:50:50.647257+0000","last_clean":"2024-04-20T10:50:50.647257+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:50:50.647257+0000","last_undegraded":"2024-04-20T10:50:50.647257+0000","last_fullsized":"2024-04-20T10:50:50.647257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904798+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:50:50.904798+0000","last_peered":"2024-04-20T10:50:50.904798+0000","last_clean":"2024-04-20T10:50:50.904798+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:50:50.904798+0000","last_undegraded":"2024-04-20T10:50:50.904798+0000","last_fullsized":"2024-04-20T10:50:50.904798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919143+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:50:50.919143+0000","last_peered":"2024-04-20T10:50:50.919143+0000","last_clean":"2024-04-20T10:50:50.919143+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:50:50.919143+0000","last_undegraded":"2024-04-20T10:50:50.919143+0000","last_fullsized":"2024-04-20T10:50:50.919143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918587+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:50.918587+0000","last_peered":"2024-04-20T10:50:50.918587+0000","last_clean":"2024-04-20T10:50:50.918587+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:50.918587+0000","last_undegraded":"2024-04-20T10:50:50.918587+0000","last_fullsized":"2024-04-20T10:50:50.918587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918226+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:50.918226+0000","last_peered":"2024-04-20T10:50:50.918226+0000","last_clean":"2024-04-20T10:50:50.918226+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:50.918226+0000","last_undegraded":"2024-04-20T10:50:50.918226+0000","last_fullsized":"2024-04-20T10:50:50.918226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919055+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:50:50.919055+0000","last_peered":"2024-04-20T10:50:50.919055+0000","last_clean":"2024-04-20T10:50:50.919055+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:50:50.919055+0000","last_undegraded":"2024-04-20T10:50:50.919055+0000","last_fullsized":"2024-04-20T10:50:50.919055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904885+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:50:50.904885+0000","last_peered":"2024-04-20T10:50:50.904885+0000","last_clean":"2024-04-20T10:50:50.904885+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:50:50.904885+0000","last_undegraded":"2024-04-20T10:50:50.904885+0000","last_fullsized":"2024-04-20T10:50:50.904885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647617+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:50.647617+0000","last_peered":"2024-04-20T10:50:50.647617+0000","last_clean":"2024-04-20T10:50:50.647617+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:50.647617+0000","last_undegraded":"2024-04-20T10:50:50.647617+0000","last_fullsized":"2024-04-20T10:50:50.647617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647427+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:50.647427+0000","last_peered":"2024-04-20T10:50:50.647427+0000","last_clean":"2024-04-20T10:50:50.647427+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:50.647427+0000","last_undegraded":"2024-04-20T10:50:50.647427+0000","last_fullsized":"2024-04-20T10:50:50.647427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919353+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:50:50.919353+0000","last_peered":"2024-04-20T10:50:50.919353+0000","last_clean":"2024-04-20T10:50:50.919353+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:50:50.919353+0000","last_undegraded":"2024-04-20T10:50:50.919353+0000","last_fullsized":"2024-04-20T10:50:50.919353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904598+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:50.904598+0000","last_peered":"2024-04-20T10:50:50.904598+0000","last_clean":"2024-04-20T10:50:50.904598+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:50.904598+0000","last_undegraded":"2024-04-20T10:50:50.904598+0000","last_fullsized":"2024-04-20T10:50:50.904598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919448+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:50.919448+0000","last_peered":"2024-04-20T10:50:50.919448+0000","last_clean":"2024-04-20T10:50:50.919448+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:50.919448+0000","last_undegraded":"2024-04-20T10:50:50.919448+0000","last_fullsized":"2024-04-20T10:50:50.919448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919923+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:50:50.919923+0000","last_peered":"2024-04-20T10:50:50.919923+0000","last_clean":"2024-04-20T10:50:50.919923+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:50:50.919923+0000","last_undegraded":"2024-04-20T10:50:50.919923+0000","last_fullsized":"2024-04-20T10:50:50.919923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646954+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:50:50.646954+0000","last_peered":"2024-04-20T10:50:50.646954+0000","last_clean":"2024-04-20T10:50:50.646954+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:50:50.646954+0000","last_undegraded":"2024-04-20T10:50:50.646954+0000","last_fullsized":"2024-04-20T10:50:50.646954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647875+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:50.647875+0000","last_peered":"2024-04-20T10:50:50.647875+0000","last_clean":"2024-04-20T10:50:50.647875+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:50.647875+0000","last_undegraded":"2024-04-20T10:50:50.647875+0000","last_fullsized":"2024-04-20T10:50:50.647875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647129+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:50.647129+0000","last_peered":"2024-04-20T10:50:50.647129+0000","last_clean":"2024-04-20T10:50:50.647129+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:50.647129+0000","last_undegraded":"2024-04-20T10:50:50.647129+0000","last_fullsized":"2024-04-20T10:50:50.647129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648051+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:50:50.648051+0000","last_peered":"2024-04-20T10:50:50.648051+0000","last_clean":"2024-04-20T10:50:50.648051+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:50:50.648051+0000","last_undegraded":"2024-04-20T10:50:50.648051+0000","last_fullsized":"2024-04-20T10:50:50.648051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648041+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:50:50.648041+0000","last_peered":"2024-04-20T10:50:50.648041+0000","last_clean":"2024-04-20T10:50:50.648041+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:50:50.648041+0000","last_undegraded":"2024-04-20T10:50:50.648041+0000","last_fullsized":"2024-04-20T10:50:50.648041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904067+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:50.904067+0000","last_peered":"2024-04-20T10:50:50.904067+0000","last_clean":"2024-04-20T10:50:50.904067+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:50.904067+0000","last_undegraded":"2024-04-20T10:50:50.904067+0000","last_fullsized":"2024-04-20T10:50:50.904067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919274+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:50:50.919274+0000","last_peered":"2024-04-20T10:50:50.919274+0000","last_clean":"2024-04-20T10:50:50.919274+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:50:50.919274+0000","last_undegraded":"2024-04-20T10:50:50.919274+0000","last_fullsized":"2024-04-20T10:50:50.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918980+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:50.918980+0000","last_peered":"2024-04-20T10:50:50.918980+0000","last_clean":"2024-04-20T10:50:50.918980+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:50.918980+0000","last_undegraded":"2024-04-20T10:50:50.918980+0000","last_fullsized":"2024-04-20T10:50:50.918980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918617+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:50:50.918617+0000","last_peered":"2024-04-20T10:50:50.918617+0000","last_clean":"2024-04-20T10:50:50.918617+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:50:50.918617+0000","last_undegraded":"2024-04-20T10:50:50.918617+0000","last_fullsized":"2024-04-20T10:50:50.918617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919308+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:50.919308+0000","last_peered":"2024-04-20T10:50:50.919308+0000","last_clean":"2024-04-20T10:50:50.919308+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:50.919308+0000","last_undegraded":"2024-04-20T10:50:50.919308+0000","last_fullsized":"2024-04-20T10:50:50.919308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919405+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:50.919405+0000","last_peered":"2024-04-20T10:50:50.919405+0000","last_clean":"2024-04-20T10:50:50.919405+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:50.919405+0000","last_undegraded":"2024-04-20T10:50:50.919405+0000","last_fullsized":"2024-04-20T10:50:50.919405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918338+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:50:50.918338+0000","last_peered":"2024-04-20T10:50:50.918338+0000","last_clean":"2024-04-20T10:50:50.918338+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:50:50.918338+0000","last_undegraded":"2024-04-20T10:50:50.918338+0000","last_fullsized":"2024-04-20T10:50:50.918338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648264+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:50.648264+0000","last_peered":"2024-04-20T10:50:50.648264+0000","last_clean":"2024-04-20T10:50:50.648264+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:50.648264+0000","last_undegraded":"2024-04-20T10:50:50.648264+0000","last_fullsized":"2024-04-20T10:50:50.648264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647153+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:50:50.647153+0000","last_peered":"2024-04-20T10:50:50.647153+0000","last_clean":"2024-04-20T10:50:50.647153+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:50:50.647153+0000","last_undegraded":"2024-04-20T10:50:50.647153+0000","last_fullsized":"2024-04-20T10:50:50.647153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919569+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:50.919569+0000","last_peered":"2024-04-20T10:50:50.919569+0000","last_clean":"2024-04-20T10:50:50.919569+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:50.919569+0000","last_undegraded":"2024-04-20T10:50:50.919569+0000","last_fullsized":"2024-04-20T10:50:50.919569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904775+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:50.904775+0000","last_peered":"2024-04-20T10:50:50.904775+0000","last_clean":"2024-04-20T10:50:50.904775+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:50.904775+0000","last_undegraded":"2024-04-20T10:50:50.904775+0000","last_fullsized":"2024-04-20T10:50:50.904775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904299+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:50:50.904299+0000","last_peered":"2024-04-20T10:50:50.904299+0000","last_clean":"2024-04-20T10:50:50.904299+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:50:50.904299+0000","last_undegraded":"2024-04-20T10:50:50.904299+0000","last_fullsized":"2024-04-20T10:50:50.904299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647767+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:50.647767+0000","last_peered":"2024-04-20T10:50:50.647767+0000","last_clean":"2024-04-20T10:50:50.647767+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:50.647767+0000","last_undegraded":"2024-04-20T10:50:50.647767+0000","last_fullsized":"2024-04-20T10:50:50.647767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647843+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:50:50.647843+0000","last_peered":"2024-04-20T10:50:50.647843+0000","last_clean":"2024-04-20T10:50:50.647843+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:50:50.647843+0000","last_undegraded":"2024-04-20T10:50:50.647843+0000","last_fullsized":"2024-04-20T10:50:50.647843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918116+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:50.918116+0000","last_peered":"2024-04-20T10:50:50.918116+0000","last_clean":"2024-04-20T10:50:50.918116+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:50.918116+0000","last_undegraded":"2024-04-20T10:50:50.918116+0000","last_fullsized":"2024-04-20T10:50:50.918116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920306+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:50:50.920306+0000","last_peered":"2024-04-20T10:50:50.920306+0000","last_clean":"2024-04-20T10:50:50.920306+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:50:50.920306+0000","last_undegraded":"2024-04-20T10:50:50.920306+0000","last_fullsized":"2024-04-20T10:50:50.920306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647324+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:50.647324+0000","last_peered":"2024-04-20T10:50:50.647324+0000","last_clean":"2024-04-20T10:50:50.647324+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:50.647324+0000","last_undegraded":"2024-04-20T10:50:50.647324+0000","last_fullsized":"2024-04-20T10:50:50.647324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919821+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:50:50.919821+0000","last_peered":"2024-04-20T10:50:50.919821+0000","last_clean":"2024-04-20T10:50:50.919821+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:50:50.919821+0000","last_undegraded":"2024-04-20T10:50:50.919821+0000","last_fullsized":"2024-04-20T10:50:50.919821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919185+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:50.919185+0000","last_peered":"2024-04-20T10:50:50.919185+0000","last_clean":"2024-04-20T10:50:50.919185+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:50.919185+0000","last_undegraded":"2024-04-20T10:50:50.919185+0000","last_fullsized":"2024-04-20T10:50:50.919185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647822+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:50:50.647822+0000","last_peered":"2024-04-20T10:50:50.647822+0000","last_clean":"2024-04-20T10:50:50.647822+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:50:50.647822+0000","last_undegraded":"2024-04-20T10:50:50.647822+0000","last_fullsized":"2024-04-20T10:50:50.647822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919221+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:50.919221+0000","last_peered":"2024-04-20T10:50:50.919221+0000","last_clean":"2024-04-20T10:50:50.919221+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:50.919221+0000","last_undegraded":"2024-04-20T10:50:50.919221+0000","last_fullsized":"2024-04-20T10:50:50.919221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646687+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:50:50.646687+0000","last_peered":"2024-04-20T10:50:50.646687+0000","last_clean":"2024-04-20T10:50:50.646687+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:50:50.646687+0000","last_undegraded":"2024-04-20T10:50:50.646687+0000","last_fullsized":"2024-04-20T10:50:50.646687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904324+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:50.904324+0000","last_peered":"2024-04-20T10:50:50.904324+0000","last_clean":"2024-04-20T10:50:50.904324+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:50.904324+0000","last_undegraded":"2024-04-20T10:50:50.904324+0000","last_fullsized":"2024-04-20T10:50:50.904324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646680+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:50:50.646680+0000","last_peered":"2024-04-20T10:50:50.646680+0000","last_clean":"2024-04-20T10:50:50.646680+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:50:50.646680+0000","last_undegraded":"2024-04-20T10:50:50.646680+0000","last_fullsized":"2024-04-20T10:50:50.646680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920058+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:50.920058+0000","last_peered":"2024-04-20T10:50:50.920058+0000","last_clean":"2024-04-20T10:50:50.920058+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:50.920058+0000","last_undegraded":"2024-04-20T10:50:50.920058+0000","last_fullsized":"2024-04-20T10:50:50.920058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918048+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:50:50.918048+0000","last_peered":"2024-04-20T10:50:50.918048+0000","last_clean":"2024-04-20T10:50:50.918048+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:50:50.918048+0000","last_undegraded":"2024-04-20T10:50:50.918048+0000","last_fullsized":"2024-04-20T10:50:50.918048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918749+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:50.918749+0000","last_peered":"2024-04-20T10:50:50.918749+0000","last_clean":"2024-04-20T10:50:50.918749+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:50.918749+0000","last_undegraded":"2024-04-20T10:50:50.918749+0000","last_fullsized":"2024-04-20T10:50:50.918749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918281+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:50:50.918281+0000","last_peered":"2024-04-20T10:50:50.918281+0000","last_clean":"2024-04-20T10:50:50.918281+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:50:50.918281+0000","last_undegraded":"2024-04-20T10:50:50.918281+0000","last_fullsized":"2024-04-20T10:50:50.918281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919598+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:50.919598+0000","last_peered":"2024-04-20T10:50:50.919598+0000","last_clean":"2024-04-20T10:50:50.919598+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:50.919598+0000","last_undegraded":"2024-04-20T10:50:50.919598+0000","last_fullsized":"2024-04-20T10:50:50.919598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919839+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:50:50.919839+0000","last_peered":"2024-04-20T10:50:50.919839+0000","last_clean":"2024-04-20T10:50:50.919839+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:50:50.919839+0000","last_undegraded":"2024-04-20T10:50:50.919839+0000","last_fullsized":"2024-04-20T10:50:50.919839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918109+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:50.918109+0000","last_peered":"2024-04-20T10:50:50.918109+0000","last_clean":"2024-04-20T10:50:50.918109+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:50.918109+0000","last_undegraded":"2024-04-20T10:50:50.918109+0000","last_fullsized":"2024-04-20T10:50:50.918109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647462+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:50:50.647462+0000","last_peered":"2024-04-20T10:50:50.647462+0000","last_clean":"2024-04-20T10:50:50.647462+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:50:50.647462+0000","last_undegraded":"2024-04-20T10:50:50.647462+0000","last_fullsized":"2024-04-20T10:50:50.647462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918682+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:50.918682+0000","last_peered":"2024-04-20T10:50:50.918682+0000","last_clean":"2024-04-20T10:50:50.918682+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:50.918682+0000","last_undegraded":"2024-04-20T10:50:50.918682+0000","last_fullsized":"2024-04-20T10:50:50.918682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918787+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:50:50.918787+0000","last_peered":"2024-04-20T10:50:50.918787+0000","last_clean":"2024-04-20T10:50:50.918787+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:50:50.918787+0000","last_undegraded":"2024-04-20T10:50:50.918787+0000","last_fullsized":"2024-04-20T10:50:50.918787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918739+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:50.918739+0000","last_peered":"2024-04-20T10:50:50.918739+0000","last_clean":"2024-04-20T10:50:50.918739+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:50.918739+0000","last_undegraded":"2024-04-20T10:50:50.918739+0000","last_fullsized":"2024-04-20T10:50:50.918739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647651+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:50.647651+0000","last_peered":"2024-04-20T10:50:50.647651+0000","last_clean":"2024-04-20T10:50:50.647651+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:50.647651+0000","last_undegraded":"2024-04-20T10:50:50.647651+0000","last_fullsized":"2024-04-20T10:50:50.647651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647567+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:50.647567+0000","last_peered":"2024-04-20T10:50:50.647567+0000","last_clean":"2024-04-20T10:50:50.647567+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:50.647567+0000","last_undegraded":"2024-04-20T10:50:50.647567+0000","last_fullsized":"2024-04-20T10:50:50.647567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919983+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:50:50.919983+0000","last_peered":"2024-04-20T10:50:50.919983+0000","last_clean":"2024-04-20T10:50:50.919983+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:50:50.919983+0000","last_undegraded":"2024-04-20T10:50:50.919983+0000","last_fullsized":"2024-04-20T10:50:50.919983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918676+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:50:50.918676+0000","last_peered":"2024-04-20T10:50:50.918676+0000","last_clean":"2024-04-20T10:50:50.918676+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:50:50.918676+0000","last_undegraded":"2024-04-20T10:50:50.918676+0000","last_fullsized":"2024-04-20T10:50:50.918676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904771+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:50.904771+0000","last_peered":"2024-04-20T10:50:50.904771+0000","last_clean":"2024-04-20T10:50:50.904771+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:50.904771+0000","last_undegraded":"2024-04-20T10:50:50.904771+0000","last_fullsized":"2024-04-20T10:50:50.904771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918237+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:50:50.918237+0000","last_peered":"2024-04-20T10:50:50.918237+0000","last_clean":"2024-04-20T10:50:50.918237+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:50:50.918237+0000","last_undegraded":"2024-04-20T10:50:50.918237+0000","last_fullsized":"2024-04-20T10:50:50.918237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920158+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:50.920158+0000","last_peered":"2024-04-20T10:50:50.920158+0000","last_clean":"2024-04-20T10:50:50.920158+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:50.920158+0000","last_undegraded":"2024-04-20T10:50:50.920158+0000","last_fullsized":"2024-04-20T10:50:50.920158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647709+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:50:50.647709+0000","last_peered":"2024-04-20T10:50:50.647709+0000","last_clean":"2024-04-20T10:50:50.647709+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:50:50.647709+0000","last_undegraded":"2024-04-20T10:50:50.647709+0000","last_fullsized":"2024-04-20T10:50:50.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647411+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:50.647411+0000","last_peered":"2024-04-20T10:50:50.647411+0000","last_clean":"2024-04-20T10:50:50.647411+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:50.647411+0000","last_undegraded":"2024-04-20T10:50:50.647411+0000","last_fullsized":"2024-04-20T10:50:50.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904808+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:50:50.904808+0000","last_peered":"2024-04-20T10:50:50.904808+0000","last_clean":"2024-04-20T10:50:50.904808+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:50:50.904808+0000","last_undegraded":"2024-04-20T10:50:50.904808+0000","last_fullsized":"2024-04-20T10:50:50.904808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918551+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:50.918551+0000","last_peered":"2024-04-20T10:50:50.918551+0000","last_clean":"2024-04-20T10:50:50.918551+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:50.918551+0000","last_undegraded":"2024-04-20T10:50:50.918551+0000","last_fullsized":"2024-04-20T10:50:50.918551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919755+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:50:50.919755+0000","last_peered":"2024-04-20T10:50:50.919755+0000","last_clean":"2024-04-20T10:50:50.919755+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:50:50.919755+0000","last_undegraded":"2024-04-20T10:50:50.919755+0000","last_fullsized":"2024-04-20T10:50:50.919755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919134+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:50.919134+0000","last_peered":"2024-04-20T10:50:50.919134+0000","last_clean":"2024-04-20T10:50:50.919134+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:50.919134+0000","last_undegraded":"2024-04-20T10:50:50.919134+0000","last_fullsized":"2024-04-20T10:50:50.919134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919397+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:50:50.919397+0000","last_peered":"2024-04-20T10:50:50.919397+0000","last_clean":"2024-04-20T10:50:50.919397+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:50:50.919397+0000","last_undegraded":"2024-04-20T10:50:50.919397+0000","last_fullsized":"2024-04-20T10:50:50.919397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919182+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:50.919182+0000","last_peered":"2024-04-20T10:50:50.919182+0000","last_clean":"2024-04-20T10:50:50.919182+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:50.919182+0000","last_undegraded":"2024-04-20T10:50:50.919182+0000","last_fullsized":"2024-04-20T10:50:50.919182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919141+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:50.919141+0000","last_peered":"2024-04-20T10:50:50.919141+0000","last_clean":"2024-04-20T10:50:50.919141+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:50.919141+0000","last_undegraded":"2024-04-20T10:50:50.919141+0000","last_fullsized":"2024-04-20T10:50:50.919141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919836+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:50:50.919836+0000","last_peered":"2024-04-20T10:50:50.919836+0000","last_clean":"2024-04-20T10:50:50.919836+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:50:50.919836+0000","last_undegraded":"2024-04-20T10:50:50.919836+0000","last_fullsized":"2024-04-20T10:50:50.919836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919036+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:50.919036+0000","last_peered":"2024-04-20T10:50:50.919036+0000","last_clean":"2024-04-20T10:50:50.919036+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:50.919036+0000","last_undegraded":"2024-04-20T10:50:50.919036+0000","last_fullsized":"2024-04-20T10:50:50.919036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918038+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:50:50.918038+0000","last_peered":"2024-04-20T10:50:50.918038+0000","last_clean":"2024-04-20T10:50:50.918038+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:50:50.918038+0000","last_undegraded":"2024-04-20T10:50:50.918038+0000","last_fullsized":"2024-04-20T10:50:50.918038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919810+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:50.919810+0000","last_peered":"2024-04-20T10:50:50.919810+0000","last_clean":"2024-04-20T10:50:50.919810+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:50.919810+0000","last_undegraded":"2024-04-20T10:50:50.919810+0000","last_fullsized":"2024-04-20T10:50:50.919810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918353+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:50:50.918353+0000","last_peered":"2024-04-20T10:50:50.918353+0000","last_clean":"2024-04-20T10:50:50.918353+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:50:50.918353+0000","last_undegraded":"2024-04-20T10:50:50.918353+0000","last_fullsized":"2024-04-20T10:50:50.918353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920113+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:50.920113+0000","last_peered":"2024-04-20T10:50:50.920113+0000","last_clean":"2024-04-20T10:50:50.920113+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:50.920113+0000","last_undegraded":"2024-04-20T10:50:50.920113+0000","last_fullsized":"2024-04-20T10:50:50.920113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3653,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":108677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":105982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:51:18.218 INFO:tasks.mds_thrash.ceph_manager:clean! 2024-04-20T10:51:18.218 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:51:18.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.346+0000 7f2fbda81640 1 Processor -- start 2024-04-20T10:51:18.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.346+0000 7f2fbda81640 1 -- start start 2024-04-20T10:51:18.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fbda81640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2fb8150550 0x7f2fb8152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fbda81640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fbda81640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fb80c2b20 con 0x7f2fb806deb0 2024-04-20T10:51:18.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fbda81640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2fb80ab0e0 con 0x7f2fb8150550 2024-04-20T10:51:18.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fbda81640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb8153250 con 0x7f2fb80c3d40 2024-04-20T10:51:18.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2faeffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2fb8150550 0x7f2fb8152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fb77fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2fb806deb0 0x7f2fb814fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50904/0 (socket says 172.21.15.90:50904) 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fb77fe640 1 -- 172.21.15.90:0/3373395614 learned_addr learned my addr 172.21.15.90:0/3373395614 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2faeffd640 1 -- 172.21.15.90:0/3373395614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 msgr2=0x7f2fb80c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fb7fff640 1 --2- 172.21.15.90:0/3373395614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2faeffd640 1 --2- 172.21.15.90:0/3373395614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2fb6ffd640 1 -- 172.21.15.90:0/3373395614 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203244529 0 0) 0x7f2fb80c2b20 con 0x7f2fb806deb0 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2faeffd640 1 -- 172.21.15.90:0/3373395614 >> v1:172.21.15.90:6789/0 conn(0x7f2fb806deb0 legacy=0x7f2fb814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.347+0000 7f2faeffd640 1 -- 172.21.15.90:0/3373395614 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb8153530 con 0x7f2fb8150550 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.348+0000 7f2faeffd640 1 --2- 172.21.15.90:0/3373395614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb8150550 0x7f2fb8152b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00097a0 tx=0x7f2fa002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab70009adeb23ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.348+0000 7f2fb6ffd640 1 -- 172.21.15.90:0/3373395614 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00315a0 con 0x7f2fb8150550 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.348+0000 7f2fb6ffd640 1 -- 172.21.15.90:0/3373395614 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa0037070 con 0x7f2fb8150550 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.348+0000 7f2fb6ffd640 1 -- 172.21.15.90:0/3373395614 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0031960 con 0x7f2fb8150550 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 -- 172.21.15.90:0/3373395614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb8150550 msgr2=0x7f2fb8152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 --2- 172.21.15.90:0/3373395614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb8150550 0x7f2fb8152b90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00097a0 tx=0x7f2fa002b840 comp rx=0 tx=0).stop 2024-04-20T10:51:18.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 -- 172.21.15.90:0/3373395614 shutdown_connections 2024-04-20T10:51:18.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 --2- 172.21.15.90:0/3373395614 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 --2- 172.21.15.90:0/3373395614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb8150550 0x7f2fb8152b90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 -- 172.21.15.90:0/3373395614 >> 172.21.15.90:0/3373395614 conn(0x7f2fb80c8080 msgr2=0x7f2fb80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:18.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 -- 172.21.15.90:0/3373395614 shutdown_connections 2024-04-20T10:51:18.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.349+0000 7f2fbda81640 1 -- 172.21.15.90:0/3373395614 wait complete. 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.350+0000 7f2fbda81640 1 Processor -- start 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.350+0000 7f2fbda81640 1 -- start start 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb806deb0 0x7f2fb814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8150550 0x7f2fb80c62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb8153af0 con 0x7f2fb806deb0 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2fb80c4880 con 0x7f2fb8150550 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2fb806e290 con 0x7f2fb80c3d40 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb806deb0 0x7f2fb814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb806deb0 0x7f2fb814e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48300/0 (socket says 172.21.15.90:48300) 2024-04-20T10:51:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 -- 172.21.15.90:0/1686549165 learned_addr learned my addr 172.21.15.90:0/1686549165 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2faeffd640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb7fff640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8150550 0x7f2fb80c62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 -- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 msgr2=0x7f2fb80c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 -- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8150550 msgr2=0x7f2fb80c62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8150550 0x7f2fb80c62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 -- 172.21.15.90:0/1686549165 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fb814df00 con 0x7f2fb806deb0 2024-04-20T10:51:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2faeffd640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb7fff640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8150550 0x7f2fb80c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:18.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb77fe640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb806deb0 0x7f2fb814e9a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c4a0 tx=0x7f2fa800c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb4ff9640 1 -- 172.21.15.90:0/1686549165 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa8017070 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb4ff9640 1 -- 172.21.15.90:0/1686549165 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fa8005ce0 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fb813c4a0 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fb4ff9640 1 -- 172.21.15.90:0/1686549165 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80072b0 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.351+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fb814e1a0 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.353+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fb8076150 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.353+0000 7f2fb4ff9640 1 -- 172.21.15.90:0/1686549165 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2fa801a070 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.353+0000 7f2fb4ff9640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2f9806c8f0 0x7f2f9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.353+0000 7f2fb4ff9640 1 -- 172.21.15.90:0/1686549165 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f2fa808b200 con 0x7f2fb806deb0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.353+0000 7f2faeffd640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2f9806c8f0 0x7f2f9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.357 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.354+0000 7f2faeffd640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2f9806c8f0 0x7f2f9806edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0036000 tx=0x7f2fa003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.358+0000 7f2fb4ff9640 1 -- 172.21.15.90:0/1686549165 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2fa8059300 con 0x7f2fb806deb0 2024-04-20T10:51:18.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.530+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fb80c86b0 con 0x7f2f9806c8f0 2024-04-20T10:51:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.540+0000 7f2fb4ff9640 1 -- 172.21.15.90:0/1686549165 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+490302 (secure 0 0 0) 0x7f2fb80c86b0 con 0x7f2f9806c8f0 2024-04-20T10:51:18.546 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:18.550 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2f9806c8f0 msgr2=0x7f2f9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2f9806c8f0 0x7f2f9806edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0036000 tx=0x7f2fa003d040 comp rx=0 tx=0).stop 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb806deb0 msgr2=0x7f2fb814e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb806deb0 0x7f2fb814e9a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f2fa800c4a0 tx=0x7f2fa800c960 comp rx=0 tx=0).stop 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 shutdown_connections 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2f9806c8f0 0x7f2f9806edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2fb8150550 0x7f2fb80c62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2fb80c3d40 0x7f2fb80c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 --2- 172.21.15.90:0/1686549165 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2fb806deb0 0x7f2fb814e9a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 >> 172.21.15.90:0/1686549165 conn(0x7f2fb80c8080 msgr2=0x7f2fb80abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:18.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.544+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 shutdown_connections 2024-04-20T10:51:18.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.545+0000 7f2fbda81640 1 -- 172.21.15.90:0/1686549165 wait complete. 2024-04-20T10:51:18.555 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-04-20T10:51:17.671126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596687,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":254,"num_write_kb":2449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219536,"kb_used_data":3368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755184,"statfs":{"total":773094113280,"available":772869308416,"internally_reserved":0,"allocated":3448832,"data_stored":2024830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1499,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646500+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:50:50.646500+0000","last_peered":"2024-04-20T10:50:50.646500+0000","last_clean":"2024-04-20T10:50:50.646500+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:50:50.646500+0000","last_undegraded":"2024-04-20T10:50:50.646500+0000","last_fullsized":"2024-04-20T10:50:50.646500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647942+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:50:50.647942+0000","last_peered":"2024-04-20T10:50:50.647942+0000","last_clean":"2024-04-20T10:50:50.647942+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:50:50.647942+0000","last_undegraded":"2024-04-20T10:50:50.647942+0000","last_fullsized":"2024-04-20T10:50:50.647942+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647361+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:50:50.647361+0000","last_peered":"2024-04-20T10:50:50.647361+0000","last_clean":"2024-04-20T10:50:50.647361+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:50:50.647361+0000","last_undegraded":"2024-04-20T10:50:50.647361+0000","last_fullsized":"2024-04-20T10:50:50.647361+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918471+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:50:50.918471+0000","last_peered":"2024-04-20T10:50:50.918471+0000","last_clean":"2024-04-20T10:50:50.918471+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:50:50.918471+0000","last_undegraded":"2024-04-20T10:50:50.918471+0000","last_fullsized":"2024-04-20T10:50:50.918471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648170+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:50:50.648170+0000","last_peered":"2024-04-20T10:50:50.648170+0000","last_clean":"2024-04-20T10:50:50.648170+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:50:50.648170+0000","last_undegraded":"2024-04-20T10:50:50.648170+0000","last_fullsized":"2024-04-20T10:50:50.648170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918903+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:50:50.918903+0000","last_peered":"2024-04-20T10:50:50.918903+0000","last_clean":"2024-04-20T10:50:50.918903+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:50:50.918903+0000","last_undegraded":"2024-04-20T10:50:50.918903+0000","last_fullsized":"2024-04-20T10:50:50.918903+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646446+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:50:50.646446+0000","last_peered":"2024-04-20T10:50:50.646446+0000","last_clean":"2024-04-20T10:50:50.646446+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:50:50.646446+0000","last_undegraded":"2024-04-20T10:50:50.646446+0000","last_fullsized":"2024-04-20T10:50:50.646446+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918478+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:50:50.918478+0000","last_peered":"2024-04-20T10:50:50.918478+0000","last_clean":"2024-04-20T10:50:50.918478+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:50:50.918478+0000","last_undegraded":"2024-04-20T10:50:50.918478+0000","last_fullsized":"2024-04-20T10:50:50.918478+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920014+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:50:50.920014+0000","last_peered":"2024-04-20T10:50:50.920014+0000","last_clean":"2024-04-20T10:50:50.920014+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:50:50.920014+0000","last_undegraded":"2024-04-20T10:50:50.920014+0000","last_fullsized":"2024-04-20T10:50:50.920014+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918841+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:50:50.918841+0000","last_peered":"2024-04-20T10:50:50.918841+0000","last_clean":"2024-04-20T10:50:50.918841+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:50:50.918841+0000","last_undegraded":"2024-04-20T10:50:50.918841+0000","last_fullsized":"2024-04-20T10:50:50.918841+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646788+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:50:50.646788+0000","last_peered":"2024-04-20T10:50:50.646788+0000","last_clean":"2024-04-20T10:50:50.646788+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:50:50.646788+0000","last_undegraded":"2024-04-20T10:50:50.646788+0000","last_fullsized":"2024-04-20T10:50:50.646788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918243+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:50:50.918243+0000","last_peered":"2024-04-20T10:50:50.918243+0000","last_clean":"2024-04-20T10:50:50.918243+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:50:50.918243+0000","last_undegraded":"2024-04-20T10:50:50.918243+0000","last_fullsized":"2024-04-20T10:50:50.918243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919668+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:50:50.919668+0000","last_peered":"2024-04-20T10:50:50.919668+0000","last_clean":"2024-04-20T10:50:50.919668+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:50:50.919668+0000","last_undegraded":"2024-04-20T10:50:50.919668+0000","last_fullsized":"2024-04-20T10:50:50.919668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919525+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:50:50.919525+0000","last_peered":"2024-04-20T10:50:50.919525+0000","last_clean":"2024-04-20T10:50:50.919525+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:50:50.919525+0000","last_undegraded":"2024-04-20T10:50:50.919525+0000","last_fullsized":"2024-04-20T10:50:50.919525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646886+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:50:50.646886+0000","last_peered":"2024-04-20T10:50:50.646886+0000","last_clean":"2024-04-20T10:50:50.646886+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:50:50.646886+0000","last_undegraded":"2024-04-20T10:50:50.646886+0000","last_fullsized":"2024-04-20T10:50:50.646886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919828+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:50:50.919828+0000","last_peered":"2024-04-20T10:50:50.919828+0000","last_clean":"2024-04-20T10:50:50.919828+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:50:50.919828+0000","last_undegraded":"2024-04-20T10:50:50.919828+0000","last_fullsized":"2024-04-20T10:50:50.919828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647374+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:50:50.647374+0000","last_peered":"2024-04-20T10:50:50.647374+0000","last_clean":"2024-04-20T10:50:50.647374+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:50:50.647374+0000","last_undegraded":"2024-04-20T10:50:50.647374+0000","last_fullsized":"2024-04-20T10:50:50.647374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919489+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:50:50.919489+0000","last_peered":"2024-04-20T10:50:50.919489+0000","last_clean":"2024-04-20T10:50:50.919489+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:50:50.919489+0000","last_undegraded":"2024-04-20T10:50:50.919489+0000","last_fullsized":"2024-04-20T10:50:50.919489+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647710+0000","last_change":"2024-04-20T10:50:40.594090+0000","last_active":"2024-04-20T10:50:50.647710+0000","last_peered":"2024-04-20T10:50:50.647710+0000","last_clean":"2024-04-20T10:50:50.647710+0000","last_became_active":"2024-04-20T10:50:40.593815+0000","last_became_peered":"2024-04-20T10:50:40.593815+0000","last_unstale":"2024-04-20T10:50:50.647710+0000","last_undegraded":"2024-04-20T10:50:50.647710+0000","last_fullsized":"2024-04-20T10:50:50.647710+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:07.016612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918599+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:50:50.918599+0000","last_peered":"2024-04-20T10:50:50.918599+0000","last_clean":"2024-04-20T10:50:50.918599+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:50:50.918599+0000","last_undegraded":"2024-04-20T10:50:50.918599+0000","last_fullsized":"2024-04-20T10:50:50.918599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647233+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:50:50.647233+0000","last_peered":"2024-04-20T10:50:50.647233+0000","last_clean":"2024-04-20T10:50:50.647233+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:50:50.647233+0000","last_undegraded":"2024-04-20T10:50:50.647233+0000","last_fullsized":"2024-04-20T10:50:50.647233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647083+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:50:50.647083+0000","last_peered":"2024-04-20T10:50:50.647083+0000","last_clean":"2024-04-20T10:50:50.647083+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:50:50.647083+0000","last_undegraded":"2024-04-20T10:50:50.647083+0000","last_fullsized":"2024-04-20T10:50:50.647083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647704+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:50:50.647704+0000","last_peered":"2024-04-20T10:50:50.647704+0000","last_clean":"2024-04-20T10:50:50.647704+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:50:50.647704+0000","last_undegraded":"2024-04-20T10:50:50.647704+0000","last_fullsized":"2024-04-20T10:50:50.647704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918767+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:50:50.918767+0000","last_peered":"2024-04-20T10:50:50.918767+0000","last_clean":"2024-04-20T10:50:50.918767+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:50:50.918767+0000","last_undegraded":"2024-04-20T10:50:50.918767+0000","last_fullsized":"2024-04-20T10:50:50.918767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919440+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:50:50.919440+0000","last_peered":"2024-04-20T10:50:50.919440+0000","last_clean":"2024-04-20T10:50:50.919440+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:50:50.919440+0000","last_undegraded":"2024-04-20T10:50:50.919440+0000","last_fullsized":"2024-04-20T10:50:50.919440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919258+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:50:50.919258+0000","last_peered":"2024-04-20T10:50:50.919258+0000","last_clean":"2024-04-20T10:50:50.919258+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:50:50.919258+0000","last_undegraded":"2024-04-20T10:50:50.919258+0000","last_fullsized":"2024-04-20T10:50:50.919258+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647487+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:50:50.647487+0000","last_peered":"2024-04-20T10:50:50.647487+0000","last_clean":"2024-04-20T10:50:50.647487+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:50:50.647487+0000","last_undegraded":"2024-04-20T10:50:50.647487+0000","last_fullsized":"2024-04-20T10:50:50.647487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918378+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:50:50.918378+0000","last_peered":"2024-04-20T10:50:50.918378+0000","last_clean":"2024-04-20T10:50:50.918378+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:50:50.918378+0000","last_undegraded":"2024-04-20T10:50:50.918378+0000","last_fullsized":"2024-04-20T10:50:50.918378+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647210+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:50:50.647210+0000","last_peered":"2024-04-20T10:50:50.647210+0000","last_clean":"2024-04-20T10:50:50.647210+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:50:50.647210+0000","last_undegraded":"2024-04-20T10:50:50.647210+0000","last_fullsized":"2024-04-20T10:50:50.647210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647499+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:50:50.647499+0000","last_peered":"2024-04-20T10:50:50.647499+0000","last_clean":"2024-04-20T10:50:50.647499+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:50:50.647499+0000","last_undegraded":"2024-04-20T10:50:50.647499+0000","last_fullsized":"2024-04-20T10:50:50.647499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919297+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:50:50.919297+0000","last_peered":"2024-04-20T10:50:50.919297+0000","last_clean":"2024-04-20T10:50:50.919297+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:50:50.919297+0000","last_undegraded":"2024-04-20T10:50:50.919297+0000","last_fullsized":"2024-04-20T10:50:50.919297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904955+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:50:50.904955+0000","last_peered":"2024-04-20T10:50:50.904955+0000","last_clean":"2024-04-20T10:50:50.904955+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:50:50.904955+0000","last_undegraded":"2024-04-20T10:50:50.904955+0000","last_fullsized":"2024-04-20T10:50:50.904955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647061+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:50:50.647061+0000","last_peered":"2024-04-20T10:50:50.647061+0000","last_clean":"2024-04-20T10:50:50.647061+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:50:50.647061+0000","last_undegraded":"2024-04-20T10:50:50.647061+0000","last_fullsized":"2024-04-20T10:50:50.647061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646640+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:50:50.646640+0000","last_peered":"2024-04-20T10:50:50.646640+0000","last_clean":"2024-04-20T10:50:50.646640+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:50:50.646640+0000","last_undegraded":"2024-04-20T10:50:50.646640+0000","last_fullsized":"2024-04-20T10:50:50.646640+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647815+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:50:50.647815+0000","last_peered":"2024-04-20T10:50:50.647815+0000","last_clean":"2024-04-20T10:50:50.647815+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:50:50.647815+0000","last_undegraded":"2024-04-20T10:50:50.647815+0000","last_fullsized":"2024-04-20T10:50:50.647815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919903+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:50:50.919903+0000","last_peered":"2024-04-20T10:50:50.919903+0000","last_clean":"2024-04-20T10:50:50.919903+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:50:50.919903+0000","last_undegraded":"2024-04-20T10:50:50.919903+0000","last_fullsized":"2024-04-20T10:50:50.919903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647184+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:50:50.647184+0000","last_peered":"2024-04-20T10:50:50.647184+0000","last_clean":"2024-04-20T10:50:50.647184+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:50:50.647184+0000","last_undegraded":"2024-04-20T10:50:50.647184+0000","last_fullsized":"2024-04-20T10:50:50.647184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904364+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:50:50.904364+0000","last_peered":"2024-04-20T10:50:50.904364+0000","last_clean":"2024-04-20T10:50:50.904364+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:50:50.904364+0000","last_undegraded":"2024-04-20T10:50:50.904364+0000","last_fullsized":"2024-04-20T10:50:50.904364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919960+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:50:50.919960+0000","last_peered":"2024-04-20T10:50:50.919960+0000","last_clean":"2024-04-20T10:50:50.919960+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:50:50.919960+0000","last_undegraded":"2024-04-20T10:50:50.919960+0000","last_fullsized":"2024-04-20T10:50:50.919960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920149+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:50:50.920149+0000","last_peered":"2024-04-20T10:50:50.920149+0000","last_clean":"2024-04-20T10:50:50.920149+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:50:50.920149+0000","last_undegraded":"2024-04-20T10:50:50.920149+0000","last_fullsized":"2024-04-20T10:50:50.920149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919053+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:50:50.919053+0000","last_peered":"2024-04-20T10:50:50.919053+0000","last_clean":"2024-04-20T10:50:50.919053+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:50:50.919053+0000","last_undegraded":"2024-04-20T10:50:50.919053+0000","last_fullsized":"2024-04-20T10:50:50.919053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919379+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:50:50.919379+0000","last_peered":"2024-04-20T10:50:50.919379+0000","last_clean":"2024-04-20T10:50:50.919379+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:50:50.919379+0000","last_undegraded":"2024-04-20T10:50:50.919379+0000","last_fullsized":"2024-04-20T10:50:50.919379+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919594+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:50:50.919594+0000","last_peered":"2024-04-20T10:50:50.919594+0000","last_clean":"2024-04-20T10:50:50.919594+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:50:50.919594+0000","last_undegraded":"2024-04-20T10:50:50.919594+0000","last_fullsized":"2024-04-20T10:50:50.919594+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919993+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:50:50.919993+0000","last_peered":"2024-04-20T10:50:50.919993+0000","last_clean":"2024-04-20T10:50:50.919993+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:50:50.919993+0000","last_undegraded":"2024-04-20T10:50:50.919993+0000","last_fullsized":"2024-04-20T10:50:50.919993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918452+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:50:50.918452+0000","last_peered":"2024-04-20T10:50:50.918452+0000","last_clean":"2024-04-20T10:50:50.918452+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:50:50.918452+0000","last_undegraded":"2024-04-20T10:50:50.918452+0000","last_fullsized":"2024-04-20T10:50:50.918452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918934+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:50:50.918934+0000","last_peered":"2024-04-20T10:50:50.918934+0000","last_clean":"2024-04-20T10:50:50.918934+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:50:50.918934+0000","last_undegraded":"2024-04-20T10:50:50.918934+0000","last_fullsized":"2024-04-20T10:50:50.918934+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647503+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:50:50.647503+0000","last_peered":"2024-04-20T10:50:50.647503+0000","last_clean":"2024-04-20T10:50:50.647503+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:50:50.647503+0000","last_undegraded":"2024-04-20T10:50:50.647503+0000","last_fullsized":"2024-04-20T10:50:50.647503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919438+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:50:50.919438+0000","last_peered":"2024-04-20T10:50:50.919438+0000","last_clean":"2024-04-20T10:50:50.919438+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:50:50.919438+0000","last_undegraded":"2024-04-20T10:50:50.919438+0000","last_fullsized":"2024-04-20T10:50:50.919438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918697+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:50:50.918697+0000","last_peered":"2024-04-20T10:50:50.918697+0000","last_clean":"2024-04-20T10:50:50.918697+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:50:50.918697+0000","last_undegraded":"2024-04-20T10:50:50.918697+0000","last_fullsized":"2024-04-20T10:50:50.918697+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918186+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:50:50.918186+0000","last_peered":"2024-04-20T10:50:50.918186+0000","last_clean":"2024-04-20T10:50:50.918186+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:50:50.918186+0000","last_undegraded":"2024-04-20T10:50:50.918186+0000","last_fullsized":"2024-04-20T10:50:50.918186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919238+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:50:50.919238+0000","last_peered":"2024-04-20T10:50:50.919238+0000","last_clean":"2024-04-20T10:50:50.919238+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:50:50.919238+0000","last_undegraded":"2024-04-20T10:50:50.919238+0000","last_fullsized":"2024-04-20T10:50:50.919238+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919687+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:50:50.919687+0000","last_peered":"2024-04-20T10:50:50.919687+0000","last_clean":"2024-04-20T10:50:50.919687+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:50:50.919687+0000","last_undegraded":"2024-04-20T10:50:50.919687+0000","last_fullsized":"2024-04-20T10:50:50.919687+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918605+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:50:50.918605+0000","last_peered":"2024-04-20T10:50:50.918605+0000","last_clean":"2024-04-20T10:50:50.918605+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:50:50.918605+0000","last_undegraded":"2024-04-20T10:50:50.918605+0000","last_fullsized":"2024-04-20T10:50:50.918605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918474+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:50:50.918474+0000","last_peered":"2024-04-20T10:50:50.918474+0000","last_clean":"2024-04-20T10:50:50.918474+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:50:50.918474+0000","last_undegraded":"2024-04-20T10:50:50.918474+0000","last_fullsized":"2024-04-20T10:50:50.918474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919237+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:50:50.919237+0000","last_peered":"2024-04-20T10:50:50.919237+0000","last_clean":"2024-04-20T10:50:50.919237+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:50:50.919237+0000","last_undegraded":"2024-04-20T10:50:50.919237+0000","last_fullsized":"2024-04-20T10:50:50.919237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919239+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:50:50.919239+0000","last_peered":"2024-04-20T10:50:50.919239+0000","last_clean":"2024-04-20T10:50:50.919239+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:50:50.919239+0000","last_undegraded":"2024-04-20T10:50:50.919239+0000","last_fullsized":"2024-04-20T10:50:50.919239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647940+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:50:50.647940+0000","last_peered":"2024-04-20T10:50:50.647940+0000","last_clean":"2024-04-20T10:50:50.647940+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:50:50.647940+0000","last_undegraded":"2024-04-20T10:50:50.647940+0000","last_fullsized":"2024-04-20T10:50:50.647940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918168+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:50:50.918168+0000","last_peered":"2024-04-20T10:50:50.918168+0000","last_clean":"2024-04-20T10:50:50.918168+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:50:50.918168+0000","last_undegraded":"2024-04-20T10:50:50.918168+0000","last_fullsized":"2024-04-20T10:50:50.918168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918735+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:50:50.918735+0000","last_peered":"2024-04-20T10:50:50.918735+0000","last_clean":"2024-04-20T10:50:50.918735+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:50:50.918735+0000","last_undegraded":"2024-04-20T10:50:50.918735+0000","last_fullsized":"2024-04-20T10:50:50.918735+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904495+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:50:50.904495+0000","last_peered":"2024-04-20T10:50:50.904495+0000","last_clean":"2024-04-20T10:50:50.904495+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:50:50.904495+0000","last_undegraded":"2024-04-20T10:50:50.904495+0000","last_fullsized":"2024-04-20T10:50:50.904495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920137+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:50:50.920137+0000","last_peered":"2024-04-20T10:50:50.920137+0000","last_clean":"2024-04-20T10:50:50.920137+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:50:50.920137+0000","last_undegraded":"2024-04-20T10:50:50.920137+0000","last_fullsized":"2024-04-20T10:50:50.920137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919949+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:50:50.919949+0000","last_peered":"2024-04-20T10:50:50.919949+0000","last_clean":"2024-04-20T10:50:50.919949+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:50:50.919949+0000","last_undegraded":"2024-04-20T10:50:50.919949+0000","last_fullsized":"2024-04-20T10:50:50.919949+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920093+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:50:50.920093+0000","last_peered":"2024-04-20T10:50:50.920093+0000","last_clean":"2024-04-20T10:50:50.920093+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:50:50.920093+0000","last_undegraded":"2024-04-20T10:50:50.920093+0000","last_fullsized":"2024-04-20T10:50:50.920093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904372+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:50:50.904372+0000","last_peered":"2024-04-20T10:50:50.904372+0000","last_clean":"2024-04-20T10:50:50.904372+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:50:50.904372+0000","last_undegraded":"2024-04-20T10:50:50.904372+0000","last_fullsized":"2024-04-20T10:50:50.904372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918546+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:50:50.918546+0000","last_peered":"2024-04-20T10:50:50.918546+0000","last_clean":"2024-04-20T10:50:50.918546+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:50:50.918546+0000","last_undegraded":"2024-04-20T10:50:50.918546+0000","last_fullsized":"2024-04-20T10:50:50.918546+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919184+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:50:50.919184+0000","last_peered":"2024-04-20T10:50:50.919184+0000","last_clean":"2024-04-20T10:50:50.919184+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:50:50.919184+0000","last_undegraded":"2024-04-20T10:50:50.919184+0000","last_fullsized":"2024-04-20T10:50:50.919184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920068+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:50:50.920068+0000","last_peered":"2024-04-20T10:50:50.920068+0000","last_clean":"2024-04-20T10:50:50.920068+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:50:50.920068+0000","last_undegraded":"2024-04-20T10:50:50.920068+0000","last_fullsized":"2024-04-20T10:50:50.920068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918899+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:50:50.918899+0000","last_peered":"2024-04-20T10:50:50.918899+0000","last_clean":"2024-04-20T10:50:50.918899+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:50:50.918899+0000","last_undegraded":"2024-04-20T10:50:50.918899+0000","last_fullsized":"2024-04-20T10:50:50.918899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918088+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:50:50.918088+0000","last_peered":"2024-04-20T10:50:50.918088+0000","last_clean":"2024-04-20T10:50:50.918088+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:50:50.918088+0000","last_undegraded":"2024-04-20T10:50:50.918088+0000","last_fullsized":"2024-04-20T10:50:50.918088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920183+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:50:50.920183+0000","last_peered":"2024-04-20T10:50:50.920183+0000","last_clean":"2024-04-20T10:50:50.920183+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:50:50.920183+0000","last_undegraded":"2024-04-20T10:50:50.920183+0000","last_fullsized":"2024-04-20T10:50:50.920183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918853+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:50:50.918853+0000","last_peered":"2024-04-20T10:50:50.918853+0000","last_clean":"2024-04-20T10:50:50.918853+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:50:50.918853+0000","last_undegraded":"2024-04-20T10:50:50.918853+0000","last_fullsized":"2024-04-20T10:50:50.918853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918057+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:50:50.918057+0000","last_peered":"2024-04-20T10:50:50.918057+0000","last_clean":"2024-04-20T10:50:50.918057+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:50:50.918057+0000","last_undegraded":"2024-04-20T10:50:50.918057+0000","last_fullsized":"2024-04-20T10:50:50.918057+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919612+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:50:50.919612+0000","last_peered":"2024-04-20T10:50:50.919612+0000","last_clean":"2024-04-20T10:50:50.919612+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:50:50.919612+0000","last_undegraded":"2024-04-20T10:50:50.919612+0000","last_fullsized":"2024-04-20T10:50:50.919612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647644+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:50:50.647644+0000","last_peered":"2024-04-20T10:50:50.647644+0000","last_clean":"2024-04-20T10:50:50.647644+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:50:50.647644+0000","last_undegraded":"2024-04-20T10:50:50.647644+0000","last_fullsized":"2024-04-20T10:50:50.647644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646587+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:50:50.646587+0000","last_peered":"2024-04-20T10:50:50.646587+0000","last_clean":"2024-04-20T10:50:50.646587+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:50:50.646587+0000","last_undegraded":"2024-04-20T10:50:50.646587+0000","last_fullsized":"2024-04-20T10:50:50.646587+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647705+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:50:50.647705+0000","last_peered":"2024-04-20T10:50:50.647705+0000","last_clean":"2024-04-20T10:50:50.647705+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:50:50.647705+0000","last_undegraded":"2024-04-20T10:50:50.647705+0000","last_fullsized":"2024-04-20T10:50:50.647705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918736+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:50:50.918736+0000","last_peered":"2024-04-20T10:50:50.918736+0000","last_clean":"2024-04-20T10:50:50.918736+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:50:50.918736+0000","last_undegraded":"2024-04-20T10:50:50.918736+0000","last_fullsized":"2024-04-20T10:50:50.918736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918257+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:50:50.918257+0000","last_peered":"2024-04-20T10:50:50.918257+0000","last_clean":"2024-04-20T10:50:50.918257+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:50:50.918257+0000","last_undegraded":"2024-04-20T10:50:50.918257+0000","last_fullsized":"2024-04-20T10:50:50.918257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919316+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:50:50.919316+0000","last_peered":"2024-04-20T10:50:50.919316+0000","last_clean":"2024-04-20T10:50:50.919316+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:50:50.919316+0000","last_undegraded":"2024-04-20T10:50:50.919316+0000","last_fullsized":"2024-04-20T10:50:50.919316+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918977+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:50:50.918977+0000","last_peered":"2024-04-20T10:50:50.918977+0000","last_clean":"2024-04-20T10:50:50.918977+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:50:50.918977+0000","last_undegraded":"2024-04-20T10:50:50.918977+0000","last_fullsized":"2024-04-20T10:50:50.918977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904080+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:50:50.904080+0000","last_peered":"2024-04-20T10:50:50.904080+0000","last_clean":"2024-04-20T10:50:50.904080+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:50:50.904080+0000","last_undegraded":"2024-04-20T10:50:50.904080+0000","last_fullsized":"2024-04-20T10:50:50.904080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904487+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:50:50.904487+0000","last_peered":"2024-04-20T10:50:50.904487+0000","last_clean":"2024-04-20T10:50:50.904487+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:50:50.904487+0000","last_undegraded":"2024-04-20T10:50:50.904487+0000","last_fullsized":"2024-04-20T10:50:50.904487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647768+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:50:50.647768+0000","last_peered":"2024-04-20T10:50:50.647768+0000","last_clean":"2024-04-20T10:50:50.647768+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:50:50.647768+0000","last_undegraded":"2024-04-20T10:50:50.647768+0000","last_fullsized":"2024-04-20T10:50:50.647768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918820+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:50:50.918820+0000","last_peered":"2024-04-20T10:50:50.918820+0000","last_clean":"2024-04-20T10:50:50.918820+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:50:50.918820+0000","last_undegraded":"2024-04-20T10:50:50.918820+0000","last_fullsized":"2024-04-20T10:50:50.918820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919283+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:50:50.919283+0000","last_peered":"2024-04-20T10:50:50.919283+0000","last_clean":"2024-04-20T10:50:50.919283+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:50:50.919283+0000","last_undegraded":"2024-04-20T10:50:50.919283+0000","last_fullsized":"2024-04-20T10:50:50.919283+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919373+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:50:50.919373+0000","last_peered":"2024-04-20T10:50:50.919373+0000","last_clean":"2024-04-20T10:50:50.919373+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:50:50.919373+0000","last_undegraded":"2024-04-20T10:50:50.919373+0000","last_fullsized":"2024-04-20T10:50:50.919373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"25'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:51:13.206557+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:51:13.206557+0000","last_peered":"2024-04-20T10:51:13.206557+0000","last_clean":"2024-04-20T10:51:13.206557+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:51:13.206557+0000","last_undegraded":"2024-04-20T10:51:13.206557+0000","last_fullsized":"2024-04-20T10:51:13.206557+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1868,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648149+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:50:50.648149+0000","last_peered":"2024-04-20T10:50:50.648149+0000","last_clean":"2024-04-20T10:50:50.648149+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:50:50.648149+0000","last_undegraded":"2024-04-20T10:50:50.648149+0000","last_fullsized":"2024-04-20T10:50:50.648149+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918773+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:50:50.918773+0000","last_peered":"2024-04-20T10:50:50.918773+0000","last_clean":"2024-04-20T10:50:50.918773+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:50:50.918773+0000","last_undegraded":"2024-04-20T10:50:50.918773+0000","last_fullsized":"2024-04-20T10:50:50.918773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919619+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:50:50.919619+0000","last_peered":"2024-04-20T10:50:50.919619+0000","last_clean":"2024-04-20T10:50:50.919619+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:50:50.919619+0000","last_undegraded":"2024-04-20T10:50:50.919619+0000","last_fullsized":"2024-04-20T10:50:50.919619+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"24'3","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919480+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:50:50.919480+0000","last_peered":"2024-04-20T10:50:50.919480+0000","last_clean":"2024-04-20T10:50:50.919480+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:50:50.919480+0000","last_undegraded":"2024-04-20T10:50:50.919480+0000","last_fullsized":"2024-04-20T10:50:50.919480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647622+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:50:50.647622+0000","last_peered":"2024-04-20T10:50:50.647622+0000","last_clean":"2024-04-20T10:50:50.647622+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:50:50.647622+0000","last_undegraded":"2024-04-20T10:50:50.647622+0000","last_fullsized":"2024-04-20T10:50:50.647622+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919782+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:50:50.919782+0000","last_peered":"2024-04-20T10:50:50.919782+0000","last_clean":"2024-04-20T10:50:50.919782+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:50:50.919782+0000","last_undegraded":"2024-04-20T10:50:50.919782+0000","last_fullsized":"2024-04-20T10:50:50.919782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:51:10.729406+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:51:10.729406+0000","last_peered":"2024-04-20T10:51:10.729406+0000","last_clean":"2024-04-20T10:51:10.729406+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:51:10.729406+0000","last_undegraded":"2024-04-20T10:51:10.729406+0000","last_fullsized":"2024-04-20T10:51:10.729406+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918370+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:50:50.918370+0000","last_peered":"2024-04-20T10:50:50.918370+0000","last_clean":"2024-04-20T10:50:50.918370+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:50:50.918370+0000","last_undegraded":"2024-04-20T10:50:50.918370+0000","last_fullsized":"2024-04-20T10:50:50.918370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918531+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:50:50.918531+0000","last_peered":"2024-04-20T10:50:50.918531+0000","last_clean":"2024-04-20T10:50:50.918531+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:50:50.918531+0000","last_undegraded":"2024-04-20T10:50:50.918531+0000","last_fullsized":"2024-04-20T10:50:50.918531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647604+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:50:50.647604+0000","last_peered":"2024-04-20T10:50:50.647604+0000","last_clean":"2024-04-20T10:50:50.647604+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:50:50.647604+0000","last_undegraded":"2024-04-20T10:50:50.647604+0000","last_fullsized":"2024-04-20T10:50:50.647604+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920018+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:50:50.920018+0000","last_peered":"2024-04-20T10:50:50.920018+0000","last_clean":"2024-04-20T10:50:50.920018+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:50:50.920018+0000","last_undegraded":"2024-04-20T10:50:50.920018+0000","last_fullsized":"2024-04-20T10:50:50.920018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647241+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:50:50.647241+0000","last_peered":"2024-04-20T10:50:50.647241+0000","last_clean":"2024-04-20T10:50:50.647241+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:50:50.647241+0000","last_undegraded":"2024-04-20T10:50:50.647241+0000","last_fullsized":"2024-04-20T10:50:50.647241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904476+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:50:50.904476+0000","last_peered":"2024-04-20T10:50:50.904476+0000","last_clean":"2024-04-20T10:50:50.904476+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:50:50.904476+0000","last_undegraded":"2024-04-20T10:50:50.904476+0000","last_fullsized":"2024-04-20T10:50:50.904476+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919071+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:50:50.919071+0000","last_peered":"2024-04-20T10:50:50.919071+0000","last_clean":"2024-04-20T10:50:50.919071+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:50:50.919071+0000","last_undegraded":"2024-04-20T10:50:50.919071+0000","last_fullsized":"2024-04-20T10:50:50.919071+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919039+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:50:50.919039+0000","last_peered":"2024-04-20T10:50:50.919039+0000","last_clean":"2024-04-20T10:50:50.919039+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:50:50.919039+0000","last_undegraded":"2024-04-20T10:50:50.919039+0000","last_fullsized":"2024-04-20T10:50:50.919039+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"24'8","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647348+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:50:50.647348+0000","last_peered":"2024-04-20T10:50:50.647348+0000","last_clean":"2024-04-20T10:50:50.647348+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:50:50.647348+0000","last_undegraded":"2024-04-20T10:50:50.647348+0000","last_fullsized":"2024-04-20T10:50:50.647348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918201+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:50:50.918201+0000","last_peered":"2024-04-20T10:50:50.918201+0000","last_clean":"2024-04-20T10:50:50.918201+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:50:50.918201+0000","last_undegraded":"2024-04-20T10:50:50.918201+0000","last_fullsized":"2024-04-20T10:50:50.918201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919011+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:50:50.919011+0000","last_peered":"2024-04-20T10:50:50.919011+0000","last_clean":"2024-04-20T10:50:50.919011+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:50:50.919011+0000","last_undegraded":"2024-04-20T10:50:50.919011+0000","last_fullsized":"2024-04-20T10:50:50.919011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904919+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:50:50.904919+0000","last_peered":"2024-04-20T10:50:50.904919+0000","last_clean":"2024-04-20T10:50:50.904919+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:50:50.904919+0000","last_undegraded":"2024-04-20T10:50:50.904919+0000","last_fullsized":"2024-04-20T10:50:50.904919+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647257+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:50:50.647257+0000","last_peered":"2024-04-20T10:50:50.647257+0000","last_clean":"2024-04-20T10:50:50.647257+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:50:50.647257+0000","last_undegraded":"2024-04-20T10:50:50.647257+0000","last_fullsized":"2024-04-20T10:50:50.647257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904798+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:50:50.904798+0000","last_peered":"2024-04-20T10:50:50.904798+0000","last_clean":"2024-04-20T10:50:50.904798+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:50:50.904798+0000","last_undegraded":"2024-04-20T10:50:50.904798+0000","last_fullsized":"2024-04-20T10:50:50.904798+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"24'1","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919143+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:50:50.919143+0000","last_peered":"2024-04-20T10:50:50.919143+0000","last_clean":"2024-04-20T10:50:50.919143+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:50:50.919143+0000","last_undegraded":"2024-04-20T10:50:50.919143+0000","last_fullsized":"2024-04-20T10:50:50.919143+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918587+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:50:50.918587+0000","last_peered":"2024-04-20T10:50:50.918587+0000","last_clean":"2024-04-20T10:50:50.918587+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:50:50.918587+0000","last_undegraded":"2024-04-20T10:50:50.918587+0000","last_fullsized":"2024-04-20T10:50:50.918587+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918226+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:50:50.918226+0000","last_peered":"2024-04-20T10:50:50.918226+0000","last_clean":"2024-04-20T10:50:50.918226+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:50:50.918226+0000","last_undegraded":"2024-04-20T10:50:50.918226+0000","last_fullsized":"2024-04-20T10:50:50.918226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919055+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:50:50.919055+0000","last_peered":"2024-04-20T10:50:50.919055+0000","last_clean":"2024-04-20T10:50:50.919055+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:50:50.919055+0000","last_undegraded":"2024-04-20T10:50:50.919055+0000","last_fullsized":"2024-04-20T10:50:50.919055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"24'4","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904885+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:50:50.904885+0000","last_peered":"2024-04-20T10:50:50.904885+0000","last_clean":"2024-04-20T10:50:50.904885+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:50:50.904885+0000","last_undegraded":"2024-04-20T10:50:50.904885+0000","last_fullsized":"2024-04-20T10:50:50.904885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647617+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:50:50.647617+0000","last_peered":"2024-04-20T10:50:50.647617+0000","last_clean":"2024-04-20T10:50:50.647617+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:50:50.647617+0000","last_undegraded":"2024-04-20T10:50:50.647617+0000","last_fullsized":"2024-04-20T10:50:50.647617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647427+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:50:50.647427+0000","last_peered":"2024-04-20T10:50:50.647427+0000","last_clean":"2024-04-20T10:50:50.647427+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:50:50.647427+0000","last_undegraded":"2024-04-20T10:50:50.647427+0000","last_fullsized":"2024-04-20T10:50:50.647427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919353+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:50:50.919353+0000","last_peered":"2024-04-20T10:50:50.919353+0000","last_clean":"2024-04-20T10:50:50.919353+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:50:50.919353+0000","last_undegraded":"2024-04-20T10:50:50.919353+0000","last_fullsized":"2024-04-20T10:50:50.919353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904598+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:50:50.904598+0000","last_peered":"2024-04-20T10:50:50.904598+0000","last_clean":"2024-04-20T10:50:50.904598+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:50:50.904598+0000","last_undegraded":"2024-04-20T10:50:50.904598+0000","last_fullsized":"2024-04-20T10:50:50.904598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919448+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:50:50.919448+0000","last_peered":"2024-04-20T10:50:50.919448+0000","last_clean":"2024-04-20T10:50:50.919448+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:50:50.919448+0000","last_undegraded":"2024-04-20T10:50:50.919448+0000","last_fullsized":"2024-04-20T10:50:50.919448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919923+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:50:50.919923+0000","last_peered":"2024-04-20T10:50:50.919923+0000","last_clean":"2024-04-20T10:50:50.919923+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:50:50.919923+0000","last_undegraded":"2024-04-20T10:50:50.919923+0000","last_fullsized":"2024-04-20T10:50:50.919923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646954+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:50:50.646954+0000","last_peered":"2024-04-20T10:50:50.646954+0000","last_clean":"2024-04-20T10:50:50.646954+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:50:50.646954+0000","last_undegraded":"2024-04-20T10:50:50.646954+0000","last_fullsized":"2024-04-20T10:50:50.646954+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647875+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:50:50.647875+0000","last_peered":"2024-04-20T10:50:50.647875+0000","last_clean":"2024-04-20T10:50:50.647875+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:50:50.647875+0000","last_undegraded":"2024-04-20T10:50:50.647875+0000","last_fullsized":"2024-04-20T10:50:50.647875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647129+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:50:50.647129+0000","last_peered":"2024-04-20T10:50:50.647129+0000","last_clean":"2024-04-20T10:50:50.647129+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:50:50.647129+0000","last_undegraded":"2024-04-20T10:50:50.647129+0000","last_fullsized":"2024-04-20T10:50:50.647129+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"24'2","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648051+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:50:50.648051+0000","last_peered":"2024-04-20T10:50:50.648051+0000","last_clean":"2024-04-20T10:50:50.648051+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:50:50.648051+0000","last_undegraded":"2024-04-20T10:50:50.648051+0000","last_fullsized":"2024-04-20T10:50:50.648051+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648041+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:50:50.648041+0000","last_peered":"2024-04-20T10:50:50.648041+0000","last_clean":"2024-04-20T10:50:50.648041+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:50:50.648041+0000","last_undegraded":"2024-04-20T10:50:50.648041+0000","last_fullsized":"2024-04-20T10:50:50.648041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904067+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:50:50.904067+0000","last_peered":"2024-04-20T10:50:50.904067+0000","last_clean":"2024-04-20T10:50:50.904067+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:50:50.904067+0000","last_undegraded":"2024-04-20T10:50:50.904067+0000","last_fullsized":"2024-04-20T10:50:50.904067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919274+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:50:50.919274+0000","last_peered":"2024-04-20T10:50:50.919274+0000","last_clean":"2024-04-20T10:50:50.919274+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:50:50.919274+0000","last_undegraded":"2024-04-20T10:50:50.919274+0000","last_fullsized":"2024-04-20T10:50:50.919274+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918980+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:50:50.918980+0000","last_peered":"2024-04-20T10:50:50.918980+0000","last_clean":"2024-04-20T10:50:50.918980+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:50:50.918980+0000","last_undegraded":"2024-04-20T10:50:50.918980+0000","last_fullsized":"2024-04-20T10:50:50.918980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918617+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:50:50.918617+0000","last_peered":"2024-04-20T10:50:50.918617+0000","last_clean":"2024-04-20T10:50:50.918617+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:50:50.918617+0000","last_undegraded":"2024-04-20T10:50:50.918617+0000","last_fullsized":"2024-04-20T10:50:50.918617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919308+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:50:50.919308+0000","last_peered":"2024-04-20T10:50:50.919308+0000","last_clean":"2024-04-20T10:50:50.919308+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:50:50.919308+0000","last_undegraded":"2024-04-20T10:50:50.919308+0000","last_fullsized":"2024-04-20T10:50:50.919308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919217+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:50:50.919217+0000","last_peered":"2024-04-20T10:50:50.919217+0000","last_clean":"2024-04-20T10:50:50.919217+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:50:50.919217+0000","last_undegraded":"2024-04-20T10:50:50.919217+0000","last_fullsized":"2024-04-20T10:50:50.919217+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919405+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:50:50.919405+0000","last_peered":"2024-04-20T10:50:50.919405+0000","last_clean":"2024-04-20T10:50:50.919405+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:50:50.919405+0000","last_undegraded":"2024-04-20T10:50:50.919405+0000","last_fullsized":"2024-04-20T10:50:50.919405+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918338+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:50:50.918338+0000","last_peered":"2024-04-20T10:50:50.918338+0000","last_clean":"2024-04-20T10:50:50.918338+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:50:50.918338+0000","last_undegraded":"2024-04-20T10:50:50.918338+0000","last_fullsized":"2024-04-20T10:50:50.918338+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.648264+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:50:50.648264+0000","last_peered":"2024-04-20T10:50:50.648264+0000","last_clean":"2024-04-20T10:50:50.648264+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:50:50.648264+0000","last_undegraded":"2024-04-20T10:50:50.648264+0000","last_fullsized":"2024-04-20T10:50:50.648264+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647153+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:50:50.647153+0000","last_peered":"2024-04-20T10:50:50.647153+0000","last_clean":"2024-04-20T10:50:50.647153+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:50:50.647153+0000","last_undegraded":"2024-04-20T10:50:50.647153+0000","last_fullsized":"2024-04-20T10:50:50.647153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919569+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:50:50.919569+0000","last_peered":"2024-04-20T10:50:50.919569+0000","last_clean":"2024-04-20T10:50:50.919569+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:50:50.919569+0000","last_undegraded":"2024-04-20T10:50:50.919569+0000","last_fullsized":"2024-04-20T10:50:50.919569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919606+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:50:50.919606+0000","last_peered":"2024-04-20T10:50:50.919606+0000","last_clean":"2024-04-20T10:50:50.919606+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:50:50.919606+0000","last_undegraded":"2024-04-20T10:50:50.919606+0000","last_fullsized":"2024-04-20T10:50:50.919606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904775+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:50:50.904775+0000","last_peered":"2024-04-20T10:50:50.904775+0000","last_clean":"2024-04-20T10:50:50.904775+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:50:50.904775+0000","last_undegraded":"2024-04-20T10:50:50.904775+0000","last_fullsized":"2024-04-20T10:50:50.904775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904299+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:50:50.904299+0000","last_peered":"2024-04-20T10:50:50.904299+0000","last_clean":"2024-04-20T10:50:50.904299+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:50:50.904299+0000","last_undegraded":"2024-04-20T10:50:50.904299+0000","last_fullsized":"2024-04-20T10:50:50.904299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647767+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:50:50.647767+0000","last_peered":"2024-04-20T10:50:50.647767+0000","last_clean":"2024-04-20T10:50:50.647767+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:50:50.647767+0000","last_undegraded":"2024-04-20T10:50:50.647767+0000","last_fullsized":"2024-04-20T10:50:50.647767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647843+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:50:50.647843+0000","last_peered":"2024-04-20T10:50:50.647843+0000","last_clean":"2024-04-20T10:50:50.647843+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:50:50.647843+0000","last_undegraded":"2024-04-20T10:50:50.647843+0000","last_fullsized":"2024-04-20T10:50:50.647843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918116+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:50:50.918116+0000","last_peered":"2024-04-20T10:50:50.918116+0000","last_clean":"2024-04-20T10:50:50.918116+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:50:50.918116+0000","last_undegraded":"2024-04-20T10:50:50.918116+0000","last_fullsized":"2024-04-20T10:50:50.918116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920306+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:50:50.920306+0000","last_peered":"2024-04-20T10:50:50.920306+0000","last_clean":"2024-04-20T10:50:50.920306+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:50:50.920306+0000","last_undegraded":"2024-04-20T10:50:50.920306+0000","last_fullsized":"2024-04-20T10:50:50.920306+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647324+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:50:50.647324+0000","last_peered":"2024-04-20T10:50:50.647324+0000","last_clean":"2024-04-20T10:50:50.647324+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:50:50.647324+0000","last_undegraded":"2024-04-20T10:50:50.647324+0000","last_fullsized":"2024-04-20T10:50:50.647324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919821+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:50:50.919821+0000","last_peered":"2024-04-20T10:50:50.919821+0000","last_clean":"2024-04-20T10:50:50.919821+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:50:50.919821+0000","last_undegraded":"2024-04-20T10:50:50.919821+0000","last_fullsized":"2024-04-20T10:50:50.919821+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919185+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:50:50.919185+0000","last_peered":"2024-04-20T10:50:50.919185+0000","last_clean":"2024-04-20T10:50:50.919185+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:50:50.919185+0000","last_undegraded":"2024-04-20T10:50:50.919185+0000","last_fullsized":"2024-04-20T10:50:50.919185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647822+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:50:50.647822+0000","last_peered":"2024-04-20T10:50:50.647822+0000","last_clean":"2024-04-20T10:50:50.647822+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:50:50.647822+0000","last_undegraded":"2024-04-20T10:50:50.647822+0000","last_fullsized":"2024-04-20T10:50:50.647822+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919221+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:50:50.919221+0000","last_peered":"2024-04-20T10:50:50.919221+0000","last_clean":"2024-04-20T10:50:50.919221+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:50:50.919221+0000","last_undegraded":"2024-04-20T10:50:50.919221+0000","last_fullsized":"2024-04-20T10:50:50.919221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646687+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:50:50.646687+0000","last_peered":"2024-04-20T10:50:50.646687+0000","last_clean":"2024-04-20T10:50:50.646687+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:50:50.646687+0000","last_undegraded":"2024-04-20T10:50:50.646687+0000","last_fullsized":"2024-04-20T10:50:50.646687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904324+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:50:50.904324+0000","last_peered":"2024-04-20T10:50:50.904324+0000","last_clean":"2024-04-20T10:50:50.904324+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:50:50.904324+0000","last_undegraded":"2024-04-20T10:50:50.904324+0000","last_fullsized":"2024-04-20T10:50:50.904324+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.646680+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:50:50.646680+0000","last_peered":"2024-04-20T10:50:50.646680+0000","last_clean":"2024-04-20T10:50:50.646680+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:50:50.646680+0000","last_undegraded":"2024-04-20T10:50:50.646680+0000","last_fullsized":"2024-04-20T10:50:50.646680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920058+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:50:50.920058+0000","last_peered":"2024-04-20T10:50:50.920058+0000","last_clean":"2024-04-20T10:50:50.920058+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:50:50.920058+0000","last_undegraded":"2024-04-20T10:50:50.920058+0000","last_fullsized":"2024-04-20T10:50:50.920058+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918048+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:50:50.918048+0000","last_peered":"2024-04-20T10:50:50.918048+0000","last_clean":"2024-04-20T10:50:50.918048+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:50:50.918048+0000","last_undegraded":"2024-04-20T10:50:50.918048+0000","last_fullsized":"2024-04-20T10:50:50.918048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918749+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:50:50.918749+0000","last_peered":"2024-04-20T10:50:50.918749+0000","last_clean":"2024-04-20T10:50:50.918749+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:50:50.918749+0000","last_undegraded":"2024-04-20T10:50:50.918749+0000","last_fullsized":"2024-04-20T10:50:50.918749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918281+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:50:50.918281+0000","last_peered":"2024-04-20T10:50:50.918281+0000","last_clean":"2024-04-20T10:50:50.918281+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:50:50.918281+0000","last_undegraded":"2024-04-20T10:50:50.918281+0000","last_fullsized":"2024-04-20T10:50:50.918281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919598+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:50:50.919598+0000","last_peered":"2024-04-20T10:50:50.919598+0000","last_clean":"2024-04-20T10:50:50.919598+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:50:50.919598+0000","last_undegraded":"2024-04-20T10:50:50.919598+0000","last_fullsized":"2024-04-20T10:50:50.919598+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919839+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:50:50.919839+0000","last_peered":"2024-04-20T10:50:50.919839+0000","last_clean":"2024-04-20T10:50:50.919839+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:50:50.919839+0000","last_undegraded":"2024-04-20T10:50:50.919839+0000","last_fullsized":"2024-04-20T10:50:50.919839+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918109+0000","last_change":"2024-04-20T10:50:40.600922+0000","last_active":"2024-04-20T10:50:50.918109+0000","last_peered":"2024-04-20T10:50:50.918109+0000","last_clean":"2024-04-20T10:50:50.918109+0000","last_became_active":"2024-04-20T10:50:40.600645+0000","last_became_peered":"2024-04-20T10:50:40.600645+0000","last_unstale":"2024-04-20T10:50:50.918109+0000","last_undegraded":"2024-04-20T10:50:50.918109+0000","last_fullsized":"2024-04-20T10:50:50.918109+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:29.643520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647462+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:50:50.647462+0000","last_peered":"2024-04-20T10:50:50.647462+0000","last_clean":"2024-04-20T10:50:50.647462+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:50:50.647462+0000","last_undegraded":"2024-04-20T10:50:50.647462+0000","last_fullsized":"2024-04-20T10:50:50.647462+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918682+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:50:50.918682+0000","last_peered":"2024-04-20T10:50:50.918682+0000","last_clean":"2024-04-20T10:50:50.918682+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:50:50.918682+0000","last_undegraded":"2024-04-20T10:50:50.918682+0000","last_fullsized":"2024-04-20T10:50:50.918682+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918787+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:50:50.918787+0000","last_peered":"2024-04-20T10:50:50.918787+0000","last_clean":"2024-04-20T10:50:50.918787+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:50:50.918787+0000","last_undegraded":"2024-04-20T10:50:50.918787+0000","last_fullsized":"2024-04-20T10:50:50.918787+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918739+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:50:50.918739+0000","last_peered":"2024-04-20T10:50:50.918739+0000","last_clean":"2024-04-20T10:50:50.918739+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:50:50.918739+0000","last_undegraded":"2024-04-20T10:50:50.918739+0000","last_fullsized":"2024-04-20T10:50:50.918739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919939+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:50:50.919939+0000","last_peered":"2024-04-20T10:50:50.919939+0000","last_clean":"2024-04-20T10:50:50.919939+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:50:50.919939+0000","last_undegraded":"2024-04-20T10:50:50.919939+0000","last_fullsized":"2024-04-20T10:50:50.919939+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647651+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:50:50.647651+0000","last_peered":"2024-04-20T10:50:50.647651+0000","last_clean":"2024-04-20T10:50:50.647651+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:50:50.647651+0000","last_undegraded":"2024-04-20T10:50:50.647651+0000","last_fullsized":"2024-04-20T10:50:50.647651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647567+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:50:50.647567+0000","last_peered":"2024-04-20T10:50:50.647567+0000","last_clean":"2024-04-20T10:50:50.647567+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:50:50.647567+0000","last_undegraded":"2024-04-20T10:50:50.647567+0000","last_fullsized":"2024-04-20T10:50:50.647567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919983+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:50:50.919983+0000","last_peered":"2024-04-20T10:50:50.919983+0000","last_clean":"2024-04-20T10:50:50.919983+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:50:50.919983+0000","last_undegraded":"2024-04-20T10:50:50.919983+0000","last_fullsized":"2024-04-20T10:50:50.919983+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904539+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:50:50.904539+0000","last_peered":"2024-04-20T10:50:50.904539+0000","last_clean":"2024-04-20T10:50:50.904539+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:50:50.904539+0000","last_undegraded":"2024-04-20T10:50:50.904539+0000","last_fullsized":"2024-04-20T10:50:50.904539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918676+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:50:50.918676+0000","last_peered":"2024-04-20T10:50:50.918676+0000","last_clean":"2024-04-20T10:50:50.918676+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:50:50.918676+0000","last_undegraded":"2024-04-20T10:50:50.918676+0000","last_fullsized":"2024-04-20T10:50:50.918676+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904771+0000","last_change":"2024-04-20T10:50:40.605022+0000","last_active":"2024-04-20T10:50:50.904771+0000","last_peered":"2024-04-20T10:50:50.904771+0000","last_clean":"2024-04-20T10:50:50.904771+0000","last_became_active":"2024-04-20T10:50:40.604735+0000","last_became_peered":"2024-04-20T10:50:40.604735+0000","last_unstale":"2024-04-20T10:50:50.904771+0000","last_undegraded":"2024-04-20T10:50:50.904771+0000","last_fullsized":"2024-04-20T10:50:50.904771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:31.874025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918237+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:50:50.918237+0000","last_peered":"2024-04-20T10:50:50.918237+0000","last_clean":"2024-04-20T10:50:50.918237+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:50:50.918237+0000","last_undegraded":"2024-04-20T10:50:50.918237+0000","last_fullsized":"2024-04-20T10:50:50.918237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920158+0000","last_change":"2024-04-20T10:50:40.598715+0000","last_active":"2024-04-20T10:50:50.920158+0000","last_peered":"2024-04-20T10:50:50.920158+0000","last_clean":"2024-04-20T10:50:50.920158+0000","last_became_active":"2024-04-20T10:50:40.598457+0000","last_became_peered":"2024-04-20T10:50:40.598457+0000","last_unstale":"2024-04-20T10:50:50.920158+0000","last_undegraded":"2024-04-20T10:50:50.920158+0000","last_fullsized":"2024-04-20T10:50:50.920158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:29.775211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647709+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:50:50.647709+0000","last_peered":"2024-04-20T10:50:50.647709+0000","last_clean":"2024-04-20T10:50:50.647709+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:50:50.647709+0000","last_undegraded":"2024-04-20T10:50:50.647709+0000","last_fullsized":"2024-04-20T10:50:50.647709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647411+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:50:50.647411+0000","last_peered":"2024-04-20T10:50:50.647411+0000","last_clean":"2024-04-20T10:50:50.647411+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:50:50.647411+0000","last_undegraded":"2024-04-20T10:50:50.647411+0000","last_fullsized":"2024-04-20T10:50:50.647411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.904808+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:50:50.904808+0000","last_peered":"2024-04-20T10:50:50.904808+0000","last_clean":"2024-04-20T10:50:50.904808+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:50:50.904808+0000","last_undegraded":"2024-04-20T10:50:50.904808+0000","last_fullsized":"2024-04-20T10:50:50.904808+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918551+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:50:50.918551+0000","last_peered":"2024-04-20T10:50:50.918551+0000","last_clean":"2024-04-20T10:50:50.918551+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:50:50.918551+0000","last_undegraded":"2024-04-20T10:50:50.918551+0000","last_fullsized":"2024-04-20T10:50:50.918551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919755+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:50:50.919755+0000","last_peered":"2024-04-20T10:50:50.919755+0000","last_clean":"2024-04-20T10:50:50.919755+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:50:50.919755+0000","last_undegraded":"2024-04-20T10:50:50.919755+0000","last_fullsized":"2024-04-20T10:50:50.919755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919134+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:50:50.919134+0000","last_peered":"2024-04-20T10:50:50.919134+0000","last_clean":"2024-04-20T10:50:50.919134+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:50:50.919134+0000","last_undegraded":"2024-04-20T10:50:50.919134+0000","last_fullsized":"2024-04-20T10:50:50.919134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919397+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:50:50.919397+0000","last_peered":"2024-04-20T10:50:50.919397+0000","last_clean":"2024-04-20T10:50:50.919397+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:50:50.919397+0000","last_undegraded":"2024-04-20T10:50:50.919397+0000","last_fullsized":"2024-04-20T10:50:50.919397+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919182+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:50:50.919182+0000","last_peered":"2024-04-20T10:50:50.919182+0000","last_clean":"2024-04-20T10:50:50.919182+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:50:50.919182+0000","last_undegraded":"2024-04-20T10:50:50.919182+0000","last_fullsized":"2024-04-20T10:50:50.919182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.647502+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:50:50.647502+0000","last_peered":"2024-04-20T10:50:50.647502+0000","last_clean":"2024-04-20T10:50:50.647502+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:50:50.647502+0000","last_undegraded":"2024-04-20T10:50:50.647502+0000","last_fullsized":"2024-04-20T10:50:50.647502+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919141+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:50:50.919141+0000","last_peered":"2024-04-20T10:50:50.919141+0000","last_clean":"2024-04-20T10:50:50.919141+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:50:50.919141+0000","last_undegraded":"2024-04-20T10:50:50.919141+0000","last_fullsized":"2024-04-20T10:50:50.919141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919836+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:50:50.919836+0000","last_peered":"2024-04-20T10:50:50.919836+0000","last_clean":"2024-04-20T10:50:50.919836+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:50:50.919836+0000","last_undegraded":"2024-04-20T10:50:50.919836+0000","last_fullsized":"2024-04-20T10:50:50.919836+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919036+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:50:50.919036+0000","last_peered":"2024-04-20T10:50:50.919036+0000","last_clean":"2024-04-20T10:50:50.919036+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:50:50.919036+0000","last_undegraded":"2024-04-20T10:50:50.919036+0000","last_fullsized":"2024-04-20T10:50:50.919036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918038+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:50:50.918038+0000","last_peered":"2024-04-20T10:50:50.918038+0000","last_clean":"2024-04-20T10:50:50.918038+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:50:50.918038+0000","last_undegraded":"2024-04-20T10:50:50.918038+0000","last_fullsized":"2024-04-20T10:50:50.918038+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.919810+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:50:50.919810+0000","last_peered":"2024-04-20T10:50:50.919810+0000","last_clean":"2024-04-20T10:50:50.919810+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:50:50.919810+0000","last_undegraded":"2024-04-20T10:50:50.919810+0000","last_fullsized":"2024-04-20T10:50:50.919810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.918353+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:50:50.918353+0000","last_peered":"2024-04-20T10:50:50.918353+0000","last_clean":"2024-04-20T10:50:50.918353+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:50:50.918353+0000","last_undegraded":"2024-04-20T10:50:50.918353+0000","last_fullsized":"2024-04-20T10:50:50.918353+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-20T10:50:50.920113+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:50:50.920113+0000","last_peered":"2024-04-20T10:50:50.920113+0000","last_clean":"2024-04-20T10:50:50.920113+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:50:50.920113+0000","last_undegraded":"2024-04-20T10:50:50.920113+0000","last_fullsized":"2024-04-20T10:50:50.920113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2666,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":5332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":3653,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":694972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574861,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":54,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":104694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":104162,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":108677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":105982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":872448,"data_stored":694938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:51:18.563 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:18.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.692+0000 7f385bec1640 1 Processor -- start 2024-04-20T10:51:18.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.692+0000 7f385bec1640 1 -- start start 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.693+0000 7f385bec1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f38540c51d0 0x7f3854157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.693+0000 7f385bec1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38541587c0 con 0x7f385406b930 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.693+0000 7f385bec1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38540c46f0 con 0x7f3854151b10 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.693+0000 7f385bec1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f38540c4d40 con 0x7f38540c51d0 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.693+0000 7f385945c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f38540c51d0 0x7f3854157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.693+0000 7f385a45e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f385406b930 0x7f3854157fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50906/0 (socket says 172.21.15.90:50906) 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.693+0000 7f385a45e640 1 -- 172.21.15.90:0/2525759423 learned_addr learned my addr 172.21.15.90:0/2525759423 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.694+0000 7f385945c640 1 -- 172.21.15.90:0/2525759423 >> v1:172.21.15.175:6789/0 conn(0x7f3854151b10 legacy=0x7f38540ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.694+0000 7f385945c640 1 -- 172.21.15.90:0/2525759423 >> v1:172.21.15.90:6789/0 conn(0x7f385406b930 legacy=0x7f3854157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.694+0000 7f385945c640 1 -- 172.21.15.90:0/2525759423 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38540c49d0 con 0x7f38540c51d0 2024-04-20T10:51:18.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.694+0000 7f3858c5b640 1 -- 172.21.15.90:0/2525759423 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945539290 0 0) 0x7f38541587c0 con 0x7f385406b930 2024-04-20T10:51:18.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.694+0000 7f385945c640 1 --2- 172.21.15.90:0/2525759423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c51d0 0x7f3854157a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f38540c4ec0 tx=0x7f384402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5af9fcac3916d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f3858c5b640 1 -- 172.21.15.90:0/2525759423 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38440315a0 con 0x7f38540c51d0 2024-04-20T10:51:18.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f3858c5b640 1 -- 172.21.15.90:0/2525759423 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3844037070 con 0x7f38540c51d0 2024-04-20T10:51:18.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f3858c5b640 1 -- 172.21.15.90:0/2525759423 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3844031960 con 0x7f38540c51d0 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f385bec1640 1 -- 172.21.15.90:0/2525759423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c51d0 msgr2=0x7f3854157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f385bec1640 1 --2- 172.21.15.90:0/2525759423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c51d0 0x7f3854157a80 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f38540c4ec0 tx=0x7f384402b840 comp rx=0 tx=0).stop 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f385bec1640 1 -- 172.21.15.90:0/2525759423 shutdown_connections 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f385bec1640 1 --2- 172.21.15.90:0/2525759423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f38540c51d0 0x7f3854157a80 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f385bec1640 1 -- 172.21.15.90:0/2525759423 >> 172.21.15.90:0/2525759423 conn(0x7f38540c9100 msgr2=0x7f38540c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f385bec1640 1 -- 172.21.15.90:0/2525759423 shutdown_connections 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.695+0000 7f385bec1640 1 -- 172.21.15.90:0/2525759423 wait complete. 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.696+0000 7f385bec1640 1 Processor -- start 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.696+0000 7f385bec1640 1 -- start start 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385bec1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f385406b930 0x7f38541eaf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385bec1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540c51d0 0x7f3854153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385bec1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3854151b10 0x7f3854152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385bec1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f38540acb90 con 0x7f3854151b10 2024-04-20T10:51:18.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385bec1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3854151ef0 con 0x7f38540c51d0 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385bec1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f38540acd10 con 0x7f385406b930 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3854151b10 0x7f3854152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3854151b10 0x7f3854152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48310/0 (socket says 172.21.15.90:48310) 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 -- 172.21.15.90:0/2725106036 learned_addr learned my addr 172.21.15.90:0/2725106036 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f3859c5d640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f385406b930 0x7f38541eaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385945c640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540c51d0 0x7f3854153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 -- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f385406b930 msgr2=0x7f38541eaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f385406b930 0x7f38541eaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 -- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540c51d0 msgr2=0x7f3854153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540c51d0 0x7f3854153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 -- 172.21.15.90:0/2725106036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38540c5c70 con 0x7f3854151b10 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.697+0000 7f385a45e640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3854151b10 0x7f3854152e40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f384c00c3f0 tx=0x7f384c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.698+0000 7f384a7fc640 1 -- 172.21.15.90:0/2725106036 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c0074e0 con 0x7f3854151b10 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.698+0000 7f384a7fc640 1 -- 172.21.15.90:0/2725106036 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f384c0047e0 con 0x7f3854151b10 2024-04-20T10:51:18.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.698+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38540c5f50 con 0x7f3854151b10 2024-04-20T10:51:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.698+0000 7f384a7fc640 1 -- 172.21.15.90:0/2725106036 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f384c004bd0 con 0x7f3854151b10 2024-04-20T10:51:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.698+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38540c6230 con 0x7f3854151b10 2024-04-20T10:51:18.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.699+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3854076150 con 0x7f3854151b10 2024-04-20T10:51:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.699+0000 7f384a7fc640 1 -- 172.21.15.90:0/2725106036 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f384c011070 con 0x7f3854151b10 2024-04-20T10:51:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.699+0000 7f384a7fc640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f383806c920 0x7f383806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.700+0000 7f384a7fc640 1 -- 172.21.15.90:0/2725106036 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f384c08b940 con 0x7f3854151b10 2024-04-20T10:51:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.700+0000 7f3859c5d640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f383806c920 0x7f383806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.700+0000 7f3859c5d640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f383806c920 0x7f383806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38500012e0 tx=0x7f3850009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:18.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.704+0000 7f384a7fc640 1 -- 172.21.15.90:0/2725106036 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f384c01a2b0 con 0x7f3854151b10 2024-04-20T10:51:18.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.880+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38540c8ee0 con 0x7f3854151b10 2024-04-20T10:51:18.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.882+0000 7f384a7fc640 1 -- 172.21.15.90:0/2725106036 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+20343 (secure 0 0 0) 0x7f384c059ad0 con 0x7f3854151b10 2024-04-20T10:51:18.882 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:18.882 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:50:50.632385+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:18.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.883+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f383806c920 msgr2=0x7f383806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.883+0000 7f385bec1640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f383806c920 0x7f383806ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f38500012e0 tx=0x7f3850009040 comp rx=0 tx=0).stop 2024-04-20T10:51:18.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3854151b10 msgr2=0x7f3854152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3854151b10 0x7f3854152e40 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f384c00c3f0 tx=0x7f384c00c8b0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 shutdown_connections 2024-04-20T10:51:18.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f383806c920 0x7f383806ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3854151b10 0x7f3854152e40 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f38540c51d0 0x7f3854153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 --2- 172.21.15.90:0/2725106036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f385406b930 0x7f38541eaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 >> 172.21.15.90:0/2725106036 conn(0x7f38540c9100 msgr2=0x7f3854150610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:18.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 shutdown_connections 2024-04-20T10:51:18.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.884+0000 7f385bec1640 1 -- 172.21.15.90:0/2725106036 wait complete. 2024-04-20T10:51:18.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:51:18.895 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:51:18.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.994+0000 7f0600150640 1 Processor -- start 2024-04-20T10:51:18.995 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.995+0000 7f0600150640 1 -- start start 2024-04-20T10:51:18.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.995+0000 7f0600150640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f05f80c4bb0 0x7f05f8159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.995+0000 7f0600150640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f80af590 con 0x7f05f815a340 2024-04-20T10:51:18.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.995+0000 7f0600150640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05f80acd70 con 0x7f05f8154040 2024-04-20T10:51:18.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.995+0000 7f0600150640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f05f80acb20 con 0x7f05f80c4bb0 2024-04-20T10:51:18.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.995+0000 7f05fe6ed640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f05f815a340 0x7f05f81611e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50910/0 (socket says 172.21.15.90:50910) 2024-04-20T10:51:18.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.995+0000 7f05fe6ed640 1 -- 172.21.15.90:0/4013141104 learned_addr learned my addr 172.21.15.90:0/4013141104 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fd6eb640 1 --2- 172.21.15.90:0/4013141104 >> v2:172.21.15.175:3300/0 conn(0x7f05f80c4bb0 0x7f05f8159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234086072 0 0) 0x7f05f80af590 con 0x7f05f815a340 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05e4003520 con 0x7f05f815a340 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2107333583 0 0) 0x7f05e4003520 con 0x7f05f815a340 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 >> v2:172.21.15.175:3300/0 conn(0x7f05f80c4bb0 msgr2=0x7f05f8159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 --2- 172.21.15.90:0/4013141104 >> v2:172.21.15.175:3300/0 conn(0x7f05f80c4bb0 0x7f05f8159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 >> v1:172.21.15.175:6789/0 conn(0x7f05f8154040 legacy=0x7f05f80730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f80c6400 con 0x7f05f815a340 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f05f0001670 con 0x7f05f815a340 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 >> v1:172.21.15.90:6789/0 conn(0x7f05f815a340 legacy=0x7f05f81611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e40039b0 0x7f05e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e4004800 0x7f05e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:18.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05f80acb20 con 0x7f05e40052e0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05e400c1b0 con 0x7f05e4004800 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f05e400c3b0 con 0x7f05e40039b0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fe6ed640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fd6eb640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e4004800 0x7f05e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fdeec640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e40039b0 0x7f05e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fe6ed640 1 -- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e40039b0 msgr2=0x7f05e4003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fe6ed640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05e40039b0 0x7f05e4003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fe6ed640 1 -- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e4004800 msgr2=0x7f05e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fe6ed640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05e4004800 0x7f05e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.996+0000 7f05fe6ed640 1 -- 172.21.15.90:0/4013141104 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05e4003520 con 0x7f05e40052e0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.997+0000 7f05fe6ed640 1 -- 172.21.15.90:0/4013141104 reap_dead start 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.997+0000 7f05fe6ed640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05e400b9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f05f0001050 tx=0x7f05e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=352afaa8dcb1a9b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.997+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0007d30 con 0x7f05e40052e0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.997+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f0030070 con 0x7f05e40052e0 2024-04-20T10:51:19.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.997+0000 7f05fceea640 1 -- 172.21.15.90:0/4013141104 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f0005d30 con 0x7f05e40052e0 2024-04-20T10:51:19.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.998+0000 7f0600150640 1 -- 172.21.15.90:0/4013141104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 msgr2=0x7f05e400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.998+0000 7f0600150640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05e400b9c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f05f0001050 tx=0x7f05e4005830 comp rx=0 tx=0).stop 2024-04-20T10:51:19.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.998+0000 7f0600150640 1 -- 172.21.15.90:0/4013141104 shutdown_connections 2024-04-20T10:51:19.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.998+0000 7f0600150640 1 --2- 172.21.15.90:0/4013141104 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05e400b9c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.998+0000 7f0600150640 1 -- 172.21.15.90:0/4013141104 >> 172.21.15.90:0/4013141104 conn(0x7f05f80676c0 msgr2=0x7f05f8067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:19.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.998+0000 7f0600150640 1 -- 172.21.15.90:0/4013141104 shutdown_connections 2024-04-20T10:51:19.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.998+0000 7f0600150640 1 -- 172.21.15.90:0/4013141104 wait complete. 2024-04-20T10:51:19.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.999+0000 7f0600150640 1 Processor -- start 2024-04-20T10:51:19.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:18.999+0000 7f0600150640 1 -- start start 2024-04-20T10:51:19.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05f814c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05f8159370 0x7f05f8149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05f81597b0 0x7f05f814a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f05f80aeea0 con 0x7f05e40052e0 2024-04-20T10:51:19.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f05f815a7b0 con 0x7f05f81597b0 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f05f80af020 con 0x7f05f8159370 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05f814c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05f814c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48326/0 (socket says 172.21.15.90:48326) 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 -- 172.21.15.90:0/3940176118 learned_addr learned my addr 172.21.15.90:0/3940176118 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fe6ed640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05f81597b0 0x7f05f814a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 -- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05f8159370 msgr2=0x7f05f8149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05f8159370 0x7f05f8149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 -- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05f81597b0 msgr2=0x7f05f814a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05f81597b0 0x7f05f814a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 -- 172.21.15.90:0/3940176118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05f814a8b0 con 0x7f05e40052e0 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fe6ed640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05f81597b0 0x7f05f814a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05fdeec640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05f814c0c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f05f400e880 tx=0x7f05f400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05ee7fc640 1 -- 172.21.15.90:0/3940176118 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4003b80 con 0x7f05e40052e0 2024-04-20T10:51:19.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05ee7fc640 1 -- 172.21.15.90:0/3940176118 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f05f4018070 con 0x7f05e40052e0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05f8157db0 con 0x7f05e40052e0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f05ee7fc640 1 -- 172.21.15.90:0/3940176118 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f40050d0 con 0x7f05e40052e0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.000+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05f8158370 con 0x7f05e40052e0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.001+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05f8076150 con 0x7f05e40052e0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.002+0000 7f05ee7fc640 1 -- 172.21.15.90:0/3940176118 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f05f4005270 con 0x7f05e40052e0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.002+0000 7f05ee7fc640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05dc06c920 0x7f05dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.002+0000 7f05ee7fc640 1 -- 172.21.15.90:0/3940176118 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7f05f408bd40 con 0x7f05e40052e0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.002+0000 7f05fd6eb640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05dc06c920 0x7f05dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.003+0000 7f05fd6eb640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05dc06c920 0x7f05dc06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f05f8153810 tx=0x7f05e8009320 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.007+0000 7f05ee7fc640 1 -- 172.21.15.90:0/3940176118 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f05f4059e50 con 0x7f05e40052e0 2024-04-20T10:51:19.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.183+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f05f80ac4f0 con 0x7f05e40052e0 2024-04-20T10:51:19.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.183+0000 7f05ee7fc640 1 -- 172.21.15.90:0/3940176118 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f05f401be40 con 0x7f05e40052e0 2024-04-20T10:51:19.184 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:51:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05dc06c920 msgr2=0x7f05dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05dc06c920 0x7f05dc06ede0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f05f8153810 tx=0x7f05e8009320 comp rx=0 tx=0).stop 2024-04-20T10:51:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 msgr2=0x7f05f814c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05f814c0c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f05f400e880 tx=0x7f05f400ed40 comp rx=0 tx=0).stop 2024-04-20T10:51:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 shutdown_connections 2024-04-20T10:51:19.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05dc06c920 0x7f05dc06ede0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f05f81597b0 0x7f05f814a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f05f8159370 0x7f05f8149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 --2- 172.21.15.90:0/3940176118 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f05e40052e0 0x7f05f814c0c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 >> 172.21.15.90:0/3940176118 conn(0x7f05f80676c0 msgr2=0x7f05f8074f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:19.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 shutdown_connections 2024-04-20T10:51:19.187 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.185+0000 7f0600150640 1 -- 172.21.15.90:0/3940176118 wait complete. 2024-04-20T10:51:19.196 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:51:19.296 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.296+0000 7fb3164fd640 1 Processor -- start 2024-04-20T10:51:19.297 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.296+0000 7fb3164fd640 1 -- start start 2024-04-20T10:51:19.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb3164fd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3100701c0 0x7fb310073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb3164fd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb31015ab30 0x7fb310156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb3164fd640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3100c6870 con 0x7fb310073640 2024-04-20T10:51:19.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb3164fd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb3100ab630 con 0x7fb31015ab30 2024-04-20T10:51:19.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb3164fd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb310159e00 con 0x7fb3100701c0 2024-04-20T10:51:19.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb30f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb31015ab30 0x7fb310156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb30f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb31015ab30 0x7fb310156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48330/0 (socket says 172.21.15.90:48330) 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb30f7fe640 1 -- 172.21.15.90:0/453892283 learned_addr learned my addr 172.21.15.90:0/453892283 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb30f7fe640 1 -- 172.21.15.90:0/453892283 >> v2:172.21.15.175:3300/0 conn(0x7fb3100701c0 msgr2=0x7fb310073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb30ffff640 1 --2- 172.21.15.90:0/453892283 >> v2:172.21.15.175:3300/0 conn(0x7fb3100701c0 0x7fb310073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb30f7fe640 1 --2- 172.21.15.90:0/453892283 >> v2:172.21.15.175:3300/0 conn(0x7fb3100701c0 0x7fb310073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.297+0000 7fb30f7fe640 1 -- 172.21.15.90:0/453892283 >> v1:172.21.15.175:6789/0 conn(0x7fb310073640 legacy=0x7fb310153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.298+0000 7fb30f7fe640 1 -- 172.21.15.90:0/453892283 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31015a050 con 0x7fb31015ab30 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.298+0000 7fb30ffff640 1 --2- 172.21.15.90:0/453892283 >> v2:172.21.15.175:3300/0 conn(0x7fb3100701c0 0x7fb310073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.298+0000 7fb30f7fe640 1 --2- 172.21.15.90:0/453892283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb310156810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3100c55f0 tx=0x7fb30402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd94633bbbb4540 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.298+0000 7fb30effd640 1 -- 172.21.15.90:0/453892283 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304035020 con 0x7fb31015ab30 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.298+0000 7fb30effd640 1 -- 172.21.15.90:0/453892283 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb304031870 con 0x7fb31015ab30 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.298+0000 7fb30effd640 1 -- 172.21.15.90:0/453892283 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304031c40 con 0x7fb31015ab30 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 -- 172.21.15.90:0/453892283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 msgr2=0x7fb310156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 --2- 172.21.15.90:0/453892283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb310156810 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb3100c55f0 tx=0x7fb30402b910 comp rx=0 tx=0).stop 2024-04-20T10:51:19.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 -- 172.21.15.90:0/453892283 shutdown_connections 2024-04-20T10:51:19.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 --2- 172.21.15.90:0/453892283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb310156810 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 --2- 172.21.15.90:0/453892283 >> v2:172.21.15.175:3300/0 conn(0x7fb3100701c0 0x7fb310073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 -- 172.21.15.90:0/453892283 >> 172.21.15.90:0/453892283 conn(0x7fb3100676c0 msgr2=0x7fb310067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:19.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 -- 172.21.15.90:0/453892283 shutdown_connections 2024-04-20T10:51:19.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.299+0000 7fb3164fd640 1 -- 172.21.15.90:0/453892283 wait complete. 2024-04-20T10:51:19.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.300+0000 7fb3164fd640 1 Processor -- start 2024-04-20T10:51:19.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.300+0000 7fb3164fd640 1 -- start start 2024-04-20T10:51:19.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb3164fd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3100701c0 0x7fb3101577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb3164fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb310073640 0x7fb3101efa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb3164fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb3101eff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb3164fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3100705a0 con 0x7fb31015ab30 2024-04-20T10:51:19.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb3164fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb31015a610 con 0x7fb310073640 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb3164fd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb3100c6470 con 0x7fb3100701c0 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb3101eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb3101eff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48332/0 (socket says 172.21.15.90:48332) 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 -- 172.21.15.90:0/4083885469 learned_addr learned my addr 172.21.15.90:0/4083885469 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb30f7fe640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb310073640 0x7fb3101efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb30ffff640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3100701c0 0x7fb3101577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 -- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3100701c0 msgr2=0x7fb3101577f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3100701c0 0x7fb3101577f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 -- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb310073640 msgr2=0x7fb3101efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb310073640 0x7fb3101efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb314a9a640 1 -- 172.21.15.90:0/4083885469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3100c8040 con 0x7fb31015ab30 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.301+0000 7fb30ffff640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3100701c0 0x7fb3101577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.302+0000 7fb314a9a640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb3101eff50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c780 tx=0x7fb30800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.302+0000 7fb30cff9640 1 -- 172.21.15.90:0/4083885469 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308004b60 con 0x7fb31015ab30 2024-04-20T10:51:19.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.302+0000 7fb30cff9640 1 -- 172.21.15.90:0/4083885469 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb308004d00 con 0x7fb31015ab30 2024-04-20T10:51:19.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.302+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3100c8c70 con 0x7fb31015ab30 2024-04-20T10:51:19.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.302+0000 7fb30cff9640 1 -- 172.21.15.90:0/4083885469 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30800aa90 con 0x7fb31015ab30 2024-04-20T10:51:19.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.302+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3101f08a0 con 0x7fb31015ab30 2024-04-20T10:51:19.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.303+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb310076150 con 0x7fb31015ab30 2024-04-20T10:51:19.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.303+0000 7fb30cff9640 1 -- 172.21.15.90:0/4083885469 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb30800ac30 con 0x7fb31015ab30 2024-04-20T10:51:19.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.304+0000 7fb30cff9640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2fc06c920 0x7fb2fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.304+0000 7fb30ffff640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2fc06c920 0x7fb2fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.304+0000 7fb30cff9640 1 -- 172.21.15.90:0/4083885469 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7fb30808c0a0 con 0x7fb31015ab30 2024-04-20T10:51:19.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.304+0000 7fb30ffff640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2fc06c920 0x7fb2fc06ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb300006fd0 tx=0x7fb300008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.308+0000 7fb30cff9640 1 -- 172.21.15.90:0/4083885469 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb308020070 con 0x7fb31015ab30 2024-04-20T10:51:19.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.480+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7fb310072790 con 0x7fb31015ab30 2024-04-20T10:51:19.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.481+0000 7fb30cff9640 1 -- 172.21.15.90:0/4083885469 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v25) ==== 99+0+11 (secure 0 0 0) 0x7fb3100c8040 con 0x7fb31015ab30 2024-04-20T10:51:19.481 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2fc06c920 msgr2=0x7fb2fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2fc06c920 0x7fb2fc06ede0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb300006fd0 tx=0x7fb300008040 comp rx=0 tx=0).stop 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 msgr2=0x7fb3101eff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb3101eff50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb30800c780 tx=0x7fb30800cc40 comp rx=0 tx=0).stop 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 shutdown_connections 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2fc06c920 0x7fb2fc06ede0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb31015ab30 0x7fb3101eff50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb310073640 0x7fb3101efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 --2- 172.21.15.90:0/4083885469 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3100701c0 0x7fb3101577f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 >> 172.21.15.90:0/4083885469 conn(0x7fb3100676c0 msgr2=0x7fb310067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:19.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 shutdown_connections 2024-04-20T10:51:19.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.483+0000 7fb3164fd640 1 -- 172.21.15.90:0/4083885469 wait complete. 2024-04-20T10:51:19.494 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:51:19.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.594+0000 7ff23f47a640 1 Processor -- start 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.595+0000 7ff23f47a640 1 -- start start 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.595+0000 7ff23f47a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 0x7ff23806e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.595+0000 7ff23f47a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff238156e90 con 0x7ff238153c90 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.595+0000 7ff23f47a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2380c3fd0 con 0x7ff2380ad4c0 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.595+0000 7ff23f47a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2380c4590 con 0x7ff23806f000 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23d216640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff238153c90 0x7ff238156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50916/0 (socket says 172.21.15.90:50916) 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23d216640 1 -- 172.21.15.90:0/773998618 learned_addr learned my addr 172.21.15.90:0/773998618 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23ca15640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 0x7ff23806e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326820766 0 0) 0x7ff238156e90 con 0x7ff238153c90 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff224003520 con 0x7ff238153c90 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3090425791 0 0) 0x7ff224003520 con 0x7ff238153c90 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 msgr2=0x7ff23806e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 0x7ff23806e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 >> v1:172.21.15.175:6789/0 conn(0x7ff2380ad4c0 legacy=0x7ff2380c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2380c42b0 con 0x7ff238153c90 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7ff234001670 con 0x7ff238153c90 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 >> v1:172.21.15.90:6789/0 conn(0x7ff238153c90 legacy=0x7ff238156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2240039e0 0x7ff224003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff224004800 0x7ff224004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 0x7ff224005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2380c4590 con 0x7ff224004800 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff22400bb80 con 0x7ff2240039e0 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff22400bd80 con 0x7ff23806f000 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23ca15640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff224004800 0x7ff224004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23d216640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2240039e0 0x7ff224003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23da17640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 0x7ff224005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23ca15640 1 -- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 msgr2=0x7ff224005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23ca15640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff23806f000 0x7ff224005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23ca15640 1 -- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2240039e0 msgr2=0x7ff224003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.596+0000 7ff23ca15640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2240039e0 0x7ff224003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.597+0000 7ff23ca15640 1 -- 172.21.15.90:0/773998618 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff224003520 con 0x7ff224004800 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.597+0000 7ff23d216640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff2240039e0 0x7ff224003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.597+0000 7ff23ca15640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff224004800 0x7ff224004c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff228009ac0 tx=0x7ff224005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34345ebde3ccfc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.597+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228039070 con 0x7ff224004800 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.597+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff22802c6b0 con 0x7ff224004800 2024-04-20T10:51:19.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.597+0000 7ff22ffff640 1 -- 172.21.15.90:0/773998618 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff228009690 con 0x7ff224004800 2024-04-20T10:51:19.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.598+0000 7ff23f47a640 1 -- 172.21.15.90:0/773998618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff224004800 msgr2=0x7ff224004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.598+0000 7ff23f47a640 1 --2- 172.21.15.90:0/773998618 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff224004800 0x7ff224004c80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff228009ac0 tx=0x7ff224005830 comp rx=0 tx=0).stop 2024-04-20T10:51:19.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.598+0000 7ff23da17640 1 -- 172.21.15.90:0/773998618 reap_dead start 2024-04-20T10:51:19.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.598+0000 7ff23f47a640 1 -- 172.21.15.90:0/773998618 shutdown_connections 2024-04-20T10:51:19.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.598+0000 7ff23f47a640 1 -- 172.21.15.90:0/773998618 >> 172.21.15.90:0/773998618 conn(0x7ff23806bb10 msgr2=0x7ff23806bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:19.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.598+0000 7ff23f47a640 1 -- 172.21.15.90:0/773998618 shutdown_connections 2024-04-20T10:51:19.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.598+0000 7ff23f47a640 1 -- 172.21.15.90:0/773998618 wait complete. 2024-04-20T10:51:19.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.599+0000 7ff23f47a640 1 Processor -- start 2024-04-20T10:51:19.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.599+0000 7ff23f47a640 1 -- start start 2024-04-20T10:51:19.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23f47a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff224004800 0x7ff238070980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23f47a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238070ec0 0x7ff2381e1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23f47a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2381e2240 0x7ff238150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23f47a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff2380c57c0 con 0x7ff2381e2240 2024-04-20T10:51:19.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23f47a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff23806e3c0 con 0x7ff238070ec0 2024-04-20T10:51:19.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23f47a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff2380c5940 con 0x7ff224004800 2024-04-20T10:51:19.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2381e2240 0x7ff238150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2381e2240 0x7ff238150150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48348/0 (socket says 172.21.15.90:48348) 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 -- 172.21.15.90:0/3743764533 learned_addr learned my addr 172.21.15.90:0/3743764533 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23d216640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff224004800 0x7ff238070980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23ca15640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238070ec0 0x7ff2381e1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 -- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff224004800 msgr2=0x7ff238070980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff224004800 0x7ff238070980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 -- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238070ec0 msgr2=0x7ff2381e1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238070ec0 0x7ff2381e1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 -- 172.21.15.90:0/3743764533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff238158a20 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23da17640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2381e2240 0x7ff238150150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2380694b0 tx=0x7ff23000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff22dffb640 1 -- 172.21.15.90:0/3743764533 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230003970 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff22dffb640 1 -- 172.21.15.90:0/3743764533 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff230018070 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2381e26f0 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.600+0000 7ff22dffb640 1 -- 172.21.15.90:0/3743764533 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff230003d50 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.601+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2381e0f40 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.602+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2380c51f0 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.602+0000 7ff22dffb640 1 -- 172.21.15.90:0/3743764533 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff2300050d0 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.603+0000 7ff22dffb640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff21c06c920 0x7ff21c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.603+0000 7ff23d216640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff21c06c920 0x7ff21c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.603+0000 7ff22dffb640 1 -- 172.21.15.90:0/3743764533 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6521+0+0 (secure 0 0 0) 0x7ff23008ba30 con 0x7ff2381e2240 2024-04-20T10:51:19.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.603+0000 7ff23d216640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff21c06c920 0x7ff21c06ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff234000c00 tx=0x7ff234009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.607+0000 7ff22dffb640 1 -- 172.21.15.90:0/3743764533 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff2380c51f0 con 0x7ff2381e2240 2024-04-20T10:51:19.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.793+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7ff23806dd90 con 0x7ff2381e2240 2024-04-20T10:51:19.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.794+0000 7ff22dffb640 1 -- 172.21.15.90:0/3743764533 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7ff230059bc0 con 0x7ff2381e2240 2024-04-20T10:51:19.794 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:19.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff21c06c920 msgr2=0x7ff21c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff21c06c920 0x7ff21c06ede0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff234000c00 tx=0x7ff234009040 comp rx=0 tx=0).stop 2024-04-20T10:51:19.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2381e2240 msgr2=0x7ff238150150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2381e2240 0x7ff238150150 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff2380694b0 tx=0x7ff23000eb90 comp rx=0 tx=0).stop 2024-04-20T10:51:19.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 shutdown_connections 2024-04-20T10:51:19.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff21c06c920 0x7ff21c06ede0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff2381e2240 0x7ff238150150 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff238070ec0 0x7ff2381e1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 --2- 172.21.15.90:0/3743764533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff224004800 0x7ff238070980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 >> 172.21.15.90:0/3743764533 conn(0x7ff23806bb10 msgr2=0x7ff2381565e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:19.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 shutdown_connections 2024-04-20T10:51:19.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.796+0000 7ff23f47a640 1 -- 172.21.15.90:0/3743764533 wait complete. 2024-04-20T10:51:19.807 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:51:19.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.906+0000 7f0d7d043640 1 Processor -- start 2024-04-20T10:51:19.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.906+0000 7f0d7d043640 1 -- start start 2024-04-20T10:51:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d7d043640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0d78157710 0x7f0d78154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d7d043640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d780c4370 con 0x7f0d78073810 2024-04-20T10:51:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d7d043640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d78156c30 con 0x7f0d780ad0c0 2024-04-20T10:51:19.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d7d043640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0d781569e0 con 0x7f0d78157710 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d76d9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0d78073810 0x7f0d780c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50932/0 (socket says 172.21.15.90:50932) 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d76d9d640 1 -- 172.21.15.90:0/3213795052 learned_addr learned my addr 172.21.15.90:0/3213795052 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417149487 0 0) 0x7f0d780c4370 con 0x7f0d78073810 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.907+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d60003520 con 0x7f0d78073810 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d7659c640 1 --2- 172.21.15.90:0/3213795052 >> v2:172.21.15.175:3300/0 conn(0x7f0d78157710 0x7f0d78154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2255196978 0 0) 0x7f0d60003520 con 0x7f0d78073810 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 >> v2:172.21.15.175:3300/0 conn(0x7f0d78157710 msgr2=0x7f0d78154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 --2- 172.21.15.90:0/3213795052 >> v2:172.21.15.175:3300/0 conn(0x7f0d78157710 0x7f0d78154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 >> v1:172.21.15.175:6789/0 conn(0x7f0d780ad0c0 legacy=0x7f0d780abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d78156f10 con 0x7f0d78073810 2024-04-20T10:51:19.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f0d68001670 con 0x7f0d78073810 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 >> v1:172.21.15.90:6789/0 conn(0x7f0d78073810 legacy=0x7f0d780c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600051c0 0x7f0d6000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d781569e0 con 0x7f0d600039b0 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d6000c160 con 0x7f0d60004800 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d6000c360 con 0x7f0d600051c0 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d7659c640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d7759e640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600051c0 0x7f0d6000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d76d9d640 1 -- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600051c0 msgr2=0x7f0d6000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600051c0 0x7f0d6000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d76d9d640 1 -- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d60004800 msgr2=0x7f0d60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d76d9d640 1 -- 172.21.15.90:0/3213795052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d60003520 con 0x7f0d600039b0 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d7759e640 1 -- 172.21.15.90:0/3213795052 reap_dead start 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.908+0000 7f0d7659c640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d60004800 0x7f0d60004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.909+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c240 tx=0x7f0d60005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0afcc3188789b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.909+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d68007d10 con 0x7f0d600039b0 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.909+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d68030070 con 0x7f0d600039b0 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.909+0000 7f0d75d9b640 1 -- 172.21.15.90:0/3213795052 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6802cdc0 con 0x7f0d600039b0 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.910+0000 7f0d7d043640 1 -- 172.21.15.90:0/3213795052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d600039b0 msgr2=0x7f0d60003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.910+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0d6800c240 tx=0x7f0d60005830 comp rx=0 tx=0).stop 2024-04-20T10:51:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.910+0000 7f0d7d043640 1 -- 172.21.15.90:0/3213795052 shutdown_connections 2024-04-20T10:51:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.910+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3213795052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d600039b0 0x7f0d60003dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.910+0000 7f0d7d043640 1 -- 172.21.15.90:0/3213795052 >> 172.21.15.90:0/3213795052 conn(0x7f0d780c8080 msgr2=0x7f0d780c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.910+0000 7f0d7d043640 1 -- 172.21.15.90:0/3213795052 shutdown_connections 2024-04-20T10:51:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.910+0000 7f0d7d043640 1 -- 172.21.15.90:0/3213795052 wait complete. 2024-04-20T10:51:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.911+0000 7f0d7d043640 1 Processor -- start 2024-04-20T10:51:19.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.911+0000 7f0d7d043640 1 -- start start 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600039b0 0x7f0d7814a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d780c2cf0 0x7f0d78146dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d78147310 0x7f0d781ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78154000 con 0x7f0d780c2cf0 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0d78157280 con 0x7f0d78147310 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0d78154180 con 0x7f0d600039b0 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d780c2cf0 0x7f0d78146dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d780c2cf0 0x7f0d78146dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48370/0 (socket says 172.21.15.90:48370) 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 -- 172.21.15.90:0/3009019162 learned_addr learned my addr 172.21.15.90:0/3009019162 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600039b0 0x7f0d7814a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7759e640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d78147310 0x7f0d781ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 -- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600039b0 msgr2=0x7f0d7814a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600039b0 0x7f0d7814a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 -- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d78147310 msgr2=0x7f0d781ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d78147310 0x7f0d781ed700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 -- 172.21.15.90:0/3009019162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d781ea190 con 0x7f0d780c2cf0 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600039b0 0x7f0d7814a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7759e640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d78147310 0x7f0d781ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7659c640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d780c2cf0 0x7f0d78146dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0114c0 tx=0x7f0d6c011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d5f7fe640 1 -- 172.21.15.90:0/3009019162 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c019070 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d5f7fe640 1 -- 172.21.15.90:0/3009019162 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d6c003610 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d5f7fe640 1 -- 172.21.15.90:0/3009019162 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c003a40 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d781485b0 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.912+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d781ea730 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.913+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d78155920 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.914+0000 7f0d5f7fe640 1 -- 172.21.15.90:0/3009019162 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0d6c01c070 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.914+0000 7f0d5f7fe640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d6406c8f0 0x7f0d6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.915+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d6406c8f0 0x7f0d6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.915+0000 7f0d5f7fe640 1 -- 172.21.15.90:0/3009019162 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f0d6c08c120 con 0x7f0d780c2cf0 2024-04-20T10:51:19.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.915+0000 7f0d76d9d640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d6406c8f0 0x7f0d6406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d68034000 tx=0x7f0d68039040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:19.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:19.919+0000 7f0d5f7fe640 1 -- 172.21.15.90:0/3009019162 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0d78155920 con 0x7f0d780c2cf0 2024-04-20T10:51:20.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.093+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f0d78076150 con 0x7f0d780c2cf0 2024-04-20T10:51:20.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.093+0000 7f0d5f7fe640 1 -- 172.21.15.90:0/3009019162 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v26) ==== 99+0+11 (secure 0 0 0) 0x7f0d6c05a240 con 0x7f0d780c2cf0 2024-04-20T10:51:20.093 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:20.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d6406c8f0 msgr2=0x7f0d6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d6406c8f0 0x7f0d6406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0d68034000 tx=0x7f0d68039040 comp rx=0 tx=0).stop 2024-04-20T10:51:20.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d780c2cf0 msgr2=0x7f0d78146dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d780c2cf0 0x7f0d78146dd0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c0114c0 tx=0x7f0d6c011980 comp rx=0 tx=0).stop 2024-04-20T10:51:20.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 shutdown_connections 2024-04-20T10:51:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0d6406c8f0 0x7f0d6406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0d78147310 0x7f0d781ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0d780c2cf0 0x7f0d78146dd0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 --2- 172.21.15.90:0/3009019162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0d600039b0 0x7f0d7814a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 >> 172.21.15.90:0/3009019162 conn(0x7f0d780c8080 msgr2=0x7f0d78151260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 shutdown_connections 2024-04-20T10:51:20.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.095+0000 7f0d7d043640 1 -- 172.21.15.90:0/3009019162 wait complete. 2024-04-20T10:51:20.106 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:51:20.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.205+0000 7f936fd50640 1 Processor -- start 2024-04-20T10:51:20.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.205+0000 7f936fd50640 1 -- start start 2024-04-20T10:51:20.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936fd50640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f93680c4bb0 0x7f9368159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936fd50640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f936815a340 0x7f93681611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936fd50640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93680af590 con 0x7f9368154040 2024-04-20T10:51:20.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936fd50640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f93680acb20 con 0x7f93680c4bb0 2024-04-20T10:51:20.207 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936fd50640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f93680acd70 con 0x7f936815a340 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936d2eb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f93680c4bb0 0x7f9368159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936d2eb640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f93680c4bb0 0x7f9368159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48378/0 (socket says 172.21.15.90:48378) 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936d2eb640 1 -- 172.21.15.90:0/2802406099 learned_addr learned my addr 172.21.15.90:0/2802406099 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936daec640 1 --1- 172.21.15.90:0/2802406099 >> v1:172.21.15.90:6789/0 conn(0x7f9368154040 0x7f93680730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50946/0 (socket says 172.21.15.90:50946) 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936e2ed640 1 --2- 172.21.15.90:0/2802406099 >> v2:172.21.15.175:3300/0 conn(0x7f936815a340 0x7f93681611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936d2eb640 1 -- 172.21.15.90:0/2802406099 >> v2:172.21.15.175:3300/0 conn(0x7f936815a340 msgr2=0x7f93681611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936d2eb640 1 --2- 172.21.15.90:0/2802406099 >> v2:172.21.15.175:3300/0 conn(0x7f936815a340 0x7f93681611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936d2eb640 1 -- 172.21.15.90:0/2802406099 >> v1:172.21.15.90:6789/0 conn(0x7f9368154040 legacy=0x7f93680730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936caea640 1 -- 172.21.15.90:0/2802406099 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876324606 0 0) 0x7f93680af590 con 0x7f9368154040 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.206+0000 7f936d2eb640 1 -- 172.21.15.90:0/2802406099 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93680c6400 con 0x7f93680c4bb0 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.207+0000 7f936d2eb640 1 --2- 172.21.15.90:0/2802406099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93680c4bb0 0x7f9368159e00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f936806c3d0 tx=0x7f935802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b209710c4d4c95 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.207+0000 7f936caea640 1 -- 172.21.15.90:0/2802406099 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935802e070 con 0x7f93680c4bb0 2024-04-20T10:51:20.208 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.207+0000 7f936caea640 1 -- 172.21.15.90:0/2802406099 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9358037070 con 0x7f93680c4bb0 2024-04-20T10:51:20.209 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.207+0000 7f936caea640 1 -- 172.21.15.90:0/2802406099 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9358031a00 con 0x7f93680c4bb0 2024-04-20T10:51:20.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 -- 172.21.15.90:0/2802406099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93680c4bb0 msgr2=0x7f9368159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 --2- 172.21.15.90:0/2802406099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93680c4bb0 0x7f9368159e00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f936806c3d0 tx=0x7f935802b880 comp rx=0 tx=0).stop 2024-04-20T10:51:20.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 -- 172.21.15.90:0/2802406099 shutdown_connections 2024-04-20T10:51:20.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 --2- 172.21.15.90:0/2802406099 >> v2:172.21.15.175:3300/0 conn(0x7f936815a340 0x7f93681611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.212 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 --2- 172.21.15.90:0/2802406099 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93680c4bb0 0x7f9368159e00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 -- 172.21.15.90:0/2802406099 >> 172.21.15.90:0/2802406099 conn(0x7f93680676c0 msgr2=0x7f9368067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 -- 172.21.15.90:0/2802406099 shutdown_connections 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.208+0000 7f936fd50640 1 -- 172.21.15.90:0/2802406099 wait complete. 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 Processor -- start 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 -- start start 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93680c4bb0 0x7f936814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9368154040 0x7f936806e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936815a340 0x7f9368145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f93680737f0 con 0x7f936815a340 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f936815a7b0 con 0x7f93680c4bb0 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936fd50640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9368073970 con 0x7f9368154040 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.209+0000 7f936e2ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936815a340 0x7f9368145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936815a340 0x7f9368145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48394/0 (socket says 172.21.15.90:48394) 2024-04-20T10:51:20.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 -- 172.21.15.90:0/1766496965 learned_addr learned my addr 172.21.15.90:0/1766496965 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936daec640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93680c4bb0 0x7f936814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936d2eb640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9368154040 0x7f936806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 -- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9368154040 msgr2=0x7f936806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9368154040 0x7f936806e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 -- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93680c4bb0 msgr2=0x7f936814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93680c4bb0 0x7f936814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 -- 172.21.15.90:0/1766496965 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9368151e10 con 0x7f936815a340 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936e2ed640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936815a340 0x7f9368145aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9360007e90 tx=0x7f936000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f935e7fc640 1 -- 172.21.15.90:0/1766496965 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360014420 con 0x7f936815a340 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f935e7fc640 1 -- 172.21.15.90:0/1766496965 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9360019070 con 0x7f936815a340 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93681520f0 con 0x7f936815a340 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f935e7fc640 1 -- 172.21.15.90:0/1766496965 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9360014800 con 0x7f936815a340 2024-04-20T10:51:20.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.210+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936806f620 con 0x7f936815a340 2024-04-20T10:51:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.211+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9368076150 con 0x7f936815a340 2024-04-20T10:51:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.211+0000 7f935e7fc640 1 -- 172.21.15.90:0/1766496965 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93600149a0 con 0x7f936815a340 2024-04-20T10:51:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.212+0000 7f935e7fc640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f934c06c8f0 0x7f934c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.212+0000 7f935e7fc640 1 -- 172.21.15.90:0/1766496965 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f936008c730 con 0x7f936815a340 2024-04-20T10:51:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.212+0000 7f936daec640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f934c06c8f0 0x7f934c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.212+0000 7f936daec640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f934c06c8f0 0x7f934c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9364000f60 tx=0x7f9364007b70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.216+0000 7f935e7fc640 1 -- 172.21.15.90:0/1766496965 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f936005a7c0 con 0x7f936815a340 2024-04-20T10:51:20.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.389+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f93680cac80 con 0x7f936815a340 2024-04-20T10:51:20.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.389+0000 7f935e7fc640 1 -- 172.21.15.90:0/1766496965 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v26) ==== 95+0+11 (secure 0 0 0) 0x7f936005a0c0 con 0x7f936815a340 2024-04-20T10:51:20.389 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f934c06c8f0 msgr2=0x7f934c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f934c06c8f0 0x7f934c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9364000f60 tx=0x7f9364007b70 comp rx=0 tx=0).stop 2024-04-20T10:51:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936815a340 msgr2=0x7f9368145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936815a340 0x7f9368145aa0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9360007e90 tx=0x7f936000e4b0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 shutdown_connections 2024-04-20T10:51:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f934c06c8f0 0x7f934c06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f936815a340 0x7f9368145aa0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9368154040 0x7f936806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 --2- 172.21.15.90:0/1766496965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93680c4bb0 0x7f936814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 >> 172.21.15.90:0/1766496965 conn(0x7f93680676c0 msgr2=0x7f93680730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 shutdown_connections 2024-04-20T10:51:20.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.391+0000 7f936fd50640 1 -- 172.21.15.90:0/1766496965 wait complete. 2024-04-20T10:51:20.402 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:20.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.498+0000 7f9c9d699640 1 Processor -- start 2024-04-20T10:51:20.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.498+0000 7f9c9d699640 1 -- start start 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c9d699640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9806ca40 0x7f9c98153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c9d699640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c9806f330 0x7f9c9806d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c9d699640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c98071fa0 con 0x7f9c98150c00 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c9d699640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9c980c4210 con 0x7f9c9806f330 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c9d699640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9c98153500 con 0x7f9c9806ca40 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c977fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c9806f330 0x7f9c9806d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c96ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9c98150c00 0x7f9c980c3b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34114/0 (socket says 172.21.15.90:34114) 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c96ffd640 1 -- 172.21.15.90:0/2842714729 learned_addr learned my addr 172.21.15.90:0/2842714729 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.499+0000 7f9c967fc640 1 --2- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9806ca40 0x7f9c98153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.500+0000 7f9c95ffb640 1 -- 172.21.15.90:0/2842714729 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885033748 0 0) 0x7f9c98071fa0 con 0x7f9c98150c00 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.500+0000 7f9c95ffb640 1 -- 172.21.15.90:0/2842714729 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c80003520 con 0x7f9c98150c00 2024-04-20T10:51:20.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.500+0000 7f9c977fe640 1 -- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9806ca40 msgr2=0x7f9c98153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.500+0000 7f9c977fe640 1 --2- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9806ca40 0x7f9c98153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.500+0000 7f9c977fe640 1 -- 172.21.15.90:0/2842714729 >> v1:172.21.15.175:6789/0 conn(0x7f9c98150c00 legacy=0x7f9c980c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.500+0000 7f9c977fe640 1 -- 172.21.15.90:0/2842714729 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9806ced0 con 0x7f9c9806f330 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.500+0000 7f9c967fc640 1 --2- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9806ca40 0x7f9c98153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c977fe640 1 --2- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9806f330 0x7f9c9806d450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c900097a0 tx=0x7f9c9002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=542bd0c1c07efb04 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c95ffb640 1 -- 172.21.15.90:0/2842714729 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90035020 con 0x7f9c9806f330 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c95ffb640 1 -- 172.21.15.90:0/2842714729 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c90031830 con 0x7f9c9806f330 2024-04-20T10:51:20.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c95ffb640 1 -- 172.21.15.90:0/2842714729 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c90031be0 con 0x7f9c9806f330 2024-04-20T10:51:20.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 -- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9806f330 msgr2=0x7f9c9806d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9806f330 0x7f9c9806d450 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9c900097a0 tx=0x7f9c9002b8d0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 -- 172.21.15.90:0/2842714729 shutdown_connections 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c9806f330 0x7f9c9806d450 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2842714729 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c9806ca40 0x7f9c98153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 -- 172.21.15.90:0/2842714729 >> 172.21.15.90:0/2842714729 conn(0x7f9c980c9100 msgr2=0x7f9c980c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 -- 172.21.15.90:0/2842714729 shutdown_connections 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.501+0000 7f9c9d699640 1 -- 172.21.15.90:0/2842714729 wait complete. 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 Processor -- start 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 -- start start 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c9806f330 0x7f9c980c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98150c00 0x7f9c98146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c980ae560 0x7f9c98146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9806d1b0 con 0x7f9c9806f330 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9c98153a80 con 0x7f9c980ae560 2024-04-20T10:51:20.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c9d699640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9c98072fb0 con 0x7f9c98150c00 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c96ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c9806f330 0x7f9c980c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c96ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c9806f330 0x7f9c980c27a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48404/0 (socket says 172.21.15.90:48404) 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.503+0000 7f9c96ffd640 1 -- 172.21.15.90:0/2964669332 learned_addr learned my addr 172.21.15.90:0/2964669332 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c967fc640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98150c00 0x7f9c98146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c977fe640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c980ae560 0x7f9c98146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c96ffd640 1 -- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98150c00 msgr2=0x7f9c98146810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c96ffd640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98150c00 0x7f9c98146810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c96ffd640 1 -- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c980ae560 msgr2=0x7f9c98146d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c96ffd640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c980ae560 0x7f9c98146d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c96ffd640 1 -- 172.21.15.90:0/2964669332 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c98147290 con 0x7f9c9806f330 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c96ffd640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c9806f330 0x7f9c980c27a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800cad0 tx=0x7f9c8800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c7f7fe640 1 -- 172.21.15.90:0/2964669332 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88017070 con 0x7f9c9806f330 2024-04-20T10:51:20.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c7f7fe640 1 -- 172.21.15.90:0/2964669332 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c8800ac30 con 0x7f9c9806f330 2024-04-20T10:51:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c98156540 con 0x7f9c9806f330 2024-04-20T10:51:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c7f7fe640 1 -- 172.21.15.90:0/2964669332 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c88012400 con 0x7f9c9806f330 2024-04-20T10:51:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.504+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c980aee70 con 0x7f9c9806f330 2024-04-20T10:51:20.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.505+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c98068510 con 0x7f9c9806f330 2024-04-20T10:51:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.506+0000 7f9c7f7fe640 1 -- 172.21.15.90:0/2964669332 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c8801a070 con 0x7f9c9806f330 2024-04-20T10:51:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.506+0000 7f9c7f7fe640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c8406c8f0 0x7f9c8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.506+0000 7f9c7f7fe640 1 -- 172.21.15.90:0/2964669332 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6637+0+0 (secure 0 0 0) 0x7f9c8808bb60 con 0x7f9c9806f330 2024-04-20T10:51:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.506+0000 7f9c967fc640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c8406c8f0 0x7f9c8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.506+0000 7f9c967fc640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c8406c8f0 0x7f9c8406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009560 tx=0x7f9c8c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.510+0000 7f9c7f7fe640 1 -- 172.21.15.90:0/2964669332 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9c98068510 con 0x7f9c9806f330 2024-04-20T10:51:20.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.726+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c980aec60 con 0x7f9c9806f330 2024-04-20T10:51:20.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.727+0000 7f9c7f7fe640 1 -- 172.21.15.90:0/2964669332 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f9c88059630 con 0x7f9c9806f330 2024-04-20T10:51:20.727 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:20.727 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:20.727 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c8406c8f0 msgr2=0x7f9c8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c8406c8f0 0x7f9c8406edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c009560 tx=0x7f9c8c009190 comp rx=0 tx=0).stop 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c9806f330 msgr2=0x7f9c980c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c9806f330 0x7f9c980c27a0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9c8800cad0 tx=0x7f9c8800cf90 comp rx=0 tx=0).stop 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 shutdown_connections 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c8406c8f0 0x7f9c8406edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c980ae560 0x7f9c98146d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c98150c00 0x7f9c98146810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 --2- 172.21.15.90:0/2964669332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c9806f330 0x7f9c980c27a0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 >> 172.21.15.90:0/2964669332 conn(0x7f9c980c9100 msgr2=0x7f9c980c4390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:20.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 shutdown_connections 2024-04-20T10:51:20.730 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.729+0000 7f9c9d699640 1 -- 172.21.15.90:0/2964669332 wait complete. 2024-04-20T10:51:20.740 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:20.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.840+0000 7f8ec874b640 1 Processor -- start 2024-04-20T10:51:20.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.840+0000 7f8ec874b640 1 -- start start 2024-04-20T10:51:20.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec874b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec006ef90 0x7f8ec00c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec874b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8ec00c23f0 0x7f8ec0157170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec874b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec00c2880 con 0x7f8ec00c7bf0 2024-04-20T10:51:20.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec874b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8ec00c4480 con 0x7f8ec00c23f0 2024-04-20T10:51:20.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec874b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec01576b0 con 0x7f8ec006ef90 2024-04-20T10:51:20.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec6ce8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8ec00c23f0 0x7f8ec0157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec6ce8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8ec00c23f0 0x7f8ec0157170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48416/0 (socket says 172.21.15.90:48416) 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec6ce8640 1 -- 172.21.15.90:0/3211050533 learned_addr learned my addr 172.21.15.90:0/3211050533 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec5ce6640 1 --2- 172.21.15.90:0/3211050533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec006ef90 0x7f8ec00c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec54e5640 1 -- 172.21.15.90:0/3211050533 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2811487570 0 0) 0x7f8ec00c2880 con 0x7f8ec00c7bf0 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec54e5640 1 -- 172.21.15.90:0/3211050533 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eac003520 con 0x7f8ec00c7bf0 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec6ce8640 1 -- 172.21.15.90:0/3211050533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec006ef90 msgr2=0x7f8ec00c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec6ce8640 1 --2- 172.21.15.90:0/3211050533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec006ef90 0x7f8ec00c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec6ce8640 1 -- 172.21.15.90:0/3211050533 >> v1:172.21.15.90:6789/0 conn(0x7f8ec00c7bf0 legacy=0x7f8ec00c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.841+0000 7f8ec6ce8640 1 -- 172.21.15.90:0/3211050533 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec00c33e0 con 0x7f8ec00c23f0 2024-04-20T10:51:20.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.842+0000 7f8ec6ce8640 1 --2- 172.21.15.90:0/3211050533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec0157170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009e80 tx=0x7f8eb802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aed1d719e9d3cd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.842+0000 7f8ec54e5640 1 -- 172.21.15.90:0/3211050533 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb802c9c0 con 0x7f8ec00c23f0 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.842+0000 7f8ec54e5640 1 -- 172.21.15.90:0/3211050533 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb802cb60 con 0x7f8ec00c23f0 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.842+0000 7f8ec54e5640 1 -- 172.21.15.90:0/3211050533 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80343f0 con 0x7f8ec00c23f0 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 -- 172.21.15.90:0/3211050533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 msgr2=0x7f8ec0157170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 --2- 172.21.15.90:0/3211050533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec0157170 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8009e80 tx=0x7f8eb802be20 comp rx=0 tx=0).stop 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 -- 172.21.15.90:0/3211050533 shutdown_connections 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 --2- 172.21.15.90:0/3211050533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec0157170 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 --2- 172.21.15.90:0/3211050533 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec006ef90 0x7f8ec00c7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 -- 172.21.15.90:0/3211050533 >> 172.21.15.90:0/3211050533 conn(0x7f8ec00aa660 msgr2=0x7f8ec00aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:20.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 -- 172.21.15.90:0/3211050533 shutdown_connections 2024-04-20T10:51:20.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.843+0000 7f8ec874b640 1 -- 172.21.15.90:0/3211050533 wait complete. 2024-04-20T10:51:20.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 Processor -- start 2024-04-20T10:51:20.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 -- start start 2024-04-20T10:51:20.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec006ef90 0x7f8ec014bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec01ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec00c7bf0 0x7f8ec00717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec00c39a0 con 0x7f8ec00c23f0 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8ec00c3ff0 con 0x7f8ec006ef90 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.844+0000 7f8ec874b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8ec00c3c80 con 0x7f8ec00c7bf0 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec01ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec01ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48424/0 (socket says 172.21.15.90:48424) 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 -- 172.21.15.90:0/607224462 learned_addr learned my addr 172.21.15.90:0/607224462 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec64e7640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec006ef90 0x7f8ec014bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec6ce8640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec00c7bf0 0x7f8ec00717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 -- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec00c7bf0 msgr2=0x7f8ec00717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec00c7bf0 0x7f8ec00717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 -- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec006ef90 msgr2=0x7f8ec014bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec006ef90 0x7f8ec014bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 -- 172.21.15.90:0/607224462 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec014c4e0 con 0x7f8ec00c23f0 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec6ce8640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec00c7bf0 0x7f8ec00717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec64e7640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec006ef90 0x7f8ec014bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:20.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec5ce6640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec01ef900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000e870 tx=0x7f8eb000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8eb6ffd640 1 -- 172.21.15.90:0/607224462 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb0017070 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8eb6ffd640 1 -- 172.21.15.90:0/607224462 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8eb000c940 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec014c180 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8eb6ffd640 1 -- 172.21.15.90:0/607224462 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8eb000cd30 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.845+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ec0073970 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.846+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ec0076150 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.847+0000 7f8eb6ffd640 1 -- 172.21.15.90:0/607224462 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8eb001a070 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.847+0000 7f8eb6ffd640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ea406c920 0x7f8ea406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.847+0000 7f8ec64e7640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ea406c920 0x7f8ea406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.847+0000 7f8eb6ffd640 1 -- 172.21.15.90:0/607224462 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f8eb008bda0 con 0x7f8ec00c23f0 2024-04-20T10:51:20.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.848+0000 7f8ec64e7640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ea406c920 0x7f8ea406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0011e0 tx=0x7f8ebc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:20.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:20.852+0000 7f8eb6ffd640 1 -- 172.21.15.90:0/607224462 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8ec014c4e0 con 0x7f8ec00c23f0 2024-04-20T10:51:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.029+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ec01559d0 con 0x7f8ec00c23f0 2024-04-20T10:51:21.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.030+0000 7f8eb6ffd640 1 -- 172.21.15.90:0/607224462 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+20592 (secure 0 0 0) 0x7f8eb0059e40 con 0x7f8ec00c23f0 2024-04-20T10:51:21.031 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:21.031 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:51:20.755164+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:21.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ea406c920 msgr2=0x7f8ea406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ea406c920 0x7f8ea406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8ebc0011e0 tx=0x7f8ebc009040 comp rx=0 tx=0).stop 2024-04-20T10:51:21.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 msgr2=0x7f8ec01ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec01ef900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f8eb000e870 tx=0x7f8eb000ed30 comp rx=0 tx=0).stop 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 shutdown_connections 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ea406c920 0x7f8ea406ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8ec00c7bf0 0x7f8ec00717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8ec00c23f0 0x7f8ec01ef900 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 --2- 172.21.15.90:0/607224462 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8ec006ef90 0x7f8ec014bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.032+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 >> 172.21.15.90:0/607224462 conn(0x7f8ec00aa660 msgr2=0x7f8ec00aaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.033+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 shutdown_connections 2024-04-20T10:51:21.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.033+0000 7f8ec874b640 1 -- 172.21.15.90:0/607224462 wait complete. 2024-04-20T10:51:21.044 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:21.045 INFO:tasks.mds_thrash.fs.[a]:starting mds_do_thrash for fs a 2024-04-20T10:51:21.045 INFO:tasks.mds_thrash.fs.[a]:waiting for 65 secs before thrashing 2024-04-20T10:51:21.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.141+0000 7fc07a23f640 1 Processor -- start 2024-04-20T10:51:21.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.141+0000 7fc07a23f640 1 -- start start 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc07a23f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc0740c54d0 0x7fc0741570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc07a23f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 0x7fc074153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc07a23f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc074071690 con 0x7fc0740c27a0 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc07a23f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc074071970 con 0x7fc0740c54d0 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc07a23f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc074159ce0 con 0x7fc0740ad640 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc0737fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc0740c27a0 0x7fc07415a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50962/0 (socket says 172.21.15.90:50962) 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc0737fe640 1 -- 172.21.15.90:0/3346887768 learned_addr learned my addr 172.21.15.90:0/3346887768 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168138755 0 0) 0x7fc074071690 con 0x7fc0740c27a0 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc05c003520 con 0x7fc0740c27a0 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc072ffd640 1 --2- 172.21.15.90:0/3346887768 >> v2:172.21.15.175:3300/0 conn(0x7fc0740c54d0 0x7fc0741570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.142+0000 7fc073fff640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 0x7fc074153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2862860875 0 0) 0x7fc05c003520 con 0x7fc0740c27a0 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 msgr2=0x7fc074153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 0x7fc074153730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 >> v2:172.21.15.175:3300/0 conn(0x7fc0740c54d0 msgr2=0x7fc0741570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 --2- 172.21.15.90:0/3346887768 >> v2:172.21.15.175:3300/0 conn(0x7fc0740c54d0 0x7fc0741570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc074159fc0 con 0x7fc0740c27a0 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fc064001670 con 0x7fc0740c27a0 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 >> v1:172.21.15.90:6789/0 conn(0x7fc0740c27a0 legacy=0x7fc07415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 0x7fc05c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c004d40 0x7fc05c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc074071970 con 0x7fc05c0039b0 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc074159ce0 con 0x7fc05c004d40 2024-04-20T10:51:21.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc05c00ba70 con 0x7fc0740ad640 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0737fe640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc072ffd640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 0x7fc05c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc073fff640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c004d40 0x7fc05c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0737fe640 1 -- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 msgr2=0x7fc05c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0737fe640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc0740ad640 0x7fc05c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0737fe640 1 -- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c004d40 msgr2=0x7fc05c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0737fe640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c004d40 0x7fc05c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.143+0000 7fc0737fe640 1 -- 172.21.15.90:0/3346887768 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc05c003520 con 0x7fc05c0039b0 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc0737fe640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc06400c270 tx=0x7fc05c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988609ad2db4fca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc064007d30 con 0x7fc05c0039b0 2024-04-20T10:51:21.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc064030070 con 0x7fc05c0039b0 2024-04-20T10:51:21.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc0727fc640 1 -- 172.21.15.90:0/3346887768 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06402cd60 con 0x7fc05c0039b0 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc07a23f640 1 -- 172.21.15.90:0/3346887768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc05c0039b0 msgr2=0x7fc05c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc07a23f640 1 --2- 172.21.15.90:0/3346887768 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc05c0039b0 0x7fc05c003dd0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fc06400c270 tx=0x7fc05c005830 comp rx=0 tx=0).stop 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc073fff640 1 -- 172.21.15.90:0/3346887768 reap_dead start 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc07a23f640 1 -- 172.21.15.90:0/3346887768 shutdown_connections 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.144+0000 7fc07a23f640 1 -- 172.21.15.90:0/3346887768 >> 172.21.15.90:0/3346887768 conn(0x7fc0740c9100 msgr2=0x7fc0740c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.145+0000 7fc07a23f640 1 -- 172.21.15.90:0/3346887768 shutdown_connections 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.145+0000 7fc07a23f640 1 -- 172.21.15.90:0/3346887768 wait complete. 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 Processor -- start 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 -- start start 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0039b0 0x7fc074146c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc074146750 0x7fc0740c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0741efbd0 0x7fc0741f0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc0740c2b80 con 0x7fc0741efbd0 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc07406f510 con 0x7fc05c0039b0 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc07a23f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc0740c2d00 con 0x7fc074146750 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.146+0000 7fc073fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0741efbd0 0x7fc0741f0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0741efbd0 0x7fc0741f0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48428/0 (socket says 172.21.15.90:48428) 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 -- 172.21.15.90:0/3353650790 learned_addr learned my addr 172.21.15.90:0/3353650790 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc0737fe640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0039b0 0x7fc074146c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc072ffd640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc074146750 0x7fc0740c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 -- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc074146750 msgr2=0x7fc0740c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc074146750 0x7fc0740c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 -- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0039b0 msgr2=0x7fc074146c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0039b0 0x7fc074146c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 -- 172.21.15.90:0/3353650790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0741ef6d0 con 0x7fc0741efbd0 2024-04-20T10:51:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc073fff640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0741efbd0 0x7fc0741f0050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc0740c3700 tx=0x7fc06c009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc05bfff640 1 -- 172.21.15.90:0/3353650790 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c007cf0 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc05bfff640 1 -- 172.21.15.90:0/3353650790 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc06c019070 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc05bfff640 1 -- 172.21.15.90:0/3353650790 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc06c014650 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0741f0590 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.147+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0741549b0 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.148+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0741ef8a0 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.148+0000 7fc05bfff640 1 -- 172.21.15.90:0/3353650790 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc06c0147f0 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.149+0000 7fc05bfff640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc06006c920 0x7fc06006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.149+0000 7fc05bfff640 1 -- 172.21.15.90:0/3353650790 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc06c08c220 con 0x7fc0741efbd0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.149+0000 7fc0737fe640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc06006c920 0x7fc06006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.149+0000 7fc0737fe640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc06006c920 0x7fc06006ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc064034000 tx=0x7fc064007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.153+0000 7fc05bfff640 1 -- 172.21.15.90:0/3353650790 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc06c059cf0 con 0x7fc0741efbd0 2024-04-20T10:51:21.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.328+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc074076150 con 0x7fc0741efbd0 2024-04-20T10:51:21.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.330+0000 7fc05bfff640 1 -- 172.21.15.90:0/3353650790 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+20592 (secure 0 0 0) 0x7fc06c05dff0 con 0x7fc0741efbd0 2024-04-20T10:51:21.330 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:21.330 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:51:20.755164+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc06006c920 msgr2=0x7fc06006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc06006c920 0x7fc06006ede0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc064034000 tx=0x7fc064007000 comp rx=0 tx=0).stop 2024-04-20T10:51:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0741efbd0 msgr2=0x7fc0741f0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0741efbd0 0x7fc0741f0050 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc0740c3700 tx=0x7fc06c009d20 comp rx=0 tx=0).stop 2024-04-20T10:51:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 shutdown_connections 2024-04-20T10:51:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc06006c920 0x7fc06006ede0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc0741efbd0 0x7fc0741f0050 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc074146750 0x7fc0740c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 --2- 172.21.15.90:0/3353650790 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc05c0039b0 0x7fc074146c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 >> 172.21.15.90:0/3353650790 conn(0x7fc0740c9100 msgr2=0x7fc074152ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:21.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 shutdown_connections 2024-04-20T10:51:21.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.332+0000 7fc07a23f640 1 -- 172.21.15.90:0/3353650790 wait complete. 2024-04-20T10:51:21.343 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:51:21.343 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:51:21.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.443+0000 7fc4880b3640 1 Processor -- start 2024-04-20T10:51:21.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc4880b3640 1 -- start start 2024-04-20T10:51:21.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc4880b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 0x7fc4801568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc4880b3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc4800c9ee0 0x7fc480156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc4880b3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc48015a720 con 0x7fc480153ef0 2024-04-20T10:51:21.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc4880b3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc48015ac80 con 0x7fc4800c9ee0 2024-04-20T10:51:21.444 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc4880b3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc48015a9a0 con 0x7fc4800ab730 2024-04-20T10:51:21.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc485e4f640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc480153ef0 0x7fc4800c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50966/0 (socket says 172.21.15.90:50966) 2024-04-20T10:51:21.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.444+0000 7fc485e4f640 1 -- 172.21.15.90:0/2530712714 learned_addr learned my addr 172.21.15.90:0/2530712714 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc486650640 1 --2- 172.21.15.90:0/2530712714 >> v2:172.21.15.175:3300/0 conn(0x7fc4800c9ee0 0x7fc480156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc48564e640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 0x7fc4801568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4064258550 0 0) 0x7fc474001110 con 0x7fc480153ef0 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46c003520 con 0x7fc480153ef0 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4253874569 0 0) 0x7fc46c003520 con 0x7fc480153ef0 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 msgr2=0x7fc4801568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 0x7fc4801568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 >> v2:172.21.15.175:3300/0 conn(0x7fc4800c9ee0 msgr2=0x7fc480156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 --2- 172.21.15.90:0/2530712714 >> v2:172.21.15.175:3300/0 conn(0x7fc4800c9ee0 0x7fc480156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4800c6a90 con 0x7fc480153ef0 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fc474001860 con 0x7fc480153ef0 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 >> v1:172.21.15.90:6789/0 conn(0x7fc480153ef0 legacy=0x7fc4800c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc46c0039b0 0x7fc46c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c004800 0x7fc46c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 0x7fc46c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc48015ac80 con 0x7fc46c0039b0 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc48015a9a0 con 0x7fc46c004800 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc46c00ba40 con 0x7fc4800ab730 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc485e4f640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc46c0039b0 0x7fc46c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc48564e640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c004800 0x7fc46c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc486650640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 0x7fc46c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc485e4f640 1 -- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 msgr2=0x7fc46c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc485e4f640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 0x7fc46c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc485e4f640 1 -- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c004800 msgr2=0x7fc46c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc485e4f640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc46c004800 0x7fc46c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc485e4f640 1 -- 172.21.15.90:0/2530712714 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c003520 con 0x7fc46c0039b0 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.445+0000 7fc486650640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc4800ab730 0x7fc46c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.446+0000 7fc485e4f640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc46c0039b0 0x7fc46c003dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c490 tx=0x7fc46c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90984e87bc3afa1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.446+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47400c0e0 con 0x7fc46c0039b0 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.446+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc474030070 con 0x7fc46c0039b0 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.446+0000 7fc484e4d640 1 -- 172.21.15.90:0/2530712714 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4740058d0 con 0x7fc46c0039b0 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.447+0000 7fc4880b3640 1 -- 172.21.15.90:0/2530712714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc46c0039b0 msgr2=0x7fc46c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.447+0000 7fc4880b3640 1 --2- 172.21.15.90:0/2530712714 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc46c0039b0 0x7fc46c003dd0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fc47400c490 tx=0x7fc46c005830 comp rx=0 tx=0).stop 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.447+0000 7fc486650640 1 -- 172.21.15.90:0/2530712714 reap_dead start 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.447+0000 7fc4880b3640 1 -- 172.21.15.90:0/2530712714 shutdown_connections 2024-04-20T10:51:21.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.447+0000 7fc4880b3640 1 -- 172.21.15.90:0/2530712714 >> 172.21.15.90:0/2530712714 conn(0x7fc4800cbfe0 msgr2=0x7fc4800cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:21.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.447+0000 7fc4880b3640 1 -- 172.21.15.90:0/2530712714 shutdown_connections 2024-04-20T10:51:21.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.447+0000 7fc4880b3640 1 -- 172.21.15.90:0/2530712714 wait complete. 2024-04-20T10:51:21.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.448+0000 7fc4880b3640 1 Processor -- start 2024-04-20T10:51:21.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.448+0000 7fc4880b3640 1 -- start start 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46c0039b0 0x7fc4800c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4801560c0 0x7fc480150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc480150cb0 0x7fc4801ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800c9280 con 0x7fc480150cb0 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc4800c9100 con 0x7fc4801560c0 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc4800bf800 con 0x7fc46c0039b0 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc480150cb0 0x7fc4801ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc480150cb0 0x7fc4801ef760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48440/0 (socket says 172.21.15.90:48440) 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 -- 172.21.15.90:0/191091169 learned_addr learned my addr 172.21.15.90:0/191091169 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc485e4f640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46c0039b0 0x7fc4800c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc48564e640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4801560c0 0x7fc480150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 -- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46c0039b0 msgr2=0x7fc4800c4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46c0039b0 0x7fc4800c4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 -- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4801560c0 msgr2=0x7fc480150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4801560c0 0x7fc480150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 -- 172.21.15.90:0/191091169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc480151820 con 0x7fc480150cb0 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc485e4f640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46c0039b0 0x7fc4800c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc486650640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc480150cb0 0x7fc4801ef760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc48008e540 tx=0x7fc478010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4727fc640 1 -- 172.21.15.90:0/191091169 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47801a030 con 0x7fc480150cb0 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4727fc640 1 -- 172.21.15.90:0/191091169 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc478010e60 con 0x7fc480150cb0 2024-04-20T10:51:21.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4727fc640 1 -- 172.21.15.90:0/191091169 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc478003bd0 con 0x7fc480150cb0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc480152b90 con 0x7fc480150cb0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.449+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc480151260 con 0x7fc480150cb0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.450+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc480076150 con 0x7fc480150cb0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.451+0000 7fc4727fc640 1 -- 172.21.15.90:0/191091169 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc47801d070 con 0x7fc480150cb0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.451+0000 7fc4727fc640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc46406c920 0x7fc46406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.451+0000 7fc4727fc640 1 -- 172.21.15.90:0/191091169 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc47808c8e0 con 0x7fc480150cb0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.451+0000 7fc485e4f640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc46406c920 0x7fc46406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.451+0000 7fc485e4f640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc46406c920 0x7fc46406ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4801578e0 tx=0x7fc474007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.455+0000 7fc4727fc640 1 -- 172.21.15.90:0/191091169 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc47805aa00 con 0x7fc480150cb0 2024-04-20T10:51:21.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.628+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc4801ed6f0 con 0x7fc480150cb0 2024-04-20T10:51:21.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.629+0000 7fc4727fc640 1 -- 172.21.15.90:0/191091169 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7fc47805a300 con 0x7fc480150cb0 2024-04-20T10:51:21.630 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:51:21.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.630+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc46406c920 msgr2=0x7fc46406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.630+0000 7fc4880b3640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc46406c920 0x7fc46406ede0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc4801578e0 tx=0x7fc474007000 comp rx=0 tx=0).stop 2024-04-20T10:51:21.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.630+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc480150cb0 msgr2=0x7fc4801ef760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.630+0000 7fc4880b3640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc480150cb0 0x7fc4801ef760 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fc48008e540 tx=0x7fc478010590 comp rx=0 tx=0).stop 2024-04-20T10:51:21.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.630+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 shutdown_connections 2024-04-20T10:51:21.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.630+0000 7fc4880b3640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc46406c920 0x7fc46406ede0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.630+0000 7fc4880b3640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc480150cb0 0x7fc4801ef760 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.631+0000 7fc4880b3640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc4801560c0 0x7fc480150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.631+0000 7fc4880b3640 1 --2- 172.21.15.90:0/191091169 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc46c0039b0 0x7fc4800c4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.631+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 >> 172.21.15.90:0/191091169 conn(0x7fc4800cbfe0 msgr2=0x7fc48006c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:21.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.631+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 shutdown_connections 2024-04-20T10:51:21.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.631+0000 7fc4880b3640 1 -- 172.21.15.90:0/191091169 wait complete. 2024-04-20T10:51:21.642 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:51:21.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.742+0000 7f85a4167640 1 Processor -- start 2024-04-20T10:51:21.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.743+0000 7f85a4167640 1 -- start start 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.743+0000 7f85a4167640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f859c0ad720 0x7f859c155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.743+0000 7f85a4167640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c0705c0 0x7f859c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.743+0000 7f85a4167640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f859c06d450 con 0x7f859c06e210 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.743+0000 7f85a4167640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f859c06dd80 con 0x7f859c0ad720 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.743+0000 7f85a4167640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f859c06d730 con 0x7f859c0705c0 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a1f03640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f859c0ad720 0x7f859c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a2704640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c0705c0 0x7f859c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a1702640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f859c06e210 0x7f859c073430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34124/0 (socket says 172.21.15.90:34124) 2024-04-20T10:51:21.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a1702640 1 -- 172.21.15.90:0/2561717191 learned_addr learned my addr 172.21.15.90:0/2561717191 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:21.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a2704640 1 -- 172.21.15.90:0/2561717191 >> v2:172.21.15.175:3300/0 conn(0x7f859c0ad720 msgr2=0x7f859c155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:21.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a2704640 1 --2- 172.21.15.90:0/2561717191 >> v2:172.21.15.175:3300/0 conn(0x7f859c0ad720 0x7f859c155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a2704640 1 -- 172.21.15.90:0/2561717191 >> v1:172.21.15.175:6789/0 conn(0x7f859c06e210 legacy=0x7f859c073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a2704640 1 -- 172.21.15.90:0/2561717191 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c06da10 con 0x7f859c0705c0 2024-04-20T10:51:21.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.744+0000 7f85a1f03640 1 --2- 172.21.15.90:0/2561717191 >> v2:172.21.15.175:3300/0 conn(0x7f859c0ad720 0x7f859c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:21.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.745+0000 7f85a2704640 1 --2- 172.21.15.90:0/2561717191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c0705c0 0x7f859c0c3530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8594009d90 tx=0x7f859402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=593a9f73ca8bd5a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.745+0000 7f85a0f01640 1 -- 172.21.15.90:0/2561717191 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594039070 con 0x7f859c0705c0 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.745+0000 7f85a0f01640 1 -- 172.21.15.90:0/2561717191 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f859402cbc0 con 0x7f859c0705c0 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.745+0000 7f85a0f01640 1 -- 172.21.15.90:0/2561717191 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8594034440 con 0x7f859c0705c0 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 -- 172.21.15.90:0/2561717191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c0705c0 msgr2=0x7f859c0c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 --2- 172.21.15.90:0/2561717191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c0705c0 0x7f859c0c3530 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8594009d90 tx=0x7f859402be10 comp rx=0 tx=0).stop 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 -- 172.21.15.90:0/2561717191 shutdown_connections 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 --2- 172.21.15.90:0/2561717191 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c0705c0 0x7f859c0c3530 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 --2- 172.21.15.90:0/2561717191 >> v2:172.21.15.175:3300/0 conn(0x7f859c0ad720 0x7f859c155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 -- 172.21.15.90:0/2561717191 >> 172.21.15.90:0/2561717191 conn(0x7f859c0c8080 msgr2=0x7f859c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 -- 172.21.15.90:0/2561717191 shutdown_connections 2024-04-20T10:51:21.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.746+0000 7f85a4167640 1 -- 172.21.15.90:0/2561717191 wait complete. 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.747+0000 7f85a4167640 1 Processor -- start 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.747+0000 7f85a4167640 1 -- start start 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a4167640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c06e210 0x7f859c14d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a4167640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f859c0705c0 0x7f859c0c1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a4167640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f859c0ad720 0x7f859c072190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a4167640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f859c073b40 con 0x7f859c0705c0 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a4167640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f859c070b30 con 0x7f859c0ad720 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a4167640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f859c14d9a0 con 0x7f859c06e210 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a1702640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f859c0705c0 0x7f859c0c1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a1702640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f859c0705c0 0x7f859c0c1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48448/0 (socket says 172.21.15.90:48448) 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a1702640 1 -- 172.21.15.90:0/2601235158 learned_addr learned my addr 172.21.15.90:0/2601235158 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a1f03640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c06e210 0x7f859c14d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.748+0000 7f85a2704640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f859c0ad720 0x7f859c072190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85a1702640 1 -- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c06e210 msgr2=0x7f859c14d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85a1702640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c06e210 0x7f859c14d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85a1702640 1 -- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f859c0ad720 msgr2=0x7f859c072190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85a1702640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f859c0ad720 0x7f859c072190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85a1702640 1 -- 172.21.15.90:0/2601235158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c1ed620 con 0x7f859c0705c0 2024-04-20T10:51:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85a1702640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f859c0705c0 0x7f859c0c1d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c400 tx=0x7f858c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85927fc640 1 -- 172.21.15.90:0/2601235158 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c017070 con 0x7f859c0705c0 2024-04-20T10:51:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85927fc640 1 -- 172.21.15.90:0/2601235158 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f858c005ce0 con 0x7f859c0705c0 2024-04-20T10:51:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85927fc640 1 -- 172.21.15.90:0/2601235158 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c0072f0 con 0x7f859c0705c0 2024-04-20T10:51:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.749+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c1ed900 con 0x7f859c0705c0 2024-04-20T10:51:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.750+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c1edec0 con 0x7f859c0705c0 2024-04-20T10:51:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.751+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c076150 con 0x7f859c0705c0 2024-04-20T10:51:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.751+0000 7f85927fc640 1 -- 172.21.15.90:0/2601235158 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f858c01a070 con 0x7f859c0705c0 2024-04-20T10:51:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.751+0000 7f85927fc640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f858006c970 0x7f858006ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.751+0000 7f85927fc640 1 -- 172.21.15.90:0/2601235158 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f858c08b140 con 0x7f859c0705c0 2024-04-20T10:51:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.751+0000 7f85a1f03640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f858006c970 0x7f858006ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.752+0000 7f85a1f03640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f858006c970 0x7f858006ee30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f859c0c62f0 tx=0x7f8598009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:21.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.756+0000 7f85927fc640 1 -- 172.21.15.90:0/2601235158 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f858c058cf0 con 0x7f859c0705c0 2024-04-20T10:51:21.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.930+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f859c0ae030 con 0x7f859c0705c0 2024-04-20T10:51:21.931 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.931+0000 7f85927fc640 1 -- 172.21.15.90:0/2601235158 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v27) ==== 99+0+11 (secure 0 0 0) 0x7f858c05cff0 con 0x7f859c0705c0 2024-04-20T10:51:21.931 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:21.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f858006c970 msgr2=0x7f858006ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f858006c970 0x7f858006ee30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f859c0c62f0 tx=0x7f8598009190 comp rx=0 tx=0).stop 2024-04-20T10:51:21.933 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f859c0705c0 msgr2=0x7f859c0c1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f859c0705c0 0x7f859c0c1d80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f858c00c400 tx=0x7f858c00c8c0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 shutdown_connections 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f858006c970 0x7f858006ee30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f859c0ad720 0x7f859c072190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f859c0705c0 0x7f859c0c1d80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 --2- 172.21.15.90:0/2601235158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f859c06e210 0x7f859c14d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 >> 172.21.15.90:0/2601235158 conn(0x7f859c0c8080 msgr2=0x7f859c073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 shutdown_connections 2024-04-20T10:51:21.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:21.933+0000 7f85a4167640 1 -- 172.21.15.90:0/2601235158 wait complete. 2024-04-20T10:51:21.944 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:51:22.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.043+0000 7fc51a806640 1 Processor -- start 2024-04-20T10:51:22.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.044+0000 7fc51a806640 1 -- start start 2024-04-20T10:51:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.044+0000 7fc51a806640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc5140ab730 0x7fc5141568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.044+0000 7fc51a806640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140c9ee0 0x7fc514156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.044+0000 7fc51a806640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc51415a720 con 0x7fc514153ef0 2024-04-20T10:51:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.044+0000 7fc51a806640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc51415ac80 con 0x7fc5140ab730 2024-04-20T10:51:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.044+0000 7fc51a806640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc51415a9a0 con 0x7fc5140c9ee0 2024-04-20T10:51:22.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc5137fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc5140ab730 0x7fc5141568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc518da3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140c9ee0 0x7fc514156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc513fff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fc514153ef0 0x7fc5140c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34134/0 (socket says 172.21.15.90:34134) 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc513fff640 1 -- 172.21.15.90:0/2901752317 learned_addr learned my addr 172.21.15.90:0/2901752317 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc512ffd640 1 -- 172.21.15.90:0/2901752317 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 931722776 0 0) 0x7fc504001110 con 0x7fc514153ef0 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc512ffd640 1 -- 172.21.15.90:0/2901752317 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4fc003520 con 0x7fc514153ef0 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc5137fe640 1 -- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140c9ee0 msgr2=0x7fc514156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc5137fe640 1 --2- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140c9ee0 0x7fc514156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc5137fe640 1 -- 172.21.15.90:0/2901752317 >> v1:172.21.15.175:6789/0 conn(0x7fc514153ef0 legacy=0x7fc5140c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc5137fe640 1 -- 172.21.15.90:0/2901752317 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5140c6a90 con 0x7fc5140ab730 2024-04-20T10:51:22.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.045+0000 7fc518da3640 1 --2- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140c9ee0 0x7fc514156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.046+0000 7fc5137fe640 1 --2- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140ab730 0x7fc5141568c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5080097a0 tx=0x7fc50802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21fe121ad6b57153 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.046+0000 7fc512ffd640 1 -- 172.21.15.90:0/2901752317 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508038070 con 0x7fc5140ab730 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.046+0000 7fc512ffd640 1 -- 172.21.15.90:0/2901752317 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc508031700 con 0x7fc5140ab730 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.046+0000 7fc512ffd640 1 -- 172.21.15.90:0/2901752317 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc508031ab0 con 0x7fc5140ab730 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 -- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140ab730 msgr2=0x7fc5141568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 --2- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140ab730 0x7fc5141568c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc5080097a0 tx=0x7fc50802b7a0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 -- 172.21.15.90:0/2901752317 shutdown_connections 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 --2- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140c9ee0 0x7fc514156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 --2- 172.21.15.90:0/2901752317 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140ab730 0x7fc5141568c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 -- 172.21.15.90:0/2901752317 >> 172.21.15.90:0/2901752317 conn(0x7fc5140cbfe0 msgr2=0x7fc5140cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:22.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 -- 172.21.15.90:0/2901752317 shutdown_connections 2024-04-20T10:51:22.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.047+0000 7fc51a806640 1 -- 172.21.15.90:0/2901752317 wait complete. 2024-04-20T10:51:22.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.048+0000 7fc51a806640 1 Processor -- start 2024-04-20T10:51:22.049 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.048+0000 7fc51a806640 1 -- start start 2024-04-20T10:51:22.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140ab730 0x7fc5140c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140c9ee0 0x7fc5141efc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc514153ef0 0x7fc5140b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140c9280 con 0x7fc514153ef0 2024-04-20T10:51:22.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc5140c9100 con 0x7fc5140c9ee0 2024-04-20T10:51:22.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc5140bf800 con 0x7fc5140ab730 2024-04-20T10:51:22.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc514153ef0 0x7fc5140b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc514153ef0 0x7fc5140b1330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48454/0 (socket says 172.21.15.90:48454) 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 -- 172.21.15.90:0/2469935252 learned_addr learned my addr 172.21.15.90:0/2469935252 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc5137fe640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140c9ee0 0x7fc5141efc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc513fff640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140ab730 0x7fc5140c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 -- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140ab730 msgr2=0x7fc5140c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140ab730 0x7fc5140c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 -- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140c9ee0 msgr2=0x7fc5141efc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140c9ee0 0x7fc5141efc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 -- 172.21.15.90:0/2469935252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc514153680 con 0x7fc514153ef0 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc518da3640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc514153ef0 0x7fc5140b1330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009e60 tx=0x7fc50c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc510ff9640 1 -- 172.21.15.90:0/2469935252 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c018030 con 0x7fc514153ef0 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc510ff9640 1 -- 172.21.15.90:0/2469935252 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc50c00cdf0 con 0x7fc514153ef0 2024-04-20T10:51:22.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc510ff9640 1 -- 172.21.15.90:0/2469935252 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc50c003bb0 con 0x7fc514153ef0 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5141f0490 con 0x7fc514153ef0 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.049+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5141f0190 con 0x7fc514153ef0 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.051+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc514157910 con 0x7fc514153ef0 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.051+0000 7fc510ff9640 1 -- 172.21.15.90:0/2469935252 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc50c01b070 con 0x7fc514153ef0 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.051+0000 7fc510ff9640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc50006c8f0 0x7fc50006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.052+0000 7fc513fff640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc50006c8f0 0x7fc50006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.052+0000 7fc510ff9640 1 -- 172.21.15.90:0/2469935252 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc50c08c6c0 con 0x7fc514153ef0 2024-04-20T10:51:22.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.052+0000 7fc513fff640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc50006c8f0 0x7fc50006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc5040013d0 tx=0x7fc504007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.056+0000 7fc510ff9640 1 -- 172.21.15.90:0/2469935252 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc514157910 con 0x7fc514153ef0 2024-04-20T10:51:22.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.230+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fc5140b0c90 con 0x7fc514153ef0 2024-04-20T10:51:22.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.231+0000 7fc510ff9640 1 -- 172.21.15.90:0/2469935252 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v27) ==== 95+0+11 (secure 0 0 0) 0x7fc50c010040 con 0x7fc514153ef0 2024-04-20T10:51:22.231 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc50006c8f0 msgr2=0x7fc50006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc50006c8f0 0x7fc50006edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc5040013d0 tx=0x7fc504007b50 comp rx=0 tx=0).stop 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc514153ef0 msgr2=0x7fc5140b1330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc514153ef0 0x7fc5140b1330 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc50c009e60 tx=0x7fc50c00c490 comp rx=0 tx=0).stop 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 shutdown_connections 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc50006c8f0 0x7fc50006edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc514153ef0 0x7fc5140b1330 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc5140c9ee0 0x7fc5141efc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 --2- 172.21.15.90:0/2469935252 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc5140ab730 0x7fc5140c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.232+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 >> 172.21.15.90:0/2469935252 conn(0x7fc5140cbfe0 msgr2=0x7fc5140ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:22.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.233+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 shutdown_connections 2024-04-20T10:51:22.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.233+0000 7fc51a806640 1 -- 172.21.15.90:0/2469935252 wait complete. 2024-04-20T10:51:22.243 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:51:22.342 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.342+0000 7fe8116e0640 1 Processor -- start 2024-04-20T10:51:22.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.342+0000 7fe8116e0640 1 -- start start 2024-04-20T10:51:22.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.343+0000 7fe8116e0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe80c072860 0x7fe80c1551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.343+0000 7fe8116e0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.343+0000 7fe8116e0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe80c158780 con 0x7fe80c0c45c0 2024-04-20T10:51:22.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.343+0000 7fe8116e0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe80c0ad010 con 0x7fe80c072860 2024-04-20T10:51:22.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.343+0000 7fe8116e0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe80c158530 con 0x7fe80c073120 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80affd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe80c072860 0x7fe80c1551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80a7fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe80c0c45c0 0x7fe80c0ab4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34148/0 (socket says 172.21.15.90:34148) 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80b7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:57112/0 (socket says 172.21.15.90:57112) 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80a7fc640 1 -- 172.21.15.90:0/2585839699 learned_addr learned my addr 172.21.15.90:0/2585839699 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80b7fe640 1 -- 172.21.15.90:0/2585839699 >> v2:172.21.15.175:3300/0 conn(0x7fe80c072860 msgr2=0x7fe80c1551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80b7fe640 1 --2- 172.21.15.90:0/2585839699 >> v2:172.21.15.175:3300/0 conn(0x7fe80c072860 0x7fe80c1551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80b7fe640 1 -- 172.21.15.90:0/2585839699 >> v1:172.21.15.175:6789/0 conn(0x7fe80c0c45c0 legacy=0x7fe80c0ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80b7fe640 1 -- 172.21.15.90:0/2585839699 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c1546d0 con 0x7fe80c073120 2024-04-20T10:51:22.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.344+0000 7fe80affd640 1 --2- 172.21.15.90:0/2585839699 >> v2:172.21.15.175:3300/0 conn(0x7fe80c072860 0x7fe80c1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe80b7fe640 1 --2- 172.21.15.90:0/2585839699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c151840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe804009d90 tx=0x7fe80402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=651f9c8be84052cb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe809ffb640 1 -- 172.21.15.90:0/2585839699 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804039070 con 0x7fe80c073120 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe809ffb640 1 -- 172.21.15.90:0/2585839699 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80402cbc0 con 0x7fe80c073120 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe809ffb640 1 -- 172.21.15.90:0/2585839699 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe804034440 con 0x7fe80c073120 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe8116e0640 1 -- 172.21.15.90:0/2585839699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 msgr2=0x7fe80c151840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe8116e0640 1 --2- 172.21.15.90:0/2585839699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c151840 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe804009d90 tx=0x7fe80402be10 comp rx=0 tx=0).stop 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe8116e0640 1 -- 172.21.15.90:0/2585839699 shutdown_connections 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe8116e0640 1 --2- 172.21.15.90:0/2585839699 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c151840 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe8116e0640 1 --2- 172.21.15.90:0/2585839699 >> v2:172.21.15.175:3300/0 conn(0x7fe80c072860 0x7fe80c1551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.345+0000 7fe8116e0640 1 -- 172.21.15.90:0/2585839699 >> 172.21.15.90:0/2585839699 conn(0x7fe80c067de0 msgr2=0x7fe80c0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:22.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.346+0000 7fe8116e0640 1 -- 172.21.15.90:0/2585839699 shutdown_connections 2024-04-20T10:51:22.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.346+0000 7fe8116e0640 1 -- 172.21.15.90:0/2585839699 wait complete. 2024-04-20T10:51:22.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 Processor -- start 2024-04-20T10:51:22.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 -- start start 2024-04-20T10:51:22.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe80c072860 0x7fe80c070260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c1efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c45c0 0x7fe80c1f0170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c154c90 con 0x7fe80c072860 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe80c158a60 con 0x7fe80c0c45c0 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.347+0000 7fe8116e0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe80c0abbb0 con 0x7fe80c073120 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe80c072860 0x7fe80c070260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe80c072860 0x7fe80c070260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48460/0 (socket says 172.21.15.90:48460) 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 -- 172.21.15.90:0/1279780428 learned_addr learned my addr 172.21.15.90:0/1279780428 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80b7fe640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c45c0 0x7fe80c1f0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80a7fc640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c1efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 -- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 msgr2=0x7fe80c1efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c1efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 -- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c45c0 msgr2=0x7fe80c1f0170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c45c0 0x7fe80c1f0170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 -- 172.21.15.90:0/1279780428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe80c0ae440 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80a7fc640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c1efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80b7fe640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c45c0 0x7fe80c1f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe80affd640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe80c072860 0x7fe80c070260 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e960 tx=0x7fe7fc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe7f37fe640 1 -- 172.21.15.90:0/1279780428 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc017070 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe7f37fe640 1 -- 172.21.15.90:0/1279780428 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00ca00 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe7f37fe640 1 -- 172.21.15.90:0/1279780428 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00cdd0 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe80c0aed10 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.348+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe80c0af2d0 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.349+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe80c076150 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.350+0000 7fe7f37fe640 1 -- 172.21.15.90:0/1279780428 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7fc01a070 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.350+0000 7fe7f37fe640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7f806c8f0 0x7fe7f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.350+0000 7fe80a7fc640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7f806c8f0 0x7fe7f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.350+0000 7fe7f37fe640 1 -- 172.21.15.90:0/1279780428 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe7fc08bd40 con 0x7fe80c072860 2024-04-20T10:51:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.350+0000 7fe80a7fc640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7f806c8f0 0x7fe7f806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06e970 tx=0x7fe800009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.354+0000 7fe7f37fe640 1 -- 172.21.15.90:0/1279780428 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe7fc059e60 con 0x7fe80c072860 2024-04-20T10:51:22.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.527+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7fe80c1ef830 con 0x7fe80c072860 2024-04-20T10:51:22.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.527+0000 7fe7f37fe640 1 -- 172.21.15.90:0/1279780428 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v27) ==== 99+0+11 (secure 0 0 0) 0x7fe7fc059760 con 0x7fe80c072860 2024-04-20T10:51:22.527 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:51:22.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7f806c8f0 msgr2=0x7fe7f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7f806c8f0 0x7fe7f806edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe80c06e970 tx=0x7fe800009040 comp rx=0 tx=0).stop 2024-04-20T10:51:22.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe80c072860 msgr2=0x7fe80c070260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe80c072860 0x7fe80c070260 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00e960 tx=0x7fe7fc00ee20 comp rx=0 tx=0).stop 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 shutdown_connections 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7f806c8f0 0x7fe7f806edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe80c0c45c0 0x7fe80c1f0170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe80c073120 0x7fe80c1efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 --2- 172.21.15.90:0/1279780428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe80c072860 0x7fe80c070260 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 >> 172.21.15.90:0/1279780428 conn(0x7fe80c067de0 msgr2=0x7fe80c0c9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 shutdown_connections 2024-04-20T10:51:22.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.529+0000 7fe8116e0640 1 -- 172.21.15.90:0/1279780428 wait complete. 2024-04-20T10:51:22.540 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:51:22.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.639+0000 7f2eafa06640 1 Processor -- start 2024-04-20T10:51:22.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.639+0000 7f2eafa06640 1 -- start start 2024-04-20T10:51:22.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eafa06640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ea80ab960 0x7f2ea8157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eafa06640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea80abdb0 con 0x7f2ea80ae720 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eafa06640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea8067a10 con 0x7f2ea8151b40 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eafa06640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea80c86d0 con 0x7f2ea80ab960 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eadfa3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2ea80ab960 0x7f2ea8157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eacfa1640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2ea80ae720 0x7f2ea80adee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50970/0 (socket says 172.21.15.90:50970) 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eacfa1640 1 -- 172.21.15.90:0/196872947 learned_addr learned my addr 172.21.15.90:0/196872947 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2e9ffff640 1 -- 172.21.15.90:0/196872947 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3217652295 0 0) 0x7f2ea80abdb0 con 0x7f2ea80ae720 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2e9ffff640 1 -- 172.21.15.90:0/196872947 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e94003520 con 0x7f2ea80ae720 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eadfa3640 1 -- 172.21.15.90:0/196872947 >> v1:172.21.15.175:6789/0 conn(0x7f2ea8151b40 legacy=0x7f2ea80c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eadfa3640 1 -- 172.21.15.90:0/196872947 >> v1:172.21.15.90:6789/0 conn(0x7f2ea80ae720 legacy=0x7f2ea80adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.640+0000 7f2eadfa3640 1 -- 172.21.15.90:0/196872947 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea8067cf0 con 0x7f2ea80ab960 2024-04-20T10:51:22.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.641+0000 7f2eadfa3640 1 --2- 172.21.15.90:0/196872947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea8157980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009d90 tx=0x7f2ea002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7c4cf55f5004e43 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.641+0000 7f2e9ffff640 1 -- 172.21.15.90:0/196872947 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0039070 con 0x7f2ea80ab960 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.641+0000 7f2e9ffff640 1 -- 172.21.15.90:0/196872947 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea002cbd0 con 0x7f2ea80ab960 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.641+0000 7f2e9ffff640 1 -- 172.21.15.90:0/196872947 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0034440 con 0x7f2ea80ab960 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.641+0000 7f2eafa06640 1 -- 172.21.15.90:0/196872947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 msgr2=0x7f2ea8157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.641+0000 7f2eafa06640 1 --2- 172.21.15.90:0/196872947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea8157980 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0009d90 tx=0x7f2ea002be20 comp rx=0 tx=0).stop 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.642+0000 7f2eafa06640 1 -- 172.21.15.90:0/196872947 shutdown_connections 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.642+0000 7f2eafa06640 1 --2- 172.21.15.90:0/196872947 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea8157980 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.642+0000 7f2eafa06640 1 -- 172.21.15.90:0/196872947 >> 172.21.15.90:0/196872947 conn(0x7f2ea80aa660 msgr2=0x7f2ea80aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.642+0000 7f2eafa06640 1 -- 172.21.15.90:0/196872947 shutdown_connections 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.642+0000 7f2eafa06640 1 -- 172.21.15.90:0/196872947 wait complete. 2024-04-20T10:51:22.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 Processor -- start 2024-04-20T10:51:22.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 -- start start 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea81ee700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea80ae720 0x7f2ea8072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ea8151b40 0x7f2ea81e04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea80c82f0 con 0x7f2ea80ab960 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea8158710 con 0x7f2ea80ae720 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.643+0000 7f2eafa06640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea80c8470 con 0x7f2ea8151b40 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea81ee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea81ee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48472/0 (socket says 172.21.15.90:48472) 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 -- 172.21.15.90:0/1704705545 learned_addr learned my addr 172.21.15.90:0/1704705545 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2eacfa1640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea80ae720 0x7f2ea8072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2eadfa3640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ea8151b40 0x7f2ea81e04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 -- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ea8151b40 msgr2=0x7f2ea81e04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ea8151b40 0x7f2ea81e04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 -- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea80ae720 msgr2=0x7f2ea8072c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea80ae720 0x7f2ea8072c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 -- 172.21.15.90:0/1704705545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea81eec40 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2ead7a2640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea81ee700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c430 tx=0x7f2ea400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2e9dffb640 1 -- 172.21.15.90:0/1704705545 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea40052d0 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2e9dffb640 1 -- 172.21.15.90:0/1704705545 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ea4005490 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea8154b10 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.644+0000 7f2e9dffb640 1 -- 172.21.15.90:0/1704705545 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ea4007260 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.645+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea81550d0 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.646+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea8076150 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.646+0000 7f2e9dffb640 1 -- 172.21.15.90:0/1704705545 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ea4007400 con 0x7f2ea80ab960 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.646+0000 7f2e9dffb640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2e8c06c8f0 0x7f2e8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.646+0000 7f2e9dffb640 1 -- 172.21.15.90:0/1704705545 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f2ea408b310 con 0x7f2ea80ab960 2024-04-20T10:51:22.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.646+0000 7f2eacfa1640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2e8c06c8f0 0x7f2e8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.647+0000 7f2eacfa1640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2e8c06c8f0 0x7f2e8c06edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80c6d40 tx=0x7f2e98007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.651+0000 7f2e9dffb640 1 -- 172.21.15.90:0/1704705545 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2ea4058de0 con 0x7f2ea80ab960 2024-04-20T10:51:22.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.825+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f2ea80c31b0 con 0x7f2ea80ab960 2024-04-20T10:51:22.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.825+0000 7f2e9dffb640 1 -- 172.21.15.90:0/1704705545 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v27) ==== 95+0+11 (secure 0 0 0) 0x7f2ea405d0e0 con 0x7f2ea80ab960 2024-04-20T10:51:22.826 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.827+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2e8c06c8f0 msgr2=0x7f2e8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.827+0000 7f2eafa06640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2e8c06c8f0 0x7f2e8c06edb0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80c6d40 tx=0x7f2e98007d30 comp rx=0 tx=0).stop 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.827+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 msgr2=0x7f2ea81ee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.827+0000 7f2eafa06640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea81ee700 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f2ea400c430 tx=0x7f2ea400c8f0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 shutdown_connections 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2e8c06c8f0 0x7f2e8c06edb0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2ea8151b40 0x7f2ea81e04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2ea80ae720 0x7f2ea8072c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 --2- 172.21.15.90:0/1704705545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2ea80ab960 0x7f2ea81ee700 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 >> 172.21.15.90:0/1704705545 conn(0x7f2ea80aa660 msgr2=0x7f2ea80c49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:22.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 shutdown_connections 2024-04-20T10:51:22.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.828+0000 7f2eafa06640 1 -- 172.21.15.90:0/1704705545 wait complete. 2024-04-20T10:51:22.839 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:51:22.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.934+0000 7f9254426640 1 Processor -- start 2024-04-20T10:51:22.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.934+0000 7f9254426640 1 -- start start 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f9254426640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c157710 0x7f924c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f9254426640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f924c0ad0c0 0x7f924c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f9254426640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f924c0c4370 con 0x7f924c073810 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f9254426640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f924c1569e0 con 0x7f924c0ad0c0 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f9254426640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f924c157280 con 0x7f924c157710 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f92529c3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f924c0ad0c0 0x7f924c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f92521c2640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f924c073810 0x7f924c0c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50978/0 (socket says 172.21.15.90:50978) 2024-04-20T10:51:22.936 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f92529c3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f924c0ad0c0 0x7f924c0ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48484/0 (socket says 172.21.15.90:48484) 2024-04-20T10:51:22.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.935+0000 7f92521c2640 1 -- 172.21.15.90:0/778527721 learned_addr learned my addr 172.21.15.90:0/778527721 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:22.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.936+0000 7f92529c3640 1 -- 172.21.15.90:0/778527721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c157710 msgr2=0x7f924c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:22.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.936+0000 7f92519c1640 1 --2- 172.21.15.90:0/778527721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c157710 0x7f924c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.936+0000 7f92529c3640 1 --2- 172.21.15.90:0/778527721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c157710 0x7f924c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.936+0000 7f92529c3640 1 -- 172.21.15.90:0/778527721 >> v1:172.21.15.90:6789/0 conn(0x7f924c073810 legacy=0x7f924c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.936+0000 7f92511c0640 1 -- 172.21.15.90:0/778527721 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739356258 0 0) 0x7f924c0c4370 con 0x7f924c073810 2024-04-20T10:51:22.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.936+0000 7f92529c3640 1 -- 172.21.15.90:0/778527721 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924c156c30 con 0x7f924c0ad0c0 2024-04-20T10:51:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.936+0000 7f92529c3640 1 --2- 172.21.15.90:0/778527721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c0ad0c0 0x7f924c0ad540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9244009d90 tx=0x7f924402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8ce1b9d63c21d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f92511c0640 1 -- 172.21.15.90:0/778527721 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244039070 con 0x7f924c0ad0c0 2024-04-20T10:51:22.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f92511c0640 1 -- 172.21.15.90:0/778527721 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f924402cbc0 con 0x7f924c0ad0c0 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f92511c0640 1 -- 172.21.15.90:0/778527721 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9244034440 con 0x7f924c0ad0c0 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 -- 172.21.15.90:0/778527721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c0ad0c0 msgr2=0x7f924c0ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 --2- 172.21.15.90:0/778527721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c0ad0c0 0x7f924c0ad540 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9244009d90 tx=0x7f924402be10 comp rx=0 tx=0).stop 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 -- 172.21.15.90:0/778527721 shutdown_connections 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 --2- 172.21.15.90:0/778527721 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c0ad0c0 0x7f924c0ad540 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 --2- 172.21.15.90:0/778527721 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c157710 0x7f924c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 -- 172.21.15.90:0/778527721 >> 172.21.15.90:0/778527721 conn(0x7f924c0c8080 msgr2=0x7f924c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 -- 172.21.15.90:0/778527721 shutdown_connections 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.937+0000 7f9254426640 1 -- 172.21.15.90:0/778527721 wait complete. 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.938+0000 7f9254426640 1 Processor -- start 2024-04-20T10:51:22.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.938+0000 7f9254426640 1 -- start start 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f9254426640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c073810 0x7f924c14f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f9254426640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c0ad0c0 0x7f924c0c3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f9254426640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f924c157710 0x7f924c1ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f9254426640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f924c0abbb0 con 0x7f924c073810 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f9254426640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f924c073bf0 con 0x7f924c157710 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f9254426640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f924c0abd30 con 0x7f924c0ad0c0 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c073810 0x7f924c14f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c073810 0x7f924c14f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48500/0 (socket says 172.21.15.90:48500) 2024-04-20T10:51:22.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 -- 172.21.15.90:0/423384931 learned_addr learned my addr 172.21.15.90:0/423384931 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 -- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c0ad0c0 msgr2=0x7f924c0c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92519c1640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c0ad0c0 0x7f924c0c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92529c3640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f924c157710 0x7f924c1ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c0ad0c0 0x7f924c0c3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 -- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f924c157710 msgr2=0x7f924c1ed3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f924c157710 0x7f924c1ed3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.939+0000 7f92521c2640 1 -- 172.21.15.90:0/423384931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f924c14fd80 con 0x7f924c073810 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.940+0000 7f92529c3640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f924c157710 0x7f924c1ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.940+0000 7f92521c2640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c073810 0x7f924c14f840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f924800c4d0 tx=0x7f924800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.940+0000 7f9242ffd640 1 -- 172.21.15.90:0/423384931 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248018070 con 0x7f924c073810 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.940+0000 7f9242ffd640 1 -- 172.21.15.90:0/423384931 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9248007500 con 0x7f924c073810 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.940+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f924c1eaa10 con 0x7f924c073810 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.940+0000 7f9242ffd640 1 -- 172.21.15.90:0/423384931 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9248004a20 con 0x7f924c073810 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.940+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f924c1ea170 con 0x7f924c073810 2024-04-20T10:51:22.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.941+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f924c076150 con 0x7f924c073810 2024-04-20T10:51:22.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.941+0000 7f9242ffd640 1 -- 172.21.15.90:0/423384931 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f924801b070 con 0x7f924c073810 2024-04-20T10:51:22.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.942+0000 7f9242ffd640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f923006c8f0 0x7f923006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:22.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.942+0000 7f92519c1640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f923006c8f0 0x7f923006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:22.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.942+0000 7f9242ffd640 1 -- 172.21.15.90:0/423384931 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f924808b170 con 0x7f924c073810 2024-04-20T10:51:22.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.942+0000 7f92519c1640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f923006c8f0 0x7f923006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f924c0bf950 tx=0x7f923c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:22.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:22.946+0000 7f9242ffd640 1 -- 172.21.15.90:0/423384931 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f924c14fd80 con 0x7f924c073810 2024-04-20T10:51:23.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.156+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f924c0c8c40 con 0x7f924c073810 2024-04-20T10:51:23.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.156+0000 7f9242ffd640 1 -- 172.21.15.90:0/423384931 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f9248059290 con 0x7f924c073810 2024-04-20T10:51:23.156 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:23.157 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:51:23.157 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f923006c8f0 msgr2=0x7f923006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f923006c8f0 0x7f923006edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f924c0bf950 tx=0x7f923c008040 comp rx=0 tx=0).stop 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c073810 msgr2=0x7f924c14f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c073810 0x7f924c14f840 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f924800c4d0 tx=0x7f924800c990 comp rx=0 tx=0).stop 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 shutdown_connections 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f923006c8f0 0x7f923006edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f924c157710 0x7f924c1ed3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f924c0ad0c0 0x7f924c0c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 --2- 172.21.15.90:0/423384931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f924c073810 0x7f924c14f840 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 >> 172.21.15.90:0/423384931 conn(0x7f924c0c8080 msgr2=0x7f924c153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 shutdown_connections 2024-04-20T10:51:23.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.158+0000 7f9254426640 1 -- 172.21.15.90:0/423384931 wait complete. 2024-04-20T10:51:23.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:51:23.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.266+0000 7fe7d8ac8640 1 Processor -- start 2024-04-20T10:51:23.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.266+0000 7fe7d8ac8640 1 -- start start 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d8ac8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7d4154110 0x7fe7d41567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d8ac8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40acc00 0x7fe7d40ad060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d8ac8640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7d406d450 con 0x7fe7d40ad5a0 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d8ac8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe7d40ab780 con 0x7fe7d4154110 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d8ac8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d406d730 con 0x7fe7d40acc00 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d259c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7d4154110 0x7fe7d41567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7cbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40acc00 0x7fe7d40ad060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d2d9d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe7d40ad5a0 0x7fe7d40c14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34172/0 (socket says 172.21.15.90:34172) 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7d2d9d640 1 -- 172.21.15.90:0/3813994389 learned_addr learned my addr 172.21.15.90:0/3813994389 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7cbfff640 1 -- 172.21.15.90:0/3813994389 >> v2:172.21.15.175:3300/0 conn(0x7fe7d4154110 msgr2=0x7fe7d41567c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7cbfff640 1 --2- 172.21.15.90:0/3813994389 >> v2:172.21.15.175:3300/0 conn(0x7fe7d4154110 0x7fe7d41567c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7cbfff640 1 -- 172.21.15.90:0/3813994389 >> v1:172.21.15.175:6789/0 conn(0x7fe7d40ad5a0 legacy=0x7fe7d40c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.267+0000 7fe7cbfff640 1 -- 172.21.15.90:0/3813994389 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d406da10 con 0x7fe7d40acc00 2024-04-20T10:51:23.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.268+0000 7fe7d259c640 1 --2- 172.21.15.90:0/3813994389 >> v2:172.21.15.175:3300/0 conn(0x7fe7d4154110 0x7fe7d41567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.268+0000 7fe7cbfff640 1 --2- 172.21.15.90:0/3813994389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40acc00 0x7fe7d40ad060 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0097a0 tx=0x7fe7bc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=464125b3a5210f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.268+0000 7fe7d1d9b640 1 -- 172.21.15.90:0/3813994389 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc035020 con 0x7fe7d40acc00 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d1d9b640 1 -- 172.21.15.90:0/3813994389 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7bc031830 con 0x7fe7d40acc00 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d1d9b640 1 -- 172.21.15.90:0/3813994389 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc031c00 con 0x7fe7d40acc00 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/3813994389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40acc00 msgr2=0x7fe7d40ad060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/3813994389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40acc00 0x7fe7d40ad060 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc0097a0 tx=0x7fe7bc02b8d0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/3813994389 shutdown_connections 2024-04-20T10:51:23.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/3813994389 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40acc00 0x7fe7d40ad060 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/3813994389 >> v2:172.21.15.175:3300/0 conn(0x7fe7d4154110 0x7fe7d41567c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/3813994389 >> 172.21.15.90:0/3813994389 conn(0x7fe7d40c8080 msgr2=0x7fe7d40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:23.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/3813994389 shutdown_connections 2024-04-20T10:51:23.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.269+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/3813994389 wait complete. 2024-04-20T10:51:23.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.270+0000 7fe7d8ac8640 1 Processor -- start 2024-04-20T10:51:23.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.270+0000 7fe7d8ac8640 1 -- start start 2024-04-20T10:51:23.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d8ac8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d40acc00 0x7fe7d414f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d8ac8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40ad5a0 0x7fe7d40722f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d8ac8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d4154110 0x7fe7d414e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d8ac8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d40c8db0 con 0x7fe7d4154110 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d8ac8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7d406dfd0 con 0x7fe7d40acc00 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d8ac8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe7d40c8f30 con 0x7fe7d40ad5a0 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d4154110 0x7fe7d414e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d4154110 0x7fe7d414e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48504/0 (socket says 172.21.15.90:48504) 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d2d9d640 1 -- 172.21.15.90:0/1228187530 learned_addr learned my addr 172.21.15.90:0/1228187530 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7d259c640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d40acc00 0x7fe7d414f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.271+0000 7fe7cbfff640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40ad5a0 0x7fe7d40722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d2d9d640 1 -- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40ad5a0 msgr2=0x7fe7d40722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d2d9d640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40ad5a0 0x7fe7d40722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d2d9d640 1 -- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d40acc00 msgr2=0x7fe7d414f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d2d9d640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d40acc00 0x7fe7d414f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d2d9d640 1 -- 172.21.15.90:0/1228187530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7d414f6f0 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d2d9d640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d4154110 0x7fe7d414e190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00cb20 tx=0x7fe7cc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7caffd640 1 -- 172.21.15.90:0/1228187530 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc017070 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7caffd640 1 -- 172.21.15.90:0/1228187530 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7cc00aca0 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7d41e07f0 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7caffd640 1 -- 172.21.15.90:0/1228187530 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7cc012600 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.272+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7d4070ae0 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.273+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7d4076150 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.273+0000 7fe7caffd640 1 -- 172.21.15.90:0/1228187530 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7cc01a070 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.274+0000 7fe7caffd640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7b406c8f0 0x7fe7b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.274+0000 7fe7caffd640 1 -- 172.21.15.90:0/1228187530 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe7cc08bb40 con 0x7fe7d4154110 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.274+0000 7fe7d259c640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7b406c8f0 0x7fe7b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:51:23.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.274+0000 7fe7d259c640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7b406c8f0 0x7fe7b406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009a30 tx=0x7fe7c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:51:23.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.278+0000 7fe7caffd640 1 -- 172.21.15.90:0/1228187530 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe7d414f6f0 con 0x7fe7d4154110 2024-04-20T10:51:23.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.452+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe7d4068e70 con 0x7fe7d4154110 2024-04-20T10:51:23.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.453+0000 7fe7caffd640 1 -- 172.21.15.90:0/1228187530 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+20592 (secure 0 0 0) 0x7fe7cc059580 con 0x7fe7d4154110 2024-04-20T10:51:23.453 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:51:23.454 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:51:20.755164+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:51:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7b406c8f0 msgr2=0x7fe7b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7b406c8f0 0x7fe7b406edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4009a30 tx=0x7fe7c4008040 comp rx=0 tx=0).stop 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d4154110 msgr2=0x7fe7d414e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d4154110 0x7fe7d414e190 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe7cc00cb20 tx=0x7fe7cc00a060 comp rx=0 tx=0).stop 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 shutdown_connections 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe7b406c8f0 0x7fe7b406edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7d4154110 0x7fe7d414e190 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe7d40ad5a0 0x7fe7d40722f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 --2- 172.21.15.90:0/1228187530 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7d40acc00 0x7fe7d414f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 >> 172.21.15.90:0/1228187530 conn(0x7fe7d40c8080 msgr2=0x7fe7d41e2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 shutdown_connections 2024-04-20T10:51:23.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:51:23.455+0000 7fe7d8ac8640 1 -- 172.21.15.90:0/1228187530 wait complete. 2024-04-20T10:51:23.467 DEBUG:tasks.mds_thrash:Yielding 2024-04-20T10:51:23.467 INFO:teuthology.run_tasks:Running task workunit... 2024-04-20T10:51:23.483 INFO:tasks.workunit:Pulling workunits from ref a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:51:23.484 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-20T10:51:23.484 INFO:tasks.workunit:timeout=6h 2024-04-20T10:51:23.484 INFO:tasks.workunit:cleanup=True 2024-04-20T10:51:23.484 DEBUG:teuthology.orchestra.run.smithi090:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:23.485 INFO:tasks.mds_thrash.fs.[b]:starting mds_do_thrash for fs b 2024-04-20T10:51:23.485 INFO:tasks.mds_thrash.fs.[b]:waiting for 64 secs before thrashing 2024-04-20T10:51:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:23.500 INFO:teuthology.orchestra.run.smithi090.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-20T10:51:23.500 INFO:teuthology.orchestra.run.smithi090.stdout:Device: 2ah/42d Inode: 1 Links: 2 2024-04-20T10:51:23.501 INFO:teuthology.orchestra.run.smithi090.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:51:23.501 INFO:teuthology.orchestra.run.smithi090.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-20T10:51:23.501 INFO:teuthology.orchestra.run.smithi090.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-20T10:51:23.501 INFO:teuthology.orchestra.run.smithi090.stdout:Modify: 2024-04-20 10:50:40.585477420 +0000 2024-04-20T10:51:23.501 INFO:teuthology.orchestra.run.smithi090.stdout:Change: 2024-04-20 10:51:10.754697252 +0000 2024-04-20T10:51:23.501 INFO:teuthology.orchestra.run.smithi090.stdout: Birth: 2024-04-20 10:50:40.585477420 +0000 2024-04-20T10:51:23.501 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-20T10:51:23.501 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-20T10:51:23.568 DEBUG:teuthology.orchestra.run.smithi175:> stat -- /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:23.587 INFO:teuthology.orchestra.run.smithi175.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:23.587 INFO:teuthology.orchestra.run.smithi175.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-04-20T10:51:23.587 INFO:teuthology.orchestra.run.smithi175.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-20T10:51:23.587 INFO:teuthology.orchestra.run.smithi175.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-20T10:51:23.587 INFO:teuthology.orchestra.run.smithi175.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-04-20T10:51:23.587 INFO:teuthology.orchestra.run.smithi175.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-20T10:51:23.587 INFO:teuthology.orchestra.run.smithi175.stdout:Modify: 2024-04-20 10:50:49.626889999 +0000 2024-04-20T10:51:23.588 INFO:teuthology.orchestra.run.smithi175.stdout:Change: 2024-04-20 10:51:13.233057402 +0000 2024-04-20T10:51:23.588 INFO:teuthology.orchestra.run.smithi175.stdout: Birth: 2024-04-20 10:50:49.626889999 +0000 2024-04-20T10:51:23.588 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-04-20T10:51:23.588 DEBUG:teuthology.orchestra.run.smithi175:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-04-20T10:51:23.660 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:51:23.661 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout a8c84f5997950fd7d008204839253291d52e6eda 2024-04-20T10:51:23.676 INFO:tasks.workunit.client.0.smithi090.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-20T10:51:23.717 INFO:tasks.workunit.client.1.smithi175.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-04-20T10:51:40.023 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:51:40.027 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:52:10.257 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:52:10.261 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:52:26.046 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:26.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.144+0000 7f1fb19f4640 1 Processor -- start 2024-04-20T10:52:26.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.144+0000 7f1fb19f4640 1 -- start start 2024-04-20T10:52:26.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fb19f4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1fac0bf5a0 0x7f1fac15acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fb19f4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fac0cbcc0 con 0x7f1fac0ca570 2024-04-20T10:52:26.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fb19f4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fac15b2c0 con 0x7f1fac0cb160 2024-04-20T10:52:26.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fb19f4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1fac0bf980 con 0x7f1fac0bf5a0 2024-04-20T10:52:26.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1faa7fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1fac0ca570 0x7f1fac0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52032/0 (socket says 172.21.15.90:52032) 2024-04-20T10:52:26.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1faa7fc640 1 -- 172.21.15.90:0/2346409154 learned_addr learned my addr 172.21.15.90:0/2346409154 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:26.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1faaffd640 1 --2- 172.21.15.90:0/2346409154 >> v2:172.21.15.175:3300/0 conn(0x7f1fac0bf5a0 0x7f1fac15acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fa9ffb640 1 -- 172.21.15.90:0/2346409154 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1206130515 0 0) 0x7f1fac0cbcc0 con 0x7f1fac0ca570 2024-04-20T10:52:26.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fa9ffb640 1 -- 172.21.15.90:0/2346409154 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f94003520 con 0x7f1fac0ca570 2024-04-20T10:52:26.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fa9ffb640 1 -- 172.21.15.90:0/2346409154 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092802183 0 0) 0x7f1fac15b2c0 con 0x7f1fac0cb160 2024-04-20T10:52:26.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.145+0000 7f1fa9ffb640 1 -- 172.21.15.90:0/2346409154 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fac0cbcc0 con 0x7f1fac0cb160 2024-04-20T10:52:26.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.146+0000 7f1faaffd640 1 -- 172.21.15.90:0/2346409154 >> v1:172.21.15.175:6789/0 conn(0x7f1fac0cb160 legacy=0x7f1fac0cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.146+0000 7f1faaffd640 1 -- 172.21.15.90:0/2346409154 >> v1:172.21.15.90:6789/0 conn(0x7f1fac0ca570 legacy=0x7f1fac0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.146+0000 7f1faaffd640 1 -- 172.21.15.90:0/2346409154 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac15b5a0 con 0x7f1fac0bf5a0 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.146+0000 7f1faaffd640 1 --2- 172.21.15.90:0/2346409154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac15acb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097a0 tx=0x7f1f9c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91da5734e3bfb579 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fa9ffb640 1 -- 172.21.15.90:0/2346409154 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c035020 con 0x7f1fac0bf5a0 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fa9ffb640 1 -- 172.21.15.90:0/2346409154 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f9c031830 con 0x7f1fac0bf5a0 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fa9ffb640 1 -- 172.21.15.90:0/2346409154 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c031c00 con 0x7f1fac0bf5a0 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2346409154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 msgr2=0x7f1fac15acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2346409154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac15acb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c0097a0 tx=0x7f1f9c02b8d0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2346409154 shutdown_connections 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2346409154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac15acb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2346409154 >> 172.21.15.90:0/2346409154 conn(0x7f1fac0cbfe0 msgr2=0x7f1fac0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:26.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2346409154 shutdown_connections 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.147+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2346409154 wait complete. 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.148+0000 7f1fb19f4640 1 Processor -- start 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1fb19f4640 1 -- start start 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1fb19f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac1f0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1fb19f4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fac0ca570 0x7f1fac0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1fb19f4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac0cb160 0x7f1fac154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1fb19f4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac0cac40 con 0x7f1fac0cb160 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1fb19f4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1fac15bb60 con 0x7f1fac0bf5a0 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1fb19f4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1fac06cfe0 con 0x7f1fac0ca570 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac1f0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1faaffd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac1f0630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:59538/0 (socket says 172.21.15.90:59538) 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.149+0000 7f1faaffd640 1 -- 172.21.15.90:0/2050343349 learned_addr learned my addr 172.21.15.90:0/2050343349 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fab7fe640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac0cb160 0x7f1fac154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1faa7fc640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fac0ca570 0x7f1fac0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fab7fe640 1 -- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fac0ca570 msgr2=0x7f1fac0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fab7fe640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fac0ca570 0x7f1fac0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fab7fe640 1 -- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 msgr2=0x7f1fac1f0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fab7fe640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac1f0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fab7fe640 1 -- 172.21.15.90:0/2050343349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fac15c430 con 0x7f1fac0cb160 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1faaffd640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac1f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fab7fe640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac0cb160 0x7f1fac154ec0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c730 tx=0x7f1fa400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1f93fff640 1 -- 172.21.15.90:0/2050343349 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa4003b70 con 0x7f1fac0cb160 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fac15c710 con 0x7f1fac0cb160 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1f93fff640 1 -- 172.21.15.90:0/2050343349 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa4003d10 con 0x7f1fac0cb160 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1f93fff640 1 -- 172.21.15.90:0/2050343349 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa40052d0 con 0x7f1fac0cb160 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.150+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fac15ccd0 con 0x7f1fac0cb160 2024-04-20T10:52:26.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.152+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fac15d000 con 0x7f1fac0cb160 2024-04-20T10:52:26.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.153+0000 7f1f93fff640 1 -- 172.21.15.90:0/2050343349 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fa400a640 con 0x7f1fac0cb160 2024-04-20T10:52:26.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.153+0000 7f1f93fff640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1f9806c8f0 0x7f1f9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.153+0000 7f1f93fff640 1 -- 172.21.15.90:0/2050343349 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f1fa408bbf0 con 0x7f1fac0cb160 2024-04-20T10:52:26.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.155+0000 7f1faaffd640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1f9806c8f0 0x7f1f9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.155+0000 7f1faaffd640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1f9806c8f0 0x7f1f9806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c02b910 tx=0x7f1f9c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:26.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.162+0000 7f1f93fff640 1 -- 172.21.15.90:0/2050343349 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1fa4021020 con 0x7f1fac0cb160 2024-04-20T10:52:26.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.381+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fac0c0cf0 con 0x7f1fac0cb160 2024-04-20T10:52:26.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.381+0000 7f1f93fff640 1 -- 172.21.15.90:0/2050343349 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f1fac0c0cf0 con 0x7f1fac0cb160 2024-04-20T10:52:26.382 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:26.382 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:26.382 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1f9806c8f0 msgr2=0x7f1f9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1f9806c8f0 0x7f1f9806edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c02b910 tx=0x7f1f9c008030 comp rx=0 tx=0).stop 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac0cb160 msgr2=0x7f1fac154ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac0cb160 0x7f1fac154ec0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f1fa400c730 tx=0x7f1fa400cbf0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 shutdown_connections 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1f9806c8f0 0x7f1f9806edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1fac0cb160 0x7f1fac154ec0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1fac0ca570 0x7f1fac0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.383+0000 7f1fb19f4640 1 --2- 172.21.15.90:0/2050343349 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1fac0bf5a0 0x7f1fac1f0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.384+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 >> 172.21.15.90:0/2050343349 conn(0x7f1fac0cbfe0 msgr2=0x7f1fac0cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:26.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.384+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 shutdown_connections 2024-04-20T10:52:26.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.384+0000 7f1fb19f4640 1 -- 172.21.15.90:0/2050343349 wait complete. 2024-04-20T10:52:26.396 INFO:tasks.mds_thrash.fs.[a]:kill mds.d (rank=0) 2024-04-20T10:52:26.396 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-20T10:52:26.396 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:52:26.411 INFO:tasks.ceph.mds.d:Stopped 2024-04-20T10:52:26.411 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:26.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.509+0000 7f5f5e47a640 1 Processor -- start 2024-04-20T10:52:26.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.509+0000 7f5f5e47a640 1 -- start start 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.509+0000 7f5f5e47a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f58151b10 0x7f5f58154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.509+0000 7f5f5e47a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f580abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.509+0000 7f5f5e47a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f58073ba0 con 0x7f5f58157a70 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.509+0000 7f5f5e47a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5f58151ef0 con 0x7f5f58151b10 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.509+0000 7f5f5e47a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f581589a0 con 0x7f5f580aba60 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f57fff640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f58151b10 0x7f5f58154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f577fe640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f5f58157a70 0x7f5f580725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:44812/0 (socket says 172.21.15.90:44812) 2024-04-20T10:52:26.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f577fe640 1 -- 172.21.15.90:0/1779758930 learned_addr learned my addr 172.21.15.90:0/1779758930 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f5ca17640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f580abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f57fff640 1 -- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 msgr2=0x7f5f580abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f57fff640 1 --2- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f580abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f57fff640 1 -- 172.21.15.90:0/1779758930 >> v1:172.21.15.175:6789/0 conn(0x7f5f58157a70 legacy=0x7f5f580725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f57fff640 1 -- 172.21.15.90:0/1779758930 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f58158100 con 0x7f5f58151b10 2024-04-20T10:52:26.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.510+0000 7f5f5ca17640 1 --2- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f580abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.511+0000 7f5f57fff640 1 --2- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58151b10 0x7f5f58154480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5f480097a0 tx=0x7f5f4802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6077ac991febda6c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.511+0000 7f5f56ffd640 1 -- 172.21.15.90:0/1779758930 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48031780 con 0x7f5f58151b10 2024-04-20T10:52:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.511+0000 7f5f56ffd640 1 -- 172.21.15.90:0/1779758930 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f48037070 con 0x7f5f58151b10 2024-04-20T10:52:26.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.511+0000 7f5f56ffd640 1 -- 172.21.15.90:0/1779758930 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48031b40 con 0x7f5f58151b10 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 -- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58151b10 msgr2=0x7f5f58154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 --2- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58151b10 0x7f5f58154480 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5f480097a0 tx=0x7f5f4802b820 comp rx=0 tx=0).stop 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 -- 172.21.15.90:0/1779758930 shutdown_connections 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 --2- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f580abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 --2- 172.21.15.90:0/1779758930 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58151b10 0x7f5f58154480 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 -- 172.21.15.90:0/1779758930 >> 172.21.15.90:0/1779758930 conn(0x7f5f580ca0a0 msgr2=0x7f5f580ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 -- 172.21.15.90:0/1779758930 shutdown_connections 2024-04-20T10:52:26.519 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.512+0000 7f5f5e47a640 1 -- 172.21.15.90:0/1779758930 wait complete. 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.513+0000 7f5f5e47a640 1 Processor -- start 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.513+0000 7f5f5e47a640 1 -- start start 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5e47a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f581f03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5e47a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f58151b10 0x7f5f580c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5e47a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58157a70 0x7f5f5806de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5e47a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f580ab540 con 0x7f5f58151b10 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5e47a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5f581586c0 con 0x7f5f58157a70 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5e47a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f58072d00 con 0x7f5f580aba60 2024-04-20T10:52:26.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f581f03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f581f03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:41712/0 (socket says 172.21.15.90:41712) 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 -- 172.21.15.90:0/2477472602 learned_addr learned my addr 172.21.15.90:0/2477472602 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f577fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f58151b10 0x7f5f580c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5ca17640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58157a70 0x7f5f5806de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 -- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58157a70 msgr2=0x7f5f5806de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58157a70 0x7f5f5806de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 -- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f58151b10 msgr2=0x7f5f580c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f58151b10 0x7f5f580c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f57fff640 1 -- 172.21.15.90:0/2477472602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f581f0920 con 0x7f5f580aba60 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f577fe640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f58151b10 0x7f5f580c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.514+0000 7f5f5ca17640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58157a70 0x7f5f5806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.515+0000 7f5f57fff640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f581f03e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f48034040 tx=0x7f5f480046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.515+0000 7f5f54ff9640 1 -- 172.21.15.90:0/2477472602 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48032610 con 0x7f5f580aba60 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.515+0000 7f5f54ff9640 1 -- 172.21.15.90:0/2477472602 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f480327d0 con 0x7f5f580aba60 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.515+0000 7f5f54ff9640 1 -- 172.21.15.90:0/2477472602 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f48032bc0 con 0x7f5f580aba60 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.515+0000 7f5f5e47a640 1 -- 172.21.15.90:0/2477472602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f580adc90 con 0x7f5f580aba60 2024-04-20T10:52:26.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.515+0000 7f5f5e47a640 1 -- 172.21.15.90:0/2477472602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f580ae250 con 0x7f5f580aba60 2024-04-20T10:52:26.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.516+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f30005290 con 0x7f5f580aba60 2024-04-20T10:52:26.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.517+0000 7f5f54ff9640 1 -- 172.21.15.90:0/2477472602 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f4804e440 con 0x7f5f580aba60 2024-04-20T10:52:26.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.517+0000 7f5f54ff9640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f4406c920 0x7f5f4406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:26.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.517+0000 7f5f54ff9640 1 -- 172.21.15.90:0/2477472602 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f5f48079a70 con 0x7f5f580aba60 2024-04-20T10:52:26.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.517+0000 7f5f577fe640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f4406c920 0x7f5f4406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:26.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.518+0000 7f5f577fe640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f4406c920 0x7f5f4406ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f581ed5e0 tx=0x7f5f4c007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:26.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.525+0000 7f5f54ff9640 1 -- 172.21.15.90:0/2477472602 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5f48040070 con 0x7f5f580aba60 2024-04-20T10:52:26.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.747+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f30005580 con 0x7f5f580aba60 2024-04-20T10:52:26.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.748+0000 7f5f54ff9640 1 -- 172.21.15.90:0/2477472602 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f5f4802f050 con 0x7f5f580aba60 2024-04-20T10:52:26.748 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:26.748 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:26.749 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:26.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f4406c920 msgr2=0x7f5f4406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f4406c920 0x7f5f4406ede0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5f581ed5e0 tx=0x7f5f4c007e80 comp rx=0 tx=0).stop 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 msgr2=0x7f5f581f03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f581f03e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5f48034040 tx=0x7f5f480046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 shutdown_connections 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f4406c920 0x7f5f4406ede0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f58157a70 0x7f5f5806de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f58151b10 0x7f5f580c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 --2- 172.21.15.90:0/2477472602 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f580aba60 0x7f5f581f03e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.750+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 >> 172.21.15.90:0/2477472602 conn(0x7f5f580ca0a0 msgr2=0x7f5f580c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:26.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.751+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 shutdown_connections 2024-04-20T10:52:26.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:26.751+0000 7f5f3e7fc640 1 -- 172.21.15.90:0/2477472602 wait complete. 2024-04-20T10:52:26.762 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-20T10:52:27.485 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:27.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.636+0000 7fc933a43640 1 Processor -- start 2024-04-20T10:52:27.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.637+0000 7fc933a43640 1 -- start start 2024-04-20T10:52:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc933a43640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc92c156c90 0x7fc92c071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc933a43640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc92c06f0e0 0x7fc92c14d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc933a43640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc92c0c56c0 con 0x7fc92c071a70 2024-04-20T10:52:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc933a43640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c06ec50 con 0x7fc92c06f0e0 2024-04-20T10:52:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc933a43640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc92c06e600 con 0x7fc92c156c90 2024-04-20T10:52:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc930fde640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc92c06f0e0 0x7fc92c14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:27.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc930fde640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc92c06f0e0 0x7fc92c14d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51504/0 (socket says 172.21.15.90:51504) 2024-04-20T10:52:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc930fde640 1 -- 172.21.15.90:0/1422206262 learned_addr learned my addr 172.21.15.90:0/1422206262 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc9317df640 1 --2- 172.21.15.90:0/1422206262 >> v2:172.21.15.175:3300/0 conn(0x7fc92c156c90 0x7fc92c071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc930fde640 1 -- 172.21.15.90:0/1422206262 >> v2:172.21.15.175:3300/0 conn(0x7fc92c156c90 msgr2=0x7fc92c071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc930fde640 1 --2- 172.21.15.90:0/1422206262 >> v2:172.21.15.175:3300/0 conn(0x7fc92c156c90 0x7fc92c071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc930fde640 1 -- 172.21.15.90:0/1422206262 >> v1:172.21.15.175:6789/0 conn(0x7fc92c071a70 legacy=0x7fc92c157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:27.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.638+0000 7fc930fde640 1 -- 172.21.15.90:0/1422206262 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c06e8e0 con 0x7fc92c06f0e0 2024-04-20T10:52:27.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.640+0000 7fc930fde640 1 --2- 172.21.15.90:0/1422206262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c06f0e0 0x7fc92c14d060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0c6b70 tx=0x7fc91c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27595f6a1be372e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.640+0000 7fc923fff640 1 -- 172.21.15.90:0/1422206262 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c02e070 con 0x7fc92c06f0e0 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.640+0000 7fc923fff640 1 -- 172.21.15.90:0/1422206262 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc91c037070 con 0x7fc92c06f0e0 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.640+0000 7fc923fff640 1 -- 172.21.15.90:0/1422206262 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91c031a00 con 0x7fc92c06f0e0 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 -- 172.21.15.90:0/1422206262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c06f0e0 msgr2=0x7fc92c14d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 --2- 172.21.15.90:0/1422206262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c06f0e0 0x7fc92c14d060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0c6b70 tx=0x7fc91c02b880 comp rx=0 tx=0).stop 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 -- 172.21.15.90:0/1422206262 shutdown_connections 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 --2- 172.21.15.90:0/1422206262 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c06f0e0 0x7fc92c14d060 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 --2- 172.21.15.90:0/1422206262 >> v2:172.21.15.175:3300/0 conn(0x7fc92c156c90 0x7fc92c071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 -- 172.21.15.90:0/1422206262 >> 172.21.15.90:0/1422206262 conn(0x7fc92c0c9000 msgr2=0x7fc92c0c93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:27.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 -- 172.21.15.90:0/1422206262 shutdown_connections 2024-04-20T10:52:27.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.641+0000 7fc933a43640 1 -- 172.21.15.90:0/1422206262 wait complete. 2024-04-20T10:52:27.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.643+0000 7fc933a43640 1 Processor -- start 2024-04-20T10:52:27.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.643+0000 7fc933a43640 1 -- start start 2024-04-20T10:52:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc933a43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc92c06f0e0 0x7fc92c0ae440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc933a43640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c071a70 0x7fc92c0ae980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc933a43640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc92c156c90 0x7fc92c1f08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc933a43640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c157780 con 0x7fc92c071a70 2024-04-20T10:52:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc933a43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc92c0c49e0 con 0x7fc92c06f0e0 2024-04-20T10:52:27.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc933a43640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc92c157900 con 0x7fc92c156c90 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc930fde640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c071a70 0x7fc92c0ae980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc930fde640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c071a70 0x7fc92c0ae980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51514/0 (socket says 172.21.15.90:51514) 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc9317df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc92c06f0e0 0x7fc92c0ae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc930fde640 1 -- 172.21.15.90:0/103674568 learned_addr learned my addr 172.21.15.90:0/103674568 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc931fe0640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc92c156c90 0x7fc92c1f08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc9317df640 1 -- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc92c156c90 msgr2=0x7fc92c1f08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc9317df640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc92c156c90 0x7fc92c1f08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc9317df640 1 -- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c071a70 msgr2=0x7fc92c0ae980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc9317df640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c071a70 0x7fc92c0ae980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.644+0000 7fc9317df640 1 -- 172.21.15.90:0/103674568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc92c154920 con 0x7fc92c06f0e0 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.645+0000 7fc9317df640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc92c06f0e0 0x7fc92c0ae440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc92800e8a0 tx=0x7fc92800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.645+0000 7fc921ffb640 1 -- 172.21.15.90:0/103674568 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928017070 con 0x7fc92c06f0e0 2024-04-20T10:52:27.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.645+0000 7fc921ffb640 1 -- 172.21.15.90:0/103674568 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92800c940 con 0x7fc92c06f0e0 2024-04-20T10:52:27.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.645+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc92c155870 con 0x7fc92c06f0e0 2024-04-20T10:52:27.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.645+0000 7fc921ffb640 1 -- 172.21.15.90:0/103674568 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc928009e60 con 0x7fc92c06f0e0 2024-04-20T10:52:27.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.645+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc92c156040 con 0x7fc92c06f0e0 2024-04-20T10:52:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.647+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc92c076150 con 0x7fc92c06f0e0 2024-04-20T10:52:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.647+0000 7fc921ffb640 1 -- 172.21.15.90:0/103674568 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc92801a070 con 0x7fc92c06f0e0 2024-04-20T10:52:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.648+0000 7fc921ffb640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc91006c8f0 0x7fc91006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.648+0000 7fc921ffb640 1 -- 172.21.15.90:0/103674568 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fc92808bf50 con 0x7fc92c06f0e0 2024-04-20T10:52:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.648+0000 7fc930fde640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc91006c8f0 0x7fc91006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:27.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.649+0000 7fc930fde640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc91006c8f0 0x7fc91006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0090b0 tx=0x7fc91c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:27.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.657+0000 7fc921ffb640 1 -- 172.21.15.90:0/103674568 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc92c154920 con 0x7fc92c06f0e0 2024-04-20T10:52:27.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.879+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc92c0c45a0 con 0x7fc92c06f0e0 2024-04-20T10:52:27.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.880+0000 7fc921ffb640 1 -- 172.21.15.90:0/103674568 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fc928059a00 con 0x7fc92c06f0e0 2024-04-20T10:52:27.880 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:27.880 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:27.881 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:27.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc91006c8f0 msgr2=0x7fc91006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc91006c8f0 0x7fc91006edb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc91c0090b0 tx=0x7fc91c03d040 comp rx=0 tx=0).stop 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc92c06f0e0 msgr2=0x7fc92c0ae440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc92c06f0e0 0x7fc92c0ae440 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc92800e8a0 tx=0x7fc92800ed60 comp rx=0 tx=0).stop 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 shutdown_connections 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc91006c8f0 0x7fc91006edb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc92c156c90 0x7fc92c1f08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc92c071a70 0x7fc92c0ae980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 --2- 172.21.15.90:0/103674568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc92c06f0e0 0x7fc92c0ae440 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 >> 172.21.15.90:0/103674568 conn(0x7fc92c0c9000 msgr2=0x7fc92c147e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 shutdown_connections 2024-04-20T10:52:27.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:27.882+0000 7fc933a43640 1 -- 172.21.15.90:0/103674568 wait complete. 2024-04-20T10:52:27.893 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-04-20T10:52:27.893 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-20T10:52:27.893 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:52:27.905 INFO:tasks.ceph.mds.c:Stopped 2024-04-20T10:52:27.905 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:28.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.043+0000 7f41ae9d0640 1 Processor -- start 2024-04-20T10:52:28.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.043+0000 7f41ae9d0640 1 -- start start 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41ae9d0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f41a8153ef0 0x7f41a80c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41ae9d0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41a80ab730 0x7f41a81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41ae9d0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a815a720 con 0x7f41a80c9ee0 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41ae9d0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f41a815ac80 con 0x7f41a8153ef0 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41a7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f41a8153ef0 0x7f41a80c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41a7fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f41a8153ef0 0x7f41a80c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51522/0 (socket says 172.21.15.90:51522) 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41a7fff640 1 -- 172.21.15.90:0/2330458772 learned_addr learned my addr 172.21.15.90:0/2330458772 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41ae9d0640 1 -- 172.21.15.90:0/2330458772 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f41a815a9a0 con 0x7f41a80ab730 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41a77fe640 1 --2- 172.21.15.90:0/2330458772 >> v2:172.21.15.175:3300/0 conn(0x7f41a80ab730 0x7f41a81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41a6ffd640 1 -- 172.21.15.90:0/2330458772 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 525077390 0 0) 0x7f41a0001490 con 0x7f41a80c9ee0 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.044+0000 7f41a6ffd640 1 -- 172.21.15.90:0/2330458772 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4190003520 con 0x7f41a80c9ee0 2024-04-20T10:52:28.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.045+0000 7f41a7fff640 1 -- 172.21.15.90:0/2330458772 >> v2:172.21.15.175:3300/0 conn(0x7f41a80ab730 msgr2=0x7f41a81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:28.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.045+0000 7f41a7fff640 1 --2- 172.21.15.90:0/2330458772 >> v2:172.21.15.175:3300/0 conn(0x7f41a80ab730 0x7f41a81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.045+0000 7f41a7fff640 1 -- 172.21.15.90:0/2330458772 >> v1:172.21.15.90:6789/0 conn(0x7f41a80c9ee0 legacy=0x7f41a8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.046 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.045+0000 7f41a7fff640 1 -- 172.21.15.90:0/2330458772 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a80c6a90 con 0x7f41a8153ef0 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41a7fff640 1 --2- 172.21.15.90:0/2330458772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80c89f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f41a80b2190 tx=0x7f419802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa1e9abbd6096863 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41a6ffd640 1 -- 172.21.15.90:0/2330458772 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419802e070 con 0x7f41a8153ef0 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41a6ffd640 1 -- 172.21.15.90:0/2330458772 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4198037070 con 0x7f41a8153ef0 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41a6ffd640 1 -- 172.21.15.90:0/2330458772 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419802e070 con 0x7f41a8153ef0 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41ae9d0640 1 -- 172.21.15.90:0/2330458772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 msgr2=0x7f41a80c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/2330458772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80c89f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f41a80b2190 tx=0x7f419802b880 comp rx=0 tx=0).stop 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41ae9d0640 1 -- 172.21.15.90:0/2330458772 shutdown_connections 2024-04-20T10:52:28.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/2330458772 >> v2:172.21.15.175:3300/0 conn(0x7f41a80ab730 0x7f41a81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/2330458772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80c89f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41ae9d0640 1 -- 172.21.15.90:0/2330458772 >> 172.21.15.90:0/2330458772 conn(0x7f41a80cbfe0 msgr2=0x7f41a80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:28.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.046+0000 7f41ae9d0640 1 -- 172.21.15.90:0/2330458772 shutdown_connections 2024-04-20T10:52:28.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.047+0000 7f41ae9d0640 1 -- 172.21.15.90:0/2330458772 wait complete. 2024-04-20T10:52:28.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.048+0000 7f41ae9d0640 1 Processor -- start 2024-04-20T10:52:28.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.048+0000 7f41ae9d0640 1 -- start start 2024-04-20T10:52:28.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41ae9d0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a80ab730 0x7f41a81ef710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41ae9d0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a80c9ee0 0x7f41a80aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41ae9d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41ae9d0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41a80bf800 con 0x7f41a8153ef0 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41ae9d0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f41a8157510 con 0x7f41a80ab730 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41ae9d0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41a80ab170 con 0x7f41a80c9ee0 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41acf6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41acf6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80aa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51536/0 (socket says 172.21.15.90:51536) 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41acf6d640 1 -- 172.21.15.90:0/3575115572 learned_addr learned my addr 172.21.15.90:0/3575115572 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.049+0000 7f41a77fe640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a80c9ee0 0x7f41a80aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41a7fff640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a80ab730 0x7f41a81ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41acf6d640 1 -- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a80c9ee0 msgr2=0x7f41a80aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41acf6d640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a80c9ee0 0x7f41a80aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41acf6d640 1 -- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a80ab730 msgr2=0x7f41a81ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41acf6d640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a80ab730 0x7f41a81ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41acf6d640 1 -- 172.21.15.90:0/3575115572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a80aaef0 con 0x7f41a8153ef0 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41a7fff640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a80ab730 0x7f41a81ef710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41acf6d640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80aa5f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c770 tx=0x7f41a000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41a4ff9640 1 -- 172.21.15.90:0/3575115572 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0003b70 con 0x7f41a8153ef0 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41a4ff9640 1 -- 172.21.15.90:0/3575115572 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a0003d10 con 0x7f41a8153ef0 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.050+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a80c2910 con 0x7f41a8153ef0 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.051+0000 7f41a4ff9640 1 -- 172.21.15.90:0/3575115572 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a000a9f0 con 0x7f41a8153ef0 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.051+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a81560f0 con 0x7f41a8153ef0 2024-04-20T10:52:28.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.052+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a8076150 con 0x7f41a8153ef0 2024-04-20T10:52:28.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.053+0000 7f41a4ff9640 1 -- 172.21.15.90:0/3575115572 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41a000ab90 con 0x7f41a8153ef0 2024-04-20T10:52:28.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.053+0000 7f41a4ff9640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f419406c920 0x7f419406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.054+0000 7f41a7fff640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f419406c920 0x7f419406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.054+0000 7f41a4ff9640 1 -- 172.21.15.90:0/3575115572 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f41a008bd00 con 0x7f41a8153ef0 2024-04-20T10:52:28.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.054+0000 7f41a7fff640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f419406c920 0x7f419406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4198036000 tx=0x7f4198008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:28.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.058+0000 7f41a4ff9640 1 -- 172.21.15.90:0/3575115572 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f41a80aaef0 con 0x7f41a8153ef0 2024-04-20T10:52:28.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.501+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41a81525a0 con 0x7f41a8153ef0 2024-04-20T10:52:28.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.502+0000 7f41a4ff9640 1 -- 172.21.15.90:0/3575115572 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f41a815a720 con 0x7f41a8153ef0 2024-04-20T10:52:28.502 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:28.503 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:28.503 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:28.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f419406c920 msgr2=0x7f419406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f419406c920 0x7f419406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4198036000 tx=0x7f4198008030 comp rx=0 tx=0).stop 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 msgr2=0x7f41a80aa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80aa5f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c770 tx=0x7f41a000cc30 comp rx=0 tx=0).stop 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 shutdown_connections 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f419406c920 0x7f419406ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a8153ef0 0x7f41a80aa5f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a80c9ee0 0x7f41a80aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 --2- 172.21.15.90:0/3575115572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a80ab730 0x7f41a81ef710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 >> 172.21.15.90:0/3575115572 conn(0x7f41a80cbfe0 msgr2=0x7f41a8152820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 shutdown_connections 2024-04-20T10:52:28.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.505+0000 7f41ae9d0640 1 -- 172.21.15.90:0/3575115572 wait complete. 2024-04-20T10:52:28.523 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:52:28.763 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:28.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.862+0000 7f9be443f640 1 Processor -- start 2024-04-20T10:52:28.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.862+0000 7f9be443f640 1 -- start start 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be443f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9bdc153e60 0x7f9bdc06c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be443f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0c6f10 0x7f9bdc06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be443f640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bdc15ab90 con 0x7f9bdc0c31d0 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be443f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9bdc159d10 con 0x7f9bdc153e60 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be443f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc1572a0 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be21db640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9bdc153e60 0x7f9bdc06c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be21db640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9bdc153e60 0x7f9bdc06c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51550/0 (socket says 172.21.15.90:51550) 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be21db640 1 -- 172.21.15.90:0/2072542303 learned_addr learned my addr 172.21.15.90:0/2072542303 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:28.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.863+0000 7f9be29dc640 1 --2- 172.21.15.90:0/2072542303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0c6f10 0x7f9bdc06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.864+0000 7f9be21db640 1 -- 172.21.15.90:0/2072542303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0c6f10 msgr2=0x7f9bdc06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:28.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.864+0000 7f9be21db640 1 --2- 172.21.15.90:0/2072542303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0c6f10 0x7f9bdc06b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.864+0000 7f9be21db640 1 -- 172.21.15.90:0/2072542303 >> v1:172.21.15.175:6789/0 conn(0x7f9bdc0c31d0 legacy=0x7f9bdc15a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.864+0000 7f9be21db640 1 -- 172.21.15.90:0/2072542303 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc157580 con 0x7f9bdc153e60 2024-04-20T10:52:28.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.864+0000 7f9be21db640 1 --2- 172.21.15.90:0/2072542303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc153e60 0x7f9bdc06c6c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009870 tx=0x7f9bd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99d394ac3c3fa8b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:28.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.866+0000 7f9be11d9640 1 -- 172.21.15.90:0/2072542303 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8035020 con 0x7f9bdc153e60 2024-04-20T10:52:28.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.866+0000 7f9be11d9640 1 -- 172.21.15.90:0/2072542303 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd8031870 con 0x7f9bdc153e60 2024-04-20T10:52:28.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.866+0000 7f9be11d9640 1 -- 172.21.15.90:0/2072542303 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8031c20 con 0x7f9bdc153e60 2024-04-20T10:52:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 -- 172.21.15.90:0/2072542303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc153e60 msgr2=0x7f9bdc06c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 --2- 172.21.15.90:0/2072542303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc153e60 0x7f9bdc06c6c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009870 tx=0x7f9bd802b910 comp rx=0 tx=0).stop 2024-04-20T10:52:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 -- 172.21.15.90:0/2072542303 shutdown_connections 2024-04-20T10:52:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 --2- 172.21.15.90:0/2072542303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc0c6f10 0x7f9bdc06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 --2- 172.21.15.90:0/2072542303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc153e60 0x7f9bdc06c6c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 -- 172.21.15.90:0/2072542303 >> 172.21.15.90:0/2072542303 conn(0x7f9bdc0aa580 msgr2=0x7f9bdc0aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:28.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 -- 172.21.15.90:0/2072542303 shutdown_connections 2024-04-20T10:52:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.867+0000 7f9be443f640 1 -- 172.21.15.90:0/2072542303 wait complete. 2024-04-20T10:52:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.868+0000 7f9be443f640 1 Processor -- start 2024-04-20T10:52:28.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.868+0000 7f9be443f640 1 -- start start 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be443f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0c6f10 0x7f9bdc0ac390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be443f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc153e60 0x7f9bdc1ece00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be443f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc1dfb70 0x7f9bdc1559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be443f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc0c4ec0 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be443f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc0c3660 con 0x7f9bdc1dfb70 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be443f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9bdc0c5040 con 0x7f9bdc153e60 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be21db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0c6f10 0x7f9bdc0ac390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be19da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc153e60 0x7f9bdc1ece00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be21db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0c6f10 0x7f9bdc0ac390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51566/0 (socket says 172.21.15.90:51566) 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be19da640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc153e60 0x7f9bdc1ece00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:41748/0 (socket says 172.21.15.90:41748) 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be21db640 1 -- 172.21.15.90:0/3380778338 learned_addr learned my addr 172.21.15.90:0/3380778338 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.869+0000 7f9be29dc640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc1dfb70 0x7f9bdc1559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be21db640 1 -- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc153e60 msgr2=0x7f9bdc1ece00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be21db640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc153e60 0x7f9bdc1ece00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be21db640 1 -- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc1dfb70 msgr2=0x7f9bdc1559c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be21db640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc1dfb70 0x7f9bdc1559c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be21db640 1 -- 172.21.15.90:0/3380778338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc0ab920 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be29dc640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc1dfb70 0x7f9bdc1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be19da640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc153e60 0x7f9bdc1ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be21db640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0c6f10 0x7f9bdc0ac390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009870 tx=0x7f9bd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9bd2ffd640 1 -- 172.21.15.90:0/3380778338 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8035040 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9bd2ffd640 1 -- 172.21.15.90:0/3380778338 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bd8003820 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc0ace20 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9bd2ffd640 1 -- 172.21.15.90:0/3380778338 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd8003c10 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.870+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc0ad100 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.872+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bdc076150 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.872+0000 7f9bd2ffd640 1 -- 172.21.15.90:0/3380778338 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9bd8038020 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.872+0000 7f9bd2ffd640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9bc006c920 0x7f9bc006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.872+0000 7f9bd2ffd640 1 -- 172.21.15.90:0/3380778338 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f9bd80adf20 con 0x7f9bdc0c6f10 2024-04-20T10:52:28.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.873+0000 7f9be19da640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9bc006c920 0x7f9bc006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:28.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.873+0000 7f9be19da640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9bc006c920 0x7f9bc006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc153620 tx=0x7f9bcc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:28.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:28.881+0000 7f9bd2ffd640 1 -- 172.21.15.90:0/3380778338 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9bd807b970 con 0x7f9bdc0c6f10 2024-04-20T10:52:29.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.101+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9bdc0c66a0 con 0x7f9bdc0c6f10 2024-04-20T10:52:29.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.102+0000 7f9bd2ffd640 1 -- 172.21.15.90:0/3380778338 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f9bd807fc70 con 0x7f9bdc0c6f10 2024-04-20T10:52:29.102 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:29.102 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:29.103 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9bc006c920 msgr2=0x7f9bc006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:29.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9bc006c920 0x7f9bc006ede0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc153620 tx=0x7f9bcc009040 comp rx=0 tx=0).stop 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0c6f10 msgr2=0x7f9bdc0ac390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0c6f10 0x7f9bdc0ac390 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9bd8009870 tx=0x7f9bd80046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 shutdown_connections 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9bc006c920 0x7f9bc006ede0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9bdc1dfb70 0x7f9bdc1559c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9bdc153e60 0x7f9bdc1ece00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 --2- 172.21.15.90:0/3380778338 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9bdc0c6f10 0x7f9bdc0ac390 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 >> 172.21.15.90:0/3380778338 conn(0x7f9bdc0aa580 msgr2=0x7f9bdc06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 shutdown_connections 2024-04-20T10:52:29.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:29.104+0000 7f9be443f640 1 -- 172.21.15.90:0/3380778338 wait complete. 2024-04-20T10:52:29.119 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-20T10:52:30.523 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.667+0000 7f88c2074640 1 Processor -- start 2024-04-20T10:52:30.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.667+0000 7f88c2074640 1 -- start start 2024-04-20T10:52:30.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88c2074640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f88bc156c90 0x7f88bc071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:30.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88c2074640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88c2074640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88bc0c56c0 con 0x7f88bc071a70 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88c2074640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f88bc06ec50 con 0x7f88bc156c90 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88c2074640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc06e600 con 0x7f88bc06f0e0 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88bbfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f88bc071a70 0x7f88bc157070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52050/0 (socket says 172.21.15.90:52050) 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88bbfff640 1 -- 172.21.15.90:0/4150593522 learned_addr learned my addr 172.21.15.90:0/4150593522 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88baffd640 1 --2- 172.21.15.90:0/4150593522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88bb7fe640 1 --2- 172.21.15.90:0/4150593522 >> v2:172.21.15.175:3300/0 conn(0x7f88bc156c90 0x7f88bc071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88ba7fc640 1 -- 172.21.15.90:0/4150593522 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240887649 0 0) 0x7f88bc0c56c0 con 0x7f88bc071a70 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88baffd640 1 -- 172.21.15.90:0/4150593522 >> v2:172.21.15.175:3300/0 conn(0x7f88bc156c90 msgr2=0x7f88bc071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88baffd640 1 --2- 172.21.15.90:0/4150593522 >> v2:172.21.15.175:3300/0 conn(0x7f88bc156c90 0x7f88bc071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88baffd640 1 -- 172.21.15.90:0/4150593522 >> v1:172.21.15.90:6789/0 conn(0x7f88bc071a70 legacy=0x7f88bc157070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88baffd640 1 -- 172.21.15.90:0/4150593522 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc06e8e0 con 0x7f88bc06f0e0 2024-04-20T10:52:30.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.668+0000 7f88bb7fe640 1 --2- 172.21.15.90:0/4150593522 >> v2:172.21.15.175:3300/0 conn(0x7f88bc156c90 0x7f88bc071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.669+0000 7f88baffd640 1 --2- 172.21.15.90:0/4150593522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14d060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88b00097a0 tx=0x7f88b002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f102c9cc18158252 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.669+0000 7f88ba7fc640 1 -- 172.21.15.90:0/4150593522 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0031780 con 0x7f88bc06f0e0 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.669+0000 7f88ba7fc640 1 -- 172.21.15.90:0/4150593522 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b0037070 con 0x7f88bc06f0e0 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.669+0000 7f88ba7fc640 1 -- 172.21.15.90:0/4150593522 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0031b40 con 0x7f88bc06f0e0 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 -- 172.21.15.90:0/4150593522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 msgr2=0x7f88bc14d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 --2- 172.21.15.90:0/4150593522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14d060 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f88b00097a0 tx=0x7f88b002b820 comp rx=0 tx=0).stop 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 -- 172.21.15.90:0/4150593522 shutdown_connections 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 --2- 172.21.15.90:0/4150593522 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14d060 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 --2- 172.21.15.90:0/4150593522 >> v2:172.21.15.175:3300/0 conn(0x7f88bc156c90 0x7f88bc071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 -- 172.21.15.90:0/4150593522 >> 172.21.15.90:0/4150593522 conn(0x7f88bc0c9000 msgr2=0x7f88bc0c93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 -- 172.21.15.90:0/4150593522 shutdown_connections 2024-04-20T10:52:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.670+0000 7f88c2074640 1 -- 172.21.15.90:0/4150593522 wait complete. 2024-04-20T10:52:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.671+0000 7f88c2074640 1 Processor -- start 2024-04-20T10:52:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.671+0000 7f88c2074640 1 -- start start 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88c2074640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88c2074640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88bc071a70 0x7f88bc0ac280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88c2074640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88bc156c90 0x7f88bc0ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88c2074640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc157780 con 0x7f88bc071a70 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88c2074640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc0c49e0 con 0x7f88bc156c90 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88c2074640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc157900 con 0x7f88bc06f0e0 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88baffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88bc071a70 0x7f88bc0ac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88baffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88bc071a70 0x7f88bc0ac280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51570/0 (socket says 172.21.15.90:51570) 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88bb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88baffd640 1 -- 172.21.15.90:0/2533535052 learned_addr learned my addr 172.21.15.90:0/2533535052 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:30.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.672+0000 7f88bbfff640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88bc156c90 0x7f88bc0ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88baffd640 1 -- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 msgr2=0x7f88bc14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88baffd640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88baffd640 1 -- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88bc156c90 msgr2=0x7f88bc0ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88baffd640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88bc156c90 0x7f88bc0ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88baffd640 1 -- 172.21.15.90:0/2533535052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc154300 con 0x7f88bc071a70 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88bbfff640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88bc156c90 0x7f88bc0ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88baffd640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88bc071a70 0x7f88bc0ac280 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f88b0034040 tx=0x7f88b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88a3fff640 1 -- 172.21.15.90:0/2533535052 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0006e10 con 0x7f88bc071a70 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88a3fff640 1 -- 172.21.15.90:0/2533535052 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b0004230 con 0x7f88bc071a70 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88a3fff640 1 -- 172.21.15.90:0/2533535052 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b0032620 con 0x7f88bc071a70 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88bc1ebf40 con 0x7f88bc071a70 2024-04-20T10:52:30.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.673+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88bc1df840 con 0x7f88bc071a70 2024-04-20T10:52:30.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.674+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88bc076150 con 0x7f88bc071a70 2024-04-20T10:52:30.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.675+0000 7f88a3fff640 1 -- 172.21.15.90:0/2533535052 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f88b00327c0 con 0x7f88bc071a70 2024-04-20T10:52:30.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.675+0000 7f88a3fff640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f88a806c8f0 0x7f88a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:30.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.676+0000 7f88bb7fe640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f88a806c8f0 0x7f88a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:30.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.676+0000 7f88a3fff640 1 -- 172.21.15.90:0/2533535052 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f88b00adeb0 con 0x7f88bc071a70 2024-04-20T10:52:30.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.676+0000 7f88bb7fe640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f88a806c8f0 0x7f88a806edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00b800 tx=0x7f88ac00b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:30.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.680+0000 7f88a3fff640 1 -- 172.21.15.90:0/2533535052 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f88b0041070 con 0x7f88bc071a70 2024-04-20T10:52:30.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.904+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f88bc0c36e0 con 0x7f88bc071a70 2024-04-20T10:52:30.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.904+0000 7f88a3fff640 1 -- 172.21.15.90:0/2533535052 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f88b002f050 con 0x7f88bc071a70 2024-04-20T10:52:30.905 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:30.905 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:30.905 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:30.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f88a806c8f0 msgr2=0x7f88a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:30.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f88a806c8f0 0x7f88a806edb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00b800 tx=0x7f88ac00b3a0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88bc071a70 msgr2=0x7f88bc0ac280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:30.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88bc071a70 0x7f88bc0ac280 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f88b0034040 tx=0x7f88b00046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 shutdown_connections 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f88a806c8f0 0x7f88a806edb0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00b800 tx=0x7f88ac00b3a0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f88bc156c90 0x7f88bc0ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f88bc071a70 0x7f88bc0ac280 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 --2- 172.21.15.90:0/2533535052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f88bc06f0e0 0x7f88bc14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 >> 172.21.15.90:0/2533535052 conn(0x7f88bc0c9000 msgr2=0x7f88bc06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 shutdown_connections 2024-04-20T10:52:30.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:30.907+0000 7f88c2074640 1 -- 172.21.15.90:0/2533535052 wait complete. 2024-04-20T10:52:30.919 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:52:31.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:31.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.270+0000 7f30a3681640 1 Processor -- start 2024-04-20T10:52:31.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.270+0000 7f30a3681640 1 -- start start 2024-04-20T10:52:31.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.271+0000 7f30a3681640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f309c0ab730 0x7f309c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:31.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.271+0000 7f30a3681640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:31.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.271+0000 7f30a3681640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c15a720 con 0x7f309c153ef0 2024-04-20T10:52:31.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.271+0000 7f30a3681640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f309c15ac80 con 0x7f309c0ab730 2024-04-20T10:52:31.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.271+0000 7f30a3681640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f309c15a9a0 con 0x7f309c0c9ee0 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a1c1e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a0c1c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f309c0ab730 0x7f309c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a141d640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f309c153ef0 0x7f309c0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:44822/0 (socket says 172.21.15.90:44822) 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a141d640 1 -- 172.21.15.90:0/3529689035 learned_addr learned my addr 172.21.15.90:0/3529689035 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a1c1e640 1 -- 172.21.15.90:0/3529689035 >> v2:172.21.15.175:3300/0 conn(0x7f309c0ab730 msgr2=0x7f309c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a1c1e640 1 --2- 172.21.15.90:0/3529689035 >> v2:172.21.15.175:3300/0 conn(0x7f309c0ab730 0x7f309c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a1c1e640 1 -- 172.21.15.90:0/3529689035 >> v1:172.21.15.175:6789/0 conn(0x7f309c153ef0 legacy=0x7f309c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a1c1e640 1 -- 172.21.15.90:0/3529689035 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c0c6a90 con 0x7f309c0c9ee0 2024-04-20T10:52:31.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.272+0000 7f30a0c1c640 1 --2- 172.21.15.90:0/3529689035 >> v2:172.21.15.175:3300/0 conn(0x7f309c0ab730 0x7f309c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.273+0000 7f30a1c1e640 1 --2- 172.21.15.90:0/3529689035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c156e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3094009d90 tx=0x7f309402bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3252c65d676fe672 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.273+0000 7f3093fff640 1 -- 172.21.15.90:0/3529689035 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094039070 con 0x7f309c0c9ee0 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.273+0000 7f3093fff640 1 -- 172.21.15.90:0/3529689035 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309402cb30 con 0x7f309c0c9ee0 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.273+0000 7f3093fff640 1 -- 172.21.15.90:0/3529689035 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3094034440 con 0x7f309c0c9ee0 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.274+0000 7f30a3681640 1 -- 172.21.15.90:0/3529689035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 msgr2=0x7f309c156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.274+0000 7f30a3681640 1 --2- 172.21.15.90:0/3529689035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c156e00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3094009d90 tx=0x7f309402bd80 comp rx=0 tx=0).stop 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.274+0000 7f30a3681640 1 -- 172.21.15.90:0/3529689035 shutdown_connections 2024-04-20T10:52:31.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.274+0000 7f30a3681640 1 --2- 172.21.15.90:0/3529689035 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c156e00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.274+0000 7f30a3681640 1 --2- 172.21.15.90:0/3529689035 >> v2:172.21.15.175:3300/0 conn(0x7f309c0ab730 0x7f309c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.274+0000 7f30a3681640 1 -- 172.21.15.90:0/3529689035 >> 172.21.15.90:0/3529689035 conn(0x7f309c0cbfe0 msgr2=0x7f309c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.275+0000 7f30a3681640 1 -- 172.21.15.90:0/3529689035 shutdown_connections 2024-04-20T10:52:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.275+0000 7f30a3681640 1 -- 172.21.15.90:0/3529689035 wait complete. 2024-04-20T10:52:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.276+0000 7f30a3681640 1 Processor -- start 2024-04-20T10:52:31.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.276+0000 7f30a3681640 1 -- start start 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.277+0000 7f30a3681640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f309c0ab730 0x7f309c1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.277+0000 7f30a3681640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c1ef6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a3681640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f309c153ef0 0x7f309c1efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a3681640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f309c0c9280 con 0x7f309c153ef0 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a3681640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f309c0c9100 con 0x7f309c0ab730 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a3681640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f309c0bf800 con 0x7f309c0c9ee0 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f309c0ab730 0x7f309c1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a1c1e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f309c153ef0 0x7f309c1efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f309c0ab730 0x7f309c1509e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:59646/0 (socket says 172.21.15.90:59646) 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 -- 172.21.15.90:0/3161497621 learned_addr learned my addr 172.21.15.90:0/3161497621 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a0c1c640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c1ef6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:31.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 -- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 msgr2=0x7f309c1ef6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c1ef6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 -- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f309c153ef0 msgr2=0x7f309c1efc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f309c153ef0 0x7f309c1efc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 -- 172.21.15.90:0/3161497621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c0cb910 con 0x7f309c0ab730 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a1c1e640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f309c153ef0 0x7f309c1efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.278+0000 7f30a141d640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f309c0ab730 0x7f309c1509e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f309800c3c0 tx=0x7f309800c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.279+0000 7f3091ffb640 1 -- 172.21.15.90:0/3161497621 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098017070 con 0x7f309c0ab730 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.279+0000 7f3091ffb640 1 -- 172.21.15.90:0/3161497621 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3098005ce0 con 0x7f309c0ab730 2024-04-20T10:52:31.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.279+0000 7f3091ffb640 1 -- 172.21.15.90:0/3161497621 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3098007310 con 0x7f309c0ab730 2024-04-20T10:52:31.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.280+0000 7f30a3681640 1 -- 172.21.15.90:0/3161497621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c150f20 con 0x7f309c0ab730 2024-04-20T10:52:31.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.280+0000 7f30a3681640 1 -- 172.21.15.90:0/3161497621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c1f0280 con 0x7f309c0ab730 2024-04-20T10:52:31.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.282+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309c076150 con 0x7f309c0ab730 2024-04-20T10:52:31.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.282+0000 7f3091ffb640 1 -- 172.21.15.90:0/3161497621 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f309801a070 con 0x7f309c0ab730 2024-04-20T10:52:31.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.283+0000 7f3091ffb640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f308006c920 0x7f308006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:31.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.283+0000 7f3091ffb640 1 -- 172.21.15.90:0/3161497621 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f309808b190 con 0x7f309c0ab730 2024-04-20T10:52:31.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.283+0000 7f30a0c1c640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f308006c920 0x7f308006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:31.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.284+0000 7f30a0c1c640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f308006c920 0x7f308006ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f309c1ed290 tx=0x7f308c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:31.292 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.292+0000 7f3091ffb640 1 -- 172.21.15.90:0/3161497621 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f309c15a720 con 0x7f309c0ab730 2024-04-20T10:52:31.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.731+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f309c06d070 con 0x7f309c0ab730 2024-04-20T10:52:31.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.731+0000 7f3091ffb640 1 -- 172.21.15.90:0/3161497621 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f3098058be0 con 0x7f309c0ab730 2024-04-20T10:52:31.732 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:31.732 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:31.732 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:31.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f308006c920 msgr2=0x7f308006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:31.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f308006c920 0x7f308006ede0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f309c1ed290 tx=0x7f308c008040 comp rx=0 tx=0).stop 2024-04-20T10:52:31.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f309c0ab730 msgr2=0x7f309c1509e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f309c0ab730 0x7f309c1509e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f309800c3c0 tx=0x7f309800c880 comp rx=0 tx=0).stop 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 shutdown_connections 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f308006c920 0x7f308006ede0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f309c153ef0 0x7f309c1efc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f309c0c9ee0 0x7f309c1ef6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 --2- 172.21.15.90:0/3161497621 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f309c0ab730 0x7f309c1509e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 >> 172.21.15.90:0/3161497621 conn(0x7f309c0cbfe0 msgr2=0x7f309c0acbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 shutdown_connections 2024-04-20T10:52:31.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:31.735+0000 7f307f7fe640 1 -- 172.21.15.90:0/3161497621 wait complete. 2024-04-20T10:52:31.750 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-20T10:52:32.919 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:33.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.022+0000 7f829d3bd640 1 Processor -- start 2024-04-20T10:52:33.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.022+0000 7f829d3bd640 1 -- start start 2024-04-20T10:52:33.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f829d3bd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82980ab730 0x7f82981568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f829d3bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82980c9ee0 0x7f8298156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f829d3bd640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f829815a720 con 0x7f8298153ef0 2024-04-20T10:52:33.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f829d3bd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f829815ac80 con 0x7f82980ab730 2024-04-20T10:52:33.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f829d3bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f829815a9a0 con 0x7f82980c9ee0 2024-04-20T10:52:33.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f82977fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82980c9ee0 0x7f8298156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f82967fc640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f82980ab730 0x7f82981568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f82977fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82980c9ee0 0x7f8298156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:41788/0 (socket says 172.21.15.90:41788) 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f82977fe640 1 -- 172.21.15.90:0/2800857686 learned_addr learned my addr 172.21.15.90:0/2800857686 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.023+0000 7f8296ffd640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f8298153ef0 0x7f82980c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:44826/0 (socket says 172.21.15.90:44826) 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.024+0000 7f82967fc640 1 -- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82980c9ee0 msgr2=0x7f8298156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.024+0000 7f82967fc640 1 --2- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82980c9ee0 0x7f8298156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.024+0000 7f82967fc640 1 -- 172.21.15.90:0/2800857686 >> v1:172.21.15.175:6789/0 conn(0x7f8298153ef0 legacy=0x7f82980c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.024+0000 7f82967fc640 1 -- 172.21.15.90:0/2800857686 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82980c6a90 con 0x7f82980ab730 2024-04-20T10:52:33.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.024+0000 7f82977fe640 1 --2- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82980c9ee0 0x7f8298156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:33.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.025+0000 7f82967fc640 1 --2- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 0x7f82981568c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f828c0097a0 tx=0x7f828c02b5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=baa13353efdf9ee8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:33.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.025+0000 7f8295ffb640 1 -- 172.21.15.90:0/2800857686 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c037070 con 0x7f82980ab730 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.025+0000 7f8295ffb640 1 -- 172.21.15.90:0/2800857686 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c030710 con 0x7f82980ab730 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.025+0000 7f8295ffb640 1 -- 172.21.15.90:0/2800857686 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c030ae0 con 0x7f82980ab730 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 -- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 msgr2=0x7f82981568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 --2- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 0x7f82981568c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f828c0097a0 tx=0x7f828c02b5d0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 -- 172.21.15.90:0/2800857686 shutdown_connections 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 --2- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f82980c9ee0 0x7f8298156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 --2- 172.21.15.90:0/2800857686 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 0x7f82981568c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 -- 172.21.15.90:0/2800857686 >> 172.21.15.90:0/2800857686 conn(0x7f82980cbfe0 msgr2=0x7f82980cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 -- 172.21.15.90:0/2800857686 shutdown_connections 2024-04-20T10:52:33.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.026+0000 7f829d3bd640 1 -- 172.21.15.90:0/2800857686 wait complete. 2024-04-20T10:52:33.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.027+0000 7f829d3bd640 1 Processor -- start 2024-04-20T10:52:33.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.027+0000 7f829d3bd640 1 -- start start 2024-04-20T10:52:33.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f829d3bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 0x7f82981eeda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f829d3bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82980c9ee0 0x7f82980b1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f829d3bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8298153ef0 0x7f82981ec4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f829d3bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f82980c9280 con 0x7f82980c9ee0 2024-04-20T10:52:33.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f829d3bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f82980c9100 con 0x7f82980ab730 2024-04-20T10:52:33.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f829d3bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f82980bf800 con 0x7f8298153ef0 2024-04-20T10:52:33.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f82967fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82980c9ee0 0x7f82980b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f82967fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82980c9ee0 0x7f82980b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51580/0 (socket says 172.21.15.90:51580) 2024-04-20T10:52:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f82967fc640 1 -- 172.21.15.90:0/3643016999 learned_addr learned my addr 172.21.15.90:0/3643016999 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f8296ffd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 0x7f82981eeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.028+0000 7f82977fe640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8298153ef0 0x7f82981ec4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f82967fc640 1 -- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8298153ef0 msgr2=0x7f82981ec4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f82967fc640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8298153ef0 0x7f82981ec4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f82967fc640 1 -- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 msgr2=0x7f82981eeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f82967fc640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 0x7f82981eeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f82967fc640 1 -- 172.21.15.90:0/3643016999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82980aaf10 con 0x7f82980c9ee0 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f82967fc640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82980c9ee0 0x7f82980b1230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f828c035040 tx=0x7f828c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f827f7fe640 1 -- 172.21.15.90:0/3643016999 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c041030 con 0x7f82980c9ee0 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f827f7fe640 1 -- 172.21.15.90:0/3643016999 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f828c03c670 con 0x7f82980c9ee0 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82980aa820 con 0x7f82980c9ee0 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82980aaae0 con 0x7f82980c9ee0 2024-04-20T10:52:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.029+0000 7f827f7fe640 1 -- 172.21.15.90:0/3643016999 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828c037040 con 0x7f82980c9ee0 2024-04-20T10:52:33.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.030+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8278005290 con 0x7f82980c9ee0 2024-04-20T10:52:33.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.031+0000 7f827f7fe640 1 -- 172.21.15.90:0/3643016999 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f828c044070 con 0x7f82980c9ee0 2024-04-20T10:52:33.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.031+0000 7f827f7fe640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f828406c8f0 0x7f828406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.032+0000 7f827f7fe640 1 -- 172.21.15.90:0/3643016999 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f828c0ad790 con 0x7f82980c9ee0 2024-04-20T10:52:33.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.032+0000 7f8296ffd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f828406c8f0 0x7f828406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.032+0000 7f8296ffd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f828406c8f0 0x7f828406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8288000f60 tx=0x7f8288007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.040+0000 7f827f7fe640 1 -- 172.21.15.90:0/3643016999 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f828c07b130 con 0x7f82980c9ee0 2024-04-20T10:52:33.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.261+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8278005580 con 0x7f82980c9ee0 2024-04-20T10:52:33.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.262+0000 7f827f7fe640 1 -- 172.21.15.90:0/3643016999 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f828c07f430 con 0x7f82980c9ee0 2024-04-20T10:52:33.262 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:33.262 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:33.263 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:33.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f828406c8f0 msgr2=0x7f828406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f828406c8f0 0x7f828406edb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8288000f60 tx=0x7f8288007e40 comp rx=0 tx=0).stop 2024-04-20T10:52:33.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82980c9ee0 msgr2=0x7f82980b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82980c9ee0 0x7f82980b1230 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f828c035040 tx=0x7f828c0046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 shutdown_connections 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f828406c8f0 0x7f828406edb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8298153ef0 0x7f82981ec4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f82980c9ee0 0x7f82980b1230 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 --2- 172.21.15.90:0/3643016999 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f82980ab730 0x7f82981eeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 >> 172.21.15.90:0/3643016999 conn(0x7f82980cbfe0 msgr2=0x7f82980acb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 shutdown_connections 2024-04-20T10:52:33.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.264+0000 7f829d3bd640 1 -- 172.21.15.90:0/3643016999 wait complete. 2024-04-20T10:52:33.275 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:52:33.754 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:33.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.861+0000 7fbe10293640 1 Processor -- start 2024-04-20T10:52:33.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.861+0000 7fbe10293640 1 -- start start 2024-04-20T10:52:33.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe10293640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe08153ef0 0x7fbe080c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe10293640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080ab730 0x7fbe081568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe10293640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe080c9ee0 0x7fbe08156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe10293640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0815a720 con 0x7fbe08153ef0 2024-04-20T10:52:33.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe10293640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbe0815ac80 con 0x7fbe080c9ee0 2024-04-20T10:52:33.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe10293640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbe0815a9a0 con 0x7fbe080ab730 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe0e02f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe08153ef0 0x7fbe080c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe0d82e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080ab730 0x7fbe081568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe0d82e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080ab730 0x7fbe081568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:41812/0 (socket says 172.21.15.90:41812) 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe0e02f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe08153ef0 0x7fbe080c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51584/0 (socket says 172.21.15.90:51584) 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe0d82e640 1 -- 172.21.15.90:0/2596877823 learned_addr learned my addr 172.21.15.90:0/2596877823 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.862+0000 7fbe0e830640 1 --2- 172.21.15.90:0/2596877823 >> v2:172.21.15.175:3300/0 conn(0x7fbe080c9ee0 0x7fbe08156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.863+0000 7fbe0e02f640 1 -- 172.21.15.90:0/2596877823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080ab730 msgr2=0x7fbe081568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.863+0000 7fbe0e02f640 1 --2- 172.21.15.90:0/2596877823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080ab730 0x7fbe081568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.863+0000 7fbe0e02f640 1 -- 172.21.15.90:0/2596877823 >> v2:172.21.15.175:3300/0 conn(0x7fbe080c9ee0 msgr2=0x7fbe08156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.863+0000 7fbe0e02f640 1 --2- 172.21.15.90:0/2596877823 >> v2:172.21.15.175:3300/0 conn(0x7fbe080c9ee0 0x7fbe08156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.863+0000 7fbe0e02f640 1 -- 172.21.15.90:0/2596877823 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe080c6a90 con 0x7fbe08153ef0 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.864+0000 7fbe0e02f640 1 --2- 172.21.15.90:0/2596877823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe08153ef0 0x7fbe080c89f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c9b40 tx=0x7fbe0402b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62fd9bdae4118a71 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.864+0000 7fbe0d02d640 1 -- 172.21.15.90:0/2596877823 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04037070 con 0x7fbe08153ef0 2024-04-20T10:52:33.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.864+0000 7fbe0d02d640 1 -- 172.21.15.90:0/2596877823 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe04030710 con 0x7fbe08153ef0 2024-04-20T10:52:33.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.864+0000 7fbe0d02d640 1 -- 172.21.15.90:0/2596877823 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe04030ae0 con 0x7fbe08153ef0 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 -- 172.21.15.90:0/2596877823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe08153ef0 msgr2=0x7fbe080c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 --2- 172.21.15.90:0/2596877823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe08153ef0 0x7fbe080c89f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fbe080c9b40 tx=0x7fbe0402b710 comp rx=0 tx=0).stop 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 -- 172.21.15.90:0/2596877823 shutdown_connections 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 --2- 172.21.15.90:0/2596877823 >> v2:172.21.15.175:3300/0 conn(0x7fbe080c9ee0 0x7fbe08156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 --2- 172.21.15.90:0/2596877823 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080ab730 0x7fbe081568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 --2- 172.21.15.90:0/2596877823 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe08153ef0 0x7fbe080c89f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 -- 172.21.15.90:0/2596877823 >> 172.21.15.90:0/2596877823 conn(0x7fbe080cbfe0 msgr2=0x7fbe080cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 -- 172.21.15.90:0/2596877823 shutdown_connections 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.865+0000 7fbe10293640 1 -- 172.21.15.90:0/2596877823 wait complete. 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.867+0000 7fbe10293640 1 Processor -- start 2024-04-20T10:52:33.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.867+0000 7fbe10293640 1 -- start start 2024-04-20T10:52:33.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe10293640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe080ab730 0x7fbe081ea1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe10293640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080c9ee0 0x7fbe081eee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe10293640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe08153ef0 0x7fbe081ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe10293640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbe080bf800 con 0x7fbe080ab730 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe10293640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbe08157340 con 0x7fbe08153ef0 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe10293640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbe081ee0e0 con 0x7fbe080c9ee0 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe0d82e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080c9ee0 0x7fbe081eee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe0d82e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080c9ee0 0x7fbe081eee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:41828/0 (socket says 172.21.15.90:41828) 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe0d82e640 1 -- 172.21.15.90:0/1709823368 learned_addr learned my addr 172.21.15.90:0/1709823368 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe0e02f640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe080ab730 0x7fbe081ea1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.868+0000 7fbe0e830640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe08153ef0 0x7fbe081ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe0d82e640 1 -- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe08153ef0 msgr2=0x7fbe081ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe0d82e640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe08153ef0 0x7fbe081ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe0d82e640 1 -- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe080ab730 msgr2=0x7fbe081ea1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe0d82e640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe080ab730 0x7fbe081ea1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:33.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe0d82e640 1 -- 172.21.15.90:0/1709823368 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe081f0550 con 0x7fbe080c9ee0 2024-04-20T10:52:33.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe0d82e640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080c9ee0 0x7fbe081eee10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e8a0 tx=0x7fbdf800ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:33.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbdfeffd640 1 -- 172.21.15.90:0/1709823368 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf8017070 con 0x7fbe080c9ee0 2024-04-20T10:52:33.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbdfeffd640 1 -- 172.21.15.90:0/1709823368 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdf800c940 con 0x7fbe080c9ee0 2024-04-20T10:52:33.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbdfeffd640 1 -- 172.21.15.90:0/1709823368 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdf800ccf0 con 0x7fbe080c9ee0 2024-04-20T10:52:33.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe081ee330 con 0x7fbe080c9ee0 2024-04-20T10:52:33.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.869+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe081ee8f0 con 0x7fbe080c9ee0 2024-04-20T10:52:33.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.871+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe080695c0 con 0x7fbe080c9ee0 2024-04-20T10:52:33.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.871+0000 7fbdfeffd640 1 -- 172.21.15.90:0/1709823368 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbdf801a070 con 0x7fbe080c9ee0 2024-04-20T10:52:33.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.872+0000 7fbdfeffd640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbdec06c8f0 0x7fbdec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:33.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.872+0000 7fbdfeffd640 1 -- 172.21.15.90:0/1709823368 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fbdf808c0e0 con 0x7fbe080c9ee0 2024-04-20T10:52:33.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.872+0000 7fbe0e02f640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbdec06c8f0 0x7fbdec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:33.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.872+0000 7fbe0e02f640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbdec06c8f0 0x7fbdec06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe04034000 tx=0x7fbe0402f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:33.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:33.876+0000 7fbdfeffd640 1 -- 172.21.15.90:0/1709823368 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbe080695c0 con 0x7fbe080c9ee0 2024-04-20T10:52:34.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.126+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe08076150 con 0x7fbe080c9ee0 2024-04-20T10:52:34.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.127+0000 7fbdfeffd640 1 -- 172.21.15.90:0/1709823368 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fbdf8059bb0 con 0x7fbe080c9ee0 2024-04-20T10:52:34.127 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:34.128 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:34.128 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:34.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.129+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbdec06c8f0 msgr2=0x7fbdec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:34.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.129+0000 7fbe10293640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbdec06c8f0 0x7fbdec06edb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe04034000 tx=0x7fbe0402f000 comp rx=0 tx=0).stop 2024-04-20T10:52:34.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.129+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080c9ee0 msgr2=0x7fbe081eee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:34.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.129+0000 7fbe10293640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080c9ee0 0x7fbe081eee10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800e8a0 tx=0x7fbdf800ed60 comp rx=0 tx=0).stop 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 shutdown_connections 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbdec06c8f0 0x7fbdec06edb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe08153ef0 0x7fbe081ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe080c9ee0 0x7fbe081eee10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 --2- 172.21.15.90:0/1709823368 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe080ab730 0x7fbe081ea1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 >> 172.21.15.90:0/1709823368 conn(0x7fbe080cbfe0 msgr2=0x7fbe081568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 shutdown_connections 2024-04-20T10:52:34.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:34.130+0000 7fbe10293640 1 -- 172.21.15.90:0/1709823368 wait complete. 2024-04-20T10:52:34.141 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-20T10:52:35.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:35.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.430+0000 7f78ebd52640 1 Processor -- start 2024-04-20T10:52:35.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.431+0000 7f78ebd52640 1 -- start start 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.432+0000 7f78ebd52640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78e4154480 0x7f78e4157a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.432+0000 7f78ebd52640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e4073ba0 con 0x7f78e4151b10 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.432+0000 7f78ebd52640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e41589a0 con 0x7f78e40aba60 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.432+0000 7f78ebd52640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f78e4151ef0 con 0x7f78e4154480 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.432+0000 7f78e92ed640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78e4154480 0x7f78e4157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.432+0000 7f78e9aee640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f78e4151b10 0x7f78e40725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57064/0 (socket says 172.21.15.90:57064) 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.432+0000 7f78e9aee640 1 -- 172.21.15.90:0/2000765133 learned_addr learned my addr 172.21.15.90:0/2000765133 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.433+0000 7f78e92ed640 1 -- 172.21.15.90:0/2000765133 >> v1:172.21.15.175:6789/0 conn(0x7f78e40aba60 legacy=0x7f78e40abed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.433+0000 7f78e92ed640 1 -- 172.21.15.90:0/2000765133 >> v1:172.21.15.90:6789/0 conn(0x7f78e4151b10 legacy=0x7f78e40725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:35.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.433+0000 7f78e92ed640 1 -- 172.21.15.90:0/2000765133 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e4158100 con 0x7f78e4154480 2024-04-20T10:52:35.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.433+0000 7f78e8aec640 1 -- 172.21.15.90:0/2000765133 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846902442 0 0) 0x7f78e4073ba0 con 0x7f78e4151b10 2024-04-20T10:52:35.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.434+0000 7f78e92ed640 1 --2- 172.21.15.90:0/2000765133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e4154480 0x7f78e4157a70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78d400f9b0 tx=0x7f78d402fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87e5f091f295df7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:35.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.434+0000 7f78e8aec640 1 -- 172.21.15.90:0/2000765133 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d403d070 con 0x7f78e4154480 2024-04-20T10:52:35.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.434+0000 7f78e8aec640 1 -- 172.21.15.90:0/2000765133 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d4030a80 con 0x7f78e4154480 2024-04-20T10:52:35.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.434+0000 7f78e8aec640 1 -- 172.21.15.90:0/2000765133 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d4030e50 con 0x7f78e4154480 2024-04-20T10:52:35.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.435+0000 7f78ebd52640 1 -- 172.21.15.90:0/2000765133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e4154480 msgr2=0x7f78e4157a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:35.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.435+0000 7f78ebd52640 1 --2- 172.21.15.90:0/2000765133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e4154480 0x7f78e4157a70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f78d400f9b0 tx=0x7f78d402fcd0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.435+0000 7f78ebd52640 1 -- 172.21.15.90:0/2000765133 shutdown_connections 2024-04-20T10:52:35.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.435+0000 7f78ebd52640 1 --2- 172.21.15.90:0/2000765133 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e4154480 0x7f78e4157a70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.435+0000 7f78ebd52640 1 -- 172.21.15.90:0/2000765133 >> 172.21.15.90:0/2000765133 conn(0x7f78e40ca0a0 msgr2=0x7f78e40ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:35.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.435+0000 7f78ebd52640 1 -- 172.21.15.90:0/2000765133 shutdown_connections 2024-04-20T10:52:35.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.435+0000 7f78ebd52640 1 -- 172.21.15.90:0/2000765133 wait complete. 2024-04-20T10:52:35.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.437+0000 7f78ebd52640 1 Processor -- start 2024-04-20T10:52:35.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.437+0000 7f78ebd52640 1 -- start start 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78ebd52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e40aba60 0x7f78e4156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78ebd52640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78e4151b10 0x7f78e4147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78ebd52640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e4154480 0x7f78e41479a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78ebd52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78e40ab540 con 0x7f78e40aba60 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78ebd52640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78e41586c0 con 0x7f78e4154480 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78ebd52640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78e4072d00 con 0x7f78e4151b10 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78e9aee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e40aba60 0x7f78e4156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:35.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78e9aee640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e40aba60 0x7f78e4156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49854/0 (socket says 172.21.15.90:49854) 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78e9aee640 1 -- 172.21.15.90:0/3054576250 learned_addr learned my addr 172.21.15.90:0/3054576250 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.438+0000 7f78ea2ef640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e4154480 0x7f78e41479a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e9aee640 1 -- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78e4151b10 msgr2=0x7f78e4147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e92ed640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78e4151b10 0x7f78e4147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e9aee640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78e4151b10 0x7f78e4147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e9aee640 1 -- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e4154480 msgr2=0x7f78e41479a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e9aee640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e4154480 0x7f78e41479a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e9aee640 1 -- 172.21.15.90:0/3054576250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e4157240 con 0x7f78e40aba60 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e92ed640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78e4151b10 0x7f78e4147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78ea2ef640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e4154480 0x7f78e41479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78e9aee640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e40aba60 0x7f78e4156200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c4a0 tx=0x7f78e000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78da7fc640 1 -- 172.21.15.90:0/3054576250 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0018070 con 0x7f78e40aba60 2024-04-20T10:52:35.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78da7fc640 1 -- 172.21.15.90:0/3054576250 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e00074e0 con 0x7f78e40aba60 2024-04-20T10:52:35.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78e4157520 con 0x7f78e40aba60 2024-04-20T10:52:35.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.439+0000 7f78da7fc640 1 -- 172.21.15.90:0/3054576250 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0004a20 con 0x7f78e40aba60 2024-04-20T10:52:35.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.440+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78e4156740 con 0x7f78e40aba60 2024-04-20T10:52:35.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.441+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78e4068c20 con 0x7f78e40aba60 2024-04-20T10:52:35.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.442+0000 7f78da7fc640 1 -- 172.21.15.90:0/3054576250 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78e001b070 con 0x7f78e40aba60 2024-04-20T10:52:35.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.442+0000 7f78da7fc640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c8f0 0x7f78c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:35.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.442+0000 7f78da7fc640 1 -- 172.21.15.90:0/3054576250 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7f78e008af60 con 0x7f78e40aba60 2024-04-20T10:52:35.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.442+0000 7f78e92ed640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c8f0 0x7f78c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:35.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.443+0000 7f78e92ed640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c8f0 0x7f78c806edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f78d403a000 tx=0x7f78d4034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:35.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.451+0000 7f78da7fc640 1 -- 172.21.15.90:0/3054576250 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f78e4068c20 con 0x7f78e40aba60 2024-04-20T10:52:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.889+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78e40695c0 con 0x7f78e40aba60 2024-04-20T10:52:35.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.889+0000 7f78da7fc640 1 -- 172.21.15.90:0/3054576250 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7f78e40695c0 con 0x7f78e40aba60 2024-04-20T10:52:35.890 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:35.890 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:35.890 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c8f0 msgr2=0x7f78c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c8f0 0x7f78c806edb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f78d403a000 tx=0x7f78d4034000 comp rx=0 tx=0).stop 2024-04-20T10:52:35.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e40aba60 msgr2=0x7f78e4156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e40aba60 0x7f78e4156200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f78e000c4a0 tx=0x7f78e000c960 comp rx=0 tx=0).stop 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 shutdown_connections 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c8f0 0x7f78c806edb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78e4154480 0x7f78e41479a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78e4151b10 0x7f78e4147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 --2- 172.21.15.90:0/3054576250 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78e40aba60 0x7f78e4156200 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 >> 172.21.15.90:0/3054576250 conn(0x7f78e40ca0a0 msgr2=0x7f78e40ac9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 shutdown_connections 2024-04-20T10:52:35.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:35.892+0000 7f78ebd52640 1 -- 172.21.15.90:0/3054576250 wait complete. 2024-04-20T10:52:35.907 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:52:36.142 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:36.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.242+0000 7fd849877640 1 Processor -- start 2024-04-20T10:52:36.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.242+0000 7fd849877640 1 -- start start 2024-04-20T10:52:36.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.243+0000 7fd849877640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd844072860 0x7fd8441551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.243+0000 7fd849877640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd844158780 con 0x7fd8440c45c0 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.243+0000 7fd849877640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8441546d0 con 0x7fd844073120 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.243+0000 7fd849877640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd8440ad010 con 0x7fd844072860 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.243+0000 7fd842ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd844072860 0x7fd8441551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.243+0000 7fd8427fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd8440c45c0 0x7fd8440ab4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57076/0 (socket says 172.21.15.90:57076) 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.243+0000 7fd8427fc640 1 -- 172.21.15.90:0/515885677 learned_addr learned my addr 172.21.15.90:0/515885677 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.244+0000 7fd842ffd640 1 -- 172.21.15.90:0/515885677 >> v1:172.21.15.175:6789/0 conn(0x7fd844073120 legacy=0x7fd844151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.244+0000 7fd842ffd640 1 -- 172.21.15.90:0/515885677 >> v1:172.21.15.90:6789/0 conn(0x7fd8440c45c0 legacy=0x7fd8440ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:36.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.244+0000 7fd842ffd640 1 -- 172.21.15.90:0/515885677 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8441549b0 con 0x7fd844072860 2024-04-20T10:52:36.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.244+0000 7fd842ffd640 1 --2- 172.21.15.90:0/515885677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844072860 0x7fd8441551b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd8340097a0 tx=0x7fd83402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b783770556ea7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:36.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.244+0000 7fd841ffb640 1 -- 172.21.15.90:0/515885677 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834035020 con 0x7fd844072860 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd841ffb640 1 -- 172.21.15.90:0/515885677 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd834031830 con 0x7fd844072860 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd841ffb640 1 -- 172.21.15.90:0/515885677 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd834031c00 con 0x7fd844072860 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd849877640 1 -- 172.21.15.90:0/515885677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844072860 msgr2=0x7fd8441551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd849877640 1 --2- 172.21.15.90:0/515885677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844072860 0x7fd8441551b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd8340097a0 tx=0x7fd83402b8d0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd849877640 1 -- 172.21.15.90:0/515885677 shutdown_connections 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd849877640 1 --2- 172.21.15.90:0/515885677 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844072860 0x7fd8441551b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd849877640 1 -- 172.21.15.90:0/515885677 >> 172.21.15.90:0/515885677 conn(0x7fd844067de0 msgr2=0x7fd8440ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd849877640 1 -- 172.21.15.90:0/515885677 shutdown_connections 2024-04-20T10:52:36.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.245+0000 7fd849877640 1 -- 172.21.15.90:0/515885677 wait complete. 2024-04-20T10:52:36.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.247+0000 7fd849877640 1 Processor -- start 2024-04-20T10:52:36.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.247+0000 7fd849877640 1 -- start start 2024-04-20T10:52:36.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd849877640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd844072860 0x7fd8440c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:36.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd849877640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844073120 0x7fd8441e8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:36.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd849877640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8440c45c0 0x7fd84414ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:36.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd849877640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd844158a60 con 0x7fd844073120 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd8427fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844073120 0x7fd8441e8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd8427fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844073120 0x7fd8441e8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49882/0 (socket says 172.21.15.90:49882) 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd8427fc640 1 -- 172.21.15.90:0/1828170040 learned_addr learned my addr 172.21.15.90:0/1828170040 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd844158530 con 0x7fd8440c45c0 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd8440abbb0 con 0x7fd844072860 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.248+0000 7fd842ffd640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd844072860 0x7fd8440c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd8437fe640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8440c45c0 0x7fd84414ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd8427fc640 1 -- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd844072860 msgr2=0x7fd8440c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd8427fc640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd844072860 0x7fd8440c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd8427fc640 1 -- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8440c45c0 msgr2=0x7fd84414ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd8427fc640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8440c45c0 0x7fd84414ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd8427fc640 1 -- 172.21.15.90:0/1828170040 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd844157490 con 0x7fd844073120 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd8427fc640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844073120 0x7fd8441e8920 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c500 tx=0x7fd83800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd82bfff640 1 -- 172.21.15.90:0/1828170040 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd838017070 con 0x7fd844073120 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd82bfff640 1 -- 172.21.15.90:0/1828170040 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd838005ce0 con 0x7fd844073120 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd82bfff640 1 -- 172.21.15.90:0/1828170040 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8380072f0 con 0x7fd844073120 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84414f500 con 0x7fd844073120 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.249+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8441ec190 con 0x7fd844073120 2024-04-20T10:52:36.253 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.251+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd844074f00 con 0x7fd844073120 2024-04-20T10:52:36.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.251+0000 7fd82bfff640 1 -- 172.21.15.90:0/1828170040 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd83801a070 con 0x7fd844073120 2024-04-20T10:52:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.252+0000 7fd82bfff640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd83006c8f0 0x7fd83006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.252+0000 7fd82bfff640 1 -- 172.21.15.90:0/1828170040 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fd83808b0b0 con 0x7fd844073120 2024-04-20T10:52:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.252+0000 7fd842ffd640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd83006c8f0 0x7fd83006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:36.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.252+0000 7fd842ffd640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd83006c8f0 0x7fd83006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd834036000 tx=0x7fd83403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:36.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.256+0000 7fd82bfff640 1 -- 172.21.15.90:0/1828170040 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd844074f00 con 0x7fd844073120 2024-04-20T10:52:36.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.501+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd844076150 con 0x7fd844073120 2024-04-20T10:52:36.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.501+0000 7fd82bfff640 1 -- 172.21.15.90:0/1828170040 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fd844157490 con 0x7fd844073120 2024-04-20T10:52:36.502 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:36.502 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:36.502 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd83006c8f0 msgr2=0x7fd83006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd83006c8f0 0x7fd83006edb0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fd834036000 tx=0x7fd83403c040 comp rx=0 tx=0).stop 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844073120 msgr2=0x7fd8441e8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844073120 0x7fd8441e8920 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd83800c500 tx=0x7fd83800c9c0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 shutdown_connections 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd83006c8f0 0x7fd83006edb0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd8440c45c0 0x7fd84414ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd844073120 0x7fd8441e8920 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 --2- 172.21.15.90:0/1828170040 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd844072860 0x7fd8440c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.504+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 >> 172.21.15.90:0/1828170040 conn(0x7fd844067de0 msgr2=0x7fd844153960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:36.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.505+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 shutdown_connections 2024-04-20T10:52:36.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:36.505+0000 7fd849877640 1 -- 172.21.15.90:0/1828170040 wait complete. 2024-04-20T10:52:36.519 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-20T10:52:37.908 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:38.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.011+0000 7fe1181b2640 1 Processor -- start 2024-04-20T10:52:38.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.011+0000 7fe1181b2640 1 -- start start 2024-04-20T10:52:38.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.011+0000 7fe1181b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe110153ef0 0x7fe1100c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe1181b2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe1100c9ee0 0x7fe110156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe1181b2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe11015a720 con 0x7fe1100ab730 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe1181b2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe11015ac80 con 0x7fe1100c9ee0 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe1181b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe11015a9a0 con 0x7fe110153ef0 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe11674f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe1100c9ee0 0x7fe110156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe11674f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe1100c9ee0 0x7fe110156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49892/0 (socket says 172.21.15.90:49892) 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe11674f640 1 -- 172.21.15.90:0/31957517 learned_addr learned my addr 172.21.15.90:0/31957517 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe115f4e640 1 --2- 172.21.15.90:0/31957517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe110153ef0 0x7fe1100c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe11674f640 1 -- 172.21.15.90:0/31957517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe110153ef0 msgr2=0x7fe1100c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe11674f640 1 --2- 172.21.15.90:0/31957517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe110153ef0 0x7fe1100c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe11674f640 1 -- 172.21.15.90:0/31957517 >> v1:172.21.15.175:6789/0 conn(0x7fe1100ab730 legacy=0x7fe1101568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe11674f640 1 -- 172.21.15.90:0/31957517 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1100c6a90 con 0x7fe1100c9ee0 2024-04-20T10:52:38.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.012+0000 7fe115f4e640 1 --2- 172.21.15.90:0/31957517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe110153ef0 0x7fe1100c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:38.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.013+0000 7fe11674f640 1 --2- 172.21.15.90:0/31957517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100c9ee0 0x7fe110156fd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe108009e50 tx=0x7fe10802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9450d4903c5910b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:38.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.013+0000 7fe114f4c640 1 -- 172.21.15.90:0/31957517 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265425159 0 0) 0x7fe100001110 con 0x7fe1100ab730 2024-04-20T10:52:38.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.014+0000 7fe114f4c640 1 -- 172.21.15.90:0/31957517 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10802c9e0 con 0x7fe1100c9ee0 2024-04-20T10:52:38.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.014+0000 7fe114f4c640 1 -- 172.21.15.90:0/31957517 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10802cb80 con 0x7fe1100c9ee0 2024-04-20T10:52:38.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.014+0000 7fe114f4c640 1 -- 172.21.15.90:0/31957517 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1080343f0 con 0x7fe1100c9ee0 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.014+0000 7fe1181b2640 1 -- 172.21.15.90:0/31957517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100c9ee0 msgr2=0x7fe110156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.014+0000 7fe1181b2640 1 --2- 172.21.15.90:0/31957517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100c9ee0 0x7fe110156fd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe108009e50 tx=0x7fe10802be40 comp rx=0 tx=0).stop 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.015+0000 7fe1181b2640 1 -- 172.21.15.90:0/31957517 shutdown_connections 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.015+0000 7fe1181b2640 1 --2- 172.21.15.90:0/31957517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100c9ee0 0x7fe110156fd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.015+0000 7fe1181b2640 1 --2- 172.21.15.90:0/31957517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe110153ef0 0x7fe1100c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.015+0000 7fe1181b2640 1 -- 172.21.15.90:0/31957517 >> 172.21.15.90:0/31957517 conn(0x7fe1100cbfe0 msgr2=0x7fe1100cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.015+0000 7fe1181b2640 1 -- 172.21.15.90:0/31957517 shutdown_connections 2024-04-20T10:52:38.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.015+0000 7fe1181b2640 1 -- 172.21.15.90:0/31957517 wait complete. 2024-04-20T10:52:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.016+0000 7fe1181b2640 1 Processor -- start 2024-04-20T10:52:38.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.016+0000 7fe1181b2640 1 -- start start 2024-04-20T10:52:38.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe1181b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100ab730 0x7fe1100c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe1181b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1100c9ee0 0x7fe110155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe1181b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe110153ef0 0x7fe1100afd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe1181b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe1100bf800 con 0x7fe1100ab730 2024-04-20T10:52:38.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe1181b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe110157510 con 0x7fe110153ef0 2024-04-20T10:52:38.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe1181b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe110155e90 con 0x7fe1100c9ee0 2024-04-20T10:52:38.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100ab730 0x7fe1100c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100ab730 0x7fe1100c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49904/0 (socket says 172.21.15.90:49904) 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 -- 172.21.15.90:0/2424273572 learned_addr learned my addr 172.21.15.90:0/2424273572 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe11574d640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1100c9ee0 0x7fe110155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe11674f640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe110153ef0 0x7fe1100afd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 -- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1100c9ee0 msgr2=0x7fe110155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1100c9ee0 0x7fe110155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 -- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe110153ef0 msgr2=0x7fe1100afd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe110153ef0 0x7fe1100afd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 -- 172.21.15.90:0/2424273572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1101f0230 con 0x7fe1100ab730 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe115f4e640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100ab730 0x7fe1100c3750 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00ec10 tx=0x7fe10c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.017+0000 7fe1067fc640 1 -- 172.21.15.90:0/2424273572 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c017070 con 0x7fe1100ab730 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.018+0000 7fe1067fc640 1 -- 172.21.15.90:0/2424273572 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10c00cc30 con 0x7fe1100ab730 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.018+0000 7fe1067fc640 1 -- 172.21.15.90:0/2424273572 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c013470 con 0x7fe1100ab730 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.018+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe110155150 con 0x7fe1100ab730 2024-04-20T10:52:38.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.018+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1100b02d0 con 0x7fe1100ab730 2024-04-20T10:52:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.019+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe110076150 con 0x7fe1100ab730 2024-04-20T10:52:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.020+0000 7fe1067fc640 1 -- 172.21.15.90:0/2424273572 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe10c01a070 con 0x7fe1100ab730 2024-04-20T10:52:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.020+0000 7fe1067fc640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe0f406c8f0 0x7fe0f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.020+0000 7fe1067fc640 1 -- 172.21.15.90:0/2424273572 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fe10c08c400 con 0x7fe1100ab730 2024-04-20T10:52:38.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.020+0000 7fe11574d640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe0f406c8f0 0x7fe0f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.021+0000 7fe11574d640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe0f406c8f0 0x7fe0f406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c3160 tx=0x7fe100009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.028+0000 7fe1067fc640 1 -- 172.21.15.90:0/2424273572 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe10c059fb0 con 0x7fe1100ab730 2024-04-20T10:52:38.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.252+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe110151ad0 con 0x7fe1100ab730 2024-04-20T10:52:38.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.252+0000 7fe1067fc640 1 -- 172.21.15.90:0/2424273572 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fe10c05e2b0 con 0x7fe1100ab730 2024-04-20T10:52:38.253 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:38.253 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:38.253 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:38.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe0f406c8f0 msgr2=0x7fe0f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe0f406c8f0 0x7fe0f406edb0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1100c3160 tx=0x7fe100009040 comp rx=0 tx=0).stop 2024-04-20T10:52:38.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100ab730 msgr2=0x7fe1100c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100ab730 0x7fe1100c3750 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00ec10 tx=0x7fe10c00c520 comp rx=0 tx=0).stop 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 shutdown_connections 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe0f406c8f0 0x7fe0f406edb0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe110153ef0 0x7fe1100afd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe1100c9ee0 0x7fe110155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 --2- 172.21.15.90:0/2424273572 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe1100ab730 0x7fe1100c3750 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 >> 172.21.15.90:0/2424273572 conn(0x7fe1100cbfe0 msgr2=0x7fe1101568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 shutdown_connections 2024-04-20T10:52:38.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.255+0000 7fe1181b2640 1 -- 172.21.15.90:0/2424273572 wait complete. 2024-04-20T10:52:38.267 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:52:38.519 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:38.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.623+0000 7feda5d7e640 1 Processor -- start 2024-04-20T10:52:38.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.623+0000 7feda5d7e640 1 -- start start 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.624+0000 7feda5d7e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feda00bf5a0 0x7feda015acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.624+0000 7feda5d7e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda00cbcc0 con 0x7feda00ca570 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.624+0000 7feda5d7e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feda015b2c0 con 0x7feda00cb160 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.624+0000 7feda5d7e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7feda00bf980 con 0x7feda00bf5a0 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.624+0000 7fed9effd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7feda00ca570 0x7feda00c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57092/0 (socket says 172.21.15.90:57092) 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.624+0000 7fed9effd640 1 -- 172.21.15.90:0/1850377396 learned_addr learned my addr 172.21.15.90:0/1850377396 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.624+0000 7fed9f7fe640 1 --2- 172.21.15.90:0/1850377396 >> v2:172.21.15.90:3300/0 conn(0x7feda00bf5a0 0x7feda015acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.625+0000 7fed9e7fc640 1 -- 172.21.15.90:0/1850377396 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224170696 0 0) 0x7feda00cbcc0 con 0x7feda00ca570 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.625+0000 7fed9e7fc640 1 -- 172.21.15.90:0/1850377396 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed88003520 con 0x7feda00ca570 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.625+0000 7fed9e7fc640 1 -- 172.21.15.90:0/1850377396 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273889466 0 0) 0x7feda015b2c0 con 0x7feda00cb160 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.625+0000 7fed9e7fc640 1 -- 172.21.15.90:0/1850377396 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda00cbcc0 con 0x7feda00cb160 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.625+0000 7fed9f7fe640 1 -- 172.21.15.90:0/1850377396 >> v1:172.21.15.175:6789/0 conn(0x7feda00cb160 legacy=0x7feda00cb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.625+0000 7fed9f7fe640 1 -- 172.21.15.90:0/1850377396 >> v1:172.21.15.90:6789/0 conn(0x7feda00ca570 legacy=0x7feda00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.625+0000 7fed9f7fe640 1 -- 172.21.15.90:0/1850377396 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda015b5a0 con 0x7feda00bf5a0 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7fed9f7fe640 1 --2- 172.21.15.90:0/1850377396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00bf5a0 0x7feda015acb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fed900097a0 tx=0x7fed9002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e847ec8872d7f95b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7fed9e7fc640 1 -- 172.21.15.90:0/1850377396 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90035020 con 0x7feda00bf5a0 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7fed9e7fc640 1 -- 172.21.15.90:0/1850377396 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed90031830 con 0x7feda00bf5a0 2024-04-20T10:52:38.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7fed9e7fc640 1 -- 172.21.15.90:0/1850377396 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed90031c00 con 0x7feda00bf5a0 2024-04-20T10:52:38.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7feda5d7e640 1 -- 172.21.15.90:0/1850377396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00bf5a0 msgr2=0x7feda015acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7feda5d7e640 1 --2- 172.21.15.90:0/1850377396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00bf5a0 0x7feda015acb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fed900097a0 tx=0x7fed9002b8d0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7feda5d7e640 1 -- 172.21.15.90:0/1850377396 shutdown_connections 2024-04-20T10:52:38.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7feda5d7e640 1 --2- 172.21.15.90:0/1850377396 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00bf5a0 0x7feda015acb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.626+0000 7feda5d7e640 1 -- 172.21.15.90:0/1850377396 >> 172.21.15.90:0/1850377396 conn(0x7feda00cbfe0 msgr2=0x7feda00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:38.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.627+0000 7feda5d7e640 1 -- 172.21.15.90:0/1850377396 shutdown_connections 2024-04-20T10:52:38.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.627+0000 7feda5d7e640 1 -- 172.21.15.90:0/1850377396 wait complete. 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.628+0000 7feda5d7e640 1 Processor -- start 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.628+0000 7feda5d7e640 1 -- start start 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7feda5d7e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feda00bf5a0 0x7feda015e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7feda5d7e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00ca570 0x7feda01f2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7feda5d7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feda00cb160 0x7feda01f34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7feda5d7e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feda00cac40 con 0x7feda00ca570 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7feda5d7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feda015bb60 con 0x7feda00cb160 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7feda5d7e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feda006cfe0 con 0x7feda00bf5a0 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00ca570 0x7feda01f2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00ca570 0x7feda01f2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49914/0 (socket says 172.21.15.90:49914) 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 -- 172.21.15.90:0/4242946539 learned_addr learned my addr 172.21.15.90:0/4242946539 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:38.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9f7fe640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feda00bf5a0 0x7feda015e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9ffff640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feda00cb160 0x7feda01f34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 -- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feda00bf5a0 msgr2=0x7feda015e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feda00bf5a0 0x7feda015e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 -- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feda00cb160 msgr2=0x7feda01f34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feda00cb160 0x7feda01f34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 -- 172.21.15.90:0/4242946539 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda00bbf40 con 0x7feda00ca570 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9f7fe640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feda00bf5a0 0x7feda015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.629+0000 7fed9effd640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00ca570 0x7feda01f2f60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c420 tx=0x7fed9400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.630+0000 7fed87fff640 1 -- 172.21.15.90:0/4242946539 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94017070 con 0x7feda00ca570 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.630+0000 7fed87fff640 1 -- 172.21.15.90:0/4242946539 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed94005ce0 con 0x7feda00ca570 2024-04-20T10:52:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.630+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda00bc220 con 0x7feda00ca570 2024-04-20T10:52:38.633 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.630+0000 7fed87fff640 1 -- 172.21.15.90:0/4242946539 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed94007310 con 0x7feda00ca570 2024-04-20T10:52:38.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.631+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda00bb970 con 0x7feda00ca570 2024-04-20T10:52:38.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.632+0000 7fed87fff640 1 -- 172.21.15.90:0/4242946539 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed9401a070 con 0x7feda00ca570 2024-04-20T10:52:38.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.632+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda00bbb70 con 0x7feda00ca570 2024-04-20T10:52:38.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.632+0000 7fed87fff640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fed8c06c8f0 0x7fed8c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:38.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.632+0000 7fed9f7fe640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fed8c06c8f0 0x7fed8c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:38.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.633+0000 7fed87fff640 1 -- 172.21.15.90:0/4242946539 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6637+0+0 (secure 0 0 0) 0x7fed9408af30 con 0x7feda00ca570 2024-04-20T10:52:38.634 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.633+0000 7fed9f7fe640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fed8c06c8f0 0x7fed8c06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed90036000 tx=0x7fed90008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.637+0000 7fed87fff640 1 -- 172.21.15.90:0/4242946539 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fed94058ac0 con 0x7feda00ca570 2024-04-20T10:52:38.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.857+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feda0076150 con 0x7feda00ca570 2024-04-20T10:52:38.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.858+0000 7fed87fff640 1 -- 172.21.15.90:0/4242946539 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6524 (secure 0 0 0) 0x7fed9405cdc0 con 0x7feda00ca570 2024-04-20T10:52:38.859 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:38.859 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:50:42.940935+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4299},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4299":{"gid":4299,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.175:6835/2994051895","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":2994051895},{"type":"v1","addr":"172.21.15.175:6835","nonce":2994051895}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4299,"qdb_cluster":[4299]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:38.859 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 12 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fed8c06c8f0 msgr2=0x7fed8c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fed8c06c8f0 0x7fed8c06edb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed90036000 tx=0x7fed90008030 comp rx=0 tx=0).stop 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00ca570 msgr2=0x7feda01f2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00ca570 0x7feda01f2f60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fed9400c420 tx=0x7fed9400c8e0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 shutdown_connections 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fed8c06c8f0 0x7fed8c06edb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feda00cb160 0x7feda01f34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feda00ca570 0x7feda01f2f60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 --2- 172.21.15.90:0/4242946539 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feda00bf5a0 0x7feda015e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:38.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 >> 172.21.15.90:0/4242946539 conn(0x7feda00cbfe0 msgr2=0x7feda015a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:38.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.861+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 shutdown_connections 2024-04-20T10:52:38.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:38.862+0000 7feda5d7e640 1 -- 172.21.15.90:0/4242946539 wait complete. 2024-04-20T10:52:38.876 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is laggy/crashed, in failed state, or mds.d is removed from mdsmap 2024-04-20T10:52:40.269 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:40.310 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:52:40.315 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:52:40.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.409+0000 7fa8c3831640 1 Processor -- start 2024-04-20T10:52:40.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.409+0000 7fa8c3831640 1 -- start start 2024-04-20T10:52:40.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c3831640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa8bc0ab730 0x7fa8bc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:40.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c3831640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc15a720 con 0x7fa8bc153ef0 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c3831640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8bc15ac80 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c15cd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa8bc153ef0 0x7fa8bc0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57096/0 (socket says 172.21.15.90:57096) 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c15cd640 1 -- 172.21.15.90:0/2424083358 learned_addr learned my addr 172.21.15.90:0/2424083358 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c3831640 1 -- 172.21.15.90:0/2424083358 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa8bc15a9a0 con 0x7fa8bc0ab730 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c0dcc640 1 --2- 172.21.15.90:0/2424083358 >> v2:172.21.15.175:3300/0 conn(0x7fa8bc0ab730 0x7fa8bc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8b3fff640 1 -- 172.21.15.90:0/2424083358 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 157215414 0 0) 0x7fa8b8001110 con 0x7fa8bc153ef0 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8b3fff640 1 -- 172.21.15.90:0/2424083358 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a8003520 con 0x7fa8bc153ef0 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8b3fff640 1 -- 172.21.15.90:0/2424083358 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949692141 0 0) 0x7fa8bc15ac80 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8b3fff640 1 -- 172.21.15.90:0/2424083358 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8b8001110 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c0dcc640 1 -- 172.21.15.90:0/2424083358 >> v1:172.21.15.175:6789/0 conn(0x7fa8bc0c9ee0 legacy=0x7fa8bc156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c0dcc640 1 -- 172.21.15.90:0/2424083358 >> v1:172.21.15.90:6789/0 conn(0x7fa8bc153ef0 legacy=0x7fa8bc0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:40.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.411+0000 7fa8c0dcc640 1 -- 172.21.15.90:0/2424083358 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc0c6a90 con 0x7fa8bc0ab730 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.412+0000 7fa8c0dcc640 1 --2- 172.21.15.90:0/2424083358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc0ab730 0x7fa8bc1568c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0097a0 tx=0x7fa8ac02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8484a08c2cbd26a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.412+0000 7fa8b3fff640 1 -- 172.21.15.90:0/2424083358 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0315a0 con 0x7fa8bc0ab730 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.412+0000 7fa8b3fff640 1 -- 172.21.15.90:0/2424083358 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac037070 con 0x7fa8bc0ab730 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.412+0000 7fa8b3fff640 1 -- 172.21.15.90:0/2424083358 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac031940 con 0x7fa8bc0ab730 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.413+0000 7fa8c3831640 1 -- 172.21.15.90:0/2424083358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc0ab730 msgr2=0x7fa8bc1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.413+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2424083358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc0ab730 0x7fa8bc1568c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac0097a0 tx=0x7fa8ac02b840 comp rx=0 tx=0).stop 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.413+0000 7fa8c3831640 1 -- 172.21.15.90:0/2424083358 shutdown_connections 2024-04-20T10:52:40.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.413+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2424083358 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc0ab730 0x7fa8bc1568c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.413+0000 7fa8c3831640 1 -- 172.21.15.90:0/2424083358 >> 172.21.15.90:0/2424083358 conn(0x7fa8bc0cbfe0 msgr2=0x7fa8bc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:40.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.413+0000 7fa8c3831640 1 -- 172.21.15.90:0/2424083358 shutdown_connections 2024-04-20T10:52:40.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.413+0000 7fa8c3831640 1 -- 172.21.15.90:0/2424083358 wait complete. 2024-04-20T10:52:40.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.415+0000 7fa8c3831640 1 Processor -- start 2024-04-20T10:52:40.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.415+0000 7fa8c3831640 1 -- start start 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c3831640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8bc0ab730 0x7fa8bc0c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c3831640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8bc0c9ee0 0x7fa8bc1ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c3831640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc153ef0 0x7fa8bc1ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c3831640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc0c9100 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c3831640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa8bc157510 con 0x7fa8bc153ef0 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c3831640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa8bc0c9280 con 0x7fa8bc0ab730 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c0dcc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8bc0c9ee0 0x7fa8bc1ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c0dcc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8bc0c9ee0 0x7fa8bc1ef450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49922/0 (socket says 172.21.15.90:49922) 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c0dcc640 1 -- 172.21.15.90:0/2514131197 learned_addr learned my addr 172.21.15.90:0/2514131197 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.416+0000 7fa8c1dce640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc153ef0 0x7fa8bc1ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:40.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c0dcc640 1 -- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8bc0ab730 msgr2=0x7fa8bc0c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c15cd640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8bc0ab730 0x7fa8bc0c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c0dcc640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8bc0ab730 0x7fa8bc0c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c0dcc640 1 -- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc153ef0 msgr2=0x7fa8bc1ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c0dcc640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc153ef0 0x7fa8bc1ef990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c0dcc640 1 -- 172.21.15.90:0/2514131197 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8bc1e9b50 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c1dce640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc153ef0 0x7fa8bc1ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c15cd640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8bc0ab730 0x7fa8bc0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c0dcc640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8bc0c9ee0 0x7fa8bc1ef450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000c00 tx=0x7fa8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8b1ffb640 1 -- 172.21.15.90:0/2514131197 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0317a0 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8bc1eff90 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8b1ffb640 1 -- 172.21.15.90:0/2514131197 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8ac031940 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.417+0000 7fa8b1ffb640 1 -- 172.21.15.90:0/2514131197 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac031d30 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.418+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8bc0aed30 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.419+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8bc076150 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.419+0000 7fa8b1ffb640 1 -- 172.21.15.90:0/2514131197 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8ac047480 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.420+0000 7fa8b1ffb640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa8a006c8f0 0x7fa8a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:40.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.420+0000 7fa8b1ffb640 1 -- 172.21.15.90:0/2514131197 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7fa8ac02f020 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.423 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.423+0000 7fa8c15cd640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa8a006c8f0 0x7fa8a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:40.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.424+0000 7fa8c15cd640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa8a006c8f0 0x7fa8a006edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80013b0 tx=0x7fa8b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:40.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.428+0000 7fa8b1ffb640 1 -- 172.21.15.90:0/2514131197 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa8ac07bef0 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.720+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8bc06d070 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.721+0000 7fa8b1ffb640 1 -- 172.21.15.90:0/2514131197 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5693 (secure 0 0 0) 0x7fa8ac0801f0 con 0x7fa8bc0c9ee0 2024-04-20T10:52:40.722 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:40.722 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:40.318100+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:40.722 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 13 2024-04-20T10:52:40.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.723+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa8a006c8f0 msgr2=0x7fa8a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.723+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa8a006c8f0 0x7fa8a006edb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80013b0 tx=0x7fa8b8009040 comp rx=0 tx=0).stop 2024-04-20T10:52:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.723+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8bc0c9ee0 msgr2=0x7fa8bc1ef450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.723+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8bc0c9ee0 0x7fa8bc1ef450 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000c00 tx=0x7fa8ac0046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 shutdown_connections 2024-04-20T10:52:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa8a006c8f0 0x7fa8a006edb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa8bc153ef0 0x7fa8bc1ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa8bc0c9ee0 0x7fa8bc1ef450 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 --2- 172.21.15.90:0/2514131197 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa8bc0ab730 0x7fa8bc0c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:40.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 >> 172.21.15.90:0/2514131197 conn(0x7fa8bc0cbfe0 msgr2=0x7fa8bc0adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:40.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 shutdown_connections 2024-04-20T10:52:40.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:40.724+0000 7fa8c3831640 1 -- 172.21.15.90:0/2514131197 wait complete. 2024-04-20T10:52:40.736 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:52:40.877 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.027+0000 7f3cc4843640 1 Processor -- start 2024-04-20T10:52:41.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.028+0000 7f3cc4843640 1 -- start start 2024-04-20T10:52:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.028+0000 7f3cc4843640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00ab730 0x7f3cc01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.028+0000 7f3cc4843640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cc015a720 con 0x7f3cc0153ef0 2024-04-20T10:52:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.028+0000 7f3cc4843640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cc015ac80 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.028+0000 7f3cc4843640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc015a9a0 con 0x7f3cc00ab730 2024-04-20T10:52:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbe59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3cc0153ef0 0x7f3cc00c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57104/0 (socket says 172.21.15.90:57104) 2024-04-20T10:52:41.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbe59c640 1 -- 172.21.15.90:0/1748362587 learned_addr learned my addr 172.21.15.90:0/1748362587 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbdd9b640 1 --2- 172.21.15.90:0/1748362587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00ab730 0x7f3cc01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbd59a640 1 -- 172.21.15.90:0/1748362587 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489923994 0 0) 0x7f3cb0001110 con 0x7f3cc0153ef0 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbd59a640 1 -- 172.21.15.90:0/1748362587 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ca8003520 con 0x7f3cc0153ef0 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbd59a640 1 -- 172.21.15.90:0/1748362587 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509020913 0 0) 0x7f3cc015ac80 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbd59a640 1 -- 172.21.15.90:0/1748362587 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ca80048e0 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbdd9b640 1 -- 172.21.15.90:0/1748362587 >> v1:172.21.15.175:6789/0 conn(0x7f3cc00c9ee0 legacy=0x7f3cc0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbdd9b640 1 -- 172.21.15.90:0/1748362587 >> v1:172.21.15.90:6789/0 conn(0x7f3cc0153ef0 legacy=0x7f3cc00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.029+0000 7f3cbdd9b640 1 -- 172.21.15.90:0/1748362587 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc00c6a90 con 0x7f3cc00ab730 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.030+0000 7f3cbdd9b640 1 --2- 172.21.15.90:0/1748362587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00ab730 0x7f3cc01568c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40097d0 tx=0x7f3cb402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec0ccbc2c7fb31fc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.030+0000 7f3cbd59a640 1 -- 172.21.15.90:0/1748362587 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4031780 con 0x7f3cc00ab730 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.030+0000 7f3cbd59a640 1 -- 172.21.15.90:0/1748362587 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb4037070 con 0x7f3cc00ab730 2024-04-20T10:52:41.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.030+0000 7f3cbd59a640 1 -- 172.21.15.90:0/1748362587 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4031b40 con 0x7f3cc00ab730 2024-04-20T10:52:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.031+0000 7f3cc4843640 1 -- 172.21.15.90:0/1748362587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00ab730 msgr2=0x7f3cc01568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.031+0000 7f3cc4843640 1 --2- 172.21.15.90:0/1748362587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00ab730 0x7f3cc01568c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40097d0 tx=0x7f3cb402b820 comp rx=0 tx=0).stop 2024-04-20T10:52:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.031+0000 7f3cc4843640 1 -- 172.21.15.90:0/1748362587 shutdown_connections 2024-04-20T10:52:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.031+0000 7f3cc4843640 1 --2- 172.21.15.90:0/1748362587 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00ab730 0x7f3cc01568c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.031+0000 7f3cc4843640 1 -- 172.21.15.90:0/1748362587 >> 172.21.15.90:0/1748362587 conn(0x7f3cc00cbfe0 msgr2=0x7f3cc00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.031+0000 7f3cc4843640 1 -- 172.21.15.90:0/1748362587 shutdown_connections 2024-04-20T10:52:41.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.031+0000 7f3cc4843640 1 -- 172.21.15.90:0/1748362587 wait complete. 2024-04-20T10:52:41.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.032+0000 7f3cc4843640 1 Processor -- start 2024-04-20T10:52:41.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.032+0000 7f3cc4843640 1 -- start start 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cc4843640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cc00ab730 0x7f3cc01efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cc4843640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00c9ee0 0x7f3cc00c1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cc4843640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc0153ef0 0x7f3cc00c1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cc4843640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc00c9100 con 0x7f3cc00ab730 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cc4843640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3cc0157510 con 0x7f3cc0153ef0 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cc4843640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3cc00c9280 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbe59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cc00ab730 0x7f3cc01efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbdd9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00c9ee0 0x7f3cc00c1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbed9d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc0153ef0 0x7f3cc00c1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbdd9b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00c9ee0 0x7f3cc00c1800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:54516/0 (socket says 172.21.15.90:54516) 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbdd9b640 1 -- 172.21.15.90:0/612896779 learned_addr learned my addr 172.21.15.90:0/612896779 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbdd9b640 1 -- 172.21.15.90:0/612896779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc0153ef0 msgr2=0x7f3cc00c1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbdd9b640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc0153ef0 0x7f3cc00c1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.033+0000 7f3cbdd9b640 1 -- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cc00ab730 msgr2=0x7f3cc01efb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3cbdd9b640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cc00ab730 0x7f3cc01efb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3cbdd9b640 1 -- 172.21.15.90:0/612896779 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cc0156520 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3cbe59c640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cc00ab730 0x7f3cc01efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:41.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3cbdd9b640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00c9ee0 0x7f3cc00c1800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40098f0 tx=0x7f3cb40046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3caeffd640 1 -- 172.21.15.90:0/612896779 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4032610 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3caeffd640 1 -- 172.21.15.90:0/612896779 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3cb40327d0 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3caeffd640 1 -- 172.21.15.90:0/612896779 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb4032bc0 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cc0151360 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.034+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cc0151080 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.035+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cc0076150 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.036+0000 7f3caeffd640 1 -- 172.21.15.90:0/612896779 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3cb404c060 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.036+0000 7f3caeffd640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ca006c8f0 0x7f3ca006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.036+0000 7f3caeffd640 1 -- 172.21.15.90:0/612896779 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(28..28 src has 1..28) ==== 6723+0+0 (secure 0 0 0) 0x7f3cb40ad6f0 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.036+0000 7f3cbe59c640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ca006c8f0 0x7f3ca006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.037+0000 7f3cbe59c640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ca006c8f0 0x7f3ca006edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000f60 tx=0x7f3cb0007d50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:41.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.045+0000 7f3caeffd640 1 -- 172.21.15.90:0/612896779 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3cb4040070 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.274+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cc006d070 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.275+0000 7f3caeffd640 1 -- 172.21.15.90:0/612896779 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5693 (secure 0 0 0) 0x7f3cb402f050 con 0x7f3cc00c9ee0 2024-04-20T10:52:41.275 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:41.275 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:40.318100+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:50:52.992905+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"c","rank":0,"incarnation":8,"state":"up:active","state_seq":6,"addr":"172.21.15.90:6837/3822230008","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":3822230008},{"type":"v1","addr":"172.21.15.90:6837","nonce":3822230008}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":2}]} 2024-04-20T10:52:41.276 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 13 2024-04-20T10:52:41.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ca006c8f0 msgr2=0x7f3ca006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ca006c8f0 0x7f3ca006edb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0000f60 tx=0x7f3cb0007d50 comp rx=0 tx=0).stop 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00c9ee0 msgr2=0x7f3cc00c1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00c9ee0 0x7f3cc00c1800 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40098f0 tx=0x7f3cb40046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 shutdown_connections 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3ca006c8f0 0x7f3ca006edb0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3cc0153ef0 0x7f3cc00c1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3cc00c9ee0 0x7f3cc00c1800 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 --2- 172.21.15.90:0/612896779 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3cc00ab730 0x7f3cc01efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 >> 172.21.15.90:0/612896779 conn(0x7f3cc00cbfe0 msgr2=0x7f3cc00ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 shutdown_connections 2024-04-20T10:52:41.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.277+0000 7f3cc4843640 1 -- 172.21.15.90:0/612896779 wait complete. 2024-04-20T10:52:41.291 INFO:tasks.mds_thrash.fs.[a]:mds.d down, removed from mdsmap 2024-04-20T10:52:41.291 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-20T10:52:41.292 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:41.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.398+0000 7f9ea7f5f640 1 Processor -- start 2024-04-20T10:52:41.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.398+0000 7f9ea7f5f640 1 -- start start 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea7f5f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ea0153ef0 0x7f9ea00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea7f5f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ea00ab730 0x7f9ea01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea7f5f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ea015a720 con 0x7f9ea00c9ee0 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea7f5f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea015ac80 con 0x7f9ea00ab730 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea7f5f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9ea015a9a0 con 0x7f9ea0153ef0 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea64fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9ea00c9ee0 0x7f9ea0156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57112/0 (socket says 172.21.15.90:57112) 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea64fc640 1 -- 172.21.15.90:0/1830116902 learned_addr learned my addr 172.21.15.90:0/1830116902 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea54fa640 1 --2- 172.21.15.90:0/1830116902 >> v2:172.21.15.90:3300/0 conn(0x7f9ea00ab730 0x7f9ea01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.399+0000 7f9ea5cfb640 1 --2- 172.21.15.90:0/1830116902 >> v2:172.21.15.175:3300/0 conn(0x7f9ea0153ef0 0x7f9ea00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.400+0000 7f9ea54fa640 1 -- 172.21.15.90:0/1830116902 >> v2:172.21.15.175:3300/0 conn(0x7f9ea0153ef0 msgr2=0x7f9ea00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.400+0000 7f9ea54fa640 1 --2- 172.21.15.90:0/1830116902 >> v2:172.21.15.175:3300/0 conn(0x7f9ea0153ef0 0x7f9ea00c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.400+0000 7f9ea54fa640 1 -- 172.21.15.90:0/1830116902 >> v1:172.21.15.90:6789/0 conn(0x7f9ea00c9ee0 legacy=0x7f9ea0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.400+0000 7f9ea54fa640 1 -- 172.21.15.90:0/1830116902 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea00c6a90 con 0x7f9ea00ab730 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea54fa640 1 --2- 172.21.15.90:0/1830116902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01568c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00aec60 tx=0x7f9e9002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d58a79a197e245 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea4cf9640 1 -- 172.21.15.90:0/1830116902 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90038070 con 0x7f9ea00ab730 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea4cf9640 1 -- 172.21.15.90:0/1830116902 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e90031710 con 0x7f9ea00ab730 2024-04-20T10:52:41.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea4cf9640 1 -- 172.21.15.90:0/1830116902 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e90031ae0 con 0x7f9ea00ab730 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/1830116902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 msgr2=0x7f9ea01568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/1830116902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01568c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00aec60 tx=0x7f9e9002b7b0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/1830116902 shutdown_connections 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/1830116902 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01568c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/1830116902 >> v2:172.21.15.175:3300/0 conn(0x7f9ea0153ef0 0x7f9ea00c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.401+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/1830116902 >> 172.21.15.90:0/1830116902 conn(0x7f9ea00cbfe0 msgr2=0x7f9ea00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.402+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/1830116902 shutdown_connections 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.402+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/1830116902 wait complete. 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.403+0000 7f9ea7f5f640 1 Processor -- start 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.403+0000 7f9ea7f5f640 1 -- start start 2024-04-20T10:52:41.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.403+0000 7f9ea7f5f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01ecc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.403+0000 7f9ea7f5f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea00c9ee0 0x7f9ea01ed140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.403+0000 7f9ea7f5f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ea0153ef0 0x7f9ea0150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea7f5f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea00bf800 con 0x7f9ea00ab730 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea7f5f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea0157510 con 0x7f9ea00c9ee0 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea7f5f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea00c0fa0 con 0x7f9ea0153ef0 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01ecc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01ecc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49950/0 (socket says 172.21.15.90:49950) 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 -- 172.21.15.90:0/217000647 learned_addr learned my addr 172.21.15.90:0/217000647 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea54fa640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea00c9ee0 0x7f9ea01ed140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea64fc640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ea0153ef0 0x7f9ea0150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 -- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ea0153ef0 msgr2=0x7f9ea0150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ea0153ef0 0x7f9ea0150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 -- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea00c9ee0 msgr2=0x7f9ea01ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea00c9ee0 0x7f9ea01ed140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 -- 172.21.15.90:0/217000647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea01ed680 con 0x7f9ea00ab730 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea5cfb640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01ecc00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00e8a0 tx=0x7f9e9c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9e967fc640 1 -- 172.21.15.90:0/217000647 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c017070 con 0x7f9ea00ab730 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9e967fc640 1 -- 172.21.15.90:0/217000647 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e9c00c940 con 0x7f9ea00ab730 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea01e1d80 con 0x7f9ea00ab730 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.404+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea01e2340 con 0x7f9ea00ab730 2024-04-20T10:52:41.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.405+0000 7f9e967fc640 1 -- 172.21.15.90:0/217000647 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c00cd30 con 0x7f9ea00ab730 2024-04-20T10:52:41.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.406+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea00ac830 con 0x7f9ea00ab730 2024-04-20T10:52:41.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.407+0000 7f9e967fc640 1 -- 172.21.15.90:0/217000647 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e9c01a070 con 0x7f9ea00ab730 2024-04-20T10:52:41.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.407+0000 7f9e967fc640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e8406c8f0 0x7f9e8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:41.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.407+0000 7f9e967fc640 1 -- 172.21.15.90:0/217000647 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f9e9c08c150 con 0x7f9ea00ab730 2024-04-20T10:52:41.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.407+0000 7f9ea54fa640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e8406c8f0 0x7f9e8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:41.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.408+0000 7f9ea54fa640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e8406c8f0 0x7f9e8406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9e90035000 tx=0x7f9e90008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:41.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.415+0000 7f9e967fc640 1 -- 172.21.15.90:0/217000647 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9ea00ac830 con 0x7f9ea00ab730 2024-04-20T10:52:41.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.668+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ea00c99b0 con 0x7f9ea00ab730 2024-04-20T10:52:41.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.669+0000 7f9e967fc640 1 -- 172.21.15.90:0/217000647 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+4869 (secure 0 0 0) 0x7f9e9c0790e0 con 0x7f9ea00ab730 2024-04-20T10:52:41.669 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:41.669 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:40.349084+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:reconnect","state_seq":33,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:41.327615+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:52:41.669 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 15 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.671+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e8406c8f0 msgr2=0x7f9e8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.671+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e8406c8f0 0x7f9e8406edb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9e90035000 tx=0x7f9e90008030 comp rx=0 tx=0).stop 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.671+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 msgr2=0x7f9ea01ecc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.671+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01ecc00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00e8a0 tx=0x7f9e9c00ed60 comp rx=0 tx=0).stop 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 shutdown_connections 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e8406c8f0 0x7f9e8406edb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ea0153ef0 0x7f9ea0150a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ea00c9ee0 0x7f9ea01ed140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 --2- 172.21.15.90:0/217000647 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ea00ab730 0x7f9ea01ecc00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:41.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 >> 172.21.15.90:0/217000647 conn(0x7f9ea00cbfe0 msgr2=0x7f9ea00acf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:41.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 shutdown_connections 2024-04-20T10:52:41.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:41.672+0000 7f9ea7f5f640 1 -- 172.21.15.90:0/217000647 wait complete. 2024-04-20T10:52:41.686 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 15, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 14, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4284": { "addr": "172.21.15.90:6835/1834995897", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6834", "nonce": 1834995897, "type": "v2" }, { "addr": "172.21.15.90:6835", "nonce": 1834995897, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4284, "incarnation": 13, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:reconnect", "state_seq": 33 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:52:40.349084+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4284 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 15, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4282": { "addr": "172.21.15.175:6833/1855171726", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6832", "nonce": 1855171726, "type": "v2" }, { "addr": "172.21.15.175:6833", "nonce": 1855171726, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4282, "incarnation": 15, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:52:41.327615+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4282 } } } ], "standbys": [] } 2024-04-20T10:52:42.737 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:42.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.878+0000 7f77f838f640 1 Processor -- start 2024-04-20T10:52:42.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.878+0000 7f77f838f640 1 -- start start 2024-04-20T10:52:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.878+0000 7f77f838f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f77f00ab730 0x7f77f01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.878+0000 7f77f838f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.878+0000 7f77f838f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77f015a720 con 0x7f77f0153ef0 2024-04-20T10:52:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.878+0000 7f77f838f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f77f015ac80 con 0x7f77f00ab730 2024-04-20T10:52:42.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.878+0000 7f77f838f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f77f015a9a0 con 0x7f77f00c9ee0 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f592a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f77f00ab730 0x7f77f01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f592a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f77f00ab730 0x7f77f01568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49964/0 (socket says 172.21.15.90:49964) 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f592a640 1 -- 172.21.15.90:0/3410470112 learned_addr learned my addr 172.21.15.90:0/3410470112 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f692c640 1 --2- 172.21.15.90:0/3410470112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f592a640 1 -- 172.21.15.90:0/3410470112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 msgr2=0x7f77f0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f592a640 1 --2- 172.21.15.90:0/3410470112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f592a640 1 -- 172.21.15.90:0/3410470112 >> v1:172.21.15.90:6789/0 conn(0x7f77f0153ef0 legacy=0x7f77f00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f592a640 1 -- 172.21.15.90:0/3410470112 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f00c6a90 con 0x7f77f00ab730 2024-04-20T10:52:42.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.879+0000 7f77f692c640 1 --2- 172.21.15.90:0/3410470112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:52:42.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.880+0000 7f77f592a640 1 --2- 172.21.15.90:0/3410470112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00ab730 0x7f77f01568c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009870 tx=0x7f77e002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7012bfb0fd84b75e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:42.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.880+0000 7f77f5129640 1 -- 172.21.15.90:0/3410470112 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e00317c0 con 0x7f77f00ab730 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.880+0000 7f77f5129640 1 -- 172.21.15.90:0/3410470112 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e0037070 con 0x7f77f00ab730 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.880+0000 7f77f5129640 1 -- 172.21.15.90:0/3410470112 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0031b80 con 0x7f77f00ab730 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 -- 172.21.15.90:0/3410470112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00ab730 msgr2=0x7f77f01568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 --2- 172.21.15.90:0/3410470112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00ab730 0x7f77f01568c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f77e0009870 tx=0x7f77e002b860 comp rx=0 tx=0).stop 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 -- 172.21.15.90:0/3410470112 shutdown_connections 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 --2- 172.21.15.90:0/3410470112 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 --2- 172.21.15.90:0/3410470112 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f00ab730 0x7f77f01568c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 -- 172.21.15.90:0/3410470112 >> 172.21.15.90:0/3410470112 conn(0x7f77f00cbfe0 msgr2=0x7f77f00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 -- 172.21.15.90:0/3410470112 shutdown_connections 2024-04-20T10:52:42.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.881+0000 7f77f838f640 1 -- 172.21.15.90:0/3410470112 wait complete. 2024-04-20T10:52:42.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.882+0000 7f77f838f640 1 Processor -- start 2024-04-20T10:52:42.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.882+0000 7f77f838f640 1 -- start start 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f838f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00ab730 0x7f77f01ec7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f838f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f00c0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f838f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f0153ef0 0x7f77f00c2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f838f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f77f00c9280 con 0x7f77f0153ef0 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f838f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f77f00c9100 con 0x7f77f00ab730 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f838f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f77f00bf800 con 0x7f77f00c9ee0 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f692c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f0153ef0 0x7f77f00c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f692c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f0153ef0 0x7f77f00c2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49970/0 (socket says 172.21.15.90:49970) 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.883+0000 7f77f692c640 1 -- 172.21.15.90:0/1031245758 learned_addr learned my addr 172.21.15.90:0/1031245758 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f612b640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00ab730 0x7f77f01ec7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f592a640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f00c0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:42.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f692c640 1 -- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 msgr2=0x7f77f00c0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f692c640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f00c0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f692c640 1 -- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00ab730 msgr2=0x7f77f01ec7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f692c640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00ab730 0x7f77f01ec7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f692c640 1 -- 172.21.15.90:0/1031245758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f00c1270 con 0x7f77f0153ef0 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f692c640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f0153ef0 0x7f77f00c2360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f77e8007df0 tx=0x7f77e800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77e6ffd640 1 -- 172.21.15.90:0/1031245758 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e801a070 con 0x7f77f0153ef0 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77e6ffd640 1 -- 172.21.15.90:0/1031245758 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77e8003990 con 0x7f77f0153ef0 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f00bfc90 con 0x7f77f0153ef0 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77e6ffd640 1 -- 172.21.15.90:0/1031245758 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e8003d80 con 0x7f77f0153ef0 2024-04-20T10:52:42.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.884+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f00c0250 con 0x7f77f0153ef0 2024-04-20T10:52:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.886+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f0076150 con 0x7f77f0153ef0 2024-04-20T10:52:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.886+0000 7f77e6ffd640 1 -- 172.21.15.90:0/1031245758 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77e801d070 con 0x7f77f0153ef0 2024-04-20T10:52:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.887+0000 7f77e6ffd640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77d406c920 0x7f77d406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.887+0000 7f77e6ffd640 1 -- 172.21.15.90:0/1031245758 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f77e808c140 con 0x7f77f0153ef0 2024-04-20T10:52:42.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.887+0000 7f77f612b640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77d406c920 0x7f77d406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:42.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.888+0000 7f77f612b640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77d406c920 0x7f77d406ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f77ec000f60 tx=0x7f77ec009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:42.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:42.895+0000 7f77e6ffd640 1 -- 172.21.15.90:0/1031245758 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f77e8010070 con 0x7f77f0153ef0 2024-04-20T10:52:43.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.118+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77f0152730 con 0x7f77f0153ef0 2024-04-20T10:52:43.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.118+0000 7f77e6ffd640 1 -- 172.21.15.90:0/1031245758 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+4870 (secure 0 0 0) 0x7f77e8010070 con 0x7f77f0153ef0 2024-04-20T10:52:43.119 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:43.119 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:41.336531+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:rejoin","state_seq":34,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:41.356251+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:reconnect","state_seq":34,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:52:43.119 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 16 2024-04-20T10:52:43.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77d406c920 msgr2=0x7f77d406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77d406c920 0x7f77d406ede0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f77ec000f60 tx=0x7f77ec009040 comp rx=0 tx=0).stop 2024-04-20T10:52:43.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f0153ef0 msgr2=0x7f77f00c2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f0153ef0 0x7f77f00c2360 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f77e8007df0 tx=0x7f77e800d4a0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 shutdown_connections 2024-04-20T10:52:43.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f77d406c920 0x7f77d406ede0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f77f0153ef0 0x7f77f00c2360 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f77f00c9ee0 0x7f77f00c0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 --2- 172.21.15.90:0/1031245758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f77f00ab730 0x7f77f01ec7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 >> 172.21.15.90:0/1031245758 conn(0x7f77f00cbfe0 msgr2=0x7f77f00ae440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:43.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 shutdown_connections 2024-04-20T10:52:43.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.121+0000 7f77f838f640 1 -- 172.21.15.90:0/1031245758 wait complete. 2024-04-20T10:52:43.136 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-04-20T10:52:43.136 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-20T10:52:43.136 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:43.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.236+0000 7f59e0e06640 1 Processor -- start 2024-04-20T10:52:43.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.236+0000 7f59e0e06640 1 -- start start 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59e0e06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0ab730 0x7f59dc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59e0e06640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc15a720 con 0x7f59dc153ef0 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59e0e06640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59dc15ac80 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59e0e06640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc15a9a0 con 0x7f59dc0ab730 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59da59c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f59dc153ef0 0x7f59dc0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57130/0 (socket says 172.21.15.90:57130) 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59da59c640 1 -- 172.21.15.90:0/3013342434 learned_addr learned my addr 172.21.15.90:0/3013342434 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59d9d9b640 1 --2- 172.21.15.90:0/3013342434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0ab730 0x7f59dc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59d959a640 1 -- 172.21.15.90:0/3013342434 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3944181480 0 0) 0x7f59cc001110 con 0x7f59dc153ef0 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59d959a640 1 -- 172.21.15.90:0/3013342434 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c4003520 con 0x7f59dc153ef0 2024-04-20T10:52:43.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59d959a640 1 -- 172.21.15.90:0/3013342434 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868507776 0 0) 0x7f59dc15ac80 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.237+0000 7f59d959a640 1 -- 172.21.15.90:0/3013342434 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59cc001110 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.238+0000 7f59d9d9b640 1 -- 172.21.15.90:0/3013342434 >> v1:172.21.15.175:6789/0 conn(0x7f59dc0c9ee0 legacy=0x7f59dc156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.238+0000 7f59d9d9b640 1 -- 172.21.15.90:0/3013342434 >> v1:172.21.15.90:6789/0 conn(0x7f59dc153ef0 legacy=0x7f59dc0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.238+0000 7f59d9d9b640 1 -- 172.21.15.90:0/3013342434 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0c6a90 con 0x7f59dc0ab730 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.238+0000 7f59d9d9b640 1 --2- 172.21.15.90:0/3013342434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0ab730 0x7f59dc1568c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59d00097d0 tx=0x7f59d002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ff2ffc0951e1337 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59d959a640 1 -- 172.21.15.90:0/3013342434 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0031770 con 0x7f59dc0ab730 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59d959a640 1 -- 172.21.15.90:0/3013342434 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d0037070 con 0x7f59dc0ab730 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59d959a640 1 -- 172.21.15.90:0/3013342434 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0031b10 con 0x7f59dc0ab730 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59e0e06640 1 -- 172.21.15.90:0/3013342434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0ab730 msgr2=0x7f59dc1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59e0e06640 1 --2- 172.21.15.90:0/3013342434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0ab730 0x7f59dc1568c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59d00097d0 tx=0x7f59d002b810 comp rx=0 tx=0).stop 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59e0e06640 1 -- 172.21.15.90:0/3013342434 shutdown_connections 2024-04-20T10:52:43.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59e0e06640 1 --2- 172.21.15.90:0/3013342434 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc0ab730 0x7f59dc1568c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59e0e06640 1 -- 172.21.15.90:0/3013342434 >> 172.21.15.90:0/3013342434 conn(0x7f59dc0cbfe0 msgr2=0x7f59dc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:43.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59e0e06640 1 -- 172.21.15.90:0/3013342434 shutdown_connections 2024-04-20T10:52:43.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.239+0000 7f59e0e06640 1 -- 172.21.15.90:0/3013342434 wait complete. 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 Processor -- start 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 -- start start 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc0ab730 0x7f59dc1ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59dc0c9ee0 0x7f59dc0c5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc153ef0 0x7f59dc1ef960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc0c9100 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59dc157510 con 0x7f59dc0ab730 2024-04-20T10:52:43.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59e0e06640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59dc0c9280 con 0x7f59dc153ef0 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59d9d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59dc0c9ee0 0x7f59dc0c5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59da59c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc0ab730 0x7f59dc1ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59d9d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59dc0c9ee0 0x7f59dc0c5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49984/0 (socket says 172.21.15.90:49984) 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59d9d9b640 1 -- 172.21.15.90:0/2561741221 learned_addr learned my addr 172.21.15.90:0/2561741221 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.241+0000 7f59dad9d640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc153ef0 0x7f59dc1ef960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59d9d9b640 1 -- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc153ef0 msgr2=0x7f59dc1ef960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59d9d9b640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc153ef0 0x7f59dc1ef960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59d9d9b640 1 -- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc0ab730 msgr2=0x7f59dc1ea160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59d9d9b640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc0ab730 0x7f59dc1ea160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59d9d9b640 1 -- 172.21.15.90:0/2561741221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59dc0c60c0 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59da59c640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc0ab730 0x7f59dc1ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59d9d9b640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59dc0c9ee0 0x7f59dc0c5310 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f59d0034040 tx=0x7f59d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59caffd640 1 -- 172.21.15.90:0/2561741221 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0032600 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59caffd640 1 -- 172.21.15.90:0/2561741221 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d00327a0 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59dc0c4830 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59caffd640 1 -- 172.21.15.90:0/2561741221 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0032b70 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.242+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59dc0c5850 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.243+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59dc0c4620 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.244+0000 7f59caffd640 1 -- 172.21.15.90:0/2561741221 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59d0031070 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.244+0000 7f59caffd640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59bc06c920 0x7f59bc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.244+0000 7f59caffd640 1 -- 172.21.15.90:0/2561741221 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f59d00ad470 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.244+0000 7f59da59c640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59bc06c920 0x7f59bc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.245+0000 7f59da59c640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59bc06c920 0x7f59bc06ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000f60 tx=0x7f59cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:43.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.248+0000 7f59caffd640 1 -- 172.21.15.90:0/2561741221 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f59d0040070 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.473+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59dc076150 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.474+0000 7f59caffd640 1 -- 172.21.15.90:0/2561741221 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+4874 (secure 0 0 0) 0x7f59d007ae00 con 0x7f59dc0c9ee0 2024-04-20T10:52:43.474 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:43.474 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:42.340481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":35,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:52:43.474 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 17 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59bc06c920 msgr2=0x7f59bc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59bc06c920 0x7f59bc06ede0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f59cc000f60 tx=0x7f59cc009040 comp rx=0 tx=0).stop 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59dc0c9ee0 msgr2=0x7f59dc0c5310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59dc0c9ee0 0x7f59dc0c5310 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f59d0034040 tx=0x7f59d00046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 shutdown_connections 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59bc06c920 0x7f59bc06ede0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59dc153ef0 0x7f59dc1ef960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59dc0c9ee0 0x7f59dc0c5310 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 --2- 172.21.15.90:0/2561741221 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59dc0ab730 0x7f59dc1ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.476+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 >> 172.21.15.90:0/2561741221 conn(0x7f59dc0cbfe0 msgr2=0x7f59dc155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:43.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.477+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 shutdown_connections 2024-04-20T10:52:43.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.477+0000 7f59e0e06640 1 -- 172.21.15.90:0/2561741221 wait complete. 2024-04-20T10:52:43.491 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 17, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_4284": { "addr": "172.21.15.90:6835/1834995897", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6834", "nonce": 1834995897, "type": "v2" }, { "addr": "172.21.15.90:6835", "nonce": 1834995897, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4284, "incarnation": 13, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 35 } }, "last_failure": 0, "last_failure_osd_epoch": 28, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:52:43.335559+0000", "qdb_cluster": [ 4284 ], "qdb_leader": 4284, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4284 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 17, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4282": { "addr": "172.21.15.175:6833/1855171726", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6832", "nonce": 1855171726, "type": "v2" }, { "addr": "172.21.15.175:6833", "nonce": 1855171726, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4282, "incarnation": 15, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:rejoin", "state_seq": 35 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:52:42.340481+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4282 } } } ], "standbys": [] } 2024-04-20T10:52:43.687 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:43.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.839+0000 7ff34c3b2640 1 Processor -- start 2024-04-20T10:52:43.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.840+0000 7ff34c3b2640 1 -- start start 2024-04-20T10:52:43.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34c3b2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff3440ab730 0x7ff3441568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34c3b2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34415a720 con 0x7ff3440c9ee0 2024-04-20T10:52:43.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34c3b2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34415ac80 con 0x7ff344153ef0 2024-04-20T10:52:43.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34c3b2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff34415a9a0 con 0x7ff3440ab730 2024-04-20T10:52:43.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34a94f640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff3440c9ee0 0x7ff344156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:57132/0 (socket says 172.21.15.90:57132) 2024-04-20T10:52:43.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34a94f640 1 -- 172.21.15.90:0/3463790321 learned_addr learned my addr 172.21.15.90:0/3463790321 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34994d640 1 --2- 172.21.15.90:0/3463790321 >> v2:172.21.15.90:3300/0 conn(0x7ff3440ab730 0x7ff3441568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34914c640 1 -- 172.21.15.90:0/3463790321 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2040964752 0 0) 0x7ff33c001490 con 0x7ff3440c9ee0 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34914c640 1 -- 172.21.15.90:0/3463790321 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff330003520 con 0x7ff3440c9ee0 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.841+0000 7ff34994d640 1 -- 172.21.15.90:0/3463790321 >> v1:172.21.15.175:6789/0 conn(0x7ff344153ef0 legacy=0x7ff3440c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.842+0000 7ff34914c640 1 -- 172.21.15.90:0/3463790321 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4045429978 0 0) 0x7ff330003520 con 0x7ff3440c9ee0 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.842+0000 7ff34994d640 1 -- 172.21.15.90:0/3463790321 >> v1:172.21.15.90:6789/0 conn(0x7ff3440c9ee0 legacy=0x7ff344156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.842+0000 7ff34994d640 1 -- 172.21.15.90:0/3463790321 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3440c6a90 con 0x7ff3440ab730 2024-04-20T10:52:43.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.843+0000 7ff34994d640 1 --2- 172.21.15.90:0/3463790321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440ab730 0x7ff3441568c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff3340097a0 tx=0x7ff33402b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c5247e16aab815 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:43.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.843+0000 7ff34914c640 1 -- 172.21.15.90:0/3463790321 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334037070 con 0x7ff3440ab730 2024-04-20T10:52:43.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.843+0000 7ff34914c640 1 -- 172.21.15.90:0/3463790321 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff334030510 con 0x7ff3440ab730 2024-04-20T10:52:43.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.843+0000 7ff34914c640 1 -- 172.21.15.90:0/3463790321 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c001bc0 con 0x7ff3440ab730 2024-04-20T10:52:43.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.844+0000 7ff34c3b2640 1 -- 172.21.15.90:0/3463790321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440ab730 msgr2=0x7ff3441568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.844+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/3463790321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440ab730 0x7ff3441568c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ff3340097a0 tx=0x7ff33402b680 comp rx=0 tx=0).stop 2024-04-20T10:52:43.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.844+0000 7ff34c3b2640 1 -- 172.21.15.90:0/3463790321 shutdown_connections 2024-04-20T10:52:43.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.845+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/3463790321 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440ab730 0x7ff3441568c0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.845+0000 7ff34c3b2640 1 -- 172.21.15.90:0/3463790321 >> 172.21.15.90:0/3463790321 conn(0x7ff3440cbfe0 msgr2=0x7ff3440cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:43.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.845+0000 7ff34c3b2640 1 -- 172.21.15.90:0/3463790321 shutdown_connections 2024-04-20T10:52:43.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.845+0000 7ff34c3b2640 1 -- 172.21.15.90:0/3463790321 wait complete. 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.846+0000 7ff34c3b2640 1 Processor -- start 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.846+0000 7ff34c3b2640 1 -- start start 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.847+0000 7ff34c3b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3440ab730 0x7ff3440b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.847+0000 7ff34c3b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440c9ee0 0x7ff344158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.847+0000 7ff34c3b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff344153ef0 0x7ff3441ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34c3b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3440c9100 con 0x7ff3440c9ee0 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34c3b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff344157510 con 0x7ff344153ef0 2024-04-20T10:52:43.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34c3b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff3440c9280 con 0x7ff3440ab730 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff344153ef0 0x7ff3441ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a14e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3440ab730 0x7ff3440b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34994d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440c9ee0 0x7ff344158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff344153ef0 0x7ff3441ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:46160/0 (socket says 172.21.15.90:46160) 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 -- 172.21.15.90:0/4255476445 learned_addr learned my addr 172.21.15.90:0/4255476445 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 -- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3440ab730 msgr2=0x7ff3440b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3440ab730 0x7ff3440b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 -- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440c9ee0 msgr2=0x7ff344158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440c9ee0 0x7ff344158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a94f640 1 -- 172.21.15.90:0/4255476445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3441f0580 con 0x7ff344153ef0 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34994d640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440c9ee0 0x7ff344158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.848+0000 7ff34a14e640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3440ab730 0x7ff3440b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.849+0000 7ff34a94f640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff344153ef0 0x7ff3441ecff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff33c001a60 tx=0x7ff33c00a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.849+0000 7ff33affd640 1 -- 172.21.15.90:0/4255476445 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c012400 con 0x7ff344153ef0 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.849+0000 7ff33affd640 1 -- 172.21.15.90:0/4255476445 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33c0125c0 con 0x7ff344153ef0 2024-04-20T10:52:43.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.849+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3441f0820 con 0x7ff344153ef0 2024-04-20T10:52:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.849+0000 7ff33affd640 1 -- 172.21.15.90:0/4255476445 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0129b0 con 0x7ff344153ef0 2024-04-20T10:52:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.849+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3440b0b20 con 0x7ff344153ef0 2024-04-20T10:52:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.851+0000 7ff33affd640 1 -- 172.21.15.90:0/4255476445 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff33c012b50 con 0x7ff344153ef0 2024-04-20T10:52:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.851+0000 7ff33affd640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff32806c920 0x7ff32806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.852+0000 7ff33affd640 1 -- 172.21.15.90:0/4255476445 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7ff33c08c680 con 0x7ff344153ef0 2024-04-20T10:52:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.852+0000 7ff34a14e640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff32806c920 0x7ff32806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:43.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.852+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff344076150 con 0x7ff344153ef0 2024-04-20T10:52:43.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.852+0000 7ff34a14e640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff32806c920 0x7ff32806ede0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3440c2e50 tx=0x7ff340007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:43.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:43.857+0000 7ff33affd640 1 -- 172.21.15.90:0/4255476445 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff34415a720 con 0x7ff344153ef0 2024-04-20T10:52:44.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.256+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3440cc6a0 con 0x7ff344153ef0 2024-04-20T10:52:44.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.256+0000 7ff33affd640 1 -- 172.21.15.90:0/4255476445 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+4874 (secure 0 0 0) 0x7ff33c05a0a0 con 0x7ff344153ef0 2024-04-20T10:52:44.257 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:44.257 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:42.340481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:rejoin","state_seq":35,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:52:44.257 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 17 2024-04-20T10:52:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.258+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff32806c920 msgr2=0x7ff32806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.258+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff32806c920 0x7ff32806ede0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff3440c2e50 tx=0x7ff340007e30 comp rx=0 tx=0).stop 2024-04-20T10:52:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.258+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff344153ef0 msgr2=0x7ff3441ecff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.258+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff344153ef0 0x7ff3441ecff0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff33c001a60 tx=0x7ff33c00a430 comp rx=0 tx=0).stop 2024-04-20T10:52:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 shutdown_connections 2024-04-20T10:52:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff32806c920 0x7ff32806ede0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:44.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff344153ef0 0x7ff3441ecff0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3440c9ee0 0x7ff344158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 --2- 172.21.15.90:0/4255476445 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3440ab730 0x7ff3440b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 >> 172.21.15.90:0/4255476445 conn(0x7ff3440cbfe0 msgr2=0x7ff3441530f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 shutdown_connections 2024-04-20T10:52:44.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:44.259+0000 7ff34c3b2640 1 -- 172.21.15.90:0/4255476445 wait complete. 2024-04-20T10:52:44.273 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=4299 2024-04-20T10:52:44.273 INFO:tasks.mds_thrash.fs.[a]:waiting for 6 secs before reviving mds.d 2024-04-20T10:52:45.492 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:45.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.591+0000 7f6957ace640 1 Processor -- start 2024-04-20T10:52:45.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.591+0000 7f6957ace640 1 -- start start 2024-04-20T10:52:45.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f6957ace640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6950150c00 0x7f6950153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:45.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f6957ace640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f695006ca40 0x7f69500c3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:45.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f6957ace640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6950071fa0 con 0x7f695006f330 2024-04-20T10:52:45.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f6957ace640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6950153500 con 0x7f695006ca40 2024-04-20T10:52:45.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f6957ace640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f695006ced0 con 0x7f6950150c00 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f6955069640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f695006ca40 0x7f69500c3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f695606b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f695006f330 0x7f695006d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55274/0 (socket says 172.21.15.90:55274) 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f695606b640 1 -- 172.21.15.90:0/3163425378 learned_addr learned my addr 172.21.15.90:0/3163425378 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.592+0000 7f695586a640 1 --2- 172.21.15.90:0/3163425378 >> v2:172.21.15.175:3300/0 conn(0x7f6950150c00 0x7f6950153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.593+0000 7f6955069640 1 -- 172.21.15.90:0/3163425378 >> v2:172.21.15.175:3300/0 conn(0x7f6950150c00 msgr2=0x7f6950153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.593+0000 7f6955069640 1 --2- 172.21.15.90:0/3163425378 >> v2:172.21.15.175:3300/0 conn(0x7f6950150c00 0x7f6950153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.593+0000 7f6955069640 1 -- 172.21.15.90:0/3163425378 >> v1:172.21.15.90:6789/0 conn(0x7f695006f330 legacy=0x7f695006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.593+0000 7f6954868640 1 -- 172.21.15.90:0/3163425378 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940029044 0 0) 0x7f6950071fa0 con 0x7f695006f330 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.593+0000 7f6955069640 1 -- 172.21.15.90:0/3163425378 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69501537a0 con 0x7f695006ca40 2024-04-20T10:52:45.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.593+0000 7f695586a640 1 --2- 172.21.15.90:0/3163425378 >> v2:172.21.15.175:3300/0 conn(0x7f6950150c00 0x7f6950153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:52:45.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.594+0000 7f6955069640 1 --2- 172.21.15.90:0/3163425378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006ca40 0x7f69500c3b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6950071a60 tx=0x7f694002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f3b0e227f4e81a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.594+0000 7f6954868640 1 -- 172.21.15.90:0/3163425378 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940035020 con 0x7f695006ca40 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.594+0000 7f6954868640 1 -- 172.21.15.90:0/3163425378 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6940031830 con 0x7f695006ca40 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.594+0000 7f6954868640 1 -- 172.21.15.90:0/3163425378 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940031c00 con 0x7f695006ca40 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.595+0000 7f6957ace640 1 -- 172.21.15.90:0/3163425378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006ca40 msgr2=0x7f69500c3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.595+0000 7f6957ace640 1 --2- 172.21.15.90:0/3163425378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006ca40 0x7f69500c3b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6950071a60 tx=0x7f694002b8d0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.595+0000 7f6957ace640 1 -- 172.21.15.90:0/3163425378 shutdown_connections 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.595+0000 7f6957ace640 1 --2- 172.21.15.90:0/3163425378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006ca40 0x7f69500c3b00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.595+0000 7f6957ace640 1 --2- 172.21.15.90:0/3163425378 >> v2:172.21.15.175:3300/0 conn(0x7f6950150c00 0x7f6950153fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.595+0000 7f6957ace640 1 -- 172.21.15.90:0/3163425378 >> 172.21.15.90:0/3163425378 conn(0x7f69500c9100 msgr2=0x7f69500c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.595+0000 7f6957ace640 1 -- 172.21.15.90:0/3163425378 shutdown_connections 2024-04-20T10:52:45.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.596+0000 7f6957ace640 1 -- 172.21.15.90:0/3163425378 wait complete. 2024-04-20T10:52:45.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.597+0000 7f6957ace640 1 Processor -- start 2024-04-20T10:52:45.597 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.597+0000 7f6957ace640 1 -- start start 2024-04-20T10:52:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.598+0000 7f6957ace640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006f330 0x7f69500ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.598+0000 7f6957ace640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6950150c00 0x7f6950154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.598+0000 7f6957ace640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69501574f0 0x7f6950143ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.598+0000 7f6957ace640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f695006db60 con 0x7f695006f330 2024-04-20T10:52:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.598+0000 7f6957ace640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f695006d1b0 con 0x7f69501574f0 2024-04-20T10:52:45.600 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.598+0000 7f6957ace640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f695006dce0 con 0x7f6950150c00 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006f330 0x7f69500ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006f330 0x7f69500ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43188/0 (socket says 172.21.15.90:43188) 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 -- 172.21.15.90:0/870075055 learned_addr learned my addr 172.21.15.90:0/870075055 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f6955069640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6950150c00 0x7f6950154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695606b640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69501574f0 0x7f6950143ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 -- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6950150c00 msgr2=0x7f6950154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6950150c00 0x7f6950154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 -- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69501574f0 msgr2=0x7f6950143ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69501574f0 0x7f6950143ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 -- 172.21.15.90:0/870075055 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69501449f0 con 0x7f695006f330 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f695586a640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006f330 0x7f69500ac1b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e960 tx=0x7f694c00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f69467fc640 1 -- 172.21.15.90:0/870075055 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c017070 con 0x7f695006f330 2024-04-20T10:52:45.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f69467fc640 1 -- 172.21.15.90:0/870075055 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f694c00c9a0 con 0x7f695006f330 2024-04-20T10:52:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f69467fc640 1 -- 172.21.15.90:0/870075055 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c00cd70 con 0x7f695006f330 2024-04-20T10:52:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69501ed880 con 0x7f695006f330 2024-04-20T10:52:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.599+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69501ede40 con 0x7f695006f330 2024-04-20T10:52:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.601+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6950076150 con 0x7f695006f330 2024-04-20T10:52:45.602 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.602+0000 7f69467fc640 1 -- 172.21.15.90:0/870075055 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f694c01a070 con 0x7f695006f330 2024-04-20T10:52:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.603+0000 7f69467fc640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f693406c8f0 0x7f693406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.603+0000 7f69467fc640 1 -- 172.21.15.90:0/870075055 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f694c08c430 con 0x7f695006f330 2024-04-20T10:52:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.603+0000 7f6955069640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f693406c8f0 0x7f693406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:45.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.604+0000 7f6955069640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f693406c8f0 0x7f693406edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6940036000 tx=0x7f694003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:45.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.606+0000 7f69467fc640 1 -- 172.21.15.90:0/870075055 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f694c059f30 con 0x7f695006f330 2024-04-20T10:52:45.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.887+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6950072170 con 0x7f695006f330 2024-04-20T10:52:45.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.887+0000 7f69467fc640 1 -- 172.21.15.90:0/870075055 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4881 (secure 0 0 0) 0x7f694c05e230 con 0x7f695006f330 2024-04-20T10:52:45.888 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:45.888 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:52:45.888 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 18 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.889+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f693406c8f0 msgr2=0x7f693406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.889+0000 7f6957ace640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f693406c8f0 0x7f693406edb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6940036000 tx=0x7f694003d040 comp rx=0 tx=0).stop 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.889+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006f330 msgr2=0x7f69500ac1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.889+0000 7f6957ace640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006f330 0x7f69500ac1b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f694c00e960 tx=0x7f694c00ee20 comp rx=0 tx=0).stop 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 shutdown_connections 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f693406c8f0 0x7f693406edb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f69501574f0 0x7f6950143ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6950150c00 0x7f6950154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 --2- 172.21.15.90:0/870075055 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f695006f330 0x7f69500ac1b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:45.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 >> 172.21.15.90:0/870075055 conn(0x7f69500c9100 msgr2=0x7f695014dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:45.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 shutdown_connections 2024-04-20T10:52:45.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:45.890+0000 7f6957ace640 1 -- 172.21.15.90:0/870075055 wait complete. 2024-04-20T10:52:45.902 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=4287 2024-04-20T10:52:45.902 INFO:tasks.mds_thrash.fs.[b]:waiting for 6 secs before reviving mds.c 2024-04-20T10:52:47.215 INFO:tasks.workunit.client.1.smithi175.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-20T10:52:47.215 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr:state without impacting any branches by switching back to a branch. 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr: git switch -c 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr:Or undo this operation with: 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr: git switch - 2024-04-20T10:52:47.216 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-20T10:52:47.217 INFO:tasks.workunit.client.1.smithi175.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-20T10:52:47.217 INFO:tasks.workunit.client.1.smithi175.stderr: 2024-04-20T10:52:47.217 INFO:tasks.workunit.client.1.smithi175.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-20T10:52:47.221 DEBUG:teuthology.orchestra.run.smithi175:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-04-20T10:52:47.283 INFO:tasks.workunit.client.1.smithi175.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-20T10:52:47.283 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-20T10:52:47.283 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-20T10:52:47.825 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-20T10:52:47.881 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-20T10:52:47.929 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-04-20T10:52:47.931 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-20T10:52:47.931 INFO:tasks.workunit.client.1.smithi175.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-20T10:52:47.969 INFO:tasks.workunit.client.1.smithi175.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-04-20T10:52:47.972 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:52:47.972 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-04-20T10:52:47.987 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-04-20T10:52:47.988 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-20T10:52:47.988 DEBUG:teuthology.orchestra.run.smithi175:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-04-20T10:52:48.046 INFO:tasks.workunit.client.1.smithi175.stderr:+ mkdir -p fsstress 2024-04-20T10:52:48.048 INFO:tasks.workunit.client.1.smithi175.stderr:+ pushd fsstress 2024-04-20T10:52:48.048 INFO:tasks.workunit.client.1.smithi175.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-20T10:52:48.048 INFO:tasks.workunit.client.1.smithi175.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-20T10:52:48.688 INFO:tasks.workunit.client.1.smithi175.stderr:+ tar xzf ltp-full.tgz 2024-04-20T10:52:49.216 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-20T10:52:49.216+0000 7f0e450aa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:52:49.258 INFO:tasks.workunit.client.0.smithi090.stderr:Note: switching to 'a8c84f5997950fd7d008204839253291d52e6eda'. 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:state without impacting any branches by switching back to a branch. 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: git switch -c 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr:Or undo this operation with: 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: git switch - 2024-04-20T10:52:49.259 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-04-20T10:52:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-20T10:52:49.260 INFO:tasks.workunit.client.0.smithi090.stderr: 2024-04-20T10:52:49.260 INFO:tasks.workunit.client.0.smithi090.stderr:HEAD is now at a8c84f59979 Merge PR #51659 into wip-rishabh-testing-20240416.193735 2024-04-20T10:52:49.264 DEBUG:teuthology.orchestra.run.smithi090:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-20T10:52:49.299 INFO:tasks.workunit.client.0.smithi090.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-20T10:52:49.301 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-20T10:52:49.301 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-20T10:52:49.912 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-20T10:52:49.993 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-20T10:52:50.032 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-20T10:52:50.034 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-20T10:52:50.034 INFO:tasks.workunit.client.0.smithi090.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-20T10:52:50.072 INFO:tasks.workunit.client.0.smithi090.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-20T10:52:50.075 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:52:50.076 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-20T10:52:50.131 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-20T10:52:50.132 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-20T10:52:50.133 DEBUG:teuthology.orchestra.run.smithi090:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a8c84f5997950fd7d008204839253291d52e6eda TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-20T10:52:50.191 INFO:tasks.workunit.client.0.smithi090.stderr:+ mkdir -p fsstress 2024-04-20T10:52:50.193 INFO:tasks.workunit.client.0.smithi090.stderr:+ pushd fsstress 2024-04-20T10:52:50.193 INFO:tasks.workunit.client.0.smithi090.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-20T10:52:50.193 INFO:tasks.workunit.client.0.smithi090.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-20T10:52:50.274 INFO:tasks.mds_thrash.fs.[a]:reviving mds.d 2024-04-20T10:52:50.274 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-20T10:52:50.274 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-20T10:52:50.277 INFO:tasks.ceph.mds.d:Started 2024-04-20T10:52:50.277 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:50.360 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-04-20T10:52:50.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.375+0000 7f78405e6640 1 Processor -- start 2024-04-20T10:52:50.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.375+0000 7f78405e6640 1 -- start start 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f78405e6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78380c34d0 0x7f78380c38b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f78405e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f78405e6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78380ac570 0x7f78380aca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f78405e6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f78380725f0 con 0x7f78380ac570 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f78405e6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f78380c57e0 con 0x7f78380c34d0 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f78405e6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78380c44f0 con 0x7f78380ab4a0 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f783eb83640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78380ac570 0x7f78380aca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f783eb83640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78380ac570 0x7f78380aca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43192/0 (socket says 172.21.15.90:43192) 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.376+0000 7f783eb83640 1 -- 172.21.15.90:0/1357802418 learned_addr learned my addr 172.21.15.90:0/1357802418 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783e382640 1 --2- 172.21.15.90:0/1357802418 >> v2:172.21.15.175:3300/0 conn(0x7f78380c34d0 0x7f78380c38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783db81640 1 --2- 172.21.15.90:0/1357802418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:50.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783eb83640 1 -- 172.21.15.90:0/1357802418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 msgr2=0x7f7838157110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783eb83640 1 --2- 172.21.15.90:0/1357802418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838157110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783eb83640 1 -- 172.21.15.90:0/1357802418 >> v2:172.21.15.175:3300/0 conn(0x7f78380c34d0 msgr2=0x7f78380c38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783eb83640 1 --2- 172.21.15.90:0/1357802418 >> v2:172.21.15.175:3300/0 conn(0x7f78380c34d0 0x7f78380c38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783eb83640 1 -- 172.21.15.90:0/1357802418 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78380c4bd0 con 0x7f78380ac570 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783db81640 1 --2- 172.21.15.90:0/1357802418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783e382640 1 --2- 172.21.15.90:0/1357802418 >> v2:172.21.15.175:3300/0 conn(0x7f78380c34d0 0x7f78380c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.377+0000 7f783eb83640 1 --2- 172.21.15.90:0/1357802418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f78380aca20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7838073a70 tx=0x7f783002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bf4465314bcd08 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f783d380640 1 -- 172.21.15.90:0/1357802418 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f783002e070 con 0x7f78380ac570 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f783d380640 1 -- 172.21.15.90:0/1357802418 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7830037070 con 0x7f78380ac570 2024-04-20T10:52:50.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f783d380640 1 -- 172.21.15.90:0/1357802418 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7830031a00 con 0x7f78380ac570 2024-04-20T10:52:50.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 -- 172.21.15.90:0/1357802418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 msgr2=0x7f78380aca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 --2- 172.21.15.90:0/1357802418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f78380aca20 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f7838073a70 tx=0x7f783002b880 comp rx=0 tx=0).stop 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 -- 172.21.15.90:0/1357802418 shutdown_connections 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 --2- 172.21.15.90:0/1357802418 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f78380aca20 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 --2- 172.21.15.90:0/1357802418 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838157110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 --2- 172.21.15.90:0/1357802418 >> v2:172.21.15.175:3300/0 conn(0x7f78380c34d0 0x7f78380c38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 -- 172.21.15.90:0/1357802418 >> 172.21.15.90:0/1357802418 conn(0x7f78380ca0a0 msgr2=0x7f78380ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 -- 172.21.15.90:0/1357802418 shutdown_connections 2024-04-20T10:52:50.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.378+0000 7f78405e6640 1 -- 172.21.15.90:0/1357802418 wait complete. 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.379+0000 7f78405e6640 1 Processor -- start 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.379+0000 7f78405e6640 1 -- start start 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f78405e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838070960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f78405e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f7838155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f78405e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78380c34d0 0x7f783814f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f78405e6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78380c5470 con 0x7f78380ac570 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f78405e6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78380c5190 con 0x7f78380c34d0 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f78405e6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78380acf60 con 0x7f78380ab4a0 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783db81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f7838155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783db81640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f7838155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43198/0 (socket says 172.21.15.90:43198) 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783db81640 1 -- 172.21.15.90:0/469067642 learned_addr learned my addr 172.21.15.90:0/469067642 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783db81640 1 -- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 msgr2=0x7f7838070960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783e382640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838070960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:50.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783eb83640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78380c34d0 0x7f783814f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783db81640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838070960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783db81640 1 -- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78380c34d0 msgr2=0x7f783814f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.380+0000 7f783db81640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78380c34d0 0x7f783814f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f783db81640 1 -- 172.21.15.90:0/469067642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78381573f0 con 0x7f78380ac570 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f783e382640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f783eb83640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78380c34d0 0x7f783814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f783db81640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f7838155be0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f782800c7c0 tx=0x7f782800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f782effd640 1 -- 172.21.15.90:0/469067642 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828015070 con 0x7f78380ac570 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f782effd640 1 -- 172.21.15.90:0/469067642 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7828007a30 con 0x7f78380ac570 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7838157110 con 0x7f78380ac570 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f782effd640 1 -- 172.21.15.90:0/469067642 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828007e00 con 0x7f78380ac570 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.381+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7838153c90 con 0x7f78380ac570 2024-04-20T10:52:50.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.382+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7838076150 con 0x7f78380ac570 2024-04-20T10:52:50.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.382+0000 7f782effd640 1 -- 172.21.15.90:0/469067642 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7828018070 con 0x7f78380ac570 2024-04-20T10:52:50.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.383+0000 7f782effd640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f781c06c8f0 0x7f781c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:50.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.383+0000 7f782effd640 1 -- 172.21.15.90:0/469067642 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f782808be10 con 0x7f78380ac570 2024-04-20T10:52:50.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.383+0000 7f783e382640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f781c06c8f0 0x7f781c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:50.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.383+0000 7f783e382640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f781c06c8f0 0x7f781c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7834007f40 tx=0x7f7834007490 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:50.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.387+0000 7f782effd640 1 -- 172.21.15.90:0/469067642 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7828059e80 con 0x7f78380ac570 2024-04-20T10:52:50.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.607+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7838157630 con 0x7f78380ac570 2024-04-20T10:52:50.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.607+0000 7f782effd640 1 -- 172.21.15.90:0/469067642 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+4881 (secure 0 0 0) 0x7f7828059780 con 0x7f78380ac570 2024-04-20T10:52:50.607 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:50.608 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:52:50.608 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 18 2024-04-20T10:52:50.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f781c06c8f0 msgr2=0x7f781c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f781c06c8f0 0x7f781c06edb0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7834007f40 tx=0x7f7834007490 comp rx=0 tx=0).stop 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 msgr2=0x7f7838155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f7838155be0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f782800c7c0 tx=0x7f782800cc80 comp rx=0 tx=0).stop 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 shutdown_connections 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f781c06c8f0 0x7f781c06edb0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78380c34d0 0x7f783814f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78380ac570 0x7f7838155be0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 --2- 172.21.15.90:0/469067642 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78380ab4a0 0x7f7838070960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 >> 172.21.15.90:0/469067642 conn(0x7f78380ca0a0 msgr2=0x7f78380c8d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 shutdown_connections 2024-04-20T10:52:50.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:50.609+0000 7f78405e6640 1 -- 172.21.15.90:0/469067642 wait complete. 2024-04-20T10:52:50.621 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.d is in active, standby or standby-replay 2024-04-20T10:52:50.861 INFO:tasks.workunit.client.0.smithi090.stderr:+ tar xzf ltp-full.tgz 2024-04-20T10:52:51.902 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-04-20T10:52:51.903 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-20T10:52:51.903 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-20T10:52:51.905 INFO:tasks.ceph.mds.c:Started 2024-04-20T10:52:51.906 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:51.982 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-04-20T10:52:52.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.008+0000 7f3409159640 1 Processor -- start 2024-04-20T10:52:52.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.008+0000 7f3409159640 1 -- start start 2024-04-20T10:52:52.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f3409159640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f3404153d60 0x7f34040ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f3409159640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34040ac2b0 0x7f34040c4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f3409159640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34040acaa0 con 0x7f34040c4600 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f3409159640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f34040acdf0 con 0x7f34040ac2b0 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f3409159640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f340415a750 con 0x7f3404153d60 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f33fbfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34040ac2b0 0x7f34040c4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f33fbfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f34040ac2b0 0x7f34040c4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43246/0 (socket says 172.21.15.90:43246) 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f33fbfff640 1 -- 172.21.15.90:0/44693592 learned_addr learned my addr 172.21.15.90:0/44693592 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f3402d9d640 1 --2- 172.21.15.90:0/44693592 >> v2:172.21.15.175:3300/0 conn(0x7f3404153d60 0x7f34040ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f33fbfff640 1 -- 172.21.15.90:0/44693592 >> v2:172.21.15.175:3300/0 conn(0x7f3404153d60 msgr2=0x7f34040ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f33fbfff640 1 --2- 172.21.15.90:0/44693592 >> v2:172.21.15.175:3300/0 conn(0x7f3404153d60 0x7f34040ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f33fbfff640 1 -- 172.21.15.90:0/44693592 >> v1:172.21.15.175:6789/0 conn(0x7f34040c4600 legacy=0x7f34040c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:52.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.009+0000 7f33fbfff640 1 -- 172.21.15.90:0/44693592 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340415aa30 con 0x7f34040ac2b0 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.010+0000 7f33fbfff640 1 --2- 172.21.15.90:0/44693592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040ac2b0 0x7f34040c4cb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f34040ca8e0 tx=0x7f33ec02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd73f62ada809d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.010+0000 7f340259c640 1 -- 172.21.15.90:0/44693592 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec038070 con 0x7f34040ac2b0 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.010+0000 7f340259c640 1 -- 172.21.15.90:0/44693592 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec02f050 con 0x7f34040ac2b0 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.010+0000 7f340259c640 1 -- 172.21.15.90:0/44693592 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec031970 con 0x7f34040ac2b0 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 -- 172.21.15.90:0/44693592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040ac2b0 msgr2=0x7f34040c4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 --2- 172.21.15.90:0/44693592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040ac2b0 0x7f34040c4cb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f34040ca8e0 tx=0x7f33ec02b7f0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 -- 172.21.15.90:0/44693592 shutdown_connections 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 --2- 172.21.15.90:0/44693592 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040ac2b0 0x7f34040c4cb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 --2- 172.21.15.90:0/44693592 >> v2:172.21.15.175:3300/0 conn(0x7f3404153d60 0x7f34040ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 -- 172.21.15.90:0/44693592 >> 172.21.15.90:0/44693592 conn(0x7f3404067de0 msgr2=0x7f34040ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 -- 172.21.15.90:0/44693592 shutdown_connections 2024-04-20T10:52:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.011+0000 7f3409159640 1 -- 172.21.15.90:0/44693592 wait complete. 2024-04-20T10:52:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.012+0000 7f3409159640 1 Processor -- start 2024-04-20T10:52:52.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.012+0000 7f3409159640 1 -- start start 2024-04-20T10:52:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040ac2b0 0x7f34040ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040c4600 0x7f34041ec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3404153d60 0x7f340413e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f34040c3e70 con 0x7f34040c4600 2024-04-20T10:52:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f34040c3cf0 con 0x7f34040ac2b0 2024-04-20T10:52:52.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f34040c51f0 con 0x7f3404153d60 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040c4600 0x7f34041ec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040c4600 0x7f34041ec4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43256/0 (socket says 172.21.15.90:43256) 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 -- 172.21.15.90:0/3112952424 learned_addr learned my addr 172.21.15.90:0/3112952424 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3402d9d640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040ac2b0 0x7f34040ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f340359e640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3404153d60 0x7f340413e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 -- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3404153d60 msgr2=0x7f340413e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3404153d60 0x7f340413e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 -- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040ac2b0 msgr2=0x7f34040ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040ac2b0 0x7f34040ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 -- 172.21.15.90:0/3112952424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3404159860 con 0x7f34040c4600 2024-04-20T10:52:52.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f340359e640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3404153d60 0x7f340413e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fbfff640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040c4600 0x7f34041ec4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000c00 tx=0x7f33ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fb7fe640 1 -- 172.21.15.90:0/3112952424 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec042070 con 0x7f34040c4600 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fb7fe640 1 -- 172.21.15.90:0/3112952424 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec03d890 con 0x7f34040c4600 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34041efb90 con 0x7f34040c4600 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f33fb7fe640 1 -- 172.21.15.90:0/3112952424 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec038040 con 0x7f34040c4600 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.013+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34041efe30 con 0x7f34040c4600 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.014+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3404076150 con 0x7f34040c4600 2024-04-20T10:52:52.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.015+0000 7f33fb7fe640 1 -- 172.21.15.90:0/3112952424 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33ec045070 con 0x7f34040c4600 2024-04-20T10:52:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.015+0000 7f33fb7fe640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e406c920 0x7f33e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.015+0000 7f3402d9d640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e406c920 0x7f33e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.015+0000 7f33fb7fe640 1 -- 172.21.15.90:0/3112952424 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f33ec0add30 con 0x7f34040c4600 2024-04-20T10:52:52.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.016+0000 7f3402d9d640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e406c920 0x7f33e406ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f33f400a970 tx=0x7f33f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:52.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.020+0000 7f33fb7fe640 1 -- 172.21.15.90:0/3112952424 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f33ec07bda0 con 0x7f34040c4600 2024-04-20T10:52:52.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.232+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f34040c43e0 con 0x7f34040c4600 2024-04-20T10:52:52.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.232+0000 7f33fb7fe640 1 -- 172.21.15.90:0/3112952424 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+5708 (secure 0 0 0) 0x7f33ec07b6a0 con 0x7f34040c4600 2024-04-20T10:52:52.233 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:52.233 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:52:52.233 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 19 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e406c920 msgr2=0x7f33e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e406c920 0x7f33e406ede0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f33f400a970 tx=0x7f33f4008040 comp rx=0 tx=0).stop 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040c4600 msgr2=0x7f34041ec4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040c4600 0x7f34041ec4f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f33ec000c00 tx=0x7f33ec0046c0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 shutdown_connections 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e406c920 0x7f33e406ede0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3404153d60 0x7f340413e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.234+0000 7f3409159640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f34040c4600 0x7f34041ec4f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.235+0000 7f3409159640 1 --2- 172.21.15.90:0/3112952424 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f34040ac2b0 0x7f34040ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.235+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 >> 172.21.15.90:0/3112952424 conn(0x7f3404067de0 msgr2=0x7f3404156840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:52.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.235+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 shutdown_connections 2024-04-20T10:52:52.236 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.235+0000 7f3409159640 1 -- 172.21.15.90:0/3112952424 wait complete. 2024-04-20T10:52:52.245 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-20T10:52:52.622 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:52.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.720+0000 7eff547ce640 1 Processor -- start 2024-04-20T10:52:52.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.720+0000 7eff547ce640 1 -- start start 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff547ce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7eff4c073810 0x7eff4c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff547ce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c0ad0c0 0x7eff4c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff547ce640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff4c0c4370 con 0x7eff4c157710 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff547ce640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7eff4c1569e0 con 0x7eff4c073810 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff547ce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff4c157280 con 0x7eff4c0ad0c0 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff5256a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7eff4c073810 0x7eff4c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff5256a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7eff4c073810 0x7eff4c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43260/0 (socket says 172.21.15.90:43260) 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff5256a640 1 -- 172.21.15.90:0/3613160295 learned_addr learned my addr 172.21.15.90:0/3613160295 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff52d6b640 1 --2- 172.21.15.90:0/3613160295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c0ad0c0 0x7eff4c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff5256a640 1 -- 172.21.15.90:0/3613160295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c0ad0c0 msgr2=0x7eff4c0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.721+0000 7eff5256a640 1 --2- 172.21.15.90:0/3613160295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c0ad0c0 0x7eff4c0ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.722+0000 7eff5256a640 1 -- 172.21.15.90:0/3613160295 >> v1:172.21.15.175:6789/0 conn(0x7eff4c157710 legacy=0x7eff4c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.722+0000 7eff5256a640 1 -- 172.21.15.90:0/3613160295 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4c156c30 con 0x7eff4c073810 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.722+0000 7eff5256a640 1 --2- 172.21.15.90:0/3613160295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c154000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff48009e50 tx=0x7eff4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e77664507f68c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.722+0000 7eff51568640 1 -- 172.21.15.90:0/3613160295 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff4802ca70 con 0x7eff4c073810 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.722+0000 7eff51568640 1 -- 172.21.15.90:0/3613160295 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff4802cc10 con 0x7eff4c073810 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.722+0000 7eff51568640 1 -- 172.21.15.90:0/3613160295 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff480343f0 con 0x7eff4c073810 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 -- 172.21.15.90:0/3613160295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 msgr2=0x7eff4c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 --2- 172.21.15.90:0/3613160295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c154000 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7eff48009e50 tx=0x7eff4802bed0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 -- 172.21.15.90:0/3613160295 shutdown_connections 2024-04-20T10:52:52.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 --2- 172.21.15.90:0/3613160295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c0ad0c0 0x7eff4c0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 --2- 172.21.15.90:0/3613160295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c154000 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 -- 172.21.15.90:0/3613160295 >> 172.21.15.90:0/3613160295 conn(0x7eff4c0c8080 msgr2=0x7eff4c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:52.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 -- 172.21.15.90:0/3613160295 shutdown_connections 2024-04-20T10:52:52.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.723+0000 7eff547ce640 1 -- 172.21.15.90:0/3613160295 wait complete. 2024-04-20T10:52:52.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.724+0000 7eff547ce640 1 Processor -- start 2024-04-20T10:52:52.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.724+0000 7eff547ce640 1 -- start start 2024-04-20T10:52:52.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff547ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c1e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff547ce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c0ad0c0 0x7eff4c14b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff547ce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c157710 0x7eff4c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff547ce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c0abbb0 con 0x7eff4c073810 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff547ce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7eff4c073bf0 con 0x7eff4c0ad0c0 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff547ce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7eff4c0abd30 con 0x7eff4c157710 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c1e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c1e9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43276/0 (socket says 172.21.15.90:43276) 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 -- 172.21.15.90:0/1195158508 learned_addr learned my addr 172.21.15.90:0/1195158508 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff51d69640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c0ad0c0 0x7eff4c14b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff52d6b640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c157710 0x7eff4c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 -- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c157710 msgr2=0x7eff4c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c157710 0x7eff4c1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 -- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c0ad0c0 msgr2=0x7eff4c14b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c0ad0c0 0x7eff4c14b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.728 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 -- 172.21.15.90:0/1195158508 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff4c151400 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff5256a640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c1e9b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7eff48036040 tx=0x7eff48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.725+0000 7eff42ffd640 1 -- 172.21.15.90:0/1195158508 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48009510 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.726+0000 7eff42ffd640 1 -- 172.21.15.90:0/1195158508 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff480476a0 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.726+0000 7eff42ffd640 1 -- 172.21.15.90:0/1195158508 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff48047a90 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.726+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff4c1516e0 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.726+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff4c1530f0 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.727+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff4c076150 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.727+0000 7eff42ffd640 1 -- 172.21.15.90:0/1195158508 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff4802ca80 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.727+0000 7eff42ffd640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff3006c8f0 0x7eff3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.727+0000 7eff42ffd640 1 -- 172.21.15.90:0/1195158508 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7eff480b0c80 con 0x7eff4c073810 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.727+0000 7eff51d69640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff3006c8f0 0x7eff3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:52.729 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.728+0000 7eff51d69640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff3006c8f0 0x7eff3006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff4c14e2e0 tx=0x7eff3c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:52.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.732+0000 7eff42ffd640 1 -- 172.21.15.90:0/1195158508 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7eff4807e6a0 con 0x7eff4c073810 2024-04-20T10:52:52.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.945+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7eff4c070710 con 0x7eff4c073810 2024-04-20T10:52:52.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.946+0000 7eff42ffd640 1 -- 172.21.15.90:0/1195158508 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7eff480829a0 con 0x7eff4c073810 2024-04-20T10:52:52.946 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:52.946 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:52:52.947 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:52:52.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff3006c8f0 msgr2=0x7eff3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff3006c8f0 0x7eff3006edb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff4c14e2e0 tx=0x7eff3c009040 comp rx=0 tx=0).stop 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 msgr2=0x7eff4c1e9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c1e9b20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7eff48036040 tx=0x7eff48004a40 comp rx=0 tx=0).stop 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 shutdown_connections 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7eff3006c8f0 0x7eff3006edb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7eff4c157710 0x7eff4c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7eff4c0ad0c0 0x7eff4c14b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 --2- 172.21.15.90:0/1195158508 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7eff4c073810 0x7eff4c1e9b20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 >> 172.21.15.90:0/1195158508 conn(0x7eff4c0c8080 msgr2=0x7eff4c0c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 shutdown_connections 2024-04-20T10:52:52.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:52.948+0000 7eff547ce640 1 -- 172.21.15.90:0/1195158508 wait complete. 2024-04-20T10:52:52.959 INFO:tasks.mds_thrash.fs.[a]:mds.d reported in up:standby state 2024-04-20T10:52:52.959 INFO:tasks.mds_thrash.fs.[a]:waiting for 25 secs before thrashing 2024-04-20T10:52:54.246 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.343+0000 7fe042a31640 1 Processor -- start 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.343+0000 7fe042a31640 1 -- start start 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe042a31640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe03c153ef0 0x7fe03c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe042a31640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe03c0c9ee0 0x7fe03c156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe042a31640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03c15a720 con 0x7fe03c0ab730 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe042a31640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c15ac80 con 0x7fe03c0c9ee0 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe042a31640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe03c15a9a0 con 0x7fe03c153ef0 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe040fce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe03c0c9ee0 0x7fe03c156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe040fce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe03c0c9ee0 0x7fe03c156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43290/0 (socket says 172.21.15.90:43290) 2024-04-20T10:52:54.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe040fce640 1 -- 172.21.15.90:0/1073479310 learned_addr learned my addr 172.21.15.90:0/1073479310 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:54.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.344+0000 7fe03bfff640 1 --2- 172.21.15.90:0/1073479310 >> v2:172.21.15.175:3300/0 conn(0x7fe03c153ef0 0x7fe03c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:54.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe040fce640 1 -- 172.21.15.90:0/1073479310 >> v2:172.21.15.175:3300/0 conn(0x7fe03c153ef0 msgr2=0x7fe03c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:52:54.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe040fce640 1 --2- 172.21.15.90:0/1073479310 >> v2:172.21.15.175:3300/0 conn(0x7fe03c153ef0 0x7fe03c0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe040fce640 1 -- 172.21.15.90:0/1073479310 >> v1:172.21.15.175:6789/0 conn(0x7fe03c0ab730 legacy=0x7fe03c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:54.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe040fce640 1 -- 172.21.15.90:0/1073479310 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c0c6a90 con 0x7fe03c0c9ee0 2024-04-20T10:52:54.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe040fce640 1 --2- 172.21.15.90:0/1073479310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c0c9ee0 0x7fe03c156fd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0aec60 tx=0x7fe03402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73dac1126e3ccc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe03affd640 1 -- 172.21.15.90:0/1073479310 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03402c9f0 con 0x7fe03c0c9ee0 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe03affd640 1 -- 172.21.15.90:0/1073479310 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03402cb90 con 0x7fe03c0c9ee0 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.345+0000 7fe03affd640 1 -- 172.21.15.90:0/1073479310 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0340343f0 con 0x7fe03c0c9ee0 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 -- 172.21.15.90:0/1073479310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c0c9ee0 msgr2=0x7fe03c156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 --2- 172.21.15.90:0/1073479310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c0c9ee0 0x7fe03c156fd0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0aec60 tx=0x7fe03402be50 comp rx=0 tx=0).stop 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 -- 172.21.15.90:0/1073479310 shutdown_connections 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 --2- 172.21.15.90:0/1073479310 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c0c9ee0 0x7fe03c156fd0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 --2- 172.21.15.90:0/1073479310 >> v2:172.21.15.175:3300/0 conn(0x7fe03c153ef0 0x7fe03c0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 -- 172.21.15.90:0/1073479310 >> 172.21.15.90:0/1073479310 conn(0x7fe03c0cbfe0 msgr2=0x7fe03c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 -- 172.21.15.90:0/1073479310 shutdown_connections 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.346+0000 7fe042a31640 1 -- 172.21.15.90:0/1073479310 wait complete. 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.347+0000 7fe042a31640 1 Processor -- start 2024-04-20T10:52:54.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.347+0000 7fe042a31640 1 -- start start 2024-04-20T10:52:54.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe042a31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ab730 0x7fe03c0c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:54.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe042a31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c9ee0 0x7fe03c0bfef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:54.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe042a31640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c153ef0 0x7fe03c0c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe042a31640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c0bf800 con 0x7fe03c153ef0 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe042a31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe03c157510 con 0x7fe03c0c9ee0 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe042a31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe03c0c1360 con 0x7fe03c0ab730 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c153ef0 0x7fe03c0c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c153ef0 0x7fe03c0c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43304/0 (socket says 172.21.15.90:43304) 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 -- 172.21.15.90:0/695306774 learned_addr learned my addr 172.21.15.90:0/695306774 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe03b7fe640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c9ee0 0x7fe03c0bfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:54.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe03bfff640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ab730 0x7fe03c0c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 -- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ab730 msgr2=0x7fe03c0c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ab730 0x7fe03c0c54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 -- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c9ee0 msgr2=0x7fe03c0bfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c9ee0 0x7fe03c0bfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.348+0000 7fe040fce640 1 -- 172.21.15.90:0/695306774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe03c1ed000 con 0x7fe03c153ef0 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.349+0000 7fe040fce640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c153ef0 0x7fe03c0c0430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe034009f40 tx=0x7fe034004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.349+0000 7fe038ff9640 1 -- 172.21.15.90:0/695306774 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034044020 con 0x7fe03c153ef0 2024-04-20T10:52:54.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.349+0000 7fe038ff9640 1 -- 172.21.15.90:0/695306774 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034040470 con 0x7fe03c153ef0 2024-04-20T10:52:54.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.349+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe03c1ed2e0 con 0x7fe03c153ef0 2024-04-20T10:52:54.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.349+0000 7fe038ff9640 1 -- 172.21.15.90:0/695306774 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe034009510 con 0x7fe03c153ef0 2024-04-20T10:52:54.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.349+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe03c1529f0 con 0x7fe03c153ef0 2024-04-20T10:52:54.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.350+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe03c06d070 con 0x7fe03c153ef0 2024-04-20T10:52:54.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.350+0000 7fe038ff9640 1 -- 172.21.15.90:0/695306774 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe034047020 con 0x7fe03c153ef0 2024-04-20T10:52:54.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.350+0000 7fe038ff9640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe02806c920 0x7fe02806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:52:54.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.351+0000 7fe038ff9640 1 -- 172.21.15.90:0/695306774 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fe0340ae610 con 0x7fe03c153ef0 2024-04-20T10:52:54.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.351+0000 7fe03bfff640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe02806c920 0x7fe02806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:52:54.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.351+0000 7fe03bfff640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe02806c920 0x7fe02806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0079a0 tx=0x7fe02c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:52:54.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.355+0000 7fe038ff9640 1 -- 172.21.15.90:0/695306774 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe03404e030 con 0x7fe03c153ef0 2024-04-20T10:52:54.587 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.587+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe03c076130 con 0x7fe03c153ef0 2024-04-20T10:52:54.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.587+0000 7fe038ff9640 1 -- 172.21.15.90:0/695306774 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7fe03407c030 con 0x7fe03c153ef0 2024-04-20T10:52:54.588 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:52:54.588 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:52:54.590 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:52:54.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe02806c920 msgr2=0x7fe02806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:54.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe02806c920 0x7fe02806ede0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe02c0079a0 tx=0x7fe02c008040 comp rx=0 tx=0).stop 2024-04-20T10:52:54.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c153ef0 msgr2=0x7fe03c0c0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:52:54.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c153ef0 0x7fe03c0c0430 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fe034009f40 tx=0x7fe034004a40 comp rx=0 tx=0).stop 2024-04-20T10:52:54.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 shutdown_connections 2024-04-20T10:52:54.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe02806c920 0x7fe02806ede0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe03c153ef0 0x7fe03c0c0430 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.591 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe03c0c9ee0 0x7fe03c0bfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 --2- 172.21.15.90:0/695306774 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe03c0ab730 0x7fe03c0c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:52:54.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 >> 172.21.15.90:0/695306774 conn(0x7fe03c0cbfe0 msgr2=0x7fe03c1563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:52:54.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 shutdown_connections 2024-04-20T10:52:54.592 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:52:54.589+0000 7fe042a31640 1 -- 172.21.15.90:0/695306774 wait complete. 2024-04-20T10:52:54.600 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-04-20T10:52:54.600 INFO:tasks.mds_thrash.fs.[b]:waiting for 64 secs before thrashing 2024-04-20T10:53:10.457 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:53:10.461 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:53:17.960 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.057+0000 7f81f21b6640 1 Processor -- start 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.057+0000 7f81f21b6640 1 -- start start 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81f21b6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81f21b6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f81ec0ab730 0x7f81ec1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81f21b6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f81ec0c9ee0 0x7f81ec156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81f21b6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f81ec15a720 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81f21b6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f81ec15ac80 con 0x7f81ec0ab730 2024-04-20T10:53:18.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81f21b6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec15a9a0 con 0x7f81ec153ef0 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81ebfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f81ec0c9ee0 0x7f81ec156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81ebfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f81ec0c9ee0 0x7f81ec156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33798/0 (socket says 172.21.15.90:33798) 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81ebfff640 1 -- 172.21.15.90:0/1325655382 learned_addr learned my addr 172.21.15.90:0/1325655382 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81eb7fe640 1 --2- 172.21.15.90:0/1325655382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.058+0000 7f81eaffd640 1 --2- 172.21.15.90:0/1325655382 >> v2:172.21.15.175:3300/0 conn(0x7f81ec0ab730 0x7f81ec1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ebfff640 1 -- 172.21.15.90:0/1325655382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 msgr2=0x7f81ec0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ebfff640 1 --2- 172.21.15.90:0/1325655382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ebfff640 1 -- 172.21.15.90:0/1325655382 >> v2:172.21.15.175:3300/0 conn(0x7f81ec0ab730 msgr2=0x7f81ec1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ebfff640 1 --2- 172.21.15.90:0/1325655382 >> v2:172.21.15.175:3300/0 conn(0x7f81ec0ab730 0x7f81ec1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ebfff640 1 -- 172.21.15.90:0/1325655382 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec0c6a90 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ebfff640 1 --2- 172.21.15.90:0/1325655382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec156e00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f81ec06ebd0 tx=0x7f81dc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31328a561566b49f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:18.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ea7fc640 1 -- 172.21.15.90:0/1325655382 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc038070 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ea7fc640 1 -- 172.21.15.90:0/1325655382 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81dc02f050 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.059+0000 7f81ea7fc640 1 -- 172.21.15.90:0/1325655382 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81dc031970 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 -- 172.21.15.90:0/1325655382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 msgr2=0x7f81ec156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 --2- 172.21.15.90:0/1325655382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec156e00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f81ec06ebd0 tx=0x7f81dc02b7f0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 -- 172.21.15.90:0/1325655382 shutdown_connections 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 --2- 172.21.15.90:0/1325655382 >> v2:172.21.15.175:3300/0 conn(0x7f81ec0ab730 0x7f81ec1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 --2- 172.21.15.90:0/1325655382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec156e00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 --2- 172.21.15.90:0/1325655382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 -- 172.21.15.90:0/1325655382 >> 172.21.15.90:0/1325655382 conn(0x7f81ec0cbfe0 msgr2=0x7f81ec0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 -- 172.21.15.90:0/1325655382 shutdown_connections 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.060+0000 7f81f21b6640 1 -- 172.21.15.90:0/1325655382 wait complete. 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.061+0000 7f81f21b6640 1 Processor -- start 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.061+0000 7f81f21b6640 1 -- start start 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81f21b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81ec0ab730 0x7f81ec1ef500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81f21b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81f21b6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81f21b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec0bf800 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81f21b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f81ec157340 con 0x7f81ec0ab730 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81f21b6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f81ec06c390 con 0x7f81ec153ef0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33812/0 (socket says 172.21.15.90:33812) 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 -- 172.21.15.90:0/2652661906 learned_addr learned my addr 172.21.15.90:0/2652661906 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eb7fe640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81ec0ab730 0x7f81ec1ef500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81ebfff640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 -- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 msgr2=0x7f81ec150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 -- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81ec0ab730 msgr2=0x7f81ec1ef500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81ec0ab730 0x7f81ec1ef500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 -- 172.21.15.90:0/2652661906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81ec1eff80 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.062+0000 7f81eaffd640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec150770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f81e000eed0 tx=0x7f81e000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.063+0000 7f81d3fff640 1 -- 172.21.15.90:0/2652661906 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0018020 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.063+0000 7f81d3fff640 1 -- 172.21.15.90:0/2652661906 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e0009e40 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.063+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81ec0b1880 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.063+0000 7f81d3fff640 1 -- 172.21.15.90:0/2652661906 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0014620 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.063+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81ec0c97b0 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.064+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81ec076150 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.064+0000 7f81d3fff640 1 -- 172.21.15.90:0/2652661906 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81e001b020 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.064+0000 7f81d3fff640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f81d806c8f0 0x7f81d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.065+0000 7f81d3fff640 1 -- 172.21.15.90:0/2652661906 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f81e008c800 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.065+0000 7f81eb7fe640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f81d806c8f0 0x7f81d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.065+0000 7f81eb7fe640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f81d806c8f0 0x7f81d806edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009aa0 tx=0x7f81e4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:18.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.069+0000 7f81d3fff640 1 -- 172.21.15.90:0/2652661906 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f81e0022020 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.366+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81ec151760 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.367+0000 7f81d3fff640 1 -- 172.21.15.90:0/2652661906 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7f81e005a220 con 0x7f81ec0c9ee0 2024-04-20T10:53:18.368 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:18.368 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:18.368 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:18.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f81d806c8f0 msgr2=0x7f81d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f81d806c8f0 0x7f81d806edb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f81e4009aa0 tx=0x7f81e4009190 comp rx=0 tx=0).stop 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 msgr2=0x7f81ec150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec150770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f81e000eed0 tx=0x7f81e000b480 comp rx=0 tx=0).stop 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 shutdown_connections 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f81d806c8f0 0x7f81d806edb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f81ec153ef0 0x7f81ec150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f81ec0c9ee0 0x7f81ec150770 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 --2- 172.21.15.90:0/2652661906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f81ec0ab730 0x7f81ec1ef500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 >> 172.21.15.90:0/2652661906 conn(0x7f81ec0cbfe0 msgr2=0x7f81ec06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 shutdown_connections 2024-04-20T10:53:18.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.369+0000 7f81f21b6640 1 -- 172.21.15.90:0/2652661906 wait complete. 2024-04-20T10:53:18.380 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2024-04-20T10:53:18.381 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-20T10:53:18.381 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:53:18.393 INFO:tasks.ceph.mds.a:Stopped 2024-04-20T10:53:18.393 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:18.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.530+0000 7fd11558f640 1 Processor -- start 2024-04-20T10:53:18.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd11558f640 1 -- start start 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd11558f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd11558f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1100ab730 0x7fd1101568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd11558f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd1100c9ee0 0x7fd110156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd11558f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd11015a720 con 0x7fd1100ab730 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd11558f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd11015ac80 con 0x7fd1100c9ee0 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd11558f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd11015a9a0 con 0x7fd110153ef0 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd10e7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1100ab730 0x7fd1101568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd10e7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd1100ab730 0x7fd1101568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33824/0 (socket says 172.21.15.90:33824) 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2409990756 learned_addr learned my addr 172.21.15.90:0/2409990756 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd10effd640 1 --2- 172.21.15.90:0/2409990756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.531+0000 7fd10f7fe640 1 --2- 172.21.15.90:0/2409990756 >> v2:172.21.15.175:3300/0 conn(0x7fd1100c9ee0 0x7fd110156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.532+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2409990756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 msgr2=0x7fd1100c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.532+0000 7fd10e7fc640 1 --2- 172.21.15.90:0/2409990756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.532+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2409990756 >> v2:172.21.15.175:3300/0 conn(0x7fd1100c9ee0 msgr2=0x7fd110156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.532+0000 7fd10e7fc640 1 --2- 172.21.15.90:0/2409990756 >> v2:172.21.15.175:3300/0 conn(0x7fd1100c9ee0 0x7fd110156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.532+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2409990756 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1100c6a90 con 0x7fd1100ab730 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.532+0000 7fd10e7fc640 1 --2- 172.21.15.90:0/2409990756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100ab730 0x7fd1101568c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd1100c9b40 tx=0x7fd10002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41625779b931bf49 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.532+0000 7fd10dffb640 1 -- 172.21.15.90:0/2409990756 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100038070 con 0x7fd1100ab730 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd10dffb640 1 -- 172.21.15.90:0/2409990756 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10002f050 con 0x7fd1100ab730 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd10dffb640 1 -- 172.21.15.90:0/2409990756 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100031970 con 0x7fd1100ab730 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 -- 172.21.15.90:0/2409990756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100ab730 msgr2=0x7fd1101568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 --2- 172.21.15.90:0/2409990756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100ab730 0x7fd1101568c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd1100c9b40 tx=0x7fd10002b7f0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 -- 172.21.15.90:0/2409990756 shutdown_connections 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 --2- 172.21.15.90:0/2409990756 >> v2:172.21.15.175:3300/0 conn(0x7fd1100c9ee0 0x7fd110156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 --2- 172.21.15.90:0/2409990756 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100ab730 0x7fd1101568c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 --2- 172.21.15.90:0/2409990756 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 -- 172.21.15.90:0/2409990756 >> 172.21.15.90:0/2409990756 conn(0x7fd1100cbfe0 msgr2=0x7fd1100cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 -- 172.21.15.90:0/2409990756 shutdown_connections 2024-04-20T10:53:18.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.533+0000 7fd11558f640 1 -- 172.21.15.90:0/2409990756 wait complete. 2024-04-20T10:53:18.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.534+0000 7fd11558f640 1 Processor -- start 2024-04-20T10:53:18.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.534+0000 7fd11558f640 1 -- start start 2024-04-20T10:53:18.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd11558f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1100ab730 0x7fd1100c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd11558f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100c9ee0 0x7fd1100c0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd11558f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd11558f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd1100bf800 con 0x7fd1100c9ee0 2024-04-20T10:53:18.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd11558f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd110157340 con 0x7fd1100ab730 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd11558f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd1100c0b60 con 0x7fd110153ef0 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100c9ee0 0x7fd1100c0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100c9ee0 0x7fd1100c0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33828/0 (socket says 172.21.15.90:33828) 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2974682438 learned_addr learned my addr 172.21.15.90:0/2974682438 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10effd640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1100ab730 0x7fd1100c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10f7fe640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 msgr2=0x7fd1100c1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10e7fc640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1100ab730 msgr2=0x7fd1100c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.535+0000 7fd10e7fc640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1100ab730 0x7fd1100c2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.536+0000 7fd10e7fc640 1 -- 172.21.15.90:0/2974682438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1100aef10 con 0x7fd1100c9ee0 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.536+0000 7fd10e7fc640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100c9ee0 0x7fd1100c0ff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd100000c00 tx=0x7fd1000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.536+0000 7fd0f77fe640 1 -- 172.21.15.90:0/2974682438 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100042020 con 0x7fd1100c9ee0 2024-04-20T10:53:18.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.536+0000 7fd0f77fe640 1 -- 172.21.15.90:0/2974682438 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10003d680 con 0x7fd1100c9ee0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.536+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1101ec6f0 con 0x7fd1100c9ee0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.536+0000 7fd0f77fe640 1 -- 172.21.15.90:0/2974682438 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100038040 con 0x7fd1100c9ee0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.536+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1101eccb0 con 0x7fd1100c9ee0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.537+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1100c0ce0 con 0x7fd1100c9ee0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.537+0000 7fd0f77fe640 1 -- 172.21.15.90:0/2974682438 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd100045020 con 0x7fd1100c9ee0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.538+0000 7fd0f77fe640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd0fc06c8f0 0x7fd0fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.538+0000 7fd0f77fe640 1 -- 172.21.15.90:0/2974682438 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fd1000ad800 con 0x7fd1100c9ee0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.538+0000 7fd10effd640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd0fc06c8f0 0x7fd0fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:18.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.538+0000 7fd10effd640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd0fc06c8f0 0x7fd0fc06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd110068e00 tx=0x7fd104009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:18.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.542+0000 7fd0f77fe640 1 -- 172.21.15.90:0/2974682438 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd10004c030 con 0x7fd1100c9ee0 2024-04-20T10:53:18.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.755+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd110076150 con 0x7fd1100c9ee0 2024-04-20T10:53:18.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.755+0000 7fd0f77fe640 1 -- 172.21.15.90:0/2974682438 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7fd10007b220 con 0x7fd1100c9ee0 2024-04-20T10:53:18.755 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:18.756 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:18.756 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd0fc06c8f0 msgr2=0x7fd0fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd0fc06c8f0 0x7fd0fc06edb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd110068e00 tx=0x7fd104009190 comp rx=0 tx=0).stop 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100c9ee0 msgr2=0x7fd1100c0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100c9ee0 0x7fd1100c0ff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd100000c00 tx=0x7fd1000046c0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 shutdown_connections 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd0fc06c8f0 0x7fd0fc06edb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd110153ef0 0x7fd1100c1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd1100c9ee0 0x7fd1100c0ff0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 --2- 172.21.15.90:0/2974682438 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd1100ab730 0x7fd1100c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 >> 172.21.15.90:0/2974682438 conn(0x7fd1100cbfe0 msgr2=0x7fd110159ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:18.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 shutdown_connections 2024-04-20T10:53:18.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:18.757+0000 7fd11558f640 1 -- 172.21.15.90:0/2974682438 wait complete. 2024-04-20T10:53:18.769 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:20.769 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:20.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.880+0000 7ffafca74640 1 Processor -- start 2024-04-20T10:53:20.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.880+0000 7ffafca74640 1 -- start start 2024-04-20T10:53:20.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.881+0000 7ffafca74640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffaf80ab730 0x7ffaf81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:20.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.881+0000 7ffafca74640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf815a720 con 0x7ffaf80c9ee0 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.881+0000 7ffafca74640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffaf815ac80 con 0x7ffaf8153ef0 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.881+0000 7ffafca74640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ffaf815a9a0 con 0x7ffaf80ab730 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.881+0000 7ffaf5d9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffaf80ab730 0x7ffaf81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.881+0000 7ffaf5d9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffaf80ab730 0x7ffaf81568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33840/0 (socket says 172.21.15.90:33840) 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.881+0000 7ffaf5d9b640 1 -- 172.21.15.90:0/2716212789 learned_addr learned my addr 172.21.15.90:0/2716212789 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.882+0000 7ffaf5d9b640 1 -- 172.21.15.90:0/2716212789 >> v1:172.21.15.175:6789/0 conn(0x7ffaf8153ef0 legacy=0x7ffaf80c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.882+0000 7ffaf5d9b640 1 -- 172.21.15.90:0/2716212789 >> v1:172.21.15.90:6789/0 conn(0x7ffaf80c9ee0 legacy=0x7ffaf8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.882+0000 7ffaf5d9b640 1 -- 172.21.15.90:0/2716212789 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf80c6a90 con 0x7ffaf80ab730 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.882+0000 7ffaf5d9b640 1 --2- 172.21.15.90:0/2716212789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf81568c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009870 tx=0x7ffaec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12917b4dd058e4c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.882+0000 7ffaf559a640 1 -- 172.21.15.90:0/2716212789 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec035020 con 0x7ffaf80ab730 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffaf559a640 1 -- 172.21.15.90:0/2716212789 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaec031870 con 0x7ffaf80ab730 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffaf559a640 1 -- 172.21.15.90:0/2716212789 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaec031c40 con 0x7ffaf80ab730 2024-04-20T10:53:20.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffafca74640 1 -- 172.21.15.90:0/2716212789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 msgr2=0x7ffaf81568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:20.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffafca74640 1 --2- 172.21.15.90:0/2716212789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf81568c0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009870 tx=0x7ffaec02b910 comp rx=0 tx=0).stop 2024-04-20T10:53:20.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffafca74640 1 -- 172.21.15.90:0/2716212789 shutdown_connections 2024-04-20T10:53:20.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffafca74640 1 --2- 172.21.15.90:0/2716212789 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf81568c0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:20.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffafca74640 1 -- 172.21.15.90:0/2716212789 >> 172.21.15.90:0/2716212789 conn(0x7ffaf80cbfe0 msgr2=0x7ffaf80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:20.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffafca74640 1 -- 172.21.15.90:0/2716212789 shutdown_connections 2024-04-20T10:53:20.885 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.883+0000 7ffafca74640 1 -- 172.21.15.90:0/2716212789 wait complete. 2024-04-20T10:53:20.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 Processor -- start 2024-04-20T10:53:20.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 -- start start 2024-04-20T10:53:20.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf80c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:20.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaf80c9ee0 0x7ffaf80c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaf8153ef0 0x7ffaf81509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf80c9100 con 0x7ffaf80ab730 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf8157510 con 0x7ffaf8153ef0 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffafca74640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffaf80c9280 con 0x7ffaf80c9ee0 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffaf659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf80c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffaf659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf80c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33854/0 (socket says 172.21.15.90:33854) 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffaf659c640 1 -- 172.21.15.90:0/2340247461 learned_addr learned my addr 172.21.15.90:0/2340247461 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffaf6d9d640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaf8153ef0 0x7ffaf81509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.885+0000 7ffaf5d9b640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaf80c9ee0 0x7ffaf80c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf659c640 1 -- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaf80c9ee0 msgr2=0x7ffaf80c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf659c640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaf80c9ee0 0x7ffaf80c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf659c640 1 -- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaf8153ef0 msgr2=0x7ffaf81509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:20.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf659c640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaf8153ef0 0x7ffaf81509a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf659c640 1 -- 172.21.15.90:0/2340247461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf815a0c0 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf5d9b640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaf80c9ee0 0x7ffaf80c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf6d9d640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaf8153ef0 0x7ffaf81509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffaf659c640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf80c4450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c790 tx=0x7ffae800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffae6ffd640 1 -- 172.21.15.90:0/2340247461 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8016020 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffae6ffd640 1 -- 172.21.15.90:0/2340247461 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffae8006d50 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffae6ffd640 1 -- 172.21.15.90:0/2340247461 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae8003bb0 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf80b1c80 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.886+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf81ec860 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.887+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf80cb7d0 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.888+0000 7ffae6ffd640 1 -- 172.21.15.90:0/2340247461 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffae800a850 con 0x7ffaf80ab730 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.888+0000 7ffae6ffd640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffad806c8f0 0x7ffad806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:20.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.888+0000 7ffaf5d9b640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffad806c8f0 0x7ffad806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:20.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.888+0000 7ffae6ffd640 1 -- 172.21.15.90:0/2340247461 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7ffae808bc60 con 0x7ffaf80ab730 2024-04-20T10:53:20.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.888+0000 7ffaf5d9b640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffad806c8f0 0x7ffad806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffaec036000 tx=0x7ffaec03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:20.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:20.892+0000 7ffae6ffd640 1 -- 172.21.15.90:0/2340247461 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ffaf80cb7d0 con 0x7ffaf80ab730 2024-04-20T10:53:21.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.108+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffaf8076150 con 0x7ffaf80ab730 2024-04-20T10:53:21.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.109+0000 7ffae6ffd640 1 -- 172.21.15.90:0/2340247461 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7ffae8020020 con 0x7ffaf80ab730 2024-04-20T10:53:21.109 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:21.110 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:21.110 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:21.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffad806c8f0 msgr2=0x7ffad806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffad806c8f0 0x7ffad806edb0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffaec036000 tx=0x7ffaec03c040 comp rx=0 tx=0).stop 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 msgr2=0x7ffaf80c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf80c4450 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c790 tx=0x7ffae800cc50 comp rx=0 tx=0).stop 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 shutdown_connections 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffad806c8f0 0x7ffad806edb0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffaf8153ef0 0x7ffaf81509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffaf80c9ee0 0x7ffaf80c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 --2- 172.21.15.90:0/2340247461 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffaf80ab730 0x7ffaf80c4450 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 >> 172.21.15.90:0/2340247461 conn(0x7ffaf80cbfe0 msgr2=0x7ffaf80cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 shutdown_connections 2024-04-20T10:53:21.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:21.111+0000 7ffafca74640 1 -- 172.21.15.90:0/2340247461 wait complete. 2024-04-20T10:53:21.123 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:23.124 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:23.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.237+0000 7f8b860d2640 1 Processor -- start 2024-04-20T10:53:23.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.237+0000 7f8b860d2640 1 -- start start 2024-04-20T10:53:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.238+0000 7f8b860d2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80151f50 0x7f8b801551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.238+0000 7f8b860d2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b80158780 con 0x7f8b80072860 2024-04-20T10:53:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.238+0000 7f8b860d2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b801546d0 con 0x7f8b800c45c0 2024-04-20T10:53:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.238+0000 7f8b860d2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800ad010 con 0x7f8b80151f50 2024-04-20T10:53:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.238+0000 7f8b7f7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8b80072860 0x7f8b800ab4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58726/0 (socket says 172.21.15.90:58726) 2024-04-20T10:53:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.238+0000 7f8b7f7fe640 1 -- 172.21.15.90:0/3380566311 learned_addr learned my addr 172.21.15.90:0/3380566311 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:23.239 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.238+0000 7f8b7ffff640 1 --2- 172.21.15.90:0/3380566311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80151f50 0x7f8b801551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.239+0000 7f8b7e7fc640 1 -- 172.21.15.90:0/3380566311 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3301616429 0 0) 0x7f8b80158780 con 0x7f8b80072860 2024-04-20T10:53:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.239+0000 7f8b7e7fc640 1 -- 172.21.15.90:0/3380566311 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b68003520 con 0x7f8b80072860 2024-04-20T10:53:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.239+0000 7f8b7e7fc640 1 -- 172.21.15.90:0/3380566311 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3123299172 0 0) 0x7f8b801546d0 con 0x7f8b800c45c0 2024-04-20T10:53:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.239+0000 7f8b7e7fc640 1 -- 172.21.15.90:0/3380566311 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b80158780 con 0x7f8b800c45c0 2024-04-20T10:53:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.239+0000 7f8b7ffff640 1 -- 172.21.15.90:0/3380566311 >> v1:172.21.15.175:6789/0 conn(0x7f8b800c45c0 legacy=0x7f8b80151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.239+0000 7f8b7ffff640 1 -- 172.21.15.90:0/3380566311 >> v1:172.21.15.90:6789/0 conn(0x7f8b80072860 legacy=0x7f8b800ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:23.240 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.239+0000 7f8b7ffff640 1 -- 172.21.15.90:0/3380566311 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b801549b0 con 0x7f8b80151f50 2024-04-20T10:53:23.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.240+0000 7f8b7ffff640 1 --2- 172.21.15.90:0/3380566311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80151f50 0x7f8b801551b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b800ad190 tx=0x7f8b7802be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=935c2c5a4359845c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:23.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.240+0000 7f8b7e7fc640 1 -- 172.21.15.90:0/3380566311 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78039070 con 0x7f8b80151f50 2024-04-20T10:53:23.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.240+0000 7f8b7e7fc640 1 -- 172.21.15.90:0/3380566311 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7802cc40 con 0x7f8b80151f50 2024-04-20T10:53:23.241 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.240+0000 7f8b7e7fc640 1 -- 172.21.15.90:0/3380566311 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78034440 con 0x7f8b80151f50 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.241+0000 7f8b860d2640 1 -- 172.21.15.90:0/3380566311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80151f50 msgr2=0x7f8b801551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.241+0000 7f8b860d2640 1 --2- 172.21.15.90:0/3380566311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80151f50 0x7f8b801551b0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b800ad190 tx=0x7f8b7802be90 comp rx=0 tx=0).stop 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.241+0000 7f8b860d2640 1 -- 172.21.15.90:0/3380566311 shutdown_connections 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.241+0000 7f8b860d2640 1 --2- 172.21.15.90:0/3380566311 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80151f50 0x7f8b801551b0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.241+0000 7f8b860d2640 1 -- 172.21.15.90:0/3380566311 >> 172.21.15.90:0/3380566311 conn(0x7f8b80067de0 msgr2=0x7f8b800ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.241+0000 7f8b860d2640 1 -- 172.21.15.90:0/3380566311 shutdown_connections 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.241+0000 7f8b860d2640 1 -- 172.21.15.90:0/3380566311 wait complete. 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.242+0000 7f8b860d2640 1 Processor -- start 2024-04-20T10:53:23.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b860d2640 1 -- start start 2024-04-20T10:53:23.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b860d2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80072860 0x7f8b80156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b860d2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b800c45c0 0x7f8b8013f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b860d2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b80151f50 0x7f8b8013fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b860d2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80158a60 con 0x7f8b80151f50 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b860d2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b80158530 con 0x7f8b800c45c0 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b860d2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8b800abbb0 con 0x7f8b80072860 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.243+0000 7f8b7ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b80151f50 0x7f8b8013fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b80151f50 0x7f8b8013fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33866/0 (socket says 172.21.15.90:33866) 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 -- 172.21.15.90:0/2771864667 learned_addr learned my addr 172.21.15.90:0/2771864667 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7f7fe640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80072860 0x7f8b80156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7effd640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b800c45c0 0x7f8b8013f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 -- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80072860 msgr2=0x7f8b80156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80072860 0x7f8b80156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 -- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b800c45c0 msgr2=0x7f8b8013f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:23.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b800c45c0 0x7f8b8013f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:23.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 -- 172.21.15.90:0/2771864667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b8014e390 con 0x7f8b80151f50 2024-04-20T10:53:23.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b7ffff640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b80151f50 0x7f8b8013fd80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b78037040 tx=0x7f8b78004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:23.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b67fff640 1 -- 172.21.15.90:0/2771864667 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78042030 con 0x7f8b80151f50 2024-04-20T10:53:23.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b67fff640 1 -- 172.21.15.90:0/2771864667 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b7803a040 con 0x7f8b80151f50 2024-04-20T10:53:23.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b8014deb0 con 0x7f8b80151f50 2024-04-20T10:53:23.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b67fff640 1 -- 172.21.15.90:0/2771864667 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b78039070 con 0x7f8b80151f50 2024-04-20T10:53:23.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.244+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b801402c0 con 0x7f8b80151f50 2024-04-20T10:53:23.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.246+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b800ae490 con 0x7f8b80151f50 2024-04-20T10:53:23.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.246+0000 7f8b67fff640 1 -- 172.21.15.90:0/2771864667 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b78045070 con 0x7f8b80151f50 2024-04-20T10:53:23.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.247+0000 7f8b67fff640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:23.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.247+0000 7f8b67fff640 1 -- 172.21.15.90:0/2771864667 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f8b780adb30 con 0x7f8b80151f50 2024-04-20T10:53:23.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.247+0000 7f8b7f7fe640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:23.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.247+0000 7f8b7f7fe640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000f60 tx=0x7f8b70007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:23.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.251+0000 7f8b67fff640 1 -- 172.21.15.90:0/2771864667 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8b7804c070 con 0x7f8b80151f50 2024-04-20T10:53:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.471+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b80076150 con 0x7f8b80151f50 2024-04-20T10:53:23.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.471+0000 7f8b67fff640 1 -- 172.21.15.90:0/2771864667 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7f8b7807b4c0 con 0x7f8b80151f50 2024-04-20T10:53:23.471 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:23.472 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:23.472 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:23.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8b6c06c8f0 msgr2=0x7f8b6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8b70000f60 tx=0x7f8b70007d70 comp rx=0 tx=0).stop 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b80151f50 msgr2=0x7f8b8013fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b80151f50 0x7f8b8013fd80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8b78037040 tx=0x7f8b78004a40 comp rx=0 tx=0).stop 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 shutdown_connections 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8b6c06c8f0 0x7f8b6c06edb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b80151f50 0x7f8b8013fd80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8b800c45c0 0x7f8b8013f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 --2- 172.21.15.90:0/2771864667 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b80072860 0x7f8b80156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 >> 172.21.15.90:0/2771864667 conn(0x7f8b80067de0 msgr2=0x7f8b800ab4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 shutdown_connections 2024-04-20T10:53:23.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:23.473+0000 7f8b860d2640 1 -- 172.21.15.90:0/2771864667 wait complete. 2024-04-20T10:53:23.485 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:25.485 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:25.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.604+0000 7f920fddb640 1 Processor -- start 2024-04-20T10:53:25.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.604+0000 7f920fddb640 1 -- start start 2024-04-20T10:53:25.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920fddb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f920815a510 0x7f92081621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:25.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920fddb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92080af590 con 0x7f9208154040 2024-04-20T10:53:25.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920fddb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92080acd70 con 0x7f92080c4bb0 2024-04-20T10:53:25.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920fddb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f92080acb20 con 0x7f920815a510 2024-04-20T10:53:25.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920db77640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9208154040 0x7f92080730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51862/0 (socket says 172.21.15.90:51862) 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920db77640 1 -- 172.21.15.90:0/3324191330 learned_addr learned my addr 172.21.15.90:0/3324191330 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920e378640 1 --2- 172.21.15.90:0/3324191330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f920815a510 0x7f92081621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920cb75640 1 -- 172.21.15.90:0/3324191330 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4273049889 0 0) 0x7f92080af590 con 0x7f9208154040 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920cb75640 1 -- 172.21.15.90:0/3324191330 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91f4003520 con 0x7f9208154040 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920cb75640 1 -- 172.21.15.90:0/3324191330 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 464671052 0 0) 0x7f92080acd70 con 0x7f92080c4bb0 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920cb75640 1 -- 172.21.15.90:0/3324191330 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92080af590 con 0x7f92080c4bb0 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920e378640 1 -- 172.21.15.90:0/3324191330 >> v1:172.21.15.175:6789/0 conn(0x7f92080c4bb0 legacy=0x7f9208159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920e378640 1 -- 172.21.15.90:0/3324191330 >> v1:172.21.15.90:6789/0 conn(0x7f9208154040 legacy=0x7f92080730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:25.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.605+0000 7f920e378640 1 -- 172.21.15.90:0/3324191330 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92080c6400 con 0x7f920815a510 2024-04-20T10:53:25.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.606+0000 7f920e378640 1 --2- 172.21.15.90:0/3324191330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f920815a510 0x7f92081621f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92000097d0 tx=0x7f920002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8b1d049e0fede08 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:25.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.606+0000 7f920cb75640 1 -- 172.21.15.90:0/3324191330 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200031770 con 0x7f920815a510 2024-04-20T10:53:25.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.606+0000 7f920cb75640 1 -- 172.21.15.90:0/3324191330 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9200037070 con 0x7f920815a510 2024-04-20T10:53:25.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.606+0000 7f920cb75640 1 -- 172.21.15.90:0/3324191330 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9200031b30 con 0x7f920815a510 2024-04-20T10:53:25.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.607+0000 7f920fddb640 1 -- 172.21.15.90:0/3324191330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f920815a510 msgr2=0x7f92081621f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:25.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.607+0000 7f920fddb640 1 --2- 172.21.15.90:0/3324191330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f920815a510 0x7f92081621f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f92000097d0 tx=0x7f920002b810 comp rx=0 tx=0).stop 2024-04-20T10:53:25.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.607+0000 7f920fddb640 1 -- 172.21.15.90:0/3324191330 shutdown_connections 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.607+0000 7f920fddb640 1 --2- 172.21.15.90:0/3324191330 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f920815a510 0x7f92081621f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.607+0000 7f920fddb640 1 -- 172.21.15.90:0/3324191330 >> 172.21.15.90:0/3324191330 conn(0x7f92080676c0 msgr2=0x7f9208067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.607+0000 7f920fddb640 1 -- 172.21.15.90:0/3324191330 shutdown_connections 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.607+0000 7f920fddb640 1 -- 172.21.15.90:0/3324191330 wait complete. 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.608+0000 7f920fddb640 1 Processor -- start 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.608+0000 7f920fddb640 1 -- start start 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920fddb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92080c4bb0 0x7f92081598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920fddb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9208154040 0x7f92081eca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:25.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920fddb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920815a510 0x7f92081effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920fddb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9208073970 con 0x7f9208154040 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920fddb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f92080737f0 con 0x7f920815a510 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920fddb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f92080aeea0 con 0x7f92080c4bb0 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920db77640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92080c4bb0 0x7f92081598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920e378640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920815a510 0x7f92081effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920d376640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9208154040 0x7f92081eca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920db77640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92080c4bb0 0x7f92081598c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:42092/0 (socket says 172.21.15.90:42092) 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920db77640 1 -- 172.21.15.90:0/3073855222 learned_addr learned my addr 172.21.15.90:0/3073855222 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.609+0000 7f920e378640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920815a510 0x7f92081effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:59174/0 (socket says 172.21.15.90:59174) 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920db77640 1 -- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920815a510 msgr2=0x7f92081effd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920db77640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920815a510 0x7f92081effd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920db77640 1 -- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9208154040 msgr2=0x7f92081eca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:25.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920db77640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9208154040 0x7f92081eca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920db77640 1 -- 172.21.15.90:0/3073855222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92081f0510 con 0x7f92080c4bb0 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920db77640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92080c4bb0 0x7f92081598c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f920400cbc0 tx=0x7f920400a430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f91fe7fc640 1 -- 172.21.15.90:0/3073855222 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204017070 con 0x7f92080c4bb0 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f91fe7fc640 1 -- 172.21.15.90:0/3073855222 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920400ad40 con 0x7f92080c4bb0 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f91fe7fc640 1 -- 172.21.15.90:0/3073855222 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204012640 con 0x7f92080c4bb0 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9208159ea0 con 0x7f92080c4bb0 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.610+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92081ef7d0 con 0x7f92080c4bb0 2024-04-20T10:53:25.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.611+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9208153bf0 con 0x7f92080c4bb0 2024-04-20T10:53:25.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.612+0000 7f91fe7fc640 1 -- 172.21.15.90:0/3073855222 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f920401a070 con 0x7f92080c4bb0 2024-04-20T10:53:25.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.612+0000 7f91fe7fc640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f91ec06c8f0 0x7f91ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:25.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.612+0000 7f91fe7fc640 1 -- 172.21.15.90:0/3073855222 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f920408bd30 con 0x7f92080c4bb0 2024-04-20T10:53:25.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.612+0000 7f920d376640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f91ec06c8f0 0x7f91ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:25.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.613+0000 7f920d376640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f91ec06c8f0 0x7f91ec06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91f8007fd0 tx=0x7f91f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:25.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.617+0000 7f91fe7fc640 1 -- 172.21.15.90:0/3073855222 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9208153bf0 con 0x7f92080c4bb0 2024-04-20T10:53:25.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.832+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f92081ef5c0 con 0x7f92080c4bb0 2024-04-20T10:53:25.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.833+0000 7f91fe7fc640 1 -- 172.21.15.90:0/3073855222 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7f9204059730 con 0x7f92080c4bb0 2024-04-20T10:53:25.833 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:25.833 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:25.833 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:25.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f91ec06c8f0 msgr2=0x7f91ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f91ec06c8f0 0x7f91ec06edb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f91f8007fd0 tx=0x7f91f8009040 comp rx=0 tx=0).stop 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92080c4bb0 msgr2=0x7f92081598c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92080c4bb0 0x7f92081598c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f920400cbc0 tx=0x7f920400a430 comp rx=0 tx=0).stop 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 shutdown_connections 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f91ec06c8f0 0x7f91ec06edb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f920815a510 0x7f92081effd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9208154040 0x7f92081eca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 --2- 172.21.15.90:0/3073855222 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f92080c4bb0 0x7f92081598c0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 >> 172.21.15.90:0/3073855222 conn(0x7f92080676c0 msgr2=0x7f9208067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 shutdown_connections 2024-04-20T10:53:25.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:25.835+0000 7f920fddb640 1 -- 172.21.15.90:0/3073855222 wait complete. 2024-04-20T10:53:25.846 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:27.848 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:27.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.955+0000 7fabfdf67640 1 Processor -- start 2024-04-20T10:53:27.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.955+0000 7fabfdf67640 1 -- start start 2024-04-20T10:53:27.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabfdf67640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabf80c27a0 0x7fabf81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:27.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabfdf67640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf80adab0 con 0x7fabf80ad640 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabfdf67640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabf8071690 con 0x7fabf80c54d0 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabfdf67640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fabf8071970 con 0x7fabf80c27a0 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf7fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fabf80ad640 0x7fabf8153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51866/0 (socket says 172.21.15.90:51866) 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf7fff640 1 -- 172.21.15.90:0/4212380902 learned_addr learned my addr 172.21.15.90:0/4212380902 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf77fe640 1 --2- 172.21.15.90:0/4212380902 >> v2:172.21.15.175:3300/0 conn(0x7fabf80c27a0 0x7fabf81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf67fc640 1 -- 172.21.15.90:0/4212380902 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497653458 0 0) 0x7fabf80adab0 con 0x7fabf80ad640 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf67fc640 1 -- 172.21.15.90:0/4212380902 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fabe0003520 con 0x7fabf80ad640 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf77fe640 1 -- 172.21.15.90:0/4212380902 >> v1:172.21.15.175:6789/0 conn(0x7fabf80c54d0 legacy=0x7fabf815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf67fc640 1 -- 172.21.15.90:0/4212380902 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807124072 0 0) 0x7fabf8071690 con 0x7fabf80c54d0 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf77fe640 1 -- 172.21.15.90:0/4212380902 >> v1:172.21.15.90:6789/0 conn(0x7fabf80ad640 legacy=0x7fabf8153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:27.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.956+0000 7fabf77fe640 1 -- 172.21.15.90:0/4212380902 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf8159ce0 con 0x7fabf80c27a0 2024-04-20T10:53:27.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.957+0000 7fabf77fe640 1 --2- 172.21.15.90:0/4212380902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c27a0 0x7fabf81570d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fabec0097a0 tx=0x7fabec02b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79df28f6ec7a01a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.957+0000 7fabf67fc640 1 -- 172.21.15.90:0/4212380902 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabec037070 con 0x7fabf80c27a0 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.957+0000 7fabf67fc640 1 -- 172.21.15.90:0/4212380902 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabec030510 con 0x7fabf80c27a0 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabf67fc640 1 -- 172.21.15.90:0/4212380902 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf00019f0 con 0x7fabf80c27a0 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabfdf67640 1 -- 172.21.15.90:0/4212380902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c27a0 msgr2=0x7fabf81570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabfdf67640 1 --2- 172.21.15.90:0/4212380902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c27a0 0x7fabf81570d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fabec0097a0 tx=0x7fabec02b740 comp rx=0 tx=0).stop 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabfdf67640 1 -- 172.21.15.90:0/4212380902 shutdown_connections 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabfdf67640 1 --2- 172.21.15.90:0/4212380902 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c27a0 0x7fabf81570d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabfdf67640 1 -- 172.21.15.90:0/4212380902 >> 172.21.15.90:0/4212380902 conn(0x7fabf80c9100 msgr2=0x7fabf80c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabfdf67640 1 -- 172.21.15.90:0/4212380902 shutdown_connections 2024-04-20T10:53:27.959 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.958+0000 7fabfdf67640 1 -- 172.21.15.90:0/4212380902 wait complete. 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.959+0000 7fabfdf67640 1 Processor -- start 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.959+0000 7fabfdf67640 1 -- start start 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabfdf67640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabf80ad640 0x7fabf8072770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabfdf67640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabf80c27a0 0x7fabf81ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabfdf67640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c54d0 0x7fabf80c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabfdf67640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fabf80c2b80 con 0x7fabf80c27a0 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabfdf67640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fabf806f510 con 0x7fabf80c54d0 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabfdf67640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fabf80c2d00 con 0x7fabf80ad640 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabf80c27a0 0x7fabf81ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:27.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabf80c27a0 0x7fabf81ec7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60488/0 (socket says 172.21.15.90:60488) 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 -- 172.21.15.90:0/2952097305 learned_addr learned my addr 172.21.15.90:0/2952097305 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf77fe640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabf80ad640 0x7fabf8072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf7fff640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c54d0 0x7fabf80c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 -- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabf80ad640 msgr2=0x7fabf8072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabf80ad640 0x7fabf8072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 -- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c54d0 msgr2=0x7fabf80c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c54d0 0x7fabf80c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf6ffd640 1 -- 172.21.15.90:0/2952097305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabf8073570 con 0x7fabf80c27a0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.960+0000 7fabf7fff640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c54d0 0x7fabf80c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.961+0000 7fabf6ffd640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabf80c27a0 0x7fabf81ec7c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c4b0 tx=0x7fabe800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.961+0000 7fabdffff640 1 -- 172.21.15.90:0/2952097305 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8017070 con 0x7fabf80c27a0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.961+0000 7fabdffff640 1 -- 172.21.15.90:0/2952097305 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabe8005480 con 0x7fabf80c27a0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.961+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabf8071cd0 con 0x7fabf80c27a0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.961+0000 7fabdffff640 1 -- 172.21.15.90:0/2952097305 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabe8003830 con 0x7fabf80c27a0 2024-04-20T10:53:27.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.961+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabf80737e0 con 0x7fabf80c27a0 2024-04-20T10:53:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.962+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabf8076150 con 0x7fabf80c27a0 2024-04-20T10:53:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.962+0000 7fabdffff640 1 -- 172.21.15.90:0/2952097305 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fabe801a070 con 0x7fabf80c27a0 2024-04-20T10:53:27.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.963+0000 7fabdffff640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fabe406c8f0 0x7fabe406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:27.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.963+0000 7fabdffff640 1 -- 172.21.15.90:0/2952097305 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7fabe808b390 con 0x7fabf80c27a0 2024-04-20T10:53:27.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.963+0000 7fabf77fe640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fabe406c8f0 0x7fabe406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:27.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.963+0000 7fabf77fe640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fabe406c8f0 0x7fabe406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fabec034000 tx=0x7fabec008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:27.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:27.967+0000 7fabdffff640 1 -- 172.21.15.90:0/2952097305 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fabe8058c80 con 0x7fabf80c27a0 2024-04-20T10:53:28.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.179+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabf80c52b0 con 0x7fabf80c27a0 2024-04-20T10:53:28.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.179+0000 7fabdffff640 1 -- 172.21.15.90:0/2952097305 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7fabe805cf80 con 0x7fabf80c27a0 2024-04-20T10:53:28.180 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:28.180 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:28.180 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:28.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fabe406c8f0 msgr2=0x7fabe406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fabe406c8f0 0x7fabe406edb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fabec034000 tx=0x7fabec008030 comp rx=0 tx=0).stop 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabf80c27a0 msgr2=0x7fabf81ec7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabf80c27a0 0x7fabf81ec7c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fabe800c4b0 tx=0x7fabe800c970 comp rx=0 tx=0).stop 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 shutdown_connections 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fabe406c8f0 0x7fabe406edb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabf80c54d0 0x7fabf80c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabf80c27a0 0x7fabf81ec7c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 --2- 172.21.15.90:0/2952097305 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabf80ad640 0x7fabf8072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 >> 172.21.15.90:0/2952097305 conn(0x7fabf80c9100 msgr2=0x7fabf80c5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 shutdown_connections 2024-04-20T10:53:28.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:28.181+0000 7fabfdf67640 1 -- 172.21.15.90:0/2952097305 wait complete. 2024-04-20T10:53:28.194 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:30.195 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:30.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f02a1088640 1 Processor -- start 2024-04-20T10:53:30.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f02a1088640 1 -- start start 2024-04-20T10:53:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f02a1088640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c0ab730 0x7f029c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f02a1088640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f029c0c9ee0 0x7f029c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f02a1088640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f029c15a720 con 0x7f029c153ef0 2024-04-20T10:53:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f02a1088640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f029c15ac80 con 0x7f029c0c9ee0 2024-04-20T10:53:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f02a1088640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f029c15a9a0 con 0x7f029c0ab730 2024-04-20T10:53:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.306+0000 7f029b59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f029c0c9ee0 0x7f029c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:30.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.307+0000 7f029b59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f029c0c9ee0 0x7f029c156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60496/0 (socket says 172.21.15.90:60496) 2024-04-20T10:53:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.307+0000 7f029b59e640 1 -- 172.21.15.90:0/2082048730 learned_addr learned my addr 172.21.15.90:0/2082048730 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.307+0000 7f0293fff640 1 --2- 172.21.15.90:0/2082048730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c0ab730 0x7f029c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.307+0000 7f029b59e640 1 -- 172.21.15.90:0/2082048730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c0ab730 msgr2=0x7f029c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.307+0000 7f029b59e640 1 --2- 172.21.15.90:0/2082048730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c0ab730 0x7f029c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.307+0000 7f029b59e640 1 -- 172.21.15.90:0/2082048730 >> v1:172.21.15.90:6789/0 conn(0x7f029c153ef0 legacy=0x7f029c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:30.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.307+0000 7f029b59e640 1 -- 172.21.15.90:0/2082048730 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c0c6a90 con 0x7f029c0c9ee0 2024-04-20T10:53:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f029b59e640 1 --2- 172.21.15.90:0/2082048730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0c9ee0 0x7f029c156e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0294009e50 tx=0x7f029402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64e654d30836da1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f029a59c640 1 -- 172.21.15.90:0/2082048730 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f029402c9e0 con 0x7f029c0c9ee0 2024-04-20T10:53:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f029a59c640 1 -- 172.21.15.90:0/2082048730 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f029402cb80 con 0x7f029c0c9ee0 2024-04-20T10:53:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f029a59c640 1 -- 172.21.15.90:0/2082048730 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02940343f0 con 0x7f029c0c9ee0 2024-04-20T10:53:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 -- 172.21.15.90:0/2082048730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0c9ee0 msgr2=0x7f029c156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:30.309 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 --2- 172.21.15.90:0/2082048730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0c9ee0 0x7f029c156e00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f0294009e50 tx=0x7f029402be40 comp rx=0 tx=0).stop 2024-04-20T10:53:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 -- 172.21.15.90:0/2082048730 shutdown_connections 2024-04-20T10:53:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 --2- 172.21.15.90:0/2082048730 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0c9ee0 0x7f029c156e00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 --2- 172.21.15.90:0/2082048730 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c0ab730 0x7f029c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 -- 172.21.15.90:0/2082048730 >> 172.21.15.90:0/2082048730 conn(0x7f029c0cbfe0 msgr2=0x7f029c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 -- 172.21.15.90:0/2082048730 shutdown_connections 2024-04-20T10:53:30.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.308+0000 7f02a1088640 1 -- 172.21.15.90:0/2082048730 wait complete. 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 Processor -- start 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 -- start start 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0ab730 0x7f029c0b06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c9ee0 0x7f029c155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c153ef0 0x7f029c1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f029c0c9280 con 0x7f029c0ab730 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f029c0c9100 con 0x7f029c0c9ee0 2024-04-20T10:53:30.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.310+0000 7f02a1088640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f029c0bf800 con 0x7f029c153ef0 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0ab730 0x7f029c0b06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0ab730 0x7f029c0b06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60498/0 (socket says 172.21.15.90:60498) 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 -- 172.21.15.90:0/2031947102 learned_addr learned my addr 172.21.15.90:0/2031947102 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f0293fff640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c9ee0 0x7f029c155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029b59e640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c153ef0 0x7f029c1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 -- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c153ef0 msgr2=0x7f029c1509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c153ef0 0x7f029c1509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 -- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c9ee0 msgr2=0x7f029c155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c9ee0 0x7f029c155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 -- 172.21.15.90:0/2031947102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f029c0b0c30 con 0x7f029c0ab730 2024-04-20T10:53:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f0293fff640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c9ee0 0x7f029c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:53:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f029ad9d640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0ab730 0x7f029c0b06f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c460 tx=0x7f028c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f02937fe640 1 -- 172.21.15.90:0/2031947102 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c0052d0 con 0x7f029c0ab730 2024-04-20T10:53:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f02937fe640 1 -- 172.21.15.90:0/2031947102 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f028c012630 con 0x7f029c0ab730 2024-04-20T10:53:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f02937fe640 1 -- 172.21.15.90:0/2031947102 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028c0054b0 con 0x7f029c0ab730 2024-04-20T10:53:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f029c0b0f20 con 0x7f029c0ab730 2024-04-20T10:53:30.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.311+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f029c0b14e0 con 0x7f029c0ab730 2024-04-20T10:53:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.312+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f029c076150 con 0x7f029c0ab730 2024-04-20T10:53:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.313+0000 7f02937fe640 1 -- 172.21.15.90:0/2031947102 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f028c012a20 con 0x7f029c0ab730 2024-04-20T10:53:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.313+0000 7f02937fe640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f027c06c920 0x7f027c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.313+0000 7f02937fe640 1 -- 172.21.15.90:0/2031947102 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f028c08bb60 con 0x7f029c0ab730 2024-04-20T10:53:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.313+0000 7f0293fff640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f027c06c920 0x7f027c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:30.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.314+0000 7f0293fff640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f027c06c920 0x7f027c06ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0284006fd0 tx=0x7f0284008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:30.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.318+0000 7f02937fe640 1 -- 172.21.15.90:0/2031947102 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f029c15a720 con 0x7f029c0ab730 2024-04-20T10:53:30.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.530+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f029c06d070 con 0x7f029c0ab730 2024-04-20T10:53:30.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.531+0000 7f02937fe640 1 -- 172.21.15.90:0/2031947102 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7f028c059b40 con 0x7f029c0ab730 2024-04-20T10:53:30.531 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:30.531 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:30.532 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:30.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f027c06c920 msgr2=0x7f027c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:30.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f027c06c920 0x7f027c06ede0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0284006fd0 tx=0x7f0284008040 comp rx=0 tx=0).stop 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0ab730 msgr2=0x7f029c0b06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0ab730 0x7f029c0b06f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f028c00c460 tx=0x7f028c00c920 comp rx=0 tx=0).stop 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 shutdown_connections 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f027c06c920 0x7f027c06ede0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f029c153ef0 0x7f029c1509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f029c0c9ee0 0x7f029c155d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 --2- 172.21.15.90:0/2031947102 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f029c0ab730 0x7f029c0b06f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 >> 172.21.15.90:0/2031947102 conn(0x7f029c0cbfe0 msgr2=0x7f029c0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 shutdown_connections 2024-04-20T10:53:30.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:30.533+0000 7f02a1088640 1 -- 172.21.15.90:0/2031947102 wait complete. 2024-04-20T10:53:30.544 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:32.545 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:32.660 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.660+0000 7f3343677640 1 Processor -- start 2024-04-20T10:53:32.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.660+0000 7f3343677640 1 -- start start 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.661+0000 7f3343677640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f333c073810 0x7f333c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.661+0000 7f3343677640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.661+0000 7f3343677640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f333c0c4370 con 0x7f333c157710 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.661+0000 7f3343677640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f333c1569e0 con 0x7f333c073810 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.661+0000 7f3343677640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f333c157280 con 0x7f333c0ad0c0 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341c14640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341413640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f333c073810 0x7f333c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:32.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3340c12640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f333c157710 0x7f333c0c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:42988/0 (socket says 172.21.15.90:42988) 2024-04-20T10:53:32.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341c14640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c0ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:42124/0 (socket says 172.21.15.90:42124) 2024-04-20T10:53:32.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3340c12640 1 -- 172.21.15.90:0/2068900123 learned_addr learned my addr 172.21.15.90:0/2068900123 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:32.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341413640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f333c073810 0x7f333c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:59194/0 (socket says 172.21.15.90:59194) 2024-04-20T10:53:32.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341c14640 1 -- 172.21.15.90:0/2068900123 >> v2:172.21.15.175:3300/0 conn(0x7f333c073810 msgr2=0x7f333c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:32.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341c14640 1 --2- 172.21.15.90:0/2068900123 >> v2:172.21.15.175:3300/0 conn(0x7f333c073810 0x7f333c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341c14640 1 -- 172.21.15.90:0/2068900123 >> v1:172.21.15.175:6789/0 conn(0x7f333c157710 legacy=0x7f333c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:32.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.662+0000 7f3341c14640 1 -- 172.21.15.90:0/2068900123 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c156c30 con 0x7f333c0ad0c0 2024-04-20T10:53:32.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.663+0000 7f3341c14640 1 --2- 172.21.15.90:0/2068900123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c0ad540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f333402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=136df177605848a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:32.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.663+0000 7f3333fff640 1 -- 172.21.15.90:0/2068900123 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334039070 con 0x7f333c0ad0c0 2024-04-20T10:53:32.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.663+0000 7f3333fff640 1 -- 172.21.15.90:0/2068900123 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f333402cbc0 con 0x7f333c0ad0c0 2024-04-20T10:53:32.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.663+0000 7f3333fff640 1 -- 172.21.15.90:0/2068900123 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334034440 con 0x7f333c0ad0c0 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 -- 172.21.15.90:0/2068900123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 msgr2=0x7f333c0ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 --2- 172.21.15.90:0/2068900123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c0ad540 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f333402be10 comp rx=0 tx=0).stop 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 -- 172.21.15.90:0/2068900123 shutdown_connections 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 --2- 172.21.15.90:0/2068900123 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c0ad540 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 --2- 172.21.15.90:0/2068900123 >> v2:172.21.15.175:3300/0 conn(0x7f333c073810 0x7f333c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 -- 172.21.15.90:0/2068900123 >> 172.21.15.90:0/2068900123 conn(0x7f333c0c8080 msgr2=0x7f333c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 -- 172.21.15.90:0/2068900123 shutdown_connections 2024-04-20T10:53:32.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.664+0000 7f3343677640 1 -- 172.21.15.90:0/2068900123 wait complete. 2024-04-20T10:53:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.665+0000 7f3343677640 1 Processor -- start 2024-04-20T10:53:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.665+0000 7f3343677640 1 -- start start 2024-04-20T10:53:32.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3343677640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f333c073810 0x7f333c0c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3343677640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c1def50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3343677640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c157710 0x7f333c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3343677640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f333c0abbb0 con 0x7f333c157710 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3343677640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f333c073bf0 con 0x7f333c073810 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3343677640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f333c0abd30 con 0x7f333c0ad0c0 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c157710 0x7f333c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c157710 0x7f333c071470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60502/0 (socket says 172.21.15.90:60502) 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 -- 172.21.15.90:0/1491811895 learned_addr learned my addr 172.21.15.90:0/1491811895 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3340c12640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c1def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341413640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f333c073810 0x7f333c0c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 -- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 msgr2=0x7f333c1def50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c1def50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 -- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f333c073810 msgr2=0x7f333c0c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:32.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f333c073810 0x7f333c0c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 -- 172.21.15.90:0/1491811895 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c0c6ea0 con 0x7f333c157710 2024-04-20T10:53:32.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3341c14640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c157710 0x7f333c071470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f3334004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:32.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.666+0000 7f3331ffb640 1 -- 172.21.15.90:0/1491811895 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334039050 con 0x7f333c157710 2024-04-20T10:53:32.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.667+0000 7f3331ffb640 1 -- 172.21.15.90:0/1491811895 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3334045070 con 0x7f333c157710 2024-04-20T10:53:32.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.667+0000 7f3331ffb640 1 -- 172.21.15.90:0/1491811895 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3334009450 con 0x7f333c157710 2024-04-20T10:53:32.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.667+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f333c1e0a00 con 0x7f333c157710 2024-04-20T10:53:32.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.667+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f333c14ea90 con 0x7f333c157710 2024-04-20T10:53:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.668+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f333c076150 con 0x7f333c157710 2024-04-20T10:53:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.668+0000 7f3331ffb640 1 -- 172.21.15.90:0/1491811895 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f333403e850 con 0x7f333c157710 2024-04-20T10:53:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.669+0000 7f3331ffb640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f332006c920 0x7f332006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.669+0000 7f3331ffb640 1 -- 172.21.15.90:0/1491811895 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f33340aeb50 con 0x7f333c157710 2024-04-20T10:53:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.669+0000 7f3341413640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f332006c920 0x7f332006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:32.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.669+0000 7f3341413640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f332006c920 0x7f332006ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3338009ad0 tx=0x7f3338008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:32.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.673+0000 7f3331ffb640 1 -- 172.21.15.90:0/1491811895 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f333407cbc0 con 0x7f333c157710 2024-04-20T10:53:32.886 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.886+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f333c0c3b40 con 0x7f333c157710 2024-04-20T10:53:32.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.887+0000 7f3331ffb640 1 -- 172.21.15.90:0/1491811895 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7f333407c4c0 con 0x7f333c157710 2024-04-20T10:53:32.888 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:32.888 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:32.888 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:32.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f332006c920 msgr2=0x7f332006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:32.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f332006c920 0x7f332006ede0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3338009ad0 tx=0x7f3338008040 comp rx=0 tx=0).stop 2024-04-20T10:53:32.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c157710 msgr2=0x7f333c071470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:32.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c157710 0x7f333c071470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3334009d90 tx=0x7f3334004a40 comp rx=0 tx=0).stop 2024-04-20T10:53:32.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 shutdown_connections 2024-04-20T10:53:32.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f332006c920 0x7f332006ede0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f333c157710 0x7f333c071470 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f333c0ad0c0 0x7f333c1def50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 --2- 172.21.15.90:0/1491811895 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f333c073810 0x7f333c0c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:32.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 >> 172.21.15.90:0/1491811895 conn(0x7f333c0c8080 msgr2=0x7f333c074f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:32.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 shutdown_connections 2024-04-20T10:53:32.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:32.889+0000 7f3343677640 1 -- 172.21.15.90:0/1491811895 wait complete. 2024-04-20T10:53:32.901 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:34.902 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:35.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.019+0000 7f7caf24e640 1 Processor -- start 2024-04-20T10:53:35.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.019+0000 7f7caf24e640 1 -- start start 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7caf24e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca8154480 0x7f7ca8157a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7caf24e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7ca80aba60 0x7f7ca80abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7caf24e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ca8073ba0 con 0x7f7ca8151b10 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7caf24e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7ca8151ef0 con 0x7f7ca80aba60 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7caf24e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca81589a0 con 0x7f7ca8154480 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7cacfea640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f7ca8151b10 0x7f7ca80725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51882/0 (socket says 172.21.15.90:51882) 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7cacfea640 1 -- 172.21.15.90:0/3490099920 learned_addr learned my addr 172.21.15.90:0/3490099920 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca7fff640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca8154480 0x7f7ca8157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7cad7eb640 1 --2- 172.21.15.90:0/3490099920 >> v2:172.21.15.175:3300/0 conn(0x7f7ca80aba60 0x7f7ca80abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374559594 0 0) 0x7f7ca8073ba0 con 0x7f7ca8151b10 2024-04-20T10:53:35.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c98003520 con 0x7f7ca8151b10 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4249387593 0 0) 0x7f7c98003520 con 0x7f7ca8151b10 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca8154480 msgr2=0x7f7ca8157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca8154480 0x7f7ca8157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 >> v2:172.21.15.175:3300/0 conn(0x7f7ca80aba60 msgr2=0x7f7ca80abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 --2- 172.21.15.90:0/3490099920 >> v2:172.21.15.175:3300/0 conn(0x7f7ca80aba60 0x7f7ca80abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca8158100 con 0x7f7ca8151b10 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f7c9c001670 con 0x7f7ca8151b10 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 >> v1:172.21.15.90:6789/0 conn(0x7f7ca8151b10 legacy=0x7f7ca80725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c980039b0 0x7f7c98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c98004800 0x7f7c98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c980051c0 0x7f7c9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca8151ef0 con 0x7f7c980051c0 2024-04-20T10:53:35.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca81589a0 con 0x7f7c980039b0 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.020+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9800bf50 con 0x7f7c98004800 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7cad7eb640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c980051c0 0x7f7c9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7cacfea640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c980039b0 0x7f7c98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7ca7fff640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c98004800 0x7f7c98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7cad7eb640 1 -- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c98004800 msgr2=0x7f7c98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7cad7eb640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c98004800 0x7f7c98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7cad7eb640 1 -- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c980039b0 msgr2=0x7f7c98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7cad7eb640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7c980039b0 0x7f7c98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7cad7eb640 1 -- 172.21.15.90:0/3490099920 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c98003520 con 0x7f7c980051c0 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.021+0000 7f7ca7fff640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7c98004800 0x7f7c98004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.022+0000 7f7cad7eb640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c980051c0 0x7f7c9800b9c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009fc0 tx=0x7f7c98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516923a8d5a523f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.022+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0039070 con 0x7f7c980051c0 2024-04-20T10:53:35.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.022+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ca002cc60 con 0x7f7c980051c0 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.022+0000 7f7ca77fe640 1 -- 172.21.15.90:0/3490099920 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca0009c10 con 0x7f7c980051c0 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.023+0000 7f7caf24e640 1 -- 172.21.15.90:0/3490099920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c980051c0 msgr2=0x7f7c9800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.023+0000 7f7caf24e640 1 --2- 172.21.15.90:0/3490099920 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7c980051c0 0x7f7c9800b9c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f7ca0009fc0 tx=0x7f7c98005830 comp rx=0 tx=0).stop 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.023+0000 7f7cad7eb640 1 -- 172.21.15.90:0/3490099920 reap_dead start 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.023+0000 7f7caf24e640 1 -- 172.21.15.90:0/3490099920 shutdown_connections 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.023+0000 7f7caf24e640 1 -- 172.21.15.90:0/3490099920 >> 172.21.15.90:0/3490099920 conn(0x7f7ca80ca0a0 msgr2=0x7f7ca80ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.023+0000 7f7caf24e640 1 -- 172.21.15.90:0/3490099920 shutdown_connections 2024-04-20T10:53:35.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.023+0000 7f7caf24e640 1 -- 172.21.15.90:0/3490099920 wait complete. 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.024+0000 7f7caf24e640 1 Processor -- start 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.024+0000 7f7caf24e640 1 -- start start 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.024+0000 7f7caf24e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca814fdf0 0x7f7ca81501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7caf24e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca8144d60 0x7f7ca81451a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7caf24e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ca80ad2f0 0x7f7ca80ad770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7caf24e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca80ab540 con 0x7f7ca8144d60 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7caf24e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7ca81586c0 con 0x7f7ca80ad2f0 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7caf24e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7ca8072d00 con 0x7f7ca814fdf0 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca8144d60 0x7f7ca81451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca8144d60 0x7f7ca81451a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60518/0 (socket says 172.21.15.90:60518) 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 -- 172.21.15.90:0/2303242990 learned_addr learned my addr 172.21.15.90:0/2303242990 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7cad7eb640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ca80ad2f0 0x7f7ca80ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7cacfea640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca814fdf0 0x7f7ca81501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 -- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca814fdf0 msgr2=0x7f7ca81501d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca814fdf0 0x7f7ca81501d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 -- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ca80ad2f0 msgr2=0x7f7ca80ad770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ca80ad2f0 0x7f7ca80ad770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 -- 172.21.15.90:0/2303242990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ca8156370 con 0x7f7ca8144d60 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca7fff640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca8144d60 0x7f7ca81451a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7c940116b0 tx=0x7f7c94011b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:35.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca57fa640 1 -- 172.21.15.90:0/2303242990 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9400f960 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca57fa640 1 -- 172.21.15.90:0/2303242990 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c9400fb00 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7ca57fa640 1 -- 172.21.15.90:0/2303242990 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c94015460 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ca8156650 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.025+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ca80acdd0 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.026+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ca8076150 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.027+0000 7f7ca57fa640 1 -- 172.21.15.90:0/2303242990 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c94015600 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.027+0000 7f7ca57fa640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7c8c06c920 0x7f7c8c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.027+0000 7f7ca57fa640 1 -- 172.21.15.90:0/2303242990 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6809+0+0 (secure 0 0 0) 0x7f7c9408c790 con 0x7f7ca8144d60 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.027+0000 7f7cacfea640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7c8c06c920 0x7f7c8c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:35.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.028+0000 7f7cacfea640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7c8c06c920 0x7f7c8c06ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007c10 tx=0x7f7c9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:35.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.032+0000 7f7ca57fa640 1 -- 172.21.15.90:0/2303242990 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7c94019030 con 0x7f7ca8144d60 2024-04-20T10:53:35.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.247+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ca8156890 con 0x7f7ca8144d60 2024-04-20T10:53:35.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.248+0000 7f7ca57fa640 1 -- 172.21.15.90:0/2303242990 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) ==== 94+0+6533 (secure 0 0 0) 0x7f7c9405a800 con 0x7f7ca8144d60 2024-04-20T10:53:35.249 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:35.249 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:52:43.335559+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":28,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":35,"addr":"172.21.15.90:6835/1834995897","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":1834995897},{"type":"v1","addr":"172.21.15.90:6835","nonce":1834995897}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4284,"qdb_cluster":[4284]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:35.249 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 20 2024-04-20T10:53:35.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7c8c06c920 msgr2=0x7f7c8c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:35.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7c8c06c920 0x7f7c8c06ede0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c007c10 tx=0x7f7c9c009040 comp rx=0 tx=0).stop 2024-04-20T10:53:35.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca8144d60 msgr2=0x7f7ca81451a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:35.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca8144d60 0x7f7ca81451a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7c940116b0 tx=0x7f7c94011b70 comp rx=0 tx=0).stop 2024-04-20T10:53:35.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 shutdown_connections 2024-04-20T10:53:35.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7c8c06c920 0x7f7c8c06ede0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7ca80ad2f0 0x7f7ca80ad770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ca8144d60 0x7f7ca81451a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 --2- 172.21.15.90:0/2303242990 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ca814fdf0 0x7f7ca81501d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:35.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 >> 172.21.15.90:0/2303242990 conn(0x7f7ca80ca0a0 msgr2=0x7f7ca80725f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:35.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 shutdown_connections 2024-04-20T10:53:35.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:35.250+0000 7f7caf24e640 1 -- 172.21.15.90:0/2303242990 wait complete. 2024-04-20T10:53:35.261 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:53:37.262 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.376+0000 7f9d2f8fd640 1 Processor -- start 2024-04-20T10:53:37.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.376+0000 7f9d2f8fd640 1 -- start start 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2f8fd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9d280ac2b0 0x7f9d280ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2f8fd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d280c4600 0x7f9d280c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2f8fd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d280acaa0 con 0x7f9d28153d60 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2f8fd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9d280acdf0 con 0x7f9d280ac2b0 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2f8fd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9d2815a750 con 0x7f9d280c4600 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2ce98640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9d280ac2b0 0x7f9d280ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2ce98640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9d280ac2b0 0x7f9d280ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59382/0 (socket says 172.21.15.90:59382) 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.377+0000 7f9d2ce98640 1 -- 172.21.15.90:0/3315274473 learned_addr learned my addr 172.21.15.90:0/3315274473 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:37.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.378+0000 7f9d2de9a640 1 --2- 172.21.15.90:0/3315274473 >> v2:172.21.15.175:3300/0 conn(0x7f9d280c4600 0x7f9d280c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.378+0000 7f9d2ce98640 1 -- 172.21.15.90:0/3315274473 >> v2:172.21.15.175:3300/0 conn(0x7f9d280c4600 msgr2=0x7f9d280c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:37.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.378+0000 7f9d2ce98640 1 --2- 172.21.15.90:0/3315274473 >> v2:172.21.15.175:3300/0 conn(0x7f9d280c4600 0x7f9d280c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.378+0000 7f9d2ce98640 1 -- 172.21.15.90:0/3315274473 >> v1:172.21.15.90:6789/0 conn(0x7f9d28153d60 legacy=0x7f9d280c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.378+0000 7f9d2ce98640 1 -- 172.21.15.90:0/3315274473 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d2815aa30 con 0x7f9d280ac2b0 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2ce98640 1 --2- 172.21.15.90:0/3315274473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d280ac2b0 0x7f9d280ab4a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9d280738d0 tx=0x7f9d1802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81720d5347cba350 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d1ffff640 1 -- 172.21.15.90:0/3315274473 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d1802e070 con 0x7f9d280ac2b0 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d1ffff640 1 -- 172.21.15.90:0/3315274473 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d18037070 con 0x7f9d280ac2b0 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d1ffff640 1 -- 172.21.15.90:0/3315274473 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d18031a00 con 0x7f9d280ac2b0 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/3315274473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d280ac2b0 msgr2=0x7f9d280ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/3315274473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d280ac2b0 0x7f9d280ab4a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9d280738d0 tx=0x7f9d1802b880 comp rx=0 tx=0).stop 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/3315274473 shutdown_connections 2024-04-20T10:53:37.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/3315274473 >> v2:172.21.15.175:3300/0 conn(0x7f9d280c4600 0x7f9d280c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/3315274473 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d280ac2b0 0x7f9d280ab4a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/3315274473 >> 172.21.15.90:0/3315274473 conn(0x7f9d28067de0 msgr2=0x7f9d280ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:37.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.379+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/3315274473 shutdown_connections 2024-04-20T10:53:37.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.380+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/3315274473 wait complete. 2024-04-20T10:53:37.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 Processor -- start 2024-04-20T10:53:37.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 -- start start 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d280ac2b0 0x7f9d2814f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d280c4600 0x7f9d28143530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d28153d60 0x7f9d281ec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28070fa0 con 0x7f9d28153d60 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d28070e20 con 0x7f9d280ac2b0 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2f8fd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9d280c3b20 con 0x7f9d280c4600 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2de9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d28153d60 0x7f9d281ec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2de9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d28153d60 0x7f9d281ec6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59384/0 (socket says 172.21.15.90:59384) 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.381+0000 7f9d2de9a640 1 -- 172.21.15.90:0/2248193610 learned_addr learned my addr 172.21.15.90:0/2248193610 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2ce98640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d280c4600 0x7f9d28143530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2d699640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d280ac2b0 0x7f9d2814f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2de9a640 1 -- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d280c4600 msgr2=0x7f9d28143530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2de9a640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d280c4600 0x7f9d28143530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2de9a640 1 -- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d280ac2b0 msgr2=0x7f9d2814f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2de9a640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d280ac2b0 0x7f9d2814f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2de9a640 1 -- 172.21.15.90:0/2248193610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d281efc00 con 0x7f9d28153d60 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2de9a640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d28153d60 0x7f9d281ec6b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000efc0 tx=0x7f9d2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d1dffb640 1 -- 172.21.15.90:0/2248193610 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20018020 con 0x7f9d28153d60 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d1dffb640 1 -- 172.21.15.90:0/2248193610 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d20014480 con 0x7f9d28153d60 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d281efee0 con 0x7f9d28153d60 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d1dffb640 1 -- 172.21.15.90:0/2248193610 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d20014870 con 0x7f9d28153d60 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.382+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d281f04a0 con 0x7f9d28153d60 2024-04-20T10:53:37.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.384+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d28076150 con 0x7f9d28153d60 2024-04-20T10:53:37.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.384+0000 7f9d1dffb640 1 -- 172.21.15.90:0/2248193610 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d20005d10 con 0x7f9d28153d60 2024-04-20T10:53:37.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.384+0000 7f9d1dffb640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d0c06c920 0x7f9d0c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.385+0000 7f9d2d699640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d0c06c920 0x7f9d0c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.385+0000 7f9d1dffb640 1 -- 172.21.15.90:0/2248193610 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f9d2008c990 con 0x7f9d28153d60 2024-04-20T10:53:37.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.385+0000 7f9d2d699640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d0c06c920 0x7f9d0c06ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d240016e0 tx=0x7f9d24009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:37.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.389+0000 7f9d1dffb640 1 -- 172.21.15.90:0/2248193610 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9d20022070 con 0x7f9d28153d60 2024-04-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.601+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d280696b0 con 0x7f9d28153d60 2024-04-20T10:53:37.601 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.601+0000 7f9d1dffb640 1 -- 172.21.15.90:0/2248193610 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5701 (secure 0 0 0) 0x7f9d20010040 con 0x7f9d28153d60 2024-04-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:36.485343+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:37.602 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 23 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d0c06c920 msgr2=0x7f9d0c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d0c06c920 0x7f9d0c06ede0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9d240016e0 tx=0x7f9d24009040 comp rx=0 tx=0).stop 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d28153d60 msgr2=0x7f9d281ec6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d28153d60 0x7f9d281ec6b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9d2000efc0 tx=0x7f9d2000c490 comp rx=0 tx=0).stop 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 shutdown_connections 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d0c06c920 0x7f9d0c06ede0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d28153d60 0x7f9d281ec6b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d280c4600 0x7f9d28143530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 --2- 172.21.15.90:0/2248193610 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d280ac2b0 0x7f9d2814f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 >> 172.21.15.90:0/2248193610 conn(0x7f9d28067de0 msgr2=0x7f9d28150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:37.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 shutdown_connections 2024-04-20T10:53:37.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.603+0000 7f9d2f8fd640 1 -- 172.21.15.90:0/2248193610 wait complete. 2024-04-20T10:53:37.614 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2024-04-20T10:53:37.614 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-20T10:53:37.615 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:37.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.712+0000 7fb6b2011640 1 Processor -- start 2024-04-20T10:53:37.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.712+0000 7fb6b2011640 1 -- start start 2024-04-20T10:53:37.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6b2011640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb6ac0ab960 0x7fb6ac157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6b2011640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6ac0abdb0 con 0x7fb6ac0ae720 2024-04-20T10:53:37.713 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6b2011640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6ac067a10 con 0x7fb6ac151b40 2024-04-20T10:53:37.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6b2011640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb6ac0c86d0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6abfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb6ac0ab960 0x7fb6ac157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6abfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb6ac0ab960 0x7fb6ac157980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59398/0 (socket says 172.21.15.90:59398) 2024-04-20T10:53:37.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6abfff640 1 -- 172.21.15.90:0/2323845553 learned_addr learned my addr 172.21.15.90:0/2323845553 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:37.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6abfff640 1 -- 172.21.15.90:0/2323845553 >> v1:172.21.15.175:6789/0 conn(0x7fb6ac151b40 legacy=0x7fb6ac0c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:37.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6abfff640 1 -- 172.21.15.90:0/2323845553 >> v1:172.21.15.90:6789/0 conn(0x7fb6ac0ae720 legacy=0x7fb6ac0adee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.713+0000 7fb6abfff640 1 -- 172.21.15.90:0/2323845553 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac067cf0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.714+0000 7fb6abfff640 1 --2- 172.21.15.90:0/2323845553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac157980 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009e50 tx=0x7fb6a402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cf791fd8f77cff server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:37.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.714+0000 7fb6aa7fc640 1 -- 172.21.15.90:0/2323845553 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a402c9f0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.714+0000 7fb6aa7fc640 1 -- 172.21.15.90:0/2323845553 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a402cb90 con 0x7fb6ac0ab960 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.714+0000 7fb6aa7fc640 1 -- 172.21.15.90:0/2323845553 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a40343f0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.714+0000 7fb6b2011640 1 -- 172.21.15.90:0/2323845553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 msgr2=0x7fb6ac157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.714+0000 7fb6b2011640 1 --2- 172.21.15.90:0/2323845553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac157980 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4009e50 tx=0x7fb6a402be50 comp rx=0 tx=0).stop 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.715+0000 7fb6b2011640 1 -- 172.21.15.90:0/2323845553 shutdown_connections 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.715+0000 7fb6b2011640 1 --2- 172.21.15.90:0/2323845553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac157980 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.715+0000 7fb6b2011640 1 -- 172.21.15.90:0/2323845553 >> 172.21.15.90:0/2323845553 conn(0x7fb6ac0aa660 msgr2=0x7fb6ac0aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.715+0000 7fb6b2011640 1 -- 172.21.15.90:0/2323845553 shutdown_connections 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.715+0000 7fb6b2011640 1 -- 172.21.15.90:0/2323845553 wait complete. 2024-04-20T10:53:37.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 Processor -- start 2024-04-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 -- start start 2024-04-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac14d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0ae720 0x7fb6ac147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac151b40 0x7fb6ac147d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac0c82f0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac158710 con 0x7fb6ac151b40 2024-04-20T10:53:37.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.716+0000 7fb6b2011640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ac0c8470 con 0x7fb6ac0ae720 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac14d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac14d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59400/0 (socket says 172.21.15.90:59400) 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 -- 172.21.15.90:0/536885822 learned_addr learned my addr 172.21.15.90:0/536885822 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6abfff640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac151b40 0x7fb6ac147d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0ae720 0x7fb6ac147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 -- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0ae720 msgr2=0x7fb6ac147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0ae720 0x7fb6ac147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 -- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac151b40 msgr2=0x7fb6ac147d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac151b40 0x7fb6ac147d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 -- 172.21.15.90:0/536885822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac1ee0a0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0ae720 0x7fb6ac147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6abfff640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac151b40 0x7fb6ac147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:37.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac14d600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c460 tx=0x7fb69c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb693fff640 1 -- 172.21.15.90:0/536885822 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c011790 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb693fff640 1 -- 172.21.15.90:0/536885822 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c017070 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ac1ee380 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb693fff640 1 -- 172.21.15.90:0/536885822 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c011bb0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.717+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ac1ee940 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.718+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ac0c7810 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.719+0000 7fb693fff640 1 -- 172.21.15.90:0/536885822 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb69c01c460 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.719+0000 7fb693fff640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.719+0000 7fb693fff640 1 -- 172.21.15.90:0/536885822 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7fb69c08bdc0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.719+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:37.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.720+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac149e90 tx=0x7fb6a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:37.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.723+0000 7fb693fff640 1 -- 172.21.15.90:0/536885822 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb6ac0c7810 con 0x7fb6ac0ab960 2024-04-20T10:53:37.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.939+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6ac076150 con 0x7fb6ac0ab960 2024-04-20T10:53:37.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.940+0000 7fb693fff640 1 -- 172.21.15.90:0/536885822 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5701 (secure 0 0 0) 0x7fb69c059de0 con 0x7fb6ac0ab960 2024-04-20T10:53:37.940 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:37.940 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:36.485343+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:37.941 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 23 2024-04-20T10:53:37.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 msgr2=0x7fb69806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac149e90 tx=0x7fb6a0009040 comp rx=0 tx=0).stop 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 msgr2=0x7fb6ac14d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac14d600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb69c00c460 tx=0x7fb69c00c920 comp rx=0 tx=0).stop 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 shutdown_connections 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac151b40 0x7fb6ac147d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0ae720 0x7fb6ac147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 --2- 172.21.15.90:0/536885822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0ab960 0x7fb6ac14d600 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 >> 172.21.15.90:0/536885822 conn(0x7fb6ac0aa660 msgr2=0x7fb6ac0ad4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 shutdown_connections 2024-04-20T10:53:37.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:37.942+0000 7fb6b2011640 1 -- 172.21.15.90:0/536885822 wait complete. 2024-04-20T10:53:37.954 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 23, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 23, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5271": { "addr": "172.21.15.90:6837/1538296646", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6836", "nonce": 1538296646, "type": "v2" }, { "addr": "172.21.15.90:6837", "nonce": 1538296646, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5271, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:rejoin", "state_seq": 13 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:53:36.485343+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5271 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 18, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4282": { "addr": "172.21.15.175:6833/1855171726", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6832", "nonce": 1855171726, "type": "v2" }, { "addr": "172.21.15.175:6833", "nonce": 1855171726, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4282, "incarnation": 15, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 36 } }, "last_failure": 0, "last_failure_osd_epoch": 29, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:52:44.337276+0000", "qdb_cluster": [ 4282 ], "qdb_leader": 4282, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4282 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:53:39.955 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:40.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.055+0000 7f4c749a4640 1 Processor -- start 2024-04-20T10:53:40.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.055+0000 7f4c749a4640 1 -- start start 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.056+0000 7f4c749a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c70153ef0 0x7f4c700c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.056+0000 7f4c749a4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4c700ab730 0x7f4c701568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.056+0000 7f4c749a4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7015a720 con 0x7f4c700c9ee0 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.056+0000 7f4c749a4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7015ac80 con 0x7f4c700ab730 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.056+0000 7f4c749a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7015a9a0 con 0x7f4c70153ef0 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.056+0000 7f4c6ed9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4c700c9ee0 0x7f4c70156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41256/0 (socket says 172.21.15.90:41256) 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.056+0000 7f4c6ed9d640 1 -- 172.21.15.90:0/1090438928 learned_addr learned my addr 172.21.15.90:0/1090438928 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6e59c640 1 --2- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c70153ef0 0x7f4c700c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6dd9b640 1 --2- 172.21.15.90:0/1090438928 >> v2:172.21.15.175:3300/0 conn(0x7f4c700ab730 0x7f4c701568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:40.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6d59a640 1 -- 172.21.15.90:0/1090438928 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001284719 0 0) 0x7f4c68001490 con 0x7f4c700c9ee0 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6d59a640 1 -- 172.21.15.90:0/1090438928 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c58003520 con 0x7f4c700c9ee0 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6d59a640 1 -- 172.21.15.90:0/1090438928 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 306248429 0 0) 0x7f4c58003520 con 0x7f4c700c9ee0 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6dd9b640 1 -- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c70153ef0 msgr2=0x7f4c700c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6dd9b640 1 --2- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c70153ef0 0x7f4c700c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6dd9b640 1 -- 172.21.15.90:0/1090438928 >> v1:172.21.15.90:6789/0 conn(0x7f4c700c9ee0 legacy=0x7f4c70156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6dd9b640 1 -- 172.21.15.90:0/1090438928 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c700c6a90 con 0x7f4c700ab730 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.057+0000 7f4c6e59c640 1 --2- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c70153ef0 0x7f4c700c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c6dd9b640 1 --2- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c700ab730 0x7f4c701568c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c600097a0 tx=0x7f4c6002b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dcad671085e81ef server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c6d59a640 1 -- 172.21.15.90:0/1090438928 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60037070 con 0x7f4c700ab730 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c6d59a640 1 -- 172.21.15.90:0/1090438928 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c60030510 con 0x7f4c700ab730 2024-04-20T10:53:40.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c6d59a640 1 -- 172.21.15.90:0/1090438928 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6002be60 con 0x7f4c700ab730 2024-04-20T10:53:40.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c749a4640 1 -- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c700ab730 msgr2=0x7f4c701568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:40.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c749a4640 1 --2- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c700ab730 0x7f4c701568c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f4c600097a0 tx=0x7f4c6002b660 comp rx=0 tx=0).stop 2024-04-20T10:53:40.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c749a4640 1 -- 172.21.15.90:0/1090438928 shutdown_connections 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c749a4640 1 --2- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c700ab730 0x7f4c701568c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c749a4640 1 --2- 172.21.15.90:0/1090438928 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c70153ef0 0x7f4c700c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.058+0000 7f4c749a4640 1 -- 172.21.15.90:0/1090438928 >> 172.21.15.90:0/1090438928 conn(0x7f4c700cbfe0 msgr2=0x7f4c700cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.059+0000 7f4c749a4640 1 -- 172.21.15.90:0/1090438928 shutdown_connections 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.059+0000 7f4c749a4640 1 -- 172.21.15.90:0/1090438928 wait complete. 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 Processor -- start 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 -- start start 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700ab730 0x7f4c70159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700c9ee0 0x7f4c700c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c700b1070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c700bf800 con 0x7f4c700c9ee0 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c70157510 con 0x7f4c70153ef0 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c749a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4c701f0660 con 0x7f4c700ab730 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.060+0000 7f4c6dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700c9ee0 0x7f4c700c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:40.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700c9ee0 0x7f4c700c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59406/0 (socket says 172.21.15.90:59406) 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 -- 172.21.15.90:0/2178055228 learned_addr learned my addr 172.21.15.90:0/2178055228 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6e59c640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700ab730 0x7f4c70159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6ed9d640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c700b1070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 -- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700ab730 msgr2=0x7f4c70159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700ab730 0x7f4c70159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 -- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 msgr2=0x7f4c700b1070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c700b1070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 -- 172.21.15.90:0/2178055228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c700b0870 con 0x7f4c700c9ee0 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6e59c640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700ab730 0x7f4c70159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6ed9d640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c700b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c6dd9b640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700c9ee0 0x7f4c700c3b10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4c6002b6a0 tx=0x7f4c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c5effd640 1 -- 172.21.15.90:0/2178055228 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60041020 con 0x7f4c700c9ee0 2024-04-20T10:53:40.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c5effd640 1 -- 172.21.15.90:0/2178055228 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6003c890 con 0x7f4c700c9ee0 2024-04-20T10:53:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c700b0b50 con 0x7f4c700c9ee0 2024-04-20T10:53:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c5effd640 1 -- 172.21.15.90:0/2178055228 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60037040 con 0x7f4c700c9ee0 2024-04-20T10:53:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.061+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c700b15b0 con 0x7f4c700c9ee0 2024-04-20T10:53:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.062+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c70076150 con 0x7f4c700c9ee0 2024-04-20T10:53:40.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.063+0000 7f4c5effd640 1 -- 172.21.15.90:0/2178055228 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c60044020 con 0x7f4c700c9ee0 2024-04-20T10:53:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.063+0000 7f4c5effd640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5006c920 0x7f4c5006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.063+0000 7f4c5effd640 1 -- 172.21.15.90:0/2178055228 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f4c600ad220 con 0x7f4c700c9ee0 2024-04-20T10:53:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.063+0000 7f4c6e59c640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5006c920 0x7f4c5006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:40.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.063+0000 7f4c6e59c640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5006c920 0x7f4c5006ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009560 tx=0x7f4c64009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:40.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.067+0000 7f4c5effd640 1 -- 172.21.15.90:0/2178055228 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4c6004b070 con 0x7f4c700c9ee0 2024-04-20T10:53:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.298+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c700b0d20 con 0x7f4c700c9ee0 2024-04-20T10:53:40.298 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.298+0000 7f4c5effd640 1 -- 172.21.15.90:0/2178055228 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5708 (secure 0 0 0) 0x7f4c6007abf0 con 0x7f4c700c9ee0 2024-04-20T10:53:40.298 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:40.299 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:40.299 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 25 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5006c920 msgr2=0x7f4c5006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5006c920 0x7f4c5006ede0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009560 tx=0x7f4c64009190 comp rx=0 tx=0).stop 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700c9ee0 msgr2=0x7f4c700c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700c9ee0 0x7f4c700c3b10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4c6002b6a0 tx=0x7f4c600046c0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 shutdown_connections 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5006c920 0x7f4c5006ede0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c700b1070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700c9ee0 0x7f4c700c3b10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 --2- 172.21.15.90:0/2178055228 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700ab730 0x7f4c70159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 >> 172.21.15.90:0/2178055228 conn(0x7f4c700cbfe0 msgr2=0x7f4c70152bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.300+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 shutdown_connections 2024-04-20T10:53:40.301 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:40.301+0000 7f4c749a4640 1 -- 172.21.15.90:0/2178055228 wait complete. 2024-04-20T10:53:40.312 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=4284 2024-04-20T10:53:40.312 INFO:tasks.mds_thrash.fs.[a]:waiting for 4 secs before reviving mds.a 2024-04-20T10:53:40.586 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:53:40.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:53:42.929 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-04-20T10:53:42.929+0000 7fe73b75b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:53:44.313 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2024-04-20T10:53:44.314 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-20T10:53:44.314 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-20T10:53:44.318 INFO:tasks.ceph.mds.a:Started 2024-04-20T10:53:44.318 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:44.402 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-20T10:53:44.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.428+0000 7fda478f2640 1 Processor -- start 2024-04-20T10:53:44.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.429+0000 7fda478f2640 1 -- start start 2024-04-20T10:53:44.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.429+0000 7fda478f2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fda40153ef0 0x7fda400c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.429+0000 7fda478f2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda4015a720 con 0x7fda400c9ee0 2024-04-20T10:53:44.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.429+0000 7fda478f2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda4015ac80 con 0x7fda400ab730 2024-04-20T10:53:44.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.429+0000 7fda478f2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fda4015a9a0 con 0x7fda40153ef0 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.429+0000 7fda45e8f640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fda400c9ee0 0x7fda40156fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:41280/0 (socket says 172.21.15.90:41280) 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda45e8f640 1 -- 172.21.15.90:0/2275067410 learned_addr learned my addr 172.21.15.90:0/2275067410 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3554057539 0 0) 0x7fda38001490 con 0x7fda400c9ee0 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda4568e640 1 --2- 172.21.15.90:0/2275067410 >> v2:172.21.15.175:3300/0 conn(0x7fda40153ef0 0x7fda400c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda2c003520 con 0x7fda400c9ee0 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2921233550 0 0) 0x7fda2c003520 con 0x7fda400c9ee0 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 >> v2:172.21.15.175:3300/0 conn(0x7fda40153ef0 msgr2=0x7fda400c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 --2- 172.21.15.90:0/2275067410 >> v2:172.21.15.175:3300/0 conn(0x7fda40153ef0 0x7fda400c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 >> v1:172.21.15.175:6789/0 conn(0x7fda400ab730 legacy=0x7fda401568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda400c6a90 con 0x7fda400c9ee0 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fda38001bc0 con 0x7fda400c9ee0 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 >> v1:172.21.15.90:6789/0 conn(0x7fda400c9ee0 legacy=0x7fda40156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:44.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda2c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda2c004800 0x7fda2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda2c0053c0 0x7fda2c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda4015a9a0 con 0x7fda2c0039b0 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda2c00c250 con 0x7fda2c0053c0 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fda2c00c450 con 0x7fda2c004800 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda4568e640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda2c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda45e8f640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda2c0053c0 0x7fda2c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.430+0000 7fda44e8d640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda2c004800 0x7fda2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda4568e640 1 -- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda2c004800 msgr2=0x7fda2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda4568e640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda2c004800 0x7fda2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda4568e640 1 -- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda2c0053c0 msgr2=0x7fda2c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda4568e640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda2c0053c0 0x7fda2c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda4568e640 1 -- 172.21.15.90:0/2275067410 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2c003520 con 0x7fda2c0039b0 2024-04-20T10:53:44.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda45e8f640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda2c0053c0 0x7fda2c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda45e8f640 1 -- 172.21.15.90:0/2275067410 reap_dead start 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda4568e640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda2c003dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00ba30 tx=0x7fda2c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32413583e56a607 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c036020 con 0x7fda2c0039b0 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c032640 con 0x7fda2c0039b0 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.431+0000 7fda37fff640 1 -- 172.21.15.90:0/2275067410 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c00b600 con 0x7fda2c0039b0 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.432+0000 7fda478f2640 1 -- 172.21.15.90:0/2275067410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 msgr2=0x7fda2c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.432+0000 7fda478f2640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda2c003dd0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fda3c00ba30 tx=0x7fda2c005830 comp rx=0 tx=0).stop 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.432+0000 7fda478f2640 1 -- 172.21.15.90:0/2275067410 shutdown_connections 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.432+0000 7fda478f2640 1 --2- 172.21.15.90:0/2275067410 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda2c003dd0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.432+0000 7fda478f2640 1 -- 172.21.15.90:0/2275067410 >> 172.21.15.90:0/2275067410 conn(0x7fda400cbfe0 msgr2=0x7fda400cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.432+0000 7fda478f2640 1 -- 172.21.15.90:0/2275067410 shutdown_connections 2024-04-20T10:53:44.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.432+0000 7fda478f2640 1 -- 172.21.15.90:0/2275067410 wait complete. 2024-04-20T10:53:44.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.433+0000 7fda478f2640 1 Processor -- start 2024-04-20T10:53:44.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.433+0000 7fda478f2640 1 -- start start 2024-04-20T10:53:44.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda478f2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda401ed850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda478f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda400ab2d0 0x7fda401efbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda478f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda401567c0 0x7fda400b0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda478f2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fda400bf800 con 0x7fda2c0039b0 2024-04-20T10:53:44.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda478f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fda400c89f0 con 0x7fda400ab2d0 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda478f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fda400bfe90 con 0x7fda401567c0 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda401ed850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda401ed850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59456/0 (socket says 172.21.15.90:59456) 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 -- 172.21.15.90:0/1701701568 learned_addr learned my addr 172.21.15.90:0/1701701568 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 -- 172.21.15.90:0/1701701568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda401567c0 msgr2=0x7fda400b0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda401567c0 0x7fda400b0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 -- 172.21.15.90:0/1701701568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda400ab2d0 msgr2=0x7fda401efbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda44e8d640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda400ab2d0 0x7fda401efbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda400ab2d0 0x7fda401efbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 -- 172.21.15.90:0/1701701568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda400b07c0 con 0x7fda2c0039b0 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.434+0000 7fda4568e640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda401ed850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda3c035040 tx=0x7fda3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:44.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.435+0000 7fda35ffb640 1 -- 172.21.15.90:0/1701701568 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c041070 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.435+0000 7fda35ffb640 1 -- 172.21.15.90:0/1701701568 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda3c0309d0 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.435+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda401f0500 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.435+0000 7fda35ffb640 1 -- 172.21.15.90:0/1701701568 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3c036040 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.435+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda401f07e0 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.436+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda40076150 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.437+0000 7fda35ffb640 1 -- 172.21.15.90:0/1701701568 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fda3c04c060 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.437+0000 7fda35ffb640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda2406c8f0 0x7fda2406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.437+0000 7fda35ffb640 1 -- 172.21.15.90:0/1701701568 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7fda3c0ae0a0 con 0x7fda2c0039b0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.437+0000 7fda44e8d640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda2406c8f0 0x7fda2406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:44.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.437+0000 7fda44e8d640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda2406c8f0 0x7fda2406edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda30007fd0 tx=0x7fda30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:44.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.441+0000 7fda35ffb640 1 -- 172.21.15.90:0/1701701568 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fda3c07c030 con 0x7fda2c0039b0 2024-04-20T10:53:44.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.666+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fda4006d070 con 0x7fda2c0039b0 2024-04-20T10:53:44.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.666+0000 7fda35ffb640 1 -- 172.21.15.90:0/1701701568 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+5708 (secure 0 0 0) 0x7fda3c07b930 con 0x7fda2c0039b0 2024-04-20T10:53:44.666 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:44.667 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:44.667 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 25 2024-04-20T10:53:44.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda2406c8f0 msgr2=0x7fda2406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:44.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda2406c8f0 0x7fda2406edb0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fda30007fd0 tx=0x7fda30009040 comp rx=0 tx=0).stop 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 msgr2=0x7fda401ed850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda401ed850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fda3c035040 tx=0x7fda3c004730 comp rx=0 tx=0).stop 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 shutdown_connections 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fda2406c8f0 0x7fda2406edb0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fda401567c0 0x7fda400b0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fda400ab2d0 0x7fda401efbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 --2- 172.21.15.90:0/1701701568 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fda2c0039b0 0x7fda401ed850 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 >> 172.21.15.90:0/1701701568 conn(0x7fda400cbfe0 msgr2=0x7fda400cac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 shutdown_connections 2024-04-20T10:53:44.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:44.668+0000 7fda478f2640 1 -- 172.21.15.90:0/1701701568 wait complete. 2024-04-20T10:53:44.679 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-04-20T10:53:46.680 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.779+0000 7f99cb68e640 1 Processor -- start 2024-04-20T10:53:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.779+0000 7f99cb68e640 1 -- start start 2024-04-20T10:53:46.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.779+0000 7f99cb68e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 0x7f99c40c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.779+0000 7f99cb68e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f99c40c23f0 0x7f99c4157170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.779+0000 7f99cb68e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99c40c2880 con 0x7f99c406ef90 2024-04-20T10:53:46.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.779+0000 7f99cb68e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f99c40c4480 con 0x7f99c40c23f0 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.779+0000 7f99cb68e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99c41576b0 con 0x7f99c40c7bf0 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99c8c29640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f99c406ef90 0x7f99c40c1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51794/0 (socket says 172.21.15.90:51794) 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99c8c29640 1 -- 172.21.15.90:0/3232334163 learned_addr learned my addr 172.21.15.90:0/3232334163 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99c942a640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 0x7f99c40c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99c9c2b640 1 --2- 172.21.15.90:0/3232334163 >> v2:172.21.15.175:3300/0 conn(0x7f99c40c23f0 0x7f99c4157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405315822 0 0) 0x7f99c40c2880 con 0x7f99c406ef90 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b0003520 con 0x7f99c406ef90 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 637169070 0 0) 0x7f99b0003520 con 0x7f99c406ef90 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 msgr2=0x7f99c40c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 0x7f99c40c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 >> v2:172.21.15.175:3300/0 conn(0x7f99c40c23f0 msgr2=0x7f99c4157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 --2- 172.21.15.90:0/3232334163 >> v2:172.21.15.175:3300/0 conn(0x7f99c40c23f0 0x7f99c4157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c40c33e0 con 0x7f99c406ef90 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f99b4001670 con 0x7f99c406ef90 2024-04-20T10:53:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 >> v1:172.21.15.90:6789/0 conn(0x7f99c406ef90 legacy=0x7f99c40c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99b00039b0 0x7f99b0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 0x7f99b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b0004d40 0x7f99b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99c40c4480 con 0x7f99b00039b0 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f99c41576b0 con 0x7f99b0004d40 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99b000ba40 con 0x7f99c40c7bf0 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99c942a640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99b00039b0 0x7f99b0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.780+0000 7f99c8c29640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 0x7f99b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c9c2b640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b0004d40 0x7f99b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c942a640 1 -- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 msgr2=0x7f99b0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c942a640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99c40c7bf0 0x7f99b0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c942a640 1 -- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b0004d40 msgr2=0x7f99b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c942a640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b0004d40 0x7f99b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c942a640 1 -- 172.21.15.90:0/3232334163 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b0003520 con 0x7f99b00039b0 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c9c2b640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99b0004d40 0x7f99b00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99c942a640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99b00039b0 0x7f99b0003dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009fc0 tx=0x7f99b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4868949872464e74 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0039070 con 0x7f99b00039b0 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99c002cc20 con 0x7f99b00039b0 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.781+0000 7f99bbfff640 1 -- 172.21.15.90:0/3232334163 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c0009c10 con 0x7f99b00039b0 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.782+0000 7f99cb68e640 1 -- 172.21.15.90:0/3232334163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99b00039b0 msgr2=0x7f99b0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.782+0000 7f99cb68e640 1 --2- 172.21.15.90:0/3232334163 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99b00039b0 0x7f99b0003dd0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009fc0 tx=0x7f99b0005830 comp rx=0 tx=0).stop 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.782+0000 7f99c9c2b640 1 -- 172.21.15.90:0/3232334163 reap_dead start 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.782+0000 7f99cb68e640 1 -- 172.21.15.90:0/3232334163 shutdown_connections 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.782+0000 7f99cb68e640 1 -- 172.21.15.90:0/3232334163 >> 172.21.15.90:0/3232334163 conn(0x7f99c40aa660 msgr2=0x7f99c40aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.782+0000 7f99cb68e640 1 -- 172.21.15.90:0/3232334163 shutdown_connections 2024-04-20T10:53:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.782+0000 7f99cb68e640 1 -- 172.21.15.90:0/3232334163 wait complete. 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.783+0000 7f99cb68e640 1 Processor -- start 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.783+0000 7f99cb68e640 1 -- start start 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99cb68e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b00039b0 0x7f99c41effc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99cb68e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99c41587a0 0x7f99c41f0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99cb68e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c41499e0 0x7f99c4149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99cb68e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f99c40c39a0 con 0x7f99c41499e0 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99cb68e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f99c40c3ff0 con 0x7f99c41587a0 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99cb68e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f99c40c3c80 con 0x7f99b00039b0 2024-04-20T10:53:46.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c41499e0 0x7f99c4149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c41499e0 0x7f99c4149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37030/0 (socket says 172.21.15.90:37030) 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 -- 172.21.15.90:0/304934342 learned_addr learned my addr 172.21.15.90:0/304934342 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c942a640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b00039b0 0x7f99c41effc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c8c29640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99c41587a0 0x7f99c41f0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 -- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b00039b0 msgr2=0x7f99c41effc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b00039b0 0x7f99c41effc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 -- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99c41587a0 msgr2=0x7f99c41f0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99c41587a0 0x7f99c41f0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 -- 172.21.15.90:0/304934342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c41f0a40 con 0x7f99c41499e0 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c8c29640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99c41587a0 0x7f99c41f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99c9c2b640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c41499e0 0x7f99c4149e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f99c4070cc0 tx=0x7f99bc010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.784+0000 7f99b9ffb640 1 -- 172.21.15.90:0/304934342 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00f040 con 0x7f99c41499e0 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.785+0000 7f99b9ffb640 1 -- 172.21.15.90:0/304934342 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99bc01c070 con 0x7f99c41499e0 2024-04-20T10:53:46.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.785+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c41e0b70 con 0x7f99c41499e0 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.785+0000 7f99b9ffb640 1 -- 172.21.15.90:0/304934342 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99bc00eac0 con 0x7f99c41499e0 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.785+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c41e13d0 con 0x7f99c41499e0 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.786+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c4076150 con 0x7f99c41499e0 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.786+0000 7f99b9ffb640 1 -- 172.21.15.90:0/304934342 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99bc00ec60 con 0x7f99c41499e0 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.786+0000 7f99b9ffb640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f99a806c8f0 0x7f99a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.787+0000 7f99b9ffb640 1 -- 172.21.15.90:0/304934342 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f99bc08bb50 con 0x7f99c41499e0 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.787+0000 7f99c942a640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f99a806c8f0 0x7f99a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:46.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.787+0000 7f99c942a640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f99a806c8f0 0x7f99a806edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f99c0036000 tx=0x7f99c002e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:46.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:46.791+0000 7f99b9ffb640 1 -- 172.21.15.90:0/304934342 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f99bc026020 con 0x7f99c41499e0 2024-04-20T10:53:47.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.015+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f99c40aad60 con 0x7f99c41499e0 2024-04-20T10:53:47.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.015+0000 7f99b9ffb640 1 -- 172.21.15.90:0/304934342 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f99bc059ae0 con 0x7f99c41499e0 2024-04-20T10:53:47.016 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:47.016 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:47.016 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:53:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.018+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f99a806c8f0 msgr2=0x7f99a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.018+0000 7f99cb68e640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f99a806c8f0 0x7f99a806edb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f99c0036000 tx=0x7f99c002e000 comp rx=0 tx=0).stop 2024-04-20T10:53:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.018+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c41499e0 msgr2=0x7f99c4149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.018+0000 7f99cb68e640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c41499e0 0x7f99c4149e90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f99c4070cc0 tx=0x7f99bc010c20 comp rx=0 tx=0).stop 2024-04-20T10:53:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 shutdown_connections 2024-04-20T10:53:47.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f99a806c8f0 0x7f99a806edb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f99c41499e0 0x7f99c4149e90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f99c41587a0 0x7f99c41f0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 --2- 172.21.15.90:0/304934342 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f99b00039b0 0x7f99c41effc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 >> 172.21.15.90:0/304934342 conn(0x7f99c40aa660 msgr2=0x7f99c4156e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 shutdown_connections 2024-04-20T10:53:47.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:47.019+0000 7f99cb68e640 1 -- 172.21.15.90:0/304934342 wait complete. 2024-04-20T10:53:47.035 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2024-04-20T10:53:47.035 INFO:tasks.mds_thrash.fs.[a]:waiting for 84 secs before thrashing 2024-04-20T10:53:58.602 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:58.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.699+0000 7f061bee0640 1 Processor -- start 2024-04-20T10:53:58.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.700+0000 7f061bee0640 1 -- start start 2024-04-20T10:53:58.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.700+0000 7f061bee0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f06140ab730 0x7f06141568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.700+0000 7f061bee0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061415a720 con 0x7f0614153ef0 2024-04-20T10:53:58.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.700+0000 7f061bee0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f061415ac80 con 0x7f06140c9ee0 2024-04-20T10:53:58.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.700+0000 7f061bee0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f061415a9a0 con 0x7f06140ab730 2024-04-20T10:53:58.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.700+0000 7f0619c7c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0614153ef0 0x7f06140c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58980/0 (socket says 172.21.15.90:58980) 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.700+0000 7f0619c7c640 1 -- 172.21.15.90:0/3101369577 learned_addr learned my addr 172.21.15.90:0/3101369577 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f061947b640 1 --2- 172.21.15.90:0/3101369577 >> v2:172.21.15.175:3300/0 conn(0x7f06140ab730 0x7f06141568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3691413505 0 0) 0x7f0610001490 con 0x7f0614153ef0 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0600003520 con 0x7f0614153ef0 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1724266195 0 0) 0x7f0600003520 con 0x7f0614153ef0 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 >> v2:172.21.15.175:3300/0 conn(0x7f06140ab730 msgr2=0x7f06141568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 --2- 172.21.15.90:0/3101369577 >> v2:172.21.15.175:3300/0 conn(0x7f06140ab730 0x7f06141568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 >> v1:172.21.15.175:6789/0 conn(0x7f06140c9ee0 legacy=0x7f0614156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06140c6a90 con 0x7f0614153ef0 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f0610001bc0 con 0x7f0614153ef0 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 >> v1:172.21.15.90:6789/0 conn(0x7f0614153ef0 legacy=0x7f06140c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000039b0 0x7f0600003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0600004800 0x7f0600004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000052e0 0x7f060000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f061415a9a0 con 0x7f06000039b0 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f060000c1b0 con 0x7f06000052e0 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f060000c3b0 con 0x7f0600004800 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0619c7c640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000039b0 0x7f0600003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f061a47d640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000052e0 0x7f060000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f061947b640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0600004800 0x7f0600004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0619c7c640 1 -- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0600004800 msgr2=0x7f0600004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0619c7c640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0600004800 0x7f0600004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0619c7c640 1 -- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000052e0 msgr2=0x7f060000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0619c7c640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000052e0 0x7f060000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f0619c7c640 1 -- 172.21.15.90:0/3101369577 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0600003520 con 0x7f06000039b0 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f061a47d640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000052e0 0x7f060000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.701+0000 7f061a47d640 1 -- 172.21.15.90:0/3101369577 reap_dead start 2024-04-20T10:53:58.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.702+0000 7f0619c7c640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000039b0 0x7f0600003dd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f061000a9f0 tx=0x7f0600005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15335779e69b0eaa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.702+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f061000a640 con 0x7f06000039b0 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.702+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0610030070 con 0x7f06000039b0 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.702+0000 7f0618c7a640 1 -- 172.21.15.90:0/3101369577 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0610034870 con 0x7f06000039b0 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.703+0000 7f061bee0640 1 -- 172.21.15.90:0/3101369577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000039b0 msgr2=0x7f0600003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.703+0000 7f061bee0640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000039b0 0x7f0600003dd0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f061000a9f0 tx=0x7f0600005830 comp rx=0 tx=0).stop 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.703+0000 7f061bee0640 1 -- 172.21.15.90:0/3101369577 shutdown_connections 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.703+0000 7f061bee0640 1 --2- 172.21.15.90:0/3101369577 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06000039b0 0x7f0600003dd0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.703+0000 7f061bee0640 1 -- 172.21.15.90:0/3101369577 >> 172.21.15.90:0/3101369577 conn(0x7f06140cbfe0 msgr2=0x7f06140cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.703+0000 7f061bee0640 1 -- 172.21.15.90:0/3101369577 shutdown_connections 2024-04-20T10:53:58.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.703+0000 7f061bee0640 1 -- 172.21.15.90:0/3101369577 wait complete. 2024-04-20T10:53:58.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.704+0000 7f061bee0640 1 Processor -- start 2024-04-20T10:53:58.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.704+0000 7f061bee0640 1 -- start start 2024-04-20T10:53:58.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000039b0 0x7f06140aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140b15d0 0x7f06141dff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06140aa5f0 0x7f06141e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f06140bf800 con 0x7f06140aa5f0 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f06140c89f0 con 0x7f06000039b0 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f06141e2b80 con 0x7f06140b15d0 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06140aa5f0 0x7f06141e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06140aa5f0 0x7f06141e04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42666/0 (socket says 172.21.15.90:42666) 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 -- 172.21.15.90:0/4120818603 learned_addr learned my addr 172.21.15.90:0/4120818603 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f0619c7c640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000039b0 0x7f06140aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061947b640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140b15d0 0x7f06141dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 -- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140b15d0 msgr2=0x7f06141dff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140b15d0 0x7f06141dff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 -- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000039b0 msgr2=0x7f06140aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000039b0 0x7f06140aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 -- 172.21.15.90:0/4120818603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06140ab130 con 0x7f06140aa5f0 2024-04-20T10:53:58.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061a47d640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06140aa5f0 0x7f06141e04a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f06140c8910 tx=0x7f060c00e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f060a7fc640 1 -- 172.21.15.90:0/4120818603 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c019070 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f060a7fc640 1 -- 172.21.15.90:0/4120818603 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f060c007e30 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f061414ec10 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f060a7fc640 1 -- 172.21.15.90:0/4120818603 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f060c0035f0 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.705+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06141e2530 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.706+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06140bf980 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.707+0000 7f060a7fc640 1 -- 172.21.15.90:0/4120818603 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f060c01c070 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.707+0000 7f060a7fc640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.707+0000 7f060a7fc640 1 -- 172.21.15.90:0/4120818603 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f060c08b1a0 con 0x7f06140aa5f0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.707+0000 7f0619c7c640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:58.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.708+0000 7f0619c7c640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0610035000 tx=0x7f0610009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:58.712 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.712+0000 7f060a7fc640 1 -- 172.21.15.90:0/4120818603 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f060c058b70 con 0x7f06140aa5f0 2024-04-20T10:53:58.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.924+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0614076150 con 0x7f06140aa5f0 2024-04-20T10:53:58.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.924+0000 7f060a7fc640 1 -- 172.21.15.90:0/4120818603 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f060c05ce70 con 0x7f06140aa5f0 2024-04-20T10:53:58.925 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:58.925 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:58.925 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 msgr2=0x7f05f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0610035000 tx=0x7f0610009030 comp rx=0 tx=0).stop 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06140aa5f0 msgr2=0x7f06141e04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06140aa5f0 0x7f06141e04a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f06140c8910 tx=0x7f060c00e820 comp rx=0 tx=0).stop 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 shutdown_connections 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f05f806c920 0x7f05f806ede0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f06140aa5f0 0x7f06141e04a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f06140b15d0 0x7f06141dff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 --2- 172.21.15.90:0/4120818603 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f06000039b0 0x7f06140aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 >> 172.21.15.90:0/4120818603 conn(0x7f06140cbfe0 msgr2=0x7f06140cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 shutdown_connections 2024-04-20T10:53:58.927 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:58.926+0000 7f061bee0640 1 -- 172.21.15.90:0/4120818603 wait complete. 2024-04-20T10:53:58.941 INFO:tasks.mds_thrash.fs.[b]:kill mds.b (rank=0) 2024-04-20T10:53:58.941 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-20T10:53:58.941 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:53:58.957 INFO:tasks.ceph.mds.b:Stopped 2024-04-20T10:53:58.957 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:53:59.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.054+0000 7f44034c1640 1 Processor -- start 2024-04-20T10:53:59.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.054+0000 7f44034c1640 1 -- start start 2024-04-20T10:53:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.054+0000 7f44034c1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f43fc0c3740 0x7f43fc0c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.054+0000 7f44034c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc157240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f44034c1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc157780 con 0x7f43fc072f90 2024-04-20T10:53:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f44034c1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f43fc072b00 con 0x7f43fc0c3740 2024-04-20T10:53:59.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f44034c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f43fc06ff00 con 0x7f43fc0ab4a0 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f440125d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f43fc0c3740 0x7f43fc0c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f4400a5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f4401a5e640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f43fc072f90 0x7f43fc153b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:33992/0 (socket says 172.21.15.90:33992) 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f4401a5e640 1 -- 172.21.15.90:0/3238827917 learned_addr learned my addr 172.21.15.90:0/3238827917 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f4400a5c640 1 -- 172.21.15.90:0/3238827917 >> v2:172.21.15.175:3300/0 conn(0x7f43fc0c3740 msgr2=0x7f43fc0c52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f4400a5c640 1 --2- 172.21.15.90:0/3238827917 >> v2:172.21.15.175:3300/0 conn(0x7f43fc0c3740 0x7f43fc0c52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f4400a5c640 1 -- 172.21.15.90:0/3238827917 >> v1:172.21.15.175:6789/0 conn(0x7f43fc072f90 legacy=0x7f43fc153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f4400a5c640 1 -- 172.21.15.90:0/3238827917 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0701e0 con 0x7f43fc0ab4a0 2024-04-20T10:53:59.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.055+0000 7f440125d640 1 --2- 172.21.15.90:0/3238827917 >> v2:172.21.15.175:3300/0 conn(0x7f43fc0c3740 0x7f43fc0c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.056+0000 7f4400a5c640 1 --2- 172.21.15.90:0/3238827917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc157240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0097a0 tx=0x7f43ec02b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e57f5b7482a0cab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.056+0000 7f43f3fff640 1 -- 172.21.15.90:0/3238827917 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec038070 con 0x7f43fc0ab4a0 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.056+0000 7f43f3fff640 1 -- 172.21.15.90:0/3238827917 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43ec031700 con 0x7f43fc0ab4a0 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.056+0000 7f43f3fff640 1 -- 172.21.15.90:0/3238827917 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec031ad0 con 0x7f43fc0ab4a0 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 -- 172.21.15.90:0/3238827917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 msgr2=0x7f43fc157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 --2- 172.21.15.90:0/3238827917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc157240 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f43ec0097a0 tx=0x7f43ec02b7a0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 -- 172.21.15.90:0/3238827917 shutdown_connections 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 --2- 172.21.15.90:0/3238827917 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc157240 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 --2- 172.21.15.90:0/3238827917 >> v2:172.21.15.175:3300/0 conn(0x7f43fc0c3740 0x7f43fc0c52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 -- 172.21.15.90:0/3238827917 >> 172.21.15.90:0/3238827917 conn(0x7f43fc0ca0a0 msgr2=0x7f43fc0ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:59.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 -- 172.21.15.90:0/3238827917 shutdown_connections 2024-04-20T10:53:59.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.057+0000 7f44034c1640 1 -- 172.21.15.90:0/3238827917 wait complete. 2024-04-20T10:53:59.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 Processor -- start 2024-04-20T10:53:59.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 -- start start 2024-04-20T10:53:59.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc072f90 0x7f43fc0af860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc0afda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43fc0c3740 0x7f43fc155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc073420 con 0x7f43fc0c3740 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc072790 con 0x7f43fc072f90 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.058+0000 7f44034c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f43fc0735a0 con 0x7f43fc0ab4a0 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43fc0c3740 0x7f43fc155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43fc0c3740 0x7f43fc155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42680/0 (socket says 172.21.15.90:42680) 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 -- 172.21.15.90:0/1437457230 learned_addr learned my addr 172.21.15.90:0/1437457230 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f440125d640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc072f90 0x7f43fc0af860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4400a5c640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc0afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 -- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 msgr2=0x7f43fc0afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc0afda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 -- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc072f90 msgr2=0x7f43fc0af860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc072f90 0x7f43fc0af860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 -- 172.21.15.90:0/1437457230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc0aef60 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f440125d640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc072f90 0x7f43fc0af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f4401a5e640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43fc0c3740 0x7f43fc155550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c9f0 tx=0x7f43f400ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f43f1ffb640 1 -- 172.21.15.90:0/1437457230 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4017070 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f43f1ffb640 1 -- 172.21.15.90:0/1437457230 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43f400ab70 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc1ec870 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f43f1ffb640 1 -- 172.21.15.90:0/1437457230 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43f4012400 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.059+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc156d30 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.060+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc076150 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.061+0000 7f43f1ffb640 1 -- 172.21.15.90:0/1437457230 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f43f401a070 con 0x7f43fc0c3740 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.061+0000 7f43f1ffb640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f43e006c8f0 0x7f43e006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:53:59.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.061+0000 7f440125d640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f43e006c8f0 0x7f43e006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:53:59.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.061+0000 7f43f1ffb640 1 -- 172.21.15.90:0/1437457230 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f43f408bb30 con 0x7f43fc0c3740 2024-04-20T10:53:59.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.062+0000 7f440125d640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f43e006c8f0 0x7f43e006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009ba0 tx=0x7f43f8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:53:59.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.066+0000 7f43f1ffb640 1 -- 172.21.15.90:0/1437457230 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f43fc157780 con 0x7f43fc0c3740 2024-04-20T10:53:59.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.281+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43fc151a80 con 0x7f43fc0c3740 2024-04-20T10:53:59.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.282+0000 7f43f1ffb640 1 -- 172.21.15.90:0/1437457230 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f43f4059500 con 0x7f43fc0c3740 2024-04-20T10:53:59.282 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:53:59.282 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:53:59.283 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:53:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f43e006c8f0 msgr2=0x7f43e006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f43e006c8f0 0x7f43e006edb0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f43f8009ba0 tx=0x7f43f8008040 comp rx=0 tx=0).stop 2024-04-20T10:53:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43fc0c3740 msgr2=0x7f43fc155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:53:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43fc0c3740 0x7f43fc155550 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f43f400c9f0 tx=0x7f43f400ceb0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 shutdown_connections 2024-04-20T10:53:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f43e006c8f0 0x7f43e006edb0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f43fc0c3740 0x7f43fc155550 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f43fc0ab4a0 0x7f43fc0afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 --2- 172.21.15.90:0/1437457230 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f43fc072f90 0x7f43fc0af860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:53:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 >> 172.21.15.90:0/1437457230 conn(0x7f43fc0ca0a0 msgr2=0x7f43fc0c5200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:53:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 shutdown_connections 2024-04-20T10:53:59.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:53:59.284+0000 7f44034c1640 1 -- 172.21.15.90:0/1437457230 wait complete. 2024-04-20T10:53:59.294 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:54:01.295 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:01.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.396+0000 7f5867e8c640 1 Processor -- start 2024-04-20T10:54:01.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.396+0000 7f5867e8c640 1 -- start start 2024-04-20T10:54:01.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5867e8c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f586015ab30 0x7f5860156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5867e8c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f58600c4bb0 0x7f5860156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5867e8c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58600c6870 con 0x7f58600701c0 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5867e8c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f58600ab630 con 0x7f58600c4bb0 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5867e8c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5860159e00 con 0x7f586015ab30 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5866429640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f58600c4bb0 0x7f5860156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5865c28640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f58600701c0 0x7f5860073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58992/0 (socket says 172.21.15.90:58992) 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5865c28640 1 -- 172.21.15.90:0/2365203001 learned_addr learned my addr 172.21.15.90:0/2365203001 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5865427640 1 --2- 172.21.15.90:0/2365203001 >> v2:172.21.15.175:3300/0 conn(0x7f586015ab30 0x7f5860156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5866429640 1 -- 172.21.15.90:0/2365203001 >> v2:172.21.15.175:3300/0 conn(0x7f586015ab30 msgr2=0x7f5860156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5866429640 1 --2- 172.21.15.90:0/2365203001 >> v2:172.21.15.175:3300/0 conn(0x7f586015ab30 0x7f5860156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5866429640 1 -- 172.21.15.90:0/2365203001 >> v1:172.21.15.90:6789/0 conn(0x7f58600701c0 legacy=0x7f5860073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5864c26640 1 -- 172.21.15.90:0/2365203001 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 948217002 0 0) 0x7f58600c6870 con 0x7f58600701c0 2024-04-20T10:54:01.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.397+0000 7f5866429640 1 -- 172.21.15.90:0/2365203001 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586015a050 con 0x7f58600c4bb0 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.398+0000 7f5866429640 1 --2- 172.21.15.90:0/2365203001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58600c4bb0 0x7f5860156d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f58600c46d0 tx=0x7f585802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=183eeb6d34a970ad server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.398+0000 7f5864c26640 1 -- 172.21.15.90:0/2365203001 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858035020 con 0x7f58600c4bb0 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.398+0000 7f5864c26640 1 -- 172.21.15.90:0/2365203001 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5858031830 con 0x7f58600c4bb0 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.398+0000 7f5864c26640 1 -- 172.21.15.90:0/2365203001 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858031c00 con 0x7f58600c4bb0 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 -- 172.21.15.90:0/2365203001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58600c4bb0 msgr2=0x7f5860156d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2365203001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58600c4bb0 0x7f5860156d50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f58600c46d0 tx=0x7f585802b8d0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 -- 172.21.15.90:0/2365203001 shutdown_connections 2024-04-20T10:54:01.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2365203001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58600c4bb0 0x7f5860156d50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2365203001 >> v2:172.21.15.175:3300/0 conn(0x7f586015ab30 0x7f5860156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 -- 172.21.15.90:0/2365203001 >> 172.21.15.90:0/2365203001 conn(0x7f58600676c0 msgr2=0x7f5860067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:01.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 -- 172.21.15.90:0/2365203001 shutdown_connections 2024-04-20T10:54:01.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.399+0000 7f5867e8c640 1 -- 172.21.15.90:0/2365203001 wait complete. 2024-04-20T10:54:01.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.400+0000 7f5867e8c640 1 Processor -- start 2024-04-20T10:54:01.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.400+0000 7f5867e8c640 1 -- start start 2024-04-20T10:54:01.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58600701c0 0x7f58601ec8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:01.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58600c4bb0 0x7f5860147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:01.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f586015ab30 0x7f58600c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58600705a0 con 0x7f586015ab30 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f586015a610 con 0x7f58600c4bb0 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5860073810 con 0x7f58600701c0 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f586015ab30 0x7f58600c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f586015ab30 0x7f58600c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42698/0 (socket says 172.21.15.90:42698) 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 -- 172.21.15.90:0/2308628497 learned_addr learned my addr 172.21.15.90:0/2308628497 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5865427640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58600c4bb0 0x7f5860147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5865c28640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58600701c0 0x7f58601ec8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 -- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58600701c0 msgr2=0x7f58601ec8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58600701c0 0x7f58601ec8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 -- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58600c4bb0 msgr2=0x7f5860147690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58600c4bb0 0x7f5860147690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 -- 172.21.15.90:0/2308628497 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f586006d950 con 0x7f586015ab30 2024-04-20T10:54:01.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5865427640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58600c4bb0 0x7f5860147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5866429640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f586015ab30 0x7f58600c96e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f585802bee0 tx=0x7f58580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f58567fc640 1 -- 172.21.15.90:0/2308628497 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858041070 con 0x7f586015ab30 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f58567fc640 1 -- 172.21.15.90:0/2308628497 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f585803a8f0 con 0x7f586015ab30 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5860147bd0 con 0x7f586015ab30 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f58567fc640 1 -- 172.21.15.90:0/2308628497 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5858035040 con 0x7f586015ab30 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.401+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f586006d390 con 0x7f586015ab30 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.402+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58600c7b90 con 0x7f586015ab30 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.403+0000 7f58567fc640 1 -- 172.21.15.90:0/2308628497 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5858038020 con 0x7f586015ab30 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.403+0000 7f58567fc640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f584406c8f0 0x7f584406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.403+0000 7f5865c28640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f584406c8f0 0x7f584406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:01.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.403+0000 7f58567fc640 1 -- 172.21.15.90:0/2308628497 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f58580ad8b0 con 0x7f586015ab30 2024-04-20T10:54:01.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.404+0000 7f5865c28640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f584406c8f0 0x7f584406edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f585c0012e0 tx=0x7f585c005eb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:01.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.408+0000 7f58567fc640 1 -- 172.21.15.90:0/2308628497 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f58600c7b90 con 0x7f586015ab30 2024-04-20T10:54:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.665+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5860076150 con 0x7f586015ab30 2024-04-20T10:54:01.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.665+0000 7f58567fc640 1 -- 172.21.15.90:0/2308628497 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f585807b8d0 con 0x7f586015ab30 2024-04-20T10:54:01.666 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:01.666 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:54:01.666 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.667+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f584406c8f0 msgr2=0x7f584406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.667+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f584406c8f0 0x7f584406edb0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f585c0012e0 tx=0x7f585c005eb0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.667+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f586015ab30 msgr2=0x7f58600c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.667+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f586015ab30 0x7f58600c96e0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f585802bee0 tx=0x7f58580046c0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 shutdown_connections 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f584406c8f0 0x7f584406edb0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f586015ab30 0x7f58600c96e0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58600c4bb0 0x7f5860147690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 --2- 172.21.15.90:0/2308628497 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58600701c0 0x7f58601ec8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 >> 172.21.15.90:0/2308628497 conn(0x7f58600676c0 msgr2=0x7f5860152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 shutdown_connections 2024-04-20T10:54:01.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:01.668+0000 7f5867e8c640 1 -- 172.21.15.90:0/2308628497 wait complete. 2024-04-20T10:54:01.682 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:54:03.683 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.798+0000 7fad2cd15640 1 Processor -- start 2024-04-20T10:54:03.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.798+0000 7fad2cd15640 1 -- start start 2024-04-20T10:54:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad2cd15640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fad280679b0 0x7fad280c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad2cd15640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad280a8050 con 0x7fad281542d0 2024-04-20T10:54:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad2cd15640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad280c3350 con 0x7fad2806d5d0 2024-04-20T10:54:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad2cd15640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fad280c5130 con 0x7fad280679b0 2024-04-20T10:54:03.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad26d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fad280679b0 0x7fad280c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad2659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fad281542d0 0x7fad280c78c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58996/0 (socket says 172.21.15.90:58996) 2024-04-20T10:54:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad2659c640 1 -- 172.21.15.90:0/635339980 learned_addr learned my addr 172.21.15.90:0/635339980 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad26d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fad280679b0 0x7fad280c4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42704/0 (socket says 172.21.15.90:42704) 2024-04-20T10:54:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad26d9d640 1 -- 172.21.15.90:0/635339980 >> v1:172.21.15.175:6789/0 conn(0x7fad2806d5d0 legacy=0x7fad280c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad26d9d640 1 -- 172.21.15.90:0/635339980 >> v1:172.21.15.90:6789/0 conn(0x7fad281542d0 legacy=0x7fad280c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:03.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.799+0000 7fad26d9d640 1 -- 172.21.15.90:0/635339980 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad280c3630 con 0x7fad280679b0 2024-04-20T10:54:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.800+0000 7fad26d9d640 1 --2- 172.21.15.90:0/635339980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad280679b0 0x7fad280c4260 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fad20009dc0 tx=0x7fad2002be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19e41c873689f1e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.800+0000 7fad25d9b640 1 -- 172.21.15.90:0/635339980 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20039070 con 0x7fad280679b0 2024-04-20T10:54:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.800+0000 7fad25d9b640 1 -- 172.21.15.90:0/635339980 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad2002cbb0 con 0x7fad280679b0 2024-04-20T10:54:03.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.800+0000 7fad25d9b640 1 -- 172.21.15.90:0/635339980 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20034440 con 0x7fad280679b0 2024-04-20T10:54:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.801+0000 7fad2cd15640 1 -- 172.21.15.90:0/635339980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad280679b0 msgr2=0x7fad280c4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.801+0000 7fad2cd15640 1 --2- 172.21.15.90:0/635339980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad280679b0 0x7fad280c4260 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fad20009dc0 tx=0x7fad2002be00 comp rx=0 tx=0).stop 2024-04-20T10:54:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.801+0000 7fad2cd15640 1 -- 172.21.15.90:0/635339980 shutdown_connections 2024-04-20T10:54:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.801+0000 7fad2cd15640 1 --2- 172.21.15.90:0/635339980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad280679b0 0x7fad280c4260 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.801+0000 7fad2cd15640 1 -- 172.21.15.90:0/635339980 >> 172.21.15.90:0/635339980 conn(0x7fad280aa660 msgr2=0x7fad280aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.801+0000 7fad2cd15640 1 -- 172.21.15.90:0/635339980 shutdown_connections 2024-04-20T10:54:03.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.801+0000 7fad2cd15640 1 -- 172.21.15.90:0/635339980 wait complete. 2024-04-20T10:54:03.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.802+0000 7fad2cd15640 1 Processor -- start 2024-04-20T10:54:03.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.802+0000 7fad2cd15640 1 -- start start 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad280679b0 0x7fad281dcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2806d5d0 0x7fad281ee890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad281542d0 0x7fad280c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fad280c7fd0 con 0x7fad281542d0 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fad280a8330 con 0x7fad2806d5d0 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fad280c8150 con 0x7fad280679b0 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad281542d0 0x7fad280c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad281542d0 0x7fad280c6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:42708/0 (socket says 172.21.15.90:42708) 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 -- 172.21.15.90:0/3069474849 learned_addr learned my addr 172.21.15.90:0/3069474849 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad1ffff640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2806d5d0 0x7fad281ee890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2659c640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad280679b0 0x7fad281dcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 -- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad280679b0 msgr2=0x7fad281dcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:03.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad280679b0 0x7fad281dcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 -- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2806d5d0 msgr2=0x7fad281ee890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2806d5d0 0x7fad281ee890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 -- 172.21.15.90:0/3069474849 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad281dd610 con 0x7fad281542d0 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad1ffff640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2806d5d0 0x7fad281ee890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad26d9d640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad281542d0 0x7fad280c6a20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad20009ee0 tx=0x7fad20004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad1effd640 1 -- 172.21.15.90:0/3069474849 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20039050 con 0x7fad281542d0 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad1effd640 1 -- 172.21.15.90:0/3069474849 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad20045070 con 0x7fad281542d0 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad1effd640 1 -- 172.21.15.90:0/3069474849 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2003e850 con 0x7fad281542d0 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad281eaab0 con 0x7fad281542d0 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.803+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad281eb070 con 0x7fad281542d0 2024-04-20T10:54:03.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.805+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad28076150 con 0x7fad281542d0 2024-04-20T10:54:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.805+0000 7fad1effd640 1 -- 172.21.15.90:0/3069474849 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fad2003e9f0 con 0x7fad281542d0 2024-04-20T10:54:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.805+0000 7fad1effd640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fad0806c8f0 0x7fad0806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.805+0000 7fad1effd640 1 -- 172.21.15.90:0/3069474849 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7fad200aecc0 con 0x7fad281542d0 2024-04-20T10:54:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.805+0000 7fad2659c640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fad0806c8f0 0x7fad0806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:03.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.806+0000 7fad2659c640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fad0806c8f0 0x7fad0806edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad18005880 tx=0x7fad18009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:03.810 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:03.810+0000 7fad1effd640 1 -- 172.21.15.90:0/3069474849 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fad2007cce0 con 0x7fad281542d0 2024-04-20T10:54:04.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.021+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad28067790 con 0x7fad281542d0 2024-04-20T10:54:04.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.021+0000 7fad1effd640 1 -- 172.21.15.90:0/3069474849 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7fad2007c5e0 con 0x7fad281542d0 2024-04-20T10:54:04.022 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:04.022 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:54:04.022 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fad0806c8f0 msgr2=0x7fad0806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fad0806c8f0 0x7fad0806edb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fad18005880 tx=0x7fad18009040 comp rx=0 tx=0).stop 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad281542d0 msgr2=0x7fad280c6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad281542d0 0x7fad280c6a20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fad20009ee0 tx=0x7fad20004a40 comp rx=0 tx=0).stop 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 shutdown_connections 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fad0806c8f0 0x7fad0806edb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fad281542d0 0x7fad280c6a20 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fad2806d5d0 0x7fad281ee890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 --2- 172.21.15.90:0/3069474849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fad280679b0 0x7fad281dcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 >> 172.21.15.90:0/3069474849 conn(0x7fad280aa660 msgr2=0x7fad280c3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 shutdown_connections 2024-04-20T10:54:04.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:04.023+0000 7fad2cd15640 1 -- 172.21.15.90:0/3069474849 wait complete. 2024-04-20T10:54:04.034 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:54:06.035 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:06.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.137+0000 7f85d9a31640 1 Processor -- start 2024-04-20T10:54:06.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.137+0000 7f85d9a31640 1 -- start start 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d9a31640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f85d40c6e70 0x7f85d4156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d9a31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 0x7f85d4150460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d9a31640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f85d40c9410 con 0x7f85d40c8c90 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d9a31640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f85d406c580 con 0x7f85d40c6e70 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d9a31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f85d40c9c30 con 0x7f85d406d120 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85cbfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f85d40c8c90 0x7f85d406ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58054/0 (socket says 172.21.15.90:58054) 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85cbfff640 1 -- 172.21.15.90:0/389935965 learned_addr learned my addr 172.21.15.90:0/389935965 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:06.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396440918 0 0) 0x7f85d40c9410 con 0x7f85d40c8c90 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f85c0003520 con 0x7f85d40c8c90 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d37fe640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 0x7f85d4150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/389935965 >> v2:172.21.15.175:3300/0 conn(0x7f85d40c6e70 0x7f85d4156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.138+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3489684655 0 0) 0x7f85c0003520 con 0x7f85d40c8c90 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 msgr2=0x7f85d4150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 0x7f85d4150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 >> v2:172.21.15.175:3300/0 conn(0x7f85d40c6e70 msgr2=0x7f85d4156a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 --2- 172.21.15.90:0/389935965 >> v2:172.21.15.175:3300/0 conn(0x7f85d40c6e70 0x7f85d4156a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d40c96b0 con 0x7f85d40c8c90 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f85bc001670 con 0x7f85d40c8c90 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/389935965 >> v2:172.21.15.175:3300/0 conn(0x7f85d40c6e70 0x7f85d4156a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:54:06.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 >> v1:172.21.15.90:6789/0 conn(0x7f85d40c8c90 legacy=0x7f85d406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c00039b0 0x7f85c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 0x7f85c0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c0004d40 0x7f85c00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85d406c580 con 0x7f85c00039b0 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40c9c30 con 0x7f85c0004d40 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f85c000bb20 con 0x7f85d406d120 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c00039b0 0x7f85c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85cbfff640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 0x7f85c0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d37fe640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c0004d40 0x7f85c00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d2ffd640 1 -- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 msgr2=0x7f85c0004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85d406d120 0x7f85c0004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d2ffd640 1 -- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c0004d40 msgr2=0x7f85c00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85c0004d40 0x7f85c00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.139+0000 7f85d2ffd640 1 -- 172.21.15.90:0/389935965 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c0003520 con 0x7f85c00039b0 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.140+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c00039b0 0x7f85c0003dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f85c40098a0 tx=0x7f85c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2350c58e8aa84d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.140+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c400f040 con 0x7f85c00039b0 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.140+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85c4004230 con 0x7f85c00039b0 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.140+0000 7f85d27fc640 1 -- 172.21.15.90:0/389935965 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c4003610 con 0x7f85c00039b0 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.141+0000 7f85d9a31640 1 -- 172.21.15.90:0/389935965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c00039b0 msgr2=0x7f85c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.141+0000 7f85d9a31640 1 --2- 172.21.15.90:0/389935965 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85c00039b0 0x7f85c0003dd0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f85c40098a0 tx=0x7f85c0005830 comp rx=0 tx=0).stop 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.141+0000 7f85d37fe640 1 -- 172.21.15.90:0/389935965 reap_dead start 2024-04-20T10:54:06.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.141+0000 7f85d9a31640 1 -- 172.21.15.90:0/389935965 shutdown_connections 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.141+0000 7f85d9a31640 1 -- 172.21.15.90:0/389935965 >> 172.21.15.90:0/389935965 conn(0x7f85d40addb0 msgr2=0x7f85d40ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.141+0000 7f85d9a31640 1 -- 172.21.15.90:0/389935965 shutdown_connections 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.141+0000 7f85d9a31640 1 -- 172.21.15.90:0/389935965 wait complete. 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 Processor -- start 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 -- start start 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c00039b0 0x7f85d40c5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d41505d0 0x7f85d414b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d414be10 0x7f85d40bff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40ca3a0 con 0x7f85d41505d0 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f85d40c90a0 con 0x7f85d414be10 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.142+0000 7f85d9a31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f85d40ca520 con 0x7f85c00039b0 2024-04-20T10:54:06.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d41505d0 0x7f85d414b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d41505d0 0x7f85d414b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49124/0 (socket says 172.21.15.90:49124) 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 -- 172.21.15.90:0/3583738550 learned_addr learned my addr 172.21.15.90:0/3583738550 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85d37fe640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d414be10 0x7f85d40bff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c00039b0 0x7f85d40c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 -- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c00039b0 msgr2=0x7f85d40c5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c00039b0 0x7f85d40c5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 -- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d414be10 msgr2=0x7f85d40bff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d414be10 0x7f85d40bff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 -- 172.21.15.90:0/3583738550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d4152220 con 0x7f85d41505d0 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85cbfff640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d41505d0 0x7f85d414b8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f85bc007340 tx=0x7f85bc007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85d0ff9640 1 -- 172.21.15.90:0/3583738550 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc01a070 con 0x7f85d41505d0 2024-04-20T10:54:06.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85d0ff9640 1 -- 172.21.15.90:0/3583738550 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85bc007e30 con 0x7f85d41505d0 2024-04-20T10:54:06.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85d0ff9640 1 -- 172.21.15.90:0/3583738550 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc00fb60 con 0x7f85d41505d0 2024-04-20T10:54:06.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d414c290 con 0x7f85d41505d0 2024-04-20T10:54:06.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.143+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d4150fc0 con 0x7f85d41505d0 2024-04-20T10:54:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.144+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d4076150 con 0x7f85d41505d0 2024-04-20T10:54:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.145+0000 7f85d0ff9640 1 -- 172.21.15.90:0/3583738550 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85bc01d070 con 0x7f85d41505d0 2024-04-20T10:54:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.145+0000 7f85d0ff9640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85b406c8f0 0x7f85b406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.145+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85b406c8f0 0x7f85b406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.145+0000 7f85d0ff9640 1 -- 172.21.15.90:0/3583738550 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f85bc08b780 con 0x7f85d41505d0 2024-04-20T10:54:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.146+0000 7f85d2ffd640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85b406c8f0 0x7f85b406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85c4035000 tx=0x7f85c4031000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:06.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.150+0000 7f85d0ff9640 1 -- 172.21.15.90:0/3583738550 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f85bc059210 con 0x7f85d41505d0 2024-04-20T10:54:06.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.362+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85d414ef50 con 0x7f85d41505d0 2024-04-20T10:54:06.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.362+0000 7f85d0ff9640 1 -- 172.21.15.90:0/3583738550 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f85bc05d510 con 0x7f85d41505d0 2024-04-20T10:54:06.362 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:06.362 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:54:06.363 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:54:06.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85b406c8f0 msgr2=0x7f85b406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85b406c8f0 0x7f85b406edb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f85c4035000 tx=0x7f85c4031000 comp rx=0 tx=0).stop 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d41505d0 msgr2=0x7f85d414b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d41505d0 0x7f85d414b8d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f85bc007340 tx=0x7f85bc007800 comp rx=0 tx=0).stop 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 shutdown_connections 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85b406c8f0 0x7f85b406edb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f85d414be10 0x7f85d40bff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f85d41505d0 0x7f85d414b8d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 --2- 172.21.15.90:0/3583738550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f85c00039b0 0x7f85d40c5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 >> 172.21.15.90:0/3583738550 conn(0x7f85d40addb0 msgr2=0x7f85d40cc940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 shutdown_connections 2024-04-20T10:54:06.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:06.364+0000 7f85d9a31640 1 -- 172.21.15.90:0/3583738550 wait complete. 2024-04-20T10:54:06.375 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:54:08.376 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:08.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.474+0000 7f66d530d640 1 Processor -- start 2024-04-20T10:54:08.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.474+0000 7f66d530d640 1 -- start start 2024-04-20T10:54:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66d530d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d00ca030 0x7f66d015a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66d530d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f66d0156f90 0x7f66d01573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66d530d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d0154430 con 0x7f66d0154050 2024-04-20T10:54:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66d530d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f66d00c9b00 con 0x7f66d0156f90 2024-04-20T10:54:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66d530d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66d0156ab0 con 0x7f66d00ca030 2024-04-20T10:54:08.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66ceffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f66d0154050 0x7f66d00c6ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58056/0 (socket says 172.21.15.90:58056) 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66ceffd640 1 -- 172.21.15.90:0/2802587573 learned_addr learned my addr 172.21.15.90:0/2802587573 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66cf7fe640 1 --2- 172.21.15.90:0/2802587573 >> v2:172.21.15.175:3300/0 conn(0x7f66d0156f90 0x7f66d01573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.475+0000 7f66ce7fc640 1 --2- 172.21.15.90:0/2802587573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d00ca030 0x7f66d015a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.476+0000 7f66cdffb640 1 -- 172.21.15.90:0/2802587573 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966322511 0 0) 0x7f66d0154430 con 0x7f66d0154050 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.476+0000 7f66cdffb640 1 -- 172.21.15.90:0/2802587573 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66b8003520 con 0x7f66d0154050 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.476+0000 7f66ce7fc640 1 -- 172.21.15.90:0/2802587573 >> v2:172.21.15.175:3300/0 conn(0x7f66d0156f90 msgr2=0x7f66d01573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.476+0000 7f66ce7fc640 1 --2- 172.21.15.90:0/2802587573 >> v2:172.21.15.175:3300/0 conn(0x7f66d0156f90 0x7f66d01573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.476+0000 7f66ce7fc640 1 -- 172.21.15.90:0/2802587573 >> v1:172.21.15.90:6789/0 conn(0x7f66d0154050 legacy=0x7f66d00c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.476+0000 7f66ce7fc640 1 -- 172.21.15.90:0/2802587573 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d0157930 con 0x7f66d00ca030 2024-04-20T10:54:08.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.476+0000 7f66cf7fe640 1 --2- 172.21.15.90:0/2802587573 >> v2:172.21.15.175:3300/0 conn(0x7f66d0156f90 0x7f66d01573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.477+0000 7f66ce7fc640 1 --2- 172.21.15.90:0/2802587573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d00ca030 0x7f66d015a920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66c40097a0 tx=0x7f66c402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=965f50ae3dd903bb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.477+0000 7f66cdffb640 1 -- 172.21.15.90:0/2802587573 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4031780 con 0x7f66d00ca030 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.477+0000 7f66cdffb640 1 -- 172.21.15.90:0/2802587573 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c4037070 con 0x7f66d00ca030 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.477+0000 7f66cdffb640 1 -- 172.21.15.90:0/2802587573 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4031b20 con 0x7f66d00ca030 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 -- 172.21.15.90:0/2802587573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d00ca030 msgr2=0x7f66d015a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 --2- 172.21.15.90:0/2802587573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d00ca030 0x7f66d015a920 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f66c40097a0 tx=0x7f66c402b820 comp rx=0 tx=0).stop 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 -- 172.21.15.90:0/2802587573 shutdown_connections 2024-04-20T10:54:08.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 --2- 172.21.15.90:0/2802587573 >> v2:172.21.15.175:3300/0 conn(0x7f66d0156f90 0x7f66d01573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 --2- 172.21.15.90:0/2802587573 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d00ca030 0x7f66d015a920 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 -- 172.21.15.90:0/2802587573 >> 172.21.15.90:0/2802587573 conn(0x7f66d00ade20 msgr2=0x7f66d00ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:08.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 -- 172.21.15.90:0/2802587573 shutdown_connections 2024-04-20T10:54:08.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.478+0000 7f66d530d640 1 -- 172.21.15.90:0/2802587573 wait complete. 2024-04-20T10:54:08.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.479+0000 7f66d530d640 1 Processor -- start 2024-04-20T10:54:08.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.479+0000 7f66d530d640 1 -- start start 2024-04-20T10:54:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66d530d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ca030 0x7f66d00ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66d530d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0154050 0x7f66d01e9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66d530d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0156f90 0x7f66d01e9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66d530d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00c91a0 con 0x7f66d0154050 2024-04-20T10:54:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66d530d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66d00c8ec0 con 0x7f66d00ca030 2024-04-20T10:54:08.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66d530d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66d00c9480 con 0x7f66d0156f90 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0154050 0x7f66d01e9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0154050 0x7f66d01e9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49130/0 (socket says 172.21.15.90:49130) 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 -- 172.21.15.90:0/1069418285 learned_addr learned my addr 172.21.15.90:0/1069418285 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66cf7fe640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0156f90 0x7f66d01e9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ceffd640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ca030 0x7f66d00ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 -- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0156f90 msgr2=0x7f66d01e9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0156f90 0x7f66d01e9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 -- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ca030 msgr2=0x7f66d00ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ca030 0x7f66d00ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 -- 172.21.15.90:0/1069418285 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d01ec290 con 0x7f66d0154050 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.480+0000 7f66ce7fc640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0154050 0x7f66d01e9300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66c40098c0 tx=0x7f66c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.481+0000 7f66b77fe640 1 -- 172.21.15.90:0/1069418285 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4006e10 con 0x7f66d0154050 2024-04-20T10:54:08.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.481+0000 7f66b77fe640 1 -- 172.21.15.90:0/1069418285 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c4031780 con 0x7f66d0154050 2024-04-20T10:54:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.481+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d00af730 con 0x7f66d0154050 2024-04-20T10:54:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.481+0000 7f66b77fe640 1 -- 172.21.15.90:0/1069418285 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c4031b70 con 0x7f66d0154050 2024-04-20T10:54:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.481+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d00ccd20 con 0x7f66d0154050 2024-04-20T10:54:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.482+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d0076150 con 0x7f66d0154050 2024-04-20T10:54:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.482+0000 7f66b77fe640 1 -- 172.21.15.90:0/1069418285 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66c4031d10 con 0x7f66d0154050 2024-04-20T10:54:08.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.483+0000 7f66b77fe640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66bc06c8f0 0x7f66bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.483+0000 7f66b77fe640 1 -- 172.21.15.90:0/1069418285 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f66c40ae380 con 0x7f66d0154050 2024-04-20T10:54:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.483+0000 7f66ceffd640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66bc06c8f0 0x7f66bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:08.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.483+0000 7f66ceffd640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66bc06c8f0 0x7f66bc06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005880 tx=0x7f66c0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:08.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.487+0000 7f66b77fe640 1 -- 172.21.15.90:0/1069418285 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f66c402f050 con 0x7f66d0154050 2024-04-20T10:54:08.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.772+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66d00c9700 con 0x7f66d0154050 2024-04-20T10:54:08.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.773+0000 7f66b77fe640 1 -- 172.21.15.90:0/1069418285 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f66c407c310 con 0x7f66d0154050 2024-04-20T10:54:08.773 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:08.773 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:54:08.774 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:54:08.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66bc06c8f0 msgr2=0x7f66bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:08.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66bc06c8f0 0x7f66bc06edb0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f66c0005880 tx=0x7f66c0009040 comp rx=0 tx=0).stop 2024-04-20T10:54:08.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0154050 msgr2=0x7f66d01e9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:08.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0154050 0x7f66d01e9300 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f66c40098c0 tx=0x7f66c40046c0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 shutdown_connections 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66bc06c8f0 0x7f66bc06edb0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66d0156f90 0x7f66d01e9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66d0154050 0x7f66d01e9300 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 --2- 172.21.15.90:0/1069418285 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66d00ca030 0x7f66d00ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 >> 172.21.15.90:0/1069418285 conn(0x7f66d00ade20 msgr2=0x7f66d0146e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 shutdown_connections 2024-04-20T10:54:08.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:08.775+0000 7f66d530d640 1 -- 172.21.15.90:0/1069418285 wait complete. 2024-04-20T10:54:08.790 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:54:10.709 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:54:10.712 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:54:10.790 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:10.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.887+0000 7f3dc1211640 1 Processor -- start 2024-04-20T10:54:10.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.887+0000 7f3dc1211640 1 -- start start 2024-04-20T10:54:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dc1211640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc15a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dc1211640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3dbc0ad640 0x7f3dbc0c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dc1211640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3dbc071650 con 0x7f3dbc153c50 2024-04-20T10:54:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dc1211640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3dbc0718f0 con 0x7f3dbc0ad640 2024-04-20T10:54:10.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dc1211640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc0c3ca0 con 0x7f3dbc0c5520 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dbb59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3dbc0ad640 0x7f3dbc0c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dbb59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3dbc0ad640 0x7f3dbc0c44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49146/0 (socket says 172.21.15.90:49146) 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dbad9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3dbc153c50 0x7f3dbc0c2530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58070/0 (socket says 172.21.15.90:58070) 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.888+0000 7f3dbb59e640 1 -- 172.21.15.90:0/864186612 learned_addr learned my addr 172.21.15.90:0/864186612 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.889+0000 7f3dba59c640 1 --2- 172.21.15.90:0/864186612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc15a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.889+0000 7f3dbb59e640 1 -- 172.21.15.90:0/864186612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 msgr2=0x7f3dbc15a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.889+0000 7f3dbb59e640 1 --2- 172.21.15.90:0/864186612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc15a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.889+0000 7f3dbb59e640 1 -- 172.21.15.90:0/864186612 >> v1:172.21.15.90:6789/0 conn(0x7f3dbc153c50 legacy=0x7f3dbc0c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.889+0000 7f3dbb59e640 1 -- 172.21.15.90:0/864186612 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc0c3f80 con 0x7f3dbc0ad640 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.889+0000 7f3db9d9b640 1 -- 172.21.15.90:0/864186612 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342941262 0 0) 0x7f3dbc071650 con 0x7f3dbc153c50 2024-04-20T10:54:10.890 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.889+0000 7f3dba59c640 1 --2- 172.21.15.90:0/864186612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc15a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:54:10.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.890+0000 7f3dbb59e640 1 --2- 172.21.15.90:0/864186612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc0c44a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009e50 tx=0x7f3db402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be43074bcc1ed052 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.890+0000 7f3db9d9b640 1 -- 172.21.15.90:0/864186612 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db402cb00 con 0x7f3dbc0ad640 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.890+0000 7f3db9d9b640 1 -- 172.21.15.90:0/864186612 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3db402cca0 con 0x7f3dbc0ad640 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.890+0000 7f3db9d9b640 1 -- 172.21.15.90:0/864186612 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3db4034610 con 0x7f3dbc0ad640 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.890+0000 7f3dc1211640 1 -- 172.21.15.90:0/864186612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 msgr2=0x7f3dbc0c44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.890+0000 7f3dc1211640 1 --2- 172.21.15.90:0/864186612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc0c44a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3db4009e50 tx=0x7f3db402bf60 comp rx=0 tx=0).stop 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.891+0000 7f3dc1211640 1 -- 172.21.15.90:0/864186612 shutdown_connections 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.891+0000 7f3dc1211640 1 --2- 172.21.15.90:0/864186612 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc0c44a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.891+0000 7f3dc1211640 1 --2- 172.21.15.90:0/864186612 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc15a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.891+0000 7f3dc1211640 1 -- 172.21.15.90:0/864186612 >> 172.21.15.90:0/864186612 conn(0x7f3dbc0c9100 msgr2=0x7f3dbc0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.891+0000 7f3dc1211640 1 -- 172.21.15.90:0/864186612 shutdown_connections 2024-04-20T10:54:10.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.891+0000 7f3dc1211640 1 -- 172.21.15.90:0/864186612 wait complete. 2024-04-20T10:54:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.892+0000 7f3dc1211640 1 Processor -- start 2024-04-20T10:54:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.892+0000 7f3dc1211640 1 -- start start 2024-04-20T10:54:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dc1211640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:10.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dc1211640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dc1211640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dbc153c50 0x7f3dbc1ec250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dc1211640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc1541b0 con 0x7f3dbc0ad640 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dc1211640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc154030 con 0x7f3dbc153c50 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dc1211640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc0c49e0 con 0x7f3dbc0c5520 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49160/0 (socket says 172.21.15.90:49160) 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 -- 172.21.15.90:0/2760634168 learned_addr learned my addr 172.21.15.90:0/2760634168 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 -- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 msgr2=0x7f3dbc158b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dba59c640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbb59e640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dbc153c50 0x7f3dbc1ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 -- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dbc153c50 msgr2=0x7f3dbc1ec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dbc153c50 0x7f3dbc1ec250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:10.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.893+0000 7f3dbad9d640 1 -- 172.21.15.90:0/2760634168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc06e260 con 0x7f3dbc0ad640 2024-04-20T10:54:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.894+0000 7f3dbad9d640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc157110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00c430 tx=0x7f3dac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.894+0000 7f3da37fe640 1 -- 172.21.15.90:0/2760634168 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac0074e0 con 0x7f3dbc0ad640 2024-04-20T10:54:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.894+0000 7f3da37fe640 1 -- 172.21.15.90:0/2760634168 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dac0047e0 con 0x7f3dbc0ad640 2024-04-20T10:54:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.894+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc06e540 con 0x7f3dbc0ad640 2024-04-20T10:54:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.894+0000 7f3da37fe640 1 -- 172.21.15.90:0/2760634168 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac004bd0 con 0x7f3dbc0ad640 2024-04-20T10:54:10.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.894+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc159040 con 0x7f3dbc0ad640 2024-04-20T10:54:10.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.895+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc076150 con 0x7f3dbc0ad640 2024-04-20T10:54:10.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.896+0000 7f3da37fe640 1 -- 172.21.15.90:0/2760634168 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3dac011070 con 0x7f3dbc0ad640 2024-04-20T10:54:10.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.896+0000 7f3da37fe640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3da806c8f0 0x7f3da806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:10.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.896+0000 7f3dba59c640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3da806c8f0 0x7f3da806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:10.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.896+0000 7f3da37fe640 1 -- 172.21.15.90:0/2760634168 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f3dac08bc40 con 0x7f3dbc0ad640 2024-04-20T10:54:10.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.897+0000 7f3dba59c640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3da806c8f0 0x7f3da806edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc072ea0 tx=0x7f3db0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:10.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:10.902+0000 7f3da37fe640 1 -- 172.21.15.90:0/2760634168 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3dac059bd0 con 0x7f3dbc0ad640 2024-04-20T10:54:11.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.122+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dbc0c5300 con 0x7f3dbc0ad640 2024-04-20T10:54:11.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.123+0000 7f3da37fe640 1 -- 172.21.15.90:0/2760634168 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f3dac0594d0 con 0x7f3dbc0ad640 2024-04-20T10:54:11.124 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:11.124 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:54:11.124 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:54:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3da806c8f0 msgr2=0x7f3da806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3da806c8f0 0x7f3da806edb0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc072ea0 tx=0x7f3db0008040 comp rx=0 tx=0).stop 2024-04-20T10:54:11.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 msgr2=0x7f3dbc157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc157110 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00c430 tx=0x7f3dac00c8f0 comp rx=0 tx=0).stop 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 shutdown_connections 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f3da806c8f0 0x7f3da806edb0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3dbc153c50 0x7f3dbc1ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3dbc0c5520 0x7f3dbc158b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 --2- 172.21.15.90:0/2760634168 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3dbc0ad640 0x7f3dbc157110 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 >> 172.21.15.90:0/2760634168 conn(0x7f3dbc0c9100 msgr2=0x7f3dbc0c2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 shutdown_connections 2024-04-20T10:54:11.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:11.125+0000 7f3dc1211640 1 -- 172.21.15.90:0/2760634168 wait complete. 2024-04-20T10:54:11.136 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:54:13.136 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:13.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.236+0000 7f18ad196640 1 Processor -- start 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.236+0000 7f18ad196640 1 -- start start 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18ad196640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f18a80c4130 0x7f18a806d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18ad196640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a816e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18ad196640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18a806e300 con 0x7f18a806de50 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18ad196640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f18a80ae150 con 0x7f18a80c4130 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18ad196640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f18a806d480 con 0x7f18a80ab8b0 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18a6d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f18a80c4130 0x7f18a806d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18a659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f18a806de50 0x7f18a80ab1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:58078/0 (socket says 172.21.15.90:58078) 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18a659c640 1 -- 172.21.15.90:0/2027829041 learned_addr learned my addr 172.21.15.90:0/2027829041 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.237+0000 7f18a5d9b640 1 -- 172.21.15.90:0/2027829041 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091300777 0 0) 0x7f18a806e300 con 0x7f18a806de50 2024-04-20T10:54:13.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.238+0000 7f18a759e640 1 --2- 172.21.15.90:0/2027829041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a816e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.366+0000 7f18a5d9b640 1 -- 172.21.15.90:0/2027829041 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1890005730 con 0x7f18a806de50 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.367+0000 7f18a6d9d640 1 -- 172.21.15.90:0/2027829041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 msgr2=0x7f18a816e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.367+0000 7f18a6d9d640 1 --2- 172.21.15.90:0/2027829041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a816e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.367+0000 7f18a6d9d640 1 -- 172.21.15.90:0/2027829041 >> v1:172.21.15.90:6789/0 conn(0x7f18a806de50 legacy=0x7f18a80ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.367+0000 7f18a5d9b640 1 -- 172.21.15.90:0/2027829041 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3885328821 0 0) 0x7f1890005730 con 0x7f18a806de50 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.367+0000 7f18a6d9d640 1 -- 172.21.15.90:0/2027829041 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a80ac250 con 0x7f18a80c4130 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.367+0000 7f18a6d9d640 1 --2- 172.21.15.90:0/2027829041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a80c4130 0x7f18a806d910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f189c008820 tx=0x7f189c008180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f837900caeca1b81 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18a5d9b640 1 -- 172.21.15.90:0/2027829041 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c038070 con 0x7f18a80c4130 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18a5d9b640 1 -- 172.21.15.90:0/2027829041 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189c00ae50 con 0x7f18a80c4130 2024-04-20T10:54:13.369 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18a5d9b640 1 -- 172.21.15.90:0/2027829041 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898001690 con 0x7f18a80c4130 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 -- 172.21.15.90:0/2027829041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a80c4130 msgr2=0x7f18a806d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 --2- 172.21.15.90:0/2027829041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a80c4130 0x7f18a806d910 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f189c008820 tx=0x7f189c008180 comp rx=0 tx=0).stop 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 -- 172.21.15.90:0/2027829041 shutdown_connections 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 --2- 172.21.15.90:0/2027829041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a816e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 --2- 172.21.15.90:0/2027829041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a80c4130 0x7f18a806d910 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 -- 172.21.15.90:0/2027829041 >> 172.21.15.90:0/2027829041 conn(0x7f18a80c8080 msgr2=0x7f18a80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 -- 172.21.15.90:0/2027829041 shutdown_connections 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.368+0000 7f18ad196640 1 -- 172.21.15.90:0/2027829041 wait complete. 2024-04-20T10:54:13.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.370+0000 7f18ad196640 1 Processor -- start 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.370+0000 7f18ad196640 1 -- start start 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18ad196640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a806de50 0x7f18a81fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18ad196640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a81fc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18ad196640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a80c4130 0x7f18a81ec3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18ad196640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f18a80c3050 con 0x7f18a806de50 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18ad196640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f18a8073b00 con 0x7f18a80c4130 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18ad196640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f18a8070510 con 0x7f18a80ab8b0 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a806de50 0x7f18a81fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a806de50 0x7f18a81fbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:49172/0 (socket says 172.21.15.90:49172) 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 -- 172.21.15.90:0/4125606017 learned_addr learned my addr 172.21.15.90:0/4125606017 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a659c640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a81fc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a759e640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a80c4130 0x7f18a81ec3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 -- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 msgr2=0x7f18a81fc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:13.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a81fc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 -- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a80c4130 msgr2=0x7f18a81ec3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a80c4130 0x7f18a81ec3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 -- 172.21.15.90:0/4125606017 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a80bd140 con 0x7f18a806de50 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18a6d9d640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a806de50 0x7f18a81fbf70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f189c000c00 tx=0x7f189c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f188f7fe640 1 -- 172.21.15.90:0/4125606017 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c042020 con 0x7f18a806de50 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f188f7fe640 1 -- 172.21.15.90:0/4125606017 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f189c030e20 con 0x7f18a806de50 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.371+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a81fc9f0 con 0x7f18a806de50 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.372+0000 7f188f7fe640 1 -- 172.21.15.90:0/4125606017 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c038040 con 0x7f18a806de50 2024-04-20T10:54:13.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.372+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a80bd3b0 con 0x7f18a806de50 2024-04-20T10:54:13.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.373+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18a8076150 con 0x7f18a806de50 2024-04-20T10:54:13.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.373+0000 7f188f7fe640 1 -- 172.21.15.90:0/4125606017 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f189c045020 con 0x7f18a806de50 2024-04-20T10:54:13.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.373+0000 7f188f7fe640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f189406c920 0x7f189406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:13.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.374+0000 7f18a659c640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f189406c920 0x7f189406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:13.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.374+0000 7f188f7fe640 1 -- 172.21.15.90:0/4125606017 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 6895+0+0 (secure 0 0 0) 0x7f189c0ad720 con 0x7f18a806de50 2024-04-20T10:54:13.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.374+0000 7f18a659c640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f189406c920 0x7f189406ede0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f18a81ef1d0 tx=0x7f1898000ed0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:13.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.378+0000 7f188f7fe640 1 -- 172.21.15.90:0/4125606017 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f189c04c030 con 0x7f18a806de50 2024-04-20T10:54:13.595 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.595+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18a80c32b0 con 0x7f18a806de50 2024-04-20T10:54:13.596 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.596+0000 7f188f7fe640 1 -- 172.21.15.90:0/4125606017 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+6533 (secure 0 0 0) 0x7f189c07b0f0 con 0x7f18a806de50 2024-04-20T10:54:13.596 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:13.596 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5367,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:52:44.337276+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":29,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4282},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4282":{"gid":4282,"name":"b","rank":0,"incarnation":15,"state":"up:active","state_seq":36,"addr":"172.21.15.175:6833/1855171726","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1855171726},{"type":"v1","addr":"172.21.15.175:6833","nonce":1855171726}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4282,"qdb_cluster":[4282]},"id":2}]} 2024-04-20T10:54:13.597 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 26 2024-04-20T10:54:13.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f189406c920 msgr2=0x7f189406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:13.598 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f189406c920 0x7f189406ede0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f18a81ef1d0 tx=0x7f1898000ed0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a806de50 msgr2=0x7f18a81fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a806de50 0x7f18a81fbf70 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f189c000c00 tx=0x7f189c0046c0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 shutdown_connections 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f189406c920 0x7f189406ede0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f18a80c4130 0x7f18a81ec3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f18a80ab8b0 0x7f18a81fc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 --2- 172.21.15.90:0/4125606017 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f18a806de50 0x7f18a81fbf70 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 >> 172.21.15.90:0/4125606017 conn(0x7f18a80c8080 msgr2=0x7f18a80c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 shutdown_connections 2024-04-20T10:54:13.599 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:13.598+0000 7f18ad196640 1 -- 172.21.15.90:0/4125606017 wait complete. 2024-04-20T10:54:13.609 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:54:15.611 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:15.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.714+0000 7fb0e1fa4640 1 Processor -- start 2024-04-20T10:54:15.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.714+0000 7fb0e1fa4640 1 -- start start 2024-04-20T10:54:15.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.714+0000 7fb0e1fa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb0dc0c9ee0 0x7fb0dc156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:15.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.714+0000 7fb0e1fa4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc15a720 con 0x7fb0dc153ef0 2024-04-20T10:54:15.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0e1fa4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0dc15ac80 con 0x7fb0dc0ab730 2024-04-20T10:54:15.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0e1fa4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb0dc15a9a0 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0dbfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb0dc0c9ee0 0x7fb0dc156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:15.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0db7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb0dc153ef0 0x7fb0dc0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49536/0 (socket says 172.21.15.90:49536) 2024-04-20T10:54:15.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0dbfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb0dc0c9ee0 0x7fb0dc156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34882/0 (socket says 172.21.15.90:34882) 2024-04-20T10:54:15.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0db7fe640 1 -- 172.21.15.90:0/1103928953 learned_addr learned my addr 172.21.15.90:0/1103928953 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:15.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0dbfff640 1 -- 172.21.15.90:0/1103928953 >> v1:172.21.15.175:6789/0 conn(0x7fb0dc0ab730 legacy=0x7fb0dc1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:15.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0dbfff640 1 -- 172.21.15.90:0/1103928953 >> v1:172.21.15.90:6789/0 conn(0x7fb0dc153ef0 legacy=0x7fb0dc0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:15.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.715+0000 7fb0dbfff640 1 -- 172.21.15.90:0/1103928953 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc0c6a90 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.716+0000 7fb0dbfff640 1 --2- 172.21.15.90:0/1103928953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc156fd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009d90 tx=0x7fb0d402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51e80b956b29709 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.716+0000 7fb0da7fc640 1 -- 172.21.15.90:0/1103928953 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4039070 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.716+0000 7fb0da7fc640 1 -- 172.21.15.90:0/1103928953 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d402cb40 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.716+0000 7fb0da7fc640 1 -- 172.21.15.90:0/1103928953 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4034440 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.717+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/1103928953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 msgr2=0x7fb0dc156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.717+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/1103928953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc156fd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4009d90 tx=0x7fb0d402bd90 comp rx=0 tx=0).stop 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.717+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/1103928953 shutdown_connections 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.717+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/1103928953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc156fd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.717+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/1103928953 >> 172.21.15.90:0/1103928953 conn(0x7fb0dc0cbfe0 msgr2=0x7fb0dc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:15.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.717+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/1103928953 shutdown_connections 2024-04-20T10:54:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.717+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/1103928953 wait complete. 2024-04-20T10:54:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.718+0000 7fb0e1fa4640 1 Processor -- start 2024-04-20T10:54:15.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.718+0000 7fb0e1fa4640 1 -- start start 2024-04-20T10:54:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0e1fa4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0dc0ab730 0x7fb0dc158950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0e1fa4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0e1fa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc153ef0 0x7fb0dc151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:15.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0e1fa4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc0c9100 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0e1fa4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb0dc157510 con 0x7fb0dc153ef0 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0e1fa4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb0dc0c9280 con 0x7fb0dc0ab730 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34892/0 (socket says 172.21.15.90:34892) 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 -- 172.21.15.90:0/4129081575 learned_addr learned my addr 172.21.15.90:0/4129081575 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0dbfff640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc153ef0 0x7fb0dc151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0db7fe640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0dc0ab730 0x7fb0dc158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 -- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0dc0ab730 msgr2=0x7fb0dc158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0dc0ab730 0x7fb0dc158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 -- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc153ef0 msgr2=0x7fb0dc151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc153ef0 0x7fb0dc151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.719+0000 7fb0daffd640 1 -- 172.21.15.90:0/4129081575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0dc159160 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.720+0000 7fb0daffd640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc150c50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000b3f0 tx=0x7fb0d000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:15.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.720+0000 7fb0c3fff640 1 -- 172.21.15.90:0/4129081575 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0015020 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.720+0000 7fb0c3fff640 1 -- 172.21.15.90:0/4129081575 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d0011830 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.720+0000 7fb0c3fff640 1 -- 172.21.15.90:0/4129081575 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0011c20 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.720+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0dc159690 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.720+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0dc158e90 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.721+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0dc076150 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.721+0000 7fb0c3fff640 1 -- 172.21.15.90:0/4129081575 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0d0018020 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.722+0000 7fb0c3fff640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb0c806c8f0 0x7fb0c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.722+0000 7fb0c3fff640 1 -- 172.21.15.90:0/4129081575 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fb0d008ba20 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.722+0000 7fb0db7fe640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb0c806c8f0 0x7fb0c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:15.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.722+0000 7fb0db7fe640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb0c806c8f0 0x7fb0c806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc007fd0 tx=0x7fb0cc007e80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:15.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.726+0000 7fb0c3fff640 1 -- 172.21.15.90:0/4129081575 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb0d001f030 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.951+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0dc0ad5f0 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.952+0000 7fb0c3fff640 1 -- 172.21.15.90:0/4129081575 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5697 (secure 0 0 0) 0x7fb0d0059390 con 0x7fb0dc0c9ee0 2024-04-20T10:54:15.952 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:15.953 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:15.331369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:54:15.953 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 27 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb0c806c8f0 msgr2=0x7fb0c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb0c806c8f0 0x7fb0c806edb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc007fd0 tx=0x7fb0cc007e80 comp rx=0 tx=0).stop 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 msgr2=0x7fb0dc150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc150c50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000b3f0 tx=0x7fb0d000b8b0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 shutdown_connections 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb0c806c8f0 0x7fb0c806edb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb0dc153ef0 0x7fb0dc151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb0dc0c9ee0 0x7fb0dc150c50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 --2- 172.21.15.90:0/4129081575 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb0dc0ab730 0x7fb0dc158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:15.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.954+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 >> 172.21.15.90:0/4129081575 conn(0x7fb0dc0cbfe0 msgr2=0x7fb0dc0acad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.955+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 shutdown_connections 2024-04-20T10:54:15.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:15.955+0000 7fb0e1fa4640 1 -- 172.21.15.90:0/4129081575 wait complete. 2024-04-20T10:54:15.965 INFO:tasks.mds_thrash.fs.[b]:mds.b down, removed from mdsmap 2024-04-20T10:54:15.966 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-20T10:54:15.966 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:16.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.063+0000 7f10e7631640 1 Processor -- start 2024-04-20T10:54:16.064 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.064+0000 7f10e7631640 1 -- start start 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e7631640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f10e0153ef0 0x7f10e00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e7631640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e015a720 con 0x7f10e00c9ee0 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e7631640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10e015ac80 con 0x7f10e00ab730 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e7631640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f10e015a9a0 con 0x7f10e0153ef0 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e53cd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f10e0153ef0 0x7f10e00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e5bce640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f10e00c9ee0 0x7f10e0156fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49550/0 (socket says 172.21.15.90:49550) 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e53cd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f10e0153ef0 0x7f10e00c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34906/0 (socket says 172.21.15.90:34906) 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e5bce640 1 -- 172.21.15.90:0/2941367858 learned_addr learned my addr 172.21.15.90:0/2941367858 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:16.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e53cd640 1 -- 172.21.15.90:0/2941367858 >> v1:172.21.15.175:6789/0 conn(0x7f10e00ab730 legacy=0x7f10e01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:16.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e53cd640 1 -- 172.21.15.90:0/2941367858 >> v1:172.21.15.90:6789/0 conn(0x7f10e00c9ee0 legacy=0x7f10e0156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:16.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10d7fff640 1 -- 172.21.15.90:0/2941367858 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508406513 0 0) 0x7f10d8001490 con 0x7f10e00c9ee0 2024-04-20T10:54:16.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.065+0000 7f10e53cd640 1 -- 172.21.15.90:0/2941367858 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e00c6a90 con 0x7f10e0153ef0 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.066+0000 7f10e53cd640 1 --2- 172.21.15.90:0/2941367858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e0153ef0 0x7f10e00c89f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0097a0 tx=0x7f10dc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8227385bb156ebe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10d7fff640 1 -- 172.21.15.90:0/2941367858 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0315a0 con 0x7f10e0153ef0 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10d7fff640 1 -- 172.21.15.90:0/2941367858 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10dc037070 con 0x7f10e0153ef0 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10d7fff640 1 -- 172.21.15.90:0/2941367858 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc031960 con 0x7f10e0153ef0 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10e7631640 1 -- 172.21.15.90:0/2941367858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e0153ef0 msgr2=0x7f10e00c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10e7631640 1 --2- 172.21.15.90:0/2941367858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e0153ef0 0x7f10e00c89f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0097a0 tx=0x7f10dc02b840 comp rx=0 tx=0).stop 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10e7631640 1 -- 172.21.15.90:0/2941367858 shutdown_connections 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10e7631640 1 --2- 172.21.15.90:0/2941367858 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e0153ef0 0x7f10e00c89f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10e7631640 1 -- 172.21.15.90:0/2941367858 >> 172.21.15.90:0/2941367858 conn(0x7f10e00cbfe0 msgr2=0x7f10e00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:16.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10e7631640 1 -- 172.21.15.90:0/2941367858 shutdown_connections 2024-04-20T10:54:16.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.067+0000 7f10e7631640 1 -- 172.21.15.90:0/2941367858 wait complete. 2024-04-20T10:54:16.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.069+0000 7f10e7631640 1 Processor -- start 2024-04-20T10:54:16.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.069+0000 7f10e7631640 1 -- start start 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e7631640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e00ab730 0x7f10e0155c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e7631640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e00c9ee0 0x7f10e01ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e7631640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e0153ef0 0x7f10e01eca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e7631640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f10e00bf800 con 0x7f10e00ab730 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e7631640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f10e00c8f30 con 0x7f10e00c9ee0 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e7631640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f10e00c0d80 con 0x7f10e0153ef0 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e53cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e00ab730 0x7f10e0155c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e53cd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e00ab730 0x7f10e0155c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34914/0 (socket says 172.21.15.90:34914) 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e53cd640 1 -- 172.21.15.90:0/3700127695 learned_addr learned my addr 172.21.15.90:0/3700127695 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e4bcc640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e00c9ee0 0x7f10e01ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.070+0000 7f10e5bce640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e0153ef0 0x7f10e01eca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:16.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e53cd640 1 -- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e0153ef0 msgr2=0x7f10e01eca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e53cd640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e0153ef0 0x7f10e01eca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e53cd640 1 -- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e00c9ee0 msgr2=0x7f10e01ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e53cd640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e00c9ee0 0x7f10e01ec4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e53cd640 1 -- 172.21.15.90:0/3700127695 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10e01ecf60 con 0x7f10e00ab730 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e5bce640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e0153ef0 0x7f10e01eca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e53cd640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e00ab730 0x7f10e0155c50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0098c0 tx=0x7f10dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10d5ffb640 1 -- 172.21.15.90:0/3700127695 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc032840 con 0x7f10e00ab730 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10d5ffb640 1 -- 172.21.15.90:0/3700127695 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10dc0329e0 con 0x7f10e00ab730 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10d5ffb640 1 -- 172.21.15.90:0/3700127695 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10dc032dd0 con 0x7f10e00ab730 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10e0156620 con 0x7f10e00ab730 2024-04-20T10:54:16.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.071+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10e00c1020 con 0x7f10e00ab730 2024-04-20T10:54:16.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.072+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10e0076150 con 0x7f10e00ab730 2024-04-20T10:54:16.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.073+0000 7f10d5ffb640 1 -- 172.21.15.90:0/3700127695 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10dc04d3f0 con 0x7f10e00ab730 2024-04-20T10:54:16.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.073+0000 7f10d5ffb640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:16.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.073+0000 7f10d5ffb640 1 -- 172.21.15.90:0/3700127695 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f10dc02f030 con 0x7f10e00ab730 2024-04-20T10:54:16.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.073+0000 7f10e4bcc640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:16.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.074+0000 7f10e4bcc640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f10c406c8f0 0x7f10c406edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ac650 tx=0x7f10d0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.077+0000 7f10d5ffb640 1 -- 172.21.15.90:0/3700127695 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f10dc040070 con 0x7f10e00ab730 2024-04-20T10:54:16.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.299+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10e006d070 con 0x7f10e00ab730 2024-04-20T10:54:16.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.300+0000 7f10d5ffb640 1 -- 172.21.15.90:0/3700127695 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+5697 (secure 0 0 0) 0x7f10dc07bbe0 con 0x7f10e00ab730 2024-04-20T10:54:16.300 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:16.300 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:15.331369+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:54:16.301 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 27 2024-04-20T10:54:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f10c406c8f0 msgr2=0x7f10c406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f10c406c8f0 0x7f10c406edb0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f10e00ac650 tx=0x7f10d0009040 comp rx=0 tx=0).stop 2024-04-20T10:54:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e00ab730 msgr2=0x7f10e0155c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:16.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e00ab730 0x7f10e0155c50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0098c0 tx=0x7f10dc0046c0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 shutdown_connections 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f10c406c8f0 0x7f10c406edb0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f10e0153ef0 0x7f10e01eca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f10e00c9ee0 0x7f10e01ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 --2- 172.21.15.90:0/3700127695 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f10e00ab730 0x7f10e0155c50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 >> 172.21.15.90:0/3700127695 conn(0x7f10e00cbfe0 msgr2=0x7f10e00acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 shutdown_connections 2024-04-20T10:54:16.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:16.302+0000 7f10e7631640 1 -- 172.21.15.90:0/3700127695 wait complete. 2024-04-20T10:54:16.314 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 27, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5271": { "addr": "172.21.15.90:6837/1538296646", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6836", "nonce": 1538296646, "type": "v2" }, { "addr": "172.21.15.90:6837", "nonce": 1538296646, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5271, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 15 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:53:39.341370+0000", "qdb_cluster": [ 5271 ], "qdb_leader": 5271, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5271 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 27, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5367": { "addr": "172.21.15.90:6835/4126797977", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6834", "nonce": 4126797977, "type": "v2" }, { "addr": "172.21.15.90:6835", "nonce": 4126797977, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5367, "incarnation": 27, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 31, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:54:15.331369+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5367 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:54:18.314 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:18.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.428+0000 7f39551ca640 1 Processor -- start 2024-04-20T10:54:18.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.428+0000 7f39551ca640 1 -- start start 2024-04-20T10:54:18.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f39551ca640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f39500ab730 0x7f39501568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f39551ca640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395015a720 con 0x7f3950153ef0 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f39551ca640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f395015ac80 con 0x7f39500c9ee0 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f39551ca640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f395015a9a0 con 0x7f39500ab730 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f394ed9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f3950153ef0 0x7f39500c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49560/0 (socket says 172.21.15.90:49560) 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f394ed9d640 1 -- 172.21.15.90:0/821667078 learned_addr learned my addr 172.21.15.90:0/821667078 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f394e59c640 1 --2- 172.21.15.90:0/821667078 >> v2:172.21.15.175:3300/0 conn(0x7f39500ab730 0x7f39501568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f394e59c640 1 -- 172.21.15.90:0/821667078 >> v1:172.21.15.175:6789/0 conn(0x7f39500c9ee0 legacy=0x7f3950156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f394e59c640 1 -- 172.21.15.90:0/821667078 >> v1:172.21.15.90:6789/0 conn(0x7f3950153ef0 legacy=0x7f39500c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.429+0000 7f394e59c640 1 -- 172.21.15.90:0/821667078 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39500c6a90 con 0x7f39500ab730 2024-04-20T10:54:18.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.430+0000 7f394e59c640 1 --2- 172.21.15.90:0/821667078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500ab730 0x7f39501568c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39440097a0 tx=0x7f394402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7807f9dcc8a0b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:18.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f394dd9b640 1 -- 172.21.15.90:0/821667078 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39440315a0 con 0x7f39500ab730 2024-04-20T10:54:18.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f394dd9b640 1 -- 172.21.15.90:0/821667078 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3944037070 con 0x7f39500ab730 2024-04-20T10:54:18.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f394dd9b640 1 -- 172.21.15.90:0/821667078 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3944031960 con 0x7f39500ab730 2024-04-20T10:54:18.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f39551ca640 1 -- 172.21.15.90:0/821667078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500ab730 msgr2=0x7f39501568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f39551ca640 1 --2- 172.21.15.90:0/821667078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500ab730 0x7f39501568c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39440097a0 tx=0x7f394402b840 comp rx=0 tx=0).stop 2024-04-20T10:54:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f39551ca640 1 -- 172.21.15.90:0/821667078 shutdown_connections 2024-04-20T10:54:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f39551ca640 1 --2- 172.21.15.90:0/821667078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500ab730 0x7f39501568c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f39551ca640 1 -- 172.21.15.90:0/821667078 >> 172.21.15.90:0/821667078 conn(0x7f39500cbfe0 msgr2=0x7f39500cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f39551ca640 1 -- 172.21.15.90:0/821667078 shutdown_connections 2024-04-20T10:54:18.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.433+0000 7f39551ca640 1 -- 172.21.15.90:0/821667078 wait complete. 2024-04-20T10:54:18.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.435+0000 7f39551ca640 1 Processor -- start 2024-04-20T10:54:18.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.435+0000 7f39551ca640 1 -- start start 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f39551ca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39500ab730 0x7f39501ef450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f39551ca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500c9ee0 0x7f39501ef990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f39551ca640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950153ef0 0x7f39501eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f39551ca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f39500c9100 con 0x7f39500ab730 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f39551ca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3950157510 con 0x7f39500c9ee0 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f39551ca640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f39500c9280 con 0x7f3950153ef0 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f394ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39500ab730 0x7f39501ef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f394ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39500ab730 0x7f39501ef450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34926/0 (socket says 172.21.15.90:34926) 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.436+0000 7f394ed9d640 1 -- 172.21.15.90:0/1975694081 learned_addr learned my addr 172.21.15.90:0/1975694081 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:18.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394f59e640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950153ef0 0x7f39501eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394e59c640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500c9ee0 0x7f39501ef990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394ed9d640 1 -- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950153ef0 msgr2=0x7f39501eda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394ed9d640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950153ef0 0x7f39501eda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394ed9d640 1 -- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500c9ee0 msgr2=0x7f39501ef990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394ed9d640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500c9ee0 0x7f39501ef990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394ed9d640 1 -- 172.21.15.90:0/1975694081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3950159540 con 0x7f39500ab730 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394e59c640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500c9ee0 0x7f39501ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f394ed9d640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39500ab730 0x7f39501ef450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f394000c4d0 tx=0x7f394000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.437+0000 7f39377fe640 1 -- 172.21.15.90:0/1975694081 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940017070 con 0x7f39500ab730 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.438+0000 7f39377fe640 1 -- 172.21.15.90:0/1975694081 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3940005ce0 con 0x7f39500ab730 2024-04-20T10:54:18.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.438+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3950159820 con 0x7f39500ab730 2024-04-20T10:54:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.438+0000 7f39377fe640 1 -- 172.21.15.90:0/1975694081 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3940007270 con 0x7f39500ab730 2024-04-20T10:54:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.438+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39501f00b0 con 0x7f39500ab730 2024-04-20T10:54:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.439+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3950076150 con 0x7f39500ab730 2024-04-20T10:54:18.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.439+0000 7f39377fe640 1 -- 172.21.15.90:0/1975694081 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f394001a070 con 0x7f39500ab730 2024-04-20T10:54:18.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.440+0000 7f39377fe640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f393c06c920 0x7f393c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:18.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.440+0000 7f39377fe640 1 -- 172.21.15.90:0/1975694081 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f394008b310 con 0x7f39500ab730 2024-04-20T10:54:18.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.440+0000 7f394e59c640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f393c06c920 0x7f393c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:18.442 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.440+0000 7f394e59c640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f393c06c920 0x7f393c06ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3944036000 tx=0x7f394403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:18.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.444+0000 7f39377fe640 1 -- 172.21.15.90:0/1975694081 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f395015a720 con 0x7f39500ab730 2024-04-20T10:54:18.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.679+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3950151660 con 0x7f39500ab730 2024-04-20T10:54:18.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.680+0000 7f39377fe640 1 -- 172.21.15.90:0/1975694081 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+5698 (secure 0 0 0) 0x7f3940058bf0 con 0x7f39500ab730 2024-04-20T10:54:18.681 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:18.681 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:18.395375+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:rejoin","state_seq":11,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:54:18.682 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 29 2024-04-20T10:54:18.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f393c06c920 msgr2=0x7f393c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:18.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f393c06c920 0x7f393c06ede0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3944036000 tx=0x7f394403d040 comp rx=0 tx=0).stop 2024-04-20T10:54:18.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39500ab730 msgr2=0x7f39501ef450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39500ab730 0x7f39501ef450 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f394000c4d0 tx=0x7f394000c990 comp rx=0 tx=0).stop 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 shutdown_connections 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f393c06c920 0x7f393c06ede0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3950153ef0 0x7f39501eda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f39500c9ee0 0x7f39501ef990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 --2- 172.21.15.90:0/1975694081 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f39500ab730 0x7f39501ef450 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 >> 172.21.15.90:0/1975694081 conn(0x7f39500cbfe0 msgr2=0x7f39500adbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 shutdown_connections 2024-04-20T10:54:18.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:18.682+0000 7f39551ca640 1 -- 172.21.15.90:0/1975694081 wait complete. 2024-04-20T10:54:18.694 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:54:20.695 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:20.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.793+0000 7f9ed54c1640 1 Processor -- start 2024-04-20T10:54:20.794 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.793+0000 7f9ed54c1640 1 -- start start 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.793+0000 7f9ed54c1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ed0153ce0 0x7f9ed00ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.793+0000 7f9ed54c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed00c5580 0x7f9ed015a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.793+0000 7f9ed54c1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ed00c3ba0 con 0x7f9ed00c4360 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.793+0000 7f9ed54c1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9ed015ac10 con 0x7f9ed0153ce0 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.793+0000 7f9ed54c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed0071570 con 0x7f9ed00c5580 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9eceffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ed0153ce0 0x7f9ed00ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9eceffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ed0153ce0 0x7f9ed00ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34928/0 (socket says 172.21.15.90:34928) 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9eceffd640 1 -- 172.21.15.90:0/1940176970 learned_addr learned my addr 172.21.15.90:0/1940176970 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9ec7fff640 1 --2- 172.21.15.90:0/1940176970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed00c5580 0x7f9ed015a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:20.796 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9eceffd640 1 -- 172.21.15.90:0/1940176970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed00c5580 msgr2=0x7f9ed015a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9eceffd640 1 --2- 172.21.15.90:0/1940176970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed00c5580 0x7f9ed015a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9eceffd640 1 -- 172.21.15.90:0/1940176970 >> v1:172.21.15.175:6789/0 conn(0x7f9ed00c4360 legacy=0x7f9ed00c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.794+0000 7f9eceffd640 1 -- 172.21.15.90:0/1940176970 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed0071850 con 0x7f9ed0153ce0 2024-04-20T10:54:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.795+0000 7f9eceffd640 1 --2- 172.21.15.90:0/1940176970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed0153ce0 0x7f9ed00ad690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009870 tx=0x7f9ec002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723152d03fa6efb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.795+0000 7f9ece7fc640 1 -- 172.21.15.90:0/1940176970 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0034070 con 0x7f9ed0153ce0 2024-04-20T10:54:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.795+0000 7f9ece7fc640 1 -- 172.21.15.90:0/1940176970 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec0030840 con 0x7f9ed0153ce0 2024-04-20T10:54:20.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.795+0000 7f9ece7fc640 1 -- 172.21.15.90:0/1940176970 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0030c10 con 0x7f9ed0153ce0 2024-04-20T10:54:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.795+0000 7f9ed54c1640 1 -- 172.21.15.90:0/1940176970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed0153ce0 msgr2=0x7f9ed00ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.795+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/1940176970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed0153ce0 0x7f9ed00ad690 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009870 tx=0x7f9ec002b980 comp rx=0 tx=0).stop 2024-04-20T10:54:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.796+0000 7f9ed54c1640 1 -- 172.21.15.90:0/1940176970 shutdown_connections 2024-04-20T10:54:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.796+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/1940176970 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed00c5580 0x7f9ed015a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.796+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/1940176970 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed0153ce0 0x7f9ed00ad690 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.796+0000 7f9ed54c1640 1 -- 172.21.15.90:0/1940176970 >> 172.21.15.90:0/1940176970 conn(0x7f9ed00c9100 msgr2=0x7f9ed00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:20.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.796+0000 7f9ed54c1640 1 -- 172.21.15.90:0/1940176970 shutdown_connections 2024-04-20T10:54:20.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.796+0000 7f9ed54c1640 1 -- 172.21.15.90:0/1940176970 wait complete. 2024-04-20T10:54:20.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.797+0000 7f9ed54c1640 1 Processor -- start 2024-04-20T10:54:20.799 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.797+0000 7f9ed54c1640 1 -- start start 2024-04-20T10:54:20.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ed54c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed00c4360 0x7f9ed01e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ed54c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed00c5580 0x7f9ed006d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ed54c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed0153ce0 0x7f9ed01efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ed54c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed01540c0 con 0x7f9ed00c5580 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ed54c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed0071b30 con 0x7f9ed00c4360 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ed54c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ed00c2c40 con 0x7f9ed0153ce0 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed00c5580 0x7f9ed006d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.798+0000 7f9ec7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed00c5580 0x7f9ed006d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34940/0 (socket says 172.21.15.90:34940) 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec7fff640 1 -- 172.21.15.90:0/2860617114 learned_addr learned my addr 172.21.15.90:0/2860617114 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9eceffd640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed00c4360 0x7f9ed01e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ecf7fe640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed0153ce0 0x7f9ed01efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec7fff640 1 -- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed0153ce0 msgr2=0x7f9ed01efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec7fff640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed0153ce0 0x7f9ed01efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:20.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec7fff640 1 -- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed00c4360 msgr2=0x7f9ed01e0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec7fff640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed00c4360 0x7f9ed01e0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec7fff640 1 -- 172.21.15.90:0/2860617114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed01e0540 con 0x7f9ed00c5580 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec7fff640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed00c5580 0x7f9ed006d070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800d800 tx=0x7f9eb800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec77fe640 1 -- 172.21.15.90:0/2860617114 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800b6c0 con 0x7f9ed00c5580 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec77fe640 1 -- 172.21.15.90:0/2860617114 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9eb8019070 con 0x7f9ed00c5580 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ec77fe640 1 -- 172.21.15.90:0/2860617114 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800bac0 con 0x7f9ed00c5580 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed006c8b0 con 0x7f9ed00c5580 2024-04-20T10:54:20.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.799+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed01e0260 con 0x7f9ed00c5580 2024-04-20T10:54:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.801+0000 7f9ec77fe640 1 -- 172.21.15.90:0/2860617114 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9eb800bc60 con 0x7f9ed00c5580 2024-04-20T10:54:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.801+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed0076150 con 0x7f9ed00c5580 2024-04-20T10:54:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.801+0000 7f9ec77fe640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eb006c8f0 0x7f9eb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.801+0000 7f9ec77fe640 1 -- 172.21.15.90:0/2860617114 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f9eb808c370 con 0x7f9ed00c5580 2024-04-20T10:54:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.801+0000 7f9eceffd640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eb006c8f0 0x7f9eb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:20.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.802+0000 7f9eceffd640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eb006c8f0 0x7f9eb006edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:20.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:20.805+0000 7f9ec77fe640 1 -- 172.21.15.90:0/2860617114 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9eb8059ce0 con 0x7f9ed00c5580 2024-04-20T10:54:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.149+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ed00c5360 con 0x7f9ed00c5580 2024-04-20T10:54:21.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.149+0000 7f9ec77fe640 1 -- 172.21.15.90:0/2860617114 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5705 (secure 0 0 0) 0x7f9eb805dfe0 con 0x7f9ed00c5580 2024-04-20T10:54:21.151 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:21.151 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:21.151 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 31 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eb006c8f0 msgr2=0x7f9eb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eb006c8f0 0x7f9eb006edb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0036000 tx=0x7f9ec003b040 comp rx=0 tx=0).stop 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed00c5580 msgr2=0x7f9ed006d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed00c5580 0x7f9ed006d070 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9eb800d800 tx=0x7f9eb800dcc0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 shutdown_connections 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eb006c8f0 0x7f9eb006edb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ed0153ce0 0x7f9ed01efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ed00c5580 0x7f9ed006d070 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.152+0000 7f9ed54c1640 1 --2- 172.21.15.90:0/2860617114 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ed00c4360 0x7f9ed01e0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.153+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 >> 172.21.15.90:0/2860617114 conn(0x7f9ed00c9100 msgr2=0x7f9ed00ad5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:21.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.153+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 shutdown_connections 2024-04-20T10:54:21.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.153+0000 7f9ed54c1640 1 -- 172.21.15.90:0/2860617114 wait complete. 2024-04-20T10:54:21.166 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=4282 2024-04-20T10:54:21.166 INFO:tasks.mds_thrash.fs.[b]:waiting for 0 secs before reviving mds.b 2024-04-20T10:54:21.166 INFO:tasks.mds_thrash.fs.[b]:reviving mds.b 2024-04-20T10:54:21.166 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-20T10:54:21.166 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-20T10:54:21.169 INFO:tasks.ceph.mds.b:Started 2024-04-20T10:54:21.169 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:21.239 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-20T10:54:21.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.268+0000 7f4eb7c55640 1 Processor -- start 2024-04-20T10:54:21.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.269+0000 7f4eb7c55640 1 -- start start 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.269+0000 7f4eb7c55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.269+0000 7f4eb7c55640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb0158780 con 0x7f4eb00c45c0 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.269+0000 7f4eb7c55640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4eb01546d0 con 0x7f4eb0073120 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.269+0000 7f4eb7c55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00ad010 con 0x7f4eb0072860 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb51f0640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4eb00c45c0 0x7f4eb00ab4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49574/0 (socket says 172.21.15.90:49574) 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb51f0640 1 -- 172.21.15.90:0/1771725961 learned_addr learned my addr 172.21.15.90:0/1771725961 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb59f1640 1 --2- 172.21.15.90:0/1771725961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb49ef640 1 -- 172.21.15.90:0/1771725961 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589444535 0 0) 0x7f4eb0158780 con 0x7f4eb00c45c0 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb49ef640 1 -- 172.21.15.90:0/1771725961 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e9c003520 con 0x7f4eb00c45c0 2024-04-20T10:54:21.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb49ef640 1 -- 172.21.15.90:0/1771725961 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438939453 0 0) 0x7f4eb01546d0 con 0x7f4eb0073120 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb49ef640 1 -- 172.21.15.90:0/1771725961 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4eb0158780 con 0x7f4eb0073120 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb59f1640 1 -- 172.21.15.90:0/1771725961 >> v1:172.21.15.175:6789/0 conn(0x7f4eb0073120 legacy=0x7f4eb0151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb59f1640 1 -- 172.21.15.90:0/1771725961 >> v1:172.21.15.90:6789/0 conn(0x7f4eb00c45c0 legacy=0x7f4eb00ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.270+0000 7f4eb59f1640 1 -- 172.21.15.90:0/1771725961 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb01549b0 con 0x7f4eb0072860 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.271+0000 7f4eb59f1640 1 --2- 172.21.15.90:0/1771725961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01551b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00097d0 tx=0x7f4ea002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0006593141b5dcf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.271+0000 7f4eb49ef640 1 -- 172.21.15.90:0/1771725961 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0035020 con 0x7f4eb0072860 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.271+0000 7f4eb49ef640 1 -- 172.21.15.90:0/1771725961 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ea0031800 con 0x7f4eb0072860 2024-04-20T10:54:21.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.271+0000 7f4eb49ef640 1 -- 172.21.15.90:0/1771725961 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0031bd0 con 0x7f4eb0072860 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.271+0000 7f4eb7c55640 1 -- 172.21.15.90:0/1771725961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 msgr2=0x7f4eb01551b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.271+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/1771725961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01551b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4ea00097d0 tx=0x7f4ea002b8a0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.272+0000 7f4eb7c55640 1 -- 172.21.15.90:0/1771725961 shutdown_connections 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.272+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/1771725961 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01551b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.272+0000 7f4eb7c55640 1 -- 172.21.15.90:0/1771725961 >> 172.21.15.90:0/1771725961 conn(0x7f4eb0067de0 msgr2=0x7f4eb00ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.272+0000 7f4eb7c55640 1 -- 172.21.15.90:0/1771725961 shutdown_connections 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.272+0000 7f4eb7c55640 1 -- 172.21.15.90:0/1771725961 wait complete. 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 Processor -- start 2024-04-20T10:54:21.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 -- start start 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0073120 0x7f4eb01439e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb00c45c0 0x7f4eb01e6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0158a60 con 0x7f4eb0073120 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb0158530 con 0x7f4eb00c45c0 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb7c55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4eb00abbb0 con 0x7f4eb0072860 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb51f0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0073120 0x7f4eb01439e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb51f0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0073120 0x7f4eb01439e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34948/0 (socket says 172.21.15.90:34948) 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.273+0000 7f4eb51f0640 1 -- 172.21.15.90:0/625027986 learned_addr learned my addr 172.21.15.90:0/625027986 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb59f1640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb61f2640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb00c45c0 0x7f4eb01e6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:21.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb51f0640 1 -- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 msgr2=0x7f4eb01532e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb51f0640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01532e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb51f0640 1 -- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb00c45c0 msgr2=0x7f4eb01e6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb51f0640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb00c45c0 0x7f4eb01e6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb51f0640 1 -- 172.21.15.90:0/625027986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb01eaa00 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb51f0640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0073120 0x7f4eb01439e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00c530 tx=0x7f4eac00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4ea67fc640 1 -- 172.21.15.90:0/625027986 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac017070 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4ea67fc640 1 -- 172.21.15.90:0/625027986 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eac005ce0 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb01e9c40 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4ea67fc640 1 -- 172.21.15.90:0/625027986 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac007270 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.274+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb01ea200 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.275+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eb0076150 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.275+0000 7f4ea67fc640 1 -- 172.21.15.90:0/625027986 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4eac01a070 con 0x7f4eb0073120 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.276+0000 7f4ea67fc640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e9406c8f0 0x7f4e9406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:21.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.276+0000 7f4ea67fc640 1 -- 172.21.15.90:0/625027986 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f4eac08b250 con 0x7f4eb0073120 2024-04-20T10:54:21.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.276+0000 7f4eb59f1640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e9406c8f0 0x7f4e9406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:21.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.276+0000 7f4eb59f1640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e9406c8f0 0x7f4e9406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0036000 tx=0x7f4ea003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:21.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.280+0000 7f4ea67fc640 1 -- 172.21.15.90:0/625027986 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4eac058bc0 con 0x7f4eb0073120 2024-04-20T10:54:21.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.497+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4eb00ab540 con 0x7f4eb0073120 2024-04-20T10:54:21.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.498+0000 7f4ea67fc640 1 -- 172.21.15.90:0/625027986 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7f4eac05cec0 con 0x7f4eb0073120 2024-04-20T10:54:21.499 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:21.499 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:21.499 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e9406c8f0 msgr2=0x7f4e9406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e9406c8f0 0x7f4e9406edb0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0036000 tx=0x7f4ea003c040 comp rx=0 tx=0).stop 2024-04-20T10:54:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0073120 msgr2=0x7f4eb01439e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0073120 0x7f4eb01439e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4eac00c530 tx=0x7f4eac00c9f0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 shutdown_connections 2024-04-20T10:54:21.501 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4e9406c8f0 0x7f4e9406edb0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4eb00c45c0 0x7f4eb01e6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4eb0073120 0x7f4eb01439e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 --2- 172.21.15.90:0/625027986 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4eb0072860 0x7f4eb01532e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 >> 172.21.15.90:0/625027986 conn(0x7f4eb0067de0 msgr2=0x7f4eb0070050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 shutdown_connections 2024-04-20T10:54:21.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:21.500+0000 7f4eb7c55640 1 -- 172.21.15.90:0/625027986 wait complete. 2024-04-20T10:54:21.511 INFO:tasks.mds_thrash.fs.[b]:mds.b reported in up:standby state 2024-04-20T10:54:21.512 INFO:tasks.mds_thrash.fs.[b]:waiting for 10 secs before thrashing 2024-04-20T10:54:22.679 INFO:tasks.workunit.client.1.smithi175.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-20T10:54:23.138 INFO:tasks.workunit.client.1.smithi175.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-20T10:54:23.139 INFO:tasks.workunit.client.1.smithi175.stderr:+ make 2024-04-20T10:54:23.518 INFO:tasks.workunit.client.1.smithi175.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-20T10:54:23.746 INFO:tasks.workunit.client.1.smithi175.stderr:++ readlink -f fsstress 2024-04-20T10:54:23.746 INFO:tasks.workunit.client.1.smithi175.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-20T10:54:23.747 INFO:tasks.workunit.client.1.smithi175.stderr:+ popd 2024-04-20T10:54:23.747 INFO:tasks.workunit.client.1.smithi175.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-04-20T10:54:23.747 INFO:tasks.workunit.client.1.smithi175.stderr:+ popd 2024-04-20T10:54:23.747 INFO:tasks.workunit.client.1.smithi175.stdout:~/cephtest/mnt.1/client.1/tmp 2024-04-20T10:54:23.748 INFO:tasks.workunit.client.1.smithi175.stderr:++ mktemp -d -p . 2024-04-20T10:54:23.748 INFO:tasks.workunit.client.1.smithi175.stderr:+ T=./tmp.8xc6qsUUr2 2024-04-20T10:54:23.748 INFO:tasks.workunit.client.1.smithi175.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.8xc6qsUUr2 -l 1 -n 1000 -p 10 -v 2024-04-20T10:54:23.749 INFO:tasks.workunit.client.1.smithi175.stdout:seed = 1713957644 2024-04-20T10:54:23.751 INFO:tasks.workunit.client.1.smithi175.stdout:0/0: read - no filename 2024-04-20T10:54:23.751 INFO:tasks.workunit.client.1.smithi175.stdout:0/1: stat - no entries 2024-04-20T10:54:23.751 INFO:tasks.workunit.client.1.smithi175.stdout:0/2: chown . 380628323 1 2024-04-20T10:54:23.751 INFO:tasks.workunit.client.1.smithi175.stdout:0/3: unlink - no file 2024-04-20T10:54:23.751 INFO:tasks.workunit.client.1.smithi175.stdout:0/4: write - no filename 2024-04-20T10:54:23.752 INFO:tasks.workunit.client.1.smithi175.stdout:0/5: write - no filename 2024-04-20T10:54:23.752 INFO:tasks.workunit.client.1.smithi175.stdout:1/0: fsync - no filename 2024-04-20T10:54:23.752 INFO:tasks.workunit.client.1.smithi175.stdout:1/1: write - no filename 2024-04-20T10:54:23.752 INFO:tasks.workunit.client.1.smithi175.stdout:0/6: creat f0 x:0 0 0 2024-04-20T10:54:23.752 INFO:tasks.workunit.client.1.smithi175.stdout:0/7: dread - f0 zero size 2024-04-20T10:54:23.753 INFO:tasks.workunit.client.1.smithi175.stdout:2/0: chown . 2 1 2024-04-20T10:54:23.753 INFO:tasks.workunit.client.1.smithi175.stdout:2/1: fdatasync - no filename 2024-04-20T10:54:23.753 INFO:tasks.workunit.client.1.smithi175.stdout:2/2: chown . 60 1 2024-04-20T10:54:23.753 INFO:tasks.workunit.client.1.smithi175.stdout:2/3: dread - no filename 2024-04-20T10:54:23.753 INFO:tasks.workunit.client.1.smithi175.stdout:2/4: stat - no entries 2024-04-20T10:54:23.753 INFO:tasks.workunit.client.1.smithi175.stdout:1/2: mkdir d0 0 2024-04-20T10:54:23.754 INFO:tasks.workunit.client.1.smithi175.stdout:3/0: fsync - no filename 2024-04-20T10:54:23.754 INFO:tasks.workunit.client.1.smithi175.stdout:3/1: write - no filename 2024-04-20T10:54:23.755 INFO:tasks.workunit.client.1.smithi175.stdout:2/5: creat f0 x:0 0 0 2024-04-20T10:54:23.755 INFO:tasks.workunit.client.1.smithi175.stdout:2/6: dread - f0 zero size 2024-04-20T10:54:23.755 INFO:tasks.workunit.client.1.smithi175.stdout:1/3: creat d0/f1 x:0 0 0 2024-04-20T10:54:23.755 INFO:tasks.workunit.client.1.smithi175.stdout:1/4: write d0/f1 [409559,106079] 0 2024-04-20T10:54:23.756 INFO:tasks.workunit.client.1.smithi175.stdout:1/5: chown d0/f1 37353964 1 2024-04-20T10:54:23.757 INFO:tasks.workunit.client.1.smithi175.stdout:3/2: creat f0 x:0 0 0 2024-04-20T10:54:23.758 INFO:tasks.workunit.client.1.smithi175.stdout:2/7: mkdir d1 0 2024-04-20T10:54:23.758 INFO:tasks.workunit.client.1.smithi175.stdout:2/8: truncate f0 798707 0 2024-04-20T10:54:23.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/0: dwrite - no filename 2024-04-20T10:54:23.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/1: fdatasync - no filename 2024-04-20T10:54:23.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/2: dwrite - no filename 2024-04-20T10:54:23.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/3: write - no filename 2024-04-20T10:54:23.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/4: truncate - no filename 2024-04-20T10:54:23.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/5: rename - no filename 2024-04-20T10:54:23.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/6: readlink - no filename 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/0: symlink l0 0 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/1: dread - no filename 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/2: dwrite - no filename 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/3: write - no filename 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/4: write - no filename 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/5: read - no filename 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/6: stat l0 0 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/7: rmdir - no directory 2024-04-20T10:54:23.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/8: readlink l0 0 2024-04-20T10:54:23.762 INFO:tasks.workunit.client.1.smithi175.stdout:4/9: dread - no filename 2024-04-20T10:54:23.762 INFO:tasks.workunit.client.1.smithi175.stdout:4/10: chown l0 4 1 2024-04-20T10:54:23.762 INFO:tasks.workunit.client.1.smithi175.stdout:3/3: link f0 f1 0 2024-04-20T10:54:23.762 INFO:tasks.workunit.client.1.smithi175.stdout:0/8: fsync f0 0 2024-04-20T10:54:23.763 INFO:tasks.workunit.client.1.smithi175.stdout:0/9: write f0 [773577,7854] 0 2024-04-20T10:54:23.763 INFO:tasks.workunit.client.1.smithi175.stdout:0/10: readlink - no filename 2024-04-20T10:54:23.763 INFO:tasks.workunit.client.1.smithi175.stdout:2/9: mknod d1/c2 0 2024-04-20T10:54:23.764 INFO:tasks.workunit.client.1.smithi175.stdout:2/10: dread f0 [0,4194304] 0 2024-04-20T10:54:23.764 INFO:tasks.workunit.client.1.smithi175.stdout:6/0: fdatasync - no filename 2024-04-20T10:54:23.765 INFO:tasks.workunit.client.1.smithi175.stdout:5/7: creat f0 x:0 0 0 2024-04-20T10:54:23.766 INFO:tasks.workunit.client.1.smithi175.stdout:4/11: creat f1 x:0 0 0 2024-04-20T10:54:23.766 INFO:tasks.workunit.client.1.smithi175.stdout:3/4: mknod c2 0 2024-04-20T10:54:23.766 INFO:tasks.workunit.client.1.smithi175.stdout:3/5: chown f1 625 1 2024-04-20T10:54:23.767 INFO:tasks.workunit.client.1.smithi175.stdout:3/6: write f1 [790154,81029] 0 2024-04-20T10:54:23.767 INFO:tasks.workunit.client.1.smithi175.stdout:2/11: creat d1/f3 x:0 0 0 2024-04-20T10:54:23.769 INFO:tasks.workunit.client.1.smithi175.stdout:7/0: truncate - no filename 2024-04-20T10:54:23.769 INFO:tasks.workunit.client.1.smithi175.stdout:7/1: truncate - no filename 2024-04-20T10:54:23.769 INFO:tasks.workunit.client.1.smithi175.stdout:6/1: mknod c0 0 2024-04-20T10:54:23.769 INFO:tasks.workunit.client.1.smithi175.stdout:5/8: mknod c1 0 2024-04-20T10:54:23.770 INFO:tasks.workunit.client.1.smithi175.stdout:4/12: creat f2 x:0 0 0 2024-04-20T10:54:23.770 INFO:tasks.workunit.client.1.smithi175.stdout:4/13: dread - f1 zero size 2024-04-20T10:54:23.770 INFO:tasks.workunit.client.1.smithi175.stdout:4/14: write f1 [772090,31301] 0 2024-04-20T10:54:23.771 INFO:tasks.workunit.client.1.smithi175.stdout:4/15: write f1 [542861,2785] 0 2024-04-20T10:54:23.771 INFO:tasks.workunit.client.1.smithi175.stdout:4/16: chown l0 10 1 2024-04-20T10:54:23.771 INFO:tasks.workunit.client.1.smithi175.stdout:2/12: link d1/f3 d1/f4 0 2024-04-20T10:54:23.771 INFO:tasks.workunit.client.1.smithi175.stdout:2/13: fdatasync d1/f3 0 2024-04-20T10:54:23.772 INFO:tasks.workunit.client.1.smithi175.stdout:8/0: dwrite - no filename 2024-04-20T10:54:23.772 INFO:tasks.workunit.client.1.smithi175.stdout:7/2: creat f0 x:0 0 0 2024-04-20T10:54:23.772 INFO:tasks.workunit.client.1.smithi175.stdout:1/6: dwrite d0/f1 [0,4194304] 0 2024-04-20T10:54:23.773 INFO:tasks.workunit.client.1.smithi175.stdout:6/2: mkdir d1 0 2024-04-20T10:54:23.773 INFO:tasks.workunit.client.1.smithi175.stdout:6/3: dread - no filename 2024-04-20T10:54:23.775 INFO:tasks.workunit.client.1.smithi175.stdout:5/9: creat f2 x:0 0 0 2024-04-20T10:54:23.775 INFO:tasks.workunit.client.1.smithi175.stdout:5/10: read - f2 zero size 2024-04-20T10:54:23.776 INFO:tasks.workunit.client.1.smithi175.stdout:2/14: creat d1/f5 x:0 0 0 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:8/1: symlink l0 0 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/0: link - no file 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/1: truncate - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/2: write - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/3: truncate - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/4: truncate - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/5: dread - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/6: truncate - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/7: read - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/8: dread - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/9: write - no filename 2024-04-20T10:54:23.778 INFO:tasks.workunit.client.1.smithi175.stdout:9/10: rename - no filename 2024-04-20T10:54:23.779 INFO:tasks.workunit.client.1.smithi175.stdout:9/11: dwrite - no filename 2024-04-20T10:54:23.779 INFO:tasks.workunit.client.1.smithi175.stdout:9/12: dread - no filename 2024-04-20T10:54:23.779 INFO:tasks.workunit.client.1.smithi175.stdout:8/2: write - no filename 2024-04-20T10:54:23.779 INFO:tasks.workunit.client.1.smithi175.stdout:9/13: readlink - no filename 2024-04-20T10:54:23.779 INFO:tasks.workunit.client.1.smithi175.stdout:8/3: fdatasync - no filename 2024-04-20T10:54:23.779 INFO:tasks.workunit.client.1.smithi175.stdout:9/14: stat - no entries 2024-04-20T10:54:23.781 INFO:tasks.workunit.client.1.smithi175.stdout:1/7: read d0/f1 [4166716,34679] 0 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:7/3: rename f0 to f1 0 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:7/4: dread - f1 zero size 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:6/4: creat d1/f2 x:0 0 0 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:7/5: dread - f1 zero size 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:7/6: stat f1 0 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:7/7: dread - f1 zero size 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:7/8: dread - f1 zero size 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:6/5: chown c0 1 1 2024-04-20T10:54:23.783 INFO:tasks.workunit.client.1.smithi175.stdout:2/15: creat d1/f6 x:0 0 0 2024-04-20T10:54:23.784 INFO:tasks.workunit.client.1.smithi175.stdout:1/8: dread d0/f1 [0,4194304] 0 2024-04-20T10:54:23.784 INFO:tasks.workunit.client.1.smithi175.stdout:8/4: creat f1 x:0 0 0 2024-04-20T10:54:23.784 INFO:tasks.workunit.client.1.smithi175.stdout:8/5: dread - f1 zero size 2024-04-20T10:54:23.785 INFO:tasks.workunit.client.1.smithi175.stdout:9/15: creat f0 x:0 0 0 2024-04-20T10:54:23.786 INFO:tasks.workunit.client.1.smithi175.stdout:7/9: creat f2 x:0 0 0 2024-04-20T10:54:23.787 INFO:tasks.workunit.client.1.smithi175.stdout:3/7: fsync f0 0 2024-04-20T10:54:23.787 INFO:tasks.workunit.client.1.smithi175.stdout:3/8: chown f1 0 1 2024-04-20T10:54:23.787 INFO:tasks.workunit.client.1.smithi175.stdout:0/11: dwrite f0 [0,4194304] 0 2024-04-20T10:54:23.788 INFO:tasks.workunit.client.1.smithi175.stdout:6/6: mkdir d1/d3 0 2024-04-20T10:54:23.788 INFO:tasks.workunit.client.1.smithi175.stdout:6/7: stat d1/f2 0 2024-04-20T10:54:23.789 INFO:tasks.workunit.client.1.smithi175.stdout:3/9: read f0 [335096,83894] 0 2024-04-20T10:54:23.789 INFO:tasks.workunit.client.1.smithi175.stdout:2/16: mkdir d1/d7 0 2024-04-20T10:54:23.792 INFO:tasks.workunit.client.1.smithi175.stdout:1/9: unlink d0/f1 0 2024-04-20T10:54:23.792 INFO:tasks.workunit.client.1.smithi175.stdout:1/10: truncate - no filename 2024-04-20T10:54:23.792 INFO:tasks.workunit.client.1.smithi175.stdout:1/11: write - no filename 2024-04-20T10:54:23.792 INFO:tasks.workunit.client.1.smithi175.stdout:1/12: chown d0 215 1 2024-04-20T10:54:23.792 INFO:tasks.workunit.client.1.smithi175.stdout:1/13: stat d0 0 2024-04-20T10:54:23.793 INFO:tasks.workunit.client.1.smithi175.stdout:1/14: dread - no filename 2024-04-20T10:54:23.793 INFO:tasks.workunit.client.1.smithi175.stdout:1/15: chown d0 1 1 2024-04-20T10:54:23.793 INFO:tasks.workunit.client.1.smithi175.stdout:1/16: write - no filename 2024-04-20T10:54:23.793 INFO:tasks.workunit.client.1.smithi175.stdout:1/17: write - no filename 2024-04-20T10:54:23.793 INFO:tasks.workunit.client.1.smithi175.stdout:1/18: write - no filename 2024-04-20T10:54:23.793 INFO:tasks.workunit.client.1.smithi175.stdout:1/19: chown d0 52 1 2024-04-20T10:54:23.794 INFO:tasks.workunit.client.1.smithi175.stdout:8/6: rename f1 to f2 0 2024-04-20T10:54:23.794 INFO:tasks.workunit.client.1.smithi175.stdout:8/7: dread - f2 zero size 2024-04-20T10:54:23.794 INFO:tasks.workunit.client.1.smithi175.stdout:5/11: dwrite f2 [0,4194304] 0 2024-04-20T10:54:23.794 INFO:tasks.workunit.client.1.smithi175.stdout:5/12: rmdir - no directory 2024-04-20T10:54:23.796 INFO:tasks.workunit.client.1.smithi175.stdout:7/10: creat f3 x:0 0 0 2024-04-20T10:54:23.798 INFO:tasks.workunit.client.1.smithi175.stdout:6/8: unlink d1/f2 0 2024-04-20T10:54:23.798 INFO:tasks.workunit.client.1.smithi175.stdout:6/9: fdatasync - no filename 2024-04-20T10:54:23.798 INFO:tasks.workunit.client.1.smithi175.stdout:6/10: chown c0 205 1 2024-04-20T10:54:23.798 INFO:tasks.workunit.client.1.smithi175.stdout:6/11: rename d1 to d1/d3/d4 22 2024-04-20T10:54:23.799 INFO:tasks.workunit.client.1.smithi175.stdout:0/12: dread f0 [0,4194304] 0 2024-04-20T10:54:23.799 INFO:tasks.workunit.client.1.smithi175.stdout:0/13: readlink - no filename 2024-04-20T10:54:23.801 INFO:tasks.workunit.client.1.smithi175.stdout:3/10: rename c2 to c3 0 2024-04-20T10:54:23.801 INFO:tasks.workunit.client.1.smithi175.stdout:2/17: link f0 d1/d7/f8 0 2024-04-20T10:54:23.803 INFO:tasks.workunit.client.1.smithi175.stdout:1/20: creat d0/f2 x:0 0 0 2024-04-20T10:54:23.803 INFO:tasks.workunit.client.1.smithi175.stdout:1/21: chown d0 0 1 2024-04-20T10:54:23.804 INFO:tasks.workunit.client.1.smithi175.stdout:0/14: write f0 [1378226,60324] 0 2024-04-20T10:54:23.806 INFO:tasks.workunit.client.1.smithi175.stdout:0/15: fsync f0 0 2024-04-20T10:54:23.806 INFO:tasks.workunit.client.1.smithi175.stdout:0/16: rmdir - no directory 2024-04-20T10:54:23.806 INFO:tasks.workunit.client.1.smithi175.stdout:0/17: fdatasync f0 0 2024-04-20T10:54:23.806 INFO:tasks.workunit.client.1.smithi175.stdout:5/13: symlink l3 0 2024-04-20T10:54:23.807 INFO:tasks.workunit.client.1.smithi175.stdout:7/11: symlink l4 0 2024-04-20T10:54:23.813 INFO:tasks.workunit.client.1.smithi175.stdout:3/11: symlink l4 0 2024-04-20T10:54:23.814 INFO:tasks.workunit.client.1.smithi175.stdout:6/12: rename d1/d3 to d1/d5 0 2024-04-20T10:54:23.815 INFO:tasks.workunit.client.1.smithi175.stdout:2/18: rename d1/c2 to d1/c9 0 2024-04-20T10:54:23.815 INFO:tasks.workunit.client.1.smithi175.stdout:2/19: truncate d1/d7/f8 1735106 0 2024-04-20T10:54:23.815 INFO:tasks.workunit.client.1.smithi175.stdout:2/20: truncate d1/f4 839756 0 2024-04-20T10:54:23.817 INFO:tasks.workunit.client.1.smithi175.stdout:1/22: creat d0/f3 x:0 0 0 2024-04-20T10:54:23.824 INFO:tasks.workunit.client.1.smithi175.stdout:0/18: creat f1 x:0 0 0 2024-04-20T10:54:23.827 INFO:tasks.workunit.client.1.smithi175.stdout:8/8: dwrite f2 [0,4194304] 0 2024-04-20T10:54:23.828 INFO:tasks.workunit.client.1.smithi175.stdout:8/9: stat f2 0 2024-04-20T10:54:23.828 INFO:tasks.workunit.client.1.smithi175.stdout:8/10: chown f2 1266895 1 2024-04-20T10:54:23.829 INFO:tasks.workunit.client.1.smithi175.stdout:7/12: mknod c5 0 2024-04-20T10:54:23.829 INFO:tasks.workunit.client.1.smithi175.stdout:6/13: creat d1/d5/f6 x:0 0 0 2024-04-20T10:54:23.829 INFO:tasks.workunit.client.1.smithi175.stdout:6/14: rename d1 to d1/d5/d7 22 2024-04-20T10:54:23.830 INFO:tasks.workunit.client.1.smithi175.stdout:9/16: getdents . 0 2024-04-20T10:54:23.831 INFO:tasks.workunit.client.1.smithi175.stdout:1/23: mknod d0/c4 0 2024-04-20T10:54:23.831 INFO:tasks.workunit.client.1.smithi175.stdout:1/24: dread - d0/f2 zero size 2024-04-20T10:54:23.836 INFO:tasks.workunit.client.1.smithi175.stdout:0/19: creat f2 x:0 0 0 2024-04-20T10:54:23.836 INFO:tasks.workunit.client.1.smithi175.stdout:0/20: dread - f1 zero size 2024-04-20T10:54:23.836 INFO:tasks.workunit.client.1.smithi175.stdout:0/21: read - f2 zero size 2024-04-20T10:54:23.836 INFO:tasks.workunit.client.1.smithi175.stdout:0/22: dread - f1 zero size 2024-04-20T10:54:23.854 INFO:tasks.workunit.client.1.smithi175.stdout:4/17: truncate f1 378220 0 2024-04-20T10:54:23.854 INFO:tasks.workunit.client.1.smithi175.stdout:4/18: fdatasync f1 0 2024-04-20T10:54:23.859 INFO:tasks.workunit.client.1.smithi175.stdout:3/12: dread f0 [0,4194304] 0 2024-04-20T10:54:24.085 INFO:tasks.workunit.client.0.smithi090.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-20T10:54:24.086 INFO:tasks.workunit.client.0.smithi090.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-20T10:54:24.086 INFO:tasks.workunit.client.0.smithi090.stderr:+ make 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:6/15: mknod d1/d5/c8 0 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:7/13: creat f6 x:0 0 0 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:6/16: readlink - no filename 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:4/19: fsync f1 0 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:9/17: creat f1 x:0 0 0 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:4/20: rmdir - no directory 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:4/21: readlink l0 0 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:8/11: unlink l0 0 2024-04-20T10:54:24.350 INFO:tasks.workunit.client.1.smithi175.stdout:4/22: write f2 [360295,75315] 0 2024-04-20T10:54:24.371 INFO:tasks.workunit.client.1.smithi175.stdout:1/25: dwrite d0/f3 [0,4194304] 0 2024-04-20T10:54:24.371 INFO:tasks.workunit.client.1.smithi175.stdout:1/26: dread - d0/f2 zero size 2024-04-20T10:54:24.396 INFO:tasks.workunit.client.1.smithi175.stdout:3/13: rename f1 to f5 0 2024-04-20T10:54:24.397 INFO:tasks.workunit.client.1.smithi175.stdout:3/14: rmdir - no directory 2024-04-20T10:54:24.408 INFO:tasks.workunit.client.1.smithi175.stdout:4/23: dwrite f1 [0,4194304] 0 2024-04-20T10:54:24.409 INFO:tasks.workunit.client.1.smithi175.stdout:4/24: chown f2 53089012 1 2024-04-20T10:54:24.461 INFO:tasks.workunit.client.0.smithi090.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-20T10:54:24.516 INFO:tasks.workunit.client.1.smithi175.stdout:7/14: mknod c7 0 2024-04-20T10:54:24.516 INFO:tasks.workunit.client.1.smithi175.stdout:7/15: write f1 [594110,29707] 0 2024-04-20T10:54:24.516 INFO:tasks.workunit.client.1.smithi175.stdout:7/16: chown f6 0 1 2024-04-20T10:54:24.517 INFO:tasks.workunit.client.1.smithi175.stdout:6/17: link d1/d5/f6 d1/f9 0 2024-04-20T10:54:24.517 INFO:tasks.workunit.client.1.smithi175.stdout:0/23: link f0 f3 0 2024-04-20T10:54:24.518 INFO:tasks.workunit.client.1.smithi175.stdout:9/18: creat f2 x:0 0 0 2024-04-20T10:54:24.519 INFO:tasks.workunit.client.1.smithi175.stdout:8/12: mknod c3 0 2024-04-20T10:54:24.521 INFO:tasks.workunit.client.1.smithi175.stdout:1/27: creat d0/f5 x:0 0 0 2024-04-20T10:54:24.524 INFO:tasks.workunit.client.1.smithi175.stdout:7/17: mknod c8 0 2024-04-20T10:54:24.525 INFO:tasks.workunit.client.1.smithi175.stdout:6/18: creat d1/d5/fa x:0 0 0 2024-04-20T10:54:24.526 INFO:tasks.workunit.client.1.smithi175.stdout:1/28: unlink d0/f2 0 2024-04-20T10:54:24.526 INFO:tasks.workunit.client.1.smithi175.stdout:1/29: chown d0/f3 30385 1 2024-04-20T10:54:24.526 INFO:tasks.workunit.client.1.smithi175.stdout:1/30: write d0/f5 [822516,6650] 0 2024-04-20T10:54:24.529 INFO:tasks.workunit.client.1.smithi175.stdout:8/13: write f2 [2724822,12092] 0 2024-04-20T10:54:24.529 INFO:tasks.workunit.client.1.smithi175.stdout:8/14: write f2 [3547530,93350] 0 2024-04-20T10:54:24.531 INFO:tasks.workunit.client.1.smithi175.stdout:7/18: rename f3 to f9 0 2024-04-20T10:54:24.531 INFO:tasks.workunit.client.1.smithi175.stdout:6/19: creat d1/fb x:0 0 0 2024-04-20T10:54:24.531 INFO:tasks.workunit.client.1.smithi175.stdout:6/20: dread - d1/d5/fa zero size 2024-04-20T10:54:24.531 INFO:tasks.workunit.client.1.smithi175.stdout:7/19: write f9 [88386,38422] 0 2024-04-20T10:54:24.531 INFO:tasks.workunit.client.1.smithi175.stdout:6/21: dread - d1/d5/fa zero size 2024-04-20T10:54:24.531 INFO:tasks.workunit.client.1.smithi175.stdout:9/19: rename f2 to f3 0 2024-04-20T10:54:24.531 INFO:tasks.workunit.client.1.smithi175.stdout:9/20: read - f3 zero size 2024-04-20T10:54:24.532 INFO:tasks.workunit.client.1.smithi175.stdout:9/21: chown f0 105800 1 2024-04-20T10:54:24.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/22: unlink f0 0 2024-04-20T10:54:24.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/23: chown f3 468840 1 2024-04-20T10:54:24.537 INFO:tasks.workunit.client.1.smithi175.stdout:9/24: mknod c4 0 2024-04-20T10:54:24.539 INFO:tasks.workunit.client.1.smithi175.stdout:9/25: link f1 f5 0 2024-04-20T10:54:24.541 INFO:tasks.workunit.client.1.smithi175.stdout:9/26: mkdir d6 0 2024-04-20T10:54:24.541 INFO:tasks.workunit.client.1.smithi175.stdout:4/25: dwrite f1 [0,4194304] 0 2024-04-20T10:54:24.541 INFO:tasks.workunit.client.1.smithi175.stdout:4/26: rmdir - no directory 2024-04-20T10:54:24.541 INFO:tasks.workunit.client.1.smithi175.stdout:9/27: write f3 [767724,73607] 0 2024-04-20T10:54:24.541 INFO:tasks.workunit.client.1.smithi175.stdout:9/28: dread - f5 zero size 2024-04-20T10:54:24.542 INFO:tasks.workunit.client.1.smithi175.stdout:4/27: creat f3 x:0 0 0 2024-04-20T10:54:24.542 INFO:tasks.workunit.client.1.smithi175.stdout:9/29: creat d6/f7 x:0 0 0 2024-04-20T10:54:24.546 INFO:tasks.workunit.client.1.smithi175.stdout:4/28: mkdir d4 0 2024-04-20T10:54:24.546 INFO:tasks.workunit.client.1.smithi175.stdout:4/29: write f2 [1086152,12995] 0 2024-04-20T10:54:24.546 INFO:tasks.workunit.client.1.smithi175.stdout:4/30: symlink d4/l5 0 2024-04-20T10:54:24.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/30: dread f3 [0,4194304] 0 2024-04-20T10:54:24.555 INFO:tasks.workunit.client.1.smithi175.stdout:1/31: write d0/f3 [4157916,19177] 0 2024-04-20T10:54:24.557 INFO:tasks.workunit.client.1.smithi175.stdout:1/32: mknod d0/c6 0 2024-04-20T10:54:24.567 INFO:tasks.workunit.client.1.smithi175.stdout:4/31: dread f1 [0,4194304] 0 2024-04-20T10:54:24.567 INFO:tasks.workunit.client.1.smithi175.stdout:4/32: write f2 [1675723,11248] 0 2024-04-20T10:54:24.577 INFO:tasks.workunit.client.1.smithi175.stdout:1/33: dread d0/f3 [0,4194304] 0 2024-04-20T10:54:24.578 INFO:tasks.workunit.client.1.smithi175.stdout:1/34: rmdir d0 39 2024-04-20T10:54:24.580 INFO:tasks.workunit.client.1.smithi175.stdout:4/33: dread f2 [0,4194304] 0 2024-04-20T10:54:24.580 INFO:tasks.workunit.client.1.smithi175.stdout:4/34: write f3 [824700,130759] 0 2024-04-20T10:54:24.581 INFO:tasks.workunit.client.1.smithi175.stdout:4/35: mkdir d4/d6 0 2024-04-20T10:54:24.582 INFO:tasks.workunit.client.1.smithi175.stdout:4/36: unlink f3 0 2024-04-20T10:54:24.583 INFO:tasks.workunit.client.1.smithi175.stdout:4/37: mkdir d4/d7 0 2024-04-20T10:54:24.722 INFO:tasks.workunit.client.0.smithi090.stderr:++ readlink -f fsstress 2024-04-20T10:54:24.722 INFO:tasks.workunit.client.0.smithi090.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-20T10:54:24.722 INFO:tasks.workunit.client.0.smithi090.stderr:+ popd 2024-04-20T10:54:24.722 INFO:tasks.workunit.client.0.smithi090.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-20T10:54:24.723 INFO:tasks.workunit.client.0.smithi090.stderr:+ popd 2024-04-20T10:54:24.723 INFO:tasks.workunit.client.0.smithi090.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-20T10:54:24.723 INFO:tasks.workunit.client.0.smithi090.stderr:++ mktemp -d -p . 2024-04-20T10:54:24.724 INFO:tasks.workunit.client.0.smithi090.stderr:+ T=./tmp.JYLQy7chn9 2024-04-20T10:54:24.724 INFO:tasks.workunit.client.0.smithi090.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.JYLQy7chn9 -l 1 -n 1000 -p 10 -v 2024-04-20T10:54:24.725 INFO:tasks.workunit.client.0.smithi090.stdout:seed = 1713933093 2024-04-20T10:54:24.728 INFO:tasks.workunit.client.0.smithi090.stdout:0/0: creat f0 x:0 0 0 2024-04-20T10:54:24.728 INFO:tasks.workunit.client.0.smithi090.stdout:0/1: dread - f0 zero size 2024-04-20T10:54:24.728 INFO:tasks.workunit.client.0.smithi090.stdout:2/0: write - no filename 2024-04-20T10:54:24.728 INFO:tasks.workunit.client.0.smithi090.stdout:2/1: truncate - no filename 2024-04-20T10:54:24.729 INFO:tasks.workunit.client.0.smithi090.stdout:1/0: symlink l0 0 2024-04-20T10:54:24.729 INFO:tasks.workunit.client.0.smithi090.stdout:3/0: write - no filename 2024-04-20T10:54:24.729 INFO:tasks.workunit.client.0.smithi090.stdout:3/1: fsync - no filename 2024-04-20T10:54:24.729 INFO:tasks.workunit.client.0.smithi090.stdout:3/2: write - no filename 2024-04-20T10:54:24.730 INFO:tasks.workunit.client.0.smithi090.stdout:2/2: mknod c0 0 2024-04-20T10:54:24.730 INFO:tasks.workunit.client.0.smithi090.stdout:1/1: symlink l1 0 2024-04-20T10:54:24.730 INFO:tasks.workunit.client.0.smithi090.stdout:1/2: write - no filename 2024-04-20T10:54:24.731 INFO:tasks.workunit.client.0.smithi090.stdout:3/3: creat f0 x:0 0 0 2024-04-20T10:54:24.731 INFO:tasks.workunit.client.0.smithi090.stdout:3/4: rmdir - no directory 2024-04-20T10:54:24.731 INFO:tasks.workunit.client.0.smithi090.stdout:2/3: mknod c1 0 2024-04-20T10:54:24.732 INFO:tasks.workunit.client.0.smithi090.stdout:1/3: mknod c2 0 2024-04-20T10:54:24.733 INFO:tasks.workunit.client.0.smithi090.stdout:4/0: creat f0 x:0 0 0 2024-04-20T10:54:24.734 INFO:tasks.workunit.client.0.smithi090.stdout:3/5: rename f0 to f1 0 2024-04-20T10:54:24.734 INFO:tasks.workunit.client.0.smithi090.stdout:3/6: rmdir - no directory 2024-04-20T10:54:24.734 INFO:tasks.workunit.client.0.smithi090.stdout:3/7: read - f1 zero size 2024-04-20T10:54:24.734 INFO:tasks.workunit.client.0.smithi090.stdout:2/4: symlink l2 0 2024-04-20T10:54:24.734 INFO:tasks.workunit.client.0.smithi090.stdout:2/5: read - no filename 2024-04-20T10:54:24.734 INFO:tasks.workunit.client.0.smithi090.stdout:1/4: mknod c3 0 2024-04-20T10:54:24.736 INFO:tasks.workunit.client.0.smithi090.stdout:5/0: creat f0 x:0 0 0 2024-04-20T10:54:24.736 INFO:tasks.workunit.client.0.smithi090.stdout:5/1: chown f0 32347 1 2024-04-20T10:54:24.736 INFO:tasks.workunit.client.0.smithi090.stdout:5/2: chown f0 292424 1 2024-04-20T10:54:24.736 INFO:tasks.workunit.client.0.smithi090.stdout:5/3: chown f0 19 1 2024-04-20T10:54:24.737 INFO:tasks.workunit.client.0.smithi090.stdout:4/1: mknod c1 0 2024-04-20T10:54:24.737 INFO:tasks.workunit.client.0.smithi090.stdout:4/2: write f0 [934147,49988] 0 2024-04-20T10:54:24.737 INFO:tasks.workunit.client.0.smithi090.stdout:2/6: creat f3 x:0 0 0 2024-04-20T10:54:24.737 INFO:tasks.workunit.client.0.smithi090.stdout:1/5: creat f4 x:0 0 0 2024-04-20T10:54:24.738 INFO:tasks.workunit.client.0.smithi090.stdout:6/0: mknod c0 0 2024-04-20T10:54:24.738 INFO:tasks.workunit.client.0.smithi090.stdout:6/1: dwrite - no filename 2024-04-20T10:54:24.739 INFO:tasks.workunit.client.0.smithi090.stdout:5/4: mkdir d1 0 2024-04-20T10:54:24.739 INFO:tasks.workunit.client.0.smithi090.stdout:2/7: symlink l4 0 2024-04-20T10:54:24.740 INFO:tasks.workunit.client.0.smithi090.stdout:1/6: creat f5 x:0 0 0 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/0: readlink - no filename 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/1: readlink - no filename 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/2: rmdir - no directory 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/3: truncate - no filename 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/4: dwrite - no filename 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/5: write - no filename 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/6: chown . 23341 1 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/7: rmdir - no directory 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/8: chown . 107 1 2024-04-20T10:54:24.741 INFO:tasks.workunit.client.0.smithi090.stdout:8/9: stat - no entries 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:7/0: creat f0 x:0 0 0 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/2: mkdir d1 0 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/3: read - no filename 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/4: truncate - no filename 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/5: dwrite - no filename 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/6: truncate - no filename 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/7: dread - no filename 2024-04-20T10:54:24.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/8: stat c0 0 2024-04-20T10:54:24.743 INFO:tasks.workunit.client.0.smithi090.stdout:5/5: unlink f0 0 2024-04-20T10:54:24.743 INFO:tasks.workunit.client.0.smithi090.stdout:5/6: dread - no filename 2024-04-20T10:54:24.743 INFO:tasks.workunit.client.0.smithi090.stdout:5/7: dread - no filename 2024-04-20T10:54:24.743 INFO:tasks.workunit.client.0.smithi090.stdout:5/8: chown d1 33 1 2024-04-20T10:54:24.744 INFO:tasks.workunit.client.0.smithi090.stdout:1/7: link f4 f6 0 2024-04-20T10:54:24.745 INFO:tasks.workunit.client.0.smithi090.stdout:9/0: rename - no filename 2024-04-20T10:54:24.746 INFO:tasks.workunit.client.0.smithi090.stdout:8/10: mkdir d0 0 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/11: rename d0 to d0/d1 22 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/12: truncate - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/13: write - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/14: read - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/15: truncate - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/16: readlink - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/17: write - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/18: truncate - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/19: stat d0 0 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/20: truncate - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/21: truncate - no filename 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/22: getdents d0 0 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/23: unlink - no file 2024-04-20T10:54:24.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/24: readlink - no filename 2024-04-20T10:54:24.748 INFO:tasks.workunit.client.0.smithi090.stdout:0/2: dwrite f0 [0,4194304] 0 2024-04-20T10:54:24.748 INFO:tasks.workunit.client.0.smithi090.stdout:7/1: creat f1 x:0 0 0 2024-04-20T10:54:24.748 INFO:tasks.workunit.client.0.smithi090.stdout:7/2: fdatasync f1 0 2024-04-20T10:54:24.748 INFO:tasks.workunit.client.0.smithi090.stdout:6/9: creat d1/f2 x:0 0 0 2024-04-20T10:54:24.750 INFO:tasks.workunit.client.0.smithi090.stdout:5/9: creat d1/f2 x:0 0 0 2024-04-20T10:54:24.755 INFO:tasks.workunit.client.0.smithi090.stdout:8/25: creat d0/f2 x:0 0 0 2024-04-20T10:54:24.761 INFO:tasks.workunit.client.0.smithi090.stdout:0/3: fsync f0 0 2024-04-20T10:54:24.765 INFO:tasks.workunit.client.0.smithi090.stdout:7/3: creat f2 x:0 0 0 2024-04-20T10:54:24.768 INFO:tasks.workunit.client.0.smithi090.stdout:6/10: mkdir d1/d3 0 2024-04-20T10:54:24.768 INFO:tasks.workunit.client.0.smithi090.stdout:6/11: write d1/f2 [305323,68] 0 2024-04-20T10:54:24.768 INFO:tasks.workunit.client.0.smithi090.stdout:0/4: mknod c1 0 2024-04-20T10:54:24.768 INFO:tasks.workunit.client.0.smithi090.stdout:0/5: chown f0 6930 1 2024-04-20T10:54:24.776 INFO:tasks.workunit.client.0.smithi090.stdout:7/4: creat f3 x:0 0 0 2024-04-20T10:54:24.787 INFO:tasks.workunit.client.0.smithi090.stdout:3/8: dwrite f1 [0,4194304] 0 2024-04-20T10:54:24.790 INFO:tasks.workunit.client.1.smithi175.stdout:1/35: dread d0/f3 [0,4194304] 0 2024-04-20T10:54:24.790 INFO:tasks.workunit.client.1.smithi175.stdout:1/36: write d0/f3 [945558,26031] 0 2024-04-20T10:54:24.804 INFO:tasks.workunit.client.0.smithi090.stdout:5/10: dwrite d1/f2 [0,4194304] 0 2024-04-20T10:54:24.806 INFO:tasks.workunit.client.0.smithi090.stdout:1/8: dwrite f6 [0,4194304] 0 2024-04-20T10:54:24.813 INFO:tasks.workunit.client.0.smithi090.stdout:8/26: dwrite d0/f2 [0,4194304] 0 2024-04-20T10:54:24.818 INFO:tasks.workunit.client.0.smithi090.stdout:5/11: dread d1/f2 [0,4194304] 0 2024-04-20T10:54:24.820 INFO:tasks.workunit.client.1.smithi175.stdout:0/24: getdents . 0 2024-04-20T10:54:24.821 INFO:tasks.workunit.client.1.smithi175.stdout:1/37: write d0/f3 [4209970,120041] 0 2024-04-20T10:54:24.822 INFO:tasks.workunit.client.1.smithi175.stdout:1/38: symlink d0/l7 0 2024-04-20T10:54:24.823 INFO:tasks.workunit.client.1.smithi175.stdout:1/39: mkdir d0/d8 0 2024-04-20T10:54:24.824 INFO:tasks.workunit.client.1.smithi175.stdout:1/40: rename d0/c6 to d0/d8/c9 0 2024-04-20T10:54:24.826 INFO:tasks.workunit.client.1.smithi175.stdout:1/41: mknod d0/d8/ca 0 2024-04-20T10:54:24.827 INFO:tasks.workunit.client.1.smithi175.stdout:6/22: getdents d1/d5 0 2024-04-20T10:54:24.827 INFO:tasks.workunit.client.1.smithi175.stdout:6/23: readlink - no filename 2024-04-20T10:54:24.828 INFO:tasks.workunit.client.1.smithi175.stdout:6/24: dread - d1/d5/f6 zero size 2024-04-20T10:54:24.828 INFO:tasks.workunit.client.1.smithi175.stdout:1/42: read d0/f5 [307635,106068] 0 2024-04-20T10:54:24.829 INFO:tasks.workunit.client.1.smithi175.stdout:6/25: creat d1/d5/fc x:0 0 0 2024-04-20T10:54:24.829 INFO:tasks.workunit.client.1.smithi175.stdout:6/26: write d1/fb [624834,24217] 0 2024-04-20T10:54:24.831 INFO:tasks.workunit.client.1.smithi175.stdout:6/27: creat d1/d5/fd x:0 0 0 2024-04-20T10:54:24.831 INFO:tasks.workunit.client.1.smithi175.stdout:6/28: chown d1/f9 0 1 2024-04-20T10:54:24.832 INFO:tasks.workunit.client.1.smithi175.stdout:7/20: link f9 fa 0 2024-04-20T10:54:24.832 INFO:tasks.workunit.client.1.smithi175.stdout:7/21: dread - f6 zero size 2024-04-20T10:54:24.834 INFO:tasks.workunit.client.1.smithi175.stdout:6/29: unlink d1/d5/fd 0 2024-04-20T10:54:24.835 INFO:tasks.workunit.client.1.smithi175.stdout:7/22: mkdir db 0 2024-04-20T10:54:24.835 INFO:tasks.workunit.client.1.smithi175.stdout:0/25: dwrite f0 [4194304,4194304] 0 2024-04-20T10:54:24.835 INFO:tasks.workunit.client.1.smithi175.stdout:0/26: readlink - no filename 2024-04-20T10:54:24.836 INFO:tasks.workunit.client.1.smithi175.stdout:0/27: dread - f1 zero size 2024-04-20T10:54:24.836 INFO:tasks.workunit.client.1.smithi175.stdout:6/30: symlink d1/le 0 2024-04-20T10:54:24.836 INFO:tasks.workunit.client.1.smithi175.stdout:6/31: fdatasync d1/f9 0 2024-04-20T10:54:24.839 INFO:tasks.workunit.client.1.smithi175.stdout:7/23: creat db/fc x:0 0 0 2024-04-20T10:54:24.840 INFO:tasks.workunit.client.1.smithi175.stdout:0/28: creat f4 x:0 0 0 2024-04-20T10:54:24.840 INFO:tasks.workunit.client.1.smithi175.stdout:0/29: dread - f2 zero size 2024-04-20T10:54:24.843 INFO:tasks.workunit.client.1.smithi175.stdout:7/24: unlink fa 0 2024-04-20T10:54:24.843 INFO:tasks.workunit.client.1.smithi175.stdout:7/25: write f6 [491480,10375] 0 2024-04-20T10:54:24.843 INFO:tasks.workunit.client.1.smithi175.stdout:7/26: write f6 [916069,25996] 0 2024-04-20T10:54:24.843 INFO:tasks.workunit.client.1.smithi175.stdout:7/27: chown f9 50 1 2024-04-20T10:54:24.843 INFO:tasks.workunit.client.1.smithi175.stdout:7/28: dread - f2 zero size 2024-04-20T10:54:24.843 INFO:tasks.workunit.client.1.smithi175.stdout:7/29: truncate db/fc 257703 0 2024-04-20T10:54:24.843 INFO:tasks.workunit.client.1.smithi175.stdout:7/30: chown c5 83 1 2024-04-20T10:54:24.844 INFO:tasks.workunit.client.1.smithi175.stdout:7/31: creat db/fd x:0 0 0 2024-04-20T10:54:24.845 INFO:tasks.workunit.client.1.smithi175.stdout:7/32: mkdir db/de 0 2024-04-20T10:54:24.847 INFO:tasks.workunit.client.1.smithi175.stdout:7/33: rename f9 to db/de/ff 0 2024-04-20T10:54:24.851 INFO:tasks.workunit.client.1.smithi175.stdout:9/31: getdents d6 0 2024-04-20T10:54:24.853 INFO:tasks.workunit.client.1.smithi175.stdout:9/32: symlink d6/l8 0 2024-04-20T10:54:24.854 INFO:tasks.workunit.client.1.smithi175.stdout:9/33: symlink d6/l9 0 2024-04-20T10:54:24.855 INFO:tasks.workunit.client.1.smithi175.stdout:9/34: creat d6/fa x:0 0 0 2024-04-20T10:54:24.857 INFO:tasks.workunit.client.1.smithi175.stdout:9/35: creat d6/fb x:0 0 0 2024-04-20T10:54:24.857 INFO:tasks.workunit.client.1.smithi175.stdout:9/36: dread - d6/fb zero size 2024-04-20T10:54:24.858 INFO:tasks.workunit.client.1.smithi175.stdout:9/37: rmdir d6 39 2024-04-20T10:54:24.860 INFO:tasks.workunit.client.1.smithi175.stdout:9/38: symlink d6/lc 0 2024-04-20T10:54:24.860 INFO:tasks.workunit.client.1.smithi175.stdout:9/39: read - d6/f7 zero size 2024-04-20T10:54:24.860 INFO:tasks.workunit.client.1.smithi175.stdout:9/40: chown c4 228567 1 2024-04-20T10:54:24.865 INFO:tasks.workunit.client.1.smithi175.stdout:6/32: dwrite d1/d5/f6 [0,4194304] 0 2024-04-20T10:54:24.869 INFO:tasks.workunit.client.1.smithi175.stdout:0/30: dwrite f2 [0,4194304] 0 2024-04-20T10:54:24.870 INFO:tasks.workunit.client.1.smithi175.stdout:7/34: dwrite f6 [0,4194304] 0 2024-04-20T10:54:24.870 INFO:tasks.workunit.client.1.smithi175.stdout:7/35: write db/fd [866535,103071] 0 2024-04-20T10:54:24.870 INFO:tasks.workunit.client.1.smithi175.stdout:7/36: read - f2 zero size 2024-04-20T10:54:24.874 INFO:tasks.workunit.client.1.smithi175.stdout:6/33: dread d1/d5/f6 [0,4194304] 0 2024-04-20T10:54:24.874 INFO:tasks.workunit.client.1.smithi175.stdout:6/34: fsync d1/d5/f6 0 2024-04-20T10:54:24.874 INFO:tasks.workunit.client.1.smithi175.stdout:6/35: fdatasync d1/d5/fc 0 2024-04-20T10:54:24.879 INFO:tasks.workunit.client.1.smithi175.stdout:4/38: truncate f2 252779 0 2024-04-20T10:54:24.879 INFO:tasks.workunit.client.1.smithi175.stdout:4/39: chown d4/d6 64 1 2024-04-20T10:54:24.880 INFO:tasks.workunit.client.1.smithi175.stdout:4/40: chown l0 5945260 1 2024-04-20T10:54:24.892 INFO:tasks.workunit.client.1.smithi175.stdout:0/31: creat f5 x:0 0 0 2024-04-20T10:54:24.894 INFO:tasks.workunit.client.1.smithi175.stdout:7/37: rename c8 to db/c10 0 2024-04-20T10:54:24.894 INFO:tasks.workunit.client.1.smithi175.stdout:7/38: chown db/fd 30 1 2024-04-20T10:54:24.894 INFO:tasks.workunit.client.1.smithi175.stdout:6/36: stat d1/d5/fa 0 2024-04-20T10:54:24.895 INFO:tasks.workunit.client.1.smithi175.stdout:4/41: creat d4/d7/f8 x:0 0 0 2024-04-20T10:54:24.896 INFO:tasks.workunit.client.1.smithi175.stdout:7/39: rename c5 to db/c11 0 2024-04-20T10:54:24.898 INFO:tasks.workunit.client.1.smithi175.stdout:4/42: creat d4/f9 x:0 0 0 2024-04-20T10:54:24.899 INFO:tasks.workunit.client.1.smithi175.stdout:4/43: creat d4/d7/fa x:0 0 0 2024-04-20T10:54:24.901 INFO:tasks.workunit.client.1.smithi175.stdout:9/41: getdents d6 0 2024-04-20T10:54:24.901 INFO:tasks.workunit.client.1.smithi175.stdout:9/42: truncate f3 1551994 0 2024-04-20T10:54:24.902 INFO:tasks.workunit.client.1.smithi175.stdout:6/37: truncate d1/fb 115696 0 2024-04-20T10:54:24.903 INFO:tasks.workunit.client.1.smithi175.stdout:4/44: truncate f1 1758881 0 2024-04-20T10:54:24.903 INFO:tasks.workunit.client.1.smithi175.stdout:6/38: rmdir d1 39 2024-04-20T10:54:24.905 INFO:tasks.workunit.client.1.smithi175.stdout:0/32: dread f3 [4194304,4194304] 0 2024-04-20T10:54:24.922 INFO:tasks.workunit.client.1.smithi175.stdout:9/43: dwrite f1 [0,4194304] 0 2024-04-20T10:54:24.925 INFO:tasks.workunit.client.1.smithi175.stdout:9/44: unlink d6/f7 0 2024-04-20T10:54:24.925 INFO:tasks.workunit.client.1.smithi175.stdout:4/45: rename f2 to d4/fb 0 2024-04-20T10:54:24.926 INFO:tasks.workunit.client.1.smithi175.stdout:9/45: rmdir d6 39 2024-04-20T10:54:24.928 INFO:tasks.workunit.client.1.smithi175.stdout:6/39: dwrite d1/f9 [0,4194304] 0 2024-04-20T10:54:24.928 INFO:tasks.workunit.client.1.smithi175.stdout:6/40: readlink d1/le 0 2024-04-20T10:54:24.930 INFO:tasks.workunit.client.1.smithi175.stdout:4/46: unlink l0 0 2024-04-20T10:54:24.939 INFO:tasks.workunit.client.1.smithi175.stdout:0/33: dwrite f0 [4194304,4194304] 0 2024-04-20T10:54:24.940 INFO:tasks.workunit.client.1.smithi175.stdout:0/34: creat f6 x:0 0 0 2024-04-20T10:54:24.943 INFO:tasks.workunit.client.1.smithi175.stdout:9/46: write f5 [3545745,35539] 0 2024-04-20T10:54:24.943 INFO:tasks.workunit.client.1.smithi175.stdout:9/47: chown d6 135561 1 2024-04-20T10:54:24.946 INFO:tasks.workunit.client.1.smithi175.stdout:4/47: dwrite d4/f9 [0,4194304] 0 2024-04-20T10:54:24.948 INFO:tasks.workunit.client.1.smithi175.stdout:6/41: rename d1/d5/c8 to d1/cf 0 2024-04-20T10:54:24.948 INFO:tasks.workunit.client.1.smithi175.stdout:6/42: chown d1/d5/fa 126 1 2024-04-20T10:54:24.948 INFO:tasks.workunit.client.1.smithi175.stdout:6/43: write d1/fb [810191,60664] 0 2024-04-20T10:54:24.951 INFO:tasks.workunit.client.1.smithi175.stdout:9/48: rename f1 to d6/fd 0 2024-04-20T10:54:24.951 INFO:tasks.workunit.client.1.smithi175.stdout:4/48: rename d4 to d4/d7/dc 22 2024-04-20T10:54:24.952 INFO:tasks.workunit.client.1.smithi175.stdout:9/49: fsync f3 0 2024-04-20T10:54:24.952 INFO:tasks.workunit.client.1.smithi175.stdout:4/49: fsync d4/d7/fa 0 2024-04-20T10:54:24.954 INFO:tasks.workunit.client.1.smithi175.stdout:0/35: write f3 [6011057,117751] 0 2024-04-20T10:54:24.955 INFO:tasks.workunit.client.1.smithi175.stdout:0/36: dread - f6 zero size 2024-04-20T10:54:24.955 INFO:tasks.workunit.client.1.smithi175.stdout:0/37: fdatasync f1 0 2024-04-20T10:54:24.970 INFO:tasks.workunit.client.1.smithi175.stdout:6/44: dwrite d1/d5/fc [0,4194304] 0 2024-04-20T10:54:24.970 INFO:tasks.workunit.client.1.smithi175.stdout:0/38: dwrite f4 [0,4194304] 0 2024-04-20T10:54:24.970 INFO:tasks.workunit.client.1.smithi175.stdout:0/39: truncate f6 497952 0 2024-04-20T10:54:24.971 INFO:tasks.workunit.client.1.smithi175.stdout:6/45: creat d1/d5/f10 x:0 0 0 2024-04-20T10:54:24.980 INFO:tasks.workunit.client.1.smithi175.stdout:6/46: dread d1/d5/fc [0,4194304] 0 2024-04-20T10:54:24.986 INFO:tasks.workunit.client.1.smithi175.stdout:6/47: write d1/f9 [1006082,32837] 0 2024-04-20T10:54:24.987 INFO:tasks.workunit.client.1.smithi175.stdout:9/50: truncate d6/fd 189398 0 2024-04-20T10:54:24.987 INFO:tasks.workunit.client.1.smithi175.stdout:9/51: write d6/fb [842500,25207] 0 2024-04-20T10:54:24.988 INFO:tasks.workunit.client.1.smithi175.stdout:0/40: dwrite f1 [0,4194304] 0 2024-04-20T10:54:24.989 INFO:tasks.workunit.client.1.smithi175.stdout:9/52: creat d6/fe x:0 0 0 2024-04-20T10:54:24.993 INFO:tasks.workunit.client.1.smithi175.stdout:6/48: dread d1/d5/f6 [0,4194304] 0 2024-04-20T10:54:24.995 INFO:tasks.workunit.client.1.smithi175.stdout:0/41: write f4 [1065996,129583] 0 2024-04-20T10:54:24.995 INFO:tasks.workunit.client.1.smithi175.stdout:0/42: rmdir - no directory 2024-04-20T10:54:25.012 INFO:tasks.workunit.client.1.smithi175.stdout:0/43: dwrite f6 [0,4194304] 0 2024-04-20T10:54:25.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/49: creat d1/d5/f11 x:0 0 0 2024-04-20T10:54:25.037 INFO:tasks.workunit.client.1.smithi175.stdout:0/44: dwrite f3 [8388608,4194304] 0 2024-04-20T10:54:25.037 INFO:tasks.workunit.client.1.smithi175.stdout:0/45: write f4 [3884430,131023] 0 2024-04-20T10:54:25.037 INFO:tasks.workunit.client.1.smithi175.stdout:9/53: dwrite d6/fd [0,4194304] 0 2024-04-20T10:54:25.038 INFO:tasks.workunit.client.1.smithi175.stdout:9/54: dread f3 [0,4194304] 0 2024-04-20T10:54:25.038 INFO:tasks.workunit.client.0.smithi090.stdout:2/8: getdents . 0 2024-04-20T10:54:25.038 INFO:tasks.workunit.client.0.smithi090.stdout:6/12: mkdir d1/d4 0 2024-04-20T10:54:25.038 INFO:tasks.workunit.client.0.smithi090.stdout:0/6: creat f2 x:0 0 0 2024-04-20T10:54:25.039 INFO:tasks.workunit.client.0.smithi090.stdout:6/13: read d1/f2 [218036,12906] 0 2024-04-20T10:54:25.039 INFO:tasks.workunit.client.1.smithi175.stdout:0/46: mknod c7 0 2024-04-20T10:54:25.039 INFO:tasks.workunit.client.1.smithi175.stdout:0/47: write f1 [4333207,15593] 0 2024-04-20T10:54:25.040 INFO:tasks.workunit.client.1.smithi175.stdout:9/55: symlink d6/lf 0 2024-04-20T10:54:25.053 INFO:tasks.workunit.client.1.smithi175.stdout:0/48: dwrite f5 [0,4194304] 0 2024-04-20T10:54:25.054 INFO:tasks.workunit.client.1.smithi175.stdout:9/56: unlink d6/fd 0 2024-04-20T10:54:25.056 INFO:tasks.workunit.client.1.smithi175.stdout:0/49: creat f8 x:0 0 0 2024-04-20T10:54:25.056 INFO:tasks.workunit.client.1.smithi175.stdout:0/50: write f8 [630953,30368] 0 2024-04-20T10:54:25.057 INFO:tasks.workunit.client.1.smithi175.stdout:9/57: mkdir d6/d10 0 2024-04-20T10:54:25.058 INFO:tasks.workunit.client.1.smithi175.stdout:9/58: write d6/fe [492512,70722] 0 2024-04-20T10:54:25.060 INFO:tasks.workunit.client.0.smithi090.stdout:6/14: dwrite d1/f2 [0,4194304] 0 2024-04-20T10:54:25.061 INFO:tasks.workunit.client.1.smithi175.stdout:0/51: creat f9 x:0 0 0 2024-04-20T10:54:25.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/3: truncate f0 170000 0 2024-04-20T10:54:25.175 INFO:tasks.workunit.client.1.smithi175.stdout:0/52: fsync f8 0 2024-04-20T10:54:25.175 INFO:tasks.workunit.client.1.smithi175.stdout:0/53: truncate f9 862159 0 2024-04-20T10:54:25.175 INFO:tasks.workunit.client.1.smithi175.stdout:0/54: dread f9 [0,4194304] 0 2024-04-20T10:54:25.183 INFO:tasks.workunit.client.1.smithi175.stdout:0/55: read f1 [3175836,21447] 0 2024-04-20T10:54:25.244 INFO:tasks.workunit.client.1.smithi175.stdout:2/21: sync 2024-04-20T10:54:25.244 INFO:tasks.workunit.client.1.smithi175.stdout:3/15: sync 2024-04-20T10:54:25.244 INFO:tasks.workunit.client.1.smithi175.stdout:5/14: sync 2024-04-20T10:54:25.245 INFO:tasks.workunit.client.1.smithi175.stdout:3/16: stat c3 0 2024-04-20T10:54:25.314 INFO:tasks.workunit.client.1.smithi175.stdout:5/15: mknod c4 0 2024-04-20T10:54:25.320 INFO:tasks.workunit.client.1.smithi175.stdout:5/16: dread f2 [0,4194304] 0 2024-04-20T10:54:25.320 INFO:tasks.workunit.client.1.smithi175.stdout:5/17: write f0 [90482,76801] 0 2024-04-20T10:54:25.324 INFO:tasks.workunit.client.1.smithi175.stdout:5/18: dread f0 [0,4194304] 0 2024-04-20T10:54:25.324 INFO:tasks.workunit.client.1.smithi175.stdout:5/19: fdatasync f0 0 2024-04-20T10:54:25.330 INFO:tasks.workunit.client.1.smithi175.stdout:0/56: truncate f9 566583 0 2024-04-20T10:54:25.355 INFO:tasks.workunit.client.1.smithi175.stdout:0/57: dwrite f6 [0,4194304] 0 2024-04-20T10:54:25.355 INFO:tasks.workunit.client.1.smithi175.stdout:0/58: write f4 [960051,40517] 0 2024-04-20T10:54:25.361 INFO:tasks.workunit.client.1.smithi175.stdout:0/59: write f2 [837853,118658] 0 2024-04-20T10:54:25.363 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-04-20T10:54:25.363+0000 7f6d180d9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:54:25.364 INFO:tasks.workunit.client.1.smithi175.stdout:1/43: sync 2024-04-20T10:54:25.364 INFO:tasks.workunit.client.1.smithi175.stdout:7/40: sync 2024-04-20T10:54:25.364 INFO:tasks.workunit.client.1.smithi175.stdout:4/50: sync 2024-04-20T10:54:25.364 INFO:tasks.workunit.client.1.smithi175.stdout:6/50: sync 2024-04-20T10:54:25.364 INFO:tasks.workunit.client.1.smithi175.stdout:9/59: sync 2024-04-20T10:54:25.364 INFO:tasks.workunit.client.1.smithi175.stdout:3/17: sync 2024-04-20T10:54:25.365 INFO:tasks.workunit.client.1.smithi175.stdout:8/15: sync 2024-04-20T10:54:25.365 INFO:tasks.workunit.client.1.smithi175.stdout:3/18: stat c3 0 2024-04-20T10:54:25.365 INFO:tasks.workunit.client.1.smithi175.stdout:8/16: stat c3 0 2024-04-20T10:54:25.365 INFO:tasks.workunit.client.1.smithi175.stdout:3/19: write f0 [1918755,1087] 0 2024-04-20T10:54:25.365 INFO:tasks.workunit.client.1.smithi175.stdout:7/41: write f2 [354956,28129] 0 2024-04-20T10:54:25.365 INFO:tasks.workunit.client.1.smithi175.stdout:8/17: read f2 [381221,113841] 0 2024-04-20T10:54:25.365 INFO:tasks.workunit.client.1.smithi175.stdout:2/22: sync 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:0/60: getdents . 0 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:0/61: chown c7 6446603 1 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:3/20: write f0 [1444237,61259] 0 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:3/21: write f5 [2685307,95506] 0 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:3/22: rmdir - no directory 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:3/23: chown l4 98376 1 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:9/60: write d6/fa [812759,76832] 0 2024-04-20T10:54:25.367 INFO:tasks.workunit.client.1.smithi175.stdout:4/51: dread f1 [0,4194304] 0 2024-04-20T10:54:25.368 INFO:tasks.workunit.client.1.smithi175.stdout:4/52: chown d4/d6 0 1 2024-04-20T10:54:25.368 INFO:tasks.workunit.client.1.smithi175.stdout:1/44: mknod d0/d8/cb 0 2024-04-20T10:54:25.368 INFO:tasks.workunit.client.1.smithi175.stdout:1/45: fdatasync d0/f5 0 2024-04-20T10:54:25.368 INFO:tasks.workunit.client.1.smithi175.stdout:2/23: getdents d1/d7 0 2024-04-20T10:54:25.368 INFO:tasks.workunit.client.1.smithi175.stdout:0/62: symlink la 0 2024-04-20T10:54:25.369 INFO:tasks.workunit.client.1.smithi175.stdout:8/18: dread f2 [0,4194304] 0 2024-04-20T10:54:25.369 INFO:tasks.workunit.client.1.smithi175.stdout:8/19: chown f2 166730604 1 2024-04-20T10:54:25.369 INFO:tasks.workunit.client.1.smithi175.stdout:9/61: link d6/lc d6/l11 0 2024-04-20T10:54:25.369 INFO:tasks.workunit.client.1.smithi175.stdout:7/42: dread f2 [0,4194304] 0 2024-04-20T10:54:25.369 INFO:tasks.workunit.client.1.smithi175.stdout:7/43: truncate db/fc 956232 0 2024-04-20T10:54:25.370 INFO:tasks.workunit.client.1.smithi175.stdout:1/46: dread d0/f5 [0,4194304] 0 2024-04-20T10:54:25.370 INFO:tasks.workunit.client.1.smithi175.stdout:1/47: fsync d0/f3 0 2024-04-20T10:54:25.370 INFO:tasks.workunit.client.1.smithi175.stdout:6/51: mkdir d1/d5/d12 0 2024-04-20T10:54:25.370 INFO:tasks.workunit.client.1.smithi175.stdout:4/53: rename d4/d6 to d4/dd 0 2024-04-20T10:54:25.371 INFO:tasks.workunit.client.1.smithi175.stdout:4/54: readlink d4/l5 0 2024-04-20T10:54:25.371 INFO:tasks.workunit.client.1.smithi175.stdout:2/24: getdents d1 0 2024-04-20T10:54:25.375 INFO:tasks.workunit.client.1.smithi175.stdout:8/20: link f2 f4 0 2024-04-20T10:54:25.375 INFO:tasks.workunit.client.1.smithi175.stdout:7/44: mkdir db/de/d12 0 2024-04-20T10:54:25.375 INFO:tasks.workunit.client.1.smithi175.stdout:1/48: symlink d0/d8/lc 0 2024-04-20T10:54:25.376 INFO:tasks.workunit.client.1.smithi175.stdout:2/25: dread f0 [0,4194304] 0 2024-04-20T10:54:25.377 INFO:tasks.workunit.client.1.smithi175.stdout:7/45: dread f2 [0,4194304] 0 2024-04-20T10:54:25.378 INFO:tasks.workunit.client.1.smithi175.stdout:8/21: creat f5 x:0 0 0 2024-04-20T10:54:25.383 INFO:tasks.workunit.client.1.smithi175.stdout:8/22: dread f2 [0,4194304] 0 2024-04-20T10:54:25.384 INFO:tasks.workunit.client.1.smithi175.stdout:2/26: mknod d1/d7/ca 0 2024-04-20T10:54:25.385 INFO:tasks.workunit.client.1.smithi175.stdout:0/63: write f5 [416289,15092] 0 2024-04-20T10:54:25.385 INFO:tasks.workunit.client.1.smithi175.stdout:1/49: dread d0/f3 [0,4194304] 0 2024-04-20T10:54:25.386 INFO:tasks.workunit.client.1.smithi175.stdout:1/50: chown d0/d8/c9 21459 1 2024-04-20T10:54:25.386 INFO:tasks.workunit.client.1.smithi175.stdout:1/51: truncate d0/f5 1219821 0 2024-04-20T10:54:25.386 INFO:tasks.workunit.client.1.smithi175.stdout:8/23: rename f4 to f6 0 2024-04-20T10:54:25.386 INFO:tasks.workunit.client.1.smithi175.stdout:2/27: rmdir d1/d7 39 2024-04-20T10:54:25.389 INFO:tasks.workunit.client.1.smithi175.stdout:9/62: dwrite d6/fb [0,4194304] 0 2024-04-20T10:54:25.390 INFO:tasks.workunit.client.1.smithi175.stdout:2/28: mknod d1/d7/cb 0 2024-04-20T10:54:25.394 INFO:tasks.workunit.client.1.smithi175.stdout:7/46: dwrite f2 [0,4194304] 0 2024-04-20T10:54:25.397 INFO:tasks.workunit.client.1.smithi175.stdout:9/63: dread f3 [0,4194304] 0 2024-04-20T10:54:25.397 INFO:tasks.workunit.client.1.smithi175.stdout:9/64: chown d6/d10 123 1 2024-04-20T10:54:25.397 INFO:tasks.workunit.client.1.smithi175.stdout:9/65: write f3 [2222233,69051] 0 2024-04-20T10:54:25.401 INFO:tasks.workunit.client.1.smithi175.stdout:4/55: dwrite d4/fb [0,4194304] 0 2024-04-20T10:54:25.401 INFO:tasks.workunit.client.1.smithi175.stdout:4/56: getdents d4/dd 0 2024-04-20T10:54:25.402 INFO:tasks.workunit.client.1.smithi175.stdout:6/52: getdents d1/d5 0 2024-04-20T10:54:25.404 INFO:tasks.workunit.client.1.smithi175.stdout:4/57: getdents d4/d7 0 2024-04-20T10:54:25.404 INFO:tasks.workunit.client.1.smithi175.stdout:0/64: dwrite f8 [0,4194304] 0 2024-04-20T10:54:25.406 INFO:tasks.workunit.client.1.smithi175.stdout:6/53: creat d1/d5/d12/f13 x:0 0 0 2024-04-20T10:54:25.407 INFO:tasks.workunit.client.1.smithi175.stdout:4/58: mknod d4/dd/ce 0 2024-04-20T10:54:25.408 INFO:tasks.workunit.client.1.smithi175.stdout:8/24: getdents . 0 2024-04-20T10:54:25.408 INFO:tasks.workunit.client.1.smithi175.stdout:8/25: fdatasync f6 0 2024-04-20T10:54:25.410 INFO:tasks.workunit.client.1.smithi175.stdout:6/54: link d1/fb d1/d5/d12/f14 0 2024-04-20T10:54:25.411 INFO:tasks.workunit.client.1.smithi175.stdout:8/26: unlink f2 0 2024-04-20T10:54:25.412 INFO:tasks.workunit.client.1.smithi175.stdout:0/65: mknod cb 0 2024-04-20T10:54:25.413 INFO:tasks.workunit.client.1.smithi175.stdout:6/55: symlink d1/l15 0 2024-04-20T10:54:25.413 INFO:tasks.workunit.client.1.smithi175.stdout:6/56: chown d1/d5 1056 1 2024-04-20T10:54:25.413 INFO:tasks.workunit.client.1.smithi175.stdout:6/57: dread - d1/d5/d12/f13 zero size 2024-04-20T10:54:25.413 INFO:tasks.workunit.client.1.smithi175.stdout:8/27: chown f6 0 1 2024-04-20T10:54:25.413 INFO:tasks.workunit.client.1.smithi175.stdout:8/28: chown f6 4 1 2024-04-20T10:54:25.413 INFO:tasks.workunit.client.1.smithi175.stdout:8/29: write f6 [3120497,118260] 0 2024-04-20T10:54:25.414 INFO:tasks.workunit.client.1.smithi175.stdout:6/58: creat d1/f16 x:0 0 0 2024-04-20T10:54:25.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/66: unlink f2 0 2024-04-20T10:54:25.416 INFO:tasks.workunit.client.1.smithi175.stdout:6/59: rename d1/d5/f11 to d1/d5/f17 0 2024-04-20T10:54:25.417 INFO:tasks.workunit.client.1.smithi175.stdout:6/60: creat d1/f18 x:0 0 0 2024-04-20T10:54:25.418 INFO:tasks.workunit.client.1.smithi175.stdout:7/47: dwrite db/fc [0,4194304] 0 2024-04-20T10:54:25.418 INFO:tasks.workunit.client.1.smithi175.stdout:0/67: mknod cc 0 2024-04-20T10:54:25.418 INFO:tasks.workunit.client.1.smithi175.stdout:6/61: mknod d1/c19 0 2024-04-20T10:54:25.419 INFO:tasks.workunit.client.1.smithi175.stdout:4/59: write d4/f9 [706666,110381] 0 2024-04-20T10:54:25.419 INFO:tasks.workunit.client.1.smithi175.stdout:4/60: readlink d4/l5 0 2024-04-20T10:54:25.419 INFO:tasks.workunit.client.1.smithi175.stdout:4/61: rename d4/d7 to d4/d7/df 22 2024-04-20T10:54:25.420 INFO:tasks.workunit.client.1.smithi175.stdout:2/29: dwrite f0 [0,4194304] 0 2024-04-20T10:54:25.420 INFO:tasks.workunit.client.1.smithi175.stdout:7/48: symlink db/de/d12/l13 0 2024-04-20T10:54:25.421 INFO:tasks.workunit.client.1.smithi175.stdout:7/49: readlink l4 0 2024-04-20T10:54:25.422 INFO:tasks.workunit.client.1.smithi175.stdout:4/62: unlink d4/l5 0 2024-04-20T10:54:25.423 INFO:tasks.workunit.client.1.smithi175.stdout:6/62: dread d1/f9 [0,4194304] 0 2024-04-20T10:54:25.423 INFO:tasks.workunit.client.1.smithi175.stdout:7/50: dread db/fd [0,4194304] 0 2024-04-20T10:54:25.425 INFO:tasks.workunit.client.1.smithi175.stdout:4/63: creat d4/f10 x:0 0 0 2024-04-20T10:54:25.427 INFO:tasks.workunit.client.1.smithi175.stdout:6/63: link d1/le d1/d5/d12/l1a 0 2024-04-20T10:54:25.427 INFO:tasks.workunit.client.1.smithi175.stdout:6/64: readlink d1/l15 0 2024-04-20T10:54:25.436 INFO:tasks.workunit.client.1.smithi175.stdout:6/65: getdents d1/d5 0 2024-04-20T10:54:25.437 INFO:tasks.workunit.client.1.smithi175.stdout:9/66: truncate f3 517295 0 2024-04-20T10:54:25.437 INFO:tasks.workunit.client.1.smithi175.stdout:0/68: getdents . 0 2024-04-20T10:54:25.437 INFO:tasks.workunit.client.1.smithi175.stdout:0/69: getdents . 0 2024-04-20T10:54:25.437 INFO:tasks.workunit.client.1.smithi175.stdout:8/30: dwrite f5 [0,4194304] 0 2024-04-20T10:54:25.438 INFO:tasks.workunit.client.1.smithi175.stdout:6/66: rename c0 to d1/d5/c1b 0 2024-04-20T10:54:25.439 INFO:tasks.workunit.client.1.smithi175.stdout:6/67: truncate d1/d5/f17 528425 0 2024-04-20T10:54:25.439 INFO:tasks.workunit.client.1.smithi175.stdout:6/68: read - d1/f18 zero size 2024-04-20T10:54:25.439 INFO:tasks.workunit.client.1.smithi175.stdout:9/67: mknod d6/c12 0 2024-04-20T10:54:25.440 INFO:tasks.workunit.client.1.smithi175.stdout:7/51: truncate db/fc 3962869 0 2024-04-20T10:54:25.440 INFO:tasks.workunit.client.1.smithi175.stdout:7/52: chown db/fd 2 1 2024-04-20T10:54:25.440 INFO:tasks.workunit.client.1.smithi175.stdout:6/69: write d1/fb [495089,127304] 0 2024-04-20T10:54:25.440 INFO:tasks.workunit.client.1.smithi175.stdout:6/70: stat d1/l15 0 2024-04-20T10:54:25.442 INFO:tasks.workunit.client.1.smithi175.stdout:7/53: creat db/f14 x:0 0 0 2024-04-20T10:54:25.443 INFO:tasks.workunit.client.1.smithi175.stdout:7/54: read - db/f14 zero size 2024-04-20T10:54:25.443 INFO:tasks.workunit.client.1.smithi175.stdout:0/70: dread f4 [0,4194304] 0 2024-04-20T10:54:25.443 INFO:tasks.workunit.client.1.smithi175.stdout:6/71: creat d1/d5/d12/f1c x:0 0 0 2024-04-20T10:54:25.444 INFO:tasks.workunit.client.1.smithi175.stdout:0/71: rename cc to cd 0 2024-04-20T10:54:25.445 INFO:tasks.workunit.client.1.smithi175.stdout:2/30: dwrite d1/f6 [0,4194304] 0 2024-04-20T10:54:25.445 INFO:tasks.workunit.client.1.smithi175.stdout:2/31: stat d1/f3 0 2024-04-20T10:54:25.445 INFO:tasks.workunit.client.1.smithi175.stdout:4/64: dwrite d4/d7/f8 [0,4194304] 0 2024-04-20T10:54:25.446 INFO:tasks.workunit.client.1.smithi175.stdout:2/32: fdatasync d1/f5 0 2024-04-20T10:54:25.446 INFO:tasks.workunit.client.1.smithi175.stdout:4/65: readlink - no filename 2024-04-20T10:54:25.446 INFO:tasks.workunit.client.1.smithi175.stdout:4/66: truncate d4/f10 731851 0 2024-04-20T10:54:25.446 INFO:tasks.workunit.client.1.smithi175.stdout:6/72: mknod d1/c1d 0 2024-04-20T10:54:25.446 INFO:tasks.workunit.client.1.smithi175.stdout:4/67: dread d4/f10 [0,4194304] 0 2024-04-20T10:54:25.447 INFO:tasks.workunit.client.1.smithi175.stdout:4/68: fsync d4/fb 0 2024-04-20T10:54:25.447 INFO:tasks.workunit.client.1.smithi175.stdout:0/72: creat fe x:0 0 0 2024-04-20T10:54:25.451 INFO:tasks.workunit.client.1.smithi175.stdout:6/73: creat d1/d5/f1e x:0 0 0 2024-04-20T10:54:25.451 INFO:tasks.workunit.client.1.smithi175.stdout:6/74: readlink d1/le 0 2024-04-20T10:54:25.452 INFO:tasks.workunit.client.1.smithi175.stdout:6/75: chown d1/d5/d12/f13 1466 1 2024-04-20T10:54:25.453 INFO:tasks.workunit.client.1.smithi175.stdout:4/69: creat d4/dd/f11 x:0 0 0 2024-04-20T10:54:25.454 INFO:tasks.workunit.client.1.smithi175.stdout:0/73: mkdir df 0 2024-04-20T10:54:25.454 INFO:tasks.workunit.client.1.smithi175.stdout:0/74: write f1 [4903074,108235] 0 2024-04-20T10:54:25.455 INFO:tasks.workunit.client.1.smithi175.stdout:2/33: link d1/d7/f8 d1/fc 0 2024-04-20T10:54:25.456 INFO:tasks.workunit.client.1.smithi175.stdout:6/76: rmdir d1 39 2024-04-20T10:54:25.456 INFO:tasks.workunit.client.1.smithi175.stdout:6/77: write d1/d5/fa [738281,6801] 0 2024-04-20T10:54:25.456 INFO:tasks.workunit.client.1.smithi175.stdout:6/78: dread - d1/d5/f1e zero size 2024-04-20T10:54:25.457 INFO:tasks.workunit.client.1.smithi175.stdout:4/70: creat d4/f12 x:0 0 0 2024-04-20T10:54:25.460 INFO:tasks.workunit.client.1.smithi175.stdout:0/75: link f4 df/f10 0 2024-04-20T10:54:25.460 INFO:tasks.workunit.client.1.smithi175.stdout:0/76: fsync f8 0 2024-04-20T10:54:25.461 INFO:tasks.workunit.client.1.smithi175.stdout:9/68: dwrite f5 [0,4194304] 0 2024-04-20T10:54:25.461 INFO:tasks.workunit.client.1.smithi175.stdout:9/69: getdents d6/d10 0 2024-04-20T10:54:25.461 INFO:tasks.workunit.client.1.smithi175.stdout:2/34: rename d1/fc to d1/fd 0 2024-04-20T10:54:25.462 INFO:tasks.workunit.client.1.smithi175.stdout:8/31: mkdir d7 0 2024-04-20T10:54:25.464 INFO:tasks.workunit.client.1.smithi175.stdout:6/79: creat d1/d5/f1f x:0 0 0 2024-04-20T10:54:25.468 INFO:tasks.workunit.client.1.smithi175.stdout:0/77: read f6 [3810422,13423] 0 2024-04-20T10:54:25.470 INFO:tasks.workunit.client.1.smithi175.stdout:8/32: mknod d7/c8 0 2024-04-20T10:54:25.470 INFO:tasks.workunit.client.1.smithi175.stdout:8/33: readlink - no filename 2024-04-20T10:54:25.471 INFO:tasks.workunit.client.1.smithi175.stdout:6/80: symlink d1/d5/d12/l20 0 2024-04-20T10:54:25.472 INFO:tasks.workunit.client.1.smithi175.stdout:0/78: creat df/f11 x:0 0 0 2024-04-20T10:54:25.473 INFO:tasks.workunit.client.1.smithi175.stdout:8/34: creat d7/f9 x:0 0 0 2024-04-20T10:54:25.474 INFO:tasks.workunit.client.1.smithi175.stdout:6/81: symlink d1/d5/l21 0 2024-04-20T10:54:25.475 INFO:tasks.workunit.client.1.smithi175.stdout:0/79: symlink df/l12 0 2024-04-20T10:54:25.475 INFO:tasks.workunit.client.1.smithi175.stdout:0/80: write fe [17255,96492] 0 2024-04-20T10:54:25.475 INFO:tasks.workunit.client.1.smithi175.stdout:8/35: stat f6 0 2024-04-20T10:54:25.476 INFO:tasks.workunit.client.1.smithi175.stdout:6/82: mkdir d1/d5/d12/d22 0 2024-04-20T10:54:25.478 INFO:tasks.workunit.client.1.smithi175.stdout:9/70: dread f5 [0,4194304] 0 2024-04-20T10:54:25.483 INFO:tasks.workunit.client.1.smithi175.stdout:2/35: unlink d1/fd 0 2024-04-20T10:54:25.483 INFO:tasks.workunit.client.1.smithi175.stdout:5/20: sync 2024-04-20T10:54:25.483 INFO:tasks.workunit.client.1.smithi175.stdout:5/21: chown f0 1928363 1 2024-04-20T10:54:25.485 INFO:tasks.workunit.client.1.smithi175.stdout:9/71: unlink d6/l11 0 2024-04-20T10:54:25.485 INFO:tasks.workunit.client.1.smithi175.stdout:9/72: fdatasync d6/fb 0 2024-04-20T10:54:25.489 INFO:tasks.workunit.client.1.smithi175.stdout:3/24: sync 2024-04-20T10:54:25.494 INFO:tasks.workunit.client.1.smithi175.stdout:4/71: dwrite d4/d7/fa [0,4194304] 0 2024-04-20T10:54:25.494 INFO:tasks.workunit.client.1.smithi175.stdout:7/55: dwrite db/fc [0,4194304] 0 2024-04-20T10:54:25.495 INFO:tasks.workunit.client.1.smithi175.stdout:7/56: fdatasync f2 0 2024-04-20T10:54:25.499 INFO:tasks.workunit.client.1.smithi175.stdout:7/57: dread db/fd [0,4194304] 0 2024-04-20T10:54:25.499 INFO:tasks.workunit.client.1.smithi175.stdout:7/58: read - db/f14 zero size 2024-04-20T10:54:25.499 INFO:tasks.workunit.client.1.smithi175.stdout:7/59: chown db/de/d12/l13 174013081 1 2024-04-20T10:54:25.500 INFO:tasks.workunit.client.1.smithi175.stdout:7/60: mknod db/de/c15 0 2024-04-20T10:54:25.502 INFO:tasks.workunit.client.1.smithi175.stdout:8/36: dwrite f6 [0,4194304] 0 2024-04-20T10:54:25.516 INFO:tasks.workunit.client.1.smithi175.stdout:8/37: dread f5 [0,4194304] 0 2024-04-20T10:54:25.516 INFO:tasks.workunit.client.1.smithi175.stdout:8/38: truncate d7/f9 1041427 0 2024-04-20T10:54:25.518 INFO:tasks.workunit.client.1.smithi175.stdout:5/22: dwrite f2 [0,4194304] 0 2024-04-20T10:54:25.518 INFO:tasks.workunit.client.1.smithi175.stdout:6/83: dwrite d1/d5/fc [0,4194304] 0 2024-04-20T10:54:25.518 INFO:tasks.workunit.client.1.smithi175.stdout:6/84: write d1/d5/f1f [70366,82613] 0 2024-04-20T10:54:25.518 INFO:tasks.workunit.client.1.smithi175.stdout:6/85: chown d1/d5/fa 327395731 1 2024-04-20T10:54:25.518 INFO:tasks.workunit.client.1.smithi175.stdout:6/86: chown d1/d5/f17 1 1 2024-04-20T10:54:25.518 INFO:tasks.workunit.client.1.smithi175.stdout:6/87: readlink d1/le 0 2024-04-20T10:54:25.518 INFO:tasks.workunit.client.1.smithi175.stdout:2/36: dwrite f0 [0,4194304] 0 2024-04-20T10:54:25.520 INFO:tasks.workunit.client.1.smithi175.stdout:6/88: mkdir d1/d5/d12/d22/d23 0 2024-04-20T10:54:25.520 INFO:tasks.workunit.client.1.smithi175.stdout:6/89: dread - d1/d5/d12/f13 zero size 2024-04-20T10:54:25.521 INFO:tasks.workunit.client.1.smithi175.stdout:8/39: dread f5 [0,4194304] 0 2024-04-20T10:54:25.523 INFO:tasks.workunit.client.1.smithi175.stdout:6/90: dread d1/f9 [0,4194304] 0 2024-04-20T10:54:25.523 INFO:tasks.workunit.client.1.smithi175.stdout:6/91: write d1/d5/f1e [420333,116327] 0 2024-04-20T10:54:25.523 INFO:tasks.workunit.client.1.smithi175.stdout:6/92: rmdir d1 39 2024-04-20T10:54:25.524 INFO:tasks.workunit.client.1.smithi175.stdout:6/93: mkdir d1/d5/d12/d24 0 2024-04-20T10:54:25.525 INFO:tasks.workunit.client.1.smithi175.stdout:6/94: write d1/d5/f17 [64775,88371] 0 2024-04-20T10:54:25.525 INFO:tasks.workunit.client.1.smithi175.stdout:1/52: sync 2024-04-20T10:54:25.526 INFO:tasks.workunit.client.1.smithi175.stdout:1/53: creat d0/fd x:0 0 0 2024-04-20T10:54:25.527 INFO:tasks.workunit.client.1.smithi175.stdout:1/54: creat d0/fe x:0 0 0 2024-04-20T10:54:25.529 INFO:tasks.workunit.client.1.smithi175.stdout:1/55: dread d0/f5 [0,4194304] 0 2024-04-20T10:54:25.530 INFO:tasks.workunit.client.1.smithi175.stdout:1/56: creat d0/ff x:0 0 0 2024-04-20T10:54:25.530 INFO:tasks.workunit.client.1.smithi175.stdout:1/57: read d0/f3 [3990323,33964] 0 2024-04-20T10:54:25.531 INFO:tasks.workunit.client.1.smithi175.stdout:1/58: rmdir d0 39 2024-04-20T10:54:25.532 INFO:tasks.workunit.client.1.smithi175.stdout:1/59: creat d0/f10 x:0 0 0 2024-04-20T10:54:25.533 INFO:tasks.workunit.client.1.smithi175.stdout:9/73: dwrite d6/fb [0,4194304] 0 2024-04-20T10:54:25.533 INFO:tasks.workunit.client.1.smithi175.stdout:9/74: fdatasync f5 0 2024-04-20T10:54:25.533 INFO:tasks.workunit.client.1.smithi175.stdout:9/75: chown f3 3903917 1 2024-04-20T10:54:25.533 INFO:tasks.workunit.client.1.smithi175.stdout:3/25: dwrite f5 [0,4194304] 0 2024-04-20T10:54:25.534 INFO:tasks.workunit.client.1.smithi175.stdout:2/37: write d1/f6 [1506753,79510] 0 2024-04-20T10:54:25.534 INFO:tasks.workunit.client.1.smithi175.stdout:2/38: dread - d1/f5 zero size 2024-04-20T10:54:25.534 INFO:tasks.workunit.client.1.smithi175.stdout:4/72: dwrite d4/dd/f11 [0,4194304] 0 2024-04-20T10:54:25.534 INFO:tasks.workunit.client.1.smithi175.stdout:7/61: dwrite f2 [4194304,4194304] 0 2024-04-20T10:54:25.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/76: mknod d6/c13 0 2024-04-20T10:54:25.535 INFO:tasks.workunit.client.1.smithi175.stdout:3/26: mknod c6 0 2024-04-20T10:54:25.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/77: dread f3 [0,4194304] 0 2024-04-20T10:54:25.536 INFO:tasks.workunit.client.1.smithi175.stdout:2/39: symlink d1/le 0 2024-04-20T10:54:25.537 INFO:tasks.workunit.client.1.smithi175.stdout:4/73: creat d4/dd/f13 x:0 0 0 2024-04-20T10:54:25.537 INFO:tasks.workunit.client.1.smithi175.stdout:4/74: chown d4 343626 1 2024-04-20T10:54:25.538 INFO:tasks.workunit.client.1.smithi175.stdout:7/62: rename db/de/d12/l13 to db/de/l16 0 2024-04-20T10:54:25.539 INFO:tasks.workunit.client.1.smithi175.stdout:2/40: creat d1/d7/ff x:0 0 0 2024-04-20T10:54:25.540 INFO:tasks.workunit.client.1.smithi175.stdout:4/75: unlink d4/f10 0 2024-04-20T10:54:25.541 INFO:tasks.workunit.client.1.smithi175.stdout:5/23: truncate f2 3310350 0 2024-04-20T10:54:25.542 INFO:tasks.workunit.client.1.smithi175.stdout:2/41: creat d1/d7/f10 x:0 0 0 2024-04-20T10:54:25.543 INFO:tasks.workunit.client.1.smithi175.stdout:4/76: link d4/fb d4/d7/f14 0 2024-04-20T10:54:25.543 INFO:tasks.workunit.client.1.smithi175.stdout:4/77: readlink - no filename 2024-04-20T10:54:25.543 INFO:tasks.workunit.client.1.smithi175.stdout:4/78: fdatasync d4/d7/fa 0 2024-04-20T10:54:25.546 INFO:tasks.workunit.client.1.smithi175.stdout:6/95: dwrite d1/d5/f10 [0,4194304] 0 2024-04-20T10:54:25.546 INFO:tasks.workunit.client.1.smithi175.stdout:6/96: write d1/d5/f1e [1383644,62767] 0 2024-04-20T10:54:25.546 INFO:tasks.workunit.client.1.smithi175.stdout:5/24: unlink f0 0 2024-04-20T10:54:25.546 INFO:tasks.workunit.client.1.smithi175.stdout:2/42: rmdir d1 39 2024-04-20T10:54:25.548 INFO:tasks.workunit.client.1.smithi175.stdout:4/79: creat d4/d7/f15 x:0 0 0 2024-04-20T10:54:25.548 INFO:tasks.workunit.client.1.smithi175.stdout:4/80: dread - d4/f12 zero size 2024-04-20T10:54:25.550 INFO:tasks.workunit.client.1.smithi175.stdout:6/97: mknod d1/c25 0 2024-04-20T10:54:25.551 INFO:tasks.workunit.client.1.smithi175.stdout:5/25: mknod c5 0 2024-04-20T10:54:25.552 INFO:tasks.workunit.client.1.smithi175.stdout:2/43: creat d1/f11 x:0 0 0 2024-04-20T10:54:25.554 INFO:tasks.workunit.client.1.smithi175.stdout:6/98: getdents d1/d5 0 2024-04-20T10:54:25.557 INFO:tasks.workunit.client.1.smithi175.stdout:9/78: dwrite d6/fa [0,4194304] 0 2024-04-20T10:54:25.558 INFO:tasks.workunit.client.1.smithi175.stdout:1/60: dwrite d0/fd [0,4194304] 0 2024-04-20T10:54:25.558 INFO:tasks.workunit.client.1.smithi175.stdout:3/27: dread f0 [0,4194304] 0 2024-04-20T10:54:25.559 INFO:tasks.workunit.client.1.smithi175.stdout:9/79: dread f3 [0,4194304] 0 2024-04-20T10:54:25.561 INFO:tasks.workunit.client.1.smithi175.stdout:7/63: dwrite f2 [0,4194304] 0 2024-04-20T10:54:25.561 INFO:tasks.workunit.client.1.smithi175.stdout:7/64: chown db/de/l16 331 1 2024-04-20T10:54:25.561 INFO:tasks.workunit.client.1.smithi175.stdout:3/28: mkdir d7 0 2024-04-20T10:54:25.561 INFO:tasks.workunit.client.1.smithi175.stdout:3/29: chown d7 1361644 1 2024-04-20T10:54:25.562 INFO:tasks.workunit.client.1.smithi175.stdout:2/44: write d1/d7/f8 [2559787,97649] 0 2024-04-20T10:54:25.568 INFO:tasks.workunit.client.1.smithi175.stdout:2/45: truncate d1/f4 507930 0 2024-04-20T10:54:25.568 INFO:tasks.workunit.client.0.smithi090.stdout:3/9: symlink l2 0 2024-04-20T10:54:25.569 INFO:tasks.workunit.client.1.smithi175.stdout:4/81: dwrite d4/d7/f14 [0,4194304] 0 2024-04-20T10:54:25.571 INFO:tasks.workunit.client.1.smithi175.stdout:9/80: write d6/fb [502928,34237] 0 2024-04-20T10:54:25.571 INFO:tasks.workunit.client.1.smithi175.stdout:9/81: stat f3 0 2024-04-20T10:54:25.573 INFO:tasks.workunit.client.1.smithi175.stdout:7/65: read f6 [3665702,55330] 0 2024-04-20T10:54:25.574 INFO:tasks.workunit.client.1.smithi175.stdout:7/66: chown f1 5264 1 2024-04-20T10:54:25.574 INFO:tasks.workunit.client.1.smithi175.stdout:2/46: symlink d1/d7/l12 0 2024-04-20T10:54:25.575 INFO:tasks.workunit.client.1.smithi175.stdout:7/67: mknod db/de/c17 0 2024-04-20T10:54:25.578 INFO:tasks.workunit.client.1.smithi175.stdout:2/47: mkdir d1/d13 0 2024-04-20T10:54:25.579 INFO:tasks.workunit.client.0.smithi090.stdout:3/10: dread f1 [0,4194304] 0 2024-04-20T10:54:25.579 INFO:tasks.workunit.client.0.smithi090.stdout:3/11: stat f1 0 2024-04-20T10:54:25.580 INFO:tasks.workunit.client.1.smithi175.stdout:9/82: dread f5 [0,4194304] 0 2024-04-20T10:54:25.580 INFO:tasks.workunit.client.1.smithi175.stdout:3/30: dwrite f5 [0,4194304] 0 2024-04-20T10:54:25.581 INFO:tasks.workunit.client.1.smithi175.stdout:2/48: mknod d1/d13/c14 0 2024-04-20T10:54:25.582 INFO:tasks.workunit.client.1.smithi175.stdout:3/31: creat d7/f8 x:0 0 0 2024-04-20T10:54:25.583 INFO:tasks.workunit.client.1.smithi175.stdout:5/26: dread f2 [0,4194304] 0 2024-04-20T10:54:25.583 INFO:tasks.workunit.client.1.smithi175.stdout:5/27: chown l3 545 1 2024-04-20T10:54:25.583 INFO:tasks.workunit.client.1.smithi175.stdout:2/49: symlink d1/d7/l15 0 2024-04-20T10:54:25.585 INFO:tasks.workunit.client.1.smithi175.stdout:3/32: mkdir d7/d9 0 2024-04-20T10:54:25.585 INFO:tasks.workunit.client.1.smithi175.stdout:3/33: truncate d7/f8 177857 0 2024-04-20T10:54:25.585 INFO:tasks.workunit.client.1.smithi175.stdout:2/50: rmdir d1/d7 39 2024-04-20T10:54:25.586 INFO:tasks.workunit.client.1.smithi175.stdout:5/28: dread f2 [0,4194304] 0 2024-04-20T10:54:25.587 INFO:tasks.workunit.client.1.smithi175.stdout:3/34: creat d7/d9/fa x:0 0 0 2024-04-20T10:54:25.589 INFO:tasks.workunit.client.1.smithi175.stdout:2/51: mknod d1/d7/c16 0 2024-04-20T10:54:25.589 INFO:tasks.workunit.client.1.smithi175.stdout:2/52: write d1/f5 [301457,129187] 0 2024-04-20T10:54:25.589 INFO:tasks.workunit.client.1.smithi175.stdout:2/53: write d1/f5 [303492,19725] 0 2024-04-20T10:54:25.589 INFO:tasks.workunit.client.1.smithi175.stdout:2/54: write f0 [2022713,71362] 0 2024-04-20T10:54:25.590 INFO:tasks.workunit.client.1.smithi175.stdout:5/29: mknod c6 0 2024-04-20T10:54:25.592 INFO:tasks.workunit.client.1.smithi175.stdout:5/30: write f2 [1130110,87799] 0 2024-04-20T10:54:25.596 INFO:tasks.workunit.client.1.smithi175.stdout:2/55: fdatasync f0 0 2024-04-20T10:54:25.596 INFO:tasks.workunit.client.1.smithi175.stdout:2/56: stat d1/d13/c14 0 2024-04-20T10:54:25.596 INFO:tasks.workunit.client.1.smithi175.stdout:2/57: write d1/f5 [1039824,35170] 0 2024-04-20T10:54:25.596 INFO:tasks.workunit.client.1.smithi175.stdout:2/58: stat d1/d13/c14 0 2024-04-20T10:54:25.597 INFO:tasks.workunit.client.1.smithi175.stdout:2/59: read d1/f4 [507665,26663] 0 2024-04-20T10:54:25.597 INFO:tasks.workunit.client.1.smithi175.stdout:2/60: read d1/d7/f8 [3403617,85214] 0 2024-04-20T10:54:25.597 INFO:tasks.workunit.client.1.smithi175.stdout:9/83: dwrite f3 [0,4194304] 0 2024-04-20T10:54:25.597 INFO:tasks.workunit.client.1.smithi175.stdout:9/84: readlink d6/l9 0 2024-04-20T10:54:25.598 INFO:tasks.workunit.client.1.smithi175.stdout:7/68: dwrite db/fc [0,4194304] 0 2024-04-20T10:54:25.599 INFO:tasks.workunit.client.1.smithi175.stdout:4/82: truncate d4/fb 2771721 0 2024-04-20T10:54:25.603 INFO:tasks.workunit.client.1.smithi175.stdout:2/61: creat d1/d13/f17 x:0 0 0 2024-04-20T10:54:25.607 INFO:tasks.workunit.client.1.smithi175.stdout:4/83: creat d4/d7/f16 x:0 0 0 2024-04-20T10:54:25.607 INFO:tasks.workunit.client.1.smithi175.stdout:4/84: fdatasync f1 0 2024-04-20T10:54:25.608 INFO:tasks.workunit.client.1.smithi175.stdout:3/35: getdents d7 0 2024-04-20T10:54:25.608 INFO:tasks.workunit.client.1.smithi175.stdout:3/36: getdents d7 0 2024-04-20T10:54:25.608 INFO:tasks.workunit.client.1.smithi175.stdout:3/37: fdatasync f5 0 2024-04-20T10:54:25.608 INFO:tasks.workunit.client.1.smithi175.stdout:3/38: chown f5 6003 1 2024-04-20T10:54:25.608 INFO:tasks.workunit.client.1.smithi175.stdout:3/39: readlink l4 0 2024-04-20T10:54:25.609 INFO:tasks.workunit.client.1.smithi175.stdout:3/40: creat d7/d9/fb x:0 0 0 2024-04-20T10:54:25.611 INFO:tasks.workunit.client.1.smithi175.stdout:5/31: truncate f2 430840 0 2024-04-20T10:54:25.619 INFO:tasks.workunit.client.1.smithi175.stdout:4/85: write d4/d7/fa [2049950,92499] 0 2024-04-20T10:54:25.621 INFO:tasks.workunit.client.1.smithi175.stdout:9/85: dwrite d6/fe [0,4194304] 0 2024-04-20T10:54:25.621 INFO:tasks.workunit.client.1.smithi175.stdout:9/86: fsync d6/fa 0 2024-04-20T10:54:25.622 INFO:tasks.workunit.client.1.smithi175.stdout:7/69: dwrite f6 [0,4194304] 0 2024-04-20T10:54:25.630 INFO:tasks.workunit.client.1.smithi175.stdout:4/86: write d4/d7/f14 [2481646,110422] 0 2024-04-20T10:54:25.631 INFO:tasks.workunit.client.1.smithi175.stdout:4/87: link d4/f9 d4/d7/f17 0 2024-04-20T10:54:25.632 INFO:tasks.workunit.client.1.smithi175.stdout:4/88: mknod d4/d7/c18 0 2024-04-20T10:54:25.633 INFO:tasks.workunit.client.1.smithi175.stdout:4/89: link d4/d7/c18 d4/d7/c19 0 2024-04-20T10:54:25.633 INFO:tasks.workunit.client.1.smithi175.stdout:4/90: truncate d4/dd/f11 4377759 0 2024-04-20T10:54:25.633 INFO:tasks.workunit.client.1.smithi175.stdout:4/91: creat d4/f1a x:0 0 0 2024-04-20T10:54:25.634 INFO:tasks.workunit.client.1.smithi175.stdout:4/92: mknod d4/d7/c1b 0 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:4/93: creat d4/d7/f1c x:0 0 0 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:4/94: read d4/d7/f14 [2703803,125242] 0 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:4/95: readlink - no filename 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:4/96: chown d4/d7/f15 1524231 1 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:7/70: write f6 [690167,82509] 0 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:7/71: fsync db/f14 0 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:4/97: mknod d4/dd/c1d 0 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:9/87: dread d6/fe [0,4194304] 0 2024-04-20T10:54:25.636 INFO:tasks.workunit.client.1.smithi175.stdout:9/88: getdents d6/d10 0 2024-04-20T10:54:25.637 INFO:tasks.workunit.client.1.smithi175.stdout:7/72: rename db/fc to db/de/d12/f18 0 2024-04-20T10:54:25.637 INFO:tasks.workunit.client.1.smithi175.stdout:7/73: write db/f14 [37151,128219] 0 2024-04-20T10:54:25.637 INFO:tasks.workunit.client.1.smithi175.stdout:3/41: dwrite d7/d9/fb [0,4194304] 0 2024-04-20T10:54:25.637 INFO:tasks.workunit.client.1.smithi175.stdout:7/74: write db/f14 [316530,112397] 0 2024-04-20T10:54:25.637 INFO:tasks.workunit.client.1.smithi175.stdout:4/98: creat d4/dd/f1e x:0 0 0 2024-04-20T10:54:25.637 INFO:tasks.workunit.client.1.smithi175.stdout:4/99: readlink - no filename 2024-04-20T10:54:25.637 INFO:tasks.workunit.client.1.smithi175.stdout:2/62: dwrite d1/f6 [0,4194304] 0 2024-04-20T10:54:25.638 INFO:tasks.workunit.client.1.smithi175.stdout:9/89: symlink d6/l14 0 2024-04-20T10:54:25.640 INFO:tasks.workunit.client.1.smithi175.stdout:7/75: link f6 db/de/d12/f19 0 2024-04-20T10:54:25.640 INFO:tasks.workunit.client.1.smithi175.stdout:0/81: sync 2024-04-20T10:54:25.641 INFO:tasks.workunit.client.1.smithi175.stdout:5/32: write f2 [64998,106071] 0 2024-04-20T10:54:25.641 INFO:tasks.workunit.client.1.smithi175.stdout:3/42: getdents d7/d9 0 2024-04-20T10:54:25.644 INFO:tasks.workunit.client.1.smithi175.stdout:2/63: rename d1/d13/f17 to d1/d13/f18 0 2024-04-20T10:54:25.647 INFO:tasks.workunit.client.1.smithi175.stdout:9/90: link d6/lc d6/d10/l15 0 2024-04-20T10:54:25.647 INFO:tasks.workunit.client.1.smithi175.stdout:7/76: symlink db/l1a 0 2024-04-20T10:54:25.649 INFO:tasks.workunit.client.1.smithi175.stdout:5/33: rename c5 to c7 0 2024-04-20T10:54:25.649 INFO:tasks.workunit.client.1.smithi175.stdout:0/82: dread f8 [0,4194304] 0 2024-04-20T10:54:25.650 INFO:tasks.workunit.client.1.smithi175.stdout:4/100: rename d4/d7/f16 to d4/f1f 0 2024-04-20T10:54:25.653 INFO:tasks.workunit.client.1.smithi175.stdout:5/34: link l3 l8 0 2024-04-20T10:54:25.654 INFO:tasks.workunit.client.1.smithi175.stdout:0/83: rmdir df 39 2024-04-20T10:54:25.654 INFO:tasks.workunit.client.1.smithi175.stdout:0/84: fsync f0 0 2024-04-20T10:54:25.655 INFO:tasks.workunit.client.1.smithi175.stdout:5/35: dread f2 [0,4194304] 0 2024-04-20T10:54:25.655 INFO:tasks.workunit.client.1.smithi175.stdout:5/36: chown l8 2198 1 2024-04-20T10:54:25.655 INFO:tasks.workunit.client.1.smithi175.stdout:5/37: chown l3 4 1 2024-04-20T10:54:25.655 INFO:tasks.workunit.client.1.smithi175.stdout:5/38: truncate f2 512654 0 2024-04-20T10:54:25.656 INFO:tasks.workunit.client.1.smithi175.stdout:4/101: link d4/d7/f17 d4/f20 0 2024-04-20T10:54:25.659 INFO:tasks.workunit.client.1.smithi175.stdout:5/39: creat f9 x:0 0 0 2024-04-20T10:54:25.659 INFO:tasks.workunit.client.1.smithi175.stdout:4/102: mkdir d4/d7/d21 0 2024-04-20T10:54:25.659 INFO:tasks.workunit.client.1.smithi175.stdout:5/40: write f2 [68659,24017] 0 2024-04-20T10:54:25.660 INFO:tasks.workunit.client.1.smithi175.stdout:0/85: getdents df 0 2024-04-20T10:54:25.660 INFO:tasks.workunit.client.1.smithi175.stdout:4/103: symlink d4/l22 0 2024-04-20T10:54:25.660 INFO:tasks.workunit.client.1.smithi175.stdout:4/104: chown d4/dd/ce 34 1 2024-04-20T10:54:25.662 INFO:tasks.workunit.client.1.smithi175.stdout:4/105: mkdir d4/d23 0 2024-04-20T10:54:25.662 INFO:tasks.workunit.client.1.smithi175.stdout:4/106: write d4/d7/f15 [838096,52389] 0 2024-04-20T10:54:25.663 INFO:tasks.workunit.client.1.smithi175.stdout:4/107: mknod d4/d7/c24 0 2024-04-20T10:54:25.667 INFO:tasks.workunit.client.1.smithi175.stdout:3/43: dwrite f5 [0,4194304] 0 2024-04-20T10:54:25.667 INFO:tasks.workunit.client.1.smithi175.stdout:3/44: fdatasync d7/f8 0 2024-04-20T10:54:25.667 INFO:tasks.workunit.client.1.smithi175.stdout:9/91: dwrite d6/fb [4194304,4194304] 0 2024-04-20T10:54:25.668 INFO:tasks.workunit.client.1.smithi175.stdout:3/45: mknod d7/d9/cc 0 2024-04-20T10:54:25.670 INFO:tasks.workunit.client.1.smithi175.stdout:5/41: dread f2 [0,4194304] 0 2024-04-20T10:54:25.671 INFO:tasks.workunit.client.1.smithi175.stdout:5/42: chown l3 1530 1 2024-04-20T10:54:25.677 INFO:tasks.workunit.client.1.smithi175.stdout:9/92: dread f3 [0,4194304] 0 2024-04-20T10:54:25.682 INFO:tasks.workunit.client.1.smithi175.stdout:4/108: dwrite d4/d7/f8 [0,4194304] 0 2024-04-20T10:54:25.683 INFO:tasks.workunit.client.1.smithi175.stdout:9/93: dread d6/fb [0,4194304] 0 2024-04-20T10:54:25.683 INFO:tasks.workunit.client.1.smithi175.stdout:9/94: fsync d6/fb 0 2024-04-20T10:54:25.684 INFO:tasks.workunit.client.1.smithi175.stdout:4/109: mkdir d4/d7/d25 0 2024-04-20T10:54:25.684 INFO:tasks.workunit.client.1.smithi175.stdout:4/110: write d4/fb [2460498,5241] 0 2024-04-20T10:54:25.684 INFO:tasks.workunit.client.1.smithi175.stdout:9/95: getdents d6 0 2024-04-20T10:54:25.688 INFO:tasks.workunit.client.0.smithi090.stdout:1/9: mknod c7 0 2024-04-20T10:54:25.688 INFO:tasks.workunit.client.0.smithi090.stdout:1/10: rmdir - no directory 2024-04-20T10:54:25.688 INFO:tasks.workunit.client.0.smithi090.stdout:1/11: fdatasync f5 0 2024-04-20T10:54:25.690 INFO:tasks.workunit.client.1.smithi175.stdout:4/111: dread d4/d7/f17 [0,4194304] 0 2024-04-20T10:54:25.693 INFO:tasks.workunit.client.1.smithi175.stdout:4/112: dread d4/f20 [0,4194304] 0 2024-04-20T10:54:25.694 INFO:tasks.workunit.client.1.smithi175.stdout:4/113: symlink d4/dd/l26 0 2024-04-20T10:54:25.694 INFO:tasks.workunit.client.1.smithi175.stdout:3/46: dwrite d7/f8 [0,4194304] 0 2024-04-20T10:54:25.695 INFO:tasks.workunit.client.1.smithi175.stdout:9/96: write d6/fa [2114719,103489] 0 2024-04-20T10:54:25.696 INFO:tasks.workunit.client.1.smithi175.stdout:5/43: dwrite f9 [0,4194304] 0 2024-04-20T10:54:25.699 INFO:tasks.workunit.client.1.smithi175.stdout:9/97: write d6/fe [474648,36751] 0 2024-04-20T10:54:25.699 INFO:tasks.workunit.client.1.smithi175.stdout:9/98: chown d6/l8 285060657 1 2024-04-20T10:54:25.699 INFO:tasks.workunit.client.1.smithi175.stdout:5/44: mknod ca 0 2024-04-20T10:54:25.701 INFO:tasks.workunit.client.1.smithi175.stdout:9/99: rmdir d6 39 2024-04-20T10:54:25.701 INFO:tasks.workunit.client.1.smithi175.stdout:9/100: stat d6/d10 0 2024-04-20T10:54:25.702 INFO:tasks.workunit.client.1.smithi175.stdout:5/45: mkdir db 0 2024-04-20T10:54:25.702 INFO:tasks.workunit.client.1.smithi175.stdout:5/46: rename db to db/dc 22 2024-04-20T10:54:25.703 INFO:tasks.workunit.client.1.smithi175.stdout:5/47: mknod db/cd 0 2024-04-20T10:54:25.704 INFO:tasks.workunit.client.1.smithi175.stdout:3/47: dread f0 [0,4194304] 0 2024-04-20T10:54:25.705 INFO:tasks.workunit.client.1.smithi175.stdout:5/48: creat db/fe x:0 0 0 2024-04-20T10:54:25.705 INFO:tasks.workunit.client.1.smithi175.stdout:5/49: dread - db/fe zero size 2024-04-20T10:54:25.709 INFO:tasks.workunit.client.1.smithi175.stdout:9/101: dread d6/fe [0,4194304] 0 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:9/102: creat d6/f16 x:0 0 0 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:8/40: sync 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:1/61: sync 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:6/99: sync 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:6/100: chown d1/d5/d12/l20 1101250 1 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:8/41: chown f6 7 1 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:8/42: truncate d7/f9 1100101 0 2024-04-20T10:54:25.711 INFO:tasks.workunit.client.1.smithi175.stdout:3/48: dread f5 [0,4194304] 0 2024-04-20T10:54:25.712 INFO:tasks.workunit.client.1.smithi175.stdout:9/103: unlink d6/d10/l15 0 2024-04-20T10:54:25.712 INFO:tasks.workunit.client.1.smithi175.stdout:9/104: truncate d6/f16 312352 0 2024-04-20T10:54:25.715 INFO:tasks.workunit.client.1.smithi175.stdout:4/114: rename d4/d7 to d4/d27 0 2024-04-20T10:54:25.715 INFO:tasks.workunit.client.1.smithi175.stdout:1/62: rename d0/d8/ca to d0/c11 0 2024-04-20T10:54:25.716 INFO:tasks.workunit.client.1.smithi175.stdout:1/63: write d0/f10 [393197,68528] 0 2024-04-20T10:54:25.716 INFO:tasks.workunit.client.1.smithi175.stdout:1/64: write d0/f10 [450126,11753] 0 2024-04-20T10:54:25.716 INFO:tasks.workunit.client.1.smithi175.stdout:6/101: truncate d1/d5/f6 478064 0 2024-04-20T10:54:25.722 INFO:tasks.workunit.client.1.smithi175.stdout:5/50: dread f9 [0,4194304] 0 2024-04-20T10:54:25.724 INFO:tasks.workunit.client.1.smithi175.stdout:6/102: mknod d1/d5/d12/d22/d23/c26 0 2024-04-20T10:54:25.732 INFO:tasks.workunit.client.1.smithi175.stdout:3/49: dwrite d7/f8 [0,4194304] 0 2024-04-20T10:54:25.733 INFO:tasks.workunit.client.1.smithi175.stdout:9/105: dwrite f3 [4194304,4194304] 0 2024-04-20T10:54:25.735 INFO:tasks.workunit.client.1.smithi175.stdout:5/51: creat db/ff x:0 0 0 2024-04-20T10:54:25.735 INFO:tasks.workunit.client.1.smithi175.stdout:5/52: write db/ff [700116,83471] 0 2024-04-20T10:54:25.735 INFO:tasks.workunit.client.1.smithi175.stdout:5/53: chown c1 1223 1 2024-04-20T10:54:25.736 INFO:tasks.workunit.client.1.smithi175.stdout:9/106: creat d6/f17 x:0 0 0 2024-04-20T10:54:25.741 INFO:tasks.workunit.client.1.smithi175.stdout:5/54: dread db/ff [0,4194304] 0 2024-04-20T10:54:25.743 INFO:tasks.workunit.client.1.smithi175.stdout:4/115: dwrite d4/fb [0,4194304] 0 2024-04-20T10:54:25.746 INFO:tasks.workunit.client.1.smithi175.stdout:9/107: symlink d6/l18 0 2024-04-20T10:54:25.748 INFO:tasks.workunit.client.1.smithi175.stdout:4/116: mknod d4/d23/c28 0 2024-04-20T10:54:25.748 INFO:tasks.workunit.client.1.smithi175.stdout:4/117: fsync f1 0 2024-04-20T10:54:25.748 INFO:tasks.workunit.client.1.smithi175.stdout:4/118: dread - d4/f1a zero size 2024-04-20T10:54:25.749 INFO:tasks.workunit.client.1.smithi175.stdout:9/108: link d6/l8 d6/d10/l19 0 2024-04-20T10:54:25.750 INFO:tasks.workunit.client.1.smithi175.stdout:4/119: creat d4/d27/d25/f29 x:0 0 0 2024-04-20T10:54:25.751 INFO:tasks.workunit.client.1.smithi175.stdout:3/50: dwrite d7/d9/fb [0,4194304] 0 2024-04-20T10:54:25.752 INFO:tasks.workunit.client.1.smithi175.stdout:9/109: truncate d6/fe 2005159 0 2024-04-20T10:54:25.753 INFO:tasks.workunit.client.1.smithi175.stdout:4/120: rmdir d4/d27/d21 0 2024-04-20T10:54:25.754 INFO:tasks.workunit.client.0.smithi090.stdout:2/9: creat f5 x:0 0 0 2024-04-20T10:54:25.755 INFO:tasks.workunit.client.0.smithi090.stdout:0/7: creat f3 x:0 0 0 2024-04-20T10:54:25.755 INFO:tasks.workunit.client.0.smithi090.stdout:0/8: stat f3 0 2024-04-20T10:54:25.755 INFO:tasks.workunit.client.0.smithi090.stdout:0/9: write f3 [412169,2298] 0 2024-04-20T10:54:25.755 INFO:tasks.workunit.client.0.smithi090.stdout:0/10: dread - f2 zero size 2024-04-20T10:54:25.755 INFO:tasks.workunit.client.0.smithi090.stdout:0/11: chown f0 1805464 1 2024-04-20T10:54:25.756 INFO:tasks.workunit.client.1.smithi175.stdout:3/51: creat d7/d9/fd x:0 0 0 2024-04-20T10:54:25.756 INFO:tasks.workunit.client.1.smithi175.stdout:3/52: getdents d7 0 2024-04-20T10:54:25.757 INFO:tasks.workunit.client.1.smithi175.stdout:3/53: dread - d7/d9/fa zero size 2024-04-20T10:54:25.757 INFO:tasks.workunit.client.1.smithi175.stdout:3/54: fsync d7/d9/fb 0 2024-04-20T10:54:25.757 INFO:tasks.workunit.client.0.smithi090.stdout:4/4: creat f2 x:0 0 0 2024-04-20T10:54:25.757 INFO:tasks.workunit.client.0.smithi090.stdout:4/5: write f0 [856066,127650] 0 2024-04-20T10:54:25.757 INFO:tasks.workunit.client.0.smithi090.stdout:4/6: chown f2 1983250133 1 2024-04-20T10:54:25.758 INFO:tasks.workunit.client.1.smithi175.stdout:1/65: getdents d0 0 2024-04-20T10:54:25.759 INFO:tasks.workunit.client.0.smithi090.stdout:3/12: mknod c3 0 2024-04-20T10:54:25.759 INFO:tasks.workunit.client.1.smithi175.stdout:9/110: rename d6/fa to d6/d10/f1a 0 2024-04-20T10:54:25.760 INFO:tasks.workunit.client.0.smithi090.stdout:1/12: mkdir d8 0 2024-04-20T10:54:25.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/121: mknod d4/d23/c2a 0 2024-04-20T10:54:25.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/122: stat d4/d27/f17 0 2024-04-20T10:54:25.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/123: readlink d4/l22 0 2024-04-20T10:54:25.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/124: truncate d4/f1a 662167 0 2024-04-20T10:54:25.761 INFO:tasks.workunit.client.0.smithi090.stdout:7/5: rename f3 to f4 0 2024-04-20T10:54:25.762 INFO:tasks.workunit.client.0.smithi090.stdout:7/6: fsync f1 0 2024-04-20T10:54:25.762 INFO:tasks.workunit.client.1.smithi175.stdout:1/66: creat d0/d8/f12 x:0 0 0 2024-04-20T10:54:25.763 INFO:tasks.workunit.client.1.smithi175.stdout:1/67: chown d0/d8/c9 845302 1 2024-04-20T10:54:25.763 INFO:tasks.workunit.client.1.smithi175.stdout:1/68: fdatasync d0/f10 0 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:2/10: mknod c6 0 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:2/11: fdatasync f5 0 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:2/12: truncate f3 318304 0 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:0/12: creat f4 x:0 0 0 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:0/13: write f4 [477124,33123] 0 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:0/14: chown c1 6 1 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:0/15: chown c1 959829 1 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:2/13: dread f3 [0,4194304] 0 2024-04-20T10:54:25.764 INFO:tasks.workunit.client.0.smithi090.stdout:2/14: write f5 [658660,43035] 0 2024-04-20T10:54:25.765 INFO:tasks.workunit.client.1.smithi175.stdout:5/55: dwrite f9 [0,4194304] 0 2024-04-20T10:54:25.765 INFO:tasks.workunit.client.1.smithi175.stdout:3/55: dread f0 [0,4194304] 0 2024-04-20T10:54:25.766 INFO:tasks.workunit.client.1.smithi175.stdout:5/56: fsync db/fe 0 2024-04-20T10:54:25.766 INFO:tasks.workunit.client.1.smithi175.stdout:3/56: chown c3 17 1 2024-04-20T10:54:25.766 INFO:tasks.workunit.client.1.smithi175.stdout:5/57: readlink l3 0 2024-04-20T10:54:25.766 INFO:tasks.workunit.client.1.smithi175.stdout:3/57: getdents d7 0 2024-04-20T10:54:25.766 INFO:tasks.workunit.client.1.smithi175.stdout:3/58: fdatasync f5 0 2024-04-20T10:54:25.766 INFO:tasks.workunit.client.1.smithi175.stdout:9/111: dread d6/d10/f1a [0,4194304] 0 2024-04-20T10:54:25.766 INFO:tasks.workunit.client.1.smithi175.stdout:6/103: dread d1/d5/f6 [0,4194304] 0 2024-04-20T10:54:25.767 INFO:tasks.workunit.client.1.smithi175.stdout:4/125: rename d4/d23/c28 to d4/d27/d25/c2b 0 2024-04-20T10:54:25.767 INFO:tasks.workunit.client.1.smithi175.stdout:4/126: chown d4/f1a 240 1 2024-04-20T10:54:25.767 INFO:tasks.workunit.client.1.smithi175.stdout:4/127: truncate d4/f12 978636 0 2024-04-20T10:54:25.767 INFO:tasks.workunit.client.0.smithi090.stdout:4/7: symlink l3 0 2024-04-20T10:54:25.767 INFO:tasks.workunit.client.0.smithi090.stdout:3/13: rename l2 to l4 0 2024-04-20T10:54:25.768 INFO:tasks.workunit.client.1.smithi175.stdout:9/112: dread d6/d10/f1a [0,4194304] 0 2024-04-20T10:54:25.768 INFO:tasks.workunit.client.0.smithi090.stdout:7/7: symlink l5 0 2024-04-20T10:54:25.769 INFO:tasks.workunit.client.0.smithi090.stdout:7/8: write f4 [625462,57771] 0 2024-04-20T10:54:25.770 INFO:tasks.workunit.client.0.smithi090.stdout:2/15: symlink l7 0 2024-04-20T10:54:25.773 INFO:tasks.workunit.client.0.smithi090.stdout:4/8: creat f4 x:0 0 0 2024-04-20T10:54:25.773 INFO:tasks.workunit.client.0.smithi090.stdout:4/9: write f2 [103602,13131] 0 2024-04-20T10:54:25.773 INFO:tasks.workunit.client.0.smithi090.stdout:4/10: dread - f4 zero size 2024-04-20T10:54:25.773 INFO:tasks.workunit.client.0.smithi090.stdout:4/11: truncate f0 1189742 0 2024-04-20T10:54:25.774 INFO:tasks.workunit.client.1.smithi175.stdout:3/59: read d7/f8 [2520612,43985] 0 2024-04-20T10:54:25.774 INFO:tasks.workunit.client.1.smithi175.stdout:3/60: stat d7/f8 0 2024-04-20T10:54:25.775 INFO:tasks.workunit.client.0.smithi090.stdout:3/14: link c3 c5 0 2024-04-20T10:54:25.778 INFO:tasks.workunit.client.1.smithi175.stdout:6/104: write d1/d5/f10 [720482,12026] 0 2024-04-20T10:54:25.781 INFO:tasks.workunit.client.1.smithi175.stdout:9/113: mkdir d6/d1b 0 2024-04-20T10:54:25.782 INFO:tasks.workunit.client.1.smithi175.stdout:6/105: link d1/d5/d12/f1c d1/d5/d12/f27 0 2024-04-20T10:54:25.782 INFO:tasks.workunit.client.0.smithi090.stdout:3/15: dread f1 [0,4194304] 0 2024-04-20T10:54:25.782 INFO:tasks.workunit.client.0.smithi090.stdout:1/13: write f6 [142498,61892] 0 2024-04-20T10:54:25.783 INFO:tasks.workunit.client.0.smithi090.stdout:7/9: rename f2 to f6 0 2024-04-20T10:54:25.783 INFO:tasks.workunit.client.0.smithi090.stdout:7/10: dread - f1 zero size 2024-04-20T10:54:25.783 INFO:tasks.workunit.client.0.smithi090.stdout:2/16: rename f5 to f8 0 2024-04-20T10:54:25.784 INFO:tasks.workunit.client.0.smithi090.stdout:3/16: creat f6 x:0 0 0 2024-04-20T10:54:25.785 INFO:tasks.workunit.client.1.smithi175.stdout:4/128: write d4/d27/f14 [1542762,82603] 0 2024-04-20T10:54:25.785 INFO:tasks.workunit.client.1.smithi175.stdout:9/114: symlink d6/d1b/l1c 0 2024-04-20T10:54:25.785 INFO:tasks.workunit.client.1.smithi175.stdout:9/115: fdatasync f5 0 2024-04-20T10:54:25.785 INFO:tasks.workunit.client.0.smithi090.stdout:1/14: mknod d8/c9 0 2024-04-20T10:54:25.787 INFO:tasks.workunit.client.1.smithi175.stdout:6/106: mknod d1/d5/d12/d22/c28 0 2024-04-20T10:54:25.788 INFO:tasks.workunit.client.1.smithi175.stdout:4/129: link d4/f1f d4/d27/f2c 0 2024-04-20T10:54:25.788 INFO:tasks.workunit.client.0.smithi090.stdout:2/17: creat f9 x:0 0 0 2024-04-20T10:54:25.788 INFO:tasks.workunit.client.0.smithi090.stdout:0/16: dwrite f2 [0,4194304] 0 2024-04-20T10:54:25.789 INFO:tasks.workunit.client.0.smithi090.stdout:0/17: stat f2 0 2024-04-20T10:54:25.789 INFO:tasks.workunit.client.0.smithi090.stdout:3/17: truncate f1 937814 0 2024-04-20T10:54:25.790 INFO:tasks.workunit.client.1.smithi175.stdout:9/116: truncate f5 1458529 0 2024-04-20T10:54:25.790 INFO:tasks.workunit.client.1.smithi175.stdout:9/117: readlink d6/d1b/l1c 0 2024-04-20T10:54:25.790 INFO:tasks.workunit.client.1.smithi175.stdout:1/69: dwrite d0/f3 [0,4194304] 0 2024-04-20T10:54:25.791 INFO:tasks.workunit.client.1.smithi175.stdout:1/70: fdatasync d0/f10 0 2024-04-20T10:54:25.791 INFO:tasks.workunit.client.1.smithi175.stdout:3/61: read f0 [884052,126360] 0 2024-04-20T10:54:25.791 INFO:tasks.workunit.client.1.smithi175.stdout:3/62: fdatasync d7/d9/fd 0 2024-04-20T10:54:25.791 INFO:tasks.workunit.client.1.smithi175.stdout:6/107: dread d1/d5/f1f [0,4194304] 0 2024-04-20T10:54:25.791 INFO:tasks.workunit.client.0.smithi090.stdout:2/18: creat fa x:0 0 0 2024-04-20T10:54:25.792 INFO:tasks.workunit.client.0.smithi090.stdout:2/19: read f3 [257104,33472] 0 2024-04-20T10:54:25.792 INFO:tasks.workunit.client.0.smithi090.stdout:2/20: dread - fa zero size 2024-04-20T10:54:25.794 INFO:tasks.workunit.client.1.smithi175.stdout:4/130: unlink d4/fb 0 2024-04-20T10:54:25.794 INFO:tasks.workunit.client.1.smithi175.stdout:4/131: truncate d4/f12 1049491 0 2024-04-20T10:54:25.794 INFO:tasks.workunit.client.1.smithi175.stdout:1/71: mkdir d0/d8/d13 0 2024-04-20T10:54:25.795 INFO:tasks.workunit.client.1.smithi175.stdout:4/132: dread - d4/d27/f1c zero size 2024-04-20T10:54:25.795 INFO:tasks.workunit.client.1.smithi175.stdout:4/133: stat d4/dd/c1d 0 2024-04-20T10:54:25.795 INFO:tasks.workunit.client.1.smithi175.stdout:4/134: write d4/d27/fa [3193099,32530] 0 2024-04-20T10:54:25.795 INFO:tasks.workunit.client.1.smithi175.stdout:1/72: write d0/ff [540373,69503] 0 2024-04-20T10:54:25.795 INFO:tasks.workunit.client.1.smithi175.stdout:1/73: fsync d0/f10 0 2024-04-20T10:54:25.795 INFO:tasks.workunit.client.0.smithi090.stdout:3/18: mkdir d7 0 2024-04-20T10:54:25.795 INFO:tasks.workunit.client.0.smithi090.stdout:3/19: read - f6 zero size 2024-04-20T10:54:25.796 INFO:tasks.workunit.client.0.smithi090.stdout:3/20: mknod d7/c8 0 2024-04-20T10:54:25.797 INFO:tasks.workunit.client.1.smithi175.stdout:3/63: unlink d7/f8 0 2024-04-20T10:54:25.798 INFO:tasks.workunit.client.1.smithi175.stdout:3/64: write d7/d9/fa [849628,130106] 0 2024-04-20T10:54:25.799 INFO:tasks.workunit.client.1.smithi175.stdout:4/135: mkdir d4/dd/d2d 0 2024-04-20T10:54:25.799 INFO:tasks.workunit.client.1.smithi175.stdout:4/136: dread - d4/d27/f2c zero size 2024-04-20T10:54:25.800 INFO:tasks.workunit.client.0.smithi090.stdout:4/12: dwrite f4 [0,4194304] 0 2024-04-20T10:54:25.801 INFO:tasks.workunit.client.1.smithi175.stdout:1/74: creat d0/d8/d13/f14 x:0 0 0 2024-04-20T10:54:25.803 INFO:tasks.workunit.client.0.smithi090.stdout:4/13: symlink l5 0 2024-04-20T10:54:25.803 INFO:tasks.workunit.client.0.smithi090.stdout:4/14: readlink l3 0 2024-04-20T10:54:25.806 INFO:tasks.workunit.client.0.smithi090.stdout:4/15: unlink f4 0 2024-04-20T10:54:25.806 INFO:tasks.workunit.client.0.smithi090.stdout:4/16: chown f0 3461317 1 2024-04-20T10:54:25.806 INFO:tasks.workunit.client.1.smithi175.stdout:3/65: creat d7/fe x:0 0 0 2024-04-20T10:54:25.808 INFO:tasks.workunit.client.1.smithi175.stdout:4/137: mkdir d4/d23/d2e 0 2024-04-20T10:54:25.808 INFO:tasks.workunit.client.1.smithi175.stdout:4/138: dread - d4/d27/f2c zero size 2024-04-20T10:54:25.808 INFO:tasks.workunit.client.0.smithi090.stdout:0/18: dread f0 [0,4194304] 0 2024-04-20T10:54:25.808 INFO:tasks.workunit.client.0.smithi090.stdout:7/11: dwrite f0 [0,4194304] 0 2024-04-20T10:54:25.810 INFO:tasks.workunit.client.1.smithi175.stdout:3/66: link f5 d7/d9/ff 0 2024-04-20T10:54:25.811 INFO:tasks.workunit.client.0.smithi090.stdout:7/12: symlink l7 0 2024-04-20T10:54:25.812 INFO:tasks.workunit.client.0.smithi090.stdout:7/13: creat f8 x:0 0 0 2024-04-20T10:54:25.814 INFO:tasks.workunit.client.0.smithi090.stdout:0/19: dread f3 [0,4194304] 0 2024-04-20T10:54:25.814 INFO:tasks.workunit.client.0.smithi090.stdout:0/20: truncate f4 1156532 0 2024-04-20T10:54:25.814 INFO:tasks.workunit.client.0.smithi090.stdout:0/21: truncate f2 4851049 0 2024-04-20T10:54:25.814 INFO:tasks.workunit.client.0.smithi090.stdout:0/22: rmdir - no directory 2024-04-20T10:54:25.814 INFO:tasks.workunit.client.0.smithi090.stdout:7/14: creat f9 x:0 0 0 2024-04-20T10:54:25.815 INFO:tasks.workunit.client.0.smithi090.stdout:0/23: creat f5 x:0 0 0 2024-04-20T10:54:25.815 INFO:tasks.workunit.client.0.smithi090.stdout:0/24: chown f4 1 1 2024-04-20T10:54:25.815 INFO:tasks.workunit.client.0.smithi090.stdout:0/25: truncate f4 1385313 0 2024-04-20T10:54:25.815 INFO:tasks.workunit.client.0.smithi090.stdout:7/15: creat fa x:0 0 0 2024-04-20T10:54:25.816 INFO:tasks.workunit.client.0.smithi090.stdout:0/26: dread f3 [0,4194304] 0 2024-04-20T10:54:25.816 INFO:tasks.workunit.client.0.smithi090.stdout:7/16: mkdir db 0 2024-04-20T10:54:25.817 INFO:tasks.workunit.client.0.smithi090.stdout:0/27: creat f6 x:0 0 0 2024-04-20T10:54:25.818 INFO:tasks.workunit.client.0.smithi090.stdout:5/12: write d1/f2 [4902952,24591] 0 2024-04-20T10:54:25.820 INFO:tasks.workunit.client.0.smithi090.stdout:5/13: creat d1/f3 x:0 0 0 2024-04-20T10:54:25.820 INFO:tasks.workunit.client.0.smithi090.stdout:5/14: write d1/f3 [402090,23800] 0 2024-04-20T10:54:25.825 INFO:tasks.workunit.client.1.smithi175.stdout:1/75: dwrite d0/f5 [0,4194304] 0 2024-04-20T10:54:25.827 INFO:tasks.workunit.client.1.smithi175.stdout:5/58: dwrite f2 [0,4194304] 0 2024-04-20T10:54:25.827 INFO:tasks.workunit.client.1.smithi175.stdout:4/139: mknod d4/dd/c2f 0 2024-04-20T10:54:25.827 INFO:tasks.workunit.client.1.smithi175.stdout:4/140: fdatasync d4/dd/f11 0 2024-04-20T10:54:25.827 INFO:tasks.workunit.client.0.smithi090.stdout:7/17: write f0 [406991,35057] 0 2024-04-20T10:54:25.827 INFO:tasks.workunit.client.0.smithi090.stdout:7/18: dread - f1 zero size 2024-04-20T10:54:25.828 INFO:tasks.workunit.client.0.smithi090.stdout:0/28: dread f2 [0,4194304] 0 2024-04-20T10:54:25.828 INFO:tasks.workunit.client.1.smithi175.stdout:6/108: dwrite d1/d5/f1f [0,4194304] 0 2024-04-20T10:54:25.829 INFO:tasks.workunit.client.1.smithi175.stdout:1/76: mknod d0/c15 0 2024-04-20T10:54:25.829 INFO:tasks.workunit.client.1.smithi175.stdout:9/118: dwrite d6/fb [4194304,4194304] 0 2024-04-20T10:54:25.830 INFO:tasks.workunit.client.0.smithi090.stdout:0/29: mknod c7 0 2024-04-20T10:54:25.831 INFO:tasks.workunit.client.0.smithi090.stdout:0/30: mknod c8 0 2024-04-20T10:54:25.833 INFO:tasks.workunit.client.0.smithi090.stdout:0/31: link f0 f9 0 2024-04-20T10:54:25.833 INFO:tasks.workunit.client.1.smithi175.stdout:6/109: dread d1/fb [0,4194304] 0 2024-04-20T10:54:25.836 INFO:tasks.workunit.client.1.smithi175.stdout:4/141: mkdir d4/d23/d2e/d30 0 2024-04-20T10:54:25.836 INFO:tasks.workunit.client.1.smithi175.stdout:4/142: write d4/f20 [5210077,24741] 0 2024-04-20T10:54:25.839 INFO:tasks.workunit.client.1.smithi175.stdout:1/77: rename d0/c4 to d0/d8/d13/c16 0 2024-04-20T10:54:25.839 INFO:tasks.workunit.client.1.smithi175.stdout:5/59: write f9 [182433,116269] 0 2024-04-20T10:54:25.841 INFO:tasks.workunit.client.0.smithi090.stdout:5/15: dwrite d1/f3 [0,4194304] 0 2024-04-20T10:54:25.841 INFO:tasks.workunit.client.0.smithi090.stdout:5/16: truncate d1/f3 5233796 0 2024-04-20T10:54:25.841 INFO:tasks.workunit.client.1.smithi175.stdout:9/119: creat d6/f1d x:0 0 0 2024-04-20T10:54:25.842 INFO:tasks.workunit.client.1.smithi175.stdout:6/110: mkdir d1/d5/d12/d22/d23/d29 0 2024-04-20T10:54:25.844 INFO:tasks.workunit.client.0.smithi090.stdout:5/17: creat d1/f4 x:0 0 0 2024-04-20T10:54:25.845 INFO:tasks.workunit.client.1.smithi175.stdout:1/78: creat d0/d8/f17 x:0 0 0 2024-04-20T10:54:25.845 INFO:tasks.workunit.client.1.smithi175.stdout:1/79: truncate d0/fe 555613 0 2024-04-20T10:54:25.845 INFO:tasks.workunit.client.0.smithi090.stdout:0/32: write f0 [216444,107516] 0 2024-04-20T10:54:25.846 INFO:tasks.workunit.client.0.smithi090.stdout:0/33: read f4 [1180803,84311] 0 2024-04-20T10:54:25.846 INFO:tasks.workunit.client.0.smithi090.stdout:0/34: chown f3 2 1 2024-04-20T10:54:25.846 INFO:tasks.workunit.client.0.smithi090.stdout:5/18: creat d1/f5 x:0 0 0 2024-04-20T10:54:25.847 INFO:tasks.workunit.client.1.smithi175.stdout:5/60: symlink db/l10 0 2024-04-20T10:54:25.848 INFO:tasks.workunit.client.1.smithi175.stdout:9/120: creat d6/d10/f1e x:0 0 0 2024-04-20T10:54:25.850 INFO:tasks.workunit.client.0.smithi090.stdout:5/19: creat d1/f6 x:0 0 0 2024-04-20T10:54:25.850 INFO:tasks.workunit.client.0.smithi090.stdout:5/20: truncate d1/f6 606309 0 2024-04-20T10:54:25.851 INFO:tasks.workunit.client.1.smithi175.stdout:1/80: link d0/fe d0/d8/f18 0 2024-04-20T10:54:25.851 INFO:tasks.workunit.client.1.smithi175.stdout:1/81: chown d0/fd 382 1 2024-04-20T10:54:25.857 INFO:tasks.workunit.client.1.smithi175.stdout:5/61: mkdir db/d11 0 2024-04-20T10:54:25.857 INFO:tasks.workunit.client.1.smithi175.stdout:5/62: chown db/l10 464889466 1 2024-04-20T10:54:25.858 INFO:tasks.workunit.client.0.smithi090.stdout:4/17: dread f2 [0,4194304] 0 2024-04-20T10:54:25.859 INFO:tasks.workunit.client.0.smithi090.stdout:4/18: symlink l6 0 2024-04-20T10:54:25.859 INFO:tasks.workunit.client.1.smithi175.stdout:9/121: mknod d6/c1f 0 2024-04-20T10:54:25.859 INFO:tasks.workunit.client.1.smithi175.stdout:9/122: fdatasync f3 0 2024-04-20T10:54:25.864 INFO:tasks.workunit.client.1.smithi175.stdout:9/123: link d6/f1d d6/f20 0 2024-04-20T10:54:25.868 INFO:tasks.workunit.client.1.smithi175.stdout:7/77: sync 2024-04-20T10:54:25.868 INFO:tasks.workunit.client.1.smithi175.stdout:2/64: sync 2024-04-20T10:54:25.868 INFO:tasks.workunit.client.1.smithi175.stdout:7/78: readlink db/l1a 0 2024-04-20T10:54:25.869 INFO:tasks.workunit.client.1.smithi175.stdout:2/65: truncate d1/d7/f10 815322 0 2024-04-20T10:54:25.869 INFO:tasks.workunit.client.1.smithi175.stdout:0/86: sync 2024-04-20T10:54:25.871 INFO:tasks.workunit.client.0.smithi090.stdout:8/27: write d0/f2 [4134093,79094] 0 2024-04-20T10:54:25.871 INFO:tasks.workunit.client.0.smithi090.stdout:8/28: write d0/f2 [280816,9163] 0 2024-04-20T10:54:25.872 INFO:tasks.workunit.client.1.smithi175.stdout:1/82: getdents d0/d8/d13 0 2024-04-20T10:54:25.872 INFO:tasks.workunit.client.1.smithi175.stdout:8/43: sync 2024-04-20T10:54:25.872 INFO:tasks.workunit.client.1.smithi175.stdout:8/44: stat d7 0 2024-04-20T10:54:25.876 INFO:tasks.workunit.client.1.smithi175.stdout:9/124: mknod d6/d10/c21 0 2024-04-20T10:54:25.880 INFO:tasks.workunit.client.0.smithi090.stdout:5/21: dwrite d1/f4 [0,4194304] 0 2024-04-20T10:54:25.881 INFO:tasks.workunit.client.1.smithi175.stdout:6/111: dwrite d1/d5/f17 [0,4194304] 0 2024-04-20T10:54:25.881 INFO:tasks.workunit.client.0.smithi090.stdout:1/15: getdents d8 0 2024-04-20T10:54:25.882 INFO:tasks.workunit.client.0.smithi090.stdout:0/35: dwrite f2 [0,4194304] 0 2024-04-20T10:54:25.882 INFO:tasks.workunit.client.1.smithi175.stdout:4/143: dwrite d4/d27/f14 [0,4194304] 0 2024-04-20T10:54:25.882 INFO:tasks.workunit.client.1.smithi175.stdout:6/112: dread d1/f9 [0,4194304] 0 2024-04-20T10:54:25.883 INFO:tasks.workunit.client.1.smithi175.stdout:6/113: read - d1/d5/d12/f13 zero size 2024-04-20T10:54:25.884 INFO:tasks.workunit.client.0.smithi090.stdout:3/21: write f1 [1603324,76059] 0 2024-04-20T10:54:25.886 INFO:tasks.workunit.client.0.smithi090.stdout:1/16: mknod d8/ca 0 2024-04-20T10:54:25.887 INFO:tasks.workunit.client.0.smithi090.stdout:0/36: creat fa x:0 0 0 2024-04-20T10:54:25.888 INFO:tasks.workunit.client.0.smithi090.stdout:4/19: dread f2 [0,4194304] 0 2024-04-20T10:54:25.888 INFO:tasks.workunit.client.1.smithi175.stdout:0/87: dread f1 [0,4194304] 0 2024-04-20T10:54:25.890 INFO:tasks.workunit.client.1.smithi175.stdout:6/114: mknod d1/d5/d12/d22/d23/d29/c2a 0 2024-04-20T10:54:25.890 INFO:tasks.workunit.client.1.smithi175.stdout:6/115: write d1/d5/f10 [630395,96532] 0 2024-04-20T10:54:25.891 INFO:tasks.workunit.client.0.smithi090.stdout:3/22: symlink d7/l9 0 2024-04-20T10:54:25.893 INFO:tasks.workunit.client.0.smithi090.stdout:1/17: creat d8/fb x:0 0 0 2024-04-20T10:54:25.893 INFO:tasks.workunit.client.1.smithi175.stdout:0/88: rename f9 to df/f13 0 2024-04-20T10:54:25.894 INFO:tasks.workunit.client.0.smithi090.stdout:3/23: creat d7/fa x:0 0 0 2024-04-20T10:54:25.894 INFO:tasks.workunit.client.0.smithi090.stdout:3/24: dread - f6 zero size 2024-04-20T10:54:25.896 INFO:tasks.workunit.client.1.smithi175.stdout:4/144: dread d4/d27/f14 [0,4194304] 0 2024-04-20T10:54:25.897 INFO:tasks.workunit.client.1.smithi175.stdout:6/116: link d1/d5/fc d1/d5/d12/f2b 0 2024-04-20T10:54:25.897 INFO:tasks.workunit.client.1.smithi175.stdout:6/117: write d1/fb [1402515,106763] 0 2024-04-20T10:54:25.897 INFO:tasks.workunit.client.1.smithi175.stdout:8/45: dwrite f6 [0,4194304] 0 2024-04-20T10:54:25.898 INFO:tasks.workunit.client.1.smithi175.stdout:0/89: creat df/f14 x:0 0 0 2024-04-20T10:54:25.899 INFO:tasks.workunit.client.1.smithi175.stdout:4/145: creat d4/f31 x:0 0 0 2024-04-20T10:54:25.899 INFO:tasks.workunit.client.1.smithi175.stdout:6/118: creat d1/d5/d12/d22/d23/d29/f2c x:0 0 0 2024-04-20T10:54:25.901 INFO:tasks.workunit.client.0.smithi090.stdout:0/37: fdatasync f0 0 2024-04-20T10:54:25.901 INFO:tasks.workunit.client.1.smithi175.stdout:2/66: dwrite d1/f6 [0,4194304] 0 2024-04-20T10:54:25.901 INFO:tasks.workunit.client.1.smithi175.stdout:2/67: write f0 [5197021,59622] 0 2024-04-20T10:54:25.901 INFO:tasks.workunit.client.1.smithi175.stdout:8/46: symlink d7/la 0 2024-04-20T10:54:25.906 INFO:tasks.workunit.client.1.smithi175.stdout:7/79: dwrite db/de/ff [0,4194304] 0 2024-04-20T10:54:25.906 INFO:tasks.workunit.client.1.smithi175.stdout:4/146: creat d4/d23/f32 x:0 0 0 2024-04-20T10:54:25.908 INFO:tasks.workunit.client.1.smithi175.stdout:6/119: rename d1/d5/f1e to d1/d5/f2d 0 2024-04-20T10:54:25.908 INFO:tasks.workunit.client.0.smithi090.stdout:5/22: getdents d1 0 2024-04-20T10:54:25.910 INFO:tasks.workunit.client.0.smithi090.stdout:5/23: rename d1/f4 to d1/f7 0 2024-04-20T10:54:25.912 INFO:tasks.workunit.client.0.smithi090.stdout:5/24: link d1/f2 d1/f8 0 2024-04-20T10:54:25.914 INFO:tasks.workunit.client.0.smithi090.stdout:5/25: symlink d1/l9 0 2024-04-20T10:54:25.916 INFO:tasks.workunit.client.1.smithi175.stdout:4/147: fdatasync d4/d27/f17 0 2024-04-20T10:54:25.916 INFO:tasks.workunit.client.0.smithi090.stdout:5/26: mkdir d1/da 0 2024-04-20T10:54:25.916 INFO:tasks.workunit.client.0.smithi090.stdout:5/27: truncate d1/f6 1487047 0 2024-04-20T10:54:25.917 INFO:tasks.workunit.client.1.smithi175.stdout:6/120: link d1/fb d1/d5/f2e 0 2024-04-20T10:54:25.917 INFO:tasks.workunit.client.1.smithi175.stdout:6/121: dread - d1/f16 zero size 2024-04-20T10:54:25.918 INFO:tasks.workunit.client.1.smithi175.stdout:7/80: read db/de/d12/f18 [3991754,95837] 0 2024-04-20T10:54:25.922 INFO:tasks.workunit.client.1.smithi175.stdout:1/83: dwrite d0/f5 [0,4194304] 0 2024-04-20T10:54:25.922 INFO:tasks.workunit.client.1.smithi175.stdout:1/84: chown d0 829179288 1 2024-04-20T10:54:25.923 INFO:tasks.workunit.client.1.smithi175.stdout:4/148: write d4/d27/f8 [4929333,85517] 0 2024-04-20T10:54:25.924 INFO:tasks.workunit.client.0.smithi090.stdout:4/20: dwrite f0 [0,4194304] 0 2024-04-20T10:54:25.925 INFO:tasks.workunit.client.0.smithi090.stdout:7/19: dwrite f0 [4194304,4194304] 0 2024-04-20T10:54:25.925 INFO:tasks.workunit.client.1.smithi175.stdout:8/47: dwrite f6 [0,4194304] 0 2024-04-20T10:54:25.926 INFO:tasks.workunit.client.1.smithi175.stdout:1/85: symlink d0/d8/l19 0 2024-04-20T10:54:25.927 INFO:tasks.workunit.client.0.smithi090.stdout:5/28: write d1/f8 [2065759,95315] 0 2024-04-20T10:54:25.928 INFO:tasks.workunit.client.1.smithi175.stdout:0/90: getdents df 0 2024-04-20T10:54:25.929 INFO:tasks.workunit.client.1.smithi175.stdout:4/149: mkdir d4/dd/d2d/d33 0 2024-04-20T10:54:25.932 INFO:tasks.workunit.client.1.smithi175.stdout:6/122: write d1/d5/d12/f2b [318686,74975] 0 2024-04-20T10:54:25.934 INFO:tasks.workunit.client.1.smithi175.stdout:0/91: symlink df/l15 0 2024-04-20T10:54:25.935 INFO:tasks.workunit.client.1.smithi175.stdout:9/125: dwrite d6/f16 [0,4194304] 0 2024-04-20T10:54:25.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/48: write f5 [2096862,120800] 0 2024-04-20T10:54:25.935 INFO:tasks.workunit.client.1.smithi175.stdout:2/68: dwrite d1/f5 [0,4194304] 0 2024-04-20T10:54:25.935 INFO:tasks.workunit.client.0.smithi090.stdout:7/20: rmdir db 0 2024-04-20T10:54:25.936 INFO:tasks.workunit.client.0.smithi090.stdout:5/29: creat d1/fb x:0 0 0 2024-04-20T10:54:25.937 INFO:tasks.workunit.client.0.smithi090.stdout:7/21: link l5 lc 0 2024-04-20T10:54:25.938 INFO:tasks.workunit.client.1.smithi175.stdout:6/123: link d1/fb d1/d5/d12/d22/d23/d29/f2f 0 2024-04-20T10:54:25.938 INFO:tasks.workunit.client.0.smithi090.stdout:5/30: mknod d1/da/cc 0 2024-04-20T10:54:25.938 INFO:tasks.workunit.client.0.smithi090.stdout:5/31: readlink d1/l9 0 2024-04-20T10:54:25.939 INFO:tasks.workunit.client.0.smithi090.stdout:5/32: write d1/fb [918998,14644] 0 2024-04-20T10:54:25.940 INFO:tasks.workunit.client.0.smithi090.stdout:7/22: creat fd x:0 0 0 2024-04-20T10:54:25.941 INFO:tasks.workunit.client.0.smithi090.stdout:5/33: fdatasync d1/f8 0 2024-04-20T10:54:25.941 INFO:tasks.workunit.client.0.smithi090.stdout:5/34: fsync d1/f7 0 2024-04-20T10:54:25.941 INFO:tasks.workunit.client.0.smithi090.stdout:7/23: creat fe x:0 0 0 2024-04-20T10:54:25.941 INFO:tasks.workunit.client.0.smithi090.stdout:7/24: chown lc 101312668 1 2024-04-20T10:54:25.943 INFO:tasks.workunit.client.1.smithi175.stdout:1/86: dread d0/f5 [0,4194304] 0 2024-04-20T10:54:25.943 INFO:tasks.workunit.client.1.smithi175.stdout:8/49: mknod d7/cb 0 2024-04-20T10:54:25.943 INFO:tasks.workunit.client.1.smithi175.stdout:8/50: rename d7 to d7/dc 22 2024-04-20T10:54:25.944 INFO:tasks.workunit.client.0.smithi090.stdout:7/25: link f1 ff 0 2024-04-20T10:54:25.944 INFO:tasks.workunit.client.0.smithi090.stdout:7/26: rmdir - no directory 2024-04-20T10:54:25.945 INFO:tasks.workunit.client.1.smithi175.stdout:2/69: creat d1/d13/f19 x:0 0 0 2024-04-20T10:54:25.945 INFO:tasks.workunit.client.1.smithi175.stdout:2/70: truncate d1/d7/f8 5359348 0 2024-04-20T10:54:25.945 INFO:tasks.workunit.client.1.smithi175.stdout:2/71: stat d1/d13/f18 0 2024-04-20T10:54:25.945 INFO:tasks.workunit.client.1.smithi175.stdout:0/92: read f3 [12220837,37809] 0 2024-04-20T10:54:25.946 INFO:tasks.workunit.client.1.smithi175.stdout:4/150: mknod d4/d27/c34 0 2024-04-20T10:54:25.947 INFO:tasks.workunit.client.1.smithi175.stdout:1/87: truncate d0/f10 383732 0 2024-04-20T10:54:25.947 INFO:tasks.workunit.client.1.smithi175.stdout:1/88: chown d0/d8/c9 23187 1 2024-04-20T10:54:25.948 INFO:tasks.workunit.client.1.smithi175.stdout:4/151: write f1 [304558,72859] 0 2024-04-20T10:54:25.949 INFO:tasks.workunit.client.1.smithi175.stdout:2/72: mkdir d1/d1a 0 2024-04-20T10:54:25.951 INFO:tasks.workunit.client.1.smithi175.stdout:0/93: symlink df/l16 0 2024-04-20T10:54:25.951 INFO:tasks.workunit.client.1.smithi175.stdout:8/51: dread f5 [0,4194304] 0 2024-04-20T10:54:25.952 INFO:tasks.workunit.client.1.smithi175.stdout:1/89: truncate d0/fd 2387959 0 2024-04-20T10:54:25.952 INFO:tasks.workunit.client.1.smithi175.stdout:1/90: chown d0/d8/c9 21355543 1 2024-04-20T10:54:25.954 INFO:tasks.workunit.client.0.smithi090.stdout:8/29: truncate d0/f2 2640346 0 2024-04-20T10:54:25.955 INFO:tasks.workunit.client.1.smithi175.stdout:4/152: link d4/dd/l26 d4/d23/d2e/d30/l35 0 2024-04-20T10:54:25.956 INFO:tasks.workunit.client.0.smithi090.stdout:8/30: creat d0/f3 x:0 0 0 2024-04-20T10:54:25.957 INFO:tasks.workunit.client.0.smithi090.stdout:8/31: mknod d0/c4 0 2024-04-20T10:54:25.958 INFO:tasks.workunit.client.0.smithi090.stdout:8/32: symlink d0/l5 0 2024-04-20T10:54:25.958 INFO:tasks.workunit.client.1.smithi175.stdout:8/52: rename f6 to d7/fd 0 2024-04-20T10:54:25.958 INFO:tasks.workunit.client.1.smithi175.stdout:8/53: write d7/f9 [1525879,112491] 0 2024-04-20T10:54:25.958 INFO:tasks.workunit.client.1.smithi175.stdout:1/91: dread d0/f5 [0,4194304] 0 2024-04-20T10:54:25.960 INFO:tasks.workunit.client.0.smithi090.stdout:5/35: write d1/f3 [780940,9221] 0 2024-04-20T10:54:25.960 INFO:tasks.workunit.client.0.smithi090.stdout:5/36: truncate d1/f5 508219 0 2024-04-20T10:54:25.962 INFO:tasks.workunit.client.0.smithi090.stdout:5/37: unlink d1/f8 0 2024-04-20T10:54:25.963 INFO:tasks.workunit.client.1.smithi175.stdout:8/54: dread f5 [0,4194304] 0 2024-04-20T10:54:25.963 INFO:tasks.workunit.client.1.smithi175.stdout:8/55: write d7/f9 [2232352,7098] 0 2024-04-20T10:54:25.964 INFO:tasks.workunit.client.1.smithi175.stdout:4/153: write d4/dd/f11 [2421150,11343] 0 2024-04-20T10:54:25.964 INFO:tasks.workunit.client.1.smithi175.stdout:9/126: dwrite d6/fe [0,4194304] 0 2024-04-20T10:54:25.964 INFO:tasks.workunit.client.1.smithi175.stdout:1/92: creat d0/f1a x:0 0 0 2024-04-20T10:54:25.965 INFO:tasks.workunit.client.1.smithi175.stdout:0/94: getdents df 0 2024-04-20T10:54:25.967 INFO:tasks.workunit.client.1.smithi175.stdout:8/56: mkdir d7/de 0 2024-04-20T10:54:25.967 INFO:tasks.workunit.client.1.smithi175.stdout:8/57: readlink d7/la 0 2024-04-20T10:54:25.969 INFO:tasks.workunit.client.1.smithi175.stdout:6/124: dwrite d1/d5/d12/d22/d23/d29/f2c [0,4194304] 0 2024-04-20T10:54:25.969 INFO:tasks.workunit.client.1.smithi175.stdout:6/125: chown d1/d5/d12/d22/d23/d29/c2a 4 1 2024-04-20T10:54:25.969 INFO:tasks.workunit.client.0.smithi090.stdout:8/33: fsync d0/f3 0 2024-04-20T10:54:25.970 INFO:tasks.workunit.client.0.smithi090.stdout:8/34: write d0/f3 [40793,118705] 0 2024-04-20T10:54:25.970 INFO:tasks.workunit.client.0.smithi090.stdout:8/35: mknod d0/c6 0 2024-04-20T10:54:25.970 INFO:tasks.workunit.client.0.smithi090.stdout:8/36: chown d0/c6 21 1 2024-04-20T10:54:25.971 INFO:tasks.workunit.client.0.smithi090.stdout:8/37: rmdir d0 39 2024-04-20T10:54:25.971 INFO:tasks.workunit.client.0.smithi090.stdout:5/38: truncate d1/f3 314987 0 2024-04-20T10:54:25.972 INFO:tasks.workunit.client.1.smithi175.stdout:2/73: dwrite d1/d7/ff [0,4194304] 0 2024-04-20T10:54:25.972 INFO:tasks.workunit.client.1.smithi175.stdout:2/74: dread - d1/f11 zero size 2024-04-20T10:54:25.973 INFO:tasks.workunit.client.1.smithi175.stdout:2/75: write f0 [2217587,1966] 0 2024-04-20T10:54:25.973 INFO:tasks.workunit.client.1.smithi175.stdout:2/76: write f0 [2624899,96942] 0 2024-04-20T10:54:25.973 INFO:tasks.workunit.client.1.smithi175.stdout:0/95: mkdir df/d17 0 2024-04-20T10:54:25.973 INFO:tasks.workunit.client.1.smithi175.stdout:1/93: dread d0/f5 [0,4194304] 0 2024-04-20T10:54:25.974 INFO:tasks.workunit.client.0.smithi090.stdout:8/38: creat d0/f7 x:0 0 0 2024-04-20T10:54:25.974 INFO:tasks.workunit.client.0.smithi090.stdout:5/39: mknod d1/cd 0 2024-04-20T10:54:25.974 INFO:tasks.workunit.client.0.smithi090.stdout:5/40: write d1/f6 [1607023,116325] 0 2024-04-20T10:54:25.974 INFO:tasks.workunit.client.0.smithi090.stdout:8/39: rename d0/f7 to d0/f8 0 2024-04-20T10:54:25.975 INFO:tasks.workunit.client.1.smithi175.stdout:6/126: truncate d1/d5/f10 630497 0 2024-04-20T10:54:25.976 INFO:tasks.workunit.client.0.smithi090.stdout:5/41: mkdir d1/de 0 2024-04-20T10:54:25.976 INFO:tasks.workunit.client.0.smithi090.stdout:5/42: truncate d1/f6 2437830 0 2024-04-20T10:54:25.976 INFO:tasks.workunit.client.1.smithi175.stdout:2/77: creat d1/d1a/f1b x:0 0 0 2024-04-20T10:54:25.977 INFO:tasks.workunit.client.1.smithi175.stdout:0/96: creat df/d17/f18 x:0 0 0 2024-04-20T10:54:25.977 INFO:tasks.workunit.client.0.smithi090.stdout:5/43: write d1/f6 [2170744,88934] 0 2024-04-20T10:54:25.978 INFO:tasks.workunit.client.0.smithi090.stdout:5/44: unlink d1/cd 0 2024-04-20T10:54:25.979 INFO:tasks.workunit.client.1.smithi175.stdout:6/127: rename d1/d5/f1f to d1/d5/d12/d24/f30 0 2024-04-20T10:54:25.979 INFO:tasks.workunit.client.0.smithi090.stdout:5/45: rename d1/f2 to d1/da/ff 0 2024-04-20T10:54:25.980 INFO:tasks.workunit.client.1.smithi175.stdout:2/78: rmdir d1/d13 39 2024-04-20T10:54:25.985 INFO:tasks.workunit.client.1.smithi175.stdout:1/94: write d0/f3 [1650690,23374] 0 2024-04-20T10:54:25.993 INFO:tasks.workunit.client.1.smithi175.stdout:4/154: dwrite d4/f12 [0,4194304] 0 2024-04-20T10:54:25.994 INFO:tasks.workunit.client.0.smithi090.stdout:5/46: write d1/f7 [816320,28004] 0 2024-04-20T10:54:25.995 INFO:tasks.workunit.client.0.smithi090.stdout:8/40: dread d0/f3 [0,4194304] 0 2024-04-20T10:54:25.996 INFO:tasks.workunit.client.0.smithi090.stdout:5/47: symlink d1/de/l10 0 2024-04-20T10:54:25.997 INFO:tasks.workunit.client.0.smithi090.stdout:8/41: creat d0/f9 x:0 0 0 2024-04-20T10:54:25.997 INFO:tasks.workunit.client.0.smithi090.stdout:8/42: read d0/f3 [140982,107932] 0 2024-04-20T10:54:25.997 INFO:tasks.workunit.client.0.smithi090.stdout:8/43: truncate d0/f3 945909 0 2024-04-20T10:54:26.003 INFO:tasks.workunit.client.1.smithi175.stdout:9/127: dwrite d6/fe [0,4194304] 0 2024-04-20T10:54:26.005 INFO:tasks.workunit.client.1.smithi175.stdout:8/58: dwrite d7/f9 [0,4194304] 0 2024-04-20T10:54:26.006 INFO:tasks.workunit.client.1.smithi175.stdout:6/128: dwrite d1/d5/fa [0,4194304] 0 2024-04-20T10:54:26.006 INFO:tasks.workunit.client.1.smithi175.stdout:6/129: chown d1/d5/f2d 949600 1 2024-04-20T10:54:26.020 INFO:tasks.workunit.client.0.smithi090.stdout:5/48: dwrite d1/da/ff [0,4194304] 0 2024-04-20T10:54:26.020 INFO:tasks.workunit.client.0.smithi090.stdout:8/44: dwrite d0/f9 [0,4194304] 0 2024-04-20T10:54:26.032 INFO:tasks.workunit.client.0.smithi090.stdout:7/27: dwrite f6 [0,4194304] 0 2024-04-20T10:54:26.034 INFO:tasks.workunit.client.0.smithi090.stdout:7/28: rename fe to f10 0 2024-04-20T10:54:26.034 INFO:tasks.workunit.client.0.smithi090.stdout:5/49: write d1/da/ff [2852183,27019] 0 2024-04-20T10:54:26.034 INFO:tasks.workunit.client.0.smithi090.stdout:7/29: stat l5 0 2024-04-20T10:54:26.036 INFO:tasks.workunit.client.0.smithi090.stdout:7/30: unlink fa 0 2024-04-20T10:54:26.063 INFO:tasks.workunit.client.0.smithi090.stdout:5/50: dwrite d1/f3 [0,4194304] 0 2024-04-20T10:54:26.063 INFO:tasks.workunit.client.0.smithi090.stdout:7/31: dwrite f8 [0,4194304] 0 2024-04-20T10:54:26.064 INFO:tasks.workunit.client.0.smithi090.stdout:5/51: link d1/f3 d1/de/f11 0 2024-04-20T10:54:26.065 INFO:tasks.workunit.client.0.smithi090.stdout:7/32: mkdir d11 0 2024-04-20T10:54:26.066 INFO:tasks.workunit.client.0.smithi090.stdout:7/33: creat d11/f12 x:0 0 0 2024-04-20T10:54:26.067 INFO:tasks.workunit.client.0.smithi090.stdout:7/34: write f10 [63006,128770] 0 2024-04-20T10:54:26.073 INFO:tasks.workunit.client.0.smithi090.stdout:8/45: dread d0/f2 [0,4194304] 0 2024-04-20T10:54:26.074 INFO:tasks.workunit.client.0.smithi090.stdout:8/46: mknod d0/ca 0 2024-04-20T10:54:26.076 INFO:tasks.workunit.client.0.smithi090.stdout:8/47: rename d0/c4 to d0/cb 0 2024-04-20T10:54:26.076 INFO:tasks.workunit.client.0.smithi090.stdout:8/48: readlink d0/l5 0 2024-04-20T10:54:26.081 INFO:tasks.workunit.client.0.smithi090.stdout:5/52: dwrite d1/de/f11 [4194304,4194304] 0 2024-04-20T10:54:26.081 INFO:tasks.workunit.client.0.smithi090.stdout:5/53: write d1/f7 [1931404,102053] 0 2024-04-20T10:54:26.082 INFO:tasks.workunit.client.0.smithi090.stdout:5/54: creat d1/f12 x:0 0 0 2024-04-20T10:54:26.083 INFO:tasks.workunit.client.0.smithi090.stdout:5/55: chown d1/f5 64276254 1 2024-04-20T10:54:26.085 INFO:tasks.workunit.client.0.smithi090.stdout:8/49: dread d0/f2 [0,4194304] 0 2024-04-20T10:54:26.101 INFO:tasks.workunit.client.0.smithi090.stdout:8/50: dwrite d0/f8 [0,4194304] 0 2024-04-20T10:54:26.102 INFO:tasks.workunit.client.0.smithi090.stdout:8/51: symlink d0/lc 0 2024-04-20T10:54:26.105 INFO:tasks.workunit.client.0.smithi090.stdout:8/52: truncate d0/f3 253311 0 2024-04-20T10:54:26.106 INFO:tasks.workunit.client.0.smithi090.stdout:8/53: chown d0/f8 73879889 1 2024-04-20T10:54:26.111 INFO:tasks.workunit.client.0.smithi090.stdout:5/56: write d1/fb [624467,35950] 0 2024-04-20T10:54:26.112 INFO:tasks.workunit.client.0.smithi090.stdout:5/57: chown d1/da 2284562 1 2024-04-20T10:54:26.112 INFO:tasks.workunit.client.0.smithi090.stdout:5/58: symlink d1/da/l13 0 2024-04-20T10:54:26.114 INFO:tasks.workunit.client.0.smithi090.stdout:5/59: write d1/f6 [1562271,106914] 0 2024-04-20T10:54:26.129 INFO:tasks.workunit.client.0.smithi090.stdout:8/54: dwrite d0/f2 [0,4194304] 0 2024-04-20T10:54:26.130 INFO:tasks.workunit.client.0.smithi090.stdout:8/55: symlink d0/ld 0 2024-04-20T10:54:26.131 INFO:tasks.workunit.client.0.smithi090.stdout:8/56: creat d0/fe x:0 0 0 2024-04-20T10:54:26.132 INFO:tasks.workunit.client.0.smithi090.stdout:8/57: rename d0/c6 to d0/cf 0 2024-04-20T10:54:26.133 INFO:tasks.workunit.client.0.smithi090.stdout:8/58: symlink d0/l10 0 2024-04-20T10:54:26.134 INFO:tasks.workunit.client.0.smithi090.stdout:8/59: mkdir d0/d11 0 2024-04-20T10:54:26.150 INFO:tasks.workunit.client.0.smithi090.stdout:8/60: dwrite d0/f9 [0,4194304] 0 2024-04-20T10:54:26.161 INFO:tasks.workunit.client.0.smithi090.stdout:5/60: dwrite d1/f3 [4194304,4194304] 0 2024-04-20T10:54:26.177 INFO:tasks.workunit.client.0.smithi090.stdout:5/61: dwrite d1/f7 [4194304,4194304] 0 2024-04-20T10:54:26.178 INFO:tasks.workunit.client.0.smithi090.stdout:5/62: mkdir d1/da/d14 0 2024-04-20T10:54:26.180 INFO:tasks.workunit.client.0.smithi090.stdout:5/63: rename d1/de/l10 to d1/de/l15 0 2024-04-20T10:54:26.196 INFO:tasks.workunit.client.0.smithi090.stdout:5/64: dread d1/f3 [4194304,4194304] 0 2024-04-20T10:54:26.198 INFO:tasks.workunit.client.0.smithi090.stdout:5/65: write d1/f3 [4465028,100623] 0 2024-04-20T10:54:26.198 INFO:tasks.workunit.client.0.smithi090.stdout:5/66: write d1/f6 [1458354,30141] 0 2024-04-20T10:54:26.200 INFO:tasks.workunit.client.0.smithi090.stdout:5/67: unlink d1/l9 0 2024-04-20T10:54:26.201 INFO:tasks.workunit.client.0.smithi090.stdout:5/68: write d1/f6 [2264151,8997] 0 2024-04-20T10:54:26.216 INFO:tasks.workunit.client.0.smithi090.stdout:5/69: dwrite d1/da/ff [4194304,4194304] 0 2024-04-20T10:54:26.217 INFO:tasks.workunit.client.0.smithi090.stdout:5/70: unlink d1/da/ff 0 2024-04-20T10:54:26.219 INFO:tasks.workunit.client.0.smithi090.stdout:5/71: fdatasync d1/de/f11 0 2024-04-20T10:54:26.220 INFO:tasks.workunit.client.0.smithi090.stdout:5/72: mkdir d1/da/d16 0 2024-04-20T10:54:26.222 INFO:tasks.workunit.client.0.smithi090.stdout:5/73: creat d1/da/f17 x:0 0 0 2024-04-20T10:54:26.222 INFO:tasks.workunit.client.0.smithi090.stdout:5/74: stat d1/f5 0 2024-04-20T10:54:26.226 INFO:tasks.workunit.client.0.smithi090.stdout:5/75: getdents d1 0 2024-04-20T10:54:26.226 INFO:tasks.workunit.client.0.smithi090.stdout:5/76: write d1/f5 [1129347,42388] 0 2024-04-20T10:54:26.227 INFO:tasks.workunit.client.0.smithi090.stdout:5/77: mknod d1/da/d14/c18 0 2024-04-20T10:54:26.227 INFO:tasks.workunit.client.0.smithi090.stdout:5/78: truncate d1/f5 2177155 0 2024-04-20T10:54:26.229 INFO:tasks.workunit.client.0.smithi090.stdout:5/79: dread d1/fb [0,4194304] 0 2024-04-20T10:54:26.230 INFO:tasks.workunit.client.0.smithi090.stdout:5/80: creat d1/da/f19 x:0 0 0 2024-04-20T10:54:26.231 INFO:tasks.workunit.client.0.smithi090.stdout:5/81: mknod d1/da/d14/c1a 0 2024-04-20T10:54:26.231 INFO:tasks.workunit.client.0.smithi090.stdout:5/82: creat d1/da/d16/f1b x:0 0 0 2024-04-20T10:54:26.232 INFO:tasks.workunit.client.0.smithi090.stdout:5/83: rename d1/da/d16/f1b to d1/da/d14/f1c 0 2024-04-20T10:54:26.233 INFO:tasks.workunit.client.0.smithi090.stdout:5/84: link d1/f6 d1/da/d14/f1d 0 2024-04-20T10:54:26.233 INFO:tasks.workunit.client.0.smithi090.stdout:5/85: write d1/da/d14/f1c [243394,64349] 0 2024-04-20T10:54:26.236 INFO:tasks.workunit.client.1.smithi175.stdout:2/79: symlink d1/d1a/l1c 0 2024-04-20T10:54:26.236 INFO:tasks.workunit.client.1.smithi175.stdout:0/97: mkdir df/d19 0 2024-04-20T10:54:26.236 INFO:tasks.workunit.client.1.smithi175.stdout:0/98: chown df/d19 11733802 1 2024-04-20T10:54:26.236 INFO:tasks.workunit.client.1.smithi175.stdout:2/80: chown d1/d7/f8 0 1 2024-04-20T10:54:26.237 INFO:tasks.workunit.client.1.smithi175.stdout:1/95: creat d0/d8/d13/f1b x:0 0 0 2024-04-20T10:54:26.237 INFO:tasks.workunit.client.1.smithi175.stdout:1/96: dread - d0/d8/f12 zero size 2024-04-20T10:54:26.237 INFO:tasks.workunit.client.1.smithi175.stdout:4/155: write d4/d27/f15 [1288963,33499] 0 2024-04-20T10:54:26.238 INFO:tasks.workunit.client.1.smithi175.stdout:9/128: mknod d6/d10/c22 0 2024-04-20T10:54:26.239 INFO:tasks.workunit.client.1.smithi175.stdout:8/59: truncate d7/fd 3751758 0 2024-04-20T10:54:26.239 INFO:tasks.workunit.client.0.smithi090.stdout:5/86: getdents d1/da/d14 0 2024-04-20T10:54:26.240 INFO:tasks.workunit.client.0.smithi090.stdout:5/87: write d1/de/f11 [7313181,62613] 0 2024-04-20T10:54:26.240 INFO:tasks.workunit.client.0.smithi090.stdout:5/88: write d1/de/f11 [6461740,26321] 0 2024-04-20T10:54:26.241 INFO:tasks.workunit.client.0.smithi090.stdout:5/89: rename d1/da/d14/f1c to d1/da/f1e 0 2024-04-20T10:54:26.241 INFO:tasks.workunit.client.0.smithi090.stdout:5/90: mkdir d1/da/d1f 0 2024-04-20T10:54:26.242 INFO:tasks.workunit.client.0.smithi090.stdout:5/91: unlink d1/f3 0 2024-04-20T10:54:26.243 INFO:tasks.workunit.client.1.smithi175.stdout:6/130: creat d1/d5/d12/f31 x:0 0 0 2024-04-20T10:54:26.245 INFO:tasks.workunit.client.1.smithi175.stdout:0/99: truncate f0 2439838 0 2024-04-20T10:54:26.245 INFO:tasks.workunit.client.1.smithi175.stdout:2/81: link d1/f3 d1/d1a/f1d 0 2024-04-20T10:54:26.246 INFO:tasks.workunit.client.1.smithi175.stdout:9/129: dread d6/fe [0,4194304] 0 2024-04-20T10:54:26.247 INFO:tasks.workunit.client.1.smithi175.stdout:1/97: mknod d0/c1c 0 2024-04-20T10:54:26.247 INFO:tasks.workunit.client.1.smithi175.stdout:1/98: dread - d0/f1a zero size 2024-04-20T10:54:26.248 INFO:tasks.workunit.client.1.smithi175.stdout:6/131: creat d1/d5/d12/d22/d23/f32 x:0 0 0 2024-04-20T10:54:26.250 INFO:tasks.workunit.client.1.smithi175.stdout:1/99: mknod d0/d8/c1d 0 2024-04-20T10:54:26.251 INFO:tasks.workunit.client.1.smithi175.stdout:6/132: link d1/c1d d1/c33 0 2024-04-20T10:54:26.252 INFO:tasks.workunit.client.1.smithi175.stdout:0/100: mkdir df/d1a 0 2024-04-20T10:54:26.253 INFO:tasks.workunit.client.1.smithi175.stdout:8/60: write d7/fd [4749491,85920] 0 2024-04-20T10:54:26.254 INFO:tasks.workunit.client.1.smithi175.stdout:6/133: mknod d1/c34 0 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:0/101: mknod df/d1a/c1b 0 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:0/102: stat f5 0 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:0/103: fdatasync f1 0 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:0/104: write f5 [979453,4959] 0 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:9/130: write d6/f16 [691427,127703] 0 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:8/61: creat d7/de/ff x:0 0 0 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:8/62: dread - d7/de/ff zero size 2024-04-20T10:54:26.256 INFO:tasks.workunit.client.1.smithi175.stdout:8/63: rename d7/de to d7/de/d10 22 2024-04-20T10:54:26.257 INFO:tasks.workunit.client.1.smithi175.stdout:6/134: creat d1/d5/d12/f35 x:0 0 0 2024-04-20T10:54:26.258 INFO:tasks.workunit.client.1.smithi175.stdout:0/105: write df/f11 [558429,114137] 0 2024-04-20T10:54:26.259 INFO:tasks.workunit.client.1.smithi175.stdout:9/131: symlink d6/d10/l23 0 2024-04-20T10:54:26.261 INFO:tasks.workunit.client.0.smithi090.stdout:5/92: dwrite d1/f7 [4194304,4194304] 0 2024-04-20T10:54:26.261 INFO:tasks.workunit.client.1.smithi175.stdout:8/64: dread f5 [0,4194304] 0 2024-04-20T10:54:26.261 INFO:tasks.workunit.client.1.smithi175.stdout:6/135: creat d1/d5/d12/d22/d23/d29/f36 x:0 0 0 2024-04-20T10:54:26.262 INFO:tasks.workunit.client.1.smithi175.stdout:0/106: creat df/f1c x:0 0 0 2024-04-20T10:54:26.264 INFO:tasks.workunit.client.1.smithi175.stdout:6/136: getdents d1/d5 0 2024-04-20T10:54:26.264 INFO:tasks.workunit.client.1.smithi175.stdout:6/137: read d1/d5/d12/f14 [653617,32563] 0 2024-04-20T10:54:26.265 INFO:tasks.workunit.client.1.smithi175.stdout:6/138: chown d1/d5/d12/f2b 8238640 1 2024-04-20T10:54:26.266 INFO:tasks.workunit.client.1.smithi175.stdout:8/65: creat d7/de/f11 x:0 0 0 2024-04-20T10:54:26.266 INFO:tasks.workunit.client.1.smithi175.stdout:8/66: dread - d7/de/ff zero size 2024-04-20T10:54:26.267 INFO:tasks.workunit.client.1.smithi175.stdout:6/139: mkdir d1/d37 0 2024-04-20T10:54:26.267 INFO:tasks.workunit.client.1.smithi175.stdout:6/140: readlink d1/d5/d12/l1a 0 2024-04-20T10:54:26.269 INFO:tasks.workunit.client.0.smithi090.stdout:5/93: truncate d1/de/f11 519554 0 2024-04-20T10:54:26.269 INFO:tasks.workunit.client.0.smithi090.stdout:5/94: chown d1/f5 4384990 1 2024-04-20T10:54:26.271 INFO:tasks.workunit.client.0.smithi090.stdout:5/95: creat d1/de/f20 x:0 0 0 2024-04-20T10:54:26.271 INFO:tasks.workunit.client.1.smithi175.stdout:9/132: dread f3 [4194304,4194304] 0 2024-04-20T10:54:26.272 INFO:tasks.workunit.client.1.smithi175.stdout:1/100: getdents d0/d8 0 2024-04-20T10:54:26.274 INFO:tasks.workunit.client.1.smithi175.stdout:9/133: getdents d6 0 2024-04-20T10:54:26.277 INFO:tasks.workunit.client.0.smithi090.stdout:5/96: dread d1/f7 [0,4194304] 0 2024-04-20T10:54:26.278 INFO:tasks.workunit.client.0.smithi090.stdout:5/97: stat d1/de/l15 0 2024-04-20T10:54:26.278 INFO:tasks.workunit.client.1.smithi175.stdout:1/101: creat d0/f1e x:0 0 0 2024-04-20T10:54:26.282 INFO:tasks.workunit.client.1.smithi175.stdout:0/107: dwrite f0 [0,4194304] 0 2024-04-20T10:54:26.286 INFO:tasks.workunit.client.0.smithi090.stdout:5/98: fdatasync d1/da/f1e 0 2024-04-20T10:54:26.286 INFO:tasks.workunit.client.1.smithi175.stdout:6/141: dwrite d1/d5/f2d [0,4194304] 0 2024-04-20T10:54:26.287 INFO:tasks.workunit.client.1.smithi175.stdout:0/108: symlink df/d1a/l1d 0 2024-04-20T10:54:26.289 INFO:tasks.workunit.client.1.smithi175.stdout:6/142: creat d1/d5/f38 x:0 0 0 2024-04-20T10:54:26.289 INFO:tasks.workunit.client.1.smithi175.stdout:6/143: dread - d1/d5/d12/f1c zero size 2024-04-20T10:54:26.289 INFO:tasks.workunit.client.1.smithi175.stdout:6/144: write d1/fb [2366953,92180] 0 2024-04-20T10:54:26.290 INFO:tasks.workunit.client.1.smithi175.stdout:6/145: stat d1/d5/fc 0 2024-04-20T10:54:26.290 INFO:tasks.workunit.client.1.smithi175.stdout:0/109: creat df/d19/f1e x:0 0 0 2024-04-20T10:54:26.291 INFO:tasks.workunit.client.1.smithi175.stdout:6/146: rmdir d1/d5/d12/d22/d23 39 2024-04-20T10:54:26.293 INFO:tasks.workunit.client.1.smithi175.stdout:0/110: unlink f6 0 2024-04-20T10:54:26.298 INFO:tasks.workunit.client.1.smithi175.stdout:9/134: dwrite d6/fe [0,4194304] 0 2024-04-20T10:54:26.299 INFO:tasks.workunit.client.1.smithi175.stdout:1/102: dwrite d0/f1e [0,4194304] 0 2024-04-20T10:54:26.300 INFO:tasks.workunit.client.1.smithi175.stdout:1/103: write d0/fe [153898,14686] 0 2024-04-20T10:54:26.301 INFO:tasks.workunit.client.1.smithi175.stdout:6/147: rename d1/d5/d12/d22/d23/d29/f2c to d1/d5/f39 0 2024-04-20T10:54:26.302 INFO:tasks.workunit.client.1.smithi175.stdout:3/67: sync 2024-04-20T10:54:26.302 INFO:tasks.workunit.client.1.smithi175.stdout:5/63: sync 2024-04-20T10:54:26.302 INFO:tasks.workunit.client.1.smithi175.stdout:7/81: sync 2024-04-20T10:54:26.302 INFO:tasks.workunit.client.1.smithi175.stdout:5/64: dread - db/fe zero size 2024-04-20T10:54:26.302 INFO:tasks.workunit.client.1.smithi175.stdout:9/135: creat d6/d1b/f24 x:0 0 0 2024-04-20T10:54:26.304 INFO:tasks.workunit.client.1.smithi175.stdout:1/104: creat d0/d8/f1f x:0 0 0 2024-04-20T10:54:26.310 INFO:tasks.workunit.client.0.smithi090.stdout:5/99: dwrite d1/f6 [0,4194304] 0 2024-04-20T10:54:26.311 INFO:tasks.workunit.client.0.smithi090.stdout:5/100: mknod d1/da/c21 0 2024-04-20T10:54:26.311 INFO:tasks.workunit.client.0.smithi090.stdout:5/101: chown d1/de/l15 2 1 2024-04-20T10:54:26.311 INFO:tasks.workunit.client.0.smithi090.stdout:5/102: chown d1/da/f1e 58387 1 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:0/111: rename f8 to df/d19/f1f 0 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:7/82: stat db/c11 0 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:7/83: fsync f1 0 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:7/84: rename db/de to db/de/d12/d1b 22 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:3/68: getdents d7/d9 0 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:3/69: fdatasync d7/d9/ff 0 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:3/70: dread - d7/fe zero size 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:3/71: write d7/d9/fd [495905,42183] 0 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:5/65: symlink db/d11/l12 0 2024-04-20T10:54:26.313 INFO:tasks.workunit.client.1.smithi175.stdout:5/66: write db/fe [46455,41477] 0 2024-04-20T10:54:26.315 INFO:tasks.workunit.client.1.smithi175.stdout:6/148: write d1/d5/fa [3281686,96243] 0 2024-04-20T10:54:26.315 INFO:tasks.workunit.client.1.smithi175.stdout:1/105: creat d0/f20 x:0 0 0 2024-04-20T10:54:26.317 INFO:tasks.workunit.client.1.smithi175.stdout:3/72: mkdir d7/d10 0 2024-04-20T10:54:26.317 INFO:tasks.workunit.client.1.smithi175.stdout:3/73: write d7/d9/fd [585835,118070] 0 2024-04-20T10:54:26.318 INFO:tasks.workunit.client.1.smithi175.stdout:6/149: rmdir d1/d5/d12 39 2024-04-20T10:54:26.320 INFO:tasks.workunit.client.1.smithi175.stdout:1/106: link d0/d8/c9 d0/d8/d13/c21 0 2024-04-20T10:54:26.320 INFO:tasks.workunit.client.1.smithi175.stdout:1/107: dread - d0/d8/f12 zero size 2024-04-20T10:54:26.321 INFO:tasks.workunit.client.1.smithi175.stdout:6/150: mknod d1/d37/c3a 0 2024-04-20T10:54:26.324 INFO:tasks.workunit.client.1.smithi175.stdout:1/108: rmdir d0 39 2024-04-20T10:54:26.324 INFO:tasks.workunit.client.1.smithi175.stdout:1/109: rename d0/d8 to d0/d8/d13/d22 22 2024-04-20T10:54:26.329 INFO:tasks.workunit.client.1.smithi175.stdout:3/74: dread f5 [0,4194304] 0 2024-04-20T10:54:26.329 INFO:tasks.workunit.client.1.smithi175.stdout:9/136: dwrite d6/f16 [4194304,4194304] 0 2024-04-20T10:54:26.329 INFO:tasks.workunit.client.1.smithi175.stdout:9/137: fdatasync f3 0 2024-04-20T10:54:26.329 INFO:tasks.workunit.client.1.smithi175.stdout:3/75: fsync d7/d9/fb 0 2024-04-20T10:54:26.329 INFO:tasks.workunit.client.1.smithi175.stdout:3/76: write d7/d9/fd [1164509,128760] 0 2024-04-20T10:54:26.347 INFO:tasks.workunit.client.1.smithi175.stdout:3/77: rename d7/d9/ff to d7/d9/f11 0 2024-04-20T10:54:26.349 INFO:tasks.workunit.client.1.smithi175.stdout:5/67: dwrite db/ff [0,4194304] 0 2024-04-20T10:54:26.350 INFO:tasks.workunit.client.0.smithi090.stdout:5/103: dwrite d1/f5 [0,4194304] 0 2024-04-20T10:54:26.351 INFO:tasks.workunit.client.1.smithi175.stdout:3/78: creat d7/f12 x:0 0 0 2024-04-20T10:54:26.352 INFO:tasks.workunit.client.0.smithi090.stdout:5/104: unlink d1/f6 0 2024-04-20T10:54:26.352 INFO:tasks.workunit.client.0.smithi090.stdout:5/105: getdents d1/de 0 2024-04-20T10:54:26.352 INFO:tasks.workunit.client.0.smithi090.stdout:5/106: truncate d1/da/f1e 1221742 0 2024-04-20T10:54:26.353 INFO:tasks.workunit.client.1.smithi175.stdout:9/138: dwrite d6/f17 [0,4194304] 0 2024-04-20T10:54:26.353 INFO:tasks.workunit.client.1.smithi175.stdout:8/67: truncate d7/fd 4239692 0 2024-04-20T10:54:26.354 INFO:tasks.workunit.client.1.smithi175.stdout:3/79: dread d7/d9/fa [0,4194304] 0 2024-04-20T10:54:26.354 INFO:tasks.workunit.client.1.smithi175.stdout:5/68: stat c7 0 2024-04-20T10:54:26.355 INFO:tasks.workunit.client.1.smithi175.stdout:0/112: dwrite f4 [0,4194304] 0 2024-04-20T10:54:26.355 INFO:tasks.workunit.client.1.smithi175.stdout:7/85: dwrite f2 [0,4194304] 0 2024-04-20T10:54:26.355 INFO:tasks.workunit.client.1.smithi175.stdout:7/86: chown db/de/d12/f18 47 1 2024-04-20T10:54:26.355 INFO:tasks.workunit.client.1.smithi175.stdout:7/87: write db/de/d12/f18 [602461,60204] 0 2024-04-20T10:54:26.355 INFO:tasks.workunit.client.1.smithi175.stdout:6/151: dwrite d1/d5/d12/d24/f30 [0,4194304] 0 2024-04-20T10:54:26.355 INFO:tasks.workunit.client.1.smithi175.stdout:6/152: chown d1/d5/d12/d22/d23/d29 76285 1 2024-04-20T10:54:26.357 INFO:tasks.workunit.client.1.smithi175.stdout:9/139: rename d6/fb to d6/f25 0 2024-04-20T10:54:26.357 INFO:tasks.workunit.client.1.smithi175.stdout:9/140: chown d6/d10/l19 266450589 1 2024-04-20T10:54:26.358 INFO:tasks.workunit.client.1.smithi175.stdout:9/141: write d6/f1d [876783,24533] 0 2024-04-20T10:54:26.359 INFO:tasks.workunit.client.1.smithi175.stdout:8/68: creat d7/de/f12 x:0 0 0 2024-04-20T10:54:26.359 INFO:tasks.workunit.client.1.smithi175.stdout:0/113: write df/d19/f1f [1956650,112479] 0 2024-04-20T10:54:26.360 INFO:tasks.workunit.client.1.smithi175.stdout:3/80: mknod d7/d10/c13 0 2024-04-20T10:54:26.360 INFO:tasks.workunit.client.1.smithi175.stdout:3/81: chown l4 2839 1 2024-04-20T10:54:26.362 INFO:tasks.workunit.client.1.smithi175.stdout:7/88: creat db/f1c x:0 0 0 2024-04-20T10:54:26.362 INFO:tasks.workunit.client.1.smithi175.stdout:7/89: write f1 [939312,86135] 0 2024-04-20T10:54:26.362 INFO:tasks.workunit.client.1.smithi175.stdout:7/90: stat db/f1c 0 2024-04-20T10:54:26.362 INFO:tasks.workunit.client.1.smithi175.stdout:7/91: chown db/de/c17 122030645 1 2024-04-20T10:54:26.364 INFO:tasks.workunit.client.1.smithi175.stdout:6/153: truncate d1/d5/f17 136411 0 2024-04-20T10:54:26.365 INFO:tasks.workunit.client.1.smithi175.stdout:0/114: rmdir df/d19 39 2024-04-20T10:54:26.372 INFO:tasks.workunit.client.1.smithi175.stdout:7/92: mkdir db/d1d 0 2024-04-20T10:54:26.372 INFO:tasks.workunit.client.1.smithi175.stdout:7/93: write db/fd [1831137,94435] 0 2024-04-20T10:54:26.372 INFO:tasks.workunit.client.1.smithi175.stdout:5/69: dwrite db/fe [0,4194304] 0 2024-04-20T10:54:26.372 INFO:tasks.workunit.client.1.smithi175.stdout:5/70: readlink db/d11/l12 0 2024-04-20T10:54:26.373 INFO:tasks.workunit.client.0.smithi090.stdout:5/107: dwrite d1/f12 [0,4194304] 0 2024-04-20T10:54:26.375 INFO:tasks.workunit.client.1.smithi175.stdout:6/154: mknod d1/c3b 0 2024-04-20T10:54:26.375 INFO:tasks.workunit.client.1.smithi175.stdout:6/155: write d1/f16 [304272,12483] 0 2024-04-20T10:54:26.376 INFO:tasks.workunit.client.1.smithi175.stdout:6/156: write d1/d5/f2e [748147,25414] 0 2024-04-20T10:54:26.376 INFO:tasks.workunit.client.1.smithi175.stdout:6/157: dread - d1/d5/d12/f35 zero size 2024-04-20T10:54:26.376 INFO:tasks.workunit.client.1.smithi175.stdout:6/158: write d1/d5/d12/d22/d23/d29/f36 [765656,98551] 0 2024-04-20T10:54:26.377 INFO:tasks.workunit.client.0.smithi090.stdout:5/108: creat d1/de/f22 x:0 0 0 2024-04-20T10:54:26.379 INFO:tasks.workunit.client.1.smithi175.stdout:3/82: truncate d7/d9/fd 460 0 2024-04-20T10:54:26.379 INFO:tasks.workunit.client.1.smithi175.stdout:3/83: truncate d7/fe 842512 0 2024-04-20T10:54:26.379 INFO:tasks.workunit.client.1.smithi175.stdout:3/84: chown f0 1 1 2024-04-20T10:54:26.381 INFO:tasks.workunit.client.1.smithi175.stdout:7/94: dread db/de/d12/f18 [0,4194304] 0 2024-04-20T10:54:26.381 INFO:tasks.workunit.client.1.smithi175.stdout:7/95: chown db/de/c17 110 1 2024-04-20T10:54:26.382 INFO:tasks.workunit.client.1.smithi175.stdout:8/69: rename d7/de to d7/d13 0 2024-04-20T10:54:26.394 INFO:tasks.workunit.client.1.smithi175.stdout:3/85: dread f5 [0,4194304] 0 2024-04-20T10:54:26.394 INFO:tasks.workunit.client.1.smithi175.stdout:5/71: rename l3 to db/l13 0 2024-04-20T10:54:26.398 INFO:tasks.workunit.client.1.smithi175.stdout:0/115: dwrite f0 [0,4194304] 0 2024-04-20T10:54:26.398 INFO:tasks.workunit.client.1.smithi175.stdout:6/159: creat d1/d5/d12/d22/d23/f3c x:0 0 0 2024-04-20T10:54:26.401 INFO:tasks.workunit.client.0.smithi090.stdout:5/109: dwrite d1/de/f22 [0,4194304] 0 2024-04-20T10:54:26.402 INFO:tasks.workunit.client.1.smithi175.stdout:5/72: symlink db/d11/l14 0 2024-04-20T10:54:26.404 INFO:tasks.workunit.client.1.smithi175.stdout:6/160: symlink d1/d37/l3d 0 2024-04-20T10:54:26.405 INFO:tasks.workunit.client.1.smithi175.stdout:6/161: chown d1/d5/c1b 0 1 2024-04-20T10:54:26.405 INFO:tasks.workunit.client.1.smithi175.stdout:7/96: dwrite db/de/d12/f19 [0,4194304] 0 2024-04-20T10:54:26.405 INFO:tasks.workunit.client.0.smithi090.stdout:5/110: creat d1/f23 x:0 0 0 2024-04-20T10:54:26.409 INFO:tasks.workunit.client.1.smithi175.stdout:0/116: rename df/f14 to df/d17/f20 0 2024-04-20T10:54:26.409 INFO:tasks.workunit.client.1.smithi175.stdout:0/117: truncate df/f11 782053 0 2024-04-20T10:54:26.409 INFO:tasks.workunit.client.1.smithi175.stdout:7/97: dread db/de/d12/f18 [0,4194304] 0 2024-04-20T10:54:26.409 INFO:tasks.workunit.client.1.smithi175.stdout:8/70: dwrite d7/d13/f11 [0,4194304] 0 2024-04-20T10:54:26.410 INFO:tasks.workunit.client.1.smithi175.stdout:3/86: dwrite d7/d9/f11 [4194304,4194304] 0 2024-04-20T10:54:26.412 INFO:tasks.workunit.client.1.smithi175.stdout:6/162: creat d1/f3e x:0 0 0 2024-04-20T10:54:26.412 INFO:tasks.workunit.client.0.smithi090.stdout:5/111: write d1/de/f11 [1342124,118840] 0 2024-04-20T10:54:26.413 INFO:tasks.workunit.client.1.smithi175.stdout:0/118: creat df/d19/f21 x:0 0 0 2024-04-20T10:54:26.415 INFO:tasks.workunit.client.1.smithi175.stdout:5/73: truncate db/fe 541993 0 2024-04-20T10:54:26.416 INFO:tasks.workunit.client.1.smithi175.stdout:8/71: creat d7/f14 x:0 0 0 2024-04-20T10:54:26.416 INFO:tasks.workunit.client.1.smithi175.stdout:8/72: dread - d7/f14 zero size 2024-04-20T10:54:26.418 INFO:tasks.workunit.client.0.smithi090.stdout:5/112: dread d1/de/f11 [0,4194304] 0 2024-04-20T10:54:26.419 INFO:tasks.workunit.client.0.smithi090.stdout:5/113: stat d1/da/d14 0 2024-04-20T10:54:26.419 INFO:tasks.workunit.client.0.smithi090.stdout:5/114: chown d1/da/l13 30436 1 2024-04-20T10:54:26.419 INFO:tasks.workunit.client.1.smithi175.stdout:6/163: symlink d1/d5/d12/d22/d23/d29/l3f 0 2024-04-20T10:54:26.419 INFO:tasks.workunit.client.1.smithi175.stdout:0/119: mkdir df/d1a/d22 0 2024-04-20T10:54:26.420 INFO:tasks.workunit.client.1.smithi175.stdout:5/74: symlink db/l15 0 2024-04-20T10:54:26.421 INFO:tasks.workunit.client.1.smithi175.stdout:3/87: write f5 [4655095,17855] 0 2024-04-20T10:54:26.421 INFO:tasks.workunit.client.1.smithi175.stdout:8/73: symlink d7/d13/l15 0 2024-04-20T10:54:26.421 INFO:tasks.workunit.client.1.smithi175.stdout:8/74: chown d7/cb 1065105 1 2024-04-20T10:54:26.422 INFO:tasks.workunit.client.1.smithi175.stdout:8/75: fsync d7/d13/f11 0 2024-04-20T10:54:26.424 INFO:tasks.workunit.client.1.smithi175.stdout:7/98: truncate db/de/d12/f19 823781 0 2024-04-20T10:54:26.425 INFO:tasks.workunit.client.1.smithi175.stdout:5/75: mkdir db/d11/d16 0 2024-04-20T10:54:26.425 INFO:tasks.workunit.client.1.smithi175.stdout:5/76: truncate db/ff 4808135 0 2024-04-20T10:54:26.428 INFO:tasks.workunit.client.1.smithi175.stdout:0/120: write f0 [3980161,15567] 0 2024-04-20T10:54:26.428 INFO:tasks.workunit.client.1.smithi175.stdout:0/121: write f4 [4397727,20385] 0 2024-04-20T10:54:26.432 INFO:tasks.workunit.client.1.smithi175.stdout:3/88: creat d7/f14 x:0 0 0 2024-04-20T10:54:26.433 INFO:tasks.workunit.client.1.smithi175.stdout:8/76: mknod d7/d13/c16 0 2024-04-20T10:54:26.434 INFO:tasks.workunit.client.1.smithi175.stdout:7/99: mknod db/d1d/c1e 0 2024-04-20T10:54:26.435 INFO:tasks.workunit.client.1.smithi175.stdout:6/164: rename d1/d5/d12/d22/d23 to d1/d40 0 2024-04-20T10:54:26.437 INFO:tasks.workunit.client.1.smithi175.stdout:0/122: getdents df/d17 0 2024-04-20T10:54:26.438 INFO:tasks.workunit.client.1.smithi175.stdout:3/89: creat d7/f15 x:0 0 0 2024-04-20T10:54:26.439 INFO:tasks.workunit.client.1.smithi175.stdout:7/100: rename f1 to db/de/f1f 0 2024-04-20T10:54:26.439 INFO:tasks.workunit.client.0.smithi090.stdout:5/115: dread d1/de/f22 [0,4194304] 0 2024-04-20T10:54:26.440 INFO:tasks.workunit.client.1.smithi175.stdout:6/165: mknod d1/d40/c41 0 2024-04-20T10:54:26.440 INFO:tasks.workunit.client.1.smithi175.stdout:6/166: fsync d1/d40/d29/f36 0 2024-04-20T10:54:26.441 INFO:tasks.workunit.client.1.smithi175.stdout:3/90: mkdir d7/d9/d16 0 2024-04-20T10:54:26.447 INFO:tasks.workunit.client.1.smithi175.stdout:5/77: dwrite f2 [0,4194304] 0 2024-04-20T10:54:26.448 INFO:tasks.workunit.client.0.smithi090.stdout:5/116: dread d1/f12 [0,4194304] 0 2024-04-20T10:54:26.449 INFO:tasks.workunit.client.1.smithi175.stdout:7/101: symlink db/de/l20 0 2024-04-20T10:54:26.449 INFO:tasks.workunit.client.1.smithi175.stdout:6/167: link d1/d40/c41 d1/d40/c42 0 2024-04-20T10:54:26.450 INFO:tasks.workunit.client.1.smithi175.stdout:0/123: mknod df/c23 0 2024-04-20T10:54:26.450 INFO:tasks.workunit.client.1.smithi175.stdout:0/124: fsync f5 0 2024-04-20T10:54:26.451 INFO:tasks.workunit.client.1.smithi175.stdout:5/78: creat db/d11/d16/f17 x:0 0 0 2024-04-20T10:54:26.457 INFO:tasks.workunit.client.1.smithi175.stdout:3/91: dwrite d7/f14 [0,4194304] 0 2024-04-20T10:54:26.457 INFO:tasks.workunit.client.1.smithi175.stdout:7/102: rmdir db/de/d12 39 2024-04-20T10:54:26.458 INFO:tasks.workunit.client.1.smithi175.stdout:6/168: rmdir d1 39 2024-04-20T10:54:26.459 INFO:tasks.workunit.client.1.smithi175.stdout:0/125: mkdir df/d1a/d22/d24 0 2024-04-20T10:54:26.461 INFO:tasks.workunit.client.1.smithi175.stdout:5/79: read db/ff [1520972,77422] 0 2024-04-20T10:54:26.463 INFO:tasks.workunit.client.1.smithi175.stdout:3/92: link l4 d7/d10/l17 0 2024-04-20T10:54:26.463 INFO:tasks.workunit.client.1.smithi175.stdout:4/156: sync 2024-04-20T10:54:26.465 INFO:tasks.workunit.client.1.smithi175.stdout:7/103: getdents db 0 2024-04-20T10:54:26.465 INFO:tasks.workunit.client.1.smithi175.stdout:6/169: truncate d1/d5/fa 2945369 0 2024-04-20T10:54:26.465 INFO:tasks.workunit.client.1.smithi175.stdout:6/170: truncate d1/d5/f17 644826 0 2024-04-20T10:54:26.466 INFO:tasks.workunit.client.1.smithi175.stdout:5/80: unlink c4 0 2024-04-20T10:54:26.469 INFO:tasks.workunit.client.1.smithi175.stdout:5/81: dread db/fe [0,4194304] 0 2024-04-20T10:54:26.470 INFO:tasks.workunit.client.1.smithi175.stdout:6/171: dread d1/d5/d12/f14 [0,4194304] 0 2024-04-20T10:54:26.470 INFO:tasks.workunit.client.1.smithi175.stdout:3/93: symlink d7/l18 0 2024-04-20T10:54:26.470 INFO:tasks.workunit.client.1.smithi175.stdout:6/172: write d1/d5/f6 [111705,48092] 0 2024-04-20T10:54:26.471 INFO:tasks.workunit.client.1.smithi175.stdout:4/157: read d4/d27/fa [443525,106882] 0 2024-04-20T10:54:26.471 INFO:tasks.workunit.client.1.smithi175.stdout:4/158: chown d4/dd/d2d 347815486 1 2024-04-20T10:54:26.471 INFO:tasks.workunit.client.1.smithi175.stdout:4/159: read d4/d27/f17 [2028602,112694] 0 2024-04-20T10:54:26.471 INFO:tasks.workunit.client.1.smithi175.stdout:4/160: stat d4/l22 0 2024-04-20T10:54:26.472 INFO:tasks.workunit.client.1.smithi175.stdout:7/104: creat db/de/d12/f21 x:0 0 0 2024-04-20T10:54:26.472 INFO:tasks.workunit.client.1.smithi175.stdout:7/105: chown db/de 113477 1 2024-04-20T10:54:26.472 INFO:tasks.workunit.client.1.smithi175.stdout:7/106: truncate f6 1488059 0 2024-04-20T10:54:26.472 INFO:tasks.workunit.client.1.smithi175.stdout:7/107: chown db/d1d/c1e 57 1 2024-04-20T10:54:26.472 INFO:tasks.workunit.client.1.smithi175.stdout:7/108: chown db/c10 489916979 1 2024-04-20T10:54:26.473 INFO:tasks.workunit.client.1.smithi175.stdout:5/82: rename db/ff to db/d11/d16/f18 0 2024-04-20T10:54:26.474 INFO:tasks.workunit.client.1.smithi175.stdout:6/173: symlink d1/d5/l43 0 2024-04-20T10:54:26.481 INFO:tasks.workunit.client.1.smithi175.stdout:0/126: dwrite df/d17/f18 [0,4194304] 0 2024-04-20T10:54:26.481 INFO:tasks.workunit.client.1.smithi175.stdout:0/127: fsync f3 0 2024-04-20T10:54:26.482 INFO:tasks.workunit.client.1.smithi175.stdout:4/161: truncate d4/d27/f14 2157865 0 2024-04-20T10:54:26.482 INFO:tasks.workunit.client.1.smithi175.stdout:6/174: dread d1/d5/f6 [0,4194304] 0 2024-04-20T10:54:26.482 INFO:tasks.workunit.client.1.smithi175.stdout:6/175: dread - d1/d40/f3c zero size 2024-04-20T10:54:26.483 INFO:tasks.workunit.client.1.smithi175.stdout:4/162: dread d4/f1a [0,4194304] 0 2024-04-20T10:54:26.483 INFO:tasks.workunit.client.1.smithi175.stdout:7/109: unlink db/de/f1f 0 2024-04-20T10:54:26.484 INFO:tasks.workunit.client.1.smithi175.stdout:5/83: creat db/d11/d16/f19 x:0 0 0 2024-04-20T10:54:26.495 INFO:tasks.workunit.client.1.smithi175.stdout:6/176: dread d1/d5/f39 [0,4194304] 0 2024-04-20T10:54:26.495 INFO:tasks.workunit.client.1.smithi175.stdout:6/177: truncate d1/d5/d12/f13 801681 0 2024-04-20T10:54:26.495 INFO:tasks.workunit.client.1.smithi175.stdout:6/178: chown d1/c25 0 1 2024-04-20T10:54:26.497 INFO:tasks.workunit.client.1.smithi175.stdout:7/110: symlink db/l22 0 2024-04-20T10:54:26.519 INFO:tasks.workunit.client.1.smithi175.stdout:4/163: dwrite d4/f12 [0,4194304] 0 2024-04-20T10:54:26.519 INFO:tasks.workunit.client.1.smithi175.stdout:5/84: dwrite f2 [0,4194304] 0 2024-04-20T10:54:26.520 INFO:tasks.workunit.client.1.smithi175.stdout:5/85: chown f2 17165699 1 2024-04-20T10:54:26.520 INFO:tasks.workunit.client.1.smithi175.stdout:5/86: fsync f9 0 2024-04-20T10:54:26.520 INFO:tasks.workunit.client.1.smithi175.stdout:0/128: dwrite f3 [0,4194304] 0 2024-04-20T10:54:26.522 INFO:tasks.workunit.client.1.smithi175.stdout:6/179: dwrite d1/d5/d12/f14 [0,4194304] 0 2024-04-20T10:54:26.522 INFO:tasks.workunit.client.1.smithi175.stdout:6/180: fsync d1/d40/d29/f2f 0 2024-04-20T10:54:26.522 INFO:tasks.workunit.client.1.smithi175.stdout:7/111: dwrite db/f1c [0,4194304] 0 2024-04-20T10:54:26.522 INFO:tasks.workunit.client.1.smithi175.stdout:7/112: chown l4 38 1 2024-04-20T10:54:26.522 INFO:tasks.workunit.client.1.smithi175.stdout:7/113: write db/de/d12/f21 [321641,127824] 0 2024-04-20T10:54:26.528 INFO:tasks.workunit.client.1.smithi175.stdout:5/87: mkdir db/d11/d1a 0 2024-04-20T10:54:26.537 INFO:tasks.workunit.client.1.smithi175.stdout:0/129: write df/f10 [262115,118921] 0 2024-04-20T10:54:26.537 INFO:tasks.workunit.client.1.smithi175.stdout:0/130: chown df/d1a/l1d 81 1 2024-04-20T10:54:26.537 INFO:tasks.workunit.client.1.smithi175.stdout:0/131: stat df/d1a 0 2024-04-20T10:54:26.539 INFO:tasks.workunit.client.1.smithi175.stdout:6/181: dwrite d1/d5/d12/f35 [0,4194304] 0 2024-04-20T10:54:26.541 INFO:tasks.workunit.client.1.smithi175.stdout:4/164: dwrite d4/d27/d25/f29 [0,4194304] 0 2024-04-20T10:54:26.541 INFO:tasks.workunit.client.1.smithi175.stdout:4/165: dread - d4/f1f zero size 2024-04-20T10:54:26.789 INFO:tasks.workunit.client.1.smithi175.stdout:5/88: creat db/f1b x:0 0 0 2024-04-20T10:54:26.789 INFO:tasks.workunit.client.1.smithi175.stdout:0/132: rmdir df/d1a/d22 39 2024-04-20T10:54:26.789 INFO:tasks.workunit.client.1.smithi175.stdout:7/114: rename db/d1d/c1e to db/de/c23 0 2024-04-20T10:54:26.789 INFO:tasks.workunit.client.1.smithi175.stdout:5/89: dread - db/d11/d16/f19 zero size 2024-04-20T10:54:26.789 INFO:tasks.workunit.client.1.smithi175.stdout:5/90: chown ca 2006743640 1 2024-04-20T10:54:26.791 INFO:tasks.workunit.client.1.smithi175.stdout:1/110: sync 2024-04-20T10:54:26.792 INFO:tasks.workunit.client.1.smithi175.stdout:6/182: link d1/f3e d1/d5/d12/d22/f44 0 2024-04-20T10:54:26.792 INFO:tasks.workunit.client.1.smithi175.stdout:2/82: sync 2024-04-20T10:54:26.793 INFO:tasks.workunit.client.1.smithi175.stdout:4/166: getdents d4/d23/d2e 0 2024-04-20T10:54:26.793 INFO:tasks.workunit.client.1.smithi175.stdout:4/167: stat d4/f31 0 2024-04-20T10:54:26.795 INFO:tasks.workunit.client.1.smithi175.stdout:7/115: truncate f2 27829 0 2024-04-20T10:54:26.795 INFO:tasks.workunit.client.1.smithi175.stdout:7/116: chown db 543 1 2024-04-20T10:54:26.798 INFO:tasks.workunit.client.1.smithi175.stdout:6/183: link d1/d5/d12/d24/f30 d1/d5/f45 0 2024-04-20T10:54:26.799 INFO:tasks.workunit.client.1.smithi175.stdout:2/83: rmdir d1/d1a 39 2024-04-20T10:54:26.799 INFO:tasks.workunit.client.1.smithi175.stdout:2/84: read - d1/d13/f19 zero size 2024-04-20T10:54:26.799 INFO:tasks.workunit.client.1.smithi175.stdout:7/117: write db/de/d12/f19 [1281990,48608] 0 2024-04-20T10:54:26.800 INFO:tasks.workunit.client.1.smithi175.stdout:4/168: mkdir d4/d27/d25/d36 0 2024-04-20T10:54:26.802 INFO:tasks.workunit.client.1.smithi175.stdout:7/118: fsync db/de/d12/f19 0 2024-04-20T10:54:26.803 INFO:tasks.workunit.client.1.smithi175.stdout:2/85: mkdir d1/d7/d1e 0 2024-04-20T10:54:26.803 INFO:tasks.workunit.client.1.smithi175.stdout:2/86: dread - d1/f11 zero size 2024-04-20T10:54:26.805 INFO:tasks.workunit.client.1.smithi175.stdout:2/87: mkdir d1/d7/d1f 0 2024-04-20T10:54:26.807 INFO:tasks.workunit.client.1.smithi175.stdout:4/169: symlink d4/d27/l37 0 2024-04-20T10:54:26.808 INFO:tasks.workunit.client.1.smithi175.stdout:3/94: sync 2024-04-20T10:54:26.808 INFO:tasks.workunit.client.1.smithi175.stdout:8/77: sync 2024-04-20T10:54:26.808 INFO:tasks.workunit.client.1.smithi175.stdout:3/95: chown d7/d9 248 1 2024-04-20T10:54:26.808 INFO:tasks.workunit.client.1.smithi175.stdout:3/96: fsync d7/fe 0 2024-04-20T10:54:26.808 INFO:tasks.workunit.client.1.smithi175.stdout:9/142: sync 2024-04-20T10:54:26.808 INFO:tasks.workunit.client.1.smithi175.stdout:4/170: getdents d4/dd 0 2024-04-20T10:54:26.808 INFO:tasks.workunit.client.1.smithi175.stdout:4/171: chown f1 153 1 2024-04-20T10:54:26.811 INFO:tasks.workunit.client.1.smithi175.stdout:8/78: creat d7/d13/f17 x:0 0 0 2024-04-20T10:54:26.811 INFO:tasks.workunit.client.1.smithi175.stdout:8/79: readlink d7/d13/l15 0 2024-04-20T10:54:26.811 INFO:tasks.workunit.client.1.smithi175.stdout:8/80: write d7/f9 [4343050,51897] 0 2024-04-20T10:54:26.811 INFO:tasks.workunit.client.1.smithi175.stdout:8/81: chown d7/d13/c16 51140516 1 2024-04-20T10:54:26.811 INFO:tasks.workunit.client.1.smithi175.stdout:5/91: dwrite db/d11/d16/f17 [0,4194304] 0 2024-04-20T10:54:26.812 INFO:tasks.workunit.client.1.smithi175.stdout:8/82: creat d7/f18 x:0 0 0 2024-04-20T10:54:26.815 INFO:tasks.workunit.client.1.smithi175.stdout:5/92: link db/l13 db/d11/d16/l1c 0 2024-04-20T10:54:26.815 INFO:tasks.workunit.client.1.smithi175.stdout:5/93: readlink db/d11/l12 0 2024-04-20T10:54:26.815 INFO:tasks.workunit.client.1.smithi175.stdout:5/94: fsync db/f1b 0 2024-04-20T10:54:26.816 INFO:tasks.workunit.client.1.smithi175.stdout:8/83: creat d7/f19 x:0 0 0 2024-04-20T10:54:26.816 INFO:tasks.workunit.client.1.smithi175.stdout:8/84: dread - d7/f14 zero size 2024-04-20T10:54:26.818 INFO:tasks.workunit.client.1.smithi175.stdout:8/85: creat d7/d13/f1a x:0 0 0 2024-04-20T10:54:26.818 INFO:tasks.workunit.client.1.smithi175.stdout:8/86: write d7/d13/ff [819414,80411] 0 2024-04-20T10:54:26.818 INFO:tasks.workunit.client.1.smithi175.stdout:8/87: dread - d7/f19 zero size 2024-04-20T10:54:26.818 INFO:tasks.workunit.client.1.smithi175.stdout:8/88: read - d7/d13/f12 zero size 2024-04-20T10:54:26.819 INFO:tasks.workunit.client.1.smithi175.stdout:8/89: creat d7/f1b x:0 0 0 2024-04-20T10:54:26.819 INFO:tasks.workunit.client.1.smithi175.stdout:2/88: dread d1/f6 [0,4194304] 0 2024-04-20T10:54:26.819 INFO:tasks.workunit.client.1.smithi175.stdout:2/89: fdatasync d1/d7/f10 0 2024-04-20T10:54:26.820 INFO:tasks.workunit.client.1.smithi175.stdout:9/143: write d6/f17 [1319145,103650] 0 2024-04-20T10:54:26.821 INFO:tasks.workunit.client.1.smithi175.stdout:6/184: rename d1/d5/d12/d24 to d1/d40/d46 0 2024-04-20T10:54:26.821 INFO:tasks.workunit.client.1.smithi175.stdout:8/90: symlink d7/d13/l1c 0 2024-04-20T10:54:26.822 INFO:tasks.workunit.client.1.smithi175.stdout:2/90: mknod d1/c20 0 2024-04-20T10:54:26.822 INFO:tasks.workunit.client.1.smithi175.stdout:2/91: chown d1/d7/l12 32873511 1 2024-04-20T10:54:26.823 INFO:tasks.workunit.client.1.smithi175.stdout:2/92: chown d1/f5 59 1 2024-04-20T10:54:26.824 INFO:tasks.workunit.client.1.smithi175.stdout:9/144: mkdir d6/d1b/d26 0 2024-04-20T10:54:26.825 INFO:tasks.workunit.client.1.smithi175.stdout:6/185: rmdir d1/d37 39 2024-04-20T10:54:26.825 INFO:tasks.workunit.client.1.smithi175.stdout:6/186: write d1/d5/d12/f1c [675295,84794] 0 2024-04-20T10:54:26.827 INFO:tasks.workunit.client.1.smithi175.stdout:9/145: rename d6/d1b/l1c to d6/d10/l27 0 2024-04-20T10:54:26.828 INFO:tasks.workunit.client.1.smithi175.stdout:6/187: creat d1/d5/d12/f47 x:0 0 0 2024-04-20T10:54:26.828 INFO:tasks.workunit.client.1.smithi175.stdout:1/111: dwrite d0/ff [0,4194304] 0 2024-04-20T10:54:26.829 INFO:tasks.workunit.client.1.smithi175.stdout:3/97: dwrite f0 [0,4194304] 0 2024-04-20T10:54:26.829 INFO:tasks.workunit.client.1.smithi175.stdout:5/95: write db/d11/d16/f17 [3963839,93695] 0 2024-04-20T10:54:26.829 INFO:tasks.workunit.client.1.smithi175.stdout:5/96: fsync db/f1b 0 2024-04-20T10:54:26.829 INFO:tasks.workunit.client.1.smithi175.stdout:5/97: dread - db/d11/d16/f19 zero size 2024-04-20T10:54:26.831 INFO:tasks.workunit.client.1.smithi175.stdout:6/188: rename d1/f9 to d1/d37/f48 0 2024-04-20T10:54:26.832 INFO:tasks.workunit.client.1.smithi175.stdout:4/172: dwrite d4/f12 [0,4194304] 0 2024-04-20T10:54:26.834 INFO:tasks.workunit.client.1.smithi175.stdout:1/112: rename d0/f3 to d0/f23 0 2024-04-20T10:54:26.834 INFO:tasks.workunit.client.1.smithi175.stdout:3/98: mkdir d7/d19 0 2024-04-20T10:54:26.834 INFO:tasks.workunit.client.1.smithi175.stdout:3/99: stat f5 0 2024-04-20T10:54:26.835 INFO:tasks.workunit.client.1.smithi175.stdout:7/119: dwrite db/de/ff [0,4194304] 0 2024-04-20T10:54:26.840 INFO:tasks.workunit.client.1.smithi175.stdout:8/91: fsync d7/d13/f17 0 2024-04-20T10:54:26.840 INFO:tasks.workunit.client.1.smithi175.stdout:8/92: chown d7/f19 72 1 2024-04-20T10:54:26.840 INFO:tasks.workunit.client.1.smithi175.stdout:8/93: readlink d7/d13/l1c 0 2024-04-20T10:54:26.842 INFO:tasks.workunit.client.1.smithi175.stdout:1/113: rename d0/d8/d13/f14 to d0/d8/d13/f24 0 2024-04-20T10:54:26.842 INFO:tasks.workunit.client.1.smithi175.stdout:3/100: mknod d7/c1a 0 2024-04-20T10:54:26.843 INFO:tasks.workunit.client.1.smithi175.stdout:2/93: dwrite d1/f5 [0,4194304] 0 2024-04-20T10:54:26.845 INFO:tasks.workunit.client.1.smithi175.stdout:8/94: mkdir d7/d13/d1d 0 2024-04-20T10:54:26.845 INFO:tasks.workunit.client.1.smithi175.stdout:7/120: dread db/f1c [0,4194304] 0 2024-04-20T10:54:26.846 INFO:tasks.workunit.client.1.smithi175.stdout:1/114: creat d0/f25 x:0 0 0 2024-04-20T10:54:26.850 INFO:tasks.workunit.client.1.smithi175.stdout:2/94: mkdir d1/d1a/d21 0 2024-04-20T10:54:26.850 INFO:tasks.workunit.client.1.smithi175.stdout:1/115: creat d0/d8/d13/f26 x:0 0 0 2024-04-20T10:54:26.850 INFO:tasks.workunit.client.1.smithi175.stdout:2/95: creat d1/d7/f22 x:0 0 0 2024-04-20T10:54:26.850 INFO:tasks.workunit.client.1.smithi175.stdout:1/116: rmdir d0 39 2024-04-20T10:54:26.851 INFO:tasks.workunit.client.1.smithi175.stdout:2/96: rename d1/d7/f10 to d1/d7/d1e/f23 0 2024-04-20T10:54:26.852 INFO:tasks.workunit.client.1.smithi175.stdout:1/117: symlink d0/d8/l27 0 2024-04-20T10:54:26.853 INFO:tasks.workunit.client.1.smithi175.stdout:2/97: creat d1/d13/f24 x:0 0 0 2024-04-20T10:54:26.855 INFO:tasks.workunit.client.1.smithi175.stdout:1/118: creat d0/d8/f28 x:0 0 0 2024-04-20T10:54:26.855 INFO:tasks.workunit.client.1.smithi175.stdout:1/119: chown d0/d8/f1f 0 1 2024-04-20T10:54:26.855 INFO:tasks.workunit.client.1.smithi175.stdout:1/120: write d0/f23 [5352691,21773] 0 2024-04-20T10:54:26.856 INFO:tasks.workunit.client.1.smithi175.stdout:2/98: symlink d1/d7/l25 0 2024-04-20T10:54:26.856 INFO:tasks.workunit.client.1.smithi175.stdout:2/99: readlink d1/d7/l15 0 2024-04-20T10:54:26.857 INFO:tasks.workunit.client.1.smithi175.stdout:1/121: mkdir d0/d29 0 2024-04-20T10:54:26.858 INFO:tasks.workunit.client.1.smithi175.stdout:1/122: readlink d0/l7 0 2024-04-20T10:54:26.860 INFO:tasks.workunit.client.1.smithi175.stdout:8/95: write d7/f9 [3378070,48475] 0 2024-04-20T10:54:26.862 INFO:tasks.workunit.client.1.smithi175.stdout:4/173: dwrite d4/f9 [0,4194304] 0 2024-04-20T10:54:26.862 INFO:tasks.workunit.client.1.smithi175.stdout:4/174: fsync d4/dd/f13 0 2024-04-20T10:54:26.863 INFO:tasks.workunit.client.1.smithi175.stdout:6/189: dwrite d1/d5/d12/f47 [0,4194304] 0 2024-04-20T10:54:26.863 INFO:tasks.workunit.client.1.smithi175.stdout:5/98: dwrite db/d11/d16/f17 [0,4194304] 0 2024-04-20T10:54:26.863 INFO:tasks.workunit.client.1.smithi175.stdout:5/99: fdatasync f9 0 2024-04-20T10:54:26.868 INFO:tasks.workunit.client.1.smithi175.stdout:4/175: creat d4/f38 x:0 0 0 2024-04-20T10:54:26.868 INFO:tasks.workunit.client.1.smithi175.stdout:6/190: mkdir d1/d40/d49 0 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:5/100: symlink db/d11/d1a/l1d 0 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:6/191: mknod d1/c4a 0 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:3/101: read d7/f14 [945922,9172] 0 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:5/101: symlink db/l1e 0 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:5/102: write f2 [4781001,124223] 0 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:5/103: chown c1 2488476 1 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:6/192: creat d1/d40/d29/f4b x:0 0 0 2024-04-20T10:54:26.869 INFO:tasks.workunit.client.1.smithi175.stdout:7/121: dread db/de/d12/f21 [0,4194304] 0 2024-04-20T10:54:26.870 INFO:tasks.workunit.client.1.smithi175.stdout:5/104: rename db/d11/d16 to db/d1f 0 2024-04-20T10:54:26.871 INFO:tasks.workunit.client.1.smithi175.stdout:6/193: unlink d1/d5/fc 0 2024-04-20T10:54:26.872 INFO:tasks.workunit.client.1.smithi175.stdout:7/122: symlink db/d1d/l24 0 2024-04-20T10:54:26.873 INFO:tasks.workunit.client.1.smithi175.stdout:7/123: creat db/de/f25 x:0 0 0 2024-04-20T10:54:26.874 INFO:tasks.workunit.client.1.smithi175.stdout:7/124: rename db/d1d/l24 to db/l26 0 2024-04-20T10:54:26.875 INFO:tasks.workunit.client.1.smithi175.stdout:7/125: mknod db/de/d12/c27 0 2024-04-20T10:54:26.879 INFO:tasks.workunit.client.1.smithi175.stdout:6/194: dread d1/fb [0,4194304] 0 2024-04-20T10:54:26.880 INFO:tasks.workunit.client.1.smithi175.stdout:6/195: chown d1/d40/c41 367486 1 2024-04-20T10:54:26.884 INFO:tasks.workunit.client.1.smithi175.stdout:8/96: write d7/fd [1318339,61310] 0 2024-04-20T10:54:26.890 INFO:tasks.workunit.client.1.smithi175.stdout:7/126: dread db/f1c [0,4194304] 0 2024-04-20T10:54:26.892 INFO:tasks.workunit.client.1.smithi175.stdout:7/127: creat db/de/f28 x:0 0 0 2024-04-20T10:54:26.892 INFO:tasks.workunit.client.1.smithi175.stdout:6/196: read d1/d5/f2d [2014643,110035] 0 2024-04-20T10:54:26.916 INFO:tasks.workunit.client.1.smithi175.stdout:5/105: dwrite db/d1f/f17 [4194304,4194304] 0 2024-04-20T10:54:26.916 INFO:tasks.workunit.client.1.smithi175.stdout:5/106: readlink db/l15 0 2024-04-20T10:54:26.916 INFO:tasks.workunit.client.1.smithi175.stdout:5/107: fsync f2 0 2024-04-20T10:54:26.917 INFO:tasks.workunit.client.1.smithi175.stdout:5/108: write db/fe [24693,49165] 0 2024-04-20T10:54:26.918 INFO:tasks.workunit.client.1.smithi175.stdout:3/102: dwrite d7/d9/fd [0,4194304] 0 2024-04-20T10:54:26.918 INFO:tasks.workunit.client.1.smithi175.stdout:4/176: dwrite d4/f12 [0,4194304] 0 2024-04-20T10:54:26.918 INFO:tasks.workunit.client.1.smithi175.stdout:4/177: write d4/d27/fa [4122697,29885] 0 2024-04-20T10:54:26.919 INFO:tasks.workunit.client.1.smithi175.stdout:2/100: dwrite f0 [0,4194304] 0 2024-04-20T10:54:26.919 INFO:tasks.workunit.client.1.smithi175.stdout:2/101: truncate d1/d13/f24 336780 0 2024-04-20T10:54:26.919 INFO:tasks.workunit.client.1.smithi175.stdout:2/102: chown d1/d7/d1e 3 1 2024-04-20T10:54:26.919 INFO:tasks.workunit.client.1.smithi175.stdout:5/109: creat db/d1f/f20 x:0 0 0 2024-04-20T10:54:26.919 INFO:tasks.workunit.client.1.smithi175.stdout:7/128: write db/fd [1530600,49969] 0 2024-04-20T10:54:26.920 INFO:tasks.workunit.client.1.smithi175.stdout:3/103: getdents d7/d9 0 2024-04-20T10:54:26.921 INFO:tasks.workunit.client.1.smithi175.stdout:8/97: dwrite d7/fd [0,4194304] 0 2024-04-20T10:54:26.922 INFO:tasks.workunit.client.1.smithi175.stdout:4/178: dread d4/d27/f15 [0,4194304] 0 2024-04-20T10:54:26.922 INFO:tasks.workunit.client.1.smithi175.stdout:6/197: dwrite d1/d40/f3c [0,4194304] 0 2024-04-20T10:54:26.922 INFO:tasks.workunit.client.1.smithi175.stdout:4/179: getdents d4/dd 0 2024-04-20T10:54:26.923 INFO:tasks.workunit.client.1.smithi175.stdout:7/129: mkdir db/d1d/d29 0 2024-04-20T10:54:26.923 INFO:tasks.workunit.client.1.smithi175.stdout:7/130: chown f2 919290 1 2024-04-20T10:54:26.925 INFO:tasks.workunit.client.1.smithi175.stdout:6/198: symlink d1/d5/d12/l4c 0 2024-04-20T10:54:26.926 INFO:tasks.workunit.client.1.smithi175.stdout:4/180: chown d4/d27/c1b 508 1 2024-04-20T10:54:26.926 INFO:tasks.workunit.client.1.smithi175.stdout:4/181: stat d4/f20 0 2024-04-20T10:54:26.926 INFO:tasks.workunit.client.1.smithi175.stdout:4/182: write d4/f1f [278551,114371] 0 2024-04-20T10:54:26.927 INFO:tasks.workunit.client.1.smithi175.stdout:7/131: mkdir db/d1d/d29/d2a 0 2024-04-20T10:54:26.927 INFO:tasks.workunit.client.1.smithi175.stdout:7/132: write db/de/ff [4272539,10483] 0 2024-04-20T10:54:26.927 INFO:tasks.workunit.client.1.smithi175.stdout:7/133: read - db/de/f28 zero size 2024-04-20T10:54:26.927 INFO:tasks.workunit.client.1.smithi175.stdout:7/134: read db/fd [1339084,101403] 0 2024-04-20T10:54:26.930 INFO:tasks.workunit.client.1.smithi175.stdout:7/135: mknod db/de/c2b 0 2024-04-20T10:54:26.932 INFO:tasks.workunit.client.1.smithi175.stdout:7/136: mkdir db/de/d2c 0 2024-04-20T10:54:26.933 INFO:tasks.workunit.client.1.smithi175.stdout:7/137: read db/f14 [407601,27166] 0 2024-04-20T10:54:26.939 INFO:tasks.workunit.client.1.smithi175.stdout:6/199: dread d1/d5/f2e [0,4194304] 0 2024-04-20T10:54:26.940 INFO:tasks.workunit.client.1.smithi175.stdout:5/110: dwrite db/d1f/f17 [0,4194304] 0 2024-04-20T10:54:26.940 INFO:tasks.workunit.client.1.smithi175.stdout:5/111: truncate db/fe 740594 0 2024-04-20T10:54:26.940 INFO:tasks.workunit.client.1.smithi175.stdout:6/200: symlink d1/l4d 0 2024-04-20T10:54:26.943 INFO:tasks.workunit.client.1.smithi175.stdout:5/112: link db/l13 db/d11/d1a/l21 0 2024-04-20T10:54:26.945 INFO:tasks.workunit.client.1.smithi175.stdout:6/201: unlink d1/d5/f2d 0 2024-04-20T10:54:26.945 INFO:tasks.workunit.client.1.smithi175.stdout:5/113: truncate f2 1085175 0 2024-04-20T10:54:26.954 INFO:tasks.workunit.client.1.smithi175.stdout:5/114: dread db/d1f/f17 [4194304,4194304] 0 2024-04-20T10:54:26.955 INFO:tasks.workunit.client.1.smithi175.stdout:8/98: dwrite d7/f14 [0,4194304] 0 2024-04-20T10:54:26.955 INFO:tasks.workunit.client.1.smithi175.stdout:5/115: mknod db/c22 0 2024-04-20T10:54:26.955 INFO:tasks.workunit.client.1.smithi175.stdout:5/116: dread - db/f1b zero size 2024-04-20T10:54:26.955 INFO:tasks.workunit.client.1.smithi175.stdout:4/183: dwrite d4/f1a [0,4194304] 0 2024-04-20T10:54:26.955 INFO:tasks.workunit.client.1.smithi175.stdout:4/184: dread - d4/f31 zero size 2024-04-20T10:54:26.956 INFO:tasks.workunit.client.1.smithi175.stdout:7/138: dwrite db/f14 [0,4194304] 0 2024-04-20T10:54:26.956 INFO:tasks.workunit.client.1.smithi175.stdout:7/139: chown db/de/l20 168 1 2024-04-20T10:54:26.956 INFO:tasks.workunit.client.1.smithi175.stdout:7/140: write db/de/f28 [856544,109637] 0 2024-04-20T10:54:26.957 INFO:tasks.workunit.client.1.smithi175.stdout:8/99: rename d7/f9 to d7/d13/d1d/f1e 0 2024-04-20T10:54:26.957 INFO:tasks.workunit.client.1.smithi175.stdout:8/100: fsync d7/d13/f12 0 2024-04-20T10:54:26.958 INFO:tasks.workunit.client.1.smithi175.stdout:8/101: chown d7/f14 7363 1 2024-04-20T10:54:26.958 INFO:tasks.workunit.client.1.smithi175.stdout:4/185: truncate d4/d27/f1c 911970 0 2024-04-20T10:54:26.959 INFO:tasks.workunit.client.1.smithi175.stdout:7/141: creat db/de/d2c/f2d x:0 0 0 2024-04-20T10:54:26.960 INFO:tasks.workunit.client.1.smithi175.stdout:8/102: rmdir d7 39 2024-04-20T10:54:26.960 INFO:tasks.workunit.client.1.smithi175.stdout:6/202: read d1/d40/f3c [1977351,8565] 0 2024-04-20T10:54:26.961 INFO:tasks.workunit.client.1.smithi175.stdout:4/186: rename d4/dd/l26 to d4/d23/d2e/d30/l39 0 2024-04-20T10:54:26.961 INFO:tasks.workunit.client.1.smithi175.stdout:7/142: mknod db/de/d12/c2e 0 2024-04-20T10:54:26.962 INFO:tasks.workunit.client.1.smithi175.stdout:8/103: mknod d7/c1f 0 2024-04-20T10:54:26.962 INFO:tasks.workunit.client.1.smithi175.stdout:8/104: chown d7/d13/f1a 130758955 1 2024-04-20T10:54:26.964 INFO:tasks.workunit.client.1.smithi175.stdout:7/143: creat db/de/d12/f2f x:0 0 0 2024-04-20T10:54:26.965 INFO:tasks.workunit.client.1.smithi175.stdout:8/105: mknod d7/d13/c20 0 2024-04-20T10:54:26.966 INFO:tasks.workunit.client.1.smithi175.stdout:6/203: mkdir d1/d5/d12/d4e 0 2024-04-20T10:54:26.966 INFO:tasks.workunit.client.1.smithi175.stdout:0/133: sync 2024-04-20T10:54:26.966 INFO:tasks.workunit.client.1.smithi175.stdout:0/134: chown cb 573393931 1 2024-04-20T10:54:26.966 INFO:tasks.workunit.client.1.smithi175.stdout:3/104: dread d7/d9/fa [0,4194304] 0 2024-04-20T10:54:26.967 INFO:tasks.workunit.client.1.smithi175.stdout:7/144: creat db/d1d/d29/d2a/f30 x:0 0 0 2024-04-20T10:54:26.967 INFO:tasks.workunit.client.1.smithi175.stdout:8/106: mknod d7/d13/d1d/c21 0 2024-04-20T10:54:26.968 INFO:tasks.workunit.client.1.smithi175.stdout:0/135: symlink df/d19/l25 0 2024-04-20T10:54:26.968 INFO:tasks.workunit.client.1.smithi175.stdout:6/204: creat d1/d40/d46/f4f x:0 0 0 2024-04-20T10:54:26.968 INFO:tasks.workunit.client.1.smithi175.stdout:3/105: mkdir d7/d10/d1b 0 2024-04-20T10:54:26.969 INFO:tasks.workunit.client.1.smithi175.stdout:8/107: rmdir d7/d13/d1d 39 2024-04-20T10:54:26.969 INFO:tasks.workunit.client.1.smithi175.stdout:0/136: fdatasync df/f13 0 2024-04-20T10:54:26.970 INFO:tasks.workunit.client.1.smithi175.stdout:6/205: creat d1/d37/f50 x:0 0 0 2024-04-20T10:54:26.970 INFO:tasks.workunit.client.1.smithi175.stdout:6/206: chown d1/d5/c1b 61 1 2024-04-20T10:54:26.970 INFO:tasks.workunit.client.1.smithi175.stdout:3/106: mkdir d7/d9/d1c 0 2024-04-20T10:54:26.971 INFO:tasks.workunit.client.1.smithi175.stdout:6/207: symlink d1/d37/l51 0 2024-04-20T10:54:26.971 INFO:tasks.workunit.client.1.smithi175.stdout:6/208: dread - d1/f3e zero size 2024-04-20T10:54:26.971 INFO:tasks.workunit.client.1.smithi175.stdout:3/107: mknod d7/d19/c1d 0 2024-04-20T10:54:26.976 INFO:tasks.workunit.client.1.smithi175.stdout:6/209: dread d1/f16 [0,4194304] 0 2024-04-20T10:54:26.976 INFO:tasks.workunit.client.1.smithi175.stdout:7/145: fsync db/fd 0 2024-04-20T10:54:26.977 INFO:tasks.workunit.client.1.smithi175.stdout:5/117: dwrite db/d1f/f20 [0,4194304] 0 2024-04-20T10:54:26.978 INFO:tasks.workunit.client.1.smithi175.stdout:0/137: write f3 [328832,23259] 0 2024-04-20T10:54:26.983 INFO:tasks.workunit.client.1.smithi175.stdout:8/108: getdents d7 0 2024-04-20T10:54:26.985 INFO:tasks.workunit.client.1.smithi175.stdout:8/109: creat d7/d13/f22 x:0 0 0 2024-04-20T10:54:26.986 INFO:tasks.workunit.client.1.smithi175.stdout:3/108: dread d7/f14 [0,4194304] 0 2024-04-20T10:54:26.986 INFO:tasks.workunit.client.1.smithi175.stdout:6/210: dread d1/d40/d29/f2f [0,4194304] 0 2024-04-20T10:54:26.987 INFO:tasks.workunit.client.1.smithi175.stdout:3/109: write d7/f14 [2041007,35587] 0 2024-04-20T10:54:26.987 INFO:tasks.workunit.client.1.smithi175.stdout:6/211: write d1/d5/f6 [830761,97824] 0 2024-04-20T10:54:26.988 INFO:tasks.workunit.client.1.smithi175.stdout:5/118: write db/d1f/f17 [2387013,84038] 0 2024-04-20T10:54:26.988 INFO:tasks.workunit.client.1.smithi175.stdout:5/119: chown l8 149437351 1 2024-04-20T10:54:26.989 INFO:tasks.workunit.client.1.smithi175.stdout:8/110: dread d7/d13/ff [0,4194304] 0 2024-04-20T10:54:26.993 INFO:tasks.workunit.client.1.smithi175.stdout:3/110: unlink f0 0 2024-04-20T10:54:26.997 INFO:tasks.workunit.client.1.smithi175.stdout:3/111: truncate d7/fe 13456 0 2024-04-20T10:54:26.999 INFO:tasks.workunit.client.1.smithi175.stdout:5/120: dread db/d1f/f17 [0,4194304] 0 2024-04-20T10:54:27.000 INFO:tasks.workunit.client.1.smithi175.stdout:5/121: getdents db/d11 0 2024-04-20T10:54:27.001 INFO:tasks.workunit.client.1.smithi175.stdout:5/122: truncate db/d1f/f19 420690 0 2024-04-20T10:54:27.004 INFO:tasks.workunit.client.1.smithi175.stdout:5/123: dread db/d1f/f17 [4194304,4194304] 0 2024-04-20T10:54:27.007 INFO:tasks.workunit.client.1.smithi175.stdout:5/124: rename db/d11/d1a/l1d to db/d11/d1a/l23 0 2024-04-20T10:54:27.010 INFO:tasks.workunit.client.1.smithi175.stdout:3/112: write d7/d9/fb [668823,23863] 0 2024-04-20T10:54:27.010 INFO:tasks.workunit.client.1.smithi175.stdout:5/125: symlink db/d11/d1a/l24 0 2024-04-20T10:54:27.010 INFO:tasks.workunit.client.1.smithi175.stdout:5/126: rmdir db/d11 39 2024-04-20T10:54:27.010 INFO:tasks.workunit.client.1.smithi175.stdout:5/127: read - db/f1b zero size 2024-04-20T10:54:27.011 INFO:tasks.workunit.client.1.smithi175.stdout:7/146: dwrite db/d1d/d29/d2a/f30 [0,4194304] 0 2024-04-20T10:54:27.014 INFO:tasks.workunit.client.1.smithi175.stdout:0/138: dwrite df/f1c [0,4194304] 0 2024-04-20T10:54:27.014 INFO:tasks.workunit.client.1.smithi175.stdout:0/139: write df/f11 [699473,120097] 0 2024-04-20T10:54:27.015 INFO:tasks.workunit.client.1.smithi175.stdout:7/147: link db/l22 db/de/d12/l31 0 2024-04-20T10:54:27.015 INFO:tasks.workunit.client.1.smithi175.stdout:7/148: truncate db/de/d12/f18 5003183 0 2024-04-20T10:54:27.015 INFO:tasks.workunit.client.1.smithi175.stdout:6/212: dwrite d1/d5/f38 [0,4194304] 0 2024-04-20T10:54:27.017 INFO:tasks.workunit.client.1.smithi175.stdout:3/113: write d7/d9/fd [25426,104508] 0 2024-04-20T10:54:27.019 INFO:tasks.workunit.client.1.smithi175.stdout:0/140: truncate df/f10 3738731 0 2024-04-20T10:54:27.021 INFO:tasks.workunit.client.1.smithi175.stdout:8/111: dwrite d7/f14 [0,4194304] 0 2024-04-20T10:54:27.021 INFO:tasks.workunit.client.1.smithi175.stdout:6/213: readlink d1/d5/d12/l20 0 2024-04-20T10:54:27.023 INFO:tasks.workunit.client.1.smithi175.stdout:3/114: rename d7/l18 to d7/l1e 0 2024-04-20T10:54:27.023 INFO:tasks.workunit.client.1.smithi175.stdout:0/141: creat df/d19/f26 x:0 0 0 2024-04-20T10:54:27.025 INFO:tasks.workunit.client.1.smithi175.stdout:8/112: symlink d7/d13/d1d/l23 0 2024-04-20T10:54:27.026 INFO:tasks.workunit.client.1.smithi175.stdout:3/115: write d7/d9/f11 [9043644,8511] 0 2024-04-20T10:54:27.026 INFO:tasks.workunit.client.1.smithi175.stdout:5/128: dwrite db/fe [0,4194304] 0 2024-04-20T10:54:27.027 INFO:tasks.workunit.client.1.smithi175.stdout:5/129: fdatasync db/d1f/f19 0 2024-04-20T10:54:27.027 INFO:tasks.workunit.client.1.smithi175.stdout:5/130: write db/f1b [77438,60129] 0 2024-04-20T10:54:27.027 INFO:tasks.workunit.client.1.smithi175.stdout:8/113: mkdir d7/d13/d1d/d24 0 2024-04-20T10:54:27.028 INFO:tasks.workunit.client.1.smithi175.stdout:6/214: write d1/d5/f39 [969095,33759] 0 2024-04-20T10:54:27.029 INFO:tasks.workunit.client.1.smithi175.stdout:3/116: mkdir d7/d10/d1b/d1f 0 2024-04-20T10:54:27.032 INFO:tasks.workunit.client.1.smithi175.stdout:5/131: dread db/d1f/f17 [0,4194304] 0 2024-04-20T10:54:27.032 INFO:tasks.workunit.client.1.smithi175.stdout:6/215: rename d1/d5/d12/f13 to d1/d5/f52 0 2024-04-20T10:54:27.033 INFO:tasks.workunit.client.1.smithi175.stdout:7/149: dwrite db/de/d12/f19 [0,4194304] 0 2024-04-20T10:54:27.034 INFO:tasks.workunit.client.1.smithi175.stdout:5/132: mkdir db/d11/d25 0 2024-04-20T10:54:27.035 INFO:tasks.workunit.client.1.smithi175.stdout:6/216: unlink d1/d5/d12/f2b 0 2024-04-20T10:54:27.036 INFO:tasks.workunit.client.1.smithi175.stdout:7/150: rmdir db/d1d/d29/d2a 39 2024-04-20T10:54:27.036 INFO:tasks.workunit.client.1.smithi175.stdout:7/151: chown db/de/l20 7 1 2024-04-20T10:54:27.036 INFO:tasks.workunit.client.1.smithi175.stdout:7/152: readlink db/de/l16 0 2024-04-20T10:54:27.037 INFO:tasks.workunit.client.1.smithi175.stdout:6/217: symlink d1/d40/d29/l53 0 2024-04-20T10:54:27.038 INFO:tasks.workunit.client.1.smithi175.stdout:7/153: creat db/de/d2c/f32 x:0 0 0 2024-04-20T10:54:27.038 INFO:tasks.workunit.client.1.smithi175.stdout:6/218: write d1/d5/d12/f1c [1098960,15673] 0 2024-04-20T10:54:27.039 INFO:tasks.workunit.client.1.smithi175.stdout:6/219: chown d1/d40/d46 3920 1 2024-04-20T10:54:27.039 INFO:tasks.workunit.client.1.smithi175.stdout:0/142: dread f0 [0,4194304] 0 2024-04-20T10:54:27.039 INFO:tasks.workunit.client.1.smithi175.stdout:6/220: symlink d1/d40/l54 0 2024-04-20T10:54:27.041 INFO:tasks.workunit.client.1.smithi175.stdout:0/143: creat df/d1a/f27 x:0 0 0 2024-04-20T10:54:27.041 INFO:tasks.workunit.client.1.smithi175.stdout:7/154: read db/de/f28 [183142,113387] 0 2024-04-20T10:54:27.041 INFO:tasks.workunit.client.1.smithi175.stdout:7/155: chown db/de/c23 120294 1 2024-04-20T10:54:27.042 INFO:tasks.workunit.client.1.smithi175.stdout:6/221: unlink d1/d40/d46/f30 0 2024-04-20T10:54:27.042 INFO:tasks.workunit.client.1.smithi175.stdout:6/222: chown d1/c19 107425407 1 2024-04-20T10:54:27.043 INFO:tasks.workunit.client.1.smithi175.stdout:5/133: dread db/d1f/f17 [4194304,4194304] 0 2024-04-20T10:54:27.043 INFO:tasks.workunit.client.1.smithi175.stdout:5/134: getdents db/d11/d25 0 2024-04-20T10:54:27.043 INFO:tasks.workunit.client.1.smithi175.stdout:5/135: chown c1 1162873 1 2024-04-20T10:54:27.043 INFO:tasks.workunit.client.1.smithi175.stdout:0/144: mkdir df/d1a/d28 0 2024-04-20T10:54:27.044 INFO:tasks.workunit.client.1.smithi175.stdout:0/145: fdatasync f0 0 2024-04-20T10:54:27.044 INFO:tasks.workunit.client.1.smithi175.stdout:7/156: symlink db/d1d/l33 0 2024-04-20T10:54:27.044 INFO:tasks.workunit.client.1.smithi175.stdout:4/187: dwrite d4/d27/f2c [0,4194304] 0 2024-04-20T10:54:27.044 INFO:tasks.workunit.client.1.smithi175.stdout:4/188: read - d4/dd/f13 zero size 2024-04-20T10:54:27.045 INFO:tasks.workunit.client.1.smithi175.stdout:0/146: mknod df/d1a/d28/c29 0 2024-04-20T10:54:27.045 INFO:tasks.workunit.client.1.smithi175.stdout:0/147: truncate fe 834835 0 2024-04-20T10:54:27.047 INFO:tasks.workunit.client.1.smithi175.stdout:7/157: rename db/l22 to db/de/d12/l34 0 2024-04-20T10:54:27.051 INFO:tasks.workunit.client.1.smithi175.stdout:0/148: dread f0 [0,4194304] 0 2024-04-20T10:54:27.056 INFO:tasks.workunit.client.1.smithi175.stdout:3/117: dwrite d7/d9/fd [0,4194304] 0 2024-04-20T10:54:27.057 INFO:tasks.workunit.client.1.smithi175.stdout:6/223: getdents d1/d5/d12 0 2024-04-20T10:54:27.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/158: dread db/de/d12/f19 [0,4194304] 0 2024-04-20T10:54:27.060 INFO:tasks.workunit.client.1.smithi175.stdout:0/149: creat df/d17/f2a x:0 0 0 2024-04-20T10:54:27.060 INFO:tasks.workunit.client.1.smithi175.stdout:3/118: getdents d7/d9/d1c 0 2024-04-20T10:54:27.061 INFO:tasks.workunit.client.1.smithi175.stdout:6/224: dread d1/d40/d29/f36 [0,4194304] 0 2024-04-20T10:54:27.062 INFO:tasks.workunit.client.1.smithi175.stdout:7/159: symlink db/l35 0 2024-04-20T10:54:27.062 INFO:tasks.workunit.client.1.smithi175.stdout:4/189: write d4/d27/f2c [2035952,61982] 0 2024-04-20T10:54:27.062 INFO:tasks.workunit.client.1.smithi175.stdout:4/190: fsync d4/dd/f1e 0 2024-04-20T10:54:27.062 INFO:tasks.workunit.client.1.smithi175.stdout:8/114: dwrite d7/d13/f17 [0,4194304] 0 2024-04-20T10:54:27.063 INFO:tasks.workunit.client.1.smithi175.stdout:5/136: dwrite db/d1f/f17 [4194304,4194304] 0 2024-04-20T10:54:27.063 INFO:tasks.workunit.client.1.smithi175.stdout:5/137: getdents db/d11/d25 0 2024-04-20T10:54:27.063 INFO:tasks.workunit.client.1.smithi175.stdout:0/150: rename df/d1a/d28/c29 to df/d1a/c2b 0 2024-04-20T10:54:27.064 INFO:tasks.workunit.client.1.smithi175.stdout:3/119: mkdir d7/d20 0 2024-04-20T10:54:27.069 INFO:tasks.workunit.client.1.smithi175.stdout:6/225: creat d1/d40/d29/f55 x:0 0 0 2024-04-20T10:54:27.069 INFO:tasks.workunit.client.1.smithi175.stdout:7/160: symlink db/d1d/l36 0 2024-04-20T10:54:27.071 INFO:tasks.workunit.client.1.smithi175.stdout:4/191: read d4/f1a [1545348,26002] 0 2024-04-20T10:54:27.072 INFO:tasks.workunit.client.1.smithi175.stdout:8/115: mknod d7/d13/d1d/c25 0 2024-04-20T10:54:27.073 INFO:tasks.workunit.client.1.smithi175.stdout:5/138: creat db/d1f/f26 x:0 0 0 2024-04-20T10:54:27.073 INFO:tasks.workunit.client.1.smithi175.stdout:5/139: fsync db/fe 0 2024-04-20T10:54:27.073 INFO:tasks.workunit.client.1.smithi175.stdout:0/151: symlink df/d1a/d28/l2c 0 2024-04-20T10:54:27.074 INFO:tasks.workunit.client.1.smithi175.stdout:0/152: stat df/d17/f20 0 2024-04-20T10:54:27.074 INFO:tasks.workunit.client.1.smithi175.stdout:5/140: dread db/d1f/f19 [0,4194304] 0 2024-04-20T10:54:27.074 INFO:tasks.workunit.client.1.smithi175.stdout:5/141: fdatasync db/fe 0 2024-04-20T10:54:27.077 INFO:tasks.workunit.client.1.smithi175.stdout:7/161: symlink db/d1d/d29/d2a/l37 0 2024-04-20T10:54:27.077 INFO:tasks.workunit.client.1.smithi175.stdout:4/192: mkdir d4/d23/d2e/d3a 0 2024-04-20T10:54:27.079 INFO:tasks.workunit.client.1.smithi175.stdout:0/153: dread f3 [0,4194304] 0 2024-04-20T10:54:27.079 INFO:tasks.workunit.client.1.smithi175.stdout:0/154: rename df to df/d1a/d22/d2d 22 2024-04-20T10:54:27.079 INFO:tasks.workunit.client.1.smithi175.stdout:0/155: chown df/d1a/c1b 49321 1 2024-04-20T10:54:27.079 INFO:tasks.workunit.client.1.smithi175.stdout:8/116: mkdir d7/d13/d1d/d24/d26 0 2024-04-20T10:54:27.079 INFO:tasks.workunit.client.1.smithi175.stdout:9/146: sync 2024-04-20T10:54:27.079 INFO:tasks.workunit.client.1.smithi175.stdout:3/120: dwrite d7/d9/fd [0,4194304] 0 2024-04-20T10:54:27.086 INFO:tasks.workunit.client.1.smithi175.stdout:7/162: mknod db/de/d12/c38 0 2024-04-20T10:54:27.086 INFO:tasks.workunit.client.1.smithi175.stdout:6/226: creat d1/d5/d12/f56 x:0 0 0 2024-04-20T10:54:27.086 INFO:tasks.workunit.client.1.smithi175.stdout:4/193: symlink d4/l3b 0 2024-04-20T10:54:27.086 INFO:tasks.workunit.client.1.smithi175.stdout:6/227: fdatasync d1/f3e 0 2024-04-20T10:54:27.086 INFO:tasks.workunit.client.1.smithi175.stdout:4/194: readlink d4/d27/l37 0 2024-04-20T10:54:27.086 INFO:tasks.workunit.client.1.smithi175.stdout:4/195: chown d4/d23/c2a 2885 1 2024-04-20T10:54:27.087 INFO:tasks.workunit.client.1.smithi175.stdout:1/123: sync 2024-04-20T10:54:27.087 INFO:tasks.workunit.client.1.smithi175.stdout:2/103: sync 2024-04-20T10:54:27.087 INFO:tasks.workunit.client.1.smithi175.stdout:8/117: truncate d7/d13/f17 2007475 0 2024-04-20T10:54:27.089 INFO:tasks.workunit.client.1.smithi175.stdout:0/156: mkdir df/d2e 0 2024-04-20T10:54:27.089 INFO:tasks.workunit.client.1.smithi175.stdout:0/157: write df/f10 [3589666,39200] 0 2024-04-20T10:54:27.089 INFO:tasks.workunit.client.1.smithi175.stdout:4/196: dread d4/d27/f15 [0,4194304] 0 2024-04-20T10:54:27.090 INFO:tasks.workunit.client.1.smithi175.stdout:7/163: mkdir db/d1d/d39 0 2024-04-20T10:54:27.090 INFO:tasks.workunit.client.1.smithi175.stdout:7/164: fdatasync db/de/f28 0 2024-04-20T10:54:27.091 INFO:tasks.workunit.client.1.smithi175.stdout:4/197: dread d4/f20 [4194304,4194304] 0 2024-04-20T10:54:27.091 INFO:tasks.workunit.client.1.smithi175.stdout:6/228: mknod d1/d40/d49/c57 0 2024-04-20T10:54:27.092 INFO:tasks.workunit.client.1.smithi175.stdout:1/124: creat d0/f2a x:0 0 0 2024-04-20T10:54:27.092 INFO:tasks.workunit.client.1.smithi175.stdout:1/125: write d0/f25 [648907,86259] 0 2024-04-20T10:54:27.093 INFO:tasks.workunit.client.1.smithi175.stdout:2/104: rename d1/d7/d1e/f23 to d1/d7/d1e/f26 0 2024-04-20T10:54:27.096 INFO:tasks.workunit.client.1.smithi175.stdout:0/158: mkdir df/d17/d2f 0 2024-04-20T10:54:27.096 INFO:tasks.workunit.client.1.smithi175.stdout:5/142: truncate db/d1f/f17 4592584 0 2024-04-20T10:54:27.096 INFO:tasks.workunit.client.1.smithi175.stdout:5/143: fdatasync f9 0 2024-04-20T10:54:27.097 INFO:tasks.workunit.client.1.smithi175.stdout:4/198: mkdir d4/dd/d2d/d33/d3c 0 2024-04-20T10:54:27.099 INFO:tasks.workunit.client.1.smithi175.stdout:6/229: getdents d1/d5/d12 0 2024-04-20T10:54:27.099 INFO:tasks.workunit.client.1.smithi175.stdout:6/230: chown d1/c3b 975419 1 2024-04-20T10:54:27.099 INFO:tasks.workunit.client.1.smithi175.stdout:3/121: truncate d7/d9/fd 3819359 0 2024-04-20T10:54:27.100 INFO:tasks.workunit.client.1.smithi175.stdout:9/147: dwrite d6/f20 [0,4194304] 0 2024-04-20T10:54:27.102 INFO:tasks.workunit.client.1.smithi175.stdout:1/126: write d0/fd [2233922,35257] 0 2024-04-20T10:54:27.102 INFO:tasks.workunit.client.1.smithi175.stdout:2/105: creat d1/d1a/f27 x:0 0 0 2024-04-20T10:54:27.102 INFO:tasks.workunit.client.1.smithi175.stdout:0/159: symlink df/d1a/d22/d24/l30 0 2024-04-20T10:54:27.102 INFO:tasks.workunit.client.1.smithi175.stdout:0/160: fdatasync df/d17/f18 0 2024-04-20T10:54:27.102 INFO:tasks.workunit.client.1.smithi175.stdout:0/161: write f1 [5392632,18404] 0 2024-04-20T10:54:27.103 INFO:tasks.workunit.client.1.smithi175.stdout:5/144: creat db/d1f/f27 x:0 0 0 2024-04-20T10:54:27.104 INFO:tasks.workunit.client.1.smithi175.stdout:5/145: chown db/d11/d1a 3 1 2024-04-20T10:54:27.105 INFO:tasks.workunit.client.1.smithi175.stdout:8/118: dwrite d7/d13/f12 [0,4194304] 0 2024-04-20T10:54:27.105 INFO:tasks.workunit.client.1.smithi175.stdout:8/119: truncate d7/f19 959186 0 2024-04-20T10:54:27.105 INFO:tasks.workunit.client.1.smithi175.stdout:4/199: creat d4/dd/d2d/d33/f3d x:0 0 0 2024-04-20T10:54:27.105 INFO:tasks.workunit.client.1.smithi175.stdout:4/200: write d4/dd/d2d/d33/f3d [224307,79481] 0 2024-04-20T10:54:27.105 INFO:tasks.workunit.client.1.smithi175.stdout:4/201: chown d4/dd/d2d/d33 2 1 2024-04-20T10:54:27.106 INFO:tasks.workunit.client.1.smithi175.stdout:6/231: chown d1/d5/f45 248950662 1 2024-04-20T10:54:27.109 INFO:tasks.workunit.client.1.smithi175.stdout:1/127: creat d0/d8/d13/f2b x:0 0 0 2024-04-20T10:54:27.109 INFO:tasks.workunit.client.1.smithi175.stdout:1/128: write d0/fe [1348432,58845] 0 2024-04-20T10:54:27.110 INFO:tasks.workunit.client.1.smithi175.stdout:1/129: dread - d0/f2a zero size 2024-04-20T10:54:27.110 INFO:tasks.workunit.client.1.smithi175.stdout:2/106: truncate f0 5112639 0 2024-04-20T10:54:27.111 INFO:tasks.workunit.client.1.smithi175.stdout:0/162: creat df/d19/f31 x:0 0 0 2024-04-20T10:54:27.111 INFO:tasks.workunit.client.1.smithi175.stdout:0/163: write df/d19/f31 [153194,127823] 0 2024-04-20T10:54:27.113 INFO:tasks.workunit.client.1.smithi175.stdout:8/120: getdents d7/d13/d1d/d24 0 2024-04-20T10:54:27.113 INFO:tasks.workunit.client.1.smithi175.stdout:8/121: fsync d7/f1b 0 2024-04-20T10:54:27.116 INFO:tasks.workunit.client.1.smithi175.stdout:5/146: dread db/d1f/f20 [0,4194304] 0 2024-04-20T10:54:27.116 INFO:tasks.workunit.client.1.smithi175.stdout:7/165: dwrite f6 [0,4194304] 0 2024-04-20T10:54:27.117 INFO:tasks.workunit.client.1.smithi175.stdout:4/202: rename d4/dd/c2f to d4/c3e 0 2024-04-20T10:54:27.117 INFO:tasks.workunit.client.1.smithi175.stdout:6/232: getdents d1/d37 0 2024-04-20T10:54:27.117 INFO:tasks.workunit.client.1.smithi175.stdout:4/203: fdatasync d4/f31 0 2024-04-20T10:54:27.117 INFO:tasks.workunit.client.1.smithi175.stdout:6/233: write d1/d40/d29/f55 [174934,85886] 0 2024-04-20T10:54:27.117 INFO:tasks.workunit.client.1.smithi175.stdout:2/107: getdents d1/d7/d1e 0 2024-04-20T10:54:27.119 INFO:tasks.workunit.client.1.smithi175.stdout:0/164: unlink df/d19/f26 0 2024-04-20T10:54:27.119 INFO:tasks.workunit.client.1.smithi175.stdout:0/165: fdatasync df/f13 0 2024-04-20T10:54:27.119 INFO:tasks.workunit.client.1.smithi175.stdout:0/166: chown df/d17/f2a 24296365 1 2024-04-20T10:54:27.121 INFO:tasks.workunit.client.1.smithi175.stdout:5/147: unlink db/cd 0 2024-04-20T10:54:27.121 INFO:tasks.workunit.client.1.smithi175.stdout:5/148: readlink db/l10 0 2024-04-20T10:54:27.121 INFO:tasks.workunit.client.1.smithi175.stdout:5/149: dread - db/d1f/f27 zero size 2024-04-20T10:54:27.121 INFO:tasks.workunit.client.1.smithi175.stdout:5/150: dread - db/d1f/f26 zero size 2024-04-20T10:54:27.122 INFO:tasks.workunit.client.1.smithi175.stdout:3/122: rmdir d7/d9/d1c 0 2024-04-20T10:54:27.124 INFO:tasks.workunit.client.1.smithi175.stdout:7/166: mknod db/d1d/c3a 0 2024-04-20T10:54:27.125 INFO:tasks.workunit.client.1.smithi175.stdout:4/204: rename d4/f12 to d4/d23/d2e/d3a/f3f 0 2024-04-20T10:54:27.126 INFO:tasks.workunit.client.1.smithi175.stdout:2/108: mknod d1/d13/c28 0 2024-04-20T10:54:27.126 INFO:tasks.workunit.client.1.smithi175.stdout:2/109: readlink d1/d1a/l1c 0 2024-04-20T10:54:27.127 INFO:tasks.workunit.client.1.smithi175.stdout:1/130: dwrite d0/d8/f28 [0,4194304] 0 2024-04-20T10:54:27.131 INFO:tasks.workunit.client.1.smithi175.stdout:5/151: read db/d1f/f20 [2833148,127130] 0 2024-04-20T10:54:27.132 INFO:tasks.workunit.client.1.smithi175.stdout:7/167: symlink db/de/d12/l3b 0 2024-04-20T10:54:27.133 INFO:tasks.workunit.client.1.smithi175.stdout:4/205: mknod d4/c40 0 2024-04-20T10:54:27.136 INFO:tasks.workunit.client.1.smithi175.stdout:1/131: rename d0/d8/l27 to d0/d8/l2c 0 2024-04-20T10:54:27.136 INFO:tasks.workunit.client.1.smithi175.stdout:1/132: dread - d0/d8/d13/f24 zero size 2024-04-20T10:54:27.138 INFO:tasks.workunit.client.1.smithi175.stdout:6/234: dwrite d1/d40/d46/f4f [0,4194304] 0 2024-04-20T10:54:27.138 INFO:tasks.workunit.client.1.smithi175.stdout:5/152: link db/d1f/f19 db/d11/d1a/f28 0 2024-04-20T10:54:27.138 INFO:tasks.workunit.client.1.smithi175.stdout:5/153: write db/d1f/f20 [3662656,71824] 0 2024-04-20T10:54:27.138 INFO:tasks.workunit.client.1.smithi175.stdout:5/154: write db/d1f/f18 [3542840,100621] 0 2024-04-20T10:54:27.139 INFO:tasks.workunit.client.1.smithi175.stdout:7/168: creat db/d1d/d29/f3c x:0 0 0 2024-04-20T10:54:27.139 INFO:tasks.workunit.client.1.smithi175.stdout:7/169: chown db/d1d/d29/f3c 21649757 1 2024-04-20T10:54:27.141 INFO:tasks.workunit.client.1.smithi175.stdout:4/206: link d4/c3e d4/d27/d25/c41 0 2024-04-20T10:54:27.141 INFO:tasks.workunit.client.1.smithi175.stdout:4/207: fdatasync d4/d23/d2e/d3a/f3f 0 2024-04-20T10:54:27.143 INFO:tasks.workunit.client.1.smithi175.stdout:3/123: rename d7/d9 to d7/d21 0 2024-04-20T10:54:27.145 INFO:tasks.workunit.client.1.smithi175.stdout:6/235: rmdir d1/d5/d12/d4e 0 2024-04-20T10:54:27.146 INFO:tasks.workunit.client.1.smithi175.stdout:6/236: dread - d1/f18 zero size 2024-04-20T10:54:27.146 INFO:tasks.workunit.client.1.smithi175.stdout:5/155: rename db/d1f/f26 to db/d1f/f29 0 2024-04-20T10:54:27.146 INFO:tasks.workunit.client.1.smithi175.stdout:5/156: chown ca 46 1 2024-04-20T10:54:27.146 INFO:tasks.workunit.client.1.smithi175.stdout:2/110: dwrite d1/d13/f18 [0,4194304] 0 2024-04-20T10:54:27.147 INFO:tasks.workunit.client.1.smithi175.stdout:7/170: mknod db/de/d2c/c3d 0 2024-04-20T10:54:27.148 INFO:tasks.workunit.client.1.smithi175.stdout:4/208: creat d4/d23/d2e/d30/f42 x:0 0 0 2024-04-20T10:54:27.149 INFO:tasks.workunit.client.1.smithi175.stdout:5/157: creat db/d11/f2a x:0 0 0 2024-04-20T10:54:27.151 INFO:tasks.workunit.client.1.smithi175.stdout:0/167: dwrite df/d17/f20 [0,4194304] 0 2024-04-20T10:54:27.151 INFO:tasks.workunit.client.1.smithi175.stdout:0/168: truncate df/d19/f1e 775589 0 2024-04-20T10:54:27.152 INFO:tasks.workunit.client.1.smithi175.stdout:7/171: creat db/de/f3e x:0 0 0 2024-04-20T10:54:27.152 INFO:tasks.workunit.client.1.smithi175.stdout:3/124: mkdir d7/d21/d16/d22 0 2024-04-20T10:54:27.152 INFO:tasks.workunit.client.1.smithi175.stdout:7/172: write db/de/d12/f2f [22232,67141] 0 2024-04-20T10:54:27.153 INFO:tasks.workunit.client.1.smithi175.stdout:5/158: creat db/d11/d25/f2b x:0 0 0 2024-04-20T10:54:27.153 INFO:tasks.workunit.client.1.smithi175.stdout:5/159: write db/d11/f2a [986580,51551] 0 2024-04-20T10:54:27.155 INFO:tasks.workunit.client.1.smithi175.stdout:3/125: creat d7/d21/d16/f23 x:0 0 0 2024-04-20T10:54:27.156 INFO:tasks.workunit.client.1.smithi175.stdout:0/169: dread df/d19/f31 [0,4194304] 0 2024-04-20T10:54:27.156 INFO:tasks.workunit.client.1.smithi175.stdout:0/170: fdatasync df/f10 0 2024-04-20T10:54:27.157 INFO:tasks.workunit.client.1.smithi175.stdout:5/160: creat db/d11/f2c x:0 0 0 2024-04-20T10:54:27.157 INFO:tasks.workunit.client.1.smithi175.stdout:3/126: getdents d7/d10/d1b 0 2024-04-20T10:54:27.157 INFO:tasks.workunit.client.1.smithi175.stdout:1/133: dwrite d0/ff [0,4194304] 0 2024-04-20T10:54:27.158 INFO:tasks.workunit.client.1.smithi175.stdout:3/127: symlink d7/d19/l24 0 2024-04-20T10:54:27.160 INFO:tasks.workunit.client.1.smithi175.stdout:4/209: write d4/d27/f17 [2649666,46452] 0 2024-04-20T10:54:27.161 INFO:tasks.workunit.client.1.smithi175.stdout:1/134: unlink d0/c15 0 2024-04-20T10:54:27.162 INFO:tasks.workunit.client.1.smithi175.stdout:0/171: link df/d1a/d28/l2c df/l32 0 2024-04-20T10:54:27.163 INFO:tasks.workunit.client.1.smithi175.stdout:4/210: dread d4/dd/d2d/d33/f3d [0,4194304] 0 2024-04-20T10:54:27.164 INFO:tasks.workunit.client.1.smithi175.stdout:4/211: fsync d4/d27/f14 0 2024-04-20T10:54:27.164 INFO:tasks.workunit.client.1.smithi175.stdout:1/135: creat d0/d8/d13/f2d x:0 0 0 2024-04-20T10:54:27.165 INFO:tasks.workunit.client.1.smithi175.stdout:3/128: symlink d7/d21/l25 0 2024-04-20T10:54:27.166 INFO:tasks.workunit.client.1.smithi175.stdout:3/129: fsync d7/d21/fd 0 2024-04-20T10:54:27.166 INFO:tasks.workunit.client.1.smithi175.stdout:1/136: mkdir d0/d8/d13/d2e 0 2024-04-20T10:54:27.170 INFO:tasks.workunit.client.1.smithi175.stdout:3/130: rename d7/d10/l17 to d7/d10/d1b/d1f/l26 0 2024-04-20T10:54:27.170 INFO:tasks.workunit.client.1.smithi175.stdout:1/137: link d0/d8/d13/c16 d0/c2f 0 2024-04-20T10:54:27.173 INFO:tasks.workunit.client.1.smithi175.stdout:5/161: fsync db/d11/f2a 0 2024-04-20T10:54:27.173 INFO:tasks.workunit.client.1.smithi175.stdout:6/237: dwrite d1/d40/f3c [4194304,4194304] 0 2024-04-20T10:54:27.173 INFO:tasks.workunit.client.1.smithi175.stdout:2/111: dwrite d1/f11 [0,4194304] 0 2024-04-20T10:54:27.174 INFO:tasks.workunit.client.1.smithi175.stdout:3/131: symlink d7/d10/d1b/l27 0 2024-04-20T10:54:27.174 INFO:tasks.workunit.client.1.smithi175.stdout:1/138: creat d0/d8/f30 x:0 0 0 2024-04-20T10:54:27.176 INFO:tasks.workunit.client.1.smithi175.stdout:6/238: write d1/d5/f6 [1922449,22532] 0 2024-04-20T10:54:27.178 INFO:tasks.workunit.client.1.smithi175.stdout:3/132: mknod d7/d21/d16/c28 0 2024-04-20T10:54:27.179 INFO:tasks.workunit.client.1.smithi175.stdout:7/173: dwrite f2 [0,4194304] 0 2024-04-20T10:54:27.179 INFO:tasks.workunit.client.1.smithi175.stdout:7/174: readlink db/l35 0 2024-04-20T10:54:27.179 INFO:tasks.workunit.client.1.smithi175.stdout:6/239: creat d1/d40/d46/f58 x:0 0 0 2024-04-20T10:54:27.180 INFO:tasks.workunit.client.1.smithi175.stdout:6/240: fsync d1/d40/d29/f36 0 2024-04-20T10:54:27.183 INFO:tasks.workunit.client.1.smithi175.stdout:0/172: dwrite fe [0,4194304] 0 2024-04-20T10:54:27.185 INFO:tasks.workunit.client.1.smithi175.stdout:3/133: getdents d7/d10/d1b/d1f 0 2024-04-20T10:54:27.189 INFO:tasks.workunit.client.1.smithi175.stdout:6/241: rename d1/c1d to d1/d5/d12/c59 0 2024-04-20T10:54:27.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/134: mknod d7/d10/d1b/c29 0 2024-04-20T10:54:27.192 INFO:tasks.workunit.client.1.smithi175.stdout:6/242: mknod d1/d40/d29/c5a 0 2024-04-20T10:54:27.192 INFO:tasks.workunit.client.1.smithi175.stdout:3/135: stat l4 0 2024-04-20T10:54:27.194 INFO:tasks.workunit.client.1.smithi175.stdout:6/243: symlink d1/d40/l5b 0 2024-04-20T10:54:27.194 INFO:tasks.workunit.client.1.smithi175.stdout:6/244: truncate d1/d40/f3c 9019948 0 2024-04-20T10:54:27.196 INFO:tasks.workunit.client.1.smithi175.stdout:4/212: dwrite d4/d27/f1c [0,4194304] 0 2024-04-20T10:54:27.197 INFO:tasks.workunit.client.1.smithi175.stdout:3/136: mkdir d7/d19/d2a 0 2024-04-20T10:54:27.202 INFO:tasks.workunit.client.1.smithi175.stdout:2/112: dwrite d1/f3 [0,4194304] 0 2024-04-20T10:54:27.203 INFO:tasks.workunit.client.1.smithi175.stdout:2/113: read - d1/d1a/f1b zero size 2024-04-20T10:54:27.203 INFO:tasks.workunit.client.1.smithi175.stdout:3/137: creat d7/d19/d2a/f2b x:0 0 0 2024-04-20T10:54:27.206 INFO:tasks.workunit.client.1.smithi175.stdout:2/114: rename d1/d13 to d1/d1a/d21/d29 0 2024-04-20T10:54:27.207 INFO:tasks.workunit.client.1.smithi175.stdout:3/138: unlink d7/d10/d1b/l27 0 2024-04-20T10:54:27.207 INFO:tasks.workunit.client.1.smithi175.stdout:3/139: dread - d7/d21/d16/f23 zero size 2024-04-20T10:54:27.208 INFO:tasks.workunit.client.1.smithi175.stdout:3/140: stat d7/d19 0 2024-04-20T10:54:27.208 INFO:tasks.workunit.client.1.smithi175.stdout:5/162: dwrite db/d11/f2a [0,4194304] 0 2024-04-20T10:54:27.208 INFO:tasks.workunit.client.1.smithi175.stdout:1/139: dwrite d0/f1a [0,4194304] 0 2024-04-20T10:54:27.209 INFO:tasks.workunit.client.1.smithi175.stdout:0/173: dwrite f4 [4194304,4194304] 0 2024-04-20T10:54:27.210 INFO:tasks.workunit.client.1.smithi175.stdout:6/245: write d1/d40/d46/f4f [351169,66046] 0 2024-04-20T10:54:27.210 INFO:tasks.workunit.client.1.smithi175.stdout:7/175: dwrite f6 [0,4194304] 0 2024-04-20T10:54:27.210 INFO:tasks.workunit.client.1.smithi175.stdout:2/115: link d1/d1a/l1c d1/d7/d1f/l2a 0 2024-04-20T10:54:27.214 INFO:tasks.workunit.client.1.smithi175.stdout:1/140: mknod d0/c31 0 2024-04-20T10:54:27.214 INFO:tasks.workunit.client.1.smithi175.stdout:1/141: write d0/f20 [337570,65950] 0 2024-04-20T10:54:27.215 INFO:tasks.workunit.client.1.smithi175.stdout:4/213: dwrite d4/d23/f32 [0,4194304] 0 2024-04-20T10:54:27.221 INFO:tasks.workunit.client.1.smithi175.stdout:3/141: rename d7/d10/d1b to d7/d21/d16/d22/d2c 0 2024-04-20T10:54:27.221 INFO:tasks.workunit.client.1.smithi175.stdout:3/142: write d7/f15 [860524,72987] 0 2024-04-20T10:54:27.222 INFO:tasks.workunit.client.1.smithi175.stdout:6/246: dread d1/d5/f45 [0,4194304] 0 2024-04-20T10:54:27.223 INFO:tasks.workunit.client.1.smithi175.stdout:2/116: mknod d1/d1a/c2b 0 2024-04-20T10:54:27.224 INFO:tasks.workunit.client.1.smithi175.stdout:7/176: creat db/d1d/d39/f3f x:0 0 0 2024-04-20T10:54:27.224 INFO:tasks.workunit.client.1.smithi175.stdout:1/142: stat d0/c2f 0 2024-04-20T10:54:27.227 INFO:tasks.workunit.client.1.smithi175.stdout:4/214: rename d4/d27/d25/d36 to d4/dd/d2d/d43 0 2024-04-20T10:54:27.228 INFO:tasks.workunit.client.1.smithi175.stdout:3/143: mknod d7/d19/c2d 0 2024-04-20T10:54:27.228 INFO:tasks.workunit.client.1.smithi175.stdout:6/247: symlink d1/d40/d49/l5c 0 2024-04-20T10:54:27.229 INFO:tasks.workunit.client.1.smithi175.stdout:2/117: rmdir d1/d7 39 2024-04-20T10:54:27.229 INFO:tasks.workunit.client.1.smithi175.stdout:2/118: stat d1/d7/d1f 0 2024-04-20T10:54:27.230 INFO:tasks.workunit.client.1.smithi175.stdout:7/177: mknod db/d1d/c40 0 2024-04-20T10:54:27.231 INFO:tasks.workunit.client.1.smithi175.stdout:4/215: mkdir d4/dd/d2d/d33/d3c/d44 0 2024-04-20T10:54:27.232 INFO:tasks.workunit.client.1.smithi175.stdout:4/216: readlink d4/d23/d2e/d30/l39 0 2024-04-20T10:54:27.232 INFO:tasks.workunit.client.1.smithi175.stdout:0/174: dwrite f3 [4194304,4194304] 0 2024-04-20T10:54:27.233 INFO:tasks.workunit.client.1.smithi175.stdout:0/175: dread df/f13 [0,4194304] 0 2024-04-20T10:54:27.234 INFO:tasks.workunit.client.1.smithi175.stdout:4/217: symlink d4/dd/d2d/d33/l45 0 2024-04-20T10:54:27.237 INFO:tasks.workunit.client.1.smithi175.stdout:6/248: unlink d1/d5/f2e 0 2024-04-20T10:54:27.237 INFO:tasks.workunit.client.1.smithi175.stdout:5/163: dwrite f2 [0,4194304] 0 2024-04-20T10:54:27.237 INFO:tasks.workunit.client.1.smithi175.stdout:6/249: chown d1/d40/d46/f4f 1825486411 1 2024-04-20T10:54:27.237 INFO:tasks.workunit.client.1.smithi175.stdout:0/176: symlink df/d1a/d28/l33 0 2024-04-20T10:54:27.238 INFO:tasks.workunit.client.1.smithi175.stdout:4/218: creat d4/d23/d2e/d30/f46 x:0 0 0 2024-04-20T10:54:27.238 INFO:tasks.workunit.client.1.smithi175.stdout:4/219: chown d4/dd/d2d/d33/d3c 1671157 1 2024-04-20T10:54:27.239 INFO:tasks.workunit.client.1.smithi175.stdout:9/148: sync 2024-04-20T10:54:27.239 INFO:tasks.workunit.client.1.smithi175.stdout:8/122: sync 2024-04-20T10:54:27.239 INFO:tasks.workunit.client.1.smithi175.stdout:9/149: chown d6/f17 821817 1 2024-04-20T10:54:27.239 INFO:tasks.workunit.client.1.smithi175.stdout:9/150: write d6/d10/f1a [529379,16586] 0 2024-04-20T10:54:27.239 INFO:tasks.workunit.client.1.smithi175.stdout:9/151: chown d6/c13 4296 1 2024-04-20T10:54:27.240 INFO:tasks.workunit.client.1.smithi175.stdout:6/250: creat d1/d40/d29/f5d x:0 0 0 2024-04-20T10:54:27.241 INFO:tasks.workunit.client.1.smithi175.stdout:0/177: link f0 df/d19/f34 0 2024-04-20T10:54:27.241 INFO:tasks.workunit.client.1.smithi175.stdout:0/178: truncate df/d17/f2a 1039434 0 2024-04-20T10:54:27.242 INFO:tasks.workunit.client.1.smithi175.stdout:4/220: symlink d4/d23/d2e/l47 0 2024-04-20T10:54:27.245 INFO:tasks.workunit.client.1.smithi175.stdout:8/123: link d7/d13/l1c d7/d13/d1d/d24/l27 0 2024-04-20T10:54:27.245 INFO:tasks.workunit.client.1.smithi175.stdout:9/152: creat d6/f28 x:0 0 0 2024-04-20T10:54:27.245 INFO:tasks.workunit.client.1.smithi175.stdout:5/164: dread f2 [0,4194304] 0 2024-04-20T10:54:27.246 INFO:tasks.workunit.client.1.smithi175.stdout:5/165: dread db/d11/d1a/f28 [0,4194304] 0 2024-04-20T10:54:27.246 INFO:tasks.workunit.client.1.smithi175.stdout:5/166: chown db/d11 1958802809 1 2024-04-20T10:54:27.246 INFO:tasks.workunit.client.1.smithi175.stdout:5/167: dread - db/d1f/f27 zero size 2024-04-20T10:54:27.246 INFO:tasks.workunit.client.1.smithi175.stdout:5/168: chown db/d1f/l1c 442 1 2024-04-20T10:54:27.247 INFO:tasks.workunit.client.1.smithi175.stdout:5/169: chown f2 28201 1 2024-04-20T10:54:27.251 INFO:tasks.workunit.client.1.smithi175.stdout:4/221: dread d4/f9 [4194304,4194304] 0 2024-04-20T10:54:27.251 INFO:tasks.workunit.client.1.smithi175.stdout:4/222: dread - d4/d23/d2e/d30/f46 zero size 2024-04-20T10:54:27.252 INFO:tasks.workunit.client.1.smithi175.stdout:3/144: dwrite d7/f12 [0,4194304] 0 2024-04-20T10:54:27.253 INFO:tasks.workunit.client.1.smithi175.stdout:2/119: dwrite d1/d1a/d21/d29/f19 [0,4194304] 0 2024-04-20T10:54:27.253 INFO:tasks.workunit.client.1.smithi175.stdout:2/120: fsync f0 0 2024-04-20T10:54:27.253 INFO:tasks.workunit.client.1.smithi175.stdout:2/121: chown d1/d7/ca 218793 1 2024-04-20T10:54:27.253 INFO:tasks.workunit.client.1.smithi175.stdout:2/122: chown d1/d7/d1e/f26 12457075 1 2024-04-20T10:54:27.256 INFO:tasks.workunit.client.1.smithi175.stdout:1/143: dwrite d0/f5 [0,4194304] 0 2024-04-20T10:54:27.272 INFO:tasks.workunit.client.1.smithi175.stdout:5/170: dwrite db/d11/d1a/f28 [0,4194304] 0 2024-04-20T10:54:27.272 INFO:tasks.workunit.client.1.smithi175.stdout:7/178: dwrite db/de/ff [0,4194304] 0 2024-04-20T10:54:27.272 INFO:tasks.workunit.client.1.smithi175.stdout:7/179: dread - db/d1d/d29/f3c zero size 2024-04-20T10:54:27.287 INFO:tasks.workunit.client.1.smithi175.stdout:5/171: dwrite db/d1f/f20 [0,4194304] 0 2024-04-20T10:54:27.295 INFO:tasks.workunit.client.1.smithi175.stdout:5/172: dread db/d11/d1a/f28 [0,4194304] 0 2024-04-20T10:54:27.501 INFO:tasks.workunit.client.1.smithi175.stdout:8/124: mknod d7/d13/d1d/c28 0 2024-04-20T10:54:27.501 INFO:tasks.workunit.client.1.smithi175.stdout:6/251: write d1/d5/f17 [1279988,55873] 0 2024-04-20T10:54:27.501 INFO:tasks.workunit.client.1.smithi175.stdout:9/153: mknod d6/c29 0 2024-04-20T10:54:27.503 INFO:tasks.workunit.client.1.smithi175.stdout:3/145: creat d7/d21/d16/d22/f2e x:0 0 0 2024-04-20T10:54:27.503 INFO:tasks.workunit.client.1.smithi175.stdout:3/146: write d7/fe [809972,87774] 0 2024-04-20T10:54:27.503 INFO:tasks.workunit.client.1.smithi175.stdout:3/147: dread - d7/d19/d2a/f2b zero size 2024-04-20T10:54:27.504 INFO:tasks.workunit.client.1.smithi175.stdout:2/123: creat d1/d7/d1f/f2c x:0 0 0 2024-04-20T10:54:27.504 INFO:tasks.workunit.client.1.smithi175.stdout:2/124: write d1/d1a/d21/d29/f24 [499818,107258] 0 2024-04-20T10:54:27.505 INFO:tasks.workunit.client.1.smithi175.stdout:1/144: link d0/f25 d0/d29/f32 0 2024-04-20T10:54:27.506 INFO:tasks.workunit.client.1.smithi175.stdout:7/180: rmdir db/d1d/d29 39 2024-04-20T10:54:27.507 INFO:tasks.workunit.client.1.smithi175.stdout:5/173: creat db/d11/f2d x:0 0 0 2024-04-20T10:54:27.508 INFO:tasks.workunit.client.1.smithi175.stdout:1/145: dread d0/d29/f32 [0,4194304] 0 2024-04-20T10:54:27.510 INFO:tasks.workunit.client.1.smithi175.stdout:8/125: rename d7/d13/d1d/c25 to d7/c29 0 2024-04-20T10:54:27.510 INFO:tasks.workunit.client.1.smithi175.stdout:8/126: write d7/d13/f12 [4232299,99826] 0 2024-04-20T10:54:27.511 INFO:tasks.workunit.client.1.smithi175.stdout:8/127: chown d7/d13/c20 818292644 1 2024-04-20T10:54:27.512 INFO:tasks.workunit.client.1.smithi175.stdout:7/181: dread db/fd [0,4194304] 0 2024-04-20T10:54:27.512 INFO:tasks.workunit.client.1.smithi175.stdout:9/154: symlink d6/d1b/d26/l2a 0 2024-04-20T10:54:27.512 INFO:tasks.workunit.client.1.smithi175.stdout:9/155: chown d6/f1d 1131 1 2024-04-20T10:54:27.512 INFO:tasks.workunit.client.1.smithi175.stdout:4/223: getdents d4/d27/d25 0 2024-04-20T10:54:27.515 INFO:tasks.workunit.client.1.smithi175.stdout:5/174: creat db/d11/f2e x:0 0 0 2024-04-20T10:54:27.517 INFO:tasks.workunit.client.1.smithi175.stdout:9/156: creat d6/d1b/d26/f2b x:0 0 0 2024-04-20T10:54:27.518 INFO:tasks.workunit.client.1.smithi175.stdout:4/224: creat d4/dd/d2d/d33/d3c/d44/f48 x:0 0 0 2024-04-20T10:54:27.521 INFO:tasks.workunit.client.1.smithi175.stdout:8/128: write d7/d13/f12 [4088481,83700] 0 2024-04-20T10:54:27.521 INFO:tasks.workunit.client.1.smithi175.stdout:8/129: getdents d7/d13/d1d/d24/d26 0 2024-04-20T10:54:27.522 INFO:tasks.workunit.client.1.smithi175.stdout:8/130: read - d7/f18 zero size 2024-04-20T10:54:27.524 INFO:tasks.workunit.client.1.smithi175.stdout:5/175: link c7 db/c2f 0 2024-04-20T10:54:27.524 INFO:tasks.workunit.client.1.smithi175.stdout:5/176: fdatasync db/d11/d25/f2b 0 2024-04-20T10:54:27.524 INFO:tasks.workunit.client.1.smithi175.stdout:5/177: chown db/d11/d1a 262854 1 2024-04-20T10:54:27.524 INFO:tasks.workunit.client.1.smithi175.stdout:5/178: write db/d11/f2e [445581,126008] 0 2024-04-20T10:54:27.524 INFO:tasks.workunit.client.1.smithi175.stdout:4/225: creat d4/d23/d2e/d30/f49 x:0 0 0 2024-04-20T10:54:27.525 INFO:tasks.workunit.client.1.smithi175.stdout:7/182: dread f2 [0,4194304] 0 2024-04-20T10:54:27.526 INFO:tasks.workunit.client.1.smithi175.stdout:3/148: link d7/d21/fb d7/d21/f2f 0 2024-04-20T10:54:27.526 INFO:tasks.workunit.client.1.smithi175.stdout:3/149: stat d7/d21/d16 0 2024-04-20T10:54:27.527 INFO:tasks.workunit.client.1.smithi175.stdout:6/252: dwrite d1/d40/d29/f4b [0,4194304] 0 2024-04-20T10:54:27.527 INFO:tasks.workunit.client.1.smithi175.stdout:6/253: dread - d1/f3e zero size 2024-04-20T10:54:27.528 INFO:tasks.workunit.client.1.smithi175.stdout:7/183: mkdir db/d1d/d29/d2a/d41 0 2024-04-20T10:54:27.528 INFO:tasks.workunit.client.1.smithi175.stdout:7/184: chown db/f1c 98393 1 2024-04-20T10:54:27.528 INFO:tasks.workunit.client.1.smithi175.stdout:7/185: stat db/c11 0 2024-04-20T10:54:27.530 INFO:tasks.workunit.client.1.smithi175.stdout:2/125: dwrite d1/d1a/f1d [0,4194304] 0 2024-04-20T10:54:27.530 INFO:tasks.workunit.client.1.smithi175.stdout:3/150: symlink d7/d19/l30 0 2024-04-20T10:54:27.533 INFO:tasks.workunit.client.1.smithi175.stdout:6/254: creat d1/d40/f5e x:0 0 0 2024-04-20T10:54:27.535 INFO:tasks.workunit.client.1.smithi175.stdout:7/186: creat db/d1d/f42 x:0 0 0 2024-04-20T10:54:27.535 INFO:tasks.workunit.client.1.smithi175.stdout:7/187: chown db/l35 11352 1 2024-04-20T10:54:27.535 INFO:tasks.workunit.client.1.smithi175.stdout:7/188: stat db/de/d12/c2e 0 2024-04-20T10:54:27.535 INFO:tasks.workunit.client.1.smithi175.stdout:2/126: rmdir d1/d7 39 2024-04-20T10:54:27.536 INFO:tasks.workunit.client.1.smithi175.stdout:6/255: mknod d1/d40/d46/c5f 0 2024-04-20T10:54:27.536 INFO:tasks.workunit.client.1.smithi175.stdout:7/189: getdents db/d1d/d39 0 2024-04-20T10:54:27.538 INFO:tasks.workunit.client.1.smithi175.stdout:2/127: rename d1/d7/l25 to d1/l2d 0 2024-04-20T10:54:27.538 INFO:tasks.workunit.client.1.smithi175.stdout:2/128: chown d1/f6 770877 1 2024-04-20T10:54:27.538 INFO:tasks.workunit.client.1.smithi175.stdout:7/190: rmdir db 39 2024-04-20T10:54:27.538 INFO:tasks.workunit.client.1.smithi175.stdout:7/191: fdatasync db/de/d2c/f2d 0 2024-04-20T10:54:27.539 INFO:tasks.workunit.client.1.smithi175.stdout:2/129: rename d1/d7/l12 to d1/d7/l2e 0 2024-04-20T10:54:27.540 INFO:tasks.workunit.client.1.smithi175.stdout:7/192: mknod db/de/d2c/c43 0 2024-04-20T10:54:27.542 INFO:tasks.workunit.client.1.smithi175.stdout:2/130: link d1/d7/c16 d1/d7/d1f/c2f 0 2024-04-20T10:54:27.545 INFO:tasks.workunit.client.1.smithi175.stdout:8/131: dwrite d7/f1b [0,4194304] 0 2024-04-20T10:54:27.545 INFO:tasks.workunit.client.1.smithi175.stdout:8/132: chown d7/fd 58915 1 2024-04-20T10:54:27.546 INFO:tasks.workunit.client.1.smithi175.stdout:0/179: sync 2024-04-20T10:54:27.546 INFO:tasks.workunit.client.1.smithi175.stdout:0/180: stat df/f13 0 2024-04-20T10:54:27.546 INFO:tasks.workunit.client.1.smithi175.stdout:0/181: chown df 127309651 1 2024-04-20T10:54:27.546 INFO:tasks.workunit.client.1.smithi175.stdout:0/182: getdents df/d2e 0 2024-04-20T10:54:27.547 INFO:tasks.workunit.client.1.smithi175.stdout:9/157: dwrite d6/d1b/f24 [0,4194304] 0 2024-04-20T10:54:27.548 INFO:tasks.workunit.client.1.smithi175.stdout:5/179: dwrite f2 [0,4194304] 0 2024-04-20T10:54:27.550 INFO:tasks.workunit.client.1.smithi175.stdout:8/133: creat d7/d13/d1d/d24/d26/f2a x:0 0 0 2024-04-20T10:54:27.554 INFO:tasks.workunit.client.1.smithi175.stdout:2/131: dread d1/d1a/d21/d29/f19 [0,4194304] 0 2024-04-20T10:54:27.554 INFO:tasks.workunit.client.1.smithi175.stdout:2/132: write d1/f11 [5204347,36939] 0 2024-04-20T10:54:27.554 INFO:tasks.workunit.client.1.smithi175.stdout:2/133: dread - d1/d1a/f27 zero size 2024-04-20T10:54:27.554 INFO:tasks.workunit.client.1.smithi175.stdout:0/183: truncate f4 2524138 0 2024-04-20T10:54:27.555 INFO:tasks.workunit.client.1.smithi175.stdout:5/180: dread db/d1f/f19 [0,4194304] 0 2024-04-20T10:54:27.555 INFO:tasks.workunit.client.1.smithi175.stdout:2/134: mkdir d1/d1a/d30 0 2024-04-20T10:54:27.557 INFO:tasks.workunit.client.1.smithi175.stdout:0/184: symlink df/d17/d2f/l35 0 2024-04-20T10:54:27.558 INFO:tasks.workunit.client.1.smithi175.stdout:5/181: unlink db/fe 0 2024-04-20T10:54:27.558 INFO:tasks.workunit.client.1.smithi175.stdout:5/182: dread - db/d11/f2c zero size 2024-04-20T10:54:27.559 INFO:tasks.workunit.client.1.smithi175.stdout:0/185: creat df/d17/d2f/f36 x:0 0 0 2024-04-20T10:54:27.559 INFO:tasks.workunit.client.1.smithi175.stdout:7/193: dwrite f6 [0,4194304] 0 2024-04-20T10:54:27.560 INFO:tasks.workunit.client.1.smithi175.stdout:5/183: mkdir db/d30 0 2024-04-20T10:54:27.561 INFO:tasks.workunit.client.1.smithi175.stdout:5/184: mkdir db/d1f/d31 0 2024-04-20T10:54:27.564 INFO:tasks.workunit.client.1.smithi175.stdout:2/135: dread f0 [0,4194304] 0 2024-04-20T10:54:27.564 INFO:tasks.workunit.client.1.smithi175.stdout:2/136: truncate d1/d1a/f27 176109 0 2024-04-20T10:54:27.566 INFO:tasks.workunit.client.1.smithi175.stdout:8/134: read d7/d13/f11 [2124190,21368] 0 2024-04-20T10:54:27.567 INFO:tasks.workunit.client.1.smithi175.stdout:6/256: dwrite d1/d40/d29/f36 [0,4194304] 0 2024-04-20T10:54:27.568 INFO:tasks.workunit.client.1.smithi175.stdout:6/257: fsync d1/d5/d12/f14 0 2024-04-20T10:54:27.568 INFO:tasks.workunit.client.1.smithi175.stdout:9/158: dwrite d6/f25 [4194304,4194304] 0 2024-04-20T10:54:27.568 INFO:tasks.workunit.client.1.smithi175.stdout:8/135: rename f5 to d7/d13/d1d/d24/f2b 0 2024-04-20T10:54:27.570 INFO:tasks.workunit.client.1.smithi175.stdout:7/194: dread db/fd [0,4194304] 0 2024-04-20T10:54:27.572 INFO:tasks.workunit.client.1.smithi175.stdout:6/258: mkdir d1/d40/d46/d60 0 2024-04-20T10:54:27.573 INFO:tasks.workunit.client.1.smithi175.stdout:6/259: fsync d1/d5/d12/f35 0 2024-04-20T10:54:27.573 INFO:tasks.workunit.client.1.smithi175.stdout:2/137: dread d1/d1a/d21/d29/f18 [0,4194304] 0 2024-04-20T10:54:27.574 INFO:tasks.workunit.client.1.smithi175.stdout:7/195: symlink db/de/d2c/l44 0 2024-04-20T10:54:27.576 INFO:tasks.workunit.client.1.smithi175.stdout:6/260: creat d1/d37/f61 x:0 0 0 2024-04-20T10:54:27.577 INFO:tasks.workunit.client.1.smithi175.stdout:9/159: dread d6/d10/f1a [0,4194304] 0 2024-04-20T10:54:27.577 INFO:tasks.workunit.client.1.smithi175.stdout:7/196: link db/de/d12/c2e db/d1d/d29/c45 0 2024-04-20T10:54:27.579 INFO:tasks.workunit.client.1.smithi175.stdout:9/160: mknod d6/c2c 0 2024-04-20T10:54:27.580 INFO:tasks.workunit.client.1.smithi175.stdout:7/197: creat db/f46 x:0 0 0 2024-04-20T10:54:27.581 INFO:tasks.workunit.client.1.smithi175.stdout:9/161: rmdir d6 39 2024-04-20T10:54:27.583 INFO:tasks.workunit.client.1.smithi175.stdout:7/198: mkdir db/de/d12/d47 0 2024-04-20T10:54:27.584 INFO:tasks.workunit.client.1.smithi175.stdout:5/185: dwrite db/d11/d25/f2b [0,4194304] 0 2024-04-20T10:54:27.584 INFO:tasks.workunit.client.1.smithi175.stdout:0/186: dwrite df/d19/f31 [0,4194304] 0 2024-04-20T10:54:27.584 INFO:tasks.workunit.client.1.smithi175.stdout:0/187: chown df/d1a/l1d 25 1 2024-04-20T10:54:27.585 INFO:tasks.workunit.client.1.smithi175.stdout:2/138: dread d1/f4 [0,4194304] 0 2024-04-20T10:54:27.585 INFO:tasks.workunit.client.1.smithi175.stdout:7/199: unlink db/de/c15 0 2024-04-20T10:54:27.585 INFO:tasks.workunit.client.1.smithi175.stdout:2/139: chown d1/d1a/d21/d29/f19 0 1 2024-04-20T10:54:27.586 INFO:tasks.workunit.client.1.smithi175.stdout:7/200: chown db/de/d12/d47 705 1 2024-04-20T10:54:27.586 INFO:tasks.workunit.client.1.smithi175.stdout:5/186: creat db/d11/f32 x:0 0 0 2024-04-20T10:54:27.587 INFO:tasks.workunit.client.1.smithi175.stdout:5/187: chown db/d11/l12 107 1 2024-04-20T10:54:27.587 INFO:tasks.workunit.client.1.smithi175.stdout:0/188: mkdir df/d1a/d22/d24/d37 0 2024-04-20T10:54:27.588 INFO:tasks.workunit.client.1.smithi175.stdout:6/261: write d1/fb [2668357,69033] 0 2024-04-20T10:54:27.589 INFO:tasks.workunit.client.1.smithi175.stdout:2/140: rename d1/f5 to d1/d1a/f31 0 2024-04-20T10:54:27.589 INFO:tasks.workunit.client.1.smithi175.stdout:9/162: write d6/f20 [2669406,69538] 0 2024-04-20T10:54:27.590 INFO:tasks.workunit.client.1.smithi175.stdout:7/201: link db/de/d12/c38 db/de/d2c/c48 0 2024-04-20T10:54:27.590 INFO:tasks.workunit.client.1.smithi175.stdout:5/188: creat db/d1f/d31/f33 x:0 0 0 2024-04-20T10:54:27.592 INFO:tasks.workunit.client.1.smithi175.stdout:9/163: chown c4 1618 1 2024-04-20T10:54:27.592 INFO:tasks.workunit.client.1.smithi175.stdout:9/164: readlink d6/lc 0 2024-04-20T10:54:27.593 INFO:tasks.workunit.client.1.smithi175.stdout:7/202: stat db/de/d12/l31 0 2024-04-20T10:54:27.594 INFO:tasks.workunit.client.1.smithi175.stdout:5/189: creat db/d30/f34 x:0 0 0 2024-04-20T10:54:27.596 INFO:tasks.workunit.client.1.smithi175.stdout:9/165: symlink d6/d10/l2d 0 2024-04-20T10:54:27.598 INFO:tasks.workunit.client.1.smithi175.stdout:7/203: creat db/de/d12/d47/f49 x:0 0 0 2024-04-20T10:54:27.598 INFO:tasks.workunit.client.1.smithi175.stdout:7/204: write db/de/f28 [1203063,124192] 0 2024-04-20T10:54:27.599 INFO:tasks.workunit.client.1.smithi175.stdout:9/166: rmdir d6/d10 39 2024-04-20T10:54:27.602 INFO:tasks.workunit.client.1.smithi175.stdout:9/167: getdents d6/d1b 0 2024-04-20T10:54:27.603 INFO:tasks.workunit.client.1.smithi175.stdout:5/190: write f2 [3983134,117040] 0 2024-04-20T10:54:27.603 INFO:tasks.workunit.client.1.smithi175.stdout:5/191: write db/d11/d1a/f28 [5024755,124586] 0 2024-04-20T10:54:27.605 INFO:tasks.workunit.client.1.smithi175.stdout:2/141: rename d1/d1a to d1/d7/d1e/d32 0 2024-04-20T10:54:27.606 INFO:tasks.workunit.client.1.smithi175.stdout:0/189: dwrite df/d17/f20 [0,4194304] 0 2024-04-20T10:54:27.606 INFO:tasks.workunit.client.1.smithi175.stdout:6/262: dwrite d1/d37/f48 [0,4194304] 0 2024-04-20T10:54:27.607 INFO:tasks.workunit.client.1.smithi175.stdout:5/192: rmdir db 39 2024-04-20T10:54:27.609 INFO:tasks.workunit.client.1.smithi175.stdout:2/142: unlink d1/d7/d1f/c2f 0 2024-04-20T10:54:27.610 INFO:tasks.workunit.client.1.smithi175.stdout:0/190: creat df/f38 x:0 0 0 2024-04-20T10:54:27.610 INFO:tasks.workunit.client.1.smithi175.stdout:6/263: write d1/d5/f38 [4454169,12334] 0 2024-04-20T10:54:27.611 INFO:tasks.workunit.client.1.smithi175.stdout:5/193: mkdir db/d1f/d31/d35 0 2024-04-20T10:54:27.611 INFO:tasks.workunit.client.1.smithi175.stdout:5/194: truncate db/d11/f2d 774687 0 2024-04-20T10:54:27.612 INFO:tasks.workunit.client.1.smithi175.stdout:0/191: mknod df/d2e/c39 0 2024-04-20T10:54:27.613 INFO:tasks.workunit.client.1.smithi175.stdout:0/192: creat df/f3a x:0 0 0 2024-04-20T10:54:27.613 INFO:tasks.workunit.client.1.smithi175.stdout:0/193: truncate f5 5014705 0 2024-04-20T10:54:27.615 INFO:tasks.workunit.client.1.smithi175.stdout:0/194: creat df/d19/f3b x:0 0 0 2024-04-20T10:54:27.619 INFO:tasks.workunit.client.1.smithi175.stdout:9/168: dwrite d6/d10/f1a [0,4194304] 0 2024-04-20T10:54:27.619 INFO:tasks.workunit.client.1.smithi175.stdout:9/169: chown d6/f17 9408158 1 2024-04-20T10:54:27.619 INFO:tasks.workunit.client.1.smithi175.stdout:9/170: getdents d6/d1b 0 2024-04-20T10:54:27.631 INFO:tasks.workunit.client.1.smithi175.stdout:5/195: dwrite db/d11/d1a/f28 [4194304,4194304] 0 2024-04-20T10:54:27.632 INFO:tasks.workunit.client.1.smithi175.stdout:5/196: creat db/d11/d1a/f36 x:0 0 0 2024-04-20T10:54:27.633 INFO:tasks.workunit.client.1.smithi175.stdout:5/197: link db/d11/f32 db/d1f/d31/d35/f37 0 2024-04-20T10:54:27.634 INFO:tasks.workunit.client.1.smithi175.stdout:5/198: mkdir db/d11/d25/d38 0 2024-04-20T10:54:27.634 INFO:tasks.workunit.client.1.smithi175.stdout:9/171: dwrite d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:27.635 INFO:tasks.workunit.client.1.smithi175.stdout:5/199: link db/d1f/f29 db/d11/d1a/f39 0 2024-04-20T10:54:27.635 INFO:tasks.workunit.client.1.smithi175.stdout:5/200: chown db/d1f/d31/d35/f37 86 1 2024-04-20T10:54:27.635 INFO:tasks.workunit.client.1.smithi175.stdout:5/201: readlink db/l10 0 2024-04-20T10:54:27.641 INFO:tasks.workunit.client.1.smithi175.stdout:9/172: write d6/fe [2163298,77413] 0 2024-04-20T10:54:27.643 INFO:tasks.workunit.client.1.smithi175.stdout:9/173: truncate d6/d1b/f24 4094790 0 2024-04-20T10:54:27.645 INFO:tasks.workunit.client.1.smithi175.stdout:9/174: rename d6/l14 to d6/d1b/l2e 0 2024-04-20T10:54:27.651 INFO:tasks.workunit.client.1.smithi175.stdout:5/202: dwrite db/d1f/f29 [0,4194304] 0 2024-04-20T10:54:27.653 INFO:tasks.workunit.client.1.smithi175.stdout:5/203: creat db/d1f/d31/f3a x:0 0 0 2024-04-20T10:54:27.663 INFO:tasks.workunit.client.1.smithi175.stdout:9/175: dwrite d6/f17 [0,4194304] 0 2024-04-20T10:54:27.664 INFO:tasks.workunit.client.1.smithi175.stdout:9/176: mkdir d6/d1b/d2f 0 2024-04-20T10:54:27.671 INFO:tasks.workunit.client.1.smithi175.stdout:5/204: dwrite db/d1f/d31/f33 [0,4194304] 0 2024-04-20T10:54:27.683 INFO:tasks.workunit.client.1.smithi175.stdout:9/177: dwrite d6/f1d [0,4194304] 0 2024-04-20T10:54:27.685 INFO:tasks.workunit.client.1.smithi175.stdout:9/178: rename d6/d1b/d26/l2a to d6/d10/l30 0 2024-04-20T10:54:27.687 INFO:tasks.workunit.client.1.smithi175.stdout:9/179: dread f5 [0,4194304] 0 2024-04-20T10:54:27.692 INFO:tasks.workunit.client.1.smithi175.stdout:5/205: dwrite db/d1f/d31/f3a [0,4194304] 0 2024-04-20T10:54:27.692 INFO:tasks.workunit.client.1.smithi175.stdout:5/206: chown db/d1f/f20 241999535 1 2024-04-20T10:54:27.693 INFO:tasks.workunit.client.1.smithi175.stdout:5/207: dread - db/d30/f34 zero size 2024-04-20T10:54:27.694 INFO:tasks.workunit.client.1.smithi175.stdout:5/208: symlink db/d1f/d31/d35/l3b 0 2024-04-20T10:54:27.709 INFO:tasks.workunit.client.1.smithi175.stdout:9/180: dwrite d6/f16 [0,4194304] 0 2024-04-20T10:54:27.709 INFO:tasks.workunit.client.1.smithi175.stdout:5/209: dread db/d1f/d31/f33 [0,4194304] 0 2024-04-20T10:54:27.709 INFO:tasks.workunit.client.1.smithi175.stdout:5/210: readlink db/l13 0 2024-04-20T10:54:27.720 INFO:tasks.workunit.client.1.smithi175.stdout:5/211: dread db/d11/d25/f2b [0,4194304] 0 2024-04-20T10:54:27.722 INFO:tasks.workunit.client.1.smithi175.stdout:5/212: mknod db/d1f/d31/d35/c3c 0 2024-04-20T10:54:27.722 INFO:tasks.workunit.client.1.smithi175.stdout:5/213: write db/d1f/f18 [5693738,80193] 0 2024-04-20T10:54:27.722 INFO:tasks.workunit.client.1.smithi175.stdout:5/214: mknod db/d11/d1a/c3d 0 2024-04-20T10:54:27.724 INFO:tasks.workunit.client.1.smithi175.stdout:5/215: unlink db/d30/f34 0 2024-04-20T10:54:27.725 INFO:tasks.workunit.client.1.smithi175.stdout:5/216: symlink db/d1f/d31/d35/l3e 0 2024-04-20T10:54:27.726 INFO:tasks.workunit.client.1.smithi175.stdout:5/217: stat db/d11/d1a/l23 0 2024-04-20T10:54:27.727 INFO:tasks.workunit.client.1.smithi175.stdout:9/181: dwrite f5 [0,4194304] 0 2024-04-20T10:54:27.727 INFO:tasks.workunit.client.1.smithi175.stdout:9/182: readlink d6/d1b/l2e 0 2024-04-20T10:54:27.727 INFO:tasks.workunit.client.1.smithi175.stdout:9/183: getdents d6/d1b/d2f 0 2024-04-20T10:54:27.727 INFO:tasks.workunit.client.1.smithi175.stdout:9/184: chown d6/l8 7929 1 2024-04-20T10:54:27.727 INFO:tasks.workunit.client.1.smithi175.stdout:9/185: fdatasync d6/d1b/f24 0 2024-04-20T10:54:27.728 INFO:tasks.workunit.client.1.smithi175.stdout:9/186: unlink d6/c12 0 2024-04-20T10:54:27.737 INFO:tasks.workunit.client.1.smithi175.stdout:9/187: dread d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:27.737 INFO:tasks.workunit.client.1.smithi175.stdout:9/188: write f3 [8504411,61660] 0 2024-04-20T10:54:27.737 INFO:tasks.workunit.client.1.smithi175.stdout:9/189: write d6/d10/f1a [4405583,123595] 0 2024-04-20T10:54:27.738 INFO:tasks.workunit.client.1.smithi175.stdout:9/190: mknod d6/d1b/d26/c31 0 2024-04-20T10:54:27.739 INFO:tasks.workunit.client.1.smithi175.stdout:9/191: creat d6/d10/f32 x:0 0 0 2024-04-20T10:54:27.740 INFO:tasks.workunit.client.1.smithi175.stdout:9/192: mkdir d6/d33 0 2024-04-20T10:54:27.740 INFO:tasks.workunit.client.1.smithi175.stdout:9/193: chown c4 44560 1 2024-04-20T10:54:27.740 INFO:tasks.workunit.client.1.smithi175.stdout:5/218: dwrite db/d11/d1a/f39 [0,4194304] 0 2024-04-20T10:54:27.742 INFO:tasks.workunit.client.1.smithi175.stdout:9/194: rename d6/l8 to d6/d1b/d26/l34 0 2024-04-20T10:54:27.742 INFO:tasks.workunit.client.1.smithi175.stdout:9/195: stat d6/d1b/d2f 0 2024-04-20T10:54:27.743 INFO:tasks.workunit.client.1.smithi175.stdout:5/219: symlink db/d11/d25/d38/l3f 0 2024-04-20T10:54:27.753 INFO:tasks.workunit.client.1.smithi175.stdout:9/196: write d6/d1b/f24 [383989,1815] 0 2024-04-20T10:54:27.761 INFO:tasks.workunit.client.1.smithi175.stdout:5/220: dwrite db/d11/d1a/f39 [0,4194304] 0 2024-04-20T10:54:28.004 INFO:tasks.workunit.client.1.smithi175.stdout:9/197: truncate d6/f17 1066334 0 2024-04-20T10:54:28.004 INFO:tasks.workunit.client.1.smithi175.stdout:9/198: chown d6/lc 425601611 1 2024-04-20T10:54:28.005 INFO:tasks.workunit.client.1.smithi175.stdout:5/221: mkdir db/d11/d25/d38/d40 0 2024-04-20T10:54:28.006 INFO:tasks.workunit.client.1.smithi175.stdout:5/222: mkdir db/d11/d25/d41 0 2024-04-20T10:54:28.006 INFO:tasks.workunit.client.1.smithi175.stdout:5/223: rmdir db/d11/d25/d38 39 2024-04-20T10:54:28.007 INFO:tasks.workunit.client.1.smithi175.stdout:5/224: symlink db/d11/d25/d41/l42 0 2024-04-20T10:54:28.007 INFO:tasks.workunit.client.1.smithi175.stdout:5/225: chown db/c2f 16048026 1 2024-04-20T10:54:28.007 INFO:tasks.workunit.client.1.smithi175.stdout:5/226: write f9 [3439275,48548] 0 2024-04-20T10:54:28.012 INFO:tasks.workunit.client.1.smithi175.stdout:5/227: dread db/d1f/f19 [0,4194304] 0 2024-04-20T10:54:28.021 INFO:tasks.workunit.client.1.smithi175.stdout:5/228: write db/d1f/f19 [4195354,59013] 0 2024-04-20T10:54:28.021 INFO:tasks.workunit.client.1.smithi175.stdout:5/229: fdatasync f2 0 2024-04-20T10:54:28.022 INFO:tasks.workunit.client.1.smithi175.stdout:5/230: unlink db/d1f/f19 0 2024-04-20T10:54:28.023 INFO:tasks.workunit.client.1.smithi175.stdout:5/231: creat db/d11/f43 x:0 0 0 2024-04-20T10:54:28.023 INFO:tasks.workunit.client.1.smithi175.stdout:5/232: rmdir db/d11 39 2024-04-20T10:54:28.024 INFO:tasks.workunit.client.1.smithi175.stdout:5/233: write db/d1f/f27 [708304,47811] 0 2024-04-20T10:54:28.024 INFO:tasks.workunit.client.1.smithi175.stdout:5/234: creat db/d1f/d31/d35/f44 x:0 0 0 2024-04-20T10:54:28.025 INFO:tasks.workunit.client.1.smithi175.stdout:5/235: truncate db/d1f/d31/f33 3665885 0 2024-04-20T10:54:28.026 INFO:tasks.workunit.client.1.smithi175.stdout:5/236: link db/d11/d1a/l21 db/d1f/d31/d35/l45 0 2024-04-20T10:54:28.027 INFO:tasks.workunit.client.1.smithi175.stdout:5/237: mkdir db/d30/d46 0 2024-04-20T10:54:28.028 INFO:tasks.workunit.client.1.smithi175.stdout:5/238: mkdir db/d11/d25/d38/d40/d47 0 2024-04-20T10:54:28.040 INFO:tasks.workunit.client.1.smithi175.stdout:5/239: write db/d1f/d31/f33 [684472,94713] 0 2024-04-20T10:54:28.041 INFO:tasks.workunit.client.1.smithi175.stdout:5/240: unlink db/d1f/f17 0 2024-04-20T10:54:28.042 INFO:tasks.workunit.client.1.smithi175.stdout:5/241: symlink db/d1f/d31/d35/l48 0 2024-04-20T10:54:28.043 INFO:tasks.workunit.client.1.smithi175.stdout:5/242: mknod db/d11/d25/d38/c49 0 2024-04-20T10:54:28.059 INFO:tasks.workunit.client.1.smithi175.stdout:5/243: dwrite db/d11/d25/f2b [4194304,4194304] 0 2024-04-20T10:54:28.059 INFO:tasks.workunit.client.1.smithi175.stdout:5/244: write db/d1f/d31/d35/f37 [722971,75444] 0 2024-04-20T10:54:28.060 INFO:tasks.workunit.client.1.smithi175.stdout:5/245: symlink db/d30/d46/l4a 0 2024-04-20T10:54:28.061 INFO:tasks.workunit.client.1.smithi175.stdout:5/246: mkdir db/d30/d46/d4b 0 2024-04-20T10:54:28.061 INFO:tasks.workunit.client.1.smithi175.stdout:5/247: readlink db/l15 0 2024-04-20T10:54:28.073 INFO:tasks.workunit.client.1.smithi175.stdout:8/136: sync 2024-04-20T10:54:28.073 INFO:tasks.workunit.client.1.smithi175.stdout:3/151: sync 2024-04-20T10:54:28.073 INFO:tasks.workunit.client.1.smithi175.stdout:4/226: sync 2024-04-20T10:54:28.073 INFO:tasks.workunit.client.1.smithi175.stdout:1/146: sync 2024-04-20T10:54:28.074 INFO:tasks.workunit.client.1.smithi175.stdout:4/227: chown d4/d23/f32 6659 1 2024-04-20T10:54:28.074 INFO:tasks.workunit.client.1.smithi175.stdout:4/228: write d4/d27/f2c [1500542,17430] 0 2024-04-20T10:54:28.074 INFO:tasks.workunit.client.1.smithi175.stdout:3/152: creat d7/d10/f31 x:0 0 0 2024-04-20T10:54:28.074 INFO:tasks.workunit.client.1.smithi175.stdout:3/153: fsync d7/d21/f11 0 2024-04-20T10:54:28.085 INFO:tasks.workunit.client.1.smithi175.stdout:4/229: link d4/d27/f15 d4/d23/d2e/d3a/f4a 0 2024-04-20T10:54:28.094 INFO:tasks.workunit.client.1.smithi175.stdout:8/137: dwrite d7/d13/d1d/f1e [0,4194304] 0 2024-04-20T10:54:28.096 INFO:tasks.workunit.client.1.smithi175.stdout:4/230: creat d4/dd/d2d/d33/d3c/d44/f4b x:0 0 0 2024-04-20T10:54:28.098 INFO:tasks.workunit.client.1.smithi175.stdout:1/147: dwrite d0/d8/d13/f26 [0,4194304] 0 2024-04-20T10:54:28.098 INFO:tasks.workunit.client.1.smithi175.stdout:1/148: write d0/d8/d13/f2b [251188,16165] 0 2024-04-20T10:54:28.099 INFO:tasks.workunit.client.1.smithi175.stdout:4/231: creat d4/dd/d2d/f4c x:0 0 0 2024-04-20T10:54:28.099 INFO:tasks.workunit.client.1.smithi175.stdout:4/232: truncate d4/dd/d2d/d33/d3c/d44/f4b 601070 0 2024-04-20T10:54:28.099 INFO:tasks.workunit.client.1.smithi175.stdout:4/233: readlink d4/dd/d2d/d33/l45 0 2024-04-20T10:54:28.100 INFO:tasks.workunit.client.1.smithi175.stdout:1/149: mkdir d0/d29/d33 0 2024-04-20T10:54:28.102 INFO:tasks.workunit.client.1.smithi175.stdout:4/234: rename d4/l3b to d4/d23/l4d 0 2024-04-20T10:54:28.105 INFO:tasks.workunit.client.1.smithi175.stdout:1/150: symlink d0/d8/d13/d2e/l34 0 2024-04-20T10:54:28.106 INFO:tasks.workunit.client.1.smithi175.stdout:1/151: chown d0/d8/cb 7403 1 2024-04-20T10:54:28.106 INFO:tasks.workunit.client.1.smithi175.stdout:1/152: write d0/f25 [1727804,10721] 0 2024-04-20T10:54:28.112 INFO:tasks.workunit.client.1.smithi175.stdout:8/138: dwrite d7/d13/d1d/f1e [0,4194304] 0 2024-04-20T10:54:28.112 INFO:tasks.workunit.client.1.smithi175.stdout:1/153: mkdir d0/d8/d13/d2e/d35 0 2024-04-20T10:54:28.112 INFO:tasks.workunit.client.1.smithi175.stdout:1/154: readlink d0/d8/lc 0 2024-04-20T10:54:28.112 INFO:tasks.workunit.client.1.smithi175.stdout:1/155: read - d0/d8/f12 zero size 2024-04-20T10:54:28.114 INFO:tasks.workunit.client.1.smithi175.stdout:1/156: fdatasync d0/f25 0 2024-04-20T10:54:28.114 INFO:tasks.workunit.client.1.smithi175.stdout:8/139: mkdir d7/d2c 0 2024-04-20T10:54:28.115 INFO:tasks.workunit.client.1.smithi175.stdout:8/140: fdatasync d7/d13/f17 0 2024-04-20T10:54:28.115 INFO:tasks.workunit.client.1.smithi175.stdout:1/157: mknod d0/d8/d13/d2e/c36 0 2024-04-20T10:54:28.115 INFO:tasks.workunit.client.1.smithi175.stdout:1/158: chown d0/d8/l2c 217387 1 2024-04-20T10:54:28.115 INFO:tasks.workunit.client.1.smithi175.stdout:1/159: dread - d0/d8/d13/f2d zero size 2024-04-20T10:54:28.115 INFO:tasks.workunit.client.1.smithi175.stdout:1/160: dread - d0/d8/f1f zero size 2024-04-20T10:54:28.116 INFO:tasks.workunit.client.1.smithi175.stdout:1/161: write d0/d8/f30 [184810,7851] 0 2024-04-20T10:54:28.125 INFO:tasks.workunit.client.1.smithi175.stdout:9/199: dwrite d6/fe [0,4194304] 0 2024-04-20T10:54:28.126 INFO:tasks.workunit.client.1.smithi175.stdout:8/141: symlink d7/d2c/l2d 0 2024-04-20T10:54:28.127 INFO:tasks.workunit.client.1.smithi175.stdout:8/142: readlink d7/d13/d1d/l23 0 2024-04-20T10:54:28.127 INFO:tasks.workunit.client.1.smithi175.stdout:9/200: link d6/d10/l19 d6/d1b/d2f/l35 0 2024-04-20T10:54:28.128 INFO:tasks.workunit.client.1.smithi175.stdout:8/143: unlink d7/d13/f1a 0 2024-04-20T10:54:28.129 INFO:tasks.workunit.client.1.smithi175.stdout:8/144: chown d7/d13/d1d/d24/d26 43325 1 2024-04-20T10:54:28.129 INFO:tasks.workunit.client.1.smithi175.stdout:8/145: readlink d7/d13/d1d/l23 0 2024-04-20T10:54:28.129 INFO:tasks.workunit.client.1.smithi175.stdout:8/146: write d7/f19 [225305,90891] 0 2024-04-20T10:54:28.129 INFO:tasks.workunit.client.1.smithi175.stdout:8/147: fsync d7/d13/f17 0 2024-04-20T10:54:28.136 INFO:tasks.workunit.client.1.smithi175.stdout:9/201: dread f5 [0,4194304] 0 2024-04-20T10:54:28.137 INFO:tasks.workunit.client.1.smithi175.stdout:8/148: creat d7/d13/d1d/d24/d26/f2e x:0 0 0 2024-04-20T10:54:28.143 INFO:tasks.workunit.client.1.smithi175.stdout:8/149: dread d7/f19 [0,4194304] 0 2024-04-20T10:54:28.143 INFO:tasks.workunit.client.1.smithi175.stdout:9/202: truncate d6/f1d 3265848 0 2024-04-20T10:54:28.144 INFO:tasks.workunit.client.1.smithi175.stdout:8/150: creat d7/d13/d1d/f2f x:0 0 0 2024-04-20T10:54:28.146 INFO:tasks.workunit.client.1.smithi175.stdout:9/203: link d6/d10/c21 d6/d1b/d26/c36 0 2024-04-20T10:54:28.146 INFO:tasks.workunit.client.1.smithi175.stdout:9/204: truncate d6/f28 320386 0 2024-04-20T10:54:28.146 INFO:tasks.workunit.client.1.smithi175.stdout:9/205: chown d6/d10/l30 0 1 2024-04-20T10:54:28.146 INFO:tasks.workunit.client.1.smithi175.stdout:9/206: write d6/d1b/f24 [4597295,46791] 0 2024-04-20T10:54:28.160 INFO:tasks.workunit.client.1.smithi175.stdout:9/207: dwrite d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:28.160 INFO:tasks.workunit.client.1.smithi175.stdout:9/208: dread d6/f28 [0,4194304] 0 2024-04-20T10:54:28.161 INFO:tasks.workunit.client.1.smithi175.stdout:8/151: creat d7/d13/d1d/d24/d26/f30 x:0 0 0 2024-04-20T10:54:28.161 INFO:tasks.workunit.client.1.smithi175.stdout:8/152: chown d7/d13/f22 6 1 2024-04-20T10:54:28.162 INFO:tasks.workunit.client.1.smithi175.stdout:9/209: symlink d6/d10/l37 0 2024-04-20T10:54:28.162 INFO:tasks.workunit.client.1.smithi175.stdout:9/210: read d6/d1b/f24 [3662826,761] 0 2024-04-20T10:54:28.163 INFO:tasks.workunit.client.1.smithi175.stdout:8/153: rename d7/d13/l1c to d7/d2c/l31 0 2024-04-20T10:54:28.164 INFO:tasks.workunit.client.1.smithi175.stdout:9/211: truncate d6/f20 86187 0 2024-04-20T10:54:28.172 INFO:tasks.workunit.client.1.smithi175.stdout:9/212: dread d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:28.172 INFO:tasks.workunit.client.1.smithi175.stdout:9/213: chown d6/l9 1198489 1 2024-04-20T10:54:28.182 INFO:tasks.workunit.client.1.smithi175.stdout:8/154: rename d7/d13/f11 to d7/d13/f32 0 2024-04-20T10:54:28.188 INFO:tasks.workunit.client.1.smithi175.stdout:9/214: dwrite d6/f16 [0,4194304] 0 2024-04-20T10:54:28.188 INFO:tasks.workunit.client.1.smithi175.stdout:9/215: fsync d6/d10/f1a 0 2024-04-20T10:54:28.192 INFO:tasks.workunit.client.1.smithi175.stdout:8/155: dread d7/f14 [0,4194304] 0 2024-04-20T10:54:28.192 INFO:tasks.workunit.client.1.smithi175.stdout:8/156: write d7/d13/f22 [879849,88351] 0 2024-04-20T10:54:28.195 INFO:tasks.workunit.client.1.smithi175.stdout:8/157: dread d7/d13/f17 [0,4194304] 0 2024-04-20T10:54:28.195 INFO:tasks.workunit.client.1.smithi175.stdout:8/158: stat d7/d2c/l2d 0 2024-04-20T10:54:28.203 INFO:tasks.workunit.client.1.smithi175.stdout:8/159: creat d7/d13/f33 x:0 0 0 2024-04-20T10:54:28.203 INFO:tasks.workunit.client.1.smithi175.stdout:8/160: truncate d7/f14 4564421 0 2024-04-20T10:54:28.477 INFO:tasks.workunit.client.1.smithi175.stdout:8/161: symlink d7/d13/d1d/l34 0 2024-04-20T10:54:28.493 INFO:tasks.workunit.client.1.smithi175.stdout:8/162: dwrite d7/d13/d1d/d24/d26/f2a [0,4194304] 0 2024-04-20T10:54:28.493 INFO:tasks.workunit.client.1.smithi175.stdout:8/163: write d7/d13/f12 [1514247,15936] 0 2024-04-20T10:54:28.509 INFO:tasks.workunit.client.1.smithi175.stdout:8/164: dwrite d7/d13/f22 [0,4194304] 0 2024-04-20T10:54:28.509 INFO:tasks.workunit.client.1.smithi175.stdout:8/165: readlink d7/d13/l15 0 2024-04-20T10:54:28.526 INFO:tasks.workunit.client.1.smithi175.stdout:8/166: dwrite d7/d13/d1d/d24/d26/f30 [0,4194304] 0 2024-04-20T10:54:28.664 INFO:tasks.workunit.client.1.smithi175.stdout:8/167: symlink d7/d13/d1d/d24/d26/l35 0 2024-04-20T10:54:28.679 INFO:tasks.workunit.client.1.smithi175.stdout:2/143: sync 2024-04-20T10:54:28.679 INFO:tasks.workunit.client.1.smithi175.stdout:5/248: sync 2024-04-20T10:54:28.679 INFO:tasks.workunit.client.1.smithi175.stdout:6/264: sync 2024-04-20T10:54:28.679 INFO:tasks.workunit.client.1.smithi175.stdout:0/195: sync 2024-04-20T10:54:28.679 INFO:tasks.workunit.client.1.smithi175.stdout:0/196: write df/d19/f3b [872931,15171] 0 2024-04-20T10:54:28.680 INFO:tasks.workunit.client.1.smithi175.stdout:2/144: creat d1/f33 x:0 0 0 2024-04-20T10:54:28.680 INFO:tasks.workunit.client.1.smithi175.stdout:7/205: sync 2024-04-20T10:54:28.680 INFO:tasks.workunit.client.1.smithi175.stdout:5/249: link db/d1f/d31/d35/f37 db/d1f/d31/f4c 0 2024-04-20T10:54:28.681 INFO:tasks.workunit.client.1.smithi175.stdout:6/265: creat d1/d40/d49/f62 x:0 0 0 2024-04-20T10:54:28.682 INFO:tasks.workunit.client.1.smithi175.stdout:8/168: truncate d7/f14 3283226 0 2024-04-20T10:54:28.683 INFO:tasks.workunit.client.1.smithi175.stdout:2/145: truncate d1/d7/d1e/d32/d21/d29/f18 3628937 0 2024-04-20T10:54:28.684 INFO:tasks.workunit.client.1.smithi175.stdout:7/206: symlink db/d1d/d39/l4a 0 2024-04-20T10:54:28.684 INFO:tasks.workunit.client.1.smithi175.stdout:5/250: write db/d11/d1a/f36 [588052,10201] 0 2024-04-20T10:54:28.685 INFO:tasks.workunit.client.1.smithi175.stdout:6/266: mkdir d1/d40/d63 0 2024-04-20T10:54:28.687 INFO:tasks.workunit.client.1.smithi175.stdout:8/169: symlink d7/l36 0 2024-04-20T10:54:28.688 INFO:tasks.workunit.client.1.smithi175.stdout:7/207: creat db/d1d/d29/d2a/f4b x:0 0 0 2024-04-20T10:54:28.691 INFO:tasks.workunit.client.1.smithi175.stdout:8/170: creat d7/d13/d1d/d24/f37 x:0 0 0 2024-04-20T10:54:28.692 INFO:tasks.workunit.client.1.smithi175.stdout:7/208: symlink db/de/d12/d47/l4c 0 2024-04-20T10:54:28.695 INFO:tasks.workunit.client.1.smithi175.stdout:3/154: sync 2024-04-20T10:54:28.695 INFO:tasks.workunit.client.1.smithi175.stdout:9/216: sync 2024-04-20T10:54:28.695 INFO:tasks.workunit.client.1.smithi175.stdout:9/217: dread - d6/d10/f32 zero size 2024-04-20T10:54:28.695 INFO:tasks.workunit.client.1.smithi175.stdout:4/235: sync 2024-04-20T10:54:28.695 INFO:tasks.workunit.client.1.smithi175.stdout:4/236: write d4/f1a [1526000,123783] 0 2024-04-20T10:54:28.696 INFO:tasks.workunit.client.1.smithi175.stdout:4/237: chown d4/d27/f8 958878708 1 2024-04-20T10:54:28.696 INFO:tasks.workunit.client.1.smithi175.stdout:4/238: read d4/d27/fa [1929830,101611] 0 2024-04-20T10:54:28.696 INFO:tasks.workunit.client.1.smithi175.stdout:1/162: sync 2024-04-20T10:54:28.696 INFO:tasks.workunit.client.1.smithi175.stdout:1/163: truncate d0/d8/f18 2090630 0 2024-04-20T10:54:28.698 INFO:tasks.workunit.client.1.smithi175.stdout:5/251: write db/d11/d1a/f39 [3294394,51595] 0 2024-04-20T10:54:28.698 INFO:tasks.workunit.client.1.smithi175.stdout:5/252: readlink db/l1e 0 2024-04-20T10:54:28.698 INFO:tasks.workunit.client.1.smithi175.stdout:0/197: dwrite df/f38 [0,4194304] 0 2024-04-20T10:54:28.699 INFO:tasks.workunit.client.1.smithi175.stdout:9/218: rmdir d6/d1b/d2f 39 2024-04-20T10:54:28.699 INFO:tasks.workunit.client.1.smithi175.stdout:8/171: mkdir d7/d13/d1d/d24/d38 0 2024-04-20T10:54:28.700 INFO:tasks.workunit.client.1.smithi175.stdout:3/155: symlink d7/d21/d16/l32 0 2024-04-20T10:54:28.701 INFO:tasks.workunit.client.1.smithi175.stdout:4/239: mknod d4/d27/d25/c4e 0 2024-04-20T10:54:28.702 INFO:tasks.workunit.client.1.smithi175.stdout:9/219: dread d6/f17 [0,4194304] 0 2024-04-20T10:54:28.702 INFO:tasks.workunit.client.1.smithi175.stdout:9/220: fsync d6/fe 0 2024-04-20T10:54:28.702 INFO:tasks.workunit.client.1.smithi175.stdout:1/164: creat d0/d8/d13/d2e/d35/f37 x:0 0 0 2024-04-20T10:54:28.703 INFO:tasks.workunit.client.1.smithi175.stdout:5/253: creat db/d30/d46/d4b/f4d x:0 0 0 2024-04-20T10:54:28.705 INFO:tasks.workunit.client.1.smithi175.stdout:8/172: truncate d7/f1b 100324 0 2024-04-20T10:54:28.705 INFO:tasks.workunit.client.1.smithi175.stdout:3/156: getdents d7/d19 0 2024-04-20T10:54:28.706 INFO:tasks.workunit.client.1.smithi175.stdout:4/240: mknod d4/dd/d2d/d33/c4f 0 2024-04-20T10:54:28.707 INFO:tasks.workunit.client.1.smithi175.stdout:9/221: creat d6/d1b/d2f/f38 x:0 0 0 2024-04-20T10:54:28.708 INFO:tasks.workunit.client.1.smithi175.stdout:8/173: mkdir d7/d13/d1d/d24/d39 0 2024-04-20T10:54:28.708 INFO:tasks.workunit.client.1.smithi175.stdout:8/174: write d7/d13/d1d/f2f [361681,18858] 0 2024-04-20T10:54:28.709 INFO:tasks.workunit.client.1.smithi175.stdout:3/157: mkdir d7/d19/d33 0 2024-04-20T10:54:28.709 INFO:tasks.workunit.client.1.smithi175.stdout:7/209: dread db/de/ff [0,4194304] 0 2024-04-20T10:54:28.709 INFO:tasks.workunit.client.1.smithi175.stdout:7/210: chown db/de/ff 2 1 2024-04-20T10:54:28.710 INFO:tasks.workunit.client.1.smithi175.stdout:2/146: dwrite d1/d7/d1e/f26 [0,4194304] 0 2024-04-20T10:54:28.710 INFO:tasks.workunit.client.1.smithi175.stdout:2/147: truncate d1/f33 667569 0 2024-04-20T10:54:28.711 INFO:tasks.workunit.client.1.smithi175.stdout:6/267: dwrite d1/d5/d12/f14 [0,4194304] 0 2024-04-20T10:54:28.712 INFO:tasks.workunit.client.1.smithi175.stdout:5/254: dread db/d1f/f29 [0,4194304] 0 2024-04-20T10:54:28.722 INFO:tasks.workunit.client.1.smithi175.stdout:1/165: dwrite d0/f5 [4194304,4194304] 0 2024-04-20T10:54:28.727 INFO:tasks.workunit.client.1.smithi175.stdout:4/241: creat d4/dd/f50 x:0 0 0 2024-04-20T10:54:28.727 INFO:tasks.workunit.client.1.smithi175.stdout:9/222: creat d6/f39 x:0 0 0 2024-04-20T10:54:28.727 INFO:tasks.workunit.client.1.smithi175.stdout:8/175: getdents d7/d13 0 2024-04-20T10:54:28.727 INFO:tasks.workunit.client.1.smithi175.stdout:3/158: creat d7/d21/d16/d22/d2c/f34 x:0 0 0 2024-04-20T10:54:28.727 INFO:tasks.workunit.client.1.smithi175.stdout:8/176: write d7/d13/d1d/d24/d26/f2a [4404584,21304] 0 2024-04-20T10:54:28.730 INFO:tasks.workunit.client.1.smithi175.stdout:7/211: dwrite db/de/d12/d47/f49 [0,4194304] 0 2024-04-20T10:54:28.745 INFO:tasks.workunit.client.1.smithi175.stdout:6/268: dwrite d1/d40/d29/f4b [0,4194304] 0 2024-04-20T10:54:28.745 INFO:tasks.workunit.client.1.smithi175.stdout:6/269: write d1/d5/d12/f31 [50107,32982] 0 2024-04-20T10:54:28.746 INFO:tasks.workunit.client.1.smithi175.stdout:3/159: dwrite d7/fe [0,4194304] 0 2024-04-20T10:54:28.746 INFO:tasks.workunit.client.1.smithi175.stdout:3/160: chown d7/c1a 892744316 1 2024-04-20T10:54:28.746 INFO:tasks.workunit.client.1.smithi175.stdout:3/161: fsync d7/d21/fb 0 2024-04-20T10:54:28.746 INFO:tasks.workunit.client.1.smithi175.stdout:3/162: truncate d7/d21/d16/d22/f2e 412776 0 2024-04-20T10:54:28.768 INFO:tasks.workunit.client.1.smithi175.stdout:6/270: dwrite d1/d5/d12/d22/f44 [0,4194304] 0 2024-04-20T10:54:28.768 INFO:tasks.workunit.client.1.smithi175.stdout:6/271: chown d1/d40/l54 626 1 2024-04-20T10:54:28.768 INFO:tasks.workunit.client.1.smithi175.stdout:6/272: dread - d1/d5/d12/f56 zero size 2024-04-20T10:54:28.768 INFO:tasks.workunit.client.1.smithi175.stdout:3/163: dwrite d7/d21/fb [0,4194304] 0 2024-04-20T10:54:28.792 INFO:tasks.workunit.client.1.smithi175.stdout:6/273: dwrite d1/d40/d46/f4f [0,4194304] 0 2024-04-20T10:54:28.796 INFO:tasks.workunit.client.1.smithi175.stdout:3/164: dwrite d7/d21/d16/f23 [0,4194304] 0 2024-04-20T10:54:28.982 INFO:tasks.workunit.client.1.smithi175.stdout:2/148: creat d1/d7/f34 x:0 0 0 2024-04-20T10:54:28.982 INFO:tasks.workunit.client.1.smithi175.stdout:5/255: rmdir db/d11/d1a 39 2024-04-20T10:54:28.983 INFO:tasks.workunit.client.1.smithi175.stdout:2/149: chown d1/l2d 31 1 2024-04-20T10:54:28.983 INFO:tasks.workunit.client.1.smithi175.stdout:1/166: link d0/d8/d13/f2d d0/d8/d13/d2e/f38 0 2024-04-20T10:54:28.983 INFO:tasks.workunit.client.1.smithi175.stdout:9/223: rename d6/d10/l19 to d6/d1b/d26/l3a 0 2024-04-20T10:54:28.983 INFO:tasks.workunit.client.1.smithi175.stdout:9/224: fsync d6/fe 0 2024-04-20T10:54:28.983 INFO:tasks.workunit.client.1.smithi175.stdout:2/150: write d1/d7/d1f/f2c [568750,128694] 0 2024-04-20T10:54:28.983 INFO:tasks.workunit.client.1.smithi175.stdout:5/256: dread db/d11/f2d [0,4194304] 0 2024-04-20T10:54:28.983 INFO:tasks.workunit.client.1.smithi175.stdout:7/212: creat db/de/d2c/f4d x:0 0 0 2024-04-20T10:54:28.984 INFO:tasks.workunit.client.1.smithi175.stdout:6/274: mknod d1/d5/d12/d22/c64 0 2024-04-20T10:54:28.990 INFO:tasks.workunit.client.1.smithi175.stdout:3/165: rmdir d7 39 2024-04-20T10:54:28.991 INFO:tasks.workunit.client.1.smithi175.stdout:4/242: symlink d4/d27/l51 0 2024-04-20T10:54:28.992 INFO:tasks.workunit.client.1.smithi175.stdout:8/177: rename d7/d13/d1d/d24/f37 to d7/d13/f3a 0 2024-04-20T10:54:28.993 INFO:tasks.workunit.client.1.smithi175.stdout:1/167: symlink d0/d8/d13/l39 0 2024-04-20T10:54:28.993 INFO:tasks.workunit.client.1.smithi175.stdout:1/168: fsync d0/d29/f32 0 2024-04-20T10:54:28.993 INFO:tasks.workunit.client.1.smithi175.stdout:1/169: chown d0/d8/f1f 9409 1 2024-04-20T10:54:28.993 INFO:tasks.workunit.client.1.smithi175.stdout:9/225: creat d6/d10/f3b x:0 0 0 2024-04-20T10:54:28.994 INFO:tasks.workunit.client.1.smithi175.stdout:7/213: symlink db/d1d/d29/d2a/l4e 0 2024-04-20T10:54:28.995 INFO:tasks.workunit.client.1.smithi175.stdout:6/275: mknod d1/d40/d46/d60/c65 0 2024-04-20T10:54:28.996 INFO:tasks.workunit.client.1.smithi175.stdout:6/276: chown d1/d37/f50 1 1 2024-04-20T10:54:28.996 INFO:tasks.workunit.client.1.smithi175.stdout:4/243: creat d4/d27/f52 x:0 0 0 2024-04-20T10:54:28.998 INFO:tasks.workunit.client.1.smithi175.stdout:4/244: read d4/dd/d2d/d33/f3d [77893,114489] 0 2024-04-20T10:54:28.998 INFO:tasks.workunit.client.1.smithi175.stdout:4/245: write d4/dd/f11 [2096125,32189] 0 2024-04-20T10:54:28.998 INFO:tasks.workunit.client.1.smithi175.stdout:8/178: creat d7/d13/d1d/d24/d39/f3b x:0 0 0 2024-04-20T10:54:28.999 INFO:tasks.workunit.client.1.smithi175.stdout:8/179: stat d7/d13/d1d 0 2024-04-20T10:54:28.999 INFO:tasks.workunit.client.1.smithi175.stdout:8/180: fsync d7/d13/ff 0 2024-04-20T10:54:28.999 INFO:tasks.workunit.client.1.smithi175.stdout:1/170: getdents d0/d8/d13/d2e 0 2024-04-20T10:54:28.999 INFO:tasks.workunit.client.1.smithi175.stdout:7/214: getdents db/d1d/d39 0 2024-04-20T10:54:29.001 INFO:tasks.workunit.client.1.smithi175.stdout:6/277: truncate d1/d5/d12/f47 1455780 0 2024-04-20T10:54:29.001 INFO:tasks.workunit.client.1.smithi175.stdout:5/257: dread db/d11/d1a/f28 [0,4194304] 0 2024-04-20T10:54:29.001 INFO:tasks.workunit.client.1.smithi175.stdout:3/166: mkdir d7/d19/d35 0 2024-04-20T10:54:29.001 INFO:tasks.workunit.client.1.smithi175.stdout:3/167: truncate d7/d21/d16/d22/f2e 942957 0 2024-04-20T10:54:29.001 INFO:tasks.workunit.client.1.smithi175.stdout:1/171: write d0/f25 [410701,87204] 0 2024-04-20T10:54:29.002 INFO:tasks.workunit.client.1.smithi175.stdout:1/172: dread - d0/d8/f1f zero size 2024-04-20T10:54:29.002 INFO:tasks.workunit.client.1.smithi175.stdout:4/246: rename d4/dd/d2d/d33/d3c/d44/f4b to d4/dd/f53 0 2024-04-20T10:54:29.003 INFO:tasks.workunit.client.1.smithi175.stdout:6/278: creat d1/d37/f66 x:0 0 0 2024-04-20T10:54:29.003 INFO:tasks.workunit.client.1.smithi175.stdout:6/279: fdatasync d1/d37/f66 0 2024-04-20T10:54:29.003 INFO:tasks.workunit.client.1.smithi175.stdout:5/258: unlink db/d11/f32 0 2024-04-20T10:54:29.004 INFO:tasks.workunit.client.1.smithi175.stdout:2/151: dwrite d1/f3 [0,4194304] 0 2024-04-20T10:54:29.005 INFO:tasks.workunit.client.1.smithi175.stdout:4/247: dread d4/f20 [0,4194304] 0 2024-04-20T10:54:29.005 INFO:tasks.workunit.client.1.smithi175.stdout:4/248: getdents d4/dd/d2d/d43 0 2024-04-20T10:54:29.005 INFO:tasks.workunit.client.1.smithi175.stdout:4/249: chown d4/d27/l37 14551854 1 2024-04-20T10:54:29.005 INFO:tasks.workunit.client.1.smithi175.stdout:3/168: mknod d7/d21/d16/c36 0 2024-04-20T10:54:29.005 INFO:tasks.workunit.client.1.smithi175.stdout:3/169: dread - d7/d21/d16/d22/d2c/f34 zero size 2024-04-20T10:54:29.005 INFO:tasks.workunit.client.1.smithi175.stdout:3/170: chown d7/d21/d16/c36 287634250 1 2024-04-20T10:54:29.007 INFO:tasks.workunit.client.1.smithi175.stdout:8/181: rename d7/d13/d1d/d24/d26/f30 to d7/d2c/f3c 0 2024-04-20T10:54:29.007 INFO:tasks.workunit.client.1.smithi175.stdout:8/182: chown d7/d13/c16 485268 1 2024-04-20T10:54:29.007 INFO:tasks.workunit.client.1.smithi175.stdout:8/183: readlink d7/d13/l15 0 2024-04-20T10:54:29.007 INFO:tasks.workunit.client.1.smithi175.stdout:9/226: write d6/f16 [2886018,112063] 0 2024-04-20T10:54:29.007 INFO:tasks.workunit.client.1.smithi175.stdout:6/280: creat d1/d40/d29/f67 x:0 0 0 2024-04-20T10:54:29.008 INFO:tasks.workunit.client.1.smithi175.stdout:6/281: read - d1/d40/d49/f62 zero size 2024-04-20T10:54:29.009 INFO:tasks.workunit.client.1.smithi175.stdout:7/215: rename db/de/c23 to db/d1d/d29/d2a/c4f 0 2024-04-20T10:54:29.010 INFO:tasks.workunit.client.1.smithi175.stdout:8/184: rmdir d7/d2c 39 2024-04-20T10:54:29.011 INFO:tasks.workunit.client.1.smithi175.stdout:8/185: chown d7/d13/f12 4451558 1 2024-04-20T10:54:29.013 INFO:tasks.workunit.client.1.smithi175.stdout:9/227: creat d6/f3c x:0 0 0 2024-04-20T10:54:29.013 INFO:tasks.workunit.client.1.smithi175.stdout:1/173: dread d0/f1a [0,4194304] 0 2024-04-20T10:54:29.013 INFO:tasks.workunit.client.1.smithi175.stdout:1/174: chown d0/d8/f17 1913736407 1 2024-04-20T10:54:29.013 INFO:tasks.workunit.client.1.smithi175.stdout:1/175: truncate d0/d8/d13/d2e/d35/f37 393345 0 2024-04-20T10:54:29.013 INFO:tasks.workunit.client.1.smithi175.stdout:1/176: dread - d0/d8/f17 zero size 2024-04-20T10:54:29.013 INFO:tasks.workunit.client.1.smithi175.stdout:2/152: dread d1/f4 [0,4194304] 0 2024-04-20T10:54:29.014 INFO:tasks.workunit.client.1.smithi175.stdout:6/282: mkdir d1/d40/d46/d60/d68 0 2024-04-20T10:54:29.014 INFO:tasks.workunit.client.1.smithi175.stdout:4/250: rename d4/d23/d2e/d3a to d4/dd/d54 0 2024-04-20T10:54:29.014 INFO:tasks.workunit.client.1.smithi175.stdout:8/186: mknod d7/d13/d1d/d24/d39/c3d 0 2024-04-20T10:54:29.015 INFO:tasks.workunit.client.1.smithi175.stdout:2/153: symlink d1/d7/d1e/d32/l35 0 2024-04-20T10:54:29.016 INFO:tasks.workunit.client.1.smithi175.stdout:0/198: sync 2024-04-20T10:54:29.016 INFO:tasks.workunit.client.1.smithi175.stdout:4/251: creat d4/d23/d2e/f55 x:0 0 0 2024-04-20T10:54:29.017 INFO:tasks.workunit.client.1.smithi175.stdout:2/154: mkdir d1/d7/d1e/d36 0 2024-04-20T10:54:29.017 INFO:tasks.workunit.client.1.smithi175.stdout:3/171: dread d7/fe [0,4194304] 0 2024-04-20T10:54:29.017 INFO:tasks.workunit.client.1.smithi175.stdout:3/172: fsync d7/f12 0 2024-04-20T10:54:29.018 INFO:tasks.workunit.client.1.smithi175.stdout:2/155: rmdir d1/d7/d1e/d32/d30 0 2024-04-20T10:54:29.018 INFO:tasks.workunit.client.1.smithi175.stdout:7/216: write db/de/d12/f19 [35638,104214] 0 2024-04-20T10:54:29.018 INFO:tasks.workunit.client.1.smithi175.stdout:7/217: chown db/de 10501983 1 2024-04-20T10:54:29.019 INFO:tasks.workunit.client.1.smithi175.stdout:3/173: mknod d7/d21/d16/d22/c37 0 2024-04-20T10:54:29.019 INFO:tasks.workunit.client.1.smithi175.stdout:3/174: stat d7/f14 0 2024-04-20T10:54:29.022 INFO:tasks.workunit.client.1.smithi175.stdout:2/156: rename d1/f4 to d1/d7/d1e/d32/d21/f37 0 2024-04-20T10:54:29.023 INFO:tasks.workunit.client.1.smithi175.stdout:5/259: dwrite f2 [0,4194304] 0 2024-04-20T10:54:29.023 INFO:tasks.workunit.client.1.smithi175.stdout:5/260: chown db/d11/f2d 338 1 2024-04-20T10:54:29.024 INFO:tasks.workunit.client.1.smithi175.stdout:3/175: creat d7/d19/d35/f38 x:0 0 0 2024-04-20T10:54:29.024 INFO:tasks.workunit.client.1.smithi175.stdout:3/176: truncate d7/f15 1940786 0 2024-04-20T10:54:29.025 INFO:tasks.workunit.client.1.smithi175.stdout:8/187: dread d7/d13/d1d/f1e [0,4194304] 0 2024-04-20T10:54:29.025 INFO:tasks.workunit.client.1.smithi175.stdout:4/252: read d4/d27/f8 [4438969,20273] 0 2024-04-20T10:54:29.025 INFO:tasks.workunit.client.1.smithi175.stdout:1/177: dread d0/fe [0,4194304] 0 2024-04-20T10:54:29.025 INFO:tasks.workunit.client.1.smithi175.stdout:2/157: mkdir d1/d7/d1e/d32/d38 0 2024-04-20T10:54:29.026 INFO:tasks.workunit.client.1.smithi175.stdout:2/158: fsync d1/d7/d1e/d32/d21/d29/f19 0 2024-04-20T10:54:29.027 INFO:tasks.workunit.client.1.smithi175.stdout:5/261: unlink db/l10 0 2024-04-20T10:54:29.028 INFO:tasks.workunit.client.1.smithi175.stdout:5/262: truncate db/d11/f43 283482 0 2024-04-20T10:54:29.028 INFO:tasks.workunit.client.1.smithi175.stdout:8/188: symlink d7/d13/d1d/d24/l3e 0 2024-04-20T10:54:29.029 INFO:tasks.workunit.client.1.smithi175.stdout:4/253: unlink d4/c40 0 2024-04-20T10:54:29.030 INFO:tasks.workunit.client.1.smithi175.stdout:1/178: mknod d0/d29/d33/c3a 0 2024-04-20T10:54:29.030 INFO:tasks.workunit.client.1.smithi175.stdout:8/189: read d7/d13/ff [394727,42580] 0 2024-04-20T10:54:29.030 INFO:tasks.workunit.client.1.smithi175.stdout:2/159: rmdir d1/d7 39 2024-04-20T10:54:29.033 INFO:tasks.workunit.client.1.smithi175.stdout:9/228: fsync d6/d10/f3b 0 2024-04-20T10:54:29.037 INFO:tasks.workunit.client.1.smithi175.stdout:0/199: dwrite df/d19/f21 [0,4194304] 0 2024-04-20T10:54:29.037 INFO:tasks.workunit.client.1.smithi175.stdout:0/200: fdatasync df/f13 0 2024-04-20T10:54:29.040 INFO:tasks.workunit.client.1.smithi175.stdout:5/263: mknod db/d11/d25/d38/d40/c4e 0 2024-04-20T10:54:29.040 INFO:tasks.workunit.client.1.smithi175.stdout:1/179: link d0/d8/d13/d2e/c36 d0/d8/d13/c3b 0 2024-04-20T10:54:29.041 INFO:tasks.workunit.client.1.smithi175.stdout:8/190: unlink d7/d13/c20 0 2024-04-20T10:54:29.041 INFO:tasks.workunit.client.1.smithi175.stdout:1/180: chown d0/f5 52209 1 2024-04-20T10:54:29.041 INFO:tasks.workunit.client.1.smithi175.stdout:2/160: rmdir d1/d7/d1e/d32/d21/d29 39 2024-04-20T10:54:29.041 INFO:tasks.workunit.client.1.smithi175.stdout:2/161: read d1/d7/d1e/d32/d21/d29/f24 [326204,903] 0 2024-04-20T10:54:29.041 INFO:tasks.workunit.client.1.smithi175.stdout:9/229: symlink d6/d1b/d26/l3d 0 2024-04-20T10:54:29.043 INFO:tasks.workunit.client.1.smithi175.stdout:0/201: getdents df/d17 0 2024-04-20T10:54:29.044 INFO:tasks.workunit.client.1.smithi175.stdout:8/191: chown c3 1860754 1 2024-04-20T10:54:29.044 INFO:tasks.workunit.client.1.smithi175.stdout:8/192: stat d7/d13/f22 0 2024-04-20T10:54:29.044 INFO:tasks.workunit.client.1.smithi175.stdout:5/264: mkdir db/d30/d46/d4b/d4f 0 2024-04-20T10:54:29.044 INFO:tasks.workunit.client.1.smithi175.stdout:6/283: dwrite d1/d40/f5e [0,4194304] 0 2024-04-20T10:54:29.045 INFO:tasks.workunit.client.1.smithi175.stdout:5/265: fsync db/d1f/f20 0 2024-04-20T10:54:29.045 INFO:tasks.workunit.client.1.smithi175.stdout:1/181: mknod d0/d8/c3c 0 2024-04-20T10:54:29.046 INFO:tasks.workunit.client.1.smithi175.stdout:0/202: symlink df/d1a/d22/d24/l3c 0 2024-04-20T10:54:29.046 INFO:tasks.workunit.client.1.smithi175.stdout:8/193: mknod d7/d13/d1d/d24/d39/c3f 0 2024-04-20T10:54:29.047 INFO:tasks.workunit.client.1.smithi175.stdout:3/177: dwrite d7/d21/fa [0,4194304] 0 2024-04-20T10:54:29.047 INFO:tasks.workunit.client.1.smithi175.stdout:9/230: dread d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:29.048 INFO:tasks.workunit.client.1.smithi175.stdout:6/284: unlink d1/d5/d12/l1a 0 2024-04-20T10:54:29.049 INFO:tasks.workunit.client.1.smithi175.stdout:0/203: creat df/d17/f3d x:0 0 0 2024-04-20T10:54:29.051 INFO:tasks.workunit.client.1.smithi175.stdout:3/178: truncate d7/d19/d2a/f2b 404214 0 2024-04-20T10:54:29.055 INFO:tasks.workunit.client.1.smithi175.stdout:9/231: symlink d6/d1b/d26/l3e 0 2024-04-20T10:54:29.057 INFO:tasks.workunit.client.1.smithi175.stdout:6/285: dread d1/d5/f6 [0,4194304] 0 2024-04-20T10:54:29.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/218: rename db/de to db/d1d/d39/d50 0 2024-04-20T10:54:29.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/219: fdatasync db/d1d/d29/f3c 0 2024-04-20T10:54:29.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/220: write db/f1c [4531879,37748] 0 2024-04-20T10:54:29.059 INFO:tasks.workunit.client.1.smithi175.stdout:0/204: dread f1 [0,4194304] 0 2024-04-20T10:54:29.060 INFO:tasks.workunit.client.1.smithi175.stdout:6/286: creat d1/d40/d49/f69 x:0 0 0 2024-04-20T10:54:29.062 INFO:tasks.workunit.client.1.smithi175.stdout:3/179: dread d7/d21/fa [0,4194304] 0 2024-04-20T10:54:29.062 INFO:tasks.workunit.client.1.smithi175.stdout:3/180: chown d7/d20 109 1 2024-04-20T10:54:29.062 INFO:tasks.workunit.client.1.smithi175.stdout:4/254: dwrite d4/dd/f50 [0,4194304] 0 2024-04-20T10:54:29.062 INFO:tasks.workunit.client.1.smithi175.stdout:4/255: getdents d4/dd/d2d/d43 0 2024-04-20T10:54:29.063 INFO:tasks.workunit.client.1.smithi175.stdout:4/256: truncate d4/f38 972078 0 2024-04-20T10:54:29.063 INFO:tasks.workunit.client.1.smithi175.stdout:4/257: dread - d4/dd/f13 zero size 2024-04-20T10:54:29.063 INFO:tasks.workunit.client.1.smithi175.stdout:4/258: chown d4/dd/d54/f3f 1216 1 2024-04-20T10:54:29.063 INFO:tasks.workunit.client.1.smithi175.stdout:7/221: mknod db/c51 0 2024-04-20T10:54:29.066 INFO:tasks.workunit.client.1.smithi175.stdout:5/266: dwrite db/d11/f43 [0,4194304] 0 2024-04-20T10:54:29.066 INFO:tasks.workunit.client.1.smithi175.stdout:5/267: fsync db/f1b 0 2024-04-20T10:54:29.066 INFO:tasks.workunit.client.1.smithi175.stdout:3/181: truncate d7/d21/f2f 1346797 0 2024-04-20T10:54:29.067 INFO:tasks.workunit.client.1.smithi175.stdout:6/287: dread d1/d5/d12/f31 [0,4194304] 0 2024-04-20T10:54:29.070 INFO:tasks.workunit.client.1.smithi175.stdout:4/259: symlink d4/d23/d2e/l56 0 2024-04-20T10:54:29.070 INFO:tasks.workunit.client.1.smithi175.stdout:4/260: fdatasync d4/d23/d2e/f55 0 2024-04-20T10:54:29.075 INFO:tasks.workunit.client.1.smithi175.stdout:3/182: creat d7/d21/d16/d22/d2c/d1f/f39 x:0 0 0 2024-04-20T10:54:29.077 INFO:tasks.workunit.client.1.smithi175.stdout:6/288: mknod d1/d40/d46/c6a 0 2024-04-20T10:54:29.077 INFO:tasks.workunit.client.1.smithi175.stdout:0/205: dwrite df/d17/f2a [0,4194304] 0 2024-04-20T10:54:29.080 INFO:tasks.workunit.client.1.smithi175.stdout:5/268: getdents db/d11/d25/d38/d40 0 2024-04-20T10:54:29.085 INFO:tasks.workunit.client.1.smithi175.stdout:8/194: dwrite d7/d13/d1d/d24/d26/f2a [4194304,4194304] 0 2024-04-20T10:54:29.086 INFO:tasks.workunit.client.1.smithi175.stdout:6/289: mkdir d1/d40/d46/d60/d6b 0 2024-04-20T10:54:29.086 INFO:tasks.workunit.client.1.smithi175.stdout:8/195: dread d7/d13/d1d/f2f [0,4194304] 0 2024-04-20T10:54:29.088 INFO:tasks.workunit.client.1.smithi175.stdout:0/206: stat df/l16 0 2024-04-20T10:54:29.088 INFO:tasks.workunit.client.1.smithi175.stdout:0/207: chown df/d1a/d22/d24 108415 1 2024-04-20T10:54:29.089 INFO:tasks.workunit.client.1.smithi175.stdout:5/269: getdents db/d30 0 2024-04-20T10:54:29.089 INFO:tasks.workunit.client.1.smithi175.stdout:5/270: write db/d1f/f29 [1654110,19457] 0 2024-04-20T10:54:29.089 INFO:tasks.workunit.client.1.smithi175.stdout:0/208: chown df/l15 29062127 1 2024-04-20T10:54:29.089 INFO:tasks.workunit.client.1.smithi175.stdout:0/209: chown df/d1a 324563 1 2024-04-20T10:54:29.089 INFO:tasks.workunit.client.1.smithi175.stdout:0/210: write df/d1a/f27 [953307,38581] 0 2024-04-20T10:54:29.091 INFO:tasks.workunit.client.1.smithi175.stdout:2/162: truncate d1/f3 342418 0 2024-04-20T10:54:29.095 INFO:tasks.workunit.client.1.smithi175.stdout:6/290: write d1/d40/f5e [3999349,52956] 0 2024-04-20T10:54:29.096 INFO:tasks.workunit.client.1.smithi175.stdout:6/291: write d1/d40/d49/f69 [158666,16842] 0 2024-04-20T10:54:29.096 INFO:tasks.workunit.client.1.smithi175.stdout:8/196: dread d7/d13/d1d/d24/d26/f2a [4194304,4194304] 0 2024-04-20T10:54:29.096 INFO:tasks.workunit.client.1.smithi175.stdout:7/222: dwrite db/d1d/d39/d50/d2c/f2d [0,4194304] 0 2024-04-20T10:54:29.096 INFO:tasks.workunit.client.1.smithi175.stdout:7/223: write db/f46 [64710,48535] 0 2024-04-20T10:54:29.096 INFO:tasks.workunit.client.1.smithi175.stdout:7/224: write db/d1d/d39/d50/d12/f2f [155852,30768] 0 2024-04-20T10:54:29.096 INFO:tasks.workunit.client.1.smithi175.stdout:5/271: stat db/d1f/d31/d35/l3b 0 2024-04-20T10:54:29.100 INFO:tasks.workunit.client.1.smithi175.stdout:9/232: truncate d6/f16 879870 0 2024-04-20T10:54:29.100 INFO:tasks.workunit.client.1.smithi175.stdout:9/233: write d6/f20 [663109,36088] 0 2024-04-20T10:54:29.105 INFO:tasks.workunit.client.1.smithi175.stdout:5/272: dread db/d1f/f29 [0,4194304] 0 2024-04-20T10:54:29.105 INFO:tasks.workunit.client.1.smithi175.stdout:5/273: write db/d1f/d31/d35/f44 [346616,51738] 0 2024-04-20T10:54:29.105 INFO:tasks.workunit.client.1.smithi175.stdout:4/261: dwrite d4/d23/f32 [0,4194304] 0 2024-04-20T10:54:29.105 INFO:tasks.workunit.client.1.smithi175.stdout:0/211: dread df/f38 [0,4194304] 0 2024-04-20T10:54:29.105 INFO:tasks.workunit.client.1.smithi175.stdout:8/197: unlink d7/d13/d1d/d24/l27 0 2024-04-20T10:54:29.105 INFO:tasks.workunit.client.1.smithi175.stdout:6/292: link d1/cf d1/d5/d12/c6c 0 2024-04-20T10:54:29.115 INFO:tasks.workunit.client.1.smithi175.stdout:7/225: dwrite db/d1d/d29/d2a/f30 [0,4194304] 0 2024-04-20T10:54:29.115 INFO:tasks.workunit.client.1.smithi175.stdout:0/212: mknod df/d2e/c3e 0 2024-04-20T10:54:29.115 INFO:tasks.workunit.client.1.smithi175.stdout:0/213: chown df/d1a/d28/l33 95 1 2024-04-20T10:54:29.115 INFO:tasks.workunit.client.1.smithi175.stdout:4/262: write d4/d27/f1c [4176924,42020] 0 2024-04-20T10:54:29.120 INFO:tasks.workunit.client.1.smithi175.stdout:5/274: dwrite f2 [0,4194304] 0 2024-04-20T10:54:29.126 INFO:tasks.workunit.client.1.smithi175.stdout:0/214: mkdir df/d1a/d3f 0 2024-04-20T10:54:29.126 INFO:tasks.workunit.client.1.smithi175.stdout:7/226: dread db/f14 [0,4194304] 0 2024-04-20T10:54:29.126 INFO:tasks.workunit.client.1.smithi175.stdout:7/227: readlink db/d1d/d39/d50/d12/l3b 0 2024-04-20T10:54:29.128 INFO:tasks.workunit.client.1.smithi175.stdout:0/215: link df/d2e/c39 df/d1a/d22/d24/c40 0 2024-04-20T10:54:29.129 INFO:tasks.workunit.client.1.smithi175.stdout:7/228: creat db/d1d/d39/d50/f52 x:0 0 0 2024-04-20T10:54:29.129 INFO:tasks.workunit.client.1.smithi175.stdout:7/229: truncate db/d1d/d39/d50/f52 369569 0 2024-04-20T10:54:29.130 INFO:tasks.workunit.client.1.smithi175.stdout:5/275: symlink db/d11/d1a/l50 0 2024-04-20T10:54:29.131 INFO:tasks.workunit.client.1.smithi175.stdout:7/230: creat db/d1d/d39/d50/d2c/f53 x:0 0 0 2024-04-20T10:54:29.141 INFO:tasks.workunit.client.1.smithi175.stdout:7/231: write db/f1c [61028,80048] 0 2024-04-20T10:54:29.141 INFO:tasks.workunit.client.1.smithi175.stdout:6/293: dwrite d1/fb [4194304,4194304] 0 2024-04-20T10:54:29.141 INFO:tasks.workunit.client.1.smithi175.stdout:7/232: chown db/d1d/d29/f3c 1 1 2024-04-20T10:54:29.141 INFO:tasks.workunit.client.1.smithi175.stdout:6/294: chown d1/d5/d12/d22/c28 5 1 2024-04-20T10:54:29.142 INFO:tasks.workunit.client.1.smithi175.stdout:5/276: unlink db/d11/d25/f2b 0 2024-04-20T10:54:29.144 INFO:tasks.workunit.client.1.smithi175.stdout:4/263: dwrite d4/f38 [0,4194304] 0 2024-04-20T10:54:29.144 INFO:tasks.workunit.client.1.smithi175.stdout:3/183: dwrite d7/d21/f2f [0,4194304] 0 2024-04-20T10:54:29.144 INFO:tasks.workunit.client.1.smithi175.stdout:6/295: symlink d1/d40/d46/d60/l6d 0 2024-04-20T10:54:29.144 INFO:tasks.workunit.client.1.smithi175.stdout:6/296: truncate d1/d5/d12/f27 1833701 0 2024-04-20T10:54:29.145 INFO:tasks.workunit.client.1.smithi175.stdout:5/277: mknod db/d30/c51 0 2024-04-20T10:54:29.148 INFO:tasks.workunit.client.1.smithi175.stdout:4/264: mknod d4/dd/d2d/d33/d3c/c57 0 2024-04-20T10:54:29.148 INFO:tasks.workunit.client.1.smithi175.stdout:4/265: chown d4/d23/d2e/d30/f42 814817 1 2024-04-20T10:54:29.148 INFO:tasks.workunit.client.1.smithi175.stdout:4/266: fdatasync d4/f20 0 2024-04-20T10:54:29.148 INFO:tasks.workunit.client.1.smithi175.stdout:6/297: creat d1/d5/d12/d22/f6e x:0 0 0 2024-04-20T10:54:29.149 INFO:tasks.workunit.client.1.smithi175.stdout:5/278: creat db/d30/d46/d4b/d4f/f52 x:0 0 0 2024-04-20T10:54:29.150 INFO:tasks.workunit.client.1.smithi175.stdout:4/267: mkdir d4/dd/d2d/d33/d58 0 2024-04-20T10:54:29.151 INFO:tasks.workunit.client.1.smithi175.stdout:5/279: mknod db/d30/c53 0 2024-04-20T10:54:29.152 INFO:tasks.workunit.client.1.smithi175.stdout:4/268: rename d4/d23/d2e/f55 to d4/dd/d2d/d33/d58/f59 0 2024-04-20T10:54:29.152 INFO:tasks.workunit.client.1.smithi175.stdout:4/269: truncate d4/dd/f1e 232592 0 2024-04-20T10:54:29.152 INFO:tasks.workunit.client.1.smithi175.stdout:4/270: write d4/f1a [2630258,39889] 0 2024-04-20T10:54:29.152 INFO:tasks.workunit.client.1.smithi175.stdout:5/280: unlink db/d11/f2e 0 2024-04-20T10:54:29.154 INFO:tasks.workunit.client.1.smithi175.stdout:4/271: rename d4/dd/f53 to d4/dd/d54/f5a 0 2024-04-20T10:54:29.154 INFO:tasks.workunit.client.1.smithi175.stdout:4/272: write d4/d23/d2e/d30/f42 [504595,59972] 0 2024-04-20T10:54:29.154 INFO:tasks.workunit.client.1.smithi175.stdout:4/273: write d4/d23/d2e/d30/f42 [142922,105314] 0 2024-04-20T10:54:29.154 INFO:tasks.workunit.client.1.smithi175.stdout:4/274: fsync d4/dd/d2d/d33/d3c/d44/f48 0 2024-04-20T10:54:29.156 INFO:tasks.workunit.client.1.smithi175.stdout:4/275: mkdir d4/dd/d2d/d33/d5b 0 2024-04-20T10:54:29.156 INFO:tasks.workunit.client.1.smithi175.stdout:8/198: dwrite d7/d13/f12 [4194304,4194304] 0 2024-04-20T10:54:29.157 INFO:tasks.workunit.client.1.smithi175.stdout:5/281: symlink db/d1f/d31/l54 0 2024-04-20T10:54:29.159 INFO:tasks.workunit.client.1.smithi175.stdout:7/233: dwrite db/d1d/d39/d50/f3e [0,4194304] 0 2024-04-20T10:54:29.159 INFO:tasks.workunit.client.1.smithi175.stdout:4/276: link d4/d27/d25/c41 d4/d23/c5c 0 2024-04-20T10:54:29.159 INFO:tasks.workunit.client.1.smithi175.stdout:8/199: creat d7/d13/f40 x:0 0 0 2024-04-20T10:54:29.160 INFO:tasks.workunit.client.1.smithi175.stdout:8/200: fsync d7/d13/f32 0 2024-04-20T10:54:29.161 INFO:tasks.workunit.client.1.smithi175.stdout:5/282: rename db/d30/d46/l4a to db/d1f/d31/d35/l55 0 2024-04-20T10:54:29.161 INFO:tasks.workunit.client.1.smithi175.stdout:5/283: fdatasync db/d11/d1a/f36 0 2024-04-20T10:54:29.162 INFO:tasks.workunit.client.1.smithi175.stdout:4/277: mkdir d4/dd/d54/d5d 0 2024-04-20T10:54:29.162 INFO:tasks.workunit.client.1.smithi175.stdout:8/201: mknod d7/d13/d1d/d24/d39/c41 0 2024-04-20T10:54:29.163 INFO:tasks.workunit.client.1.smithi175.stdout:0/216: dwrite f3 [0,4194304] 0 2024-04-20T10:54:29.164 INFO:tasks.workunit.client.1.smithi175.stdout:7/234: rename db/d1d/d39/l4a to db/d1d/d39/d50/d12/d47/l54 0 2024-04-20T10:54:29.165 INFO:tasks.workunit.client.1.smithi175.stdout:6/298: dwrite d1/fb [8388608,4194304] 0 2024-04-20T10:54:29.165 INFO:tasks.workunit.client.1.smithi175.stdout:4/278: mkdir d4/dd/d5e 0 2024-04-20T10:54:29.165 INFO:tasks.workunit.client.1.smithi175.stdout:6/299: stat d1/d37/l51 0 2024-04-20T10:54:29.166 INFO:tasks.workunit.client.1.smithi175.stdout:4/279: dread d4/dd/f1e [0,4194304] 0 2024-04-20T10:54:29.166 INFO:tasks.workunit.client.1.smithi175.stdout:8/202: creat d7/d13/d1d/d24/d38/f42 x:0 0 0 2024-04-20T10:54:29.167 INFO:tasks.workunit.client.1.smithi175.stdout:0/217: link df/d1a/d28/l33 df/d19/l41 0 2024-04-20T10:54:29.168 INFO:tasks.workunit.client.1.smithi175.stdout:7/235: creat db/d1d/d39/d50/f55 x:0 0 0 2024-04-20T10:54:29.175 INFO:tasks.workunit.client.1.smithi175.stdout:5/284: getdents db/d11/d1a 0 2024-04-20T10:54:29.176 INFO:tasks.workunit.client.1.smithi175.stdout:7/236: dread db/d1d/d29/d2a/f30 [0,4194304] 0 2024-04-20T10:54:29.176 INFO:tasks.workunit.client.1.smithi175.stdout:4/280: write d4/d23/f32 [2013056,56984] 0 2024-04-20T10:54:29.176 INFO:tasks.workunit.client.1.smithi175.stdout:6/300: creat d1/d37/f6f x:0 0 0 2024-04-20T10:54:29.176 INFO:tasks.workunit.client.1.smithi175.stdout:8/203: symlink d7/d13/d1d/d24/d38/l43 0 2024-04-20T10:54:29.177 INFO:tasks.workunit.client.1.smithi175.stdout:8/204: fdatasync d7/d13/f32 0 2024-04-20T10:54:29.177 INFO:tasks.workunit.client.1.smithi175.stdout:8/205: write d7/d13/ff [1607082,43298] 0 2024-04-20T10:54:29.177 INFO:tasks.workunit.client.1.smithi175.stdout:8/206: fdatasync d7/d13/d1d/d24/d38/f42 0 2024-04-20T10:54:29.177 INFO:tasks.workunit.client.1.smithi175.stdout:8/207: readlink d7/d2c/l31 0 2024-04-20T10:54:29.177 INFO:tasks.workunit.client.1.smithi175.stdout:0/218: creat df/d1a/d28/f42 x:0 0 0 2024-04-20T10:54:29.178 INFO:tasks.workunit.client.1.smithi175.stdout:5/285: creat db/d11/f56 x:0 0 0 2024-04-20T10:54:29.179 INFO:tasks.workunit.client.1.smithi175.stdout:7/237: link db/d1d/c40 db/d1d/d39/d50/c56 0 2024-04-20T10:54:29.179 INFO:tasks.workunit.client.1.smithi175.stdout:7/238: fdatasync db/d1d/d39/f3f 0 2024-04-20T10:54:29.180 INFO:tasks.workunit.client.1.smithi175.stdout:7/239: write db/d1d/d39/d50/f55 [879972,113918] 0 2024-04-20T10:54:29.184 INFO:tasks.workunit.client.1.smithi175.stdout:8/208: rename d7/d13/l15 to d7/d2c/l44 0 2024-04-20T10:54:29.185 INFO:tasks.workunit.client.1.smithi175.stdout:0/219: creat df/d1a/d28/f43 x:0 0 0 2024-04-20T10:54:29.185 INFO:tasks.workunit.client.1.smithi175.stdout:8/209: write d7/d13/d1d/f1e [4198718,101731] 0 2024-04-20T10:54:29.186 INFO:tasks.workunit.client.1.smithi175.stdout:7/240: getdents db/d1d/d39/d50/d12 0 2024-04-20T10:54:29.188 INFO:tasks.workunit.client.1.smithi175.stdout:8/210: symlink d7/d13/d1d/d24/d38/l45 0 2024-04-20T10:54:29.188 INFO:tasks.workunit.client.1.smithi175.stdout:8/211: dread - d7/d13/d1d/d24/d26/f2e zero size 2024-04-20T10:54:29.188 INFO:tasks.workunit.client.1.smithi175.stdout:8/212: dread - d7/d13/f3a zero size 2024-04-20T10:54:29.189 INFO:tasks.workunit.client.1.smithi175.stdout:8/213: write d7/d13/d1d/f1e [4649686,117564] 0 2024-04-20T10:54:29.189 INFO:tasks.workunit.client.1.smithi175.stdout:8/214: write d7/d13/f12 [944026,87183] 0 2024-04-20T10:54:29.189 INFO:tasks.workunit.client.1.smithi175.stdout:7/241: rmdir db/d1d/d29/d2a 39 2024-04-20T10:54:29.191 INFO:tasks.workunit.client.1.smithi175.stdout:8/215: unlink d7/d13/d1d/d24/d38/f42 0 2024-04-20T10:54:29.191 INFO:tasks.workunit.client.1.smithi175.stdout:8/216: truncate d7/f18 990800 0 2024-04-20T10:54:29.191 INFO:tasks.workunit.client.1.smithi175.stdout:8/217: write d7/d13/d1d/f2f [904580,17028] 0 2024-04-20T10:54:29.192 INFO:tasks.workunit.client.1.smithi175.stdout:5/286: dread db/d11/f2a [0,4194304] 0 2024-04-20T10:54:29.192 INFO:tasks.workunit.client.1.smithi175.stdout:5/287: chown db/d1f/f29 1403761803 1 2024-04-20T10:54:29.194 INFO:tasks.workunit.client.1.smithi175.stdout:6/301: dwrite d1/d5/d12/f35 [0,4194304] 0 2024-04-20T10:54:29.197 INFO:tasks.workunit.client.1.smithi175.stdout:7/242: rename db/d1d/d39/d50/d12/l34 to db/d1d/d29/d2a/l57 0 2024-04-20T10:54:29.200 INFO:tasks.workunit.client.1.smithi175.stdout:7/243: mknod db/d1d/d39/d50/d12/d47/c58 0 2024-04-20T10:54:29.202 INFO:tasks.workunit.client.1.smithi175.stdout:0/220: dwrite df/d19/f1f [0,4194304] 0 2024-04-20T10:54:29.203 INFO:tasks.workunit.client.1.smithi175.stdout:7/244: mkdir db/d1d/d29/d2a/d41/d59 0 2024-04-20T10:54:29.204 INFO:tasks.workunit.client.1.smithi175.stdout:6/302: dread d1/d40/d29/f4b [0,4194304] 0 2024-04-20T10:54:29.205 INFO:tasks.workunit.client.1.smithi175.stdout:0/221: link df/f11 df/d1a/d22/f44 0 2024-04-20T10:54:29.206 INFO:tasks.workunit.client.1.smithi175.stdout:6/303: creat d1/d40/d29/f70 x:0 0 0 2024-04-20T10:54:29.207 INFO:tasks.workunit.client.1.smithi175.stdout:0/222: symlink df/d2e/l45 0 2024-04-20T10:54:29.208 INFO:tasks.workunit.client.1.smithi175.stdout:6/304: mknod d1/d40/d46/d60/d68/c71 0 2024-04-20T10:54:29.208 INFO:tasks.workunit.client.1.smithi175.stdout:6/305: getdents d1/d40/d46/d60/d6b 0 2024-04-20T10:54:29.210 INFO:tasks.workunit.client.1.smithi175.stdout:8/218: dwrite d7/f18 [0,4194304] 0 2024-04-20T10:54:29.210 INFO:tasks.workunit.client.1.smithi175.stdout:8/219: readlink d7/la 0 2024-04-20T10:54:29.210 INFO:tasks.workunit.client.1.smithi175.stdout:8/220: chown d7/d13/d1d/d24/d38 948506198 1 2024-04-20T10:54:29.211 INFO:tasks.workunit.client.1.smithi175.stdout:0/223: mknod df/d2e/c46 0 2024-04-20T10:54:29.214 INFO:tasks.workunit.client.1.smithi175.stdout:1/182: sync 2024-04-20T10:54:29.214 INFO:tasks.workunit.client.1.smithi175.stdout:1/183: rename d0 to d0/d8/d13/d2e/d35/d3d 22 2024-04-20T10:54:29.218 INFO:tasks.workunit.client.1.smithi175.stdout:6/306: dread d1/d40/d29/f36 [0,4194304] 0 2024-04-20T10:54:29.219 INFO:tasks.workunit.client.1.smithi175.stdout:1/184: getdents d0/d29/d33 0 2024-04-20T10:54:29.220 INFO:tasks.workunit.client.1.smithi175.stdout:6/307: creat d1/d40/d46/d60/d6b/f72 x:0 0 0 2024-04-20T10:54:29.220 INFO:tasks.workunit.client.1.smithi175.stdout:6/308: chown d1/c34 2027 1 2024-04-20T10:54:29.221 INFO:tasks.workunit.client.1.smithi175.stdout:6/309: readlink d1/d40/d49/l5c 0 2024-04-20T10:54:29.221 INFO:tasks.workunit.client.1.smithi175.stdout:1/185: mkdir d0/d3e 0 2024-04-20T10:54:29.223 INFO:tasks.workunit.client.1.smithi175.stdout:0/224: fsync df/d1a/d28/f43 0 2024-04-20T10:54:29.223 INFO:tasks.workunit.client.1.smithi175.stdout:7/245: dwrite db/f14 [0,4194304] 0 2024-04-20T10:54:29.223 INFO:tasks.workunit.client.1.smithi175.stdout:7/246: readlink db/d1d/d29/d2a/l57 0 2024-04-20T10:54:29.224 INFO:tasks.workunit.client.1.smithi175.stdout:7/247: chown db/f46 3 1 2024-04-20T10:54:29.224 INFO:tasks.workunit.client.1.smithi175.stdout:7/248: write db/d1d/d39/d50/d12/f21 [866023,67419] 0 2024-04-20T10:54:29.224 INFO:tasks.workunit.client.1.smithi175.stdout:1/186: symlink d0/d29/d33/l3f 0 2024-04-20T10:54:29.224 INFO:tasks.workunit.client.1.smithi175.stdout:1/187: chown d0/f2a 5171 1 2024-04-20T10:54:29.225 INFO:tasks.workunit.client.1.smithi175.stdout:6/310: mkdir d1/d5/d12/d73 0 2024-04-20T10:54:29.226 INFO:tasks.workunit.client.1.smithi175.stdout:1/188: dread d0/d8/f18 [0,4194304] 0 2024-04-20T10:54:29.226 INFO:tasks.workunit.client.1.smithi175.stdout:0/225: creat df/d2e/f47 x:0 0 0 2024-04-20T10:54:29.227 INFO:tasks.workunit.client.1.smithi175.stdout:0/226: chown df/f1c 51 1 2024-04-20T10:54:29.227 INFO:tasks.workunit.client.1.smithi175.stdout:8/221: dwrite d7/d2c/f3c [0,4194304] 0 2024-04-20T10:54:29.230 INFO:tasks.workunit.client.1.smithi175.stdout:0/227: mkdir df/d1a/d22/d24/d37/d48 0 2024-04-20T10:54:29.230 INFO:tasks.workunit.client.1.smithi175.stdout:7/249: dread db/d1d/d39/d50/d12/d47/f49 [0,4194304] 0 2024-04-20T10:54:29.231 INFO:tasks.workunit.client.1.smithi175.stdout:6/311: rename d1/c25 to d1/d5/c74 0 2024-04-20T10:54:29.232 INFO:tasks.workunit.client.1.smithi175.stdout:7/250: stat db/d1d/d39/d50/d12/c2e 0 2024-04-20T10:54:29.234 INFO:tasks.workunit.client.1.smithi175.stdout:0/228: rename df/d17/f3d to df/d1a/d22/d24/d37/d48/f49 0 2024-04-20T10:54:29.234 INFO:tasks.workunit.client.1.smithi175.stdout:0/229: chown df/d1a/d22/d24/l30 5609152 1 2024-04-20T10:54:29.234 INFO:tasks.workunit.client.1.smithi175.stdout:6/312: creat d1/d40/d46/f75 x:0 0 0 2024-04-20T10:54:29.238 INFO:tasks.workunit.client.1.smithi175.stdout:7/251: unlink db/d1d/d39/d50/d12/l31 0 2024-04-20T10:54:29.240 INFO:tasks.workunit.client.1.smithi175.stdout:1/189: write d0/f5 [2670069,35572] 0 2024-04-20T10:54:29.241 INFO:tasks.workunit.client.1.smithi175.stdout:1/190: write d0/d8/f17 [510202,71881] 0 2024-04-20T10:54:29.242 INFO:tasks.workunit.client.1.smithi175.stdout:7/252: mknod db/d1d/d39/d50/d12/d47/c5a 0 2024-04-20T10:54:29.242 INFO:tasks.workunit.client.1.smithi175.stdout:7/253: fsync db/d1d/d39/d50/d12/f19 0 2024-04-20T10:54:29.243 INFO:tasks.workunit.client.1.smithi175.stdout:1/191: unlink d0/d29/d33/l3f 0 2024-04-20T10:54:29.244 INFO:tasks.workunit.client.1.smithi175.stdout:1/192: fsync d0/d8/f18 0 2024-04-20T10:54:29.244 INFO:tasks.workunit.client.1.smithi175.stdout:1/193: chown d0/d8/d13/f24 96933 1 2024-04-20T10:54:29.244 INFO:tasks.workunit.client.1.smithi175.stdout:1/194: write d0/d8/f30 [85475,23157] 0 2024-04-20T10:54:29.244 INFO:tasks.workunit.client.1.smithi175.stdout:1/195: read d0/d8/f30 [115202,107418] 0 2024-04-20T10:54:29.244 INFO:tasks.workunit.client.1.smithi175.stdout:8/222: dwrite d7/f18 [0,4194304] 0 2024-04-20T10:54:29.245 INFO:tasks.workunit.client.1.smithi175.stdout:0/230: write df/d17/f20 [2623675,52656] 0 2024-04-20T10:54:29.245 INFO:tasks.workunit.client.1.smithi175.stdout:7/254: mknod db/d1d/d29/d2a/d41/c5b 0 2024-04-20T10:54:29.248 INFO:tasks.workunit.client.1.smithi175.stdout:8/223: dread d7/d13/ff [0,4194304] 0 2024-04-20T10:54:29.248 INFO:tasks.workunit.client.1.smithi175.stdout:8/224: stat d7/d13/d1d/d24/d39/c41 0 2024-04-20T10:54:29.248 INFO:tasks.workunit.client.1.smithi175.stdout:8/225: dread - d7/d13/f40 zero size 2024-04-20T10:54:29.249 INFO:tasks.workunit.client.1.smithi175.stdout:1/196: unlink d0/d8/d13/f2b 0 2024-04-20T10:54:29.249 INFO:tasks.workunit.client.1.smithi175.stdout:7/255: dread f2 [0,4194304] 0 2024-04-20T10:54:29.250 INFO:tasks.workunit.client.1.smithi175.stdout:8/226: truncate d7/d13/d1d/d24/d26/f2a 2434328 0 2024-04-20T10:54:29.250 INFO:tasks.workunit.client.1.smithi175.stdout:8/227: chown d7/d13/d1d/d24/d38 0 1 2024-04-20T10:54:29.251 INFO:tasks.workunit.client.1.smithi175.stdout:7/256: mknod db/d1d/d29/d2a/d41/d59/c5c 0 2024-04-20T10:54:29.252 INFO:tasks.workunit.client.1.smithi175.stdout:1/197: mknod d0/d8/d13/d2e/c40 0 2024-04-20T10:54:29.252 INFO:tasks.workunit.client.1.smithi175.stdout:1/198: read d0/d8/d13/d2e/d35/f37 [355877,89510] 0 2024-04-20T10:54:29.253 INFO:tasks.workunit.client.1.smithi175.stdout:8/228: getdents d7/d13/d1d/d24 0 2024-04-20T10:54:29.253 INFO:tasks.workunit.client.1.smithi175.stdout:1/199: creat d0/d3e/f41 x:0 0 0 2024-04-20T10:54:29.258 INFO:tasks.workunit.client.1.smithi175.stdout:8/229: getdents d7/d13 0 2024-04-20T10:54:29.258 INFO:tasks.workunit.client.1.smithi175.stdout:8/230: chown d7/d13/d1d/f2f 10 1 2024-04-20T10:54:29.258 INFO:tasks.workunit.client.1.smithi175.stdout:6/313: dwrite d1/fb [0,4194304] 0 2024-04-20T10:54:29.271 INFO:tasks.workunit.client.1.smithi175.stdout:7/257: read db/f14 [3794801,11936] 0 2024-04-20T10:54:29.271 INFO:tasks.workunit.client.1.smithi175.stdout:7/258: chown db/d1d/d39/d50/d12/d47/l4c 264590388 1 2024-04-20T10:54:29.271 INFO:tasks.workunit.client.1.smithi175.stdout:7/259: fdatasync db/d1d/f42 0 2024-04-20T10:54:29.271 INFO:tasks.workunit.client.1.smithi175.stdout:7/260: write db/d1d/d39/d50/d2c/f32 [27503,70607] 0 2024-04-20T10:54:29.276 INFO:tasks.workunit.client.1.smithi175.stdout:1/200: dwrite d0/d8/f1f [0,4194304] 0 2024-04-20T10:54:29.277 INFO:tasks.workunit.client.1.smithi175.stdout:1/201: dread d0/f10 [0,4194304] 0 2024-04-20T10:54:29.277 INFO:tasks.workunit.client.1.smithi175.stdout:7/261: symlink db/d1d/d29/d2a/d41/d59/l5d 0 2024-04-20T10:54:29.278 INFO:tasks.workunit.client.1.smithi175.stdout:1/202: rmdir d0/d29 39 2024-04-20T10:54:29.279 INFO:tasks.workunit.client.1.smithi175.stdout:7/262: mknod db/d1d/d39/c5e 0 2024-04-20T10:54:29.280 INFO:tasks.workunit.client.1.smithi175.stdout:1/203: creat d0/d8/d13/d2e/d35/f42 x:0 0 0 2024-04-20T10:54:29.280 INFO:tasks.workunit.client.1.smithi175.stdout:7/263: mknod db/d1d/d39/d50/d12/c5f 0 2024-04-20T10:54:29.281 INFO:tasks.workunit.client.1.smithi175.stdout:1/204: symlink d0/d29/d33/l43 0 2024-04-20T10:54:29.282 INFO:tasks.workunit.client.1.smithi175.stdout:8/231: dwrite d7/d13/d1d/d24/d39/f3b [0,4194304] 0 2024-04-20T10:54:29.282 INFO:tasks.workunit.client.1.smithi175.stdout:8/232: stat d7/d2c/f3c 0 2024-04-20T10:54:29.282 INFO:tasks.workunit.client.1.smithi175.stdout:7/264: mkdir db/d1d/d60 0 2024-04-20T10:54:29.282 INFO:tasks.workunit.client.1.smithi175.stdout:6/314: dwrite d1/d40/d29/f36 [0,4194304] 0 2024-04-20T10:54:29.283 INFO:tasks.workunit.client.1.smithi175.stdout:1/205: rename d0/d8/f17 to d0/d8/d13/d2e/f44 0 2024-04-20T10:54:29.283 INFO:tasks.workunit.client.1.smithi175.stdout:1/206: dread - d0/d8/d13/d2e/d35/f42 zero size 2024-04-20T10:54:29.283 INFO:tasks.workunit.client.1.smithi175.stdout:1/207: fdatasync d0/d8/d13/f26 0 2024-04-20T10:54:29.285 INFO:tasks.workunit.client.1.smithi175.stdout:8/233: mknod d7/c46 0 2024-04-20T10:54:29.285 INFO:tasks.workunit.client.1.smithi175.stdout:8/234: stat d7/c8 0 2024-04-20T10:54:29.286 INFO:tasks.workunit.client.1.smithi175.stdout:7/265: mkdir db/d61 0 2024-04-20T10:54:29.287 INFO:tasks.workunit.client.1.smithi175.stdout:6/315: symlink d1/d40/d29/l76 0 2024-04-20T10:54:29.288 INFO:tasks.workunit.client.1.smithi175.stdout:7/266: dread db/fd [0,4194304] 0 2024-04-20T10:54:29.292 INFO:tasks.workunit.client.1.smithi175.stdout:7/267: dread f2 [0,4194304] 0 2024-04-20T10:54:29.292 INFO:tasks.workunit.client.1.smithi175.stdout:7/268: readlink db/d1d/d29/d2a/l57 0 2024-04-20T10:54:29.292 INFO:tasks.workunit.client.1.smithi175.stdout:7/269: chown db/d1d/d39/d50/f3e 61088 1 2024-04-20T10:54:29.292 INFO:tasks.workunit.client.1.smithi175.stdout:8/235: write d7/fd [1836280,128674] 0 2024-04-20T10:54:29.293 INFO:tasks.workunit.client.1.smithi175.stdout:1/208: link d0/f1a d0/d8/f45 0 2024-04-20T10:54:29.293 INFO:tasks.workunit.client.1.smithi175.stdout:7/270: symlink db/d1d/d39/d50/d12/l62 0 2024-04-20T10:54:29.294 INFO:tasks.workunit.client.1.smithi175.stdout:7/271: read db/d1d/d39/d50/d12/f21 [268891,33308] 0 2024-04-20T10:54:29.294 INFO:tasks.workunit.client.1.smithi175.stdout:8/236: rmdir d7/d13/d1d/d24/d26 39 2024-04-20T10:54:29.295 INFO:tasks.workunit.client.1.smithi175.stdout:7/272: getdents db/d1d/d39/d50 0 2024-04-20T10:54:29.295 INFO:tasks.workunit.client.1.smithi175.stdout:7/273: dread - db/d1d/d39/d50/d2c/f53 zero size 2024-04-20T10:54:29.296 INFO:tasks.workunit.client.1.smithi175.stdout:8/237: rename d7/d13/ff to d7/d13/d1d/f47 0 2024-04-20T10:54:29.297 INFO:tasks.workunit.client.1.smithi175.stdout:7/274: creat db/d1d/d39/d50/d2c/f63 x:0 0 0 2024-04-20T10:54:29.297 INFO:tasks.workunit.client.1.smithi175.stdout:7/275: fsync db/d1d/d39/d50/d12/f21 0 2024-04-20T10:54:29.298 INFO:tasks.workunit.client.1.smithi175.stdout:7/276: mknod db/d1d/d39/c64 0 2024-04-20T10:54:29.310 INFO:tasks.workunit.client.1.smithi175.stdout:1/209: dwrite d0/d8/d13/d2e/d35/f37 [0,4194304] 0 2024-04-20T10:54:29.310 INFO:tasks.workunit.client.1.smithi175.stdout:7/277: mknod db/d61/c65 0 2024-04-20T10:54:29.318 INFO:tasks.workunit.client.1.smithi175.stdout:1/210: write d0/f5 [7329444,103419] 0 2024-04-20T10:54:29.318 INFO:tasks.workunit.client.1.smithi175.stdout:1/211: dread - d0/d8/d13/f24 zero size 2024-04-20T10:54:29.321 INFO:tasks.workunit.client.1.smithi175.stdout:7/278: creat db/f66 x:0 0 0 2024-04-20T10:54:29.323 INFO:tasks.workunit.client.1.smithi175.stdout:7/279: dread db/d1d/d29/d2a/f30 [0,4194304] 0 2024-04-20T10:54:29.339 INFO:tasks.workunit.client.1.smithi175.stdout:7/280: symlink db/d1d/d29/d2a/d41/d59/l67 0 2024-04-20T10:54:29.388 INFO:tasks.workunit.client.1.smithi175.stdout:7/281: getdents db/d1d/d29 0 2024-04-20T10:54:29.388 INFO:tasks.workunit.client.1.smithi175.stdout:7/282: stat db/d1d/l36 0 2024-04-20T10:54:29.406 INFO:tasks.workunit.client.1.smithi175.stdout:7/283: creat db/d61/f68 x:0 0 0 2024-04-20T10:54:29.406 INFO:tasks.workunit.client.1.smithi175.stdout:7/284: dread - db/d1d/d39/d50/d2c/f63 zero size 2024-04-20T10:54:29.608 INFO:tasks.workunit.client.1.smithi175.stdout:7/285: symlink db/d1d/d39/d50/d12/d47/l69 0 2024-04-20T10:54:29.608 INFO:tasks.workunit.client.1.smithi175.stdout:7/286: rmdir db/d61 39 2024-04-20T10:54:29.608 INFO:tasks.workunit.client.1.smithi175.stdout:7/287: getdents db/d1d/d39/d50 0 2024-04-20T10:54:29.809 INFO:tasks.workunit.client.1.smithi175.stdout:8/238: truncate d7/d13/d1d/d24/d39/f3b 4110868 0 2024-04-20T10:54:29.811 INFO:tasks.workunit.client.1.smithi175.stdout:3/184: sync 2024-04-20T10:54:29.811 INFO:tasks.workunit.client.1.smithi175.stdout:9/234: sync 2024-04-20T10:54:29.811 INFO:tasks.workunit.client.1.smithi175.stdout:2/163: sync 2024-04-20T10:54:29.812 INFO:tasks.workunit.client.1.smithi175.stdout:2/164: write d1/f3 [10137,395] 0 2024-04-20T10:54:29.812 INFO:tasks.workunit.client.1.smithi175.stdout:2/165: chown d1/d7/d1e/d32/l1c 76 1 2024-04-20T10:54:29.812 INFO:tasks.workunit.client.1.smithi175.stdout:9/235: mknod d6/c3f 0 2024-04-20T10:54:29.812 INFO:tasks.workunit.client.1.smithi175.stdout:9/236: write d6/d1b/d26/f2b [624029,44349] 0 2024-04-20T10:54:29.813 INFO:tasks.workunit.client.1.smithi175.stdout:3/185: mknod d7/c3a 0 2024-04-20T10:54:29.816 INFO:tasks.workunit.client.1.smithi175.stdout:2/166: getdents d1 0 2024-04-20T10:54:29.816 INFO:tasks.workunit.client.1.smithi175.stdout:2/167: getdents d1/d7/d1e/d36 0 2024-04-20T10:54:29.817 INFO:tasks.workunit.client.1.smithi175.stdout:9/237: mkdir d6/d40 0 2024-04-20T10:54:29.819 INFO:tasks.workunit.client.1.smithi175.stdout:3/186: creat d7/d19/d33/f3b x:0 0 0 2024-04-20T10:54:29.820 INFO:tasks.workunit.client.1.smithi175.stdout:3/187: dread d7/d19/d2a/f2b [0,4194304] 0 2024-04-20T10:54:29.820 INFO:tasks.workunit.client.1.smithi175.stdout:9/238: creat d6/d1b/d2f/f41 x:0 0 0 2024-04-20T10:54:29.821 INFO:tasks.workunit.client.1.smithi175.stdout:3/188: creat d7/d21/d16/d22/d2c/f3c x:0 0 0 2024-04-20T10:54:29.822 INFO:tasks.workunit.client.1.smithi175.stdout:9/239: mkdir d6/d1b/d42 0 2024-04-20T10:54:29.824 INFO:tasks.workunit.client.1.smithi175.stdout:9/240: creat d6/f43 x:0 0 0 2024-04-20T10:54:29.826 INFO:tasks.workunit.client.1.smithi175.stdout:3/189: mknod d7/d21/c3d 0 2024-04-20T10:54:29.826 INFO:tasks.workunit.client.1.smithi175.stdout:8/239: dwrite d7/f14 [0,4194304] 0 2024-04-20T10:54:29.827 INFO:tasks.workunit.client.1.smithi175.stdout:3/190: symlink d7/d19/d33/l3e 0 2024-04-20T10:54:29.827 INFO:tasks.workunit.client.1.smithi175.stdout:3/191: truncate d7/d21/f2f 4314339 0 2024-04-20T10:54:29.828 INFO:tasks.workunit.client.1.smithi175.stdout:8/240: creat d7/d13/d1d/d24/d39/f48 x:0 0 0 2024-04-20T10:54:29.828 INFO:tasks.workunit.client.1.smithi175.stdout:8/241: chown d7/d13/d1d/d24/d38/l45 150869866 1 2024-04-20T10:54:29.830 INFO:tasks.workunit.client.1.smithi175.stdout:8/242: symlink d7/d13/d1d/d24/d26/l49 0 2024-04-20T10:54:29.832 INFO:tasks.workunit.client.1.smithi175.stdout:3/192: rename d7/d21/d16/d22/d2c/d1f/l26 to d7/d19/l3f 0 2024-04-20T10:54:29.833 INFO:tasks.workunit.client.1.smithi175.stdout:9/241: write f3 [6060471,1194] 0 2024-04-20T10:54:29.833 INFO:tasks.workunit.client.1.smithi175.stdout:9/242: chown d6/d10/f1a 18972 1 2024-04-20T10:54:29.833 INFO:tasks.workunit.client.1.smithi175.stdout:8/243: rmdir d7/d13/d1d/d24/d26 39 2024-04-20T10:54:29.834 INFO:tasks.workunit.client.1.smithi175.stdout:2/168: dwrite d1/d7/ff [0,4194304] 0 2024-04-20T10:54:29.835 INFO:tasks.workunit.client.1.smithi175.stdout:3/193: creat d7/d19/f40 x:0 0 0 2024-04-20T10:54:29.837 INFO:tasks.workunit.client.1.smithi175.stdout:9/243: creat d6/d1b/d42/f44 x:0 0 0 2024-04-20T10:54:29.837 INFO:tasks.workunit.client.1.smithi175.stdout:9/244: dread - d6/f39 zero size 2024-04-20T10:54:29.837 INFO:tasks.workunit.client.1.smithi175.stdout:9/245: readlink d6/d10/l30 0 2024-04-20T10:54:29.837 INFO:tasks.workunit.client.1.smithi175.stdout:8/244: creat d7/d13/d1d/d24/f4a x:0 0 0 2024-04-20T10:54:29.840 INFO:tasks.workunit.client.1.smithi175.stdout:2/169: creat d1/d7/d1e/d32/d21/d29/f39 x:0 0 0 2024-04-20T10:54:29.841 INFO:tasks.workunit.client.1.smithi175.stdout:9/246: creat d6/d1b/d2f/f45 x:0 0 0 2024-04-20T10:54:29.842 INFO:tasks.workunit.client.1.smithi175.stdout:2/170: symlink d1/d7/d1f/l3a 0 2024-04-20T10:54:29.843 INFO:tasks.workunit.client.1.smithi175.stdout:9/247: mknod d6/d10/c46 0 2024-04-20T10:54:29.847 INFO:tasks.workunit.client.1.smithi175.stdout:9/248: rmdir d6/d1b 39 2024-04-20T10:54:29.847 INFO:tasks.workunit.client.1.smithi175.stdout:9/249: read - d6/f39 zero size 2024-04-20T10:54:29.857 INFO:tasks.workunit.client.1.smithi175.stdout:3/194: dwrite f5 [0,4194304] 0 2024-04-20T10:54:29.857 INFO:tasks.workunit.client.1.smithi175.stdout:8/245: dwrite d7/d13/f12 [4194304,4194304] 0 2024-04-20T10:54:29.857 INFO:tasks.workunit.client.1.smithi175.stdout:8/246: write d7/d13/d1d/d24/f2b [1479833,36799] 0 2024-04-20T10:54:29.858 INFO:tasks.workunit.client.1.smithi175.stdout:3/195: getdents d7/d19/d35 0 2024-04-20T10:54:29.861 INFO:tasks.workunit.client.1.smithi175.stdout:8/247: rename d7/d13/d1d/d24/d39/c41 to d7/d13/d1d/c4b 0 2024-04-20T10:54:29.862 INFO:tasks.workunit.client.1.smithi175.stdout:8/248: rename d7/d13/c16 to d7/d2c/c4c 0 2024-04-20T10:54:29.863 INFO:tasks.workunit.client.1.smithi175.stdout:8/249: creat d7/d2c/f4d x:0 0 0 2024-04-20T10:54:29.864 INFO:tasks.workunit.client.1.smithi175.stdout:2/171: dwrite d1/f3 [0,4194304] 0 2024-04-20T10:54:29.865 INFO:tasks.workunit.client.1.smithi175.stdout:2/172: write d1/d7/f34 [501327,107420] 0 2024-04-20T10:54:29.865 INFO:tasks.workunit.client.1.smithi175.stdout:2/173: getdents d1/d7/d1e/d36 0 2024-04-20T10:54:29.866 INFO:tasks.workunit.client.1.smithi175.stdout:3/196: dread d7/d21/fa [0,4194304] 0 2024-04-20T10:54:29.867 INFO:tasks.workunit.client.1.smithi175.stdout:2/174: creat d1/d7/d1e/d32/f3b x:0 0 0 2024-04-20T10:54:29.871 INFO:tasks.workunit.client.1.smithi175.stdout:3/197: link d7/d19/d33/f3b d7/d21/f41 0 2024-04-20T10:54:29.875 INFO:tasks.workunit.client.1.smithi175.stdout:2/175: write d1/f3 [2796205,98093] 0 2024-04-20T10:54:29.876 INFO:tasks.workunit.client.1.smithi175.stdout:2/176: chown d1/d7/d1e/d32/d21/d29/c14 61392830 1 2024-04-20T10:54:29.877 INFO:tasks.workunit.client.1.smithi175.stdout:2/177: dread d1/f11 [4194304,4194304] 0 2024-04-20T10:54:29.877 INFO:tasks.workunit.client.1.smithi175.stdout:2/178: dread - d1/d7/d1e/d32/f3b zero size 2024-04-20T10:54:29.878 INFO:tasks.workunit.client.1.smithi175.stdout:3/198: rename d7/d21/d16/d22/f2e to d7/d10/f42 0 2024-04-20T10:54:29.879 INFO:tasks.workunit.client.1.smithi175.stdout:8/250: dwrite d7/f19 [0,4194304] 0 2024-04-20T10:54:29.907 INFO:tasks.workunit.client.1.smithi175.stdout:8/251: dwrite d7/d13/f3a [0,4194304] 0 2024-04-20T10:54:29.918 INFO:tasks.workunit.client.1.smithi175.stdout:8/252: dread d7/d2c/f3c [0,4194304] 0 2024-04-20T10:54:29.930 INFO:tasks.workunit.client.1.smithi175.stdout:8/253: dwrite d7/d13/d1d/f47 [0,4194304] 0 2024-04-20T10:54:29.930 INFO:tasks.workunit.client.1.smithi175.stdout:8/254: chown d7/d13/d1d/d24/d26/l49 55 1 2024-04-20T10:54:29.932 INFO:tasks.workunit.client.1.smithi175.stdout:8/255: creat d7/d13/d1d/f4e x:0 0 0 2024-04-20T10:54:29.932 INFO:tasks.workunit.client.1.smithi175.stdout:8/256: chown d7/cb 115949367 1 2024-04-20T10:54:29.934 INFO:tasks.workunit.client.1.smithi175.stdout:8/257: link d7/d13/f40 d7/f4f 0 2024-04-20T10:54:29.934 INFO:tasks.workunit.client.1.smithi175.stdout:8/258: truncate d7/d13/f40 681764 0 2024-04-20T10:54:29.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/259: creat d7/d13/f50 x:0 0 0 2024-04-20T10:54:29.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/260: truncate d7/d13/d1d/f2f 1857817 0 2024-04-20T10:54:29.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/261: chown d7/d13/d1d/d24/d26 1 1 2024-04-20T10:54:29.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/262: truncate d7/f1b 355324 0 2024-04-20T10:54:29.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/263: stat d7/d13/d1d/l34 0 2024-04-20T10:54:29.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/264: write d7/d13/f40 [1079534,87786] 0 2024-04-20T10:54:29.935 INFO:tasks.workunit.client.1.smithi175.stdout:8/265: write d7/d13/d1d/f4e [984247,65045] 0 2024-04-20T10:54:29.936 INFO:tasks.workunit.client.1.smithi175.stdout:8/266: truncate d7/fd 1855939 0 2024-04-20T10:54:29.937 INFO:tasks.workunit.client.1.smithi175.stdout:8/267: rename d7/d2c/f3c to d7/d13/d1d/d24/d26/f51 0 2024-04-20T10:54:29.938 INFO:tasks.workunit.client.1.smithi175.stdout:8/268: link d7/d13/d1d/d24/l3e d7/d2c/l52 0 2024-04-20T10:54:29.939 INFO:tasks.workunit.client.1.smithi175.stdout:8/269: truncate d7/d13/d1d/d24/f4a 515008 0 2024-04-20T10:54:29.944 INFO:tasks.workunit.client.1.smithi175.stdout:8/270: dread d7/f4f [0,4194304] 0 2024-04-20T10:54:29.945 INFO:tasks.workunit.client.1.smithi175.stdout:8/271: symlink d7/d13/l53 0 2024-04-20T10:54:29.945 INFO:tasks.workunit.client.1.smithi175.stdout:8/272: truncate d7/d13/d1d/f2f 2898918 0 2024-04-20T10:54:29.970 INFO:tasks.workunit.client.1.smithi175.stdout:6/316: sync 2024-04-20T10:54:29.970 INFO:tasks.workunit.client.1.smithi175.stdout:7/288: sync 2024-04-20T10:54:29.970 INFO:tasks.workunit.client.1.smithi175.stdout:4/281: sync 2024-04-20T10:54:29.970 INFO:tasks.workunit.client.1.smithi175.stdout:5/288: sync 2024-04-20T10:54:29.970 INFO:tasks.workunit.client.1.smithi175.stdout:1/212: sync 2024-04-20T10:54:29.970 INFO:tasks.workunit.client.1.smithi175.stdout:0/231: sync 2024-04-20T10:54:29.970 INFO:tasks.workunit.client.1.smithi175.stdout:0/232: read df/f10 [1895725,50750] 0 2024-04-20T10:54:29.971 INFO:tasks.workunit.client.1.smithi175.stdout:5/289: link db/d30/c53 db/c57 0 2024-04-20T10:54:29.971 INFO:tasks.workunit.client.1.smithi175.stdout:5/290: write db/d11/f2c [295542,40167] 0 2024-04-20T10:54:29.972 INFO:tasks.workunit.client.1.smithi175.stdout:4/282: mkdir d4/dd/d54/d5f 0 2024-04-20T10:54:29.973 INFO:tasks.workunit.client.1.smithi175.stdout:7/289: mkdir db/d1d/d39/d50/d12/d47/d6a 0 2024-04-20T10:54:29.973 INFO:tasks.workunit.client.1.smithi175.stdout:7/290: chown l4 80 1 2024-04-20T10:54:29.975 INFO:tasks.workunit.client.1.smithi175.stdout:1/213: creat d0/d8/d13/d2e/f46 x:0 0 0 2024-04-20T10:54:29.975 INFO:tasks.workunit.client.1.smithi175.stdout:5/291: rename db/d1f/d31/d35/l48 to db/d11/d25/d41/l58 0 2024-04-20T10:54:29.976 INFO:tasks.workunit.client.1.smithi175.stdout:6/317: dread d1/d40/f5e [0,4194304] 0 2024-04-20T10:54:29.983 INFO:tasks.workunit.client.1.smithi175.stdout:4/283: mknod d4/dd/d54/c60 0 2024-04-20T10:54:29.983 INFO:tasks.workunit.client.1.smithi175.stdout:6/318: truncate d1/d5/d12/f35 947514 0 2024-04-20T10:54:29.983 INFO:tasks.workunit.client.1.smithi175.stdout:3/199: getdents d7/d21/d16/d22/d2c 0 2024-04-20T10:54:29.983 INFO:tasks.workunit.client.1.smithi175.stdout:9/250: getdents d6 0 2024-04-20T10:54:29.984 INFO:tasks.workunit.client.1.smithi175.stdout:3/200: mknod d7/d21/d16/d22/d2c/c43 0 2024-04-20T10:54:29.987 INFO:tasks.workunit.client.1.smithi175.stdout:9/251: creat d6/d1b/f47 x:0 0 0 2024-04-20T10:54:29.987 INFO:tasks.workunit.client.1.smithi175.stdout:4/284: rename d4/d23/d2e/d30 to d4/d27/d61 0 2024-04-20T10:54:29.988 INFO:tasks.workunit.client.1.smithi175.stdout:6/319: dread d1/d40/d29/f4b [0,4194304] 0 2024-04-20T10:54:29.988 INFO:tasks.workunit.client.1.smithi175.stdout:6/320: chown d1/d5/f6 452481 1 2024-04-20T10:54:29.988 INFO:tasks.workunit.client.1.smithi175.stdout:3/201: getdents d7/d19/d33 0 2024-04-20T10:54:29.990 INFO:tasks.workunit.client.1.smithi175.stdout:3/202: write d7/d10/f42 [43771,56209] 0 2024-04-20T10:54:29.990 INFO:tasks.workunit.client.1.smithi175.stdout:3/203: fsync d7/d21/f2f 0 2024-04-20T10:54:29.991 INFO:tasks.workunit.client.1.smithi175.stdout:6/321: creat d1/d40/d63/f77 x:0 0 0 2024-04-20T10:54:29.993 INFO:tasks.workunit.client.1.smithi175.stdout:6/322: creat d1/d40/d46/d60/d6b/f78 x:0 0 0 2024-04-20T10:54:29.998 INFO:tasks.workunit.client.1.smithi175.stdout:1/214: dwrite d0/d8/d13/d2e/f44 [0,4194304] 0 2024-04-20T10:54:29.999 INFO:tasks.workunit.client.1.smithi175.stdout:8/273: fsync d7/d13/f40 0 2024-04-20T10:54:30.005 INFO:tasks.workunit.client.1.smithi175.stdout:5/292: dwrite f2 [4194304,4194304] 0 2024-04-20T10:54:30.005 INFO:tasks.workunit.client.1.smithi175.stdout:5/293: chown db/d11/d1a/f39 2783 1 2024-04-20T10:54:30.005 INFO:tasks.workunit.client.1.smithi175.stdout:5/294: chown db/d11 0 1 2024-04-20T10:54:30.006 INFO:tasks.workunit.client.1.smithi175.stdout:2/179: rmdir d1/d7 39 2024-04-20T10:54:30.009 INFO:tasks.workunit.client.1.smithi175.stdout:5/295: symlink db/d30/l59 0 2024-04-20T10:54:30.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/323: dwrite d1/d40/d29/f67 [0,4194304] 0 2024-04-20T10:54:30.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/324: chown d1/d40/d49/c57 1358372877 1 2024-04-20T10:54:30.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/325: chown d1/d5/d12/f14 254 1 2024-04-20T10:54:30.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/326: chown d1/d40/d29/f2f 28829290 1 2024-04-20T10:54:30.013 INFO:tasks.workunit.client.1.smithi175.stdout:0/233: dwrite fe [0,4194304] 0 2024-04-20T10:54:30.013 INFO:tasks.workunit.client.1.smithi175.stdout:7/291: dwrite db/f66 [0,4194304] 0 2024-04-20T10:54:30.014 INFO:tasks.workunit.client.1.smithi175.stdout:0/234: stat df/d1a/d22/d24/d37 0 2024-04-20T10:54:30.014 INFO:tasks.workunit.client.1.smithi175.stdout:0/235: read - df/d1a/d28/f42 zero size 2024-04-20T10:54:30.017 INFO:tasks.workunit.client.1.smithi175.stdout:3/204: read d7/d21/fb [904057,90101] 0 2024-04-20T10:54:30.017 INFO:tasks.workunit.client.1.smithi175.stdout:3/205: readlink d7/l1e 0 2024-04-20T10:54:30.017 INFO:tasks.workunit.client.1.smithi175.stdout:3/206: truncate d7/d19/d2a/f2b 702658 0 2024-04-20T10:54:30.017 INFO:tasks.workunit.client.1.smithi175.stdout:3/207: fsync d7/d21/fb 0 2024-04-20T10:54:30.020 INFO:tasks.workunit.client.1.smithi175.stdout:8/274: dwrite d7/d13/d1d/d24/d26/f51 [0,4194304] 0 2024-04-20T10:54:30.027 INFO:tasks.workunit.client.1.smithi175.stdout:1/215: dwrite d0/d8/f30 [0,4194304] 0 2024-04-20T10:54:30.033 INFO:tasks.workunit.client.1.smithi175.stdout:9/252: dwrite f3 [0,4194304] 0 2024-04-20T10:54:30.033 INFO:tasks.workunit.client.1.smithi175.stdout:9/253: fdatasync d6/d1b/d2f/f38 0 2024-04-20T10:54:30.033 INFO:tasks.workunit.client.1.smithi175.stdout:9/254: chown d6/f39 4647316 1 2024-04-20T10:54:30.036 INFO:tasks.workunit.client.1.smithi175.stdout:3/208: dwrite d7/fe [0,4194304] 0 2024-04-20T10:54:30.036 INFO:tasks.workunit.client.1.smithi175.stdout:3/209: chown d7/d21/d16/d22/d2c 104819 1 2024-04-20T10:54:30.036 INFO:tasks.workunit.client.1.smithi175.stdout:3/210: write d7/d21/d16/f23 [4676347,64538] 0 2024-04-20T10:54:30.038 INFO:tasks.workunit.client.1.smithi175.stdout:9/255: dread d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:30.041 INFO:tasks.workunit.client.1.smithi175.stdout:9/256: write d6/f20 [287511,17793] 0 2024-04-20T10:54:30.044 INFO:tasks.workunit.client.1.smithi175.stdout:1/216: dwrite d0/d8/f12 [0,4194304] 0 2024-04-20T10:54:30.268 INFO:tasks.workunit.client.1.smithi175.stdout:6/327: mknod d1/d40/d46/d60/d6b/c79 0 2024-04-20T10:54:30.269 INFO:tasks.workunit.client.1.smithi175.stdout:5/296: truncate f2 2229347 0 2024-04-20T10:54:30.271 INFO:tasks.workunit.client.1.smithi175.stdout:7/292: rename db/d1d/d39/d50/d12/f21 to db/d1d/d39/d50/d12/f6b 0 2024-04-20T10:54:30.272 INFO:tasks.workunit.client.1.smithi175.stdout:0/236: getdents df/d17 0 2024-04-20T10:54:30.272 INFO:tasks.workunit.client.1.smithi175.stdout:0/237: chown df/d1a 346160 1 2024-04-20T10:54:30.272 INFO:tasks.workunit.client.1.smithi175.stdout:0/238: write df/d2e/f47 [916802,4667] 0 2024-04-20T10:54:30.272 INFO:tasks.workunit.client.1.smithi175.stdout:0/239: dread df/d19/f1e [0,4194304] 0 2024-04-20T10:54:30.272 INFO:tasks.workunit.client.1.smithi175.stdout:0/240: chown df/d19/f1e 215 1 2024-04-20T10:54:30.273 INFO:tasks.workunit.client.1.smithi175.stdout:8/275: mknod d7/d13/d1d/d24/c54 0 2024-04-20T10:54:30.278 INFO:tasks.workunit.client.1.smithi175.stdout:3/211: chown d7/d19/c1d 2096605 1 2024-04-20T10:54:30.278 INFO:tasks.workunit.client.1.smithi175.stdout:0/241: dread df/f38 [0,4194304] 0 2024-04-20T10:54:30.278 INFO:tasks.workunit.client.1.smithi175.stdout:0/242: fdatasync df/f1c 0 2024-04-20T10:54:30.278 INFO:tasks.workunit.client.1.smithi175.stdout:0/243: readlink df/d19/l41 0 2024-04-20T10:54:30.280 INFO:tasks.workunit.client.1.smithi175.stdout:1/217: creat d0/d8/d13/d2e/f47 x:0 0 0 2024-04-20T10:54:30.281 INFO:tasks.workunit.client.1.smithi175.stdout:6/328: mkdir d1/d5/d12/d73/d7a 0 2024-04-20T10:54:30.283 INFO:tasks.workunit.client.1.smithi175.stdout:5/297: mkdir db/d30/d46/d4b/d4f/d5a 0 2024-04-20T10:54:30.285 INFO:tasks.workunit.client.1.smithi175.stdout:7/293: creat db/d1d/d29/d2a/d41/f6c x:0 0 0 2024-04-20T10:54:30.285 INFO:tasks.workunit.client.1.smithi175.stdout:7/294: write db/fd [2433177,130684] 0 2024-04-20T10:54:30.285 INFO:tasks.workunit.client.1.smithi175.stdout:8/276: rename d7/d2c to d7/d55 0 2024-04-20T10:54:30.287 INFO:tasks.workunit.client.1.smithi175.stdout:0/244: mknod df/d1a/d22/c4a 0 2024-04-20T10:54:30.287 INFO:tasks.workunit.client.1.smithi175.stdout:3/212: write d7/d21/fd [1789850,15777] 0 2024-04-20T10:54:30.288 INFO:tasks.workunit.client.1.smithi175.stdout:1/218: truncate d0/d8/f45 4098163 0 2024-04-20T10:54:30.290 INFO:tasks.workunit.client.1.smithi175.stdout:7/295: mkdir db/d61/d6d 0 2024-04-20T10:54:30.292 INFO:tasks.workunit.client.1.smithi175.stdout:8/277: unlink d7/f14 0 2024-04-20T10:54:30.292 INFO:tasks.workunit.client.1.smithi175.stdout:8/278: truncate d7/d13/d1d/f1e 5796132 0 2024-04-20T10:54:30.292 INFO:tasks.workunit.client.1.smithi175.stdout:8/279: stat d7/cb 0 2024-04-20T10:54:30.292 INFO:tasks.workunit.client.1.smithi175.stdout:6/329: write d1/d40/d29/f67 [843368,121853] 0 2024-04-20T10:54:30.297 INFO:tasks.workunit.client.1.smithi175.stdout:3/213: rename d7/d19/d35/f38 to d7/d19/d35/f44 0 2024-04-20T10:54:30.297 INFO:tasks.workunit.client.1.smithi175.stdout:0/245: getdents df/d19 0 2024-04-20T10:54:30.297 INFO:tasks.workunit.client.1.smithi175.stdout:1/219: creat d0/d29/d33/f48 x:0 0 0 2024-04-20T10:54:30.297 INFO:tasks.workunit.client.1.smithi175.stdout:5/298: rename db/d11/d25/d38/l3f to db/d1f/d31/l5b 0 2024-04-20T10:54:30.297 INFO:tasks.workunit.client.1.smithi175.stdout:5/299: readlink db/d11/d1a/l50 0 2024-04-20T10:54:30.297 INFO:tasks.workunit.client.1.smithi175.stdout:5/300: stat db/d1f/d31/d35/c3c 0 2024-04-20T10:54:30.299 INFO:tasks.workunit.client.1.smithi175.stdout:7/296: mknod db/d1d/d29/d2a/d41/d59/c6e 0 2024-04-20T10:54:30.299 INFO:tasks.workunit.client.1.smithi175.stdout:7/297: getdents db/d1d/d60 0 2024-04-20T10:54:30.303 INFO:tasks.workunit.client.1.smithi175.stdout:3/214: mknod d7/d19/d33/c45 0 2024-04-20T10:54:30.303 INFO:tasks.workunit.client.1.smithi175.stdout:3/215: read - d7/d21/d16/d22/d2c/f34 zero size 2024-04-20T10:54:30.304 INFO:tasks.workunit.client.1.smithi175.stdout:5/301: creat db/d30/d46/d4b/f5c x:0 0 0 2024-04-20T10:54:30.305 INFO:tasks.workunit.client.1.smithi175.stdout:3/216: mknod d7/d10/c46 0 2024-04-20T10:54:30.305 INFO:tasks.workunit.client.1.smithi175.stdout:3/217: chown d7/d21/d16 1 1 2024-04-20T10:54:30.305 INFO:tasks.workunit.client.1.smithi175.stdout:3/218: dread - d7/d21/d16/d22/d2c/d1f/f39 zero size 2024-04-20T10:54:30.306 INFO:tasks.workunit.client.1.smithi175.stdout:3/219: mkdir d7/d21/d16/d47 0 2024-04-20T10:54:30.307 INFO:tasks.workunit.client.1.smithi175.stdout:8/280: dwrite d7/d13/f40 [0,4194304] 0 2024-04-20T10:54:30.311 INFO:tasks.workunit.client.1.smithi175.stdout:8/281: getdents d7/d55 0 2024-04-20T10:54:30.316 INFO:tasks.workunit.client.1.smithi175.stdout:3/220: dread d7/d21/d16/f23 [0,4194304] 0 2024-04-20T10:54:30.317 INFO:tasks.workunit.client.1.smithi175.stdout:2/180: sync 2024-04-20T10:54:30.317 INFO:tasks.workunit.client.1.smithi175.stdout:9/257: sync 2024-04-20T10:54:30.317 INFO:tasks.workunit.client.1.smithi175.stdout:2/181: chown d1/d7/d1e/d32/f1d 61929 1 2024-04-20T10:54:30.317 INFO:tasks.workunit.client.1.smithi175.stdout:4/285: sync 2024-04-20T10:54:30.319 INFO:tasks.workunit.client.1.smithi175.stdout:2/182: symlink d1/d7/l3c 0 2024-04-20T10:54:30.319 INFO:tasks.workunit.client.1.smithi175.stdout:2/183: dread - d1/d7/d1e/d32/f1b zero size 2024-04-20T10:54:30.321 INFO:tasks.workunit.client.1.smithi175.stdout:6/330: dread d1/d5/fa [0,4194304] 0 2024-04-20T10:54:30.321 INFO:tasks.workunit.client.1.smithi175.stdout:4/286: creat d4/d23/f62 x:0 0 0 2024-04-20T10:54:30.323 INFO:tasks.workunit.client.1.smithi175.stdout:2/184: link d1/d7/d1e/d32/d21/d29/f39 d1/d7/d1f/f3d 0 2024-04-20T10:54:30.326 INFO:tasks.workunit.client.1.smithi175.stdout:4/287: dread d4/d27/f2c [0,4194304] 0 2024-04-20T10:54:30.327 INFO:tasks.workunit.client.1.smithi175.stdout:4/288: fdatasync f1 0 2024-04-20T10:54:30.327 INFO:tasks.workunit.client.1.smithi175.stdout:4/289: fsync d4/dd/d54/f4a 0 2024-04-20T10:54:30.327 INFO:tasks.workunit.client.1.smithi175.stdout:6/331: truncate d1/d37/f48 1198878 0 2024-04-20T10:54:30.328 INFO:tasks.workunit.client.1.smithi175.stdout:2/185: dread d1/d7/d1e/d32/d21/d29/f18 [0,4194304] 0 2024-04-20T10:54:30.328 INFO:tasks.workunit.client.1.smithi175.stdout:9/258: read d6/d10/f1e [310214,21020] 0 2024-04-20T10:54:30.328 INFO:tasks.workunit.client.1.smithi175.stdout:7/298: dwrite db/f1c [4194304,4194304] 0 2024-04-20T10:54:30.328 INFO:tasks.workunit.client.1.smithi175.stdout:7/299: fsync db/d1d/d39/d50/d12/f19 0 2024-04-20T10:54:30.330 INFO:tasks.workunit.client.1.smithi175.stdout:7/300: link db/d1d/f42 db/d1d/d29/f6f 0 2024-04-20T10:54:30.331 INFO:tasks.workunit.client.1.smithi175.stdout:0/246: dwrite df/f10 [0,4194304] 0 2024-04-20T10:54:30.332 INFO:tasks.workunit.client.1.smithi175.stdout:6/332: mkdir d1/d5/d12/d7b 0 2024-04-20T10:54:30.332 INFO:tasks.workunit.client.1.smithi175.stdout:0/247: stat c7 0 2024-04-20T10:54:30.332 INFO:tasks.workunit.client.1.smithi175.stdout:7/301: mknod db/d61/d6d/c70 0 2024-04-20T10:54:30.332 INFO:tasks.workunit.client.1.smithi175.stdout:6/333: mkdir d1/d40/d63/d7c 0 2024-04-20T10:54:30.332 INFO:tasks.workunit.client.1.smithi175.stdout:7/302: symlink db/d1d/d60/l71 0 2024-04-20T10:54:30.333 INFO:tasks.workunit.client.1.smithi175.stdout:4/290: dread d4/d27/f1c [0,4194304] 0 2024-04-20T10:54:30.333 INFO:tasks.workunit.client.1.smithi175.stdout:6/334: unlink d1/d40/d29/c5a 0 2024-04-20T10:54:30.335 INFO:tasks.workunit.client.1.smithi175.stdout:8/282: dwrite d7/d13/d1d/f4e [0,4194304] 0 2024-04-20T10:54:30.335 INFO:tasks.workunit.client.1.smithi175.stdout:7/303: getdents db 0 2024-04-20T10:54:30.336 INFO:tasks.workunit.client.1.smithi175.stdout:4/291: creat d4/d23/d2e/f63 x:0 0 0 2024-04-20T10:54:30.337 INFO:tasks.workunit.client.1.smithi175.stdout:6/335: getdents d1/d40/d46/d60/d68 0 2024-04-20T10:54:30.341 INFO:tasks.workunit.client.1.smithi175.stdout:9/259: dread d6/fe [0,4194304] 0 2024-04-20T10:54:30.341 INFO:tasks.workunit.client.1.smithi175.stdout:7/304: creat db/d1d/d39/d50/d12/d47/d6a/f72 x:0 0 0 2024-04-20T10:54:30.343 INFO:tasks.workunit.client.1.smithi175.stdout:4/292: link d4/d27/d61/f42 d4/d27/d25/f64 0 2024-04-20T10:54:30.344 INFO:tasks.workunit.client.1.smithi175.stdout:6/336: link d1/f3e d1/d40/d46/d60/d6b/f7d 0 2024-04-20T10:54:30.345 INFO:tasks.workunit.client.1.smithi175.stdout:0/248: dread fe [0,4194304] 0 2024-04-20T10:54:30.346 INFO:tasks.workunit.client.1.smithi175.stdout:6/337: unlink d1/d5/f17 0 2024-04-20T10:54:30.350 INFO:tasks.workunit.client.1.smithi175.stdout:8/283: write d7/d13/d1d/f47 [828958,84763] 0 2024-04-20T10:54:30.351 INFO:tasks.workunit.client.1.smithi175.stdout:6/338: mkdir d1/d40/d46/d60/d68/d7e 0 2024-04-20T10:54:30.352 INFO:tasks.workunit.client.1.smithi175.stdout:0/249: creat df/d1a/d28/f4b x:0 0 0 2024-04-20T10:54:30.354 INFO:tasks.workunit.client.1.smithi175.stdout:0/250: symlink df/d1a/l4c 0 2024-04-20T10:54:30.354 INFO:tasks.workunit.client.1.smithi175.stdout:0/251: write df/d1a/d22/d24/d37/d48/f49 [675438,107570] 0 2024-04-20T10:54:30.354 INFO:tasks.workunit.client.1.smithi175.stdout:9/260: write f3 [1934840,67857] 0 2024-04-20T10:54:30.354 INFO:tasks.workunit.client.1.smithi175.stdout:0/252: truncate df/f1c 3640512 0 2024-04-20T10:54:30.355 INFO:tasks.workunit.client.1.smithi175.stdout:9/261: truncate d6/d10/f1e 448004 0 2024-04-20T10:54:30.355 INFO:tasks.workunit.client.1.smithi175.stdout:9/262: write d6/fe [4248466,63273] 0 2024-04-20T10:54:30.355 INFO:tasks.workunit.client.1.smithi175.stdout:9/263: fdatasync d6/f17 0 2024-04-20T10:54:30.356 INFO:tasks.workunit.client.1.smithi175.stdout:9/264: mkdir d6/d1b/d2f/d48 0 2024-04-20T10:54:30.357 INFO:tasks.workunit.client.1.smithi175.stdout:6/339: write d1/d5/f45 [2149881,58357] 0 2024-04-20T10:54:30.357 INFO:tasks.workunit.client.1.smithi175.stdout:9/265: creat d6/d1b/d2f/d48/f49 x:0 0 0 2024-04-20T10:54:30.357 INFO:tasks.workunit.client.1.smithi175.stdout:5/302: dwrite db/d11/f2d [0,4194304] 0 2024-04-20T10:54:30.357 INFO:tasks.workunit.client.1.smithi175.stdout:6/340: write d1/f18 [535608,46039] 0 2024-04-20T10:54:30.359 INFO:tasks.workunit.client.1.smithi175.stdout:9/266: creat d6/f4a x:0 0 0 2024-04-20T10:54:30.359 INFO:tasks.workunit.client.1.smithi175.stdout:9/267: stat f5 0 2024-04-20T10:54:30.360 INFO:tasks.workunit.client.1.smithi175.stdout:6/341: mkdir d1/d5/d12/d7f 0 2024-04-20T10:54:30.360 INFO:tasks.workunit.client.1.smithi175.stdout:6/342: stat d1/c4a 0 2024-04-20T10:54:30.360 INFO:tasks.workunit.client.1.smithi175.stdout:6/343: chown d1 82528 1 2024-04-20T10:54:30.363 INFO:tasks.workunit.client.1.smithi175.stdout:6/344: rename d1/d40/d29/f36 to d1/d5/d12/d73/d7a/f80 0 2024-04-20T10:54:30.364 INFO:tasks.workunit.client.1.smithi175.stdout:6/345: truncate d1/d40/d29/f4b 3762785 0 2024-04-20T10:54:30.370 INFO:tasks.workunit.client.1.smithi175.stdout:0/253: write df/d17/f2a [1456372,5305] 0 2024-04-20T10:54:30.372 INFO:tasks.workunit.client.1.smithi175.stdout:0/254: symlink df/d17/l4d 0 2024-04-20T10:54:30.373 INFO:tasks.workunit.client.1.smithi175.stdout:0/255: truncate df/d19/f1e 529392 0 2024-04-20T10:54:30.373 INFO:tasks.workunit.client.1.smithi175.stdout:0/256: truncate df/f11 1431864 0 2024-04-20T10:54:30.375 INFO:tasks.workunit.client.1.smithi175.stdout:0/257: mkdir df/d1a/d22/d24/d37/d48/d4e 0 2024-04-20T10:54:30.375 INFO:tasks.workunit.client.1.smithi175.stdout:0/258: read f5 [3315426,96073] 0 2024-04-20T10:54:30.375 INFO:tasks.workunit.client.1.smithi175.stdout:0/259: dread - df/d1a/d28/f43 zero size 2024-04-20T10:54:30.376 INFO:tasks.workunit.client.1.smithi175.stdout:2/186: dwrite d1/d7/d1e/d32/f31 [4194304,4194304] 0 2024-04-20T10:54:30.376 INFO:tasks.workunit.client.1.smithi175.stdout:2/187: fdatasync d1/d7/d1e/d32/d21/d29/f19 0 2024-04-20T10:54:30.376 INFO:tasks.workunit.client.1.smithi175.stdout:3/221: dwrite d7/d21/d16/d22/d2c/f3c [0,4194304] 0 2024-04-20T10:54:30.376 INFO:tasks.workunit.client.1.smithi175.stdout:3/222: write d7/d21/f41 [459356,10552] 0 2024-04-20T10:54:30.376 INFO:tasks.workunit.client.1.smithi175.stdout:3/223: write d7/d21/d16/d22/d2c/f34 [96120,57303] 0 2024-04-20T10:54:30.376 INFO:tasks.workunit.client.1.smithi175.stdout:0/260: mkdir df/d17/d2f/d4f 0 2024-04-20T10:54:30.377 INFO:tasks.workunit.client.1.smithi175.stdout:1/220: dwrite d0/d8/d13/d2e/f47 [0,4194304] 0 2024-04-20T10:54:30.379 INFO:tasks.workunit.client.1.smithi175.stdout:2/188: getdents d1/d7/d1f 0 2024-04-20T10:54:30.379 INFO:tasks.workunit.client.1.smithi175.stdout:2/189: write d1/d7/d1e/d32/d21/f37 [5025548,8883] 0 2024-04-20T10:54:30.381 INFO:tasks.workunit.client.1.smithi175.stdout:3/224: truncate d7/fe 2068045 0 2024-04-20T10:54:30.381 INFO:tasks.workunit.client.1.smithi175.stdout:3/225: write d7/f14 [4323093,127399] 0 2024-04-20T10:54:30.382 INFO:tasks.workunit.client.1.smithi175.stdout:0/261: symlink df/d19/l50 0 2024-04-20T10:54:30.382 INFO:tasks.workunit.client.1.smithi175.stdout:0/262: dread - df/f3a zero size 2024-04-20T10:54:30.383 INFO:tasks.workunit.client.1.smithi175.stdout:1/221: creat d0/f49 x:0 0 0 2024-04-20T10:54:30.383 INFO:tasks.workunit.client.1.smithi175.stdout:1/222: chown d0/d8/d13/f24 59582 1 2024-04-20T10:54:30.383 INFO:tasks.workunit.client.1.smithi175.stdout:1/223: read - d0/d3e/f41 zero size 2024-04-20T10:54:30.384 INFO:tasks.workunit.client.1.smithi175.stdout:1/224: write d0/f10 [383553,90833] 0 2024-04-20T10:54:30.384 INFO:tasks.workunit.client.1.smithi175.stdout:3/226: mkdir d7/d21/d16/d22/d2c/d1f/d48 0 2024-04-20T10:54:30.386 INFO:tasks.workunit.client.1.smithi175.stdout:0/263: creat df/d19/f51 x:0 0 0 2024-04-20T10:54:30.386 INFO:tasks.workunit.client.1.smithi175.stdout:0/264: fdatasync df/d1a/d28/f42 0 2024-04-20T10:54:30.386 INFO:tasks.workunit.client.1.smithi175.stdout:7/305: dwrite db/f46 [0,4194304] 0 2024-04-20T10:54:30.386 INFO:tasks.workunit.client.1.smithi175.stdout:4/293: dwrite d4/f20 [4194304,4194304] 0 2024-04-20T10:54:30.387 INFO:tasks.workunit.client.1.smithi175.stdout:1/225: getdents d0/d8/d13/d2e 0 2024-04-20T10:54:30.387 INFO:tasks.workunit.client.1.smithi175.stdout:1/226: chown d0/d8/d13/c3b 18039 1 2024-04-20T10:54:30.387 INFO:tasks.workunit.client.1.smithi175.stdout:6/346: dwrite d1/d5/d12/f56 [0,4194304] 0 2024-04-20T10:54:30.387 INFO:tasks.workunit.client.1.smithi175.stdout:6/347: getdents d1/d40/d63/d7c 0 2024-04-20T10:54:30.388 INFO:tasks.workunit.client.1.smithi175.stdout:3/227: mkdir d7/d21/d16/d49 0 2024-04-20T10:54:30.389 INFO:tasks.workunit.client.1.smithi175.stdout:8/284: dwrite d7/d13/d1d/d24/d39/f48 [0,4194304] 0 2024-04-20T10:54:30.389 INFO:tasks.workunit.client.1.smithi175.stdout:5/303: dwrite db/d11/f56 [0,4194304] 0 2024-04-20T10:54:30.389 INFO:tasks.workunit.client.1.smithi175.stdout:0/265: creat df/d17/f52 x:0 0 0 2024-04-20T10:54:30.389 INFO:tasks.workunit.client.1.smithi175.stdout:0/266: fdatasync df/f13 0 2024-04-20T10:54:30.392 INFO:tasks.workunit.client.1.smithi175.stdout:3/228: write d7/d21/d16/f23 [3805907,82592] 0 2024-04-20T10:54:30.398 INFO:tasks.workunit.client.1.smithi175.stdout:7/306: rename db/d1d/d39/d50/d12/d47/l69 to db/d61/l73 0 2024-04-20T10:54:30.398 INFO:tasks.workunit.client.1.smithi175.stdout:4/294: mkdir d4/dd/d2d/d33/d5b/d65 0 2024-04-20T10:54:30.398 INFO:tasks.workunit.client.1.smithi175.stdout:4/295: write d4/d27/f52 [71367,76747] 0 2024-04-20T10:54:30.398 INFO:tasks.workunit.client.1.smithi175.stdout:4/296: fsync d4/dd/d54/f5a 0 2024-04-20T10:54:30.398 INFO:tasks.workunit.client.1.smithi175.stdout:6/348: link d1/d37/f6f d1/d40/d46/d60/d68/d7e/f81 0 2024-04-20T10:54:30.398 INFO:tasks.workunit.client.1.smithi175.stdout:6/349: stat d1/d40/d49/f62 0 2024-04-20T10:54:30.400 INFO:tasks.workunit.client.1.smithi175.stdout:8/285: unlink d7/f4f 0 2024-04-20T10:54:30.402 INFO:tasks.workunit.client.1.smithi175.stdout:5/304: creat db/d30/d46/f5d x:0 0 0 2024-04-20T10:54:30.404 INFO:tasks.workunit.client.1.smithi175.stdout:9/268: dwrite d6/d1b/d2f/d48/f49 [0,4194304] 0 2024-04-20T10:54:30.404 INFO:tasks.workunit.client.1.smithi175.stdout:3/229: unlink d7/d19/f40 0 2024-04-20T10:54:30.404 INFO:tasks.workunit.client.1.smithi175.stdout:3/230: chown d7/d21/d16 24441701 1 2024-04-20T10:54:30.406 INFO:tasks.workunit.client.1.smithi175.stdout:1/227: rename d0/d8/d13/d2e/c40 to d0/d3e/c4a 0 2024-04-20T10:54:30.406 INFO:tasks.workunit.client.1.smithi175.stdout:1/228: stat d0/d8/d13 0 2024-04-20T10:54:30.407 INFO:tasks.workunit.client.1.smithi175.stdout:8/286: mkdir d7/d13/d1d/d56 0 2024-04-20T10:54:30.408 INFO:tasks.workunit.client.1.smithi175.stdout:0/267: dwrite df/f13 [0,4194304] 0 2024-04-20T10:54:30.408 INFO:tasks.workunit.client.1.smithi175.stdout:0/268: write df/d1a/d28/f4b [688815,95138] 0 2024-04-20T10:54:30.409 INFO:tasks.workunit.client.1.smithi175.stdout:5/305: mknod db/d11/d25/c5e 0 2024-04-20T10:54:30.412 INFO:tasks.workunit.client.1.smithi175.stdout:9/269: mknod d6/d1b/d2f/d48/c4b 0 2024-04-20T10:54:30.412 INFO:tasks.workunit.client.1.smithi175.stdout:9/270: dread - d6/d1b/d2f/f45 zero size 2024-04-20T10:54:30.414 INFO:tasks.workunit.client.1.smithi175.stdout:1/229: creat d0/d8/d13/d2e/d35/f4b x:0 0 0 2024-04-20T10:54:30.414 INFO:tasks.workunit.client.1.smithi175.stdout:1/230: fsync d0/d8/f30 0 2024-04-20T10:54:30.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/269: write df/d19/f1e [1478399,108244] 0 2024-04-20T10:54:30.417 INFO:tasks.workunit.client.1.smithi175.stdout:5/306: unlink l8 0 2024-04-20T10:54:30.417 INFO:tasks.workunit.client.1.smithi175.stdout:7/307: dread db/d1d/d39/d50/f3e [0,4194304] 0 2024-04-20T10:54:30.418 INFO:tasks.workunit.client.1.smithi175.stdout:9/271: creat d6/f4c x:0 0 0 2024-04-20T10:54:30.418 INFO:tasks.workunit.client.1.smithi175.stdout:9/272: readlink d6/d1b/d26/l3e 0 2024-04-20T10:54:30.418 INFO:tasks.workunit.client.1.smithi175.stdout:0/270: fsync df/d19/f1e 0 2024-04-20T10:54:30.419 INFO:tasks.workunit.client.1.smithi175.stdout:1/231: symlink d0/d8/d13/d2e/d35/l4c 0 2024-04-20T10:54:30.420 INFO:tasks.workunit.client.1.smithi175.stdout:5/307: link db/d1f/f18 db/d11/d25/d38/d40/f5f 0 2024-04-20T10:54:30.420 INFO:tasks.workunit.client.1.smithi175.stdout:5/308: fsync db/d11/f2d 0 2024-04-20T10:54:30.421 INFO:tasks.workunit.client.1.smithi175.stdout:7/308: symlink db/d1d/d29/d2a/l74 0 2024-04-20T10:54:30.422 INFO:tasks.workunit.client.1.smithi175.stdout:7/309: chown db/d1d/d39/d50/d12/c27 3 1 2024-04-20T10:54:30.422 INFO:tasks.workunit.client.1.smithi175.stdout:7/310: readlink db/d61/l73 0 2024-04-20T10:54:30.422 INFO:tasks.workunit.client.1.smithi175.stdout:7/311: chown db/d61/d6d/c70 23574 1 2024-04-20T10:54:30.422 INFO:tasks.workunit.client.1.smithi175.stdout:6/350: dwrite d1/d5/d12/f35 [0,4194304] 0 2024-04-20T10:54:30.424 INFO:tasks.workunit.client.1.smithi175.stdout:0/271: rmdir df/d2e 39 2024-04-20T10:54:30.426 INFO:tasks.workunit.client.1.smithi175.stdout:4/297: dwrite d4/dd/d54/f4a [0,4194304] 0 2024-04-20T10:54:30.426 INFO:tasks.workunit.client.1.smithi175.stdout:4/298: chown d4/d27/d25/c2b 259571 1 2024-04-20T10:54:30.426 INFO:tasks.workunit.client.1.smithi175.stdout:4/299: chown d4/d27/fa 9 1 2024-04-20T10:54:30.426 INFO:tasks.workunit.client.1.smithi175.stdout:1/232: truncate d0/d8/d13/d2e/d35/f37 3815064 0 2024-04-20T10:54:30.426 INFO:tasks.workunit.client.1.smithi175.stdout:1/233: truncate d0/d8/d13/d2e/f46 797964 0 2024-04-20T10:54:30.427 INFO:tasks.workunit.client.1.smithi175.stdout:5/309: rmdir db 39 2024-04-20T10:54:30.429 INFO:tasks.workunit.client.1.smithi175.stdout:9/273: dread d6/f25 [0,4194304] 0 2024-04-20T10:54:30.429 INFO:tasks.workunit.client.1.smithi175.stdout:9/274: truncate d6/d1b/d2f/f41 766722 0 2024-04-20T10:54:30.429 INFO:tasks.workunit.client.1.smithi175.stdout:9/275: chown d6/d10 65078 1 2024-04-20T10:54:30.429 INFO:tasks.workunit.client.1.smithi175.stdout:7/312: symlink db/d1d/d39/d50/d12/d47/d6a/l75 0 2024-04-20T10:54:30.429 INFO:tasks.workunit.client.1.smithi175.stdout:7/313: write db/d1d/d39/d50/f52 [57054,127301] 0 2024-04-20T10:54:30.429 INFO:tasks.workunit.client.1.smithi175.stdout:7/314: truncate db/d1d/d39/d50/d12/f18 5948549 0 2024-04-20T10:54:30.429 INFO:tasks.workunit.client.1.smithi175.stdout:7/315: chown db/d1d/d39/d50/d12/c2e 17243 1 2024-04-20T10:54:30.431 INFO:tasks.workunit.client.1.smithi175.stdout:4/300: symlink d4/dd/d54/d5f/l66 0 2024-04-20T10:54:30.432 INFO:tasks.workunit.client.1.smithi175.stdout:1/234: creat d0/d8/f4d x:0 0 0 2024-04-20T10:54:30.432 INFO:tasks.workunit.client.1.smithi175.stdout:1/235: write d0/d29/f32 [2732197,84561] 0 2024-04-20T10:54:30.432 INFO:tasks.workunit.client.1.smithi175.stdout:1/236: readlink d0/d8/d13/d2e/d35/l4c 0 2024-04-20T10:54:30.432 INFO:tasks.workunit.client.1.smithi175.stdout:5/310: mkdir db/d11/d25/d41/d60 0 2024-04-20T10:54:30.433 INFO:tasks.workunit.client.1.smithi175.stdout:8/287: dwrite d7/d13/d1d/d24/d39/f3b [4194304,4194304] 0 2024-04-20T10:54:30.433 INFO:tasks.workunit.client.1.smithi175.stdout:8/288: fsync d7/d13/d1d/d24/f2b 0 2024-04-20T10:54:30.433 INFO:tasks.workunit.client.1.smithi175.stdout:9/276: truncate d6/d1b/d26/f2b 20969 0 2024-04-20T10:54:30.433 INFO:tasks.workunit.client.1.smithi175.stdout:6/351: dread d1/d5/d12/f56 [0,4194304] 0 2024-04-20T10:54:30.434 INFO:tasks.workunit.client.1.smithi175.stdout:0/272: dread df/d1a/d22/d24/d37/d48/f49 [0,4194304] 0 2024-04-20T10:54:30.434 INFO:tasks.workunit.client.1.smithi175.stdout:7/316: mkdir db/d1d/d60/d76 0 2024-04-20T10:54:30.435 INFO:tasks.workunit.client.1.smithi175.stdout:4/301: mkdir d4/dd/d2d/d33/d58/d67 0 2024-04-20T10:54:30.436 INFO:tasks.workunit.client.1.smithi175.stdout:1/237: link d0/d8/f1f d0/d29/d33/f4e 0 2024-04-20T10:54:30.440 INFO:tasks.workunit.client.1.smithi175.stdout:3/231: dwrite d7/f14 [0,4194304] 0 2024-04-20T10:54:30.441 INFO:tasks.workunit.client.1.smithi175.stdout:5/311: getdents db/d30/d46 0 2024-04-20T10:54:30.441 INFO:tasks.workunit.client.1.smithi175.stdout:5/312: stat ca 0 2024-04-20T10:54:30.443 INFO:tasks.workunit.client.1.smithi175.stdout:4/302: symlink d4/d23/d2e/l68 0 2024-04-20T10:54:30.447 INFO:tasks.workunit.client.1.smithi175.stdout:3/232: creat d7/d10/f4a x:0 0 0 2024-04-20T10:54:30.447 INFO:tasks.workunit.client.1.smithi175.stdout:8/289: write d7/d13/f3a [2590861,25937] 0 2024-04-20T10:54:30.447 INFO:tasks.workunit.client.1.smithi175.stdout:8/290: fsync d7/d13/d1d/f2f 0 2024-04-20T10:54:30.447 INFO:tasks.workunit.client.1.smithi175.stdout:8/291: readlink d7/d13/d1d/d24/d38/l43 0 2024-04-20T10:54:30.447 INFO:tasks.workunit.client.1.smithi175.stdout:8/292: write d7/f1b [1069033,86960] 0 2024-04-20T10:54:30.447 INFO:tasks.workunit.client.1.smithi175.stdout:5/313: mknod db/d30/d46/d4b/d4f/d5a/c61 0 2024-04-20T10:54:30.448 INFO:tasks.workunit.client.1.smithi175.stdout:6/352: write d1/d40/f3c [6842949,85588] 0 2024-04-20T10:54:30.449 INFO:tasks.workunit.client.1.smithi175.stdout:6/353: stat d1/d40/d49/c57 0 2024-04-20T10:54:30.450 INFO:tasks.workunit.client.1.smithi175.stdout:4/303: mkdir d4/dd/d2d/d43/d69 0 2024-04-20T10:54:30.452 INFO:tasks.workunit.client.1.smithi175.stdout:7/317: dread db/d1d/d39/d50/d2c/f2d [0,4194304] 0 2024-04-20T10:54:30.452 INFO:tasks.workunit.client.1.smithi175.stdout:8/293: unlink d7/d13/d1d/d24/d26/f2e 0 2024-04-20T10:54:30.452 INFO:tasks.workunit.client.1.smithi175.stdout:8/294: stat d7/c46 0 2024-04-20T10:54:30.452 INFO:tasks.workunit.client.1.smithi175.stdout:8/295: fdatasync d7/d13/f32 0 2024-04-20T10:54:30.453 INFO:tasks.workunit.client.1.smithi175.stdout:9/277: dwrite d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:30.453 INFO:tasks.workunit.client.1.smithi175.stdout:9/278: write d6/d1b/f47 [111855,34233] 0 2024-04-20T10:54:30.453 INFO:tasks.workunit.client.1.smithi175.stdout:9/279: fsync d6/f16 0 2024-04-20T10:54:30.453 INFO:tasks.workunit.client.1.smithi175.stdout:9/280: dread - d6/f3c zero size 2024-04-20T10:54:30.453 INFO:tasks.workunit.client.1.smithi175.stdout:5/314: mkdir db/d11/d25/d62 0 2024-04-20T10:54:30.453 INFO:tasks.workunit.client.1.smithi175.stdout:6/354: mknod d1/d40/d46/d60/d68/c82 0 2024-04-20T10:54:30.456 INFO:tasks.workunit.client.1.smithi175.stdout:4/304: creat d4/d27/f6a x:0 0 0 2024-04-20T10:54:30.457 INFO:tasks.workunit.client.1.smithi175.stdout:7/318: creat db/d1d/d29/d2a/d41/d59/f77 x:0 0 0 2024-04-20T10:54:30.457 INFO:tasks.workunit.client.1.smithi175.stdout:7/319: chown l4 266 1 2024-04-20T10:54:30.458 INFO:tasks.workunit.client.1.smithi175.stdout:8/296: unlink d7/d13/d1d/d24/f4a 0 2024-04-20T10:54:30.460 INFO:tasks.workunit.client.1.smithi175.stdout:9/281: rmdir d6/d40 0 2024-04-20T10:54:30.462 INFO:tasks.workunit.client.1.smithi175.stdout:5/315: unlink db/l13 0 2024-04-20T10:54:30.462 INFO:tasks.workunit.client.1.smithi175.stdout:5/316: chown db/d11/d1a/l23 7502481 1 2024-04-20T10:54:30.462 INFO:tasks.workunit.client.1.smithi175.stdout:6/355: mkdir d1/d37/d83 0 2024-04-20T10:54:30.463 INFO:tasks.workunit.client.1.smithi175.stdout:6/356: fsync d1/d37/f6f 0 2024-04-20T10:54:30.463 INFO:tasks.workunit.client.1.smithi175.stdout:9/282: dread d6/f20 [0,4194304] 0 2024-04-20T10:54:30.463 INFO:tasks.workunit.client.1.smithi175.stdout:9/283: dread - d6/f3c zero size 2024-04-20T10:54:30.464 INFO:tasks.workunit.client.1.smithi175.stdout:4/305: creat d4/dd/d5e/f6b x:0 0 0 2024-04-20T10:54:30.464 INFO:tasks.workunit.client.1.smithi175.stdout:1/238: dwrite d0/d8/d13/d2e/d35/f4b [0,4194304] 0 2024-04-20T10:54:30.464 INFO:tasks.workunit.client.1.smithi175.stdout:7/320: mknod db/d1d/d29/d2a/d41/d59/c78 0 2024-04-20T10:54:30.465 INFO:tasks.workunit.client.1.smithi175.stdout:8/297: creat d7/d13/d1d/d24/d38/f57 x:0 0 0 2024-04-20T10:54:30.465 INFO:tasks.workunit.client.1.smithi175.stdout:8/298: chown d7/cb 8143277 1 2024-04-20T10:54:30.466 INFO:tasks.workunit.client.1.smithi175.stdout:5/317: unlink db/d11/d1a/l24 0 2024-04-20T10:54:30.467 INFO:tasks.workunit.client.1.smithi175.stdout:6/357: link d1/d40/d49/c57 d1/d40/d46/d60/d68/c84 0 2024-04-20T10:54:30.468 INFO:tasks.workunit.client.1.smithi175.stdout:9/284: creat d6/d1b/d2f/d48/f4d x:0 0 0 2024-04-20T10:54:30.470 INFO:tasks.workunit.client.1.smithi175.stdout:4/306: rename d4/d23/d2e/l56 to d4/dd/d2d/d33/d3c/l6c 0 2024-04-20T10:54:30.473 INFO:tasks.workunit.client.1.smithi175.stdout:7/321: creat db/d1d/d39/d50/d12/d47/f79 x:0 0 0 2024-04-20T10:54:30.473 INFO:tasks.workunit.client.1.smithi175.stdout:8/299: stat d7/d55/l52 0 2024-04-20T10:54:30.474 INFO:tasks.workunit.client.1.smithi175.stdout:5/318: creat db/f63 x:0 0 0 2024-04-20T10:54:30.475 INFO:tasks.workunit.client.1.smithi175.stdout:6/358: rename d1/d5/d12/d22/f6e to d1/d37/f85 0 2024-04-20T10:54:30.476 INFO:tasks.workunit.client.1.smithi175.stdout:4/307: mkdir d4/d6d 0 2024-04-20T10:54:30.477 INFO:tasks.workunit.client.1.smithi175.stdout:7/322: dread f6 [0,4194304] 0 2024-04-20T10:54:30.477 INFO:tasks.workunit.client.1.smithi175.stdout:5/319: write db/d1f/d31/f33 [3895380,19759] 0 2024-04-20T10:54:30.478 INFO:tasks.workunit.client.1.smithi175.stdout:5/320: fsync db/d30/d46/f5d 0 2024-04-20T10:54:30.478 INFO:tasks.workunit.client.1.smithi175.stdout:9/285: rename d6/c2c to d6/d1b/d2f/d48/c4e 0 2024-04-20T10:54:30.479 INFO:tasks.workunit.client.1.smithi175.stdout:4/308: symlink d4/dd/d2d/d33/d58/d67/l6e 0 2024-04-20T10:54:30.480 INFO:tasks.workunit.client.1.smithi175.stdout:4/309: write d4/d27/d61/f42 [963245,17276] 0 2024-04-20T10:54:30.480 INFO:tasks.workunit.client.1.smithi175.stdout:1/239: dwrite d0/fe [0,4194304] 0 2024-04-20T10:54:30.480 INFO:tasks.workunit.client.1.smithi175.stdout:8/300: read d7/d13/d1d/d24/d26/f2a [1025885,112780] 0 2024-04-20T10:54:30.480 INFO:tasks.workunit.client.1.smithi175.stdout:7/323: creat db/d1d/d39/f7a x:0 0 0 2024-04-20T10:54:30.481 INFO:tasks.workunit.client.1.smithi175.stdout:9/286: rename d6/f25 to d6/d1b/d2f/f4f 0 2024-04-20T10:54:30.481 INFO:tasks.workunit.client.1.smithi175.stdout:9/287: write d6/d1b/f47 [1054845,26827] 0 2024-04-20T10:54:30.482 INFO:tasks.workunit.client.1.smithi175.stdout:4/310: link d4/d23/d2e/l47 d4/dd/l6f 0 2024-04-20T10:54:30.487 INFO:tasks.workunit.client.1.smithi175.stdout:1/240: link d0/f49 d0/d29/f4f 0 2024-04-20T10:54:30.487 INFO:tasks.workunit.client.1.smithi175.stdout:8/301: symlink d7/l58 0 2024-04-20T10:54:30.488 INFO:tasks.workunit.client.1.smithi175.stdout:7/324: rename db/d1d/d29/d2a/d41/d59/l67 to db/d1d/d39/d50/d12/l7b 0 2024-04-20T10:54:30.488 INFO:tasks.workunit.client.1.smithi175.stdout:7/325: fdatasync db/d1d/d39/d50/d2c/f53 0 2024-04-20T10:54:30.488 INFO:tasks.workunit.client.1.smithi175.stdout:7/326: truncate db/d1d/d39/d50/d2c/f32 831259 0 2024-04-20T10:54:30.488 INFO:tasks.workunit.client.1.smithi175.stdout:7/327: chown db/d1d/d29/d2a/d41/d59/f77 307402 1 2024-04-20T10:54:30.488 INFO:tasks.workunit.client.1.smithi175.stdout:7/328: fdatasync db/d1d/d39/d50/f52 0 2024-04-20T10:54:30.489 INFO:tasks.workunit.client.1.smithi175.stdout:2/190: dwrite d1/d7/d1e/d32/f3b [0,4194304] 0 2024-04-20T10:54:30.489 INFO:tasks.workunit.client.1.smithi175.stdout:2/191: dread - d1/d7/f22 zero size 2024-04-20T10:54:30.492 INFO:tasks.workunit.client.1.smithi175.stdout:9/288: creat d6/d1b/d42/f50 x:0 0 0 2024-04-20T10:54:30.498 INFO:tasks.workunit.client.1.smithi175.stdout:1/241: dread d0/d8/f18 [0,4194304] 0 2024-04-20T10:54:30.499 INFO:tasks.workunit.client.1.smithi175.stdout:6/359: dwrite d1/d5/d12/f35 [0,4194304] 0 2024-04-20T10:54:30.499 INFO:tasks.workunit.client.1.smithi175.stdout:6/360: truncate d1/d40/d29/f5d 106854 0 2024-04-20T10:54:30.499 INFO:tasks.workunit.client.1.smithi175.stdout:9/289: mkdir d6/d1b/d42/d51 0 2024-04-20T10:54:30.501 INFO:tasks.workunit.client.1.smithi175.stdout:3/233: fsync d7/d21/f41 0 2024-04-20T10:54:30.501 INFO:tasks.workunit.client.1.smithi175.stdout:5/321: dwrite db/d1f/f20 [0,4194304] 0 2024-04-20T10:54:30.501 INFO:tasks.workunit.client.1.smithi175.stdout:4/311: mknod d4/d27/c70 0 2024-04-20T10:54:30.504 INFO:tasks.workunit.client.1.smithi175.stdout:1/242: symlink d0/l50 0 2024-04-20T10:54:30.506 INFO:tasks.workunit.client.1.smithi175.stdout:6/361: creat d1/d40/d46/d60/f86 x:0 0 0 2024-04-20T10:54:30.507 INFO:tasks.workunit.client.1.smithi175.stdout:9/290: creat d6/d1b/d42/f52 x:0 0 0 2024-04-20T10:54:30.512 INFO:tasks.workunit.client.1.smithi175.stdout:4/312: unlink d4/d27/c70 0 2024-04-20T10:54:30.516 INFO:tasks.workunit.client.1.smithi175.stdout:2/192: dwrite d1/d7/d1e/d32/d21/d29/f19 [4194304,4194304] 0 2024-04-20T10:54:30.516 INFO:tasks.workunit.client.1.smithi175.stdout:2/193: getdents d1/d7/d1e/d32/d38 0 2024-04-20T10:54:30.518 INFO:tasks.workunit.client.1.smithi175.stdout:7/329: dwrite db/d1d/d39/d50/d12/f2f [0,4194304] 0 2024-04-20T10:54:30.524 INFO:tasks.workunit.client.1.smithi175.stdout:1/243: rmdir d0/d8/d13/d2e 39 2024-04-20T10:54:30.526 INFO:tasks.workunit.client.1.smithi175.stdout:6/362: link d1/d40/c26 d1/d5/d12/d7f/c87 0 2024-04-20T10:54:30.528 INFO:tasks.workunit.client.1.smithi175.stdout:9/291: mknod d6/d1b/d42/d51/c53 0 2024-04-20T10:54:30.528 INFO:tasks.workunit.client.1.smithi175.stdout:3/234: mknod d7/d19/c4b 0 2024-04-20T10:54:30.529 INFO:tasks.workunit.client.1.smithi175.stdout:7/330: dread db/f14 [0,4194304] 0 2024-04-20T10:54:30.529 INFO:tasks.workunit.client.1.smithi175.stdout:7/331: readlink db/d1d/d29/d2a/l57 0 2024-04-20T10:54:30.529 INFO:tasks.workunit.client.1.smithi175.stdout:7/332: chown db/d1d/d39/d50/d2c/c3d 3 1 2024-04-20T10:54:30.532 INFO:tasks.workunit.client.1.smithi175.stdout:2/194: creat d1/d7/d1e/f3e x:0 0 0 2024-04-20T10:54:30.532 INFO:tasks.workunit.client.1.smithi175.stdout:8/302: fsync d7/d13/d1d/d24/d38/f57 0 2024-04-20T10:54:30.532 INFO:tasks.workunit.client.1.smithi175.stdout:8/303: dread - d7/d13/f33 zero size 2024-04-20T10:54:30.532 INFO:tasks.workunit.client.1.smithi175.stdout:1/244: write d0/d8/f30 [2767800,124995] 0 2024-04-20T10:54:30.534 INFO:tasks.workunit.client.1.smithi175.stdout:4/313: dwrite d4/d27/d61/f46 [0,4194304] 0 2024-04-20T10:54:30.534 INFO:tasks.workunit.client.1.smithi175.stdout:4/314: stat d4/f1a 0 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:5/322: dwrite db/d1f/d31/f4c [0,4194304] 0 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/292: symlink d6/d1b/d2f/l54 0 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:5/323: chown db/d11/f56 3495 1 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/293: chown d6/d10/l23 164905 1 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/294: readlink d6/d10/l2d 0 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/295: chown d6/d33 102166643 1 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/296: chown d6/d1b/f47 31754592 1 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/297: chown d6/l18 45986 1 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/298: write f3 [3938723,24336] 0 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/299: fsync d6/f17 0 2024-04-20T10:54:30.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/300: getdents d6/d33 0 2024-04-20T10:54:30.536 INFO:tasks.workunit.client.1.smithi175.stdout:3/235: rmdir d7/d21/d16/d47 0 2024-04-20T10:54:30.538 INFO:tasks.workunit.client.1.smithi175.stdout:7/333: creat db/d61/d6d/f7c x:0 0 0 2024-04-20T10:54:30.540 INFO:tasks.workunit.client.1.smithi175.stdout:8/304: truncate d7/d13/d1d/d24/d26/f2a 1006946 0 2024-04-20T10:54:30.542 INFO:tasks.workunit.client.1.smithi175.stdout:6/363: dwrite d1/f18 [0,4194304] 0 2024-04-20T10:54:30.542 INFO:tasks.workunit.client.1.smithi175.stdout:6/364: read - d1/d40/d46/d60/d6b/f78 zero size 2024-04-20T10:54:30.544 INFO:tasks.workunit.client.1.smithi175.stdout:4/315: getdents d4/dd/d2d 0 2024-04-20T10:54:30.550 INFO:tasks.workunit.client.1.smithi175.stdout:5/324: unlink db/d11/f56 0 2024-04-20T10:54:30.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/301: mknod d6/d1b/d42/d51/c55 0 2024-04-20T10:54:30.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/302: readlink d6/d10/l37 0 2024-04-20T10:54:30.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/303: write d6/fe [5300742,98409] 0 2024-04-20T10:54:30.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/304: write d6/f39 [182151,102762] 0 2024-04-20T10:54:30.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/305: fdatasync d6/f17 0 2024-04-20T10:54:30.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/306: write d6/d1b/d2f/f38 [698162,48125] 0 2024-04-20T10:54:30.552 INFO:tasks.workunit.client.1.smithi175.stdout:9/307: fdatasync d6/d10/f1a 0 2024-04-20T10:54:30.553 INFO:tasks.workunit.client.1.smithi175.stdout:9/308: read d6/f1d [536943,46278] 0 2024-04-20T10:54:30.554 INFO:tasks.workunit.client.1.smithi175.stdout:8/305: mknod d7/d13/d1d/d56/c59 0 2024-04-20T10:54:30.556 INFO:tasks.workunit.client.1.smithi175.stdout:4/316: read d4/d27/d25/f29 [3038011,59814] 0 2024-04-20T10:54:30.557 INFO:tasks.workunit.client.1.smithi175.stdout:5/325: dread db/d11/f2a [0,4194304] 0 2024-04-20T10:54:30.557 INFO:tasks.workunit.client.1.smithi175.stdout:7/334: getdents db/d1d/d29/d2a/d41/d59 0 2024-04-20T10:54:30.557 INFO:tasks.workunit.client.1.smithi175.stdout:2/195: dwrite d1/f3 [4194304,4194304] 0 2024-04-20T10:54:30.557 INFO:tasks.workunit.client.1.smithi175.stdout:2/196: chown d1/d7/d1e/d32/l1c 0 1 2024-04-20T10:54:30.559 INFO:tasks.workunit.client.1.smithi175.stdout:1/245: write d0/d8/f18 [4114182,119609] 0 2024-04-20T10:54:30.559 INFO:tasks.workunit.client.1.smithi175.stdout:1/246: chown d0/d8/f30 40468 1 2024-04-20T10:54:30.559 INFO:tasks.workunit.client.1.smithi175.stdout:4/317: symlink d4/d27/d61/l71 0 2024-04-20T10:54:30.560 INFO:tasks.workunit.client.1.smithi175.stdout:4/318: read d4/f1a [1058422,102026] 0 2024-04-20T10:54:30.560 INFO:tasks.workunit.client.1.smithi175.stdout:8/306: write d7/f1b [635310,107818] 0 2024-04-20T10:54:30.560 INFO:tasks.workunit.client.1.smithi175.stdout:3/236: dwrite f5 [4194304,4194304] 0 2024-04-20T10:54:30.561 INFO:tasks.workunit.client.1.smithi175.stdout:6/365: dwrite d1/f16 [0,4194304] 0 2024-04-20T10:54:30.562 INFO:tasks.workunit.client.1.smithi175.stdout:7/335: creat db/d1d/f7d x:0 0 0 2024-04-20T10:54:30.563 INFO:tasks.workunit.client.1.smithi175.stdout:2/197: stat d1/d7/c16 0 2024-04-20T10:54:30.563 INFO:tasks.workunit.client.1.smithi175.stdout:2/198: chown d1/le 222 1 2024-04-20T10:54:30.566 INFO:tasks.workunit.client.1.smithi175.stdout:8/307: mknod d7/d55/c5a 0 2024-04-20T10:54:30.570 INFO:tasks.workunit.client.1.smithi175.stdout:4/319: write d4/d27/f15 [1563505,69687] 0 2024-04-20T10:54:30.570 INFO:tasks.workunit.client.1.smithi175.stdout:4/320: chown f1 122 1 2024-04-20T10:54:30.571 INFO:tasks.workunit.client.1.smithi175.stdout:3/237: symlink d7/d21/d16/l4c 0 2024-04-20T10:54:30.573 INFO:tasks.workunit.client.1.smithi175.stdout:6/366: mknod d1/d5/d12/d22/c88 0 2024-04-20T10:54:30.573 INFO:tasks.workunit.client.1.smithi175.stdout:6/367: write d1/d40/d46/d60/d6b/f78 [286610,89878] 0 2024-04-20T10:54:30.574 INFO:tasks.workunit.client.1.smithi175.stdout:8/308: rmdir d7/d13/d1d/d56 39 2024-04-20T10:54:30.574 INFO:tasks.workunit.client.1.smithi175.stdout:8/309: chown d7 934036673 1 2024-04-20T10:54:30.576 INFO:tasks.workunit.client.1.smithi175.stdout:1/247: read d0/d8/f12 [255352,128254] 0 2024-04-20T10:54:30.576 INFO:tasks.workunit.client.1.smithi175.stdout:4/321: creat d4/dd/d5e/f72 x:0 0 0 2024-04-20T10:54:30.576 INFO:tasks.workunit.client.1.smithi175.stdout:4/322: chown d4/dd/d2d/d33/d3c 1733651803 1 2024-04-20T10:54:30.577 INFO:tasks.workunit.client.1.smithi175.stdout:3/238: mknod d7/d10/c4d 0 2024-04-20T10:54:30.578 INFO:tasks.workunit.client.1.smithi175.stdout:6/368: symlink d1/d40/d46/d60/l89 0 2024-04-20T10:54:30.579 INFO:tasks.workunit.client.1.smithi175.stdout:8/310: mkdir d7/d13/d1d/d5b 0 2024-04-20T10:54:30.579 INFO:tasks.workunit.client.1.smithi175.stdout:8/311: readlink d7/d13/d1d/l23 0 2024-04-20T10:54:30.580 INFO:tasks.workunit.client.1.smithi175.stdout:4/323: mkdir d4/dd/d73 0 2024-04-20T10:54:30.580 INFO:tasks.workunit.client.1.smithi175.stdout:4/324: chown d4/dd/d5e/f72 0 1 2024-04-20T10:54:30.581 INFO:tasks.workunit.client.1.smithi175.stdout:4/325: chown d4/d27/f8 4 1 2024-04-20T10:54:30.581 INFO:tasks.workunit.client.1.smithi175.stdout:3/239: getdents d7/d21/d16/d22/d2c/d1f 0 2024-04-20T10:54:30.583 INFO:tasks.workunit.client.1.smithi175.stdout:8/312: mknod d7/d13/d1d/d24/c5c 0 2024-04-20T10:54:30.583 INFO:tasks.workunit.client.1.smithi175.stdout:7/336: dwrite db/d1d/d39/d50/d12/f2f [0,4194304] 0 2024-04-20T10:54:30.583 INFO:tasks.workunit.client.1.smithi175.stdout:7/337: dread - db/d1d/d29/d2a/f4b zero size 2024-04-20T10:54:30.583 INFO:tasks.workunit.client.1.smithi175.stdout:7/338: stat db/c51 0 2024-04-20T10:54:30.584 INFO:tasks.workunit.client.1.smithi175.stdout:4/326: mkdir d4/dd/d5e/d74 0 2024-04-20T10:54:30.584 INFO:tasks.workunit.client.1.smithi175.stdout:7/339: dread db/d1d/d39/d50/f52 [0,4194304] 0 2024-04-20T10:54:30.586 INFO:tasks.workunit.client.1.smithi175.stdout:4/327: creat d4/dd/d2d/d43/d69/f75 x:0 0 0 2024-04-20T10:54:30.587 INFO:tasks.workunit.client.1.smithi175.stdout:7/340: truncate db/d1d/d39/d50/f28 694586 0 2024-04-20T10:54:30.587 INFO:tasks.workunit.client.1.smithi175.stdout:7/341: chown db/d1d/d29/d2a/l57 8 1 2024-04-20T10:54:30.588 INFO:tasks.workunit.client.1.smithi175.stdout:3/240: dread d7/d21/fa [0,4194304] 0 2024-04-20T10:54:30.592 INFO:tasks.workunit.client.1.smithi175.stdout:5/326: rename db/d11/d1a/l21 to db/d1f/d31/d35/l64 0 2024-04-20T10:54:30.592 INFO:tasks.workunit.client.1.smithi175.stdout:4/328: mknod d4/dd/d2d/d33/d3c/c76 0 2024-04-20T10:54:30.595 INFO:tasks.workunit.client.1.smithi175.stdout:7/342: dread db/f66 [0,4194304] 0 2024-04-20T10:54:30.595 INFO:tasks.workunit.client.1.smithi175.stdout:7/343: write db/f66 [4733410,53861] 0 2024-04-20T10:54:30.599 INFO:tasks.workunit.client.1.smithi175.stdout:6/369: dwrite d1/d40/d46/d60/d68/d7e/f81 [0,4194304] 0 2024-04-20T10:54:30.599 INFO:tasks.workunit.client.1.smithi175.stdout:1/248: rename d0/d29/d33 to d0/d51 0 2024-04-20T10:54:30.599 INFO:tasks.workunit.client.1.smithi175.stdout:1/249: write d0/d8/f1f [4578684,21976] 0 2024-04-20T10:54:30.599 INFO:tasks.workunit.client.1.smithi175.stdout:5/327: mknod db/d11/d25/d41/c65 0 2024-04-20T10:54:30.600 INFO:tasks.workunit.client.1.smithi175.stdout:3/241: dread d7/d10/f42 [0,4194304] 0 2024-04-20T10:54:30.602 INFO:tasks.workunit.client.1.smithi175.stdout:6/370: symlink d1/d40/d49/l8a 0 2024-04-20T10:54:30.604 INFO:tasks.workunit.client.1.smithi175.stdout:8/313: rename d7/d13/d1d/d24/d26/f2a to d7/d13/d1d/d24/f5d 0 2024-04-20T10:54:30.606 INFO:tasks.workunit.client.1.smithi175.stdout:5/328: mkdir db/d11/d25/d38/d40/d66 0 2024-04-20T10:54:30.606 INFO:tasks.workunit.client.1.smithi175.stdout:3/242: rmdir d7 39 2024-04-20T10:54:30.607 INFO:tasks.workunit.client.1.smithi175.stdout:6/371: mknod d1/d40/d63/d7c/c8b 0 2024-04-20T10:54:30.607 INFO:tasks.workunit.client.1.smithi175.stdout:6/372: stat d1/d40/f5e 0 2024-04-20T10:54:30.608 INFO:tasks.workunit.client.1.smithi175.stdout:2/199: dwrite d1/d7/d1f/f2c [0,4194304] 0 2024-04-20T10:54:30.608 INFO:tasks.workunit.client.1.smithi175.stdout:7/344: rename db/d1d/d39/d50/d12/f18 to db/f7e 0 2024-04-20T10:54:30.609 INFO:tasks.workunit.client.1.smithi175.stdout:7/345: stat db/d61/d6d 0 2024-04-20T10:54:30.609 INFO:tasks.workunit.client.1.smithi175.stdout:8/314: mknod d7/d13/d1d/d56/c5e 0 2024-04-20T10:54:30.609 INFO:tasks.workunit.client.1.smithi175.stdout:8/315: dread - d7/d13/d1d/d24/d38/f57 zero size 2024-04-20T10:54:30.609 INFO:tasks.workunit.client.1.smithi175.stdout:3/243: rename d7/d10/c13 to d7/d10/c4e 0 2024-04-20T10:54:30.611 INFO:tasks.workunit.client.1.smithi175.stdout:2/200: rename d1/c9 to d1/d7/d1e/d32/d21/c3f 0 2024-04-20T10:54:30.611 INFO:tasks.workunit.client.1.smithi175.stdout:2/201: write d1/d7/d1e/d32/d21/d29/f39 [878462,53110] 0 2024-04-20T10:54:30.611 INFO:tasks.workunit.client.1.smithi175.stdout:4/329: dwrite d4/d23/f32 [0,4194304] 0 2024-04-20T10:54:30.613 INFO:tasks.workunit.client.1.smithi175.stdout:3/244: dread d7/d21/d16/f23 [0,4194304] 0 2024-04-20T10:54:30.613 INFO:tasks.workunit.client.1.smithi175.stdout:7/346: link db/d1d/d39/d50/d2c/f53 db/d61/d6d/f7f 0 2024-04-20T10:54:30.614 INFO:tasks.workunit.client.1.smithi175.stdout:1/250: write d0/f1e [2232475,70421] 0 2024-04-20T10:54:30.615 INFO:tasks.workunit.client.1.smithi175.stdout:8/316: rename d7/d13/d1d/d24/l3e to d7/d55/l5f 0 2024-04-20T10:54:30.616 INFO:tasks.workunit.client.1.smithi175.stdout:3/245: getdents d7/d19/d33 0 2024-04-20T10:54:30.616 INFO:tasks.workunit.client.1.smithi175.stdout:7/347: getdents db/d1d/d39/d50/d2c 0 2024-04-20T10:54:30.617 INFO:tasks.workunit.client.1.smithi175.stdout:2/202: write f0 [2322192,130077] 0 2024-04-20T10:54:30.618 INFO:tasks.workunit.client.1.smithi175.stdout:1/251: creat d0/d51/f52 x:0 0 0 2024-04-20T10:54:30.620 INFO:tasks.workunit.client.1.smithi175.stdout:4/330: rename d4/d27/f6a to d4/d27/d25/f77 0 2024-04-20T10:54:30.623 INFO:tasks.workunit.client.1.smithi175.stdout:8/317: dread d7/d13/d1d/d24/f2b [0,4194304] 0 2024-04-20T10:54:30.623 INFO:tasks.workunit.client.1.smithi175.stdout:8/318: chown c3 451 1 2024-04-20T10:54:30.623 INFO:tasks.workunit.client.1.smithi175.stdout:8/319: chown d7/cb 17 1 2024-04-20T10:54:30.623 INFO:tasks.workunit.client.1.smithi175.stdout:8/320: readlink d7/d55/l5f 0 2024-04-20T10:54:30.623 INFO:tasks.workunit.client.1.smithi175.stdout:3/246: rename d7/d21/l25 to d7/d19/d2a/l4f 0 2024-04-20T10:54:30.623 INFO:tasks.workunit.client.1.smithi175.stdout:3/247: stat d7/d21/d16 0 2024-04-20T10:54:30.623 INFO:tasks.workunit.client.1.smithi175.stdout:4/331: link d4/dd/d2d/d33/c4f d4/dd/d2d/c78 0 2024-04-20T10:54:30.624 INFO:tasks.workunit.client.1.smithi175.stdout:8/321: stat d7/d13/f40 0 2024-04-20T10:54:30.624 INFO:tasks.workunit.client.1.smithi175.stdout:8/322: chown d7/d13/d1d/l23 2991069 1 2024-04-20T10:54:30.626 INFO:tasks.workunit.client.1.smithi175.stdout:7/348: rename db/d1d/d39/d50/d12/f2f to db/d1d/d29/d2a/d41/f80 0 2024-04-20T10:54:30.626 INFO:tasks.workunit.client.1.smithi175.stdout:4/332: dread f1 [0,4194304] 0 2024-04-20T10:54:30.627 INFO:tasks.workunit.client.1.smithi175.stdout:0/273: sync 2024-04-20T10:54:30.627 INFO:tasks.workunit.client.1.smithi175.stdout:0/274: chown df/d1a/d22/d24/d37/d48/d4e 86305587 1 2024-04-20T10:54:30.627 INFO:tasks.workunit.client.1.smithi175.stdout:7/349: dread db/d1d/d39/d50/f28 [0,4194304] 0 2024-04-20T10:54:30.627 INFO:tasks.workunit.client.1.smithi175.stdout:3/248: mkdir d7/d19/d35/d50 0 2024-04-20T10:54:30.628 INFO:tasks.workunit.client.1.smithi175.stdout:4/333: unlink d4/dd/f1e 0 2024-04-20T10:54:30.629 INFO:tasks.workunit.client.1.smithi175.stdout:0/275: rmdir df/d19 39 2024-04-20T10:54:30.631 INFO:tasks.workunit.client.1.smithi175.stdout:1/252: dread d0/d8/d13/d2e/f47 [0,4194304] 0 2024-04-20T10:54:30.631 INFO:tasks.workunit.client.1.smithi175.stdout:7/350: rename db/d1d/d39/d50/c17 to db/d1d/d60/d76/c81 0 2024-04-20T10:54:30.632 INFO:tasks.workunit.client.1.smithi175.stdout:3/249: creat d7/f51 x:0 0 0 2024-04-20T10:54:30.640 INFO:tasks.workunit.client.1.smithi175.stdout:8/323: dread d7/d13/d1d/d24/d26/f51 [0,4194304] 0 2024-04-20T10:54:30.640 INFO:tasks.workunit.client.1.smithi175.stdout:5/329: dwrite db/d30/d46/f5d [0,4194304] 0 2024-04-20T10:54:30.641 INFO:tasks.workunit.client.1.smithi175.stdout:8/324: write d7/d13/d1d/d24/d39/f48 [4880636,115619] 0 2024-04-20T10:54:30.641 INFO:tasks.workunit.client.1.smithi175.stdout:7/351: rename db/d1d/d29/d2a/l57 to db/d1d/d29/d2a/d41/l82 0 2024-04-20T10:54:30.642 INFO:tasks.workunit.client.1.smithi175.stdout:5/330: fdatasync db/d1f/f27 0 2024-04-20T10:54:30.643 INFO:tasks.workunit.client.1.smithi175.stdout:8/325: getdents d7/d13/d1d/d24/d38 0 2024-04-20T10:54:30.644 INFO:tasks.workunit.client.1.smithi175.stdout:8/326: readlink d7/l36 0 2024-04-20T10:54:30.644 INFO:tasks.workunit.client.1.smithi175.stdout:8/327: dread - d7/d13/f50 zero size 2024-04-20T10:54:30.645 INFO:tasks.workunit.client.1.smithi175.stdout:3/250: rename d7/d21/d16/d22/d2c/d1f/f39 to d7/d21/d16/d22/f52 0 2024-04-20T10:54:30.645 INFO:tasks.workunit.client.1.smithi175.stdout:3/251: dread - d7/f51 zero size 2024-04-20T10:54:30.645 INFO:tasks.workunit.client.1.smithi175.stdout:7/352: symlink db/d61/d6d/l83 0 2024-04-20T10:54:30.647 INFO:tasks.workunit.client.1.smithi175.stdout:8/328: rename d7/c8 to d7/d13/d1d/d24/c60 0 2024-04-20T10:54:30.647 INFO:tasks.workunit.client.1.smithi175.stdout:6/373: write d1/d5/f6 [776501,12159] 0 2024-04-20T10:54:30.647 INFO:tasks.workunit.client.1.smithi175.stdout:3/252: creat d7/d21/d16/d22/d2c/d1f/d48/f53 x:0 0 0 2024-04-20T10:54:30.650 INFO:tasks.workunit.client.1.smithi175.stdout:0/276: dwrite df/d17/f20 [0,4194304] 0 2024-04-20T10:54:30.650 INFO:tasks.workunit.client.1.smithi175.stdout:6/374: rmdir d1/d5/d12/d7b 0 2024-04-20T10:54:30.650 INFO:tasks.workunit.client.1.smithi175.stdout:6/375: truncate d1/f16 4271289 0 2024-04-20T10:54:30.651 INFO:tasks.workunit.client.1.smithi175.stdout:3/253: chown d7/d21/cc 21 1 2024-04-20T10:54:30.652 INFO:tasks.workunit.client.1.smithi175.stdout:7/353: fsync db/f7e 0 2024-04-20T10:54:30.652 INFO:tasks.workunit.client.1.smithi175.stdout:7/354: chown db/d1d/d39/d50/d12/f6b 798669 1 2024-04-20T10:54:30.654 INFO:tasks.workunit.client.1.smithi175.stdout:5/331: dread db/d11/f2c [0,4194304] 0 2024-04-20T10:54:30.656 INFO:tasks.workunit.client.1.smithi175.stdout:4/334: dwrite d4/dd/d5e/f6b [0,4194304] 0 2024-04-20T10:54:30.656 INFO:tasks.workunit.client.1.smithi175.stdout:4/335: fdatasync d4/d23/d2e/f63 0 2024-04-20T10:54:30.657 INFO:tasks.workunit.client.1.smithi175.stdout:1/253: dwrite d0/d8/d13/f26 [0,4194304] 0 2024-04-20T10:54:30.658 INFO:tasks.workunit.client.1.smithi175.stdout:6/376: unlink d1/d40/d29/f70 0 2024-04-20T10:54:30.660 INFO:tasks.workunit.client.1.smithi175.stdout:2/203: getdents d1/d7/d1e/d32/d21 0 2024-04-20T10:54:30.662 INFO:tasks.workunit.client.1.smithi175.stdout:1/254: mknod d0/d3e/c53 0 2024-04-20T10:54:30.662 INFO:tasks.workunit.client.1.smithi175.stdout:1/255: fsync d0/ff 0 2024-04-20T10:54:30.664 INFO:tasks.workunit.client.1.smithi175.stdout:6/377: mknod d1/d40/d46/c8c 0 2024-04-20T10:54:30.665 INFO:tasks.workunit.client.1.smithi175.stdout:4/336: write d4/d27/f8 [2786499,98763] 0 2024-04-20T10:54:30.667 INFO:tasks.workunit.client.1.smithi175.stdout:2/204: creat d1/f40 x:0 0 0 2024-04-20T10:54:30.667 INFO:tasks.workunit.client.1.smithi175.stdout:1/256: getdents d0/d8/d13/d2e 0 2024-04-20T10:54:30.668 INFO:tasks.workunit.client.1.smithi175.stdout:4/337: mkdir d4/dd/d54/d5d/d79 0 2024-04-20T10:54:30.670 INFO:tasks.workunit.client.1.smithi175.stdout:2/205: link d1/f40 d1/d7/d1e/d32/f41 0 2024-04-20T10:54:30.670 INFO:tasks.workunit.client.1.smithi175.stdout:2/206: write d1/d7/d1f/f3d [1001562,117213] 0 2024-04-20T10:54:30.670 INFO:tasks.workunit.client.1.smithi175.stdout:1/257: truncate d0/d8/f1f 2009657 0 2024-04-20T10:54:30.670 INFO:tasks.workunit.client.1.smithi175.stdout:1/258: chown d0/d8/c9 13 1 2024-04-20T10:54:30.671 INFO:tasks.workunit.client.1.smithi175.stdout:4/338: creat d4/d27/d61/f7a x:0 0 0 2024-04-20T10:54:30.671 INFO:tasks.workunit.client.1.smithi175.stdout:4/339: fdatasync d4/dd/d54/f4a 0 2024-04-20T10:54:30.671 INFO:tasks.workunit.client.1.smithi175.stdout:4/340: stat d4/d27/d25/f64 0 2024-04-20T10:54:30.671 INFO:tasks.workunit.client.1.smithi175.stdout:2/207: creat d1/d7/d1f/f42 x:0 0 0 2024-04-20T10:54:30.672 INFO:tasks.workunit.client.1.smithi175.stdout:1/259: rename d0/f5 to d0/f54 0 2024-04-20T10:54:30.673 INFO:tasks.workunit.client.1.smithi175.stdout:4/341: creat d4/d27/f7b x:0 0 0 2024-04-20T10:54:30.673 INFO:tasks.workunit.client.1.smithi175.stdout:8/329: dwrite d7/d13/d1d/d24/d39/f48 [0,4194304] 0 2024-04-20T10:54:30.676 INFO:tasks.workunit.client.1.smithi175.stdout:5/332: dwrite db/d30/d46/f5d [0,4194304] 0 2024-04-20T10:54:30.678 INFO:tasks.workunit.client.1.smithi175.stdout:2/208: truncate d1/d7/d1e/d32/f1d 3894109 0 2024-04-20T10:54:30.678 INFO:tasks.workunit.client.1.smithi175.stdout:2/209: chown d1/d7/d1e/d32/d21 198 1 2024-04-20T10:54:30.678 INFO:tasks.workunit.client.1.smithi175.stdout:2/210: chown d1/d7/ff 82663 1 2024-04-20T10:54:30.678 INFO:tasks.workunit.client.1.smithi175.stdout:2/211: fdatasync d1/f33 0 2024-04-20T10:54:30.678 INFO:tasks.workunit.client.1.smithi175.stdout:2/212: chown d1/d7/d1e/d32/d21/d29/f18 3 1 2024-04-20T10:54:30.680 INFO:tasks.workunit.client.1.smithi175.stdout:3/254: dread d7/d10/f42 [0,4194304] 0 2024-04-20T10:54:30.680 INFO:tasks.workunit.client.1.smithi175.stdout:3/255: truncate d7/d19/d2a/f2b 820601 0 2024-04-20T10:54:30.683 INFO:tasks.workunit.client.1.smithi175.stdout:7/355: dwrite db/f46 [0,4194304] 0 2024-04-20T10:54:30.683 INFO:tasks.workunit.client.1.smithi175.stdout:6/378: read d1/d37/f6f [887457,9373] 0 2024-04-20T10:54:30.683 INFO:tasks.workunit.client.1.smithi175.stdout:8/330: dread d7/d13/d1d/d24/f2b [0,4194304] 0 2024-04-20T10:54:30.683 INFO:tasks.workunit.client.1.smithi175.stdout:8/331: chown d7/d13/f17 52 1 2024-04-20T10:54:30.690 INFO:tasks.workunit.client.1.smithi175.stdout:3/256: mkdir d7/d21/d16/d49/d54 0 2024-04-20T10:54:30.690 INFO:tasks.workunit.client.1.smithi175.stdout:7/356: dread db/d1d/d39/d50/ff [4194304,4194304] 0 2024-04-20T10:54:30.690 INFO:tasks.workunit.client.1.smithi175.stdout:3/257: chown d7/d19/d35/d50 1227914 1 2024-04-20T10:54:30.691 INFO:tasks.workunit.client.1.smithi175.stdout:8/332: creat d7/d13/d1d/d5b/f61 x:0 0 0 2024-04-20T10:54:30.691 INFO:tasks.workunit.client.1.smithi175.stdout:8/333: chown d7/d13/d1d/d56 6404 1 2024-04-20T10:54:30.691 INFO:tasks.workunit.client.1.smithi175.stdout:8/334: chown d7/d13/d1d/d24/f2b 75638 1 2024-04-20T10:54:30.691 INFO:tasks.workunit.client.1.smithi175.stdout:8/335: fdatasync d7/d13/d1d/f1e 0 2024-04-20T10:54:30.691 INFO:tasks.workunit.client.1.smithi175.stdout:4/342: dread d4/d23/f32 [0,4194304] 0 2024-04-20T10:54:30.691 INFO:tasks.workunit.client.1.smithi175.stdout:4/343: dread - d4/dd/d2d/f4c zero size 2024-04-20T10:54:30.694 INFO:tasks.workunit.client.1.smithi175.stdout:7/357: link db/d1d/d39/d50/d12/d47/d6a/f72 db/d1d/d29/d2a/f84 0 2024-04-20T10:54:30.694 INFO:tasks.workunit.client.1.smithi175.stdout:8/336: unlink d7/la 0 2024-04-20T10:54:30.694 INFO:tasks.workunit.client.1.smithi175.stdout:3/258: symlink d7/d21/d16/d22/d2c/l55 0 2024-04-20T10:54:30.694 INFO:tasks.workunit.client.1.smithi175.stdout:8/337: truncate d7/d13/f3a 4309405 0 2024-04-20T10:54:30.695 INFO:tasks.workunit.client.1.smithi175.stdout:4/344: rmdir d4/dd/d2d/d33/d58/d67 39 2024-04-20T10:54:30.696 INFO:tasks.workunit.client.1.smithi175.stdout:7/358: rename db/d1d/d39/d50/l16 to db/d61/d6d/l85 0 2024-04-20T10:54:30.696 INFO:tasks.workunit.client.1.smithi175.stdout:7/359: chown db/d61/d6d 112781 1 2024-04-20T10:54:30.696 INFO:tasks.workunit.client.1.smithi175.stdout:3/259: mknod d7/d21/d16/d22/d2c/d1f/c56 0 2024-04-20T10:54:30.697 INFO:tasks.workunit.client.1.smithi175.stdout:8/338: creat d7/d13/d1d/d56/f62 x:0 0 0 2024-04-20T10:54:30.698 INFO:tasks.workunit.client.1.smithi175.stdout:5/333: dwrite db/f63 [0,4194304] 0 2024-04-20T10:54:30.698 INFO:tasks.workunit.client.1.smithi175.stdout:5/334: dread - db/d30/d46/d4b/f4d zero size 2024-04-20T10:54:30.698 INFO:tasks.workunit.client.1.smithi175.stdout:5/335: write db/d11/d1a/f39 [2287279,47115] 0 2024-04-20T10:54:30.698 INFO:tasks.workunit.client.1.smithi175.stdout:4/345: symlink d4/dd/d54/l7c 0 2024-04-20T10:54:30.699 INFO:tasks.workunit.client.1.smithi175.stdout:7/360: creat db/d1d/d29/d2a/f86 x:0 0 0 2024-04-20T10:54:30.700 INFO:tasks.workunit.client.1.smithi175.stdout:8/339: mkdir d7/d13/d1d/d24/d63 0 2024-04-20T10:54:30.700 INFO:tasks.workunit.client.1.smithi175.stdout:6/379: dwrite d1/d5/d12/f27 [0,4194304] 0 2024-04-20T10:54:30.701 INFO:tasks.workunit.client.1.smithi175.stdout:1/260: dwrite d0/f1e [0,4194304] 0 2024-04-20T10:54:30.701 INFO:tasks.workunit.client.1.smithi175.stdout:1/261: readlink d0/l7 0 2024-04-20T10:54:30.703 INFO:tasks.workunit.client.1.smithi175.stdout:5/336: unlink db/d11/d25/d41/l42 0 2024-04-20T10:54:30.704 INFO:tasks.workunit.client.1.smithi175.stdout:4/346: mknod d4/dd/d54/d5d/c7d 0 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:4/347: read - d4/dd/d2d/d43/d69/f75 zero size 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:4/348: write d4/d23/f62 [901562,129556] 0 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:4/349: dread - d4/dd/f13 zero size 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:7/361: dread db/d1d/d39/d50/f55 [0,4194304] 0 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:7/362: chown db/c11 60201245 1 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:7/363: dread - db/d1d/d39/d50/d2c/f63 zero size 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:7/364: dread - db/d1d/d29/d2a/d41/f6c zero size 2024-04-20T10:54:30.705 INFO:tasks.workunit.client.1.smithi175.stdout:8/340: creat d7/d13/d1d/d24/d38/f64 x:0 0 0 2024-04-20T10:54:30.709 INFO:tasks.workunit.client.1.smithi175.stdout:5/337: rename db/l1e to db/d11/d1a/l67 0 2024-04-20T10:54:30.711 INFO:tasks.workunit.client.1.smithi175.stdout:4/350: creat d4/dd/d54/f7e x:0 0 0 2024-04-20T10:54:30.711 INFO:tasks.workunit.client.1.smithi175.stdout:4/351: dread - d4/dd/d2d/d33/d3c/d44/f48 zero size 2024-04-20T10:54:30.712 INFO:tasks.workunit.client.1.smithi175.stdout:8/341: unlink d7/l36 0 2024-04-20T10:54:30.713 INFO:tasks.workunit.client.1.smithi175.stdout:2/213: dread d1/f33 [0,4194304] 0 2024-04-20T10:54:30.713 INFO:tasks.workunit.client.1.smithi175.stdout:5/338: symlink db/d11/d1a/l68 0 2024-04-20T10:54:30.714 INFO:tasks.workunit.client.1.smithi175.stdout:5/339: chown db/d11/d1a/l67 3085 1 2024-04-20T10:54:30.714 INFO:tasks.workunit.client.1.smithi175.stdout:5/340: truncate db/d30/d46/d4b/f5c 422188 0 2024-04-20T10:54:30.714 INFO:tasks.workunit.client.1.smithi175.stdout:4/352: rmdir d4/d27/d25 39 2024-04-20T10:54:30.714 INFO:tasks.workunit.client.1.smithi175.stdout:4/353: write d4/dd/d2d/f4c [548906,53381] 0 2024-04-20T10:54:30.715 INFO:tasks.workunit.client.1.smithi175.stdout:2/214: symlink d1/d7/d1e/d32/d38/l43 0 2024-04-20T10:54:30.715 INFO:tasks.workunit.client.1.smithi175.stdout:5/341: mknod db/d11/d1a/c69 0 2024-04-20T10:54:30.716 INFO:tasks.workunit.client.1.smithi175.stdout:3/260: dwrite f5 [0,4194304] 0 2024-04-20T10:54:30.716 INFO:tasks.workunit.client.1.smithi175.stdout:4/354: mknod d4/dd/d54/d5d/d79/c7f 0 2024-04-20T10:54:30.717 INFO:tasks.workunit.client.1.smithi175.stdout:2/215: creat d1/d7/f44 x:0 0 0 2024-04-20T10:54:30.719 INFO:tasks.workunit.client.1.smithi175.stdout:2/216: dread d1/d7/d1e/d32/d21/d29/f24 [0,4194304] 0 2024-04-20T10:54:30.720 INFO:tasks.workunit.client.1.smithi175.stdout:5/342: symlink db/d11/d25/d38/d40/d66/l6a 0 2024-04-20T10:54:30.721 INFO:tasks.workunit.client.1.smithi175.stdout:2/217: symlink d1/d7/d1e/d32/l45 0 2024-04-20T10:54:30.721 INFO:tasks.workunit.client.1.smithi175.stdout:5/343: getdents db/d11/d25/d38 0 2024-04-20T10:54:30.721 INFO:tasks.workunit.client.1.smithi175.stdout:5/344: write f9 [3792921,106690] 0 2024-04-20T10:54:30.722 INFO:tasks.workunit.client.1.smithi175.stdout:2/218: creat d1/d7/d1e/d32/d21/d29/f46 x:0 0 0 2024-04-20T10:54:30.723 INFO:tasks.workunit.client.1.smithi175.stdout:5/345: symlink db/d11/d25/d38/l6b 0 2024-04-20T10:54:30.723 INFO:tasks.workunit.client.1.smithi175.stdout:2/219: truncate d1/d7/d1e/d32/d21/d29/f18 2893153 0 2024-04-20T10:54:30.725 INFO:tasks.workunit.client.1.smithi175.stdout:7/365: dwrite db/d1d/d39/d50/d12/f19 [0,4194304] 0 2024-04-20T10:54:30.725 INFO:tasks.workunit.client.1.smithi175.stdout:5/346: rename f9 to db/d11/d25/d41/d60/f6c 0 2024-04-20T10:54:30.725 INFO:tasks.workunit.client.1.smithi175.stdout:6/380: dwrite d1/d40/f3c [0,4194304] 0 2024-04-20T10:54:30.726 INFO:tasks.workunit.client.1.smithi175.stdout:2/220: creat d1/d7/d1e/d36/f47 x:0 0 0 2024-04-20T10:54:30.728 INFO:tasks.workunit.client.1.smithi175.stdout:5/347: unlink db/d1f/d31/l5b 0 2024-04-20T10:54:30.728 INFO:tasks.workunit.client.1.smithi175.stdout:5/348: stat db/d11 0 2024-04-20T10:54:30.728 INFO:tasks.workunit.client.1.smithi175.stdout:5/349: write db/d11/f2c [968769,79771] 0 2024-04-20T10:54:30.735 INFO:tasks.workunit.client.1.smithi175.stdout:7/366: write db/d1d/d29/d2a/d41/f80 [2870285,22593] 0 2024-04-20T10:54:30.736 INFO:tasks.workunit.client.1.smithi175.stdout:7/367: read db/f66 [4489994,76777] 0 2024-04-20T10:54:30.737 INFO:tasks.workunit.client.1.smithi175.stdout:5/350: dread db/d1f/d31/d35/f37 [0,4194304] 0 2024-04-20T10:54:30.738 INFO:tasks.workunit.client.1.smithi175.stdout:5/351: chown db/d1f/d31/d35/f37 78648 1 2024-04-20T10:54:30.738 INFO:tasks.workunit.client.1.smithi175.stdout:4/355: dwrite d4/d27/d25/f64 [0,4194304] 0 2024-04-20T10:54:30.739 INFO:tasks.workunit.client.1.smithi175.stdout:7/368: creat db/d1d/d29/d2a/f87 x:0 0 0 2024-04-20T10:54:30.741 INFO:tasks.workunit.client.1.smithi175.stdout:5/352: dread f2 [0,4194304] 0 2024-04-20T10:54:30.741 INFO:tasks.workunit.client.1.smithi175.stdout:4/356: truncate d4/d23/f32 2766089 0 2024-04-20T10:54:30.742 INFO:tasks.workunit.client.1.smithi175.stdout:7/369: truncate db/f66 2933929 0 2024-04-20T10:54:30.743 INFO:tasks.workunit.client.1.smithi175.stdout:5/353: mkdir db/d11/d6d 0 2024-04-20T10:54:30.746 INFO:tasks.workunit.client.1.smithi175.stdout:4/357: truncate d4/d27/d61/f46 2103448 0 2024-04-20T10:54:30.752 INFO:tasks.workunit.client.1.smithi175.stdout:2/221: rename d1/d7/d1e/d32 to d1/d48 0 2024-04-20T10:54:30.754 INFO:tasks.workunit.client.1.smithi175.stdout:4/358: unlink d4/d23/l4d 0 2024-04-20T10:54:30.756 INFO:tasks.workunit.client.1.smithi175.stdout:7/370: rename db/d1d/d39/d50/d2c/f63 to db/d1d/d39/d50/d12/f88 0 2024-04-20T10:54:30.757 INFO:tasks.workunit.client.1.smithi175.stdout:4/359: rmdir d4/d6d 0 2024-04-20T10:54:30.759 INFO:tasks.workunit.client.1.smithi175.stdout:7/371: mknod db/d1d/c89 0 2024-04-20T10:54:30.760 INFO:tasks.workunit.client.1.smithi175.stdout:4/360: creat d4/dd/d2d/d33/d3c/f80 x:0 0 0 2024-04-20T10:54:30.760 INFO:tasks.workunit.client.1.smithi175.stdout:4/361: chown d4/dd/d2d/d33/d3c/c76 0 1 2024-04-20T10:54:30.762 INFO:tasks.workunit.client.1.smithi175.stdout:7/372: symlink db/d1d/d29/d2a/d41/l8a 0 2024-04-20T10:54:30.762 INFO:tasks.workunit.client.1.smithi175.stdout:7/373: write db/f1c [396123,101991] 0 2024-04-20T10:54:30.768 INFO:tasks.workunit.client.1.smithi175.stdout:2/222: dwrite d1/d48/d21/d29/f46 [0,4194304] 0 2024-04-20T10:54:30.768 INFO:tasks.workunit.client.1.smithi175.stdout:2/223: chown d1/d7/d1e/f3e 51604 1 2024-04-20T10:54:30.768 INFO:tasks.workunit.client.1.smithi175.stdout:7/374: dread db/d1d/d39/d50/f3e [0,4194304] 0 2024-04-20T10:54:30.768 INFO:tasks.workunit.client.1.smithi175.stdout:4/362: mknod d4/dd/d2d/d33/d3c/d44/c81 0 2024-04-20T10:54:31.020 INFO:tasks.workunit.client.1.smithi175.stdout:2/224: rmdir d1/d7/d1e/d36 39 2024-04-20T10:54:31.021 INFO:tasks.workunit.client.1.smithi175.stdout:7/375: getdents db/d1d/d29 0 2024-04-20T10:54:31.021 INFO:tasks.workunit.client.1.smithi175.stdout:7/376: readlink db/d1d/d29/d2a/d41/d59/l5d 0 2024-04-20T10:54:31.021 INFO:tasks.workunit.client.1.smithi175.stdout:4/363: creat d4/d23/d2e/f82 x:0 0 0 2024-04-20T10:54:31.021 INFO:tasks.workunit.client.1.smithi175.stdout:5/354: read db/d11/f2c [362009,35806] 0 2024-04-20T10:54:31.021 INFO:tasks.workunit.client.1.smithi175.stdout:5/355: chown db/d30/d46/d4b/d4f/f52 0 1 2024-04-20T10:54:31.022 INFO:tasks.workunit.client.1.smithi175.stdout:7/377: mknod db/d1d/d39/d50/d2c/c8b 0 2024-04-20T10:54:31.023 INFO:tasks.workunit.client.1.smithi175.stdout:9/309: sync 2024-04-20T10:54:31.023 INFO:tasks.workunit.client.1.smithi175.stdout:2/225: dread d1/d7/d1f/f3d [0,4194304] 0 2024-04-20T10:54:31.023 INFO:tasks.workunit.client.1.smithi175.stdout:7/378: truncate db/d1d/d39/d50/d2c/f2d 1958414 0 2024-04-20T10:54:31.024 INFO:tasks.workunit.client.1.smithi175.stdout:5/356: mknod db/d11/d25/d38/c6e 0 2024-04-20T10:54:31.027 INFO:tasks.workunit.client.1.smithi175.stdout:7/379: rename db/d1d/d29/d2a/d41/d59/f77 to db/d1d/d39/d50/f8c 0 2024-04-20T10:54:31.027 INFO:tasks.workunit.client.1.smithi175.stdout:7/380: chown db/d1d/d39/d50/d2c/f53 331 1 2024-04-20T10:54:31.027 INFO:tasks.workunit.client.1.smithi175.stdout:7/381: read - db/d1d/d39/d50/d12/d47/f79 zero size 2024-04-20T10:54:31.045 INFO:tasks.workunit.client.1.smithi175.stdout:5/357: write db/d11/f2d [2519176,73645] 0 2024-04-20T10:54:31.049 INFO:tasks.workunit.client.1.smithi175.stdout:2/226: dwrite d1/d7/d1e/d36/f47 [0,4194304] 0 2024-04-20T10:54:31.049 INFO:tasks.workunit.client.1.smithi175.stdout:5/358: mknod db/d11/d25/d38/d40/c6f 0 2024-04-20T10:54:31.050 INFO:tasks.workunit.client.1.smithi175.stdout:9/310: dwrite d6/d1b/d2f/f41 [0,4194304] 0 2024-04-20T10:54:31.052 INFO:tasks.workunit.client.1.smithi175.stdout:2/227: dread d1/d48/d21/d29/f18 [0,4194304] 0 2024-04-20T10:54:31.052 INFO:tasks.workunit.client.1.smithi175.stdout:2/228: chown d1/d48/d21/d29/f19 24 1 2024-04-20T10:54:31.052 INFO:tasks.workunit.client.1.smithi175.stdout:5/359: write f2 [1624977,111724] 0 2024-04-20T10:54:31.053 INFO:tasks.workunit.client.1.smithi175.stdout:7/382: dwrite db/d61/f68 [0,4194304] 0 2024-04-20T10:54:31.054 INFO:tasks.workunit.client.1.smithi175.stdout:2/229: unlink d1/d7/cb 0 2024-04-20T10:54:31.054 INFO:tasks.workunit.client.1.smithi175.stdout:2/230: stat d1/d7/f8 0 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:1/262: sync 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:6/381: sync 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:0/277: sync 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:8/342: sync 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:3/261: sync 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:6/382: stat d1/d40/d46/d60/d6b/f78 0 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:1/263: truncate d0/d51/f48 28514 0 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:8/343: truncate d7/f1b 1605542 0 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:8/344: fdatasync d7/d13/f50 0 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:1/264: truncate d0/d8/d13/f1b 506057 0 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:6/383: write d1/d5/d12/f35 [4803663,1852] 0 2024-04-20T10:54:31.058 INFO:tasks.workunit.client.1.smithi175.stdout:1/265: truncate d0/d8/d13/d2e/f44 4777623 0 2024-04-20T10:54:31.059 INFO:tasks.workunit.client.1.smithi175.stdout:5/360: mknod db/d11/d25/d38/c70 0 2024-04-20T10:54:31.060 INFO:tasks.workunit.client.1.smithi175.stdout:0/278: symlink df/d2e/l53 0 2024-04-20T10:54:31.061 INFO:tasks.workunit.client.1.smithi175.stdout:6/384: creat d1/d5/d12/d22/f8d x:0 0 0 2024-04-20T10:54:31.066 INFO:tasks.workunit.client.1.smithi175.stdout:7/383: write db/d61/f68 [1931652,3779] 0 2024-04-20T10:54:31.066 INFO:tasks.workunit.client.1.smithi175.stdout:8/345: getdents d7/d13/d1d/d24/d39 0 2024-04-20T10:54:31.066 INFO:tasks.workunit.client.1.smithi175.stdout:1/266: symlink d0/d8/d13/l55 0 2024-04-20T10:54:31.066 INFO:tasks.workunit.client.1.smithi175.stdout:7/384: truncate db/d1d/d39/d50/d2c/f4d 1003291 0 2024-04-20T10:54:31.066 INFO:tasks.workunit.client.1.smithi175.stdout:0/279: rename df/f13 to df/d2e/f54 0 2024-04-20T10:54:31.067 INFO:tasks.workunit.client.1.smithi175.stdout:4/364: write d4/d27/d61/f42 [215335,17748] 0 2024-04-20T10:54:31.067 INFO:tasks.workunit.client.1.smithi175.stdout:6/385: truncate d1/d37/f48 785015 0 2024-04-20T10:54:31.071 INFO:tasks.workunit.client.1.smithi175.stdout:8/346: symlink d7/d13/d1d/d24/l65 0 2024-04-20T10:54:31.071 INFO:tasks.workunit.client.1.smithi175.stdout:8/347: write d7/d13/d1d/f47 [564215,15533] 0 2024-04-20T10:54:31.071 INFO:tasks.workunit.client.1.smithi175.stdout:8/348: stat d7/d13/d1d/f47 0 2024-04-20T10:54:31.071 INFO:tasks.workunit.client.1.smithi175.stdout:7/385: link db/fd db/d1d/d60/d76/f8d 0 2024-04-20T10:54:31.072 INFO:tasks.workunit.client.1.smithi175.stdout:9/311: dwrite d6/d1b/d2f/d48/f49 [0,4194304] 0 2024-04-20T10:54:31.072 INFO:tasks.workunit.client.1.smithi175.stdout:0/280: mkdir df/d1a/d22/d55 0 2024-04-20T10:54:31.073 INFO:tasks.workunit.client.1.smithi175.stdout:9/312: write d6/d1b/d2f/f38 [118495,40230] 0 2024-04-20T10:54:31.077 INFO:tasks.workunit.client.1.smithi175.stdout:3/262: read d7/d21/d16/d22/d2c/f3c [844668,13212] 0 2024-04-20T10:54:31.083 INFO:tasks.workunit.client.1.smithi175.stdout:0/281: dread df/d17/f20 [0,4194304] 0 2024-04-20T10:54:31.083 INFO:tasks.workunit.client.1.smithi175.stdout:0/282: chown df/d19/l50 714819 1 2024-04-20T10:54:31.084 INFO:tasks.workunit.client.1.smithi175.stdout:0/283: write df/d1a/d22/f44 [1501711,41829] 0 2024-04-20T10:54:31.085 INFO:tasks.workunit.client.1.smithi175.stdout:2/231: dwrite d1/d7/d1f/f42 [0,4194304] 0 2024-04-20T10:54:31.085 INFO:tasks.workunit.client.1.smithi175.stdout:5/361: dwrite db/d11/f2a [4194304,4194304] 0 2024-04-20T10:54:31.090 INFO:tasks.workunit.client.1.smithi175.stdout:0/284: write df/f10 [255718,122083] 0 2024-04-20T10:54:31.114 INFO:tasks.workunit.client.1.smithi175.stdout:0/285: dwrite df/f3a [0,4194304] 0 2024-04-20T10:54:31.115 INFO:tasks.workunit.client.1.smithi175.stdout:0/286: readlink df/l32 0 2024-04-20T10:54:31.117 INFO:tasks.workunit.client.1.smithi175.stdout:5/362: dwrite db/d30/d46/f5d [0,4194304] 0 2024-04-20T10:54:31.117 INFO:tasks.workunit.client.1.smithi175.stdout:5/363: readlink db/d1f/d31/d35/l55 0 2024-04-20T10:54:31.117 INFO:tasks.workunit.client.1.smithi175.stdout:5/364: fdatasync db/d11/d1a/f28 0 2024-04-20T10:54:31.287 INFO:tasks.workunit.client.1.smithi175.stdout:4/365: mkdir d4/dd/d2d/d43/d69/d83 0 2024-04-20T10:54:31.288 INFO:tasks.workunit.client.1.smithi175.stdout:6/386: mknod d1/d5/d12/d22/c8e 0 2024-04-20T10:54:31.288 INFO:tasks.workunit.client.1.smithi175.stdout:6/387: fdatasync d1/d37/f50 0 2024-04-20T10:54:31.288 INFO:tasks.workunit.client.1.smithi175.stdout:6/388: getdents d1/d37/d83 0 2024-04-20T10:54:31.291 INFO:tasks.workunit.client.1.smithi175.stdout:8/349: mknod d7/c66 0 2024-04-20T10:54:31.292 INFO:tasks.workunit.client.1.smithi175.stdout:7/386: rename db/d1d/d39/d50/d2c to db/d1d/d29/d8e 0 2024-04-20T10:54:31.294 INFO:tasks.workunit.client.1.smithi175.stdout:9/313: creat d6/d1b/f56 x:0 0 0 2024-04-20T10:54:31.307 INFO:tasks.workunit.client.1.smithi175.stdout:2/232: rmdir d1/d7/d1e/d36 39 2024-04-20T10:54:31.309 INFO:tasks.workunit.client.1.smithi175.stdout:0/287: unlink f4 0 2024-04-20T10:54:31.311 INFO:tasks.workunit.client.1.smithi175.stdout:5/365: unlink db/d11/d1a/l67 0 2024-04-20T10:54:31.313 INFO:tasks.workunit.client.1.smithi175.stdout:4/366: rename d4/d23/d2e/l47 to d4/dd/d2d/d33/d3c/d44/l84 0 2024-04-20T10:54:31.314 INFO:tasks.workunit.client.1.smithi175.stdout:7/387: mkdir db/d1d/d29/d8f 0 2024-04-20T10:54:31.314 INFO:tasks.workunit.client.1.smithi175.stdout:3/263: mknod d7/d21/c57 0 2024-04-20T10:54:31.315 INFO:tasks.workunit.client.1.smithi175.stdout:4/367: dread d4/dd/d2d/f4c [0,4194304] 0 2024-04-20T10:54:31.315 INFO:tasks.workunit.client.1.smithi175.stdout:4/368: truncate d4/d23/d2e/f82 715657 0 2024-04-20T10:54:31.315 INFO:tasks.workunit.client.1.smithi175.stdout:2/233: dread f0 [0,4194304] 0 2024-04-20T10:54:31.315 INFO:tasks.workunit.client.1.smithi175.stdout:4/369: truncate d4/dd/d54/f5a 1450757 0 2024-04-20T10:54:31.315 INFO:tasks.workunit.client.1.smithi175.stdout:4/370: chown d4/d27/l51 59593457 1 2024-04-20T10:54:31.316 INFO:tasks.workunit.client.1.smithi175.stdout:8/350: rename d7/cb to d7/d55/c67 0 2024-04-20T10:54:31.316 INFO:tasks.workunit.client.1.smithi175.stdout:9/314: dwrite d6/f17 [0,4194304] 0 2024-04-20T10:54:31.316 INFO:tasks.workunit.client.1.smithi175.stdout:7/388: creat db/d61/d6d/f90 x:0 0 0 2024-04-20T10:54:31.316 INFO:tasks.workunit.client.1.smithi175.stdout:3/264: rmdir d7/d21 39 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:2/234: symlink d1/d7/d1f/l49 0 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:5/366: rename db/d11/l14 to db/l71 0 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:8/351: unlink d7/d13/d1d/d56/c5e 0 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:7/389: mknod db/d1d/d39/d50/d12/d47/d6a/c91 0 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:8/352: chown d7/f19 834343 1 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:9/315: creat d6/d1b/f57 x:0 0 0 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:8/353: readlink d7/d13/d1d/d24/d26/l35 0 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:7/390: chown db/d1d/d39/d50/f8c 351485684 1 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:2/235: write d1/d48/f1d [932554,48078] 0 2024-04-20T10:54:31.323 INFO:tasks.workunit.client.1.smithi175.stdout:8/354: write d7/d13/d1d/d24/d38/f64 [1018827,65728] 0 2024-04-20T10:54:31.324 INFO:tasks.workunit.client.1.smithi175.stdout:0/288: rename df/l12 to df/l56 0 2024-04-20T10:54:31.324 INFO:tasks.workunit.client.1.smithi175.stdout:0/289: readlink df/l15 0 2024-04-20T10:54:31.324 INFO:tasks.workunit.client.1.smithi175.stdout:0/290: readlink df/d17/l4d 0 2024-04-20T10:54:31.324 INFO:tasks.workunit.client.1.smithi175.stdout:4/371: write d4/dd/f50 [2950511,42257] 0 2024-04-20T10:54:31.324 INFO:tasks.workunit.client.1.smithi175.stdout:9/316: truncate d6/fe 3381120 0 2024-04-20T10:54:31.324 INFO:tasks.workunit.client.1.smithi175.stdout:2/236: mknod d1/d48/d21/d29/c4a 0 2024-04-20T10:54:31.324 INFO:tasks.workunit.client.1.smithi175.stdout:2/237: readlink d1/d7/d1f/l49 0 2024-04-20T10:54:31.325 INFO:tasks.workunit.client.1.smithi175.stdout:5/367: dread db/f1b [0,4194304] 0 2024-04-20T10:54:31.325 INFO:tasks.workunit.client.1.smithi175.stdout:8/355: mknod d7/d13/d1d/d5b/c68 0 2024-04-20T10:54:31.327 INFO:tasks.workunit.client.1.smithi175.stdout:4/372: dread d4/d27/f14 [0,4194304] 0 2024-04-20T10:54:31.327 INFO:tasks.workunit.client.1.smithi175.stdout:0/291: creat df/d17/d2f/d4f/f57 x:0 0 0 2024-04-20T10:54:31.328 INFO:tasks.workunit.client.1.smithi175.stdout:5/368: write db/d1f/d31/f4c [3258498,110412] 0 2024-04-20T10:54:31.329 INFO:tasks.workunit.client.1.smithi175.stdout:9/317: mkdir d6/d58 0 2024-04-20T10:54:31.329 INFO:tasks.workunit.client.1.smithi175.stdout:2/238: mkdir d1/d7/d1e/d4b 0 2024-04-20T10:54:31.330 INFO:tasks.workunit.client.1.smithi175.stdout:8/356: creat d7/d13/d1d/d24/d63/f69 x:0 0 0 2024-04-20T10:54:31.330 INFO:tasks.workunit.client.1.smithi175.stdout:8/357: chown d7/d13/d1d/d56/f62 3333705 1 2024-04-20T10:54:31.331 INFO:tasks.workunit.client.1.smithi175.stdout:4/373: creat d4/dd/d5e/f85 x:0 0 0 2024-04-20T10:54:31.333 INFO:tasks.workunit.client.1.smithi175.stdout:0/292: rename c7 to df/d17/d2f/d4f/c58 0 2024-04-20T10:54:31.333 INFO:tasks.workunit.client.1.smithi175.stdout:2/239: dread d1/d7/f8 [0,4194304] 0 2024-04-20T10:54:31.335 INFO:tasks.workunit.client.1.smithi175.stdout:5/369: creat db/d11/d1a/f72 x:0 0 0 2024-04-20T10:54:31.335 INFO:tasks.workunit.client.1.smithi175.stdout:5/370: write db/d1f/d31/f4c [2910286,103078] 0 2024-04-20T10:54:31.335 INFO:tasks.workunit.client.1.smithi175.stdout:4/374: write d4/d27/f14 [1648101,80743] 0 2024-04-20T10:54:31.336 INFO:tasks.workunit.client.1.smithi175.stdout:9/318: creat d6/d58/f59 x:0 0 0 2024-04-20T10:54:31.336 INFO:tasks.workunit.client.1.smithi175.stdout:9/319: chown d6/d10/f32 34 1 2024-04-20T10:54:31.336 INFO:tasks.workunit.client.1.smithi175.stdout:9/320: write d6/d1b/f57 [254582,75970] 0 2024-04-20T10:54:31.337 INFO:tasks.workunit.client.1.smithi175.stdout:4/375: creat d4/d27/d25/f86 x:0 0 0 2024-04-20T10:54:31.337 INFO:tasks.workunit.client.1.smithi175.stdout:9/321: mknod d6/d1b/d2f/c5a 0 2024-04-20T10:54:31.338 INFO:tasks.workunit.client.1.smithi175.stdout:4/376: link d4/d27/f17 d4/dd/d2d/d43/f87 0 2024-04-20T10:54:31.340 INFO:tasks.workunit.client.1.smithi175.stdout:9/322: mkdir d6/d1b/d42/d5b 0 2024-04-20T10:54:31.340 INFO:tasks.workunit.client.1.smithi175.stdout:9/323: dread - d6/d10/f3b zero size 2024-04-20T10:54:31.340 INFO:tasks.workunit.client.1.smithi175.stdout:9/324: fsync d6/d10/f1a 0 2024-04-20T10:54:31.351 INFO:tasks.workunit.client.1.smithi175.stdout:4/377: dread d4/d27/d61/f46 [0,4194304] 0 2024-04-20T10:54:31.351 INFO:tasks.workunit.client.1.smithi175.stdout:7/391: dwrite db/d1d/d29/f6f [0,4194304] 0 2024-04-20T10:54:31.351 INFO:tasks.workunit.client.1.smithi175.stdout:3/265: dwrite d7/d21/f11 [0,4194304] 0 2024-04-20T10:54:31.351 INFO:tasks.workunit.client.1.smithi175.stdout:2/240: dread d1/d48/f3b [0,4194304] 0 2024-04-20T10:54:31.354 INFO:tasks.workunit.client.1.smithi175.stdout:4/378: mkdir d4/d27/d61/d88 0 2024-04-20T10:54:31.355 INFO:tasks.workunit.client.1.smithi175.stdout:7/392: dread db/f7e [0,4194304] 0 2024-04-20T10:54:31.363 INFO:tasks.workunit.client.1.smithi175.stdout:3/266: rename d7/d21/d16/c28 to d7/d19/c58 0 2024-04-20T10:54:31.364 INFO:tasks.workunit.client.1.smithi175.stdout:7/393: unlink db/d1d/d39/c5e 0 2024-04-20T10:54:31.368 INFO:tasks.workunit.client.1.smithi175.stdout:2/241: rename d1/d7/d1f/l3a to d1/l4c 0 2024-04-20T10:54:31.370 INFO:tasks.workunit.client.1.smithi175.stdout:7/394: link db/d61/c65 db/d1d/d29/d2a/c92 0 2024-04-20T10:54:31.375 INFO:tasks.workunit.client.1.smithi175.stdout:0/293: dwrite df/d19/f21 [0,4194304] 0 2024-04-20T10:54:31.376 INFO:tasks.workunit.client.1.smithi175.stdout:0/294: chown df/d19/f31 495298554 1 2024-04-20T10:54:31.376 INFO:tasks.workunit.client.1.smithi175.stdout:0/295: chown df/d19/l41 6504 1 2024-04-20T10:54:31.376 INFO:tasks.workunit.client.1.smithi175.stdout:7/395: rename db/d61/d6d/c70 to db/d1d/c93 0 2024-04-20T10:54:31.377 INFO:tasks.workunit.client.1.smithi175.stdout:4/379: dwrite d4/d23/d2e/f82 [0,4194304] 0 2024-04-20T10:54:31.381 INFO:tasks.workunit.client.1.smithi175.stdout:0/296: symlink df/d1a/d22/l59 0 2024-04-20T10:54:31.381 INFO:tasks.workunit.client.1.smithi175.stdout:0/297: chown df/d19/f51 916 1 2024-04-20T10:54:31.382 INFO:tasks.workunit.client.1.smithi175.stdout:4/380: symlink d4/dd/d54/d5d/d79/l89 0 2024-04-20T10:54:31.383 INFO:tasks.workunit.client.1.smithi175.stdout:0/298: truncate df/d1a/d22/f44 313321 0 2024-04-20T10:54:31.384 INFO:tasks.workunit.client.1.smithi175.stdout:4/381: mkdir d4/dd/d54/d5d/d8a 0 2024-04-20T10:54:31.385 INFO:tasks.workunit.client.1.smithi175.stdout:4/382: write d4/f31 [721743,51927] 0 2024-04-20T10:54:31.385 INFO:tasks.workunit.client.1.smithi175.stdout:2/242: dwrite d1/d48/f31 [8388608,4194304] 0 2024-04-20T10:54:31.385 INFO:tasks.workunit.client.1.smithi175.stdout:0/299: unlink df/d19/f21 0 2024-04-20T10:54:31.387 INFO:tasks.workunit.client.1.smithi175.stdout:4/383: creat d4/dd/d54/d5d/d79/f8b x:0 0 0 2024-04-20T10:54:31.388 INFO:tasks.workunit.client.1.smithi175.stdout:2/243: rename d1/l2d to d1/d7/l4d 0 2024-04-20T10:54:31.390 INFO:tasks.workunit.client.1.smithi175.stdout:2/244: rename d1/d7/f44 to d1/f4e 0 2024-04-20T10:54:31.390 INFO:tasks.workunit.client.1.smithi175.stdout:4/384: mkdir d4/d27/d8c 0 2024-04-20T10:54:31.391 INFO:tasks.workunit.client.1.smithi175.stdout:0/300: write df/f38 [3534718,26833] 0 2024-04-20T10:54:31.394 INFO:tasks.workunit.client.1.smithi175.stdout:7/396: dwrite db/d1d/d29/d8e/f32 [0,4194304] 0 2024-04-20T10:54:31.394 INFO:tasks.workunit.client.1.smithi175.stdout:7/397: chown db/d1d/d29/c45 347 1 2024-04-20T10:54:31.394 INFO:tasks.workunit.client.1.smithi175.stdout:7/398: write db/d1d/d29/d2a/f87 [348797,90837] 0 2024-04-20T10:54:31.394 INFO:tasks.workunit.client.1.smithi175.stdout:1/267: sync 2024-04-20T10:54:31.398 INFO:tasks.workunit.client.1.smithi175.stdout:0/301: dread f5 [0,4194304] 0 2024-04-20T10:54:31.398 INFO:tasks.workunit.client.1.smithi175.stdout:7/399: truncate db/d1d/d29/d8e/f4d 664186 0 2024-04-20T10:54:31.398 INFO:tasks.workunit.client.1.smithi175.stdout:7/400: readlink db/d1d/d29/d2a/l37 0 2024-04-20T10:54:31.400 INFO:tasks.workunit.client.1.smithi175.stdout:1/268: creat d0/f56 x:0 0 0 2024-04-20T10:54:31.400 INFO:tasks.workunit.client.1.smithi175.stdout:1/269: write d0/f10 [614172,39723] 0 2024-04-20T10:54:31.403 INFO:tasks.workunit.client.1.smithi175.stdout:7/401: creat db/d1d/d39/d50/d12/d47/f94 x:0 0 0 2024-04-20T10:54:31.403 INFO:tasks.workunit.client.1.smithi175.stdout:7/402: stat db/d1d/d29/d2a/d41/l8a 0 2024-04-20T10:54:31.404 INFO:tasks.workunit.client.1.smithi175.stdout:1/270: truncate d0/d8/d13/d2e/f46 403151 0 2024-04-20T10:54:31.405 INFO:tasks.workunit.client.1.smithi175.stdout:1/271: dread - d0/d8/f4d zero size 2024-04-20T10:54:31.406 INFO:tasks.workunit.client.1.smithi175.stdout:0/302: mknod df/d1a/d28/c5a 0 2024-04-20T10:54:31.412 INFO:tasks.workunit.client.1.smithi175.stdout:1/272: unlink d0/d8/d13/c21 0 2024-04-20T10:54:31.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/303: creat df/d17/d2f/f5b x:0 0 0 2024-04-20T10:54:31.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/304: stat df/d1a/d22/d55 0 2024-04-20T10:54:31.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/305: chown df/d1a/d22/d24/d37/d48/d4e 41208 1 2024-04-20T10:54:31.416 INFO:tasks.workunit.client.1.smithi175.stdout:9/325: read d6/fe [2902991,75885] 0 2024-04-20T10:54:31.420 INFO:tasks.workunit.client.1.smithi175.stdout:7/403: dwrite db/d1d/d29/f6f [0,4194304] 0 2024-04-20T10:54:31.423 INFO:tasks.workunit.client.1.smithi175.stdout:7/404: rename db/d1d/d39/c64 to db/d1d/d60/c95 0 2024-04-20T10:54:31.426 INFO:tasks.workunit.client.1.smithi175.stdout:3/267: getdents d7/d21/d16 0 2024-04-20T10:54:31.428 INFO:tasks.workunit.client.1.smithi175.stdout:3/268: rename d7/d20 to d7/d19/d2a/d59 0 2024-04-20T10:54:31.428 INFO:tasks.workunit.client.1.smithi175.stdout:1/273: dwrite d0/d51/f4e [0,4194304] 0 2024-04-20T10:54:31.430 INFO:tasks.workunit.client.1.smithi175.stdout:1/274: truncate d0/d8/f18 1383262 0 2024-04-20T10:54:31.433 INFO:tasks.workunit.client.1.smithi175.stdout:5/371: dread f2 [0,4194304] 0 2024-04-20T10:54:31.436 INFO:tasks.workunit.client.1.smithi175.stdout:5/372: mknod db/d1f/c73 0 2024-04-20T10:54:31.438 INFO:tasks.workunit.client.1.smithi175.stdout:5/373: mkdir db/d1f/d31/d35/d74 0 2024-04-20T10:54:31.440 INFO:tasks.workunit.client.1.smithi175.stdout:9/326: dwrite d6/d1b/f47 [0,4194304] 0 2024-04-20T10:54:31.441 INFO:tasks.workunit.client.1.smithi175.stdout:7/405: dwrite db/d1d/d29/d2a/d41/f6c [0,4194304] 0 2024-04-20T10:54:31.441 INFO:tasks.workunit.client.1.smithi175.stdout:7/406: stat db/d1d/d39/d50/d12/f19 0 2024-04-20T10:54:31.441 INFO:tasks.workunit.client.1.smithi175.stdout:7/407: chown db/d61/l73 1323787 1 2024-04-20T10:54:31.443 INFO:tasks.workunit.client.1.smithi175.stdout:9/327: creat d6/d33/f5c x:0 0 0 2024-04-20T10:54:31.444 INFO:tasks.workunit.client.1.smithi175.stdout:9/328: dread - d6/f3c zero size 2024-04-20T10:54:31.444 INFO:tasks.workunit.client.1.smithi175.stdout:2/245: getdents d1 0 2024-04-20T10:54:31.444 INFO:tasks.workunit.client.1.smithi175.stdout:2/246: write d1/f33 [1373900,114890] 0 2024-04-20T10:54:31.444 INFO:tasks.workunit.client.1.smithi175.stdout:2/247: write d1/d48/f1d [2360192,88921] 0 2024-04-20T10:54:31.446 INFO:tasks.workunit.client.1.smithi175.stdout:7/408: rmdir db/d1d/d29/d2a 39 2024-04-20T10:54:31.447 INFO:tasks.workunit.client.1.smithi175.stdout:5/374: read db/d11/f43 [2416024,57237] 0 2024-04-20T10:54:31.447 INFO:tasks.workunit.client.1.smithi175.stdout:2/248: rename d1/d7/d1f/l49 to d1/d48/d21/l4f 0 2024-04-20T10:54:31.447 INFO:tasks.workunit.client.1.smithi175.stdout:2/249: chown d1/d48/d21/d29/c14 602 1 2024-04-20T10:54:31.448 INFO:tasks.workunit.client.1.smithi175.stdout:5/375: write db/d1f/f18 [3933934,27721] 0 2024-04-20T10:54:31.449 INFO:tasks.workunit.client.1.smithi175.stdout:2/250: creat d1/d48/d21/d29/f50 x:0 0 0 2024-04-20T10:54:31.449 INFO:tasks.workunit.client.1.smithi175.stdout:2/251: fdatasync d1/d48/d21/d29/f18 0 2024-04-20T10:54:31.450 INFO:tasks.workunit.client.1.smithi175.stdout:5/376: mkdir db/d30/d46/d4b/d4f/d75 0 2024-04-20T10:54:31.451 INFO:tasks.workunit.client.1.smithi175.stdout:2/252: symlink d1/l51 0 2024-04-20T10:54:31.451 INFO:tasks.workunit.client.1.smithi175.stdout:2/253: dread - d1/d7/d1e/f3e zero size 2024-04-20T10:54:31.451 INFO:tasks.workunit.client.1.smithi175.stdout:2/254: chown d1/d7/l2e 1943207752 1 2024-04-20T10:54:31.453 INFO:tasks.workunit.client.1.smithi175.stdout:5/377: creat db/d11/d1a/f76 x:0 0 0 2024-04-20T10:54:31.453 INFO:tasks.workunit.client.1.smithi175.stdout:1/275: dwrite d0/d51/f4e [0,4194304] 0 2024-04-20T10:54:31.454 INFO:tasks.workunit.client.1.smithi175.stdout:5/378: rmdir db/d1f/d31/d35/d74 0 2024-04-20T10:54:31.455 INFO:tasks.workunit.client.1.smithi175.stdout:2/255: dread d1/d7/f34 [0,4194304] 0 2024-04-20T10:54:31.455 INFO:tasks.workunit.client.1.smithi175.stdout:2/256: readlink d1/d7/l3c 0 2024-04-20T10:54:31.455 INFO:tasks.workunit.client.1.smithi175.stdout:2/257: dread - d1/d48/f41 zero size 2024-04-20T10:54:31.457 INFO:tasks.workunit.client.1.smithi175.stdout:9/329: write d6/d1b/f47 [3069017,5959] 0 2024-04-20T10:54:31.457 INFO:tasks.workunit.client.1.smithi175.stdout:9/330: chown d6/d1b/d2f/d48/f49 129469 1 2024-04-20T10:54:31.458 INFO:tasks.workunit.client.1.smithi175.stdout:0/306: truncate df/f10 4598372 0 2024-04-20T10:54:31.458 INFO:tasks.workunit.client.1.smithi175.stdout:7/409: write f6 [1797156,79924] 0 2024-04-20T10:54:31.458 INFO:tasks.workunit.client.1.smithi175.stdout:7/410: dread - db/d1d/d39/d50/d12/f88 zero size 2024-04-20T10:54:31.460 INFO:tasks.workunit.client.1.smithi175.stdout:1/276: rmdir d0/d8/d13 39 2024-04-20T10:54:31.462 INFO:tasks.workunit.client.1.smithi175.stdout:2/258: mknod d1/d7/d1e/d36/c52 0 2024-04-20T10:54:31.463 INFO:tasks.workunit.client.1.smithi175.stdout:5/379: dread db/d30/d46/f5d [0,4194304] 0 2024-04-20T10:54:31.464 INFO:tasks.workunit.client.1.smithi175.stdout:9/331: unlink d6/d1b/d26/l3e 0 2024-04-20T10:54:31.465 INFO:tasks.workunit.client.1.smithi175.stdout:0/307: mkdir df/d1a/d22/d24/d37/d48/d5c 0 2024-04-20T10:54:31.468 INFO:tasks.workunit.client.1.smithi175.stdout:7/411: rename db/d1d/f42 to db/d1d/d29/f96 0 2024-04-20T10:54:31.470 INFO:tasks.workunit.client.1.smithi175.stdout:1/277: mkdir d0/d57 0 2024-04-20T10:54:31.472 INFO:tasks.workunit.client.1.smithi175.stdout:2/259: mkdir d1/d53 0 2024-04-20T10:54:31.473 INFO:tasks.workunit.client.1.smithi175.stdout:5/380: getdents db/d11/d25/d38/d40/d66 0 2024-04-20T10:54:31.475 INFO:tasks.workunit.client.1.smithi175.stdout:5/381: dread db/d1f/d31/d35/f44 [0,4194304] 0 2024-04-20T10:54:31.476 INFO:tasks.workunit.client.1.smithi175.stdout:7/412: symlink db/d1d/d60/d76/l97 0 2024-04-20T10:54:31.476 INFO:tasks.workunit.client.1.smithi175.stdout:7/413: chown db/d1d/d39/d50/d12/l3b 71 1 2024-04-20T10:54:31.477 INFO:tasks.workunit.client.1.smithi175.stdout:1/278: rename d0/d8/d13/d2e/c36 to d0/d8/d13/c58 0 2024-04-20T10:54:31.485 INFO:tasks.workunit.client.1.smithi175.stdout:0/308: write df/d2e/f54 [1526846,46714] 0 2024-04-20T10:54:31.485 INFO:tasks.workunit.client.1.smithi175.stdout:9/332: dwrite d6/d1b/d2f/d48/f49 [0,4194304] 0 2024-04-20T10:54:31.485 INFO:tasks.workunit.client.1.smithi175.stdout:2/260: write d1/d7/d1f/f42 [2514090,57322] 0 2024-04-20T10:54:31.486 INFO:tasks.workunit.client.1.smithi175.stdout:7/414: creat db/d1d/d29/d8f/f98 x:0 0 0 2024-04-20T10:54:31.486 INFO:tasks.workunit.client.1.smithi175.stdout:1/279: rename d0/c1c to d0/d8/d13/c59 0 2024-04-20T10:54:31.486 INFO:tasks.workunit.client.1.smithi175.stdout:1/280: fdatasync d0/fe 0 2024-04-20T10:54:31.486 INFO:tasks.workunit.client.1.smithi175.stdout:0/309: getdents df/d1a/d22 0 2024-04-20T10:54:31.487 INFO:tasks.workunit.client.1.smithi175.stdout:4/385: sync 2024-04-20T10:54:31.487 INFO:tasks.workunit.client.1.smithi175.stdout:6/389: sync 2024-04-20T10:54:31.487 INFO:tasks.workunit.client.1.smithi175.stdout:8/358: sync 2024-04-20T10:54:31.487 INFO:tasks.workunit.client.1.smithi175.stdout:8/359: write d7/d13/f3a [1466749,45658] 0 2024-04-20T10:54:31.489 INFO:tasks.workunit.client.1.smithi175.stdout:9/333: mknod d6/c5d 0 2024-04-20T10:54:31.489 INFO:tasks.workunit.client.1.smithi175.stdout:9/334: write d6/d10/f1e [4824657,103403] 0 2024-04-20T10:54:31.489 INFO:tasks.workunit.client.1.smithi175.stdout:9/335: chown d6/d10/c21 10804445 1 2024-04-20T10:54:31.491 INFO:tasks.workunit.client.1.smithi175.stdout:2/261: creat d1/d53/f54 x:0 0 0 2024-04-20T10:54:31.493 INFO:tasks.workunit.client.1.smithi175.stdout:7/415: rename db/d1d/c3a to db/d1d/d39/d50/d12/c99 0 2024-04-20T10:54:31.496 INFO:tasks.workunit.client.1.smithi175.stdout:0/310: unlink f5 0 2024-04-20T10:54:31.496 INFO:tasks.workunit.client.1.smithi175.stdout:4/386: dread d4/dd/d2d/d43/f87 [0,4194304] 0 2024-04-20T10:54:31.496 INFO:tasks.workunit.client.1.smithi175.stdout:4/387: stat f1 0 2024-04-20T10:54:31.497 INFO:tasks.workunit.client.1.smithi175.stdout:4/388: fdatasync d4/d27/f7b 0 2024-04-20T10:54:31.502 INFO:tasks.workunit.client.1.smithi175.stdout:9/336: link d6/d1b/d26/l3a d6/l5e 0 2024-04-20T10:54:31.502 INFO:tasks.workunit.client.1.smithi175.stdout:7/416: mkdir db/d1d/d29/d9a 0 2024-04-20T10:54:31.502 INFO:tasks.workunit.client.1.smithi175.stdout:0/311: creat df/d1a/d22/d24/d37/d48/d4e/f5d x:0 0 0 2024-04-20T10:54:31.502 INFO:tasks.workunit.client.1.smithi175.stdout:4/389: creat d4/dd/d5e/d74/f8d x:0 0 0 2024-04-20T10:54:31.502 INFO:tasks.workunit.client.1.smithi175.stdout:4/390: chown d4/dd/c1d 67111134 1 2024-04-20T10:54:31.502 INFO:tasks.workunit.client.1.smithi175.stdout:4/391: stat d4/dd/d2d/f4c 0 2024-04-20T10:54:31.503 INFO:tasks.workunit.client.1.smithi175.stdout:7/417: creat db/d1d/d39/d50/d12/d47/f9b x:0 0 0 2024-04-20T10:54:31.503 INFO:tasks.workunit.client.1.smithi175.stdout:7/418: truncate db/d61/d6d/f7c 943298 0 2024-04-20T10:54:31.504 INFO:tasks.workunit.client.1.smithi175.stdout:9/337: symlink d6/d10/l5f 0 2024-04-20T10:54:31.504 INFO:tasks.workunit.client.1.smithi175.stdout:8/360: write d7/d13/d1d/d24/d39/f3b [4970224,28467] 0 2024-04-20T10:54:31.504 INFO:tasks.workunit.client.1.smithi175.stdout:7/419: mkdir db/d61/d6d/d9c 0 2024-04-20T10:54:31.505 INFO:tasks.workunit.client.1.smithi175.stdout:9/338: mkdir d6/d33/d60 0 2024-04-20T10:54:31.505 INFO:tasks.workunit.client.1.smithi175.stdout:4/392: dread d4/d27/f14 [0,4194304] 0 2024-04-20T10:54:31.510 INFO:tasks.workunit.client.1.smithi175.stdout:0/312: dread df/f10 [0,4194304] 0 2024-04-20T10:54:31.512 INFO:tasks.workunit.client.1.smithi175.stdout:1/281: dwrite d0/f1e [0,4194304] 0 2024-04-20T10:54:31.512 INFO:tasks.workunit.client.1.smithi175.stdout:1/282: chown d0/d8/c3c 33 1 2024-04-20T10:54:31.512 INFO:tasks.workunit.client.1.smithi175.stdout:5/382: dwrite db/f1b [0,4194304] 0 2024-04-20T10:54:31.512 INFO:tasks.workunit.client.1.smithi175.stdout:6/390: dwrite d1/d37/f6f [0,4194304] 0 2024-04-20T10:54:31.512 INFO:tasks.workunit.client.1.smithi175.stdout:6/391: chown d1/f16 4600082 1 2024-04-20T10:54:31.512 INFO:tasks.workunit.client.1.smithi175.stdout:8/361: creat d7/d13/d1d/d24/d26/f6a x:0 0 0 2024-04-20T10:54:31.512 INFO:tasks.workunit.client.1.smithi175.stdout:7/420: creat db/d1d/d39/d50/f9d x:0 0 0 2024-04-20T10:54:31.513 INFO:tasks.workunit.client.1.smithi175.stdout:7/421: fdatasync db/f14 0 2024-04-20T10:54:31.513 INFO:tasks.workunit.client.1.smithi175.stdout:7/422: write db/d1d/d29/d2a/d41/f80 [271673,15720] 0 2024-04-20T10:54:31.513 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:31.514 INFO:tasks.workunit.client.1.smithi175.stdout:2/262: dwrite d1/d7/f8 [0,4194304] 0 2024-04-20T10:54:31.514 INFO:tasks.workunit.client.1.smithi175.stdout:0/313: mkdir df/d1a/d3f/d5e 0 2024-04-20T10:54:31.518 INFO:tasks.workunit.client.1.smithi175.stdout:5/383: write db/d1f/d31/f3a [4562640,129890] 0 2024-04-20T10:54:31.520 INFO:tasks.workunit.client.1.smithi175.stdout:3/269: dread d7/d21/fa [0,4194304] 0 2024-04-20T10:54:31.523 INFO:tasks.workunit.client.1.smithi175.stdout:6/392: truncate d1/fb 3351777 0 2024-04-20T10:54:31.523 INFO:tasks.workunit.client.1.smithi175.stdout:7/423: rename db/f14 to db/d1d/d29/f9e 0 2024-04-20T10:54:31.523 INFO:tasks.workunit.client.1.smithi175.stdout:6/393: fdatasync d1/d5/d12/f31 0 2024-04-20T10:54:31.523 INFO:tasks.workunit.client.1.smithi175.stdout:0/314: unlink df/d1a/d22/d24/l3c 0 2024-04-20T10:54:31.527 INFO:tasks.workunit.client.1.smithi175.stdout:3/270: symlink d7/d21/d16/d22/d2c/d1f/l5a 0 2024-04-20T10:54:31.527 INFO:tasks.workunit.client.1.smithi175.stdout:3/271: write d7/d21/f41 [1062665,130246] 0 2024-04-20T10:54:31.527 INFO:tasks.workunit.client.1.smithi175.stdout:3/272: dread - d7/d10/f31 zero size 2024-04-20T10:54:31.527 INFO:tasks.workunit.client.1.smithi175.stdout:9/339: dwrite d6/d1b/f24 [4194304,4194304] 0 2024-04-20T10:54:31.529 INFO:tasks.workunit.client.1.smithi175.stdout:7/424: rename db/d1d/d39/d50/d12/l3b to db/d1d/d39/l9f 0 2024-04-20T10:54:31.529 INFO:tasks.workunit.client.1.smithi175.stdout:7/425: write db/d61/d6d/f90 [331419,8109] 0 2024-04-20T10:54:31.530 INFO:tasks.workunit.client.1.smithi175.stdout:6/394: link d1/d40/d46/f58 d1/d40/d46/d60/d68/d7e/f8f 0 2024-04-20T10:54:31.531 INFO:tasks.workunit.client.1.smithi175.stdout:6/395: dread - d1/d37/f50 zero size 2024-04-20T10:54:31.531 INFO:tasks.workunit.client.1.smithi175.stdout:6/396: readlink d1/d5/d12/l20 0 2024-04-20T10:54:31.532 INFO:tasks.workunit.client.1.smithi175.stdout:0/315: mkdir df/d1a/d22/d24/d5f 0 2024-04-20T10:54:31.534 INFO:tasks.workunit.client.1.smithi175.stdout:3/273: creat d7/d21/d16/d22/d2c/d1f/f5b x:0 0 0 2024-04-20T10:54:31.534 INFO:tasks.workunit.client.1.smithi175.stdout:3/274: stat d7/d21/c57 0 2024-04-20T10:54:31.534 INFO:tasks.workunit.client.1.smithi175.stdout:3/275: dread - d7/d10/f31 zero size 2024-04-20T10:54:31.536 INFO:tasks.workunit.client.1.smithi175.stdout:7/426: creat db/d1d/d29/d2a/d41/d59/fa0 x:0 0 0 2024-04-20T10:54:31.536 INFO:tasks.workunit.client.1.smithi175.stdout:7/427: stat db/d1d/d29/d2a/d41/d59/c78 0 2024-04-20T10:54:31.537 INFO:tasks.workunit.client.1.smithi175.stdout:0/316: write df/f1c [4627234,31515] 0 2024-04-20T10:54:31.538 INFO:tasks.workunit.client.1.smithi175.stdout:3/276: creat d7/d21/f5c x:0 0 0 2024-04-20T10:54:31.540 INFO:tasks.workunit.client.1.smithi175.stdout:9/340: dread d6/d10/f1e [0,4194304] 0 2024-04-20T10:54:31.540 INFO:tasks.workunit.client.1.smithi175.stdout:0/317: mknod df/d1a/d28/c60 0 2024-04-20T10:54:31.540 INFO:tasks.workunit.client.1.smithi175.stdout:9/341: read d6/d1b/f47 [4044151,88642] 0 2024-04-20T10:54:31.541 INFO:tasks.workunit.client.1.smithi175.stdout:0/318: creat df/d1a/d22/d24/d37/d48/d4e/f61 x:0 0 0 2024-04-20T10:54:31.542 INFO:tasks.workunit.client.1.smithi175.stdout:6/397: write d1/d5/d12/d73/d7a/f80 [2855660,51452] 0 2024-04-20T10:54:31.543 INFO:tasks.workunit.client.1.smithi175.stdout:9/342: rmdir d6/d1b/d42/d51 39 2024-04-20T10:54:31.545 INFO:tasks.workunit.client.1.smithi175.stdout:0/319: creat df/d17/f62 x:0 0 0 2024-04-20T10:54:31.545 INFO:tasks.workunit.client.1.smithi175.stdout:0/320: readlink df/d1a/l1d 0 2024-04-20T10:54:31.546 INFO:tasks.workunit.client.1.smithi175.stdout:1/283: dwrite d0/d8/f1f [0,4194304] 0 2024-04-20T10:54:31.546 INFO:tasks.workunit.client.1.smithi175.stdout:5/384: dwrite db/d30/d46/d4b/f4d [0,4194304] 0 2024-04-20T10:54:31.550 INFO:tasks.workunit.client.1.smithi175.stdout:6/398: symlink d1/d5/d12/d73/d7a/l90 0 2024-04-20T10:54:31.550 INFO:tasks.workunit.client.1.smithi175.stdout:9/343: creat d6/d58/f61 x:0 0 0 2024-04-20T10:54:31.551 INFO:tasks.workunit.client.1.smithi175.stdout:2/263: dread d1/d48/f31 [4194304,4194304] 0 2024-04-20T10:54:31.551 INFO:tasks.workunit.client.1.smithi175.stdout:1/284: mknod d0/d3e/c5a 0 2024-04-20T10:54:31.556 INFO:tasks.workunit.client.1.smithi175.stdout:6/399: creat d1/d40/d46/d60/f91 x:0 0 0 2024-04-20T10:54:31.559 INFO:tasks.workunit.client.1.smithi175.stdout:6/400: creat d1/d37/f92 x:0 0 0 2024-04-20T10:54:31.559 INFO:tasks.workunit.client.1.smithi175.stdout:6/401: stat d1/d40/d46/d60/c65 0 2024-04-20T10:54:31.561 INFO:tasks.workunit.client.1.smithi175.stdout:7/428: dwrite db/d1d/d29/f6f [4194304,4194304] 0 2024-04-20T10:54:31.561 INFO:tasks.workunit.client.1.smithi175.stdout:6/402: rename d1/c19 to d1/d40/d46/d60/d68/d7e/c93 0 2024-04-20T10:54:31.561 INFO:tasks.workunit.client.1.smithi175.stdout:6/403: write d1/d40/d49/f69 [167824,82663] 0 2024-04-20T10:54:31.561 INFO:tasks.workunit.client.1.smithi175.stdout:6/404: chown d1/d37/f6f 22 1 2024-04-20T10:54:31.561 INFO:tasks.workunit.client.1.smithi175.stdout:6/405: fdatasync d1/d5/d12/d22/f8d 0 2024-04-20T10:54:31.562 INFO:tasks.workunit.client.1.smithi175.stdout:2/264: write d1/d7/d1e/f26 [325454,98336] 0 2024-04-20T10:54:31.564 INFO:tasks.workunit.client.1.smithi175.stdout:7/429: creat db/d61/d6d/d9c/fa1 x:0 0 0 2024-04-20T10:54:31.565 INFO:tasks.workunit.client.1.smithi175.stdout:2/265: mknod d1/d48/d21/d29/c55 0 2024-04-20T10:54:31.566 INFO:tasks.workunit.client.1.smithi175.stdout:7/430: mknod db/d1d/d39/d50/d12/d47/d6a/ca2 0 2024-04-20T10:54:31.568 INFO:tasks.workunit.client.1.smithi175.stdout:2/266: truncate d1/d48/d21/d29/f46 3721076 0 2024-04-20T10:54:31.569 INFO:tasks.workunit.client.1.smithi175.stdout:7/431: symlink db/d61/d6d/d9c/la3 0 2024-04-20T10:54:31.570 INFO:tasks.workunit.client.1.smithi175.stdout:3/277: write d7/d21/fa [4171052,27005] 0 2024-04-20T10:54:31.570 INFO:tasks.workunit.client.1.smithi175.stdout:2/267: dread d1/d48/d21/d29/f39 [0,4194304] 0 2024-04-20T10:54:31.571 INFO:tasks.workunit.client.1.smithi175.stdout:7/432: creat db/d1d/d39/fa4 x:0 0 0 2024-04-20T10:54:31.571 INFO:tasks.workunit.client.1.smithi175.stdout:7/433: stat db/f66 0 2024-04-20T10:54:31.571 INFO:tasks.workunit.client.1.smithi175.stdout:9/344: dwrite d6/f4c [0,4194304] 0 2024-04-20T10:54:31.571 INFO:tasks.workunit.client.1.smithi175.stdout:9/345: read d6/fe [3222670,9476] 0 2024-04-20T10:54:31.571 INFO:tasks.workunit.client.1.smithi175.stdout:9/346: write d6/d1b/f56 [670039,1846] 0 2024-04-20T10:54:31.571 INFO:tasks.workunit.client.1.smithi175.stdout:0/321: dwrite df/d17/d2f/d4f/f57 [0,4194304] 0 2024-04-20T10:54:31.574 INFO:tasks.workunit.client.1.smithi175.stdout:7/434: creat db/d1d/d29/d2a/d41/fa5 x:0 0 0 2024-04-20T10:54:31.574 INFO:tasks.workunit.client.1.smithi175.stdout:5/385: dread db/d1f/d31/f3a [0,4194304] 0 2024-04-20T10:54:31.578 INFO:tasks.workunit.client.1.smithi175.stdout:9/347: mkdir d6/d10/d62 0 2024-04-20T10:54:31.580 INFO:tasks.workunit.client.1.smithi175.stdout:3/278: dread d7/d21/f11 [0,4194304] 0 2024-04-20T10:54:31.580 INFO:tasks.workunit.client.1.smithi175.stdout:3/279: fsync d7/d21/f41 0 2024-04-20T10:54:31.581 INFO:tasks.workunit.client.1.smithi175.stdout:3/280: write d7/d10/f42 [886537,50524] 0 2024-04-20T10:54:31.581 INFO:tasks.workunit.client.1.smithi175.stdout:3/281: readlink d7/d21/d16/d22/d2c/l55 0 2024-04-20T10:54:31.582 INFO:tasks.workunit.client.1.smithi175.stdout:0/322: mknod df/d1a/d22/d24/c63 0 2024-04-20T10:54:31.584 INFO:tasks.workunit.client.1.smithi175.stdout:7/435: mkdir db/d1d/d39/d50/d12/d47/da6 0 2024-04-20T10:54:31.591 INFO:tasks.workunit.client.1.smithi175.stdout:3/282: truncate d7/d21/f2f 514799 0 2024-04-20T10:54:31.592 INFO:tasks.workunit.client.1.smithi175.stdout:7/436: symlink db/d1d/d39/d50/d12/d47/la7 0 2024-04-20T10:54:31.594 INFO:tasks.workunit.client.1.smithi175.stdout:1/285: dwrite d0/f49 [0,4194304] 0 2024-04-20T10:54:31.594 INFO:tasks.workunit.client.1.smithi175.stdout:3/283: creat d7/d19/d35/f5d x:0 0 0 2024-04-20T10:54:31.596 INFO:tasks.workunit.client.1.smithi175.stdout:5/386: write db/d1f/f20 [1326460,78630] 0 2024-04-20T10:54:31.597 INFO:tasks.workunit.client.1.smithi175.stdout:2/268: dwrite d1/d7/d1e/f26 [0,4194304] 0 2024-04-20T10:54:31.599 INFO:tasks.workunit.client.1.smithi175.stdout:1/286: unlink d0/d8/d13/f24 0 2024-04-20T10:54:31.600 INFO:tasks.workunit.client.1.smithi175.stdout:9/348: dwrite d6/f28 [0,4194304] 0 2024-04-20T10:54:31.600 INFO:tasks.workunit.client.1.smithi175.stdout:9/349: dread - d6/d33/f5c zero size 2024-04-20T10:54:31.600 INFO:tasks.workunit.client.1.smithi175.stdout:9/350: chown d6/d58 2 1 2024-04-20T10:54:31.601 INFO:tasks.workunit.client.1.smithi175.stdout:3/284: unlink f5 0 2024-04-20T10:54:31.601 INFO:tasks.workunit.client.1.smithi175.stdout:3/285: fdatasync d7/d21/f41 0 2024-04-20T10:54:31.606 INFO:tasks.workunit.client.1.smithi175.stdout:2/269: symlink d1/d7/d1f/l56 0 2024-04-20T10:54:31.609 INFO:tasks.workunit.client.1.smithi175.stdout:1/287: link d0/d8/d13/f1b d0/d8/d13/d2e/f5b 0 2024-04-20T10:54:31.610 INFO:tasks.workunit.client.1.smithi175.stdout:9/351: write f5 [3467669,966] 0 2024-04-20T10:54:31.610 INFO:tasks.workunit.client.1.smithi175.stdout:7/437: dwrite db/d61/f68 [0,4194304] 0 2024-04-20T10:54:31.615 INFO:tasks.workunit.client.1.smithi175.stdout:2/270: creat d1/f57 x:0 0 0 2024-04-20T10:54:31.617 INFO:tasks.workunit.client.1.smithi175.stdout:1/288: creat d0/d29/f5c x:0 0 0 2024-04-20T10:54:31.618 INFO:tasks.workunit.client.1.smithi175.stdout:9/352: rename d6/d1b/d2f/d48 to d6/d33/d63 0 2024-04-20T10:54:31.618 INFO:tasks.workunit.client.1.smithi175.stdout:9/353: dread - d6/d1b/d2f/f45 zero size 2024-04-20T10:54:31.621 INFO:tasks.workunit.client.1.smithi175.stdout:1/289: rename d0/d51/f52 to d0/d57/f5d 0 2024-04-20T10:54:31.621 INFO:tasks.workunit.client.1.smithi175.stdout:1/290: write d0/d8/d13/d2e/f44 [4961135,37344] 0 2024-04-20T10:54:31.623 INFO:tasks.workunit.client.1.smithi175.stdout:1/291: rename d0/d51/f4e to d0/d8/f5e 0 2024-04-20T10:54:31.624 INFO:tasks.workunit.client.1.smithi175.stdout:1/292: write d0/fe [678291,641] 0 2024-04-20T10:54:31.628 INFO:tasks.workunit.client.1.smithi175.stdout:3/286: dwrite d7/d21/d16/d22/d2c/f3c [0,4194304] 0 2024-04-20T10:54:31.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/287: mknod d7/d19/d35/c5e 0 2024-04-20T10:54:31.642 INFO:tasks.workunit.client.1.smithi175.stdout:1/293: write d0/d8/d13/d2e/d35/f4b [2416879,94729] 0 2024-04-20T10:54:31.655 INFO:tasks.workunit.client.1.smithi175.stdout:9/354: dwrite f3 [0,4194304] 0 2024-04-20T10:54:31.655 INFO:tasks.workunit.client.1.smithi175.stdout:2/271: dwrite d1/d48/d21/d29/f46 [0,4194304] 0 2024-04-20T10:54:31.655 INFO:tasks.workunit.client.1.smithi175.stdout:2/272: read d1/d7/d1f/f42 [892235,110585] 0 2024-04-20T10:54:31.656 INFO:tasks.workunit.client.1.smithi175.stdout:1/294: dwrite d0/d57/f5d [0,4194304] 0 2024-04-20T10:54:31.658 INFO:tasks.workunit.client.1.smithi175.stdout:9/355: rename d6/f20 to d6/d1b/d2f/f64 0 2024-04-20T10:54:31.658 INFO:tasks.workunit.client.1.smithi175.stdout:9/356: dread - d6/f4a zero size 2024-04-20T10:54:31.659 INFO:tasks.workunit.client.1.smithi175.stdout:2/273: creat d1/d48/d38/f58 x:0 0 0 2024-04-20T10:54:31.661 INFO:tasks.workunit.client.1.smithi175.stdout:1/295: creat d0/d8/f5f x:0 0 0 2024-04-20T10:54:31.661 INFO:tasks.workunit.client.1.smithi175.stdout:9/357: getdents d6/d33/d63 0 2024-04-20T10:54:31.663 INFO:tasks.workunit.client.1.smithi175.stdout:2/274: link d1/d7/d1f/l2a d1/d48/d38/l59 0 2024-04-20T10:54:31.664 INFO:tasks.workunit.client.1.smithi175.stdout:1/296: creat d0/d8/d13/f60 x:0 0 0 2024-04-20T10:54:31.664 INFO:tasks.workunit.client.1.smithi175.stdout:9/358: symlink d6/d1b/l65 0 2024-04-20T10:54:31.666 INFO:tasks.workunit.client.1.smithi175.stdout:2/275: mknod d1/c5a 0 2024-04-20T10:54:31.667 INFO:tasks.workunit.client.1.smithi175.stdout:9/359: symlink d6/d1b/d2f/l66 0 2024-04-20T10:54:31.667 INFO:tasks.workunit.client.1.smithi175.stdout:9/360: fsync d6/f16 0 2024-04-20T10:54:31.668 INFO:tasks.workunit.client.1.smithi175.stdout:2/276: rename d1/d48/d21/d29/f18 to d1/d7/f5b 0 2024-04-20T10:54:31.669 INFO:tasks.workunit.client.1.smithi175.stdout:9/361: mknod d6/d1b/c67 0 2024-04-20T10:54:31.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.669+0000 7efc6a825640 1 Processor -- start 2024-04-20T10:54:31.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.669+0000 7efc6a825640 1 -- start start 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.670+0000 7efc6a825640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64153ef0 0x7efc640c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.670+0000 7efc6a825640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efc640ab730 0x7efc641568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc6a825640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7efc640c9ee0 0x7efc64156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efc640ab730 0x7efc641568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efc640ab730 0x7efc641568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60008/0 (socket says 172.21.15.90:60008) 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 -- 172.21.15.90:0/1082215242 learned_addr learned my addr 172.21.15.90:0/1082215242 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7efc6415a720 con 0x7efc640ab730 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7efc6415ac80 con 0x7efc640c9ee0 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efc6415a9a0 con 0x7efc64153ef0 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 -- 172.21.15.90:0/1082215242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64153ef0 msgr2=0x7efc640c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:31.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 --2- 172.21.15.90:0/1082215242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64153ef0 0x7efc640c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 -- 172.21.15.90:0/1082215242 >> v2:172.21.15.175:3300/0 conn(0x7efc640c9ee0 msgr2=0x7efc64156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:31.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 --2- 172.21.15.90:0/1082215242 >> v2:172.21.15.175:3300/0 conn(0x7efc640c9ee0 0x7efc64156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.671+0000 7efc637fe640 1 -- 172.21.15.90:0/1082215242 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc640c6a90 con 0x7efc640ab730 2024-04-20T10:54:31.673 INFO:tasks.workunit.client.1.smithi175.stdout:2/277: dread d1/d7/f8 [4194304,4194304] 0 2024-04-20T10:54:31.674 INFO:tasks.workunit.client.1.smithi175.stdout:2/278: getdents d1/d48 0 2024-04-20T10:54:31.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.673+0000 7efc637fe640 1 --2- 172.21.15.90:0/1082215242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640ab730 0x7efc641568c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efc640c9b40 tx=0x7efc5802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8e37a7c797cffa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.673+0000 7efc62ffd640 1 -- 172.21.15.90:0/1082215242 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58038070 con 0x7efc640ab730 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.673+0000 7efc62ffd640 1 -- 172.21.15.90:0/1082215242 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5802f050 con 0x7efc640ab730 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.673+0000 7efc62ffd640 1 -- 172.21.15.90:0/1082215242 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58031970 con 0x7efc640ab730 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640ab730 msgr2=0x7efc641568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 --2- 172.21.15.90:0/1082215242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640ab730 0x7efc641568c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efc640c9b40 tx=0x7efc5802b7f0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 shutdown_connections 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 --2- 172.21.15.90:0/1082215242 >> v2:172.21.15.175:3300/0 conn(0x7efc640c9ee0 0x7efc64156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 --2- 172.21.15.90:0/1082215242 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640ab730 0x7efc641568c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 --2- 172.21.15.90:0/1082215242 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc64153ef0 0x7efc640c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 >> 172.21.15.90:0/1082215242 conn(0x7efc640cbfe0 msgr2=0x7efc640cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 shutdown_connections 2024-04-20T10:54:31.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.674+0000 7efc6a825640 1 -- 172.21.15.90:0/1082215242 wait complete. 2024-04-20T10:54:31.676 INFO:tasks.workunit.client.1.smithi175.stdout:2/279: mknod d1/d7/d1e/d36/c5c 0 2024-04-20T10:54:31.676 INFO:tasks.workunit.client.1.smithi175.stdout:2/280: mknod d1/d48/d38/c5d 0 2024-04-20T10:54:31.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.676+0000 7efc6a825640 1 Processor -- start 2024-04-20T10:54:31.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.677+0000 7efc6a825640 1 -- start start 2024-04-20T10:54:31.677 INFO:tasks.workunit.client.1.smithi175.stdout:2/281: mknod d1/d7/d1e/d36/c5e 0 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.677+0000 7efc6a825640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc640ab730 0x7efc640c5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.677+0000 7efc6a825640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640c9ee0 0x7efc641e31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.677+0000 7efc6a825640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc64153ef0 0x7efc64150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.677+0000 7efc6a825640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efc640bf800 con 0x7efc640c9ee0 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.677+0000 7efc6a825640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efc64157340 con 0x7efc64153ef0 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.677+0000 7efc6a825640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efc640c37a0 con 0x7efc640ab730 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640c9ee0 0x7efc641e31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640c9ee0 0x7efc641e31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60018/0 (socket says 172.21.15.90:60018) 2024-04-20T10:54:31.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 -- 172.21.15.90:0/2323907859 learned_addr learned my addr 172.21.15.90:0/2323907859 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 -- 172.21.15.90:0/2323907859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc640ab730 msgr2=0x7efc640c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc640ab730 0x7efc640c5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 -- 172.21.15.90:0/2323907859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc64153ef0 msgr2=0x7efc64150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc64153ef0 0x7efc64150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 -- 172.21.15.90:0/2323907859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc641ec730 con 0x7efc640c9ee0 2024-04-20T10:54:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.678+0000 7efc637fe640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640c9ee0 0x7efc641e31c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.679+0000 7efc60ff9640 1 -- 172.21.15.90:0/2323907859 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58042070 con 0x7efc640c9ee0 2024-04-20T10:54:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.679+0000 7efc60ff9640 1 -- 172.21.15.90:0/2323907859 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc5803d870 con 0x7efc640c9ee0 2024-04-20T10:54:31.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.679+0000 7efc60ff9640 1 -- 172.21.15.90:0/2323907859 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc58038040 con 0x7efc640c9ee0 2024-04-20T10:54:31.681 INFO:tasks.workunit.client.1.smithi175.stdout:1/297: dwrite d0/f2a [0,4194304] 0 2024-04-20T10:54:31.681 INFO:tasks.workunit.client.1.smithi175.stdout:2/282: dread d1/d48/d21/d29/f39 [0,4194304] 0 2024-04-20T10:54:31.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.679+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc640c3150 con 0x7efc640c9ee0 2024-04-20T10:54:31.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.679+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc641e3700 con 0x7efc640c9ee0 2024-04-20T10:54:31.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.681+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc640c7d50 con 0x7efc640c9ee0 2024-04-20T10:54:31.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.681+0000 7efc60ff9640 1 -- 172.21.15.90:0/2323907859 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efc58045070 con 0x7efc640c9ee0 2024-04-20T10:54:31.682 INFO:tasks.workunit.client.1.smithi175.stdout:1/298: dread d0/d8/d13/d2e/f5b [0,4194304] 0 2024-04-20T10:54:31.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.681+0000 7efc60ff9640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efc5006c8f0 0x7efc5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:31.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.682+0000 7efc60ff9640 1 -- 172.21.15.90:0/2323907859 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7efc580adfb0 con 0x7efc640c9ee0 2024-04-20T10:54:31.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.682+0000 7efc63fff640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efc5006c8f0 0x7efc5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:31.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.682+0000 7efc63fff640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efc5006c8f0 0x7efc5006edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc54009670 tx=0x7efc54006bf0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:31.683 INFO:tasks.workunit.client.1.smithi175.stdout:2/283: symlink d1/d7/d1f/l5f 0 2024-04-20T10:54:31.684 INFO:tasks.workunit.client.1.smithi175.stdout:1/299: mkdir d0/d3e/d61 0 2024-04-20T10:54:31.684 INFO:tasks.workunit.client.1.smithi175.stdout:2/284: mknod d1/d48/d21/c60 0 2024-04-20T10:54:31.685 INFO:tasks.workunit.client.1.smithi175.stdout:2/285: dread d1/d48/f27 [0,4194304] 0 2024-04-20T10:54:31.686 INFO:tasks.workunit.client.1.smithi175.stdout:2/286: mknod d1/c61 0 2024-04-20T10:54:31.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.687+0000 7efc60ff9640 1 -- 172.21.15.90:0/2323907859 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7efc5807bff0 con 0x7efc640c9ee0 2024-04-20T10:54:31.696 INFO:tasks.workunit.client.1.smithi175.stdout:9/362: dwrite d6/f16 [0,4194304] 0 2024-04-20T10:54:31.696 INFO:tasks.workunit.client.1.smithi175.stdout:2/287: dread d1/d7/f5b [0,4194304] 0 2024-04-20T10:54:31.696 INFO:tasks.workunit.client.1.smithi175.stdout:2/288: chown d1/d7/f8 6 1 2024-04-20T10:54:31.720 INFO:tasks.workunit.client.1.smithi175.stdout:9/363: dwrite d6/d1b/d2f/f38 [0,4194304] 0 2024-04-20T10:54:31.720 INFO:tasks.workunit.client.1.smithi175.stdout:9/364: dread - d6/f43 zero size 2024-04-20T10:54:31.720 INFO:tasks.workunit.client.1.smithi175.stdout:9/365: truncate d6/d10/f1e 5455560 0 2024-04-20T10:54:31.720 INFO:tasks.workunit.client.1.smithi175.stdout:9/366: chown d6/d33/d63/c4b 37332 1 2024-04-20T10:54:31.720 INFO:tasks.workunit.client.1.smithi175.stdout:9/367: dread - d6/f3c zero size 2024-04-20T10:54:31.721 INFO:tasks.workunit.client.1.smithi175.stdout:2/289: dwrite d1/d48/d38/f58 [0,4194304] 0 2024-04-20T10:54:31.724 INFO:tasks.workunit.client.1.smithi175.stdout:2/290: symlink d1/d7/d1e/l62 0 2024-04-20T10:54:31.740 INFO:tasks.workunit.client.1.smithi175.stdout:2/291: dwrite d1/d7/d1f/f42 [0,4194304] 0 2024-04-20T10:54:31.770 INFO:tasks.workunit.client.0.smithi090.stdout:9/1: sync 2024-04-20T10:54:31.770 INFO:tasks.workunit.client.0.smithi090.stdout:9/2: truncate - no filename 2024-04-20T10:54:31.770 INFO:tasks.workunit.client.0.smithi090.stdout:9/3: mkdir d0 0 2024-04-20T10:54:31.770 INFO:tasks.workunit.client.0.smithi090.stdout:9/4: write - no filename 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/5: dwrite - no filename 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/6: chown d0 1352257951 1 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/7: fsync - no filename 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/8: truncate - no filename 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/9: dwrite - no filename 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/10: creat d0/f1 x:0 0 0 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/11: chown d0/f1 0 1 2024-04-20T10:54:31.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/12: chown d0 16610538 1 2024-04-20T10:54:31.772 INFO:tasks.workunit.client.1.smithi175.stdout:5/387: dread f2 [0,4194304] 0 2024-04-20T10:54:31.772 INFO:tasks.workunit.client.1.smithi175.stdout:5/388: write db/d1f/f20 [1171588,32682] 0 2024-04-20T10:54:31.774 INFO:tasks.workunit.client.1.smithi175.stdout:5/389: creat db/d1f/d31/f77 x:0 0 0 2024-04-20T10:54:31.775 INFO:tasks.workunit.client.0.smithi090.stdout:9/13: getdents d0 0 2024-04-20T10:54:31.775 INFO:tasks.workunit.client.0.smithi090.stdout:9/14: fsync d0/f1 0 2024-04-20T10:54:31.775 INFO:tasks.workunit.client.0.smithi090.stdout:9/15: read - d0/f1 zero size 2024-04-20T10:54:31.775 INFO:tasks.workunit.client.0.smithi090.stdout:9/16: stat d0 0 2024-04-20T10:54:31.775 INFO:tasks.workunit.client.0.smithi090.stdout:9/17: dread - d0/f1 zero size 2024-04-20T10:54:31.775 INFO:tasks.workunit.client.1.smithi175.stdout:5/390: truncate db/d11/f43 2819287 0 2024-04-20T10:54:31.776 INFO:tasks.workunit.client.0.smithi090.stdout:9/18: unlink d0/f1 0 2024-04-20T10:54:31.776 INFO:tasks.workunit.client.0.smithi090.stdout:9/19: link - no file 2024-04-20T10:54:31.776 INFO:tasks.workunit.client.0.smithi090.stdout:9/20: dread - no filename 2024-04-20T10:54:31.777 INFO:tasks.workunit.client.1.smithi175.stdout:5/391: creat db/d30/d46/d4b/d4f/f78 x:0 0 0 2024-04-20T10:54:31.779 INFO:tasks.workunit.client.1.smithi175.stdout:5/392: unlink db/d30/d46/f5d 0 2024-04-20T10:54:31.779 INFO:tasks.workunit.client.1.smithi175.stdout:5/393: truncate db/d11/d1a/f36 954816 0 2024-04-20T10:54:31.779 INFO:tasks.workunit.client.1.smithi175.stdout:5/394: write db/d1f/d31/f33 [4952540,3757] 0 2024-04-20T10:54:31.781 INFO:tasks.workunit.client.1.smithi175.stdout:5/395: rename db/c22 to db/d11/d25/d41/c79 0 2024-04-20T10:54:31.782 INFO:tasks.workunit.client.1.smithi175.stdout:5/396: symlink db/d30/l7a 0 2024-04-20T10:54:31.782 INFO:tasks.workunit.client.1.smithi175.stdout:5/397: write db/d1f/d31/f33 [5994219,7389] 0 2024-04-20T10:54:31.783 INFO:tasks.workunit.client.1.smithi175.stdout:5/398: rename db/d11/d25 to db/d11/d25/d7b 22 2024-04-20T10:54:31.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.920+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc64076150 con 0x7efc640c9ee0 2024-04-20T10:54:31.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.920+0000 7efc60ff9640 1 -- 172.21.15.90:0/2323907859 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7efc5807b8f0 con 0x7efc640c9ee0 2024-04-20T10:54:31.921 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:31.921 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:31.921 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:31.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efc5006c8f0 msgr2=0x7efc5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:31.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efc5006c8f0 0x7efc5006edb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7efc54009670 tx=0x7efc54006bf0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640c9ee0 msgr2=0x7efc641e31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:31.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640c9ee0 0x7efc641e31c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7efc58000c00 tx=0x7efc580046c0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 shutdown_connections 2024-04-20T10:54:31.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efc5006c8f0 0x7efc5006edb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efc64153ef0 0x7efc64150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efc640c9ee0 0x7efc641e31c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.922+0000 7efc6a825640 1 --2- 172.21.15.90:0/2323907859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efc640ab730 0x7efc640c5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:31.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.923+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 >> 172.21.15.90:0/2323907859 conn(0x7efc640cbfe0 msgr2=0x7efc640cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:31.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.923+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 shutdown_connections 2024-04-20T10:54:31.924 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:31.923+0000 7efc6a825640 1 -- 172.21.15.90:0/2323907859 wait complete. 2024-04-20T10:54:31.933 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2024-04-20T10:54:31.934 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-20T10:54:31.934 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:54:31.946 INFO:tasks.ceph.mds.a:Stopped 2024-04-20T10:54:31.947 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.085+0000 7f8b0b32b640 1 Processor -- start 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.085+0000 7f8b0b32b640 1 -- start start 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b0b32b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8b040c4130 0x7f8b0406d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b0b32b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 0x7f8b040ab1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b0b32b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0406e2d0 con 0x7f8b040ab6e0 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b0b32b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8b040ae150 con 0x7f8b040c4130 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b0b32b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0406d480 con 0x7f8b0406de50 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b098c8640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8b040ab6e0 0x7f8b041671b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:46164/0 (socket says 172.21.15.90:46164) 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b098c8640 1 -- 172.21.15.90:0/1188114196 learned_addr learned my addr 172.21.15.90:0/1188114196 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:32.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b090c7640 1 --2- 172.21.15.90:0/1188114196 >> v2:172.21.15.175:3300/0 conn(0x7f8b040c4130 0x7f8b0406d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394719776 0 0) 0x7f8b0406e2d0 con 0x7f8b040ab6e0 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.086+0000 7f8b088c6640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 0x7f8b040ab1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.104+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8af0007930 con 0x7f8b040ab6e0 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4010207918 0 0) 0x7f8af0007930 con 0x7f8b040ab6e0 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 msgr2=0x7f8b040ab1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 0x7f8b040ab1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 >> v2:172.21.15.175:3300/0 conn(0x7f8b040c4130 msgr2=0x7f8b0406d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 --2- 172.21.15.90:0/1188114196 >> v2:172.21.15.175:3300/0 conn(0x7f8b040c4130 0x7f8b0406d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b040ac250 con 0x7f8b040ab6e0 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f8afc0019f0 con 0x7f8b040ab6e0 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 >> v1:172.21.15.90:6789/0 conn(0x7f8b040ab6e0 legacy=0x7f8b041671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 0x7f8af0007de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af00083b0 0x7f8af0008c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8af0009150 0x7f8af00095d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040ae150 con 0x7f8af0009150 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0406d480 con 0x7f8af00083b0 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8af000fe80 con 0x7f8b0406de50 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b098c8640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8af0009150 0x7f8af00095d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b088c6640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af00083b0 0x7f8af0008c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b090c7640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 0x7f8af0007de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b098c8640 1 -- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 msgr2=0x7f8af0007de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b098c8640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b0406de50 0x7f8af0007de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b098c8640 1 -- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af00083b0 msgr2=0x7f8af0008c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b098c8640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af00083b0 0x7f8af0008c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b098c8640 1 -- 172.21.15.90:0/1188114196 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af0007930 con 0x7f8af0009150 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.105+0000 7f8b088c6640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af00083b0 0x7f8af0008c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.106+0000 7f8b098c8640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8af0009150 0x7f8af00095d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00a7a0 tx=0x7f8af0009c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc01241aedd2156f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:32.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.106+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc00a3f0 con 0x7f8af0009150 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.106+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8afc034650 con 0x7f8af0009150 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.106+0000 7f8afbfff640 1 -- 172.21.15.90:0/1188114196 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8afc034a40 con 0x7f8af0009150 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.107+0000 7f8b0b32b640 1 -- 172.21.15.90:0/1188114196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8af0009150 msgr2=0x7f8af00095d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.107+0000 7f8b0b32b640 1 --2- 172.21.15.90:0/1188114196 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8af0009150 0x7f8af00095d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00a7a0 tx=0x7f8af0009c40 comp rx=0 tx=0).stop 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.107+0000 7f8b098c8640 1 -- 172.21.15.90:0/1188114196 reap_dead start 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.107+0000 7f8b0b32b640 1 -- 172.21.15.90:0/1188114196 shutdown_connections 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.107+0000 7f8b0b32b640 1 -- 172.21.15.90:0/1188114196 >> 172.21.15.90:0/1188114196 conn(0x7f8b040c8080 msgr2=0x7f8b040c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.107+0000 7f8b0b32b640 1 -- 172.21.15.90:0/1188114196 shutdown_connections 2024-04-20T10:54:32.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.107+0000 7f8b0b32b640 1 -- 172.21.15.90:0/1188114196 wait complete. 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 Processor -- start 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 -- start start 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af0009150 0x7f8b041f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b040bd900 0x7f8b040bdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b040bfbd0 0x7f8b040c0050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040c3050 con 0x7f8b040bd900 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8b04073b00 con 0x7f8af0009150 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.108+0000 7f8b0b32b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8b04070510 con 0x7f8b040bfbd0 2024-04-20T10:54:32.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b040bd900 0x7f8b040bdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b040bd900 0x7f8b040bdd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60038/0 (socket says 172.21.15.90:60038) 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 -- 172.21.15.90:0/2780128783 learned_addr learned my addr 172.21.15.90:0/2780128783 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b098c8640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b040bfbd0 0x7f8b040c0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b090c7640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af0009150 0x7f8b041f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 -- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b040bfbd0 msgr2=0x7f8b040c0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b040bfbd0 0x7f8b040c0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 -- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af0009150 msgr2=0x7f8b041f93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af0009150 0x7f8b041f93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 -- 172.21.15.90:0/2780128783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b041eeac0 con 0x7f8b040bd900 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b088c6640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b040bd900 0x7f8b040bdd80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8af400dd50 tx=0x7f8af400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8af9ffb640 1 -- 172.21.15.90:0/2780128783 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4004220 con 0x7f8b040bd900 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8af9ffb640 1 -- 172.21.15.90:0/2780128783 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af40043c0 con 0x7f8b040bd900 2024-04-20T10:54:32.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b040c1e00 con 0x7f8b040bd900 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8af9ffb640 1 -- 172.21.15.90:0/2780128783 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af400a850 con 0x7f8b040bd900 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.109+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b040c23c0 con 0x7f8b040bd900 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.110+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b04076150 con 0x7f8b040bd900 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.111+0000 7f8af9ffb640 1 -- 172.21.15.90:0/2780128783 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8af401f020 con 0x7f8b040bd900 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.111+0000 7f8af9ffb640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ae806c8f0 0x7f8ae806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.111+0000 7f8af9ffb640 1 -- 172.21.15.90:0/2780128783 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f8af408ccc0 con 0x7f8b040bd900 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.111+0000 7f8b090c7640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ae806c8f0 0x7f8ae806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.112+0000 7f8b090c7640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ae806c8f0 0x7f8ae806edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c690 tx=0x7f8b0000f040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:32.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.116+0000 7f8af9ffb640 1 -- 172.21.15.90:0/2780128783 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8af405a630 con 0x7f8b040bd900 2024-04-20T10:54:32.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.326+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b041ecfa0 con 0x7f8b040bd900 2024-04-20T10:54:32.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.327+0000 7f8af9ffb640 1 -- 172.21.15.90:0/2780128783 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7f8af405e930 con 0x7f8b040bd900 2024-04-20T10:54:32.327 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:32.327 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:32.327 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.328+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ae806c8f0 msgr2=0x7f8ae806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.328+0000 7f8b0b32b640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ae806c8f0 0x7f8ae806edb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f8b0000c690 tx=0x7f8b0000f040 comp rx=0 tx=0).stop 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.328+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b040bd900 msgr2=0x7f8b040bdd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.328+0000 7f8b0b32b640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b040bd900 0x7f8b040bdd80 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f8af400dd50 tx=0x7f8af400b780 comp rx=0 tx=0).stop 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.328+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 shutdown_connections 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.329+0000 7f8b0b32b640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8ae806c8f0 0x7f8ae806edb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.329+0000 7f8b0b32b640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8b040bfbd0 0x7f8b040c0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.329+0000 7f8b0b32b640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8b040bd900 0x7f8b040bdd80 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.329+0000 7f8b0b32b640 1 --2- 172.21.15.90:0/2780128783 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8af0009150 0x7f8b041f93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:32.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.329+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 >> 172.21.15.90:0/2780128783 conn(0x7f8b040c8080 msgr2=0x7f8b040c34d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:32.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.329+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 shutdown_connections 2024-04-20T10:54:32.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:32.329+0000 7f8b0b32b640 1 -- 172.21.15.90:0/2780128783 wait complete. 2024-04-20T10:54:32.340 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:33.360 INFO:tasks.workunit.client.0.smithi090.stdout:6/15: sync 2024-04-20T10:54:33.361 INFO:tasks.workunit.client.0.smithi090.stdout:6/16: mkdir d1/d5 0 2024-04-20T10:54:33.362 INFO:tasks.workunit.client.0.smithi090.stdout:6/17: truncate d1/f2 4171140 0 2024-04-20T10:54:33.362 INFO:tasks.workunit.client.0.smithi090.stdout:6/18: chown d1 971063 1 2024-04-20T10:54:33.377 INFO:tasks.workunit.client.0.smithi090.stdout:6/19: dread d1/f2 [0,4194304] 0 2024-04-20T10:54:33.378 INFO:tasks.workunit.client.0.smithi090.stdout:6/20: rmdir d1 39 2024-04-20T10:54:33.378 INFO:tasks.workunit.client.0.smithi090.stdout:6/21: chown d1/d3 59158123 1 2024-04-20T10:54:33.378 INFO:tasks.workunit.client.0.smithi090.stdout:6/22: creat d1/f6 x:0 0 0 2024-04-20T10:54:33.379 INFO:tasks.workunit.client.0.smithi090.stdout:6/23: mknod d1/c7 0 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:0/38: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:4/21: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:7/35: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:3/25: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:8/61: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:2/21: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:5/117: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:2/22: dread - f9 zero size 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:2/23: chown f3 6 1 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:1/18: sync 2024-04-20T10:54:33.531 INFO:tasks.workunit.client.0.smithi090.stdout:9/21: sync 2024-04-20T10:54:33.532 INFO:tasks.workunit.client.0.smithi090.stdout:9/22: dread - no filename 2024-04-20T10:54:33.532 INFO:tasks.workunit.client.0.smithi090.stdout:9/23: dread - no filename 2024-04-20T10:54:33.532 INFO:tasks.workunit.client.0.smithi090.stdout:1/19: write f5 [104017,105910] 0 2024-04-20T10:54:33.532 INFO:tasks.workunit.client.0.smithi090.stdout:1/20: truncate d8/fb 269256 0 2024-04-20T10:54:33.532 INFO:tasks.workunit.client.0.smithi090.stdout:7/36: mkdir d11/d13 0 2024-04-20T10:54:33.532 INFO:tasks.workunit.client.0.smithi090.stdout:7/37: write f9 [29741,118995] 0 2024-04-20T10:54:33.533 INFO:tasks.workunit.client.0.smithi090.stdout:3/26: link d7/fa d7/fb 0 2024-04-20T10:54:33.534 INFO:tasks.workunit.client.0.smithi090.stdout:8/62: creat d0/f12 x:0 0 0 2024-04-20T10:54:33.535 INFO:tasks.workunit.client.0.smithi090.stdout:5/118: mknod d1/da/d1f/c24 0 2024-04-20T10:54:33.537 INFO:tasks.workunit.client.0.smithi090.stdout:2/24: creat fb x:0 0 0 2024-04-20T10:54:33.537 INFO:tasks.workunit.client.0.smithi090.stdout:2/25: dread - f9 zero size 2024-04-20T10:54:33.537 INFO:tasks.workunit.client.0.smithi090.stdout:9/24: mknod d0/c2 0 2024-04-20T10:54:33.538 INFO:tasks.workunit.client.0.smithi090.stdout:9/25: write - no filename 2024-04-20T10:54:33.538 INFO:tasks.workunit.client.0.smithi090.stdout:9/26: dread - no filename 2024-04-20T10:54:33.538 INFO:tasks.workunit.client.0.smithi090.stdout:1/21: mknod d8/cc 0 2024-04-20T10:54:33.540 INFO:tasks.workunit.client.0.smithi090.stdout:7/38: mknod d11/c14 0 2024-04-20T10:54:33.540 INFO:tasks.workunit.client.0.smithi090.stdout:7/39: stat f0 0 2024-04-20T10:54:33.540 INFO:tasks.workunit.client.0.smithi090.stdout:7/40: chown l5 63432334 1 2024-04-20T10:54:33.542 INFO:tasks.workunit.client.0.smithi090.stdout:3/27: creat d7/fc x:0 0 0 2024-04-20T10:54:33.542 INFO:tasks.workunit.client.0.smithi090.stdout:8/63: symlink d0/l13 0 2024-04-20T10:54:33.542 INFO:tasks.workunit.client.0.smithi090.stdout:8/64: write d0/fe [439771,44349] 0 2024-04-20T10:54:33.543 INFO:tasks.workunit.client.0.smithi090.stdout:2/26: creat fc x:0 0 0 2024-04-20T10:54:33.544 INFO:tasks.workunit.client.0.smithi090.stdout:2/27: chown l4 53765063 1 2024-04-20T10:54:33.544 INFO:tasks.workunit.client.0.smithi090.stdout:9/27: mknod d0/c3 0 2024-04-20T10:54:33.544 INFO:tasks.workunit.client.0.smithi090.stdout:9/28: write - no filename 2024-04-20T10:54:33.546 INFO:tasks.workunit.client.0.smithi090.stdout:1/22: dread f5 [0,4194304] 0 2024-04-20T10:54:33.546 INFO:tasks.workunit.client.0.smithi090.stdout:1/23: stat d8/cc 0 2024-04-20T10:54:33.546 INFO:tasks.workunit.client.0.smithi090.stdout:7/41: link lc d11/d13/l15 0 2024-04-20T10:54:33.546 INFO:tasks.workunit.client.0.smithi090.stdout:7/42: chown f1 937 1 2024-04-20T10:54:33.546 INFO:tasks.workunit.client.0.smithi090.stdout:7/43: stat d11 0 2024-04-20T10:54:33.547 INFO:tasks.workunit.client.0.smithi090.stdout:3/28: rename d7/fb to d7/fd 0 2024-04-20T10:54:33.547 INFO:tasks.workunit.client.0.smithi090.stdout:8/65: mkdir d0/d11/d14 0 2024-04-20T10:54:33.548 INFO:tasks.workunit.client.0.smithi090.stdout:8/66: chown d0/f9 41107 1 2024-04-20T10:54:33.548 INFO:tasks.workunit.client.0.smithi090.stdout:8/67: write d0/f12 [740502,40761] 0 2024-04-20T10:54:33.548 INFO:tasks.workunit.client.0.smithi090.stdout:8/68: write d0/fe [405888,113366] 0 2024-04-20T10:54:33.548 INFO:tasks.workunit.client.0.smithi090.stdout:2/28: rename f9 to fd 0 2024-04-20T10:54:33.548 INFO:tasks.workunit.client.0.smithi090.stdout:2/29: rmdir - no directory 2024-04-20T10:54:33.549 INFO:tasks.workunit.client.0.smithi090.stdout:9/29: creat d0/f4 x:0 0 0 2024-04-20T10:54:33.549 INFO:tasks.workunit.client.0.smithi090.stdout:9/30: write d0/f4 [412952,94772] 0 2024-04-20T10:54:33.550 INFO:tasks.workunit.client.0.smithi090.stdout:1/24: creat d8/fd x:0 0 0 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:7/44: creat d11/f16 x:0 0 0 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:1/25: dread d8/fb [0,4194304] 0 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:3/29: symlink d7/le 0 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:3/30: dread - d7/fc zero size 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:2/30: symlink le 0 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:9/31: rename d0/c3 to d0/c5 0 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:7/45: truncate f6 3128747 0 2024-04-20T10:54:33.555 INFO:tasks.workunit.client.0.smithi090.stdout:1/26: creat d8/fe x:0 0 0 2024-04-20T10:54:33.556 INFO:tasks.workunit.client.0.smithi090.stdout:2/31: mknod cf 0 2024-04-20T10:54:33.556 INFO:tasks.workunit.client.0.smithi090.stdout:9/32: mknod d0/c6 0 2024-04-20T10:54:33.557 INFO:tasks.workunit.client.0.smithi090.stdout:1/27: mknod d8/cf 0 2024-04-20T10:54:33.560 INFO:tasks.workunit.client.0.smithi090.stdout:2/32: mknod c10 0 2024-04-20T10:54:33.561 INFO:tasks.workunit.client.0.smithi090.stdout:0/39: dwrite f2 [0,4194304] 0 2024-04-20T10:54:33.561 INFO:tasks.workunit.client.0.smithi090.stdout:4/22: dwrite f0 [0,4194304] 0 2024-04-20T10:54:33.565 INFO:tasks.workunit.client.0.smithi090.stdout:5/119: dwrite d1/da/f1e [0,4194304] 0 2024-04-20T10:54:33.565 INFO:tasks.workunit.client.0.smithi090.stdout:0/40: rename f2 to fb 0 2024-04-20T10:54:33.567 INFO:tasks.workunit.client.0.smithi090.stdout:4/23: mkdir d7 0 2024-04-20T10:54:33.570 INFO:tasks.workunit.client.0.smithi090.stdout:5/120: rmdir d1/da/d14 39 2024-04-20T10:54:33.570 INFO:tasks.workunit.client.0.smithi090.stdout:5/121: dread - d1/de/f20 zero size 2024-04-20T10:54:33.570 INFO:tasks.workunit.client.0.smithi090.stdout:8/69: getdents d0/d11 0 2024-04-20T10:54:33.571 INFO:tasks.workunit.client.0.smithi090.stdout:2/33: fsync fd 0 2024-04-20T10:54:33.571 INFO:tasks.workunit.client.0.smithi090.stdout:2/34: truncate fd 4621 0 2024-04-20T10:54:33.574 INFO:tasks.workunit.client.0.smithi090.stdout:3/31: getdents d7 0 2024-04-20T10:54:33.574 INFO:tasks.workunit.client.0.smithi090.stdout:3/32: write d7/fa [125383,85882] 0 2024-04-20T10:54:33.575 INFO:tasks.workunit.client.0.smithi090.stdout:7/46: dwrite f4 [0,4194304] 0 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:5/122: unlink d1/de/f11 0 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:4/24: dread f0 [0,4194304] 0 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:5/123: fdatasync d1/de/f22 0 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:5/124: chown d1/de 11168 1 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:4/25: chown c1 189 1 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:4/26: chown f0 1002 1 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:5/125: read - d1/f23 zero size 2024-04-20T10:54:33.577 INFO:tasks.workunit.client.0.smithi090.stdout:8/70: getdents d0 0 2024-04-20T10:54:33.578 INFO:tasks.workunit.client.0.smithi090.stdout:2/35: mkdir d11 0 2024-04-20T10:54:33.578 INFO:tasks.workunit.client.0.smithi090.stdout:2/36: fsync fc 0 2024-04-20T10:54:33.578 INFO:tasks.workunit.client.0.smithi090.stdout:4/27: dread f2 [0,4194304] 0 2024-04-20T10:54:33.579 INFO:tasks.workunit.client.0.smithi090.stdout:2/37: readlink l7 0 2024-04-20T10:54:33.579 INFO:tasks.workunit.client.0.smithi090.stdout:2/38: truncate fc 685516 0 2024-04-20T10:54:33.579 INFO:tasks.workunit.client.0.smithi090.stdout:2/39: write fb [59403,29153] 0 2024-04-20T10:54:33.579 INFO:tasks.workunit.client.0.smithi090.stdout:2/40: truncate fb 380177 0 2024-04-20T10:54:33.579 INFO:tasks.workunit.client.0.smithi090.stdout:2/41: chown c10 988295 1 2024-04-20T10:54:33.579 INFO:tasks.workunit.client.0.smithi090.stdout:2/42: dread - fa zero size 2024-04-20T10:54:33.579 INFO:tasks.workunit.client.0.smithi090.stdout:4/28: dread f2 [0,4194304] 0 2024-04-20T10:54:33.580 INFO:tasks.workunit.client.0.smithi090.stdout:9/33: dwrite d0/f4 [0,4194304] 0 2024-04-20T10:54:33.582 INFO:tasks.workunit.client.0.smithi090.stdout:7/47: symlink d11/d13/l17 0 2024-04-20T10:54:33.582 INFO:tasks.workunit.client.0.smithi090.stdout:7/48: chown f0 15 1 2024-04-20T10:54:33.583 INFO:tasks.workunit.client.0.smithi090.stdout:5/126: rmdir d1/de 39 2024-04-20T10:54:33.584 INFO:tasks.workunit.client.0.smithi090.stdout:8/71: mknod d0/d11/c15 0 2024-04-20T10:54:33.586 INFO:tasks.workunit.client.0.smithi090.stdout:2/43: creat d11/f12 x:0 0 0 2024-04-20T10:54:33.586 INFO:tasks.workunit.client.0.smithi090.stdout:2/44: dread - d11/f12 zero size 2024-04-20T10:54:33.589 INFO:tasks.workunit.client.0.smithi090.stdout:0/41: link fb fc 0 2024-04-20T10:54:33.594 INFO:tasks.workunit.client.0.smithi090.stdout:9/34: getdents d0 0 2024-04-20T10:54:33.595 INFO:tasks.workunit.client.0.smithi090.stdout:7/49: unlink ff 0 2024-04-20T10:54:33.595 INFO:tasks.workunit.client.0.smithi090.stdout:7/50: chown d11/d13/l15 3067 1 2024-04-20T10:54:33.596 INFO:tasks.workunit.client.0.smithi090.stdout:7/51: chown f9 0 1 2024-04-20T10:54:33.596 INFO:tasks.workunit.client.0.smithi090.stdout:5/127: unlink d1/de/f22 0 2024-04-20T10:54:33.597 INFO:tasks.workunit.client.0.smithi090.stdout:8/72: mknod d0/d11/d14/c16 0 2024-04-20T10:54:33.598 INFO:tasks.workunit.client.0.smithi090.stdout:2/45: symlink d11/l13 0 2024-04-20T10:54:33.600 INFO:tasks.workunit.client.0.smithi090.stdout:0/42: creat fd x:0 0 0 2024-04-20T10:54:33.600 INFO:tasks.workunit.client.0.smithi090.stdout:0/43: write f5 [240772,64559] 0 2024-04-20T10:54:33.600 INFO:tasks.workunit.client.0.smithi090.stdout:9/35: creat d0/f7 x:0 0 0 2024-04-20T10:54:33.600 INFO:tasks.workunit.client.0.smithi090.stdout:9/36: dread - d0/f7 zero size 2024-04-20T10:54:33.601 INFO:tasks.workunit.client.0.smithi090.stdout:9/37: chown d0/c6 49 1 2024-04-20T10:54:33.601 INFO:tasks.workunit.client.0.smithi090.stdout:7/52: dread f10 [0,4194304] 0 2024-04-20T10:54:33.602 INFO:tasks.workunit.client.0.smithi090.stdout:5/128: creat d1/da/d1f/f25 x:0 0 0 2024-04-20T10:54:33.602 INFO:tasks.workunit.client.0.smithi090.stdout:5/129: write d1/f23 [978701,61611] 0 2024-04-20T10:54:33.603 INFO:tasks.workunit.client.0.smithi090.stdout:2/46: rmdir d11 39 2024-04-20T10:54:33.604 INFO:tasks.workunit.client.0.smithi090.stdout:0/44: creat fe x:0 0 0 2024-04-20T10:54:33.604 INFO:tasks.workunit.client.0.smithi090.stdout:3/33: dwrite f6 [0,4194304] 0 2024-04-20T10:54:33.605 INFO:tasks.workunit.client.0.smithi090.stdout:7/53: symlink d11/l18 0 2024-04-20T10:54:33.605 INFO:tasks.workunit.client.0.smithi090.stdout:7/54: fsync f1 0 2024-04-20T10:54:33.606 INFO:tasks.workunit.client.0.smithi090.stdout:5/130: creat d1/f26 x:0 0 0 2024-04-20T10:54:33.606 INFO:tasks.workunit.client.0.smithi090.stdout:5/131: chown d1/da/f1e 10 1 2024-04-20T10:54:33.606 INFO:tasks.workunit.client.0.smithi090.stdout:5/132: fsync d1/da/f19 0 2024-04-20T10:54:33.606 INFO:tasks.workunit.client.0.smithi090.stdout:5/133: read d1/f7 [867807,23136] 0 2024-04-20T10:54:33.606 INFO:tasks.workunit.client.0.smithi090.stdout:4/29: dwrite f0 [0,4194304] 0 2024-04-20T10:54:33.608 INFO:tasks.workunit.client.0.smithi090.stdout:8/73: write d0/f2 [1586591,32855] 0 2024-04-20T10:54:33.608 INFO:tasks.workunit.client.0.smithi090.stdout:2/47: dread f3 [0,4194304] 0 2024-04-20T10:54:33.608 INFO:tasks.workunit.client.0.smithi090.stdout:0/45: rename fc to ff 0 2024-04-20T10:54:33.610 INFO:tasks.workunit.client.0.smithi090.stdout:2/48: dread f8 [0,4194304] 0 2024-04-20T10:54:33.610 INFO:tasks.workunit.client.0.smithi090.stdout:6/24: sync 2024-04-20T10:54:33.611 INFO:tasks.workunit.client.0.smithi090.stdout:9/38: dread d0/f4 [0,4194304] 0 2024-04-20T10:54:33.612 INFO:tasks.workunit.client.0.smithi090.stdout:3/34: dread d7/fd [0,4194304] 0 2024-04-20T10:54:33.612 INFO:tasks.workunit.client.0.smithi090.stdout:3/35: fdatasync f6 0 2024-04-20T10:54:33.612 INFO:tasks.workunit.client.0.smithi090.stdout:5/134: rename d1/da/c21 to d1/da/c27 0 2024-04-20T10:54:33.615 INFO:tasks.workunit.client.0.smithi090.stdout:8/74: rename d0/f3 to d0/f17 0 2024-04-20T10:54:33.616 INFO:tasks.workunit.client.0.smithi090.stdout:0/46: creat f10 x:0 0 0 2024-04-20T10:54:33.617 INFO:tasks.workunit.client.0.smithi090.stdout:8/75: dread d0/f12 [0,4194304] 0 2024-04-20T10:54:33.620 INFO:tasks.workunit.client.0.smithi090.stdout:6/25: unlink d1/c7 0 2024-04-20T10:54:33.620 INFO:tasks.workunit.client.0.smithi090.stdout:6/26: chown c0 10765 1 2024-04-20T10:54:33.621 INFO:tasks.workunit.client.0.smithi090.stdout:9/39: symlink d0/l8 0 2024-04-20T10:54:33.621 INFO:tasks.workunit.client.0.smithi090.stdout:9/40: dread - d0/f7 zero size 2024-04-20T10:54:33.622 INFO:tasks.workunit.client.0.smithi090.stdout:3/36: mkdir d7/df 0 2024-04-20T10:54:33.622 INFO:tasks.workunit.client.0.smithi090.stdout:3/37: chown c5 2049 1 2024-04-20T10:54:33.624 INFO:tasks.workunit.client.0.smithi090.stdout:5/135: read d1/da/f1e [3622141,6645] 0 2024-04-20T10:54:33.624 INFO:tasks.workunit.client.0.smithi090.stdout:0/47: link f6 f11 0 2024-04-20T10:54:33.625 INFO:tasks.workunit.client.0.smithi090.stdout:8/76: link d0/d11/d14/c16 d0/d11/c18 0 2024-04-20T10:54:33.625 INFO:tasks.workunit.client.0.smithi090.stdout:8/77: readlink d0/l5 0 2024-04-20T10:54:33.627 INFO:tasks.workunit.client.0.smithi090.stdout:6/27: rename d1/f2 to d1/d4/f8 0 2024-04-20T10:54:33.628 INFO:tasks.workunit.client.0.smithi090.stdout:9/41: creat d0/f9 x:0 0 0 2024-04-20T10:54:33.631 INFO:tasks.workunit.client.0.smithi090.stdout:5/136: unlink d1/f5 0 2024-04-20T10:54:33.631 INFO:tasks.workunit.client.0.smithi090.stdout:3/38: dread f6 [0,4194304] 0 2024-04-20T10:54:33.632 INFO:tasks.workunit.client.0.smithi090.stdout:2/49: dwrite fc [0,4194304] 0 2024-04-20T10:54:33.633 INFO:tasks.workunit.client.0.smithi090.stdout:0/48: unlink f10 0 2024-04-20T10:54:33.635 INFO:tasks.workunit.client.0.smithi090.stdout:8/78: symlink d0/d11/d14/l19 0 2024-04-20T10:54:33.635 INFO:tasks.workunit.client.0.smithi090.stdout:3/39: dread f6 [0,4194304] 0 2024-04-20T10:54:33.635 INFO:tasks.workunit.client.0.smithi090.stdout:3/40: write f1 [1785671,687] 0 2024-04-20T10:54:33.637 INFO:tasks.workunit.client.0.smithi090.stdout:3/41: write f1 [735562,73680] 0 2024-04-20T10:54:33.637 INFO:tasks.workunit.client.0.smithi090.stdout:9/42: mkdir d0/da 0 2024-04-20T10:54:33.637 INFO:tasks.workunit.client.0.smithi090.stdout:5/137: mknod d1/da/d16/c28 0 2024-04-20T10:54:33.641 INFO:tasks.workunit.client.0.smithi090.stdout:8/79: rmdir d0 39 2024-04-20T10:54:33.641 INFO:tasks.workunit.client.0.smithi090.stdout:8/80: write d0/fe [1142073,93261] 0 2024-04-20T10:54:33.641 INFO:tasks.workunit.client.0.smithi090.stdout:8/81: stat d0/d11 0 2024-04-20T10:54:33.642 INFO:tasks.workunit.client.0.smithi090.stdout:6/28: fsync d1/d4/f8 0 2024-04-20T10:54:33.643 INFO:tasks.workunit.client.0.smithi090.stdout:3/42: mknod d7/df/c10 0 2024-04-20T10:54:33.643 INFO:tasks.workunit.client.0.smithi090.stdout:3/43: chown d7/fa 952324 1 2024-04-20T10:54:33.644 INFO:tasks.workunit.client.0.smithi090.stdout:9/43: mkdir d0/da/db 0 2024-04-20T10:54:33.644 INFO:tasks.workunit.client.0.smithi090.stdout:7/55: dwrite f6 [0,4194304] 0 2024-04-20T10:54:33.645 INFO:tasks.workunit.client.0.smithi090.stdout:5/138: fsync d1/da/d14/f1d 0 2024-04-20T10:54:33.647 INFO:tasks.workunit.client.0.smithi090.stdout:0/49: getdents . 0 2024-04-20T10:54:33.647 INFO:tasks.workunit.client.0.smithi090.stdout:6/29: dread d1/d4/f8 [0,4194304] 0 2024-04-20T10:54:33.648 INFO:tasks.workunit.client.0.smithi090.stdout:8/82: creat d0/d11/f1a x:0 0 0 2024-04-20T10:54:33.648 INFO:tasks.workunit.client.0.smithi090.stdout:8/83: chown d0/d11/d14/l19 380632 1 2024-04-20T10:54:33.649 INFO:tasks.workunit.client.0.smithi090.stdout:3/44: unlink f1 0 2024-04-20T10:54:33.650 INFO:tasks.workunit.client.0.smithi090.stdout:9/44: symlink d0/da/db/lc 0 2024-04-20T10:54:33.651 INFO:tasks.workunit.client.0.smithi090.stdout:7/56: symlink d11/l19 0 2024-04-20T10:54:33.651 INFO:tasks.workunit.client.0.smithi090.stdout:7/57: readlink d11/d13/l15 0 2024-04-20T10:54:33.652 INFO:tasks.workunit.client.0.smithi090.stdout:0/50: mknod c12 0 2024-04-20T10:54:33.653 INFO:tasks.workunit.client.0.smithi090.stdout:0/51: readlink - no filename 2024-04-20T10:54:33.653 INFO:tasks.workunit.client.0.smithi090.stdout:6/30: mknod d1/d4/c9 0 2024-04-20T10:54:33.654 INFO:tasks.workunit.client.0.smithi090.stdout:8/84: getdents d0 0 2024-04-20T10:54:33.654 INFO:tasks.workunit.client.0.smithi090.stdout:3/45: mkdir d7/d11 0 2024-04-20T10:54:33.655 INFO:tasks.workunit.client.0.smithi090.stdout:3/46: stat d7/l9 0 2024-04-20T10:54:33.656 INFO:tasks.workunit.client.0.smithi090.stdout:9/45: rename d0/c6 to d0/da/db/cd 0 2024-04-20T10:54:33.657 INFO:tasks.workunit.client.0.smithi090.stdout:7/58: mkdir d11/d1a 0 2024-04-20T10:54:33.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/59: write f10 [633461,106160] 0 2024-04-20T10:54:33.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/60: chown f4 34214062 1 2024-04-20T10:54:33.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/61: fdatasync f4 0 2024-04-20T10:54:33.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/62: write d11/f12 [323867,51798] 0 2024-04-20T10:54:33.658 INFO:tasks.workunit.client.0.smithi090.stdout:5/139: link d1/da/d14/c18 d1/c29 0 2024-04-20T10:54:33.659 INFO:tasks.workunit.client.0.smithi090.stdout:0/52: read - fa zero size 2024-04-20T10:54:33.660 INFO:tasks.workunit.client.0.smithi090.stdout:6/31: mknod d1/d3/ca 0 2024-04-20T10:54:33.660 INFO:tasks.workunit.client.0.smithi090.stdout:8/85: getdents d0/d11/d14 0 2024-04-20T10:54:33.661 INFO:tasks.workunit.client.0.smithi090.stdout:5/140: dread d1/f23 [0,4194304] 0 2024-04-20T10:54:33.664 INFO:tasks.workunit.client.0.smithi090.stdout:0/53: link f6 f13 0 2024-04-20T10:54:33.665 INFO:tasks.workunit.client.0.smithi090.stdout:0/54: mkdir d14 0 2024-04-20T10:54:33.665 INFO:tasks.workunit.client.0.smithi090.stdout:6/32: write d1/d4/f8 [637869,130213] 0 2024-04-20T10:54:33.665 INFO:tasks.workunit.client.0.smithi090.stdout:0/55: rename f6 to d14/f15 0 2024-04-20T10:54:33.674 INFO:tasks.workunit.client.0.smithi090.stdout:7/63: read f8 [3258999,123183] 0 2024-04-20T10:54:33.674 INFO:tasks.workunit.client.0.smithi090.stdout:7/64: chown d11/c14 742 1 2024-04-20T10:54:33.675 INFO:tasks.workunit.client.0.smithi090.stdout:9/46: dwrite d0/f7 [0,4194304] 0 2024-04-20T10:54:33.678 INFO:tasks.workunit.client.0.smithi090.stdout:9/47: creat d0/da/fe x:0 0 0 2024-04-20T10:54:33.678 INFO:tasks.workunit.client.0.smithi090.stdout:9/48: dread - d0/da/fe zero size 2024-04-20T10:54:33.680 INFO:tasks.workunit.client.0.smithi090.stdout:9/49: creat d0/ff x:0 0 0 2024-04-20T10:54:33.696 INFO:tasks.workunit.client.0.smithi090.stdout:8/86: dwrite d0/d11/f1a [0,4194304] 0 2024-04-20T10:54:33.696 INFO:tasks.workunit.client.0.smithi090.stdout:7/65: dwrite d11/f12 [0,4194304] 0 2024-04-20T10:54:33.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/141: dwrite d1/da/d1f/f25 [0,4194304] 0 2024-04-20T10:54:33.696 INFO:tasks.workunit.client.0.smithi090.stdout:7/66: chown f0 0 1 2024-04-20T10:54:33.696 INFO:tasks.workunit.client.0.smithi090.stdout:6/33: dwrite d1/d4/f8 [4194304,4194304] 0 2024-04-20T10:54:33.696 INFO:tasks.workunit.client.0.smithi090.stdout:6/34: write d1/f6 [709999,42934] 0 2024-04-20T10:54:33.701 INFO:tasks.workunit.client.0.smithi090.stdout:5/142: truncate d1/fb 741192 0 2024-04-20T10:54:33.701 INFO:tasks.workunit.client.0.smithi090.stdout:6/35: dread d1/f6 [0,4194304] 0 2024-04-20T10:54:33.703 INFO:tasks.workunit.client.0.smithi090.stdout:9/50: getdents d0/da/db 0 2024-04-20T10:54:33.704 INFO:tasks.workunit.client.0.smithi090.stdout:8/87: dread d0/d11/f1a [0,4194304] 0 2024-04-20T10:54:33.705 INFO:tasks.workunit.client.0.smithi090.stdout:5/143: mkdir d1/d2a 0 2024-04-20T10:54:33.705 INFO:tasks.workunit.client.0.smithi090.stdout:5/144: chown d1/da/f1e 1539939767 1 2024-04-20T10:54:33.705 INFO:tasks.workunit.client.0.smithi090.stdout:5/145: write d1/f26 [41367,90081] 0 2024-04-20T10:54:33.705 INFO:tasks.workunit.client.0.smithi090.stdout:5/146: write d1/da/f17 [176810,69018] 0 2024-04-20T10:54:33.705 INFO:tasks.workunit.client.0.smithi090.stdout:5/147: truncate d1/da/f17 1181159 0 2024-04-20T10:54:33.705 INFO:tasks.workunit.client.0.smithi090.stdout:5/148: write d1/f7 [325201,36519] 0 2024-04-20T10:54:33.706 INFO:tasks.workunit.client.0.smithi090.stdout:6/36: mknod d1/d3/cb 0 2024-04-20T10:54:33.706 INFO:tasks.workunit.client.0.smithi090.stdout:9/51: creat d0/da/db/f10 x:0 0 0 2024-04-20T10:54:33.707 INFO:tasks.workunit.client.0.smithi090.stdout:6/37: dread d1/f6 [0,4194304] 0 2024-04-20T10:54:33.707 INFO:tasks.workunit.client.0.smithi090.stdout:6/38: chown d1/d4 27 1 2024-04-20T10:54:33.708 INFO:tasks.workunit.client.0.smithi090.stdout:8/88: creat d0/d11/f1b x:0 0 0 2024-04-20T10:54:33.709 INFO:tasks.workunit.client.0.smithi090.stdout:5/149: creat d1/de/f2b x:0 0 0 2024-04-20T10:54:33.711 INFO:tasks.workunit.client.0.smithi090.stdout:6/39: link d1/f6 d1/d3/fc 0 2024-04-20T10:54:33.711 INFO:tasks.workunit.client.0.smithi090.stdout:8/89: dread d0/fe [0,4194304] 0 2024-04-20T10:54:33.711 INFO:tasks.workunit.client.0.smithi090.stdout:8/90: chown d0/f2 5 1 2024-04-20T10:54:33.712 INFO:tasks.workunit.client.0.smithi090.stdout:5/150: creat d1/da/f2c x:0 0 0 2024-04-20T10:54:33.712 INFO:tasks.workunit.client.0.smithi090.stdout:5/151: chown d1/f7 40166 1 2024-04-20T10:54:33.714 INFO:tasks.workunit.client.0.smithi090.stdout:6/40: creat d1/fd x:0 0 0 2024-04-20T10:54:33.714 INFO:tasks.workunit.client.0.smithi090.stdout:6/41: write d1/d3/fc [1130960,87043] 0 2024-04-20T10:54:33.714 INFO:tasks.workunit.client.0.smithi090.stdout:6/42: read d1/f6 [1101166,81782] 0 2024-04-20T10:54:33.716 INFO:tasks.workunit.client.0.smithi090.stdout:5/152: rename d1/da/f19 to d1/da/d16/f2d 0 2024-04-20T10:54:33.716 INFO:tasks.workunit.client.0.smithi090.stdout:5/153: write d1/f7 [2661917,113197] 0 2024-04-20T10:54:33.718 INFO:tasks.workunit.client.0.smithi090.stdout:6/43: mknod d1/d3/ce 0 2024-04-20T10:54:33.723 INFO:tasks.workunit.client.0.smithi090.stdout:9/52: dwrite d0/f9 [0,4194304] 0 2024-04-20T10:54:33.725 INFO:tasks.workunit.client.0.smithi090.stdout:9/53: creat d0/f11 x:0 0 0 2024-04-20T10:54:33.735 INFO:tasks.workunit.client.0.smithi090.stdout:5/154: dwrite d1/f23 [0,4194304] 0 2024-04-20T10:54:33.735 INFO:tasks.workunit.client.0.smithi090.stdout:5/155: chown d1/da/d14/c18 42693 1 2024-04-20T10:54:33.735 INFO:tasks.workunit.client.0.smithi090.stdout:5/156: fsync d1/da/f1e 0 2024-04-20T10:54:33.735 INFO:tasks.workunit.client.0.smithi090.stdout:5/157: write d1/da/d1f/f25 [4656005,46811] 0 2024-04-20T10:54:33.737 INFO:tasks.workunit.client.0.smithi090.stdout:5/158: mknod d1/da/d14/c2e 0 2024-04-20T10:54:33.737 INFO:tasks.workunit.client.0.smithi090.stdout:5/159: dread - d1/da/d16/f2d zero size 2024-04-20T10:54:33.739 INFO:tasks.workunit.client.0.smithi090.stdout:5/160: truncate d1/f12 4166606 0 2024-04-20T10:54:33.739 INFO:tasks.workunit.client.0.smithi090.stdout:5/161: write d1/da/f1e [1527869,70923] 0 2024-04-20T10:54:33.739 INFO:tasks.workunit.client.0.smithi090.stdout:5/162: fdatasync d1/fb 0 2024-04-20T10:54:33.741 INFO:tasks.workunit.client.0.smithi090.stdout:9/54: write d0/f7 [2820789,53605] 0 2024-04-20T10:54:33.741 INFO:tasks.workunit.client.0.smithi090.stdout:5/163: mkdir d1/d2f 0 2024-04-20T10:54:33.741 INFO:tasks.workunit.client.0.smithi090.stdout:9/55: write d0/f11 [835118,126653] 0 2024-04-20T10:54:33.742 INFO:tasks.workunit.client.0.smithi090.stdout:5/164: mkdir d1/d30 0 2024-04-20T10:54:33.742 INFO:tasks.workunit.client.0.smithi090.stdout:5/165: readlink d1/de/l15 0 2024-04-20T10:54:33.742 INFO:tasks.workunit.client.0.smithi090.stdout:5/166: chown d1/da/d16/f2d 296135769 1 2024-04-20T10:54:33.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/44: dwrite d1/d4/f8 [0,4194304] 0 2024-04-20T10:54:33.742 INFO:tasks.workunit.client.0.smithi090.stdout:6/45: read - d1/fd zero size 2024-04-20T10:54:33.742 INFO:tasks.workunit.client.0.smithi090.stdout:8/91: dwrite d0/d11/f1a [0,4194304] 0 2024-04-20T10:54:33.742 INFO:tasks.workunit.client.0.smithi090.stdout:8/92: chown d0/ca 25 1 2024-04-20T10:54:33.744 INFO:tasks.workunit.client.0.smithi090.stdout:5/167: symlink d1/de/l31 0 2024-04-20T10:54:33.746 INFO:tasks.workunit.client.0.smithi090.stdout:9/56: write d0/f9 [4680662,77100] 0 2024-04-20T10:54:33.747 INFO:tasks.workunit.client.0.smithi090.stdout:9/57: mknod d0/c12 0 2024-04-20T10:54:33.753 INFO:tasks.workunit.client.0.smithi090.stdout:6/46: read d1/d4/f8 [7437328,104833] 0 2024-04-20T10:54:33.753 INFO:tasks.workunit.client.0.smithi090.stdout:6/47: getdents d1/d5 0 2024-04-20T10:54:33.753 INFO:tasks.workunit.client.0.smithi090.stdout:6/48: stat d1/d3/cb 0 2024-04-20T10:54:33.753 INFO:tasks.workunit.client.0.smithi090.stdout:6/49: chown c0 17 1 2024-04-20T10:54:33.753 INFO:tasks.workunit.client.0.smithi090.stdout:9/58: fsync d0/f7 0 2024-04-20T10:54:33.753 INFO:tasks.workunit.client.0.smithi090.stdout:9/59: dread - d0/ff zero size 2024-04-20T10:54:33.753 INFO:tasks.workunit.client.0.smithi090.stdout:7/67: dwrite d11/f12 [4194304,4194304] 0 2024-04-20T10:54:33.755 INFO:tasks.workunit.client.0.smithi090.stdout:7/68: creat d11/d1a/f1b x:0 0 0 2024-04-20T10:54:33.755 INFO:tasks.workunit.client.0.smithi090.stdout:7/69: dread - fd zero size 2024-04-20T10:54:33.756 INFO:tasks.workunit.client.0.smithi090.stdout:5/168: getdents d1 0 2024-04-20T10:54:33.758 INFO:tasks.workunit.client.0.smithi090.stdout:8/93: dwrite d0/d11/f1b [0,4194304] 0 2024-04-20T10:54:33.758 INFO:tasks.workunit.client.0.smithi090.stdout:8/94: chown d0/l10 266796308 1 2024-04-20T10:54:33.758 INFO:tasks.workunit.client.0.smithi090.stdout:7/70: dread f9 [0,4194304] 0 2024-04-20T10:54:33.762 INFO:tasks.workunit.client.0.smithi090.stdout:6/50: read d1/d4/f8 [1381311,19978] 0 2024-04-20T10:54:33.763 INFO:tasks.workunit.client.0.smithi090.stdout:5/169: dread d1/da/f1e [0,4194304] 0 2024-04-20T10:54:33.768 INFO:tasks.workunit.client.0.smithi090.stdout:7/71: symlink d11/l1c 0 2024-04-20T10:54:33.768 INFO:tasks.workunit.client.0.smithi090.stdout:7/72: readlink d11/l1c 0 2024-04-20T10:54:33.768 INFO:tasks.workunit.client.0.smithi090.stdout:7/73: readlink lc 0 2024-04-20T10:54:33.770 INFO:tasks.workunit.client.0.smithi090.stdout:9/60: dwrite d0/ff [0,4194304] 0 2024-04-20T10:54:33.770 INFO:tasks.workunit.client.0.smithi090.stdout:6/51: truncate d1/d4/f8 6314003 0 2024-04-20T10:54:33.770 INFO:tasks.workunit.client.0.smithi090.stdout:6/52: stat d1/d3/fc 0 2024-04-20T10:54:33.772 INFO:tasks.workunit.client.0.smithi090.stdout:5/170: creat d1/da/d16/f32 x:0 0 0 2024-04-20T10:54:33.774 INFO:tasks.workunit.client.0.smithi090.stdout:7/74: getdents d11 0 2024-04-20T10:54:33.776 INFO:tasks.workunit.client.0.smithi090.stdout:9/61: rmdir d0/da/db 39 2024-04-20T10:54:33.776 INFO:tasks.workunit.client.0.smithi090.stdout:9/62: chown d0/f11 47269551 1 2024-04-20T10:54:33.777 INFO:tasks.workunit.client.0.smithi090.stdout:7/75: creat d11/d13/f1d x:0 0 0 2024-04-20T10:54:33.777 INFO:tasks.workunit.client.0.smithi090.stdout:7/76: write d11/d1a/f1b [528534,60571] 0 2024-04-20T10:54:33.777 INFO:tasks.workunit.client.0.smithi090.stdout:7/77: chown f6 6566505 1 2024-04-20T10:54:33.779 INFO:tasks.workunit.client.0.smithi090.stdout:5/171: write d1/f23 [4007936,56773] 0 2024-04-20T10:54:33.779 INFO:tasks.workunit.client.0.smithi090.stdout:5/172: readlink d1/da/l13 0 2024-04-20T10:54:33.784 INFO:tasks.workunit.client.0.smithi090.stdout:7/78: write f6 [791263,103564] 0 2024-04-20T10:54:33.784 INFO:tasks.workunit.client.0.smithi090.stdout:9/63: creat d0/da/f13 x:0 0 0 2024-04-20T10:54:33.785 INFO:tasks.workunit.client.0.smithi090.stdout:9/64: chown d0/f7 3035 1 2024-04-20T10:54:33.785 INFO:tasks.workunit.client.0.smithi090.stdout:7/79: truncate f0 2791421 0 2024-04-20T10:54:33.785 INFO:tasks.workunit.client.0.smithi090.stdout:7/80: write d11/f16 [312786,19020] 0 2024-04-20T10:54:33.786 INFO:tasks.workunit.client.0.smithi090.stdout:7/81: write f9 [587552,80076] 0 2024-04-20T10:54:33.786 INFO:tasks.workunit.client.0.smithi090.stdout:9/65: rmdir d0 39 2024-04-20T10:54:33.791 INFO:tasks.workunit.client.0.smithi090.stdout:5/173: write d1/da/d1f/f25 [1367574,97653] 0 2024-04-20T10:54:33.791 INFO:tasks.workunit.client.0.smithi090.stdout:5/174: chown d1/da/d16/f32 1920955197 1 2024-04-20T10:54:33.792 INFO:tasks.workunit.client.0.smithi090.stdout:7/82: creat d11/f1e x:0 0 0 2024-04-20T10:54:33.795 INFO:tasks.workunit.client.0.smithi090.stdout:5/175: mknod d1/c33 0 2024-04-20T10:54:33.795 INFO:tasks.workunit.client.0.smithi090.stdout:5/176: chown d1/fb 18637 1 2024-04-20T10:54:33.798 INFO:tasks.workunit.client.0.smithi090.stdout:5/177: mkdir d1/da/d34 0 2024-04-20T10:54:33.798 INFO:tasks.workunit.client.0.smithi090.stdout:5/178: fsync d1/da/f17 0 2024-04-20T10:54:33.802 INFO:tasks.workunit.client.0.smithi090.stdout:9/66: dwrite d0/ff [0,4194304] 0 2024-04-20T10:54:33.802 INFO:tasks.workunit.client.0.smithi090.stdout:9/67: fsync d0/f11 0 2024-04-20T10:54:33.805 INFO:tasks.workunit.client.0.smithi090.stdout:5/179: rename d1/de/f2b to d1/d2a/f35 0 2024-04-20T10:54:33.807 INFO:tasks.workunit.client.0.smithi090.stdout:9/68: dread d0/f4 [0,4194304] 0 2024-04-20T10:54:33.808 INFO:tasks.workunit.client.0.smithi090.stdout:9/69: stat d0/c5 0 2024-04-20T10:54:33.821 INFO:tasks.workunit.client.0.smithi090.stdout:9/70: dwrite d0/f7 [4194304,4194304] 0 2024-04-20T10:54:33.822 INFO:tasks.workunit.client.0.smithi090.stdout:9/71: stat d0/da/db/f10 0 2024-04-20T10:54:33.822 INFO:tasks.workunit.client.0.smithi090.stdout:5/180: symlink d1/d2f/l36 0 2024-04-20T10:54:33.823 INFO:tasks.workunit.client.0.smithi090.stdout:9/72: creat d0/da/f14 x:0 0 0 2024-04-20T10:54:33.824 INFO:tasks.workunit.client.0.smithi090.stdout:5/181: creat d1/d2f/f37 x:0 0 0 2024-04-20T10:54:33.824 INFO:tasks.workunit.client.0.smithi090.stdout:5/182: write d1/f23 [4879105,61706] 0 2024-04-20T10:54:33.824 INFO:tasks.workunit.client.0.smithi090.stdout:9/73: rmdir d0/da/db 39 2024-04-20T10:54:33.825 INFO:tasks.workunit.client.0.smithi090.stdout:5/183: symlink d1/l38 0 2024-04-20T10:54:33.825 INFO:tasks.workunit.client.0.smithi090.stdout:5/184: stat d1/da/f1e 0 2024-04-20T10:54:33.825 INFO:tasks.workunit.client.0.smithi090.stdout:5/185: dread - d1/da/f2c zero size 2024-04-20T10:54:33.825 INFO:tasks.workunit.client.0.smithi090.stdout:5/186: truncate d1/f26 589623 0 2024-04-20T10:54:33.865 INFO:tasks.workunit.client.0.smithi090.stdout:9/74: getdents d0/da/db 0 2024-04-20T10:54:33.869 INFO:tasks.workunit.client.0.smithi090.stdout:9/75: write d0/f4 [275384,73890] 0 2024-04-20T10:54:33.950 INFO:tasks.workunit.client.0.smithi090.stdout:1/28: sync 2024-04-20T10:54:33.955 INFO:tasks.workunit.client.0.smithi090.stdout:1/29: dread f6 [0,4194304] 0 2024-04-20T10:54:33.956 INFO:tasks.workunit.client.0.smithi090.stdout:9/76: rename d0/da/db/cd to d0/c15 0 2024-04-20T10:54:33.957 INFO:tasks.workunit.client.0.smithi090.stdout:1/30: link c3 d8/c10 0 2024-04-20T10:54:33.957 INFO:tasks.workunit.client.0.smithi090.stdout:1/31: truncate d8/fd 385567 0 2024-04-20T10:54:33.957 INFO:tasks.workunit.client.0.smithi090.stdout:1/32: chown l0 204602210 1 2024-04-20T10:54:33.957 INFO:tasks.workunit.client.0.smithi090.stdout:1/33: chown f6 3406 1 2024-04-20T10:54:33.957 INFO:tasks.workunit.client.0.smithi090.stdout:1/34: fdatasync d8/fd 0 2024-04-20T10:54:33.958 INFO:tasks.workunit.client.0.smithi090.stdout:9/77: mknod d0/c16 0 2024-04-20T10:54:33.958 INFO:tasks.workunit.client.0.smithi090.stdout:9/78: read - d0/da/db/f10 zero size 2024-04-20T10:54:33.974 INFO:tasks.workunit.client.0.smithi090.stdout:9/79: dwrite d0/da/f14 [0,4194304] 0 2024-04-20T10:54:33.976 INFO:tasks.workunit.client.0.smithi090.stdout:1/35: creat d8/f11 x:0 0 0 2024-04-20T10:54:33.976 INFO:tasks.workunit.client.0.smithi090.stdout:9/80: dread d0/f11 [0,4194304] 0 2024-04-20T10:54:33.977 INFO:tasks.workunit.client.0.smithi090.stdout:9/81: fsync d0/da/db/f10 0 2024-04-20T10:54:33.996 INFO:tasks.workunit.client.0.smithi090.stdout:1/36: dwrite d8/fd [0,4194304] 0 2024-04-20T10:54:34.045 INFO:tasks.workunit.client.0.smithi090.stdout:9/82: mknod d0/da/db/c17 0 2024-04-20T10:54:34.045 INFO:tasks.workunit.client.0.smithi090.stdout:9/83: chown d0/da/db 1 1 2024-04-20T10:54:34.045 INFO:tasks.workunit.client.0.smithi090.stdout:9/84: truncate d0/f11 673303 0 2024-04-20T10:54:34.061 INFO:tasks.workunit.client.0.smithi090.stdout:9/85: dwrite d0/f11 [0,4194304] 0 2024-04-20T10:54:34.063 INFO:tasks.workunit.client.0.smithi090.stdout:9/86: creat d0/da/f18 x:0 0 0 2024-04-20T10:54:34.063 INFO:tasks.workunit.client.0.smithi090.stdout:9/87: mknod d0/c19 0 2024-04-20T10:54:34.064 INFO:tasks.workunit.client.0.smithi090.stdout:9/88: creat d0/da/f1a x:0 0 0 2024-04-20T10:54:34.068 INFO:tasks.workunit.client.0.smithi090.stdout:4/30: sync 2024-04-20T10:54:34.068 INFO:tasks.workunit.client.0.smithi090.stdout:2/50: sync 2024-04-20T10:54:34.069 INFO:tasks.workunit.client.0.smithi090.stdout:4/31: link l3 d7/l8 0 2024-04-20T10:54:34.070 INFO:tasks.workunit.client.0.smithi090.stdout:2/51: write f8 [157075,124676] 0 2024-04-20T10:54:34.071 INFO:tasks.workunit.client.0.smithi090.stdout:2/52: mknod d11/c14 0 2024-04-20T10:54:34.073 INFO:tasks.workunit.client.0.smithi090.stdout:2/53: dread fb [0,4194304] 0 2024-04-20T10:54:34.074 INFO:tasks.workunit.client.0.smithi090.stdout:2/54: creat d11/f15 x:0 0 0 2024-04-20T10:54:34.074 INFO:tasks.workunit.client.0.smithi090.stdout:2/55: truncate fc 4291880 0 2024-04-20T10:54:34.076 INFO:tasks.workunit.client.0.smithi090.stdout:4/32: write f0 [1405277,16147] 0 2024-04-20T10:54:34.082 INFO:tasks.workunit.client.0.smithi090.stdout:9/89: dwrite d0/da/f14 [0,4194304] 0 2024-04-20T10:54:34.082 INFO:tasks.workunit.client.0.smithi090.stdout:2/56: dread fc [0,4194304] 0 2024-04-20T10:54:34.082 INFO:tasks.workunit.client.0.smithi090.stdout:2/57: readlink l4 0 2024-04-20T10:54:34.082 INFO:tasks.workunit.client.0.smithi090.stdout:2/58: dread - fa zero size 2024-04-20T10:54:34.082 INFO:tasks.workunit.client.0.smithi090.stdout:2/59: chown d11/c14 6106 1 2024-04-20T10:54:34.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/33: dread f0 [0,4194304] 0 2024-04-20T10:54:34.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/34: fsync f2 0 2024-04-20T10:54:34.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/35: chown l5 1946 1 2024-04-20T10:54:34.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/36: chown d7 1 1 2024-04-20T10:54:34.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/37: truncate f2 463394 0 2024-04-20T10:54:34.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/38: chown f2 2019999501 1 2024-04-20T10:54:34.084 INFO:tasks.workunit.client.0.smithi090.stdout:4/39: mkdir d7/d9 0 2024-04-20T10:54:34.099 INFO:tasks.workunit.client.0.smithi090.stdout:9/90: dwrite d0/f11 [0,4194304] 0 2024-04-20T10:54:34.100 INFO:tasks.workunit.client.0.smithi090.stdout:9/91: creat d0/da/f1b x:0 0 0 2024-04-20T10:54:34.100 INFO:tasks.workunit.client.0.smithi090.stdout:9/92: fsync d0/ff 0 2024-04-20T10:54:34.102 INFO:tasks.workunit.client.0.smithi090.stdout:9/93: mkdir d0/da/d1c 0 2024-04-20T10:54:34.102 INFO:tasks.workunit.client.0.smithi090.stdout:9/94: read d0/f7 [2185333,55265] 0 2024-04-20T10:54:34.102 INFO:tasks.workunit.client.0.smithi090.stdout:9/95: rename d0/da/d1c to d0/da/d1c/d1d 22 2024-04-20T10:54:34.104 INFO:tasks.workunit.client.0.smithi090.stdout:9/96: rename d0/f7 to d0/da/f1e 0 2024-04-20T10:54:34.104 INFO:tasks.workunit.client.0.smithi090.stdout:9/97: write d0/da/db/f10 [574746,116400] 0 2024-04-20T10:54:34.104 INFO:tasks.workunit.client.0.smithi090.stdout:9/98: stat d0 0 2024-04-20T10:54:34.104 INFO:tasks.workunit.client.0.smithi090.stdout:9/99: fdatasync d0/f4 0 2024-04-20T10:54:34.104 INFO:tasks.workunit.client.0.smithi090.stdout:9/100: getdents d0/da/db 0 2024-04-20T10:54:34.109 INFO:tasks.workunit.client.0.smithi090.stdout:9/101: dread d0/da/db/f10 [0,4194304] 0 2024-04-20T10:54:34.111 INFO:tasks.workunit.client.0.smithi090.stdout:9/102: unlink d0/da/f1a 0 2024-04-20T10:54:34.112 INFO:tasks.workunit.client.0.smithi090.stdout:9/103: stat d0/c16 0 2024-04-20T10:54:34.112 INFO:tasks.workunit.client.0.smithi090.stdout:9/104: fdatasync d0/da/db/f10 0 2024-04-20T10:54:34.112 INFO:tasks.workunit.client.0.smithi090.stdout:9/105: dread - d0/da/f1b zero size 2024-04-20T10:54:34.112 INFO:tasks.workunit.client.0.smithi090.stdout:9/106: write d0/f4 [2976022,95956] 0 2024-04-20T10:54:34.113 INFO:tasks.workunit.client.0.smithi090.stdout:9/107: unlink d0/da/fe 0 2024-04-20T10:54:34.113 INFO:tasks.workunit.client.0.smithi090.stdout:9/108: readlink d0/l8 0 2024-04-20T10:54:34.113 INFO:tasks.workunit.client.0.smithi090.stdout:9/109: chown d0/da/f1e 536191497 1 2024-04-20T10:54:34.113 INFO:tasks.workunit.client.0.smithi090.stdout:9/110: readlink d0/l8 0 2024-04-20T10:54:34.114 INFO:tasks.workunit.client.0.smithi090.stdout:9/111: mkdir d0/da/d1f 0 2024-04-20T10:54:34.114 INFO:tasks.workunit.client.0.smithi090.stdout:9/112: dread - d0/da/f1b zero size 2024-04-20T10:54:34.114 INFO:tasks.workunit.client.0.smithi090.stdout:9/113: write d0/da/f13 [688012,104901] 0 2024-04-20T10:54:34.127 INFO:tasks.workunit.client.0.smithi090.stdout:9/114: dwrite d0/f9 [4194304,4194304] 0 2024-04-20T10:54:34.341 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:34.383 INFO:tasks.workunit.client.0.smithi090.stdout:9/115: symlink d0/da/db/l20 0 2024-04-20T10:54:34.383 INFO:tasks.workunit.client.0.smithi090.stdout:9/116: chown d0/da/f14 247 1 2024-04-20T10:54:34.383 INFO:tasks.workunit.client.0.smithi090.stdout:9/117: write d0/f11 [4419030,117899] 0 2024-04-20T10:54:34.385 INFO:tasks.workunit.client.0.smithi090.stdout:6/53: sync 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:8/95: sync 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:7/83: sync 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:5/187: sync 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:5/188: chown d1/da 1136 1 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:5/189: write d1/d2a/f35 [319547,5717] 0 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:3/47: sync 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:0/56: sync 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:1/37: sync 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:3/48: dread - d7/fc zero size 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:1/38: dread - d8/f11 zero size 2024-04-20T10:54:34.386 INFO:tasks.workunit.client.0.smithi090.stdout:3/49: chown d7/le 23163 1 2024-04-20T10:54:34.387 INFO:tasks.workunit.client.0.smithi090.stdout:3/50: fsync d7/fd 0 2024-04-20T10:54:34.387 INFO:tasks.workunit.client.0.smithi090.stdout:2/60: sync 2024-04-20T10:54:34.387 INFO:tasks.workunit.client.0.smithi090.stdout:4/40: sync 2024-04-20T10:54:34.387 INFO:tasks.workunit.client.0.smithi090.stdout:7/84: mknod d11/d1a/c1f 0 2024-04-20T10:54:34.387 INFO:tasks.workunit.client.0.smithi090.stdout:7/85: write d11/f1e [1000497,72859] 0 2024-04-20T10:54:34.387 INFO:tasks.workunit.client.0.smithi090.stdout:7/86: chown d11/d13/f1d 129 1 2024-04-20T10:54:34.388 INFO:tasks.workunit.client.0.smithi090.stdout:6/54: creat d1/d3/ff x:0 0 0 2024-04-20T10:54:34.389 INFO:tasks.workunit.client.0.smithi090.stdout:5/190: mkdir d1/d30/d39 0 2024-04-20T10:54:34.390 INFO:tasks.workunit.client.0.smithi090.stdout:0/57: dread - f11 zero size 2024-04-20T10:54:34.391 INFO:tasks.workunit.client.0.smithi090.stdout:9/118: write d0/f9 [3401908,99555] 0 2024-04-20T10:54:34.391 INFO:tasks.workunit.client.0.smithi090.stdout:9/119: read d0/da/db/f10 [651511,67421] 0 2024-04-20T10:54:34.391 INFO:tasks.workunit.client.0.smithi090.stdout:3/51: symlink d7/l12 0 2024-04-20T10:54:34.393 INFO:tasks.workunit.client.0.smithi090.stdout:2/61: rename f3 to d11/f16 0 2024-04-20T10:54:34.394 INFO:tasks.workunit.client.0.smithi090.stdout:4/41: creat d7/d9/fa x:0 0 0 2024-04-20T10:54:34.395 INFO:tasks.workunit.client.0.smithi090.stdout:7/87: link d11/l1c d11/l20 0 2024-04-20T10:54:34.395 INFO:tasks.workunit.client.0.smithi090.stdout:1/39: dread d8/fd [0,4194304] 0 2024-04-20T10:54:34.398 INFO:tasks.workunit.client.0.smithi090.stdout:6/55: mkdir d1/d10 0 2024-04-20T10:54:34.398 INFO:tasks.workunit.client.0.smithi090.stdout:6/56: dread - d1/fd zero size 2024-04-20T10:54:34.398 INFO:tasks.workunit.client.0.smithi090.stdout:6/57: fsync d1/f6 0 2024-04-20T10:54:34.398 INFO:tasks.workunit.client.0.smithi090.stdout:0/58: creat d14/f16 x:0 0 0 2024-04-20T10:54:34.399 INFO:tasks.workunit.client.0.smithi090.stdout:3/52: read d7/fd [47604,22981] 0 2024-04-20T10:54:34.399 INFO:tasks.workunit.client.0.smithi090.stdout:2/62: dread d11/f16 [0,4194304] 0 2024-04-20T10:54:34.401 INFO:tasks.workunit.client.0.smithi090.stdout:9/120: unlink d0/da/db/l20 0 2024-04-20T10:54:34.401 INFO:tasks.workunit.client.0.smithi090.stdout:4/42: creat d7/fb x:0 0 0 2024-04-20T10:54:34.401 INFO:tasks.workunit.client.0.smithi090.stdout:4/43: readlink l6 0 2024-04-20T10:54:34.401 INFO:tasks.workunit.client.0.smithi090.stdout:4/44: write d7/d9/fa [511989,26992] 0 2024-04-20T10:54:34.401 INFO:tasks.workunit.client.0.smithi090.stdout:4/45: fdatasync f2 0 2024-04-20T10:54:34.401 INFO:tasks.workunit.client.0.smithi090.stdout:4/46: dread - d7/fb zero size 2024-04-20T10:54:34.402 INFO:tasks.workunit.client.0.smithi090.stdout:7/88: creat d11/d1a/f21 x:0 0 0 2024-04-20T10:54:34.402 INFO:tasks.workunit.client.0.smithi090.stdout:7/89: fsync d11/d13/f1d 0 2024-04-20T10:54:34.403 INFO:tasks.workunit.client.0.smithi090.stdout:6/58: mkdir d1/d3/d11 0 2024-04-20T10:54:34.403 INFO:tasks.workunit.client.0.smithi090.stdout:6/59: write d1/fd [464743,72973] 0 2024-04-20T10:54:34.403 INFO:tasks.workunit.client.0.smithi090.stdout:6/60: write d1/f6 [1495202,32635] 0 2024-04-20T10:54:34.403 INFO:tasks.workunit.client.0.smithi090.stdout:6/61: stat d1/d3/fc 0 2024-04-20T10:54:34.403 INFO:tasks.workunit.client.0.smithi090.stdout:6/62: readlink - no filename 2024-04-20T10:54:34.403 INFO:tasks.workunit.client.0.smithi090.stdout:0/59: truncate fb 5084617 0 2024-04-20T10:54:34.405 INFO:tasks.workunit.client.0.smithi090.stdout:3/53: rmdir d7 39 2024-04-20T10:54:34.407 INFO:tasks.workunit.client.0.smithi090.stdout:7/90: unlink d11/d13/l15 0 2024-04-20T10:54:34.407 INFO:tasks.workunit.client.0.smithi090.stdout:0/60: truncate f3 508407 0 2024-04-20T10:54:34.413 INFO:tasks.workunit.client.0.smithi090.stdout:5/191: dwrite d1/f26 [0,4194304] 0 2024-04-20T10:54:34.413 INFO:tasks.workunit.client.0.smithi090.stdout:5/192: stat d1/de 0 2024-04-20T10:54:34.413 INFO:tasks.workunit.client.0.smithi090.stdout:4/47: dread d7/d9/fa [0,4194304] 0 2024-04-20T10:54:34.413 INFO:tasks.workunit.client.0.smithi090.stdout:4/48: stat l5 0 2024-04-20T10:54:34.413 INFO:tasks.workunit.client.0.smithi090.stdout:4/49: readlink l3 0 2024-04-20T10:54:34.420 INFO:tasks.workunit.client.0.smithi090.stdout:4/50: mknod d7/cc 0 2024-04-20T10:54:34.421 INFO:tasks.workunit.client.0.smithi090.stdout:9/121: write d0/ff [2206252,6546] 0 2024-04-20T10:54:34.422 INFO:tasks.workunit.client.0.smithi090.stdout:4/51: symlink d7/d9/ld 0 2024-04-20T10:54:34.424 INFO:tasks.workunit.client.0.smithi090.stdout:9/122: creat d0/da/d1c/f21 x:0 0 0 2024-04-20T10:54:34.425 INFO:tasks.workunit.client.0.smithi090.stdout:4/52: mknod d7/d9/ce 0 2024-04-20T10:54:34.426 INFO:tasks.workunit.client.0.smithi090.stdout:4/53: read f2 [100235,70351] 0 2024-04-20T10:54:34.426 INFO:tasks.workunit.client.0.smithi090.stdout:9/123: symlink d0/da/d1f/l22 0 2024-04-20T10:54:34.426 INFO:tasks.workunit.client.0.smithi090.stdout:4/54: rmdir d7/d9 39 2024-04-20T10:54:34.427 INFO:tasks.workunit.client.0.smithi090.stdout:4/55: stat f2 0 2024-04-20T10:54:34.428 INFO:tasks.workunit.client.0.smithi090.stdout:9/124: mkdir d0/da/db/d23 0 2024-04-20T10:54:34.429 INFO:tasks.workunit.client.0.smithi090.stdout:4/56: truncate f0 2932917 0 2024-04-20T10:54:34.431 INFO:tasks.workunit.client.0.smithi090.stdout:5/193: dread d1/f7 [4194304,4194304] 0 2024-04-20T10:54:34.431 INFO:tasks.workunit.client.0.smithi090.stdout:5/194: rmdir d1/da/d14 39 2024-04-20T10:54:34.436 INFO:tasks.workunit.client.0.smithi090.stdout:8/96: dwrite d0/fe [0,4194304] 0 2024-04-20T10:54:34.440 INFO:tasks.workunit.client.0.smithi090.stdout:1/40: dwrite d8/fd [4194304,4194304] 0 2024-04-20T10:54:34.447 INFO:tasks.workunit.client.0.smithi090.stdout:6/63: dwrite d1/d4/f8 [0,4194304] 0 2024-04-20T10:54:34.447 INFO:tasks.workunit.client.0.smithi090.stdout:7/91: dwrite f9 [0,4194304] 0 2024-04-20T10:54:34.448 INFO:tasks.workunit.client.0.smithi090.stdout:2/63: dwrite d11/f16 [0,4194304] 0 2024-04-20T10:54:34.448 INFO:tasks.workunit.client.0.smithi090.stdout:9/125: dwrite d0/da/f1b [0,4194304] 0 2024-04-20T10:54:34.449 INFO:tasks.workunit.client.0.smithi090.stdout:6/64: unlink d1/d4/c9 0 2024-04-20T10:54:34.449 INFO:tasks.workunit.client.0.smithi090.stdout:7/92: dread d11/f16 [0,4194304] 0 2024-04-20T10:54:34.449 INFO:tasks.workunit.client.0.smithi090.stdout:7/93: fdatasync f6 0 2024-04-20T10:54:34.450 INFO:tasks.workunit.client.0.smithi090.stdout:1/41: write d8/fd [6934075,25209] 0 2024-04-20T10:54:34.453 INFO:tasks.workunit.client.0.smithi090.stdout:2/64: unlink f8 0 2024-04-20T10:54:34.455 INFO:tasks.workunit.client.0.smithi090.stdout:9/126: rename d0/da/db/lc to d0/da/db/l24 0 2024-04-20T10:54:34.455 INFO:tasks.workunit.client.0.smithi090.stdout:9/127: getdents d0/da/db/d23 0 2024-04-20T10:54:34.457 INFO:tasks.workunit.client.0.smithi090.stdout:6/65: unlink d1/d4/f8 0 2024-04-20T10:54:34.457 INFO:tasks.workunit.client.0.smithi090.stdout:6/66: write d1/d3/ff [248807,106220] 0 2024-04-20T10:54:34.457 INFO:tasks.workunit.client.0.smithi090.stdout:6/67: chown d1/d3/d11 294557 1 2024-04-20T10:54:34.459 INFO:tasks.workunit.client.0.smithi090.stdout:7/94: mkdir d11/d13/d22 0 2024-04-20T10:54:34.460 INFO:tasks.workunit.client.0.smithi090.stdout:4/57: getdents d7/d9 0 2024-04-20T10:54:34.464 INFO:tasks.workunit.client.0.smithi090.stdout:4/58: rename d7/cc to d7/cf 0 2024-04-20T10:54:34.464 INFO:tasks.workunit.client.0.smithi090.stdout:9/128: read d0/da/f1e [4760784,50344] 0 2024-04-20T10:54:34.466 INFO:tasks.workunit.client.0.smithi090.stdout:4/59: dread f2 [0,4194304] 0 2024-04-20T10:54:34.466 INFO:tasks.workunit.client.0.smithi090.stdout:9/129: creat d0/da/db/f25 x:0 0 0 2024-04-20T10:54:34.467 INFO:tasks.workunit.client.0.smithi090.stdout:4/60: creat d7/d9/f10 x:0 0 0 2024-04-20T10:54:34.468 INFO:tasks.workunit.client.0.smithi090.stdout:9/130: mknod d0/da/db/d23/c26 0 2024-04-20T10:54:34.468 INFO:tasks.workunit.client.0.smithi090.stdout:9/131: chown d0/da/f18 1 1 2024-04-20T10:54:34.468 INFO:tasks.workunit.client.0.smithi090.stdout:9/132: stat d0/da/db/f10 0 2024-04-20T10:54:34.469 INFO:tasks.workunit.client.0.smithi090.stdout:9/133: write d0/da/d1c/f21 [476352,3639] 0 2024-04-20T10:54:34.469 INFO:tasks.workunit.client.0.smithi090.stdout:9/134: fdatasync d0/da/db/f25 0 2024-04-20T10:54:34.469 INFO:tasks.workunit.client.0.smithi090.stdout:9/135: chown d0/da/f13 46804 1 2024-04-20T10:54:34.469 INFO:tasks.workunit.client.0.smithi090.stdout:9/136: truncate d0/da/db/f25 385197 0 2024-04-20T10:54:34.469 INFO:tasks.workunit.client.0.smithi090.stdout:4/61: creat d7/d9/f11 x:0 0 0 2024-04-20T10:54:34.469 INFO:tasks.workunit.client.0.smithi090.stdout:4/62: write d7/d9/f11 [764349,34487] 0 2024-04-20T10:54:34.470 INFO:tasks.workunit.client.0.smithi090.stdout:9/137: fsync d0/da/d1c/f21 0 2024-04-20T10:54:34.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.472+0000 7fb5a52c1640 1 Processor -- start 2024-04-20T10:54:34.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.472+0000 7fb5a52c1640 1 -- start start 2024-04-20T10:54:34.473 INFO:tasks.workunit.client.0.smithi090.stdout:9/138: creat d0/da/db/f27 x:0 0 0 2024-04-20T10:54:34.473 INFO:tasks.workunit.client.0.smithi090.stdout:9/139: write d0/f9 [1270703,114270] 0 2024-04-20T10:54:34.473 INFO:tasks.workunit.client.0.smithi090.stdout:7/95: dread f8 [0,4194304] 0 2024-04-20T10:54:34.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb5a52c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00aeb40 0x7fb5a00725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb5a52c1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5a00aef20 0x7fb5a00af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb5a52c1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5a00acfa0 con 0x7fb5a00c44a0 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb5a52c1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb5a015b5b0 con 0x7fb5a00aef20 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb5a52c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a015b890 con 0x7fb5a00aeb40 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5a00aef20 0x7fb5a00af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5a00aef20 0x7fb5a00af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60054/0 (socket says 172.21.15.90:60054) 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59f7fe640 1 -- 172.21.15.90:0/823727863 learned_addr learned my addr 172.21.15.90:0/823727863 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59effd640 1 --2- 172.21.15.90:0/823727863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00aeb40 0x7fb5a00725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59f7fe640 1 -- 172.21.15.90:0/823727863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00aeb40 msgr2=0x7fb5a00725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59f7fe640 1 --2- 172.21.15.90:0/823727863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00aeb40 0x7fb5a00725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59f7fe640 1 -- 172.21.15.90:0/823727863 >> v1:172.21.15.175:6789/0 conn(0x7fb5a00c44a0 legacy=0x7fb5a00abe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:34.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59f7fe640 1 -- 172.21.15.90:0/823727863 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a00ab620 con 0x7fb5a00aef20 2024-04-20T10:54:34.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.473+0000 7fb59e7fc640 1 -- 172.21.15.90:0/823727863 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805579124 0 0) 0x7fb5a00acfa0 con 0x7fb5a00c44a0 2024-04-20T10:54:34.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.474+0000 7fb59f7fe640 1 --2- 172.21.15.90:0/823727863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aef20 0x7fb5a00af370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb598009e50 tx=0x7fb59802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b87532194aa86d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:34.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb59e7fc640 1 -- 172.21.15.90:0/823727863 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59802ca70 con 0x7fb5a00aef20 2024-04-20T10:54:34.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb59e7fc640 1 -- 172.21.15.90:0/823727863 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59802cc10 con 0x7fb5a00aef20 2024-04-20T10:54:34.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb59e7fc640 1 -- 172.21.15.90:0/823727863 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5980343f0 con 0x7fb5a00aef20 2024-04-20T10:54:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb5a52c1640 1 -- 172.21.15.90:0/823727863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aef20 msgr2=0x7fb5a00af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/823727863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aef20 0x7fb5a00af370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb598009e50 tx=0x7fb59802bed0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb5a52c1640 1 -- 172.21.15.90:0/823727863 shutdown_connections 2024-04-20T10:54:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/823727863 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aef20 0x7fb5a00af370 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/823727863 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00aeb40 0x7fb5a00725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb5a52c1640 1 -- 172.21.15.90:0/823727863 >> 172.21.15.90:0/823727863 conn(0x7fb5a0067de0 msgr2=0x7fb5a00ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:34.477 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.475+0000 7fb5a52c1640 1 -- 172.21.15.90:0/823727863 shutdown_connections 2024-04-20T10:54:34.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.476+0000 7fb5a52c1640 1 -- 172.21.15.90:0/823727863 wait complete. 2024-04-20T10:54:34.478 INFO:tasks.workunit.client.0.smithi090.stdout:7/96: mkdir d11/d13/d23 0 2024-04-20T10:54:34.478 INFO:tasks.workunit.client.0.smithi090.stdout:2/65: write d11/f16 [4344253,9220] 0 2024-04-20T10:54:34.478 INFO:tasks.workunit.client.0.smithi090.stdout:2/66: truncate d11/f15 460337 0 2024-04-20T10:54:34.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.477+0000 7fb5a52c1640 1 Processor -- start 2024-04-20T10:54:34.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.477+0000 7fb5a52c1640 1 -- start start 2024-04-20T10:54:34.479 INFO:tasks.workunit.client.0.smithi090.stdout:6/68: dwrite d1/fd [0,4194304] 0 2024-04-20T10:54:34.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.478+0000 7fb5a52c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aeb40 0x7fb5a01f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:34.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.478+0000 7fb5a52c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a00aef20 0x7fb5a014c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:34.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.478+0000 7fb5a52c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00c44a0 0x7fb5a014a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:34.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.478+0000 7fb5a52c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a01547c0 con 0x7fb5a00aeb40 2024-04-20T10:54:34.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.478+0000 7fb5a52c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a0154640 con 0x7fb5a00aef20 2024-04-20T10:54:34.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb5a52c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb5a0154940 con 0x7fb5a00c44a0 2024-04-20T10:54:34.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00c44a0 0x7fb5a014a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:34.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00c44a0 0x7fb5a014a150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:46560/0 (socket says 172.21.15.90:46560) 2024-04-20T10:54:34.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 -- 172.21.15.90:0/3765261207 learned_addr learned my addr 172.21.15.90:0/3765261207 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:34.481 INFO:tasks.workunit.client.0.smithi090.stdout:9/140: write d0/da/f1b [4281143,95238] 0 2024-04-20T10:54:34.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59effd640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aeb40 0x7fb5a01f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:34.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb597fff640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a00aef20 0x7fb5a014c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:34.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 -- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a00aef20 msgr2=0x7fb5a014c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:34.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a00aef20 0x7fb5a014c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 -- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aeb40 msgr2=0x7fb5a01f0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:34.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aeb40 0x7fb5a01f0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 -- 172.21.15.90:0/3765261207 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a01526b0 con 0x7fb5a00c44a0 2024-04-20T10:54:34.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.479+0000 7fb59f7fe640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00c44a0 0x7fb5a014a150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb598009e50 tx=0x7fb598004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:34.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.482+0000 7fb5977fe640 1 -- 172.21.15.90:0/3765261207 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598043030 con 0x7fb5a00c44a0 2024-04-20T10:54:34.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.482+0000 7fb5977fe640 1 -- 172.21.15.90:0/3765261207 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb59803e450 con 0x7fb5a00c44a0 2024-04-20T10:54:34.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.482+0000 7fb5977fe640 1 -- 172.21.15.90:0/3765261207 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb598009510 con 0x7fb5a00c44a0 2024-04-20T10:54:34.483 INFO:tasks.workunit.client.0.smithi090.stdout:9/141: symlink d0/l28 0 2024-04-20T10:54:34.484 INFO:tasks.workunit.client.0.smithi090.stdout:9/142: write d0/ff [1784526,80786] 0 2024-04-20T10:54:34.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.483+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a01552d0 con 0x7fb5a00c44a0 2024-04-20T10:54:34.484 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.483+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a01f0740 con 0x7fb5a00c44a0 2024-04-20T10:54:34.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.485+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a0076150 con 0x7fb5a00c44a0 2024-04-20T10:54:34.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.486+0000 7fb5977fe640 1 -- 172.21.15.90:0/3765261207 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb598046070 con 0x7fb5a00c44a0 2024-04-20T10:54:34.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.486+0000 7fb5977fe640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb58006c940 0x7fb58006ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:34.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.486+0000 7fb5977fe640 1 -- 172.21.15.90:0/3765261207 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fb5980ae180 con 0x7fb5a00c44a0 2024-04-20T10:54:34.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.487+0000 7fb59effd640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb58006c940 0x7fb58006ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:34.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.487+0000 7fb59effd640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb58006c940 0x7fb58006ee00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb590009b40 tx=0x7fb590009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:34.489 INFO:tasks.workunit.client.0.smithi090.stdout:7/97: write f0 [446934,64642] 0 2024-04-20T10:54:34.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.491+0000 7fb5977fe640 1 -- 172.21.15.90:0/3765261207 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb59804d070 con 0x7fb5a00c44a0 2024-04-20T10:54:34.493 INFO:tasks.workunit.client.0.smithi090.stdout:2/67: dwrite fd [0,4194304] 0 2024-04-20T10:54:34.494 INFO:tasks.workunit.client.0.smithi090.stdout:7/98: dread f8 [0,4194304] 0 2024-04-20T10:54:34.495 INFO:tasks.workunit.client.0.smithi090.stdout:2/68: dread fb [0,4194304] 0 2024-04-20T10:54:34.495 INFO:tasks.workunit.client.0.smithi090.stdout:2/69: write fb [1244938,54982] 0 2024-04-20T10:54:34.496 INFO:tasks.workunit.client.0.smithi090.stdout:7/99: dread f10 [0,4194304] 0 2024-04-20T10:54:34.498 INFO:tasks.workunit.client.0.smithi090.stdout:2/70: unlink fb 0 2024-04-20T10:54:34.498 INFO:tasks.workunit.client.0.smithi090.stdout:2/71: chown d11 29117666 1 2024-04-20T10:54:34.513 INFO:tasks.workunit.client.0.smithi090.stdout:7/100: dwrite f0 [0,4194304] 0 2024-04-20T10:54:34.517 INFO:tasks.workunit.client.0.smithi090.stdout:2/72: dwrite d11/f16 [0,4194304] 0 2024-04-20T10:54:34.518 INFO:tasks.workunit.client.0.smithi090.stdout:2/73: mknod d11/c17 0 2024-04-20T10:54:34.519 INFO:tasks.workunit.client.0.smithi090.stdout:2/74: mknod d11/c18 0 2024-04-20T10:54:34.519 INFO:tasks.workunit.client.0.smithi090.stdout:2/75: creat d11/f19 x:0 0 0 2024-04-20T10:54:34.520 INFO:tasks.workunit.client.0.smithi090.stdout:2/76: unlink c6 0 2024-04-20T10:54:34.529 INFO:tasks.workunit.client.0.smithi090.stdout:2/77: dread d11/f16 [0,4194304] 0 2024-04-20T10:54:34.544 INFO:tasks.workunit.client.0.smithi090.stdout:2/78: dwrite fc [4194304,4194304] 0 2024-04-20T10:54:34.550 INFO:tasks.workunit.client.0.smithi090.stdout:2/79: truncate fc 4985565 0 2024-04-20T10:54:34.550 INFO:tasks.workunit.client.0.smithi090.stdout:2/80: dread - fa zero size 2024-04-20T10:54:34.550 INFO:tasks.workunit.client.0.smithi090.stdout:2/81: read - fa zero size 2024-04-20T10:54:34.550 INFO:tasks.workunit.client.0.smithi090.stdout:2/82: write d11/f19 [773239,126721] 0 2024-04-20T10:54:34.551 INFO:tasks.workunit.client.0.smithi090.stdout:2/83: dread d11/f15 [0,4194304] 0 2024-04-20T10:54:34.551 INFO:tasks.workunit.client.0.smithi090.stdout:2/84: stat d11 0 2024-04-20T10:54:34.551 INFO:tasks.workunit.client.0.smithi090.stdout:2/85: chown d11/f16 840887 1 2024-04-20T10:54:34.553 INFO:tasks.workunit.client.0.smithi090.stdout:2/86: mkdir d11/d1a 0 2024-04-20T10:54:34.554 INFO:tasks.workunit.client.0.smithi090.stdout:2/87: creat d11/d1a/f1b x:0 0 0 2024-04-20T10:54:34.557 INFO:tasks.workunit.client.0.smithi090.stdout:2/88: truncate d11/f19 211077 0 2024-04-20T10:54:34.557 INFO:tasks.workunit.client.0.smithi090.stdout:2/89: dread - d11/d1a/f1b zero size 2024-04-20T10:54:34.557 INFO:tasks.workunit.client.0.smithi090.stdout:2/90: read - d11/f12 zero size 2024-04-20T10:54:34.558 INFO:tasks.workunit.client.0.smithi090.stdout:2/91: creat d11/f1c x:0 0 0 2024-04-20T10:54:34.564 INFO:tasks.workunit.client.0.smithi090.stdout:2/92: write fd [2978130,68853] 0 2024-04-20T10:54:34.564 INFO:tasks.workunit.client.0.smithi090.stdout:2/93: fsync d11/f19 0 2024-04-20T10:54:34.564 INFO:tasks.workunit.client.0.smithi090.stdout:2/94: write fd [2533439,118848] 0 2024-04-20T10:54:34.564 INFO:tasks.workunit.client.0.smithi090.stdout:2/95: readlink l7 0 2024-04-20T10:54:34.578 INFO:tasks.workunit.client.0.smithi090.stdout:2/96: dwrite d11/f15 [0,4194304] 0 2024-04-20T10:54:34.579 INFO:tasks.workunit.client.0.smithi090.stdout:2/97: creat d11/d1a/f1d x:0 0 0 2024-04-20T10:54:34.580 INFO:tasks.workunit.client.0.smithi090.stdout:2/98: creat d11/f1e x:0 0 0 2024-04-20T10:54:34.585 INFO:tasks.workunit.client.0.smithi090.stdout:2/99: write d11/f16 [1961032,129514] 0 2024-04-20T10:54:34.603 INFO:tasks.workunit.client.0.smithi090.stdout:2/100: dwrite d11/f16 [0,4194304] 0 2024-04-20T10:54:34.604 INFO:tasks.workunit.client.0.smithi090.stdout:2/101: mkdir d11/d1f 0 2024-04-20T10:54:34.604 INFO:tasks.workunit.client.0.smithi090.stdout:2/102: creat d11/f20 x:0 0 0 2024-04-20T10:54:34.605 INFO:tasks.workunit.client.0.smithi090.stdout:2/103: chown fa 913 1 2024-04-20T10:54:34.605 INFO:tasks.workunit.client.0.smithi090.stdout:2/104: truncate d11/f12 924343 0 2024-04-20T10:54:34.605 INFO:tasks.workunit.client.0.smithi090.stdout:2/105: mknod d11/d1f/c21 0 2024-04-20T10:54:34.606 INFO:tasks.workunit.client.0.smithi090.stdout:2/106: rename c1 to d11/d1f/c22 0 2024-04-20T10:54:34.606 INFO:tasks.workunit.client.0.smithi090.stdout:2/107: stat d11/c17 0 2024-04-20T10:54:34.619 INFO:tasks.workunit.client.0.smithi090.stdout:2/108: dwrite fc [4194304,4194304] 0 2024-04-20T10:54:34.620 INFO:tasks.workunit.client.0.smithi090.stdout:2/109: symlink d11/d1a/l23 0 2024-04-20T10:54:34.621 INFO:tasks.workunit.client.0.smithi090.stdout:2/110: creat d11/f24 x:0 0 0 2024-04-20T10:54:34.731 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.731+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5a00acd80 con 0x7fb5a00c44a0 2024-04-20T10:54:34.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.732+0000 7fb5977fe640 1 -- 172.21.15.90:0/3765261207 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7fb59807c220 con 0x7fb5a00c44a0 2024-04-20T10:54:34.733 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:34.733 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:34.733 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb58006c940 msgr2=0x7fb58006ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb58006c940 0x7fb58006ee00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fb590009b40 tx=0x7fb590009190 comp rx=0 tx=0).stop 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00c44a0 msgr2=0x7fb5a014a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00c44a0 0x7fb5a014a150 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb598009e50 tx=0x7fb598004a40 comp rx=0 tx=0).stop 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 shutdown_connections 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb58006c940 0x7fb58006ee00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5a00c44a0 0x7fb5a014a150 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5a00aef20 0x7fb5a014c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 --2- 172.21.15.90:0/3765261207 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5a00aeb40 0x7fb5a01f0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 >> 172.21.15.90:0/3765261207 conn(0x7fb5a0067de0 msgr2=0x7fb5a0150150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 shutdown_connections 2024-04-20T10:54:34.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:34.734+0000 7fb5a52c1640 1 -- 172.21.15.90:0/3765261207 wait complete. 2024-04-20T10:54:34.746 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:35.376 INFO:tasks.workunit.client.0.smithi090.stdout:6/69: dread d1/d3/ff [0,4194304] 0 2024-04-20T10:54:35.376 INFO:tasks.workunit.client.0.smithi090.stdout:6/70: mknod d1/d4/c12 0 2024-04-20T10:54:35.380 INFO:tasks.workunit.client.0.smithi090.stdout:6/71: mkdir d1/d10/d13 0 2024-04-20T10:54:35.384 INFO:tasks.workunit.client.0.smithi090.stdout:3/54: sync 2024-04-20T10:54:35.384 INFO:tasks.workunit.client.0.smithi090.stdout:0/61: sync 2024-04-20T10:54:35.384 INFO:tasks.workunit.client.0.smithi090.stdout:8/97: sync 2024-04-20T10:54:35.384 INFO:tasks.workunit.client.0.smithi090.stdout:8/98: chown d0/d11/f1a 40 1 2024-04-20T10:54:35.384 INFO:tasks.workunit.client.0.smithi090.stdout:3/55: fdatasync d7/fc 0 2024-04-20T10:54:35.385 INFO:tasks.workunit.client.0.smithi090.stdout:3/56: write d7/fd [299315,11813] 0 2024-04-20T10:54:35.385 INFO:tasks.workunit.client.0.smithi090.stdout:3/57: read d7/fd [94882,50596] 0 2024-04-20T10:54:35.385 INFO:tasks.workunit.client.0.smithi090.stdout:5/195: sync 2024-04-20T10:54:35.386 INFO:tasks.workunit.client.0.smithi090.stdout:3/58: fdatasync d7/fd 0 2024-04-20T10:54:35.387 INFO:tasks.workunit.client.0.smithi090.stdout:3/59: chown d7/fd 20 1 2024-04-20T10:54:35.388 INFO:tasks.workunit.client.0.smithi090.stdout:3/60: creat d7/df/f13 x:0 0 0 2024-04-20T10:54:35.395 INFO:tasks.workunit.client.0.smithi090.stdout:8/99: write d0/d11/f1a [2523859,76382] 0 2024-04-20T10:54:35.400 INFO:tasks.workunit.client.0.smithi090.stdout:6/72: dwrite d1/d3/fc [0,4194304] 0 2024-04-20T10:54:35.403 INFO:tasks.workunit.client.0.smithi090.stdout:6/73: symlink d1/d3/l14 0 2024-04-20T10:54:35.404 INFO:tasks.workunit.client.0.smithi090.stdout:6/74: link d1/d3/ce d1/d3/d11/c15 0 2024-04-20T10:54:35.412 INFO:tasks.workunit.client.0.smithi090.stdout:8/100: read d0/f9 [313352,23582] 0 2024-04-20T10:54:35.414 INFO:tasks.workunit.client.0.smithi090.stdout:3/61: dread d7/fd [0,4194304] 0 2024-04-20T10:54:35.414 INFO:tasks.workunit.client.0.smithi090.stdout:8/101: creat d0/f1c x:0 0 0 2024-04-20T10:54:35.414 INFO:tasks.workunit.client.0.smithi090.stdout:8/102: readlink d0/lc 0 2024-04-20T10:54:35.414 INFO:tasks.workunit.client.0.smithi090.stdout:3/62: symlink d7/df/l14 0 2024-04-20T10:54:35.415 INFO:tasks.workunit.client.0.smithi090.stdout:8/103: symlink d0/l1d 0 2024-04-20T10:54:35.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/63: getdents d7 0 2024-04-20T10:54:35.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/64: chown c5 28728793 1 2024-04-20T10:54:35.417 INFO:tasks.workunit.client.0.smithi090.stdout:3/65: truncate d7/fa 253555 0 2024-04-20T10:54:35.417 INFO:tasks.workunit.client.0.smithi090.stdout:3/66: getdents d7/d11 0 2024-04-20T10:54:35.418 INFO:tasks.workunit.client.0.smithi090.stdout:3/67: mkdir d7/d15 0 2024-04-20T10:54:35.418 INFO:tasks.workunit.client.0.smithi090.stdout:3/68: getdents d7/d15 0 2024-04-20T10:54:35.419 INFO:tasks.workunit.client.0.smithi090.stdout:3/69: fsync d7/fc 0 2024-04-20T10:54:35.419 INFO:tasks.workunit.client.0.smithi090.stdout:3/70: fsync f6 0 2024-04-20T10:54:35.419 INFO:tasks.workunit.client.0.smithi090.stdout:3/71: fdatasync d7/fc 0 2024-04-20T10:54:35.419 INFO:tasks.workunit.client.0.smithi090.stdout:3/72: rmdir d7/df 39 2024-04-20T10:54:35.419 INFO:tasks.workunit.client.0.smithi090.stdout:3/73: dread - d7/df/f13 zero size 2024-04-20T10:54:35.422 INFO:tasks.workunit.client.0.smithi090.stdout:3/74: link d7/df/f13 d7/df/f16 0 2024-04-20T10:54:35.436 INFO:tasks.workunit.client.0.smithi090.stdout:6/75: dwrite d1/fd [0,4194304] 0 2024-04-20T10:54:35.436 INFO:tasks.workunit.client.0.smithi090.stdout:6/76: chown d1/d4/c12 708067 1 2024-04-20T10:54:35.437 INFO:tasks.workunit.client.0.smithi090.stdout:6/77: mknod d1/d10/c16 0 2024-04-20T10:54:35.437 INFO:tasks.workunit.client.0.smithi090.stdout:6/78: chown d1/d10/c16 5449380 1 2024-04-20T10:54:35.438 INFO:tasks.workunit.client.0.smithi090.stdout:5/196: dwrite d1/da/d16/f32 [0,4194304] 0 2024-04-20T10:54:35.438 INFO:tasks.workunit.client.0.smithi090.stdout:5/197: stat d1/de/l31 0 2024-04-20T10:54:35.442 INFO:tasks.workunit.client.0.smithi090.stdout:3/75: dread d7/fd [0,4194304] 0 2024-04-20T10:54:35.442 INFO:tasks.workunit.client.0.smithi090.stdout:3/76: dread - d7/fc zero size 2024-04-20T10:54:35.443 INFO:tasks.workunit.client.0.smithi090.stdout:3/77: creat d7/d15/f17 x:0 0 0 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/78: readlink d7/df/l14 0 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/79: chown d7/df 230126 1 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/80: truncate d7/fa 1298154 0 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/81: chown d7/d15 5349650 1 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/82: chown d7/df/c10 623 1 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/83: truncate d7/df/f13 955239 0 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/84: chown c5 613 1 2024-04-20T10:54:35.444 INFO:tasks.workunit.client.0.smithi090.stdout:3/85: unlink d7/df/f16 0 2024-04-20T10:54:35.446 INFO:tasks.workunit.client.0.smithi090.stdout:5/198: truncate d1/da/d16/f32 3332877 0 2024-04-20T10:54:35.454 INFO:tasks.workunit.client.0.smithi090.stdout:0/62: dwrite fe [0,4194304] 0 2024-04-20T10:54:35.457 INFO:tasks.workunit.client.0.smithi090.stdout:8/104: dwrite d0/f1c [0,4194304] 0 2024-04-20T10:54:35.457 INFO:tasks.workunit.client.0.smithi090.stdout:8/105: write d0/f9 [1103090,53770] 0 2024-04-20T10:54:35.457 INFO:tasks.workunit.client.0.smithi090.stdout:8/106: chown d0/ld 0 1 2024-04-20T10:54:35.460 INFO:tasks.workunit.client.0.smithi090.stdout:6/79: dwrite d1/d3/ff [0,4194304] 0 2024-04-20T10:54:35.466 INFO:tasks.workunit.client.0.smithi090.stdout:0/63: write ff [2995485,25865] 0 2024-04-20T10:54:35.468 INFO:tasks.workunit.client.0.smithi090.stdout:5/199: dwrite d1/f26 [0,4194304] 0 2024-04-20T10:54:35.469 INFO:tasks.workunit.client.0.smithi090.stdout:8/107: dread d0/fe [0,4194304] 0 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:9/143: sync 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:7/101: sync 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:4/63: sync 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:2/111: sync 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:9/144: chown d0/c15 305 1 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:7/102: chown lc 13 1 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:1/42: sync 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:1/43: chown f4 86173 1 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:1/44: write d8/fb [834419,53280] 0 2024-04-20T10:54:35.470 INFO:tasks.workunit.client.0.smithi090.stdout:1/45: write d8/f11 [800993,41315] 0 2024-04-20T10:54:35.471 INFO:tasks.workunit.client.0.smithi090.stdout:3/86: dwrite d7/fa [0,4194304] 0 2024-04-20T10:54:35.471 INFO:tasks.workunit.client.0.smithi090.stdout:5/200: symlink d1/da/d16/l3a 0 2024-04-20T10:54:35.473 INFO:tasks.workunit.client.0.smithi090.stdout:8/108: creat d0/d11/f1e x:0 0 0 2024-04-20T10:54:35.474 INFO:tasks.workunit.client.0.smithi090.stdout:6/80: dread d1/fd [0,4194304] 0 2024-04-20T10:54:35.475 INFO:tasks.workunit.client.0.smithi090.stdout:2/112: mknod d11/c25 0 2024-04-20T10:54:35.475 INFO:tasks.workunit.client.0.smithi090.stdout:2/113: stat fd 0 2024-04-20T10:54:35.475 INFO:tasks.workunit.client.0.smithi090.stdout:3/87: dread f6 [0,4194304] 0 2024-04-20T10:54:35.475 INFO:tasks.workunit.client.0.smithi090.stdout:3/88: truncate d7/fa 4806147 0 2024-04-20T10:54:35.475 INFO:tasks.workunit.client.0.smithi090.stdout:3/89: fsync d7/fc 0 2024-04-20T10:54:35.475 INFO:tasks.workunit.client.0.smithi090.stdout:9/145: mkdir d0/d29 0 2024-04-20T10:54:35.475 INFO:tasks.workunit.client.0.smithi090.stdout:9/146: readlink d0/da/db/l24 0 2024-04-20T10:54:35.476 INFO:tasks.workunit.client.0.smithi090.stdout:1/46: creat d8/f12 x:0 0 0 2024-04-20T10:54:35.476 INFO:tasks.workunit.client.0.smithi090.stdout:1/47: write d8/fb [1539470,42869] 0 2024-04-20T10:54:35.478 INFO:tasks.workunit.client.0.smithi090.stdout:5/201: unlink d1/da/d16/f2d 0 2024-04-20T10:54:35.479 INFO:tasks.workunit.client.0.smithi090.stdout:8/109: mknod d0/c1f 0 2024-04-20T10:54:35.479 INFO:tasks.workunit.client.0.smithi090.stdout:8/110: chown d0/d11/d14 83503 1 2024-04-20T10:54:35.479 INFO:tasks.workunit.client.0.smithi090.stdout:8/111: chown d0/d11/f1b 134 1 2024-04-20T10:54:35.480 INFO:tasks.workunit.client.0.smithi090.stdout:6/81: truncate d1/f6 3222220 0 2024-04-20T10:54:35.484 INFO:tasks.workunit.client.0.smithi090.stdout:3/90: dread d7/df/f13 [0,4194304] 0 2024-04-20T10:54:35.484 INFO:tasks.workunit.client.0.smithi090.stdout:3/91: chown d7 1 1 2024-04-20T10:54:35.484 INFO:tasks.workunit.client.0.smithi090.stdout:9/147: creat d0/da/d1c/f2a x:0 0 0 2024-04-20T10:54:35.484 INFO:tasks.workunit.client.0.smithi090.stdout:1/48: symlink d8/l13 0 2024-04-20T10:54:35.485 INFO:tasks.workunit.client.0.smithi090.stdout:8/112: creat d0/f20 x:0 0 0 2024-04-20T10:54:35.486 INFO:tasks.workunit.client.0.smithi090.stdout:3/92: truncate f6 4144097 0 2024-04-20T10:54:35.486 INFO:tasks.workunit.client.0.smithi090.stdout:9/148: creat d0/da/d1c/f2b x:0 0 0 2024-04-20T10:54:35.487 INFO:tasks.workunit.client.0.smithi090.stdout:1/49: symlink d8/l14 0 2024-04-20T10:54:35.487 INFO:tasks.workunit.client.0.smithi090.stdout:1/50: chown l1 0 1 2024-04-20T10:54:35.487 INFO:tasks.workunit.client.0.smithi090.stdout:1/51: read - d8/f12 zero size 2024-04-20T10:54:35.488 INFO:tasks.workunit.client.0.smithi090.stdout:3/93: link c3 d7/d11/c18 0 2024-04-20T10:54:35.489 INFO:tasks.workunit.client.0.smithi090.stdout:9/149: symlink d0/da/d1f/l2c 0 2024-04-20T10:54:35.489 INFO:tasks.workunit.client.0.smithi090.stdout:1/52: mknod d8/c15 0 2024-04-20T10:54:35.490 INFO:tasks.workunit.client.0.smithi090.stdout:5/202: read d1/da/d16/f32 [1970987,102259] 0 2024-04-20T10:54:35.490 INFO:tasks.workunit.client.0.smithi090.stdout:3/94: creat d7/f19 x:0 0 0 2024-04-20T10:54:35.491 INFO:tasks.workunit.client.0.smithi090.stdout:1/53: creat d8/f16 x:0 0 0 2024-04-20T10:54:35.492 INFO:tasks.workunit.client.0.smithi090.stdout:5/203: rmdir d1/da/d34 0 2024-04-20T10:54:35.492 INFO:tasks.workunit.client.0.smithi090.stdout:5/204: write d1/de/f20 [366243,85749] 0 2024-04-20T10:54:35.493 INFO:tasks.workunit.client.0.smithi090.stdout:3/95: symlink d7/l1a 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:8/113: dread d0/f9 [0,4194304] 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:8/114: rename d0/d11 to d0/d11/d14/d21 22 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:8/115: fdatasync d0/d11/f1b 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:8/116: getdents d0/d11/d14 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:7/103: dwrite f1 [0,4194304] 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:4/64: dwrite d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:4/65: truncate d7/d9/fa 811450 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:2/114: dwrite fc [0,4194304] 0 2024-04-20T10:54:35.499 INFO:tasks.workunit.client.0.smithi090.stdout:2/115: write d11/f1c [428386,17533] 0 2024-04-20T10:54:35.500 INFO:tasks.workunit.client.0.smithi090.stdout:2/116: chown l2 765464 1 2024-04-20T10:54:35.500 INFO:tasks.workunit.client.0.smithi090.stdout:8/117: mkdir d0/d11/d22 0 2024-04-20T10:54:35.500 INFO:tasks.workunit.client.0.smithi090.stdout:1/54: dread f4 [0,4194304] 0 2024-04-20T10:54:35.507 INFO:tasks.workunit.client.0.smithi090.stdout:4/66: creat d7/f12 x:0 0 0 2024-04-20T10:54:35.508 INFO:tasks.workunit.client.0.smithi090.stdout:2/117: getdents d11/d1a 0 2024-04-20T10:54:35.508 INFO:tasks.workunit.client.0.smithi090.stdout:2/118: chown d11/d1a 12019 1 2024-04-20T10:54:35.510 INFO:tasks.workunit.client.0.smithi090.stdout:8/118: unlink d0/ld 0 2024-04-20T10:54:35.511 INFO:tasks.workunit.client.0.smithi090.stdout:8/119: write d0/f1c [4959321,29527] 0 2024-04-20T10:54:35.511 INFO:tasks.workunit.client.0.smithi090.stdout:1/55: mknod d8/c17 0 2024-04-20T10:54:35.511 INFO:tasks.workunit.client.0.smithi090.stdout:1/56: write d8/f16 [1001410,33617] 0 2024-04-20T10:54:35.513 INFO:tasks.workunit.client.0.smithi090.stdout:3/96: unlink f6 0 2024-04-20T10:54:35.514 INFO:tasks.workunit.client.0.smithi090.stdout:7/104: write f1 [3698883,76725] 0 2024-04-20T10:54:35.514 INFO:tasks.workunit.client.0.smithi090.stdout:7/105: fsync fd 0 2024-04-20T10:54:35.514 INFO:tasks.workunit.client.0.smithi090.stdout:7/106: chown f0 0 1 2024-04-20T10:54:35.514 INFO:tasks.workunit.client.0.smithi090.stdout:7/107: chown d11/l18 40058662 1 2024-04-20T10:54:35.515 INFO:tasks.workunit.client.0.smithi090.stdout:1/57: symlink d8/l18 0 2024-04-20T10:54:35.517 INFO:tasks.workunit.client.0.smithi090.stdout:2/119: write fc [2838317,128821] 0 2024-04-20T10:54:35.518 INFO:tasks.workunit.client.0.smithi090.stdout:1/58: mkdir d8/d19 0 2024-04-20T10:54:35.519 INFO:tasks.workunit.client.0.smithi090.stdout:1/59: mkdir d8/d1a 0 2024-04-20T10:54:35.519 INFO:tasks.workunit.client.0.smithi090.stdout:1/60: fsync d8/fe 0 2024-04-20T10:54:35.519 INFO:tasks.workunit.client.0.smithi090.stdout:1/61: chown d8/c10 23234 1 2024-04-20T10:54:35.519 INFO:tasks.workunit.client.0.smithi090.stdout:1/62: chown d8/f11 1719116 1 2024-04-20T10:54:35.523 INFO:tasks.workunit.client.0.smithi090.stdout:1/63: dread d8/fd [0,4194304] 0 2024-04-20T10:54:35.525 INFO:tasks.workunit.client.0.smithi090.stdout:9/150: dwrite d0/da/d1c/f2a [0,4194304] 0 2024-04-20T10:54:35.527 INFO:tasks.workunit.client.0.smithi090.stdout:1/64: rename d8/cc to d8/d19/c1b 0 2024-04-20T10:54:35.528 INFO:tasks.workunit.client.0.smithi090.stdout:8/120: dread d0/f8 [0,4194304] 0 2024-04-20T10:54:35.532 INFO:tasks.workunit.client.0.smithi090.stdout:5/205: dwrite d1/da/d14/f1d [0,4194304] 0 2024-04-20T10:54:35.532 INFO:tasks.workunit.client.0.smithi090.stdout:5/206: truncate d1/da/f2c 400833 0 2024-04-20T10:54:35.533 INFO:tasks.workunit.client.0.smithi090.stdout:1/65: creat d8/d19/f1c x:0 0 0 2024-04-20T10:54:35.533 INFO:tasks.workunit.client.0.smithi090.stdout:1/66: chown d8/l18 9116087 1 2024-04-20T10:54:35.533 INFO:tasks.workunit.client.0.smithi090.stdout:3/97: dwrite d7/fc [0,4194304] 0 2024-04-20T10:54:35.537 INFO:tasks.workunit.client.0.smithi090.stdout:8/121: creat d0/d11/d22/f23 x:0 0 0 2024-04-20T10:54:35.537 INFO:tasks.workunit.client.0.smithi090.stdout:2/120: read d11/f16 [212519,103228] 0 2024-04-20T10:54:35.537 INFO:tasks.workunit.client.0.smithi090.stdout:5/207: symlink d1/l3b 0 2024-04-20T10:54:35.537 INFO:tasks.workunit.client.0.smithi090.stdout:8/122: write d0/fe [4299140,111971] 0 2024-04-20T10:54:35.537 INFO:tasks.workunit.client.0.smithi090.stdout:8/123: fsync d0/d11/f1b 0 2024-04-20T10:54:35.537 INFO:tasks.workunit.client.0.smithi090.stdout:8/124: dread - d0/f20 zero size 2024-04-20T10:54:35.537 INFO:tasks.workunit.client.0.smithi090.stdout:8/125: chown d0/d11/f1a 33398412 1 2024-04-20T10:54:35.541 INFO:tasks.workunit.client.0.smithi090.stdout:5/208: mknod d1/da/d16/c3c 0 2024-04-20T10:54:35.542 INFO:tasks.workunit.client.0.smithi090.stdout:5/209: rmdir d1/d30 39 2024-04-20T10:54:35.543 INFO:tasks.workunit.client.0.smithi090.stdout:5/210: mkdir d1/d2f/d3d 0 2024-04-20T10:54:35.544 INFO:tasks.workunit.client.0.smithi090.stdout:5/211: creat d1/d2a/f3e x:0 0 0 2024-04-20T10:54:35.545 INFO:tasks.workunit.client.0.smithi090.stdout:5/212: creat d1/da/d16/f3f x:0 0 0 2024-04-20T10:54:35.550 INFO:tasks.workunit.client.0.smithi090.stdout:9/151: dwrite d0/da/f1e [4194304,4194304] 0 2024-04-20T10:54:35.550 INFO:tasks.workunit.client.0.smithi090.stdout:9/152: fsync d0/f9 0 2024-04-20T10:54:35.557 INFO:tasks.workunit.client.0.smithi090.stdout:6/82: dwrite d1/d3/fc [0,4194304] 0 2024-04-20T10:54:35.557 INFO:tasks.workunit.client.0.smithi090.stdout:5/213: dread d1/f12 [0,4194304] 0 2024-04-20T10:54:35.557 INFO:tasks.workunit.client.0.smithi090.stdout:6/83: fdatasync d1/fd 0 2024-04-20T10:54:35.559 INFO:tasks.workunit.client.0.smithi090.stdout:6/84: creat d1/d3/d11/f17 x:0 0 0 2024-04-20T10:54:35.559 INFO:tasks.workunit.client.0.smithi090.stdout:6/85: write d1/d3/d11/f17 [74,9211] 0 2024-04-20T10:54:35.559 INFO:tasks.workunit.client.0.smithi090.stdout:5/214: mkdir d1/d2f/d3d/d40 0 2024-04-20T10:54:35.560 INFO:tasks.workunit.client.0.smithi090.stdout:6/86: link d1/d3/ca d1/d3/c18 0 2024-04-20T10:54:35.561 INFO:tasks.workunit.client.0.smithi090.stdout:5/215: mkdir d1/d41 0 2024-04-20T10:54:35.562 INFO:tasks.workunit.client.0.smithi090.stdout:5/216: symlink d1/d2f/l42 0 2024-04-20T10:54:35.562 INFO:tasks.workunit.client.0.smithi090.stdout:5/217: read d1/da/f1e [2331928,124733] 0 2024-04-20T10:54:35.562 INFO:tasks.workunit.client.0.smithi090.stdout:5/218: symlink d1/d30/l43 0 2024-04-20T10:54:35.563 INFO:tasks.workunit.client.0.smithi090.stdout:5/219: stat d1/da/cc 0 2024-04-20T10:54:35.564 INFO:tasks.workunit.client.0.smithi090.stdout:8/126: dwrite d0/f17 [0,4194304] 0 2024-04-20T10:54:35.564 INFO:tasks.workunit.client.0.smithi090.stdout:3/98: dwrite d7/fc [0,4194304] 0 2024-04-20T10:54:35.564 INFO:tasks.workunit.client.0.smithi090.stdout:5/220: link d1/da/d14/f1d d1/d2f/f44 0 2024-04-20T10:54:35.564 INFO:tasks.workunit.client.0.smithi090.stdout:5/221: write d1/da/d16/f3f [625497,113659] 0 2024-04-20T10:54:35.565 INFO:tasks.workunit.client.0.smithi090.stdout:2/121: dwrite d11/f20 [0,4194304] 0 2024-04-20T10:54:35.565 INFO:tasks.workunit.client.0.smithi090.stdout:8/127: rmdir d0/d11/d22 39 2024-04-20T10:54:35.566 INFO:tasks.workunit.client.0.smithi090.stdout:8/128: truncate d0/f12 1174133 0 2024-04-20T10:54:35.567 INFO:tasks.workunit.client.0.smithi090.stdout:3/99: unlink d7/d11/c18 0 2024-04-20T10:54:35.567 INFO:tasks.workunit.client.0.smithi090.stdout:5/222: truncate d1/de/f20 141187 0 2024-04-20T10:54:35.569 INFO:tasks.workunit.client.0.smithi090.stdout:9/153: dwrite d0/f9 [0,4194304] 0 2024-04-20T10:54:35.569 INFO:tasks.workunit.client.0.smithi090.stdout:2/122: creat d11/f26 x:0 0 0 2024-04-20T10:54:35.569 INFO:tasks.workunit.client.0.smithi090.stdout:2/123: write d11/f26 [362582,40869] 0 2024-04-20T10:54:35.569 INFO:tasks.workunit.client.0.smithi090.stdout:2/124: chown d11/f20 1 1 2024-04-20T10:54:35.569 INFO:tasks.workunit.client.0.smithi090.stdout:2/125: dread - d11/d1a/f1b zero size 2024-04-20T10:54:35.570 INFO:tasks.workunit.client.0.smithi090.stdout:5/223: link d1/da/f17 d1/d2f/d3d/d40/f45 0 2024-04-20T10:54:35.572 INFO:tasks.workunit.client.0.smithi090.stdout:9/154: rename d0/da/db/f25 to d0/da/db/f2d 0 2024-04-20T10:54:35.572 INFO:tasks.workunit.client.0.smithi090.stdout:8/129: dread d0/f9 [0,4194304] 0 2024-04-20T10:54:35.572 INFO:tasks.workunit.client.0.smithi090.stdout:9/155: write d0/da/f13 [191927,103797] 0 2024-04-20T10:54:35.573 INFO:tasks.workunit.client.0.smithi090.stdout:2/126: rename d11/f12 to d11/d1f/f27 0 2024-04-20T10:54:35.576 INFO:tasks.workunit.client.0.smithi090.stdout:5/224: unlink d1/da/f17 0 2024-04-20T10:54:35.576 INFO:tasks.workunit.client.0.smithi090.stdout:5/225: stat d1/fb 0 2024-04-20T10:54:35.579 INFO:tasks.workunit.client.0.smithi090.stdout:9/156: rename d0/da/db/d23/c26 to d0/da/c2e 0 2024-04-20T10:54:35.580 INFO:tasks.workunit.client.0.smithi090.stdout:5/226: symlink d1/d2f/l46 0 2024-04-20T10:54:35.580 INFO:tasks.workunit.client.0.smithi090.stdout:5/227: chown d1/da/f1e 2134017757 1 2024-04-20T10:54:35.581 INFO:tasks.workunit.client.0.smithi090.stdout:5/228: write d1/d2a/f35 [1106681,77743] 0 2024-04-20T10:54:35.582 INFO:tasks.workunit.client.0.smithi090.stdout:9/157: creat d0/da/f2f x:0 0 0 2024-04-20T10:54:35.584 INFO:tasks.workunit.client.0.smithi090.stdout:9/158: mkdir d0/da/d30 0 2024-04-20T10:54:35.585 INFO:tasks.workunit.client.0.smithi090.stdout:2/127: read d11/f20 [792094,13414] 0 2024-04-20T10:54:35.585 INFO:tasks.workunit.client.0.smithi090.stdout:2/128: chown d11/d1f 3779427 1 2024-04-20T10:54:35.586 INFO:tasks.workunit.client.0.smithi090.stdout:5/229: rename d1/d30 to d1/da/d14/d47 0 2024-04-20T10:54:35.587 INFO:tasks.workunit.client.0.smithi090.stdout:9/159: creat d0/da/f31 x:0 0 0 2024-04-20T10:54:35.587 INFO:tasks.workunit.client.0.smithi090.stdout:2/129: dread d11/f1c [0,4194304] 0 2024-04-20T10:54:35.588 INFO:tasks.workunit.client.0.smithi090.stdout:5/230: rename d1/da/d16/c28 to d1/da/c48 0 2024-04-20T10:54:35.589 INFO:tasks.workunit.client.0.smithi090.stdout:9/160: unlink d0/c5 0 2024-04-20T10:54:35.590 INFO:tasks.workunit.client.0.smithi090.stdout:9/161: write d0/da/db/f10 [692045,22356] 0 2024-04-20T10:54:35.590 INFO:tasks.workunit.client.0.smithi090.stdout:2/130: creat d11/f28 x:0 0 0 2024-04-20T10:54:35.591 INFO:tasks.workunit.client.0.smithi090.stdout:8/130: dwrite d0/d11/f1b [0,4194304] 0 2024-04-20T10:54:35.592 INFO:tasks.workunit.client.0.smithi090.stdout:5/231: creat d1/d2a/f49 x:0 0 0 2024-04-20T10:54:35.592 INFO:tasks.workunit.client.0.smithi090.stdout:5/232: readlink d1/da/l13 0 2024-04-20T10:54:35.594 INFO:tasks.workunit.client.0.smithi090.stdout:9/162: creat d0/da/d1c/f32 x:0 0 0 2024-04-20T10:54:35.594 INFO:tasks.workunit.client.0.smithi090.stdout:9/163: dread - d0/da/f18 zero size 2024-04-20T10:54:35.595 INFO:tasks.workunit.client.0.smithi090.stdout:2/131: creat d11/d1f/f29 x:0 0 0 2024-04-20T10:54:35.598 INFO:tasks.workunit.client.0.smithi090.stdout:9/164: mknod d0/da/db/c33 0 2024-04-20T10:54:35.601 INFO:tasks.workunit.client.0.smithi090.stdout:9/165: mkdir d0/da/d1f/d34 0 2024-04-20T10:54:35.602 INFO:tasks.workunit.client.0.smithi090.stdout:9/166: readlink d0/l8 0 2024-04-20T10:54:35.602 INFO:tasks.workunit.client.0.smithi090.stdout:9/167: mkdir d0/da/d1f/d35 0 2024-04-20T10:54:35.604 INFO:tasks.workunit.client.0.smithi090.stdout:9/168: mkdir d0/d29/d36 0 2024-04-20T10:54:35.607 INFO:tasks.workunit.client.0.smithi090.stdout:5/233: dwrite d1/de/f20 [0,4194304] 0 2024-04-20T10:54:35.607 INFO:tasks.workunit.client.0.smithi090.stdout:5/234: write d1/da/d16/f3f [681689,39032] 0 2024-04-20T10:54:35.611 INFO:tasks.workunit.client.0.smithi090.stdout:2/132: getdents d11 0 2024-04-20T10:54:35.613 INFO:tasks.workunit.client.0.smithi090.stdout:2/133: rename cf to d11/d1a/c2a 0 2024-04-20T10:54:35.615 INFO:tasks.workunit.client.0.smithi090.stdout:2/134: mkdir d11/d1a/d2b 0 2024-04-20T10:54:35.615 INFO:tasks.workunit.client.0.smithi090.stdout:9/169: truncate d0/da/db/f10 165286 0 2024-04-20T10:54:35.615 INFO:tasks.workunit.client.0.smithi090.stdout:9/170: dread - d0/da/f2f zero size 2024-04-20T10:54:35.616 INFO:tasks.workunit.client.0.smithi090.stdout:2/135: creat d11/d1a/f2c x:0 0 0 2024-04-20T10:54:35.617 INFO:tasks.workunit.client.0.smithi090.stdout:2/136: unlink d11/c18 0 2024-04-20T10:54:35.618 INFO:tasks.workunit.client.0.smithi090.stdout:8/131: truncate d0/d11/f1b 4145224 0 2024-04-20T10:54:35.620 INFO:tasks.workunit.client.0.smithi090.stdout:8/132: rename d0/lc to d0/l24 0 2024-04-20T10:54:35.623 INFO:tasks.workunit.client.0.smithi090.stdout:8/133: mknod d0/c25 0 2024-04-20T10:54:35.626 INFO:tasks.workunit.client.0.smithi090.stdout:8/134: mkdir d0/d26 0 2024-04-20T10:54:35.629 INFO:tasks.workunit.client.0.smithi090.stdout:9/171: read d0/da/db/f10 [59378,55210] 0 2024-04-20T10:54:35.629 INFO:tasks.workunit.client.0.smithi090.stdout:9/172: stat d0/da/db/f10 0 2024-04-20T10:54:35.630 INFO:tasks.workunit.client.0.smithi090.stdout:5/235: dwrite d1/d2f/f44 [0,4194304] 0 2024-04-20T10:54:35.631 INFO:tasks.workunit.client.0.smithi090.stdout:9/173: creat d0/f37 x:0 0 0 2024-04-20T10:54:35.632 INFO:tasks.workunit.client.0.smithi090.stdout:5/236: truncate d1/da/d16/f32 1616804 0 2024-04-20T10:54:35.632 INFO:tasks.workunit.client.0.smithi090.stdout:9/174: symlink d0/l38 0 2024-04-20T10:54:35.632 INFO:tasks.workunit.client.0.smithi090.stdout:9/175: stat d0/da/f1e 0 2024-04-20T10:54:35.634 INFO:tasks.workunit.client.0.smithi090.stdout:5/237: mkdir d1/d2f/d3d/d40/d4a 0 2024-04-20T10:54:35.634 INFO:tasks.workunit.client.0.smithi090.stdout:5/238: rmdir d1/de 39 2024-04-20T10:54:35.635 INFO:tasks.workunit.client.0.smithi090.stdout:5/239: rmdir d1/da 39 2024-04-20T10:54:35.635 INFO:tasks.workunit.client.0.smithi090.stdout:5/240: stat d1/da/d1f 0 2024-04-20T10:54:35.637 INFO:tasks.workunit.client.0.smithi090.stdout:5/241: dread d1/da/d16/f3f [0,4194304] 0 2024-04-20T10:54:35.639 INFO:tasks.workunit.client.0.smithi090.stdout:5/242: mknod d1/da/d1f/c4b 0 2024-04-20T10:54:35.639 INFO:tasks.workunit.client.0.smithi090.stdout:5/243: readlink d1/d2f/l36 0 2024-04-20T10:54:35.639 INFO:tasks.workunit.client.0.smithi090.stdout:5/244: write d1/fb [831275,66550] 0 2024-04-20T10:54:35.640 INFO:tasks.workunit.client.0.smithi090.stdout:5/245: link d1/d2a/f3e d1/da/d14/f4c 0 2024-04-20T10:54:35.642 INFO:tasks.workunit.client.0.smithi090.stdout:5/246: rename d1/f12 to d1/d2f/d3d/f4d 0 2024-04-20T10:54:35.655 INFO:tasks.workunit.client.0.smithi090.stdout:9/176: dwrite d0/f37 [0,4194304] 0 2024-04-20T10:54:35.671 INFO:tasks.workunit.client.0.smithi090.stdout:9/177: dwrite d0/da/f1e [8388608,4194304] 0 2024-04-20T10:54:35.671 INFO:tasks.workunit.client.0.smithi090.stdout:9/178: write d0/da/d1c/f2b [790384,45398] 0 2024-04-20T10:54:35.672 INFO:tasks.workunit.client.0.smithi090.stdout:9/179: rename d0/da/d1f/l2c to d0/da/d1f/d34/l39 0 2024-04-20T10:54:35.674 INFO:tasks.workunit.client.0.smithi090.stdout:9/180: truncate d0/f37 1585553 0 2024-04-20T10:54:35.681 INFO:tasks.workunit.client.0.smithi090.stdout:9/181: write d0/f11 [3687008,13649] 0 2024-04-20T10:54:35.681 INFO:tasks.workunit.client.0.smithi090.stdout:9/182: symlink d0/da/l3a 0 2024-04-20T10:54:35.682 INFO:tasks.workunit.client.0.smithi090.stdout:9/183: truncate d0/f37 1336257 0 2024-04-20T10:54:35.683 INFO:tasks.workunit.client.0.smithi090.stdout:9/184: symlink d0/da/db/l3b 0 2024-04-20T10:54:35.683 INFO:tasks.workunit.client.0.smithi090.stdout:9/185: creat d0/da/d1f/d35/f3c x:0 0 0 2024-04-20T10:54:35.684 INFO:tasks.workunit.client.0.smithi090.stdout:9/186: getdents d0/da/d1f/d34 0 2024-04-20T10:54:35.729 INFO:tasks.workunit.client.0.smithi090.stdout:0/64: sync 2024-04-20T10:54:35.729 INFO:tasks.workunit.client.0.smithi090.stdout:0/65: fdatasync f3 0 2024-04-20T10:54:35.730 INFO:tasks.workunit.client.0.smithi090.stdout:0/66: creat d14/f17 x:0 0 0 2024-04-20T10:54:35.731 INFO:tasks.workunit.client.0.smithi090.stdout:0/67: write f3 [1346644,31102] 0 2024-04-20T10:54:35.751 INFO:tasks.workunit.client.0.smithi090.stdout:0/68: dwrite fe [0,4194304] 0 2024-04-20T10:54:35.751 INFO:tasks.workunit.client.0.smithi090.stdout:0/69: dread - f13 zero size 2024-04-20T10:54:35.751 INFO:tasks.workunit.client.0.smithi090.stdout:0/70: link f11 d14/f18 0 2024-04-20T10:54:35.752 INFO:tasks.workunit.client.0.smithi090.stdout:0/71: mkdir d14/d19 0 2024-04-20T10:54:35.752 INFO:tasks.workunit.client.0.smithi090.stdout:0/72: truncate d14/f16 19874 0 2024-04-20T10:54:35.753 INFO:tasks.workunit.client.0.smithi090.stdout:0/73: mknod d14/c1a 0 2024-04-20T10:54:35.769 INFO:tasks.workunit.client.0.smithi090.stdout:0/74: dwrite f4 [0,4194304] 0 2024-04-20T10:54:35.769 INFO:tasks.workunit.client.0.smithi090.stdout:0/75: readlink - no filename 2024-04-20T10:54:35.790 INFO:tasks.workunit.client.0.smithi090.stdout:0/76: dwrite d14/f18 [0,4194304] 0 2024-04-20T10:54:35.791 INFO:tasks.workunit.client.0.smithi090.stdout:0/77: write ff [620017,125742] 0 2024-04-20T10:54:35.805 INFO:tasks.workunit.client.0.smithi090.stdout:0/78: dwrite fe [0,4194304] 0 2024-04-20T10:54:35.821 INFO:tasks.workunit.client.0.smithi090.stdout:0/79: dwrite fd [0,4194304] 0 2024-04-20T10:54:35.822 INFO:tasks.workunit.client.0.smithi090.stdout:0/80: creat d14/d19/f1b x:0 0 0 2024-04-20T10:54:35.823 INFO:tasks.workunit.client.0.smithi090.stdout:0/81: link f13 d14/d19/f1c 0 2024-04-20T10:54:35.824 INFO:tasks.workunit.client.0.smithi090.stdout:0/82: link d14/c1a d14/c1d 0 2024-04-20T10:54:35.828 INFO:tasks.workunit.client.0.smithi090.stdout:0/83: truncate fe 1892031 0 2024-04-20T10:54:35.829 INFO:tasks.workunit.client.0.smithi090.stdout:0/84: creat d14/f1e x:0 0 0 2024-04-20T10:54:35.829 INFO:tasks.workunit.client.0.smithi090.stdout:0/85: write fa [832745,18298] 0 2024-04-20T10:54:35.943 INFO:tasks.workunit.client.0.smithi090.stdout:7/108: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:3/100: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:8/135: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:9/187: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:1/67: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:4/67: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:6/87: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:2/137: sync 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:4/68: write f0 [459597,114337] 0 2024-04-20T10:54:35.944 INFO:tasks.workunit.client.0.smithi090.stdout:5/247: sync 2024-04-20T10:54:35.945 INFO:tasks.workunit.client.0.smithi090.stdout:7/109: mkdir d11/d13/d22/d24 0 2024-04-20T10:54:35.945 INFO:tasks.workunit.client.0.smithi090.stdout:3/101: symlink d7/d15/l1b 0 2024-04-20T10:54:35.946 INFO:tasks.workunit.client.0.smithi090.stdout:9/188: creat d0/da/f3d x:0 0 0 2024-04-20T10:54:35.947 INFO:tasks.workunit.client.0.smithi090.stdout:4/69: dread d7/d9/f11 [0,4194304] 0 2024-04-20T10:54:35.947 INFO:tasks.workunit.client.0.smithi090.stdout:1/68: mkdir d8/d1a/d1d 0 2024-04-20T10:54:35.947 INFO:tasks.workunit.client.0.smithi090.stdout:1/69: chown d8/c15 128907 1 2024-04-20T10:54:35.947 INFO:tasks.workunit.client.0.smithi090.stdout:2/138: creat d11/d1a/f2d x:0 0 0 2024-04-20T10:54:35.949 INFO:tasks.workunit.client.0.smithi090.stdout:5/248: rename d1/da/cc to d1/da/d16/c4e 0 2024-04-20T10:54:35.950 INFO:tasks.workunit.client.0.smithi090.stdout:7/110: unlink d11/f12 0 2024-04-20T10:54:35.950 INFO:tasks.workunit.client.0.smithi090.stdout:7/111: readlink d11/l1c 0 2024-04-20T10:54:35.950 INFO:tasks.workunit.client.0.smithi090.stdout:6/88: dread d1/fd [0,4194304] 0 2024-04-20T10:54:35.952 INFO:tasks.workunit.client.0.smithi090.stdout:9/189: creat d0/da/d1c/f3e x:0 0 0 2024-04-20T10:54:35.955 INFO:tasks.workunit.client.0.smithi090.stdout:5/249: creat d1/d2f/d3d/d40/d4a/f4f x:0 0 0 2024-04-20T10:54:35.956 INFO:tasks.workunit.client.0.smithi090.stdout:5/250: fsync d1/fb 0 2024-04-20T10:54:35.956 INFO:tasks.workunit.client.0.smithi090.stdout:7/112: mknod d11/d1a/c25 0 2024-04-20T10:54:35.956 INFO:tasks.workunit.client.0.smithi090.stdout:7/113: chown d11/d13/f1d 13522 1 2024-04-20T10:54:35.956 INFO:tasks.workunit.client.0.smithi090.stdout:7/114: dread - d11/d1a/f21 zero size 2024-04-20T10:54:35.956 INFO:tasks.workunit.client.0.smithi090.stdout:1/70: getdents d8/d1a 0 2024-04-20T10:54:35.958 INFO:tasks.workunit.client.0.smithi090.stdout:2/139: write d11/f15 [1521668,34347] 0 2024-04-20T10:54:35.959 INFO:tasks.workunit.client.0.smithi090.stdout:9/190: creat d0/da/f3f x:0 0 0 2024-04-20T10:54:35.959 INFO:tasks.workunit.client.0.smithi090.stdout:9/191: readlink d0/da/l3a 0 2024-04-20T10:54:35.959 INFO:tasks.workunit.client.0.smithi090.stdout:8/136: write d0/f1c [2868356,39291] 0 2024-04-20T10:54:35.960 INFO:tasks.workunit.client.0.smithi090.stdout:5/251: mkdir d1/da/d14/d47/d50 0 2024-04-20T10:54:35.963 INFO:tasks.workunit.client.0.smithi090.stdout:7/115: rename fd to d11/d13/d23/f26 0 2024-04-20T10:54:35.963 INFO:tasks.workunit.client.0.smithi090.stdout:7/116: fdatasync f9 0 2024-04-20T10:54:35.965 INFO:tasks.workunit.client.0.smithi090.stdout:1/71: unlink c3 0 2024-04-20T10:54:35.968 INFO:tasks.workunit.client.0.smithi090.stdout:2/140: mkdir d11/d1f/d2e 0 2024-04-20T10:54:35.969 INFO:tasks.workunit.client.0.smithi090.stdout:9/192: mknod d0/da/d1f/c40 0 2024-04-20T10:54:35.969 INFO:tasks.workunit.client.0.smithi090.stdout:9/193: fsync d0/f4 0 2024-04-20T10:54:35.971 INFO:tasks.workunit.client.0.smithi090.stdout:7/117: dread d11/f1e [0,4194304] 0 2024-04-20T10:54:35.975 INFO:tasks.workunit.client.0.smithi090.stdout:8/137: write d0/fe [4159639,99808] 0 2024-04-20T10:54:35.975 INFO:tasks.workunit.client.0.smithi090.stdout:8/138: truncate d0/f17 5070703 0 2024-04-20T10:54:35.975 INFO:tasks.workunit.client.0.smithi090.stdout:2/141: link fc d11/d1a/d2b/f2f 0 2024-04-20T10:54:35.976 INFO:tasks.workunit.client.0.smithi090.stdout:8/139: write d0/f12 [326415,20935] 0 2024-04-20T10:54:35.976 INFO:tasks.workunit.client.0.smithi090.stdout:9/194: unlink d0/da/d1c/f32 0 2024-04-20T10:54:35.978 INFO:tasks.workunit.client.0.smithi090.stdout:7/118: mkdir d11/d13/d22/d27 0 2024-04-20T10:54:35.978 INFO:tasks.workunit.client.0.smithi090.stdout:7/119: write f6 [2680429,79707] 0 2024-04-20T10:54:35.981 INFO:tasks.workunit.client.0.smithi090.stdout:2/142: mkdir d11/d1a/d30 0 2024-04-20T10:54:35.981 INFO:tasks.workunit.client.0.smithi090.stdout:2/143: readlink l2 0 2024-04-20T10:54:35.981 INFO:tasks.workunit.client.0.smithi090.stdout:9/195: creat d0/da/d30/f41 x:0 0 0 2024-04-20T10:54:35.982 INFO:tasks.workunit.client.0.smithi090.stdout:7/120: symlink d11/d13/d22/d24/l28 0 2024-04-20T10:54:35.985 INFO:tasks.workunit.client.0.smithi090.stdout:2/144: rename d11/f24 to d11/f31 0 2024-04-20T10:54:35.986 INFO:tasks.workunit.client.0.smithi090.stdout:9/196: getdents d0/da 0 2024-04-20T10:54:35.987 INFO:tasks.workunit.client.0.smithi090.stdout:7/121: symlink d11/d13/d22/l29 0 2024-04-20T10:54:35.988 INFO:tasks.workunit.client.0.smithi090.stdout:4/70: dwrite f0 [0,4194304] 0 2024-04-20T10:54:35.989 INFO:tasks.workunit.client.0.smithi090.stdout:2/145: getdents d11/d1a/d2b 0 2024-04-20T10:54:35.989 INFO:tasks.workunit.client.0.smithi090.stdout:2/146: chown d11/f19 10 1 2024-04-20T10:54:35.990 INFO:tasks.workunit.client.0.smithi090.stdout:3/102: dwrite d7/fd [0,4194304] 0 2024-04-20T10:54:35.990 INFO:tasks.workunit.client.0.smithi090.stdout:4/71: creat d7/d9/f13 x:0 0 0 2024-04-20T10:54:35.990 INFO:tasks.workunit.client.0.smithi090.stdout:2/147: creat d11/d1a/d30/f32 x:0 0 0 2024-04-20T10:54:35.991 INFO:tasks.workunit.client.0.smithi090.stdout:2/148: chown l7 3 1 2024-04-20T10:54:35.993 INFO:tasks.workunit.client.0.smithi090.stdout:6/89: dwrite d1/d3/fc [0,4194304] 0 2024-04-20T10:54:35.993 INFO:tasks.workunit.client.0.smithi090.stdout:8/140: dwrite d0/f2 [4194304,4194304] 0 2024-04-20T10:54:35.994 INFO:tasks.workunit.client.0.smithi090.stdout:5/252: dwrite d1/da/f1e [0,4194304] 0 2024-04-20T10:54:35.995 INFO:tasks.workunit.client.0.smithi090.stdout:3/103: rename d7/d15/f17 to d7/d11/f1c 0 2024-04-20T10:54:35.996 INFO:tasks.workunit.client.0.smithi090.stdout:6/90: mkdir d1/d19 0 2024-04-20T10:54:35.998 INFO:tasks.workunit.client.0.smithi090.stdout:3/104: creat d7/d15/f1d x:0 0 0 2024-04-20T10:54:35.998 INFO:tasks.workunit.client.0.smithi090.stdout:3/105: chown d7/df/c10 6 1 2024-04-20T10:54:35.998 INFO:tasks.workunit.client.0.smithi090.stdout:9/197: dread d0/f4 [0,4194304] 0 2024-04-20T10:54:36.002 INFO:tasks.workunit.client.0.smithi090.stdout:4/72: dread f0 [0,4194304] 0 2024-04-20T10:54:36.002 INFO:tasks.workunit.client.0.smithi090.stdout:4/73: fdatasync d7/f12 0 2024-04-20T10:54:36.003 INFO:tasks.workunit.client.0.smithi090.stdout:2/149: rename d11/d1f/f29 to d11/d1f/d2e/f33 0 2024-04-20T10:54:36.003 INFO:tasks.workunit.client.0.smithi090.stdout:2/150: truncate d11/d1a/d30/f32 97360 0 2024-04-20T10:54:36.003 INFO:tasks.workunit.client.0.smithi090.stdout:8/141: dread d0/fe [4194304,4194304] 0 2024-04-20T10:54:36.004 INFO:tasks.workunit.client.0.smithi090.stdout:6/91: creat d1/d19/f1a x:0 0 0 2024-04-20T10:54:36.004 INFO:tasks.workunit.client.0.smithi090.stdout:7/122: dwrite d11/d1a/f1b [0,4194304] 0 2024-04-20T10:54:36.006 INFO:tasks.workunit.client.0.smithi090.stdout:5/253: write d1/de/f20 [2372335,35576] 0 2024-04-20T10:54:36.006 INFO:tasks.workunit.client.0.smithi090.stdout:5/254: chown d1/da/d14/f1d 483754 1 2024-04-20T10:54:36.010 INFO:tasks.workunit.client.0.smithi090.stdout:4/74: rmdir d7 39 2024-04-20T10:54:36.010 INFO:tasks.workunit.client.0.smithi090.stdout:9/198: dread d0/f9 [0,4194304] 0 2024-04-20T10:54:36.010 INFO:tasks.workunit.client.0.smithi090.stdout:9/199: fdatasync d0/da/f13 0 2024-04-20T10:54:36.010 INFO:tasks.workunit.client.0.smithi090.stdout:8/142: creat d0/f27 x:0 0 0 2024-04-20T10:54:36.011 INFO:tasks.workunit.client.0.smithi090.stdout:6/92: mknod d1/d3/d11/c1b 0 2024-04-20T10:54:36.011 INFO:tasks.workunit.client.0.smithi090.stdout:6/93: readlink d1/d3/l14 0 2024-04-20T10:54:36.011 INFO:tasks.workunit.client.0.smithi090.stdout:2/151: write d11/d1a/d2b/f2f [4452568,32736] 0 2024-04-20T10:54:36.011 INFO:tasks.workunit.client.0.smithi090.stdout:1/72: dwrite f6 [4194304,4194304] 0 2024-04-20T10:54:36.011 INFO:tasks.workunit.client.0.smithi090.stdout:4/75: dread d7/d9/f11 [0,4194304] 0 2024-04-20T10:54:36.013 INFO:tasks.workunit.client.0.smithi090.stdout:7/123: creat d11/d13/d22/d24/f2a x:0 0 0 2024-04-20T10:54:36.013 INFO:tasks.workunit.client.0.smithi090.stdout:7/124: chown d11/d13/f1d 1474 1 2024-04-20T10:54:36.013 INFO:tasks.workunit.client.0.smithi090.stdout:7/125: write f6 [4510458,94037] 0 2024-04-20T10:54:36.014 INFO:tasks.workunit.client.0.smithi090.stdout:5/255: dread d1/d2f/f44 [0,4194304] 0 2024-04-20T10:54:36.017 INFO:tasks.workunit.client.0.smithi090.stdout:6/94: link d1/d3/ce d1/d4/c1c 0 2024-04-20T10:54:36.018 INFO:tasks.workunit.client.0.smithi090.stdout:8/143: dread d0/f17 [0,4194304] 0 2024-04-20T10:54:36.018 INFO:tasks.workunit.client.0.smithi090.stdout:8/144: fdatasync d0/d11/d22/f23 0 2024-04-20T10:54:36.022 INFO:tasks.workunit.client.0.smithi090.stdout:2/152: truncate d11/f26 232374 0 2024-04-20T10:54:36.023 INFO:tasks.workunit.client.0.smithi090.stdout:2/153: truncate d11/d1a/d30/f32 882392 0 2024-04-20T10:54:36.024 INFO:tasks.workunit.client.0.smithi090.stdout:4/76: rename l3 to d7/d9/l14 0 2024-04-20T10:54:36.024 INFO:tasks.workunit.client.0.smithi090.stdout:7/126: getdents d11/d13/d23 0 2024-04-20T10:54:36.024 INFO:tasks.workunit.client.0.smithi090.stdout:5/256: creat d1/da/d14/d47/d50/f51 x:0 0 0 2024-04-20T10:54:36.025 INFO:tasks.workunit.client.0.smithi090.stdout:6/95: creat d1/d4/f1d x:0 0 0 2024-04-20T10:54:36.026 INFO:tasks.workunit.client.0.smithi090.stdout:8/145: rmdir d0/d11/d22 39 2024-04-20T10:54:36.027 INFO:tasks.workunit.client.0.smithi090.stdout:2/154: rmdir d11/d1f/d2e 39 2024-04-20T10:54:36.032 INFO:tasks.workunit.client.0.smithi090.stdout:1/73: mknod d8/d1a/d1d/c1e 0 2024-04-20T10:54:36.033 INFO:tasks.workunit.client.0.smithi090.stdout:6/96: dread d1/fd [0,4194304] 0 2024-04-20T10:54:36.033 INFO:tasks.workunit.client.0.smithi090.stdout:6/97: chown d1/d3/d11/c15 116495 1 2024-04-20T10:54:36.033 INFO:tasks.workunit.client.0.smithi090.stdout:4/77: symlink d7/l15 0 2024-04-20T10:54:36.033 INFO:tasks.workunit.client.0.smithi090.stdout:4/78: write f2 [507076,13089] 0 2024-04-20T10:54:36.034 INFO:tasks.workunit.client.0.smithi090.stdout:7/127: link f6 d11/d13/d23/f2b 0 2024-04-20T10:54:36.035 INFO:tasks.workunit.client.0.smithi090.stdout:5/257: creat d1/da/d1f/f52 x:0 0 0 2024-04-20T10:54:36.035 INFO:tasks.workunit.client.0.smithi090.stdout:5/258: fdatasync d1/da/d16/f3f 0 2024-04-20T10:54:36.035 INFO:tasks.workunit.client.0.smithi090.stdout:0/86: sync 2024-04-20T10:54:36.036 INFO:tasks.workunit.client.0.smithi090.stdout:7/128: dread d11/f1e [0,4194304] 0 2024-04-20T10:54:36.036 INFO:tasks.workunit.client.0.smithi090.stdout:8/146: creat d0/f28 x:0 0 0 2024-04-20T10:54:36.038 INFO:tasks.workunit.client.0.smithi090.stdout:6/98: mkdir d1/d10/d13/d1e 0 2024-04-20T10:54:36.039 INFO:tasks.workunit.client.0.smithi090.stdout:4/79: truncate d7/d9/f11 750149 0 2024-04-20T10:54:36.040 INFO:tasks.workunit.client.0.smithi090.stdout:5/259: read d1/da/d14/f1d [497145,29722] 0 2024-04-20T10:54:36.040 INFO:tasks.workunit.client.0.smithi090.stdout:0/87: creat d14/f1f x:0 0 0 2024-04-20T10:54:36.041 INFO:tasks.workunit.client.0.smithi090.stdout:7/129: creat d11/f2c x:0 0 0 2024-04-20T10:54:36.042 INFO:tasks.workunit.client.0.smithi090.stdout:1/74: unlink f4 0 2024-04-20T10:54:36.043 INFO:tasks.workunit.client.0.smithi090.stdout:2/155: dwrite d11/f28 [0,4194304] 0 2024-04-20T10:54:36.043 INFO:tasks.workunit.client.0.smithi090.stdout:2/156: write fc [4652921,81270] 0 2024-04-20T10:54:36.043 INFO:tasks.workunit.client.0.smithi090.stdout:6/99: mkdir d1/d10/d13/d1e/d1f 0 2024-04-20T10:54:36.044 INFO:tasks.workunit.client.0.smithi090.stdout:4/80: symlink d7/l16 0 2024-04-20T10:54:36.044 INFO:tasks.workunit.client.0.smithi090.stdout:4/81: write d7/fb [50300,20423] 0 2024-04-20T10:54:36.044 INFO:tasks.workunit.client.0.smithi090.stdout:5/260: truncate d1/f7 7273420 0 2024-04-20T10:54:36.046 INFO:tasks.workunit.client.0.smithi090.stdout:0/88: mknod d14/c20 0 2024-04-20T10:54:36.046 INFO:tasks.workunit.client.0.smithi090.stdout:0/89: chown ff 128920430 1 2024-04-20T10:54:36.048 INFO:tasks.workunit.client.0.smithi090.stdout:7/130: link d11/d13/d23/f2b d11/d13/d22/d27/f2d 0 2024-04-20T10:54:36.050 INFO:tasks.workunit.client.0.smithi090.stdout:2/157: getdents d11/d1f/d2e 0 2024-04-20T10:54:36.051 INFO:tasks.workunit.client.0.smithi090.stdout:6/100: creat d1/d10/d13/d1e/f20 x:0 0 0 2024-04-20T10:54:36.054 INFO:tasks.workunit.client.0.smithi090.stdout:0/90: unlink d14/f15 0 2024-04-20T10:54:36.056 INFO:tasks.workunit.client.0.smithi090.stdout:1/75: getdents d8/d19 0 2024-04-20T10:54:36.057 INFO:tasks.workunit.client.0.smithi090.stdout:2/158: symlink d11/d1a/d2b/l34 0 2024-04-20T10:54:36.058 INFO:tasks.workunit.client.0.smithi090.stdout:6/101: symlink d1/d4/l21 0 2024-04-20T10:54:36.058 INFO:tasks.workunit.client.0.smithi090.stdout:6/102: write d1/d19/f1a [256899,61192] 0 2024-04-20T10:54:36.059 INFO:tasks.workunit.client.0.smithi090.stdout:5/261: symlink d1/da/d14/l53 0 2024-04-20T10:54:36.059 INFO:tasks.workunit.client.0.smithi090.stdout:5/262: readlink d1/d2f/l42 0 2024-04-20T10:54:36.059 INFO:tasks.workunit.client.0.smithi090.stdout:5/263: fsync d1/d2f/f37 0 2024-04-20T10:54:36.061 INFO:tasks.workunit.client.0.smithi090.stdout:8/147: dwrite d0/d11/f1e [0,4194304] 0 2024-04-20T10:54:36.061 INFO:tasks.workunit.client.0.smithi090.stdout:8/148: chown d0/f8 0 1 2024-04-20T10:54:36.061 INFO:tasks.workunit.client.0.smithi090.stdout:8/149: fdatasync d0/d11/f1e 0 2024-04-20T10:54:36.061 INFO:tasks.workunit.client.0.smithi090.stdout:0/91: write d14/f18 [5217878,6487] 0 2024-04-20T10:54:36.061 INFO:tasks.workunit.client.0.smithi090.stdout:4/82: dwrite f0 [0,4194304] 0 2024-04-20T10:54:36.061 INFO:tasks.workunit.client.0.smithi090.stdout:4/83: chown d7/l16 324021522 1 2024-04-20T10:54:36.065 INFO:tasks.workunit.client.0.smithi090.stdout:2/159: unlink d11/f26 0 2024-04-20T10:54:36.066 INFO:tasks.workunit.client.0.smithi090.stdout:6/103: unlink d1/d3/d11/c1b 0 2024-04-20T10:54:36.068 INFO:tasks.workunit.client.0.smithi090.stdout:5/264: mknod d1/d41/c54 0 2024-04-20T10:54:36.068 INFO:tasks.workunit.client.0.smithi090.stdout:5/265: write d1/da/f1e [4428555,92578] 0 2024-04-20T10:54:36.068 INFO:tasks.workunit.client.0.smithi090.stdout:5/266: read - d1/d2a/f3e zero size 2024-04-20T10:54:36.070 INFO:tasks.workunit.client.0.smithi090.stdout:8/150: link d0/cb d0/d11/c29 0 2024-04-20T10:54:36.070 INFO:tasks.workunit.client.0.smithi090.stdout:8/151: fsync d0/f27 0 2024-04-20T10:54:36.071 INFO:tasks.workunit.client.0.smithi090.stdout:4/84: mkdir d7/d9/d17 0 2024-04-20T10:54:36.074 INFO:tasks.workunit.client.0.smithi090.stdout:6/104: write d1/d3/ff [2512515,47248] 0 2024-04-20T10:54:36.077 INFO:tasks.workunit.client.0.smithi090.stdout:2/160: creat d11/d1a/d2b/f35 x:0 0 0 2024-04-20T10:54:36.077 INFO:tasks.workunit.client.0.smithi090.stdout:2/161: getdents d11/d1f/d2e 0 2024-04-20T10:54:36.080 INFO:tasks.workunit.client.0.smithi090.stdout:4/85: link d7/fb d7/d9/d17/f18 0 2024-04-20T10:54:36.080 INFO:tasks.workunit.client.0.smithi090.stdout:5/267: write d1/da/f1e [875764,85132] 0 2024-04-20T10:54:36.081 INFO:tasks.workunit.client.0.smithi090.stdout:1/76: dwrite d8/fd [8388608,4194304] 0 2024-04-20T10:54:36.081 INFO:tasks.workunit.client.0.smithi090.stdout:2/162: rmdir d11/d1a 39 2024-04-20T10:54:36.086 INFO:tasks.workunit.client.0.smithi090.stdout:4/86: creat d7/d9/f19 x:0 0 0 2024-04-20T10:54:36.086 INFO:tasks.workunit.client.0.smithi090.stdout:4/87: chown d7/fb 446 1 2024-04-20T10:54:36.086 INFO:tasks.workunit.client.0.smithi090.stdout:4/88: fsync d7/d9/f11 0 2024-04-20T10:54:36.086 INFO:tasks.workunit.client.0.smithi090.stdout:4/89: chown d7/l8 417234325 1 2024-04-20T10:54:36.086 INFO:tasks.workunit.client.0.smithi090.stdout:4/90: truncate d7/f12 1030049 0 2024-04-20T10:54:36.087 INFO:tasks.workunit.client.0.smithi090.stdout:5/268: getdents d1/da/d16 0 2024-04-20T10:54:36.087 INFO:tasks.workunit.client.0.smithi090.stdout:5/269: write d1/f23 [3350522,108711] 0 2024-04-20T10:54:36.087 INFO:tasks.workunit.client.0.smithi090.stdout:5/270: chown d1/l38 114 1 2024-04-20T10:54:36.087 INFO:tasks.workunit.client.0.smithi090.stdout:5/271: fdatasync d1/d2f/d3d/f4d 0 2024-04-20T10:54:36.087 INFO:tasks.workunit.client.0.smithi090.stdout:5/272: fdatasync d1/d2a/f49 0 2024-04-20T10:54:36.088 INFO:tasks.workunit.client.0.smithi090.stdout:2/163: symlink d11/d1f/d2e/l36 0 2024-04-20T10:54:36.088 INFO:tasks.workunit.client.0.smithi090.stdout:2/164: readlink l7 0 2024-04-20T10:54:36.090 INFO:tasks.workunit.client.0.smithi090.stdout:8/152: dwrite d0/d11/f1e [0,4194304] 0 2024-04-20T10:54:36.090 INFO:tasks.workunit.client.0.smithi090.stdout:8/153: stat d0/l10 0 2024-04-20T10:54:36.090 INFO:tasks.workunit.client.0.smithi090.stdout:4/91: getdents d7 0 2024-04-20T10:54:36.092 INFO:tasks.workunit.client.0.smithi090.stdout:5/273: mkdir d1/d55 0 2024-04-20T10:54:36.092 INFO:tasks.workunit.client.0.smithi090.stdout:5/274: dread - d1/d2a/f49 zero size 2024-04-20T10:54:36.094 INFO:tasks.workunit.client.0.smithi090.stdout:5/275: dread d1/da/d16/f3f [0,4194304] 0 2024-04-20T10:54:36.094 INFO:tasks.workunit.client.0.smithi090.stdout:2/165: mkdir d11/d1a/d37 0 2024-04-20T10:54:36.094 INFO:tasks.workunit.client.0.smithi090.stdout:2/166: dread d11/d1f/f27 [0,4194304] 0 2024-04-20T10:54:36.095 INFO:tasks.workunit.client.0.smithi090.stdout:2/167: dread d11/f19 [0,4194304] 0 2024-04-20T10:54:36.095 INFO:tasks.workunit.client.0.smithi090.stdout:2/168: fsync d11/f1c 0 2024-04-20T10:54:36.096 INFO:tasks.workunit.client.0.smithi090.stdout:6/105: dwrite d1/d3/d11/f17 [0,4194304] 0 2024-04-20T10:54:36.096 INFO:tasks.workunit.client.0.smithi090.stdout:6/106: write d1/d19/f1a [320355,100207] 0 2024-04-20T10:54:36.096 INFO:tasks.workunit.client.0.smithi090.stdout:8/154: symlink d0/l2a 0 2024-04-20T10:54:36.097 INFO:tasks.workunit.client.0.smithi090.stdout:8/155: stat d0 0 2024-04-20T10:54:36.098 INFO:tasks.workunit.client.0.smithi090.stdout:1/77: rename d8/d19/f1c to d8/f1f 0 2024-04-20T10:54:36.100 INFO:tasks.workunit.client.0.smithi090.stdout:2/169: link d11/f31 d11/d1a/d2b/f38 0 2024-04-20T10:54:36.100 INFO:tasks.workunit.client.0.smithi090.stdout:2/170: fdatasync d11/f1c 0 2024-04-20T10:54:36.103 INFO:tasks.workunit.client.0.smithi090.stdout:6/107: mknod d1/d10/d13/d1e/c22 0 2024-04-20T10:54:36.106 INFO:tasks.workunit.client.0.smithi090.stdout:4/92: dread f0 [0,4194304] 0 2024-04-20T10:54:36.106 INFO:tasks.workunit.client.0.smithi090.stdout:4/93: write d7/d9/fa [860085,77724] 0 2024-04-20T10:54:36.118 INFO:tasks.workunit.client.0.smithi090.stdout:6/108: write d1/f6 [2248648,109284] 0 2024-04-20T10:54:36.118 INFO:tasks.workunit.client.0.smithi090.stdout:8/156: dwrite d0/f12 [0,4194304] 0 2024-04-20T10:54:36.120 INFO:tasks.workunit.client.0.smithi090.stdout:5/276: rename d1/da/d1f/f52 to d1/d2f/f56 0 2024-04-20T10:54:36.121 INFO:tasks.workunit.client.0.smithi090.stdout:6/109: creat d1/f23 x:0 0 0 2024-04-20T10:54:36.126 INFO:tasks.workunit.client.0.smithi090.stdout:6/110: fsync d1/f23 0 2024-04-20T10:54:36.126 INFO:tasks.workunit.client.0.smithi090.stdout:6/111: write d1/d3/ff [547987,52019] 0 2024-04-20T10:54:36.126 INFO:tasks.workunit.client.0.smithi090.stdout:6/112: chown c0 105 1 2024-04-20T10:54:36.132 INFO:tasks.workunit.client.0.smithi090.stdout:4/94: dwrite f0 [0,4194304] 0 2024-04-20T10:54:36.132 INFO:tasks.workunit.client.0.smithi090.stdout:4/95: chown d7/d9/l14 4155156 1 2024-04-20T10:54:36.132 INFO:tasks.workunit.client.0.smithi090.stdout:4/96: readlink d7/l16 0 2024-04-20T10:54:36.132 INFO:tasks.workunit.client.0.smithi090.stdout:2/171: dwrite d11/f1e [0,4194304] 0 2024-04-20T10:54:36.132 INFO:tasks.workunit.client.0.smithi090.stdout:2/172: chown le 1054966 1 2024-04-20T10:54:36.134 INFO:tasks.workunit.client.0.smithi090.stdout:6/113: creat d1/d10/d13/f24 x:0 0 0 2024-04-20T10:54:36.134 INFO:tasks.workunit.client.0.smithi090.stdout:1/78: dread f6 [4194304,4194304] 0 2024-04-20T10:54:36.136 INFO:tasks.workunit.client.0.smithi090.stdout:2/173: rename d11/d1f/d2e/l36 to d11/d1f/d2e/l39 0 2024-04-20T10:54:36.136 INFO:tasks.workunit.client.0.smithi090.stdout:2/174: truncate d11/d1a/f1d 699473 0 2024-04-20T10:54:36.137 INFO:tasks.workunit.client.0.smithi090.stdout:2/175: stat d11/f20 0 2024-04-20T10:54:36.138 INFO:tasks.workunit.client.0.smithi090.stdout:6/114: mkdir d1/d19/d25 0 2024-04-20T10:54:36.138 INFO:tasks.workunit.client.0.smithi090.stdout:6/115: fsync d1/fd 0 2024-04-20T10:54:36.140 INFO:tasks.workunit.client.0.smithi090.stdout:2/176: mknod d11/d1a/d30/c3a 0 2024-04-20T10:54:36.140 INFO:tasks.workunit.client.0.smithi090.stdout:8/157: dwrite d0/f12 [0,4194304] 0 2024-04-20T10:54:36.144 INFO:tasks.workunit.client.0.smithi090.stdout:1/79: rename l0 to d8/d19/l20 0 2024-04-20T10:54:36.147 INFO:tasks.workunit.client.0.smithi090.stdout:8/158: dread d0/f1c [0,4194304] 0 2024-04-20T10:54:36.149 INFO:tasks.workunit.client.0.smithi090.stdout:6/116: truncate d1/d3/fc 4184280 0 2024-04-20T10:54:36.151 INFO:tasks.workunit.client.0.smithi090.stdout:5/277: dwrite d1/f7 [0,4194304] 0 2024-04-20T10:54:36.152 INFO:tasks.workunit.client.0.smithi090.stdout:5/278: chown d1/da/d14/d47/d50/f51 0 1 2024-04-20T10:54:36.153 INFO:tasks.workunit.client.0.smithi090.stdout:4/97: dwrite d7/d9/f19 [0,4194304] 0 2024-04-20T10:54:36.153 INFO:tasks.workunit.client.0.smithi090.stdout:4/98: dread - d7/d9/f13 zero size 2024-04-20T10:54:36.153 INFO:tasks.workunit.client.0.smithi090.stdout:2/177: rename d11/d1a/d30/f32 to d11/d1f/d2e/f3b 0 2024-04-20T10:54:36.153 INFO:tasks.workunit.client.0.smithi090.stdout:1/80: truncate d8/fe 777920 0 2024-04-20T10:54:36.156 INFO:tasks.workunit.client.0.smithi090.stdout:8/159: write d0/f12 [3055630,78265] 0 2024-04-20T10:54:36.156 INFO:tasks.workunit.client.0.smithi090.stdout:8/160: chown d0/d11/d22 8391964 1 2024-04-20T10:54:36.156 INFO:tasks.workunit.client.0.smithi090.stdout:5/279: creat d1/de/f57 x:0 0 0 2024-04-20T10:54:36.160 INFO:tasks.workunit.client.0.smithi090.stdout:6/117: rename d1/d3 to d1/d4/d26 0 2024-04-20T10:54:36.160 INFO:tasks.workunit.client.0.smithi090.stdout:2/178: rename d11 to d11/d3c 22 2024-04-20T10:54:36.160 INFO:tasks.workunit.client.0.smithi090.stdout:2/179: truncate d11/d1f/d2e/f3b 1699187 0 2024-04-20T10:54:36.161 INFO:tasks.workunit.client.0.smithi090.stdout:4/99: write d7/d9/f19 [367287,26001] 0 2024-04-20T10:54:36.163 INFO:tasks.workunit.client.0.smithi090.stdout:8/161: creat d0/d11/d14/f2b x:0 0 0 2024-04-20T10:54:36.164 INFO:tasks.workunit.client.0.smithi090.stdout:4/100: creat d7/f1a x:0 0 0 2024-04-20T10:54:36.173 INFO:tasks.workunit.client.0.smithi090.stdout:4/101: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:36.173 INFO:tasks.workunit.client.0.smithi090.stdout:4/102: truncate d7/fb 989883 0 2024-04-20T10:54:36.174 INFO:tasks.workunit.client.0.smithi090.stdout:8/162: symlink d0/d11/l2c 0 2024-04-20T10:54:36.180 INFO:tasks.workunit.client.0.smithi090.stdout:5/280: dwrite d1/d2a/f35 [0,4194304] 0 2024-04-20T10:54:36.180 INFO:tasks.workunit.client.0.smithi090.stdout:4/103: symlink d7/d9/d17/l1b 0 2024-04-20T10:54:36.181 INFO:tasks.workunit.client.0.smithi090.stdout:4/104: chown d7/d9/d17/l1b 7474 1 2024-04-20T10:54:36.181 INFO:tasks.workunit.client.0.smithi090.stdout:1/81: rename d8/c17 to d8/c21 0 2024-04-20T10:54:36.185 INFO:tasks.workunit.client.0.smithi090.stdout:6/118: dwrite d1/f6 [0,4194304] 0 2024-04-20T10:54:36.186 INFO:tasks.workunit.client.0.smithi090.stdout:5/281: creat d1/f58 x:0 0 0 2024-04-20T10:54:36.186 INFO:tasks.workunit.client.0.smithi090.stdout:5/282: truncate d1/de/f20 5051929 0 2024-04-20T10:54:36.186 INFO:tasks.workunit.client.0.smithi090.stdout:5/283: fsync d1/d2a/f35 0 2024-04-20T10:54:36.186 INFO:tasks.workunit.client.0.smithi090.stdout:5/284: read d1/da/d16/f32 [830165,91231] 0 2024-04-20T10:54:36.187 INFO:tasks.workunit.client.0.smithi090.stdout:1/82: truncate f6 3127494 0 2024-04-20T10:54:36.188 INFO:tasks.workunit.client.0.smithi090.stdout:8/163: dread d0/d11/f1a [0,4194304] 0 2024-04-20T10:54:36.188 INFO:tasks.workunit.client.0.smithi090.stdout:8/164: write d0/f9 [1403337,64578] 0 2024-04-20T10:54:36.189 INFO:tasks.workunit.client.0.smithi090.stdout:2/180: dwrite d11/f16 [0,4194304] 0 2024-04-20T10:54:36.189 INFO:tasks.workunit.client.0.smithi090.stdout:6/119: creat d1/d10/d13/f27 x:0 0 0 2024-04-20T10:54:36.189 INFO:tasks.workunit.client.0.smithi090.stdout:6/120: chown d1/fd 822012192 1 2024-04-20T10:54:36.190 INFO:tasks.workunit.client.0.smithi090.stdout:5/285: mknod d1/c59 0 2024-04-20T10:54:36.192 INFO:tasks.workunit.client.0.smithi090.stdout:8/165: mkdir d0/d2d 0 2024-04-20T10:54:36.192 INFO:tasks.workunit.client.0.smithi090.stdout:8/166: fsync d0/f17 0 2024-04-20T10:54:36.192 INFO:tasks.workunit.client.0.smithi090.stdout:1/83: write d8/f11 [434450,81484] 0 2024-04-20T10:54:36.192 INFO:tasks.workunit.client.0.smithi090.stdout:1/84: getdents d8/d1a 0 2024-04-20T10:54:36.193 INFO:tasks.workunit.client.0.smithi090.stdout:2/181: creat d11/d1f/d2e/f3d x:0 0 0 2024-04-20T10:54:36.193 INFO:tasks.workunit.client.0.smithi090.stdout:2/182: fsync d11/d1f/d2e/f3b 0 2024-04-20T10:54:36.193 INFO:tasks.workunit.client.0.smithi090.stdout:2/183: write d11/f19 [827488,81944] 0 2024-04-20T10:54:36.194 INFO:tasks.workunit.client.0.smithi090.stdout:6/121: rename d1/d5 to d1/d10/d13/d28 0 2024-04-20T10:54:36.195 INFO:tasks.workunit.client.0.smithi090.stdout:5/286: mknod d1/da/d14/d47/d50/c5a 0 2024-04-20T10:54:36.196 INFO:tasks.workunit.client.0.smithi090.stdout:8/167: creat d0/f2e x:0 0 0 2024-04-20T10:54:36.197 INFO:tasks.workunit.client.0.smithi090.stdout:2/184: rmdir d11/d1f 39 2024-04-20T10:54:36.198 INFO:tasks.workunit.client.0.smithi090.stdout:4/105: dwrite d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:36.198 INFO:tasks.workunit.client.0.smithi090.stdout:5/287: creat d1/d2f/d3d/f5b x:0 0 0 2024-04-20T10:54:36.199 INFO:tasks.workunit.client.0.smithi090.stdout:8/168: mknod d0/d11/c2f 0 2024-04-20T10:54:36.199 INFO:tasks.workunit.client.0.smithi090.stdout:2/185: symlink d11/d1a/l3e 0 2024-04-20T10:54:36.223 INFO:tasks.workunit.client.0.smithi090.stdout:5/288: dwrite d1/d2f/d3d/f4d [0,4194304] 0 2024-04-20T10:54:36.223 INFO:tasks.workunit.client.0.smithi090.stdout:2/186: dwrite d11/f1e [0,4194304] 0 2024-04-20T10:54:36.224 INFO:tasks.workunit.client.0.smithi090.stdout:1/85: rename c7 to d8/c22 0 2024-04-20T10:54:36.225 INFO:tasks.workunit.client.0.smithi090.stdout:2/187: symlink d11/d1a/d30/l3f 0 2024-04-20T10:54:36.225 INFO:tasks.workunit.client.0.smithi090.stdout:2/188: read d11/f16 [4344495,64236] 0 2024-04-20T10:54:36.225 INFO:tasks.workunit.client.0.smithi090.stdout:2/189: dread - d11/d1a/f2c zero size 2024-04-20T10:54:36.227 INFO:tasks.workunit.client.0.smithi090.stdout:6/122: rename d1/d4/d26/c18 to d1/d19/d25/c29 0 2024-04-20T10:54:36.249 INFO:tasks.workunit.client.0.smithi090.stdout:1/86: dwrite f6 [0,4194304] 0 2024-04-20T10:54:36.249 INFO:tasks.workunit.client.0.smithi090.stdout:1/87: fsync d8/f11 0 2024-04-20T10:54:36.250 INFO:tasks.workunit.client.0.smithi090.stdout:2/190: dwrite d11/f20 [0,4194304] 0 2024-04-20T10:54:36.250 INFO:tasks.workunit.client.0.smithi090.stdout:4/106: rename d7/f1a to d7/d9/f1c 0 2024-04-20T10:54:36.251 INFO:tasks.workunit.client.0.smithi090.stdout:6/123: creat d1/d10/d13/d28/f2a x:0 0 0 2024-04-20T10:54:36.251 INFO:tasks.workunit.client.0.smithi090.stdout:6/124: write d1/f23 [316853,77658] 0 2024-04-20T10:54:36.251 INFO:tasks.workunit.client.0.smithi090.stdout:1/88: write d8/f12 [499163,61739] 0 2024-04-20T10:54:36.251 INFO:tasks.workunit.client.0.smithi090.stdout:2/191: mknod d11/c40 0 2024-04-20T10:54:36.252 INFO:tasks.workunit.client.0.smithi090.stdout:8/169: rename d0/d11/f1e to d0/d2d/f30 0 2024-04-20T10:54:36.253 INFO:tasks.workunit.client.0.smithi090.stdout:6/125: creat d1/d4/d26/f2b x:0 0 0 2024-04-20T10:54:36.253 INFO:tasks.workunit.client.0.smithi090.stdout:8/170: read d0/f17 [4731489,6415] 0 2024-04-20T10:54:36.253 INFO:tasks.workunit.client.0.smithi090.stdout:8/171: dread - d0/d11/d14/f2b zero size 2024-04-20T10:54:36.254 INFO:tasks.workunit.client.0.smithi090.stdout:8/172: fdatasync d0/f27 0 2024-04-20T10:54:36.254 INFO:tasks.workunit.client.0.smithi090.stdout:1/89: getdents d8 0 2024-04-20T10:54:36.254 INFO:tasks.workunit.client.0.smithi090.stdout:1/90: dread - d8/f1f zero size 2024-04-20T10:54:36.254 INFO:tasks.workunit.client.0.smithi090.stdout:1/91: chown d8/d1a/d1d 14 1 2024-04-20T10:54:36.254 INFO:tasks.workunit.client.0.smithi090.stdout:1/92: write d8/f11 [827084,10575] 0 2024-04-20T10:54:36.255 INFO:tasks.workunit.client.0.smithi090.stdout:2/192: rename d11/d1a/l3e to d11/l41 0 2024-04-20T10:54:36.255 INFO:tasks.workunit.client.0.smithi090.stdout:6/126: rmdir d1/d10/d13/d1e 39 2024-04-20T10:54:36.255 INFO:tasks.workunit.client.0.smithi090.stdout:6/127: dread - d1/d10/d13/d28/f2a zero size 2024-04-20T10:54:36.256 INFO:tasks.workunit.client.0.smithi090.stdout:6/128: chown d1/d4/d26/d11/f17 332665 1 2024-04-20T10:54:36.256 INFO:tasks.workunit.client.0.smithi090.stdout:8/173: creat d0/d11/f31 x:0 0 0 2024-04-20T10:54:36.267 INFO:tasks.workunit.client.0.smithi090.stdout:8/174: write d0/d2d/f30 [392846,83183] 0 2024-04-20T10:54:36.268 INFO:tasks.workunit.client.0.smithi090.stdout:8/175: chown d0/l2a 32550583 1 2024-04-20T10:54:36.268 INFO:tasks.workunit.client.0.smithi090.stdout:4/107: dwrite d7/d9/f13 [0,4194304] 0 2024-04-20T10:54:36.268 INFO:tasks.workunit.client.0.smithi090.stdout:4/108: truncate d7/fb 2007502 0 2024-04-20T10:54:36.268 INFO:tasks.workunit.client.0.smithi090.stdout:1/93: creat d8/d19/f23 x:0 0 0 2024-04-20T10:54:36.269 INFO:tasks.workunit.client.0.smithi090.stdout:2/193: dread d11/f28 [0,4194304] 0 2024-04-20T10:54:36.527 INFO:tasks.workunit.client.0.smithi090.stdout:8/176: stat d0/d11/c29 0 2024-04-20T10:54:36.527 INFO:tasks.workunit.client.0.smithi090.stdout:6/129: creat d1/d4/d26/d11/f2c x:0 0 0 2024-04-20T10:54:36.527 INFO:tasks.workunit.client.0.smithi090.stdout:8/177: read - d0/f20 zero size 2024-04-20T10:54:36.527 INFO:tasks.workunit.client.0.smithi090.stdout:4/109: creat d7/f1d x:0 0 0 2024-04-20T10:54:36.527 INFO:tasks.workunit.client.0.smithi090.stdout:8/178: fsync d0/d2d/f30 0 2024-04-20T10:54:36.528 INFO:tasks.workunit.client.0.smithi090.stdout:1/94: creat d8/d1a/d1d/f24 x:0 0 0 2024-04-20T10:54:36.528 INFO:tasks.workunit.client.0.smithi090.stdout:1/95: fdatasync f6 0 2024-04-20T10:54:36.528 INFO:tasks.workunit.client.0.smithi090.stdout:2/194: creat d11/d1a/d30/f42 x:0 0 0 2024-04-20T10:54:36.530 INFO:tasks.workunit.client.0.smithi090.stdout:6/130: creat d1/d19/f2d x:0 0 0 2024-04-20T10:54:36.531 INFO:tasks.workunit.client.0.smithi090.stdout:4/110: rmdir d7 39 2024-04-20T10:54:36.532 INFO:tasks.workunit.client.0.smithi090.stdout:8/179: link d0/l1d d0/d2d/l32 0 2024-04-20T10:54:36.533 INFO:tasks.workunit.client.0.smithi090.stdout:1/96: truncate d8/f16 730312 0 2024-04-20T10:54:36.533 INFO:tasks.workunit.client.0.smithi090.stdout:1/97: fdatasync d8/d1a/d1d/f24 0 2024-04-20T10:54:36.534 INFO:tasks.workunit.client.0.smithi090.stdout:2/195: symlink d11/d1a/d2b/l43 0 2024-04-20T10:54:36.534 INFO:tasks.workunit.client.0.smithi090.stdout:6/131: mknod d1/d10/d13/d28/c2e 0 2024-04-20T10:54:36.535 INFO:tasks.workunit.client.0.smithi090.stdout:4/111: mknod d7/c1e 0 2024-04-20T10:54:36.536 INFO:tasks.workunit.client.0.smithi090.stdout:2/196: getdents d11 0 2024-04-20T10:54:36.536 INFO:tasks.workunit.client.0.smithi090.stdout:6/132: mknod d1/c2f 0 2024-04-20T10:54:36.537 INFO:tasks.workunit.client.0.smithi090.stdout:4/112: truncate d7/d9/f13 2763083 0 2024-04-20T10:54:36.537 INFO:tasks.workunit.client.0.smithi090.stdout:4/113: chown d7/l8 149118 1 2024-04-20T10:54:36.538 INFO:tasks.workunit.client.0.smithi090.stdout:2/197: creat d11/d1a/d37/f44 x:0 0 0 2024-04-20T10:54:36.540 INFO:tasks.workunit.client.0.smithi090.stdout:4/114: symlink d7/l1f 0 2024-04-20T10:54:36.546 INFO:tasks.workunit.client.0.smithi090.stdout:7/131: sync 2024-04-20T10:54:36.546 INFO:tasks.workunit.client.0.smithi090.stdout:0/92: sync 2024-04-20T10:54:36.546 INFO:tasks.workunit.client.0.smithi090.stdout:3/106: sync 2024-04-20T10:54:36.546 INFO:tasks.workunit.client.0.smithi090.stdout:7/132: truncate d11/d13/d22/d24/f2a 547895 0 2024-04-20T10:54:36.547 INFO:tasks.workunit.client.0.smithi090.stdout:3/107: write d7/f19 [240829,105647] 0 2024-04-20T10:54:36.547 INFO:tasks.workunit.client.0.smithi090.stdout:9/200: sync 2024-04-20T10:54:36.547 INFO:tasks.workunit.client.0.smithi090.stdout:9/201: write d0/da/f3d [175539,57888] 0 2024-04-20T10:54:36.547 INFO:tasks.workunit.client.0.smithi090.stdout:5/289: sync 2024-04-20T10:54:36.547 INFO:tasks.workunit.client.0.smithi090.stdout:5/290: fdatasync d1/da/d16/f3f 0 2024-04-20T10:54:36.547 INFO:tasks.workunit.client.0.smithi090.stdout:1/98: dread f6 [0,4194304] 0 2024-04-20T10:54:36.548 INFO:tasks.workunit.client.0.smithi090.stdout:1/99: chown d8/d19/c1b 1047652179 1 2024-04-20T10:54:36.551 INFO:tasks.workunit.client.0.smithi090.stdout:2/198: read d11/f1e [653398,53319] 0 2024-04-20T10:54:36.552 INFO:tasks.workunit.client.0.smithi090.stdout:3/108: rename d7/le to d7/d15/l1e 0 2024-04-20T10:54:36.554 INFO:tasks.workunit.client.0.smithi090.stdout:8/180: dwrite d0/f8 [4194304,4194304] 0 2024-04-20T10:54:36.556 INFO:tasks.workunit.client.0.smithi090.stdout:5/291: creat d1/da/d14/d47/d50/f5c x:0 0 0 2024-04-20T10:54:36.556 INFO:tasks.workunit.client.0.smithi090.stdout:3/109: mknod d7/d11/c1f 0 2024-04-20T10:54:36.559 INFO:tasks.workunit.client.0.smithi090.stdout:5/292: creat d1/da/d14/d47/d39/f5d x:0 0 0 2024-04-20T10:54:36.559 INFO:tasks.workunit.client.0.smithi090.stdout:5/293: fdatasync d1/d2f/d3d/d40/d4a/f4f 0 2024-04-20T10:54:36.562 INFO:tasks.workunit.client.0.smithi090.stdout:3/110: rename l4 to d7/d11/l20 0 2024-04-20T10:54:36.562 INFO:tasks.workunit.client.0.smithi090.stdout:3/111: dread - d7/d11/f1c zero size 2024-04-20T10:54:36.564 INFO:tasks.workunit.client.0.smithi090.stdout:3/112: mknod d7/d15/c21 0 2024-04-20T10:54:36.564 INFO:tasks.workunit.client.0.smithi090.stdout:3/113: fdatasync d7/fd 0 2024-04-20T10:54:36.564 INFO:tasks.workunit.client.0.smithi090.stdout:3/114: write d7/f19 [1035094,9109] 0 2024-04-20T10:54:36.566 INFO:tasks.workunit.client.0.smithi090.stdout:3/115: mkdir d7/d22 0 2024-04-20T10:54:36.568 INFO:tasks.workunit.client.0.smithi090.stdout:3/116: creat d7/d15/f23 x:0 0 0 2024-04-20T10:54:36.569 INFO:tasks.workunit.client.0.smithi090.stdout:3/117: mknod d7/d11/c24 0 2024-04-20T10:54:36.570 INFO:tasks.workunit.client.0.smithi090.stdout:3/118: creat d7/d15/f25 x:0 0 0 2024-04-20T10:54:36.571 INFO:tasks.workunit.client.0.smithi090.stdout:3/119: mkdir d7/d26 0 2024-04-20T10:54:36.572 INFO:tasks.workunit.client.0.smithi090.stdout:3/120: dread - d7/d15/f23 zero size 2024-04-20T10:54:36.581 INFO:tasks.workunit.client.0.smithi090.stdout:0/93: dwrite d14/f16 [0,4194304] 0 2024-04-20T10:54:36.582 INFO:tasks.workunit.client.0.smithi090.stdout:5/294: dwrite d1/d2f/d3d/d40/d4a/f4f [0,4194304] 0 2024-04-20T10:54:36.582 INFO:tasks.workunit.client.0.smithi090.stdout:5/295: chown d1/f58 20307546 1 2024-04-20T10:54:36.582 INFO:tasks.workunit.client.0.smithi090.stdout:5/296: write d1/d2f/d3d/f5b [231201,64806] 0 2024-04-20T10:54:36.583 INFO:tasks.workunit.client.0.smithi090.stdout:0/94: stat c8 0 2024-04-20T10:54:36.583 INFO:tasks.workunit.client.0.smithi090.stdout:5/297: link d1/d2f/d3d/d40/d4a/f4f d1/d2a/f5e 0 2024-04-20T10:54:36.586 INFO:tasks.workunit.client.0.smithi090.stdout:0/95: dread fa [0,4194304] 0 2024-04-20T10:54:36.586 INFO:tasks.workunit.client.0.smithi090.stdout:0/96: write d14/f1f [519678,110706] 0 2024-04-20T10:54:36.587 INFO:tasks.workunit.client.0.smithi090.stdout:0/97: creat d14/f21 x:0 0 0 2024-04-20T10:54:36.587 INFO:tasks.workunit.client.0.smithi090.stdout:0/98: creat d14/f22 x:0 0 0 2024-04-20T10:54:36.588 INFO:tasks.workunit.client.0.smithi090.stdout:0/99: mknod d14/c23 0 2024-04-20T10:54:36.596 INFO:tasks.workunit.client.0.smithi090.stdout:3/121: dread d7/fd [0,4194304] 0 2024-04-20T10:54:36.599 INFO:tasks.workunit.client.0.smithi090.stdout:5/298: dwrite d1/da/d14/d47/d50/f51 [0,4194304] 0 2024-04-20T10:54:36.601 INFO:tasks.workunit.client.0.smithi090.stdout:5/299: symlink d1/d41/l5f 0 2024-04-20T10:54:36.601 INFO:tasks.workunit.client.0.smithi090.stdout:9/202: dwrite d0/da/f3f [0,4194304] 0 2024-04-20T10:54:36.602 INFO:tasks.workunit.client.0.smithi090.stdout:7/133: dwrite f1 [0,4194304] 0 2024-04-20T10:54:36.602 INFO:tasks.workunit.client.0.smithi090.stdout:7/134: truncate f6 4660083 0 2024-04-20T10:54:36.602 INFO:tasks.workunit.client.0.smithi090.stdout:9/203: readlink d0/l38 0 2024-04-20T10:54:36.602 INFO:tasks.workunit.client.0.smithi090.stdout:5/300: rename d1/d2a/f49 to d1/d2a/f60 0 2024-04-20T10:54:36.605 INFO:tasks.workunit.client.0.smithi090.stdout:7/135: creat d11/d13/d22/d24/f2e x:0 0 0 2024-04-20T10:54:36.606 INFO:tasks.workunit.client.0.smithi090.stdout:9/204: mkdir d0/da/d1f/d34/d42 0 2024-04-20T10:54:36.606 INFO:tasks.workunit.client.0.smithi090.stdout:9/205: truncate d0/da/d1c/f3e 360991 0 2024-04-20T10:54:36.606 INFO:tasks.workunit.client.0.smithi090.stdout:4/115: dwrite d7/f1d [0,4194304] 0 2024-04-20T10:54:36.607 INFO:tasks.workunit.client.0.smithi090.stdout:4/116: readlink d7/d9/l14 0 2024-04-20T10:54:36.607 INFO:tasks.workunit.client.0.smithi090.stdout:4/117: write d7/d9/fa [1157473,9489] 0 2024-04-20T10:54:36.607 INFO:tasks.workunit.client.0.smithi090.stdout:1/100: dwrite d8/d1a/d1d/f24 [0,4194304] 0 2024-04-20T10:54:36.608 INFO:tasks.workunit.client.0.smithi090.stdout:8/181: dwrite d0/f1c [4194304,4194304] 0 2024-04-20T10:54:36.609 INFO:tasks.workunit.client.0.smithi090.stdout:4/118: rmdir d7/d9 39 2024-04-20T10:54:36.611 INFO:tasks.workunit.client.0.smithi090.stdout:2/199: dwrite d11/f31 [0,4194304] 0 2024-04-20T10:54:36.613 INFO:tasks.workunit.client.0.smithi090.stdout:0/100: dwrite d14/f21 [0,4194304] 0 2024-04-20T10:54:36.613 INFO:tasks.workunit.client.0.smithi090.stdout:3/122: dwrite d7/d15/f23 [0,4194304] 0 2024-04-20T10:54:36.613 INFO:tasks.workunit.client.0.smithi090.stdout:3/123: write d7/d15/f25 [38701,11023] 0 2024-04-20T10:54:36.614 INFO:tasks.workunit.client.0.smithi090.stdout:1/101: mknod d8/d19/c25 0 2024-04-20T10:54:36.614 INFO:tasks.workunit.client.0.smithi090.stdout:1/102: write d8/f12 [691674,67085] 0 2024-04-20T10:54:36.621 INFO:tasks.workunit.client.0.smithi090.stdout:5/301: dwrite d1/de/f57 [0,4194304] 0 2024-04-20T10:54:36.621 INFO:tasks.workunit.client.0.smithi090.stdout:8/182: unlink d0/c1f 0 2024-04-20T10:54:36.626 INFO:tasks.workunit.client.0.smithi090.stdout:2/200: mknod d11/d1f/c45 0 2024-04-20T10:54:36.626 INFO:tasks.workunit.client.0.smithi090.stdout:0/101: write fb [2934025,54951] 0 2024-04-20T10:54:36.629 INFO:tasks.workunit.client.0.smithi090.stdout:1/103: mknod d8/d19/c26 0 2024-04-20T10:54:36.629 INFO:tasks.workunit.client.0.smithi090.stdout:1/104: fdatasync d8/f11 0 2024-04-20T10:54:36.630 INFO:tasks.workunit.client.0.smithi090.stdout:1/105: dread d8/fe [0,4194304] 0 2024-04-20T10:54:36.630 INFO:tasks.workunit.client.0.smithi090.stdout:2/201: dread fd [0,4194304] 0 2024-04-20T10:54:36.630 INFO:tasks.workunit.client.0.smithi090.stdout:2/202: chown d11/d1a/d2b/l43 1643 1 2024-04-20T10:54:36.630 INFO:tasks.workunit.client.0.smithi090.stdout:2/203: fdatasync d11/f19 0 2024-04-20T10:54:36.631 INFO:tasks.workunit.client.0.smithi090.stdout:5/302: getdents d1/da/d14/d47 0 2024-04-20T10:54:36.632 INFO:tasks.workunit.client.0.smithi090.stdout:8/183: mknod d0/d11/c33 0 2024-04-20T10:54:36.632 INFO:tasks.workunit.client.0.smithi090.stdout:9/206: dwrite d0/f4 [0,4194304] 0 2024-04-20T10:54:36.632 INFO:tasks.workunit.client.0.smithi090.stdout:7/136: dwrite d11/d13/d23/f2b [4194304,4194304] 0 2024-04-20T10:54:36.633 INFO:tasks.workunit.client.0.smithi090.stdout:1/106: creat d8/d1a/d1d/f27 x:0 0 0 2024-04-20T10:54:36.634 INFO:tasks.workunit.client.0.smithi090.stdout:2/204: mknod d11/d1a/d37/c46 0 2024-04-20T10:54:36.634 INFO:tasks.workunit.client.0.smithi090.stdout:5/303: getdents d1/d2f/d3d 0 2024-04-20T10:54:36.636 INFO:tasks.workunit.client.0.smithi090.stdout:7/137: mkdir d11/d1a/d2f 0 2024-04-20T10:54:36.637 INFO:tasks.workunit.client.0.smithi090.stdout:3/124: dwrite d7/fd [0,4194304] 0 2024-04-20T10:54:36.638 INFO:tasks.workunit.client.0.smithi090.stdout:9/207: creat d0/da/d1f/d34/f43 x:0 0 0 2024-04-20T10:54:36.639 INFO:tasks.workunit.client.0.smithi090.stdout:0/102: rename c12 to d14/d19/c24 0 2024-04-20T10:54:36.640 INFO:tasks.workunit.client.0.smithi090.stdout:2/205: rmdir d11/d1a/d37 39 2024-04-20T10:54:36.640 INFO:tasks.workunit.client.0.smithi090.stdout:2/206: read - d11/d1a/d30/f42 zero size 2024-04-20T10:54:36.642 INFO:tasks.workunit.client.0.smithi090.stdout:5/304: write d1/d2f/d3d/d40/d4a/f4f [2376386,37422] 0 2024-04-20T10:54:36.642 INFO:tasks.workunit.client.0.smithi090.stdout:5/305: truncate d1/f58 486419 0 2024-04-20T10:54:36.643 INFO:tasks.workunit.client.0.smithi090.stdout:7/138: link l7 d11/d13/l30 0 2024-04-20T10:54:36.644 INFO:tasks.workunit.client.0.smithi090.stdout:9/208: rename d0/c12 to d0/da/d1f/c44 0 2024-04-20T10:54:36.644 INFO:tasks.workunit.client.0.smithi090.stdout:9/209: write d0/da/d1c/f3e [397932,45576] 0 2024-04-20T10:54:36.645 INFO:tasks.workunit.client.0.smithi090.stdout:0/103: creat d14/d19/f25 x:0 0 0 2024-04-20T10:54:36.645 INFO:tasks.workunit.client.0.smithi090.stdout:0/104: stat d14/c20 0 2024-04-20T10:54:36.647 INFO:tasks.workunit.client.0.smithi090.stdout:2/207: creat d11/d1a/d2b/f47 x:0 0 0 2024-04-20T10:54:36.647 INFO:tasks.workunit.client.0.smithi090.stdout:2/208: chown d11/f15 3 1 2024-04-20T10:54:36.647 INFO:tasks.workunit.client.0.smithi090.stdout:0/105: write fa [388087,129703] 0 2024-04-20T10:54:36.648 INFO:tasks.workunit.client.0.smithi090.stdout:5/306: unlink d1/l3b 0 2024-04-20T10:54:36.649 INFO:tasks.workunit.client.0.smithi090.stdout:8/184: truncate d0/f8 5809615 0 2024-04-20T10:54:36.651 INFO:tasks.workunit.client.0.smithi090.stdout:3/125: write d7/fd [1861311,79012] 0 2024-04-20T10:54:36.651 INFO:tasks.workunit.client.0.smithi090.stdout:3/126: readlink d7/l1a 0 2024-04-20T10:54:36.651 INFO:tasks.workunit.client.0.smithi090.stdout:3/127: readlink d7/l12 0 2024-04-20T10:54:36.651 INFO:tasks.workunit.client.0.smithi090.stdout:7/139: link d11/d13/l17 d11/d13/d22/d27/l31 0 2024-04-20T10:54:36.654 INFO:tasks.workunit.client.0.smithi090.stdout:9/210: mknod d0/da/c45 0 2024-04-20T10:54:36.655 INFO:tasks.workunit.client.0.smithi090.stdout:1/107: dwrite f6 [4194304,4194304] 0 2024-04-20T10:54:36.655 INFO:tasks.workunit.client.0.smithi090.stdout:1/108: write d8/f16 [797165,15520] 0 2024-04-20T10:54:36.655 INFO:tasks.workunit.client.0.smithi090.stdout:1/109: fsync f6 0 2024-04-20T10:54:36.655 INFO:tasks.workunit.client.0.smithi090.stdout:2/209: creat d11/d1a/d30/f48 x:0 0 0 2024-04-20T10:54:36.655 INFO:tasks.workunit.client.0.smithi090.stdout:2/210: stat d11 0 2024-04-20T10:54:36.655 INFO:tasks.workunit.client.0.smithi090.stdout:2/211: truncate d11/d1a/f2d 427053 0 2024-04-20T10:54:36.655 INFO:tasks.workunit.client.0.smithi090.stdout:2/212: fdatasync d11/d1a/d37/f44 0 2024-04-20T10:54:36.656 INFO:tasks.workunit.client.0.smithi090.stdout:2/213: chown fa 90735 1 2024-04-20T10:54:36.657 INFO:tasks.workunit.client.0.smithi090.stdout:0/106: truncate d14/f16 3251208 0 2024-04-20T10:54:36.659 INFO:tasks.workunit.client.0.smithi090.stdout:3/128: rmdir d7/d22 0 2024-04-20T10:54:36.661 INFO:tasks.workunit.client.0.smithi090.stdout:8/185: dread d0/d11/f1b [0,4194304] 0 2024-04-20T10:54:36.661 INFO:tasks.workunit.client.0.smithi090.stdout:7/140: unlink d11/l20 0 2024-04-20T10:54:36.661 INFO:tasks.workunit.client.0.smithi090.stdout:2/214: dread d11/f19 [0,4194304] 0 2024-04-20T10:54:36.664 INFO:tasks.workunit.client.0.smithi090.stdout:1/110: mkdir d8/d1a/d1d/d28 0 2024-04-20T10:54:36.664 INFO:tasks.workunit.client.0.smithi090.stdout:1/111: truncate d8/f1f 30228 0 2024-04-20T10:54:36.665 INFO:tasks.workunit.client.0.smithi090.stdout:0/107: mknod d14/c26 0 2024-04-20T10:54:36.666 INFO:tasks.workunit.client.0.smithi090.stdout:0/108: fdatasync d14/f18 0 2024-04-20T10:54:36.667 INFO:tasks.workunit.client.0.smithi090.stdout:9/211: write d0/da/f3f [2109869,72352] 0 2024-04-20T10:54:36.667 INFO:tasks.workunit.client.0.smithi090.stdout:3/129: getdents d7/d15 0 2024-04-20T10:54:36.668 INFO:tasks.workunit.client.0.smithi090.stdout:3/130: write d7/d11/f1c [113252,103293] 0 2024-04-20T10:54:36.669 INFO:tasks.workunit.client.0.smithi090.stdout:7/141: dread f10 [0,4194304] 0 2024-04-20T10:54:36.670 INFO:tasks.workunit.client.0.smithi090.stdout:7/142: chown d11/f16 0 1 2024-04-20T10:54:36.670 INFO:tasks.workunit.client.0.smithi090.stdout:5/307: dwrite d1/de/f57 [0,4194304] 0 2024-04-20T10:54:36.670 INFO:tasks.workunit.client.0.smithi090.stdout:0/109: mknod d14/d19/c27 0 2024-04-20T10:54:36.670 INFO:tasks.workunit.client.0.smithi090.stdout:0/110: chown d14/f1e 102 1 2024-04-20T10:54:36.673 INFO:tasks.workunit.client.0.smithi090.stdout:9/212: mknod d0/d29/d36/c46 0 2024-04-20T10:54:36.674 INFO:tasks.workunit.client.0.smithi090.stdout:3/131: creat d7/df/f27 x:0 0 0 2024-04-20T10:54:36.678 INFO:tasks.workunit.client.0.smithi090.stdout:8/186: dwrite d0/f17 [0,4194304] 0 2024-04-20T10:54:36.682 INFO:tasks.workunit.client.0.smithi090.stdout:5/308: symlink d1/da/d14/d47/d39/l61 0 2024-04-20T10:54:36.682 INFO:tasks.workunit.client.0.smithi090.stdout:9/213: rename d0/da/db/c33 to d0/da/db/c47 0 2024-04-20T10:54:36.683 INFO:tasks.workunit.client.0.smithi090.stdout:3/132: creat d7/d26/f28 x:0 0 0 2024-04-20T10:54:36.684 INFO:tasks.workunit.client.0.smithi090.stdout:8/187: creat d0/d11/d22/f34 x:0 0 0 2024-04-20T10:54:36.685 INFO:tasks.workunit.client.0.smithi090.stdout:5/309: creat d1/f62 x:0 0 0 2024-04-20T10:54:36.686 INFO:tasks.workunit.client.0.smithi090.stdout:8/188: getdents d0 0 2024-04-20T10:54:36.686 INFO:tasks.workunit.client.0.smithi090.stdout:8/189: dread - d0/f20 zero size 2024-04-20T10:54:36.687 INFO:tasks.workunit.client.0.smithi090.stdout:8/190: fdatasync d0/f20 0 2024-04-20T10:54:36.687 INFO:tasks.workunit.client.0.smithi090.stdout:5/310: symlink d1/d41/l63 0 2024-04-20T10:54:36.688 INFO:tasks.workunit.client.0.smithi090.stdout:8/191: symlink d0/d11/d14/l35 0 2024-04-20T10:54:36.690 INFO:tasks.workunit.client.0.smithi090.stdout:5/311: link d1/f7 d1/d2f/d3d/d40/d4a/f64 0 2024-04-20T10:54:36.690 INFO:tasks.workunit.client.0.smithi090.stdout:5/312: readlink d1/d2f/l42 0 2024-04-20T10:54:36.691 INFO:tasks.workunit.client.0.smithi090.stdout:8/192: unlink d0/d11/c33 0 2024-04-20T10:54:36.692 INFO:tasks.workunit.client.0.smithi090.stdout:5/313: symlink d1/d55/l65 0 2024-04-20T10:54:36.692 INFO:tasks.workunit.client.0.smithi090.stdout:5/314: write d1/da/d1f/f25 [3504894,98112] 0 2024-04-20T10:54:36.693 INFO:tasks.workunit.client.0.smithi090.stdout:8/193: creat d0/f36 x:0 0 0 2024-04-20T10:54:36.694 INFO:tasks.workunit.client.0.smithi090.stdout:5/315: creat d1/f66 x:0 0 0 2024-04-20T10:54:36.694 INFO:tasks.workunit.client.0.smithi090.stdout:5/316: getdents d1/da/d16 0 2024-04-20T10:54:36.694 INFO:tasks.workunit.client.0.smithi090.stdout:8/194: rmdir d0/d11/d14 39 2024-04-20T10:54:36.694 INFO:tasks.workunit.client.0.smithi090.stdout:8/195: chown d0/f17 120943827 1 2024-04-20T10:54:36.695 INFO:tasks.workunit.client.0.smithi090.stdout:5/317: mknod d1/da/c67 0 2024-04-20T10:54:36.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/318: dread - d1/d2a/f60 zero size 2024-04-20T10:54:36.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/319: write d1/d2a/f60 [328348,71960] 0 2024-04-20T10:54:36.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/320: truncate d1/d2f/d3d/f5b 646712 0 2024-04-20T10:54:36.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/321: dread - d1/d2f/f37 zero size 2024-04-20T10:54:36.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/322: write d1/f62 [828106,12010] 0 2024-04-20T10:54:36.696 INFO:tasks.workunit.client.0.smithi090.stdout:8/196: symlink d0/d11/l37 0 2024-04-20T10:54:36.696 INFO:tasks.workunit.client.0.smithi090.stdout:8/197: mknod d0/d11/d14/c38 0 2024-04-20T10:54:36.697 INFO:tasks.workunit.client.0.smithi090.stdout:8/198: creat d0/d26/f39 x:0 0 0 2024-04-20T10:54:36.697 INFO:tasks.workunit.client.0.smithi090.stdout:8/199: dread - d0/f36 zero size 2024-04-20T10:54:36.697 INFO:tasks.workunit.client.0.smithi090.stdout:8/200: rmdir d0/d2d 39 2024-04-20T10:54:36.698 INFO:tasks.workunit.client.0.smithi090.stdout:7/143: dwrite d11/f1e [0,4194304] 0 2024-04-20T10:54:36.698 INFO:tasks.workunit.client.0.smithi090.stdout:5/323: dread d1/d2f/d3d/f5b [0,4194304] 0 2024-04-20T10:54:36.700 INFO:tasks.workunit.client.0.smithi090.stdout:0/111: dwrite d14/f22 [0,4194304] 0 2024-04-20T10:54:36.702 INFO:tasks.workunit.client.0.smithi090.stdout:7/144: rename d11/d13/d22/d27/f2d to d11/d13/d22/d27/f32 0 2024-04-20T10:54:36.702 INFO:tasks.workunit.client.0.smithi090.stdout:7/145: write f1 [4979632,56393] 0 2024-04-20T10:54:36.703 INFO:tasks.workunit.client.0.smithi090.stdout:3/133: dwrite d7/fd [4194304,4194304] 0 2024-04-20T10:54:36.703 INFO:tasks.workunit.client.0.smithi090.stdout:3/134: dread - d7/df/f27 zero size 2024-04-20T10:54:36.710 INFO:tasks.workunit.client.0.smithi090.stdout:9/214: dread d0/da/f3f [0,4194304] 0 2024-04-20T10:54:36.710 INFO:tasks.workunit.client.0.smithi090.stdout:1/112: dwrite d8/f12 [0,4194304] 0 2024-04-20T10:54:36.710 INFO:tasks.workunit.client.0.smithi090.stdout:1/113: write d8/d19/f23 [868469,59059] 0 2024-04-20T10:54:36.710 INFO:tasks.workunit.client.0.smithi090.stdout:1/114: chown d8/c21 1007465 1 2024-04-20T10:54:36.711 INFO:tasks.workunit.client.0.smithi090.stdout:3/135: symlink d7/d11/l29 0 2024-04-20T10:54:36.712 INFO:tasks.workunit.client.0.smithi090.stdout:0/112: dread d14/f22 [0,4194304] 0 2024-04-20T10:54:36.721 INFO:tasks.workunit.client.0.smithi090.stdout:8/201: dwrite d0/d11/d22/f23 [0,4194304] 0 2024-04-20T10:54:36.721 INFO:tasks.workunit.client.0.smithi090.stdout:8/202: write d0/f9 [4499228,106871] 0 2024-04-20T10:54:36.721 INFO:tasks.workunit.client.0.smithi090.stdout:8/203: write d0/f12 [3642421,73831] 0 2024-04-20T10:54:36.721 INFO:tasks.workunit.client.0.smithi090.stdout:8/204: write d0/d11/f1a [5069730,23007] 0 2024-04-20T10:54:36.722 INFO:tasks.workunit.client.0.smithi090.stdout:7/146: write f9 [2180734,96461] 0 2024-04-20T10:54:36.736 INFO:tasks.workunit.client.0.smithi090.stdout:1/115: dwrite d8/fb [0,4194304] 0 2024-04-20T10:54:36.737 INFO:tasks.workunit.client.0.smithi090.stdout:3/136: dwrite d7/d11/f1c [0,4194304] 0 2024-04-20T10:54:36.737 INFO:tasks.workunit.client.0.smithi090.stdout:3/137: write d7/fa [1934754,130054] 0 2024-04-20T10:54:36.746 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:36.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.844+0000 7f5b4d3bd640 1 Processor -- start 2024-04-20T10:54:36.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.844+0000 7f5b4d3bd640 1 -- start start 2024-04-20T10:54:36.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b4d3bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 0x7f5b481568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b4d3bd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b480c9ee0 0x7f5b48156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b4d3bd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b4815a720 con 0x7f5b48153ef0 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b4d3bd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5b4815ac80 con 0x7f5b480c9ee0 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b4d3bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b4815a9a0 con 0x7f5b480ab730 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b46ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5b48153ef0 0x7f5b480c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56398/0 (socket says 172.21.15.90:56398) 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b46ffd640 1 -- 172.21.15.90:0/937743432 learned_addr learned my addr 172.21.15.90:0/937743432 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b477fe640 1 --2- 172.21.15.90:0/937743432 >> v2:172.21.15.175:3300/0 conn(0x7f5b480c9ee0 0x7f5b48156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b467fc640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 0x7f5b481568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964175316 0 0) 0x7f5b40001490 con 0x7f5b48153ef0 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b30003520 con 0x7f5b48153ef0 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 628893580 0 0) 0x7f5b30003520 con 0x7f5b48153ef0 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 msgr2=0x7f5b481568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:36.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 0x7f5b481568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 >> v2:172.21.15.175:3300/0 conn(0x7f5b480c9ee0 msgr2=0x7f5b48156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 --2- 172.21.15.90:0/937743432 >> v2:172.21.15.175:3300/0 conn(0x7f5b480c9ee0 0x7f5b48156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b480c6a90 con 0x7f5b48153ef0 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.845+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f5b40001be0 con 0x7f5b48153ef0 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 >> v1:172.21.15.90:6789/0 conn(0x7f5b48153ef0 legacy=0x7f5b480c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b45ffb640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 0x7f5b300039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b45ffb640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30003f30 0x7f5b30004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b45ffb640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30004d40 0x7f5b300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4815ac80 con 0x7f5b30003f30 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b4815a9a0 con 0x7f5b30004d40 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3000baa0 con 0x7f5b480ab730 2024-04-20T10:54:36.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b467fc640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30003f30 0x7f5b30004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b46ffd640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 0x7f5b300039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b477fe640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30004d40 0x7f5b300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b467fc640 1 -- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 msgr2=0x7f5b300039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b467fc640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480ab730 0x7f5b300039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b467fc640 1 -- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30004d40 msgr2=0x7f5b300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b467fc640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30004d40 0x7f5b300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.846+0000 7f5b467fc640 1 -- 172.21.15.90:0/937743432 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b30003520 con 0x7f5b30003f30 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b467fc640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30003f30 0x7f5b30004800 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009a90 tx=0x7f5b30005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74231cc909e2ec79 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c039070 con 0x7f5b30003f30 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3c02c680 con 0x7f5b30003f30 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b45ffb640 1 -- 172.21.15.90:0/937743432 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c009690 con 0x7f5b30003f30 2024-04-20T10:54:36.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/937743432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30003f30 msgr2=0x7f5b30004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b4d3bd640 1 --2- 172.21.15.90:0/937743432 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b30003f30 0x7f5b30004800 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c009a90 tx=0x7f5b30005830 comp rx=0 tx=0).stop 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b477fe640 1 -- 172.21.15.90:0/937743432 reap_dead start 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/937743432 shutdown_connections 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/937743432 >> 172.21.15.90:0/937743432 conn(0x7f5b480cbfe0 msgr2=0x7f5b480cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/937743432 shutdown_connections 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.847+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/937743432 wait complete. 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 Processor -- start 2024-04-20T10:54:36.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 -- start start 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30003f30 0x7f5b48155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b48155f50 0x7f5b48150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480c30b0 0x7f5b48150cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b480c9280 con 0x7f5b48155f50 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b480c9100 con 0x7f5b30003f30 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b4d3bd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b480bf800 con 0x7f5b480c30b0 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b467fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b48155f50 0x7f5b48150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b467fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b48155f50 0x7f5b48150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48548/0 (socket says 172.21.15.90:48548) 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b467fc640 1 -- 172.21.15.90:0/3353135926 learned_addr learned my addr 172.21.15.90:0/3353135926 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b46ffd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30003f30 0x7f5b48155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.849+0000 7f5b477fe640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480c30b0 0x7f5b48150cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b467fc640 1 -- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480c30b0 msgr2=0x7f5b48150cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b467fc640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480c30b0 0x7f5b48150cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:36.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b467fc640 1 -- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30003f30 msgr2=0x7f5b48155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b467fc640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30003f30 0x7f5b48155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b467fc640 1 -- 172.21.15.90:0/3353135926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b481ece10 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b467fc640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b48155f50 0x7f5b48150770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c000c00 tx=0x7f5b3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b2f7fe640 1 -- 172.21.15.90:0/3353135926 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c042020 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b2f7fe640 1 -- 172.21.15.90:0/3353135926 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b3c03a040 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b48151660 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b2f7fe640 1 -- 172.21.15.90:0/3353135926 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b3c039070 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.850+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b480b1ac0 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.851+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b48076150 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.851+0000 7f5b2f7fe640 1 -- 172.21.15.90:0/3353135926 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b3c045020 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.852+0000 7f5b2f7fe640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b3406c8f0 0x7f5b3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.852+0000 7f5b2f7fe640 1 -- 172.21.15.90:0/3353135926 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f5b3c0ad260 con 0x7f5b48155f50 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.852+0000 7f5b46ffd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b3406c8f0 0x7f5b3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:36.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.852+0000 7f5b46ffd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b3406c8f0 0x7f5b3406edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cc7c0 tx=0x7f5b40006040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:36.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:36.856+0000 7f5b2f7fe640 1 -- 172.21.15.90:0/3353135926 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5b3c04c070 con 0x7f5b48155f50 2024-04-20T10:54:36.974 INFO:tasks.workunit.client.0.smithi090.stdout:0/113: getdents d14 0 2024-04-20T10:54:36.976 INFO:tasks.workunit.client.0.smithi090.stdout:8/205: mkdir d0/d3a 0 2024-04-20T10:54:36.976 INFO:tasks.workunit.client.0.smithi090.stdout:8/206: fsync d0/f12 0 2024-04-20T10:54:36.976 INFO:tasks.workunit.client.0.smithi090.stdout:7/147: getdents d11/d13/d23 0 2024-04-20T10:54:36.976 INFO:tasks.workunit.client.0.smithi090.stdout:7/148: stat d11/d13/d22 0 2024-04-20T10:54:36.978 INFO:tasks.workunit.client.0.smithi090.stdout:1/116: creat d8/d19/f29 x:0 0 0 2024-04-20T10:54:36.978 INFO:tasks.workunit.client.0.smithi090.stdout:1/117: stat d8/d19/f23 0 2024-04-20T10:54:36.979 INFO:tasks.workunit.client.0.smithi090.stdout:3/138: mkdir d7/d15/d2a 0 2024-04-20T10:54:36.982 INFO:tasks.workunit.client.0.smithi090.stdout:0/114: stat c7 0 2024-04-20T10:54:36.982 INFO:tasks.workunit.client.0.smithi090.stdout:0/115: chown d14/d19/f25 120067987 1 2024-04-20T10:54:36.982 INFO:tasks.workunit.client.0.smithi090.stdout:7/149: getdents d11 0 2024-04-20T10:54:36.982 INFO:tasks.workunit.client.0.smithi090.stdout:6/133: sync 2024-04-20T10:54:36.983 INFO:tasks.workunit.client.0.smithi090.stdout:0/116: mknod d14/c28 0 2024-04-20T10:54:36.987 INFO:tasks.workunit.client.0.smithi090.stdout:0/117: dread d14/f1f [0,4194304] 0 2024-04-20T10:54:36.996 INFO:tasks.workunit.client.0.smithi090.stdout:6/134: read d1/d4/d26/d11/f17 [2076938,60201] 0 2024-04-20T10:54:36.997 INFO:tasks.workunit.client.0.smithi090.stdout:8/207: dwrite d0/f2e [0,4194304] 0 2024-04-20T10:54:36.997 INFO:tasks.workunit.client.0.smithi090.stdout:8/208: fsync d0/d11/f31 0 2024-04-20T10:54:37.002 INFO:tasks.workunit.client.0.smithi090.stdout:1/118: dwrite f6 [4194304,4194304] 0 2024-04-20T10:54:37.003 INFO:tasks.workunit.client.0.smithi090.stdout:8/209: dread d0/fe [0,4194304] 0 2024-04-20T10:54:37.003 INFO:tasks.workunit.client.0.smithi090.stdout:8/210: truncate d0/d11/f31 576078 0 2024-04-20T10:54:37.005 INFO:tasks.workunit.client.0.smithi090.stdout:7/150: dwrite d11/d1a/f1b [0,4194304] 0 2024-04-20T10:54:37.010 INFO:tasks.workunit.client.0.smithi090.stdout:6/135: creat d1/d4/f30 x:0 0 0 2024-04-20T10:54:37.010 INFO:tasks.workunit.client.0.smithi090.stdout:6/136: chown d1/d10/d13/d28 97124 1 2024-04-20T10:54:37.010 INFO:tasks.workunit.client.0.smithi090.stdout:6/137: read - d1/d10/d13/d1e/f20 zero size 2024-04-20T10:54:37.011 INFO:tasks.workunit.client.0.smithi090.stdout:6/138: stat d1/d4/c12 0 2024-04-20T10:54:37.014 INFO:tasks.workunit.client.0.smithi090.stdout:7/151: dread d11/f1e [0,4194304] 0 2024-04-20T10:54:37.014 INFO:tasks.workunit.client.0.smithi090.stdout:7/152: stat f6 0 2024-04-20T10:54:37.014 INFO:tasks.workunit.client.0.smithi090.stdout:7/153: fsync d11/d13/f1d 0 2024-04-20T10:54:37.014 INFO:tasks.workunit.client.0.smithi090.stdout:1/119: creat d8/f2a x:0 0 0 2024-04-20T10:54:37.016 INFO:tasks.workunit.client.0.smithi090.stdout:0/118: dread f13 [0,4194304] 0 2024-04-20T10:54:37.016 INFO:tasks.workunit.client.0.smithi090.stdout:8/211: rename d0/l2a to d0/d3a/l3b 0 2024-04-20T10:54:37.016 INFO:tasks.workunit.client.0.smithi090.stdout:8/212: write d0/d11/f1a [1808262,57754] 0 2024-04-20T10:54:37.016 INFO:tasks.workunit.client.0.smithi090.stdout:9/215: sync 2024-04-20T10:54:37.017 INFO:tasks.workunit.client.0.smithi090.stdout:2/215: sync 2024-04-20T10:54:37.017 INFO:tasks.workunit.client.0.smithi090.stdout:4/119: sync 2024-04-20T10:54:37.017 INFO:tasks.workunit.client.0.smithi090.stdout:5/324: sync 2024-04-20T10:54:37.017 INFO:tasks.workunit.client.0.smithi090.stdout:9/216: dread - d0/da/f18 zero size 2024-04-20T10:54:37.017 INFO:tasks.workunit.client.0.smithi090.stdout:4/120: fdatasync f2 0 2024-04-20T10:54:37.017 INFO:tasks.workunit.client.0.smithi090.stdout:9/217: fdatasync d0/f37 0 2024-04-20T10:54:37.017 INFO:tasks.workunit.client.0.smithi090.stdout:9/218: chown d0/c16 6 1 2024-04-20T10:54:37.018 INFO:tasks.workunit.client.0.smithi090.stdout:6/139: mknod d1/d10/c31 0 2024-04-20T10:54:37.019 INFO:tasks.workunit.client.0.smithi090.stdout:7/154: mkdir d11/d13/d33 0 2024-04-20T10:54:37.020 INFO:tasks.workunit.client.0.smithi090.stdout:1/120: mknod d8/d1a/d1d/d28/c2b 0 2024-04-20T10:54:37.023 INFO:tasks.workunit.client.0.smithi090.stdout:0/119: symlink d14/l29 0 2024-04-20T10:54:37.023 INFO:tasks.workunit.client.0.smithi090.stdout:0/120: chown d14/f17 0 1 2024-04-20T10:54:37.026 INFO:tasks.workunit.client.0.smithi090.stdout:8/213: rmdir d0/d3a 39 2024-04-20T10:54:37.026 INFO:tasks.workunit.client.0.smithi090.stdout:8/214: chown d0/d26/f39 13638275 1 2024-04-20T10:54:37.027 INFO:tasks.workunit.client.0.smithi090.stdout:4/121: creat d7/d9/f20 x:0 0 0 2024-04-20T10:54:37.027 INFO:tasks.workunit.client.0.smithi090.stdout:5/325: dread d1/d2f/d3d/f4d [0,4194304] 0 2024-04-20T10:54:37.028 INFO:tasks.workunit.client.0.smithi090.stdout:9/219: mknod d0/da/d30/c48 0 2024-04-20T10:54:37.029 INFO:tasks.workunit.client.0.smithi090.stdout:9/220: fdatasync d0/da/d1c/f2b 0 2024-04-20T10:54:37.030 INFO:tasks.workunit.client.0.smithi090.stdout:7/155: write d11/d13/d22/d27/f32 [8217228,60433] 0 2024-04-20T10:54:37.030 INFO:tasks.workunit.client.0.smithi090.stdout:6/140: creat d1/d10/d13/d28/f32 x:0 0 0 2024-04-20T10:54:37.031 INFO:tasks.workunit.client.0.smithi090.stdout:1/121: getdents d8/d1a/d1d 0 2024-04-20T10:54:37.033 INFO:tasks.workunit.client.0.smithi090.stdout:0/121: creat d14/f2a x:0 0 0 2024-04-20T10:54:37.034 INFO:tasks.workunit.client.0.smithi090.stdout:5/326: mknod d1/d55/c68 0 2024-04-20T10:54:37.036 INFO:tasks.workunit.client.0.smithi090.stdout:9/221: creat d0/da/d30/f49 x:0 0 0 2024-04-20T10:54:37.038 INFO:tasks.workunit.client.0.smithi090.stdout:3/139: dwrite d7/d11/f1c [4194304,4194304] 0 2024-04-20T10:54:37.038 INFO:tasks.workunit.client.0.smithi090.stdout:3/140: fdatasync d7/df/f27 0 2024-04-20T10:54:37.038 INFO:tasks.workunit.client.0.smithi090.stdout:7/156: rename d11/d13/d22/d27/f32 to d11/d13/d22/f34 0 2024-04-20T10:54:37.039 INFO:tasks.workunit.client.0.smithi090.stdout:8/215: write d0/f2e [1987316,44155] 0 2024-04-20T10:54:37.041 INFO:tasks.workunit.client.0.smithi090.stdout:6/141: mknod d1/d4/d26/c33 0 2024-04-20T10:54:37.041 INFO:tasks.workunit.client.0.smithi090.stdout:0/122: chown f9 25611526 1 2024-04-20T10:54:37.043 INFO:tasks.workunit.client.0.smithi090.stdout:5/327: mknod d1/d2f/d3d/c69 0 2024-04-20T10:54:37.049 INFO:tasks.workunit.client.0.smithi090.stdout:9/222: mknod d0/da/d1f/d35/c4a 0 2024-04-20T10:54:37.049 INFO:tasks.workunit.client.0.smithi090.stdout:9/223: truncate d0/da/d1c/f21 510649 0 2024-04-20T10:54:37.049 INFO:tasks.workunit.client.0.smithi090.stdout:7/157: mkdir d11/d13/d22/d24/d35 0 2024-04-20T10:54:37.049 INFO:tasks.workunit.client.0.smithi090.stdout:3/141: symlink d7/df/l2b 0 2024-04-20T10:54:37.049 INFO:tasks.workunit.client.0.smithi090.stdout:2/216: dwrite fd [0,4194304] 0 2024-04-20T10:54:37.054 INFO:tasks.workunit.client.0.smithi090.stdout:6/142: rename d1/d4/d26/fc to d1/d10/d13/d28/f34 0 2024-04-20T10:54:37.055 INFO:tasks.workunit.client.0.smithi090.stdout:7/158: symlink d11/d13/d33/l36 0 2024-04-20T10:54:37.055 INFO:tasks.workunit.client.0.smithi090.stdout:7/159: write f4 [4272010,8228] 0 2024-04-20T10:54:37.056 INFO:tasks.workunit.client.0.smithi090.stdout:4/122: dwrite d7/f12 [0,4194304] 0 2024-04-20T10:54:37.056 INFO:tasks.workunit.client.0.smithi090.stdout:3/142: mkdir d7/df/d2c 0 2024-04-20T10:54:37.059 INFO:tasks.workunit.client.0.smithi090.stdout:2/217: rename d11/c25 to d11/c49 0 2024-04-20T10:54:37.059 INFO:tasks.workunit.client.0.smithi090.stdout:2/218: readlink d11/d1a/d30/l3f 0 2024-04-20T10:54:37.059 INFO:tasks.workunit.client.0.smithi090.stdout:9/224: write d0/f9 [4548689,49917] 0 2024-04-20T10:54:37.059 INFO:tasks.workunit.client.0.smithi090.stdout:9/225: write d0/da/d1c/f3e [1289512,10892] 0 2024-04-20T10:54:37.060 INFO:tasks.workunit.client.0.smithi090.stdout:6/143: mkdir d1/d4/d26/d11/d35 0 2024-04-20T10:54:37.063 INFO:tasks.workunit.client.0.smithi090.stdout:4/123: getdents d7 0 2024-04-20T10:54:37.063 INFO:tasks.workunit.client.0.smithi090.stdout:4/124: chown d7/d9/f11 2340 1 2024-04-20T10:54:37.064 INFO:tasks.workunit.client.0.smithi090.stdout:3/143: symlink d7/d26/l2d 0 2024-04-20T10:54:37.064 INFO:tasks.workunit.client.0.smithi090.stdout:3/144: chown d7/d15/l1b 848582028 1 2024-04-20T10:54:37.065 INFO:tasks.workunit.client.0.smithi090.stdout:2/219: mkdir d11/d1a/d4a 0 2024-04-20T10:54:37.065 INFO:tasks.workunit.client.0.smithi090.stdout:5/328: dwrite d1/d2a/f3e [0,4194304] 0 2024-04-20T10:54:37.067 INFO:tasks.workunit.client.0.smithi090.stdout:2/220: creat d11/d1f/d2e/f4b x:0 0 0 2024-04-20T10:54:37.068 INFO:tasks.workunit.client.0.smithi090.stdout:0/123: dwrite d14/f2a [0,4194304] 0 2024-04-20T10:54:37.070 INFO:tasks.workunit.client.0.smithi090.stdout:4/125: dread d7/d9/f11 [0,4194304] 0 2024-04-20T10:54:37.070 INFO:tasks.workunit.client.0.smithi090.stdout:5/329: creat d1/d2f/d3d/f6a x:0 0 0 2024-04-20T10:54:37.078 INFO:tasks.workunit.client.0.smithi090.stdout:9/226: dread d0/da/f1b [0,4194304] 0 2024-04-20T10:54:37.079 INFO:tasks.workunit.client.0.smithi090.stdout:2/221: mknod d11/d1a/d30/c4c 0 2024-04-20T10:54:37.079 INFO:tasks.workunit.client.0.smithi090.stdout:0/124: dread d14/f22 [0,4194304] 0 2024-04-20T10:54:37.079 INFO:tasks.workunit.client.0.smithi090.stdout:8/216: dwrite d0/f2 [0,4194304] 0 2024-04-20T10:54:37.079 INFO:tasks.workunit.client.0.smithi090.stdout:8/217: chown d0/d11/f1a 8144024 1 2024-04-20T10:54:37.090 INFO:tasks.workunit.client.0.smithi090.stdout:9/227: rename d0/da/db/l3b to d0/da/d1f/d34/d42/l4b 0 2024-04-20T10:54:37.090 INFO:tasks.workunit.client.0.smithi090.stdout:2/222: dread d11/f28 [0,4194304] 0 2024-04-20T10:54:37.091 INFO:tasks.workunit.client.0.smithi090.stdout:0/125: getdents d14/d19 0 2024-04-20T10:54:37.091 INFO:tasks.workunit.client.0.smithi090.stdout:0/126: truncate d14/f17 645229 0 2024-04-20T10:54:37.093 INFO:tasks.workunit.client.0.smithi090.stdout:2/223: creat d11/d1f/d2e/f4d x:0 0 0 2024-04-20T10:54:37.093 INFO:tasks.workunit.client.0.smithi090.stdout:0/127: chown f3 959729202 1 2024-04-20T10:54:37.094 INFO:tasks.workunit.client.0.smithi090.stdout:0/128: mkdir d14/d19/d2b 0 2024-04-20T10:54:37.098 INFO:tasks.workunit.client.0.smithi090.stdout:0/129: dread f3 [0,4194304] 0 2024-04-20T10:54:37.099 INFO:tasks.workunit.client.0.smithi090.stdout:0/130: mkdir d14/d19/d2c 0 2024-04-20T10:54:37.101 INFO:tasks.workunit.client.0.smithi090.stdout:0/131: creat d14/d19/d2c/f2d x:0 0 0 2024-04-20T10:54:37.102 INFO:tasks.workunit.client.0.smithi090.stdout:4/126: dwrite d7/d9/f19 [0,4194304] 0 2024-04-20T10:54:37.103 INFO:tasks.workunit.client.0.smithi090.stdout:6/144: dwrite d1/d10/d13/d28/f34 [0,4194304] 0 2024-04-20T10:54:37.103 INFO:tasks.workunit.client.0.smithi090.stdout:6/145: truncate d1/d19/f2d 344818 0 2024-04-20T10:54:37.103 INFO:tasks.workunit.client.0.smithi090.stdout:6/146: getdents d1/d4/d26/d11/d35 0 2024-04-20T10:54:37.103 INFO:tasks.workunit.client.0.smithi090.stdout:7/160: dwrite f4 [0,4194304] 0 2024-04-20T10:54:37.104 INFO:tasks.workunit.client.0.smithi090.stdout:0/132: creat d14/f2e x:0 0 0 2024-04-20T10:54:37.105 INFO:tasks.workunit.client.0.smithi090.stdout:4/127: rmdir d7 39 2024-04-20T10:54:37.105 INFO:tasks.workunit.client.0.smithi090.stdout:3/145: dwrite d7/f19 [0,4194304] 0 2024-04-20T10:54:37.109 INFO:tasks.workunit.client.0.smithi090.stdout:0/133: link d14/c1a d14/d19/d2b/c2f 0 2024-04-20T10:54:37.112 INFO:tasks.workunit.client.0.smithi090.stdout:7/161: dread f4 [0,4194304] 0 2024-04-20T10:54:37.112 INFO:tasks.workunit.client.0.smithi090.stdout:7/162: chown d11/d13/l30 62 1 2024-04-20T10:54:37.113 INFO:tasks.workunit.client.0.smithi090.stdout:3/146: link d7/d15/f25 d7/d11/f2e 0 2024-04-20T10:54:37.114 INFO:tasks.workunit.client.0.smithi090.stdout:9/228: dwrite d0/da/d1f/d34/f43 [0,4194304] 0 2024-04-20T10:54:37.114 INFO:tasks.workunit.client.0.smithi090.stdout:9/229: dread - d0/da/f18 zero size 2024-04-20T10:54:37.114 INFO:tasks.workunit.client.0.smithi090.stdout:9/230: write d0/da/d1c/f21 [826811,40558] 0 2024-04-20T10:54:37.116 INFO:tasks.workunit.client.0.smithi090.stdout:3/147: creat d7/d11/f2f x:0 0 0 2024-04-20T10:54:37.116 INFO:tasks.workunit.client.0.smithi090.stdout:2/224: dwrite d11/d1a/d2b/f35 [0,4194304] 0 2024-04-20T10:54:37.121 INFO:tasks.workunit.client.0.smithi090.stdout:9/231: creat d0/da/d30/f4c x:0 0 0 2024-04-20T10:54:37.121 INFO:tasks.workunit.client.0.smithi090.stdout:9/232: write d0/da/d30/f4c [1040058,57202] 0 2024-04-20T10:54:37.122 INFO:tasks.workunit.client.0.smithi090.stdout:3/148: mkdir d7/d15/d2a/d30 0 2024-04-20T10:54:37.125 INFO:tasks.workunit.client.0.smithi090.stdout:9/233: mkdir d0/da/d1f/d4d 0 2024-04-20T10:54:37.129 INFO:tasks.workunit.client.0.smithi090.stdout:6/147: rename d1/d10/d13 to d1/d19/d36 0 2024-04-20T10:54:37.130 INFO:tasks.workunit.client.0.smithi090.stdout:6/148: readlink d1/d4/d26/l14 0 2024-04-20T10:54:37.130 INFO:tasks.workunit.client.0.smithi090.stdout:6/149: mknod d1/c37 0 2024-04-20T10:54:37.133 INFO:tasks.workunit.client.0.smithi090.stdout:2/225: rename d11/d1a/d2b/f47 to d11/d1a/d4a/f4e 0 2024-04-20T10:54:37.133 INFO:tasks.workunit.client.0.smithi090.stdout:2/226: chown fa 2641352 1 2024-04-20T10:54:37.135 INFO:tasks.workunit.client.0.smithi090.stdout:6/150: rename c0 to d1/d4/d26/c38 0 2024-04-20T10:54:37.136 INFO:tasks.workunit.client.0.smithi090.stdout:6/151: creat d1/d10/f39 x:0 0 0 2024-04-20T10:54:37.139 INFO:tasks.workunit.client.0.smithi090.stdout:4/128: dwrite f0 [4194304,4194304] 0 2024-04-20T10:54:37.141 INFO:tasks.workunit.client.0.smithi090.stdout:0/134: dwrite d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:37.141 INFO:tasks.workunit.client.0.smithi090.stdout:0/135: fdatasync f13 0 2024-04-20T10:54:37.141 INFO:tasks.workunit.client.0.smithi090.stdout:7/163: dwrite d11/f1e [0,4194304] 0 2024-04-20T10:54:37.144 INFO:tasks.workunit.client.0.smithi090.stdout:0/136: read d14/d19/f1c [2460481,58973] 0 2024-04-20T10:54:37.145 INFO:tasks.workunit.client.0.smithi090.stdout:7/164: rmdir d11/d13/d22/d24 39 2024-04-20T10:54:37.146 INFO:tasks.workunit.client.0.smithi090.stdout:9/234: dwrite d0/da/f13 [0,4194304] 0 2024-04-20T10:54:37.148 INFO:tasks.workunit.client.0.smithi090.stdout:0/137: unlink fb 0 2024-04-20T10:54:37.149 INFO:tasks.workunit.client.0.smithi090.stdout:7/165: link d11/c14 d11/d13/d33/c37 0 2024-04-20T10:54:37.149 INFO:tasks.workunit.client.0.smithi090.stdout:7/166: fsync d11/d13/d22/d24/f2a 0 2024-04-20T10:54:37.150 INFO:tasks.workunit.client.0.smithi090.stdout:6/152: write d1/f6 [1208759,67960] 0 2024-04-20T10:54:37.150 INFO:tasks.workunit.client.0.smithi090.stdout:3/149: dwrite d7/fa [8388608,4194304] 0 2024-04-20T10:54:37.150 INFO:tasks.workunit.client.0.smithi090.stdout:6/153: dread - d1/d10/f39 zero size 2024-04-20T10:54:37.151 INFO:tasks.workunit.client.0.smithi090.stdout:9/235: unlink d0/da/d30/f41 0 2024-04-20T10:54:37.151 INFO:tasks.workunit.client.0.smithi090.stdout:9/236: dread - d0/da/f18 zero size 2024-04-20T10:54:37.152 INFO:tasks.workunit.client.0.smithi090.stdout:0/138: creat d14/d19/d2b/f30 x:0 0 0 2024-04-20T10:54:37.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.153+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b48152680 con 0x7f5b48155f50 2024-04-20T10:54:37.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.153+0000 7f5b2f7fe640 1 -- 172.21.15.90:0/3353135926 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7f5b3c07b2e0 con 0x7f5b48155f50 2024-04-20T10:54:37.154 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:37.154 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:37.154 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:37.155 INFO:tasks.workunit.client.0.smithi090.stdout:3/150: truncate d7/d11/f2e 20962 0 2024-04-20T10:54:37.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.155+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b3406c8f0 msgr2=0x7f5b3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:37.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.155+0000 7f5b4d3bd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b3406c8f0 0x7f5b3406edb0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5b480cc7c0 tx=0x7f5b40006040 comp rx=0 tx=0).stop 2024-04-20T10:54:37.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b48155f50 msgr2=0x7f5b48150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:37.156 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b48155f50 0x7f5b48150770 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5b3c000c00 tx=0x7f5b3c004730 comp rx=0 tx=0).stop 2024-04-20T10:54:37.156 INFO:tasks.workunit.client.0.smithi090.stdout:9/237: rmdir d0/d29/d36 39 2024-04-20T10:54:37.156 INFO:tasks.workunit.client.0.smithi090.stdout:9/238: write d0/f9 [4417779,83495] 0 2024-04-20T10:54:37.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 shutdown_connections 2024-04-20T10:54:37.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b3406c8f0 0x7f5b3406edb0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:37.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b480c30b0 0x7f5b48150cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:37.157 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b48155f50 0x7f5b48150770 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:37.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 --2- 172.21.15.90:0/3353135926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b30003f30 0x7f5b48155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:37.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 >> 172.21.15.90:0/3353135926 conn(0x7f5b480cbfe0 msgr2=0x7f5b48152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:37.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 shutdown_connections 2024-04-20T10:54:37.158 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:37.156+0000 7f5b4d3bd640 1 -- 172.21.15.90:0/3353135926 wait complete. 2024-04-20T10:54:37.158 INFO:tasks.workunit.client.0.smithi090.stdout:0/139: mkdir d14/d19/d31 0 2024-04-20T10:54:37.158 INFO:tasks.workunit.client.0.smithi090.stdout:0/140: readlink d14/l29 0 2024-04-20T10:54:37.159 INFO:tasks.workunit.client.0.smithi090.stdout:6/154: write d1/fd [373800,15608] 0 2024-04-20T10:54:37.159 INFO:tasks.workunit.client.0.smithi090.stdout:6/155: read d1/d4/d26/d11/f17 [2908038,35075] 0 2024-04-20T10:54:37.160 INFO:tasks.workunit.client.0.smithi090.stdout:6/156: write d1/fd [672247,7065] 0 2024-04-20T10:54:37.160 INFO:tasks.workunit.client.0.smithi090.stdout:3/151: rename d7/d15/l1b to d7/d15/d2a/l31 0 2024-04-20T10:54:37.160 INFO:tasks.workunit.client.0.smithi090.stdout:3/152: creat d7/d11/f32 x:0 0 0 2024-04-20T10:54:37.161 INFO:tasks.workunit.client.0.smithi090.stdout:0/141: dread f3 [0,4194304] 0 2024-04-20T10:54:37.162 INFO:tasks.workunit.client.0.smithi090.stdout:0/142: rmdir d14/d19 39 2024-04-20T10:54:37.165 INFO:tasks.workunit.client.0.smithi090.stdout:9/239: dread d0/da/d1f/d34/f43 [0,4194304] 0 2024-04-20T10:54:37.167 INFO:tasks.workunit.client.0.smithi090.stdout:9/240: link d0/c16 d0/da/d1f/d34/d42/c4e 0 2024-04-20T10:54:37.167 INFO:tasks.workunit.client.0.smithi090.stdout:9/241: getdents d0/da/d1f/d4d 0 2024-04-20T10:54:37.173 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:37.178 INFO:tasks.workunit.client.0.smithi090.stdout:7/167: truncate d11/f1e 3039124 0 2024-04-20T10:54:37.178 INFO:tasks.workunit.client.0.smithi090.stdout:7/168: chown f10 189 1 2024-04-20T10:54:37.178 INFO:tasks.workunit.client.0.smithi090.stdout:7/169: getdents d11/d1a/d2f 0 2024-04-20T10:54:37.179 INFO:tasks.workunit.client.0.smithi090.stdout:7/170: creat d11/d13/d23/f38 x:0 0 0 2024-04-20T10:54:37.180 INFO:tasks.workunit.client.0.smithi090.stdout:7/171: symlink d11/d13/l39 0 2024-04-20T10:54:37.180 INFO:tasks.workunit.client.0.smithi090.stdout:7/172: truncate f4 5009654 0 2024-04-20T10:54:37.181 INFO:tasks.workunit.client.0.smithi090.stdout:7/173: creat d11/d13/d22/f3a x:0 0 0 2024-04-20T10:54:37.184 INFO:tasks.workunit.client.0.smithi090.stdout:7/174: mkdir d11/d1a/d3b 0 2024-04-20T10:54:37.185 INFO:tasks.workunit.client.0.smithi090.stdout:6/157: dwrite d1/d10/f39 [0,4194304] 0 2024-04-20T10:54:37.186 INFO:tasks.workunit.client.0.smithi090.stdout:3/153: truncate d7/d15/f25 448116 0 2024-04-20T10:54:37.188 INFO:tasks.workunit.client.0.smithi090.stdout:6/158: mkdir d1/d4/d3a 0 2024-04-20T10:54:37.189 INFO:tasks.workunit.client.0.smithi090.stdout:0/143: dwrite d14/f2e [0,4194304] 0 2024-04-20T10:54:37.189 INFO:tasks.workunit.client.0.smithi090.stdout:9/242: dwrite d0/f37 [0,4194304] 0 2024-04-20T10:54:37.190 INFO:tasks.workunit.client.0.smithi090.stdout:9/243: write d0/da/db/f10 [9170,31186] 0 2024-04-20T10:54:37.201 INFO:tasks.workunit.client.0.smithi090.stdout:3/154: dread d7/fa [8388608,4194304] 0 2024-04-20T10:54:37.447 INFO:tasks.workunit.client.0.smithi090.stdout:6/159: unlink d1/f23 0 2024-04-20T10:54:37.447 INFO:tasks.workunit.client.0.smithi090.stdout:9/244: rename d0/da/db to d0/d29/d4f 0 2024-04-20T10:54:37.447 INFO:tasks.workunit.client.0.smithi090.stdout:7/175: truncate f4 4349752 0 2024-04-20T10:54:37.447 INFO:tasks.workunit.client.0.smithi090.stdout:7/176: truncate d11/f16 511895 0 2024-04-20T10:54:37.448 INFO:tasks.workunit.client.0.smithi090.stdout:3/155: creat d7/d11/f33 x:0 0 0 2024-04-20T10:54:37.448 INFO:tasks.workunit.client.0.smithi090.stdout:3/156: fdatasync d7/df/f13 0 2024-04-20T10:54:37.463 INFO:tasks.workunit.client.0.smithi090.stdout:6/160: dwrite d1/d19/d36/d28/f32 [0,4194304] 0 2024-04-20T10:54:37.464 INFO:tasks.workunit.client.0.smithi090.stdout:6/161: chown d1/d4 232618 1 2024-04-20T10:54:37.479 INFO:tasks.workunit.client.0.smithi090.stdout:0/144: creat d14/f32 x:0 0 0 2024-04-20T10:54:37.479 INFO:tasks.workunit.client.0.smithi090.stdout:7/177: creat d11/d13/d22/d24/f3c x:0 0 0 2024-04-20T10:54:37.480 INFO:tasks.workunit.client.0.smithi090.stdout:7/178: dread - d11/d13/f1d zero size 2024-04-20T10:54:37.480 INFO:tasks.workunit.client.0.smithi090.stdout:6/162: dwrite d1/d19/d36/d28/f2a [0,4194304] 0 2024-04-20T10:54:37.481 INFO:tasks.workunit.client.0.smithi090.stdout:6/163: chown d1/d19/d36/f24 44371941 1 2024-04-20T10:54:37.481 INFO:tasks.workunit.client.0.smithi090.stdout:3/157: symlink d7/d26/l34 0 2024-04-20T10:54:37.481 INFO:tasks.workunit.client.0.smithi090.stdout:3/158: chown d7/d26/l34 856 1 2024-04-20T10:54:37.482 INFO:tasks.workunit.client.0.smithi090.stdout:0/145: write f9 [2372668,86248] 0 2024-04-20T10:54:37.482 INFO:tasks.workunit.client.0.smithi090.stdout:7/179: symlink d11/d1a/d3b/l3d 0 2024-04-20T10:54:37.483 INFO:tasks.workunit.client.0.smithi090.stdout:7/180: stat d11/d1a/c1f 0 2024-04-20T10:54:37.484 INFO:tasks.workunit.client.0.smithi090.stdout:6/164: rename d1/d19/d36/d28/f32 to d1/d19/d36/d28/f3b 0 2024-04-20T10:54:37.485 INFO:tasks.workunit.client.0.smithi090.stdout:0/146: mknod d14/d19/c33 0 2024-04-20T10:54:37.485 INFO:tasks.workunit.client.0.smithi090.stdout:0/147: chown d14/f17 10993 1 2024-04-20T10:54:37.487 INFO:tasks.workunit.client.0.smithi090.stdout:7/181: creat d11/d1a/d2f/f3e x:0 0 0 2024-04-20T10:54:37.487 INFO:tasks.workunit.client.0.smithi090.stdout:7/182: stat d11/d1a/d3b 0 2024-04-20T10:54:37.487 INFO:tasks.workunit.client.0.smithi090.stdout:7/183: write d11/d13/d22/d24/f3c [567705,60495] 0 2024-04-20T10:54:37.487 INFO:tasks.workunit.client.0.smithi090.stdout:7/184: stat d11/d13/d22/d24/f3c 0 2024-04-20T10:54:37.487 INFO:tasks.workunit.client.0.smithi090.stdout:7/185: dread - d11/d13/d23/f26 zero size 2024-04-20T10:54:37.489 INFO:tasks.workunit.client.0.smithi090.stdout:7/186: mkdir d11/d1a/d3f 0 2024-04-20T10:54:37.490 INFO:tasks.workunit.client.0.smithi090.stdout:7/187: creat d11/d1a/f40 x:0 0 0 2024-04-20T10:54:37.491 INFO:tasks.workunit.client.0.smithi090.stdout:0/148: dread f11 [0,4194304] 0 2024-04-20T10:54:37.491 INFO:tasks.workunit.client.0.smithi090.stdout:0/149: write d14/d19/d2c/f2d [167582,46647] 0 2024-04-20T10:54:37.492 INFO:tasks.workunit.client.0.smithi090.stdout:7/188: mkdir d11/d13/d22/d41 0 2024-04-20T10:54:37.492 INFO:tasks.workunit.client.0.smithi090.stdout:7/189: write d11/d13/d22/d24/f2e [991404,9566] 0 2024-04-20T10:54:37.503 INFO:tasks.workunit.client.0.smithi090.stdout:1/122: sync 2024-04-20T10:54:37.503 INFO:tasks.workunit.client.0.smithi090.stdout:8/218: sync 2024-04-20T10:54:37.504 INFO:tasks.workunit.client.0.smithi090.stdout:5/330: sync 2024-04-20T10:54:37.504 INFO:tasks.workunit.client.0.smithi090.stdout:6/165: dwrite d1/d4/d26/ff [4194304,4194304] 0 2024-04-20T10:54:37.504 INFO:tasks.workunit.client.0.smithi090.stdout:5/331: creat d1/da/d16/f6b x:0 0 0 2024-04-20T10:54:37.505 INFO:tasks.workunit.client.0.smithi090.stdout:8/219: symlink d0/d26/l3c 0 2024-04-20T10:54:37.505 INFO:tasks.workunit.client.0.smithi090.stdout:8/220: chown d0/f28 257895 1 2024-04-20T10:54:37.505 INFO:tasks.workunit.client.0.smithi090.stdout:6/166: mknod d1/d4/d3a/c3c 0 2024-04-20T10:54:37.507 INFO:tasks.workunit.client.0.smithi090.stdout:5/332: write d1/d2f/d3d/d40/f45 [642834,46893] 0 2024-04-20T10:54:37.507 INFO:tasks.workunit.client.0.smithi090.stdout:5/333: write d1/da/d16/f6b [208343,98786] 0 2024-04-20T10:54:37.508 INFO:tasks.workunit.client.0.smithi090.stdout:8/221: rename d0/cb to d0/d11/c3d 0 2024-04-20T10:54:37.508 INFO:tasks.workunit.client.0.smithi090.stdout:6/167: mknod d1/d4/d26/d11/c3d 0 2024-04-20T10:54:37.510 INFO:tasks.workunit.client.0.smithi090.stdout:8/222: write d0/fe [4154353,109585] 0 2024-04-20T10:54:37.510 INFO:tasks.workunit.client.0.smithi090.stdout:6/168: rename d1/d4/c1c to d1/d19/d25/c3e 0 2024-04-20T10:54:37.511 INFO:tasks.workunit.client.0.smithi090.stdout:5/334: mkdir d1/d2f/d3d/d40/d6c 0 2024-04-20T10:54:37.512 INFO:tasks.workunit.client.0.smithi090.stdout:8/223: rename d0/d11/d14/c38 to d0/d11/d14/c3e 0 2024-04-20T10:54:37.513 INFO:tasks.workunit.client.0.smithi090.stdout:6/169: mkdir d1/d19/d36/d1e/d1f/d3f 0 2024-04-20T10:54:37.525 INFO:tasks.workunit.client.0.smithi090.stdout:0/150: dwrite f13 [0,4194304] 0 2024-04-20T10:54:37.525 INFO:tasks.workunit.client.0.smithi090.stdout:0/151: write d14/f1e [193778,38994] 0 2024-04-20T10:54:37.527 INFO:tasks.workunit.client.0.smithi090.stdout:5/335: mknod d1/d2a/c6d 0 2024-04-20T10:54:37.527 INFO:tasks.workunit.client.0.smithi090.stdout:5/336: chown d1/da/d16/c3c 1 1 2024-04-20T10:54:37.527 INFO:tasks.workunit.client.0.smithi090.stdout:5/337: fsync d1/de/f57 0 2024-04-20T10:54:37.527 INFO:tasks.workunit.client.0.smithi090.stdout:5/338: write d1/d2a/f60 [1132208,5188] 0 2024-04-20T10:54:37.527 INFO:tasks.workunit.client.0.smithi090.stdout:5/339: write d1/d2f/f37 [649801,53980] 0 2024-04-20T10:54:37.527 INFO:tasks.workunit.client.0.smithi090.stdout:0/152: truncate d14/f2a 833071 0 2024-04-20T10:54:37.527 INFO:tasks.workunit.client.0.smithi090.stdout:1/123: dwrite d8/fe [0,4194304] 0 2024-04-20T10:54:37.528 INFO:tasks.workunit.client.0.smithi090.stdout:7/190: dwrite d11/d13/d22/d24/f2e [0,4194304] 0 2024-04-20T10:54:37.528 INFO:tasks.workunit.client.0.smithi090.stdout:5/340: getdents d1/d2f/d3d 0 2024-04-20T10:54:37.528 INFO:tasks.workunit.client.0.smithi090.stdout:5/341: chown d1/de/l15 6 1 2024-04-20T10:54:37.528 INFO:tasks.workunit.client.0.smithi090.stdout:5/342: read - d1/d2f/f56 zero size 2024-04-20T10:54:37.528 INFO:tasks.workunit.client.0.smithi090.stdout:5/343: stat d1/da/d14/d47/d50/c5a 0 2024-04-20T10:54:37.528 INFO:tasks.workunit.client.0.smithi090.stdout:5/344: chown d1/de/f57 116782 1 2024-04-20T10:54:37.529 INFO:tasks.workunit.client.0.smithi090.stdout:5/345: dread d1/f58 [0,4194304] 0 2024-04-20T10:54:37.530 INFO:tasks.workunit.client.0.smithi090.stdout:1/124: truncate d8/d1a/d1d/f24 201734 0 2024-04-20T10:54:37.530 INFO:tasks.workunit.client.0.smithi090.stdout:1/125: fsync d8/d1a/d1d/f27 0 2024-04-20T10:54:37.532 INFO:tasks.workunit.client.0.smithi090.stdout:7/191: mknod d11/d13/d22/d41/c42 0 2024-04-20T10:54:37.540 INFO:tasks.workunit.client.0.smithi090.stdout:7/192: write f4 [2636237,100421] 0 2024-04-20T10:54:37.542 INFO:tasks.workunit.client.0.smithi090.stdout:6/170: dwrite d1/f6 [0,4194304] 0 2024-04-20T10:54:37.543 INFO:tasks.workunit.client.0.smithi090.stdout:7/193: symlink d11/d13/d22/l43 0 2024-04-20T10:54:37.543 INFO:tasks.workunit.client.0.smithi090.stdout:8/224: dwrite d0/f12 [0,4194304] 0 2024-04-20T10:54:37.543 INFO:tasks.workunit.client.0.smithi090.stdout:8/225: fdatasync d0/d11/f31 0 2024-04-20T10:54:37.543 INFO:tasks.workunit.client.0.smithi090.stdout:8/226: stat d0/d11/f1a 0 2024-04-20T10:54:37.544 INFO:tasks.workunit.client.0.smithi090.stdout:8/227: chown d0/d11/f1a 14 1 2024-04-20T10:54:37.544 INFO:tasks.workunit.client.0.smithi090.stdout:0/153: dwrite d14/d19/d2c/f2d [0,4194304] 0 2024-04-20T10:54:37.545 INFO:tasks.workunit.client.0.smithi090.stdout:6/171: getdents d1/d19 0 2024-04-20T10:54:37.545 INFO:tasks.workunit.client.0.smithi090.stdout:6/172: fsync d1/f6 0 2024-04-20T10:54:37.546 INFO:tasks.workunit.client.0.smithi090.stdout:8/228: truncate d0/f9 583724 0 2024-04-20T10:54:37.551 INFO:tasks.workunit.client.0.smithi090.stdout:5/346: dwrite d1/d2f/d3d/d40/f45 [0,4194304] 0 2024-04-20T10:54:37.554 INFO:tasks.workunit.client.0.smithi090.stdout:8/229: rename d0/l24 to d0/d2d/l3f 0 2024-04-20T10:54:37.555 INFO:tasks.workunit.client.0.smithi090.stdout:6/173: dread d1/d19/d36/d28/f2a [0,4194304] 0 2024-04-20T10:54:37.555 INFO:tasks.workunit.client.0.smithi090.stdout:6/174: write d1/fd [5090909,12787] 0 2024-04-20T10:54:37.555 INFO:tasks.workunit.client.0.smithi090.stdout:6/175: write d1/d19/f1a [904970,65676] 0 2024-04-20T10:54:37.555 INFO:tasks.workunit.client.0.smithi090.stdout:5/347: stat d1/c29 0 2024-04-20T10:54:37.565 INFO:tasks.workunit.client.0.smithi090.stdout:6/176: dread d1/d10/f39 [0,4194304] 0 2024-04-20T10:54:37.573 INFO:tasks.workunit.client.0.smithi090.stdout:0/154: dwrite d14/f22 [0,4194304] 0 2024-04-20T10:54:37.573 INFO:tasks.workunit.client.0.smithi090.stdout:0/155: stat d14/f1f 0 2024-04-20T10:54:37.573 INFO:tasks.workunit.client.0.smithi090.stdout:1/126: dwrite f5 [0,4194304] 0 2024-04-20T10:54:37.573 INFO:tasks.workunit.client.0.smithi090.stdout:0/156: write d14/f1f [625011,129996] 0 2024-04-20T10:54:37.573 INFO:tasks.workunit.client.0.smithi090.stdout:0/157: write f11 [6154787,94265] 0 2024-04-20T10:54:37.573 INFO:tasks.workunit.client.0.smithi090.stdout:8/230: dwrite d0/d11/d22/f34 [0,4194304] 0 2024-04-20T10:54:37.573 INFO:tasks.workunit.client.0.smithi090.stdout:8/231: chown d0/l13 49483302 1 2024-04-20T10:54:37.574 INFO:tasks.workunit.client.0.smithi090.stdout:5/348: unlink d1/da/d14/d47/d39/l61 0 2024-04-20T10:54:37.577 INFO:tasks.workunit.client.0.smithi090.stdout:1/127: mkdir d8/d1a/d1d/d2c 0 2024-04-20T10:54:37.580 INFO:tasks.workunit.client.0.smithi090.stdout:0/158: mkdir d14/d19/d31/d34 0 2024-04-20T10:54:37.581 INFO:tasks.workunit.client.0.smithi090.stdout:8/232: creat d0/d26/f40 x:0 0 0 2024-04-20T10:54:37.582 INFO:tasks.workunit.client.0.smithi090.stdout:5/349: rename d1/c29 to d1/d2f/d3d/d40/d6c/c6e 0 2024-04-20T10:54:37.584 INFO:tasks.workunit.client.0.smithi090.stdout:8/233: creat d0/d11/d14/f41 x:0 0 0 2024-04-20T10:54:37.584 INFO:tasks.workunit.client.0.smithi090.stdout:8/234: fdatasync d0/f9 0 2024-04-20T10:54:37.591 INFO:tasks.workunit.client.0.smithi090.stdout:0/159: write fe [1718225,43579] 0 2024-04-20T10:54:37.591 INFO:tasks.workunit.client.0.smithi090.stdout:6/177: dwrite d1/fd [0,4194304] 0 2024-04-20T10:54:37.603 INFO:tasks.workunit.client.0.smithi090.stdout:1/128: dwrite d8/f11 [0,4194304] 0 2024-04-20T10:54:37.606 INFO:tasks.workunit.client.0.smithi090.stdout:6/178: dwrite d1/d19/d36/f27 [0,4194304] 0 2024-04-20T10:54:37.622 INFO:tasks.workunit.client.0.smithi090.stdout:1/129: dwrite d8/fb [0,4194304] 0 2024-04-20T10:54:37.622 INFO:tasks.workunit.client.0.smithi090.stdout:1/130: write d8/f2a [305451,21225] 0 2024-04-20T10:54:37.638 INFO:tasks.workunit.client.0.smithi090.stdout:1/131: dwrite f5 [0,4194304] 0 2024-04-20T10:54:37.675 INFO:tasks.workunit.client.0.smithi090.stdout:5/350: creat d1/da/d14/d47/d39/f6f x:0 0 0 2024-04-20T10:54:37.675 INFO:tasks.workunit.client.0.smithi090.stdout:8/235: symlink d0/d26/l42 0 2024-04-20T10:54:37.681 INFO:tasks.workunit.client.0.smithi090.stdout:5/351: dread d1/de/f20 [0,4194304] 0 2024-04-20T10:54:37.682 INFO:tasks.workunit.client.0.smithi090.stdout:0/160: creat d14/d19/d2c/f35 x:0 0 0 2024-04-20T10:54:37.683 INFO:tasks.workunit.client.0.smithi090.stdout:6/179: mknod d1/d4/d26/d11/d35/c40 0 2024-04-20T10:54:37.684 INFO:tasks.workunit.client.0.smithi090.stdout:1/132: creat d8/f2d x:0 0 0 2024-04-20T10:54:37.684 INFO:tasks.workunit.client.0.smithi090.stdout:1/133: stat d8/d1a 0 2024-04-20T10:54:37.684 INFO:tasks.workunit.client.0.smithi090.stdout:1/134: dread - d8/d19/f29 zero size 2024-04-20T10:54:37.685 INFO:tasks.workunit.client.0.smithi090.stdout:8/236: link d0/d11/d14/f2b d0/d2d/f43 0 2024-04-20T10:54:37.686 INFO:tasks.workunit.client.0.smithi090.stdout:6/180: creat d1/d4/d26/d11/f41 x:0 0 0 2024-04-20T10:54:37.686 INFO:tasks.workunit.client.0.smithi090.stdout:6/181: read d1/d4/d26/ff [106444,58609] 0 2024-04-20T10:54:37.687 INFO:tasks.workunit.client.0.smithi090.stdout:1/135: mknod d8/d1a/d1d/c2e 0 2024-04-20T10:54:37.688 INFO:tasks.workunit.client.0.smithi090.stdout:8/237: mkdir d0/d2d/d44 0 2024-04-20T10:54:37.688 INFO:tasks.workunit.client.0.smithi090.stdout:0/161: dread d14/f1f [0,4194304] 0 2024-04-20T10:54:37.689 INFO:tasks.workunit.client.0.smithi090.stdout:5/352: mkdir d1/d2f/d3d/d40/d70 0 2024-04-20T10:54:37.689 INFO:tasks.workunit.client.0.smithi090.stdout:6/182: getdents d1/d10 0 2024-04-20T10:54:37.690 INFO:tasks.workunit.client.0.smithi090.stdout:1/136: mknod d8/d1a/d1d/d2c/c2f 0 2024-04-20T10:54:37.692 INFO:tasks.workunit.client.0.smithi090.stdout:8/238: rename d0/d11/c3d to d0/d26/c45 0 2024-04-20T10:54:37.692 INFO:tasks.workunit.client.0.smithi090.stdout:5/353: getdents d1/da 0 2024-04-20T10:54:37.693 INFO:tasks.workunit.client.0.smithi090.stdout:5/354: stat d1/da/d14 0 2024-04-20T10:54:37.693 INFO:tasks.workunit.client.0.smithi090.stdout:1/137: creat d8/d19/f30 x:0 0 0 2024-04-20T10:54:37.695 INFO:tasks.workunit.client.0.smithi090.stdout:8/239: creat d0/d3a/f46 x:0 0 0 2024-04-20T10:54:37.695 INFO:tasks.workunit.client.0.smithi090.stdout:8/240: chown d0/l13 4450928 1 2024-04-20T10:54:37.696 INFO:tasks.workunit.client.0.smithi090.stdout:2/227: sync 2024-04-20T10:54:37.696 INFO:tasks.workunit.client.0.smithi090.stdout:4/129: sync 2024-04-20T10:54:37.698 INFO:tasks.workunit.client.0.smithi090.stdout:1/138: rmdir d8/d1a 39 2024-04-20T10:54:37.700 INFO:tasks.workunit.client.0.smithi090.stdout:4/130: truncate d7/f12 1257788 0 2024-04-20T10:54:37.700 INFO:tasks.workunit.client.0.smithi090.stdout:4/131: write d7/d9/f13 [3491502,41665] 0 2024-04-20T10:54:37.701 INFO:tasks.workunit.client.0.smithi090.stdout:1/139: rmdir d8/d1a/d1d 39 2024-04-20T10:54:37.702 INFO:tasks.workunit.client.0.smithi090.stdout:0/162: dread f13 [0,4194304] 0 2024-04-20T10:54:37.702 INFO:tasks.workunit.client.0.smithi090.stdout:0/163: dread - d14/d19/d2c/f35 zero size 2024-04-20T10:54:37.702 INFO:tasks.workunit.client.0.smithi090.stdout:0/164: stat fe 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:5/355: dread d1/f26 [0,4194304] 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:1/140: rename d8/d1a/d1d/d28 to d8/d19/d31 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:0/165: mkdir d14/d19/d2b/d36 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:5/356: mknod d1/d2f/d3d/d40/d4a/c71 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:5/357: write d1/f62 [1246595,96818] 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:8/241: dread d0/d11/d22/f23 [0,4194304] 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:0/166: mkdir d14/d19/d31/d37 0 2024-04-20T10:54:37.707 INFO:tasks.workunit.client.0.smithi090.stdout:6/183: dwrite d1/d19/d36/d1e/f20 [0,4194304] 0 2024-04-20T10:54:37.708 INFO:tasks.workunit.client.0.smithi090.stdout:6/184: read - d1/d4/d26/d11/f41 zero size 2024-04-20T10:54:37.708 INFO:tasks.workunit.client.0.smithi090.stdout:8/242: mknod d0/d3a/c47 0 2024-04-20T10:54:37.708 INFO:tasks.workunit.client.0.smithi090.stdout:8/243: stat d0/d26 0 2024-04-20T10:54:37.709 INFO:tasks.workunit.client.0.smithi090.stdout:0/167: unlink d14/f17 0 2024-04-20T10:54:37.710 INFO:tasks.workunit.client.0.smithi090.stdout:6/185: creat d1/d4/d3a/f42 x:0 0 0 2024-04-20T10:54:37.711 INFO:tasks.workunit.client.0.smithi090.stdout:8/244: creat d0/d2d/f48 x:0 0 0 2024-04-20T10:54:37.712 INFO:tasks.workunit.client.0.smithi090.stdout:0/168: link d14/f32 d14/d19/d31/f38 0 2024-04-20T10:54:37.713 INFO:tasks.workunit.client.0.smithi090.stdout:0/169: write d14/f32 [216821,105046] 0 2024-04-20T10:54:37.713 INFO:tasks.workunit.client.0.smithi090.stdout:0/170: chown d14/d19/c24 1 1 2024-04-20T10:54:37.715 INFO:tasks.workunit.client.0.smithi090.stdout:8/245: mkdir d0/d2d/d49 0 2024-04-20T10:54:37.717 INFO:tasks.workunit.client.0.smithi090.stdout:4/132: write d7/d9/fa [203284,9459] 0 2024-04-20T10:54:37.719 INFO:tasks.workunit.client.0.smithi090.stdout:8/246: mkdir d0/d3a/d4a 0 2024-04-20T10:54:37.721 INFO:tasks.workunit.client.0.smithi090.stdout:4/133: creat d7/f21 x:0 0 0 2024-04-20T10:54:37.723 INFO:tasks.workunit.client.0.smithi090.stdout:2/228: dwrite d11/d1a/d30/f48 [0,4194304] 0 2024-04-20T10:54:37.724 INFO:tasks.workunit.client.0.smithi090.stdout:2/229: truncate d11/d1f/d2e/f3b 2472796 0 2024-04-20T10:54:37.724 INFO:tasks.workunit.client.0.smithi090.stdout:2/230: truncate d11/f1c 1080651 0 2024-04-20T10:54:37.724 INFO:tasks.workunit.client.0.smithi090.stdout:0/171: dread f0 [0,4194304] 0 2024-04-20T10:54:37.724 INFO:tasks.workunit.client.0.smithi090.stdout:8/247: symlink d0/d11/l4b 0 2024-04-20T10:54:37.726 INFO:tasks.workunit.client.0.smithi090.stdout:1/141: truncate f5 129036 0 2024-04-20T10:54:37.728 INFO:tasks.workunit.client.0.smithi090.stdout:2/231: creat d11/d1a/d37/f4f x:0 0 0 2024-04-20T10:54:37.728 INFO:tasks.workunit.client.0.smithi090.stdout:2/232: readlink d11/d1a/d30/l3f 0 2024-04-20T10:54:37.730 INFO:tasks.workunit.client.0.smithi090.stdout:8/248: creat d0/d2d/d44/f4c x:0 0 0 2024-04-20T10:54:37.730 INFO:tasks.workunit.client.0.smithi090.stdout:8/249: write d0/f2e [307875,57500] 0 2024-04-20T10:54:37.730 INFO:tasks.workunit.client.0.smithi090.stdout:1/142: rmdir d8/d19 39 2024-04-20T10:54:37.740 INFO:tasks.workunit.client.0.smithi090.stdout:0/172: dwrite d14/f18 [4194304,4194304] 0 2024-04-20T10:54:37.748 INFO:tasks.workunit.client.0.smithi090.stdout:1/143: dwrite d8/d19/f29 [0,4194304] 0 2024-04-20T10:54:37.749 INFO:tasks.workunit.client.0.smithi090.stdout:2/233: mknod d11/d1a/d37/c50 0 2024-04-20T10:54:37.749 INFO:tasks.workunit.client.0.smithi090.stdout:2/234: dread - d11/d1f/d2e/f33 zero size 2024-04-20T10:54:37.754 INFO:tasks.workunit.client.0.smithi090.stdout:8/250: dwrite d0/f8 [4194304,4194304] 0 2024-04-20T10:54:37.754 INFO:tasks.workunit.client.0.smithi090.stdout:1/144: truncate d8/f16 642109 0 2024-04-20T10:54:37.754 INFO:tasks.workunit.client.0.smithi090.stdout:1/145: readlink d8/d19/l20 0 2024-04-20T10:54:37.755 INFO:tasks.workunit.client.0.smithi090.stdout:2/235: mknod d11/d1f/c51 0 2024-04-20T10:54:37.760 INFO:tasks.workunit.client.0.smithi090.stdout:2/236: unlink le 0 2024-04-20T10:54:37.760 INFO:tasks.workunit.client.0.smithi090.stdout:0/173: dwrite d14/f16 [0,4194304] 0 2024-04-20T10:54:37.760 INFO:tasks.workunit.client.0.smithi090.stdout:0/174: write d14/d19/d31/f38 [1344778,1837] 0 2024-04-20T10:54:37.776 INFO:tasks.workunit.client.0.smithi090.stdout:6/186: dwrite d1/d4/f1d [0,4194304] 0 2024-04-20T10:54:37.777 INFO:tasks.workunit.client.0.smithi090.stdout:6/187: truncate d1/d4/d26/f2b 255540 0 2024-04-20T10:54:37.777 INFO:tasks.workunit.client.0.smithi090.stdout:6/188: dread - d1/d4/d26/d11/f41 zero size 2024-04-20T10:54:37.778 INFO:tasks.workunit.client.0.smithi090.stdout:2/237: unlink d11/d1a/d37/c46 0 2024-04-20T10:54:37.779 INFO:tasks.workunit.client.0.smithi090.stdout:0/175: mkdir d14/d39 0 2024-04-20T10:54:37.779 INFO:tasks.workunit.client.0.smithi090.stdout:0/176: truncate d14/f1f 860339 0 2024-04-20T10:54:37.779 INFO:tasks.workunit.client.0.smithi090.stdout:0/177: chown d14/d19/d31/d34 2 1 2024-04-20T10:54:37.786 INFO:tasks.workunit.client.0.smithi090.stdout:6/189: symlink d1/d19/d25/l43 0 2024-04-20T10:54:37.787 INFO:tasks.workunit.client.0.smithi090.stdout:0/178: write d14/f21 [4119974,119018] 0 2024-04-20T10:54:37.788 INFO:tasks.workunit.client.0.smithi090.stdout:2/238: creat d11/d1f/d2e/f52 x:0 0 0 2024-04-20T10:54:37.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/239: write d11/f16 [1400464,79098] 0 2024-04-20T10:54:37.797 INFO:tasks.workunit.client.0.smithi090.stdout:2/240: truncate d11/d1a/f1b 439692 0 2024-04-20T10:54:37.797 INFO:tasks.workunit.client.0.smithi090.stdout:2/241: read d11/d1f/f27 [10480,52815] 0 2024-04-20T10:54:37.798 INFO:tasks.workunit.client.0.smithi090.stdout:1/146: truncate d8/f16 126476 0 2024-04-20T10:54:37.805 INFO:tasks.workunit.client.0.smithi090.stdout:6/190: read d1/d19/d36/d28/f3b [585047,36118] 0 2024-04-20T10:54:37.805 INFO:tasks.workunit.client.0.smithi090.stdout:6/191: readlink d1/d4/d26/l14 0 2024-04-20T10:54:37.805 INFO:tasks.workunit.client.0.smithi090.stdout:8/251: dwrite d0/f17 [0,4194304] 0 2024-04-20T10:54:37.805 INFO:tasks.workunit.client.0.smithi090.stdout:8/252: truncate d0/d11/f31 1263666 0 2024-04-20T10:54:37.811 INFO:tasks.workunit.client.0.smithi090.stdout:1/147: write d8/fb [2463041,44922] 0 2024-04-20T10:54:37.812 INFO:tasks.workunit.client.0.smithi090.stdout:2/242: getdents d11/d1f/d2e 0 2024-04-20T10:54:37.812 INFO:tasks.workunit.client.0.smithi090.stdout:6/192: getdents d1/d19/d36/d1e 0 2024-04-20T10:54:37.813 INFO:tasks.workunit.client.0.smithi090.stdout:1/148: link d8/l18 d8/d1a/d1d/l32 0 2024-04-20T10:54:37.818 INFO:tasks.workunit.client.0.smithi090.stdout:8/253: dread d0/f17 [0,4194304] 0 2024-04-20T10:54:37.818 INFO:tasks.workunit.client.0.smithi090.stdout:8/254: chown d0 4065270 1 2024-04-20T10:54:37.820 INFO:tasks.workunit.client.0.smithi090.stdout:2/243: creat d11/d1a/d4a/f53 x:0 0 0 2024-04-20T10:54:37.820 INFO:tasks.workunit.client.0.smithi090.stdout:2/244: fsync d11/d1a/d2b/f2f 0 2024-04-20T10:54:37.821 INFO:tasks.workunit.client.0.smithi090.stdout:6/193: creat d1/d4/d26/d11/f44 x:0 0 0 2024-04-20T10:54:37.823 INFO:tasks.workunit.client.0.smithi090.stdout:0/179: dwrite fa [0,4194304] 0 2024-04-20T10:54:37.825 INFO:tasks.workunit.client.0.smithi090.stdout:8/255: creat d0/d26/f4d x:0 0 0 2024-04-20T10:54:37.825 INFO:tasks.workunit.client.0.smithi090.stdout:8/256: fsync d0/f27 0 2024-04-20T10:54:37.825 INFO:tasks.workunit.client.0.smithi090.stdout:2/245: rmdir d11/d1f/d2e 39 2024-04-20T10:54:37.839 INFO:tasks.workunit.client.0.smithi090.stdout:6/194: dwrite d1/d4/d26/ff [4194304,4194304] 0 2024-04-20T10:54:37.840 INFO:tasks.workunit.client.0.smithi090.stdout:0/180: symlink d14/d19/d31/d34/l3a 0 2024-04-20T10:54:37.847 INFO:tasks.workunit.client.0.smithi090.stdout:0/181: dread d14/f32 [0,4194304] 0 2024-04-20T10:54:37.848 INFO:tasks.workunit.client.0.smithi090.stdout:2/246: mkdir d11/d1a/d4a/d54 0 2024-04-20T10:54:37.848 INFO:tasks.workunit.client.0.smithi090.stdout:6/195: mknod d1/d19/d25/c45 0 2024-04-20T10:54:37.849 INFO:tasks.workunit.client.0.smithi090.stdout:0/182: mkdir d14/d19/d31/d34/d3b 0 2024-04-20T10:54:37.850 INFO:tasks.workunit.client.0.smithi090.stdout:8/257: dwrite d0/fe [0,4194304] 0 2024-04-20T10:54:37.850 INFO:tasks.workunit.client.0.smithi090.stdout:2/247: mkdir d11/d1a/d4a/d55 0 2024-04-20T10:54:37.850 INFO:tasks.workunit.client.0.smithi090.stdout:2/248: write d11/d1a/f2d [644819,112346] 0 2024-04-20T10:54:37.851 INFO:tasks.workunit.client.0.smithi090.stdout:6/196: rename d1/d4/d26/f2b to d1/d4/f46 0 2024-04-20T10:54:37.853 INFO:tasks.workunit.client.0.smithi090.stdout:8/258: write d0/f17 [3007801,29322] 0 2024-04-20T10:54:37.853 INFO:tasks.workunit.client.0.smithi090.stdout:8/259: write d0/d11/f1a [426100,53794] 0 2024-04-20T10:54:37.855 INFO:tasks.workunit.client.0.smithi090.stdout:1/149: dread d8/fb [0,4194304] 0 2024-04-20T10:54:37.868 INFO:tasks.workunit.client.0.smithi090.stdout:8/260: dread d0/f1c [0,4194304] 0 2024-04-20T10:54:37.869 INFO:tasks.workunit.client.0.smithi090.stdout:1/150: write d8/d19/f29 [3626997,37513] 0 2024-04-20T10:54:37.869 INFO:tasks.workunit.client.0.smithi090.stdout:0/183: symlink d14/d19/l3c 0 2024-04-20T10:54:37.870 INFO:tasks.workunit.client.0.smithi090.stdout:2/249: creat d11/d1a/d2b/f56 x:0 0 0 2024-04-20T10:54:37.871 INFO:tasks.workunit.client.0.smithi090.stdout:8/261: creat d0/d3a/d4a/f4e x:0 0 0 2024-04-20T10:54:37.871 INFO:tasks.workunit.client.0.smithi090.stdout:8/262: write d0/d3a/f46 [67666,125766] 0 2024-04-20T10:54:37.871 INFO:tasks.workunit.client.0.smithi090.stdout:8/263: fdatasync d0/d11/d14/f2b 0 2024-04-20T10:54:37.872 INFO:tasks.workunit.client.0.smithi090.stdout:1/151: creat d8/d19/d31/f33 x:0 0 0 2024-04-20T10:54:37.873 INFO:tasks.workunit.client.0.smithi090.stdout:0/184: read ff [4470815,91366] 0 2024-04-20T10:54:37.873 INFO:tasks.workunit.client.0.smithi090.stdout:0/185: write d14/f1e [527159,120013] 0 2024-04-20T10:54:37.878 INFO:tasks.workunit.client.0.smithi090.stdout:1/152: creat d8/f34 x:0 0 0 2024-04-20T10:54:37.879 INFO:tasks.workunit.client.0.smithi090.stdout:6/197: dwrite d1/d4/d26/d11/f17 [0,4194304] 0 2024-04-20T10:54:37.880 INFO:tasks.workunit.client.0.smithi090.stdout:6/198: truncate d1/d4/d3a/f42 796221 0 2024-04-20T10:54:37.880 INFO:tasks.workunit.client.0.smithi090.stdout:6/199: fdatasync d1/d4/d26/d11/f2c 0 2024-04-20T10:54:37.880 INFO:tasks.workunit.client.0.smithi090.stdout:0/186: unlink d14/f16 0 2024-04-20T10:54:37.881 INFO:tasks.workunit.client.0.smithi090.stdout:1/153: unlink d8/d1a/d1d/d2c/c2f 0 2024-04-20T10:54:37.883 INFO:tasks.workunit.client.0.smithi090.stdout:1/154: write d8/d1a/d1d/f24 [178393,35326] 0 2024-04-20T10:54:37.883 INFO:tasks.workunit.client.0.smithi090.stdout:1/155: dread - d8/d19/f30 zero size 2024-04-20T10:54:37.885 INFO:tasks.workunit.client.0.smithi090.stdout:6/200: truncate d1/d19/d36/d28/f3b 1024156 0 2024-04-20T10:54:37.887 INFO:tasks.workunit.client.0.smithi090.stdout:0/187: link f13 d14/d19/d2b/f3d 0 2024-04-20T10:54:37.889 INFO:tasks.workunit.client.0.smithi090.stdout:8/264: truncate d0/d11/f1a 3193218 0 2024-04-20T10:54:37.889 INFO:tasks.workunit.client.0.smithi090.stdout:4/134: dwrite d7/d9/f13 [0,4194304] 0 2024-04-20T10:54:37.889 INFO:tasks.workunit.client.0.smithi090.stdout:4/135: truncate d7/f1d 5144650 0 2024-04-20T10:54:37.890 INFO:tasks.workunit.client.0.smithi090.stdout:6/201: link d1/d4/d26/ff d1/d4/f47 0 2024-04-20T10:54:37.891 INFO:tasks.workunit.client.0.smithi090.stdout:0/188: getdents d14/d19 0 2024-04-20T10:54:37.892 INFO:tasks.workunit.client.0.smithi090.stdout:6/202: dread d1/d4/d3a/f42 [0,4194304] 0 2024-04-20T10:54:37.892 INFO:tasks.workunit.client.0.smithi090.stdout:6/203: chown d1/d19/d25/l43 113931472 1 2024-04-20T10:54:37.892 INFO:tasks.workunit.client.0.smithi090.stdout:8/265: rmdir d0/d3a 39 2024-04-20T10:54:37.898 INFO:tasks.workunit.client.0.smithi090.stdout:4/136: mknod d7/d9/c22 0 2024-04-20T10:54:37.898 INFO:tasks.workunit.client.0.smithi090.stdout:1/156: dwrite d8/d19/f30 [0,4194304] 0 2024-04-20T10:54:37.900 INFO:tasks.workunit.client.0.smithi090.stdout:0/189: creat d14/d19/d2b/f3e x:0 0 0 2024-04-20T10:54:37.902 INFO:tasks.workunit.client.0.smithi090.stdout:6/204: link d1/d4/l21 d1/d19/d36/d1e/d1f/l48 0 2024-04-20T10:54:37.910 INFO:tasks.workunit.client.0.smithi090.stdout:8/266: dwrite d0/d26/f4d [0,4194304] 0 2024-04-20T10:54:37.910 INFO:tasks.workunit.client.0.smithi090.stdout:8/267: dread - d0/d11/d14/f41 zero size 2024-04-20T10:54:37.910 INFO:tasks.workunit.client.0.smithi090.stdout:8/268: fsync d0/d11/f1a 0 2024-04-20T10:54:37.910 INFO:tasks.workunit.client.0.smithi090.stdout:8/269: chown d0/d11/l2c 4552249 1 2024-04-20T10:54:37.911 INFO:tasks.workunit.client.0.smithi090.stdout:9/245: sync 2024-04-20T10:54:37.912 INFO:tasks.workunit.client.0.smithi090.stdout:4/137: symlink d7/l23 0 2024-04-20T10:54:37.914 INFO:tasks.workunit.client.0.smithi090.stdout:8/270: symlink d0/d2d/d44/l4f 0 2024-04-20T10:54:37.927 INFO:tasks.workunit.client.0.smithi090.stdout:8/271: write d0/f1c [4913789,100721] 0 2024-04-20T10:54:37.928 INFO:tasks.workunit.client.0.smithi090.stdout:9/246: creat d0/da/d1f/d4d/f50 x:0 0 0 2024-04-20T10:54:37.928 INFO:tasks.workunit.client.0.smithi090.stdout:9/247: stat d0/d29/d4f/d23 0 2024-04-20T10:54:37.928 INFO:tasks.workunit.client.0.smithi090.stdout:9/248: chown d0/d29/d4f/c17 3 1 2024-04-20T10:54:37.928 INFO:tasks.workunit.client.0.smithi090.stdout:4/138: mkdir d7/d9/d24 0 2024-04-20T10:54:37.930 INFO:tasks.workunit.client.0.smithi090.stdout:1/157: dwrite d8/f12 [0,4194304] 0 2024-04-20T10:54:37.930 INFO:tasks.workunit.client.0.smithi090.stdout:2/250: dwrite d11/d1a/d37/f44 [0,4194304] 0 2024-04-20T10:54:37.931 INFO:tasks.workunit.client.0.smithi090.stdout:2/251: read d11/d1f/f27 [630116,90780] 0 2024-04-20T10:54:37.931 INFO:tasks.workunit.client.0.smithi090.stdout:0/190: dwrite d14/d19/d2b/f30 [0,4194304] 0 2024-04-20T10:54:37.931 INFO:tasks.workunit.client.0.smithi090.stdout:0/191: chown d14/d19/c33 21 1 2024-04-20T10:54:37.931 INFO:tasks.workunit.client.0.smithi090.stdout:8/272: link d0/d26/l42 d0/d2d/d44/l50 0 2024-04-20T10:54:37.932 INFO:tasks.workunit.client.0.smithi090.stdout:9/249: link d0/f9 d0/f51 0 2024-04-20T10:54:37.934 INFO:tasks.workunit.client.0.smithi090.stdout:1/158: rename d8/l13 to d8/l35 0 2024-04-20T10:54:37.936 INFO:tasks.workunit.client.0.smithi090.stdout:4/139: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:37.938 INFO:tasks.workunit.client.0.smithi090.stdout:2/252: mknod d11/d1a/d37/c57 0 2024-04-20T10:54:37.938 INFO:tasks.workunit.client.0.smithi090.stdout:2/253: readlink l7 0 2024-04-20T10:54:37.943 INFO:tasks.workunit.client.0.smithi090.stdout:3/159: sync 2024-04-20T10:54:37.943 INFO:tasks.workunit.client.0.smithi090.stdout:7/194: sync 2024-04-20T10:54:37.943 INFO:tasks.workunit.client.0.smithi090.stdout:5/358: sync 2024-04-20T10:54:37.943 INFO:tasks.workunit.client.0.smithi090.stdout:7/195: chown f4 42237 1 2024-04-20T10:54:37.943 INFO:tasks.workunit.client.0.smithi090.stdout:3/160: readlink d7/d26/l34 0 2024-04-20T10:54:37.945 INFO:tasks.workunit.client.0.smithi090.stdout:8/273: creat d0/d26/f51 x:0 0 0 2024-04-20T10:54:37.945 INFO:tasks.workunit.client.0.smithi090.stdout:8/274: fdatasync d0/d11/d22/f34 0 2024-04-20T10:54:37.945 INFO:tasks.workunit.client.0.smithi090.stdout:8/275: write d0/d11/d14/f2b [1036577,97727] 0 2024-04-20T10:54:37.947 INFO:tasks.workunit.client.0.smithi090.stdout:9/250: rename d0/da/d30 to d0/da/d1f/d34/d42/d52 0 2024-04-20T10:54:37.948 INFO:tasks.workunit.client.0.smithi090.stdout:4/140: mknod d7/d9/c25 0 2024-04-20T10:54:37.949 INFO:tasks.workunit.client.0.smithi090.stdout:7/196: mkdir d11/d13/d33/d44 0 2024-04-20T10:54:37.950 INFO:tasks.workunit.client.0.smithi090.stdout:2/254: dread d11/f20 [0,4194304] 0 2024-04-20T10:54:37.950 INFO:tasks.workunit.client.0.smithi090.stdout:1/159: dwrite f6 [4194304,4194304] 0 2024-04-20T10:54:37.951 INFO:tasks.workunit.client.0.smithi090.stdout:3/161: mkdir d7/d35 0 2024-04-20T10:54:37.953 INFO:tasks.workunit.client.0.smithi090.stdout:9/251: creat d0/da/d1f/d34/d42/f53 x:0 0 0 2024-04-20T10:54:37.953 INFO:tasks.workunit.client.0.smithi090.stdout:5/359: symlink d1/d2f/d3d/d40/l72 0 2024-04-20T10:54:37.954 INFO:tasks.workunit.client.0.smithi090.stdout:7/197: creat d11/d13/d23/f45 x:0 0 0 2024-04-20T10:54:37.956 INFO:tasks.workunit.client.0.smithi090.stdout:0/192: dwrite d14/f2a [0,4194304] 0 2024-04-20T10:54:37.956 INFO:tasks.workunit.client.0.smithi090.stdout:2/255: link d11/d1a/d37/f44 d11/d1a/f58 0 2024-04-20T10:54:37.958 INFO:tasks.workunit.client.0.smithi090.stdout:0/193: dread d14/f32 [0,4194304] 0 2024-04-20T10:54:37.959 INFO:tasks.workunit.client.0.smithi090.stdout:9/252: rename d0/da/c45 to d0/da/d1f/d35/c54 0 2024-04-20T10:54:37.961 INFO:tasks.workunit.client.0.smithi090.stdout:5/360: unlink d1/da/d1f/c24 0 2024-04-20T10:54:37.965 INFO:tasks.workunit.client.0.smithi090.stdout:0/194: dread fe [0,4194304] 0 2024-04-20T10:54:37.965 INFO:tasks.workunit.client.0.smithi090.stdout:0/195: chown d14/f1e 7725 1 2024-04-20T10:54:37.965 INFO:tasks.workunit.client.0.smithi090.stdout:0/196: chown f11 29267 1 2024-04-20T10:54:37.966 INFO:tasks.workunit.client.0.smithi090.stdout:1/160: dread d8/fe [0,4194304] 0 2024-04-20T10:54:37.967 INFO:tasks.workunit.client.0.smithi090.stdout:7/198: dread f9 [0,4194304] 0 2024-04-20T10:54:37.968 INFO:tasks.workunit.client.0.smithi090.stdout:2/256: rename d11/d1a/d4a/d54 to d11/d1a/d4a/d59 0 2024-04-20T10:54:37.968 INFO:tasks.workunit.client.0.smithi090.stdout:9/253: mknod d0/d29/c55 0 2024-04-20T10:54:37.970 INFO:tasks.workunit.client.0.smithi090.stdout:5/361: creat d1/d2f/d3d/d40/d70/f73 x:0 0 0 2024-04-20T10:54:37.970 INFO:tasks.workunit.client.0.smithi090.stdout:5/362: chown d1/d2f/l36 125334148 1 2024-04-20T10:54:37.970 INFO:tasks.workunit.client.0.smithi090.stdout:1/161: truncate d8/fe 743508 0 2024-04-20T10:54:37.970 INFO:tasks.workunit.client.0.smithi090.stdout:0/197: dread f9 [0,4194304] 0 2024-04-20T10:54:37.971 INFO:tasks.workunit.client.0.smithi090.stdout:7/199: creat d11/d1a/f46 x:0 0 0 2024-04-20T10:54:37.971 INFO:tasks.workunit.client.0.smithi090.stdout:2/257: symlink d11/d1f/d2e/l5a 0 2024-04-20T10:54:37.972 INFO:tasks.workunit.client.0.smithi090.stdout:9/254: mkdir d0/da/d1f/d34/d42/d56 0 2024-04-20T10:54:37.973 INFO:tasks.workunit.client.0.smithi090.stdout:5/363: rename d1/da/d14/f1d to d1/d55/f74 0 2024-04-20T10:54:37.974 INFO:tasks.workunit.client.0.smithi090.stdout:1/162: truncate d8/d19/f29 2638333 0 2024-04-20T10:54:37.974 INFO:tasks.workunit.client.0.smithi090.stdout:1/163: write d8/f1f [1024796,78652] 0 2024-04-20T10:54:37.975 INFO:tasks.workunit.client.0.smithi090.stdout:0/198: rename d14/d19/d2b/d36 to d14/d19/d2b/d3f 0 2024-04-20T10:54:37.975 INFO:tasks.workunit.client.0.smithi090.stdout:0/199: write d14/f1f [1868535,82132] 0 2024-04-20T10:54:37.975 INFO:tasks.workunit.client.0.smithi090.stdout:0/200: chown d14/c20 120123 1 2024-04-20T10:54:37.976 INFO:tasks.workunit.client.0.smithi090.stdout:7/200: creat d11/d13/d22/d24/d35/f47 x:0 0 0 2024-04-20T10:54:37.977 INFO:tasks.workunit.client.0.smithi090.stdout:2/258: rename d11/d1a/d2b/f38 to d11/d1f/d2e/f5b 0 2024-04-20T10:54:37.977 INFO:tasks.workunit.client.0.smithi090.stdout:2/259: write d11/d1a/d2b/f2f [3882776,22739] 0 2024-04-20T10:54:37.978 INFO:tasks.workunit.client.0.smithi090.stdout:1/164: mknod d8/d1a/d1d/d2c/c36 0 2024-04-20T10:54:37.980 INFO:tasks.workunit.client.0.smithi090.stdout:0/201: dread d14/d19/d2b/f3d [0,4194304] 0 2024-04-20T10:54:37.980 INFO:tasks.workunit.client.0.smithi090.stdout:4/141: dwrite d7/d9/f20 [0,4194304] 0 2024-04-20T10:54:37.981 INFO:tasks.workunit.client.0.smithi090.stdout:8/276: dwrite d0/f36 [0,4194304] 0 2024-04-20T10:54:37.981 INFO:tasks.workunit.client.0.smithi090.stdout:8/277: write d0/d2d/f48 [960216,3489] 0 2024-04-20T10:54:37.981 INFO:tasks.workunit.client.0.smithi090.stdout:6/205: dwrite d1/d4/d26/d11/f41 [0,4194304] 0 2024-04-20T10:54:37.988 INFO:tasks.workunit.client.0.smithi090.stdout:5/364: write d1/f7 [542521,35563] 0 2024-04-20T10:54:37.988 INFO:tasks.workunit.client.0.smithi090.stdout:5/365: write d1/da/d14/d47/d50/f5c [420214,88835] 0 2024-04-20T10:54:37.988 INFO:tasks.workunit.client.0.smithi090.stdout:5/366: readlink d1/da/d16/l3a 0 2024-04-20T10:54:37.990 INFO:tasks.workunit.client.0.smithi090.stdout:1/165: dread d8/fd [8388608,4194304] 0 2024-04-20T10:54:37.990 INFO:tasks.workunit.client.0.smithi090.stdout:1/166: readlink d8/l35 0 2024-04-20T10:54:37.990 INFO:tasks.workunit.client.0.smithi090.stdout:1/167: stat d8/d1a 0 2024-04-20T10:54:37.990 INFO:tasks.workunit.client.0.smithi090.stdout:1/168: dread - d8/d19/d31/f33 zero size 2024-04-20T10:54:37.992 INFO:tasks.workunit.client.0.smithi090.stdout:2/260: rename d11/d1a/f1d to d11/d1a/d4a/d59/f5c 0 2024-04-20T10:54:37.992 INFO:tasks.workunit.client.0.smithi090.stdout:4/142: link d7/d9/f10 d7/f26 0 2024-04-20T10:54:37.993 INFO:tasks.workunit.client.0.smithi090.stdout:0/202: write d14/d19/d2b/f3d [2061208,105782] 0 2024-04-20T10:54:37.993 INFO:tasks.workunit.client.0.smithi090.stdout:0/203: dread - d14/d19/d2b/f3e zero size 2024-04-20T10:54:37.993 INFO:tasks.workunit.client.0.smithi090.stdout:7/201: truncate d11/d13/d23/f2b 3810918 0 2024-04-20T10:54:37.993 INFO:tasks.workunit.client.0.smithi090.stdout:7/202: chown d11/d13 0 1 2024-04-20T10:54:37.995 INFO:tasks.workunit.client.0.smithi090.stdout:9/255: dwrite d0/da/d1c/f21 [0,4194304] 0 2024-04-20T10:54:37.999 INFO:tasks.workunit.client.0.smithi090.stdout:1/169: mknod d8/d19/d31/c37 0 2024-04-20T10:54:38.002 INFO:tasks.workunit.client.0.smithi090.stdout:7/203: link lc d11/d13/d33/l48 0 2024-04-20T10:54:38.005 INFO:tasks.workunit.client.0.smithi090.stdout:6/206: dwrite d1/d4/d26/ff [0,4194304] 0 2024-04-20T10:54:38.007 INFO:tasks.workunit.client.0.smithi090.stdout:8/278: dwrite d0/fe [4194304,4194304] 0 2024-04-20T10:54:38.008 INFO:tasks.workunit.client.0.smithi090.stdout:9/256: getdents d0/d29 0 2024-04-20T10:54:38.008 INFO:tasks.workunit.client.0.smithi090.stdout:9/257: write d0/da/f31 [325345,54631] 0 2024-04-20T10:54:38.009 INFO:tasks.workunit.client.0.smithi090.stdout:9/258: write d0/d29/d4f/f2d [495651,93793] 0 2024-04-20T10:54:38.013 INFO:tasks.workunit.client.0.smithi090.stdout:5/367: mkdir d1/de/d75 0 2024-04-20T10:54:38.015 INFO:tasks.workunit.client.0.smithi090.stdout:7/204: rename d11/d13/l39 to d11/d1a/d2f/l49 0 2024-04-20T10:54:38.016 INFO:tasks.workunit.client.0.smithi090.stdout:9/259: creat d0/d29/f57 x:0 0 0 2024-04-20T10:54:38.016 INFO:tasks.workunit.client.0.smithi090.stdout:9/260: fdatasync d0/da/d1f/d35/f3c 0 2024-04-20T10:54:38.016 INFO:tasks.workunit.client.0.smithi090.stdout:9/261: truncate d0/da/d1f/d34/d42/f53 412270 0 2024-04-20T10:54:38.017 INFO:tasks.workunit.client.0.smithi090.stdout:5/368: rmdir d1/da/d14/d47 39 2024-04-20T10:54:38.017 INFO:tasks.workunit.client.0.smithi090.stdout:5/369: fdatasync d1/da/f2c 0 2024-04-20T10:54:38.017 INFO:tasks.workunit.client.0.smithi090.stdout:5/370: stat d1/d2f/d3d/d40/f45 0 2024-04-20T10:54:38.017 INFO:tasks.workunit.client.0.smithi090.stdout:5/371: chown d1/d55/f74 670133737 1 2024-04-20T10:54:38.018 INFO:tasks.workunit.client.0.smithi090.stdout:6/207: rename d1/d4/d26/cb to d1/c49 0 2024-04-20T10:54:38.018 INFO:tasks.workunit.client.0.smithi090.stdout:8/279: dread d0/f8 [0,4194304] 0 2024-04-20T10:54:38.019 INFO:tasks.workunit.client.0.smithi090.stdout:7/205: rmdir d11/d13/d22/d24/d35 39 2024-04-20T10:54:38.019 INFO:tasks.workunit.client.0.smithi090.stdout:7/206: write d11/d13/d23/f45 [198491,126777] 0 2024-04-20T10:54:38.020 INFO:tasks.workunit.client.0.smithi090.stdout:1/170: dwrite d8/d1a/d1d/f24 [0,4194304] 0 2024-04-20T10:54:38.020 INFO:tasks.workunit.client.0.smithi090.stdout:1/171: chown d8/f12 1 1 2024-04-20T10:54:38.020 INFO:tasks.workunit.client.0.smithi090.stdout:9/262: creat d0/da/d1f/d34/d42/d56/f58 x:0 0 0 2024-04-20T10:54:38.021 INFO:tasks.workunit.client.0.smithi090.stdout:6/208: mkdir d1/d4/d26/d11/d4a 0 2024-04-20T10:54:38.022 INFO:tasks.workunit.client.0.smithi090.stdout:8/280: mkdir d0/d11/d14/d52 0 2024-04-20T10:54:38.024 INFO:tasks.workunit.client.0.smithi090.stdout:0/204: dwrite f5 [0,4194304] 0 2024-04-20T10:54:38.025 INFO:tasks.workunit.client.0.smithi090.stdout:1/172: symlink d8/d19/l38 0 2024-04-20T10:54:38.025 INFO:tasks.workunit.client.0.smithi090.stdout:1/173: write d8/fb [4159314,59374] 0 2024-04-20T10:54:38.026 INFO:tasks.workunit.client.0.smithi090.stdout:9/263: creat d0/da/d1f/d34/d42/d56/f59 x:0 0 0 2024-04-20T10:54:38.027 INFO:tasks.workunit.client.0.smithi090.stdout:8/281: dread d0/f17 [0,4194304] 0 2024-04-20T10:54:38.028 INFO:tasks.workunit.client.0.smithi090.stdout:7/207: dread f8 [0,4194304] 0 2024-04-20T10:54:38.029 INFO:tasks.workunit.client.0.smithi090.stdout:5/372: write d1/da/d14/f4c [388497,61082] 0 2024-04-20T10:54:38.029 INFO:tasks.workunit.client.0.smithi090.stdout:1/174: creat d8/d1a/f39 x:0 0 0 2024-04-20T10:54:38.031 INFO:tasks.workunit.client.0.smithi090.stdout:2/261: dread fd [0,4194304] 0 2024-04-20T10:54:38.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/282: mkdir d0/d11/d22/d53 0 2024-04-20T10:54:38.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/283: dread - d0/f28 zero size 2024-04-20T10:54:38.033 INFO:tasks.workunit.client.0.smithi090.stdout:0/205: dread f5 [0,4194304] 0 2024-04-20T10:54:38.034 INFO:tasks.workunit.client.0.smithi090.stdout:5/373: creat d1/da/d14/d47/d39/f76 x:0 0 0 2024-04-20T10:54:38.035 INFO:tasks.workunit.client.0.smithi090.stdout:1/175: link d8/l18 d8/d1a/d1d/l3a 0 2024-04-20T10:54:38.037 INFO:tasks.workunit.client.0.smithi090.stdout:2/262: creat d11/d1f/d2e/f5d x:0 0 0 2024-04-20T10:54:38.038 INFO:tasks.workunit.client.0.smithi090.stdout:8/284: creat d0/d11/d22/d53/f54 x:0 0 0 2024-04-20T10:54:38.040 INFO:tasks.workunit.client.0.smithi090.stdout:0/206: mkdir d14/d19/d2b/d3f/d40 0 2024-04-20T10:54:38.040 INFO:tasks.workunit.client.0.smithi090.stdout:8/285: write d0/d11/d14/f2b [894503,79198] 0 2024-04-20T10:54:38.042 INFO:tasks.workunit.client.0.smithi090.stdout:5/374: symlink d1/da/d14/d47/d50/l77 0 2024-04-20T10:54:38.044 INFO:tasks.workunit.client.0.smithi090.stdout:2/263: mknod d11/c5e 0 2024-04-20T10:54:38.044 INFO:tasks.workunit.client.0.smithi090.stdout:6/209: write d1/d4/d26/d11/f41 [1898550,21558] 0 2024-04-20T10:54:38.044 INFO:tasks.workunit.client.0.smithi090.stdout:0/207: getdents d14 0 2024-04-20T10:54:38.047 INFO:tasks.workunit.client.0.smithi090.stdout:5/375: mknod d1/da/d14/d47/d39/c78 0 2024-04-20T10:54:38.048 INFO:tasks.workunit.client.0.smithi090.stdout:2/264: symlink d11/d1f/d2e/l5f 0 2024-04-20T10:54:38.050 INFO:tasks.workunit.client.0.smithi090.stdout:9/264: rename d0/da/d1f/d34/d42 to d0/da/d1c/d5a 0 2024-04-20T10:54:38.052 INFO:tasks.workunit.client.0.smithi090.stdout:5/376: getdents d1/d2f 0 2024-04-20T10:54:38.055 INFO:tasks.workunit.client.0.smithi090.stdout:6/210: rename d1/d4/d26/d11/f44 to d1/d19/d36/d1e/d1f/d3f/f4b 0 2024-04-20T10:54:38.055 INFO:tasks.workunit.client.0.smithi090.stdout:1/176: dread d8/f2a [0,4194304] 0 2024-04-20T10:54:38.055 INFO:tasks.workunit.client.0.smithi090.stdout:7/208: dwrite f9 [4194304,4194304] 0 2024-04-20T10:54:38.055 INFO:tasks.workunit.client.0.smithi090.stdout:7/209: stat d11/d1a/d2f 0 2024-04-20T10:54:38.055 INFO:tasks.workunit.client.0.smithi090.stdout:7/210: fdatasync d11/d13/f1d 0 2024-04-20T10:54:38.056 INFO:tasks.workunit.client.0.smithi090.stdout:9/265: mknod d0/da/d1f/d4d/c5b 0 2024-04-20T10:54:38.056 INFO:tasks.workunit.client.0.smithi090.stdout:9/266: chown d0/da/f3d 98307 1 2024-04-20T10:54:38.056 INFO:tasks.workunit.client.0.smithi090.stdout:9/267: write d0/da/d1c/f2a [4796275,21638] 0 2024-04-20T10:54:38.056 INFO:tasks.workunit.client.0.smithi090.stdout:1/177: dread f5 [0,4194304] 0 2024-04-20T10:54:38.056 INFO:tasks.workunit.client.0.smithi090.stdout:1/178: write d8/fd [4518986,97055] 0 2024-04-20T10:54:38.057 INFO:tasks.workunit.client.0.smithi090.stdout:1/179: chown d8/c10 3 1 2024-04-20T10:54:38.057 INFO:tasks.workunit.client.0.smithi090.stdout:5/377: creat d1/da/d14/d47/d39/f79 x:0 0 0 2024-04-20T10:54:38.060 INFO:tasks.workunit.client.0.smithi090.stdout:7/211: symlink d11/d13/d22/d24/d35/l4a 0 2024-04-20T10:54:38.061 INFO:tasks.workunit.client.0.smithi090.stdout:9/268: creat d0/da/d1c/f5c x:0 0 0 2024-04-20T10:54:38.063 INFO:tasks.workunit.client.0.smithi090.stdout:1/180: rename d8/d19/f30 to d8/d1a/f3b 0 2024-04-20T10:54:38.063 INFO:tasks.workunit.client.0.smithi090.stdout:0/208: dwrite d14/f2e [0,4194304] 0 2024-04-20T10:54:38.063 INFO:tasks.workunit.client.0.smithi090.stdout:0/209: stat d14/d19/f1c 0 2024-04-20T10:54:38.063 INFO:tasks.workunit.client.0.smithi090.stdout:5/378: truncate d1/d2a/f35 2008299 0 2024-04-20T10:54:38.065 INFO:tasks.workunit.client.0.smithi090.stdout:7/212: creat d11/d13/d22/f4b x:0 0 0 2024-04-20T10:54:38.065 INFO:tasks.workunit.client.0.smithi090.stdout:7/213: dread - d11/d13/d23/f26 zero size 2024-04-20T10:54:38.065 INFO:tasks.workunit.client.0.smithi090.stdout:7/214: fdatasync d11/d13/d22/d24/f2a 0 2024-04-20T10:54:38.065 INFO:tasks.workunit.client.0.smithi090.stdout:9/269: rmdir d0/da/d1f/d4d 39 2024-04-20T10:54:38.069 INFO:tasks.workunit.client.0.smithi090.stdout:1/181: unlink d8/d19/d31/f33 0 2024-04-20T10:54:38.069 INFO:tasks.workunit.client.0.smithi090.stdout:1/182: read d8/fb [947722,28261] 0 2024-04-20T10:54:38.069 INFO:tasks.workunit.client.0.smithi090.stdout:1/183: truncate d8/f34 66990 0 2024-04-20T10:54:38.070 INFO:tasks.workunit.client.0.smithi090.stdout:5/379: rename d1/da/d14/d47/d39/c78 to d1/d41/c7a 0 2024-04-20T10:54:38.071 INFO:tasks.workunit.client.0.smithi090.stdout:7/215: getdents d11/d1a 0 2024-04-20T10:54:38.072 INFO:tasks.workunit.client.0.smithi090.stdout:0/210: write f11 [6982000,71367] 0 2024-04-20T10:54:38.072 INFO:tasks.workunit.client.0.smithi090.stdout:1/184: symlink d8/d1a/d1d/l3c 0 2024-04-20T10:54:38.072 INFO:tasks.workunit.client.0.smithi090.stdout:1/185: chown d8/l14 10414481 1 2024-04-20T10:54:38.073 INFO:tasks.workunit.client.0.smithi090.stdout:1/186: stat d8/d1a/f3b 0 2024-04-20T10:54:38.073 INFO:tasks.workunit.client.0.smithi090.stdout:5/380: symlink d1/d2f/d3d/l7b 0 2024-04-20T10:54:38.075 INFO:tasks.workunit.client.0.smithi090.stdout:6/211: dwrite d1/d19/d36/f27 [0,4194304] 0 2024-04-20T10:54:38.075 INFO:tasks.workunit.client.0.smithi090.stdout:7/216: rename d11/f16 to d11/d13/d22/f4c 0 2024-04-20T10:54:38.077 INFO:tasks.workunit.client.0.smithi090.stdout:0/211: mkdir d14/d41 0 2024-04-20T10:54:38.077 INFO:tasks.workunit.client.0.smithi090.stdout:0/212: chown d14/d19/d2b/d3f 7 1 2024-04-20T10:54:38.078 INFO:tasks.workunit.client.0.smithi090.stdout:6/212: creat d1/f4c x:0 0 0 2024-04-20T10:54:38.079 INFO:tasks.workunit.client.0.smithi090.stdout:7/217: creat d11/d13/d33/f4d x:0 0 0 2024-04-20T10:54:38.080 INFO:tasks.workunit.client.0.smithi090.stdout:6/213: creat d1/d4/d26/f4d x:0 0 0 2024-04-20T10:54:38.081 INFO:tasks.workunit.client.0.smithi090.stdout:7/218: symlink d11/d13/d22/l4e 0 2024-04-20T10:54:38.085 INFO:tasks.workunit.client.0.smithi090.stdout:6/214: fdatasync d1/d4/d26/d11/f41 0 2024-04-20T10:54:38.087 INFO:tasks.workunit.client.0.smithi090.stdout:5/381: write d1/d2f/d3d/d40/f45 [1368246,33983] 0 2024-04-20T10:54:38.087 INFO:tasks.workunit.client.0.smithi090.stdout:9/270: dwrite d0/f51 [4194304,4194304] 0 2024-04-20T10:54:38.087 INFO:tasks.workunit.client.0.smithi090.stdout:5/382: chown d1/da/d16/c4e 0 1 2024-04-20T10:54:38.088 INFO:tasks.workunit.client.0.smithi090.stdout:9/271: chown d0/c16 0 1 2024-04-20T10:54:38.088 INFO:tasks.workunit.client.0.smithi090.stdout:5/383: write d1/d2f/d3d/d40/f45 [1877404,88074] 0 2024-04-20T10:54:38.089 INFO:tasks.workunit.client.0.smithi090.stdout:2/265: dwrite d11/d1a/d37/f44 [0,4194304] 0 2024-04-20T10:54:38.089 INFO:tasks.workunit.client.0.smithi090.stdout:2/266: dread - d11/d1a/d4a/f4e zero size 2024-04-20T10:54:38.089 INFO:tasks.workunit.client.0.smithi090.stdout:6/215: unlink d1/d4/l21 0 2024-04-20T10:54:38.090 INFO:tasks.workunit.client.0.smithi090.stdout:5/384: getdents d1/d2a 0 2024-04-20T10:54:38.092 INFO:tasks.workunit.client.0.smithi090.stdout:2/267: symlink d11/d1a/d4a/d55/l60 0 2024-04-20T10:54:38.092 INFO:tasks.workunit.client.0.smithi090.stdout:2/268: write d11/d1a/d4a/f4e [624519,129474] 0 2024-04-20T10:54:38.092 INFO:tasks.workunit.client.0.smithi090.stdout:2/269: readlink l2 0 2024-04-20T10:54:38.093 INFO:tasks.workunit.client.0.smithi090.stdout:9/272: symlink d0/d29/d36/l5d 0 2024-04-20T10:54:38.093 INFO:tasks.workunit.client.0.smithi090.stdout:9/273: truncate d0/da/f2f 869893 0 2024-04-20T10:54:38.093 INFO:tasks.workunit.client.0.smithi090.stdout:9/274: write d0/da/f31 [710413,110036] 0 2024-04-20T10:54:38.093 INFO:tasks.workunit.client.0.smithi090.stdout:1/187: getdents d8/d1a/d1d 0 2024-04-20T10:54:38.093 INFO:tasks.workunit.client.0.smithi090.stdout:1/188: write f5 [833601,122655] 0 2024-04-20T10:54:38.094 INFO:tasks.workunit.client.0.smithi090.stdout:5/385: rename d1/f66 to d1/da/d14/d47/d50/f7c 0 2024-04-20T10:54:38.095 INFO:tasks.workunit.client.0.smithi090.stdout:2/270: rmdir d11/d1a/d37 39 2024-04-20T10:54:38.095 INFO:tasks.workunit.client.0.smithi090.stdout:2/271: read d11/d1a/d2b/f2f [4779264,100598] 0 2024-04-20T10:54:38.097 INFO:tasks.workunit.client.0.smithi090.stdout:9/275: mknod d0/da/d1c/d5a/c5e 0 2024-04-20T10:54:38.099 INFO:tasks.workunit.client.0.smithi090.stdout:1/189: dread d8/fd [0,4194304] 0 2024-04-20T10:54:38.101 INFO:tasks.workunit.client.0.smithi090.stdout:5/386: symlink d1/da/d1f/l7d 0 2024-04-20T10:54:38.101 INFO:tasks.workunit.client.0.smithi090.stdout:5/387: dread - d1/da/d14/d47/d39/f6f zero size 2024-04-20T10:54:38.101 INFO:tasks.workunit.client.0.smithi090.stdout:5/388: truncate d1/d2f/d3d/f5b 1140388 0 2024-04-20T10:54:38.102 INFO:tasks.workunit.client.0.smithi090.stdout:9/276: mknod d0/da/d1f/d4d/c5f 0 2024-04-20T10:54:38.102 INFO:tasks.workunit.client.0.smithi090.stdout:9/277: dread - d0/da/d1c/d5a/d52/f49 zero size 2024-04-20T10:54:38.102 INFO:tasks.workunit.client.0.smithi090.stdout:9/278: readlink d0/l28 0 2024-04-20T10:54:38.103 INFO:tasks.workunit.client.0.smithi090.stdout:1/190: rmdir d8/d1a/d1d/d2c 39 2024-04-20T10:54:38.104 INFO:tasks.workunit.client.0.smithi090.stdout:9/279: dread - d0/d29/d4f/f27 zero size 2024-04-20T10:54:38.110 INFO:tasks.workunit.client.0.smithi090.stdout:0/213: truncate d14/d19/d2b/f3d 393489 0 2024-04-20T10:54:38.110 INFO:tasks.workunit.client.0.smithi090.stdout:1/191: rmdir d8/d1a 39 2024-04-20T10:54:38.111 INFO:tasks.workunit.client.0.smithi090.stdout:0/214: mknod d14/d19/d31/d34/c42 0 2024-04-20T10:54:38.111 INFO:tasks.workunit.client.0.smithi090.stdout:0/215: read - d14/d19/d2c/f35 zero size 2024-04-20T10:54:38.112 INFO:tasks.workunit.client.0.smithi090.stdout:1/192: rename d8/f11 to d8/d19/f3d 0 2024-04-20T10:54:38.113 INFO:tasks.workunit.client.0.smithi090.stdout:0/216: chown c8 1 1 2024-04-20T10:54:38.113 INFO:tasks.workunit.client.0.smithi090.stdout:0/217: truncate d14/d19/d2b/f30 4512691 0 2024-04-20T10:54:38.114 INFO:tasks.workunit.client.0.smithi090.stdout:1/193: creat d8/f3e x:0 0 0 2024-04-20T10:54:38.116 INFO:tasks.workunit.client.0.smithi090.stdout:7/219: read f0 [3652153,110483] 0 2024-04-20T10:54:38.116 INFO:tasks.workunit.client.0.smithi090.stdout:7/220: write d11/d13/d23/f26 [910521,86693] 0 2024-04-20T10:54:38.116 INFO:tasks.workunit.client.0.smithi090.stdout:6/216: dwrite d1/d4/f1d [0,4194304] 0 2024-04-20T10:54:38.119 INFO:tasks.workunit.client.0.smithi090.stdout:2/272: dwrite d11/d1a/d4a/d59/f5c [0,4194304] 0 2024-04-20T10:54:38.119 INFO:tasks.workunit.client.0.smithi090.stdout:2/273: chown fc 13 1 2024-04-20T10:54:38.120 INFO:tasks.workunit.client.0.smithi090.stdout:0/218: chown f4 28131841 1 2024-04-20T10:54:38.124 INFO:tasks.workunit.client.0.smithi090.stdout:5/389: dwrite d1/da/d14/d47/d39/f76 [0,4194304] 0 2024-04-20T10:54:38.126 INFO:tasks.workunit.client.0.smithi090.stdout:7/221: fsync d11/d13/d23/f26 0 2024-04-20T10:54:38.126 INFO:tasks.workunit.client.0.smithi090.stdout:0/219: mkdir d14/d19/d2b/d3f/d43 0 2024-04-20T10:54:38.126 INFO:tasks.workunit.client.0.smithi090.stdout:0/220: getdents d14/d19/d31/d34/d3b 0 2024-04-20T10:54:38.127 INFO:tasks.workunit.client.0.smithi090.stdout:6/217: write d1/d4/f47 [1593073,20421] 0 2024-04-20T10:54:38.129 INFO:tasks.workunit.client.0.smithi090.stdout:1/194: dread f6 [4194304,4194304] 0 2024-04-20T10:54:38.131 INFO:tasks.workunit.client.0.smithi090.stdout:5/390: creat d1/da/d14/d47/f7e x:0 0 0 2024-04-20T10:54:38.131 INFO:tasks.workunit.client.0.smithi090.stdout:5/391: truncate d1/da/d16/f6b 606413 0 2024-04-20T10:54:38.132 INFO:tasks.workunit.client.0.smithi090.stdout:0/221: read f5 [3954402,90350] 0 2024-04-20T10:54:38.133 INFO:tasks.workunit.client.0.smithi090.stdout:7/222: rename d11/d13/d33/c37 to d11/d13/d22/d27/c4f 0 2024-04-20T10:54:38.133 INFO:tasks.workunit.client.0.smithi090.stdout:0/222: read f13 [200306,98331] 0 2024-04-20T10:54:38.135 INFO:tasks.workunit.client.0.smithi090.stdout:6/218: link d1/d19/d25/c29 d1/d4/d3a/c4e 0 2024-04-20T10:54:38.138 INFO:tasks.workunit.client.0.smithi090.stdout:2/274: dwrite d11/f16 [0,4194304] 0 2024-04-20T10:54:38.138 INFO:tasks.workunit.client.0.smithi090.stdout:1/195: mkdir d8/d1a/d1d/d2c/d3f 0 2024-04-20T10:54:38.140 INFO:tasks.workunit.client.0.smithi090.stdout:5/392: creat d1/de/d75/f7f x:0 0 0 2024-04-20T10:54:38.140 INFO:tasks.workunit.client.0.smithi090.stdout:5/393: chown d1/da/c67 226487 1 2024-04-20T10:54:38.142 INFO:tasks.workunit.client.0.smithi090.stdout:7/223: link d11/d13/d22/d24/f2a d11/d13/d22/d27/f50 0 2024-04-20T10:54:38.143 INFO:tasks.workunit.client.0.smithi090.stdout:0/223: symlink d14/d19/d2b/l44 0 2024-04-20T10:54:38.144 INFO:tasks.workunit.client.0.smithi090.stdout:5/394: mkdir d1/d2f/d80 0 2024-04-20T10:54:38.144 INFO:tasks.workunit.client.0.smithi090.stdout:2/275: read d11/f20 [98792,117751] 0 2024-04-20T10:54:38.147 INFO:tasks.workunit.client.0.smithi090.stdout:5/395: symlink d1/da/d16/l81 0 2024-04-20T10:54:38.149 INFO:tasks.workunit.client.0.smithi090.stdout:1/196: dread d8/f2a [0,4194304] 0 2024-04-20T10:54:38.149 INFO:tasks.workunit.client.0.smithi090.stdout:1/197: chown d8/d19/d31/c2b 443353 1 2024-04-20T10:54:38.151 INFO:tasks.workunit.client.0.smithi090.stdout:2/276: creat d11/d1a/d30/f61 x:0 0 0 2024-04-20T10:54:38.152 INFO:tasks.workunit.client.0.smithi090.stdout:1/198: mknod d8/d1a/d1d/d2c/d3f/c40 0 2024-04-20T10:54:38.158 INFO:tasks.workunit.client.0.smithi090.stdout:5/396: dread d1/da/f1e [0,4194304] 0 2024-04-20T10:54:38.163 INFO:tasks.workunit.client.0.smithi090.stdout:6/219: dwrite d1/d19/d36/d28/f34 [0,4194304] 0 2024-04-20T10:54:38.163 INFO:tasks.workunit.client.0.smithi090.stdout:0/224: dwrite d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:38.164 INFO:tasks.workunit.client.0.smithi090.stdout:2/277: creat d11/f62 x:0 0 0 2024-04-20T10:54:38.165 INFO:tasks.workunit.client.0.smithi090.stdout:2/278: readlink d11/d1a/d2b/l34 0 2024-04-20T10:54:38.165 INFO:tasks.workunit.client.0.smithi090.stdout:6/220: getdents d1/d4 0 2024-04-20T10:54:38.166 INFO:tasks.workunit.client.0.smithi090.stdout:0/225: rename d14/c26 to d14/d19/d2b/d3f/d40/c45 0 2024-04-20T10:54:38.166 INFO:tasks.workunit.client.0.smithi090.stdout:2/279: getdents d11/d1a 0 2024-04-20T10:54:38.167 INFO:tasks.workunit.client.0.smithi090.stdout:0/226: creat d14/d19/d2b/d3f/d43/f46 x:0 0 0 2024-04-20T10:54:38.168 INFO:tasks.workunit.client.0.smithi090.stdout:2/280: symlink d11/d1a/l63 0 2024-04-20T10:54:38.170 INFO:tasks.workunit.client.0.smithi090.stdout:1/199: dwrite d8/f2d [0,4194304] 0 2024-04-20T10:54:38.173 INFO:tasks.workunit.client.0.smithi090.stdout:1/200: creat d8/d1a/d1d/d2c/d3f/f41 x:0 0 0 2024-04-20T10:54:38.175 INFO:tasks.workunit.client.0.smithi090.stdout:5/397: dwrite d1/da/f1e [0,4194304] 0 2024-04-20T10:54:38.175 INFO:tasks.workunit.client.0.smithi090.stdout:5/398: readlink d1/da/d14/d47/l43 0 2024-04-20T10:54:38.175 INFO:tasks.workunit.client.0.smithi090.stdout:6/221: truncate d1/d4/f1d 1101075 0 2024-04-20T10:54:38.176 INFO:tasks.workunit.client.0.smithi090.stdout:2/281: mknod d11/d1a/d37/c64 0 2024-04-20T10:54:38.177 INFO:tasks.workunit.client.0.smithi090.stdout:5/399: creat d1/d2f/d3d/d40/d6c/f82 x:0 0 0 2024-04-20T10:54:38.177 INFO:tasks.workunit.client.0.smithi090.stdout:5/400: fsync d1/d55/f74 0 2024-04-20T10:54:38.177 INFO:tasks.workunit.client.0.smithi090.stdout:5/401: fdatasync d1/d2f/d3d/d40/f45 0 2024-04-20T10:54:38.177 INFO:tasks.workunit.client.0.smithi090.stdout:6/222: truncate d1/d19/d36/d28/f2a 153023 0 2024-04-20T10:54:38.177 INFO:tasks.workunit.client.0.smithi090.stdout:6/223: readlink d1/d19/d25/l43 0 2024-04-20T10:54:38.179 INFO:tasks.workunit.client.0.smithi090.stdout:0/227: write fd [2915578,80527] 0 2024-04-20T10:54:38.180 INFO:tasks.workunit.client.0.smithi090.stdout:0/228: link d14/c28 d14/c47 0 2024-04-20T10:54:38.180 INFO:tasks.workunit.client.0.smithi090.stdout:0/229: chown d14/l29 83 1 2024-04-20T10:54:38.181 INFO:tasks.workunit.client.0.smithi090.stdout:2/282: mknod d11/d1a/d30/c65 0 2024-04-20T10:54:38.182 INFO:tasks.workunit.client.0.smithi090.stdout:1/201: dread d8/d1a/d1d/f24 [0,4194304] 0 2024-04-20T10:54:38.185 INFO:tasks.workunit.client.0.smithi090.stdout:0/230: rename d14/c28 to d14/d19/d31/d34/d3b/c48 0 2024-04-20T10:54:38.186 INFO:tasks.workunit.client.0.smithi090.stdout:0/231: readlink d14/d19/l3c 0 2024-04-20T10:54:38.186 INFO:tasks.workunit.client.0.smithi090.stdout:0/232: truncate d14/f1e 1169087 0 2024-04-20T10:54:38.187 INFO:tasks.workunit.client.0.smithi090.stdout:1/202: creat d8/d1a/d1d/d2c/f42 x:0 0 0 2024-04-20T10:54:38.188 INFO:tasks.workunit.client.0.smithi090.stdout:0/233: creat d14/d41/f49 x:0 0 0 2024-04-20T10:54:38.189 INFO:tasks.workunit.client.0.smithi090.stdout:6/224: dread d1/d19/d36/d28/f2a [0,4194304] 0 2024-04-20T10:54:38.189 INFO:tasks.workunit.client.0.smithi090.stdout:1/203: link d8/d19/l20 d8/d19/d31/l43 0 2024-04-20T10:54:38.190 INFO:tasks.workunit.client.0.smithi090.stdout:0/234: link d14/d19/d2b/f3e d14/d19/d2b/d3f/d43/f4a 0 2024-04-20T10:54:38.192 INFO:tasks.workunit.client.0.smithi090.stdout:6/225: creat d1/d4/d3a/f4f x:0 0 0 2024-04-20T10:54:38.192 INFO:tasks.workunit.client.0.smithi090.stdout:1/204: creat d8/f44 x:0 0 0 2024-04-20T10:54:38.193 INFO:tasks.workunit.client.0.smithi090.stdout:0/235: creat d14/f4b x:0 0 0 2024-04-20T10:54:38.194 INFO:tasks.workunit.client.0.smithi090.stdout:1/205: read d8/d19/f23 [835582,77791] 0 2024-04-20T10:54:38.194 INFO:tasks.workunit.client.0.smithi090.stdout:1/206: read d8/f34 [17517,15893] 0 2024-04-20T10:54:38.195 INFO:tasks.workunit.client.0.smithi090.stdout:6/226: truncate d1/d4/d26/d11/f41 1568028 0 2024-04-20T10:54:38.195 INFO:tasks.workunit.client.0.smithi090.stdout:6/227: chown d1/d10/c31 0 1 2024-04-20T10:54:38.195 INFO:tasks.workunit.client.0.smithi090.stdout:0/236: mknod d14/d19/d2b/d3f/c4c 0 2024-04-20T10:54:38.195 INFO:tasks.workunit.client.0.smithi090.stdout:0/237: chown d14/d19/l3c 448376794 1 2024-04-20T10:54:38.197 INFO:tasks.workunit.client.0.smithi090.stdout:1/207: unlink f6 0 2024-04-20T10:54:38.198 INFO:tasks.workunit.client.0.smithi090.stdout:6/228: creat d1/d4/f50 x:0 0 0 2024-04-20T10:54:38.198 INFO:tasks.workunit.client.0.smithi090.stdout:6/229: chown d1/d4/d3a/c4e 6 1 2024-04-20T10:54:38.198 INFO:tasks.workunit.client.0.smithi090.stdout:6/230: chown d1/d19/d25/l43 828 1 2024-04-20T10:54:38.198 INFO:tasks.workunit.client.0.smithi090.stdout:0/238: stat d14/c1a 0 2024-04-20T10:54:38.199 INFO:tasks.workunit.client.0.smithi090.stdout:1/208: mkdir d8/d1a/d45 0 2024-04-20T10:54:38.199 INFO:tasks.workunit.client.0.smithi090.stdout:1/209: write d8/f2a [1306374,35298] 0 2024-04-20T10:54:38.199 INFO:tasks.workunit.client.0.smithi090.stdout:6/231: truncate d1/fd 1401056 0 2024-04-20T10:54:38.200 INFO:tasks.workunit.client.0.smithi090.stdout:1/210: creat d8/f46 x:0 0 0 2024-04-20T10:54:38.202 INFO:tasks.workunit.client.0.smithi090.stdout:2/283: dwrite d11/d1f/d2e/f5d [0,4194304] 0 2024-04-20T10:54:38.203 INFO:tasks.workunit.client.0.smithi090.stdout:5/402: dwrite d1/fb [0,4194304] 0 2024-04-20T10:54:38.203 INFO:tasks.workunit.client.0.smithi090.stdout:1/211: creat d8/d1a/f47 x:0 0 0 2024-04-20T10:54:38.203 INFO:tasks.workunit.client.0.smithi090.stdout:1/212: truncate d8/d19/f23 1900140 0 2024-04-20T10:54:38.205 INFO:tasks.workunit.client.0.smithi090.stdout:1/213: write f5 [62986,67912] 0 2024-04-20T10:54:38.205 INFO:tasks.workunit.client.0.smithi090.stdout:1/214: chown d8/d19/d31/l43 30122277 1 2024-04-20T10:54:38.205 INFO:tasks.workunit.client.0.smithi090.stdout:2/284: creat d11/d1f/f66 x:0 0 0 2024-04-20T10:54:38.207 INFO:tasks.workunit.client.0.smithi090.stdout:6/232: fsync d1/d4/d3a/f4f 0 2024-04-20T10:54:38.207 INFO:tasks.workunit.client.0.smithi090.stdout:6/233: stat d1/f6 0 2024-04-20T10:54:38.208 INFO:tasks.workunit.client.0.smithi090.stdout:5/403: creat d1/d2f/f83 x:0 0 0 2024-04-20T10:54:38.210 INFO:tasks.workunit.client.0.smithi090.stdout:1/215: rmdir d8/d19 39 2024-04-20T10:54:38.210 INFO:tasks.workunit.client.0.smithi090.stdout:1/216: write d8/fb [1756096,58048] 0 2024-04-20T10:54:38.210 INFO:tasks.workunit.client.0.smithi090.stdout:1/217: chown d8/d19/f29 8957 1 2024-04-20T10:54:38.211 INFO:tasks.workunit.client.0.smithi090.stdout:1/218: fdatasync d8/f1f 0 2024-04-20T10:54:38.213 INFO:tasks.workunit.client.0.smithi090.stdout:6/234: truncate d1/d19/d36/d1e/f20 1321926 0 2024-04-20T10:54:38.215 INFO:tasks.workunit.client.0.smithi090.stdout:5/404: creat d1/da/d14/d47/f84 x:0 0 0 2024-04-20T10:54:38.215 INFO:tasks.workunit.client.0.smithi090.stdout:2/285: mkdir d11/d1a/d4a/d55/d67 0 2024-04-20T10:54:38.216 INFO:tasks.workunit.client.0.smithi090.stdout:0/239: dwrite d14/f1e [0,4194304] 0 2024-04-20T10:54:38.216 INFO:tasks.workunit.client.0.smithi090.stdout:5/405: mkdir d1/d2f/d85 0 2024-04-20T10:54:38.217 INFO:tasks.workunit.client.0.smithi090.stdout:5/406: fdatasync d1/f7 0 2024-04-20T10:54:38.218 INFO:tasks.workunit.client.0.smithi090.stdout:2/286: truncate d11/d1f/d2e/f3b 581456 0 2024-04-20T10:54:38.221 INFO:tasks.workunit.client.0.smithi090.stdout:0/240: symlink d14/d39/l4d 0 2024-04-20T10:54:38.222 INFO:tasks.workunit.client.0.smithi090.stdout:7/224: dwrite d11/f2c [0,4194304] 0 2024-04-20T10:54:38.223 INFO:tasks.workunit.client.0.smithi090.stdout:5/407: unlink d1/d2a/f35 0 2024-04-20T10:54:38.223 INFO:tasks.workunit.client.0.smithi090.stdout:5/408: chown d1/da/d14/c18 1685631 1 2024-04-20T10:54:38.223 INFO:tasks.workunit.client.0.smithi090.stdout:5/409: chown d1/d2a/f60 1762 1 2024-04-20T10:54:38.223 INFO:tasks.workunit.client.0.smithi090.stdout:5/410: readlink d1/da/l13 0 2024-04-20T10:54:38.224 INFO:tasks.workunit.client.0.smithi090.stdout:0/241: symlink d14/d19/d2b/l4e 0 2024-04-20T10:54:38.227 INFO:tasks.workunit.client.0.smithi090.stdout:5/411: dread d1/d2f/f37 [0,4194304] 0 2024-04-20T10:54:38.232 INFO:tasks.workunit.client.0.smithi090.stdout:6/235: dread d1/d4/f47 [4194304,4194304] 0 2024-04-20T10:54:38.234 INFO:tasks.workunit.client.0.smithi090.stdout:0/242: write fa [2147566,127505] 0 2024-04-20T10:54:38.251 INFO:tasks.workunit.client.0.smithi090.stdout:6/236: dwrite d1/f4c [0,4194304] 0 2024-04-20T10:54:38.251 INFO:tasks.workunit.client.0.smithi090.stdout:7/225: read d11/f2c [4011334,82452] 0 2024-04-20T10:54:38.251 INFO:tasks.workunit.client.0.smithi090.stdout:6/237: truncate d1/d4/d26/d11/f2c 221848 0 2024-04-20T10:54:38.273 INFO:tasks.workunit.client.0.smithi090.stdout:5/412: dwrite d1/d2a/f3e [0,4194304] 0 2024-04-20T10:54:38.273 INFO:tasks.workunit.client.0.smithi090.stdout:2/287: dwrite d11/f31 [4194304,4194304] 0 2024-04-20T10:54:38.273 INFO:tasks.workunit.client.0.smithi090.stdout:0/243: dwrite d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:38.273 INFO:tasks.workunit.client.0.smithi090.stdout:0/244: write d14/d19/d2b/f3e [113878,90620] 0 2024-04-20T10:54:38.273 INFO:tasks.workunit.client.0.smithi090.stdout:6/238: dwrite d1/d4/f1d [0,4194304] 0 2024-04-20T10:54:38.273 INFO:tasks.workunit.client.0.smithi090.stdout:6/239: fsync d1/d19/f2d 0 2024-04-20T10:54:38.274 INFO:tasks.workunit.client.0.smithi090.stdout:7/226: rename d11/f1e to d11/d13/d22/d24/d35/f51 0 2024-04-20T10:54:38.274 INFO:tasks.workunit.client.0.smithi090.stdout:7/227: write f0 [4881973,11183] 0 2024-04-20T10:54:38.276 INFO:tasks.workunit.client.0.smithi090.stdout:5/413: creat d1/da/d16/f86 x:0 0 0 2024-04-20T10:54:38.276 INFO:tasks.workunit.client.0.smithi090.stdout:7/228: dread d11/d13/d23/f45 [0,4194304] 0 2024-04-20T10:54:38.281 INFO:tasks.workunit.client.0.smithi090.stdout:7/229: dread f6 [0,4194304] 0 2024-04-20T10:54:38.283 INFO:tasks.workunit.client.0.smithi090.stdout:6/240: rmdir d1/d19/d36/d1e/d1f 39 2024-04-20T10:54:38.284 INFO:tasks.workunit.client.0.smithi090.stdout:7/230: creat d11/d1a/d2f/f52 x:0 0 0 2024-04-20T10:54:38.284 INFO:tasks.workunit.client.0.smithi090.stdout:1/219: dread d8/f2a [0,4194304] 0 2024-04-20T10:54:38.285 INFO:tasks.workunit.client.0.smithi090.stdout:1/220: readlink d8/l35 0 2024-04-20T10:54:38.292 INFO:tasks.workunit.client.0.smithi090.stdout:0/245: dwrite d14/d19/f1b [0,4194304] 0 2024-04-20T10:54:38.293 INFO:tasks.workunit.client.0.smithi090.stdout:6/241: rmdir d1/d4/d26/d11 39 2024-04-20T10:54:38.302 INFO:tasks.workunit.client.0.smithi090.stdout:0/246: dread d14/d19/d2c/f2d [0,4194304] 0 2024-04-20T10:54:38.302 INFO:tasks.workunit.client.0.smithi090.stdout:6/242: readlink d1/d19/d36/d1e/d1f/l48 0 2024-04-20T10:54:38.302 INFO:tasks.workunit.client.0.smithi090.stdout:6/243: truncate d1/d19/d36/d1e/f20 1616715 0 2024-04-20T10:54:38.303 INFO:tasks.workunit.client.0.smithi090.stdout:0/247: rmdir d14/d39 39 2024-04-20T10:54:38.303 INFO:tasks.workunit.client.0.smithi090.stdout:0/248: write d14/d19/f1c [652443,94915] 0 2024-04-20T10:54:38.304 INFO:tasks.workunit.client.0.smithi090.stdout:6/244: read - d1/d19/d36/d1e/d1f/d3f/f4b zero size 2024-04-20T10:54:38.323 INFO:tasks.workunit.client.0.smithi090.stdout:2/288: dwrite d11/d1a/d2b/f2f [0,4194304] 0 2024-04-20T10:54:38.324 INFO:tasks.workunit.client.0.smithi090.stdout:1/221: dwrite d8/f1f [0,4194304] 0 2024-04-20T10:54:38.324 INFO:tasks.workunit.client.0.smithi090.stdout:1/222: rename d8 to d8/d1a/d48 22 2024-04-20T10:54:38.325 INFO:tasks.workunit.client.0.smithi090.stdout:6/245: symlink d1/d19/d36/l51 0 2024-04-20T10:54:38.326 INFO:tasks.workunit.client.0.smithi090.stdout:1/223: chown c2 20 1 2024-04-20T10:54:38.328 INFO:tasks.workunit.client.0.smithi090.stdout:2/289: dread d11/f20 [0,4194304] 0 2024-04-20T10:54:38.328 INFO:tasks.workunit.client.0.smithi090.stdout:7/231: dwrite d11/d1a/f40 [0,4194304] 0 2024-04-20T10:54:38.328 INFO:tasks.workunit.client.0.smithi090.stdout:2/290: dread - d11/d1a/d4a/f53 zero size 2024-04-20T10:54:38.328 INFO:tasks.workunit.client.0.smithi090.stdout:0/249: dwrite d14/d41/f49 [0,4194304] 0 2024-04-20T10:54:38.329 INFO:tasks.workunit.client.0.smithi090.stdout:5/414: dwrite d1/da/f2c [0,4194304] 0 2024-04-20T10:54:38.329 INFO:tasks.workunit.client.0.smithi090.stdout:6/246: symlink d1/d19/d36/d1e/l52 0 2024-04-20T10:54:38.329 INFO:tasks.workunit.client.0.smithi090.stdout:6/247: truncate d1/d19/d36/d1e/d1f/d3f/f4b 121582 0 2024-04-20T10:54:38.329 INFO:tasks.workunit.client.0.smithi090.stdout:6/248: write d1/d4/f50 [728578,107458] 0 2024-04-20T10:54:38.330 INFO:tasks.workunit.client.0.smithi090.stdout:5/415: write d1/da/d16/f3f [577808,4918] 0 2024-04-20T10:54:38.330 INFO:tasks.workunit.client.0.smithi090.stdout:5/416: truncate d1/da/d14/d47/f7e 263586 0 2024-04-20T10:54:38.331 INFO:tasks.workunit.client.0.smithi090.stdout:7/232: symlink d11/d13/l53 0 2024-04-20T10:54:38.331 INFO:tasks.workunit.client.0.smithi090.stdout:7/233: readlink d11/d13/d22/l4e 0 2024-04-20T10:54:38.332 INFO:tasks.workunit.client.0.smithi090.stdout:2/291: symlink d11/d1a/d30/l68 0 2024-04-20T10:54:38.333 INFO:tasks.workunit.client.0.smithi090.stdout:0/250: dread d14/f1f [0,4194304] 0 2024-04-20T10:54:38.333 INFO:tasks.workunit.client.0.smithi090.stdout:0/251: write f5 [1790541,102590] 0 2024-04-20T10:54:38.336 INFO:tasks.workunit.client.0.smithi090.stdout:0/252: dread f9 [0,4194304] 0 2024-04-20T10:54:38.337 INFO:tasks.workunit.client.0.smithi090.stdout:5/417: creat d1/d2f/d3d/d40/d70/f87 x:0 0 0 2024-04-20T10:54:38.337 INFO:tasks.workunit.client.0.smithi090.stdout:5/418: chown d1/da/d14/d47/d50/l77 929 1 2024-04-20T10:54:38.337 INFO:tasks.workunit.client.0.smithi090.stdout:1/224: dread d8/d19/f3d [0,4194304] 0 2024-04-20T10:54:38.338 INFO:tasks.workunit.client.0.smithi090.stdout:7/234: unlink d11/f2c 0 2024-04-20T10:54:38.339 INFO:tasks.workunit.client.0.smithi090.stdout:1/225: dread d8/d19/f23 [0,4194304] 0 2024-04-20T10:54:38.340 INFO:tasks.workunit.client.0.smithi090.stdout:1/226: write d8/d1a/d1d/d2c/f42 [693697,114706] 0 2024-04-20T10:54:38.340 INFO:tasks.workunit.client.0.smithi090.stdout:1/227: read - d8/f44 zero size 2024-04-20T10:54:38.341 INFO:tasks.workunit.client.0.smithi090.stdout:1/228: write d8/fe [30247,81816] 0 2024-04-20T10:54:38.341 INFO:tasks.workunit.client.0.smithi090.stdout:1/229: fsync d8/d19/f29 0 2024-04-20T10:54:38.341 INFO:tasks.workunit.client.0.smithi090.stdout:1/230: read f5 [942602,121001] 0 2024-04-20T10:54:38.341 INFO:tasks.workunit.client.0.smithi090.stdout:1/231: dread - d8/d1a/f39 zero size 2024-04-20T10:54:38.348 INFO:tasks.workunit.client.0.smithi090.stdout:2/292: creat d11/d1a/d4a/d55/f69 x:0 0 0 2024-04-20T10:54:38.349 INFO:tasks.workunit.client.0.smithi090.stdout:0/253: rmdir d14/d19/d2b/d3f/d43 39 2024-04-20T10:54:38.350 INFO:tasks.workunit.client.0.smithi090.stdout:5/419: rename d1/d41/c54 to d1/d2f/d3d/d40/d6c/c88 0 2024-04-20T10:54:38.351 INFO:tasks.workunit.client.0.smithi090.stdout:7/235: rmdir d11/d1a 39 2024-04-20T10:54:38.351 INFO:tasks.workunit.client.0.smithi090.stdout:7/236: chown d11/d13/d22/d24/d35/f47 4518622 1 2024-04-20T10:54:38.353 INFO:tasks.workunit.client.0.smithi090.stdout:1/232: symlink d8/d1a/d1d/d2c/l49 0 2024-04-20T10:54:38.354 INFO:tasks.workunit.client.0.smithi090.stdout:0/254: creat d14/d19/d2b/d3f/f4f x:0 0 0 2024-04-20T10:54:38.355 INFO:tasks.workunit.client.0.smithi090.stdout:0/255: chown d14/d19/d2b/d3f/d40 438062106 1 2024-04-20T10:54:38.355 INFO:tasks.workunit.client.0.smithi090.stdout:0/256: chown d14/c47 1 1 2024-04-20T10:54:38.355 INFO:tasks.workunit.client.0.smithi090.stdout:5/420: rmdir d1/da/d14/d47/d50 39 2024-04-20T10:54:38.356 INFO:tasks.workunit.client.0.smithi090.stdout:0/257: dread f11 [0,4194304] 0 2024-04-20T10:54:38.358 INFO:tasks.workunit.client.0.smithi090.stdout:1/233: mkdir d8/d1a/d1d/d2c/d4a 0 2024-04-20T10:54:38.359 INFO:tasks.workunit.client.0.smithi090.stdout:0/258: mkdir d14/d50 0 2024-04-20T10:54:38.360 INFO:tasks.workunit.client.0.smithi090.stdout:5/421: mkdir d1/d2f/d3d/d40/d89 0 2024-04-20T10:54:38.360 INFO:tasks.workunit.client.0.smithi090.stdout:5/422: dread - d1/d2f/f56 zero size 2024-04-20T10:54:38.361 INFO:tasks.workunit.client.0.smithi090.stdout:0/259: creat d14/d19/d2b/f51 x:0 0 0 2024-04-20T10:54:38.363 INFO:tasks.workunit.client.0.smithi090.stdout:1/234: dread d8/d19/f3d [0,4194304] 0 2024-04-20T10:54:38.364 INFO:tasks.workunit.client.0.smithi090.stdout:5/423: unlink d1/da/d16/f3f 0 2024-04-20T10:54:38.365 INFO:tasks.workunit.client.0.smithi090.stdout:5/424: readlink d1/d2f/d3d/l7b 0 2024-04-20T10:54:38.365 INFO:tasks.workunit.client.0.smithi090.stdout:5/425: chown d1/da/d14/l53 112754889 1 2024-04-20T10:54:38.365 INFO:tasks.workunit.client.0.smithi090.stdout:1/235: truncate d8/d19/f3d 1012603 0 2024-04-20T10:54:38.367 INFO:tasks.workunit.client.0.smithi090.stdout:1/236: creat d8/d1a/d45/f4b x:0 0 0 2024-04-20T10:54:38.367 INFO:tasks.workunit.client.0.smithi090.stdout:1/237: stat d8/d1a/d1d/d2c/l49 0 2024-04-20T10:54:38.367 INFO:tasks.workunit.client.0.smithi090.stdout:1/238: dread - d8/f46 zero size 2024-04-20T10:54:38.368 INFO:tasks.workunit.client.0.smithi090.stdout:5/426: mkdir d1/de/d8a 0 2024-04-20T10:54:38.368 INFO:tasks.workunit.client.0.smithi090.stdout:7/237: dwrite d11/d13/d22/d24/d35/f51 [0,4194304] 0 2024-04-20T10:54:38.369 INFO:tasks.workunit.client.0.smithi090.stdout:1/239: symlink d8/d1a/l4c 0 2024-04-20T10:54:38.369 INFO:tasks.workunit.client.0.smithi090.stdout:1/240: write d8/f44 [231844,95445] 0 2024-04-20T10:54:38.369 INFO:tasks.workunit.client.0.smithi090.stdout:1/241: chown c2 118244228 1 2024-04-20T10:54:38.369 INFO:tasks.workunit.client.0.smithi090.stdout:1/242: write f5 [228754,52884] 0 2024-04-20T10:54:38.369 INFO:tasks.workunit.client.0.smithi090.stdout:5/427: truncate d1/da/d14/d47/d39/f76 1279818 0 2024-04-20T10:54:38.370 INFO:tasks.workunit.client.0.smithi090.stdout:1/243: mkdir d8/d1a/d4d 0 2024-04-20T10:54:38.370 INFO:tasks.workunit.client.0.smithi090.stdout:1/244: chown d8/f16 9 1 2024-04-20T10:54:38.370 INFO:tasks.workunit.client.0.smithi090.stdout:1/245: dread - d8/f46 zero size 2024-04-20T10:54:38.371 INFO:tasks.workunit.client.0.smithi090.stdout:5/428: rename d1/d2a/f60 to d1/d2f/d3d/f8b 0 2024-04-20T10:54:38.374 INFO:tasks.workunit.client.0.smithi090.stdout:1/246: mknod d8/d1a/d1d/d2c/d4a/c4e 0 2024-04-20T10:54:38.385 INFO:tasks.workunit.client.0.smithi090.stdout:1/247: dread d8/d19/f3d [0,4194304] 0 2024-04-20T10:54:38.386 INFO:tasks.workunit.client.0.smithi090.stdout:5/429: rmdir d1/d2f/d80 0 2024-04-20T10:54:38.387 INFO:tasks.workunit.client.0.smithi090.stdout:0/260: dwrite d14/f2a [0,4194304] 0 2024-04-20T10:54:38.388 INFO:tasks.workunit.client.0.smithi090.stdout:7/238: dwrite d11/d1a/f46 [0,4194304] 0 2024-04-20T10:54:38.388 INFO:tasks.workunit.client.0.smithi090.stdout:1/248: creat d8/d1a/d45/f4f x:0 0 0 2024-04-20T10:54:38.389 INFO:tasks.workunit.client.0.smithi090.stdout:1/249: getdents d8/d1a/d1d 0 2024-04-20T10:54:38.391 INFO:tasks.workunit.client.0.smithi090.stdout:0/261: rename d14/d50 to d14/d19/d2b/d52 0 2024-04-20T10:54:38.391 INFO:tasks.workunit.client.0.smithi090.stdout:0/262: fsync d14/f32 0 2024-04-20T10:54:38.391 INFO:tasks.workunit.client.0.smithi090.stdout:0/263: write fd [4066957,67356] 0 2024-04-20T10:54:38.391 INFO:tasks.workunit.client.0.smithi090.stdout:0/264: truncate d14/d19/d2b/f51 325573 0 2024-04-20T10:54:38.391 INFO:tasks.workunit.client.0.smithi090.stdout:7/239: dread d11/d13/d22/f34 [0,4194304] 0 2024-04-20T10:54:38.392 INFO:tasks.workunit.client.0.smithi090.stdout:0/265: dread d14/f18 [0,4194304] 0 2024-04-20T10:54:38.400 INFO:tasks.workunit.client.0.smithi090.stdout:7/240: dread d11/d1a/f1b [0,4194304] 0 2024-04-20T10:54:38.400 INFO:tasks.workunit.client.0.smithi090.stdout:7/241: read - d11/d13/d22/f3a zero size 2024-04-20T10:54:38.400 INFO:tasks.workunit.client.0.smithi090.stdout:7/242: getdents d11/d13/d33/d44 0 2024-04-20T10:54:38.401 INFO:tasks.workunit.client.0.smithi090.stdout:1/250: rename d8/d19 to d8/d1a/d1d/d50 0 2024-04-20T10:54:38.402 INFO:tasks.workunit.client.0.smithi090.stdout:5/430: dread d1/d55/f74 [0,4194304] 0 2024-04-20T10:54:38.403 INFO:tasks.workunit.client.0.smithi090.stdout:7/243: creat d11/d13/d33/f54 x:0 0 0 2024-04-20T10:54:38.405 INFO:tasks.workunit.client.0.smithi090.stdout:5/431: unlink d1/da/d16/f6b 0 2024-04-20T10:54:38.406 INFO:tasks.workunit.client.0.smithi090.stdout:1/251: fsync f5 0 2024-04-20T10:54:38.407 INFO:tasks.workunit.client.0.smithi090.stdout:7/244: creat d11/d13/f55 x:0 0 0 2024-04-20T10:54:38.408 INFO:tasks.workunit.client.0.smithi090.stdout:1/252: creat d8/d1a/d1d/d2c/f51 x:0 0 0 2024-04-20T10:54:38.409 INFO:tasks.workunit.client.0.smithi090.stdout:7/245: creat d11/d13/d22/d24/d35/f56 x:0 0 0 2024-04-20T10:54:38.409 INFO:tasks.workunit.client.0.smithi090.stdout:1/253: dread d8/f16 [0,4194304] 0 2024-04-20T10:54:38.409 INFO:tasks.workunit.client.0.smithi090.stdout:1/254: dread - d8/d1a/d1d/d2c/f51 zero size 2024-04-20T10:54:38.409 INFO:tasks.workunit.client.0.smithi090.stdout:1/255: dread - d8/d1a/d1d/d2c/d3f/f41 zero size 2024-04-20T10:54:38.410 INFO:tasks.workunit.client.0.smithi090.stdout:0/266: dwrite d14/f2e [0,4194304] 0 2024-04-20T10:54:38.410 INFO:tasks.workunit.client.0.smithi090.stdout:0/267: chown f5 942799661 1 2024-04-20T10:54:38.412 INFO:tasks.workunit.client.0.smithi090.stdout:7/246: link d11/l1c d11/d1a/d2f/l57 0 2024-04-20T10:54:38.413 INFO:tasks.workunit.client.0.smithi090.stdout:0/268: symlink d14/d19/d2b/d3f/d40/l53 0 2024-04-20T10:54:38.413 INFO:tasks.workunit.client.0.smithi090.stdout:0/269: getdents d14/d19/d31/d37 0 2024-04-20T10:54:38.414 INFO:tasks.workunit.client.0.smithi090.stdout:7/247: mkdir d11/d1a/d3b/d58 0 2024-04-20T10:54:38.414 INFO:tasks.workunit.client.0.smithi090.stdout:7/248: fsync d11/d13/d22/f4b 0 2024-04-20T10:54:38.429 INFO:tasks.workunit.client.0.smithi090.stdout:1/256: dwrite d8/d1a/d1d/d2c/d3f/f41 [0,4194304] 0 2024-04-20T10:54:38.429 INFO:tasks.workunit.client.0.smithi090.stdout:5/432: dread d1/da/f2c [0,4194304] 0 2024-04-20T10:54:38.431 INFO:tasks.workunit.client.0.smithi090.stdout:0/270: creat d14/d19/d2b/d3f/d43/f54 x:0 0 0 2024-04-20T10:54:38.433 INFO:tasks.workunit.client.0.smithi090.stdout:5/433: rmdir d1/de/d8a 0 2024-04-20T10:54:38.434 INFO:tasks.workunit.client.0.smithi090.stdout:5/434: chown d1/d55/c68 6 1 2024-04-20T10:54:38.434 INFO:tasks.workunit.client.0.smithi090.stdout:5/435: fdatasync d1/da/d1f/f25 0 2024-04-20T10:54:38.434 INFO:tasks.workunit.client.0.smithi090.stdout:5/436: fdatasync d1/d2f/d3d/f8b 0 2024-04-20T10:54:38.434 INFO:tasks.workunit.client.0.smithi090.stdout:0/271: mkdir d14/d19/d2b/d52/d55 0 2024-04-20T10:54:38.443 INFO:tasks.workunit.client.0.smithi090.stdout:7/249: dwrite d11/d13/f1d [0,4194304] 0 2024-04-20T10:54:38.445 INFO:tasks.workunit.client.0.smithi090.stdout:5/437: truncate d1/d2f/d3d/d40/f45 247526 0 2024-04-20T10:54:38.450 INFO:tasks.workunit.client.0.smithi090.stdout:4/143: sync 2024-04-20T10:54:38.450 INFO:tasks.workunit.client.0.smithi090.stdout:3/162: sync 2024-04-20T10:54:38.450 INFO:tasks.workunit.client.0.smithi090.stdout:4/144: readlink d7/l16 0 2024-04-20T10:54:38.451 INFO:tasks.workunit.client.0.smithi090.stdout:5/438: mknod d1/d2f/d85/c8c 0 2024-04-20T10:54:38.451 INFO:tasks.workunit.client.0.smithi090.stdout:7/250: dread f1 [0,4194304] 0 2024-04-20T10:54:38.451 INFO:tasks.workunit.client.0.smithi090.stdout:7/251: write d11/d13/d33/f54 [451870,115062] 0 2024-04-20T10:54:38.452 INFO:tasks.workunit.client.0.smithi090.stdout:3/163: rmdir d7/d11 39 2024-04-20T10:54:38.454 INFO:tasks.workunit.client.0.smithi090.stdout:4/145: getdents d7 0 2024-04-20T10:54:38.456 INFO:tasks.workunit.client.0.smithi090.stdout:1/257: dread d8/f2a [0,4194304] 0 2024-04-20T10:54:38.458 INFO:tasks.workunit.client.0.smithi090.stdout:1/258: rename d8/d1a/d1d/d50/f29 to d8/d1a/d1d/d50/d31/f52 0 2024-04-20T10:54:38.459 INFO:tasks.workunit.client.0.smithi090.stdout:5/439: symlink d1/d2f/d3d/d40/l8d 0 2024-04-20T10:54:38.459 INFO:tasks.workunit.client.0.smithi090.stdout:5/440: chown d1/d2f/d3d/f8b 32020625 1 2024-04-20T10:54:38.460 INFO:tasks.workunit.client.0.smithi090.stdout:1/259: truncate d8/d1a/d1d/d50/d31/f52 2441317 0 2024-04-20T10:54:38.461 INFO:tasks.workunit.client.0.smithi090.stdout:5/441: creat d1/d2f/d3d/d40/d70/f8e x:0 0 0 2024-04-20T10:54:38.462 INFO:tasks.workunit.client.0.smithi090.stdout:1/260: creat d8/d1a/d1d/d2c/d3f/f53 x:0 0 0 2024-04-20T10:54:38.467 INFO:tasks.workunit.client.0.smithi090.stdout:0/272: dwrite fd [0,4194304] 0 2024-04-20T10:54:38.467 INFO:tasks.workunit.client.0.smithi090.stdout:5/442: creat d1/da/d14/d47/f8f x:0 0 0 2024-04-20T10:54:38.468 INFO:tasks.workunit.client.0.smithi090.stdout:0/273: chown f3 1239 1 2024-04-20T10:54:38.470 INFO:tasks.workunit.client.0.smithi090.stdout:4/146: dread d7/d9/f13 [0,4194304] 0 2024-04-20T10:54:38.471 INFO:tasks.workunit.client.0.smithi090.stdout:5/443: creat d1/d2f/d3d/d40/f90 x:0 0 0 2024-04-20T10:54:38.476 INFO:tasks.workunit.client.0.smithi090.stdout:7/252: dwrite d11/d13/d22/d24/f2e [0,4194304] 0 2024-04-20T10:54:38.477 INFO:tasks.workunit.client.0.smithi090.stdout:3/164: dwrite d7/df/f27 [0,4194304] 0 2024-04-20T10:54:38.477 INFO:tasks.workunit.client.0.smithi090.stdout:0/274: dread d14/f21 [0,4194304] 0 2024-04-20T10:54:38.477 INFO:tasks.workunit.client.0.smithi090.stdout:0/275: chown d14/d19/l3c 31893 1 2024-04-20T10:54:38.478 INFO:tasks.workunit.client.0.smithi090.stdout:4/147: creat d7/d9/d17/f27 x:0 0 0 2024-04-20T10:54:38.480 INFO:tasks.workunit.client.0.smithi090.stdout:7/253: link d11/d1a/d2f/l57 d11/d1a/d3b/d58/l59 0 2024-04-20T10:54:38.489 INFO:tasks.workunit.client.0.smithi090.stdout:4/148: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:38.490 INFO:tasks.workunit.client.0.smithi090.stdout:5/444: dwrite d1/da/d14/d47/f8f [0,4194304] 0 2024-04-20T10:54:38.491 INFO:tasks.workunit.client.0.smithi090.stdout:5/445: write d1/d2a/f5e [4393445,19483] 0 2024-04-20T10:54:38.491 INFO:tasks.workunit.client.0.smithi090.stdout:0/276: link c1 d14/d19/d31/c56 0 2024-04-20T10:54:38.491 INFO:tasks.workunit.client.0.smithi090.stdout:0/277: write d14/d19/f1c [1125333,106117] 0 2024-04-20T10:54:38.492 INFO:tasks.workunit.client.0.smithi090.stdout:4/149: mknod d7/d9/c28 0 2024-04-20T10:54:38.496 INFO:tasks.workunit.client.0.smithi090.stdout:7/254: dwrite d11/d13/d22/d24/d35/f51 [0,4194304] 0 2024-04-20T10:54:38.509 INFO:tasks.workunit.client.0.smithi090.stdout:3/165: dread d7/fa [4194304,4194304] 0 2024-04-20T10:54:38.510 INFO:tasks.workunit.client.0.smithi090.stdout:0/278: dwrite fe [0,4194304] 0 2024-04-20T10:54:38.510 INFO:tasks.workunit.client.0.smithi090.stdout:0/279: read - d14/d19/d2b/d3f/d43/f46 zero size 2024-04-20T10:54:38.525 INFO:tasks.workunit.client.0.smithi090.stdout:0/280: dwrite f9 [0,4194304] 0 2024-04-20T10:54:38.525 INFO:tasks.workunit.client.0.smithi090.stdout:0/281: readlink d14/d19/d2b/d3f/d40/l53 0 2024-04-20T10:54:38.530 INFO:tasks.workunit.client.0.smithi090.stdout:0/282: dread d14/d19/d2c/f2d [0,4194304] 0 2024-04-20T10:54:38.530 INFO:tasks.workunit.client.0.smithi090.stdout:0/283: readlink d14/d19/d2b/l4e 0 2024-04-20T10:54:38.751 INFO:tasks.workunit.client.0.smithi090.stdout:4/150: link d7/d9/d17/f18 d7/d9/d17/f29 0 2024-04-20T10:54:38.752 INFO:tasks.workunit.client.0.smithi090.stdout:7/255: mknod d11/d1a/c5a 0 2024-04-20T10:54:38.752 INFO:tasks.workunit.client.0.smithi090.stdout:7/256: readlink d11/l1c 0 2024-04-20T10:54:38.753 INFO:tasks.workunit.client.0.smithi090.stdout:3/166: rename d7/d26/l34 to d7/l36 0 2024-04-20T10:54:38.757 INFO:tasks.workunit.client.0.smithi090.stdout:0/284: creat d14/d19/d2b/d3f/d40/f57 x:0 0 0 2024-04-20T10:54:38.757 INFO:tasks.workunit.client.0.smithi090.stdout:0/285: write fa [256359,8943] 0 2024-04-20T10:54:38.757 INFO:tasks.workunit.client.0.smithi090.stdout:5/446: mknod d1/de/c91 0 2024-04-20T10:54:38.758 INFO:tasks.workunit.client.0.smithi090.stdout:5/447: chown d1/d2f/d3d/l7b 75635598 1 2024-04-20T10:54:38.759 INFO:tasks.workunit.client.0.smithi090.stdout:4/151: symlink d7/l2a 0 2024-04-20T10:54:38.760 INFO:tasks.workunit.client.0.smithi090.stdout:3/167: link d7/f19 d7/f37 0 2024-04-20T10:54:38.762 INFO:tasks.workunit.client.0.smithi090.stdout:4/152: creat d7/d9/d17/f2b x:0 0 0 2024-04-20T10:54:38.763 INFO:tasks.workunit.client.0.smithi090.stdout:3/168: symlink d7/d35/l38 0 2024-04-20T10:54:38.764 INFO:tasks.workunit.client.0.smithi090.stdout:5/448: symlink d1/d2f/d3d/d40/l92 0 2024-04-20T10:54:38.765 INFO:tasks.workunit.client.0.smithi090.stdout:3/169: link d7/d11/c24 d7/d11/c39 0 2024-04-20T10:54:38.766 INFO:tasks.workunit.client.0.smithi090.stdout:5/449: symlink d1/da/d14/d47/l93 0 2024-04-20T10:54:38.767 INFO:tasks.workunit.client.0.smithi090.stdout:3/170: link d7/d35/l38 d7/d11/l3a 0 2024-04-20T10:54:38.769 INFO:tasks.workunit.client.0.smithi090.stdout:5/450: creat d1/da/d14/d47/d50/f94 x:0 0 0 2024-04-20T10:54:38.769 INFO:tasks.workunit.client.0.smithi090.stdout:5/451: truncate d1/f58 1305343 0 2024-04-20T10:54:38.769 INFO:tasks.workunit.client.0.smithi090.stdout:5/452: write d1/d2f/d3d/f6a [515044,110482] 0 2024-04-20T10:54:38.769 INFO:tasks.workunit.client.0.smithi090.stdout:3/171: rmdir d7/d15 39 2024-04-20T10:54:38.769 INFO:tasks.workunit.client.0.smithi090.stdout:3/172: dread - d7/d11/f33 zero size 2024-04-20T10:54:38.769 INFO:tasks.workunit.client.0.smithi090.stdout:3/173: chown d7/d11/c24 117 1 2024-04-20T10:54:38.770 INFO:tasks.workunit.client.0.smithi090.stdout:5/453: creat d1/de/d75/f95 x:0 0 0 2024-04-20T10:54:38.775 INFO:tasks.workunit.client.0.smithi090.stdout:7/257: dwrite d11/d13/d23/f38 [0,4194304] 0 2024-04-20T10:54:38.776 INFO:tasks.workunit.client.0.smithi090.stdout:7/258: write d11/d13/d22/d27/f50 [734198,18360] 0 2024-04-20T10:54:38.776 INFO:tasks.workunit.client.0.smithi090.stdout:7/259: read - d11/d1a/d2f/f52 zero size 2024-04-20T10:54:38.777 INFO:tasks.workunit.client.0.smithi090.stdout:0/286: dwrite d14/d19/d2b/d3f/d43/f54 [0,4194304] 0 2024-04-20T10:54:38.780 INFO:tasks.workunit.client.0.smithi090.stdout:0/287: rename c8 to d14/d19/d2b/d3f/d40/c58 0 2024-04-20T10:54:38.781 INFO:tasks.workunit.client.0.smithi090.stdout:0/288: write d14/d19/d2b/f3d [555479,67347] 0 2024-04-20T10:54:38.782 INFO:tasks.workunit.client.0.smithi090.stdout:0/289: rename f4 to d14/d19/d31/d34/d3b/f59 0 2024-04-20T10:54:38.783 INFO:tasks.workunit.client.0.smithi090.stdout:0/290: rmdir d14/d19/d2b/d3f/d43 39 2024-04-20T10:54:38.785 INFO:tasks.workunit.client.0.smithi090.stdout:4/153: dwrite d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:38.786 INFO:tasks.workunit.client.0.smithi090.stdout:4/154: creat d7/f2c x:0 0 0 2024-04-20T10:54:38.786 INFO:tasks.workunit.client.0.smithi090.stdout:9/280: sync 2024-04-20T10:54:38.787 INFO:tasks.workunit.client.0.smithi090.stdout:8/286: sync 2024-04-20T10:54:38.787 INFO:tasks.workunit.client.0.smithi090.stdout:8/287: fdatasync d0/fe 0 2024-04-20T10:54:38.787 INFO:tasks.workunit.client.0.smithi090.stdout:6/249: sync 2024-04-20T10:54:38.787 INFO:tasks.workunit.client.0.smithi090.stdout:2/293: sync 2024-04-20T10:54:38.787 INFO:tasks.workunit.client.0.smithi090.stdout:1/261: sync 2024-04-20T10:54:38.787 INFO:tasks.workunit.client.0.smithi090.stdout:6/250: readlink d1/d19/d25/l43 0 2024-04-20T10:54:38.788 INFO:tasks.workunit.client.0.smithi090.stdout:5/454: dwrite d1/da/d16/f86 [0,4194304] 0 2024-04-20T10:54:38.789 INFO:tasks.workunit.client.0.smithi090.stdout:4/155: symlink d7/d9/d17/l2d 0 2024-04-20T10:54:38.789 INFO:tasks.workunit.client.0.smithi090.stdout:4/156: fsync d7/f1d 0 2024-04-20T10:54:38.790 INFO:tasks.workunit.client.0.smithi090.stdout:8/288: rename d0/f2e to d0/d26/f55 0 2024-04-20T10:54:38.791 INFO:tasks.workunit.client.0.smithi090.stdout:2/294: mknod d11/d1a/d37/c6a 0 2024-04-20T10:54:38.791 INFO:tasks.workunit.client.0.smithi090.stdout:2/295: truncate d11/d1f/d2e/f52 222344 0 2024-04-20T10:54:38.792 INFO:tasks.workunit.client.0.smithi090.stdout:0/291: write d14/d41/f49 [3540687,96661] 0 2024-04-20T10:54:38.793 INFO:tasks.workunit.client.0.smithi090.stdout:6/251: link d1/d4/d26/c33 d1/d4/d26/c53 0 2024-04-20T10:54:38.796 INFO:tasks.workunit.client.0.smithi090.stdout:8/289: dread d0/d11/d14/f2b [0,4194304] 0 2024-04-20T10:54:38.796 INFO:tasks.workunit.client.0.smithi090.stdout:8/290: fsync d0/f27 0 2024-04-20T10:54:38.797 INFO:tasks.workunit.client.0.smithi090.stdout:6/252: mkdir d1/d19/d36/d1e/d1f/d3f/d54 0 2024-04-20T10:54:38.798 INFO:tasks.workunit.client.0.smithi090.stdout:9/281: dread d0/f11 [0,4194304] 0 2024-04-20T10:54:38.799 INFO:tasks.workunit.client.0.smithi090.stdout:9/282: dread d0/da/f2f [0,4194304] 0 2024-04-20T10:54:38.799 INFO:tasks.workunit.client.0.smithi090.stdout:4/157: dread d7/f1d [0,4194304] 0 2024-04-20T10:54:38.801 INFO:tasks.workunit.client.0.smithi090.stdout:1/262: dread d8/f2d [0,4194304] 0 2024-04-20T10:54:38.802 INFO:tasks.workunit.client.0.smithi090.stdout:8/291: rename d0/d26/l3c to d0/l56 0 2024-04-20T10:54:38.804 INFO:tasks.workunit.client.0.smithi090.stdout:9/283: creat d0/da/d1c/d5a/d52/f60 x:0 0 0 2024-04-20T10:54:38.805 INFO:tasks.workunit.client.0.smithi090.stdout:7/260: dwrite d11/d13/d22/d24/d35/f47 [0,4194304] 0 2024-04-20T10:54:38.806 INFO:tasks.workunit.client.0.smithi090.stdout:4/158: getdents d7/d9 0 2024-04-20T10:54:38.807 INFO:tasks.workunit.client.0.smithi090.stdout:6/253: dread d1/d19/d36/f27 [0,4194304] 0 2024-04-20T10:54:38.808 INFO:tasks.workunit.client.0.smithi090.stdout:1/263: link d8/d1a/f47 d8/f54 0 2024-04-20T10:54:38.813 INFO:tasks.workunit.client.0.smithi090.stdout:9/284: unlink d0/da/f3d 0 2024-04-20T10:54:38.813 INFO:tasks.workunit.client.0.smithi090.stdout:9/285: write d0/da/f31 [1025250,31620] 0 2024-04-20T10:54:38.814 INFO:tasks.workunit.client.0.smithi090.stdout:0/292: dwrite ff [0,4194304] 0 2024-04-20T10:54:38.817 INFO:tasks.workunit.client.0.smithi090.stdout:4/159: mknod d7/c2e 0 2024-04-20T10:54:38.817 INFO:tasks.workunit.client.0.smithi090.stdout:4/160: fdatasync f2 0 2024-04-20T10:54:38.817 INFO:tasks.workunit.client.0.smithi090.stdout:4/161: chown f0 1285763 1 2024-04-20T10:54:38.818 INFO:tasks.workunit.client.0.smithi090.stdout:1/264: link d8/d1a/d1d/l32 d8/d1a/d4d/l55 0 2024-04-20T10:54:38.818 INFO:tasks.workunit.client.0.smithi090.stdout:1/265: write d8/d1a/d45/f4b [947836,75521] 0 2024-04-20T10:54:38.820 INFO:tasks.workunit.client.0.smithi090.stdout:9/286: mknod d0/da/d1c/c61 0 2024-04-20T10:54:38.821 INFO:tasks.workunit.client.0.smithi090.stdout:4/162: write d7/f1d [1582145,10625] 0 2024-04-20T10:54:38.823 INFO:tasks.workunit.client.0.smithi090.stdout:0/293: dread d14/d19/d31/d34/d3b/f59 [0,4194304] 0 2024-04-20T10:54:38.827 INFO:tasks.workunit.client.0.smithi090.stdout:6/254: dwrite d1/d19/d36/d28/f2a [0,4194304] 0 2024-04-20T10:54:38.828 INFO:tasks.workunit.client.0.smithi090.stdout:8/292: dwrite d0/f28 [0,4194304] 0 2024-04-20T10:54:38.830 INFO:tasks.workunit.client.0.smithi090.stdout:0/294: mknod d14/d39/c5a 0 2024-04-20T10:54:38.830 INFO:tasks.workunit.client.0.smithi090.stdout:0/295: write d14/d19/d2b/d3f/d40/f57 [177025,35095] 0 2024-04-20T10:54:38.836 INFO:tasks.workunit.client.0.smithi090.stdout:0/296: mkdir d14/d19/d2b/d52/d55/d5b 0 2024-04-20T10:54:38.838 INFO:tasks.workunit.client.0.smithi090.stdout:6/255: symlink d1/d19/d36/d1e/d1f/l55 0 2024-04-20T10:54:38.840 INFO:tasks.workunit.client.0.smithi090.stdout:0/297: truncate f11 378001 0 2024-04-20T10:54:38.842 INFO:tasks.workunit.client.0.smithi090.stdout:6/256: rename d1/d4/d3a to d1/d4/d26/d11/d4a/d56 0 2024-04-20T10:54:38.843 INFO:tasks.workunit.client.0.smithi090.stdout:0/298: mkdir d14/d19/d2b/d3f/d43/d5c 0 2024-04-20T10:54:38.846 INFO:tasks.workunit.client.0.smithi090.stdout:6/257: rename d1/d19/d36/d28/f3b to d1/d19/f57 0 2024-04-20T10:54:38.847 INFO:tasks.workunit.client.0.smithi090.stdout:0/299: symlink d14/d19/d2b/d3f/d40/l5d 0 2024-04-20T10:54:38.850 INFO:tasks.workunit.client.0.smithi090.stdout:1/266: dwrite d8/f44 [0,4194304] 0 2024-04-20T10:54:38.850 INFO:tasks.workunit.client.0.smithi090.stdout:4/163: dwrite f0 [4194304,4194304] 0 2024-04-20T10:54:38.852 INFO:tasks.workunit.client.0.smithi090.stdout:6/258: rename d1/d4/d26/d11/d4a/d56/f42 to d1/d19/d36/d1e/f58 0 2024-04-20T10:54:38.853 INFO:tasks.workunit.client.0.smithi090.stdout:9/287: dwrite d0/da/f13 [0,4194304] 0 2024-04-20T10:54:38.853 INFO:tasks.workunit.client.0.smithi090.stdout:8/293: dwrite d0/f8 [4194304,4194304] 0 2024-04-20T10:54:38.855 INFO:tasks.workunit.client.0.smithi090.stdout:4/164: symlink d7/d9/l2f 0 2024-04-20T10:54:38.855 INFO:tasks.workunit.client.0.smithi090.stdout:7/261: truncate d11/d13/d22/d24/d35/f47 1928837 0 2024-04-20T10:54:38.857 INFO:tasks.workunit.client.0.smithi090.stdout:8/294: rmdir d0/d11/d22 39 2024-04-20T10:54:38.859 INFO:tasks.workunit.client.0.smithi090.stdout:9/288: dread d0/da/d1c/d5a/d52/f4c [0,4194304] 0 2024-04-20T10:54:38.859 INFO:tasks.workunit.client.0.smithi090.stdout:4/165: mkdir d7/d9/d30 0 2024-04-20T10:54:38.860 INFO:tasks.workunit.client.0.smithi090.stdout:4/166: fsync d7/d9/f1c 0 2024-04-20T10:54:38.861 INFO:tasks.workunit.client.0.smithi090.stdout:8/295: mkdir d0/d11/d22/d53/d57 0 2024-04-20T10:54:38.861 INFO:tasks.workunit.client.0.smithi090.stdout:6/259: dread d1/d10/f39 [0,4194304] 0 2024-04-20T10:54:38.861 INFO:tasks.workunit.client.0.smithi090.stdout:6/260: truncate d1/d19/d36/d1e/d1f/d3f/f4b 338240 0 2024-04-20T10:54:38.861 INFO:tasks.workunit.client.0.smithi090.stdout:6/261: chown d1/d19/d36/f24 26 1 2024-04-20T10:54:38.862 INFO:tasks.workunit.client.0.smithi090.stdout:9/289: mknod d0/c62 0 2024-04-20T10:54:38.862 INFO:tasks.workunit.client.0.smithi090.stdout:9/290: fdatasync d0/da/d1c/d5a/f53 0 2024-04-20T10:54:38.862 INFO:tasks.workunit.client.0.smithi090.stdout:9/291: truncate d0/da/d1c/d5a/d56/f58 990956 0 2024-04-20T10:54:38.863 INFO:tasks.workunit.client.0.smithi090.stdout:4/167: mknod d7/d9/d30/c31 0 2024-04-20T10:54:38.864 INFO:tasks.workunit.client.0.smithi090.stdout:8/296: symlink d0/d11/d14/d52/l58 0 2024-04-20T10:54:38.864 INFO:tasks.workunit.client.0.smithi090.stdout:8/297: readlink d0/d11/d14/l19 0 2024-04-20T10:54:38.864 INFO:tasks.workunit.client.0.smithi090.stdout:8/298: write d0/d26/f40 [639306,17931] 0 2024-04-20T10:54:38.865 INFO:tasks.workunit.client.0.smithi090.stdout:4/168: mknod d7/d9/d17/c32 0 2024-04-20T10:54:38.866 INFO:tasks.workunit.client.0.smithi090.stdout:8/299: truncate d0/d11/f1b 999460 0 2024-04-20T10:54:38.867 INFO:tasks.workunit.client.0.smithi090.stdout:4/169: rmdir d7/d9/d30 39 2024-04-20T10:54:38.868 INFO:tasks.workunit.client.0.smithi090.stdout:4/170: chown d7/d9/d17 0 1 2024-04-20T10:54:38.868 INFO:tasks.workunit.client.0.smithi090.stdout:4/171: chown d7/fb 2 1 2024-04-20T10:54:38.869 INFO:tasks.workunit.client.0.smithi090.stdout:0/300: dwrite f5 [0,4194304] 0 2024-04-20T10:54:38.870 INFO:tasks.workunit.client.0.smithi090.stdout:8/300: link d0/d11/c18 d0/d11/d22/c59 0 2024-04-20T10:54:38.871 INFO:tasks.workunit.client.0.smithi090.stdout:4/172: stat d7/d9/l14 0 2024-04-20T10:54:38.871 INFO:tasks.workunit.client.0.smithi090.stdout:6/262: write d1/d4/f1d [1134049,5889] 0 2024-04-20T10:54:38.873 INFO:tasks.workunit.client.0.smithi090.stdout:8/301: mknod d0/d11/d14/d52/c5a 0 2024-04-20T10:54:38.875 INFO:tasks.workunit.client.0.smithi090.stdout:0/301: dread d14/d19/d31/d34/d3b/f59 [0,4194304] 0 2024-04-20T10:54:38.876 INFO:tasks.workunit.client.0.smithi090.stdout:4/173: unlink d7/d9/d17/f29 0 2024-04-20T10:54:38.877 INFO:tasks.workunit.client.0.smithi090.stdout:0/302: dread d14/d19/f1c [0,4194304] 0 2024-04-20T10:54:38.878 INFO:tasks.workunit.client.0.smithi090.stdout:8/302: link d0/l1d d0/d11/l5b 0 2024-04-20T10:54:38.879 INFO:tasks.workunit.client.0.smithi090.stdout:0/303: mknod d14/d19/d2b/d3f/c5e 0 2024-04-20T10:54:38.879 INFO:tasks.workunit.client.0.smithi090.stdout:0/304: stat d14/d39 0 2024-04-20T10:54:38.879 INFO:tasks.workunit.client.0.smithi090.stdout:0/305: chown d14/f2e 10 1 2024-04-20T10:54:38.879 INFO:tasks.workunit.client.0.smithi090.stdout:0/306: write d14/f32 [1591332,111103] 0 2024-04-20T10:54:38.880 INFO:tasks.workunit.client.0.smithi090.stdout:8/303: symlink d0/d26/l5c 0 2024-04-20T10:54:38.880 INFO:tasks.workunit.client.0.smithi090.stdout:8/304: truncate d0/d3a/f46 736802 0 2024-04-20T10:54:38.880 INFO:tasks.workunit.client.0.smithi090.stdout:1/267: truncate d8/f44 2413202 0 2024-04-20T10:54:38.880 INFO:tasks.workunit.client.0.smithi090.stdout:1/268: dread - d8/f46 zero size 2024-04-20T10:54:38.881 INFO:tasks.workunit.client.0.smithi090.stdout:1/269: write d8/f3e [330529,85860] 0 2024-04-20T10:54:38.881 INFO:tasks.workunit.client.0.smithi090.stdout:9/292: dwrite d0/f9 [0,4194304] 0 2024-04-20T10:54:38.881 INFO:tasks.workunit.client.0.smithi090.stdout:9/293: stat d0/da/d1c/d5a/d52/c48 0 2024-04-20T10:54:38.890 INFO:tasks.workunit.client.0.smithi090.stdout:6/263: dwrite d1/f6 [4194304,4194304] 0 2024-04-20T10:54:38.921 INFO:tasks.workunit.client.0.smithi090.stdout:8/305: mknod d0/c5d 0 2024-04-20T10:54:38.922 INFO:tasks.workunit.client.0.smithi090.stdout:1/270: mknod d8/d1a/d1d/d2c/d4a/c56 0 2024-04-20T10:54:38.922 INFO:tasks.workunit.client.0.smithi090.stdout:1/271: stat c2 0 2024-04-20T10:54:38.922 INFO:tasks.workunit.client.0.smithi090.stdout:1/272: readlink d8/d1a/d1d/l3a 0 2024-04-20T10:54:38.926 INFO:tasks.workunit.client.0.smithi090.stdout:9/294: unlink d0/da/f18 0 2024-04-20T10:54:38.928 INFO:tasks.workunit.client.0.smithi090.stdout:6/264: creat d1/d19/f59 x:0 0 0 2024-04-20T10:54:38.928 INFO:tasks.workunit.client.0.smithi090.stdout:6/265: fsync d1/d10/f39 0 2024-04-20T10:54:38.928 INFO:tasks.workunit.client.0.smithi090.stdout:6/266: stat d1/d4/f47 0 2024-04-20T10:54:38.930 INFO:tasks.workunit.client.0.smithi090.stdout:8/306: mknod d0/d2d/d49/c5e 0 2024-04-20T10:54:38.930 INFO:tasks.workunit.client.0.smithi090.stdout:8/307: fsync d0/d2d/d44/f4c 0 2024-04-20T10:54:38.930 INFO:tasks.workunit.client.0.smithi090.stdout:8/308: write d0/d2d/f43 [80179,30611] 0 2024-04-20T10:54:38.931 INFO:tasks.workunit.client.0.smithi090.stdout:1/273: rmdir d8/d1a/d1d/d2c/d3f 39 2024-04-20T10:54:38.933 INFO:tasks.workunit.client.0.smithi090.stdout:6/267: truncate d1/d19/f57 301096 0 2024-04-20T10:54:38.935 INFO:tasks.workunit.client.0.smithi090.stdout:1/274: creat d8/d1a/d1d/d50/d31/f57 x:0 0 0 2024-04-20T10:54:38.936 INFO:tasks.workunit.client.0.smithi090.stdout:6/268: mknod d1/d10/c5a 0 2024-04-20T10:54:38.936 INFO:tasks.workunit.client.0.smithi090.stdout:6/269: fsync d1/d4/f50 0 2024-04-20T10:54:38.937 INFO:tasks.workunit.client.0.smithi090.stdout:1/275: symlink d8/d1a/d4d/l58 0 2024-04-20T10:54:38.938 INFO:tasks.workunit.client.0.smithi090.stdout:8/309: write d0/f36 [684251,73487] 0 2024-04-20T10:54:38.938 INFO:tasks.workunit.client.0.smithi090.stdout:8/310: dread - d0/d11/d22/d53/f54 zero size 2024-04-20T10:54:38.940 INFO:tasks.workunit.client.0.smithi090.stdout:1/276: dread d8/d1a/d1d/d50/f23 [0,4194304] 0 2024-04-20T10:54:38.940 INFO:tasks.workunit.client.0.smithi090.stdout:6/270: symlink d1/d4/d26/d11/d35/l5b 0 2024-04-20T10:54:38.942 INFO:tasks.workunit.client.0.smithi090.stdout:8/311: symlink d0/d2d/l5f 0 2024-04-20T10:54:38.942 INFO:tasks.workunit.client.0.smithi090.stdout:8/312: dread - d0/f20 zero size 2024-04-20T10:54:38.942 INFO:tasks.workunit.client.0.smithi090.stdout:8/313: chown d0/d2d/f30 409493283 1 2024-04-20T10:54:38.943 INFO:tasks.workunit.client.0.smithi090.stdout:1/277: creat d8/f59 x:0 0 0 2024-04-20T10:54:38.944 INFO:tasks.workunit.client.0.smithi090.stdout:8/314: mknod d0/d2d/c60 0 2024-04-20T10:54:38.946 INFO:tasks.workunit.client.0.smithi090.stdout:7/262: dwrite d11/d13/d22/d24/d35/f47 [0,4194304] 0 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:9/295: rename d0/da to d0/d29/d36/d63 0 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:9/296: write d0/d29/d4f/f27 [659042,25115] 0 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:9/297: chown d0/d29/d36/d63/d1c/d5a/d56 369 1 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:8/315: creat d0/d11/d22/d53/d57/f61 x:0 0 0 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:7/263: mkdir d11/d13/d5b 0 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:9/298: getdents d0/d29/d36/d63/d1f/d35 0 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:8/316: symlink d0/d11/d22/l62 0 2024-04-20T10:54:38.951 INFO:tasks.workunit.client.0.smithi090.stdout:8/317: chown d0/d11/l5b 186780608 1 2024-04-20T10:54:38.952 INFO:tasks.workunit.client.0.smithi090.stdout:0/307: truncate d14/f32 604920 0 2024-04-20T10:54:38.952 INFO:tasks.workunit.client.0.smithi090.stdout:8/318: truncate d0/d11/f1b 902405 0 2024-04-20T10:54:38.952 INFO:tasks.workunit.client.0.smithi090.stdout:8/319: readlink d0/d11/l37 0 2024-04-20T10:54:38.953 INFO:tasks.workunit.client.0.smithi090.stdout:0/308: truncate d14/d19/f25 1637687 0 2024-04-20T10:54:38.953 INFO:tasks.workunit.client.0.smithi090.stdout:0/309: dread - d14/f4b zero size 2024-04-20T10:54:38.954 INFO:tasks.workunit.client.0.smithi090.stdout:8/320: creat d0/f63 x:0 0 0 2024-04-20T10:54:38.955 INFO:tasks.workunit.client.0.smithi090.stdout:0/310: getdents d14/d19/d2b/d3f 0 2024-04-20T10:54:38.955 INFO:tasks.workunit.client.0.smithi090.stdout:0/311: chown d14/d19/d2b/d3f/d43/f54 570795396 1 2024-04-20T10:54:38.956 INFO:tasks.workunit.client.0.smithi090.stdout:9/299: write d0/d29/d36/d63/f1e [5513972,79187] 0 2024-04-20T10:54:38.956 INFO:tasks.workunit.client.0.smithi090.stdout:9/300: chown d0/d29/d36/d63/f14 194008126 1 2024-04-20T10:54:38.956 INFO:tasks.workunit.client.0.smithi090.stdout:9/301: write d0/d29/d36/d63/f31 [1012586,122750] 0 2024-04-20T10:54:38.956 INFO:tasks.workunit.client.0.smithi090.stdout:9/302: chown d0/d29/d4f/c17 233201 1 2024-04-20T10:54:39.174 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:39.216 INFO:tasks.workunit.client.0.smithi090.stdout:0/312: creat d14/f5f x:0 0 0 2024-04-20T10:54:39.216 INFO:tasks.workunit.client.0.smithi090.stdout:7/264: getdents d11/d13 0 2024-04-20T10:54:39.216 INFO:tasks.workunit.client.0.smithi090.stdout:8/321: truncate d0/d3a/f46 620450 0 2024-04-20T10:54:39.216 INFO:tasks.workunit.client.0.smithi090.stdout:8/322: write d0/d11/d14/f2b [842066,79875] 0 2024-04-20T10:54:39.216 INFO:tasks.workunit.client.0.smithi090.stdout:9/303: mknod d0/d29/d36/d63/d1c/d5a/d52/c64 0 2024-04-20T10:54:39.216 INFO:tasks.workunit.client.0.smithi090.stdout:9/304: chown d0/d29/d36/d63 2421 1 2024-04-20T10:54:39.223 INFO:tasks.workunit.client.0.smithi090.stdout:0/313: write d14/f22 [312461,26105] 0 2024-04-20T10:54:39.225 INFO:tasks.workunit.client.0.smithi090.stdout:7/265: creat d11/d13/f5c x:0 0 0 2024-04-20T10:54:39.226 INFO:tasks.workunit.client.0.smithi090.stdout:7/266: read - d11/d1a/f21 zero size 2024-04-20T10:54:39.226 INFO:tasks.workunit.client.0.smithi090.stdout:9/305: unlink d0/d29/d36/d63/d1c/c61 0 2024-04-20T10:54:39.227 INFO:tasks.workunit.client.0.smithi090.stdout:9/306: chown d0/d29/d36/d63/f1b 37659 1 2024-04-20T10:54:39.227 INFO:tasks.workunit.client.0.smithi090.stdout:9/307: readlink d0/l28 0 2024-04-20T10:54:39.227 INFO:tasks.workunit.client.0.smithi090.stdout:9/308: rename d0/d29 to d0/d29/d36/d63/d1f/d34/d65 22 2024-04-20T10:54:39.227 INFO:tasks.workunit.client.0.smithi090.stdout:7/267: mkdir d11/d13/d5d 0 2024-04-20T10:54:39.234 INFO:tasks.workunit.client.0.smithi090.stdout:8/323: dwrite d0/d11/d14/f41 [0,4194304] 0 2024-04-20T10:54:39.239 INFO:tasks.workunit.client.0.smithi090.stdout:5/455: sync 2024-04-20T10:54:39.239 INFO:tasks.workunit.client.0.smithi090.stdout:6/271: sync 2024-04-20T10:54:39.240 INFO:tasks.workunit.client.0.smithi090.stdout:3/174: sync 2024-04-20T10:54:39.240 INFO:tasks.workunit.client.0.smithi090.stdout:4/174: sync 2024-04-20T10:54:39.240 INFO:tasks.workunit.client.0.smithi090.stdout:4/175: chown d7/d9/f13 462303 1 2024-04-20T10:54:39.240 INFO:tasks.workunit.client.0.smithi090.stdout:2/296: sync 2024-04-20T10:54:39.241 INFO:tasks.workunit.client.0.smithi090.stdout:5/456: dread d1/d2f/d3d/f5b [0,4194304] 0 2024-04-20T10:54:39.241 INFO:tasks.workunit.client.0.smithi090.stdout:5/457: fsync d1/d2f/d3d/d40/d70/f73 0 2024-04-20T10:54:39.241 INFO:tasks.workunit.client.0.smithi090.stdout:5/458: read - d1/de/d75/f7f zero size 2024-04-20T10:54:39.241 INFO:tasks.workunit.client.0.smithi090.stdout:5/459: read - d1/da/d14/d47/d39/f6f zero size 2024-04-20T10:54:39.241 INFO:tasks.workunit.client.0.smithi090.stdout:5/460: chown d1/da/d14/d47/d39/f5d 0 1 2024-04-20T10:54:39.241 INFO:tasks.workunit.client.0.smithi090.stdout:6/272: mknod d1/c5c 0 2024-04-20T10:54:39.242 INFO:tasks.workunit.client.0.smithi090.stdout:4/176: truncate d7/d9/f10 543485 0 2024-04-20T10:54:39.242 INFO:tasks.workunit.client.0.smithi090.stdout:4/177: dread - d7/f21 zero size 2024-04-20T10:54:39.243 INFO:tasks.workunit.client.0.smithi090.stdout:6/273: getdents d1/d4/d26/d11/d4a 0 2024-04-20T10:54:39.245 INFO:tasks.workunit.client.0.smithi090.stdout:4/178: mknod d7/d9/d17/c33 0 2024-04-20T10:54:39.245 INFO:tasks.workunit.client.0.smithi090.stdout:6/274: write d1/d4/f50 [140463,104442] 0 2024-04-20T10:54:39.246 INFO:tasks.workunit.client.0.smithi090.stdout:5/461: mkdir d1/de/d96 0 2024-04-20T10:54:39.246 INFO:tasks.workunit.client.0.smithi090.stdout:5/462: write d1/d2f/d3d/d40/d4a/f4f [2436979,110761] 0 2024-04-20T10:54:39.246 INFO:tasks.workunit.client.0.smithi090.stdout:5/463: dread - d1/da/d14/d47/d39/f6f zero size 2024-04-20T10:54:39.247 INFO:tasks.workunit.client.0.smithi090.stdout:8/324: dread d0/d26/f4d [0,4194304] 0 2024-04-20T10:54:39.247 INFO:tasks.workunit.client.0.smithi090.stdout:8/325: chown d0/d26 1229 1 2024-04-20T10:54:39.251 INFO:tasks.workunit.client.0.smithi090.stdout:3/175: read d7/d11/f1c [1833927,34490] 0 2024-04-20T10:54:39.254 INFO:tasks.workunit.client.0.smithi090.stdout:6/275: dread d1/d19/f57 [0,4194304] 0 2024-04-20T10:54:39.255 INFO:tasks.workunit.client.0.smithi090.stdout:6/276: rmdir d1/d19/d36/d1e 39 2024-04-20T10:54:39.255 INFO:tasks.workunit.client.0.smithi090.stdout:6/277: fdatasync d1/d19/d36/d1e/d1f/d3f/f4b 0 2024-04-20T10:54:39.256 INFO:tasks.workunit.client.0.smithi090.stdout:2/297: dread d11/d1f/d2e/f5d [0,4194304] 0 2024-04-20T10:54:39.257 INFO:tasks.workunit.client.0.smithi090.stdout:4/179: dread d7/d9/fa [0,4194304] 0 2024-04-20T10:54:39.257 INFO:tasks.workunit.client.0.smithi090.stdout:6/278: creat d1/d19/d36/d1e/d1f/d3f/d54/f5d x:0 0 0 2024-04-20T10:54:39.259 INFO:tasks.workunit.client.0.smithi090.stdout:2/298: link d11/d1f/c45 d11/d1a/d30/c6b 0 2024-04-20T10:54:39.259 INFO:tasks.workunit.client.0.smithi090.stdout:7/268: dwrite d11/d13/d23/f2b [0,4194304] 0 2024-04-20T10:54:39.260 INFO:tasks.workunit.client.0.smithi090.stdout:4/180: rmdir d7/d9/d24 0 2024-04-20T10:54:39.261 INFO:tasks.workunit.client.0.smithi090.stdout:6/279: mknod d1/d4/d26/d11/c5e 0 2024-04-20T10:54:39.262 INFO:tasks.workunit.client.0.smithi090.stdout:2/299: getdents d11/d1a/d4a 0 2024-04-20T10:54:39.264 INFO:tasks.workunit.client.0.smithi090.stdout:0/314: dwrite f13 [0,4194304] 0 2024-04-20T10:54:39.264 INFO:tasks.workunit.client.0.smithi090.stdout:9/309: dwrite d0/d29/d36/d63/d1c/f3e [0,4194304] 0 2024-04-20T10:54:39.264 INFO:tasks.workunit.client.0.smithi090.stdout:9/310: dread - d0/d29/d36/d63/d1c/d5a/d56/f59 zero size 2024-04-20T10:54:39.265 INFO:tasks.workunit.client.0.smithi090.stdout:7/269: rename d11/d13/d22/d24/d35/f56 to d11/d13/d22/d24/f5e 0 2024-04-20T10:54:39.265 INFO:tasks.workunit.client.0.smithi090.stdout:4/181: creat d7/d9/d30/f34 x:0 0 0 2024-04-20T10:54:39.266 INFO:tasks.workunit.client.0.smithi090.stdout:6/280: creat d1/d4/d26/d11/d35/f5f x:0 0 0 2024-04-20T10:54:39.267 INFO:tasks.workunit.client.0.smithi090.stdout:2/300: rmdir d11 39 2024-04-20T10:54:39.268 INFO:tasks.workunit.client.0.smithi090.stdout:5/464: dwrite d1/d2f/d3d/f8b [0,4194304] 0 2024-04-20T10:54:39.272 INFO:tasks.workunit.client.0.smithi090.stdout:9/311: creat d0/d29/d36/d63/f66 x:0 0 0 2024-04-20T10:54:39.273 INFO:tasks.workunit.client.0.smithi090.stdout:9/312: chown d0/d29/d4f 28 1 2024-04-20T10:54:39.273 INFO:tasks.workunit.client.0.smithi090.stdout:9/313: write d0/d29/d4f/f10 [804217,41690] 0 2024-04-20T10:54:39.273 INFO:tasks.workunit.client.0.smithi090.stdout:9/314: readlink d0/l8 0 2024-04-20T10:54:39.274 INFO:tasks.workunit.client.0.smithi090.stdout:7/270: unlink d11/d13/d22/f4c 0 2024-04-20T10:54:39.278 INFO:tasks.workunit.client.0.smithi090.stdout:4/182: rename f0 to d7/d9/f35 0 2024-04-20T10:54:39.278 INFO:tasks.workunit.client.0.smithi090.stdout:4/183: read - d7/d9/d30/f34 zero size 2024-04-20T10:54:39.278 INFO:tasks.workunit.client.0.smithi090.stdout:9/315: dread d0/d29/d4f/f27 [0,4194304] 0 2024-04-20T10:54:39.278 INFO:tasks.workunit.client.0.smithi090.stdout:6/281: creat d1/d19/d36/d1e/f60 x:0 0 0 2024-04-20T10:54:39.280 INFO:tasks.workunit.client.0.smithi090.stdout:2/301: creat d11/d1f/f6c x:0 0 0 2024-04-20T10:54:39.282 INFO:tasks.workunit.client.0.smithi090.stdout:5/465: truncate d1/da/f1e 3214681 0 2024-04-20T10:54:39.282 INFO:tasks.workunit.client.0.smithi090.stdout:8/326: dwrite d0/d11/d22/f23 [0,4194304] 0 2024-04-20T10:54:39.282 INFO:tasks.workunit.client.0.smithi090.stdout:8/327: chown d0/d11/d14/d52 3474 1 2024-04-20T10:54:39.282 INFO:tasks.workunit.client.0.smithi090.stdout:3/176: dwrite d7/d15/f1d [0,4194304] 0 2024-04-20T10:54:39.283 INFO:tasks.workunit.client.0.smithi090.stdout:4/184: rename d7/d9/f13 to d7/d9/f36 0 2024-04-20T10:54:39.285 INFO:tasks.workunit.client.0.smithi090.stdout:5/466: creat d1/da/d1f/f97 x:0 0 0 2024-04-20T10:54:39.285 INFO:tasks.workunit.client.0.smithi090.stdout:5/467: write d1/da/d14/d47/d39/f76 [2091493,22920] 0 2024-04-20T10:54:39.286 INFO:tasks.workunit.client.0.smithi090.stdout:8/328: creat d0/d11/d14/f64 x:0 0 0 2024-04-20T10:54:39.286 INFO:tasks.workunit.client.0.smithi090.stdout:8/329: write d0/d11/f1a [3360998,45955] 0 2024-04-20T10:54:39.286 INFO:tasks.workunit.client.0.smithi090.stdout:8/330: truncate d0/f36 4238138 0 2024-04-20T10:54:39.291 INFO:tasks.workunit.client.0.smithi090.stdout:3/177: mknod d7/c3b 0 2024-04-20T10:54:39.291 INFO:tasks.workunit.client.0.smithi090.stdout:3/178: fsync d7/d15/f1d 0 2024-04-20T10:54:39.293 INFO:tasks.workunit.client.0.smithi090.stdout:4/185: link d7/d9/d17/f2b d7/d9/d17/f37 0 2024-04-20T10:54:39.293 INFO:tasks.workunit.client.0.smithi090.stdout:4/186: dread - d7/d9/d30/f34 zero size 2024-04-20T10:54:39.293 INFO:tasks.workunit.client.0.smithi090.stdout:4/187: fdatasync d7/d9/d30/f34 0 2024-04-20T10:54:39.293 INFO:tasks.workunit.client.0.smithi090.stdout:4/188: chown d7/d9/ld 37533 1 2024-04-20T10:54:39.294 INFO:tasks.workunit.client.0.smithi090.stdout:2/302: write d11/f31 [2802793,93971] 0 2024-04-20T10:54:39.294 INFO:tasks.workunit.client.0.smithi090.stdout:2/303: fsync d11/d1a/d37/f44 0 2024-04-20T10:54:39.296 INFO:tasks.workunit.client.0.smithi090.stdout:8/331: creat d0/d26/f65 x:0 0 0 2024-04-20T10:54:39.296 INFO:tasks.workunit.client.0.smithi090.stdout:8/332: truncate d0/d2d/f48 1484427 0 2024-04-20T10:54:39.296 INFO:tasks.workunit.client.0.smithi090.stdout:8/333: readlink d0/l1d 0 2024-04-20T10:54:39.299 INFO:tasks.workunit.client.0.smithi090.stdout:0/315: dwrite f5 [0,4194304] 0 2024-04-20T10:54:39.299 INFO:tasks.workunit.client.0.smithi090.stdout:3/179: getdents d7/d35 0 2024-04-20T10:54:39.302 INFO:tasks.workunit.client.0.smithi090.stdout:2/304: link d11/f15 d11/d1a/d4a/d55/f6d 0 2024-04-20T10:54:39.305 INFO:tasks.workunit.client.0.smithi090.stdout:0/316: mknod d14/d19/d31/d34/c60 0 2024-04-20T10:54:39.306 INFO:tasks.workunit.client.0.smithi090.stdout:3/180: rmdir d7/d15 39 2024-04-20T10:54:39.306 INFO:tasks.workunit.client.0.smithi090.stdout:7/271: dwrite d11/d13/f5c [0,4194304] 0 2024-04-20T10:54:39.307 INFO:tasks.workunit.client.0.smithi090.stdout:7/272: write d11/d13/d22/d24/d35/f51 [5045675,126611] 0 2024-04-20T10:54:39.307 INFO:tasks.workunit.client.0.smithi090.stdout:5/468: dwrite d1/de/d75/f95 [0,4194304] 0 2024-04-20T10:54:39.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.310+0000 7fbb99bb2640 1 Processor -- start 2024-04-20T10:54:39.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.310+0000 7fbb99bb2640 1 -- start start 2024-04-20T10:54:39.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.312+0000 7fbb99bb2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbb9406ca40 0x7fbb94153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.312+0000 7fbb99bb2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb94071fa0 con 0x7fbb9406f330 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.312+0000 7fbb99bb2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb94153500 con 0x7fbb94150c00 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.312+0000 7fbb99bb2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbb940c4210 con 0x7fbb9406ca40 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.312+0000 7fbb93fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbb9406f330 0x7fbb9406d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56414/0 (socket says 172.21.15.90:56414) 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.312+0000 7fbb93fff640 1 -- 172.21.15.90:0/3184658131 learned_addr learned my addr 172.21.15.90:0/3184658131 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.312+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/3184658131 >> v2:172.21.15.175:3300/0 conn(0x7fbb9406ca40 0x7fbb94153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2016544899 0 0) 0x7fbb94071fa0 con 0x7fbb9406f330 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb7c003520 con 0x7fbb9406f330 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1830775839 0 0) 0x7fbb7c003520 con 0x7fbb9406f330 2024-04-20T10:54:39.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 >> v2:172.21.15.175:3300/0 conn(0x7fbb9406ca40 msgr2=0x7fbb94153fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 --2- 172.21.15.90:0/3184658131 >> v2:172.21.15.175:3300/0 conn(0x7fbb9406ca40 0x7fbb94153fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 >> v1:172.21.15.175:6789/0 conn(0x7fbb94150c00 legacy=0x7fbb940c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9406ced0 con 0x7fbb9406f330 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fbb8c0019f0 con 0x7fbb9406f330 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 >> v1:172.21.15.90:6789/0 conn(0x7fbb9406f330 legacy=0x7fbb9406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb7c0039b0 0x7fbb7c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb7c0051c0 0x7fbb7c00fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb940c4210 con 0x7fbb7c0051c0 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb7c0104a0 con 0x7fbb7c004800 2024-04-20T10:54:39.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.313+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbb7c0106a0 con 0x7fbb7c0039b0 2024-04-20T10:54:39.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb937fe640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb7c0039b0 0x7fbb7c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb93fff640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb7c0051c0 0x7fbb7c00fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.315 INFO:tasks.workunit.client.0.smithi090.stdout:9/316: dwrite d0/d29/d36/d63/f31 [0,4194304] 0 2024-04-20T10:54:39.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb92ffd640 1 -- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb7c0039b0 msgr2=0x7fbb7c003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:39.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb7c0039b0 0x7fbb7c003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb92ffd640 1 -- 172.21.15.90:0/3184658131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb7c0051c0 msgr2=0x7fbb7c00fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:39.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb7c0051c0 0x7fbb7c00fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb92ffd640 1 -- 172.21.15.90:0/3184658131 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb9406ced0 con 0x7fbb7c004800 2024-04-20T10:54:39.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.314+0000 7fbb93fff640 1 -- 172.21.15.90:0/3184658131 reap_dead start 2024-04-20T10:54:39.316 INFO:tasks.workunit.client.0.smithi090.stdout:7/273: dread f0 [0,4194304] 0 2024-04-20T10:54:39.316 INFO:tasks.workunit.client.0.smithi090.stdout:7/274: chown d11/d13/d22/d27 4 1 2024-04-20T10:54:39.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.316+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb7c004c80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009a90 tx=0x7fbb7c005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26427a6713dac16 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:39.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.316+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88039070 con 0x7fbb7c004800 2024-04-20T10:54:39.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.316+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb8802c660 con 0x7fbb7c004800 2024-04-20T10:54:39.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.316+0000 7fbb927fc640 1 -- 172.21.15.90:0/3184658131 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88009690 con 0x7fbb7c004800 2024-04-20T10:54:39.317 INFO:tasks.workunit.client.0.smithi090.stdout:4/189: dwrite d7/d9/d17/f37 [0,4194304] 0 2024-04-20T10:54:39.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.317+0000 7fbb99bb2640 1 -- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 msgr2=0x7fbb7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:39.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.317+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb7c004c80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb88009a90 tx=0x7fbb7c005830 comp rx=0 tx=0).stop 2024-04-20T10:54:39.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.317+0000 7fbb99bb2640 1 -- 172.21.15.90:0/3184658131 shutdown_connections 2024-04-20T10:54:39.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.317+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/3184658131 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb7c004c80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.317+0000 7fbb99bb2640 1 -- 172.21.15.90:0/3184658131 >> 172.21.15.90:0/3184658131 conn(0x7fbb940c9100 msgr2=0x7fbb940c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:39.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.317+0000 7fbb99bb2640 1 -- 172.21.15.90:0/3184658131 shutdown_connections 2024-04-20T10:54:39.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.317+0000 7fbb99bb2640 1 -- 172.21.15.90:0/3184658131 wait complete. 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.318+0000 7fbb99bb2640 1 Processor -- start 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb99bb2640 1 -- start start 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb99bb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb941558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb99bb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb941565f0 0x7fbb9414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb99bb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb941e7f40 0x7fbb94149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb99bb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbb9406d1b0 con 0x7fbb941e7f40 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb99bb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbb94153a80 con 0x7fbb7c004800 2024-04-20T10:54:39.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb99bb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbb94072fb0 con 0x7fbb941565f0 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb92ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb941565f0 0x7fbb9414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb93fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb941e7f40 0x7fbb94149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb937fe640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb941558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb92ffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb941565f0 0x7fbb9414c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:56782/0 (socket says 172.21.15.90:56782) 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.319+0000 7fbb92ffd640 1 -- 172.21.15.90:0/206868791 learned_addr learned my addr 172.21.15.90:0/206868791 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb92ffd640 1 -- 172.21.15.90:0/206868791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 msgr2=0x7fbb941558b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb941558b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb92ffd640 1 -- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb941e7f40 msgr2=0x7fbb94149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb941e7f40 0x7fbb94149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb92ffd640 1 -- 172.21.15.90:0/206868791 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb94155df0 con 0x7fbb941565f0 2024-04-20T10:54:39.321 INFO:tasks.workunit.client.0.smithi090.stdout:6/282: dwrite d1/d4/f50 [0,4194304] 0 2024-04-20T10:54:39.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb92ffd640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb941565f0 0x7fbb9414c6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb88037040 tx=0x7fbb88004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:39.322 INFO:tasks.workunit.client.0.smithi090.stdout:6/283: write d1/d4/d26/f4d [44352,81088] 0 2024-04-20T10:54:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb7bfff640 1 -- 172.21.15.90:0/206868791 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb88039050 con 0x7fbb941565f0 2024-04-20T10:54:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb7bfff640 1 -- 172.21.15.90:0/206868791 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb88045070 con 0x7fbb941565f0 2024-04-20T10:54:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb9414ab10 con 0x7fbb941565f0 2024-04-20T10:54:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb7bfff640 1 -- 172.21.15.90:0/206868791 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb880044e0 con 0x7fbb941565f0 2024-04-20T10:54:39.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.320+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb9414a4e0 con 0x7fbb941565f0 2024-04-20T10:54:39.323 INFO:tasks.workunit.client.0.smithi090.stdout:4/190: dread d7/f26 [0,4194304] 0 2024-04-20T10:54:39.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.321+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb9414a720 con 0x7fbb941565f0 2024-04-20T10:54:39.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.322+0000 7fbb7bfff640 1 -- 172.21.15.90:0/206868791 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbb88003830 con 0x7fbb941565f0 2024-04-20T10:54:39.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.323+0000 7fbb7bfff640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbb8006c920 0x7fbb8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:39.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.323+0000 7fbb937fe640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbb8006c920 0x7fbb8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:39.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.323+0000 7fbb7bfff640 1 -- 172.21.15.90:0/206868791 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7fbb880ae270 con 0x7fbb941565f0 2024-04-20T10:54:39.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.323+0000 7fbb937fe640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbb8006c920 0x7fbb8006ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406a810 tx=0x7fbb84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:39.325 INFO:tasks.workunit.client.0.smithi090.stdout:8/334: dwrite d0/d11/d14/f64 [0,4194304] 0 2024-04-20T10:54:39.325 INFO:tasks.workunit.client.0.smithi090.stdout:0/317: dwrite fa [0,4194304] 0 2024-04-20T10:54:39.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.327+0000 7fbb7bfff640 1 -- 172.21.15.90:0/206868791 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbb9414a720 con 0x7fbb941565f0 2024-04-20T10:54:39.332 INFO:tasks.workunit.client.0.smithi090.stdout:0/318: write fd [300655,112675] 0 2024-04-20T10:54:39.336 INFO:tasks.workunit.client.0.smithi090.stdout:4/191: dwrite d7/d9/f11 [0,4194304] 0 2024-04-20T10:54:39.339 INFO:tasks.workunit.client.0.smithi090.stdout:0/319: dread f13 [0,4194304] 0 2024-04-20T10:54:39.339 INFO:tasks.workunit.client.0.smithi090.stdout:0/320: dread - d14/d19/d2b/d3f/f4f zero size 2024-04-20T10:54:39.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.543+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb94076150 con 0x7fbb941565f0 2024-04-20T10:54:39.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.543+0000 7fbb7bfff640 1 -- 172.21.15.90:0/206868791 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7fbb8807bc50 con 0x7fbb941565f0 2024-04-20T10:54:39.544 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:39.544 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:39.544 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:39.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.545+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbb8006c920 msgr2=0x7fbb8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:39.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.545+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbb8006c920 0x7fbb8006ede0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbb9406a810 tx=0x7fbb84009040 comp rx=0 tx=0).stop 2024-04-20T10:54:39.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.545+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb941565f0 msgr2=0x7fbb9414c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:39.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.545+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb941565f0 0x7fbb9414c6a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbb88037040 tx=0x7fbb88004730 comp rx=0 tx=0).stop 2024-04-20T10:54:39.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 shutdown_connections 2024-04-20T10:54:39.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbb8006c920 0x7fbb8006ede0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbb941e7f40 0x7fbb94149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbb941565f0 0x7fbb9414c6a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 --2- 172.21.15.90:0/206868791 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbb7c004800 0x7fbb941558b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 >> 172.21.15.90:0/206868791 conn(0x7fbb940c9100 msgr2=0x7fbb940c4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 shutdown_connections 2024-04-20T10:54:39.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:39.546+0000 7fbb99bb2640 1 -- 172.21.15.90:0/206868791 wait complete. 2024-04-20T10:54:39.556 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:39.558 INFO:tasks.workunit.client.0.smithi090.stdout:2/305: mkdir d11/d1f/d2e/d6e 0 2024-04-20T10:54:39.558 INFO:tasks.workunit.client.0.smithi090.stdout:1/278: sync 2024-04-20T10:54:39.559 INFO:tasks.workunit.client.0.smithi090.stdout:3/181: creat d7/d26/f3c x:0 0 0 2024-04-20T10:54:39.561 INFO:tasks.workunit.client.0.smithi090.stdout:5/469: mkdir d1/d41/d98 0 2024-04-20T10:54:39.563 INFO:tasks.workunit.client.0.smithi090.stdout:9/317: unlink d0/d29/d36/d63/d1c/f5c 0 2024-04-20T10:54:39.563 INFO:tasks.workunit.client.0.smithi090.stdout:9/318: fsync d0/d29/d36/d63/d1f/d4d/f50 0 2024-04-20T10:54:39.564 INFO:tasks.workunit.client.0.smithi090.stdout:7/275: creat d11/d1a/d3f/f5f x:0 0 0 2024-04-20T10:54:39.564 INFO:tasks.workunit.client.0.smithi090.stdout:7/276: fsync f9 0 2024-04-20T10:54:39.567 INFO:tasks.workunit.client.0.smithi090.stdout:6/284: creat d1/d4/d26/d11/d4a/d56/f61 x:0 0 0 2024-04-20T10:54:39.567 INFO:tasks.workunit.client.0.smithi090.stdout:6/285: read d1/d19/f57 [142510,64814] 0 2024-04-20T10:54:39.567 INFO:tasks.workunit.client.0.smithi090.stdout:6/286: truncate d1/d4/d26/f4d 930335 0 2024-04-20T10:54:39.567 INFO:tasks.workunit.client.0.smithi090.stdout:7/277: read d11/d1a/f1b [978904,95087] 0 2024-04-20T10:54:39.568 INFO:tasks.workunit.client.0.smithi090.stdout:2/306: write d11/d1a/d30/f48 [3916615,9897] 0 2024-04-20T10:54:39.568 INFO:tasks.workunit.client.0.smithi090.stdout:9/319: write d0/d29/d36/d63/d1c/d5a/d56/f58 [455920,110488] 0 2024-04-20T10:54:39.568 INFO:tasks.workunit.client.0.smithi090.stdout:9/320: truncate d0/d29/d36/d63/d1c/d5a/d56/f59 1023127 0 2024-04-20T10:54:39.568 INFO:tasks.workunit.client.0.smithi090.stdout:8/335: symlink d0/d3a/l66 0 2024-04-20T10:54:39.571 INFO:tasks.workunit.client.0.smithi090.stdout:4/192: getdents d7/d9/d30 0 2024-04-20T10:54:39.572 INFO:tasks.workunit.client.0.smithi090.stdout:0/321: unlink d14/d19/d31/d34/c60 0 2024-04-20T10:54:39.575 INFO:tasks.workunit.client.0.smithi090.stdout:1/279: unlink d8/d1a/d1d/d50/c25 0 2024-04-20T10:54:39.576 INFO:tasks.workunit.client.0.smithi090.stdout:3/182: creat d7/f3d x:0 0 0 2024-04-20T10:54:39.577 INFO:tasks.workunit.client.0.smithi090.stdout:3/183: write d7/d26/f3c [197965,58612] 0 2024-04-20T10:54:39.578 INFO:tasks.workunit.client.0.smithi090.stdout:5/470: rename d1/d41/l63 to d1/d2f/d3d/d40/d70/l99 0 2024-04-20T10:54:39.578 INFO:tasks.workunit.client.0.smithi090.stdout:5/471: chown d1/da/d14/d47/d39/f79 89 1 2024-04-20T10:54:39.579 INFO:tasks.workunit.client.0.smithi090.stdout:6/287: truncate d1/f6 4500832 0 2024-04-20T10:54:39.581 INFO:tasks.workunit.client.0.smithi090.stdout:7/278: creat d11/d13/d5b/f60 x:0 0 0 2024-04-20T10:54:39.581 INFO:tasks.workunit.client.0.smithi090.stdout:2/307: chown d11/d1a/f1b 18 1 2024-04-20T10:54:39.582 INFO:tasks.workunit.client.0.smithi090.stdout:9/321: creat d0/d29/d4f/f67 x:0 0 0 2024-04-20T10:54:39.583 INFO:tasks.workunit.client.0.smithi090.stdout:8/336: mkdir d0/d2d/d49/d67 0 2024-04-20T10:54:39.585 INFO:tasks.workunit.client.0.smithi090.stdout:4/193: creat d7/f38 x:0 0 0 2024-04-20T10:54:39.586 INFO:tasks.workunit.client.0.smithi090.stdout:1/280: mkdir d8/d1a/d1d/d2c/d4a/d5a 0 2024-04-20T10:54:39.587 INFO:tasks.workunit.client.0.smithi090.stdout:3/184: symlink d7/d15/d2a/l3e 0 2024-04-20T10:54:39.587 INFO:tasks.workunit.client.0.smithi090.stdout:3/185: dread - d7/f3d zero size 2024-04-20T10:54:39.588 INFO:tasks.workunit.client.0.smithi090.stdout:5/472: creat d1/d2f/d3d/d40/d89/f9a x:0 0 0 2024-04-20T10:54:39.590 INFO:tasks.workunit.client.0.smithi090.stdout:6/288: creat d1/d19/d36/d1e/d1f/d3f/d54/f62 x:0 0 0 2024-04-20T10:54:39.592 INFO:tasks.workunit.client.0.smithi090.stdout:9/322: dread d0/f4 [0,4194304] 0 2024-04-20T10:54:39.592 INFO:tasks.workunit.client.0.smithi090.stdout:9/323: dread - d0/d29/f57 zero size 2024-04-20T10:54:39.592 INFO:tasks.workunit.client.0.smithi090.stdout:7/279: mkdir d11/d61 0 2024-04-20T10:54:39.595 INFO:tasks.workunit.client.0.smithi090.stdout:0/322: dwrite d14/d19/f1b [0,4194304] 0 2024-04-20T10:54:39.596 INFO:tasks.workunit.client.0.smithi090.stdout:2/308: rmdir d11/d1a/d4a 39 2024-04-20T10:54:39.596 INFO:tasks.workunit.client.0.smithi090.stdout:2/309: fdatasync d11/d1a/d4a/f53 0 2024-04-20T10:54:39.596 INFO:tasks.workunit.client.0.smithi090.stdout:2/310: chown d11/f15 69713 1 2024-04-20T10:54:39.596 INFO:tasks.workunit.client.0.smithi090.stdout:2/311: dread - d11/d1f/d2e/f33 zero size 2024-04-20T10:54:39.596 INFO:tasks.workunit.client.0.smithi090.stdout:8/337: link d0/d11/d22/c59 d0/d11/d22/d53/d57/c68 0 2024-04-20T10:54:39.597 INFO:tasks.workunit.client.0.smithi090.stdout:8/338: truncate d0/f63 389372 0 2024-04-20T10:54:39.599 INFO:tasks.workunit.client.0.smithi090.stdout:5/473: dread d1/da/d14/d47/d50/f51 [0,4194304] 0 2024-04-20T10:54:39.599 INFO:tasks.workunit.client.0.smithi090.stdout:3/186: rename d7/fd to d7/d11/f3f 0 2024-04-20T10:54:39.599 INFO:tasks.workunit.client.0.smithi090.stdout:3/187: chown d7/c8 773467 1 2024-04-20T10:54:39.600 INFO:tasks.workunit.client.0.smithi090.stdout:9/324: mkdir d0/d29/d36/d63/d1c/d5a/d68 0 2024-04-20T10:54:39.601 INFO:tasks.workunit.client.0.smithi090.stdout:2/312: symlink d11/d1a/d4a/l6f 0 2024-04-20T10:54:39.602 INFO:tasks.workunit.client.0.smithi090.stdout:0/323: rename d14/d19/d31/d37 to d14/d19/d2b/d61 0 2024-04-20T10:54:39.603 INFO:tasks.workunit.client.0.smithi090.stdout:9/325: symlink d0/l69 0 2024-04-20T10:54:39.605 INFO:tasks.workunit.client.0.smithi090.stdout:5/474: rename d1/d2f/d3d/d40/f45 to d1/da/d1f/f9b 0 2024-04-20T10:54:39.606 INFO:tasks.workunit.client.0.smithi090.stdout:0/324: mknod d14/d19/d2b/c62 0 2024-04-20T10:54:39.608 INFO:tasks.workunit.client.0.smithi090.stdout:9/326: creat d0/f6a x:0 0 0 2024-04-20T10:54:39.608 INFO:tasks.workunit.client.0.smithi090.stdout:5/475: truncate d1/f26 3261560 0 2024-04-20T10:54:39.609 INFO:tasks.workunit.client.0.smithi090.stdout:9/327: mkdir d0/d29/d4f/d6b 0 2024-04-20T10:54:39.609 INFO:tasks.workunit.client.0.smithi090.stdout:9/328: stat d0/d29/d4f/f2d 0 2024-04-20T10:54:39.610 INFO:tasks.workunit.client.0.smithi090.stdout:5/476: creat d1/d2a/f9c x:0 0 0 2024-04-20T10:54:39.612 INFO:tasks.workunit.client.0.smithi090.stdout:9/329: creat d0/d29/d36/d63/d1c/d5a/d56/f6c x:0 0 0 2024-04-20T10:54:39.612 INFO:tasks.workunit.client.0.smithi090.stdout:9/330: dread - d0/d29/d36/d63/d1c/d5a/d56/f6c zero size 2024-04-20T10:54:39.612 INFO:tasks.workunit.client.0.smithi090.stdout:9/331: fdatasync d0/d29/d36/d63/d1c/f2a 0 2024-04-20T10:54:39.612 INFO:tasks.workunit.client.0.smithi090.stdout:9/332: write d0/d29/d36/d63/f13 [4758560,15615] 0 2024-04-20T10:54:39.612 INFO:tasks.workunit.client.0.smithi090.stdout:5/477: mknod d1/da/d14/d47/d50/c9d 0 2024-04-20T10:54:39.614 INFO:tasks.workunit.client.0.smithi090.stdout:9/333: link d0/d29/d4f/f67 d0/d29/d36/f6d 0 2024-04-20T10:54:39.615 INFO:tasks.workunit.client.0.smithi090.stdout:9/334: truncate d0/d29/d36/d63/d1f/d4d/f50 482803 0 2024-04-20T10:54:39.615 INFO:tasks.workunit.client.0.smithi090.stdout:9/335: write d0/d29/d4f/f10 [1000611,124336] 0 2024-04-20T10:54:39.616 INFO:tasks.workunit.client.0.smithi090.stdout:5/478: symlink d1/d2f/d3d/l9e 0 2024-04-20T10:54:39.616 INFO:tasks.workunit.client.0.smithi090.stdout:5/479: symlink d1/d55/l9f 0 2024-04-20T10:54:39.617 INFO:tasks.workunit.client.0.smithi090.stdout:5/480: getdents d1/d41/d98 0 2024-04-20T10:54:39.617 INFO:tasks.workunit.client.0.smithi090.stdout:5/481: truncate d1/de/d75/f95 3017757 0 2024-04-20T10:54:39.617 INFO:tasks.workunit.client.0.smithi090.stdout:5/482: getdents d1/de/d96 0 2024-04-20T10:54:39.618 INFO:tasks.workunit.client.0.smithi090.stdout:5/483: dread d1/f58 [0,4194304] 0 2024-04-20T10:54:39.619 INFO:tasks.workunit.client.0.smithi090.stdout:5/484: symlink d1/da/d16/la0 0 2024-04-20T10:54:39.620 INFO:tasks.workunit.client.0.smithi090.stdout:6/289: write d1/f6 [2638414,44251] 0 2024-04-20T10:54:39.620 INFO:tasks.workunit.client.0.smithi090.stdout:6/290: write d1/d4/f30 [646369,36225] 0 2024-04-20T10:54:39.621 INFO:tasks.workunit.client.0.smithi090.stdout:8/339: dwrite d0/d11/d22/f34 [0,4194304] 0 2024-04-20T10:54:39.621 INFO:tasks.workunit.client.0.smithi090.stdout:5/485: rename d1/da/l13 to d1/d55/la1 0 2024-04-20T10:54:39.622 INFO:tasks.workunit.client.0.smithi090.stdout:8/340: truncate d0/d11/d14/f64 411636 0 2024-04-20T10:54:39.626 INFO:tasks.workunit.client.0.smithi090.stdout:0/325: dwrite d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:39.628 INFO:tasks.workunit.client.0.smithi090.stdout:4/194: dwrite d7/f1d [0,4194304] 0 2024-04-20T10:54:39.630 INFO:tasks.workunit.client.0.smithi090.stdout:9/336: dread d0/d29/d36/d63/f31 [0,4194304] 0 2024-04-20T10:54:39.630 INFO:tasks.workunit.client.0.smithi090.stdout:9/337: stat d0/d29/d36/d63/l3a 0 2024-04-20T10:54:39.630 INFO:tasks.workunit.client.0.smithi090.stdout:4/195: rename f2 to d7/d9/f39 0 2024-04-20T10:54:39.631 INFO:tasks.workunit.client.0.smithi090.stdout:9/338: rename d0/d29/d36/d63/d1f/d35/f3c to d0/d29/f6e 0 2024-04-20T10:54:39.631 INFO:tasks.workunit.client.0.smithi090.stdout:4/196: rename d7/d9/d17 to d7/d9/d17/d3a 22 2024-04-20T10:54:39.632 INFO:tasks.workunit.client.0.smithi090.stdout:0/326: dread fd [0,4194304] 0 2024-04-20T10:54:39.632 INFO:tasks.workunit.client.0.smithi090.stdout:4/197: rename d7/l23 to d7/d9/l3b 0 2024-04-20T10:54:39.633 INFO:tasks.workunit.client.0.smithi090.stdout:9/339: mknod d0/d29/d36/d63/d1f/d34/c6f 0 2024-04-20T10:54:39.633 INFO:tasks.workunit.client.0.smithi090.stdout:9/340: stat d0/f11 0 2024-04-20T10:54:39.634 INFO:tasks.workunit.client.0.smithi090.stdout:0/327: mknod d14/d19/d2c/c63 0 2024-04-20T10:54:39.634 INFO:tasks.workunit.client.0.smithi090.stdout:0/328: chown d14/d19/d2b/d52/d55 17 1 2024-04-20T10:54:39.634 INFO:tasks.workunit.client.0.smithi090.stdout:4/198: unlink d7/f1d 0 2024-04-20T10:54:39.634 INFO:tasks.workunit.client.0.smithi090.stdout:1/281: dwrite d8/f34 [0,4194304] 0 2024-04-20T10:54:39.637 INFO:tasks.workunit.client.0.smithi090.stdout:0/329: symlink d14/l64 0 2024-04-20T10:54:39.640 INFO:tasks.workunit.client.0.smithi090.stdout:8/341: fdatasync d0/d2d/f43 0 2024-04-20T10:54:39.641 INFO:tasks.workunit.client.0.smithi090.stdout:7/280: dwrite f8 [0,4194304] 0 2024-04-20T10:54:39.641 INFO:tasks.workunit.client.0.smithi090.stdout:8/342: creat d0/d2d/d49/d67/f69 x:0 0 0 2024-04-20T10:54:39.641 INFO:tasks.workunit.client.0.smithi090.stdout:7/281: chown d11/d13/d22/d24/d35/f51 0 1 2024-04-20T10:54:39.642 INFO:tasks.workunit.client.0.smithi090.stdout:2/313: dwrite d11/d1f/d2e/f3d [0,4194304] 0 2024-04-20T10:54:39.642 INFO:tasks.workunit.client.0.smithi090.stdout:3/188: dwrite d7/d11/f3f [8388608,4194304] 0 2024-04-20T10:54:39.642 INFO:tasks.workunit.client.0.smithi090.stdout:3/189: truncate d7/d11/f32 903440 0 2024-04-20T10:54:39.642 INFO:tasks.workunit.client.0.smithi090.stdout:4/199: dread d7/d9/d17/f2b [0,4194304] 0 2024-04-20T10:54:39.643 INFO:tasks.workunit.client.0.smithi090.stdout:3/190: dread d7/d15/f25 [0,4194304] 0 2024-04-20T10:54:39.643 INFO:tasks.workunit.client.0.smithi090.stdout:8/343: symlink d0/d11/d22/d53/l6a 0 2024-04-20T10:54:39.646 INFO:tasks.workunit.client.0.smithi090.stdout:2/314: mknod d11/d1a/d30/c70 0 2024-04-20T10:54:39.646 INFO:tasks.workunit.client.0.smithi090.stdout:2/315: write d11/d1a/d4a/f4e [651876,67437] 0 2024-04-20T10:54:39.646 INFO:tasks.workunit.client.0.smithi090.stdout:2/316: write d11/f1c [1935866,39555] 0 2024-04-20T10:54:39.647 INFO:tasks.workunit.client.0.smithi090.stdout:3/191: truncate d7/d15/f1d 3187215 0 2024-04-20T10:54:39.647 INFO:tasks.workunit.client.0.smithi090.stdout:3/192: fdatasync d7/fc 0 2024-04-20T10:54:39.649 INFO:tasks.workunit.client.0.smithi090.stdout:3/193: creat d7/f40 x:0 0 0 2024-04-20T10:54:39.650 INFO:tasks.workunit.client.0.smithi090.stdout:3/194: creat d7/df/f41 x:0 0 0 2024-04-20T10:54:39.651 INFO:tasks.workunit.client.0.smithi090.stdout:3/195: symlink d7/d35/l42 0 2024-04-20T10:54:39.653 INFO:tasks.workunit.client.0.smithi090.stdout:3/196: mkdir d7/d43 0 2024-04-20T10:54:39.656 INFO:tasks.workunit.client.0.smithi090.stdout:0/330: dwrite d14/f2a [0,4194304] 0 2024-04-20T10:54:39.660 INFO:tasks.workunit.client.0.smithi090.stdout:9/341: rename d0/d29/d36/d63/d1c/d5a to d0/d29/d36/d63/d1f/d34/d70 0 2024-04-20T10:54:39.660 INFO:tasks.workunit.client.0.smithi090.stdout:9/342: stat d0/d29/d4f/d6b 0 2024-04-20T10:54:39.661 INFO:tasks.workunit.client.0.smithi090.stdout:1/282: rename d8/d1a/d1d/c2e to d8/c5b 0 2024-04-20T10:54:39.663 INFO:tasks.workunit.client.0.smithi090.stdout:7/282: rename d11/d13/d5b/f60 to d11/d13/d23/f62 0 2024-04-20T10:54:39.664 INFO:tasks.workunit.client.0.smithi090.stdout:1/283: truncate d8/f2d 2256897 0 2024-04-20T10:54:39.666 INFO:tasks.workunit.client.0.smithi090.stdout:4/200: rename d7/d9/f11 to d7/f3c 0 2024-04-20T10:54:39.666 INFO:tasks.workunit.client.0.smithi090.stdout:2/317: dwrite d11/d1f/d2e/f52 [0,4194304] 0 2024-04-20T10:54:39.667 INFO:tasks.workunit.client.0.smithi090.stdout:7/283: symlink d11/d13/d22/d27/l63 0 2024-04-20T10:54:39.669 INFO:tasks.workunit.client.0.smithi090.stdout:1/284: creat d8/d1a/d1d/d2c/d3f/f5c x:0 0 0 2024-04-20T10:54:39.670 INFO:tasks.workunit.client.0.smithi090.stdout:0/331: write d14/f2a [2733353,17736] 0 2024-04-20T10:54:39.671 INFO:tasks.workunit.client.0.smithi090.stdout:8/344: rename d0/d2d/d44/l50 to d0/d3a/l6b 0 2024-04-20T10:54:39.672 INFO:tasks.workunit.client.0.smithi090.stdout:6/291: dwrite d1/d19/d36/d28/f34 [0,4194304] 0 2024-04-20T10:54:39.673 INFO:tasks.workunit.client.0.smithi090.stdout:4/201: mkdir d7/d9/d30/d3d 0 2024-04-20T10:54:39.673 INFO:tasks.workunit.client.0.smithi090.stdout:4/202: chown d7/c2e 1203718 1 2024-04-20T10:54:39.674 INFO:tasks.workunit.client.0.smithi090.stdout:3/197: dwrite d7/d26/f3c [0,4194304] 0 2024-04-20T10:54:39.674 INFO:tasks.workunit.client.0.smithi090.stdout:3/198: chown d7/d15 1610116 1 2024-04-20T10:54:39.676 INFO:tasks.workunit.client.0.smithi090.stdout:1/285: dread d8/f44 [0,4194304] 0 2024-04-20T10:54:39.676 INFO:tasks.workunit.client.0.smithi090.stdout:1/286: fdatasync d8/d1a/d1d/d2c/f51 0 2024-04-20T10:54:39.676 INFO:tasks.workunit.client.0.smithi090.stdout:1/287: dread - d8/f54 zero size 2024-04-20T10:54:39.677 INFO:tasks.workunit.client.0.smithi090.stdout:2/318: creat d11/d1a/d4a/d55/d67/f71 x:0 0 0 2024-04-20T10:54:39.678 INFO:tasks.workunit.client.0.smithi090.stdout:0/332: creat d14/d19/d2b/d61/f65 x:0 0 0 2024-04-20T10:54:39.678 INFO:tasks.workunit.client.0.smithi090.stdout:0/333: fsync d14/f1e 0 2024-04-20T10:54:39.680 INFO:tasks.workunit.client.0.smithi090.stdout:9/343: rename d0/d29/d36/d63/f31 to d0/d29/d36/d63/d1f/f71 0 2024-04-20T10:54:39.681 INFO:tasks.workunit.client.0.smithi090.stdout:8/345: getdents d0/d11/d22/d53/d57 0 2024-04-20T10:54:39.682 INFO:tasks.workunit.client.0.smithi090.stdout:4/203: read d7/d9/f36 [2636572,5985] 0 2024-04-20T10:54:39.682 INFO:tasks.workunit.client.0.smithi090.stdout:4/204: readlink d7/l2a 0 2024-04-20T10:54:39.682 INFO:tasks.workunit.client.0.smithi090.stdout:4/205: chown d7/d9/d30 226114531 1 2024-04-20T10:54:39.686 INFO:tasks.workunit.client.0.smithi090.stdout:1/288: mkdir d8/d1a/d1d/d50/d31/d5d 0 2024-04-20T10:54:39.686 INFO:tasks.workunit.client.0.smithi090.stdout:2/319: link d11/d1a/d30/c65 d11/d1a/d2b/c72 0 2024-04-20T10:54:39.687 INFO:tasks.workunit.client.0.smithi090.stdout:9/344: dread d0/d29/d36/d63/d1f/d34/d70/d56/f58 [0,4194304] 0 2024-04-20T10:54:39.688 INFO:tasks.workunit.client.0.smithi090.stdout:9/345: fdatasync d0/f4 0 2024-04-20T10:54:39.688 INFO:tasks.workunit.client.0.smithi090.stdout:7/284: rename d11/d13/d22/d24/f3c to d11/d13/d22/f64 0 2024-04-20T10:54:39.689 INFO:tasks.workunit.client.0.smithi090.stdout:4/206: unlink d7/l2a 0 2024-04-20T10:54:39.691 INFO:tasks.workunit.client.0.smithi090.stdout:1/289: unlink d8/d1a/d4d/l58 0 2024-04-20T10:54:39.691 INFO:tasks.workunit.client.0.smithi090.stdout:1/290: dread - d8/d1a/d45/f4f zero size 2024-04-20T10:54:39.693 INFO:tasks.workunit.client.0.smithi090.stdout:9/346: stat d0/d29/d4f/c47 0 2024-04-20T10:54:39.693 INFO:tasks.workunit.client.0.smithi090.stdout:9/347: chown d0/d29/d36/d63/d1f/c40 834 1 2024-04-20T10:54:39.693 INFO:tasks.workunit.client.0.smithi090.stdout:9/348: fdatasync d0/f11 0 2024-04-20T10:54:39.693 INFO:tasks.workunit.client.0.smithi090.stdout:9/349: fdatasync d0/f4 0 2024-04-20T10:54:39.693 INFO:tasks.workunit.client.0.smithi090.stdout:9/350: write d0/d29/d36/d63/d1f/d34/d70/f53 [636985,26897] 0 2024-04-20T10:54:39.695 INFO:tasks.workunit.client.0.smithi090.stdout:3/199: rename c3 to d7/d15/d2a/c44 0 2024-04-20T10:54:39.695 INFO:tasks.workunit.client.0.smithi090.stdout:3/200: fsync d7/d15/f25 0 2024-04-20T10:54:39.696 INFO:tasks.workunit.client.0.smithi090.stdout:7/285: mkdir d11/d13/d5d/d65 0 2024-04-20T10:54:39.696 INFO:tasks.workunit.client.0.smithi090.stdout:7/286: stat d11/d13/d22/d24/l28 0 2024-04-20T10:54:39.697 INFO:tasks.workunit.client.0.smithi090.stdout:4/207: unlink d7/d9/ce 0 2024-04-20T10:54:39.698 INFO:tasks.workunit.client.0.smithi090.stdout:9/351: creat d0/d29/d4f/d6b/f72 x:0 0 0 2024-04-20T10:54:39.699 INFO:tasks.workunit.client.0.smithi090.stdout:7/287: getdents d11/d1a/d2f 0 2024-04-20T10:54:39.701 INFO:tasks.workunit.client.0.smithi090.stdout:4/208: mknod d7/d9/d17/c3e 0 2024-04-20T10:54:39.703 INFO:tasks.workunit.client.0.smithi090.stdout:9/352: mknod d0/c73 0 2024-04-20T10:54:39.703 INFO:tasks.workunit.client.0.smithi090.stdout:9/353: stat d0/l8 0 2024-04-20T10:54:39.704 INFO:tasks.workunit.client.0.smithi090.stdout:2/320: dread d11/d1a/f58 [0,4194304] 0 2024-04-20T10:54:39.705 INFO:tasks.workunit.client.0.smithi090.stdout:4/209: creat d7/d9/d17/f3f x:0 0 0 2024-04-20T10:54:39.708 INFO:tasks.workunit.client.0.smithi090.stdout:9/354: rmdir d0/d29/d36/d63/d1f/d34/d70/d68 0 2024-04-20T10:54:39.709 INFO:tasks.workunit.client.0.smithi090.stdout:9/355: getdents d0/d29/d4f/d23 0 2024-04-20T10:54:39.709 INFO:tasks.workunit.client.0.smithi090.stdout:9/356: dread - d0/d29/d36/d63/d1f/d34/d70/d52/f60 zero size 2024-04-20T10:54:39.712 INFO:tasks.workunit.client.0.smithi090.stdout:9/357: rename d0/d29/d36/d63/d1f/d34/d70/d52/f60 to d0/d29/d36/d63/d1c/f74 0 2024-04-20T10:54:39.712 INFO:tasks.workunit.client.0.smithi090.stdout:9/358: fsync d0/d29/d36/d63/f14 0 2024-04-20T10:54:39.713 INFO:tasks.workunit.client.0.smithi090.stdout:9/359: creat d0/d29/d36/d63/d1f/d34/d70/d56/f75 x:0 0 0 2024-04-20T10:54:39.714 INFO:tasks.workunit.client.0.smithi090.stdout:9/360: rename d0/d29/d36/d63/d1f to d0/d29/d36/d63/d1f/d35/d76 22 2024-04-20T10:54:39.714 INFO:tasks.workunit.client.0.smithi090.stdout:7/288: dread f4 [0,4194304] 0 2024-04-20T10:54:39.715 INFO:tasks.workunit.client.0.smithi090.stdout:9/361: symlink d0/d29/d36/d63/d1f/d34/d70/d52/l77 0 2024-04-20T10:54:39.718 INFO:tasks.workunit.client.0.smithi090.stdout:7/289: rename d11/d1a/d2f/f52 to d11/d1a/d3f/f66 0 2024-04-20T10:54:39.718 INFO:tasks.workunit.client.0.smithi090.stdout:8/346: dwrite d0/f63 [0,4194304] 0 2024-04-20T10:54:39.720 INFO:tasks.workunit.client.0.smithi090.stdout:6/292: dwrite d1/d4/d26/f4d [0,4194304] 0 2024-04-20T10:54:39.721 INFO:tasks.workunit.client.0.smithi090.stdout:9/362: mkdir d0/d29/d36/d63/d78 0 2024-04-20T10:54:39.721 INFO:tasks.workunit.client.0.smithi090.stdout:9/363: truncate d0/f37 4629326 0 2024-04-20T10:54:39.721 INFO:tasks.workunit.client.0.smithi090.stdout:9/364: write d0/d29/d4f/f67 [143950,53031] 0 2024-04-20T10:54:39.721 INFO:tasks.workunit.client.0.smithi090.stdout:0/334: dwrite f9 [0,4194304] 0 2024-04-20T10:54:39.721 INFO:tasks.workunit.client.0.smithi090.stdout:6/293: write d1/d19/f2d [248879,128479] 0 2024-04-20T10:54:39.721 INFO:tasks.workunit.client.0.smithi090.stdout:6/294: readlink d1/d19/d25/l43 0 2024-04-20T10:54:39.725 INFO:tasks.workunit.client.0.smithi090.stdout:7/290: unlink d11/d13/f55 0 2024-04-20T10:54:39.728 INFO:tasks.workunit.client.0.smithi090.stdout:0/335: getdents d14/d19/d2b/d61 0 2024-04-20T10:54:39.729 INFO:tasks.workunit.client.0.smithi090.stdout:7/291: truncate f9 2256384 0 2024-04-20T10:54:39.731 INFO:tasks.workunit.client.0.smithi090.stdout:8/347: dread d0/d11/d14/f41 [0,4194304] 0 2024-04-20T10:54:39.731 INFO:tasks.workunit.client.0.smithi090.stdout:0/336: unlink d14/f32 0 2024-04-20T10:54:39.731 INFO:tasks.workunit.client.0.smithi090.stdout:0/337: getdents d14/d19/d2b/d3f 0 2024-04-20T10:54:39.731 INFO:tasks.workunit.client.0.smithi090.stdout:0/338: fdatasync ff 0 2024-04-20T10:54:39.732 INFO:tasks.workunit.client.0.smithi090.stdout:7/292: unlink d11/d1a/f21 0 2024-04-20T10:54:39.732 INFO:tasks.workunit.client.0.smithi090.stdout:1/291: dwrite d8/f46 [0,4194304] 0 2024-04-20T10:54:39.733 INFO:tasks.workunit.client.0.smithi090.stdout:8/348: creat d0/d11/d14/f6c x:0 0 0 2024-04-20T10:54:39.734 INFO:tasks.workunit.client.0.smithi090.stdout:7/293: mknod d11/d1a/d3b/d58/c67 0 2024-04-20T10:54:39.736 INFO:tasks.workunit.client.0.smithi090.stdout:8/349: creat d0/d26/f6d x:0 0 0 2024-04-20T10:54:39.737 INFO:tasks.workunit.client.0.smithi090.stdout:7/294: symlink d11/l68 0 2024-04-20T10:54:39.737 INFO:tasks.workunit.client.0.smithi090.stdout:7/295: stat d11/d13/d22/l4e 0 2024-04-20T10:54:39.738 INFO:tasks.workunit.client.0.smithi090.stdout:5/486: truncate d1/f26 2029191 0 2024-04-20T10:54:39.739 INFO:tasks.workunit.client.0.smithi090.stdout:3/201: dwrite d7/f3d [0,4194304] 0 2024-04-20T10:54:39.739 INFO:tasks.workunit.client.0.smithi090.stdout:7/296: creat d11/d13/d22/d24/f69 x:0 0 0 2024-04-20T10:54:39.739 INFO:tasks.workunit.client.0.smithi090.stdout:2/321: dwrite d11/d1a/d30/f42 [0,4194304] 0 2024-04-20T10:54:39.739 INFO:tasks.workunit.client.0.smithi090.stdout:2/322: write d11/d1a/d37/f4f [566033,15040] 0 2024-04-20T10:54:39.743 INFO:tasks.workunit.client.0.smithi090.stdout:4/210: dwrite d7/d9/f19 [0,4194304] 0 2024-04-20T10:54:39.743 INFO:tasks.workunit.client.0.smithi090.stdout:6/295: dwrite d1/d4/d26/d11/d35/f5f [0,4194304] 0 2024-04-20T10:54:39.743 INFO:tasks.workunit.client.0.smithi090.stdout:1/292: write d8/d1a/d1d/f24 [2699465,1767] 0 2024-04-20T10:54:39.743 INFO:tasks.workunit.client.0.smithi090.stdout:0/339: write d14/f2e [1554919,14334] 0 2024-04-20T10:54:39.743 INFO:tasks.workunit.client.0.smithi090.stdout:3/202: creat d7/d43/f45 x:0 0 0 2024-04-20T10:54:39.746 INFO:tasks.workunit.client.0.smithi090.stdout:2/323: mknod d11/d1a/d2b/c73 0 2024-04-20T10:54:39.749 INFO:tasks.workunit.client.0.smithi090.stdout:7/297: dread f8 [0,4194304] 0 2024-04-20T10:54:39.750 INFO:tasks.workunit.client.0.smithi090.stdout:4/211: symlink d7/d9/d30/l40 0 2024-04-20T10:54:39.751 INFO:tasks.workunit.client.0.smithi090.stdout:1/293: creat d8/d1a/d1d/d50/d31/d5d/f5e x:0 0 0 2024-04-20T10:54:39.753 INFO:tasks.workunit.client.0.smithi090.stdout:0/340: rename d14/d19/d2b/d3f to d14/d19/d2b/d66 0 2024-04-20T10:54:39.754 INFO:tasks.workunit.client.0.smithi090.stdout:3/203: creat d7/d11/f46 x:0 0 0 2024-04-20T10:54:39.755 INFO:tasks.workunit.client.0.smithi090.stdout:5/487: dwrite d1/da/d14/d47/d50/f51 [0,4194304] 0 2024-04-20T10:54:39.756 INFO:tasks.workunit.client.0.smithi090.stdout:4/212: mknod d7/d9/d17/c41 0 2024-04-20T10:54:39.756 INFO:tasks.workunit.client.0.smithi090.stdout:4/213: fdatasync d7/f2c 0 2024-04-20T10:54:39.756 INFO:tasks.workunit.client.0.smithi090.stdout:4/214: dread - d7/f38 zero size 2024-04-20T10:54:39.758 INFO:tasks.workunit.client.0.smithi090.stdout:1/294: link d8/d1a/d45/f4b d8/d1a/d1d/d2c/d3f/f5f 0 2024-04-20T10:54:39.759 INFO:tasks.workunit.client.0.smithi090.stdout:0/341: mknod d14/d19/d2b/d52/d55/d5b/c67 0 2024-04-20T10:54:39.760 INFO:tasks.workunit.client.0.smithi090.stdout:9/365: rename d0/d29/d36/d63/d1f/d34/d70/d56 to d0/d29/d36/d63/d1f/d79 0 2024-04-20T10:54:39.763 INFO:tasks.workunit.client.0.smithi090.stdout:3/204: mkdir d7/d15/d47 0 2024-04-20T10:54:39.766 INFO:tasks.workunit.client.0.smithi090.stdout:5/488: mknod d1/da/d14/d47/ca2 0 2024-04-20T10:54:39.766 INFO:tasks.workunit.client.0.smithi090.stdout:4/215: mkdir d7/d9/d30/d42 0 2024-04-20T10:54:39.767 INFO:tasks.workunit.client.0.smithi090.stdout:1/295: truncate d8/d1a/d1d/d2c/d3f/f41 1998053 0 2024-04-20T10:54:39.768 INFO:tasks.workunit.client.0.smithi090.stdout:7/298: dwrite d11/d13/d22/f3a [0,4194304] 0 2024-04-20T10:54:39.768 INFO:tasks.workunit.client.0.smithi090.stdout:7/299: stat d11/d13/d22/d41 0 2024-04-20T10:54:39.768 INFO:tasks.workunit.client.0.smithi090.stdout:7/300: chown d11/d13/d33 106680 1 2024-04-20T10:54:39.769 INFO:tasks.workunit.client.0.smithi090.stdout:0/342: mkdir d14/d19/d2b/d66/d68 0 2024-04-20T10:54:39.772 INFO:tasks.workunit.client.0.smithi090.stdout:8/350: rename d0/d26/f6d to d0/d3a/f6e 0 2024-04-20T10:54:39.772 INFO:tasks.workunit.client.0.smithi090.stdout:8/351: chown d0/d11/d22/f23 6468 1 2024-04-20T10:54:39.772 INFO:tasks.workunit.client.0.smithi090.stdout:5/489: creat d1/de/fa3 x:0 0 0 2024-04-20T10:54:39.773 INFO:tasks.workunit.client.0.smithi090.stdout:2/324: dwrite fa [0,4194304] 0 2024-04-20T10:54:39.774 INFO:tasks.workunit.client.0.smithi090.stdout:4/216: symlink d7/d9/d17/l43 0 2024-04-20T10:54:39.776 INFO:tasks.workunit.client.0.smithi090.stdout:1/296: link d8/d1a/d1d/c1e d8/d1a/d1d/d50/d31/d5d/c60 0 2024-04-20T10:54:39.781 INFO:tasks.workunit.client.0.smithi090.stdout:3/205: dwrite d7/f3d [0,4194304] 0 2024-04-20T10:54:39.782 INFO:tasks.workunit.client.0.smithi090.stdout:7/301: mknod d11/d1a/d3b/d58/c6a 0 2024-04-20T10:54:39.783 INFO:tasks.workunit.client.0.smithi090.stdout:0/343: creat d14/d19/d2b/d52/f69 x:0 0 0 2024-04-20T10:54:39.790 INFO:tasks.workunit.client.0.smithi090.stdout:6/296: rename d1/f6 to d1/d4/d26/d11/f63 0 2024-04-20T10:54:39.790 INFO:tasks.workunit.client.0.smithi090.stdout:8/352: link d0/d26/l42 d0/d2d/l6f 0 2024-04-20T10:54:39.791 INFO:tasks.workunit.client.0.smithi090.stdout:5/490: mkdir d1/da/d1f/da4 0 2024-04-20T10:54:39.791 INFO:tasks.workunit.client.0.smithi090.stdout:0/344: write f9 [1134182,85862] 0 2024-04-20T10:54:39.792 INFO:tasks.workunit.client.0.smithi090.stdout:0/345: chown d14/d19/d2b/d66/f4f 1 1 2024-04-20T10:54:39.795 INFO:tasks.workunit.client.0.smithi090.stdout:2/325: creat d11/d1f/d2e/f74 x:0 0 0 2024-04-20T10:54:39.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/326: readlink d11/l41 0 2024-04-20T10:54:39.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/327: truncate d11/d1f/f6c 221047 0 2024-04-20T10:54:39.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/328: truncate d11/d1a/d2b/f56 175076 0 2024-04-20T10:54:39.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/329: stat d11/d1a/d4a/d55/f6d 0 2024-04-20T10:54:39.797 INFO:tasks.workunit.client.0.smithi090.stdout:4/217: mknod d7/d9/d30/d3d/c44 0 2024-04-20T10:54:39.798 INFO:tasks.workunit.client.0.smithi090.stdout:1/297: creat d8/d1a/d1d/d50/f61 x:0 0 0 2024-04-20T10:54:39.801 INFO:tasks.workunit.client.0.smithi090.stdout:3/206: mkdir d7/d15/d2a/d30/d48 0 2024-04-20T10:54:39.802 INFO:tasks.workunit.client.0.smithi090.stdout:7/302: dwrite d11/d1a/d3f/f5f [0,4194304] 0 2024-04-20T10:54:39.802 INFO:tasks.workunit.client.0.smithi090.stdout:7/303: write d11/d13/d22/f4b [604285,63297] 0 2024-04-20T10:54:39.802 INFO:tasks.workunit.client.0.smithi090.stdout:7/304: truncate d11/d13/d22/d24/f5e 179543 0 2024-04-20T10:54:39.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/305: stat d11/d13/d22/d24/f5e 0 2024-04-20T10:54:39.803 INFO:tasks.workunit.client.0.smithi090.stdout:8/353: rename d0/d11/d14/f64 to d0/d11/d14/f70 0 2024-04-20T10:54:39.803 INFO:tasks.workunit.client.0.smithi090.stdout:4/218: dread d7/d9/d17/f37 [0,4194304] 0 2024-04-20T10:54:39.804 INFO:tasks.workunit.client.0.smithi090.stdout:5/491: dread d1/d55/f74 [0,4194304] 0 2024-04-20T10:54:39.805 INFO:tasks.workunit.client.0.smithi090.stdout:1/298: mkdir d8/d1a/d1d/d2c/d62 0 2024-04-20T10:54:39.805 INFO:tasks.workunit.client.0.smithi090.stdout:2/330: write fd [222028,60025] 0 2024-04-20T10:54:39.805 INFO:tasks.workunit.client.0.smithi090.stdout:2/331: chown d11/d1a/d30/c4c 0 1 2024-04-20T10:54:39.806 INFO:tasks.workunit.client.0.smithi090.stdout:3/207: unlink d7/df/f41 0 2024-04-20T10:54:39.807 INFO:tasks.workunit.client.0.smithi090.stdout:1/299: dread d8/d1a/d1d/d50/f23 [0,4194304] 0 2024-04-20T10:54:39.809 INFO:tasks.workunit.client.0.smithi090.stdout:7/306: mkdir d11/d13/d5b/d6b 0 2024-04-20T10:54:39.810 INFO:tasks.workunit.client.0.smithi090.stdout:7/307: fsync d11/d13/d22/d27/f50 0 2024-04-20T10:54:39.810 INFO:tasks.workunit.client.0.smithi090.stdout:6/297: dwrite d1/d4/d26/d11/d35/f5f [0,4194304] 0 2024-04-20T10:54:39.811 INFO:tasks.workunit.client.0.smithi090.stdout:8/354: link d0/d11/d22/d53/l6a d0/d2d/d44/l71 0 2024-04-20T10:54:39.812 INFO:tasks.workunit.client.0.smithi090.stdout:5/492: creat d1/de/d96/fa5 x:0 0 0 2024-04-20T10:54:39.814 INFO:tasks.workunit.client.0.smithi090.stdout:3/208: link d7/f40 d7/d15/d2a/f49 0 2024-04-20T10:54:39.816 INFO:tasks.workunit.client.0.smithi090.stdout:1/300: creat d8/d1a/d4d/f63 x:0 0 0 2024-04-20T10:54:39.816 INFO:tasks.workunit.client.0.smithi090.stdout:1/301: chown d8/cf 9782 1 2024-04-20T10:54:39.818 INFO:tasks.workunit.client.0.smithi090.stdout:6/298: mknod d1/d19/d36/c64 0 2024-04-20T10:54:39.819 INFO:tasks.workunit.client.0.smithi090.stdout:0/346: dwrite d14/f5f [0,4194304] 0 2024-04-20T10:54:39.819 INFO:tasks.workunit.client.0.smithi090.stdout:4/219: read d7/d9/f20 [3112105,87463] 0 2024-04-20T10:54:39.820 INFO:tasks.workunit.client.0.smithi090.stdout:3/209: mkdir d7/d43/d4a 0 2024-04-20T10:54:39.821 INFO:tasks.workunit.client.0.smithi090.stdout:4/220: dread d7/f26 [0,4194304] 0 2024-04-20T10:54:39.821 INFO:tasks.workunit.client.0.smithi090.stdout:4/221: truncate d7/d9/d17/f27 316192 0 2024-04-20T10:54:39.822 INFO:tasks.workunit.client.0.smithi090.stdout:1/302: unlink d8/d1a/d1d/d2c/f42 0 2024-04-20T10:54:39.829 INFO:tasks.workunit.client.0.smithi090.stdout:0/347: dread d14/d19/d31/d34/d3b/f59 [0,4194304] 0 2024-04-20T10:54:39.830 INFO:tasks.workunit.client.0.smithi090.stdout:0/348: fsync fd 0 2024-04-20T10:54:39.830 INFO:tasks.workunit.client.0.smithi090.stdout:0/349: readlink d14/d39/l4d 0 2024-04-20T10:54:39.831 INFO:tasks.workunit.client.0.smithi090.stdout:3/210: getdents d7/d35 0 2024-04-20T10:54:39.833 INFO:tasks.workunit.client.0.smithi090.stdout:6/299: dread d1/d19/d36/d28/f2a [0,4194304] 0 2024-04-20T10:54:39.834 INFO:tasks.workunit.client.0.smithi090.stdout:0/350: rename d14/c23 to d14/d19/d2b/d66/c6a 0 2024-04-20T10:54:39.835 INFO:tasks.workunit.client.0.smithi090.stdout:7/308: dwrite d11/d13/d23/f2b [0,4194304] 0 2024-04-20T10:54:39.835 INFO:tasks.workunit.client.0.smithi090.stdout:7/309: chown d11/d1a/d3f/f5f 0 1 2024-04-20T10:54:39.835 INFO:tasks.workunit.client.0.smithi090.stdout:7/310: chown d11/d1a/f46 1 1 2024-04-20T10:54:39.835 INFO:tasks.workunit.client.0.smithi090.stdout:7/311: fdatasync f9 0 2024-04-20T10:54:39.836 INFO:tasks.workunit.client.0.smithi090.stdout:3/211: creat d7/d35/f4b x:0 0 0 2024-04-20T10:54:39.838 INFO:tasks.workunit.client.0.smithi090.stdout:8/355: dread d0/f28 [0,4194304] 0 2024-04-20T10:54:39.839 INFO:tasks.workunit.client.0.smithi090.stdout:1/303: dread d8/d1a/f3b [0,4194304] 0 2024-04-20T10:54:39.846 INFO:tasks.workunit.client.0.smithi090.stdout:4/222: dwrite d7/d9/f19 [0,4194304] 0 2024-04-20T10:54:39.847 INFO:tasks.workunit.client.0.smithi090.stdout:7/312: mkdir d11/d13/d23/d6c 0 2024-04-20T10:54:39.848 INFO:tasks.workunit.client.0.smithi090.stdout:0/351: read ff [718251,60199] 0 2024-04-20T10:54:39.850 INFO:tasks.workunit.client.0.smithi090.stdout:2/332: dwrite d11/d1a/d30/f42 [0,4194304] 0 2024-04-20T10:54:39.851 INFO:tasks.workunit.client.0.smithi090.stdout:5/493: dwrite d1/da/d16/f32 [0,4194304] 0 2024-04-20T10:54:39.851 INFO:tasks.workunit.client.0.smithi090.stdout:4/223: creat d7/d9/d30/f45 x:0 0 0 2024-04-20T10:54:39.851 INFO:tasks.workunit.client.0.smithi090.stdout:4/224: chown d7/d9/d17/c32 1963 1 2024-04-20T10:54:39.852 INFO:tasks.workunit.client.0.smithi090.stdout:7/313: stat d11/d13/d22/d27/c4f 0 2024-04-20T10:54:39.854 INFO:tasks.workunit.client.0.smithi090.stdout:7/314: dread f10 [0,4194304] 0 2024-04-20T10:54:39.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/352: unlink d14/d19/d2b/d66/d40/c58 0 2024-04-20T10:54:39.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/353: stat fa 0 2024-04-20T10:54:39.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/354: readlink d14/d19/d2b/l4e 0 2024-04-20T10:54:39.856 INFO:tasks.workunit.client.0.smithi090.stdout:2/333: read d11/d1a/f58 [763802,61448] 0 2024-04-20T10:54:39.857 INFO:tasks.workunit.client.0.smithi090.stdout:4/225: symlink d7/d9/d30/d3d/l46 0 2024-04-20T10:54:39.858 INFO:tasks.workunit.client.0.smithi090.stdout:0/355: getdents d14/d19/d2b/d66/d43 0 2024-04-20T10:54:39.866 INFO:tasks.workunit.client.0.smithi090.stdout:7/315: write d11/d13/d23/f2b [3442312,38444] 0 2024-04-20T10:54:39.867 INFO:tasks.workunit.client.0.smithi090.stdout:4/226: mkdir d7/d9/d47 0 2024-04-20T10:54:39.867 INFO:tasks.workunit.client.0.smithi090.stdout:4/227: write d7/f38 [83751,101259] 0 2024-04-20T10:54:39.868 INFO:tasks.workunit.client.0.smithi090.stdout:4/228: truncate d7/d9/f36 4965852 0 2024-04-20T10:54:39.868 INFO:tasks.workunit.client.0.smithi090.stdout:4/229: write d7/d9/d30/f34 [627455,62449] 0 2024-04-20T10:54:39.868 INFO:tasks.workunit.client.0.smithi090.stdout:4/230: dread - d7/d9/d17/f3f zero size 2024-04-20T10:54:39.868 INFO:tasks.workunit.client.0.smithi090.stdout:7/316: mknod d11/d13/d33/c6d 0 2024-04-20T10:54:39.872 INFO:tasks.workunit.client.0.smithi090.stdout:0/356: dread d14/f22 [0,4194304] 0 2024-04-20T10:54:39.872 INFO:tasks.workunit.client.0.smithi090.stdout:3/212: dwrite d7/d15/f23 [0,4194304] 0 2024-04-20T10:54:39.873 INFO:tasks.workunit.client.0.smithi090.stdout:8/356: dwrite d0/d11/d14/f6c [0,4194304] 0 2024-04-20T10:54:39.873 INFO:tasks.workunit.client.0.smithi090.stdout:1/304: dwrite d8/d1a/f39 [0,4194304] 0 2024-04-20T10:54:39.873 INFO:tasks.workunit.client.0.smithi090.stdout:1/305: write d8/d1a/d4d/f63 [772820,52331] 0 2024-04-20T10:54:39.874 INFO:tasks.workunit.client.0.smithi090.stdout:4/231: creat d7/d9/d17/f48 x:0 0 0 2024-04-20T10:54:39.874 INFO:tasks.workunit.client.0.smithi090.stdout:5/494: dwrite d1/d2a/f5e [0,4194304] 0 2024-04-20T10:54:39.875 INFO:tasks.workunit.client.0.smithi090.stdout:0/357: symlink d14/d19/d2b/d52/d55/d5b/l6b 0 2024-04-20T10:54:39.879 INFO:tasks.workunit.client.0.smithi090.stdout:4/232: creat d7/d9/d17/f49 x:0 0 0 2024-04-20T10:54:39.879 INFO:tasks.workunit.client.0.smithi090.stdout:4/233: write d7/f12 [1308388,94219] 0 2024-04-20T10:54:39.880 INFO:tasks.workunit.client.0.smithi090.stdout:5/495: mknod d1/d2a/ca6 0 2024-04-20T10:54:39.884 INFO:tasks.workunit.client.0.smithi090.stdout:3/213: write d7/d15/f23 [2683049,119292] 0 2024-04-20T10:54:39.884 INFO:tasks.workunit.client.0.smithi090.stdout:4/234: creat d7/d9/f4a x:0 0 0 2024-04-20T10:54:39.884 INFO:tasks.workunit.client.0.smithi090.stdout:7/317: read d11/d13/d23/f38 [2600991,74661] 0 2024-04-20T10:54:39.884 INFO:tasks.workunit.client.0.smithi090.stdout:7/318: fdatasync d11/d13/d23/f2b 0 2024-04-20T10:54:39.885 INFO:tasks.workunit.client.0.smithi090.stdout:5/496: creat d1/d55/fa7 x:0 0 0 2024-04-20T10:54:39.890 INFO:tasks.workunit.client.0.smithi090.stdout:3/214: unlink d7/d26/f28 0 2024-04-20T10:54:39.891 INFO:tasks.workunit.client.0.smithi090.stdout:4/235: stat d7/fb 0 2024-04-20T10:54:39.891 INFO:tasks.workunit.client.0.smithi090.stdout:4/236: truncate d7/d9/d30/f45 878571 0 2024-04-20T10:54:39.891 INFO:tasks.workunit.client.0.smithi090.stdout:7/319: mknod d11/d13/d5b/c6e 0 2024-04-20T10:54:39.891 INFO:tasks.workunit.client.0.smithi090.stdout:5/497: unlink d1/da/d14/c18 0 2024-04-20T10:54:39.891 INFO:tasks.workunit.client.0.smithi090.stdout:5/498: write d1/f58 [306347,28692] 0 2024-04-20T10:54:39.891 INFO:tasks.workunit.client.0.smithi090.stdout:3/215: creat d7/d15/d2a/d30/f4c x:0 0 0 2024-04-20T10:54:39.893 INFO:tasks.workunit.client.0.smithi090.stdout:0/358: dwrite d14/d19/d2b/f51 [0,4194304] 0 2024-04-20T10:54:39.893 INFO:tasks.workunit.client.0.smithi090.stdout:4/237: rename d7/l8 to d7/d9/d17/l4b 0 2024-04-20T10:54:39.895 INFO:tasks.workunit.client.0.smithi090.stdout:7/320: truncate d11/d13/d23/f38 1134330 0 2024-04-20T10:54:39.895 INFO:tasks.workunit.client.0.smithi090.stdout:7/321: readlink d11/d1a/d3b/d58/l59 0 2024-04-20T10:54:39.895 INFO:tasks.workunit.client.0.smithi090.stdout:7/322: truncate d11/d13/d22/d24/f69 879857 0 2024-04-20T10:54:39.895 INFO:tasks.workunit.client.0.smithi090.stdout:1/306: dwrite d8/f46 [0,4194304] 0 2024-04-20T10:54:39.895 INFO:tasks.workunit.client.0.smithi090.stdout:4/238: dread d7/d9/fa [0,4194304] 0 2024-04-20T10:54:39.897 INFO:tasks.workunit.client.0.smithi090.stdout:5/499: unlink d1/d2f/f56 0 2024-04-20T10:54:39.897 INFO:tasks.workunit.client.0.smithi090.stdout:5/500: chown d1/da/d16/f86 267820 1 2024-04-20T10:54:39.897 INFO:tasks.workunit.client.0.smithi090.stdout:5/501: write d1/de/d96/fa5 [267288,96842] 0 2024-04-20T10:54:39.898 INFO:tasks.workunit.client.0.smithi090.stdout:3/216: write d7/d11/f3f [7079947,50012] 0 2024-04-20T10:54:39.899 INFO:tasks.workunit.client.0.smithi090.stdout:0/359: mknod d14/d19/d2b/c6c 0 2024-04-20T10:54:39.899 INFO:tasks.workunit.client.0.smithi090.stdout:0/360: chown d14/d19/d2b/l4e 542 1 2024-04-20T10:54:39.901 INFO:tasks.workunit.client.0.smithi090.stdout:7/323: rename f10 to d11/d1a/d3f/f6f 0 2024-04-20T10:54:39.901 INFO:tasks.workunit.client.0.smithi090.stdout:7/324: fdatasync d11/d13/d22/f34 0 2024-04-20T10:54:39.902 INFO:tasks.workunit.client.0.smithi090.stdout:7/325: dread d11/d13/d23/f45 [0,4194304] 0 2024-04-20T10:54:39.902 INFO:tasks.workunit.client.0.smithi090.stdout:7/326: stat d11/d13/d22/l4e 0 2024-04-20T10:54:39.903 INFO:tasks.workunit.client.0.smithi090.stdout:1/307: creat d8/d1a/d1d/d2c/f64 x:0 0 0 2024-04-20T10:54:39.903 INFO:tasks.workunit.client.0.smithi090.stdout:1/308: chown d8/d1a/d1d/d2c/d4a/d5a 12151549 1 2024-04-20T10:54:39.903 INFO:tasks.workunit.client.0.smithi090.stdout:5/502: rmdir d1/d2f/d85 39 2024-04-20T10:54:39.906 INFO:tasks.workunit.client.0.smithi090.stdout:3/217: creat d7/df/f4d x:0 0 0 2024-04-20T10:54:39.906 INFO:tasks.workunit.client.0.smithi090.stdout:3/218: fdatasync d7/f19 0 2024-04-20T10:54:39.906 INFO:tasks.workunit.client.0.smithi090.stdout:3/219: chown d7/d15/d2a/f49 0 1 2024-04-20T10:54:39.906 INFO:tasks.workunit.client.0.smithi090.stdout:3/220: chown d7/d15/d2a/f49 16238 1 2024-04-20T10:54:39.906 INFO:tasks.workunit.client.0.smithi090.stdout:3/221: write d7/d11/f32 [1196796,8292] 0 2024-04-20T10:54:39.907 INFO:tasks.workunit.client.0.smithi090.stdout:0/361: mkdir d14/d19/d2b/d66/d43/d6d 0 2024-04-20T10:54:39.912 INFO:tasks.workunit.client.0.smithi090.stdout:1/309: creat d8/d1a/d1d/d2c/d4a/f65 x:0 0 0 2024-04-20T10:54:39.912 INFO:tasks.workunit.client.0.smithi090.stdout:1/310: fdatasync d8/d1a/d45/f4b 0 2024-04-20T10:54:39.912 INFO:tasks.workunit.client.0.smithi090.stdout:1/311: dread - d8/d1a/d1d/d2c/d3f/f53 zero size 2024-04-20T10:54:39.913 INFO:tasks.workunit.client.0.smithi090.stdout:5/503: mknod d1/d2f/d3d/ca8 0 2024-04-20T10:54:39.913 INFO:tasks.workunit.client.0.smithi090.stdout:5/504: fdatasync d1/de/d75/f95 0 2024-04-20T10:54:39.915 INFO:tasks.workunit.client.0.smithi090.stdout:3/222: write d7/fc [2548149,116991] 0 2024-04-20T10:54:39.915 INFO:tasks.workunit.client.0.smithi090.stdout:1/312: mknod d8/d1a/c66 0 2024-04-20T10:54:39.918 INFO:tasks.workunit.client.0.smithi090.stdout:7/327: dwrite d11/d1a/d3f/f6f [0,4194304] 0 2024-04-20T10:54:39.920 INFO:tasks.workunit.client.0.smithi090.stdout:3/223: mknod d7/df/c4e 0 2024-04-20T10:54:39.921 INFO:tasks.workunit.client.0.smithi090.stdout:1/313: rename d8/d1a/d1d/d50 to d8/d1a/d1d/d67 0 2024-04-20T10:54:39.921 INFO:tasks.workunit.client.0.smithi090.stdout:1/314: readlink d8/d1a/d1d/d67/l20 0 2024-04-20T10:54:39.933 INFO:tasks.workunit.client.0.smithi090.stdout:4/239: dwrite d7/d9/f39 [0,4194304] 0 2024-04-20T10:54:39.934 INFO:tasks.workunit.client.0.smithi090.stdout:1/315: link d8/c5b d8/d1a/d4d/c68 0 2024-04-20T10:54:39.940 INFO:tasks.workunit.client.0.smithi090.stdout:4/240: symlink d7/l4c 0 2024-04-20T10:54:39.940 INFO:tasks.workunit.client.0.smithi090.stdout:4/241: readlink d7/d9/d30/d3d/l46 0 2024-04-20T10:54:39.942 INFO:tasks.workunit.client.0.smithi090.stdout:4/242: mknod d7/d9/d47/c4d 0 2024-04-20T10:54:39.944 INFO:tasks.workunit.client.0.smithi090.stdout:3/224: dwrite d7/d11/f3f [4194304,4194304] 0 2024-04-20T10:54:39.945 INFO:tasks.workunit.client.0.smithi090.stdout:7/328: dwrite d11/d1a/d3f/f66 [0,4194304] 0 2024-04-20T10:54:39.945 INFO:tasks.workunit.client.0.smithi090.stdout:7/329: getdents d11/d13/d5b/d6b 0 2024-04-20T10:54:39.945 INFO:tasks.workunit.client.0.smithi090.stdout:7/330: fsync d11/d13/d23/f26 0 2024-04-20T10:54:39.945 INFO:tasks.workunit.client.0.smithi090.stdout:7/331: fsync d11/d13/d33/f54 0 2024-04-20T10:54:39.953 INFO:tasks.workunit.client.0.smithi090.stdout:1/316: dwrite d8/f1f [0,4194304] 0 2024-04-20T10:54:39.958 INFO:tasks.workunit.client.0.smithi090.stdout:4/243: dwrite d7/d9/d17/f48 [0,4194304] 0 2024-04-20T10:54:39.961 INFO:tasks.workunit.client.0.smithi090.stdout:3/225: creat d7/d15/d2a/d30/d48/f4f x:0 0 0 2024-04-20T10:54:39.964 INFO:tasks.workunit.client.0.smithi090.stdout:7/332: link d11/d1a/d3b/l3d d11/d1a/l70 0 2024-04-20T10:54:39.964 INFO:tasks.workunit.client.0.smithi090.stdout:7/333: truncate d11/d13/f1d 5007122 0 2024-04-20T10:54:39.967 INFO:tasks.workunit.client.0.smithi090.stdout:3/226: unlink d7/d15/d2a/l31 0 2024-04-20T10:54:39.977 INFO:tasks.workunit.client.0.smithi090.stdout:1/317: dwrite d8/fe [0,4194304] 0 2024-04-20T10:54:39.977 INFO:tasks.workunit.client.0.smithi090.stdout:1/318: write d8/f2d [2761062,118819] 0 2024-04-20T10:54:39.977 INFO:tasks.workunit.client.0.smithi090.stdout:1/319: fdatasync d8/d1a/d45/f4b 0 2024-04-20T10:54:39.977 INFO:tasks.workunit.client.0.smithi090.stdout:1/320: dread - d8/d1a/d1d/f27 zero size 2024-04-20T10:54:39.978 INFO:tasks.workunit.client.0.smithi090.stdout:7/334: stat d11/d13/l17 0 2024-04-20T10:54:39.983 INFO:tasks.workunit.client.0.smithi090.stdout:4/244: dwrite d7/d9/d17/f3f [0,4194304] 0 2024-04-20T10:54:39.984 INFO:tasks.workunit.client.0.smithi090.stdout:3/227: dwrite d7/d11/f3f [0,4194304] 0 2024-04-20T10:54:39.989 INFO:tasks.workunit.client.0.smithi090.stdout:1/321: read d8/f12 [1016034,75997] 0 2024-04-20T10:54:39.994 INFO:tasks.workunit.client.0.smithi090.stdout:7/335: dwrite d11/d13/d22/d27/f50 [0,4194304] 0 2024-04-20T10:54:39.994 INFO:tasks.workunit.client.0.smithi090.stdout:7/336: chown d11/d13/d22/d24/l28 0 1 2024-04-20T10:54:39.995 INFO:tasks.workunit.client.0.smithi090.stdout:3/228: truncate d7/df/f27 3179245 0 2024-04-20T10:54:39.995 INFO:tasks.workunit.client.0.smithi090.stdout:3/229: chown d7/d15/f25 0 1 2024-04-20T10:54:39.995 INFO:tasks.workunit.client.0.smithi090.stdout:3/230: truncate d7/df/f4d 643600 0 2024-04-20T10:54:40.001 INFO:tasks.workunit.client.0.smithi090.stdout:1/322: dread d8/f2d [0,4194304] 0 2024-04-20T10:54:40.001 INFO:tasks.workunit.client.0.smithi090.stdout:1/323: truncate f5 1277490 0 2024-04-20T10:54:40.001 INFO:tasks.workunit.client.0.smithi090.stdout:1/324: write d8/d1a/d1d/d2c/f64 [841080,59472] 0 2024-04-20T10:54:40.007 INFO:tasks.workunit.client.0.smithi090.stdout:7/337: creat d11/d13/d33/d44/f71 x:0 0 0 2024-04-20T10:54:40.008 INFO:tasks.workunit.client.0.smithi090.stdout:1/325: creat d8/d1a/d1d/d2c/d4a/d5a/f69 x:0 0 0 2024-04-20T10:54:40.008 INFO:tasks.workunit.client.0.smithi090.stdout:4/245: dwrite d7/d9/fa [0,4194304] 0 2024-04-20T10:54:40.009 INFO:tasks.workunit.client.0.smithi090.stdout:7/338: mkdir d11/d13/d23/d6c/d72 0 2024-04-20T10:54:40.010 INFO:tasks.workunit.client.0.smithi090.stdout:1/326: unlink d8/d1a/d1d/d2c/d3f/f41 0 2024-04-20T10:54:40.012 INFO:tasks.workunit.client.0.smithi090.stdout:3/231: dwrite d7/d15/f23 [0,4194304] 0 2024-04-20T10:54:40.013 INFO:tasks.workunit.client.0.smithi090.stdout:7/339: creat d11/d13/d5b/f73 x:0 0 0 2024-04-20T10:54:40.014 INFO:tasks.workunit.client.0.smithi090.stdout:3/232: unlink d7/d11/l29 0 2024-04-20T10:54:40.016 INFO:tasks.workunit.client.0.smithi090.stdout:7/340: link d11/d13/d22/d24/f5e d11/d13/d33/f74 0 2024-04-20T10:54:40.016 INFO:tasks.workunit.client.0.smithi090.stdout:4/246: write d7/d9/f19 [2747159,63217] 0 2024-04-20T10:54:40.016 INFO:tasks.workunit.client.0.smithi090.stdout:7/341: read - d11/d1a/d2f/f3e zero size 2024-04-20T10:54:40.017 INFO:tasks.workunit.client.0.smithi090.stdout:5/505: write d1/da/f1e [969998,42719] 0 2024-04-20T10:54:40.018 INFO:tasks.workunit.client.0.smithi090.stdout:3/233: link d7/df/f13 d7/df/d2c/f50 0 2024-04-20T10:54:40.019 INFO:tasks.workunit.client.0.smithi090.stdout:4/247: mknod d7/d9/d30/c4e 0 2024-04-20T10:54:40.024 INFO:tasks.workunit.client.0.smithi090.stdout:5/506: dread d1/d2f/d3d/d40/d4a/f4f [0,4194304] 0 2024-04-20T10:54:40.024 INFO:tasks.workunit.client.0.smithi090.stdout:3/234: mknod d7/d15/d47/c51 0 2024-04-20T10:54:40.025 INFO:tasks.workunit.client.0.smithi090.stdout:5/507: link d1/de/d96/fa5 d1/d2f/d3d/d40/d4a/fa9 0 2024-04-20T10:54:40.026 INFO:tasks.workunit.client.0.smithi090.stdout:3/235: rmdir d7/d15 39 2024-04-20T10:54:40.033 INFO:tasks.workunit.client.0.smithi090.stdout:3/236: write d7/d15/f23 [835841,69531] 0 2024-04-20T10:54:40.034 INFO:tasks.workunit.client.0.smithi090.stdout:5/508: mknod d1/d41/d98/caa 0 2024-04-20T10:54:40.035 INFO:tasks.workunit.client.0.smithi090.stdout:5/509: truncate d1/f58 474814 0 2024-04-20T10:54:40.039 INFO:tasks.workunit.client.0.smithi090.stdout:7/342: dwrite f8 [0,4194304] 0 2024-04-20T10:54:40.040 INFO:tasks.workunit.client.0.smithi090.stdout:4/248: dwrite d7/f12 [0,4194304] 0 2024-04-20T10:54:40.040 INFO:tasks.workunit.client.0.smithi090.stdout:4/249: write d7/f38 [132231,3054] 0 2024-04-20T10:54:40.042 INFO:tasks.workunit.client.0.smithi090.stdout:5/510: mknod d1/de/d96/cab 0 2024-04-20T10:54:40.044 INFO:tasks.workunit.client.0.smithi090.stdout:4/250: mknod d7/d9/d17/c4f 0 2024-04-20T10:54:40.045 INFO:tasks.workunit.client.0.smithi090.stdout:4/251: mknod d7/d9/d30/d3d/c50 0 2024-04-20T10:54:40.046 INFO:tasks.workunit.client.0.smithi090.stdout:3/237: truncate d7/fa 1321721 0 2024-04-20T10:54:40.057 INFO:tasks.workunit.client.0.smithi090.stdout:3/238: dread d7/fa [0,4194304] 0 2024-04-20T10:54:40.058 INFO:tasks.workunit.client.0.smithi090.stdout:3/239: stat d7/d15/d47/c51 0 2024-04-20T10:54:40.059 INFO:tasks.workunit.client.0.smithi090.stdout:3/240: dread d7/df/f13 [0,4194304] 0 2024-04-20T10:54:40.059 INFO:tasks.workunit.client.0.smithi090.stdout:3/241: truncate d7/df/f4d 890471 0 2024-04-20T10:54:40.059 INFO:tasks.workunit.client.0.smithi090.stdout:3/242: write d7/d15/d2a/d30/f4c [622015,129552] 0 2024-04-20T10:54:40.059 INFO:tasks.workunit.client.0.smithi090.stdout:3/243: stat d7/df/l14 0 2024-04-20T10:54:40.066 INFO:tasks.workunit.client.0.smithi090.stdout:7/343: dwrite d11/d13/d22/f3a [0,4194304] 0 2024-04-20T10:54:40.066 INFO:tasks.workunit.client.0.smithi090.stdout:7/344: chown d11/d13/d23/f2b 1328 1 2024-04-20T10:54:40.066 INFO:tasks.workunit.client.0.smithi090.stdout:7/345: chown d11/d1a/d2f/l57 285654 1 2024-04-20T10:54:40.066 INFO:tasks.workunit.client.0.smithi090.stdout:4/252: dwrite d7/d9/f35 [0,4194304] 0 2024-04-20T10:54:40.067 INFO:tasks.workunit.client.0.smithi090.stdout:7/346: read d11/d13/d22/d24/f5e [79717,96538] 0 2024-04-20T10:54:40.067 INFO:tasks.workunit.client.0.smithi090.stdout:3/244: dread d7/f37 [0,4194304] 0 2024-04-20T10:54:40.067 INFO:tasks.workunit.client.0.smithi090.stdout:3/245: write d7/d15/f25 [6055,31401] 0 2024-04-20T10:54:40.067 INFO:tasks.workunit.client.0.smithi090.stdout:5/511: symlink d1/d2f/d3d/d40/d6c/lac 0 2024-04-20T10:54:40.068 INFO:tasks.workunit.client.0.smithi090.stdout:7/347: symlink d11/d1a/d3b/l75 0 2024-04-20T10:54:40.069 INFO:tasks.workunit.client.0.smithi090.stdout:3/246: creat d7/d11/f52 x:0 0 0 2024-04-20T10:54:40.076 INFO:tasks.workunit.client.0.smithi090.stdout:3/247: dread d7/d11/f1c [0,4194304] 0 2024-04-20T10:54:40.077 INFO:tasks.workunit.client.0.smithi090.stdout:5/512: mkdir d1/da/d1f/dad 0 2024-04-20T10:54:40.079 INFO:tasks.workunit.client.0.smithi090.stdout:3/248: link d7/df/c4e d7/c53 0 2024-04-20T10:54:40.079 INFO:tasks.workunit.client.0.smithi090.stdout:3/249: chown d7/l9 1087612 1 2024-04-20T10:54:40.080 INFO:tasks.workunit.client.0.smithi090.stdout:7/348: write d11/d13/d22/d24/f2e [817513,15438] 0 2024-04-20T10:54:40.081 INFO:tasks.workunit.client.0.smithi090.stdout:5/513: creat d1/de/fae x:0 0 0 2024-04-20T10:54:40.081 INFO:tasks.workunit.client.0.smithi090.stdout:5/514: write d1/da/d14/d47/d39/f6f [82939,44584] 0 2024-04-20T10:54:40.082 INFO:tasks.workunit.client.0.smithi090.stdout:3/250: rmdir d7/d26 39 2024-04-20T10:54:40.082 INFO:tasks.workunit.client.0.smithi090.stdout:3/251: fdatasync d7/d15/d2a/f49 0 2024-04-20T10:54:40.082 INFO:tasks.workunit.client.0.smithi090.stdout:3/252: fsync d7/f37 0 2024-04-20T10:54:40.084 INFO:tasks.workunit.client.0.smithi090.stdout:1/327: dwrite d8/d1a/d1d/d2c/f64 [0,4194304] 0 2024-04-20T10:54:40.086 INFO:tasks.workunit.client.0.smithi090.stdout:3/253: creat d7/d43/d4a/f54 x:0 0 0 2024-04-20T10:54:40.089 INFO:tasks.workunit.client.0.smithi090.stdout:1/328: write d8/d1a/d1d/d2c/d3f/f5f [419171,88256] 0 2024-04-20T10:54:40.089 INFO:tasks.workunit.client.0.smithi090.stdout:1/329: fsync d8/d1a/d1d/d67/f61 0 2024-04-20T10:54:40.089 INFO:tasks.workunit.client.0.smithi090.stdout:3/254: mknod d7/d15/d2a/d30/d48/c55 0 2024-04-20T10:54:40.091 INFO:tasks.workunit.client.0.smithi090.stdout:3/255: fsync d7/d15/f23 0 2024-04-20T10:54:40.093 INFO:tasks.workunit.client.0.smithi090.stdout:1/330: link d8/d1a/d1d/d2c/d4a/f65 d8/f6a 0 2024-04-20T10:54:40.093 INFO:tasks.workunit.client.0.smithi090.stdout:1/331: chown d8/d1a/d4d/f63 33593251 1 2024-04-20T10:54:40.096 INFO:tasks.workunit.client.0.smithi090.stdout:3/256: rename d7/d43/d4a to d7/d15/d47/d56 0 2024-04-20T10:54:40.097 INFO:tasks.workunit.client.0.smithi090.stdout:1/332: unlink d8/d1a/d1d/d2c/l49 0 2024-04-20T10:54:40.105 INFO:tasks.workunit.client.0.smithi090.stdout:5/515: dwrite d1/da/d1f/f25 [0,4194304] 0 2024-04-20T10:54:40.105 INFO:tasks.workunit.client.0.smithi090.stdout:1/333: fdatasync d8/d1a/d1d/d2c/d3f/f5f 0 2024-04-20T10:54:40.106 INFO:tasks.workunit.client.0.smithi090.stdout:4/253: dwrite d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:40.106 INFO:tasks.workunit.client.0.smithi090.stdout:1/334: chown d8/d1a/d1d/d67/d31/d5d 2465832 1 2024-04-20T10:54:40.106 INFO:tasks.workunit.client.0.smithi090.stdout:4/254: getdents d7/d9/d30/d42 0 2024-04-20T10:54:40.106 INFO:tasks.workunit.client.0.smithi090.stdout:1/335: write d8/d1a/d1d/d67/f61 [1032930,45336] 0 2024-04-20T10:54:40.106 INFO:tasks.workunit.client.0.smithi090.stdout:1/336: chown d8/d1a/d1d/d2c/d4a/c56 0 1 2024-04-20T10:54:40.106 INFO:tasks.workunit.client.0.smithi090.stdout:1/337: write d8/d1a/d1d/d2c/d3f/f5f [910876,106270] 0 2024-04-20T10:54:40.107 INFO:tasks.workunit.client.0.smithi090.stdout:3/257: symlink d7/d15/d2a/d30/d48/l57 0 2024-04-20T10:54:40.107 INFO:tasks.workunit.client.0.smithi090.stdout:3/258: truncate d7/f19 5071914 0 2024-04-20T10:54:40.108 INFO:tasks.workunit.client.0.smithi090.stdout:3/259: write d7/d11/f33 [425858,96737] 0 2024-04-20T10:54:40.110 INFO:tasks.workunit.client.0.smithi090.stdout:1/338: dread d8/d1a/d1d/d67/d31/f52 [0,4194304] 0 2024-04-20T10:54:40.111 INFO:tasks.workunit.client.0.smithi090.stdout:1/339: chown d8/f44 69 1 2024-04-20T10:54:40.134 INFO:tasks.workunit.client.0.smithi090.stdout:7/349: dwrite d11/d13/d23/f2b [0,4194304] 0 2024-04-20T10:54:40.135 INFO:tasks.workunit.client.0.smithi090.stdout:7/350: write d11/d1a/d2f/f3e [898553,106903] 0 2024-04-20T10:54:40.135 INFO:tasks.workunit.client.0.smithi090.stdout:3/260: creat d7/d15/d2a/f58 x:0 0 0 2024-04-20T10:54:40.137 INFO:tasks.workunit.client.0.smithi090.stdout:7/351: rename d11/d13/f1d to d11/d1a/f76 0 2024-04-20T10:54:40.138 INFO:tasks.workunit.client.0.smithi090.stdout:5/516: dwrite d1/d2f/d3d/f5b [0,4194304] 0 2024-04-20T10:54:40.138 INFO:tasks.workunit.client.0.smithi090.stdout:3/261: creat d7/d43/f59 x:0 0 0 2024-04-20T10:54:40.139 INFO:tasks.workunit.client.0.smithi090.stdout:1/340: dwrite d8/f2d [0,4194304] 0 2024-04-20T10:54:40.140 INFO:tasks.workunit.client.0.smithi090.stdout:4/255: read d7/d9/d17/f37 [1228451,53720] 0 2024-04-20T10:54:40.140 INFO:tasks.workunit.client.0.smithi090.stdout:7/352: rename d11/d13/d22/d41 to d11/d1a/d3b/d77 0 2024-04-20T10:54:40.141 INFO:tasks.workunit.client.0.smithi090.stdout:5/517: mkdir d1/d41/d98/daf 0 2024-04-20T10:54:40.143 INFO:tasks.workunit.client.0.smithi090.stdout:3/262: unlink d7/df/c10 0 2024-04-20T10:54:40.144 INFO:tasks.workunit.client.0.smithi090.stdout:1/341: read d8/d1a/f3b [4171961,56186] 0 2024-04-20T10:54:40.151 INFO:tasks.workunit.client.0.smithi090.stdout:4/256: mknod d7/d9/d47/c51 0 2024-04-20T10:54:40.152 INFO:tasks.workunit.client.0.smithi090.stdout:7/353: rmdir d11/d13/d33/d44 39 2024-04-20T10:54:40.152 INFO:tasks.workunit.client.0.smithi090.stdout:7/354: write d11/d13/d23/f62 [130862,105283] 0 2024-04-20T10:54:40.152 INFO:tasks.workunit.client.0.smithi090.stdout:5/518: symlink d1/da/lb0 0 2024-04-20T10:54:40.153 INFO:tasks.workunit.client.0.smithi090.stdout:1/342: mknod d8/d1a/d1d/d2c/d4a/d5a/c6b 0 2024-04-20T10:54:40.153 INFO:tasks.workunit.client.0.smithi090.stdout:1/343: truncate d8/d1a/d4d/f63 1243616 0 2024-04-20T10:54:40.153 INFO:tasks.workunit.client.0.smithi090.stdout:4/257: rmdir d7/d9/d47 39 2024-04-20T10:54:40.154 INFO:tasks.workunit.client.0.smithi090.stdout:5/519: mknod d1/d2f/cb1 0 2024-04-20T10:54:40.154 INFO:tasks.workunit.client.0.smithi090.stdout:4/258: getdents d7/d9/d30/d3d 0 2024-04-20T10:54:40.155 INFO:tasks.workunit.client.0.smithi090.stdout:5/520: rename d1/da/d14/d47/f8f to d1/d2f/d3d/fb2 0 2024-04-20T10:54:40.155 INFO:tasks.workunit.client.0.smithi090.stdout:5/521: chown d1/d2f/d3d/fb2 588619 1 2024-04-20T10:54:40.157 INFO:tasks.workunit.client.0.smithi090.stdout:5/522: write d1/f23 [4306568,52412] 0 2024-04-20T10:54:40.157 INFO:tasks.workunit.client.0.smithi090.stdout:5/523: dread - d1/d2a/f9c zero size 2024-04-20T10:54:40.158 INFO:tasks.workunit.client.0.smithi090.stdout:4/259: creat d7/f52 x:0 0 0 2024-04-20T10:54:40.159 INFO:tasks.workunit.client.0.smithi090.stdout:3/263: dwrite d7/d15/d2a/f58 [0,4194304] 0 2024-04-20T10:54:40.159 INFO:tasks.workunit.client.0.smithi090.stdout:5/524: mknod d1/d2f/d3d/d40/d4a/cb3 0 2024-04-20T10:54:40.159 INFO:tasks.workunit.client.0.smithi090.stdout:5/525: readlink d1/d2f/l42 0 2024-04-20T10:54:40.160 INFO:tasks.workunit.client.0.smithi090.stdout:3/264: rmdir d7/df/d2c 39 2024-04-20T10:54:40.165 INFO:tasks.workunit.client.0.smithi090.stdout:5/526: creat d1/d2f/d3d/d40/fb4 x:0 0 0 2024-04-20T10:54:40.182 INFO:tasks.workunit.client.0.smithi090.stdout:7/355: dwrite f0 [4194304,4194304] 0 2024-04-20T10:54:40.182 INFO:tasks.workunit.client.0.smithi090.stdout:1/344: dwrite d8/d1a/d1d/d2c/d3f/f5c [0,4194304] 0 2024-04-20T10:54:40.182 INFO:tasks.workunit.client.0.smithi090.stdout:4/260: dwrite d7/f21 [0,4194304] 0 2024-04-20T10:54:40.182 INFO:tasks.workunit.client.0.smithi090.stdout:4/261: write d7/f52 [840851,75419] 0 2024-04-20T10:54:40.183 INFO:tasks.workunit.client.0.smithi090.stdout:5/527: rename d1/de/d75/f7f to d1/d2f/d85/fb5 0 2024-04-20T10:54:40.183 INFO:tasks.workunit.client.0.smithi090.stdout:5/528: write d1/da/d14/d47/d50/f51 [5046027,18265] 0 2024-04-20T10:54:40.185 INFO:tasks.workunit.client.0.smithi090.stdout:7/356: mknod d11/d13/d23/d6c/d72/c78 0 2024-04-20T10:54:40.186 INFO:tasks.workunit.client.0.smithi090.stdout:1/345: symlink d8/d1a/d1d/l6c 0 2024-04-20T10:54:40.186 INFO:tasks.workunit.client.0.smithi090.stdout:4/262: symlink d7/d9/d30/l53 0 2024-04-20T10:54:40.187 INFO:tasks.workunit.client.0.smithi090.stdout:4/263: write d7/fb [1546289,90215] 0 2024-04-20T10:54:40.194 INFO:tasks.workunit.client.0.smithi090.stdout:4/264: dread d7/d9/f35 [0,4194304] 0 2024-04-20T10:54:40.197 INFO:tasks.workunit.client.0.smithi090.stdout:3/265: read d7/d26/f3c [3816616,28723] 0 2024-04-20T10:54:40.197 INFO:tasks.workunit.client.0.smithi090.stdout:3/266: write d7/df/f4d [943455,21857] 0 2024-04-20T10:54:40.197 INFO:tasks.workunit.client.0.smithi090.stdout:3/267: write d7/d11/f46 [498747,18870] 0 2024-04-20T10:54:40.203 INFO:tasks.workunit.client.0.smithi090.stdout:5/529: creat d1/da/d14/d47/fb6 x:0 0 0 2024-04-20T10:54:40.222 INFO:tasks.workunit.client.0.smithi090.stdout:7/357: dwrite f6 [0,4194304] 0 2024-04-20T10:54:40.463 INFO:tasks.workunit.client.0.smithi090.stdout:1/346: symlink d8/d1a/d4d/l6d 0 2024-04-20T10:54:40.463 INFO:tasks.workunit.client.0.smithi090.stdout:4/265: rmdir d7/d9/d47 39 2024-04-20T10:54:40.463 INFO:tasks.workunit.client.0.smithi090.stdout:3/268: rename d7/d11/f33 to d7/d15/d47/f5a 0 2024-04-20T10:54:40.463 INFO:tasks.workunit.client.0.smithi090.stdout:3/269: truncate d7/d11/f3f 1526195 0 2024-04-20T10:54:40.463 INFO:tasks.workunit.client.0.smithi090.stdout:3/270: chown d7/df/f27 553 1 2024-04-20T10:54:40.463 INFO:tasks.workunit.client.0.smithi090.stdout:5/530: truncate d1/da/d14/d47/d50/f5c 219155 0 2024-04-20T10:54:40.464 INFO:tasks.workunit.client.0.smithi090.stdout:7/358: rename d11/d1a/d3b/d58 to d11/d1a/d3b/d79 0 2024-04-20T10:54:40.464 INFO:tasks.workunit.client.0.smithi090.stdout:1/347: mkdir d8/d1a/d1d/d2c/d6e 0 2024-04-20T10:54:40.465 INFO:tasks.workunit.client.0.smithi090.stdout:3/271: rmdir d7/d15 39 2024-04-20T10:54:40.469 INFO:tasks.workunit.client.0.smithi090.stdout:3/272: link d7/c8 d7/d43/c5b 0 2024-04-20T10:54:40.470 INFO:tasks.workunit.client.0.smithi090.stdout:5/531: mknod d1/da/d14/cb7 0 2024-04-20T10:54:40.470 INFO:tasks.workunit.client.0.smithi090.stdout:3/273: symlink d7/d43/l5c 0 2024-04-20T10:54:40.472 INFO:tasks.workunit.client.0.smithi090.stdout:5/532: rename d1/d2f/cb1 to d1/da/d14/d47/d50/cb8 0 2024-04-20T10:54:40.484 INFO:tasks.workunit.client.0.smithi090.stdout:9/366: sync 2024-04-20T10:54:40.484 INFO:tasks.workunit.client.0.smithi090.stdout:6/300: sync 2024-04-20T10:54:40.484 INFO:tasks.workunit.client.0.smithi090.stdout:9/367: fdatasync d0/f37 0 2024-04-20T10:54:40.484 INFO:tasks.workunit.client.0.smithi090.stdout:9/368: write d0/d29/d36/d63/d1f/d34/d70/d52/f4c [1898549,66198] 0 2024-04-20T10:54:40.485 INFO:tasks.workunit.client.0.smithi090.stdout:3/274: symlink d7/df/l5d 0 2024-04-20T10:54:40.486 INFO:tasks.workunit.client.0.smithi090.stdout:6/301: creat d1/f65 x:0 0 0 2024-04-20T10:54:40.486 INFO:tasks.workunit.client.0.smithi090.stdout:6/302: write d1/d4/d26/d11/f2c [304197,64300] 0 2024-04-20T10:54:40.489 INFO:tasks.workunit.client.0.smithi090.stdout:1/348: dwrite f5 [0,4194304] 0 2024-04-20T10:54:40.489 INFO:tasks.workunit.client.0.smithi090.stdout:1/349: write d8/f2d [4714879,67203] 0 2024-04-20T10:54:40.491 INFO:tasks.workunit.client.0.smithi090.stdout:1/350: dread d8/d1a/d1d/d67/f3d [0,4194304] 0 2024-04-20T10:54:40.496 INFO:tasks.workunit.client.0.smithi090.stdout:7/359: dwrite d11/d13/f5c [0,4194304] 0 2024-04-20T10:54:40.496 INFO:tasks.workunit.client.0.smithi090.stdout:5/533: dwrite d1/f62 [0,4194304] 0 2024-04-20T10:54:40.497 INFO:tasks.workunit.client.0.smithi090.stdout:3/275: mkdir d7/d26/d5e 0 2024-04-20T10:54:40.497 INFO:tasks.workunit.client.0.smithi090.stdout:3/276: fsync d7/d35/f4b 0 2024-04-20T10:54:40.497 INFO:tasks.workunit.client.0.smithi090.stdout:3/277: fdatasync d7/d15/d47/f5a 0 2024-04-20T10:54:40.497 INFO:tasks.workunit.client.0.smithi090.stdout:3/278: chown d7/d15/l1e 2078 1 2024-04-20T10:54:40.497 INFO:tasks.workunit.client.0.smithi090.stdout:7/360: truncate f6 986135 0 2024-04-20T10:54:40.501 INFO:tasks.workunit.client.0.smithi090.stdout:3/279: mknod d7/df/c5f 0 2024-04-20T10:54:40.502 INFO:tasks.workunit.client.0.smithi090.stdout:3/280: dread d7/df/f13 [0,4194304] 0 2024-04-20T10:54:40.503 INFO:tasks.workunit.client.0.smithi090.stdout:5/534: symlink d1/de/lb9 0 2024-04-20T10:54:40.507 INFO:tasks.workunit.client.0.smithi090.stdout:6/303: dwrite d1/d19/f2d [0,4194304] 0 2024-04-20T10:54:40.508 INFO:tasks.workunit.client.0.smithi090.stdout:3/281: creat d7/df/d2c/f60 x:0 0 0 2024-04-20T10:54:40.511 INFO:tasks.workunit.client.0.smithi090.stdout:9/369: dwrite d0/d29/d4f/f2d [0,4194304] 0 2024-04-20T10:54:40.511 INFO:tasks.workunit.client.0.smithi090.stdout:6/304: creat d1/d4/f66 x:0 0 0 2024-04-20T10:54:40.511 INFO:tasks.workunit.client.0.smithi090.stdout:6/305: write d1/d19/f57 [285289,17241] 0 2024-04-20T10:54:40.512 INFO:tasks.workunit.client.0.smithi090.stdout:4/266: write d7/f26 [2555060,27751] 0 2024-04-20T10:54:40.512 INFO:tasks.workunit.client.0.smithi090.stdout:3/282: rmdir d7/df 39 2024-04-20T10:54:40.512 INFO:tasks.workunit.client.0.smithi090.stdout:3/283: stat d7/d15/f25 0 2024-04-20T10:54:40.512 INFO:tasks.workunit.client.0.smithi090.stdout:3/284: write d7/d43/f59 [297628,93077] 0 2024-04-20T10:54:40.512 INFO:tasks.workunit.client.0.smithi090.stdout:1/351: dwrite d8/d1a/d1d/d67/f23 [0,4194304] 0 2024-04-20T10:54:40.515 INFO:tasks.workunit.client.0.smithi090.stdout:4/267: creat d7/f54 x:0 0 0 2024-04-20T10:54:40.516 INFO:tasks.workunit.client.0.smithi090.stdout:3/285: creat d7/d26/d5e/f61 x:0 0 0 2024-04-20T10:54:40.517 INFO:tasks.workunit.client.0.smithi090.stdout:3/286: stat d7/d26/f3c 0 2024-04-20T10:54:40.518 INFO:tasks.workunit.client.0.smithi090.stdout:1/352: write d8/d1a/d1d/d67/f3d [18043,97852] 0 2024-04-20T10:54:40.518 INFO:tasks.workunit.client.0.smithi090.stdout:1/353: fdatasync d8/d1a/d1d/d2c/f64 0 2024-04-20T10:54:40.520 INFO:tasks.workunit.client.0.smithi090.stdout:4/268: truncate d7/f3c 3535232 0 2024-04-20T10:54:40.521 INFO:tasks.workunit.client.0.smithi090.stdout:3/287: rmdir d7/d26 39 2024-04-20T10:54:40.522 INFO:tasks.workunit.client.0.smithi090.stdout:1/354: symlink d8/l6f 0 2024-04-20T10:54:40.524 INFO:tasks.workunit.client.0.smithi090.stdout:6/306: write d1/d4/d26/d11/d35/f5f [1059086,68872] 0 2024-04-20T10:54:40.524 INFO:tasks.workunit.client.0.smithi090.stdout:4/269: mknod d7/c55 0 2024-04-20T10:54:40.524 INFO:tasks.workunit.client.0.smithi090.stdout:4/270: chown d7/d9/f10 631312 1 2024-04-20T10:54:40.524 INFO:tasks.workunit.client.0.smithi090.stdout:3/288: truncate d7/d11/f3f 1137734 0 2024-04-20T10:54:40.525 INFO:tasks.workunit.client.0.smithi090.stdout:2/334: sync 2024-04-20T10:54:40.525 INFO:tasks.workunit.client.0.smithi090.stdout:8/357: sync 2024-04-20T10:54:40.528 INFO:tasks.workunit.client.0.smithi090.stdout:6/307: rename d1/d4/d26/d11/d35/l5b to d1/d4/d26/l67 0 2024-04-20T10:54:40.528 INFO:tasks.workunit.client.0.smithi090.stdout:4/271: stat d7/d9/d17/l4b 0 2024-04-20T10:54:40.530 INFO:tasks.workunit.client.0.smithi090.stdout:3/289: link d7/df/l2b d7/d15/d47/l62 0 2024-04-20T10:54:40.532 INFO:tasks.workunit.client.0.smithi090.stdout:8/358: symlink d0/l72 0 2024-04-20T10:54:40.532 INFO:tasks.workunit.client.0.smithi090.stdout:8/359: fdatasync d0/d11/d22/f23 0 2024-04-20T10:54:40.532 INFO:tasks.workunit.client.0.smithi090.stdout:7/361: dwrite d11/d13/d22/f3a [0,4194304] 0 2024-04-20T10:54:40.533 INFO:tasks.workunit.client.0.smithi090.stdout:4/272: mkdir d7/d9/d17/d56 0 2024-04-20T10:54:40.535 INFO:tasks.workunit.client.0.smithi090.stdout:3/290: symlink d7/df/l63 0 2024-04-20T10:54:40.536 INFO:tasks.workunit.client.0.smithi090.stdout:5/535: dwrite d1/da/d14/d47/f7e [0,4194304] 0 2024-04-20T10:54:40.538 INFO:tasks.workunit.client.0.smithi090.stdout:8/360: rename d0/f1c to d0/d2d/d49/f73 0 2024-04-20T10:54:40.540 INFO:tasks.workunit.client.0.smithi090.stdout:1/355: dread d8/d1a/d1d/d2c/d3f/f5c [0,4194304] 0 2024-04-20T10:54:40.541 INFO:tasks.workunit.client.0.smithi090.stdout:5/536: creat d1/da/d14/d47/d39/fba x:0 0 0 2024-04-20T10:54:40.543 INFO:tasks.workunit.client.0.smithi090.stdout:8/361: symlink d0/d11/d22/d53/d57/l74 0 2024-04-20T10:54:40.543 INFO:tasks.workunit.client.0.smithi090.stdout:8/362: write d0/d11/f1b [1009553,67775] 0 2024-04-20T10:54:40.543 INFO:tasks.workunit.client.0.smithi090.stdout:6/308: write d1/d10/f39 [2199450,82872] 0 2024-04-20T10:54:40.544 INFO:tasks.workunit.client.0.smithi090.stdout:3/291: dread d7/df/f13 [0,4194304] 0 2024-04-20T10:54:40.544 INFO:tasks.workunit.client.0.smithi090.stdout:1/356: rmdir d8/d1a/d1d/d67 39 2024-04-20T10:54:40.544 INFO:tasks.workunit.client.0.smithi090.stdout:2/335: dwrite d11/d1f/d2e/f5d [0,4194304] 0 2024-04-20T10:54:40.547 INFO:tasks.workunit.client.0.smithi090.stdout:1/357: read d8/f44 [226057,110489] 0 2024-04-20T10:54:40.547 INFO:tasks.workunit.client.0.smithi090.stdout:8/363: rename d0/d26/f51 to d0/d11/d22/d53/f75 0 2024-04-20T10:54:40.549 INFO:tasks.workunit.client.0.smithi090.stdout:5/537: dread d1/f7 [0,4194304] 0 2024-04-20T10:54:40.550 INFO:tasks.workunit.client.0.smithi090.stdout:6/309: creat d1/d4/d26/d11/d4a/f68 x:0 0 0 2024-04-20T10:54:40.552 INFO:tasks.workunit.client.0.smithi090.stdout:3/292: link d7/d26/d5e/f61 d7/d15/d2a/d30/f64 0 2024-04-20T10:54:40.553 INFO:tasks.workunit.client.0.smithi090.stdout:1/358: mknod d8/d1a/d1d/d2c/c70 0 2024-04-20T10:54:40.553 INFO:tasks.workunit.client.0.smithi090.stdout:1/359: write d8/d1a/f3b [1562913,84294] 0 2024-04-20T10:54:40.555 INFO:tasks.workunit.client.0.smithi090.stdout:8/364: mknod d0/d11/c76 0 2024-04-20T10:54:40.555 INFO:tasks.workunit.client.0.smithi090.stdout:8/365: write d0/d11/d22/d53/f54 [263834,37767] 0 2024-04-20T10:54:40.556 INFO:tasks.workunit.client.0.smithi090.stdout:4/273: dwrite d7/d9/f4a [0,4194304] 0 2024-04-20T10:54:40.557 INFO:tasks.workunit.client.0.smithi090.stdout:2/336: rename d11/d1a/d4a/d55/d67/f71 to d11/d1f/f75 0 2024-04-20T10:54:40.557 INFO:tasks.workunit.client.0.smithi090.stdout:2/337: fsync d11/d1a/d30/f48 0 2024-04-20T10:54:40.558 INFO:tasks.workunit.client.0.smithi090.stdout:3/293: dread d7/f37 [0,4194304] 0 2024-04-20T10:54:40.558 INFO:tasks.workunit.client.0.smithi090.stdout:6/310: mknod d1/d4/c69 0 2024-04-20T10:54:40.559 INFO:tasks.workunit.client.0.smithi090.stdout:7/362: dwrite d11/d13/d23/f45 [0,4194304] 0 2024-04-20T10:54:40.560 INFO:tasks.workunit.client.0.smithi090.stdout:1/360: creat d8/d1a/d1d/f71 x:0 0 0 2024-04-20T10:54:40.562 INFO:tasks.workunit.client.0.smithi090.stdout:8/366: symlink d0/d11/l77 0 2024-04-20T10:54:40.566 INFO:tasks.workunit.client.0.smithi090.stdout:2/338: creat d11/f76 x:0 0 0 2024-04-20T10:54:40.568 INFO:tasks.workunit.client.0.smithi090.stdout:3/294: link d7/df/l63 d7/d11/l65 0 2024-04-20T10:54:40.570 INFO:tasks.workunit.client.0.smithi090.stdout:7/363: creat d11/d61/f7a x:0 0 0 2024-04-20T10:54:40.572 INFO:tasks.workunit.client.0.smithi090.stdout:2/339: creat d11/d1a/d37/f77 x:0 0 0 2024-04-20T10:54:40.572 INFO:tasks.workunit.client.0.smithi090.stdout:2/340: write d11/d1f/d2e/f5d [5160977,127310] 0 2024-04-20T10:54:40.572 INFO:tasks.workunit.client.0.smithi090.stdout:2/341: chown d11/d1f/d2e/l5a 0 1 2024-04-20T10:54:40.573 INFO:tasks.workunit.client.0.smithi090.stdout:3/295: rmdir d7/df 39 2024-04-20T10:54:40.574 INFO:tasks.workunit.client.0.smithi090.stdout:7/364: creat d11/d13/d22/d24/f7b x:0 0 0 2024-04-20T10:54:40.579 INFO:tasks.workunit.client.0.smithi090.stdout:5/538: dwrite d1/d55/fa7 [0,4194304] 0 2024-04-20T10:54:40.579 INFO:tasks.workunit.client.0.smithi090.stdout:5/539: fdatasync d1/d2f/d3d/f6a 0 2024-04-20T10:54:40.579 INFO:tasks.workunit.client.0.smithi090.stdout:5/540: chown d1/da/d14/d47/f84 22820116 1 2024-04-20T10:54:40.582 INFO:tasks.workunit.client.0.smithi090.stdout:3/296: truncate d7/d15/d2a/f58 1766091 0 2024-04-20T10:54:40.585 INFO:tasks.workunit.client.0.smithi090.stdout:4/274: dwrite d7/d9/d17/f49 [0,4194304] 0 2024-04-20T10:54:40.586 INFO:tasks.workunit.client.0.smithi090.stdout:4/275: stat d7/d9/d17/l2d 0 2024-04-20T10:54:40.586 INFO:tasks.workunit.client.0.smithi090.stdout:4/276: write d7/d9/f19 [3572196,120876] 0 2024-04-20T10:54:40.586 INFO:tasks.workunit.client.0.smithi090.stdout:8/367: dwrite d0/d2d/d49/d67/f69 [0,4194304] 0 2024-04-20T10:54:40.588 INFO:tasks.workunit.client.0.smithi090.stdout:6/311: dwrite d1/d4/d26/d11/d4a/d56/f4f [0,4194304] 0 2024-04-20T10:54:40.588 INFO:tasks.workunit.client.0.smithi090.stdout:3/297: write d7/f37 [2756501,105224] 0 2024-04-20T10:54:40.588 INFO:tasks.workunit.client.0.smithi090.stdout:3/298: chown d7/d15/d2a/d30/f4c 9641158 1 2024-04-20T10:54:40.588 INFO:tasks.workunit.client.0.smithi090.stdout:3/299: chown d7/df/c4e 1348621 1 2024-04-20T10:54:40.588 INFO:tasks.workunit.client.0.smithi090.stdout:3/300: read - d7/f40 zero size 2024-04-20T10:54:40.588 INFO:tasks.workunit.client.0.smithi090.stdout:3/301: truncate d7/d43/f59 936815 0 2024-04-20T10:54:40.590 INFO:tasks.workunit.client.0.smithi090.stdout:3/302: dread d7/d11/f3f [0,4194304] 0 2024-04-20T10:54:40.590 INFO:tasks.workunit.client.0.smithi090.stdout:3/303: fsync d7/f40 0 2024-04-20T10:54:40.591 INFO:tasks.workunit.client.0.smithi090.stdout:3/304: read - d7/d43/f45 zero size 2024-04-20T10:54:40.592 INFO:tasks.workunit.client.0.smithi090.stdout:3/305: dread d7/fa [0,4194304] 0 2024-04-20T10:54:40.596 INFO:tasks.workunit.client.0.smithi090.stdout:3/306: write d7/fa [718681,121901] 0 2024-04-20T10:54:40.596 INFO:tasks.workunit.client.0.smithi090.stdout:2/342: dwrite d11/d1a/d37/f4f [0,4194304] 0 2024-04-20T10:54:40.599 INFO:tasks.workunit.client.0.smithi090.stdout:4/277: write d7/f3c [3319637,9817] 0 2024-04-20T10:54:40.599 INFO:tasks.workunit.client.0.smithi090.stdout:4/278: chown d7/d9/d17/f3f 3 1 2024-04-20T10:54:40.599 INFO:tasks.workunit.client.0.smithi090.stdout:4/279: stat d7/d9/f19 0 2024-04-20T10:54:40.604 INFO:tasks.workunit.client.0.smithi090.stdout:3/307: write d7/d11/f1c [7687610,38575] 0 2024-04-20T10:54:40.604 INFO:tasks.workunit.client.0.smithi090.stdout:3/308: stat d7/d15/d2a/f49 0 2024-04-20T10:54:40.604 INFO:tasks.workunit.client.0.smithi090.stdout:3/309: write d7/d43/f45 [31392,58224] 0 2024-04-20T10:54:40.604 INFO:tasks.workunit.client.0.smithi090.stdout:2/343: mknod d11/d1a/d4a/c78 0 2024-04-20T10:54:40.605 INFO:tasks.workunit.client.0.smithi090.stdout:6/312: write d1/d4/d26/d11/f63 [650971,24903] 0 2024-04-20T10:54:40.606 INFO:tasks.workunit.client.0.smithi090.stdout:3/310: rename d7/l1a to d7/d15/d2a/l66 0 2024-04-20T10:54:40.606 INFO:tasks.workunit.client.0.smithi090.stdout:3/311: chown d7/df/l14 0 1 2024-04-20T10:54:40.607 INFO:tasks.workunit.client.0.smithi090.stdout:6/313: link d1/d4/d26/ce d1/d19/c6a 0 2024-04-20T10:54:40.607 INFO:tasks.workunit.client.0.smithi090.stdout:6/314: truncate d1/d4/d26/d11/d4a/f68 160957 0 2024-04-20T10:54:40.609 INFO:tasks.workunit.client.0.smithi090.stdout:2/344: rename l4 to d11/d1f/l79 0 2024-04-20T10:54:40.609 INFO:tasks.workunit.client.0.smithi090.stdout:2/345: read d11/d1a/d30/f48 [169286,21964] 0 2024-04-20T10:54:40.609 INFO:tasks.workunit.client.0.smithi090.stdout:2/346: readlink d11/d1a/d2b/l43 0 2024-04-20T10:54:40.609 INFO:tasks.workunit.client.0.smithi090.stdout:2/347: truncate d11/d1a/d2b/f2f 9307361 0 2024-04-20T10:54:40.609 INFO:tasks.workunit.client.0.smithi090.stdout:3/312: creat d7/d15/d2a/f67 x:0 0 0 2024-04-20T10:54:40.609 INFO:tasks.workunit.client.0.smithi090.stdout:3/313: chown d7/df/f4d 105 1 2024-04-20T10:54:40.614 INFO:tasks.workunit.client.0.smithi090.stdout:7/365: dwrite d11/d13/d23/f2b [0,4194304] 0 2024-04-20T10:54:40.614 INFO:tasks.workunit.client.0.smithi090.stdout:3/314: fdatasync d7/fa 0 2024-04-20T10:54:40.614 INFO:tasks.workunit.client.0.smithi090.stdout:2/348: creat d11/f7a x:0 0 0 2024-04-20T10:54:40.615 INFO:tasks.workunit.client.0.smithi090.stdout:7/366: getdents d11/d1a/d3b 0 2024-04-20T10:54:40.615 INFO:tasks.workunit.client.0.smithi090.stdout:3/315: readlink d7/d35/l38 0 2024-04-20T10:54:40.615 INFO:tasks.workunit.client.0.smithi090.stdout:3/316: write d7/d11/f3f [648502,30577] 0 2024-04-20T10:54:40.616 INFO:tasks.workunit.client.0.smithi090.stdout:2/349: mknod d11/d1f/d2e/c7b 0 2024-04-20T10:54:40.616 INFO:tasks.workunit.client.0.smithi090.stdout:2/350: dread - d11/d1f/d2e/f33 zero size 2024-04-20T10:54:40.616 INFO:tasks.workunit.client.0.smithi090.stdout:2/351: truncate d11/d1a/d37/f77 57738 0 2024-04-20T10:54:40.616 INFO:tasks.workunit.client.0.smithi090.stdout:2/352: chown d11/d1a/d4a/d59 735600 1 2024-04-20T10:54:40.616 INFO:tasks.workunit.client.0.smithi090.stdout:7/367: rename d11/d13/d5b/f73 to d11/d13/d33/d44/f7c 0 2024-04-20T10:54:40.617 INFO:tasks.workunit.client.0.smithi090.stdout:3/317: rmdir d7/d11 39 2024-04-20T10:54:40.618 INFO:tasks.workunit.client.0.smithi090.stdout:2/353: rename d11/d1f/d2e/f74 to d11/d1f/d2e/d6e/f7c 0 2024-04-20T10:54:40.618 INFO:tasks.workunit.client.0.smithi090.stdout:2/354: chown d11/c17 1856201 1 2024-04-20T10:54:40.619 INFO:tasks.workunit.client.0.smithi090.stdout:7/368: mkdir d11/d13/d22/d7d 0 2024-04-20T10:54:40.619 INFO:tasks.workunit.client.0.smithi090.stdout:3/318: mkdir d7/d15/d2a/d68 0 2024-04-20T10:54:40.620 INFO:tasks.workunit.client.0.smithi090.stdout:2/355: readlink d11/d1a/l23 0 2024-04-20T10:54:40.621 INFO:tasks.workunit.client.0.smithi090.stdout:7/369: dread d11/d13/d22/d24/d35/f51 [4194304,4194304] 0 2024-04-20T10:54:40.621 INFO:tasks.workunit.client.0.smithi090.stdout:2/356: unlink d11/c14 0 2024-04-20T10:54:40.622 INFO:tasks.workunit.client.0.smithi090.stdout:3/319: mknod d7/d35/c69 0 2024-04-20T10:54:40.626 INFO:tasks.workunit.client.0.smithi090.stdout:5/541: dwrite d1/de/d75/f95 [0,4194304] 0 2024-04-20T10:54:40.626 INFO:tasks.workunit.client.0.smithi090.stdout:5/542: stat d1/d2f/d3d/d40/d6c 0 2024-04-20T10:54:40.628 INFO:tasks.workunit.client.0.smithi090.stdout:8/368: dwrite d0/d26/f40 [0,4194304] 0 2024-04-20T10:54:40.629 INFO:tasks.workunit.client.0.smithi090.stdout:8/369: write d0/d11/d14/f2b [2008310,25602] 0 2024-04-20T10:54:40.629 INFO:tasks.workunit.client.0.smithi090.stdout:6/315: dwrite d1/f4c [0,4194304] 0 2024-04-20T10:54:40.630 INFO:tasks.workunit.client.0.smithi090.stdout:2/357: creat d11/d1a/f7d x:0 0 0 2024-04-20T10:54:40.631 INFO:tasks.workunit.client.0.smithi090.stdout:2/358: write d11/d1f/f66 [433508,43376] 0 2024-04-20T10:54:40.631 INFO:tasks.workunit.client.0.smithi090.stdout:2/359: chown d11/d1f/d2e/f5b 291 1 2024-04-20T10:54:40.631 INFO:tasks.workunit.client.0.smithi090.stdout:2/360: truncate d11/f62 418842 0 2024-04-20T10:54:40.631 INFO:tasks.workunit.client.0.smithi090.stdout:5/543: dread d1/da/f2c [0,4194304] 0 2024-04-20T10:54:40.633 INFO:tasks.workunit.client.0.smithi090.stdout:4/280: dread d7/f3c [0,4194304] 0 2024-04-20T10:54:40.633 INFO:tasks.workunit.client.0.smithi090.stdout:4/281: chown d7/d9/d17/l4b 13983749 1 2024-04-20T10:54:40.634 INFO:tasks.workunit.client.0.smithi090.stdout:6/316: unlink d1/d4/d26/d11/d4a/d56/c3c 0 2024-04-20T10:54:40.636 INFO:tasks.workunit.client.0.smithi090.stdout:5/544: unlink d1/da/d16/l81 0 2024-04-20T10:54:40.639 INFO:tasks.workunit.client.0.smithi090.stdout:4/282: symlink d7/d9/d30/l57 0 2024-04-20T10:54:40.643 INFO:tasks.workunit.client.0.smithi090.stdout:2/361: write d11/d1a/d2b/f35 [3583396,45594] 0 2024-04-20T10:54:40.644 INFO:tasks.workunit.client.0.smithi090.stdout:5/545: creat d1/d2f/d3d/d40/d70/fbb x:0 0 0 2024-04-20T10:54:40.649 INFO:tasks.workunit.client.0.smithi090.stdout:7/370: dwrite d11/d13/d22/d24/f2a [4194304,4194304] 0 2024-04-20T10:54:40.650 INFO:tasks.workunit.client.0.smithi090.stdout:3/320: dwrite d7/d26/d5e/f61 [0,4194304] 0 2024-04-20T10:54:40.650 INFO:tasks.workunit.client.0.smithi090.stdout:5/546: getdents d1/da/d14/d47/d50 0 2024-04-20T10:54:40.650 INFO:tasks.workunit.client.0.smithi090.stdout:5/547: stat d1/d2f/d3d/d40/d4a/f4f 0 2024-04-20T10:54:40.650 INFO:tasks.workunit.client.0.smithi090.stdout:5/548: fdatasync d1/de/d96/fa5 0 2024-04-20T10:54:40.651 INFO:tasks.workunit.client.0.smithi090.stdout:5/549: fsync d1/da/d14/d47/d39/f76 0 2024-04-20T10:54:40.653 INFO:tasks.workunit.client.0.smithi090.stdout:7/371: symlink d11/d13/d5d/l7e 0 2024-04-20T10:54:40.656 INFO:tasks.workunit.client.0.smithi090.stdout:4/283: dread d7/d9/fa [0,4194304] 0 2024-04-20T10:54:40.656 INFO:tasks.workunit.client.0.smithi090.stdout:3/321: link d7/df/c4e d7/d26/d5e/c6a 0 2024-04-20T10:54:40.657 INFO:tasks.workunit.client.0.smithi090.stdout:7/372: mkdir d11/d13/d22/d24/d7f 0 2024-04-20T10:54:40.658 INFO:tasks.workunit.client.0.smithi090.stdout:4/284: link d7/d9/d17/f48 d7/d9/d17/f58 0 2024-04-20T10:54:40.660 INFO:tasks.workunit.client.0.smithi090.stdout:7/373: rmdir d11/d13/d22/d24/d7f 0 2024-04-20T10:54:40.661 INFO:tasks.workunit.client.0.smithi090.stdout:3/322: rename d7/df/d2c/f60 to d7/d35/f6b 0 2024-04-20T10:54:40.662 INFO:tasks.workunit.client.0.smithi090.stdout:7/374: creat d11/d13/d5d/f80 x:0 0 0 2024-04-20T10:54:40.663 INFO:tasks.workunit.client.0.smithi090.stdout:7/375: dread - d11/d13/d33/d44/f71 zero size 2024-04-20T10:54:40.663 INFO:tasks.workunit.client.0.smithi090.stdout:3/323: creat d7/f6c x:0 0 0 2024-04-20T10:54:40.664 INFO:tasks.workunit.client.0.smithi090.stdout:7/376: mknod d11/d13/d33/c81 0 2024-04-20T10:54:40.667 INFO:tasks.workunit.client.0.smithi090.stdout:2/362: dwrite d11/d1a/f2c [0,4194304] 0 2024-04-20T10:54:40.667 INFO:tasks.workunit.client.0.smithi090.stdout:2/363: chown fd 46 1 2024-04-20T10:54:40.668 INFO:tasks.workunit.client.0.smithi090.stdout:2/364: dread d11/d1a/d2b/f2f [8388608,4194304] 0 2024-04-20T10:54:40.668 INFO:tasks.workunit.client.0.smithi090.stdout:2/365: write d11/d1a/f58 [3138938,98067] 0 2024-04-20T10:54:40.669 INFO:tasks.workunit.client.0.smithi090.stdout:5/550: dwrite d1/d2f/d3d/d40/f90 [0,4194304] 0 2024-04-20T10:54:40.669 INFO:tasks.workunit.client.0.smithi090.stdout:3/324: creat d7/d15/d2a/d68/f6d x:0 0 0 2024-04-20T10:54:40.671 INFO:tasks.workunit.client.0.smithi090.stdout:3/325: dread d7/d11/f2e [0,4194304] 0 2024-04-20T10:54:40.673 INFO:tasks.workunit.client.0.smithi090.stdout:7/377: dread d11/d13/d22/d24/d35/f51 [0,4194304] 0 2024-04-20T10:54:40.674 INFO:tasks.workunit.client.0.smithi090.stdout:2/366: creat d11/d1a/d30/f7e x:0 0 0 2024-04-20T10:54:40.674 INFO:tasks.workunit.client.0.smithi090.stdout:2/367: write d11/d1f/d2e/f33 [386652,41906] 0 2024-04-20T10:54:40.676 INFO:tasks.workunit.client.0.smithi090.stdout:5/551: symlink d1/da/d14/d47/d39/lbc 0 2024-04-20T10:54:40.677 INFO:tasks.workunit.client.0.smithi090.stdout:3/326: unlink d7/l36 0 2024-04-20T10:54:40.679 INFO:tasks.workunit.client.0.smithi090.stdout:5/552: rename d1/d2f/d3d/d40/d4a to d1/d2f/d85/dbd 0 2024-04-20T10:54:40.680 INFO:tasks.workunit.client.0.smithi090.stdout:3/327: rmdir d7/df 39 2024-04-20T10:54:40.681 INFO:tasks.workunit.client.0.smithi090.stdout:7/378: write f6 [3083204,105723] 0 2024-04-20T10:54:40.681 INFO:tasks.workunit.client.0.smithi090.stdout:7/379: write d11/d13/d5d/f80 [880737,73649] 0 2024-04-20T10:54:40.682 INFO:tasks.workunit.client.0.smithi090.stdout:4/285: dwrite d7/d9/fa [0,4194304] 0 2024-04-20T10:54:40.682 INFO:tasks.workunit.client.0.smithi090.stdout:5/553: rename d1/da/d14/d47/d39/f5d to d1/de/d75/fbe 0 2024-04-20T10:54:40.683 INFO:tasks.workunit.client.0.smithi090.stdout:3/328: mknod d7/d43/c6e 0 2024-04-20T10:54:40.683 INFO:tasks.workunit.client.0.smithi090.stdout:3/329: write d7/d15/d2a/f49 [858744,58921] 0 2024-04-20T10:54:40.684 INFO:tasks.workunit.client.0.smithi090.stdout:3/330: write d7/df/f4d [886728,34628] 0 2024-04-20T10:54:40.685 INFO:tasks.workunit.client.0.smithi090.stdout:3/331: write d7/fa [1885777,111024] 0 2024-04-20T10:54:40.685 INFO:tasks.workunit.client.0.smithi090.stdout:3/332: chown d7/d11/l65 16660657 1 2024-04-20T10:54:40.689 INFO:tasks.workunit.client.0.smithi090.stdout:3/333: dread d7/df/f27 [0,4194304] 0 2024-04-20T10:54:40.693 INFO:tasks.workunit.client.0.smithi090.stdout:4/286: link d7/d9/c22 d7/d9/c59 0 2024-04-20T10:54:40.694 INFO:tasks.workunit.client.0.smithi090.stdout:7/380: rename d11/d1a/d3b/d77 to d11/d13/d22/d82 0 2024-04-20T10:54:40.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/554: unlink d1/da/d14/d47/l93 0 2024-04-20T10:54:40.696 INFO:tasks.workunit.client.0.smithi090.stdout:3/334: creat d7/df/d2c/f6f x:0 0 0 2024-04-20T10:54:40.699 INFO:tasks.workunit.client.0.smithi090.stdout:2/368: truncate d11/d1a/d37/f44 3254046 0 2024-04-20T10:54:40.701 INFO:tasks.workunit.client.0.smithi090.stdout:4/287: rename d7/d9/d17/c4f to d7/d9/d30/d3d/c5a 0 2024-04-20T10:54:40.702 INFO:tasks.workunit.client.0.smithi090.stdout:7/381: getdents d11/d13/d23 0 2024-04-20T10:54:40.703 INFO:tasks.workunit.client.0.smithi090.stdout:5/555: creat d1/d2f/d85/fbf x:0 0 0 2024-04-20T10:54:40.703 INFO:tasks.workunit.client.0.smithi090.stdout:5/556: readlink d1/da/lb0 0 2024-04-20T10:54:40.703 INFO:tasks.workunit.client.0.smithi090.stdout:3/335: mknod d7/d15/d47/d56/c70 0 2024-04-20T10:54:40.705 INFO:tasks.workunit.client.0.smithi090.stdout:4/288: truncate d7/d9/d17/f2b 16715 0 2024-04-20T10:54:40.705 INFO:tasks.workunit.client.0.smithi090.stdout:7/382: symlink d11/d13/d5d/l83 0 2024-04-20T10:54:40.706 INFO:tasks.workunit.client.0.smithi090.stdout:7/383: dread - d11/d13/d22/d24/f7b zero size 2024-04-20T10:54:40.706 INFO:tasks.workunit.client.0.smithi090.stdout:7/384: read d11/d13/d22/d24/f5e [48400,39579] 0 2024-04-20T10:54:40.706 INFO:tasks.workunit.client.0.smithi090.stdout:7/385: chown d11/d1a/d3b/d79/c67 354 1 2024-04-20T10:54:40.710 INFO:tasks.workunit.client.0.smithi090.stdout:5/557: read d1/da/d14/d47/d50/f51 [3783910,102957] 0 2024-04-20T10:54:40.711 INFO:tasks.workunit.client.0.smithi090.stdout:0/362: sync 2024-04-20T10:54:40.711 INFO:tasks.workunit.client.0.smithi090.stdout:0/363: fsync d14/d19/d2b/d52/f69 0 2024-04-20T10:54:40.712 INFO:tasks.workunit.client.0.smithi090.stdout:5/558: dread d1/da/d1f/f9b [0,4194304] 0 2024-04-20T10:54:40.713 INFO:tasks.workunit.client.0.smithi090.stdout:3/336: getdents d7/df/d2c 0 2024-04-20T10:54:40.713 INFO:tasks.workunit.client.0.smithi090.stdout:3/337: write d7/d15/f23 [1152456,9656] 0 2024-04-20T10:54:40.713 INFO:tasks.workunit.client.0.smithi090.stdout:7/386: dread f9 [0,4194304] 0 2024-04-20T10:54:40.714 INFO:tasks.workunit.client.0.smithi090.stdout:7/387: chown d11/d13/d33/f54 91603 1 2024-04-20T10:54:40.714 INFO:tasks.workunit.client.0.smithi090.stdout:7/388: fdatasync d11/d13/d23/f2b 0 2024-04-20T10:54:40.714 INFO:tasks.workunit.client.0.smithi090.stdout:2/369: symlink d11/d1a/l7f 0 2024-04-20T10:54:40.730 INFO:tasks.workunit.client.0.smithi090.stdout:3/338: dwrite d7/f40 [0,4194304] 0 2024-04-20T10:54:40.731 INFO:tasks.workunit.client.0.smithi090.stdout:7/389: creat d11/d13/d23/d6c/d72/f84 x:0 0 0 2024-04-20T10:54:40.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/339: unlink d7/d11/f3f 0 2024-04-20T10:54:40.733 INFO:tasks.workunit.client.0.smithi090.stdout:5/559: mkdir d1/da/d14/dc0 0 2024-04-20T10:54:40.734 INFO:tasks.workunit.client.0.smithi090.stdout:7/390: truncate f8 165746 0 2024-04-20T10:54:40.736 INFO:tasks.workunit.client.0.smithi090.stdout:3/340: creat d7/f71 x:0 0 0 2024-04-20T10:54:40.736 INFO:tasks.workunit.client.0.smithi090.stdout:3/341: write d7/d43/f45 [310336,54218] 0 2024-04-20T10:54:40.736 INFO:tasks.workunit.client.0.smithi090.stdout:3/342: chown d7/d15/d2a/d30 1058 1 2024-04-20T10:54:40.736 INFO:tasks.workunit.client.0.smithi090.stdout:3/343: fdatasync d7/f19 0 2024-04-20T10:54:40.736 INFO:tasks.workunit.client.0.smithi090.stdout:3/344: dread - d7/f71 zero size 2024-04-20T10:54:40.736 INFO:tasks.workunit.client.0.smithi090.stdout:5/560: mknod d1/cc1 0 2024-04-20T10:54:40.737 INFO:tasks.workunit.client.0.smithi090.stdout:7/391: creat d11/d1a/d2f/f85 x:0 0 0 2024-04-20T10:54:40.737 INFO:tasks.workunit.client.0.smithi090.stdout:7/392: write d11/d1a/f40 [5108678,119834] 0 2024-04-20T10:54:40.738 INFO:tasks.workunit.client.0.smithi090.stdout:3/345: symlink d7/d15/d2a/d30/d48/l72 0 2024-04-20T10:54:40.740 INFO:tasks.workunit.client.0.smithi090.stdout:3/346: rename d7/df/f13 to d7/d11/f73 0 2024-04-20T10:54:40.778 INFO:tasks.workunit.client.0.smithi090.stdout:2/370: dread d11/d1f/d2e/f5b [0,4194304] 0 2024-04-20T10:54:40.795 INFO:tasks.workunit.client.0.smithi090.stdout:2/371: dwrite d11/d1f/d2e/f3d [0,4194304] 0 2024-04-20T10:54:40.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/372: write d11/d1f/d2e/f3b [1373865,43837] 0 2024-04-20T10:54:40.796 INFO:tasks.workunit.client.0.smithi090.stdout:5/561: mknod d1/da/d14/cc2 0 2024-04-20T10:54:40.796 INFO:tasks.workunit.client.0.smithi090.stdout:7/393: dwrite d11/d13/d22/f4b [0,4194304] 0 2024-04-20T10:54:40.796 INFO:tasks.workunit.client.0.smithi090.stdout:3/347: dwrite d7/f37 [0,4194304] 0 2024-04-20T10:54:40.797 INFO:tasks.workunit.client.0.smithi090.stdout:2/373: mkdir d11/d1a/d4a/d80 0 2024-04-20T10:54:40.797 INFO:tasks.workunit.client.0.smithi090.stdout:4/289: dwrite d7/f26 [0,4194304] 0 2024-04-20T10:54:40.797 INFO:tasks.workunit.client.0.smithi090.stdout:0/364: dwrite f9 [0,4194304] 0 2024-04-20T10:54:40.797 INFO:tasks.workunit.client.0.smithi090.stdout:5/562: creat d1/da/fc3 x:0 0 0 2024-04-20T10:54:40.799 INFO:tasks.workunit.client.0.smithi090.stdout:7/394: mknod d11/d1a/d3b/c86 0 2024-04-20T10:54:40.800 INFO:tasks.workunit.client.0.smithi090.stdout:3/348: creat d7/d15/d2a/d68/f74 x:0 0 0 2024-04-20T10:54:40.800 INFO:tasks.workunit.client.0.smithi090.stdout:2/374: creat d11/d1f/f81 x:0 0 0 2024-04-20T10:54:40.801 INFO:tasks.workunit.client.0.smithi090.stdout:3/349: dread d7/d11/f73 [0,4194304] 0 2024-04-20T10:54:40.801 INFO:tasks.workunit.client.0.smithi090.stdout:3/350: fdatasync d7/f6c 0 2024-04-20T10:54:40.801 INFO:tasks.workunit.client.0.smithi090.stdout:3/351: fdatasync d7/f37 0 2024-04-20T10:54:40.802 INFO:tasks.workunit.client.0.smithi090.stdout:0/365: rename d14/f1e to d14/d41/f6e 0 2024-04-20T10:54:40.804 INFO:tasks.workunit.client.0.smithi090.stdout:5/563: creat d1/d2f/fc4 x:0 0 0 2024-04-20T10:54:40.805 INFO:tasks.workunit.client.0.smithi090.stdout:7/395: mkdir d11/d13/d5b/d6b/d87 0 2024-04-20T10:54:40.807 INFO:tasks.workunit.client.0.smithi090.stdout:2/375: symlink d11/d1a/d30/l82 0 2024-04-20T10:54:40.813 INFO:tasks.workunit.client.0.smithi090.stdout:3/352: dread d7/d15/f1d [0,4194304] 0 2024-04-20T10:54:40.813 INFO:tasks.workunit.client.0.smithi090.stdout:3/353: truncate d7/d11/f46 1369966 0 2024-04-20T10:54:40.816 INFO:tasks.workunit.client.0.smithi090.stdout:4/290: dwrite d7/f26 [0,4194304] 0 2024-04-20T10:54:40.816 INFO:tasks.workunit.client.0.smithi090.stdout:0/366: dread d14/d41/f6e [0,4194304] 0 2024-04-20T10:54:40.816 INFO:tasks.workunit.client.0.smithi090.stdout:7/396: symlink d11/d13/d22/d24/l88 0 2024-04-20T10:54:40.817 INFO:tasks.workunit.client.0.smithi090.stdout:0/367: creat d14/d19/d2b/d61/f6f x:0 0 0 2024-04-20T10:54:40.825 INFO:tasks.workunit.client.0.smithi090.stdout:0/368: write f0 [584757,97391] 0 2024-04-20T10:54:40.826 INFO:tasks.workunit.client.0.smithi090.stdout:7/397: mkdir d11/d13/d33/d44/d89 0 2024-04-20T10:54:40.828 INFO:tasks.workunit.client.0.smithi090.stdout:5/564: dwrite d1/da/d14/d47/f7e [0,4194304] 0 2024-04-20T10:54:40.829 INFO:tasks.workunit.client.0.smithi090.stdout:2/376: dwrite d11/d1a/d37/f4f [4194304,4194304] 0 2024-04-20T10:54:40.829 INFO:tasks.workunit.client.0.smithi090.stdout:0/369: mkdir d14/d19/d2b/d66/d43/d5c/d70 0 2024-04-20T10:54:40.830 INFO:tasks.workunit.client.0.smithi090.stdout:5/565: symlink d1/da/d16/lc5 0 2024-04-20T10:54:40.830 INFO:tasks.workunit.client.0.smithi090.stdout:5/566: write d1/da/d14/d47/d50/f51 [1746687,98355] 0 2024-04-20T10:54:40.831 INFO:tasks.workunit.client.0.smithi090.stdout:2/377: creat d11/d1a/f83 x:0 0 0 2024-04-20T10:54:40.832 INFO:tasks.workunit.client.0.smithi090.stdout:2/378: write d11/d1a/d2b/f2f [5470127,89175] 0 2024-04-20T10:54:40.832 INFO:tasks.workunit.client.0.smithi090.stdout:0/370: creat d14/d19/f71 x:0 0 0 2024-04-20T10:54:40.833 INFO:tasks.workunit.client.0.smithi090.stdout:5/567: truncate d1/d2a/f3e 2756677 0 2024-04-20T10:54:40.839 INFO:tasks.workunit.client.0.smithi090.stdout:7/398: dread f6 [0,4194304] 0 2024-04-20T10:54:40.840 INFO:tasks.workunit.client.0.smithi090.stdout:2/379: rmdir d11/d1a 39 2024-04-20T10:54:40.840 INFO:tasks.workunit.client.0.smithi090.stdout:2/380: dread - d11/d1f/d2e/d6e/f7c zero size 2024-04-20T10:54:40.841 INFO:tasks.workunit.client.0.smithi090.stdout:7/399: mknod d11/d13/c8a 0 2024-04-20T10:54:40.843 INFO:tasks.workunit.client.0.smithi090.stdout:2/381: creat d11/d1a/d2b/f84 x:0 0 0 2024-04-20T10:54:40.844 INFO:tasks.workunit.client.0.smithi090.stdout:2/382: dread - d11/d1a/d30/f61 zero size 2024-04-20T10:54:40.845 INFO:tasks.workunit.client.0.smithi090.stdout:2/383: mkdir d11/d1a/d37/d85 0 2024-04-20T10:54:40.845 INFO:tasks.workunit.client.0.smithi090.stdout:2/384: write d11/f1e [4282794,102907] 0 2024-04-20T10:54:40.846 INFO:tasks.workunit.client.0.smithi090.stdout:2/385: dread d11/d1a/f1b [0,4194304] 0 2024-04-20T10:54:40.850 INFO:tasks.workunit.client.0.smithi090.stdout:3/354: dwrite d7/df/f4d [0,4194304] 0 2024-04-20T10:54:40.850 INFO:tasks.workunit.client.0.smithi090.stdout:4/291: dwrite d7/f38 [0,4194304] 0 2024-04-20T10:54:40.850 INFO:tasks.workunit.client.0.smithi090.stdout:4/292: readlink d7/l15 0 2024-04-20T10:54:40.850 INFO:tasks.workunit.client.0.smithi090.stdout:5/568: dwrite d1/da/d14/d47/f84 [0,4194304] 0 2024-04-20T10:54:40.850 INFO:tasks.workunit.client.0.smithi090.stdout:0/371: dread d14/f5f [0,4194304] 0 2024-04-20T10:54:40.854 INFO:tasks.workunit.client.0.smithi090.stdout:0/372: dread d14/f2e [0,4194304] 0 2024-04-20T10:54:40.854 INFO:tasks.workunit.client.0.smithi090.stdout:0/373: readlink d14/d19/l3c 0 2024-04-20T10:54:40.859 INFO:tasks.workunit.client.0.smithi090.stdout:7/400: dwrite d11/d13/d22/d24/f69 [0,4194304] 0 2024-04-20T10:54:40.872 INFO:tasks.workunit.client.0.smithi090.stdout:0/374: dwrite ff [0,4194304] 0 2024-04-20T10:54:40.878 INFO:tasks.workunit.client.0.smithi090.stdout:0/375: write d14/f18 [2015470,108315] 0 2024-04-20T10:54:41.038 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:54:41.041 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:54:41.102 INFO:tasks.workunit.client.0.smithi090.stdout:2/386: mknod d11/d1a/d4a/d80/c86 0 2024-04-20T10:54:41.103 INFO:tasks.workunit.client.0.smithi090.stdout:3/355: creat d7/d43/f75 x:0 0 0 2024-04-20T10:54:41.103 INFO:tasks.workunit.client.0.smithi090.stdout:3/356: chown d7/d11/f2e 95092668 1 2024-04-20T10:54:41.103 INFO:tasks.workunit.client.0.smithi090.stdout:4/293: mknod d7/d9/d47/c5b 0 2024-04-20T10:54:41.104 INFO:tasks.workunit.client.0.smithi090.stdout:7/401: creat d11/d13/d5d/d65/f8b x:0 0 0 2024-04-20T10:54:41.104 INFO:tasks.workunit.client.0.smithi090.stdout:0/376: creat d14/d19/d2b/d61/f72 x:0 0 0 2024-04-20T10:54:41.106 INFO:tasks.workunit.client.0.smithi090.stdout:2/387: mkdir d11/d1a/d37/d85/d87 0 2024-04-20T10:54:41.107 INFO:tasks.workunit.client.0.smithi090.stdout:3/357: creat d7/d43/f76 x:0 0 0 2024-04-20T10:54:41.107 INFO:tasks.workunit.client.0.smithi090.stdout:5/569: mknod d1/d2f/d3d/d40/d6c/cc6 0 2024-04-20T10:54:41.108 INFO:tasks.workunit.client.0.smithi090.stdout:5/570: write d1/da/f1e [3313299,15676] 0 2024-04-20T10:54:41.108 INFO:tasks.workunit.client.0.smithi090.stdout:7/402: truncate f4 3746679 0 2024-04-20T10:54:41.110 INFO:tasks.workunit.client.0.smithi090.stdout:0/377: mkdir d14/d19/d2b/d66/d43/d73 0 2024-04-20T10:54:41.111 INFO:tasks.workunit.client.0.smithi090.stdout:2/388: rmdir d11/d1a/d30 39 2024-04-20T10:54:41.113 INFO:tasks.workunit.client.0.smithi090.stdout:5/571: creat d1/da/d1f/dad/fc7 x:0 0 0 2024-04-20T10:54:41.115 INFO:tasks.workunit.client.0.smithi090.stdout:0/378: creat d14/d19/d31/d34/d3b/f74 x:0 0 0 2024-04-20T10:54:41.115 INFO:tasks.workunit.client.0.smithi090.stdout:0/379: write d14/f2a [214671,24792] 0 2024-04-20T10:54:41.116 INFO:tasks.workunit.client.0.smithi090.stdout:2/389: getdents d11/d1a/d4a/d55 0 2024-04-20T10:54:41.116 INFO:tasks.workunit.client.0.smithi090.stdout:2/390: write d11/d1f/d2e/f5b [155140,15766] 0 2024-04-20T10:54:41.118 INFO:tasks.workunit.client.0.smithi090.stdout:0/380: rename d14/d19/d2c/f2d to d14/d19/d2c/f75 0 2024-04-20T10:54:41.119 INFO:tasks.workunit.client.0.smithi090.stdout:1/361: sync 2024-04-20T10:54:41.119 INFO:tasks.workunit.client.0.smithi090.stdout:8/370: sync 2024-04-20T10:54:41.119 INFO:tasks.workunit.client.0.smithi090.stdout:9/370: sync 2024-04-20T10:54:41.120 INFO:tasks.workunit.client.0.smithi090.stdout:6/317: sync 2024-04-20T10:54:41.120 INFO:tasks.workunit.client.0.smithi090.stdout:1/362: fdatasync d8/fe 0 2024-04-20T10:54:41.120 INFO:tasks.workunit.client.0.smithi090.stdout:6/318: stat d1/d19/f2d 0 2024-04-20T10:54:41.120 INFO:tasks.workunit.client.0.smithi090.stdout:6/319: write d1/d19/f59 [593489,1699] 0 2024-04-20T10:54:41.121 INFO:tasks.workunit.client.0.smithi090.stdout:2/391: rename d11/f62 to d11/d1f/d2e/f88 0 2024-04-20T10:54:41.124 INFO:tasks.workunit.client.0.smithi090.stdout:0/381: unlink d14/d19/d31/d34/d3b/c48 0 2024-04-20T10:54:41.124 INFO:tasks.workunit.client.0.smithi090.stdout:0/382: write d14/d19/d2b/f3d [123002,95255] 0 2024-04-20T10:54:41.124 INFO:tasks.workunit.client.0.smithi090.stdout:0/383: dread - d14/d19/d2b/d66/f4f zero size 2024-04-20T10:54:41.124 INFO:tasks.workunit.client.0.smithi090.stdout:4/294: dwrite d7/d9/f39 [4194304,4194304] 0 2024-04-20T10:54:41.126 INFO:tasks.workunit.client.0.smithi090.stdout:8/371: link d0/f36 d0/d26/f78 0 2024-04-20T10:54:41.127 INFO:tasks.workunit.client.0.smithi090.stdout:1/363: link d8/d1a/d45/f4f d8/d1a/d1d/d2c/d6e/f72 0 2024-04-20T10:54:41.129 INFO:tasks.workunit.client.0.smithi090.stdout:9/371: mknod d0/d29/d36/d63/d1f/d34/d70/c7a 0 2024-04-20T10:54:41.129 INFO:tasks.workunit.client.0.smithi090.stdout:9/372: stat d0/d29/d36/d63/d1f/d34/d70/d52/f4c 0 2024-04-20T10:54:41.131 INFO:tasks.workunit.client.0.smithi090.stdout:2/392: creat d11/d1f/d2e/f89 x:0 0 0 2024-04-20T10:54:41.131 INFO:tasks.workunit.client.0.smithi090.stdout:0/384: mknod d14/d19/d2b/d66/d43/d5c/c76 0 2024-04-20T10:54:41.133 INFO:tasks.workunit.client.0.smithi090.stdout:4/295: truncate d7/d9/f4a 678670 0 2024-04-20T10:54:41.134 INFO:tasks.workunit.client.0.smithi090.stdout:8/372: creat d0/f79 x:0 0 0 2024-04-20T10:54:41.135 INFO:tasks.workunit.client.0.smithi090.stdout:0/385: symlink d14/d19/d2b/d66/d43/d5c/d70/l77 0 2024-04-20T10:54:41.136 INFO:tasks.workunit.client.0.smithi090.stdout:7/403: dwrite d11/d1a/f46 [4194304,4194304] 0 2024-04-20T10:54:41.136 INFO:tasks.workunit.client.0.smithi090.stdout:7/404: chown d11/d13/d33/d44 204 1 2024-04-20T10:54:41.136 INFO:tasks.workunit.client.0.smithi090.stdout:7/405: chown d11/d13/d22/f34 408854668 1 2024-04-20T10:54:41.136 INFO:tasks.workunit.client.0.smithi090.stdout:4/296: symlink d7/d9/d30/d3d/l5c 0 2024-04-20T10:54:41.138 INFO:tasks.workunit.client.0.smithi090.stdout:7/406: unlink d11/d1a/d3b/d79/c67 0 2024-04-20T10:54:41.138 INFO:tasks.workunit.client.0.smithi090.stdout:7/407: chown d11/d13/l53 93654 1 2024-04-20T10:54:41.138 INFO:tasks.workunit.client.0.smithi090.stdout:7/408: chown d11/d1a/f40 587378 1 2024-04-20T10:54:41.139 INFO:tasks.workunit.client.0.smithi090.stdout:0/386: write d14/f5f [3093653,91643] 0 2024-04-20T10:54:41.139 INFO:tasks.workunit.client.0.smithi090.stdout:4/297: symlink d7/d9/d47/l5d 0 2024-04-20T10:54:41.140 INFO:tasks.workunit.client.0.smithi090.stdout:7/409: creat d11/d13/f8c x:0 0 0 2024-04-20T10:54:41.140 INFO:tasks.workunit.client.0.smithi090.stdout:5/572: dwrite d1/d2f/d85/dbd/f64 [0,4194304] 0 2024-04-20T10:54:41.140 INFO:tasks.workunit.client.0.smithi090.stdout:5/573: write d1/d2a/f9c [192044,31853] 0 2024-04-20T10:54:41.141 INFO:tasks.workunit.client.0.smithi090.stdout:0/387: creat d14/d19/f78 x:0 0 0 2024-04-20T10:54:41.142 INFO:tasks.workunit.client.0.smithi090.stdout:4/298: mknod d7/d9/d17/c5e 0 2024-04-20T10:54:41.144 INFO:tasks.workunit.client.0.smithi090.stdout:7/410: link f0 d11/d1a/d3b/d79/f8d 0 2024-04-20T10:54:41.144 INFO:tasks.workunit.client.0.smithi090.stdout:7/411: truncate d11/d13/d22/d24/d35/f47 4942533 0 2024-04-20T10:54:41.145 INFO:tasks.workunit.client.0.smithi090.stdout:1/364: dread f5 [0,4194304] 0 2024-04-20T10:54:41.145 INFO:tasks.workunit.client.0.smithi090.stdout:5/574: mkdir d1/da/d1f/dad/dc8 0 2024-04-20T10:54:41.145 INFO:tasks.workunit.client.0.smithi090.stdout:7/412: truncate d11/d1a/f76 3152210 0 2024-04-20T10:54:41.145 INFO:tasks.workunit.client.0.smithi090.stdout:7/413: write d11/d13/d23/d6c/d72/f84 [438259,92890] 0 2024-04-20T10:54:41.146 INFO:tasks.workunit.client.0.smithi090.stdout:1/365: mknod d8/d1a/d1d/d67/d31/c73 0 2024-04-20T10:54:41.147 INFO:tasks.workunit.client.0.smithi090.stdout:5/575: mknod d1/da/cc9 0 2024-04-20T10:54:41.147 INFO:tasks.workunit.client.0.smithi090.stdout:5/576: readlink d1/d2f/d3d/d40/d70/l99 0 2024-04-20T10:54:41.148 INFO:tasks.workunit.client.0.smithi090.stdout:7/414: rename d11/d13/d22/d27/c4f to d11/d13/d22/d27/c8e 0 2024-04-20T10:54:41.149 INFO:tasks.workunit.client.0.smithi090.stdout:1/366: unlink d8/d1a/d4d/l55 0 2024-04-20T10:54:41.150 INFO:tasks.workunit.client.0.smithi090.stdout:4/299: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:41.151 INFO:tasks.workunit.client.0.smithi090.stdout:1/367: creat d8/d1a/f74 x:0 0 0 2024-04-20T10:54:41.152 INFO:tasks.workunit.client.0.smithi090.stdout:4/300: truncate d7/d9/f35 4442130 0 2024-04-20T10:54:41.152 INFO:tasks.workunit.client.0.smithi090.stdout:4/301: fdatasync d7/f3c 0 2024-04-20T10:54:41.152 INFO:tasks.workunit.client.0.smithi090.stdout:5/577: dread d1/d2f/f44 [0,4194304] 0 2024-04-20T10:54:41.152 INFO:tasks.workunit.client.0.smithi090.stdout:1/368: rmdir d8/d1a/d4d 39 2024-04-20T10:54:41.152 INFO:tasks.workunit.client.0.smithi090.stdout:1/369: truncate d8/f54 725606 0 2024-04-20T10:54:41.153 INFO:tasks.workunit.client.0.smithi090.stdout:1/370: chown d8/c5b 0 1 2024-04-20T10:54:41.154 INFO:tasks.workunit.client.0.smithi090.stdout:5/578: creat d1/d2f/d3d/d40/d6c/fca x:0 0 0 2024-04-20T10:54:41.155 INFO:tasks.workunit.client.0.smithi090.stdout:5/579: rmdir d1/da/d14/d47 39 2024-04-20T10:54:41.156 INFO:tasks.workunit.client.0.smithi090.stdout:4/302: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:41.156 INFO:tasks.workunit.client.0.smithi090.stdout:4/303: dread - d7/f2c zero size 2024-04-20T10:54:41.156 INFO:tasks.workunit.client.0.smithi090.stdout:5/580: link d1/f58 d1/d2f/d3d/d40/d6c/fcb 0 2024-04-20T10:54:41.157 INFO:tasks.workunit.client.0.smithi090.stdout:5/581: creat d1/da/d1f/dad/fcc x:0 0 0 2024-04-20T10:54:41.158 INFO:tasks.workunit.client.0.smithi090.stdout:5/582: mknod d1/d41/ccd 0 2024-04-20T10:54:41.158 INFO:tasks.workunit.client.0.smithi090.stdout:5/583: chown d1/da/d16/c4e 94318 1 2024-04-20T10:54:41.158 INFO:tasks.workunit.client.0.smithi090.stdout:5/584: stat d1/d2f/d3d/d40/d70/fbb 0 2024-04-20T10:54:41.158 INFO:tasks.workunit.client.0.smithi090.stdout:5/585: chown d1/d2f/d85/c8c 14 1 2024-04-20T10:54:41.159 INFO:tasks.workunit.client.0.smithi090.stdout:5/586: mkdir d1/da/dce 0 2024-04-20T10:54:41.159 INFO:tasks.workunit.client.0.smithi090.stdout:5/587: readlink d1/d2f/d3d/d40/d70/l99 0 2024-04-20T10:54:41.159 INFO:tasks.workunit.client.0.smithi090.stdout:1/371: dread d8/d1a/d1d/d2c/d3f/f5f [0,4194304] 0 2024-04-20T10:54:41.159 INFO:tasks.workunit.client.0.smithi090.stdout:5/588: rename d1/da/d14/d47/d39 to d1/de/dcf 0 2024-04-20T10:54:41.161 INFO:tasks.workunit.client.0.smithi090.stdout:1/372: mkdir d8/d1a/d1d/d2c/d62/d75 0 2024-04-20T10:54:41.166 INFO:tasks.workunit.client.0.smithi090.stdout:0/388: fdatasync f11 0 2024-04-20T10:54:41.166 INFO:tasks.workunit.client.0.smithi090.stdout:0/389: write d14/d19/f71 [504559,123052] 0 2024-04-20T10:54:41.167 INFO:tasks.workunit.client.0.smithi090.stdout:6/320: dwrite d1/d19/d36/f27 [0,4194304] 0 2024-04-20T10:54:41.168 INFO:tasks.workunit.client.0.smithi090.stdout:3/358: dwrite d7/d15/d2a/f67 [0,4194304] 0 2024-04-20T10:54:41.171 INFO:tasks.workunit.client.0.smithi090.stdout:2/393: dwrite d11/d1f/f27 [0,4194304] 0 2024-04-20T10:54:41.171 INFO:tasks.workunit.client.0.smithi090.stdout:3/359: dread d7/d43/f59 [0,4194304] 0 2024-04-20T10:54:41.172 INFO:tasks.workunit.client.0.smithi090.stdout:6/321: mkdir d1/d4/d26/d11/d4a/d6b 0 2024-04-20T10:54:41.172 INFO:tasks.workunit.client.0.smithi090.stdout:6/322: chown d1/d19/d36/d1e/d1f/l48 1 1 2024-04-20T10:54:41.178 INFO:tasks.workunit.client.0.smithi090.stdout:5/589: dwrite d1/da/f2c [0,4194304] 0 2024-04-20T10:54:41.179 INFO:tasks.workunit.client.0.smithi090.stdout:2/394: mknod d11/d1f/d2e/d6e/c8a 0 2024-04-20T10:54:41.179 INFO:tasks.workunit.client.0.smithi090.stdout:3/360: mknod d7/d43/c77 0 2024-04-20T10:54:41.184 INFO:tasks.workunit.client.0.smithi090.stdout:5/590: creat d1/da/d1f/dad/fd0 x:0 0 0 2024-04-20T10:54:41.185 INFO:tasks.workunit.client.0.smithi090.stdout:2/395: unlink d11/d1f/d2e/l39 0 2024-04-20T10:54:41.188 INFO:tasks.workunit.client.0.smithi090.stdout:8/373: dwrite d0/f63 [0,4194304] 0 2024-04-20T10:54:41.188 INFO:tasks.workunit.client.0.smithi090.stdout:4/304: dwrite d7/d9/f39 [4194304,4194304] 0 2024-04-20T10:54:41.188 INFO:tasks.workunit.client.0.smithi090.stdout:4/305: dread - d7/d9/f1c zero size 2024-04-20T10:54:41.188 INFO:tasks.workunit.client.0.smithi090.stdout:5/591: link d1/de/l31 d1/d2f/d3d/d40/ld1 0 2024-04-20T10:54:41.188 INFO:tasks.workunit.client.0.smithi090.stdout:5/592: read d1/de/d96/fa5 [268009,52311] 0 2024-04-20T10:54:41.193 INFO:tasks.workunit.client.0.smithi090.stdout:8/374: symlink d0/d11/d14/l7a 0 2024-04-20T10:54:41.255 INFO:tasks.workunit.client.0.smithi090.stdout:8/375: write d0/d26/f55 [521497,60863] 0 2024-04-20T10:54:41.255 INFO:tasks.workunit.client.0.smithi090.stdout:6/323: dread d1/d4/d26/d11/f17 [0,4194304] 0 2024-04-20T10:54:41.268 INFO:tasks.workunit.client.0.smithi090.stdout:1/373: getdents d8/d1a/d1d/d67/d31 0 2024-04-20T10:54:41.269 INFO:tasks.workunit.client.0.smithi090.stdout:3/361: dwrite d7/fc [0,4194304] 0 2024-04-20T10:54:41.269 INFO:tasks.workunit.client.0.smithi090.stdout:3/362: chown d7/d11/c1f 3 1 2024-04-20T10:54:41.269 INFO:tasks.workunit.client.0.smithi090.stdout:4/306: symlink d7/l5f 0 2024-04-20T10:54:41.269 INFO:tasks.workunit.client.0.smithi090.stdout:4/307: read - d7/d9/f1c zero size 2024-04-20T10:54:41.269 INFO:tasks.workunit.client.0.smithi090.stdout:4/308: write d7/fb [2411419,56594] 0 2024-04-20T10:54:41.269 INFO:tasks.workunit.client.0.smithi090.stdout:3/363: write d7/df/d2c/f50 [818181,64504] 0 2024-04-20T10:54:41.270 INFO:tasks.workunit.client.0.smithi090.stdout:5/593: unlink d1/d2f/d3d/d40/d6c/fca 0 2024-04-20T10:54:41.270 INFO:tasks.workunit.client.0.smithi090.stdout:8/376: mknod d0/d11/d22/c7b 0 2024-04-20T10:54:41.270 INFO:tasks.workunit.client.0.smithi090.stdout:7/415: dread d11/d1a/f76 [0,4194304] 0 2024-04-20T10:54:41.270 INFO:tasks.workunit.client.0.smithi090.stdout:6/324: mknod d1/d19/d36/c6c 0 2024-04-20T10:54:41.270 INFO:tasks.workunit.client.0.smithi090.stdout:6/325: dread d1/d4/f46 [0,4194304] 0 2024-04-20T10:54:41.270 INFO:tasks.workunit.client.0.smithi090.stdout:1/374: mknod d8/d1a/d1d/d67/c76 0 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:4/309: creat d7/d9/d30/d3d/f60 x:0 0 0 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:4/310: write d7/d9/d30/d3d/f60 [519856,15497] 0 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:4/311: fsync d7/d9/d17/f2b 0 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:4/312: chown d7/d9 225578108 1 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:3/364: mkdir d7/d26/d78 0 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:5/594: dread d1/da/f2c [0,4194304] 0 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:8/377: creat d0/d11/d14/f7c x:0 0 0 2024-04-20T10:54:41.271 INFO:tasks.workunit.client.0.smithi090.stdout:8/378: stat d0/d2d 0 2024-04-20T10:54:41.272 INFO:tasks.workunit.client.0.smithi090.stdout:6/326: mknod d1/d19/d36/c6d 0 2024-04-20T10:54:41.272 INFO:tasks.workunit.client.0.smithi090.stdout:4/313: dread d7/d9/f20 [0,4194304] 0 2024-04-20T10:54:41.272 INFO:tasks.workunit.client.0.smithi090.stdout:1/375: symlink d8/d1a/d45/l77 0 2024-04-20T10:54:41.272 INFO:tasks.workunit.client.0.smithi090.stdout:8/379: creat d0/d11/d22/d53/d57/f7d x:0 0 0 2024-04-20T10:54:41.272 INFO:tasks.workunit.client.0.smithi090.stdout:4/314: creat d7/d9/d30/d3d/f61 x:0 0 0 2024-04-20T10:54:41.272 INFO:tasks.workunit.client.0.smithi090.stdout:1/376: rename d8/f1f to d8/d1a/d1d/d2c/d62/f78 0 2024-04-20T10:54:41.272 INFO:tasks.workunit.client.0.smithi090.stdout:5/595: mkdir d1/d2f/d3d/d40/d6c/dd2 0 2024-04-20T10:54:41.273 INFO:tasks.workunit.client.0.smithi090.stdout:5/596: fsync d1/d2f/fc4 0 2024-04-20T10:54:41.273 INFO:tasks.workunit.client.0.smithi090.stdout:4/315: creat d7/d9/f62 x:0 0 0 2024-04-20T10:54:41.273 INFO:tasks.workunit.client.0.smithi090.stdout:1/377: mknod d8/d1a/d1d/c79 0 2024-04-20T10:54:41.273 INFO:tasks.workunit.client.0.smithi090.stdout:1/378: write d8/d1a/d1d/d67/d31/d5d/f5e [391361,41592] 0 2024-04-20T10:54:41.273 INFO:tasks.workunit.client.0.smithi090.stdout:1/379: fdatasync d8/d1a/d1d/d2c/d3f/f5f 0 2024-04-20T10:54:41.273 INFO:tasks.workunit.client.0.smithi090.stdout:5/597: creat d1/d2f/d3d/d40/d89/fd3 x:0 0 0 2024-04-20T10:54:41.273 INFO:tasks.workunit.client.0.smithi090.stdout:1/380: dread d8/f44 [0,4194304] 0 2024-04-20T10:54:41.274 INFO:tasks.workunit.client.0.smithi090.stdout:5/598: mknod d1/cd4 0 2024-04-20T10:54:41.274 INFO:tasks.workunit.client.0.smithi090.stdout:1/381: mkdir d8/d1a/d1d/d7a 0 2024-04-20T10:54:41.274 INFO:tasks.workunit.client.0.smithi090.stdout:5/599: truncate d1/de/f57 2835195 0 2024-04-20T10:54:41.274 INFO:tasks.workunit.client.0.smithi090.stdout:5/600: fdatasync d1/da/f1e 0 2024-04-20T10:54:41.274 INFO:tasks.workunit.client.0.smithi090.stdout:5/601: chown d1/d2f/d85/dbd/c71 9543 1 2024-04-20T10:54:41.274 INFO:tasks.workunit.client.0.smithi090.stdout:5/602: creat d1/d2f/d85/fd5 x:0 0 0 2024-04-20T10:54:41.274 INFO:tasks.workunit.client.0.smithi090.stdout:5/603: dread - d1/de/dcf/fba zero size 2024-04-20T10:54:41.275 INFO:tasks.workunit.client.0.smithi090.stdout:3/365: dwrite d7/f37 [0,4194304] 0 2024-04-20T10:54:41.275 INFO:tasks.workunit.client.0.smithi090.stdout:6/327: dwrite d1/d19/d36/f27 [0,4194304] 0 2024-04-20T10:54:41.275 INFO:tasks.workunit.client.0.smithi090.stdout:3/366: link d7/d15/d47/d56/f54 d7/f79 0 2024-04-20T10:54:41.275 INFO:tasks.workunit.client.0.smithi090.stdout:3/367: fdatasync d7/d15/d2a/f58 0 2024-04-20T10:54:41.275 INFO:tasks.workunit.client.0.smithi090.stdout:3/368: fsync d7/d15/d2a/d30/f4c 0 2024-04-20T10:54:41.275 INFO:tasks.workunit.client.0.smithi090.stdout:1/382: write d8/d1a/d1d/d2c/f64 [761028,56144] 0 2024-04-20T10:54:41.275 INFO:tasks.workunit.client.0.smithi090.stdout:6/328: read d1/d4/d26/d11/f17 [1940662,56814] 0 2024-04-20T10:54:41.276 INFO:tasks.workunit.client.0.smithi090.stdout:1/383: mkdir d8/d1a/d1d/d2c/d4a/d7b 0 2024-04-20T10:54:41.276 INFO:tasks.workunit.client.0.smithi090.stdout:6/329: mknod d1/d10/c6e 0 2024-04-20T10:54:41.276 INFO:tasks.workunit.client.0.smithi090.stdout:6/330: write d1/f65 [999436,68477] 0 2024-04-20T10:54:41.276 INFO:tasks.workunit.client.0.smithi090.stdout:6/331: truncate d1/d19/d36/d1e/d1f/d3f/f4b 1332376 0 2024-04-20T10:54:41.276 INFO:tasks.workunit.client.0.smithi090.stdout:1/384: link d8/d1a/f74 d8/d1a/d45/f7c 0 2024-04-20T10:54:41.276 INFO:tasks.workunit.client.0.smithi090.stdout:1/385: symlink d8/d1a/d1d/d2c/d4a/d5a/l7d 0 2024-04-20T10:54:41.276 INFO:tasks.workunit.client.0.smithi090.stdout:5/604: dwrite d1/da/d1f/dad/fd0 [0,4194304] 0 2024-04-20T10:54:41.277 INFO:tasks.workunit.client.0.smithi090.stdout:5/605: getdents d1/da 0 2024-04-20T10:54:41.277 INFO:tasks.workunit.client.0.smithi090.stdout:4/316: rename d7/d9/d30 to d7/d9/d47/d63 0 2024-04-20T10:54:41.277 INFO:tasks.workunit.client.0.smithi090.stdout:4/317: write d7/d9/d17/f18 [1004682,32176] 0 2024-04-20T10:54:41.277 INFO:tasks.workunit.client.0.smithi090.stdout:5/606: creat d1/d2f/d3d/d40/d70/fd6 x:0 0 0 2024-04-20T10:54:41.277 INFO:tasks.workunit.client.0.smithi090.stdout:5/607: write d1/f58 [1096223,48992] 0 2024-04-20T10:54:41.277 INFO:tasks.workunit.client.0.smithi090.stdout:4/318: rmdir d7/d9 39 2024-04-20T10:54:41.277 INFO:tasks.workunit.client.0.smithi090.stdout:4/319: write d7/d9/f62 [155609,55989] 0 2024-04-20T10:54:41.278 INFO:tasks.workunit.client.0.smithi090.stdout:4/320: fdatasync d7/d9/f19 0 2024-04-20T10:54:41.278 INFO:tasks.workunit.client.0.smithi090.stdout:5/608: symlink d1/da/d1f/da4/ld7 0 2024-04-20T10:54:41.278 INFO:tasks.workunit.client.0.smithi090.stdout:5/609: readlink d1/da/d1f/l7d 0 2024-04-20T10:54:41.278 INFO:tasks.workunit.client.0.smithi090.stdout:4/321: getdents d7/d9/d47/d63 0 2024-04-20T10:54:41.278 INFO:tasks.workunit.client.0.smithi090.stdout:4/322: rename d7/f3c to d7/d9/d47/d63/d42/f64 0 2024-04-20T10:54:41.278 INFO:tasks.workunit.client.0.smithi090.stdout:5/610: symlink d1/d2f/d3d/d40/d6c/ld8 0 2024-04-20T10:54:41.278 INFO:tasks.workunit.client.0.smithi090.stdout:4/323: unlink d7/d9/d47/d63/l40 0 2024-04-20T10:54:41.279 INFO:tasks.workunit.client.0.smithi090.stdout:4/324: stat d7/f52 0 2024-04-20T10:54:41.279 INFO:tasks.workunit.client.0.smithi090.stdout:1/386: dwrite d8/f6a [0,4194304] 0 2024-04-20T10:54:41.279 INFO:tasks.workunit.client.0.smithi090.stdout:6/332: dwrite d1/f65 [0,4194304] 0 2024-04-20T10:54:41.279 INFO:tasks.workunit.client.0.smithi090.stdout:6/333: mkdir d1/d4/d26/d11/d4a/d6b/d6f 0 2024-04-20T10:54:41.281 INFO:tasks.workunit.client.0.smithi090.stdout:1/387: creat d8/d1a/d1d/d2c/d3f/f7e x:0 0 0 2024-04-20T10:54:41.281 INFO:tasks.workunit.client.0.smithi090.stdout:1/388: dread - d8/d1a/d1d/f27 zero size 2024-04-20T10:54:41.282 INFO:tasks.workunit.client.0.smithi090.stdout:6/334: mkdir d1/d4/d26/d11/d4a/d70 0 2024-04-20T10:54:41.282 INFO:tasks.workunit.client.0.smithi090.stdout:6/335: creat d1/d4/d26/d11/f71 x:0 0 0 2024-04-20T10:54:41.282 INFO:tasks.workunit.client.0.smithi090.stdout:6/336: dread d1/d4/f46 [0,4194304] 0 2024-04-20T10:54:41.282 INFO:tasks.workunit.client.0.smithi090.stdout:6/337: fdatasync d1/d19/f57 0 2024-04-20T10:54:41.282 INFO:tasks.workunit.client.0.smithi090.stdout:4/325: dwrite d7/f2c [0,4194304] 0 2024-04-20T10:54:41.282 INFO:tasks.workunit.client.0.smithi090.stdout:4/326: rmdir d7 39 2024-04-20T10:54:41.282 INFO:tasks.workunit.client.0.smithi090.stdout:4/327: dread - d7/d9/d47/d63/d3d/f61 zero size 2024-04-20T10:54:41.283 INFO:tasks.workunit.client.0.smithi090.stdout:4/328: symlink d7/d9/l65 0 2024-04-20T10:54:41.283 INFO:tasks.workunit.client.0.smithi090.stdout:4/329: readlink d7/d9/d17/l2d 0 2024-04-20T10:54:41.283 INFO:tasks.workunit.client.0.smithi090.stdout:4/330: stat d7/d9/d47 0 2024-04-20T10:54:41.283 INFO:tasks.workunit.client.0.smithi090.stdout:4/331: chown l6 4466822 1 2024-04-20T10:54:41.284 INFO:tasks.workunit.client.0.smithi090.stdout:4/332: mkdir d7/d9/d17/d56/d66 0 2024-04-20T10:54:41.284 INFO:tasks.workunit.client.0.smithi090.stdout:4/333: unlink d7/d9/c28 0 2024-04-20T10:54:41.285 INFO:tasks.workunit.client.0.smithi090.stdout:4/334: creat d7/d9/d47/d63/d42/f67 x:0 0 0 2024-04-20T10:54:41.285 INFO:tasks.workunit.client.0.smithi090.stdout:4/335: mknod d7/d9/d47/d63/d42/c68 0 2024-04-20T10:54:41.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/389: dwrite d8/f6a [0,4194304] 0 2024-04-20T10:54:41.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/390: dread - d8/d1a/d1d/d2c/d3f/f7e zero size 2024-04-20T10:54:41.288 INFO:tasks.workunit.client.0.smithi090.stdout:1/391: truncate d8/f54 267443 0 2024-04-20T10:54:41.289 INFO:tasks.workunit.client.0.smithi090.stdout:6/338: dwrite d1/d19/d36/d1e/f58 [0,4194304] 0 2024-04-20T10:54:41.291 INFO:tasks.workunit.client.0.smithi090.stdout:1/392: creat d8/f7f x:0 0 0 2024-04-20T10:54:41.291 INFO:tasks.workunit.client.0.smithi090.stdout:6/339: stat d1/d19/c6a 0 2024-04-20T10:54:41.291 INFO:tasks.workunit.client.0.smithi090.stdout:1/393: rmdir d8/d1a/d1d 39 2024-04-20T10:54:41.291 INFO:tasks.workunit.client.0.smithi090.stdout:1/394: truncate d8/f2a 2120978 0 2024-04-20T10:54:41.292 INFO:tasks.workunit.client.0.smithi090.stdout:6/340: creat d1/d4/d26/d11/d4a/d70/f72 x:0 0 0 2024-04-20T10:54:41.294 INFO:tasks.workunit.client.0.smithi090.stdout:1/395: rename d8/f3e to d8/f80 0 2024-04-20T10:54:41.294 INFO:tasks.workunit.client.0.smithi090.stdout:1/396: chown d8/fb 3 1 2024-04-20T10:54:41.295 INFO:tasks.workunit.client.0.smithi090.stdout:1/397: creat d8/d1a/d1d/d2c/d4a/d5a/f81 x:0 0 0 2024-04-20T10:54:41.296 INFO:tasks.workunit.client.0.smithi090.stdout:1/398: creat d8/d1a/d1d/d67/f82 x:0 0 0 2024-04-20T10:54:41.298 INFO:tasks.workunit.client.0.smithi090.stdout:1/399: rename d8/ca to d8/d1a/d1d/d2c/d4a/c83 0 2024-04-20T10:54:41.298 INFO:tasks.workunit.client.0.smithi090.stdout:1/400: chown d8/d1a/d1d/d67/d31/c73 86 1 2024-04-20T10:54:41.299 INFO:tasks.workunit.client.0.smithi090.stdout:1/401: dread - d8/d1a/d1d/d2c/d3f/f53 zero size 2024-04-20T10:54:41.300 INFO:tasks.workunit.client.0.smithi090.stdout:1/402: creat d8/d1a/d1d/d2c/d6e/f84 x:0 0 0 2024-04-20T10:54:41.300 INFO:tasks.workunit.client.0.smithi090.stdout:4/336: dwrite d7/f26 [0,4194304] 0 2024-04-20T10:54:41.300 INFO:tasks.workunit.client.0.smithi090.stdout:4/337: chown d7/d9/d47/c51 2 1 2024-04-20T10:54:41.301 INFO:tasks.workunit.client.0.smithi090.stdout:1/403: unlink d8/f2a 0 2024-04-20T10:54:41.301 INFO:tasks.workunit.client.0.smithi090.stdout:1/404: chown d8/d1a/d1d/d2c/d4a/d5a/f69 12665088 1 2024-04-20T10:54:41.302 INFO:tasks.workunit.client.0.smithi090.stdout:4/338: write d7/f52 [506696,122835] 0 2024-04-20T10:54:41.303 INFO:tasks.workunit.client.0.smithi090.stdout:1/405: symlink d8/d1a/d1d/d67/d31/l85 0 2024-04-20T10:54:41.304 INFO:tasks.workunit.client.0.smithi090.stdout:1/406: creat d8/d1a/d1d/d2c/d3f/f86 x:0 0 0 2024-04-20T10:54:41.304 INFO:tasks.workunit.client.0.smithi090.stdout:1/407: truncate d8/f7f 251952 0 2024-04-20T10:54:41.305 INFO:tasks.workunit.client.0.smithi090.stdout:1/408: creat d8/d1a/d1d/d2c/d3f/f87 x:0 0 0 2024-04-20T10:54:41.307 INFO:tasks.workunit.client.0.smithi090.stdout:1/409: symlink d8/d1a/d1d/d2c/d4a/d7b/l88 0 2024-04-20T10:54:41.308 INFO:tasks.workunit.client.0.smithi090.stdout:1/410: creat d8/d1a/f89 x:0 0 0 2024-04-20T10:54:41.308 INFO:tasks.workunit.client.0.smithi090.stdout:6/341: dwrite d1/d4/d26/d11/d4a/d56/f61 [0,4194304] 0 2024-04-20T10:54:41.308 INFO:tasks.workunit.client.0.smithi090.stdout:6/342: dread - d1/d19/d36/d1e/d1f/d3f/d54/f5d zero size 2024-04-20T10:54:41.308 INFO:tasks.workunit.client.0.smithi090.stdout:6/343: stat d1/d4/d26/d11/d4a/d56 0 2024-04-20T10:54:41.309 INFO:tasks.workunit.client.0.smithi090.stdout:1/411: rmdir d8/d1a/d1d/d2c/d62/d75 0 2024-04-20T10:54:41.309 INFO:tasks.workunit.client.0.smithi090.stdout:1/412: write d8/d1a/d1d/d67/f3d [476498,88540] 0 2024-04-20T10:54:41.309 INFO:tasks.workunit.client.0.smithi090.stdout:1/413: chown d8/d1a/f74 9231594 1 2024-04-20T10:54:41.311 INFO:tasks.workunit.client.0.smithi090.stdout:1/414: write d8/f2d [4465957,117771] 0 2024-04-20T10:54:41.313 INFO:tasks.workunit.client.0.smithi090.stdout:1/415: link d8/d1a/d1d/c79 d8/c8a 0 2024-04-20T10:54:41.316 INFO:tasks.workunit.client.0.smithi090.stdout:1/416: dread d8/d1a/d45/f4b [0,4194304] 0 2024-04-20T10:54:41.322 INFO:tasks.workunit.client.0.smithi090.stdout:4/339: dwrite d7/d9/d47/d63/f34 [0,4194304] 0 2024-04-20T10:54:41.326 INFO:tasks.workunit.client.0.smithi090.stdout:6/344: dwrite d1/d4/d26/d11/d4a/d70/f72 [0,4194304] 0 2024-04-20T10:54:41.330 INFO:tasks.workunit.client.0.smithi090.stdout:4/340: write d7/f26 [2203441,51048] 0 2024-04-20T10:54:41.331 INFO:tasks.workunit.client.0.smithi090.stdout:6/345: creat d1/d19/d36/d28/f73 x:0 0 0 2024-04-20T10:54:41.332 INFO:tasks.workunit.client.0.smithi090.stdout:6/346: rmdir d1/d4 39 2024-04-20T10:54:41.345 INFO:tasks.workunit.client.0.smithi090.stdout:1/417: dwrite d8/d1a/d1d/d67/d31/f57 [0,4194304] 0 2024-04-20T10:54:41.360 INFO:tasks.workunit.client.0.smithi090.stdout:4/341: dwrite d7/d9/f4a [0,4194304] 0 2024-04-20T10:54:41.360 INFO:tasks.workunit.client.0.smithi090.stdout:4/342: chown d7/d9/d17/c5e 19823 1 2024-04-20T10:54:41.360 INFO:tasks.workunit.client.0.smithi090.stdout:6/347: dwrite d1/d19/f2d [0,4194304] 0 2024-04-20T10:54:41.360 INFO:tasks.workunit.client.0.smithi090.stdout:6/348: write d1/d4/f66 [109510,16856] 0 2024-04-20T10:54:41.376 INFO:tasks.workunit.client.0.smithi090.stdout:6/349: dwrite d1/d19/d36/d1e/f58 [4194304,4194304] 0 2024-04-20T10:54:41.558 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:41.599 INFO:tasks.workunit.client.0.smithi090.stdout:1/418: getdents d8/d1a/d45 0 2024-04-20T10:54:41.599 INFO:tasks.workunit.client.0.smithi090.stdout:1/419: readlink d8/d1a/d4d/l6d 0 2024-04-20T10:54:41.599 INFO:tasks.workunit.client.0.smithi090.stdout:1/420: stat d8/l14 0 2024-04-20T10:54:41.599 INFO:tasks.workunit.client.0.smithi090.stdout:1/421: dread - d8/f59 zero size 2024-04-20T10:54:41.599 INFO:tasks.workunit.client.0.smithi090.stdout:4/343: mknod d7/d9/d17/c69 0 2024-04-20T10:54:41.601 INFO:tasks.workunit.client.0.smithi090.stdout:6/350: mkdir d1/d19/d36/d1e/d74 0 2024-04-20T10:54:41.605 INFO:tasks.workunit.client.0.smithi090.stdout:1/422: creat d8/d1a/d1d/d2c/d4a/f8b x:0 0 0 2024-04-20T10:54:41.605 INFO:tasks.workunit.client.0.smithi090.stdout:1/423: dread - d8/d1a/d1d/d2c/d4a/d5a/f69 zero size 2024-04-20T10:54:41.605 INFO:tasks.workunit.client.0.smithi090.stdout:1/424: rmdir d8/d1a/d1d/d2c/d4a 39 2024-04-20T10:54:41.606 INFO:tasks.workunit.client.0.smithi090.stdout:1/425: symlink d8/d1a/d1d/d2c/d4a/l8c 0 2024-04-20T10:54:41.606 INFO:tasks.workunit.client.0.smithi090.stdout:1/426: write d8/d1a/d45/f4f [297182,123700] 0 2024-04-20T10:54:41.607 INFO:tasks.workunit.client.0.smithi090.stdout:1/427: symlink d8/d1a/d1d/d2c/d62/l8d 0 2024-04-20T10:54:41.610 INFO:tasks.workunit.client.0.smithi090.stdout:1/428: dread d8/d1a/d4d/f63 [0,4194304] 0 2024-04-20T10:54:41.618 INFO:tasks.workunit.client.0.smithi090.stdout:0/390: sync 2024-04-20T10:54:41.618 INFO:tasks.workunit.client.0.smithi090.stdout:9/373: sync 2024-04-20T10:54:41.619 INFO:tasks.workunit.client.0.smithi090.stdout:2/396: sync 2024-04-20T10:54:41.619 INFO:tasks.workunit.client.0.smithi090.stdout:2/397: truncate d11/d1a/f58 4103663 0 2024-04-20T10:54:41.619 INFO:tasks.workunit.client.0.smithi090.stdout:2/398: write d11/d1f/f6c [1213209,56715] 0 2024-04-20T10:54:41.619 INFO:tasks.workunit.client.0.smithi090.stdout:2/399: dread - d11/d1f/d2e/f89 zero size 2024-04-20T10:54:41.620 INFO:tasks.workunit.client.0.smithi090.stdout:2/400: read - d11/d1a/d4a/d55/f69 zero size 2024-04-20T10:54:41.620 INFO:tasks.workunit.client.0.smithi090.stdout:9/374: creat d0/d29/d36/d63/d1f/d4d/f7b x:0 0 0 2024-04-20T10:54:41.620 INFO:tasks.workunit.client.0.smithi090.stdout:0/391: mknod d14/d19/d2b/d66/d43/d6d/c79 0 2024-04-20T10:54:41.620 INFO:tasks.workunit.client.0.smithi090.stdout:0/392: dread - d14/d19/d2c/f35 zero size 2024-04-20T10:54:41.621 INFO:tasks.workunit.client.0.smithi090.stdout:2/401: symlink d11/d1f/d2e/d6e/l8b 0 2024-04-20T10:54:41.622 INFO:tasks.workunit.client.0.smithi090.stdout:9/375: link d0/d29/d36/d63/f1e d0/f7c 0 2024-04-20T10:54:41.622 INFO:tasks.workunit.client.0.smithi090.stdout:9/376: write d0/d29/d4f/d6b/f72 [626684,43176] 0 2024-04-20T10:54:41.622 INFO:tasks.workunit.client.0.smithi090.stdout:9/377: chown d0/d29/d36 340183162 1 2024-04-20T10:54:41.622 INFO:tasks.workunit.client.0.smithi090.stdout:0/393: mknod d14/d19/d2b/d66/d43/d5c/c7a 0 2024-04-20T10:54:41.623 INFO:tasks.workunit.client.0.smithi090.stdout:2/402: creat d11/d1a/d4a/f8c x:0 0 0 2024-04-20T10:54:41.623 INFO:tasks.workunit.client.0.smithi090.stdout:9/378: symlink d0/d29/d36/d63/d1f/d34/l7d 0 2024-04-20T10:54:41.624 INFO:tasks.workunit.client.0.smithi090.stdout:2/403: mkdir d11/d1a/d30/d8d 0 2024-04-20T10:54:41.624 INFO:tasks.workunit.client.0.smithi090.stdout:2/404: dread - d11/d1a/f7d zero size 2024-04-20T10:54:41.625 INFO:tasks.workunit.client.0.smithi090.stdout:1/429: dwrite d8/d1a/f89 [0,4194304] 0 2024-04-20T10:54:41.625 INFO:tasks.workunit.client.0.smithi090.stdout:9/379: creat d0/f7e x:0 0 0 2024-04-20T10:54:41.626 INFO:tasks.workunit.client.0.smithi090.stdout:4/344: dwrite d7/d9/f19 [0,4194304] 0 2024-04-20T10:54:41.627 INFO:tasks.workunit.client.0.smithi090.stdout:0/394: mkdir d14/d19/d31/d7b 0 2024-04-20T10:54:41.628 INFO:tasks.workunit.client.0.smithi090.stdout:9/380: write d0/d29/d36/d63/d1f/d34/d70/d52/f4c [187267,70078] 0 2024-04-20T10:54:41.629 INFO:tasks.workunit.client.0.smithi090.stdout:9/381: stat d0/d29/d36/d63/d1f/d79 0 2024-04-20T10:54:41.629 INFO:tasks.workunit.client.0.smithi090.stdout:1/430: rename d8/d1a/d1d/d67/d31/f52 to d8/d1a/d1d/d67/d31/d5d/f8e 0 2024-04-20T10:54:41.629 INFO:tasks.workunit.client.0.smithi090.stdout:1/431: chown d8/d1a/d1d/d2c/d4a/d5a/f69 451827 1 2024-04-20T10:54:41.636 INFO:tasks.workunit.client.0.smithi090.stdout:9/382: rmdir d0/d29/d36/d63/d1f/d79 39 2024-04-20T10:54:41.636 INFO:tasks.workunit.client.0.smithi090.stdout:1/432: mkdir d8/d1a/d1d/d2c/d8f 0 2024-04-20T10:54:41.637 INFO:tasks.workunit.client.0.smithi090.stdout:0/395: dread d14/f18 [0,4194304] 0 2024-04-20T10:54:41.637 INFO:tasks.workunit.client.0.smithi090.stdout:9/383: mkdir d0/d29/d36/d63/d1f/d79/d7f 0 2024-04-20T10:54:41.638 INFO:tasks.workunit.client.0.smithi090.stdout:9/384: write d0/d29/d36/d63/d1f/d79/f75 [785732,109320] 0 2024-04-20T10:54:41.639 INFO:tasks.workunit.client.0.smithi090.stdout:1/433: creat d8/d1a/d1d/d67/f90 x:0 0 0 2024-04-20T10:54:41.639 INFO:tasks.workunit.client.0.smithi090.stdout:1/434: dread - d8/d1a/d1d/d2c/f51 zero size 2024-04-20T10:54:41.639 INFO:tasks.workunit.client.0.smithi090.stdout:1/435: write d8/d1a/d1d/d67/f61 [1933898,165] 0 2024-04-20T10:54:41.641 INFO:tasks.workunit.client.0.smithi090.stdout:9/385: symlink d0/d29/d36/d63/d78/l80 0 2024-04-20T10:54:41.642 INFO:tasks.workunit.client.0.smithi090.stdout:1/436: mknod d8/d1a/d45/c91 0 2024-04-20T10:54:41.644 INFO:tasks.workunit.client.0.smithi090.stdout:0/396: rename d14/d19/d31/d7b to d14/d39/d7c 0 2024-04-20T10:54:41.645 INFO:tasks.workunit.client.0.smithi090.stdout:1/437: mkdir d8/d92 0 2024-04-20T10:54:41.645 INFO:tasks.workunit.client.0.smithi090.stdout:1/438: write d8/d1a/d1d/d2c/d6e/f84 [991777,78614] 0 2024-04-20T10:54:41.646 INFO:tasks.workunit.client.0.smithi090.stdout:0/397: getdents d14/d19/d2b/d52/d55 0 2024-04-20T10:54:41.647 INFO:tasks.workunit.client.0.smithi090.stdout:4/345: dwrite d7/d9/d17/f3f [0,4194304] 0 2024-04-20T10:54:41.650 INFO:tasks.workunit.client.0.smithi090.stdout:4/346: link d7/d9/f35 d7/f6a 0 2024-04-20T10:54:41.651 INFO:tasks.workunit.client.0.smithi090.stdout:7/416: sync 2024-04-20T10:54:41.652 INFO:tasks.workunit.client.0.smithi090.stdout:7/417: getdents d11/d13/d5b 0 2024-04-20T10:54:41.653 INFO:tasks.workunit.client.0.smithi090.stdout:7/418: mkdir d11/d13/d22/d8f 0 2024-04-20T10:54:41.661 INFO:tasks.workunit.client.0.smithi090.stdout:9/386: dread d0/f4 [0,4194304] 0 2024-04-20T10:54:41.661 INFO:tasks.workunit.client.0.smithi090.stdout:4/347: dread d7/f38 [0,4194304] 0 2024-04-20T10:54:41.662 INFO:tasks.workunit.client.0.smithi090.stdout:4/348: dread d7/d9/d17/f27 [0,4194304] 0 2024-04-20T10:54:41.663 INFO:tasks.workunit.client.0.smithi090.stdout:7/419: dread f0 [4194304,4194304] 0 2024-04-20T10:54:41.663 INFO:tasks.workunit.client.0.smithi090.stdout:7/420: write f0 [9320579,115876] 0 2024-04-20T10:54:41.664 INFO:tasks.workunit.client.0.smithi090.stdout:1/439: dwrite d8/d1a/d1d/f27 [0,4194304] 0 2024-04-20T10:54:41.664 INFO:tasks.workunit.client.0.smithi090.stdout:4/349: truncate d7/d9/f20 129164 0 2024-04-20T10:54:41.665 INFO:tasks.workunit.client.0.smithi090.stdout:0/398: dwrite d14/d19/d2b/f3e [0,4194304] 0 2024-04-20T10:54:41.665 INFO:tasks.workunit.client.0.smithi090.stdout:0/399: write d14/d19/d2b/d66/d40/f57 [727728,77841] 0 2024-04-20T10:54:41.665 INFO:tasks.workunit.client.0.smithi090.stdout:1/440: dread d8/f54 [0,4194304] 0 2024-04-20T10:54:41.665 INFO:tasks.workunit.client.0.smithi090.stdout:7/421: creat d11/d13/f90 x:0 0 0 2024-04-20T10:54:41.666 INFO:tasks.workunit.client.0.smithi090.stdout:4/350: symlink d7/d9/d17/l6b 0 2024-04-20T10:54:41.668 INFO:tasks.workunit.client.0.smithi090.stdout:1/441: rmdir d8/d92 0 2024-04-20T10:54:41.669 INFO:tasks.workunit.client.0.smithi090.stdout:7/422: symlink d11/d13/d23/d6c/d72/l91 0 2024-04-20T10:54:41.669 INFO:tasks.workunit.client.0.smithi090.stdout:7/423: write d11/d13/d23/f62 [637771,101152] 0 2024-04-20T10:54:41.669 INFO:tasks.workunit.client.0.smithi090.stdout:7/424: chown d11/d1a/d3f 51807 1 2024-04-20T10:54:41.671 INFO:tasks.workunit.client.0.smithi090.stdout:4/351: rename d7/d9/l14 to d7/d9/d47/d63/d3d/l6c 0 2024-04-20T10:54:41.671 INFO:tasks.workunit.client.0.smithi090.stdout:7/425: dread d11/d1a/f76 [0,4194304] 0 2024-04-20T10:54:41.673 INFO:tasks.workunit.client.0.smithi090.stdout:7/426: fdatasync f0 0 2024-04-20T10:54:41.674 INFO:tasks.workunit.client.0.smithi090.stdout:0/400: creat d14/d41/f7d x:0 0 0 2024-04-20T10:54:41.677 INFO:tasks.workunit.client.0.smithi090.stdout:1/442: rename d8/d1a/d1d/d67/d31 to d8/d1a/d1d/d2c/d4a/d93 0 2024-04-20T10:54:41.677 INFO:tasks.workunit.client.0.smithi090.stdout:4/352: creat d7/d9/f6d x:0 0 0 2024-04-20T10:54:41.679 INFO:tasks.workunit.client.0.smithi090.stdout:1/443: truncate d8/d1a/d1d/d67/f23 3036218 0 2024-04-20T10:54:41.681 INFO:tasks.workunit.client.0.smithi090.stdout:1/444: rename d8/d1a/d1d/d2c/d4a/d93/f57 to d8/d1a/d1d/f94 0 2024-04-20T10:54:41.681 INFO:tasks.workunit.client.0.smithi090.stdout:1/445: write d8/d1a/d1d/d2c/d3f/f53 [528828,24284] 0 2024-04-20T10:54:41.681 INFO:tasks.workunit.client.0.smithi090.stdout:1/446: truncate d8/d1a/d1d/d2c/d3f/f7e 722223 0 2024-04-20T10:54:41.682 INFO:tasks.workunit.client.0.smithi090.stdout:4/353: dread d7/d9/d17/f18 [0,4194304] 0 2024-04-20T10:54:41.683 INFO:tasks.workunit.client.0.smithi090.stdout:1/447: symlink d8/d1a/d1d/l95 0 2024-04-20T10:54:41.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.684+0000 7f661b48c640 1 Processor -- start 2024-04-20T10:54:41.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.684+0000 7f661b48c640 1 -- start start 2024-04-20T10:54:41.684 INFO:tasks.workunit.client.0.smithi090.stdout:4/354: creat d7/f6e x:0 0 0 2024-04-20T10:54:41.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f661b48c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f6614154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:41.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f661b48c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6614157a70 0x7f66140725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:41.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f661b48c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6614073ba0 con 0x7f6614072b30 2024-04-20T10:54:41.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f661b48c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6614157ed0 con 0x7f6614157a70 2024-04-20T10:54:41.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f661b48c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6614151ef0 con 0x7f6614151b10 2024-04-20T10:54:41.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6619a29640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6614072b30 0x7f66140aba60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56430/0 (socket says 172.21.15.90:56430) 2024-04-20T10:54:41.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6619a29640 1 -- 172.21.15.90:0/1919637771 learned_addr learned my addr 172.21.15.90:0/1919637771 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:54:41.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6618a27640 1 --2- 172.21.15.90:0/1919637771 >> v2:172.21.15.175:3300/0 conn(0x7f6614157a70 0x7f66140725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:41.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6619228640 1 --2- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f6614154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:41.686 INFO:tasks.workunit.client.0.smithi090.stdout:1/448: mknod d8/d1a/d1d/c96 0 2024-04-20T10:54:41.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f660bfff640 1 -- 172.21.15.90:0/1919637771 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352641874 0 0) 0x7f6614073ba0 con 0x7f6614072b30 2024-04-20T10:54:41.687 INFO:tasks.workunit.client.0.smithi090.stdout:1/449: fdatasync d8/d1a/f47 0 2024-04-20T10:54:41.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f660bfff640 1 -- 172.21.15.90:0/1919637771 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6600003520 con 0x7f6614072b30 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6618a27640 1 -- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 msgr2=0x7f6614154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6618a27640 1 --2- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f6614154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6618a27640 1 -- 172.21.15.90:0/1919637771 >> v1:172.21.15.90:6789/0 conn(0x7f6614072b30 legacy=0x7f66140aba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.685+0000 7f6618a27640 1 -- 172.21.15.90:0/1919637771 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66141589a0 con 0x7f6614157a70 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.687+0000 7f6618a27640 1 --2- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614157a70 0x7f66140725f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f66040097a0 tx=0x7f660402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=812c7b689a0475c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.687+0000 7f660bfff640 1 -- 172.21.15.90:0/1919637771 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604035020 con 0x7f6614157a70 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.687+0000 7f660bfff640 1 -- 172.21.15.90:0/1919637771 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6604031810 con 0x7f6614157a70 2024-04-20T10:54:41.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.687+0000 7f660bfff640 1 -- 172.21.15.90:0/1919637771 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6604031be0 con 0x7f6614157a70 2024-04-20T10:54:41.688 INFO:tasks.workunit.client.0.smithi090.stdout:4/355: creat d7/d9/d47/f6f x:0 0 0 2024-04-20T10:54:41.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 -- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614157a70 msgr2=0x7f66140725f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:41.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 --2- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614157a70 0x7f66140725f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f66040097a0 tx=0x7f660402b8b0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 -- 172.21.15.90:0/1919637771 shutdown_connections 2024-04-20T10:54:41.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 --2- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614157a70 0x7f66140725f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 --2- 172.21.15.90:0/1919637771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f6614154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 -- 172.21.15.90:0/1919637771 >> 172.21.15.90:0/1919637771 conn(0x7f66140ca0a0 msgr2=0x7f66140ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:41.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 -- 172.21.15.90:0/1919637771 shutdown_connections 2024-04-20T10:54:41.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.688+0000 7f661b48c640 1 -- 172.21.15.90:0/1919637771 wait complete. 2024-04-20T10:54:41.690 INFO:tasks.workunit.client.0.smithi090.stdout:1/450: creat d8/d1a/d1d/d67/f97 x:0 0 0 2024-04-20T10:54:41.690 INFO:tasks.workunit.client.0.smithi090.stdout:4/356: mkdir d7/d9/d17/d56/d66/d70 0 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 Processor -- start 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 -- start start 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614072b30 0x7f6614147460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f66140c9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6614157a70 0x7f66141f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66141586c0 con 0x7f6614157a70 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66141583e0 con 0x7f6614072b30 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.690+0000 7f661b48c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66140ab540 con 0x7f6614151b10 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6614157a70 0x7f66141f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6614157a70 0x7f66141f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48580/0 (socket says 172.21.15.90:48580) 2024-04-20T10:54:41.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 -- 172.21.15.90:0/257978455 learned_addr learned my addr 172.21.15.90:0/257978455 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:41.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619228640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614072b30 0x7f6614147460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:41.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6618a27640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f66140c9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:41.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 -- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 msgr2=0x7f66140c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:41.693 INFO:tasks.workunit.client.0.smithi090.stdout:4/357: getdents d7/d9/d17 0 2024-04-20T10:54:41.693 INFO:tasks.workunit.client.0.smithi090.stdout:4/358: chown d7/d9/d17/l6b 124103 1 2024-04-20T10:54:41.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f66140c9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 -- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614072b30 msgr2=0x7f6614147460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:41.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614072b30 0x7f6614147460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 -- 172.21.15.90:0/257978455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6614147f30 con 0x7f6614157a70 2024-04-20T10:54:41.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6619a29640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6614157a70 0x7f66141f00e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f660c00cb40 tx=0x7f660c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:41.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.691+0000 7f6609ffb640 1 -- 172.21.15.90:0/257978455 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c017070 con 0x7f6614157a70 2024-04-20T10:54:41.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.692+0000 7f6609ffb640 1 -- 172.21.15.90:0/257978455 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f660c00aca0 con 0x7f6614157a70 2024-04-20T10:54:41.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.692+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6614154230 con 0x7f6614157a70 2024-04-20T10:54:41.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.692+0000 7f6609ffb640 1 -- 172.21.15.90:0/257978455 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f660c012620 con 0x7f6614157a70 2024-04-20T10:54:41.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.692+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6614156880 con 0x7f6614157a70 2024-04-20T10:54:41.695 INFO:tasks.workunit.client.0.smithi090.stdout:4/359: mknod d7/d9/d17/c71 0 2024-04-20T10:54:41.695 INFO:tasks.workunit.client.0.smithi090.stdout:4/360: chown d7/l15 0 1 2024-04-20T10:54:41.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.693+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6614076150 con 0x7f6614157a70 2024-04-20T10:54:41.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.694+0000 7f6609ffb640 1 -- 172.21.15.90:0/257978455 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f660c01a070 con 0x7f6614157a70 2024-04-20T10:54:41.696 INFO:tasks.workunit.client.0.smithi090.stdout:4/361: mkdir d7/d72 0 2024-04-20T10:54:41.696 INFO:tasks.workunit.client.0.smithi090.stdout:4/362: fdatasync d7/d9/d47/d63/f45 0 2024-04-20T10:54:41.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.694+0000 7f6609ffb640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f65f806c8f0 0x7f65f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:41.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.694+0000 7f6609ffb640 1 -- 172.21.15.90:0/257978455 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f660c08bd70 con 0x7f6614157a70 2024-04-20T10:54:41.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.694+0000 7f6619228640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f65f806c8f0 0x7f65f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:41.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.695+0000 7f6619228640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f65f806c8f0 0x7f65f806edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6610009b40 tx=0x7f6610009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:41.698 INFO:tasks.workunit.client.0.smithi090.stdout:0/401: dwrite d14/d41/f6e [0,4194304] 0 2024-04-20T10:54:41.698 INFO:tasks.workunit.client.0.smithi090.stdout:4/363: unlink d7/d9/d17/l1b 0 2024-04-20T10:54:41.698 INFO:tasks.workunit.client.0.smithi090.stdout:4/364: write d7/d9/f4a [4473494,122875] 0 2024-04-20T10:54:41.698 INFO:tasks.workunit.client.0.smithi090.stdout:4/365: truncate d7/d9/d17/f37 654813 0 2024-04-20T10:54:41.699 INFO:tasks.workunit.client.0.smithi090.stdout:4/366: mknod d7/d9/d17/c73 0 2024-04-20T10:54:41.700 INFO:tasks.workunit.client.0.smithi090.stdout:4/367: unlink d7/d9/d17/l6b 0 2024-04-20T10:54:41.701 INFO:tasks.workunit.client.0.smithi090.stdout:4/368: mknod d7/d9/d17/c74 0 2024-04-20T10:54:41.701 INFO:tasks.workunit.client.0.smithi090.stdout:4/369: rmdir d7/d9/d47/d63/d42 39 2024-04-20T10:54:41.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.703+0000 7f6609ffb640 1 -- 172.21.15.90:0/257978455 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f660c0596e0 con 0x7f6614157a70 2024-04-20T10:54:41.703 INFO:tasks.workunit.client.0.smithi090.stdout:1/451: dwrite d8/d1a/d1d/d2c/d4a/f8b [0,4194304] 0 2024-04-20T10:54:41.714 INFO:tasks.workunit.client.0.smithi090.stdout:1/452: dread d8/d1a/f39 [0,4194304] 0 2024-04-20T10:54:41.716 INFO:tasks.workunit.client.0.smithi090.stdout:1/453: rename d8/d1a/d45/c91 to d8/d1a/d4d/c98 0 2024-04-20T10:54:41.719 INFO:tasks.workunit.client.0.smithi090.stdout:0/402: dwrite d14/f1f [0,4194304] 0 2024-04-20T10:54:41.719 INFO:tasks.workunit.client.0.smithi090.stdout:0/403: readlink d14/d19/d2b/d66/d40/l5d 0 2024-04-20T10:54:41.721 INFO:tasks.workunit.client.0.smithi090.stdout:0/404: mknod d14/d19/d2b/d66/d43/c7e 0 2024-04-20T10:54:41.721 INFO:tasks.workunit.client.0.smithi090.stdout:4/370: dwrite d7/d9/d17/f48 [0,4194304] 0 2024-04-20T10:54:41.722 INFO:tasks.workunit.client.0.smithi090.stdout:0/405: mkdir d14/d19/d2b/d52/d55/d5b/d7f 0 2024-04-20T10:54:41.723 INFO:tasks.workunit.client.0.smithi090.stdout:4/371: creat d7/d9/d47/d63/d3d/f75 x:0 0 0 2024-04-20T10:54:41.723 INFO:tasks.workunit.client.0.smithi090.stdout:4/372: fsync d7/d9/d47/d63/f34 0 2024-04-20T10:54:41.724 INFO:tasks.workunit.client.0.smithi090.stdout:0/406: creat d14/f80 x:0 0 0 2024-04-20T10:54:41.725 INFO:tasks.workunit.client.0.smithi090.stdout:4/373: mkdir d7/d9/d47/d63/d76 0 2024-04-20T10:54:41.726 INFO:tasks.workunit.client.0.smithi090.stdout:0/407: creat d14/d19/d2b/d66/d43/d5c/f81 x:0 0 0 2024-04-20T10:54:41.727 INFO:tasks.workunit.client.0.smithi090.stdout:0/408: creat d14/d19/d2b/f82 x:0 0 0 2024-04-20T10:54:41.730 INFO:tasks.workunit.client.0.smithi090.stdout:0/409: dread f3 [0,4194304] 0 2024-04-20T10:54:41.731 INFO:tasks.workunit.client.0.smithi090.stdout:1/454: dwrite d8/d1a/d45/f7c [0,4194304] 0 2024-04-20T10:54:41.732 INFO:tasks.workunit.client.0.smithi090.stdout:1/455: truncate d8/d1a/d1d/d2c/d4a/d5a/f69 838470 0 2024-04-20T10:54:41.732 INFO:tasks.workunit.client.0.smithi090.stdout:1/456: chown d8/d1a/d45/f4b 3498037 1 2024-04-20T10:54:41.732 INFO:tasks.workunit.client.0.smithi090.stdout:4/374: write d7/d9/f19 [2756012,99413] 0 2024-04-20T10:54:41.732 INFO:tasks.workunit.client.0.smithi090.stdout:0/410: creat d14/d19/d2b/f83 x:0 0 0 2024-04-20T10:54:41.733 INFO:tasks.workunit.client.0.smithi090.stdout:0/411: fsync d14/f4b 0 2024-04-20T10:54:41.737 INFO:tasks.workunit.client.0.smithi090.stdout:4/375: dread d7/d9/d17/f18 [0,4194304] 0 2024-04-20T10:54:41.738 INFO:tasks.workunit.client.0.smithi090.stdout:4/376: write d7/f6e [567407,68649] 0 2024-04-20T10:54:41.738 INFO:tasks.workunit.client.0.smithi090.stdout:4/377: write d7/d9/f1c [272695,5943] 0 2024-04-20T10:54:41.738 INFO:tasks.workunit.client.0.smithi090.stdout:4/378: write d7/d9/d47/d63/d3d/f60 [964149,15473] 0 2024-04-20T10:54:41.738 INFO:tasks.workunit.client.0.smithi090.stdout:4/379: unlink l6 0 2024-04-20T10:54:41.741 INFO:tasks.workunit.client.0.smithi090.stdout:1/457: write d8/d1a/d1d/d2c/d4a/f8b [2025024,103407] 0 2024-04-20T10:54:41.741 INFO:tasks.workunit.client.0.smithi090.stdout:1/458: truncate d8/d1a/d1d/d2c/f51 541383 0 2024-04-20T10:54:41.741 INFO:tasks.workunit.client.0.smithi090.stdout:1/459: dread - d8/d1a/d1d/d2c/d3f/f87 zero size 2024-04-20T10:54:41.742 INFO:tasks.workunit.client.0.smithi090.stdout:4/380: rename d7/d9/d17/c41 to d7/c77 0 2024-04-20T10:54:41.743 INFO:tasks.workunit.client.0.smithi090.stdout:1/460: creat d8/d1a/f99 x:0 0 0 2024-04-20T10:54:41.743 INFO:tasks.workunit.client.0.smithi090.stdout:1/461: fsync d8/d1a/d1d/d2c/d62/f78 0 2024-04-20T10:54:41.744 INFO:tasks.workunit.client.0.smithi090.stdout:4/381: link d7/d9/f36 d7/d9/d47/d63/d3d/f78 0 2024-04-20T10:54:41.744 INFO:tasks.workunit.client.0.smithi090.stdout:4/382: readlink d7/d9/l2f 0 2024-04-20T10:54:41.744 INFO:tasks.workunit.client.0.smithi090.stdout:4/383: chown d7/l1f 13350 1 2024-04-20T10:54:41.745 INFO:tasks.workunit.client.0.smithi090.stdout:4/384: read d7/f52 [11420,94174] 0 2024-04-20T10:54:41.745 INFO:tasks.workunit.client.0.smithi090.stdout:1/462: rename d8/d1a/d45 to d8/d1a/d1d/d7a/d9a 0 2024-04-20T10:54:41.745 INFO:tasks.workunit.client.0.smithi090.stdout:1/463: chown d8/fe 855 1 2024-04-20T10:54:41.746 INFO:tasks.workunit.client.0.smithi090.stdout:4/385: creat d7/d9/d17/f79 x:0 0 0 2024-04-20T10:54:41.752 INFO:tasks.workunit.client.0.smithi090.stdout:4/386: rename d7/d9/d47/d63/d42/c68 to d7/c7a 0 2024-04-20T10:54:41.752 INFO:tasks.workunit.client.0.smithi090.stdout:4/387: chown d7/d9/d17/c74 6715888 1 2024-04-20T10:54:41.765 INFO:tasks.workunit.client.0.smithi090.stdout:1/464: dwrite d8/d1a/d1d/d2c/d3f/f5c [0,4194304] 0 2024-04-20T10:54:41.767 INFO:tasks.workunit.client.0.smithi090.stdout:1/465: dread d8/d1a/d1d/d7a/d9a/f4b [0,4194304] 0 2024-04-20T10:54:41.941 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.941+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6614073b90 con 0x7f6614157a70 2024-04-20T10:54:41.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.942+0000 7f6609ffb640 1 -- 172.21.15.90:0/257978455 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7f660c05d9e0 con 0x7f6614157a70 2024-04-20T10:54:41.942 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:41.942 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:41.943 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:41.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f65f806c8f0 msgr2=0x7f65f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:41.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f65f806c8f0 0x7f65f806edb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6610009b40 tx=0x7f6610009190 comp rx=0 tx=0).stop 2024-04-20T10:54:41.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6614157a70 msgr2=0x7f66141f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:41.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6614157a70 0x7f66141f00e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f660c00cb40 tx=0x7f660c00a060 comp rx=0 tx=0).stop 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 shutdown_connections 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f65f806c8f0 0x7f65f806edb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6614157a70 0x7f66141f00e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6614151b10 0x7f66140c9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 --2- 172.21.15.90:0/257978455 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6614072b30 0x7f6614147460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 >> 172.21.15.90:0/257978455 conn(0x7f66140ca0a0 msgr2=0x7f66140ac200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 shutdown_connections 2024-04-20T10:54:41.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:41.944+0000 7f661b48c640 1 -- 172.21.15.90:0/257978455 wait complete. 2024-04-20T10:54:41.955 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:42.510 INFO:tasks.workunit.client.0.smithi090.stdout:4/388: rmdir d7 39 2024-04-20T10:54:42.511 INFO:tasks.workunit.client.0.smithi090.stdout:4/389: mknod d7/d9/d47/d63/d76/c7b 0 2024-04-20T10:54:42.511 INFO:tasks.workunit.client.0.smithi090.stdout:4/390: fsync d7/d9/d17/f18 0 2024-04-20T10:54:42.512 INFO:tasks.workunit.client.0.smithi090.stdout:4/391: mknod d7/d9/d17/c7c 0 2024-04-20T10:54:42.512 INFO:tasks.workunit.client.0.smithi090.stdout:4/392: fdatasync d7/d9/d17/f2b 0 2024-04-20T10:54:42.514 INFO:tasks.workunit.client.0.smithi090.stdout:4/393: rename d7/fb to d7/f7d 0 2024-04-20T10:54:42.514 INFO:tasks.workunit.client.0.smithi090.stdout:4/394: rmdir d7 39 2024-04-20T10:54:42.515 INFO:tasks.workunit.client.0.smithi090.stdout:4/395: mknod d7/d9/d17/d56/c7e 0 2024-04-20T10:54:42.516 INFO:tasks.workunit.client.0.smithi090.stdout:4/396: truncate d7/d9/f19 1273024 0 2024-04-20T10:54:42.516 INFO:tasks.workunit.client.0.smithi090.stdout:4/397: write d7/d9/d17/f27 [1111059,17701] 0 2024-04-20T10:54:42.519 INFO:tasks.workunit.client.0.smithi090.stdout:0/412: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:3/369: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:1/466: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:9/387: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:2/405: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:2/406: fdatasync d11/f7a 0 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:2/407: fsync d11/f15 0 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:5/611: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:5/612: stat d1/c33 0 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:7/427: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:6/351: sync 2024-04-20T10:54:42.520 INFO:tasks.workunit.client.0.smithi090.stdout:8/380: sync 2024-04-20T10:54:42.521 INFO:tasks.workunit.client.0.smithi090.stdout:3/370: stat d7/d15/d47/l62 0 2024-04-20T10:54:42.521 INFO:tasks.workunit.client.0.smithi090.stdout:3/371: truncate d7/d15/d2a/d30/d48/f4f 217893 0 2024-04-20T10:54:42.521 INFO:tasks.workunit.client.0.smithi090.stdout:3/372: fdatasync d7/d15/d2a/f67 0 2024-04-20T10:54:42.521 INFO:tasks.workunit.client.0.smithi090.stdout:0/413: mknod d14/d19/d2b/d66/d43/d5c/c84 0 2024-04-20T10:54:42.522 INFO:tasks.workunit.client.0.smithi090.stdout:1/467: getdents d8/d1a/d1d/d67 0 2024-04-20T10:54:42.526 INFO:tasks.workunit.client.0.smithi090.stdout:5/613: rename d1/d2f/d3d/f5b to d1/da/d1f/dad/dc8/fd9 0 2024-04-20T10:54:42.526 INFO:tasks.workunit.client.0.smithi090.stdout:5/614: write d1/d2f/d3d/d40/fb4 [504723,125587] 0 2024-04-20T10:54:42.527 INFO:tasks.workunit.client.0.smithi090.stdout:6/352: dread d1/d4/d26/f4d [0,4194304] 0 2024-04-20T10:54:42.528 INFO:tasks.workunit.client.0.smithi090.stdout:8/381: mknod d0/d2d/d49/c7e 0 2024-04-20T10:54:42.529 INFO:tasks.workunit.client.0.smithi090.stdout:7/428: creat d11/d13/f92 x:0 0 0 2024-04-20T10:54:42.529 INFO:tasks.workunit.client.0.smithi090.stdout:7/429: fdatasync d11/d13/d33/f4d 0 2024-04-20T10:54:42.530 INFO:tasks.workunit.client.0.smithi090.stdout:3/373: getdents d7/d15/d2a/d30 0 2024-04-20T10:54:42.532 INFO:tasks.workunit.client.0.smithi090.stdout:0/414: creat d14/d19/d2b/d52/d55/d5b/d7f/f85 x:0 0 0 2024-04-20T10:54:42.534 INFO:tasks.workunit.client.0.smithi090.stdout:5/615: unlink d1/da/d14/cc2 0 2024-04-20T10:54:42.534 INFO:tasks.workunit.client.0.smithi090.stdout:5/616: write d1/da/f1e [1072265,24367] 0 2024-04-20T10:54:42.535 INFO:tasks.workunit.client.0.smithi090.stdout:8/382: creat d0/d11/d14/f7f x:0 0 0 2024-04-20T10:54:42.535 INFO:tasks.workunit.client.0.smithi090.stdout:8/383: chown d0/d11/d14/f41 16 1 2024-04-20T10:54:42.537 INFO:tasks.workunit.client.0.smithi090.stdout:0/415: chown d14/f22 1 1 2024-04-20T10:54:42.540 INFO:tasks.workunit.client.0.smithi090.stdout:3/374: write d7/df/f4d [3968019,69946] 0 2024-04-20T10:54:42.540 INFO:tasks.workunit.client.0.smithi090.stdout:7/430: write d11/d1a/d3f/f5f [400602,119208] 0 2024-04-20T10:54:42.540 INFO:tasks.workunit.client.0.smithi090.stdout:8/384: rename d0/d11/c29 to d0/d2d/d49/c80 0 2024-04-20T10:54:42.540 INFO:tasks.workunit.client.0.smithi090.stdout:5/617: mkdir d1/da/d14/dda 0 2024-04-20T10:54:42.543 INFO:tasks.workunit.client.0.smithi090.stdout:3/375: mknod d7/d15/d2a/d68/c7a 0 2024-04-20T10:54:42.546 INFO:tasks.workunit.client.0.smithi090.stdout:7/431: rmdir d11/d13/d5b/d6b/d87 0 2024-04-20T10:54:42.546 INFO:tasks.workunit.client.0.smithi090.stdout:9/388: dwrite d0/d29/d36/d63/d1f/f71 [0,4194304] 0 2024-04-20T10:54:42.546 INFO:tasks.workunit.client.0.smithi090.stdout:9/389: chown d0/d29/d36/d63/d1f/d79/f58 103688 1 2024-04-20T10:54:42.546 INFO:tasks.workunit.client.0.smithi090.stdout:9/390: chown d0/d29/d4f/f10 568651363 1 2024-04-20T10:54:42.547 INFO:tasks.workunit.client.0.smithi090.stdout:5/618: getdents d1/da/d14/d47 0 2024-04-20T10:54:42.547 INFO:tasks.workunit.client.0.smithi090.stdout:5/619: chown d1/da/d1f/f25 6597 1 2024-04-20T10:54:42.547 INFO:tasks.workunit.client.0.smithi090.stdout:1/468: dwrite d8/d1a/f74 [0,4194304] 0 2024-04-20T10:54:42.547 INFO:tasks.workunit.client.0.smithi090.stdout:1/469: write d8/d1a/f3b [1735295,20636] 0 2024-04-20T10:54:42.547 INFO:tasks.workunit.client.0.smithi090.stdout:0/416: dread d14/d19/f1b [0,4194304] 0 2024-04-20T10:54:42.547 INFO:tasks.workunit.client.0.smithi090.stdout:0/417: fsync d14/d19/d2b/f51 0 2024-04-20T10:54:42.548 INFO:tasks.workunit.client.0.smithi090.stdout:3/376: rename d7/d15/d2a/d30/d48/c55 to d7/d26/d78/c7b 0 2024-04-20T10:54:42.548 INFO:tasks.workunit.client.0.smithi090.stdout:3/377: stat d7/df/l14 0 2024-04-20T10:54:42.554 INFO:tasks.workunit.client.0.smithi090.stdout:1/470: link d8/d1a/d1d/d2c/d4a/d93/l85 d8/d1a/d4d/l9b 0 2024-04-20T10:54:42.554 INFO:tasks.workunit.client.0.smithi090.stdout:9/391: rename d0/d29/d36/d63/d1f/c44 to d0/d29/d36/d63/c81 0 2024-04-20T10:54:42.557 INFO:tasks.workunit.client.0.smithi090.stdout:0/418: write fe [3081638,15235] 0 2024-04-20T10:54:42.557 INFO:tasks.workunit.client.0.smithi090.stdout:0/419: fsync d14/d19/d2b/f82 0 2024-04-20T10:54:42.558 INFO:tasks.workunit.client.0.smithi090.stdout:0/420: mknod d14/d19/d2b/c86 0 2024-04-20T10:54:42.559 INFO:tasks.workunit.client.0.smithi090.stdout:0/421: unlink d14/d19/d2b/d52/d55/d5b/d7f/f85 0 2024-04-20T10:54:42.560 INFO:tasks.workunit.client.0.smithi090.stdout:0/422: creat d14/d19/d2b/d52/d55/d5b/d7f/f87 x:0 0 0 2024-04-20T10:54:42.560 INFO:tasks.workunit.client.0.smithi090.stdout:0/423: dread - d14/d19/d2b/d61/f72 zero size 2024-04-20T10:54:42.561 INFO:tasks.workunit.client.0.smithi090.stdout:0/424: mkdir d14/d19/d2b/d61/d88 0 2024-04-20T10:54:42.563 INFO:tasks.workunit.client.0.smithi090.stdout:0/425: rename d14/d19/d31 to d14/d19/d31/d89 22 2024-04-20T10:54:42.563 INFO:tasks.workunit.client.0.smithi090.stdout:0/426: fsync d14/d19/d2b/f83 0 2024-04-20T10:54:42.564 INFO:tasks.workunit.client.0.smithi090.stdout:0/427: mkdir d14/d19/d2b/d52/d55/d5b/d8a 0 2024-04-20T10:54:42.564 INFO:tasks.workunit.client.0.smithi090.stdout:0/428: dread - d14/d19/f78 zero size 2024-04-20T10:54:42.564 INFO:tasks.workunit.client.0.smithi090.stdout:8/385: dwrite d0/d11/d14/f7c [0,4194304] 0 2024-04-20T10:54:42.566 INFO:tasks.workunit.client.0.smithi090.stdout:1/471: dread d8/d1a/d1d/d7a/d9a/f7c [0,4194304] 0 2024-04-20T10:54:42.570 INFO:tasks.workunit.client.0.smithi090.stdout:1/472: unlink d8/d1a/l4c 0 2024-04-20T10:54:42.572 INFO:tasks.workunit.client.0.smithi090.stdout:1/473: creat d8/d1a/d4d/f9c x:0 0 0 2024-04-20T10:54:42.580 INFO:tasks.workunit.client.0.smithi090.stdout:3/378: dwrite d7/d15/d2a/d68/f74 [0,4194304] 0 2024-04-20T10:54:42.583 INFO:tasks.workunit.client.0.smithi090.stdout:3/379: mknod d7/d43/c7c 0 2024-04-20T10:54:42.584 INFO:tasks.workunit.client.0.smithi090.stdout:3/380: symlink d7/d15/d2a/d30/d48/l7d 0 2024-04-20T10:54:42.584 INFO:tasks.workunit.client.0.smithi090.stdout:3/381: read d7/d15/d2a/d30/d48/f4f [173779,56170] 0 2024-04-20T10:54:42.585 INFO:tasks.workunit.client.0.smithi090.stdout:3/382: symlink d7/d43/l7e 0 2024-04-20T10:54:42.586 INFO:tasks.workunit.client.0.smithi090.stdout:1/474: write d8/d1a/d1d/d2c/d4a/f65 [1882377,75974] 0 2024-04-20T10:54:42.586 INFO:tasks.workunit.client.0.smithi090.stdout:1/475: fdatasync d8/f80 0 2024-04-20T10:54:42.586 INFO:tasks.workunit.client.0.smithi090.stdout:3/383: mkdir d7/d15/d2a/d68/d7f 0 2024-04-20T10:54:42.586 INFO:tasks.workunit.client.0.smithi090.stdout:9/392: dwrite d0/d29/d36/f6d [0,4194304] 0 2024-04-20T10:54:42.587 INFO:tasks.workunit.client.0.smithi090.stdout:8/386: dwrite d0/fe [4194304,4194304] 0 2024-04-20T10:54:42.589 INFO:tasks.workunit.client.0.smithi090.stdout:9/393: mkdir d0/d29/d4f/d82 0 2024-04-20T10:54:42.590 INFO:tasks.workunit.client.0.smithi090.stdout:9/394: creat d0/d29/d36/d63/d1c/f83 x:0 0 0 2024-04-20T10:54:42.593 INFO:tasks.workunit.client.0.smithi090.stdout:0/429: dwrite d14/f5f [0,4194304] 0 2024-04-20T10:54:42.597 INFO:tasks.workunit.client.0.smithi090.stdout:1/476: dread d8/f2d [0,4194304] 0 2024-04-20T10:54:42.597 INFO:tasks.workunit.client.0.smithi090.stdout:1/477: chown d8/d1a/d1d/d2c/d4a/c56 987 1 2024-04-20T10:54:42.597 INFO:tasks.workunit.client.0.smithi090.stdout:1/478: fdatasync d8/f2d 0 2024-04-20T10:54:42.598 INFO:tasks.workunit.client.0.smithi090.stdout:9/395: dread d0/f37 [0,4194304] 0 2024-04-20T10:54:42.598 INFO:tasks.workunit.client.0.smithi090.stdout:9/396: dread - d0/d29/d36/d63/f66 zero size 2024-04-20T10:54:42.600 INFO:tasks.workunit.client.0.smithi090.stdout:1/479: dread d8/d1a/d1d/d2c/d3f/f53 [0,4194304] 0 2024-04-20T10:54:42.600 INFO:tasks.workunit.client.0.smithi090.stdout:9/397: rmdir d0/d29/d36/d63/d1f/d34/d70 39 2024-04-20T10:54:42.600 INFO:tasks.workunit.client.0.smithi090.stdout:9/398: dread - d0/d29/d36/d63/d1f/d34/d70/d52/f49 zero size 2024-04-20T10:54:42.603 INFO:tasks.workunit.client.0.smithi090.stdout:3/384: dwrite d7/d26/f3c [0,4194304] 0 2024-04-20T10:54:42.603 INFO:tasks.workunit.client.0.smithi090.stdout:3/385: chown d7/d11/l3a 21757 1 2024-04-20T10:54:42.603 INFO:tasks.workunit.client.0.smithi090.stdout:3/386: read - d7/d43/f76 zero size 2024-04-20T10:54:42.603 INFO:tasks.workunit.client.0.smithi090.stdout:3/387: chown d7/d43/f45 416100055 1 2024-04-20T10:54:42.604 INFO:tasks.workunit.client.0.smithi090.stdout:3/388: rename d7/d15/d2a/l3e to d7/d26/l80 0 2024-04-20T10:54:42.604 INFO:tasks.workunit.client.0.smithi090.stdout:3/389: getdents d7/d15/d47 0 2024-04-20T10:54:42.613 INFO:tasks.workunit.client.0.smithi090.stdout:0/430: dwrite fa [4194304,4194304] 0 2024-04-20T10:54:42.614 INFO:tasks.workunit.client.0.smithi090.stdout:3/390: dread d7/d15/f1d [0,4194304] 0 2024-04-20T10:54:42.614 INFO:tasks.workunit.client.0.smithi090.stdout:3/391: write d7/d15/f23 [4148960,52780] 0 2024-04-20T10:54:42.615 INFO:tasks.workunit.client.0.smithi090.stdout:0/431: creat d14/d19/d2b/d52/d55/d5b/d7f/f8b x:0 0 0 2024-04-20T10:54:42.616 INFO:tasks.workunit.client.0.smithi090.stdout:0/432: creat d14/d19/d2b/d66/f8c x:0 0 0 2024-04-20T10:54:42.617 INFO:tasks.workunit.client.0.smithi090.stdout:0/433: write d14/d19/d2b/f51 [4607458,120588] 0 2024-04-20T10:54:42.620 INFO:tasks.workunit.client.0.smithi090.stdout:0/434: unlink d14/f2e 0 2024-04-20T10:54:42.620 INFO:tasks.workunit.client.0.smithi090.stdout:0/435: write d14/d19/d2b/f30 [5072114,106827] 0 2024-04-20T10:54:42.623 INFO:tasks.workunit.client.0.smithi090.stdout:9/399: dwrite d0/d29/d36/d63/d1f/d79/f58 [0,4194304] 0 2024-04-20T10:54:42.623 INFO:tasks.workunit.client.0.smithi090.stdout:0/436: dread d14/d19/d2b/d66/d40/f57 [0,4194304] 0 2024-04-20T10:54:42.626 INFO:tasks.workunit.client.0.smithi090.stdout:0/437: symlink d14/d19/d31/d34/d3b/l8d 0 2024-04-20T10:54:42.630 INFO:tasks.workunit.client.0.smithi090.stdout:0/438: dread d14/d19/d31/f38 [0,4194304] 0 2024-04-20T10:54:42.632 INFO:tasks.workunit.client.0.smithi090.stdout:0/439: rename d14/d19/d2b/d66 to d14/d19/d2b/d8e 0 2024-04-20T10:54:42.632 INFO:tasks.workunit.client.0.smithi090.stdout:0/440: stat d14/d19/d2b/d8e/d43/d5c/c84 0 2024-04-20T10:54:42.632 INFO:tasks.workunit.client.0.smithi090.stdout:0/441: dread - d14/d19/d2b/f82 zero size 2024-04-20T10:54:42.632 INFO:tasks.workunit.client.0.smithi090.stdout:0/442: readlink d14/d19/d2b/d8e/d40/l5d 0 2024-04-20T10:54:42.633 INFO:tasks.workunit.client.0.smithi090.stdout:0/443: creat d14/d19/d2b/d52/d55/d5b/f8f x:0 0 0 2024-04-20T10:54:42.640 INFO:tasks.workunit.client.0.smithi090.stdout:3/392: dwrite d7/d15/f23 [0,4194304] 0 2024-04-20T10:54:42.641 INFO:tasks.workunit.client.0.smithi090.stdout:3/393: write d7/d11/f32 [1115797,20070] 0 2024-04-20T10:54:42.643 INFO:tasks.workunit.client.0.smithi090.stdout:3/394: link d7/d26/d78/c7b d7/d43/c81 0 2024-04-20T10:54:42.649 INFO:tasks.workunit.client.0.smithi090.stdout:9/400: dwrite d0/d29/d4f/d6b/f72 [0,4194304] 0 2024-04-20T10:54:42.649 INFO:tasks.workunit.client.0.smithi090.stdout:0/444: dwrite d14/d19/f78 [0,4194304] 0 2024-04-20T10:54:42.650 INFO:tasks.workunit.client.0.smithi090.stdout:9/401: creat d0/d29/d4f/f84 x:0 0 0 2024-04-20T10:54:42.653 INFO:tasks.workunit.client.0.smithi090.stdout:0/445: link d14/f4b d14/d19/d2b/d52/d55/d5b/d7f/f90 0 2024-04-20T10:54:42.653 INFO:tasks.workunit.client.0.smithi090.stdout:3/395: dread d7/d15/f23 [0,4194304] 0 2024-04-20T10:54:42.654 INFO:tasks.workunit.client.0.smithi090.stdout:9/402: mkdir d0/d29/d4f/d85 0 2024-04-20T10:54:42.654 INFO:tasks.workunit.client.0.smithi090.stdout:9/403: fdatasync d0/d29/d36/d63/f2f 0 2024-04-20T10:54:42.654 INFO:tasks.workunit.client.0.smithi090.stdout:9/404: fsync d0/f6a 0 2024-04-20T10:54:42.656 INFO:tasks.workunit.client.0.smithi090.stdout:0/446: creat d14/d19/d2b/d8e/d43/d6d/f91 x:0 0 0 2024-04-20T10:54:42.657 INFO:tasks.workunit.client.0.smithi090.stdout:3/396: symlink d7/d43/l82 0 2024-04-20T10:54:42.658 INFO:tasks.workunit.client.0.smithi090.stdout:0/447: creat d14/d19/d2b/d8e/f92 x:0 0 0 2024-04-20T10:54:42.658 INFO:tasks.workunit.client.0.smithi090.stdout:3/397: symlink d7/l83 0 2024-04-20T10:54:42.676 INFO:tasks.workunit.client.0.smithi090.stdout:9/405: dwrite d0/f7c [8388608,4194304] 0 2024-04-20T10:54:42.677 INFO:tasks.workunit.client.0.smithi090.stdout:9/406: dread - d0/d29/f57 zero size 2024-04-20T10:54:42.677 INFO:tasks.workunit.client.0.smithi090.stdout:9/407: readlink d0/d29/d36/d63/d1f/l22 0 2024-04-20T10:54:42.679 INFO:tasks.workunit.client.0.smithi090.stdout:3/398: dwrite d7/d15/d47/f5a [0,4194304] 0 2024-04-20T10:54:42.680 INFO:tasks.workunit.client.0.smithi090.stdout:3/399: chown d7/d26/f3c 3 1 2024-04-20T10:54:42.681 INFO:tasks.workunit.client.0.smithi090.stdout:0/448: dwrite d14/f5f [0,4194304] 0 2024-04-20T10:54:42.682 INFO:tasks.workunit.client.0.smithi090.stdout:0/449: write d14/d19/d2b/f82 [513934,28641] 0 2024-04-20T10:54:42.682 INFO:tasks.workunit.client.0.smithi090.stdout:3/400: rename d7/df/l5d to d7/d35/l84 0 2024-04-20T10:54:42.693 INFO:tasks.workunit.client.0.smithi090.stdout:9/408: dwrite d0/d29/d4f/f10 [0,4194304] 0 2024-04-20T10:54:42.695 INFO:tasks.workunit.client.0.smithi090.stdout:9/409: mkdir d0/d86 0 2024-04-20T10:54:42.695 INFO:tasks.workunit.client.0.smithi090.stdout:9/410: chown d0/d29/d36/d63/d1c 6879 1 2024-04-20T10:54:42.695 INFO:tasks.workunit.client.0.smithi090.stdout:9/411: write d0/d29/d36/d63/d1c/f2b [801567,87660] 0 2024-04-20T10:54:42.695 INFO:tasks.workunit.client.0.smithi090.stdout:9/412: write d0/d29/d36/d63/d1f/d4d/f7b [196652,101221] 0 2024-04-20T10:54:42.695 INFO:tasks.workunit.client.0.smithi090.stdout:9/413: symlink d0/d29/l87 0 2024-04-20T10:54:42.701 INFO:tasks.workunit.client.0.smithi090.stdout:9/414: dread d0/f9 [0,4194304] 0 2024-04-20T10:54:42.707 INFO:tasks.workunit.client.0.smithi090.stdout:9/415: dread d0/f7c [0,4194304] 0 2024-04-20T10:54:42.708 INFO:tasks.workunit.client.0.smithi090.stdout:9/416: symlink d0/d29/d36/l88 0 2024-04-20T10:54:42.714 INFO:tasks.workunit.client.0.smithi090.stdout:9/417: write d0/f7c [11473911,1483] 0 2024-04-20T10:54:42.715 INFO:tasks.workunit.client.0.smithi090.stdout:9/418: rename d0/d29/d4f/d85 to d0/d29/d4f/d82/d89 0 2024-04-20T10:54:42.724 INFO:tasks.workunit.client.0.smithi090.stdout:9/419: dread d0/d29/d36/d63/d1c/f3e [0,4194304] 0 2024-04-20T10:54:42.742 INFO:tasks.workunit.client.0.smithi090.stdout:9/420: dwrite d0/d29/d36/d63/f66 [0,4194304] 0 2024-04-20T10:54:42.743 INFO:tasks.workunit.client.0.smithi090.stdout:9/421: chown d0/d29/d36/d63/d1f/d34/d70/d52 50722858 1 2024-04-20T10:54:42.744 INFO:tasks.workunit.client.0.smithi090.stdout:9/422: truncate d0/d29/d36/d63/f3f 3301459 0 2024-04-20T10:54:42.760 INFO:tasks.workunit.client.0.smithi090.stdout:9/423: dwrite d0/d29/d36/d63/d1f/d4d/f50 [0,4194304] 0 2024-04-20T10:54:42.760 INFO:tasks.workunit.client.0.smithi090.stdout:9/424: fdatasync d0/d29/f6e 0 2024-04-20T10:54:42.967 INFO:tasks.workunit.client.0.smithi090.stdout:3/401: dwrite d7/d43/f59 [0,4194304] 0 2024-04-20T10:54:42.967 INFO:tasks.workunit.client.0.smithi090.stdout:3/402: write d7/d11/f2f [115615,34537] 0 2024-04-20T10:54:42.968 INFO:tasks.workunit.client.0.smithi090.stdout:3/403: rename d7/d26/d5e/c6a to d7/d15/d47/c85 0 2024-04-20T10:54:42.969 INFO:tasks.workunit.client.0.smithi090.stdout:3/404: creat d7/f86 x:0 0 0 2024-04-20T10:54:42.971 INFO:tasks.workunit.client.0.smithi090.stdout:4/398: sync 2024-04-20T10:54:42.971 INFO:tasks.workunit.client.0.smithi090.stdout:8/387: sync 2024-04-20T10:54:42.971 INFO:tasks.workunit.client.0.smithi090.stdout:6/353: sync 2024-04-20T10:54:42.971 INFO:tasks.workunit.client.0.smithi090.stdout:2/408: sync 2024-04-20T10:54:42.971 INFO:tasks.workunit.client.0.smithi090.stdout:4/399: write d7/f38 [4736619,106677] 0 2024-04-20T10:54:42.971 INFO:tasks.workunit.client.0.smithi090.stdout:7/432: sync 2024-04-20T10:54:42.971 INFO:tasks.workunit.client.0.smithi090.stdout:5/620: sync 2024-04-20T10:54:42.972 INFO:tasks.workunit.client.0.smithi090.stdout:8/388: mkdir d0/d3a/d4a/d81 0 2024-04-20T10:54:42.973 INFO:tasks.workunit.client.0.smithi090.stdout:2/409: creat d11/d1f/d2e/f8e x:0 0 0 2024-04-20T10:54:42.973 INFO:tasks.workunit.client.0.smithi090.stdout:7/433: dread d11/d13/d5d/f80 [0,4194304] 0 2024-04-20T10:54:42.974 INFO:tasks.workunit.client.0.smithi090.stdout:4/400: write d7/d9/f35 [2625909,30872] 0 2024-04-20T10:54:42.975 INFO:tasks.workunit.client.0.smithi090.stdout:4/401: write d7/d9/f20 [270688,93630] 0 2024-04-20T10:54:42.976 INFO:tasks.workunit.client.0.smithi090.stdout:6/354: rename d1/d19/d36/d1e/d1f/d3f/d54/f5d to d1/d19/d36/d1e/f75 0 2024-04-20T10:54:42.976 INFO:tasks.workunit.client.0.smithi090.stdout:6/355: fdatasync d1/d19/d36/d1e/f75 0 2024-04-20T10:54:42.977 INFO:tasks.workunit.client.0.smithi090.stdout:8/389: unlink d0/d2d/d49/c7e 0 2024-04-20T10:54:42.979 INFO:tasks.workunit.client.0.smithi090.stdout:4/402: mknod d7/d9/d17/d56/d66/c7f 0 2024-04-20T10:54:42.979 INFO:tasks.workunit.client.0.smithi090.stdout:4/403: read d7/d9/f10 [1199324,111023] 0 2024-04-20T10:54:42.979 INFO:tasks.workunit.client.0.smithi090.stdout:1/480: sync 2024-04-20T10:54:42.979 INFO:tasks.workunit.client.0.smithi090.stdout:9/425: sync 2024-04-20T10:54:42.979 INFO:tasks.workunit.client.0.smithi090.stdout:0/450: sync 2024-04-20T10:54:42.980 INFO:tasks.workunit.client.0.smithi090.stdout:5/621: rename d1/d2f/d85/dbd/cb3 to d1/d2f/cdb 0 2024-04-20T10:54:42.980 INFO:tasks.workunit.client.0.smithi090.stdout:5/622: stat d1/d2a/ca6 0 2024-04-20T10:54:42.981 INFO:tasks.workunit.client.0.smithi090.stdout:4/404: dread d7/d9/f62 [0,4194304] 0 2024-04-20T10:54:42.981 INFO:tasks.workunit.client.0.smithi090.stdout:6/356: symlink d1/d19/d25/l76 0 2024-04-20T10:54:42.982 INFO:tasks.workunit.client.0.smithi090.stdout:6/357: write d1/d4/f30 [804290,75164] 0 2024-04-20T10:54:42.985 INFO:tasks.workunit.client.0.smithi090.stdout:1/481: unlink d8/d1a/d1d/l32 0 2024-04-20T10:54:42.985 INFO:tasks.workunit.client.0.smithi090.stdout:1/482: write d8/d1a/d1d/d2c/d6e/f72 [664692,70204] 0 2024-04-20T10:54:42.985 INFO:tasks.workunit.client.0.smithi090.stdout:1/483: readlink d8/d1a/d1d/d67/l20 0 2024-04-20T10:54:42.987 INFO:tasks.workunit.client.0.smithi090.stdout:0/451: rename d14/d19/d2b/d8e/c5e to d14/d19/d31/d34/d3b/c93 0 2024-04-20T10:54:42.990 INFO:tasks.workunit.client.0.smithi090.stdout:6/358: mknod d1/d19/c77 0 2024-04-20T10:54:42.990 INFO:tasks.workunit.client.0.smithi090.stdout:6/359: chown d1/d4/d26/f4d 456792 1 2024-04-20T10:54:42.991 INFO:tasks.workunit.client.0.smithi090.stdout:9/426: rename d0/d29/d36/d63/d1f/d4d/f7b to d0/d29/d36/d63/d1f/d79/f8a 0 2024-04-20T10:54:42.992 INFO:tasks.workunit.client.0.smithi090.stdout:5/623: symlink d1/d2f/d3d/d40/ldc 0 2024-04-20T10:54:42.993 INFO:tasks.workunit.client.0.smithi090.stdout:6/360: creat d1/d19/d25/f78 x:0 0 0 2024-04-20T10:54:42.993 INFO:tasks.workunit.client.0.smithi090.stdout:6/361: readlink d1/d19/d36/d1e/d1f/l48 0 2024-04-20T10:54:42.995 INFO:tasks.workunit.client.0.smithi090.stdout:1/484: rename d8/c8a to d8/d1a/d1d/d2c/d4a/d7b/c9d 0 2024-04-20T10:54:42.995 INFO:tasks.workunit.client.0.smithi090.stdout:1/485: fdatasync d8/d1a/d1d/f94 0 2024-04-20T10:54:42.995 INFO:tasks.workunit.client.0.smithi090.stdout:1/486: chown d8/d1a/d1d/d2c/c70 0 1 2024-04-20T10:54:42.996 INFO:tasks.workunit.client.0.smithi090.stdout:9/427: getdents d0 0 2024-04-20T10:54:42.997 INFO:tasks.workunit.client.0.smithi090.stdout:6/362: creat d1/d19/d36/d1e/d1f/d3f/f79 x:0 0 0 2024-04-20T10:54:42.997 INFO:tasks.workunit.client.0.smithi090.stdout:9/428: write d0/d29/d36/d63/d1f/d79/f75 [50612,8385] 0 2024-04-20T10:54:42.998 INFO:tasks.workunit.client.0.smithi090.stdout:1/487: mkdir d8/d1a/d1d/d2c/d4a/d93/d9e 0 2024-04-20T10:54:42.998 INFO:tasks.workunit.client.0.smithi090.stdout:1/488: write d8/d1a/d1d/d67/f90 [427958,116590] 0 2024-04-20T10:54:42.998 INFO:tasks.workunit.client.0.smithi090.stdout:6/363: creat d1/d19/d25/f7a x:0 0 0 2024-04-20T10:54:42.999 INFO:tasks.workunit.client.0.smithi090.stdout:7/434: dwrite d11/d1a/d3f/f66 [0,4194304] 0 2024-04-20T10:54:42.999 INFO:tasks.workunit.client.0.smithi090.stdout:9/429: link d0/d29/f6e d0/f8b 0 2024-04-20T10:54:43.000 INFO:tasks.workunit.client.0.smithi090.stdout:0/452: dread d14/d19/f78 [0,4194304] 0 2024-04-20T10:54:43.000 INFO:tasks.workunit.client.0.smithi090.stdout:1/489: truncate d8/fb 1814660 0 2024-04-20T10:54:43.000 INFO:tasks.workunit.client.0.smithi090.stdout:6/364: symlink d1/d19/d36/d1e/l7b 0 2024-04-20T10:54:43.002 INFO:tasks.workunit.client.0.smithi090.stdout:7/435: unlink d11/d13/d23/d6c/d72/f84 0 2024-04-20T10:54:43.002 INFO:tasks.workunit.client.0.smithi090.stdout:9/430: creat d0/d29/d36/d63/d1c/f8c x:0 0 0 2024-04-20T10:54:43.003 INFO:tasks.workunit.client.0.smithi090.stdout:1/490: getdents d8/d1a/d1d/d7a/d9a 0 2024-04-20T10:54:43.005 INFO:tasks.workunit.client.0.smithi090.stdout:6/365: creat d1/d4/d26/d11/f7c x:0 0 0 2024-04-20T10:54:43.005 INFO:tasks.workunit.client.0.smithi090.stdout:6/366: chown d1/d19/d36/d1e/d1f/d3f/f4b 1736 1 2024-04-20T10:54:43.005 INFO:tasks.workunit.client.0.smithi090.stdout:6/367: dread - d1/d19/d36/d1e/f60 zero size 2024-04-20T10:54:43.006 INFO:tasks.workunit.client.0.smithi090.stdout:7/436: rmdir d11/d13/d33/d44 39 2024-04-20T10:54:43.006 INFO:tasks.workunit.client.0.smithi090.stdout:9/431: symlink d0/d29/d4f/d82/l8d 0 2024-04-20T10:54:43.009 INFO:tasks.workunit.client.0.smithi090.stdout:0/453: link d14/d19/d2b/c2f d14/c94 0 2024-04-20T10:54:43.010 INFO:tasks.workunit.client.0.smithi090.stdout:1/491: link c2 d8/d1a/d1d/d2c/d4a/d93/d5d/c9f 0 2024-04-20T10:54:43.010 INFO:tasks.workunit.client.0.smithi090.stdout:1/492: chown d8/d1a/f74 176915 1 2024-04-20T10:54:43.010 INFO:tasks.workunit.client.0.smithi090.stdout:7/437: truncate d11/d1a/f40 3752349 0 2024-04-20T10:54:43.011 INFO:tasks.workunit.client.0.smithi090.stdout:6/368: write d1/d4/f47 [7573018,41421] 0 2024-04-20T10:54:43.016 INFO:tasks.workunit.client.0.smithi090.stdout:8/390: dwrite d0/d11/d14/f70 [0,4194304] 0 2024-04-20T10:54:43.016 INFO:tasks.workunit.client.0.smithi090.stdout:5/624: dwrite d1/d2f/d3d/d40/d6c/f82 [0,4194304] 0 2024-04-20T10:54:43.017 INFO:tasks.workunit.client.0.smithi090.stdout:5/625: chown d1/da/fc3 7179 1 2024-04-20T10:54:43.018 INFO:tasks.workunit.client.0.smithi090.stdout:8/391: creat d0/d11/d14/d52/f82 x:0 0 0 2024-04-20T10:54:43.019 INFO:tasks.workunit.client.0.smithi090.stdout:0/454: dread d14/d19/d2b/d8e/d43/f4a [0,4194304] 0 2024-04-20T10:54:43.020 INFO:tasks.workunit.client.0.smithi090.stdout:2/410: dwrite d11/d1f/d2e/f3d [0,4194304] 0 2024-04-20T10:54:43.020 INFO:tasks.workunit.client.0.smithi090.stdout:4/405: dwrite d7/d9/d17/f3f [0,4194304] 0 2024-04-20T10:54:43.020 INFO:tasks.workunit.client.0.smithi090.stdout:2/411: chown d11/d1f/d2e/f5d 618309430 1 2024-04-20T10:54:43.020 INFO:tasks.workunit.client.0.smithi090.stdout:4/406: stat d7/d9/d47/d63/d3d/l5c 0 2024-04-20T10:54:43.020 INFO:tasks.workunit.client.0.smithi090.stdout:4/407: stat d7/d9/d17/d56/c7e 0 2024-04-20T10:54:43.021 INFO:tasks.workunit.client.0.smithi090.stdout:4/408: readlink d7/d9/l3b 0 2024-04-20T10:54:43.021 INFO:tasks.workunit.client.0.smithi090.stdout:2/412: write d11/d1f/d2e/f88 [492080,86996] 0 2024-04-20T10:54:43.022 INFO:tasks.workunit.client.0.smithi090.stdout:5/626: mkdir d1/d41/d98/daf/ddd 0 2024-04-20T10:54:43.023 INFO:tasks.workunit.client.0.smithi090.stdout:4/409: mknod d7/d9/d47/d63/d42/c80 0 2024-04-20T10:54:43.025 INFO:tasks.workunit.client.0.smithi090.stdout:1/493: getdents d8/d1a/d1d/d2c/d4a/d7b 0 2024-04-20T10:54:43.026 INFO:tasks.workunit.client.0.smithi090.stdout:9/432: dwrite d0/d29/d36/d63/d1c/f21 [0,4194304] 0 2024-04-20T10:54:43.026 INFO:tasks.workunit.client.0.smithi090.stdout:9/433: dread - d0/d29/d4f/f84 zero size 2024-04-20T10:54:43.026 INFO:tasks.workunit.client.0.smithi090.stdout:0/455: dread f9 [0,4194304] 0 2024-04-20T10:54:43.027 INFO:tasks.workunit.client.0.smithi090.stdout:9/434: read d0/d29/d36/d63/d1f/d79/f59 [201249,87874] 0 2024-04-20T10:54:43.027 INFO:tasks.workunit.client.0.smithi090.stdout:9/435: fsync d0/f11 0 2024-04-20T10:54:43.028 INFO:tasks.workunit.client.0.smithi090.stdout:4/410: creat d7/d9/d17/d56/d66/d70/f81 x:0 0 0 2024-04-20T10:54:43.030 INFO:tasks.workunit.client.0.smithi090.stdout:7/438: dread d11/d13/d22/d24/d35/f47 [0,4194304] 0 2024-04-20T10:54:43.030 INFO:tasks.workunit.client.0.smithi090.stdout:1/494: mknod d8/d1a/d1d/d7a/ca0 0 2024-04-20T10:54:43.033 INFO:tasks.workunit.client.0.smithi090.stdout:0/456: rmdir d14/d19/d2b/d8e/d40 39 2024-04-20T10:54:43.034 INFO:tasks.workunit.client.0.smithi090.stdout:5/627: rename d1/d2f/d3d/d40/d70/f73 to d1/da/d14/fde 0 2024-04-20T10:54:43.036 INFO:tasks.workunit.client.0.smithi090.stdout:9/436: symlink d0/d29/d36/d63/d1f/d4d/l8e 0 2024-04-20T10:54:43.037 INFO:tasks.workunit.client.0.smithi090.stdout:4/411: mknod d7/d9/d47/c82 0 2024-04-20T10:54:43.039 INFO:tasks.workunit.client.0.smithi090.stdout:6/369: dwrite d1/d19/d36/d1e/d1f/d3f/f4b [0,4194304] 0 2024-04-20T10:54:43.039 INFO:tasks.workunit.client.0.smithi090.stdout:6/370: chown d1/d19/f57 28128600 1 2024-04-20T10:54:43.040 INFO:tasks.workunit.client.0.smithi090.stdout:7/439: symlink d11/d13/d33/d44/l93 0 2024-04-20T10:54:43.040 INFO:tasks.workunit.client.0.smithi090.stdout:8/392: dwrite d0/f20 [0,4194304] 0 2024-04-20T10:54:43.040 INFO:tasks.workunit.client.0.smithi090.stdout:8/393: chown d0/d3a/d4a/d81 1994396 1 2024-04-20T10:54:43.041 INFO:tasks.workunit.client.0.smithi090.stdout:1/495: creat d8/fa1 x:0 0 0 2024-04-20T10:54:43.041 INFO:tasks.workunit.client.0.smithi090.stdout:1/496: write d8/d1a/d1d/d2c/d4a/d5a/f81 [452863,110707] 0 2024-04-20T10:54:43.043 INFO:tasks.workunit.client.0.smithi090.stdout:5/628: unlink d1/da/d14/f4c 0 2024-04-20T10:54:43.043 INFO:tasks.workunit.client.0.smithi090.stdout:5/629: truncate d1/de/dcf/f79 77614 0 2024-04-20T10:54:43.045 INFO:tasks.workunit.client.0.smithi090.stdout:9/437: creat d0/d86/f8f x:0 0 0 2024-04-20T10:54:43.045 INFO:tasks.workunit.client.0.smithi090.stdout:9/438: chown d0/f6a 16526922 1 2024-04-20T10:54:43.045 INFO:tasks.workunit.client.0.smithi090.stdout:0/457: read d14/d19/d2b/f30 [4036331,84316] 0 2024-04-20T10:54:43.050 INFO:tasks.workunit.client.0.smithi090.stdout:6/371: getdents d1/d4 0 2024-04-20T10:54:43.050 INFO:tasks.workunit.client.0.smithi090.stdout:7/440: write d11/d13/d22/d24/f69 [2943504,63767] 0 2024-04-20T10:54:43.052 INFO:tasks.workunit.client.0.smithi090.stdout:8/394: write d0/d11/d14/f7c [3730367,69092] 0 2024-04-20T10:54:43.053 INFO:tasks.workunit.client.0.smithi090.stdout:1/497: rename d8/d1a/d1d/d67/c1b to d8/d1a/d1d/d2c/d6e/ca2 0 2024-04-20T10:54:43.054 INFO:tasks.workunit.client.0.smithi090.stdout:7/441: dread d11/d1a/d2f/f3e [0,4194304] 0 2024-04-20T10:54:43.054 INFO:tasks.workunit.client.0.smithi090.stdout:7/442: fsync d11/d13/d22/d24/f2e 0 2024-04-20T10:54:43.055 INFO:tasks.workunit.client.0.smithi090.stdout:0/458: mknod d14/d19/d2b/d8e/d43/d6d/c95 0 2024-04-20T10:54:43.056 INFO:tasks.workunit.client.0.smithi090.stdout:2/413: truncate d11/d1f/d2e/f88 358892 0 2024-04-20T10:54:43.058 INFO:tasks.workunit.client.0.smithi090.stdout:8/395: mknod d0/d3a/c83 0 2024-04-20T10:54:43.058 INFO:tasks.workunit.client.0.smithi090.stdout:8/396: write d0/d2d/d49/f73 [5398437,33626] 0 2024-04-20T10:54:43.059 INFO:tasks.workunit.client.0.smithi090.stdout:5/630: rename d1/da/d16/lc5 to d1/de/dcf/ldf 0 2024-04-20T10:54:43.059 INFO:tasks.workunit.client.0.smithi090.stdout:5/631: chown d1/d2a/ca6 20065692 1 2024-04-20T10:54:43.059 INFO:tasks.workunit.client.0.smithi090.stdout:5/632: dread - d1/d2f/f83 zero size 2024-04-20T10:54:43.060 INFO:tasks.workunit.client.0.smithi090.stdout:7/443: creat d11/d13/d33/d44/f94 x:0 0 0 2024-04-20T10:54:43.060 INFO:tasks.workunit.client.0.smithi090.stdout:7/444: readlink d11/d13/d22/d24/l28 0 2024-04-20T10:54:43.061 INFO:tasks.workunit.client.0.smithi090.stdout:6/372: dread d1/d4/f47 [0,4194304] 0 2024-04-20T10:54:43.061 INFO:tasks.workunit.client.0.smithi090.stdout:6/373: write d1/fd [2186587,31673] 0 2024-04-20T10:54:43.062 INFO:tasks.workunit.client.0.smithi090.stdout:8/397: creat d0/d2d/f84 x:0 0 0 2024-04-20T10:54:43.063 INFO:tasks.workunit.client.0.smithi090.stdout:1/498: rename d8/fa1 to d8/d1a/d1d/d2c/d4a/d93/d9e/fa3 0 2024-04-20T10:54:43.064 INFO:tasks.workunit.client.0.smithi090.stdout:4/412: dwrite d7/d9/d17/f37 [0,4194304] 0 2024-04-20T10:54:43.064 INFO:tasks.workunit.client.0.smithi090.stdout:5/633: truncate d1/d2a/f3e 3217759 0 2024-04-20T10:54:43.065 INFO:tasks.workunit.client.0.smithi090.stdout:7/445: mknod d11/d13/d23/c95 0 2024-04-20T10:54:43.067 INFO:tasks.workunit.client.0.smithi090.stdout:0/459: mknod d14/c96 0 2024-04-20T10:54:43.068 INFO:tasks.workunit.client.0.smithi090.stdout:8/398: creat d0/d26/f85 x:0 0 0 2024-04-20T10:54:43.071 INFO:tasks.workunit.client.0.smithi090.stdout:1/499: unlink d8/d1a/d1d/d2c/d4a/d5a/f81 0 2024-04-20T10:54:43.071 INFO:tasks.workunit.client.0.smithi090.stdout:9/439: dwrite d0/d29/d36/d63/f2f [0,4194304] 0 2024-04-20T10:54:43.071 INFO:tasks.workunit.client.0.smithi090.stdout:9/440: chown d0/d29/d36/d63/d1f/d34/f43 3 1 2024-04-20T10:54:43.071 INFO:tasks.workunit.client.0.smithi090.stdout:9/441: write d0/d29/d36/d63/d1c/f83 [1021356,63518] 0 2024-04-20T10:54:43.072 INFO:tasks.workunit.client.0.smithi090.stdout:2/414: read d11/f28 [615624,91085] 0 2024-04-20T10:54:43.073 INFO:tasks.workunit.client.0.smithi090.stdout:2/415: write d11/d1a/d30/f48 [1933907,23849] 0 2024-04-20T10:54:43.073 INFO:tasks.workunit.client.0.smithi090.stdout:4/413: rmdir d7/d9 39 2024-04-20T10:54:43.073 INFO:tasks.workunit.client.0.smithi090.stdout:4/414: chown d7/l1f 43354529 1 2024-04-20T10:54:43.073 INFO:tasks.workunit.client.0.smithi090.stdout:6/374: write d1/d4/d26/d11/d4a/d56/f4f [2270291,27093] 0 2024-04-20T10:54:43.073 INFO:tasks.workunit.client.0.smithi090.stdout:5/634: rmdir d1/de/dcf 39 2024-04-20T10:54:43.076 INFO:tasks.workunit.client.0.smithi090.stdout:7/446: creat d11/d13/d5d/f96 x:0 0 0 2024-04-20T10:54:43.076 INFO:tasks.workunit.client.0.smithi090.stdout:7/447: fdatasync d11/d13/d5d/f96 0 2024-04-20T10:54:43.077 INFO:tasks.workunit.client.0.smithi090.stdout:0/460: creat d14/d19/d2b/d8e/d43/d73/f97 x:0 0 0 2024-04-20T10:54:43.077 INFO:tasks.workunit.client.0.smithi090.stdout:9/442: dread d0/d29/d36/d63/d1c/f3e [0,4194304] 0 2024-04-20T10:54:43.079 INFO:tasks.workunit.client.0.smithi090.stdout:1/500: link d8/d1a/d1d/d2c/d4a/d5a/f69 d8/d1a/d1d/d2c/d4a/d93/fa4 0 2024-04-20T10:54:43.079 INFO:tasks.workunit.client.0.smithi090.stdout:1/501: write d8/d1a/d1d/d2c/d62/f78 [4859025,88037] 0 2024-04-20T10:54:43.082 INFO:tasks.workunit.client.0.smithi090.stdout:0/461: dread d14/d19/f1b [0,4194304] 0 2024-04-20T10:54:43.083 INFO:tasks.workunit.client.0.smithi090.stdout:4/415: symlink d7/d9/d47/l83 0 2024-04-20T10:54:43.084 INFO:tasks.workunit.client.0.smithi090.stdout:6/375: creat d1/d19/d36/f7d x:0 0 0 2024-04-20T10:54:43.085 INFO:tasks.workunit.client.0.smithi090.stdout:5/635: mkdir d1/da/d1f/dad/de0 0 2024-04-20T10:54:43.085 INFO:tasks.workunit.client.0.smithi090.stdout:5/636: read - d1/da/d1f/dad/fcc zero size 2024-04-20T10:54:43.085 INFO:tasks.workunit.client.0.smithi090.stdout:5/637: fdatasync d1/d2f/d3d/d40/d70/fbb 0 2024-04-20T10:54:43.086 INFO:tasks.workunit.client.0.smithi090.stdout:7/448: symlink d11/d13/d22/d24/l97 0 2024-04-20T10:54:43.086 INFO:tasks.workunit.client.0.smithi090.stdout:9/443: truncate d0/ff 3517199 0 2024-04-20T10:54:43.087 INFO:tasks.workunit.client.0.smithi090.stdout:1/502: truncate d8/f34 258712 0 2024-04-20T10:54:43.087 INFO:tasks.workunit.client.0.smithi090.stdout:8/399: dwrite d0/f2 [0,4194304] 0 2024-04-20T10:54:43.087 INFO:tasks.workunit.client.0.smithi090.stdout:0/462: mknod d14/d19/d2b/d8e/d43/d6d/c98 0 2024-04-20T10:54:43.089 INFO:tasks.workunit.client.0.smithi090.stdout:1/503: write d8/d1a/d1d/d2c/d3f/f53 [415271,4636] 0 2024-04-20T10:54:43.089 INFO:tasks.workunit.client.0.smithi090.stdout:4/416: creat d7/d9/d17/d56/f84 x:0 0 0 2024-04-20T10:54:43.089 INFO:tasks.workunit.client.0.smithi090.stdout:4/417: fdatasync d7/d9/d47/f6f 0 2024-04-20T10:54:43.089 INFO:tasks.workunit.client.0.smithi090.stdout:4/418: write d7/d9/d47/d63/f34 [4633638,88107] 0 2024-04-20T10:54:43.089 INFO:tasks.workunit.client.0.smithi090.stdout:4/419: chown d7/d9/ld 341219 1 2024-04-20T10:54:43.089 INFO:tasks.workunit.client.0.smithi090.stdout:6/376: creat d1/d4/f7e x:0 0 0 2024-04-20T10:54:43.090 INFO:tasks.workunit.client.0.smithi090.stdout:7/449: mkdir d11/d13/d33/d44/d89/d98 0 2024-04-20T10:54:43.090 INFO:tasks.workunit.client.0.smithi090.stdout:7/450: chown d11/d13/d23/f62 4919226 1 2024-04-20T10:54:43.090 INFO:tasks.workunit.client.0.smithi090.stdout:7/451: write d11/d13/d33/f54 [611598,40135] 0 2024-04-20T10:54:43.094 INFO:tasks.workunit.client.0.smithi090.stdout:2/416: dwrite d11/d1a/d4a/d59/f5c [0,4194304] 0 2024-04-20T10:54:43.098 INFO:tasks.workunit.client.0.smithi090.stdout:5/638: read d1/d2f/d3d/d40/f90 [3926942,39811] 0 2024-04-20T10:54:43.098 INFO:tasks.workunit.client.0.smithi090.stdout:5/639: write d1/da/d14/fde [58830,110646] 0 2024-04-20T10:54:43.102 INFO:tasks.workunit.client.0.smithi090.stdout:2/417: read d11/d1a/d37/f4f [1655860,53991] 0 2024-04-20T10:54:43.102 INFO:tasks.workunit.client.0.smithi090.stdout:2/418: write d11/d1a/d4a/f8c [336448,104181] 0 2024-04-20T10:54:43.106 INFO:tasks.workunit.client.0.smithi090.stdout:5/640: write d1/d55/fa7 [720104,114069] 0 2024-04-20T10:54:43.107 INFO:tasks.workunit.client.0.smithi090.stdout:8/400: creat d0/d26/f86 x:0 0 0 2024-04-20T10:54:43.108 INFO:tasks.workunit.client.0.smithi090.stdout:0/463: getdents d14/d19/d2b/d52 0 2024-04-20T10:54:43.109 INFO:tasks.workunit.client.0.smithi090.stdout:1/504: unlink d8/f54 0 2024-04-20T10:54:43.110 INFO:tasks.workunit.client.0.smithi090.stdout:4/420: creat d7/d9/d17/d56/d66/f85 x:0 0 0 2024-04-20T10:54:43.110 INFO:tasks.workunit.client.0.smithi090.stdout:1/505: dread d8/d1a/d1d/d2c/f51 [0,4194304] 0 2024-04-20T10:54:43.114 INFO:tasks.workunit.client.0.smithi090.stdout:6/377: rename d1/d4/d26/d11/f7c to d1/d4/d26/d11/d4a/d70/f7f 0 2024-04-20T10:54:43.114 INFO:tasks.workunit.client.0.smithi090.stdout:6/378: read - d1/d19/d36/d1e/d1f/d3f/d54/f62 zero size 2024-04-20T10:54:43.116 INFO:tasks.workunit.client.0.smithi090.stdout:7/452: creat d11/d1a/d3b/d79/f99 x:0 0 0 2024-04-20T10:54:43.117 INFO:tasks.workunit.client.0.smithi090.stdout:2/419: creat d11/d1f/d2e/f8f x:0 0 0 2024-04-20T10:54:43.120 INFO:tasks.workunit.client.0.smithi090.stdout:0/464: symlink d14/d19/d2b/d8e/d43/d6d/l99 0 2024-04-20T10:54:43.121 INFO:tasks.workunit.client.0.smithi090.stdout:1/506: mkdir d8/d1a/d4d/da5 0 2024-04-20T10:54:43.121 INFO:tasks.workunit.client.0.smithi090.stdout:1/507: chown d8/d1a/d1d/d67/c26 19 1 2024-04-20T10:54:43.122 INFO:tasks.workunit.client.0.smithi090.stdout:6/379: mkdir d1/d4/d26/d11/d35/d80 0 2024-04-20T10:54:43.123 INFO:tasks.workunit.client.0.smithi090.stdout:7/453: rename d11/d13/f5c to d11/d13/d5b/f9a 0 2024-04-20T10:54:43.124 INFO:tasks.workunit.client.0.smithi090.stdout:2/420: unlink d11/d1a/d37/c64 0 2024-04-20T10:54:43.125 INFO:tasks.workunit.client.0.smithi090.stdout:5/641: mknod d1/de/ce1 0 2024-04-20T10:54:43.126 INFO:tasks.workunit.client.0.smithi090.stdout:5/642: dread d1/de/f20 [4194304,4194304] 0 2024-04-20T10:54:43.127 INFO:tasks.workunit.client.0.smithi090.stdout:0/465: creat d14/d19/d2b/d8e/d43/f9a x:0 0 0 2024-04-20T10:54:43.129 INFO:tasks.workunit.client.0.smithi090.stdout:1/508: creat d8/d1a/d1d/d2c/d4a/fa6 x:0 0 0 2024-04-20T10:54:43.129 INFO:tasks.workunit.client.0.smithi090.stdout:6/380: getdents d1/d19/d36/d1e/d1f/d3f/d54 0 2024-04-20T10:54:43.131 INFO:tasks.workunit.client.0.smithi090.stdout:7/454: symlink d11/d13/d23/l9b 0 2024-04-20T10:54:43.131 INFO:tasks.workunit.client.0.smithi090.stdout:7/455: dread - d11/d13/d22/d24/f7b zero size 2024-04-20T10:54:43.131 INFO:tasks.workunit.client.0.smithi090.stdout:7/456: dread - d11/d13/f8c zero size 2024-04-20T10:54:43.131 INFO:tasks.workunit.client.0.smithi090.stdout:7/457: truncate d11/d13/d22/d24/d35/f47 5465516 0 2024-04-20T10:54:43.131 INFO:tasks.workunit.client.0.smithi090.stdout:2/421: creat d11/d1a/d30/f90 x:0 0 0 2024-04-20T10:54:43.133 INFO:tasks.workunit.client.0.smithi090.stdout:8/401: dwrite d0/d11/d14/f7c [0,4194304] 0 2024-04-20T10:54:43.134 INFO:tasks.workunit.client.0.smithi090.stdout:8/402: readlink d0/l72 0 2024-04-20T10:54:43.134 INFO:tasks.workunit.client.0.smithi090.stdout:1/509: creat d8/d1a/d1d/d2c/d3f/fa7 x:0 0 0 2024-04-20T10:54:43.134 INFO:tasks.workunit.client.0.smithi090.stdout:1/510: readlink d8/d1a/d1d/d2c/d4a/d93/l43 0 2024-04-20T10:54:43.134 INFO:tasks.workunit.client.0.smithi090.stdout:6/381: mkdir d1/d19/d36/d1e/d1f/d3f/d81 0 2024-04-20T10:54:43.135 INFO:tasks.workunit.client.0.smithi090.stdout:7/458: creat d11/d13/d23/d6c/d72/f9c x:0 0 0 2024-04-20T10:54:43.136 INFO:tasks.workunit.client.0.smithi090.stdout:2/422: getdents d11/d1a/d4a/d55/d67 0 2024-04-20T10:54:43.138 INFO:tasks.workunit.client.0.smithi090.stdout:0/466: truncate d14/f2a 2230837 0 2024-04-20T10:54:43.138 INFO:tasks.workunit.client.0.smithi090.stdout:0/467: write d14/d19/d2b/d52/d55/d5b/d7f/f8b [667084,90818] 0 2024-04-20T10:54:43.139 INFO:tasks.workunit.client.0.smithi090.stdout:8/403: creat d0/d2d/d49/d67/f87 x:0 0 0 2024-04-20T10:54:43.141 INFO:tasks.workunit.client.0.smithi090.stdout:9/444: truncate d0/ff 4258346 0 2024-04-20T10:54:43.141 INFO:tasks.workunit.client.0.smithi090.stdout:9/445: chown d0/d29/f6e 54 1 2024-04-20T10:54:43.142 INFO:tasks.workunit.client.0.smithi090.stdout:1/511: mknod d8/d1a/d1d/d2c/ca8 0 2024-04-20T10:54:43.142 INFO:tasks.workunit.client.0.smithi090.stdout:1/512: stat d8/d1a/d1d/d2c/d4a/fa6 0 2024-04-20T10:54:43.143 INFO:tasks.workunit.client.0.smithi090.stdout:5/643: write d1/de/d75/f95 [1806039,6655] 0 2024-04-20T10:54:43.143 INFO:tasks.workunit.client.0.smithi090.stdout:2/423: symlink d11/d1a/d4a/l91 0 2024-04-20T10:54:43.145 INFO:tasks.workunit.client.0.smithi090.stdout:0/468: stat d14/d19/d2b/d8e/c6a 0 2024-04-20T10:54:43.146 INFO:tasks.workunit.client.0.smithi090.stdout:8/404: rename d0/c5d to d0/d11/c88 0 2024-04-20T10:54:43.148 INFO:tasks.workunit.client.0.smithi090.stdout:5/644: rmdir d1/d2f/d85/dbd 39 2024-04-20T10:54:43.148 INFO:tasks.workunit.client.0.smithi090.stdout:5/645: readlink d1/d2f/d3d/l9e 0 2024-04-20T10:54:43.149 INFO:tasks.workunit.client.0.smithi090.stdout:2/424: symlink d11/d1a/d30/d8d/l92 0 2024-04-20T10:54:43.151 INFO:tasks.workunit.client.0.smithi090.stdout:0/469: mkdir d14/d19/d2b/d8e/d43/d5c/d70/d9b 0 2024-04-20T10:54:43.154 INFO:tasks.workunit.client.0.smithi090.stdout:7/459: dread d11/d13/d23/f45 [0,4194304] 0 2024-04-20T10:54:43.154 INFO:tasks.workunit.client.0.smithi090.stdout:6/382: dwrite d1/d19/d36/d1e/f60 [0,4194304] 0 2024-04-20T10:54:43.155 INFO:tasks.workunit.client.0.smithi090.stdout:8/405: rmdir d0/d2d/d44 39 2024-04-20T10:54:43.155 INFO:tasks.workunit.client.0.smithi090.stdout:5/646: rmdir d1/d2f/d3d/d40/d70 39 2024-04-20T10:54:43.155 INFO:tasks.workunit.client.0.smithi090.stdout:8/406: dread - d0/f27 zero size 2024-04-20T10:54:43.155 INFO:tasks.workunit.client.0.smithi090.stdout:2/425: link d11/d1a/d37/f77 d11/d1a/d37/f93 0 2024-04-20T10:54:43.157 INFO:tasks.workunit.client.0.smithi090.stdout:5/647: dread d1/da/d1f/f9b [0,4194304] 0 2024-04-20T10:54:43.157 INFO:tasks.workunit.client.0.smithi090.stdout:5/648: write d1/da/d14/d47/d50/f5c [339375,50333] 0 2024-04-20T10:54:43.157 INFO:tasks.workunit.client.0.smithi090.stdout:5/649: dread - d1/da/d1f/f97 zero size 2024-04-20T10:54:43.160 INFO:tasks.workunit.client.0.smithi090.stdout:7/460: unlink d11/d13/d22/d24/d35/f47 0 2024-04-20T10:54:43.162 INFO:tasks.workunit.client.0.smithi090.stdout:8/407: creat d0/d11/d14/d52/f89 x:0 0 0 2024-04-20T10:54:43.162 INFO:tasks.workunit.client.0.smithi090.stdout:6/383: dread d1/d4/d26/d11/d4a/d70/f72 [0,4194304] 0 2024-04-20T10:54:43.163 INFO:tasks.workunit.client.0.smithi090.stdout:5/650: mknod d1/da/d1f/ce2 0 2024-04-20T10:54:43.164 INFO:tasks.workunit.client.0.smithi090.stdout:8/408: rename d0/l56 to d0/d26/l8a 0 2024-04-20T10:54:43.165 INFO:tasks.workunit.client.0.smithi090.stdout:6/384: creat d1/d4/d26/d11/d35/d80/f82 x:0 0 0 2024-04-20T10:54:43.166 INFO:tasks.workunit.client.0.smithi090.stdout:5/651: symlink d1/d2f/d3d/le3 0 2024-04-20T10:54:43.170 INFO:tasks.workunit.client.0.smithi090.stdout:8/409: mknod d0/c8b 0 2024-04-20T10:54:43.170 INFO:tasks.workunit.client.0.smithi090.stdout:6/385: rename d1/d19/d36/d1e/f75 to d1/d4/d26/d11/d4a/f83 0 2024-04-20T10:54:43.170 INFO:tasks.workunit.client.0.smithi090.stdout:3/405: sync 2024-04-20T10:54:43.171 INFO:tasks.workunit.client.0.smithi090.stdout:0/470: unlink d14/f2a 0 2024-04-20T10:54:43.171 INFO:tasks.workunit.client.0.smithi090.stdout:0/471: chown d14/d19/d2b/d8e/d43/d6d/l99 1928002 1 2024-04-20T10:54:43.180 INFO:tasks.workunit.client.0.smithi090.stdout:3/406: dread d7/d43/f59 [0,4194304] 0 2024-04-20T10:54:43.182 INFO:tasks.workunit.client.0.smithi090.stdout:7/461: dwrite d11/d13/d33/d44/f7c [0,4194304] 0 2024-04-20T10:54:43.182 INFO:tasks.workunit.client.0.smithi090.stdout:9/446: dread d0/ff [0,4194304] 0 2024-04-20T10:54:43.182 INFO:tasks.workunit.client.0.smithi090.stdout:2/426: dwrite d11/d1f/d2e/f8e [0,4194304] 0 2024-04-20T10:54:43.182 INFO:tasks.workunit.client.0.smithi090.stdout:2/427: chown d11/d1a/d4a/d55/f69 60894 1 2024-04-20T10:54:43.182 INFO:tasks.workunit.client.0.smithi090.stdout:2/428: chown d11/d1a/d4a/l6f 0 1 2024-04-20T10:54:43.183 INFO:tasks.workunit.client.0.smithi090.stdout:2/429: write d11/d1a/d2b/f56 [482661,68133] 0 2024-04-20T10:54:43.184 INFO:tasks.workunit.client.0.smithi090.stdout:3/407: write d7/d43/f59 [321962,14032] 0 2024-04-20T10:54:43.185 INFO:tasks.workunit.client.0.smithi090.stdout:7/462: rename d11/d13/d33/f74 to d11/d13/d33/f9d 0 2024-04-20T10:54:43.185 INFO:tasks.workunit.client.0.smithi090.stdout:7/463: chown d11/d1a/d3f 625 1 2024-04-20T10:54:43.188 INFO:tasks.workunit.client.0.smithi090.stdout:8/410: dwrite d0/d11/d22/d53/f75 [0,4194304] 0 2024-04-20T10:54:43.189 INFO:tasks.workunit.client.0.smithi090.stdout:8/411: chown d0/d11/d22 913 1 2024-04-20T10:54:43.189 INFO:tasks.workunit.client.0.smithi090.stdout:8/412: stat d0/d11/f1a 0 2024-04-20T10:54:43.189 INFO:tasks.workunit.client.0.smithi090.stdout:8/413: fsync d0/d11/d22/d53/d57/f61 0 2024-04-20T10:54:43.189 INFO:tasks.workunit.client.0.smithi090.stdout:9/447: mknod d0/d29/d4f/d6b/c90 0 2024-04-20T10:54:43.191 INFO:tasks.workunit.client.0.smithi090.stdout:2/430: symlink d11/d1a/d2b/l94 0 2024-04-20T10:54:43.192 INFO:tasks.workunit.client.0.smithi090.stdout:2/431: readlink d11/d1a/d4a/d55/l60 0 2024-04-20T10:54:43.192 INFO:tasks.workunit.client.0.smithi090.stdout:6/386: getdents d1/d4/d26/d11/d35/d80 0 2024-04-20T10:54:43.193 INFO:tasks.workunit.client.0.smithi090.stdout:0/472: write f5 [3690391,129094] 0 2024-04-20T10:54:43.194 INFO:tasks.workunit.client.0.smithi090.stdout:7/464: mknod d11/d13/d23/d6c/c9e 0 2024-04-20T10:54:43.200 INFO:tasks.workunit.client.0.smithi090.stdout:6/387: link d1/d4/d26/l67 d1/d4/l84 0 2024-04-20T10:54:43.200 INFO:tasks.workunit.client.0.smithi090.stdout:6/388: truncate d1/d4/f66 242906 0 2024-04-20T10:54:43.202 INFO:tasks.workunit.client.0.smithi090.stdout:7/465: rmdir d11 39 2024-04-20T10:54:43.202 INFO:tasks.workunit.client.0.smithi090.stdout:7/466: fsync f0 0 2024-04-20T10:54:43.202 INFO:tasks.workunit.client.0.smithi090.stdout:7/467: write d11/d13/d22/f4b [5054227,120323] 0 2024-04-20T10:54:43.202 INFO:tasks.workunit.client.0.smithi090.stdout:7/468: fsync d11/d1a/d2f/f3e 0 2024-04-20T10:54:43.204 INFO:tasks.workunit.client.0.smithi090.stdout:7/469: creat d11/d13/d33/d44/d89/f9f x:0 0 0 2024-04-20T10:54:43.204 INFO:tasks.workunit.client.0.smithi090.stdout:7/470: chown d11/d13/d23 1924556 1 2024-04-20T10:54:43.206 INFO:tasks.workunit.client.0.smithi090.stdout:6/389: dread d1/d4/f30 [0,4194304] 0 2024-04-20T10:54:43.206 INFO:tasks.workunit.client.0.smithi090.stdout:6/390: chown d1/d19/d25/c45 324144 1 2024-04-20T10:54:43.206 INFO:tasks.workunit.client.0.smithi090.stdout:6/391: chown d1/d4/d26/d11/f2c 16704 1 2024-04-20T10:54:43.206 INFO:tasks.workunit.client.0.smithi090.stdout:6/392: fdatasync d1/d19/d36/d28/f2a 0 2024-04-20T10:54:43.206 INFO:tasks.workunit.client.0.smithi090.stdout:6/393: truncate d1/d4/d26/d11/f71 55989 0 2024-04-20T10:54:43.206 INFO:tasks.workunit.client.0.smithi090.stdout:7/471: rename lc to d11/d1a/d3b/d79/la0 0 2024-04-20T10:54:43.207 INFO:tasks.workunit.client.0.smithi090.stdout:7/472: symlink d11/d13/d5d/d65/la1 0 2024-04-20T10:54:43.208 INFO:tasks.workunit.client.0.smithi090.stdout:7/473: rename d11/d13/d22/d24/l88 to d11/d13/d22/d8f/la2 0 2024-04-20T10:54:43.209 INFO:tasks.workunit.client.0.smithi090.stdout:7/474: symlink d11/d13/la3 0 2024-04-20T10:54:43.218 INFO:tasks.workunit.client.0.smithi090.stdout:3/408: dwrite d7/d15/d47/f5a [0,4194304] 0 2024-04-20T10:54:43.219 INFO:tasks.workunit.client.0.smithi090.stdout:3/409: mknod d7/d43/c87 0 2024-04-20T10:54:43.219 INFO:tasks.workunit.client.0.smithi090.stdout:8/414: dwrite d0/d11/d22/d53/f75 [0,4194304] 0 2024-04-20T10:54:43.232 INFO:tasks.workunit.client.0.smithi090.stdout:6/394: dwrite d1/d4/d26/d11/d4a/d56/f61 [0,4194304] 0 2024-04-20T10:54:43.232 INFO:tasks.workunit.client.0.smithi090.stdout:2/432: dwrite d11/d1a/d2b/f2f [4194304,4194304] 0 2024-04-20T10:54:43.232 INFO:tasks.workunit.client.0.smithi090.stdout:2/433: write d11/f7a [942442,92389] 0 2024-04-20T10:54:43.232 INFO:tasks.workunit.client.0.smithi090.stdout:2/434: write d11/d1f/d2e/d6e/f7c [554526,125775] 0 2024-04-20T10:54:43.233 INFO:tasks.workunit.client.0.smithi090.stdout:2/435: chown d11/d1a/d30/l82 335659501 1 2024-04-20T10:54:43.233 INFO:tasks.workunit.client.0.smithi090.stdout:2/436: creat d11/d1a/d37/d85/f95 x:0 0 0 2024-04-20T10:54:43.233 INFO:tasks.workunit.client.0.smithi090.stdout:2/437: mknod d11/d1a/d4a/d55/d67/c96 0 2024-04-20T10:54:43.234 INFO:tasks.workunit.client.0.smithi090.stdout:2/438: fdatasync d11/d1a/d37/f93 0 2024-04-20T10:54:43.234 INFO:tasks.workunit.client.0.smithi090.stdout:2/439: write d11/d1f/d2e/d6e/f7c [370483,103700] 0 2024-04-20T10:54:43.234 INFO:tasks.workunit.client.0.smithi090.stdout:2/440: dread - d11/d1a/d2b/f84 zero size 2024-04-20T10:54:43.234 INFO:tasks.workunit.client.0.smithi090.stdout:2/441: write d11/f19 [759449,18287] 0 2024-04-20T10:54:43.235 INFO:tasks.workunit.client.0.smithi090.stdout:2/442: mkdir d11/d97 0 2024-04-20T10:54:43.236 INFO:tasks.workunit.client.0.smithi090.stdout:2/443: creat d11/d1a/d37/d85/f98 x:0 0 0 2024-04-20T10:54:43.241 INFO:tasks.workunit.client.0.smithi090.stdout:0/473: dwrite ff [0,4194304] 0 2024-04-20T10:54:43.241 INFO:tasks.workunit.client.0.smithi090.stdout:0/474: rmdir d14/d19/d2b 39 2024-04-20T10:54:43.241 INFO:tasks.workunit.client.0.smithi090.stdout:6/395: write d1/d19/f2d [2797502,82784] 0 2024-04-20T10:54:43.242 INFO:tasks.workunit.client.0.smithi090.stdout:6/396: symlink d1/l85 0 2024-04-20T10:54:43.243 INFO:tasks.workunit.client.0.smithi090.stdout:0/475: unlink d14/c47 0 2024-04-20T10:54:43.245 INFO:tasks.workunit.client.0.smithi090.stdout:0/476: unlink d14/c1a 0 2024-04-20T10:54:43.245 INFO:tasks.workunit.client.0.smithi090.stdout:0/477: write d14/d19/d2b/d52/d55/d5b/d7f/f87 [18621,11358] 0 2024-04-20T10:54:43.246 INFO:tasks.workunit.client.0.smithi090.stdout:0/478: creat d14/d19/d31/d34/d3b/f9c x:0 0 0 2024-04-20T10:54:43.246 INFO:tasks.workunit.client.0.smithi090.stdout:0/479: dread - d14/d19/d31/d34/d3b/f9c zero size 2024-04-20T10:54:43.246 INFO:tasks.workunit.client.0.smithi090.stdout:0/480: fdatasync d14/f1f 0 2024-04-20T10:54:43.246 INFO:tasks.workunit.client.0.smithi090.stdout:0/481: stat d14/d19/d2c/c63 0 2024-04-20T10:54:43.249 INFO:tasks.workunit.client.0.smithi090.stdout:9/448: dwrite d0/d29/d4f/f67 [4194304,4194304] 0 2024-04-20T10:54:43.251 INFO:tasks.workunit.client.0.smithi090.stdout:9/449: unlink d0/d29/d36/d63/d1f/l22 0 2024-04-20T10:54:43.252 INFO:tasks.workunit.client.0.smithi090.stdout:7/475: dwrite d11/d13/d23/f45 [4194304,4194304] 0 2024-04-20T10:54:43.252 INFO:tasks.workunit.client.0.smithi090.stdout:7/476: read - d11/d13/d5d/d65/f8b zero size 2024-04-20T10:54:43.253 INFO:tasks.workunit.client.0.smithi090.stdout:3/410: dwrite d7/d26/d5e/f61 [0,4194304] 0 2024-04-20T10:54:43.253 INFO:tasks.workunit.client.0.smithi090.stdout:2/444: dwrite d11/d1a/d37/f77 [0,4194304] 0 2024-04-20T10:54:43.253 INFO:tasks.workunit.client.0.smithi090.stdout:8/415: dwrite d0/d26/f85 [0,4194304] 0 2024-04-20T10:54:43.253 INFO:tasks.workunit.client.0.smithi090.stdout:9/450: rmdir d0/d29/d4f/d82/d89 0 2024-04-20T10:54:43.255 INFO:tasks.workunit.client.0.smithi090.stdout:7/477: creat d11/d13/d23/d6c/d72/fa4 x:0 0 0 2024-04-20T10:54:43.256 INFO:tasks.workunit.client.0.smithi090.stdout:3/411: mkdir d7/d26/d5e/d88 0 2024-04-20T10:54:43.259 INFO:tasks.workunit.client.0.smithi090.stdout:8/416: symlink d0/l8c 0 2024-04-20T10:54:43.260 INFO:tasks.workunit.client.0.smithi090.stdout:9/451: link d0/d29/d4f/f67 d0/f91 0 2024-04-20T10:54:43.261 INFO:tasks.workunit.client.0.smithi090.stdout:7/478: truncate d11/d13/d23/f62 399793 0 2024-04-20T10:54:43.263 INFO:tasks.workunit.client.0.smithi090.stdout:3/412: creat d7/d26/d5e/f89 x:0 0 0 2024-04-20T10:54:43.263 INFO:tasks.workunit.client.0.smithi090.stdout:3/413: stat d7/d43/l5c 0 2024-04-20T10:54:43.266 INFO:tasks.workunit.client.0.smithi090.stdout:8/417: creat d0/d3a/f8d x:0 0 0 2024-04-20T10:54:43.272 INFO:tasks.workunit.client.0.smithi090.stdout:7/479: dread d11/d13/d22/d24/f2e [0,4194304] 0 2024-04-20T10:54:43.272 INFO:tasks.workunit.client.0.smithi090.stdout:7/480: write d11/d13/d23/d6c/d72/f9c [85590,28954] 0 2024-04-20T10:54:43.272 INFO:tasks.workunit.client.0.smithi090.stdout:7/481: chown d11/d13/f90 5520 1 2024-04-20T10:54:43.273 INFO:tasks.workunit.client.0.smithi090.stdout:2/445: dwrite d11/d1f/d2e/f3b [0,4194304] 0 2024-04-20T10:54:43.275 INFO:tasks.workunit.client.0.smithi090.stdout:7/482: symlink d11/d61/la5 0 2024-04-20T10:54:43.277 INFO:tasks.workunit.client.0.smithi090.stdout:6/397: dwrite d1/d19/d36/d1e/f58 [4194304,4194304] 0 2024-04-20T10:54:43.277 INFO:tasks.workunit.client.0.smithi090.stdout:0/482: dwrite f3 [0,4194304] 0 2024-04-20T10:54:43.278 INFO:tasks.workunit.client.0.smithi090.stdout:2/446: dread d11/f1c [0,4194304] 0 2024-04-20T10:54:43.278 INFO:tasks.workunit.client.0.smithi090.stdout:2/447: write d11/d1a/d37/f44 [852485,94881] 0 2024-04-20T10:54:43.279 INFO:tasks.workunit.client.0.smithi090.stdout:6/398: symlink d1/d19/d36/d1e/d74/l86 0 2024-04-20T10:54:43.282 INFO:tasks.workunit.client.0.smithi090.stdout:0/483: mknod d14/d19/d2b/c9d 0 2024-04-20T10:54:43.282 INFO:tasks.workunit.client.0.smithi090.stdout:0/484: truncate d14/d19/d2b/d8e/d43/d73/f97 948926 0 2024-04-20T10:54:43.283 INFO:tasks.workunit.client.0.smithi090.stdout:6/399: truncate d1/d4/d26/f4d 2088727 0 2024-04-20T10:54:43.284 INFO:tasks.workunit.client.0.smithi090.stdout:6/400: creat d1/d19/d25/f87 x:0 0 0 2024-04-20T10:54:43.285 INFO:tasks.workunit.client.0.smithi090.stdout:6/401: getdents d1/d19/d36/d1e 0 2024-04-20T10:54:43.286 INFO:tasks.workunit.client.0.smithi090.stdout:6/402: creat d1/d4/f88 x:0 0 0 2024-04-20T10:54:43.286 INFO:tasks.workunit.client.0.smithi090.stdout:6/403: write d1/d19/d25/f87 [598159,95795] 0 2024-04-20T10:54:43.286 INFO:tasks.workunit.client.0.smithi090.stdout:6/404: write d1/d4/d26/d11/f41 [55758,6861] 0 2024-04-20T10:54:43.287 INFO:tasks.workunit.client.0.smithi090.stdout:6/405: creat d1/d4/d26/d11/d4a/d6b/f89 x:0 0 0 2024-04-20T10:54:43.287 INFO:tasks.workunit.client.0.smithi090.stdout:6/406: chown d1/d4/d26/l67 9038705 1 2024-04-20T10:54:43.287 INFO:tasks.workunit.client.0.smithi090.stdout:6/407: readlink d1/d19/d36/l51 0 2024-04-20T10:54:43.287 INFO:tasks.workunit.client.0.smithi090.stdout:6/408: chown d1/d19/d36/c6d 12105 1 2024-04-20T10:54:43.288 INFO:tasks.workunit.client.0.smithi090.stdout:6/409: creat d1/d4/d26/d11/f8a x:0 0 0 2024-04-20T10:54:43.288 INFO:tasks.workunit.client.0.smithi090.stdout:6/410: dread - d1/d19/d36/f24 zero size 2024-04-20T10:54:43.293 INFO:tasks.workunit.client.0.smithi090.stdout:8/418: dwrite d0/d2d/d44/f4c [0,4194304] 0 2024-04-20T10:54:43.294 INFO:tasks.workunit.client.0.smithi090.stdout:9/452: dwrite d0/f7c [4194304,4194304] 0 2024-04-20T10:54:43.297 INFO:tasks.workunit.client.0.smithi090.stdout:8/419: mkdir d0/d11/d22/d53/d8e 0 2024-04-20T10:54:43.299 INFO:tasks.workunit.client.0.smithi090.stdout:8/420: symlink d0/l8f 0 2024-04-20T10:54:43.300 INFO:tasks.workunit.client.0.smithi090.stdout:8/421: unlink d0/d11/f1a 0 2024-04-20T10:54:43.302 INFO:tasks.workunit.client.0.smithi090.stdout:8/422: mknod d0/d26/c90 0 2024-04-20T10:54:43.302 INFO:tasks.workunit.client.0.smithi090.stdout:2/448: dwrite d11/f31 [4194304,4194304] 0 2024-04-20T10:54:43.303 INFO:tasks.workunit.client.0.smithi090.stdout:0/485: dwrite d14/d41/f7d [0,4194304] 0 2024-04-20T10:54:43.303 INFO:tasks.workunit.client.0.smithi090.stdout:9/453: read d0/f4 [532988,27019] 0 2024-04-20T10:54:43.304 INFO:tasks.workunit.client.0.smithi090.stdout:7/483: dread d11/d13/d23/f62 [0,4194304] 0 2024-04-20T10:54:43.305 INFO:tasks.workunit.client.0.smithi090.stdout:7/484: chown d11/d13/d5b/c6e 60643392 1 2024-04-20T10:54:43.305 INFO:tasks.workunit.client.0.smithi090.stdout:7/485: chown d11/d1a/d2f/f85 6361411 1 2024-04-20T10:54:43.305 INFO:tasks.workunit.client.0.smithi090.stdout:0/486: fsync d14/f21 0 2024-04-20T10:54:43.307 INFO:tasks.workunit.client.0.smithi090.stdout:0/487: truncate fe 1744108 0 2024-04-20T10:54:43.307 INFO:tasks.workunit.client.0.smithi090.stdout:0/488: stat d14/d41/f49 0 2024-04-20T10:54:43.308 INFO:tasks.workunit.client.0.smithi090.stdout:9/454: rename d0/d29/d36/d63/d1f/d34/d70/f53 to d0/d29/f92 0 2024-04-20T10:54:43.309 INFO:tasks.workunit.client.0.smithi090.stdout:0/489: dread - d14/d19/d2b/d8e/d43/d6d/f91 zero size 2024-04-20T10:54:43.310 INFO:tasks.workunit.client.0.smithi090.stdout:7/486: rename d11/d13/d5d/d65/la1 to d11/d13/d22/d8f/la6 0 2024-04-20T10:54:43.311 INFO:tasks.workunit.client.0.smithi090.stdout:7/487: chown d11/d13/d22/l29 129784 1 2024-04-20T10:54:43.312 INFO:tasks.workunit.client.0.smithi090.stdout:9/455: truncate d0/d29/d4f/f10 2576269 0 2024-04-20T10:54:43.312 INFO:tasks.workunit.client.0.smithi090.stdout:9/456: fsync d0/f7c 0 2024-04-20T10:54:43.313 INFO:tasks.workunit.client.0.smithi090.stdout:0/490: mkdir d14/d19/d9e 0 2024-04-20T10:54:43.314 INFO:tasks.workunit.client.0.smithi090.stdout:7/488: truncate f1 4701682 0 2024-04-20T10:54:43.315 INFO:tasks.workunit.client.0.smithi090.stdout:7/489: write d11/d13/d23/d6c/d72/fa4 [207368,126532] 0 2024-04-20T10:54:43.315 INFO:tasks.workunit.client.0.smithi090.stdout:7/490: fdatasync d11/d13/d5b/f9a 0 2024-04-20T10:54:43.319 INFO:tasks.workunit.client.0.smithi090.stdout:9/457: creat d0/d29/d36/d63/f93 x:0 0 0 2024-04-20T10:54:43.319 INFO:tasks.workunit.client.0.smithi090.stdout:9/458: write d0/d29/d36/d63/d1f/d34/d70/d52/f49 [900372,84191] 0 2024-04-20T10:54:43.319 INFO:tasks.workunit.client.0.smithi090.stdout:9/459: write d0/d29/d36/d63/d1f/d79/f75 [1367729,2795] 0 2024-04-20T10:54:43.320 INFO:tasks.workunit.client.0.smithi090.stdout:0/491: fsync d14/d19/d2b/f3d 0 2024-04-20T10:54:43.320 INFO:tasks.workunit.client.0.smithi090.stdout:0/492: chown f9 76 1 2024-04-20T10:54:43.320 INFO:tasks.workunit.client.0.smithi090.stdout:2/449: dwrite d11/d1a/f83 [0,4194304] 0 2024-04-20T10:54:43.323 INFO:tasks.workunit.client.0.smithi090.stdout:9/460: mkdir d0/d29/d36/d63/d1c/d94 0 2024-04-20T10:54:43.325 INFO:tasks.workunit.client.0.smithi090.stdout:2/450: rmdir d11/d1a 39 2024-04-20T10:54:43.326 INFO:tasks.workunit.client.0.smithi090.stdout:2/451: fdatasync d11/d1a/f58 0 2024-04-20T10:54:43.326 INFO:tasks.workunit.client.0.smithi090.stdout:2/452: fsync d11/f76 0 2024-04-20T10:54:43.327 INFO:tasks.workunit.client.0.smithi090.stdout:9/461: rename d0/d29/d4f/l24 to d0/d29/d36/d63/d1c/l95 0 2024-04-20T10:54:43.328 INFO:tasks.workunit.client.0.smithi090.stdout:0/493: symlink d14/d19/d2b/d52/d55/d5b/d8a/l9f 0 2024-04-20T10:54:43.329 INFO:tasks.workunit.client.0.smithi090.stdout:2/453: creat d11/d1a/d37/d85/f99 x:0 0 0 2024-04-20T10:54:43.331 INFO:tasks.workunit.client.0.smithi090.stdout:0/494: mkdir d14/d19/d2b/d61/da0 0 2024-04-20T10:54:43.331 INFO:tasks.workunit.client.0.smithi090.stdout:8/423: getdents d0/d11 0 2024-04-20T10:54:43.332 INFO:tasks.workunit.client.0.smithi090.stdout:2/454: dread d11/d1a/f2d [0,4194304] 0 2024-04-20T10:54:43.333 INFO:tasks.workunit.client.0.smithi090.stdout:2/455: getdents d11/d1a/d4a 0 2024-04-20T10:54:43.334 INFO:tasks.workunit.client.0.smithi090.stdout:2/456: write d11/d1f/f75 [810438,49472] 0 2024-04-20T10:54:43.336 INFO:tasks.workunit.client.0.smithi090.stdout:2/457: rmdir d11/d1a/d37 39 2024-04-20T10:54:43.336 INFO:tasks.workunit.client.0.smithi090.stdout:9/462: dread d0/d29/d36/d63/d1f/d79/f58 [0,4194304] 0 2024-04-20T10:54:43.337 INFO:tasks.workunit.client.0.smithi090.stdout:7/491: dwrite d11/d13/f8c [0,4194304] 0 2024-04-20T10:54:43.338 INFO:tasks.workunit.client.0.smithi090.stdout:9/463: mknod d0/d29/d36/d63/d1f/d79/d7f/c96 0 2024-04-20T10:54:43.339 INFO:tasks.workunit.client.0.smithi090.stdout:0/495: write fa [999199,2037] 0 2024-04-20T10:54:43.339 INFO:tasks.workunit.client.0.smithi090.stdout:0/496: write d14/d19/d2b/d52/d55/d5b/d7f/f8b [1712743,79533] 0 2024-04-20T10:54:43.340 INFO:tasks.workunit.client.0.smithi090.stdout:8/424: write d0/d11/d22/f23 [1211850,3640] 0 2024-04-20T10:54:43.340 INFO:tasks.workunit.client.0.smithi090.stdout:8/425: dread - d0/f79 zero size 2024-04-20T10:54:43.340 INFO:tasks.workunit.client.0.smithi090.stdout:8/426: fdatasync d0/d11/f31 0 2024-04-20T10:54:43.341 INFO:tasks.workunit.client.0.smithi090.stdout:8/427: read - d0/d3a/f8d zero size 2024-04-20T10:54:43.341 INFO:tasks.workunit.client.0.smithi090.stdout:8/428: chown d0/d3a/c47 0 1 2024-04-20T10:54:43.341 INFO:tasks.workunit.client.0.smithi090.stdout:7/492: getdents d11/d13/d33/d44 0 2024-04-20T10:54:43.341 INFO:tasks.workunit.client.0.smithi090.stdout:7/493: write d11/d13/d33/f9d [834653,67055] 0 2024-04-20T10:54:43.343 INFO:tasks.workunit.client.0.smithi090.stdout:9/464: truncate d0/d29/d36/d63/d1c/f3e 3125162 0 2024-04-20T10:54:43.345 INFO:tasks.workunit.client.0.smithi090.stdout:0/497: unlink f9 0 2024-04-20T10:54:43.346 INFO:tasks.workunit.client.0.smithi090.stdout:8/429: rmdir d0 39 2024-04-20T10:54:43.348 INFO:tasks.workunit.client.0.smithi090.stdout:9/465: write d0/d29/d36/d63/d1f/d34/d70/d52/f49 [407943,50153] 0 2024-04-20T10:54:43.348 INFO:tasks.workunit.client.0.smithi090.stdout:9/466: chown d0/c62 1 1 2024-04-20T10:54:43.348 INFO:tasks.workunit.client.0.smithi090.stdout:9/467: chown d0/d86/f8f 365 1 2024-04-20T10:54:43.350 INFO:tasks.workunit.client.0.smithi090.stdout:0/498: getdents d14/d19/d31/d34 0 2024-04-20T10:54:43.354 INFO:tasks.workunit.client.0.smithi090.stdout:8/430: symlink d0/d11/d22/d53/d8e/l91 0 2024-04-20T10:54:43.359 INFO:tasks.workunit.client.0.smithi090.stdout:2/458: dwrite d11/d1a/d30/f7e [0,4194304] 0 2024-04-20T10:54:43.366 INFO:tasks.workunit.client.0.smithi090.stdout:2/459: dread d11/d1f/d2e/f52 [0,4194304] 0 2024-04-20T10:54:43.368 INFO:tasks.workunit.client.0.smithi090.stdout:9/468: dwrite d0/d29/d36/d63/d1f/d34/f43 [4194304,4194304] 0 2024-04-20T10:54:43.371 INFO:tasks.workunit.client.0.smithi090.stdout:2/460: dread d11/d1a/d37/f4f [0,4194304] 0 2024-04-20T10:54:43.372 INFO:tasks.workunit.client.0.smithi090.stdout:2/461: rmdir d11/d1a 39 2024-04-20T10:54:43.372 INFO:tasks.workunit.client.0.smithi090.stdout:2/462: fdatasync d11/d1f/d2e/f5b 0 2024-04-20T10:54:43.372 INFO:tasks.workunit.client.0.smithi090.stdout:2/463: fsync d11/f1e 0 2024-04-20T10:54:43.374 INFO:tasks.workunit.client.0.smithi090.stdout:8/431: dwrite d0/d11/d14/f41 [4194304,4194304] 0 2024-04-20T10:54:43.374 INFO:tasks.workunit.client.0.smithi090.stdout:8/432: fsync d0/d2d/f84 0 2024-04-20T10:54:43.374 INFO:tasks.workunit.client.0.smithi090.stdout:8/433: write d0/d3a/f8d [652332,62075] 0 2024-04-20T10:54:43.374 INFO:tasks.workunit.client.0.smithi090.stdout:9/469: dread d0/d29/d36/d63/d1f/d79/f8a [0,4194304] 0 2024-04-20T10:54:43.374 INFO:tasks.workunit.client.0.smithi090.stdout:9/470: dread - d0/d29/d36/d63/d1c/f74 zero size 2024-04-20T10:54:43.374 INFO:tasks.workunit.client.0.smithi090.stdout:9/471: write d0/d29/d36/d63/d1f/d79/f8a [526484,47412] 0 2024-04-20T10:54:43.381 INFO:tasks.workunit.client.0.smithi090.stdout:8/434: mkdir d0/d11/d22/d53/d8e/d92 0 2024-04-20T10:54:43.382 INFO:tasks.workunit.client.0.smithi090.stdout:9/472: getdents d0/d29/d4f 0 2024-04-20T10:54:43.392 INFO:tasks.workunit.client.0.smithi090.stdout:2/464: dwrite d11/d1a/d37/f44 [0,4194304] 0 2024-04-20T10:54:43.392 INFO:tasks.workunit.client.0.smithi090.stdout:2/465: stat d11/d1a/d4a/l6f 0 2024-04-20T10:54:43.392 INFO:tasks.workunit.client.0.smithi090.stdout:2/466: getdents d11/d1a 0 2024-04-20T10:54:43.398 INFO:tasks.workunit.client.0.smithi090.stdout:8/435: dwrite d0/d26/f78 [0,4194304] 0 2024-04-20T10:54:43.401 INFO:tasks.workunit.client.0.smithi090.stdout:9/473: dread d0/d29/d36/d63/f2f [0,4194304] 0 2024-04-20T10:54:43.402 INFO:tasks.workunit.client.0.smithi090.stdout:9/474: creat d0/d29/d4f/f97 x:0 0 0 2024-04-20T10:54:43.403 INFO:tasks.workunit.client.0.smithi090.stdout:9/475: readlink d0/d29/d36/d63/d1f/d4d/l8e 0 2024-04-20T10:54:43.403 INFO:tasks.workunit.client.0.smithi090.stdout:9/476: write d0/d29/d4f/f84 [166657,127421] 0 2024-04-20T10:54:43.403 INFO:tasks.workunit.client.0.smithi090.stdout:9/477: mknod d0/d29/c98 0 2024-04-20T10:54:43.404 INFO:tasks.workunit.client.0.smithi090.stdout:9/478: symlink d0/d29/d4f/d82/l99 0 2024-04-20T10:54:43.406 INFO:tasks.workunit.client.0.smithi090.stdout:9/479: rename d0/d29/d36/d63/d78 to d0/d9a 0 2024-04-20T10:54:43.406 INFO:tasks.workunit.client.0.smithi090.stdout:9/480: write d0/d29/d36/d63/d1f/d79/f8a [1341376,23187] 0 2024-04-20T10:54:43.406 INFO:tasks.workunit.client.0.smithi090.stdout:9/481: truncate d0/d29/d4f/f27 1408851 0 2024-04-20T10:54:43.407 INFO:tasks.workunit.client.0.smithi090.stdout:8/436: write d0/d11/d14/f41 [7732261,31026] 0 2024-04-20T10:54:43.407 INFO:tasks.workunit.client.0.smithi090.stdout:8/437: truncate d0/d2d/f43 2398162 0 2024-04-20T10:54:43.408 INFO:tasks.workunit.client.0.smithi090.stdout:8/438: creat d0/d2d/f93 x:0 0 0 2024-04-20T10:54:43.408 INFO:tasks.workunit.client.0.smithi090.stdout:8/439: chown d0/d26/f4d 28 1 2024-04-20T10:54:43.409 INFO:tasks.workunit.client.0.smithi090.stdout:8/440: rename d0/d11/c15 to d0/d11/d22/d53/d8e/c94 0 2024-04-20T10:54:43.409 INFO:tasks.workunit.client.0.smithi090.stdout:8/441: write d0/f79 [704895,25501] 0 2024-04-20T10:54:43.409 INFO:tasks.workunit.client.0.smithi090.stdout:8/442: stat d0/d2d 0 2024-04-20T10:54:43.410 INFO:tasks.workunit.client.0.smithi090.stdout:8/443: truncate d0/d26/f40 688487 0 2024-04-20T10:54:43.410 INFO:tasks.workunit.client.0.smithi090.stdout:8/444: stat d0/f79 0 2024-04-20T10:54:43.414 INFO:tasks.workunit.client.0.smithi090.stdout:2/467: dwrite d11/d1f/d2e/f5d [4194304,4194304] 0 2024-04-20T10:54:43.415 INFO:tasks.workunit.client.0.smithi090.stdout:2/468: creat d11/d1a/d4a/d55/f9a x:0 0 0 2024-04-20T10:54:43.416 INFO:tasks.workunit.client.0.smithi090.stdout:2/469: creat d11/d1a/d4a/d80/f9b x:0 0 0 2024-04-20T10:54:43.417 INFO:tasks.workunit.client.0.smithi090.stdout:2/470: chown d11/d1a/d2b/f35 26332363 1 2024-04-20T10:54:43.418 INFO:tasks.workunit.client.0.smithi090.stdout:2/471: creat d11/d1a/d30/d8d/f9c x:0 0 0 2024-04-20T10:54:43.419 INFO:tasks.workunit.client.0.smithi090.stdout:9/482: read d0/d29/d4f/f2d [1315273,39590] 0 2024-04-20T10:54:43.419 INFO:tasks.workunit.client.0.smithi090.stdout:1/513: sync 2024-04-20T10:54:43.419 INFO:tasks.workunit.client.0.smithi090.stdout:4/421: sync 2024-04-20T10:54:43.421 INFO:tasks.workunit.client.0.smithi090.stdout:1/514: symlink d8/d1a/d1d/d7a/la9 0 2024-04-20T10:54:43.423 INFO:tasks.workunit.client.0.smithi090.stdout:1/515: symlink d8/d1a/d1d/d2c/d4a/d5a/laa 0 2024-04-20T10:54:43.427 INFO:tasks.workunit.client.0.smithi090.stdout:9/483: dread d0/f4 [0,4194304] 0 2024-04-20T10:54:43.430 INFO:tasks.workunit.client.0.smithi090.stdout:9/484: mkdir d0/d29/d36/d63/d1f/d79/d9b 0 2024-04-20T10:54:43.430 INFO:tasks.workunit.client.0.smithi090.stdout:9/485: write d0/d29/d36/d63/f2f [4247239,111735] 0 2024-04-20T10:54:43.433 INFO:tasks.workunit.client.0.smithi090.stdout:4/422: dread d7/f12 [0,4194304] 0 2024-04-20T10:54:43.437 INFO:tasks.workunit.client.0.smithi090.stdout:8/445: truncate d0/f36 4201786 0 2024-04-20T10:54:43.437 INFO:tasks.workunit.client.0.smithi090.stdout:8/446: chown d0/l72 254 1 2024-04-20T10:54:43.437 INFO:tasks.workunit.client.0.smithi090.stdout:8/447: chown d0/d2d/d49/d67/f69 47 1 2024-04-20T10:54:43.444 INFO:tasks.workunit.client.0.smithi090.stdout:2/472: dwrite d11/f20 [0,4194304] 0 2024-04-20T10:54:43.445 INFO:tasks.workunit.client.0.smithi090.stdout:2/473: rename d11/d1a/d4a/d80/f9b to d11/d1a/d30/f9d 0 2024-04-20T10:54:43.447 INFO:tasks.workunit.client.0.smithi090.stdout:1/516: dwrite d8/d1a/d1d/d2c/d4a/d93/d5d/f8e [0,4194304] 0 2024-04-20T10:54:43.449 INFO:tasks.workunit.client.0.smithi090.stdout:2/474: dread d11/f7a [0,4194304] 0 2024-04-20T10:54:43.451 INFO:tasks.workunit.client.0.smithi090.stdout:2/475: rename d11/d1a/d30/c3a to d11/c9e 0 2024-04-20T10:54:43.454 INFO:tasks.workunit.client.0.smithi090.stdout:2/476: rename d11/d1a/d30/f61 to d11/d1a/d30/d8d/f9f 0 2024-04-20T10:54:43.455 INFO:tasks.workunit.client.0.smithi090.stdout:2/477: readlink l7 0 2024-04-20T10:54:43.455 INFO:tasks.workunit.client.0.smithi090.stdout:2/478: write d11/f16 [4973602,23690] 0 2024-04-20T10:54:43.455 INFO:tasks.workunit.client.0.smithi090.stdout:2/479: chown d11/d1a/d30/f9d 164 1 2024-04-20T10:54:43.455 INFO:tasks.workunit.client.0.smithi090.stdout:4/423: dwrite d7/f2c [0,4194304] 0 2024-04-20T10:54:43.455 INFO:tasks.workunit.client.0.smithi090.stdout:2/480: creat d11/d97/fa0 x:0 0 0 2024-04-20T10:54:43.456 INFO:tasks.workunit.client.0.smithi090.stdout:2/481: mkdir d11/d1a/d4a/d55/da1 0 2024-04-20T10:54:43.458 INFO:tasks.workunit.client.0.smithi090.stdout:2/482: symlink d11/d1a/d30/la2 0 2024-04-20T10:54:43.459 INFO:tasks.workunit.client.0.smithi090.stdout:2/483: write d11/d1a/f2d [184754,109854] 0 2024-04-20T10:54:43.459 INFO:tasks.workunit.client.0.smithi090.stdout:2/484: write d11/d1a/d4a/d55/f69 [917641,88815] 0 2024-04-20T10:54:43.459 INFO:tasks.workunit.client.0.smithi090.stdout:2/485: chown d11/d1a/d30/d8d/f9f 336 1 2024-04-20T10:54:43.460 INFO:tasks.workunit.client.0.smithi090.stdout:9/486: dwrite d0/d29/d4f/f10 [0,4194304] 0 2024-04-20T10:54:43.463 INFO:tasks.workunit.client.0.smithi090.stdout:2/486: symlink d11/d1a/d30/la3 0 2024-04-20T10:54:43.475 INFO:tasks.workunit.client.0.smithi090.stdout:4/424: dwrite d7/f6a [0,4194304] 0 2024-04-20T10:54:43.479 INFO:tasks.workunit.client.0.smithi090.stdout:1/517: dwrite d8/f6a [0,4194304] 0 2024-04-20T10:54:43.481 INFO:tasks.workunit.client.0.smithi090.stdout:9/487: dwrite d0/f37 [4194304,4194304] 0 2024-04-20T10:54:43.481 INFO:tasks.workunit.client.0.smithi090.stdout:9/488: dread - d0/d29/f57 zero size 2024-04-20T10:54:43.498 INFO:tasks.workunit.client.0.smithi090.stdout:1/518: dwrite d8/d1a/d1d/d67/f90 [0,4194304] 0 2024-04-20T10:54:43.498 INFO:tasks.workunit.client.0.smithi090.stdout:9/489: dwrite d0/d86/f8f [0,4194304] 0 2024-04-20T10:54:43.498 INFO:tasks.workunit.client.0.smithi090.stdout:2/487: mknod d11/d1a/d37/ca4 0 2024-04-20T10:54:43.499 INFO:tasks.workunit.client.0.smithi090.stdout:4/425: dwrite d7/d9/f6d [0,4194304] 0 2024-04-20T10:54:43.499 INFO:tasks.workunit.client.0.smithi090.stdout:4/426: getdents d7/d72 0 2024-04-20T10:54:43.500 INFO:tasks.workunit.client.0.smithi090.stdout:4/427: fdatasync d7/f6a 0 2024-04-20T10:54:43.500 INFO:tasks.workunit.client.0.smithi090.stdout:1/519: unlink d8/f12 0 2024-04-20T10:54:43.503 INFO:tasks.workunit.client.0.smithi090.stdout:9/490: creat d0/d29/d36/d63/d1f/d4d/f9c x:0 0 0 2024-04-20T10:54:43.505 INFO:tasks.workunit.client.0.smithi090.stdout:2/488: mknod d11/ca5 0 2024-04-20T10:54:43.505 INFO:tasks.workunit.client.0.smithi090.stdout:2/489: readlink d11/d1a/d30/d8d/l92 0 2024-04-20T10:54:43.505 INFO:tasks.workunit.client.0.smithi090.stdout:2/490: write d11/d1a/d30/d8d/f9f [658492,29243] 0 2024-04-20T10:54:43.507 INFO:tasks.workunit.client.0.smithi090.stdout:9/491: dread d0/d29/d36/d63/f1e [8388608,4194304] 0 2024-04-20T10:54:43.509 INFO:tasks.workunit.client.0.smithi090.stdout:4/428: mknod d7/d9/d47/d63/d76/c86 0 2024-04-20T10:54:43.510 INFO:tasks.workunit.client.0.smithi090.stdout:2/491: mkdir d11/d1a/d30/da6 0 2024-04-20T10:54:43.516 INFO:tasks.workunit.client.0.smithi090.stdout:9/492: write d0/f37 [8385422,25265] 0 2024-04-20T10:54:43.520 INFO:tasks.workunit.client.0.smithi090.stdout:1/520: dwrite d8/d1a/d4d/f63 [0,4194304] 0 2024-04-20T10:54:43.520 INFO:tasks.workunit.client.0.smithi090.stdout:1/521: write d8/d1a/d1d/d2c/d3f/f7e [1302866,68392] 0 2024-04-20T10:54:43.520 INFO:tasks.workunit.client.0.smithi090.stdout:1/522: fdatasync d8/d1a/f3b 0 2024-04-20T10:54:43.520 INFO:tasks.workunit.client.0.smithi090.stdout:4/429: rmdir d7/d9/d17 39 2024-04-20T10:54:43.528 INFO:tasks.workunit.client.0.smithi090.stdout:4/430: write d7/f21 [1020966,98052] 0 2024-04-20T10:54:43.530 INFO:tasks.workunit.client.0.smithi090.stdout:1/523: mknod d8/d1a/d4d/da5/cab 0 2024-04-20T10:54:43.531 INFO:tasks.workunit.client.0.smithi090.stdout:1/524: dread - d8/d1a/d4d/f9c zero size 2024-04-20T10:54:43.531 INFO:tasks.workunit.client.0.smithi090.stdout:1/525: write d8/d1a/d1d/d2c/d4a/f8b [1768340,17115] 0 2024-04-20T10:54:43.533 INFO:tasks.workunit.client.0.smithi090.stdout:4/431: truncate d7/f38 3692228 0 2024-04-20T10:54:43.533 INFO:tasks.workunit.client.0.smithi090.stdout:4/432: chown d7/d9/d17/d56/d66/d70/f81 83 1 2024-04-20T10:54:43.534 INFO:tasks.workunit.client.0.smithi090.stdout:2/492: dwrite fa [4194304,4194304] 0 2024-04-20T10:54:43.537 INFO:tasks.workunit.client.0.smithi090.stdout:9/493: dwrite d0/d29/f57 [0,4194304] 0 2024-04-20T10:54:43.537 INFO:tasks.workunit.client.0.smithi090.stdout:9/494: chown d0/d29/d36/l88 32022 1 2024-04-20T10:54:43.538 INFO:tasks.workunit.client.0.smithi090.stdout:2/493: unlink d11/d1a/d37/ca4 0 2024-04-20T10:54:43.541 INFO:tasks.workunit.client.0.smithi090.stdout:9/495: rmdir d0/d29/d36/d63/d1f/d35 39 2024-04-20T10:54:43.542 INFO:tasks.workunit.client.0.smithi090.stdout:2/494: mkdir d11/d1a/d2b/da7 0 2024-04-20T10:54:43.544 INFO:tasks.workunit.client.0.smithi090.stdout:4/433: write d7/d9/d17/f58 [1127874,75174] 0 2024-04-20T10:54:43.544 INFO:tasks.workunit.client.0.smithi090.stdout:4/434: write d7/d9/f10 [1470969,82743] 0 2024-04-20T10:54:43.544 INFO:tasks.workunit.client.0.smithi090.stdout:4/435: fdatasync d7/d9/f62 0 2024-04-20T10:54:43.544 INFO:tasks.workunit.client.0.smithi090.stdout:4/436: chown d7/d9/d47/d63/l53 415 1 2024-04-20T10:54:43.545 INFO:tasks.workunit.client.0.smithi090.stdout:2/495: creat d11/d1a/d30/fa8 x:0 0 0 2024-04-20T10:54:43.546 INFO:tasks.workunit.client.0.smithi090.stdout:9/496: rename d0/d29/d36/d63/d1f/d35 to d0/d29/d36/d63/d1f/d34/d70/d9d 0 2024-04-20T10:54:43.548 INFO:tasks.workunit.client.0.smithi090.stdout:2/496: symlink d11/la9 0 2024-04-20T10:54:43.549 INFO:tasks.workunit.client.0.smithi090.stdout:1/526: dwrite d8/d1a/d1d/d2c/d4a/fa6 [0,4194304] 0 2024-04-20T10:54:43.549 INFO:tasks.workunit.client.0.smithi090.stdout:9/497: symlink d0/d29/d36/d63/d1f/d79/d9b/l9e 0 2024-04-20T10:54:43.550 INFO:tasks.workunit.client.0.smithi090.stdout:2/497: truncate fc 7401505 0 2024-04-20T10:54:43.552 INFO:tasks.workunit.client.0.smithi090.stdout:1/527: creat d8/d1a/d1d/d7a/d9a/fac x:0 0 0 2024-04-20T10:54:43.553 INFO:tasks.workunit.client.0.smithi090.stdout:4/437: write d7/d9/f35 [829191,93964] 0 2024-04-20T10:54:43.554 INFO:tasks.workunit.client.0.smithi090.stdout:2/498: creat d11/d1f/faa x:0 0 0 2024-04-20T10:54:43.555 INFO:tasks.workunit.client.0.smithi090.stdout:2/499: chown d11/d1a/d30/la2 190 1 2024-04-20T10:54:43.556 INFO:tasks.workunit.client.0.smithi090.stdout:4/438: stat d7/d9/d17/f49 0 2024-04-20T10:54:43.562 INFO:tasks.workunit.client.0.smithi090.stdout:9/498: getdents d0/d29/d36/d63/d1f/d34/d70 0 2024-04-20T10:54:43.563 INFO:tasks.workunit.client.0.smithi090.stdout:2/500: creat d11/d1a/d4a/d59/fab x:0 0 0 2024-04-20T10:54:43.570 INFO:tasks.workunit.client.0.smithi090.stdout:1/528: dwrite d8/fb [0,4194304] 0 2024-04-20T10:54:43.580 INFO:tasks.workunit.client.0.smithi090.stdout:4/439: dwrite d7/d9/f19 [0,4194304] 0 2024-04-20T10:54:43.587 INFO:tasks.workunit.client.0.smithi090.stdout:1/529: dwrite f5 [0,4194304] 0 2024-04-20T10:54:43.653 INFO:tasks.workunit.client.0.smithi090.stdout:5/652: sync 2024-04-20T10:54:43.660 INFO:tasks.workunit.client.0.smithi090.stdout:5/653: dread d1/d2f/d85/dbd/f4f [0,4194304] 0 2024-04-20T10:54:43.676 INFO:tasks.workunit.client.0.smithi090.stdout:5/654: dwrite d1/d2f/d3d/d40/d70/f87 [0,4194304] 0 2024-04-20T10:54:43.693 INFO:tasks.workunit.client.0.smithi090.stdout:5/655: dwrite d1/d2f/d85/fbf [0,4194304] 0 2024-04-20T10:54:43.823 INFO:tasks.workunit.client.0.smithi090.stdout:9/499: symlink d0/d29/d4f/d23/l9f 0 2024-04-20T10:54:43.823 INFO:tasks.workunit.client.0.smithi090.stdout:2/501: truncate d11/d1a/d4a/d55/f69 542910 0 2024-04-20T10:54:43.823 INFO:tasks.workunit.client.0.smithi090.stdout:4/440: getdents d7/d9/d47/d63/d76 0 2024-04-20T10:54:43.824 INFO:tasks.workunit.client.0.smithi090.stdout:1/530: mkdir d8/d1a/d4d/da5/dad 0 2024-04-20T10:54:43.827 INFO:tasks.workunit.client.0.smithi090.stdout:5/656: getdents d1 0 2024-04-20T10:54:43.828 INFO:tasks.workunit.client.0.smithi090.stdout:9/500: mknod d0/d29/d4f/ca0 0 2024-04-20T10:54:43.828 INFO:tasks.workunit.client.0.smithi090.stdout:2/502: truncate d11/f16 684318 0 2024-04-20T10:54:43.830 INFO:tasks.workunit.client.0.smithi090.stdout:4/441: link d7/c77 d7/d9/d17/d56/d66/c87 0 2024-04-20T10:54:43.830 INFO:tasks.workunit.client.0.smithi090.stdout:4/442: chown d7/d9/d47/d63/d3d/l46 961 1 2024-04-20T10:54:43.831 INFO:tasks.workunit.client.0.smithi090.stdout:1/531: stat l1 0 2024-04-20T10:54:43.832 INFO:tasks.workunit.client.0.smithi090.stdout:5/657: getdents d1/da/d1f/dad/dc8 0 2024-04-20T10:54:43.833 INFO:tasks.workunit.client.0.smithi090.stdout:9/501: mkdir d0/d29/d36/d63/da1 0 2024-04-20T10:54:43.833 INFO:tasks.workunit.client.0.smithi090.stdout:9/502: chown d0/d29/d36/d63/f1b 1913876777 1 2024-04-20T10:54:43.834 INFO:tasks.workunit.client.0.smithi090.stdout:9/503: write d0/d29/d36/d63/d1c/f2b [724691,80760] 0 2024-04-20T10:54:43.834 INFO:tasks.workunit.client.0.smithi090.stdout:9/504: chown d0/d29/d4f/c47 7138218 1 2024-04-20T10:54:43.835 INFO:tasks.workunit.client.0.smithi090.stdout:2/503: link d11/d1a/d30/la2 d11/d1a/d4a/d55/da1/lac 0 2024-04-20T10:54:43.835 INFO:tasks.workunit.client.0.smithi090.stdout:1/532: rename d8/d1a/d1d/d7a/d9a/l77 to d8/d1a/lae 0 2024-04-20T10:54:43.836 INFO:tasks.workunit.client.0.smithi090.stdout:5/658: symlink d1/de/d96/le4 0 2024-04-20T10:54:43.838 INFO:tasks.workunit.client.0.smithi090.stdout:4/443: dread d7/d9/f36 [0,4194304] 0 2024-04-20T10:54:43.838 INFO:tasks.workunit.client.0.smithi090.stdout:4/444: dread - d7/d9/d17/d56/d66/d70/f81 zero size 2024-04-20T10:54:43.838 INFO:tasks.workunit.client.0.smithi090.stdout:4/445: write d7/d9/d17/f27 [1297583,108601] 0 2024-04-20T10:54:43.838 INFO:tasks.workunit.client.0.smithi090.stdout:9/505: unlink d0/d29/d36/d63/d1f/d34/d70/l4b 0 2024-04-20T10:54:43.839 INFO:tasks.workunit.client.0.smithi090.stdout:2/504: mkdir d11/d1f/d2e/dad 0 2024-04-20T10:54:43.840 INFO:tasks.workunit.client.0.smithi090.stdout:1/533: unlink d8/d1a/f99 0 2024-04-20T10:54:43.841 INFO:tasks.workunit.client.0.smithi090.stdout:5/659: symlink d1/da/le5 0 2024-04-20T10:54:43.842 INFO:tasks.workunit.client.0.smithi090.stdout:4/446: mknod d7/d9/d47/d63/d42/c88 0 2024-04-20T10:54:43.843 INFO:tasks.workunit.client.0.smithi090.stdout:9/506: creat d0/d29/d36/d63/d1f/fa2 x:0 0 0 2024-04-20T10:54:43.843 INFO:tasks.workunit.client.0.smithi090.stdout:2/505: mknod d11/d1a/d37/cae 0 2024-04-20T10:54:43.844 INFO:tasks.workunit.client.0.smithi090.stdout:3/414: sync 2024-04-20T10:54:43.845 INFO:tasks.workunit.client.0.smithi090.stdout:1/534: link d8/l14 d8/d1a/d1d/d67/laf 0 2024-04-20T10:54:43.846 INFO:tasks.workunit.client.0.smithi090.stdout:4/447: unlink d7/l16 0 2024-04-20T10:54:43.848 INFO:tasks.workunit.client.0.smithi090.stdout:2/506: rename d11/d1a/d2b/l34 to d11/d1a/d37/laf 0 2024-04-20T10:54:43.848 INFO:tasks.workunit.client.0.smithi090.stdout:1/535: mkdir d8/d1a/d1d/d7a/db0 0 2024-04-20T10:54:43.849 INFO:tasks.workunit.client.0.smithi090.stdout:4/448: mknod d7/d9/d47/d63/d3d/c89 0 2024-04-20T10:54:43.850 INFO:tasks.workunit.client.0.smithi090.stdout:1/536: mknod d8/d1a/d4d/da5/dad/cb1 0 2024-04-20T10:54:43.852 INFO:tasks.workunit.client.0.smithi090.stdout:4/449: creat d7/d9/d17/d56/d66/f8a x:0 0 0 2024-04-20T10:54:43.853 INFO:tasks.workunit.client.0.smithi090.stdout:4/450: write d7/d9/d17/f18 [1571279,63874] 0 2024-04-20T10:54:43.853 INFO:tasks.workunit.client.0.smithi090.stdout:1/537: mkdir d8/d1a/d1d/d2c/d4a/d5a/db2 0 2024-04-20T10:54:43.861 INFO:tasks.workunit.client.0.smithi090.stdout:2/507: write d11/d1a/d37/f4f [6764768,24594] 0 2024-04-20T10:54:43.861 INFO:tasks.workunit.client.0.smithi090.stdout:2/508: write d11/d1a/f2d [772398,76514] 0 2024-04-20T10:54:43.861 INFO:tasks.workunit.client.0.smithi090.stdout:3/415: dread d7/d15/d2a/f67 [0,4194304] 0 2024-04-20T10:54:43.863 INFO:tasks.workunit.client.0.smithi090.stdout:4/451: rename d7/d9/d47/c82 to d7/d9/d47/d63/d76/c8b 0 2024-04-20T10:54:43.863 INFO:tasks.workunit.client.0.smithi090.stdout:4/452: dread - d7/d9/d47/d63/d42/f67 zero size 2024-04-20T10:54:43.863 INFO:tasks.workunit.client.0.smithi090.stdout:3/416: mkdir d7/d26/d5e/d88/d8a 0 2024-04-20T10:54:43.864 INFO:tasks.workunit.client.0.smithi090.stdout:4/453: getdents d7/d9/d17/d56 0 2024-04-20T10:54:43.864 INFO:tasks.workunit.client.0.smithi090.stdout:4/454: stat d7/d9/d17/c7c 0 2024-04-20T10:54:43.865 INFO:tasks.workunit.client.0.smithi090.stdout:3/417: truncate d7/d26/d5e/f61 3148991 0 2024-04-20T10:54:43.865 INFO:tasks.workunit.client.0.smithi090.stdout:3/418: fsync d7/f79 0 2024-04-20T10:54:43.865 INFO:tasks.workunit.client.0.smithi090.stdout:3/419: readlink d7/d43/l82 0 2024-04-20T10:54:43.866 INFO:tasks.workunit.client.0.smithi090.stdout:9/507: dwrite d0/d29/d36/d63/f1b [0,4194304] 0 2024-04-20T10:54:43.867 INFO:tasks.workunit.client.0.smithi090.stdout:2/509: dread d11/f31 [0,4194304] 0 2024-04-20T10:54:43.867 INFO:tasks.workunit.client.0.smithi090.stdout:2/510: write d11/d1a/d30/f90 [244702,107069] 0 2024-04-20T10:54:43.869 INFO:tasks.workunit.client.0.smithi090.stdout:5/660: dwrite d1/d2a/f3e [0,4194304] 0 2024-04-20T10:54:43.869 INFO:tasks.workunit.client.0.smithi090.stdout:5/661: chown d1/d41 5 1 2024-04-20T10:54:43.869 INFO:tasks.workunit.client.0.smithi090.stdout:5/662: write d1/d2f/d3d/d40/d6c/f82 [4316580,130157] 0 2024-04-20T10:54:43.869 INFO:tasks.workunit.client.0.smithi090.stdout:5/663: stat d1/da 0 2024-04-20T10:54:43.869 INFO:tasks.workunit.client.0.smithi090.stdout:4/455: creat d7/d9/d17/d56/f8c x:0 0 0 2024-04-20T10:54:43.869 INFO:tasks.workunit.client.0.smithi090.stdout:4/456: write d7/f6a [1828780,29656] 0 2024-04-20T10:54:43.870 INFO:tasks.workunit.client.0.smithi090.stdout:5/664: symlink d1/da/d14/d47/d50/le6 0 2024-04-20T10:54:43.870 INFO:tasks.workunit.client.0.smithi090.stdout:1/538: dread d8/d1a/f89 [0,4194304] 0 2024-04-20T10:54:43.871 INFO:tasks.workunit.client.0.smithi090.stdout:1/539: dread - d8/d1a/d1d/f71 zero size 2024-04-20T10:54:43.871 INFO:tasks.workunit.client.0.smithi090.stdout:1/540: chown d8/d1a/d4d/da5/cab 0 1 2024-04-20T10:54:43.871 INFO:tasks.workunit.client.0.smithi090.stdout:9/508: dread d0/d29/d36/d63/d1c/f3e [0,4194304] 0 2024-04-20T10:54:43.872 INFO:tasks.workunit.client.0.smithi090.stdout:4/457: mkdir d7/d9/d47/d8d 0 2024-04-20T10:54:43.872 INFO:tasks.workunit.client.0.smithi090.stdout:6/411: sync 2024-04-20T10:54:43.872 INFO:tasks.workunit.client.0.smithi090.stdout:0/499: sync 2024-04-20T10:54:43.872 INFO:tasks.workunit.client.0.smithi090.stdout:7/494: sync 2024-04-20T10:54:43.873 INFO:tasks.workunit.client.0.smithi090.stdout:0/500: read - d14/d19/d2b/d8e/f8c zero size 2024-04-20T10:54:43.873 INFO:tasks.workunit.client.0.smithi090.stdout:6/412: truncate d1/d4/d26/d11/f71 518894 0 2024-04-20T10:54:43.873 INFO:tasks.workunit.client.0.smithi090.stdout:6/413: readlink d1/d19/d36/l51 0 2024-04-20T10:54:43.873 INFO:tasks.workunit.client.0.smithi090.stdout:8/448: sync 2024-04-20T10:54:43.873 INFO:tasks.workunit.client.0.smithi090.stdout:8/449: chown d0/d3a/l6b 154960 1 2024-04-20T10:54:43.874 INFO:tasks.workunit.client.0.smithi090.stdout:5/665: dread d1/d2f/d3d/d40/f90 [0,4194304] 0 2024-04-20T10:54:43.874 INFO:tasks.workunit.client.0.smithi090.stdout:5/666: write d1/da/d1f/f97 [65623,71599] 0 2024-04-20T10:54:43.874 INFO:tasks.workunit.client.0.smithi090.stdout:5/667: dread - d1/da/d1f/dad/fc7 zero size 2024-04-20T10:54:43.875 INFO:tasks.workunit.client.0.smithi090.stdout:9/509: read d0/f9 [754990,107788] 0 2024-04-20T10:54:43.875 INFO:tasks.workunit.client.0.smithi090.stdout:1/541: mknod d8/d1a/d4d/da5/cb3 0 2024-04-20T10:54:43.875 INFO:tasks.workunit.client.0.smithi090.stdout:1/542: fdatasync d8/d1a/d1d/d7a/d9a/fac 0 2024-04-20T10:54:43.876 INFO:tasks.workunit.client.0.smithi090.stdout:4/458: truncate d7/d9/f4a 1969198 0 2024-04-20T10:54:43.877 INFO:tasks.workunit.client.0.smithi090.stdout:0/501: mkdir d14/d19/d2c/da1 0 2024-04-20T10:54:43.877 INFO:tasks.workunit.client.0.smithi090.stdout:0/502: write d14/d19/d2b/d8e/d43/f46 [363251,7119] 0 2024-04-20T10:54:43.877 INFO:tasks.workunit.client.0.smithi090.stdout:0/503: chown d14/d19/f71 13201769 1 2024-04-20T10:54:43.878 INFO:tasks.workunit.client.0.smithi090.stdout:6/414: rename d1/d10/c31 to d1/d4/c8b 0 2024-04-20T10:54:43.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/450: creat d0/d3a/d4a/f95 x:0 0 0 2024-04-20T10:54:43.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/451: stat d0/f9 0 2024-04-20T10:54:43.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/452: getdents d0/d11/d22/d53/d8e/d92 0 2024-04-20T10:54:43.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/453: stat d0/d11/d22/d53/f75 0 2024-04-20T10:54:43.880 INFO:tasks.workunit.client.0.smithi090.stdout:9/510: link d0/d29/d36/d63/d1f/d4d/l8e d0/d29/d36/la3 0 2024-04-20T10:54:43.881 INFO:tasks.workunit.client.0.smithi090.stdout:8/454: dread d0/f9 [0,4194304] 0 2024-04-20T10:54:43.881 INFO:tasks.workunit.client.0.smithi090.stdout:1/543: mkdir d8/d1a/d1d/d2c/d8f/db4 0 2024-04-20T10:54:43.883 INFO:tasks.workunit.client.0.smithi090.stdout:4/459: readlink d7/d9/d17/l2d 0 2024-04-20T10:54:43.883 INFO:tasks.workunit.client.0.smithi090.stdout:4/460: readlink d7/d9/d47/d63/l57 0 2024-04-20T10:54:43.887 INFO:tasks.workunit.client.0.smithi090.stdout:6/415: rmdir d1/d4/d26/d11/d35 39 2024-04-20T10:54:43.887 INFO:tasks.workunit.client.0.smithi090.stdout:6/416: write d1/d19/f59 [1610119,28879] 0 2024-04-20T10:54:43.887 INFO:tasks.workunit.client.0.smithi090.stdout:8/455: rmdir d0/d26 39 2024-04-20T10:54:43.890 INFO:tasks.workunit.client.0.smithi090.stdout:6/417: creat d1/d4/d26/d11/d35/f8c x:0 0 0 2024-04-20T10:54:43.893 INFO:tasks.workunit.client.0.smithi090.stdout:8/456: getdents d0/d2d 0 2024-04-20T10:54:43.893 INFO:tasks.workunit.client.0.smithi090.stdout:8/457: fdatasync d0/f36 0 2024-04-20T10:54:43.897 INFO:tasks.workunit.client.0.smithi090.stdout:1/544: write d8/d1a/d4d/f63 [2711423,30759] 0 2024-04-20T10:54:43.899 INFO:tasks.workunit.client.0.smithi090.stdout:6/418: getdents d1/d19/d36/d1e/d1f/d3f 0 2024-04-20T10:54:43.899 INFO:tasks.workunit.client.0.smithi090.stdout:6/419: fdatasync d1/d19/d25/f78 0 2024-04-20T10:54:43.899 INFO:tasks.workunit.client.0.smithi090.stdout:4/461: write d7/d9/d17/f3f [3964821,7934] 0 2024-04-20T10:54:43.900 INFO:tasks.workunit.client.0.smithi090.stdout:5/668: dwrite d1/d55/f74 [0,4194304] 0 2024-04-20T10:54:43.900 INFO:tasks.workunit.client.0.smithi090.stdout:5/669: chown d1/de/dcf/f6f 41199 1 2024-04-20T10:54:43.900 INFO:tasks.workunit.client.0.smithi090.stdout:8/458: mknod d0/d11/d14/c96 0 2024-04-20T10:54:43.902 INFO:tasks.workunit.client.0.smithi090.stdout:7/495: dwrite d11/d13/d5b/f9a [0,4194304] 0 2024-04-20T10:54:43.903 INFO:tasks.workunit.client.0.smithi090.stdout:1/545: link d8/fd d8/d1a/d1d/d2c/d4a/d5a/fb5 0 2024-04-20T10:54:43.903 INFO:tasks.workunit.client.0.smithi090.stdout:1/546: write d8/d1a/d4d/f63 [183213,112914] 0 2024-04-20T10:54:43.903 INFO:tasks.workunit.client.0.smithi090.stdout:9/511: dwrite d0/d29/d36/d63/d1f/fa2 [0,4194304] 0 2024-04-20T10:54:43.903 INFO:tasks.workunit.client.0.smithi090.stdout:6/420: symlink d1/d19/d36/d1e/d1f/d3f/d81/l8d 0 2024-04-20T10:54:43.906 INFO:tasks.workunit.client.0.smithi090.stdout:5/670: mknod d1/da/d1f/ce7 0 2024-04-20T10:54:43.906 INFO:tasks.workunit.client.0.smithi090.stdout:5/671: readlink d1/d2f/d3d/l7b 0 2024-04-20T10:54:43.907 INFO:tasks.workunit.client.0.smithi090.stdout:8/459: rename d0/d11/d14/f6c to d0/d11/f97 0 2024-04-20T10:54:43.909 INFO:tasks.workunit.client.0.smithi090.stdout:7/496: mkdir d11/d13/d22/d24/d35/da7 0 2024-04-20T10:54:43.909 INFO:tasks.workunit.client.0.smithi090.stdout:7/497: chown d11/d13/d22/d82/c42 29 1 2024-04-20T10:54:43.909 INFO:tasks.workunit.client.0.smithi090.stdout:1/547: creat d8/d1a/d1d/d7a/db0/fb6 x:0 0 0 2024-04-20T10:54:43.912 INFO:tasks.workunit.client.0.smithi090.stdout:1/548: dread d8/f80 [0,4194304] 0 2024-04-20T10:54:43.912 INFO:tasks.workunit.client.0.smithi090.stdout:1/549: stat d8/d1a/c66 0 2024-04-20T10:54:43.912 INFO:tasks.workunit.client.0.smithi090.stdout:1/550: write d8/d1a/d1d/d2c/d3f/f53 [1253622,82969] 0 2024-04-20T10:54:43.913 INFO:tasks.workunit.client.0.smithi090.stdout:9/512: symlink d0/d29/d36/d63/d1f/d79/la4 0 2024-04-20T10:54:43.913 INFO:tasks.workunit.client.0.smithi090.stdout:6/421: mknod d1/d4/c8e 0 2024-04-20T10:54:43.914 INFO:tasks.workunit.client.0.smithi090.stdout:5/672: rmdir d1/da/d14/d47/d50 39 2024-04-20T10:54:43.914 INFO:tasks.workunit.client.0.smithi090.stdout:5/673: chown d1/d2f/d3d/d40/d6c/dd2 256066644 1 2024-04-20T10:54:43.916 INFO:tasks.workunit.client.0.smithi090.stdout:8/460: creat d0/d3a/d4a/f98 x:0 0 0 2024-04-20T10:54:43.917 INFO:tasks.workunit.client.0.smithi090.stdout:8/461: chown d0/d26/f55 50939 1 2024-04-20T10:54:43.917 INFO:tasks.workunit.client.0.smithi090.stdout:8/462: write d0/d11/d22/d53/d57/f61 [664083,81765] 0 2024-04-20T10:54:43.919 INFO:tasks.workunit.client.0.smithi090.stdout:7/498: link d11/d13/d33/d44/f7c d11/d13/d5d/fa8 0 2024-04-20T10:54:43.919 INFO:tasks.workunit.client.0.smithi090.stdout:7/499: write d11/d13/d22/f34 [1333810,38189] 0 2024-04-20T10:54:43.920 INFO:tasks.workunit.client.0.smithi090.stdout:1/551: creat d8/d1a/d1d/d2c/d4a/fb7 x:0 0 0 2024-04-20T10:54:43.920 INFO:tasks.workunit.client.0.smithi090.stdout:1/552: fsync d8/d1a/d1d/d2c/d4a/d93/d5d/f5e 0 2024-04-20T10:54:43.921 INFO:tasks.workunit.client.0.smithi090.stdout:6/422: symlink d1/d4/d26/d11/l8f 0 2024-04-20T10:54:43.922 INFO:tasks.workunit.client.0.smithi090.stdout:8/463: mkdir d0/d99 0 2024-04-20T10:54:43.925 INFO:tasks.workunit.client.0.smithi090.stdout:7/500: unlink d11/d1a/c5a 0 2024-04-20T10:54:43.927 INFO:tasks.workunit.client.0.smithi090.stdout:0/504: getdents d14/d19/d2c 0 2024-04-20T10:54:43.927 INFO:tasks.workunit.client.0.smithi090.stdout:0/505: truncate fd 4699202 0 2024-04-20T10:54:43.928 INFO:tasks.workunit.client.0.smithi090.stdout:8/464: creat d0/d11/d14/d52/f9a x:0 0 0 2024-04-20T10:54:43.929 INFO:tasks.workunit.client.0.smithi090.stdout:9/513: dwrite d0/d29/f57 [0,4194304] 0 2024-04-20T10:54:43.930 INFO:tasks.workunit.client.0.smithi090.stdout:7/501: mkdir d11/d13/d23/d6c/d72/da9 0 2024-04-20T10:54:43.930 INFO:tasks.workunit.client.0.smithi090.stdout:9/514: read d0/d29/f92 [47167,109933] 0 2024-04-20T10:54:43.931 INFO:tasks.workunit.client.0.smithi090.stdout:0/506: readlink d14/l64 0 2024-04-20T10:54:43.932 INFO:tasks.workunit.client.0.smithi090.stdout:8/465: symlink d0/d11/d22/l9b 0 2024-04-20T10:54:43.934 INFO:tasks.workunit.client.0.smithi090.stdout:7/502: rename d11/d13/d22/d24/d35/f51 to d11/d13/d22/d82/faa 0 2024-04-20T10:54:43.935 INFO:tasks.workunit.client.0.smithi090.stdout:5/674: dwrite d1/f26 [0,4194304] 0 2024-04-20T10:54:43.935 INFO:tasks.workunit.client.0.smithi090.stdout:9/515: mkdir d0/d29/d4f/d23/da5 0 2024-04-20T10:54:43.935 INFO:tasks.workunit.client.0.smithi090.stdout:0/507: read - d14/d19/d2b/f83 zero size 2024-04-20T10:54:43.936 INFO:tasks.workunit.client.0.smithi090.stdout:8/466: rmdir d0/d2d/d49 39 2024-04-20T10:54:43.936 INFO:tasks.workunit.client.0.smithi090.stdout:8/467: truncate d0/d11/d14/f2b 2692412 0 2024-04-20T10:54:43.951 INFO:tasks.workunit.client.0.smithi090.stdout:7/503: dwrite d11/d13/d33/f54 [0,4194304] 0 2024-04-20T10:54:43.954 INFO:tasks.workunit.client.0.smithi090.stdout:5/675: rename d1/de/lb9 to d1/da/d1f/dad/dc8/le8 0 2024-04-20T10:54:43.954 INFO:tasks.workunit.client.0.smithi090.stdout:9/516: creat d0/fa6 x:0 0 0 2024-04-20T10:54:43.954 INFO:tasks.workunit.client.0.smithi090.stdout:0/508: creat d14/d19/d2b/d52/d55/d5b/d7f/fa2 x:0 0 0 2024-04-20T10:54:43.954 INFO:tasks.workunit.client.0.smithi090.stdout:5/676: write d1/da/d1f/dad/fd0 [4557656,102439] 0 2024-04-20T10:54:43.954 INFO:tasks.workunit.client.0.smithi090.stdout:8/468: creat d0/f9c x:0 0 0 2024-04-20T10:54:43.954 INFO:tasks.workunit.client.0.smithi090.stdout:6/423: getdents d1/d19/d36/d1e/d1f/d3f/d81 0 2024-04-20T10:54:43.956 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:43.956 INFO:tasks.workunit.client.0.smithi090.stdout:5/677: creat d1/fe9 x:0 0 0 2024-04-20T10:54:43.957 INFO:tasks.workunit.client.0.smithi090.stdout:9/517: rmdir d0/d29/d36/d63/d1f/d34 39 2024-04-20T10:54:43.959 INFO:tasks.workunit.client.0.smithi090.stdout:0/509: dread f13 [0,4194304] 0 2024-04-20T10:54:43.959 INFO:tasks.workunit.client.0.smithi090.stdout:6/424: rename d1/l85 to d1/d4/d26/l90 0 2024-04-20T10:54:43.960 INFO:tasks.workunit.client.0.smithi090.stdout:8/469: creat d0/d3a/d4a/f9d x:0 0 0 2024-04-20T10:54:43.960 INFO:tasks.workunit.client.0.smithi090.stdout:8/470: write d0/d26/f55 [1240682,76955] 0 2024-04-20T10:54:43.961 INFO:tasks.workunit.client.0.smithi090.stdout:5/678: creat d1/da/d1f/dad/fea x:0 0 0 2024-04-20T10:54:43.962 INFO:tasks.workunit.client.0.smithi090.stdout:5/679: write d1/da/d14/d47/d50/f51 [4088886,69568] 0 2024-04-20T10:54:43.962 INFO:tasks.workunit.client.0.smithi090.stdout:5/680: read - d1/de/fa3 zero size 2024-04-20T10:54:43.963 INFO:tasks.workunit.client.0.smithi090.stdout:9/518: link d0/d29/d36/d63/d1f/d34/d70/d52/c64 d0/d9a/ca7 0 2024-04-20T10:54:43.963 INFO:tasks.workunit.client.0.smithi090.stdout:9/519: rename d0/d29 to d0/d29/d4f/d6b/da8 22 2024-04-20T10:54:43.963 INFO:tasks.workunit.client.0.smithi090.stdout:9/520: read d0/d29/d36/d63/d1f/d79/f59 [958976,40087] 0 2024-04-20T10:54:43.965 INFO:tasks.workunit.client.0.smithi090.stdout:0/510: symlink d14/d19/d2b/d61/d88/la3 0 2024-04-20T10:54:43.965 INFO:tasks.workunit.client.0.smithi090.stdout:0/511: write d14/d19/d2b/d8e/d43/d73/f97 [1896132,33059] 0 2024-04-20T10:54:43.966 INFO:tasks.workunit.client.0.smithi090.stdout:0/512: read fe [830136,54978] 0 2024-04-20T10:54:43.966 INFO:tasks.workunit.client.0.smithi090.stdout:0/513: dread - d14/d19/d2b/d52/d55/d5b/f8f zero size 2024-04-20T10:54:43.966 INFO:tasks.workunit.client.0.smithi090.stdout:8/471: unlink d0/d11/d14/d52/f89 0 2024-04-20T10:54:43.970 INFO:tasks.workunit.client.0.smithi090.stdout:9/521: rename d0/d29/d36/d63/d1f/d34/d70/d52/c48 to d0/d29/d4f/d82/ca9 0 2024-04-20T10:54:43.971 INFO:tasks.workunit.client.0.smithi090.stdout:9/522: write d0/f7c [13302248,95431] 0 2024-04-20T10:54:43.971 INFO:tasks.workunit.client.0.smithi090.stdout:9/523: fsync d0/d29/d4f/d6b/f72 0 2024-04-20T10:54:43.971 INFO:tasks.workunit.client.0.smithi090.stdout:9/524: readlink d0/l28 0 2024-04-20T10:54:43.971 INFO:tasks.workunit.client.0.smithi090.stdout:7/504: dwrite d11/d13/d22/d27/f50 [4194304,4194304] 0 2024-04-20T10:54:43.972 INFO:tasks.workunit.client.0.smithi090.stdout:8/472: dread d0/f9 [0,4194304] 0 2024-04-20T10:54:43.972 INFO:tasks.workunit.client.0.smithi090.stdout:8/473: dread - d0/d11/d14/f7f zero size 2024-04-20T10:54:43.972 INFO:tasks.workunit.client.0.smithi090.stdout:8/474: readlink d0/d26/l42 0 2024-04-20T10:54:43.974 INFO:tasks.workunit.client.0.smithi090.stdout:7/505: unlink d11/d13/l30 0 2024-04-20T10:54:43.975 INFO:tasks.workunit.client.0.smithi090.stdout:7/506: write d11/d13/d22/d24/f2e [3636085,65057] 0 2024-04-20T10:54:43.976 INFO:tasks.workunit.client.0.smithi090.stdout:8/475: rename d0/d2d/f48 to d0/d3a/d4a/d81/f9e 0 2024-04-20T10:54:43.976 INFO:tasks.workunit.client.0.smithi090.stdout:8/476: read - d0/d2d/d49/d67/f87 zero size 2024-04-20T10:54:43.981 INFO:tasks.workunit.client.0.smithi090.stdout:6/425: dwrite d1/d4/f1d [4194304,4194304] 0 2024-04-20T10:54:43.982 INFO:tasks.workunit.client.0.smithi090.stdout:8/477: write d0/d11/f1b [424711,60239] 0 2024-04-20T10:54:43.983 INFO:tasks.workunit.client.0.smithi090.stdout:6/426: dread d1/d4/f46 [0,4194304] 0 2024-04-20T10:54:43.983 INFO:tasks.workunit.client.0.smithi090.stdout:5/681: dwrite d1/d2a/f3e [0,4194304] 0 2024-04-20T10:54:43.987 INFO:tasks.workunit.client.0.smithi090.stdout:6/427: truncate d1/d4/d26/d11/d4a/d56/f4f 155698 0 2024-04-20T10:54:43.987 INFO:tasks.workunit.client.0.smithi090.stdout:6/428: fdatasync d1/d4/d26/d11/d4a/d70/f7f 0 2024-04-20T10:54:43.987 INFO:tasks.workunit.client.0.smithi090.stdout:6/429: fdatasync d1/d4/d26/ff 0 2024-04-20T10:54:43.988 INFO:tasks.workunit.client.0.smithi090.stdout:0/514: dwrite fe [0,4194304] 0 2024-04-20T10:54:43.989 INFO:tasks.workunit.client.0.smithi090.stdout:5/682: creat d1/da/d14/dc0/feb x:0 0 0 2024-04-20T10:54:43.994 INFO:tasks.workunit.client.0.smithi090.stdout:4/462: truncate d7/d9/f4a 1241149 0 2024-04-20T10:54:43.995 INFO:tasks.workunit.client.0.smithi090.stdout:0/515: mknod d14/d19/d2b/ca4 0 2024-04-20T10:54:43.995 INFO:tasks.workunit.client.0.smithi090.stdout:4/463: dread d7/d9/f20 [0,4194304] 0 2024-04-20T10:54:43.995 INFO:tasks.workunit.client.0.smithi090.stdout:4/464: write d7/d9/d17/f3f [3911787,39165] 0 2024-04-20T10:54:43.995 INFO:tasks.workunit.client.0.smithi090.stdout:0/516: creat d14/d19/d2b/d61/fa5 x:0 0 0 2024-04-20T10:54:43.995 INFO:tasks.workunit.client.0.smithi090.stdout:7/507: dwrite d11/d1a/f46 [4194304,4194304] 0 2024-04-20T10:54:43.996 INFO:tasks.workunit.client.0.smithi090.stdout:0/517: mkdir d14/d39/da6 0 2024-04-20T10:54:43.997 INFO:tasks.workunit.client.0.smithi090.stdout:7/508: rmdir d11/d13/d23/d6c/d72 39 2024-04-20T10:54:43.998 INFO:tasks.workunit.client.0.smithi090.stdout:4/465: mknod d7/d9/d17/c8e 0 2024-04-20T10:54:43.998 INFO:tasks.workunit.client.0.smithi090.stdout:4/466: truncate d7/d9/d47/d63/d42/f67 220156 0 2024-04-20T10:54:44.000 INFO:tasks.workunit.client.0.smithi090.stdout:0/518: unlink d14/f18 0 2024-04-20T10:54:44.002 INFO:tasks.workunit.client.0.smithi090.stdout:7/509: rename d11/d13/d33/d44/f71 to d11/d13/d5d/d65/fab 0 2024-04-20T10:54:44.003 INFO:tasks.workunit.client.0.smithi090.stdout:9/525: dwrite d0/f7c [0,4194304] 0 2024-04-20T10:54:44.004 INFO:tasks.workunit.client.0.smithi090.stdout:4/467: mkdir d7/d9/d47/d63/d42/d8f 0 2024-04-20T10:54:44.006 INFO:tasks.workunit.client.0.smithi090.stdout:7/510: rmdir d11 39 2024-04-20T10:54:44.007 INFO:tasks.workunit.client.0.smithi090.stdout:6/430: dwrite d1/d10/f39 [0,4194304] 0 2024-04-20T10:54:44.007 INFO:tasks.workunit.client.0.smithi090.stdout:9/526: mkdir d0/d29/d4f/d23/daa 0 2024-04-20T10:54:44.009 INFO:tasks.workunit.client.0.smithi090.stdout:0/519: rename d14/d19/d2b/c62 to d14/d19/d2b/d8e/d40/ca7 0 2024-04-20T10:54:44.010 INFO:tasks.workunit.client.0.smithi090.stdout:7/511: creat d11/d13/d23/d6c/d72/fac x:0 0 0 2024-04-20T10:54:44.011 INFO:tasks.workunit.client.0.smithi090.stdout:9/527: creat d0/d29/d36/d63/d1c/d94/fab x:0 0 0 2024-04-20T10:54:44.013 INFO:tasks.workunit.client.0.smithi090.stdout:6/431: rename d1/fd to d1/d19/d36/f91 0 2024-04-20T10:54:44.014 INFO:tasks.workunit.client.0.smithi090.stdout:0/520: creat d14/d19/d31/d34/fa8 x:0 0 0 2024-04-20T10:54:44.014 INFO:tasks.workunit.client.0.smithi090.stdout:7/512: symlink d11/d13/d22/d82/lad 0 2024-04-20T10:54:44.015 INFO:tasks.workunit.client.0.smithi090.stdout:6/432: creat d1/d4/d26/d11/d35/d80/f92 x:0 0 0 2024-04-20T10:54:44.017 INFO:tasks.workunit.client.0.smithi090.stdout:9/528: rename d0/d29/d4f/f67 to d0/d29/d36/d63/d1f/d34/fac 0 2024-04-20T10:54:44.019 INFO:tasks.workunit.client.0.smithi090.stdout:9/529: link d0/d29/d36/d63/d1f/d4d/c5f d0/d29/d4f/cad 0 2024-04-20T10:54:44.020 INFO:tasks.workunit.client.0.smithi090.stdout:9/530: readlink d0/d29/d36/d63/d1c/l95 0 2024-04-20T10:54:44.020 INFO:tasks.workunit.client.0.smithi090.stdout:9/531: chown d0/d29/d36/d63/d1f/d34 550 1 2024-04-20T10:54:44.020 INFO:tasks.workunit.client.0.smithi090.stdout:7/513: rename d11/d1a/f76 to d11/d13/fae 0 2024-04-20T10:54:44.021 INFO:tasks.workunit.client.0.smithi090.stdout:0/521: unlink d14/d19/d2b/f51 0 2024-04-20T10:54:44.023 INFO:tasks.workunit.client.0.smithi090.stdout:7/514: rmdir d11/d13/d22/d7d 0 2024-04-20T10:54:44.024 INFO:tasks.workunit.client.0.smithi090.stdout:0/522: mknod d14/d19/d2b/d8e/d43/d5c/d70/ca9 0 2024-04-20T10:54:44.024 INFO:tasks.workunit.client.0.smithi090.stdout:0/523: dread - d14/d19/d2b/d52/d55/d5b/d7f/fa2 zero size 2024-04-20T10:54:44.031 INFO:tasks.workunit.client.0.smithi090.stdout:9/532: dread d0/f7c [0,4194304] 0 2024-04-20T10:54:44.040 INFO:tasks.workunit.client.0.smithi090.stdout:0/524: dwrite d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:44.057 INFO:tasks.workunit.client.0.smithi090.stdout:0/525: dwrite d14/d19/d2b/d8e/f92 [0,4194304] 0 2024-04-20T10:54:44.057 INFO:tasks.workunit.client.0.smithi090.stdout:0/526: chown d14/d19/d9e 130418 1 2024-04-20T10:54:44.058 INFO:tasks.workunit.client.0.smithi090.stdout:7/515: rename d11/d1a/d3b/d79/l59 to d11/d61/laf 0 2024-04-20T10:54:44.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.080+0000 7f4a0b225640 1 Processor -- start 2024-04-20T10:54:44.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a0b225640 1 -- start start 2024-04-20T10:54:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a0b225640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a04153df0 0x7f4a0406cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:44.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a0b225640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4a040c6a00 0x7f4a0415a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a0b225640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a040c6e60 con 0x7f4a040c9f80 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a0b225640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0415ad50 con 0x7f4a04153df0 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a0b225640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4a0406c7b0 con 0x7f4a040c6a00 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a08fc1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a04153df0 0x7f4a0406cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a08fc1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a04153df0 0x7f4a0406cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48584/0 (socket says 172.21.15.90:48584) 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.081+0000 7f4a08fc1640 1 -- 172.21.15.90:0/4086801357 learned_addr learned my addr 172.21.15.90:0/4086801357 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a03fff640 1 --2- 172.21.15.90:0/4086801357 >> v2:172.21.15.175:3300/0 conn(0x7f4a040c6a00 0x7f4a0415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a08fc1640 1 -- 172.21.15.90:0/4086801357 >> v2:172.21.15.175:3300/0 conn(0x7f4a040c6a00 msgr2=0x7f4a0415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a08fc1640 1 --2- 172.21.15.90:0/4086801357 >> v2:172.21.15.175:3300/0 conn(0x7f4a040c6a00 0x7f4a0415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a08fc1640 1 -- 172.21.15.90:0/4086801357 >> v1:172.21.15.90:6789/0 conn(0x7f4a040c9f80 legacy=0x7f4a040c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a08fc1640 1 -- 172.21.15.90:0/4086801357 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a040c7100 con 0x7f4a04153df0 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a03fff640 1 --2- 172.21.15.90:0/4086801357 >> v2:172.21.15.175:3300/0 conn(0x7f4a040c6a00 0x7f4a0415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:54:44.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a08fc1640 1 --2- 172.21.15.90:0/4086801357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a0406cc40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4a0406c930 tx=0x7f49f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86fd1d540b2ecc4a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a037fe640 1 -- 172.21.15.90:0/4086801357 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f802e070 con 0x7f4a04153df0 2024-04-20T10:54:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a037fe640 1 -- 172.21.15.90:0/4086801357 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49f8037070 con 0x7f4a04153df0 2024-04-20T10:54:44.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.082+0000 7f4a037fe640 1 -- 172.21.15.90:0/4086801357 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8031a00 con 0x7f4a04153df0 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 -- 172.21.15.90:0/4086801357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 msgr2=0x7f4a0406cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 --2- 172.21.15.90:0/4086801357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a0406cc40 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f4a0406c930 tx=0x7f49f802b880 comp rx=0 tx=0).stop 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 -- 172.21.15.90:0/4086801357 shutdown_connections 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 --2- 172.21.15.90:0/4086801357 >> v2:172.21.15.175:3300/0 conn(0x7f4a040c6a00 0x7f4a0415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 --2- 172.21.15.90:0/4086801357 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a0406cc40 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 -- 172.21.15.90:0/4086801357 >> 172.21.15.90:0/4086801357 conn(0x7f4a040adbd0 msgr2=0x7f4a040adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 -- 172.21.15.90:0/4086801357 shutdown_connections 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.083+0000 7f4a0b225640 1 -- 172.21.15.90:0/4086801357 wait complete. 2024-04-20T10:54:44.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.084+0000 7f4a0b225640 1 Processor -- start 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.084+0000 7f4a0b225640 1 -- start start 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a0b225640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a040c6a00 0x7f4a04158480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a0b225640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a040c9f80 0x7f4a04159690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a0b225640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a040ac8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a0b225640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a041541d0 con 0x7f4a04153df0 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a0b225640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0406c440 con 0x7f4a040c9f80 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a0b225640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4a040c73e0 con 0x7f4a040c6a00 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a040ac8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a040ac8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48592/0 (socket says 172.21.15.90:48592) 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 -- 172.21.15.90:0/3505106159 learned_addr learned my addr 172.21.15.90:0/3505106159 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a03fff640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a040c9f80 0x7f4a04159690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a08fc1640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a040c6a00 0x7f4a04158480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 -- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a040c6a00 msgr2=0x7f4a04158480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a040c6a00 0x7f4a04158480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 -- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a040c9f80 msgr2=0x7f4a04159690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a040c9f80 0x7f4a04159690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 -- 172.21.15.90:0/3505106159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a04157200 con 0x7f4a04153df0 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a03fff640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a040c9f80 0x7f4a04159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.085+0000 7f4a097c2640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a040ac8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c7a0 tx=0x7f49fc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.086+0000 7f4a017fa640 1 -- 172.21.15.90:0/3505106159 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc003b70 con 0x7f4a04153df0 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.086+0000 7f4a017fa640 1 -- 172.21.15.90:0/3505106159 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49fc003d30 con 0x7f4a04153df0 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.086+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a041efe10 con 0x7f4a04153df0 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.086+0000 7f4a017fa640 1 -- 172.21.15.90:0/3505106159 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49fc00aa90 con 0x7f4a04153df0 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.086+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a04157c80 con 0x7f4a04153df0 2024-04-20T10:54:44.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.087+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a04076150 con 0x7f4a04153df0 2024-04-20T10:54:44.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.087+0000 7f4a017fa640 1 -- 172.21.15.90:0/3505106159 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f49fc00ac30 con 0x7f4a04153df0 2024-04-20T10:54:44.113 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.088+0000 7f4a017fa640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f49e806c8f0 0x7f49e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:44.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.088+0000 7f4a017fa640 1 -- 172.21.15.90:0/3505106159 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f49fc08bf20 con 0x7f4a04153df0 2024-04-20T10:54:44.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.088+0000 7f4a08fc1640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f49e806c8f0 0x7f49e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:44.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.088+0000 7f4a08fc1640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f49e806c8f0 0x7f49e806edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49f8036000 tx=0x7f49f803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:44.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.092+0000 7f4a017fa640 1 -- 172.21.15.90:0/3505106159 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f49fc059ee0 con 0x7f4a04153df0 2024-04-20T10:54:44.294 INFO:tasks.workunit.client.0.smithi090.stdout:0/527: mkdir d14/daa 0 2024-04-20T10:54:44.298 INFO:tasks.workunit.client.0.smithi090.stdout:2/511: sync 2024-04-20T10:54:44.298 INFO:tasks.workunit.client.0.smithi090.stdout:3/420: sync 2024-04-20T10:54:44.298 INFO:tasks.workunit.client.0.smithi090.stdout:2/512: dread - d11/d1f/d2e/f89 zero size 2024-04-20T10:54:44.299 INFO:tasks.workunit.client.0.smithi090.stdout:3/421: creat d7/f8b x:0 0 0 2024-04-20T10:54:44.300 INFO:tasks.workunit.client.0.smithi090.stdout:3/422: chown d7/d43/f76 236356 1 2024-04-20T10:54:44.301 INFO:tasks.workunit.client.0.smithi090.stdout:2/513: mkdir d11/db0 0 2024-04-20T10:54:44.302 INFO:tasks.workunit.client.0.smithi090.stdout:3/423: creat d7/d15/f8c x:0 0 0 2024-04-20T10:54:44.303 INFO:tasks.workunit.client.0.smithi090.stdout:2/514: rename d11/d1f/c51 to d11/d1a/d2b/da7/cb1 0 2024-04-20T10:54:44.303 INFO:tasks.workunit.client.0.smithi090.stdout:3/424: rmdir d7/df 39 2024-04-20T10:54:44.304 INFO:tasks.workunit.client.0.smithi090.stdout:2/515: rename d11/d1a/l23 to d11/d1f/d2e/lb2 0 2024-04-20T10:54:44.304 INFO:tasks.workunit.client.0.smithi090.stdout:2/516: dread - d11/d1a/d30/d8d/f9c zero size 2024-04-20T10:54:44.309 INFO:tasks.workunit.client.0.smithi090.stdout:0/528: dwrite d14/d19/d2b/d61/fa5 [0,4194304] 0 2024-04-20T10:54:44.310 INFO:tasks.workunit.client.0.smithi090.stdout:3/425: mkdir d7/d15/d2a/d8d 0 2024-04-20T10:54:44.313 INFO:tasks.workunit.client.0.smithi090.stdout:3/426: dread d7/d43/f45 [0,4194304] 0 2024-04-20T10:54:44.313 INFO:tasks.workunit.client.0.smithi090.stdout:3/427: write d7/d15/f8c [823350,75834] 0 2024-04-20T10:54:44.313 INFO:tasks.workunit.client.0.smithi090.stdout:3/428: fsync d7/d15/f23 0 2024-04-20T10:54:44.314 INFO:tasks.workunit.client.0.smithi090.stdout:0/529: getdents d14/d19/d2b/d61/d88 0 2024-04-20T10:54:44.315 INFO:tasks.workunit.client.0.smithi090.stdout:3/429: creat d7/d15/d2a/d8d/f8e x:0 0 0 2024-04-20T10:54:44.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.316+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a0406d950 con 0x7f4a04153df0 2024-04-20T10:54:44.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.316+0000 7f4a017fa640 1 -- 172.21.15.90:0/3505106159 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7f49fc0597e0 con 0x7f4a04153df0 2024-04-20T10:54:44.316 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:44.317 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:44.317 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:44.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f49e806c8f0 msgr2=0x7f49e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:44.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f49e806c8f0 0x7f49e806edb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f49f8036000 tx=0x7f49f803d040 comp rx=0 tx=0).stop 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 msgr2=0x7f4a040ac8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a040ac8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f49fc00c7a0 tx=0x7f49fc00cc60 comp rx=0 tx=0).stop 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 shutdown_connections 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f49e806c8f0 0x7f49e806edb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a04153df0 0x7f4a040ac8f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a040c9f80 0x7f4a04159690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 --2- 172.21.15.90:0/3505106159 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a040c6a00 0x7f4a04158480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 >> 172.21.15.90:0/3505106159 conn(0x7f4a040adbd0 msgr2=0x7f4a0414e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 shutdown_connections 2024-04-20T10:54:44.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:44.319+0000 7f4a0b225640 1 -- 172.21.15.90:0/3505106159 wait complete. 2024-04-20T10:54:44.322 INFO:tasks.workunit.client.0.smithi090.stdout:0/530: dread d14/d19/d2b/f30 [0,4194304] 0 2024-04-20T10:54:44.322 INFO:tasks.workunit.client.0.smithi090.stdout:2/517: dwrite d11/f76 [0,4194304] 0 2024-04-20T10:54:44.323 INFO:tasks.workunit.client.0.smithi090.stdout:2/518: dread - d11/d1f/d2e/f4b zero size 2024-04-20T10:54:44.323 INFO:tasks.workunit.client.0.smithi090.stdout:2/519: chown d11/l41 2455024 1 2024-04-20T10:54:44.323 INFO:tasks.workunit.client.0.smithi090.stdout:2/520: stat d11/d1a/d37/f77 0 2024-04-20T10:54:44.323 INFO:tasks.workunit.client.0.smithi090.stdout:3/430: creat d7/d15/f8f x:0 0 0 2024-04-20T10:54:44.323 INFO:tasks.workunit.client.0.smithi090.stdout:3/431: readlink d7/d11/l3a 0 2024-04-20T10:54:44.323 INFO:tasks.workunit.client.0.smithi090.stdout:3/432: readlink d7/l12 0 2024-04-20T10:54:44.324 INFO:tasks.workunit.client.0.smithi090.stdout:0/531: rename d14/d19/d2c to d14/d19/d2b/d52/dab 0 2024-04-20T10:54:44.324 INFO:tasks.workunit.client.0.smithi090.stdout:0/532: chown d14/d19/d2b/d52/dab/f75 2232 1 2024-04-20T10:54:44.324 INFO:tasks.workunit.client.0.smithi090.stdout:0/533: stat d14/d19/c24 0 2024-04-20T10:54:44.325 INFO:tasks.workunit.client.0.smithi090.stdout:2/521: unlink d11/d1a/l7f 0 2024-04-20T10:54:44.325 INFO:tasks.workunit.client.0.smithi090.stdout:2/522: write d11/d1a/d4a/d55/f9a [1014204,82587] 0 2024-04-20T10:54:44.326 INFO:tasks.workunit.client.0.smithi090.stdout:0/534: unlink fa 0 2024-04-20T10:54:44.328 INFO:tasks.workunit.client.0.smithi090.stdout:3/433: getdents d7/d15/d2a/d8d 0 2024-04-20T10:54:44.328 INFO:tasks.workunit.client.0.smithi090.stdout:3/434: chown d7/d15/d2a/d68/f74 22747281 1 2024-04-20T10:54:44.328 INFO:tasks.workunit.client.0.smithi090.stdout:3/435: write d7/d11/f32 [528360,55182] 0 2024-04-20T10:54:44.329 INFO:tasks.workunit.client.0.smithi090.stdout:2/523: symlink d11/db0/lb3 0 2024-04-20T10:54:44.330 INFO:tasks.workunit.client.0.smithi090.stdout:3/436: truncate d7/d15/d2a/f49 2366549 0 2024-04-20T10:54:44.333 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:44.333 INFO:tasks.workunit.client.0.smithi090.stdout:2/524: creat d11/d1a/d4a/d55/d67/fb4 x:0 0 0 2024-04-20T10:54:44.334 INFO:tasks.workunit.client.0.smithi090.stdout:2/525: dread d11/d1a/d2b/f56 [0,4194304] 0 2024-04-20T10:54:44.335 INFO:tasks.workunit.client.0.smithi090.stdout:3/437: creat d7/d26/f90 x:0 0 0 2024-04-20T10:54:44.335 INFO:tasks.workunit.client.0.smithi090.stdout:3/438: stat d7/df/l14 0 2024-04-20T10:54:44.336 INFO:tasks.workunit.client.0.smithi090.stdout:2/526: mknod d11/d1a/d30/da6/cb5 0 2024-04-20T10:54:44.339 INFO:tasks.workunit.client.0.smithi090.stdout:3/439: symlink d7/d15/d2a/d68/d7f/l91 0 2024-04-20T10:54:44.345 INFO:tasks.workunit.client.0.smithi090.stdout:3/440: write d7/d15/d2a/d30/f64 [2456184,25517] 0 2024-04-20T10:54:44.423 INFO:tasks.workunit.client.0.smithi090.stdout:3/441: symlink d7/df/d2c/l92 0 2024-04-20T10:54:44.423 INFO:tasks.workunit.client.0.smithi090.stdout:3/442: write d7/d26/f90 [497201,124465] 0 2024-04-20T10:54:44.424 INFO:tasks.workunit.client.0.smithi090.stdout:3/443: dread d7/d11/f2e [0,4194304] 0 2024-04-20T10:54:44.439 INFO:tasks.workunit.client.0.smithi090.stdout:3/444: rename d7/d15/d2a/d68 to d7/d15/d2a/d30/d93 0 2024-04-20T10:54:44.439 INFO:tasks.workunit.client.0.smithi090.stdout:3/445: readlink d7/d15/d2a/l66 0 2024-04-20T10:54:44.456 INFO:tasks.workunit.client.0.smithi090.stdout:3/446: dwrite d7/f6c [0,4194304] 0 2024-04-20T10:54:44.487 INFO:tasks.workunit.client.0.smithi090.stdout:1/553: sync 2024-04-20T10:54:44.487 INFO:tasks.workunit.client.0.smithi090.stdout:8/478: sync 2024-04-20T10:54:44.487 INFO:tasks.workunit.client.0.smithi090.stdout:8/479: chown d0/d2d/l32 1759 1 2024-04-20T10:54:44.488 INFO:tasks.workunit.client.0.smithi090.stdout:3/447: unlink d7/d26/f90 0 2024-04-20T10:54:44.489 INFO:tasks.workunit.client.0.smithi090.stdout:1/554: unlink d8/f6a 0 2024-04-20T10:54:44.489 INFO:tasks.workunit.client.0.smithi090.stdout:1/555: write d8/d1a/d1d/d2c/d3f/f87 [600923,22061] 0 2024-04-20T10:54:44.489 INFO:tasks.workunit.client.0.smithi090.stdout:1/556: write d8/f44 [1145110,87343] 0 2024-04-20T10:54:44.491 INFO:tasks.workunit.client.0.smithi090.stdout:8/480: rename d0/d11/d14 to d0/d3a/d9f 0 2024-04-20T10:54:44.491 INFO:tasks.workunit.client.0.smithi090.stdout:8/481: dread - d0/d3a/d4a/f95 zero size 2024-04-20T10:54:44.493 INFO:tasks.workunit.client.0.smithi090.stdout:3/448: unlink d7/d11/f32 0 2024-04-20T10:54:44.493 INFO:tasks.workunit.client.0.smithi090.stdout:3/449: write d7/d11/f1c [1894987,23761] 0 2024-04-20T10:54:44.493 INFO:tasks.workunit.client.0.smithi090.stdout:3/450: truncate d7/d15/d2a/d8d/f8e 147959 0 2024-04-20T10:54:44.494 INFO:tasks.workunit.client.0.smithi090.stdout:8/482: symlink d0/d2d/d49/la0 0 2024-04-20T10:54:44.494 INFO:tasks.workunit.client.0.smithi090.stdout:8/483: fdatasync d0/f9 0 2024-04-20T10:54:44.505 INFO:tasks.workunit.client.0.smithi090.stdout:8/484: dread d0/f20 [0,4194304] 0 2024-04-20T10:54:44.505 INFO:tasks.workunit.client.0.smithi090.stdout:8/485: truncate d0/d3a/f8d 1539443 0 2024-04-20T10:54:44.505 INFO:tasks.workunit.client.0.smithi090.stdout:8/486: write d0/d3a/d4a/f9d [512769,51765] 0 2024-04-20T10:54:44.508 INFO:tasks.workunit.client.0.smithi090.stdout:3/451: mknod d7/d15/d47/c94 0 2024-04-20T10:54:44.508 INFO:tasks.workunit.client.0.smithi090.stdout:3/452: dread - d7/d35/f6b zero size 2024-04-20T10:54:44.510 INFO:tasks.workunit.client.0.smithi090.stdout:1/557: dwrite d8/d1a/d1d/d2c/d3f/f5c [0,4194304] 0 2024-04-20T10:54:44.523 INFO:tasks.workunit.client.0.smithi090.stdout:3/453: dwrite d7/f8b [0,4194304] 0 2024-04-20T10:54:44.774 INFO:tasks.workunit.client.0.smithi090.stdout:1/558: link d8/d1a/d1d/l95 d8/d1a/d1d/lb8 0 2024-04-20T10:54:44.775 INFO:tasks.workunit.client.0.smithi090.stdout:3/454: rename d7/df/l2b to d7/d15/d2a/l95 0 2024-04-20T10:54:44.775 INFO:tasks.workunit.client.0.smithi090.stdout:3/455: stat d7/d43 0 2024-04-20T10:54:44.775 INFO:tasks.workunit.client.0.smithi090.stdout:1/559: creat d8/d1a/d1d/d2c/d4a/fb9 x:0 0 0 2024-04-20T10:54:44.776 INFO:tasks.workunit.client.0.smithi090.stdout:3/456: truncate d7/d15/d2a/d30/d48/f4f 193206 0 2024-04-20T10:54:44.776 INFO:tasks.workunit.client.0.smithi090.stdout:3/457: write d7/df/f4d [2611667,55227] 0 2024-04-20T10:54:44.776 INFO:tasks.workunit.client.0.smithi090.stdout:1/560: rmdir d8/d1a/d1d/d2c/d6e 39 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:6/433: sync 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:6/434: readlink d1/d4/d26/l14 0 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:3/458: symlink d7/d15/d2a/l96 0 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:9/533: sync 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:4/468: sync 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:3/459: write d7/d43/f76 [856788,111209] 0 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:5/683: sync 2024-04-20T10:54:44.779 INFO:tasks.workunit.client.0.smithi090.stdout:7/516: sync 2024-04-20T10:54:44.780 INFO:tasks.workunit.client.0.smithi090.stdout:5/684: fdatasync d1/da/d14/d47/f84 0 2024-04-20T10:54:44.780 INFO:tasks.workunit.client.0.smithi090.stdout:5/685: stat d1/da/d14/d47/ca2 0 2024-04-20T10:54:44.780 INFO:tasks.workunit.client.0.smithi090.stdout:5/686: write d1/da/d1f/dad/fcc [78141,111926] 0 2024-04-20T10:54:44.780 INFO:tasks.workunit.client.0.smithi090.stdout:5/687: write d1/de/fae [18434,26517] 0 2024-04-20T10:54:44.780 INFO:tasks.workunit.client.0.smithi090.stdout:1/561: truncate d8/d1a/d1d/d7a/d9a/f4f 415149 0 2024-04-20T10:54:44.780 INFO:tasks.workunit.client.0.smithi090.stdout:1/562: stat d8/d1a/d4d/da5/cb3 0 2024-04-20T10:54:44.780 INFO:tasks.workunit.client.0.smithi090.stdout:1/563: write d8/d1a/d1d/d67/f61 [2400217,49432] 0 2024-04-20T10:54:44.781 INFO:tasks.workunit.client.0.smithi090.stdout:9/534: symlink d0/d29/d4f/d23/daa/lae 0 2024-04-20T10:54:44.781 INFO:tasks.workunit.client.0.smithi090.stdout:0/535: sync 2024-04-20T10:54:44.781 INFO:tasks.workunit.client.0.smithi090.stdout:2/527: sync 2024-04-20T10:54:44.781 INFO:tasks.workunit.client.0.smithi090.stdout:8/487: sync 2024-04-20T10:54:44.781 INFO:tasks.workunit.client.0.smithi090.stdout:0/536: truncate fe 4917387 0 2024-04-20T10:54:44.781 INFO:tasks.workunit.client.0.smithi090.stdout:2/528: fsync d11/d1a/d4a/d55/f69 0 2024-04-20T10:54:44.782 INFO:tasks.workunit.client.0.smithi090.stdout:8/488: read d0/d11/d22/d53/f54 [46320,46992] 0 2024-04-20T10:54:44.782 INFO:tasks.workunit.client.0.smithi090.stdout:3/460: unlink d7/d11/f52 0 2024-04-20T10:54:44.784 INFO:tasks.workunit.client.0.smithi090.stdout:4/469: creat d7/d9/d17/f90 x:0 0 0 2024-04-20T10:54:44.786 INFO:tasks.workunit.client.0.smithi090.stdout:7/517: mkdir d11/d13/d5d/db0 0 2024-04-20T10:54:44.787 INFO:tasks.workunit.client.0.smithi090.stdout:5/688: creat d1/da/fec x:0 0 0 2024-04-20T10:54:44.787 INFO:tasks.workunit.client.0.smithi090.stdout:6/435: write d1/d4/f50 [1521818,39975] 0 2024-04-20T10:54:44.787 INFO:tasks.workunit.client.0.smithi090.stdout:6/436: dread - d1/d4/f7e zero size 2024-04-20T10:54:44.788 INFO:tasks.workunit.client.0.smithi090.stdout:9/535: creat d0/d29/d36/d63/da1/faf x:0 0 0 2024-04-20T10:54:44.788 INFO:tasks.workunit.client.0.smithi090.stdout:5/689: dread d1/de/fae [0,4194304] 0 2024-04-20T10:54:44.790 INFO:tasks.workunit.client.0.smithi090.stdout:0/537: rename d14/d19/d2b/d52/d55/d5b/l6b to d14/d19/d2b/d61/da0/lac 0 2024-04-20T10:54:44.792 INFO:tasks.workunit.client.0.smithi090.stdout:3/461: truncate d7/f37 2346238 0 2024-04-20T10:54:44.796 INFO:tasks.workunit.client.0.smithi090.stdout:4/470: unlink d7/c1e 0 2024-04-20T10:54:44.796 INFO:tasks.workunit.client.0.smithi090.stdout:4/471: fsync d7/f7d 0 2024-04-20T10:54:44.797 INFO:tasks.workunit.client.0.smithi090.stdout:6/437: link d1/d19/c77 d1/d19/d36/d1e/c93 0 2024-04-20T10:54:44.798 INFO:tasks.workunit.client.0.smithi090.stdout:5/690: dread d1/da/d14/d47/f84 [0,4194304] 0 2024-04-20T10:54:44.799 INFO:tasks.workunit.client.0.smithi090.stdout:9/536: unlink d0/d29/d36/d63/d1f/d79/f58 0 2024-04-20T10:54:44.800 INFO:tasks.workunit.client.0.smithi090.stdout:8/489: write d0/fe [6691058,17475] 0 2024-04-20T10:54:44.801 INFO:tasks.workunit.client.0.smithi090.stdout:0/538: creat d14/d19/d2b/d52/dab/da1/fad x:0 0 0 2024-04-20T10:54:44.801 INFO:tasks.workunit.client.0.smithi090.stdout:0/539: chown f0 1802103 1 2024-04-20T10:54:44.802 INFO:tasks.workunit.client.0.smithi090.stdout:3/462: symlink d7/d15/d2a/d30/d93/d7f/l97 0 2024-04-20T10:54:44.805 INFO:tasks.workunit.client.0.smithi090.stdout:9/537: dread d0/d29/d36/d63/d1f/d79/f8a [0,4194304] 0 2024-04-20T10:54:44.805 INFO:tasks.workunit.client.0.smithi090.stdout:9/538: write d0/ff [144794,120590] 0 2024-04-20T10:54:44.805 INFO:tasks.workunit.client.0.smithi090.stdout:5/691: creat d1/de/d96/fed x:0 0 0 2024-04-20T10:54:44.805 INFO:tasks.workunit.client.0.smithi090.stdout:7/518: dwrite d11/d13/d5b/f9a [0,4194304] 0 2024-04-20T10:54:44.805 INFO:tasks.workunit.client.0.smithi090.stdout:5/692: readlink d1/d2f/l42 0 2024-04-20T10:54:44.805 INFO:tasks.workunit.client.0.smithi090.stdout:5/693: getdents d1/d2f/d3d/d40/d6c/dd2 0 2024-04-20T10:54:44.813 INFO:tasks.workunit.client.0.smithi090.stdout:1/564: dwrite d8/f7f [0,4194304] 0 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:8/490: creat d0/d99/fa1 x:0 0 0 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:0/540: chown d14/l29 16179 1 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:7/519: link d11/d13/d33/d44/f7c d11/fb1 0 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:0/541: fdatasync d14/d19/f1b 0 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:6/438: rename d1/d4/c69 to d1/d19/d36/d1e/d1f/c94 0 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:9/539: creat d0/d29/d36/d63/d1c/fb0 x:0 0 0 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:9/540: chown d0/d29/d4f/c47 46 1 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:9/541: stat d0/d29/d4f/c47 0 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:9/542: chown d0/d29 215572983 1 2024-04-20T10:54:44.814 INFO:tasks.workunit.client.0.smithi090.stdout:3/463: creat d7/d26/d5e/f98 x:0 0 0 2024-04-20T10:54:44.818 INFO:tasks.workunit.client.0.smithi090.stdout:4/472: dwrite d7/d9/f62 [0,4194304] 0 2024-04-20T10:54:44.818 INFO:tasks.workunit.client.0.smithi090.stdout:0/542: rename d14/d19/d2b/d8e/d43/f46 to d14/d19/d2b/d8e/d43/d5c/d70/d9b/fae 0 2024-04-20T10:54:44.818 INFO:tasks.workunit.client.0.smithi090.stdout:7/520: write d11/d13/d23/f26 [668444,112326] 0 2024-04-20T10:54:44.819 INFO:tasks.workunit.client.0.smithi090.stdout:6/439: symlink d1/d19/d36/d1e/d1f/d3f/d54/l95 0 2024-04-20T10:54:44.820 INFO:tasks.workunit.client.0.smithi090.stdout:3/464: symlink d7/l99 0 2024-04-20T10:54:44.820 INFO:tasks.workunit.client.0.smithi090.stdout:3/465: readlink d7/df/d2c/l92 0 2024-04-20T10:54:44.820 INFO:tasks.workunit.client.0.smithi090.stdout:3/466: fsync d7/d15/f23 0 2024-04-20T10:54:44.823 INFO:tasks.workunit.client.0.smithi090.stdout:4/473: symlink d7/d72/l91 0 2024-04-20T10:54:44.824 INFO:tasks.workunit.client.0.smithi090.stdout:4/474: fsync d7/f52 0 2024-04-20T10:54:44.824 INFO:tasks.workunit.client.0.smithi090.stdout:4/475: read - d7/d9/d17/f79 zero size 2024-04-20T10:54:44.824 INFO:tasks.workunit.client.0.smithi090.stdout:1/565: write d8/d1a/d1d/f94 [876612,101813] 0 2024-04-20T10:54:44.827 INFO:tasks.workunit.client.0.smithi090.stdout:5/694: rename d1/d2f/d3d/d40/d6c/ld8 to d1/da/d1f/da4/lee 0 2024-04-20T10:54:44.827 INFO:tasks.workunit.client.0.smithi090.stdout:5/695: readlink d1/l38 0 2024-04-20T10:54:44.828 INFO:tasks.workunit.client.0.smithi090.stdout:7/521: mknod d11/d13/d23/d6c/d72/da9/cb2 0 2024-04-20T10:54:44.828 INFO:tasks.workunit.client.0.smithi090.stdout:7/522: write d11/d13/d5b/f9a [4747646,12464] 0 2024-04-20T10:54:44.828 INFO:tasks.workunit.client.0.smithi090.stdout:7/523: chown d11/d13/d23/f2b 113 1 2024-04-20T10:54:44.842 INFO:tasks.workunit.client.0.smithi090.stdout:9/543: dwrite d0/d29/f57 [0,4194304] 0 2024-04-20T10:54:44.842 INFO:tasks.workunit.client.0.smithi090.stdout:0/543: dwrite d14/d19/d2b/d52/d55/d5b/f8f [0,4194304] 0 2024-04-20T10:54:44.846 INFO:tasks.workunit.client.0.smithi090.stdout:1/566: dwrite d8/f7f [0,4194304] 0 2024-04-20T10:54:44.846 INFO:tasks.workunit.client.0.smithi090.stdout:1/567: chown d8/d1a/d1d/d67/laf 925694229 1 2024-04-20T10:54:44.852 INFO:tasks.workunit.client.0.smithi090.stdout:5/696: write d1/f62 [2350516,95315] 0 2024-04-20T10:54:44.853 INFO:tasks.workunit.client.0.smithi090.stdout:1/568: dread d8/fb [0,4194304] 0 2024-04-20T10:54:44.853 INFO:tasks.workunit.client.0.smithi090.stdout:1/569: chown d8/d1a/d1d/d67/f90 97348216 1 2024-04-20T10:54:44.859 INFO:tasks.workunit.client.0.smithi090.stdout:1/570: read d8/f2d [2078264,44362] 0 2024-04-20T10:54:44.859 INFO:tasks.workunit.client.0.smithi090.stdout:5/697: dread d1/fb [0,4194304] 0 2024-04-20T10:54:44.859 INFO:tasks.workunit.client.0.smithi090.stdout:5/698: fdatasync d1/d2f/d3d/f8b 0 2024-04-20T10:54:44.862 INFO:tasks.workunit.client.0.smithi090.stdout:0/544: dwrite d14/f21 [0,4194304] 0 2024-04-20T10:54:44.866 INFO:tasks.workunit.client.0.smithi090.stdout:5/699: dread d1/f23 [0,4194304] 0 2024-04-20T10:54:45.087 INFO:tasks.workunit.client.0.smithi090.stdout:8/491: getdents d0/d99 0 2024-04-20T10:54:45.087 INFO:tasks.workunit.client.0.smithi090.stdout:6/440: creat d1/d19/d36/d1e/d1f/d3f/f96 x:0 0 0 2024-04-20T10:54:45.087 INFO:tasks.workunit.client.0.smithi090.stdout:3/467: rename d7/d15/f23 to d7/d15/f9a 0 2024-04-20T10:54:45.087 INFO:tasks.workunit.client.0.smithi090.stdout:4/476: mkdir d7/d9/d92 0 2024-04-20T10:54:45.087 INFO:tasks.workunit.client.0.smithi090.stdout:7/524: rename d11/d13/d33/d44/f94 to d11/d13/d33/fb3 0 2024-04-20T10:54:45.089 INFO:tasks.workunit.client.0.smithi090.stdout:1/571: creat d8/d1a/fba x:0 0 0 2024-04-20T10:54:45.090 INFO:tasks.workunit.client.0.smithi090.stdout:0/545: mknod d14/d19/d2b/d8e/d43/d6d/caf 0 2024-04-20T10:54:45.090 INFO:tasks.workunit.client.0.smithi090.stdout:5/700: creat d1/da/d16/fef x:0 0 0 2024-04-20T10:54:45.094 INFO:tasks.workunit.client.0.smithi090.stdout:3/468: write d7/fc [799236,3774] 0 2024-04-20T10:54:45.097 INFO:tasks.workunit.client.0.smithi090.stdout:8/492: symlink d0/d2d/d49/la2 0 2024-04-20T10:54:45.100 INFO:tasks.workunit.client.0.smithi090.stdout:9/544: rename d0/d9a/ca7 to d0/d29/d36/d63/cb1 0 2024-04-20T10:54:45.100 INFO:tasks.workunit.client.0.smithi090.stdout:9/545: truncate d0/d29/d36/d63/f14 4614274 0 2024-04-20T10:54:45.101 INFO:tasks.workunit.client.0.smithi090.stdout:7/525: link d11/d13/d33/d44/d89/f9f d11/d13/d5b/fb4 0 2024-04-20T10:54:45.101 INFO:tasks.workunit.client.0.smithi090.stdout:7/526: dread - d11/d13/f90 zero size 2024-04-20T10:54:45.102 INFO:tasks.workunit.client.0.smithi090.stdout:1/572: truncate d8/d1a/d1d/d2c/d4a/fa6 2696999 0 2024-04-20T10:54:45.102 INFO:tasks.workunit.client.0.smithi090.stdout:1/573: stat d8/d1a/d1d/d2c/d4a/d93/c37 0 2024-04-20T10:54:45.104 INFO:tasks.workunit.client.0.smithi090.stdout:0/546: link d14/d19/d31/d34/d3b/f59 d14/d19/d31/d34/fb0 0 2024-04-20T10:54:45.106 INFO:tasks.workunit.client.0.smithi090.stdout:5/701: truncate d1/da/d16/f32 2816393 0 2024-04-20T10:54:45.106 INFO:tasks.workunit.client.0.smithi090.stdout:5/702: write d1/da/d14/dc0/feb [679457,96354] 0 2024-04-20T10:54:45.107 INFO:tasks.workunit.client.0.smithi090.stdout:3/469: rmdir d7/d26/d5e/d88 39 2024-04-20T10:54:45.107 INFO:tasks.workunit.client.0.smithi090.stdout:6/441: dwrite d1/d4/d26/d11/d35/d80/f82 [0,4194304] 0 2024-04-20T10:54:45.108 INFO:tasks.workunit.client.0.smithi090.stdout:8/493: rmdir d0/d3a/d9f 39 2024-04-20T10:54:45.108 INFO:tasks.workunit.client.0.smithi090.stdout:8/494: fdatasync d0/d11/f31 0 2024-04-20T10:54:45.109 INFO:tasks.workunit.client.0.smithi090.stdout:4/477: mknod d7/d9/d17/d56/d66/d70/c93 0 2024-04-20T10:54:45.110 INFO:tasks.workunit.client.0.smithi090.stdout:9/546: creat d0/d29/d36/d63/d1f/d4d/fb2 x:0 0 0 2024-04-20T10:54:45.111 INFO:tasks.workunit.client.0.smithi090.stdout:7/527: creat d11/d13/d5d/d65/fb5 x:0 0 0 2024-04-20T10:54:45.112 INFO:tasks.workunit.client.0.smithi090.stdout:0/547: mkdir d14/d19/d2b/d61/da0/db1 0 2024-04-20T10:54:45.113 INFO:tasks.workunit.client.0.smithi090.stdout:0/548: getdents d14/d19/d2b/d8e/d68 0 2024-04-20T10:54:45.113 INFO:tasks.workunit.client.0.smithi090.stdout:0/549: write d14/d19/d2b/f30 [1729316,73248] 0 2024-04-20T10:54:45.113 INFO:tasks.workunit.client.0.smithi090.stdout:2/529: sync 2024-04-20T10:54:45.115 INFO:tasks.workunit.client.0.smithi090.stdout:5/703: creat d1/d41/d98/ff0 x:0 0 0 2024-04-20T10:54:45.115 INFO:tasks.workunit.client.0.smithi090.stdout:5/704: fdatasync d1/f26 0 2024-04-20T10:54:45.116 INFO:tasks.workunit.client.0.smithi090.stdout:3/470: symlink d7/d15/d47/l9b 0 2024-04-20T10:54:45.118 INFO:tasks.workunit.client.0.smithi090.stdout:6/442: truncate d1/d19/d36/d28/f34 2606038 0 2024-04-20T10:54:45.119 INFO:tasks.workunit.client.0.smithi090.stdout:6/443: chown d1/d19/d36/d1e/d1f/l48 553 1 2024-04-20T10:54:45.119 INFO:tasks.workunit.client.0.smithi090.stdout:6/444: chown d1/d4/d26/d11/d4a/d6b 328243360 1 2024-04-20T10:54:45.119 INFO:tasks.workunit.client.0.smithi090.stdout:8/495: creat d0/d99/fa3 x:0 0 0 2024-04-20T10:54:45.120 INFO:tasks.workunit.client.0.smithi090.stdout:1/574: dwrite d8/d1a/d1d/d7a/d9a/f7c [4194304,4194304] 0 2024-04-20T10:54:45.120 INFO:tasks.workunit.client.0.smithi090.stdout:1/575: fsync d8/d1a/d1d/d2c/d4a/f65 0 2024-04-20T10:54:45.129 INFO:tasks.workunit.client.0.smithi090.stdout:7/528: dread f1 [0,4194304] 0 2024-04-20T10:54:45.129 INFO:tasks.workunit.client.0.smithi090.stdout:7/529: chown f4 9078 1 2024-04-20T10:54:45.133 INFO:tasks.workunit.client.0.smithi090.stdout:3/471: dwrite d7/d15/d2a/d30/f64 [0,4194304] 0 2024-04-20T10:54:45.134 INFO:tasks.workunit.client.0.smithi090.stdout:3/472: dread d7/d15/d2a/d30/f4c [0,4194304] 0 2024-04-20T10:54:45.375 INFO:tasks.workunit.client.0.smithi090.stdout:9/547: unlink d0/d29/d4f/d82/ca9 0 2024-04-20T10:54:45.375 INFO:tasks.workunit.client.0.smithi090.stdout:0/550: symlink d14/d19/d2b/d8e/d40/lb2 0 2024-04-20T10:54:45.375 INFO:tasks.workunit.client.0.smithi090.stdout:5/705: unlink d1/da/d1f/dad/dc8/le8 0 2024-04-20T10:54:45.375 INFO:tasks.workunit.client.0.smithi090.stdout:8/496: getdents d0/d3a/d9f 0 2024-04-20T10:54:45.376 INFO:tasks.workunit.client.0.smithi090.stdout:4/478: mkdir d7/d9/d17/d94 0 2024-04-20T10:54:45.376 INFO:tasks.workunit.client.0.smithi090.stdout:6/445: mkdir d1/d4/d26/d11/d35/d97 0 2024-04-20T10:54:45.376 INFO:tasks.workunit.client.0.smithi090.stdout:1/576: mknod d8/d1a/d1d/d2c/d3f/cbb 0 2024-04-20T10:54:45.376 INFO:tasks.workunit.client.0.smithi090.stdout:7/530: creat d11/d13/d5b/fb6 x:0 0 0 2024-04-20T10:54:45.376 INFO:tasks.workunit.client.0.smithi090.stdout:3/473: creat d7/d35/f9c x:0 0 0 2024-04-20T10:54:45.376 INFO:tasks.workunit.client.0.smithi090.stdout:3/474: write d7/d43/f45 [948046,6458] 0 2024-04-20T10:54:45.379 INFO:tasks.workunit.client.0.smithi090.stdout:5/706: link d1/de/dcf/f6f d1/da/d14/dc0/ff1 0 2024-04-20T10:54:45.379 INFO:tasks.workunit.client.0.smithi090.stdout:5/707: chown d1/da/dce 190197913 1 2024-04-20T10:54:45.380 INFO:tasks.workunit.client.0.smithi090.stdout:8/497: creat d0/d11/d22/d53/d57/fa4 x:0 0 0 2024-04-20T10:54:45.381 INFO:tasks.workunit.client.0.smithi090.stdout:8/498: write d0/d2d/f30 [170044,34028] 0 2024-04-20T10:54:45.381 INFO:tasks.workunit.client.0.smithi090.stdout:3/475: write d7/d15/d2a/f67 [15757,105435] 0 2024-04-20T10:54:45.382 INFO:tasks.workunit.client.0.smithi090.stdout:4/479: mknod d7/d9/d47/d63/d42/d8f/c95 0 2024-04-20T10:54:45.383 INFO:tasks.workunit.client.0.smithi090.stdout:6/446: mknod d1/d10/c98 0 2024-04-20T10:54:45.385 INFO:tasks.workunit.client.0.smithi090.stdout:1/577: creat d8/d1a/d1d/d2c/d4a/fbc x:0 0 0 2024-04-20T10:54:45.385 INFO:tasks.workunit.client.0.smithi090.stdout:7/531: mkdir d11/d13/d5b/d6b/db7 0 2024-04-20T10:54:45.385 INFO:tasks.workunit.client.0.smithi090.stdout:7/532: fdatasync d11/d1a/d3b/d79/f8d 0 2024-04-20T10:54:45.388 INFO:tasks.workunit.client.0.smithi090.stdout:5/708: mkdir d1/d2f/df2 0 2024-04-20T10:54:45.391 INFO:tasks.workunit.client.0.smithi090.stdout:8/499: mknod d0/d11/d22/d53/d8e/ca5 0 2024-04-20T10:54:45.392 INFO:tasks.workunit.client.0.smithi090.stdout:1/578: dread d8/d1a/d1d/d2c/d3f/f5f [0,4194304] 0 2024-04-20T10:54:45.392 INFO:tasks.workunit.client.0.smithi090.stdout:6/447: mknod d1/d19/d36/d1e/d1f/d3f/c99 0 2024-04-20T10:54:45.392 INFO:tasks.workunit.client.0.smithi090.stdout:6/448: fdatasync d1/d19/f1a 0 2024-04-20T10:54:45.392 INFO:tasks.workunit.client.0.smithi090.stdout:6/449: truncate d1/d4/f88 577593 0 2024-04-20T10:54:45.394 INFO:tasks.workunit.client.0.smithi090.stdout:9/548: dwrite d0/f8b [0,4194304] 0 2024-04-20T10:54:45.400 INFO:tasks.workunit.client.0.smithi090.stdout:5/709: creat d1/de/ff3 x:0 0 0 2024-04-20T10:54:45.400 INFO:tasks.workunit.client.0.smithi090.stdout:5/710: dread - d1/d2f/d85/fb5 zero size 2024-04-20T10:54:45.400 INFO:tasks.workunit.client.0.smithi090.stdout:5/711: fdatasync d1/d2f/f83 0 2024-04-20T10:54:45.400 INFO:tasks.workunit.client.0.smithi090.stdout:1/579: dread d8/d1a/d1d/d2c/d4a/f8b [0,4194304] 0 2024-04-20T10:54:45.400 INFO:tasks.workunit.client.0.smithi090.stdout:8/500: rmdir d0/d11 39 2024-04-20T10:54:45.401 INFO:tasks.workunit.client.0.smithi090.stdout:8/501: write d0/d99/fa3 [394325,72818] 0 2024-04-20T10:54:45.404 INFO:tasks.workunit.client.0.smithi090.stdout:5/712: creat d1/d2f/d3d/ff4 x:0 0 0 2024-04-20T10:54:45.404 INFO:tasks.workunit.client.0.smithi090.stdout:5/713: fdatasync d1/fb 0 2024-04-20T10:54:45.404 INFO:tasks.workunit.client.0.smithi090.stdout:8/502: creat d0/d3a/d4a/fa6 x:0 0 0 2024-04-20T10:54:45.404 INFO:tasks.workunit.client.0.smithi090.stdout:8/503: write d0/d3a/d9f/d52/f9a [373301,10657] 0 2024-04-20T10:54:45.405 INFO:tasks.workunit.client.0.smithi090.stdout:5/714: creat d1/da/d1f/dad/dc8/ff5 x:0 0 0 2024-04-20T10:54:45.406 INFO:tasks.workunit.client.0.smithi090.stdout:5/715: getdents d1/da/d1f/dad 0 2024-04-20T10:54:45.409 INFO:tasks.workunit.client.0.smithi090.stdout:5/716: rename d1/da/d16/f86 to d1/d2f/d85/ff6 0 2024-04-20T10:54:45.409 INFO:tasks.workunit.client.0.smithi090.stdout:5/717: readlink d1/d2f/d3d/d40/d70/l99 0 2024-04-20T10:54:45.411 INFO:tasks.workunit.client.0.smithi090.stdout:5/718: symlink d1/da/d1f/dad/dc8/lf7 0 2024-04-20T10:54:45.411 INFO:tasks.workunit.client.0.smithi090.stdout:5/719: dread - d1/da/d1f/dad/fea zero size 2024-04-20T10:54:45.411 INFO:tasks.workunit.client.0.smithi090.stdout:5/720: write d1/da/f2c [4683577,51286] 0 2024-04-20T10:54:45.412 INFO:tasks.workunit.client.0.smithi090.stdout:5/721: creat d1/da/ff8 x:0 0 0 2024-04-20T10:54:45.412 INFO:tasks.workunit.client.0.smithi090.stdout:5/722: write d1/d2f/d3d/d40/d89/fd3 [743651,45329] 0 2024-04-20T10:54:45.415 INFO:tasks.workunit.client.0.smithi090.stdout:5/723: read d1/fb [1918605,76653] 0 2024-04-20T10:54:45.423 INFO:tasks.workunit.client.0.smithi090.stdout:3/476: dwrite d7/f3d [0,4194304] 0 2024-04-20T10:54:45.423 INFO:tasks.workunit.client.0.smithi090.stdout:7/533: dwrite d11/d1a/d3b/d79/f99 [0,4194304] 0 2024-04-20T10:54:45.425 INFO:tasks.workunit.client.0.smithi090.stdout:3/477: symlink d7/d15/d2a/d30/d93/d7f/l9d 0 2024-04-20T10:54:45.426 INFO:tasks.workunit.client.0.smithi090.stdout:3/478: truncate d7/d43/f45 1690286 0 2024-04-20T10:54:45.426 INFO:tasks.workunit.client.0.smithi090.stdout:3/479: chown d7/d15 392927 1 2024-04-20T10:54:45.430 INFO:tasks.workunit.client.0.smithi090.stdout:7/534: rename d11/d1a/d2f to d11/d13/d5b/db8 0 2024-04-20T10:54:45.431 INFO:tasks.workunit.client.0.smithi090.stdout:3/480: getdents d7/df 0 2024-04-20T10:54:45.431 INFO:tasks.workunit.client.0.smithi090.stdout:3/481: fdatasync d7/d15/d2a/d30/d93/f6d 0 2024-04-20T10:54:45.431 INFO:tasks.workunit.client.0.smithi090.stdout:3/482: chown d7/df 0 1 2024-04-20T10:54:45.432 INFO:tasks.workunit.client.0.smithi090.stdout:7/535: unlink d11/d1a/f46 0 2024-04-20T10:54:45.432 INFO:tasks.workunit.client.0.smithi090.stdout:3/483: stat d7/d11/c39 0 2024-04-20T10:54:45.432 INFO:tasks.workunit.client.0.smithi090.stdout:4/480: dwrite d7/f26 [0,4194304] 0 2024-04-20T10:54:45.434 INFO:tasks.workunit.client.0.smithi090.stdout:4/481: creat d7/d9/d47/d63/d76/f96 x:0 0 0 2024-04-20T10:54:45.435 INFO:tasks.workunit.client.0.smithi090.stdout:1/580: dwrite d8/d1a/d4d/f9c [0,4194304] 0 2024-04-20T10:54:45.436 INFO:tasks.workunit.client.0.smithi090.stdout:6/450: dwrite d1/d4/f1d [0,4194304] 0 2024-04-20T10:54:45.436 INFO:tasks.workunit.client.0.smithi090.stdout:6/451: chown d1/d19/d25/c29 15869910 1 2024-04-20T10:54:45.437 INFO:tasks.workunit.client.0.smithi090.stdout:9/549: dwrite d0/d29/d4f/f2d [0,4194304] 0 2024-04-20T10:54:45.437 INFO:tasks.workunit.client.0.smithi090.stdout:4/482: truncate d7/d9/d47/d63/d42/f64 3256051 0 2024-04-20T10:54:45.439 INFO:tasks.workunit.client.0.smithi090.stdout:1/581: mknod d8/d1a/d4d/da5/cbd 0 2024-04-20T10:54:45.441 INFO:tasks.workunit.client.0.smithi090.stdout:6/452: mkdir d1/d9a 0 2024-04-20T10:54:45.447 INFO:tasks.workunit.client.0.smithi090.stdout:9/550: write d0/d29/d36/d63/d1f/d34/f43 [5281186,95940] 0 2024-04-20T10:54:45.448 INFO:tasks.workunit.client.0.smithi090.stdout:0/551: truncate d14/d19/d2b/f30 2022141 0 2024-04-20T10:54:45.449 INFO:tasks.workunit.client.0.smithi090.stdout:9/551: symlink d0/d9a/lb3 0 2024-04-20T10:54:45.450 INFO:tasks.workunit.client.0.smithi090.stdout:9/552: write d0/f4 [3118642,91310] 0 2024-04-20T10:54:45.450 INFO:tasks.workunit.client.0.smithi090.stdout:3/484: dwrite d7/df/f4d [0,4194304] 0 2024-04-20T10:54:45.450 INFO:tasks.workunit.client.0.smithi090.stdout:0/552: truncate d14/d19/d2b/f82 1522917 0 2024-04-20T10:54:45.454 INFO:tasks.workunit.client.0.smithi090.stdout:9/553: unlink d0/d29/d36/d63/d1f/d34/d70/c7a 0 2024-04-20T10:54:45.454 INFO:tasks.workunit.client.0.smithi090.stdout:0/553: dread d14/d19/d2b/d8e/d43/f4a [0,4194304] 0 2024-04-20T10:54:45.457 INFO:tasks.workunit.client.0.smithi090.stdout:3/485: creat d7/d15/d47/d56/f9e x:0 0 0 2024-04-20T10:54:45.457 INFO:tasks.workunit.client.0.smithi090.stdout:3/486: getdents d7/d15/d2a/d8d 0 2024-04-20T10:54:45.457 INFO:tasks.workunit.client.0.smithi090.stdout:9/554: symlink d0/d9a/lb4 0 2024-04-20T10:54:45.458 INFO:tasks.workunit.client.0.smithi090.stdout:9/555: readlink d0/d29/d4f/d23/daa/lae 0 2024-04-20T10:54:45.458 INFO:tasks.workunit.client.0.smithi090.stdout:9/556: readlink d0/d29/l87 0 2024-04-20T10:54:45.458 INFO:tasks.workunit.client.0.smithi090.stdout:0/554: creat d14/d39/da6/fb3 x:0 0 0 2024-04-20T10:54:45.460 INFO:tasks.workunit.client.0.smithi090.stdout:3/487: symlink d7/d11/l9f 0 2024-04-20T10:54:45.460 INFO:tasks.workunit.client.0.smithi090.stdout:3/488: readlink d7/d15/d47/l9b 0 2024-04-20T10:54:45.460 INFO:tasks.workunit.client.0.smithi090.stdout:3/489: chown d7/d15/d2a/d30/d93/d7f/l9d 1037894 1 2024-04-20T10:54:45.460 INFO:tasks.workunit.client.0.smithi090.stdout:3/490: chown d7/d11/l9f 30318 1 2024-04-20T10:54:45.460 INFO:tasks.workunit.client.0.smithi090.stdout:3/491: dread - d7/d15/f8f zero size 2024-04-20T10:54:45.461 INFO:tasks.workunit.client.0.smithi090.stdout:1/582: dwrite d8/d1a/d4d/f63 [0,4194304] 0 2024-04-20T10:54:45.461 INFO:tasks.workunit.client.0.smithi090.stdout:0/555: creat d14/d19/d2b/d52/d55/d5b/d7f/fb4 x:0 0 0 2024-04-20T10:54:45.463 INFO:tasks.workunit.client.0.smithi090.stdout:3/492: getdents d7/d15/d2a/d30 0 2024-04-20T10:54:45.466 INFO:tasks.workunit.client.0.smithi090.stdout:5/724: truncate d1/da/d14/dc0/feb 148420 0 2024-04-20T10:54:45.468 INFO:tasks.workunit.client.0.smithi090.stdout:0/556: creat d14/d41/fb5 x:0 0 0 2024-04-20T10:54:45.469 INFO:tasks.workunit.client.0.smithi090.stdout:4/483: dread d7/f12 [0,4194304] 0 2024-04-20T10:54:45.471 INFO:tasks.workunit.client.0.smithi090.stdout:1/583: dread d8/d1a/d1d/d2c/d4a/fa6 [0,4194304] 0 2024-04-20T10:54:45.471 INFO:tasks.workunit.client.0.smithi090.stdout:1/584: write d8/d1a/d1d/d2c/d4a/fb9 [823961,65960] 0 2024-04-20T10:54:45.471 INFO:tasks.workunit.client.0.smithi090.stdout:1/585: truncate d8/d1a/d1d/d2c/f64 4962065 0 2024-04-20T10:54:45.471 INFO:tasks.workunit.client.0.smithi090.stdout:6/453: dwrite d1/d4/f88 [0,4194304] 0 2024-04-20T10:54:45.471 INFO:tasks.workunit.client.0.smithi090.stdout:3/493: dread d7/f19 [0,4194304] 0 2024-04-20T10:54:45.471 INFO:tasks.workunit.client.0.smithi090.stdout:6/454: dread - d1/d19/d36/f7d zero size 2024-04-20T10:54:45.472 INFO:tasks.workunit.client.0.smithi090.stdout:6/455: chown d1/d10/f39 31453150 1 2024-04-20T10:54:45.472 INFO:tasks.workunit.client.0.smithi090.stdout:5/725: creat d1/da/d14/d47/d50/ff9 x:0 0 0 2024-04-20T10:54:45.472 INFO:tasks.workunit.client.0.smithi090.stdout:5/726: dread - d1/de/ff3 zero size 2024-04-20T10:54:45.472 INFO:tasks.workunit.client.0.smithi090.stdout:5/727: chown d1/da/c27 310 1 2024-04-20T10:54:45.472 INFO:tasks.workunit.client.0.smithi090.stdout:5/728: write d1/f62 [1134319,48552] 0 2024-04-20T10:54:45.472 INFO:tasks.workunit.client.0.smithi090.stdout:7/536: truncate d11/d1a/d3b/d79/f99 647887 0 2024-04-20T10:54:45.474 INFO:tasks.workunit.client.0.smithi090.stdout:9/557: write d0/d29/d36/d63/d1f/d34/fac [3455012,71543] 0 2024-04-20T10:54:45.474 INFO:tasks.workunit.client.0.smithi090.stdout:9/558: stat d0/d29/d36/c46 0 2024-04-20T10:54:45.474 INFO:tasks.workunit.client.0.smithi090.stdout:9/559: fsync d0/fa6 0 2024-04-20T10:54:45.478 INFO:tasks.workunit.client.0.smithi090.stdout:1/586: mknod d8/d1a/d1d/d2c/d4a/d7b/cbe 0 2024-04-20T10:54:45.480 INFO:tasks.workunit.client.0.smithi090.stdout:3/494: symlink d7/la0 0 2024-04-20T10:54:45.480 INFO:tasks.workunit.client.0.smithi090.stdout:3/495: write d7/d15/d2a/f58 [2645014,107471] 0 2024-04-20T10:54:45.480 INFO:tasks.workunit.client.0.smithi090.stdout:6/456: symlink d1/d4/d26/l9b 0 2024-04-20T10:54:45.482 INFO:tasks.workunit.client.0.smithi090.stdout:5/729: rename d1/da/d14/l53 to d1/de/d75/lfa 0 2024-04-20T10:54:45.482 INFO:tasks.workunit.client.0.smithi090.stdout:5/730: write d1/d2f/d3d/d40/d70/f8e [589771,307] 0 2024-04-20T10:54:45.484 INFO:tasks.workunit.client.0.smithi090.stdout:7/537: creat d11/d13/d23/d6c/d72/da9/fb9 x:0 0 0 2024-04-20T10:54:45.486 INFO:tasks.workunit.client.0.smithi090.stdout:9/560: unlink d0/l69 0 2024-04-20T10:54:45.487 INFO:tasks.workunit.client.0.smithi090.stdout:6/457: unlink d1/d4/d26/l67 0 2024-04-20T10:54:45.487 INFO:tasks.workunit.client.0.smithi090.stdout:6/458: readlink d1/d19/d36/d1e/l7b 0 2024-04-20T10:54:45.488 INFO:tasks.workunit.client.0.smithi090.stdout:5/731: rmdir d1/da/d14/d47 39 2024-04-20T10:54:45.490 INFO:tasks.workunit.client.0.smithi090.stdout:7/538: creat d11/d1a/d3f/fba x:0 0 0 2024-04-20T10:54:45.490 INFO:tasks.workunit.client.0.smithi090.stdout:7/539: stat d11/d13/d23/f38 0 2024-04-20T10:54:45.490 INFO:tasks.workunit.client.0.smithi090.stdout:7/540: write d11/d1a/d3f/f5f [582462,71123] 0 2024-04-20T10:54:45.491 INFO:tasks.workunit.client.0.smithi090.stdout:1/587: dread d8/f2d [0,4194304] 0 2024-04-20T10:54:45.491 INFO:tasks.workunit.client.0.smithi090.stdout:1/588: chown d8/d1a/d1d/d2c/d4a/d93/d5d 1774995 1 2024-04-20T10:54:45.493 INFO:tasks.workunit.client.0.smithi090.stdout:4/484: dwrite d7/d9/d47/d63/d42/f67 [0,4194304] 0 2024-04-20T10:54:45.493 INFO:tasks.workunit.client.0.smithi090.stdout:4/485: dread - d7/d9/d17/f79 zero size 2024-04-20T10:54:45.493 INFO:tasks.workunit.client.0.smithi090.stdout:6/459: unlink d1/d4/d26/d11/d4a/d56/f4f 0 2024-04-20T10:54:45.493 INFO:tasks.workunit.client.0.smithi090.stdout:6/460: chown d1/d10/c98 9465396 1 2024-04-20T10:54:45.494 INFO:tasks.workunit.client.0.smithi090.stdout:5/732: creat d1/da/d14/ffb x:0 0 0 2024-04-20T10:54:45.496 INFO:tasks.workunit.client.0.smithi090.stdout:7/541: getdents d11/d13/d5d/d65 0 2024-04-20T10:54:45.497 INFO:tasks.workunit.client.0.smithi090.stdout:7/542: write d11/d13/d22/d24/f5e [1640823,87844] 0 2024-04-20T10:54:45.498 INFO:tasks.workunit.client.0.smithi090.stdout:1/589: symlink d8/d1a/d1d/d7a/d9a/lbf 0 2024-04-20T10:54:45.498 INFO:tasks.workunit.client.0.smithi090.stdout:1/590: readlink d8/d1a/d1d/d2c/d4a/l8c 0 2024-04-20T10:54:45.501 INFO:tasks.workunit.client.0.smithi090.stdout:4/486: mkdir d7/d97 0 2024-04-20T10:54:45.501 INFO:tasks.workunit.client.0.smithi090.stdout:4/487: write d7/d9/d17/d56/f8c [525976,32021] 0 2024-04-20T10:54:45.502 INFO:tasks.workunit.client.0.smithi090.stdout:1/591: dread d8/d1a/d1d/d2c/d3f/f87 [0,4194304] 0 2024-04-20T10:54:45.503 INFO:tasks.workunit.client.0.smithi090.stdout:1/592: dread - d8/d1a/d1d/d7a/db0/fb6 zero size 2024-04-20T10:54:45.503 INFO:tasks.workunit.client.0.smithi090.stdout:6/461: creat d1/d4/d26/d11/d35/d80/f9c x:0 0 0 2024-04-20T10:54:45.504 INFO:tasks.workunit.client.0.smithi090.stdout:5/733: creat d1/da/d1f/dad/de0/ffc x:0 0 0 2024-04-20T10:54:45.505 INFO:tasks.workunit.client.0.smithi090.stdout:5/734: write d1/da/d14/d47/d50/f5c [326756,83630] 0 2024-04-20T10:54:45.505 INFO:tasks.workunit.client.0.smithi090.stdout:5/735: chown d1/da/c27 484664 1 2024-04-20T10:54:45.505 INFO:tasks.workunit.client.0.smithi090.stdout:5/736: write d1/d2f/d3d/d40/d89/fd3 [761429,22371] 0 2024-04-20T10:54:45.505 INFO:tasks.workunit.client.0.smithi090.stdout:5/737: write d1/da/d14/ffb [914090,4541] 0 2024-04-20T10:54:45.505 INFO:tasks.workunit.client.0.smithi090.stdout:4/488: rmdir d7 39 2024-04-20T10:54:45.506 INFO:tasks.workunit.client.0.smithi090.stdout:4/489: readlink d7/d9/d47/l83 0 2024-04-20T10:54:45.506 INFO:tasks.workunit.client.0.smithi090.stdout:4/490: readlink d7/d9/d47/l83 0 2024-04-20T10:54:45.507 INFO:tasks.workunit.client.0.smithi090.stdout:6/462: symlink d1/d19/d36/l9d 0 2024-04-20T10:54:45.507 INFO:tasks.workunit.client.0.smithi090.stdout:6/463: chown d1/d4/d26/d11/d35/f8c 491 1 2024-04-20T10:54:45.508 INFO:tasks.workunit.client.0.smithi090.stdout:5/738: mknod d1/da/cfd 0 2024-04-20T10:54:45.509 INFO:tasks.workunit.client.0.smithi090.stdout:3/496: dwrite d7/d15/d2a/d30/f64 [0,4194304] 0 2024-04-20T10:54:45.509 INFO:tasks.workunit.client.0.smithi090.stdout:3/497: write d7/d15/d2a/d30/f64 [4225075,17798] 0 2024-04-20T10:54:45.509 INFO:tasks.workunit.client.0.smithi090.stdout:3/498: truncate d7/f79 689394 0 2024-04-20T10:54:45.510 INFO:tasks.workunit.client.0.smithi090.stdout:4/491: mknod d7/d97/c98 0 2024-04-20T10:54:45.511 INFO:tasks.workunit.client.0.smithi090.stdout:6/464: rmdir d1/d19 39 2024-04-20T10:54:45.514 INFO:tasks.workunit.client.0.smithi090.stdout:1/593: write d8/f46 [1297327,30217] 0 2024-04-20T10:54:45.514 INFO:tasks.workunit.client.0.smithi090.stdout:3/499: read d7/f19 [1488969,123013] 0 2024-04-20T10:54:45.517 INFO:tasks.workunit.client.0.smithi090.stdout:4/492: link d7/d9/d47/d63/d3d/l5c d7/d9/d47/l99 0 2024-04-20T10:54:45.518 INFO:tasks.workunit.client.0.smithi090.stdout:4/493: fdatasync d7/d9/d47/d63/d3d/f78 0 2024-04-20T10:54:45.518 INFO:tasks.workunit.client.0.smithi090.stdout:4/494: write d7/d9/d17/d56/d66/f85 [3042,207] 0 2024-04-20T10:54:45.518 INFO:tasks.workunit.client.0.smithi090.stdout:9/561: dwrite d0/f7c [8388608,4194304] 0 2024-04-20T10:54:45.518 INFO:tasks.workunit.client.0.smithi090.stdout:9/562: dread - d0/f7e zero size 2024-04-20T10:54:45.518 INFO:tasks.workunit.client.0.smithi090.stdout:9/563: stat d0/d29/l87 0 2024-04-20T10:54:45.519 INFO:tasks.workunit.client.0.smithi090.stdout:9/564: dread - d0/d29/d36/d63/d1f/d79/f6c zero size 2024-04-20T10:54:45.519 INFO:tasks.workunit.client.0.smithi090.stdout:9/565: chown d0/d29/d36/d63/d1c/f3e 495 1 2024-04-20T10:54:45.521 INFO:tasks.workunit.client.0.smithi090.stdout:3/500: mkdir d7/d26/d5e/d88/da1 0 2024-04-20T10:54:45.522 INFO:tasks.workunit.client.0.smithi090.stdout:4/495: creat d7/d97/f9a x:0 0 0 2024-04-20T10:54:45.523 INFO:tasks.workunit.client.0.smithi090.stdout:9/566: symlink d0/d29/d36/d63/d1f/lb5 0 2024-04-20T10:54:45.524 INFO:tasks.workunit.client.0.smithi090.stdout:3/501: mkdir d7/d15/d2a/da2 0 2024-04-20T10:54:45.524 INFO:tasks.workunit.client.0.smithi090.stdout:3/502: write d7/d15/d2a/d8d/f8e [1145183,116887] 0 2024-04-20T10:54:45.525 INFO:tasks.workunit.client.0.smithi090.stdout:4/496: unlink d7/d9/l2f 0 2024-04-20T10:54:45.526 INFO:tasks.workunit.client.0.smithi090.stdout:9/567: creat d0/d29/d36/d63/d1f/d34/fb6 x:0 0 0 2024-04-20T10:54:45.526 INFO:tasks.workunit.client.0.smithi090.stdout:9/568: fdatasync d0/d29/d36/d63/d1f/d34/d70/d52/f49 0 2024-04-20T10:54:45.526 INFO:tasks.workunit.client.0.smithi090.stdout:3/503: symlink d7/d26/d5e/la3 0 2024-04-20T10:54:45.527 INFO:tasks.workunit.client.0.smithi090.stdout:4/497: mknod d7/c9b 0 2024-04-20T10:54:45.527 INFO:tasks.workunit.client.0.smithi090.stdout:7/543: dwrite f4 [0,4194304] 0 2024-04-20T10:54:45.527 INFO:tasks.workunit.client.0.smithi090.stdout:7/544: dread - d11/d13/d5d/d65/fab zero size 2024-04-20T10:54:45.529 INFO:tasks.workunit.client.0.smithi090.stdout:7/545: mknod d11/d13/d5b/db8/cbb 0 2024-04-20T10:54:45.531 INFO:tasks.workunit.client.0.smithi090.stdout:3/504: symlink d7/d35/la4 0 2024-04-20T10:54:45.531 INFO:tasks.workunit.client.0.smithi090.stdout:3/505: truncate d7/d43/f45 2340631 0 2024-04-20T10:54:45.531 INFO:tasks.workunit.client.0.smithi090.stdout:3/506: chown d7/l12 10434 1 2024-04-20T10:54:45.539 INFO:tasks.workunit.client.0.smithi090.stdout:9/569: write d0/d29/d36/d63/f1b [1293456,11521] 0 2024-04-20T10:54:45.546 INFO:tasks.workunit.client.0.smithi090.stdout:1/594: dwrite d8/d1a/d1d/d2c/d3f/f5c [0,4194304] 0 2024-04-20T10:54:45.546 INFO:tasks.workunit.client.0.smithi090.stdout:1/595: write d8/f59 [676986,69940] 0 2024-04-20T10:54:45.546 INFO:tasks.workunit.client.0.smithi090.stdout:7/546: rmdir d11/d61 39 2024-04-20T10:54:45.547 INFO:tasks.workunit.client.0.smithi090.stdout:2/530: write d11/d1a/d30/d8d/f9f [4282,15628] 0 2024-04-20T10:54:45.547 INFO:tasks.workunit.client.0.smithi090.stdout:3/507: dwrite d7/d43/f75 [0,4194304] 0 2024-04-20T10:54:45.548 INFO:tasks.workunit.client.0.smithi090.stdout:4/498: dwrite d7/d9/d17/d56/f84 [0,4194304] 0 2024-04-20T10:54:45.549 INFO:tasks.workunit.client.0.smithi090.stdout:7/547: creat d11/d13/d23/d6c/d72/da9/fbc x:0 0 0 2024-04-20T10:54:45.552 INFO:tasks.workunit.client.0.smithi090.stdout:3/508: mkdir d7/d15/d2a/da2/da5 0 2024-04-20T10:54:45.553 INFO:tasks.workunit.client.0.smithi090.stdout:9/570: dread d0/d29/d36/d63/d1f/f71 [0,4194304] 0 2024-04-20T10:54:45.555 INFO:tasks.workunit.client.0.smithi090.stdout:4/499: unlink d7/d9/d17/d56/d66/f85 0 2024-04-20T10:54:45.555 INFO:tasks.workunit.client.0.smithi090.stdout:4/500: truncate d7/f6e 1535240 0 2024-04-20T10:54:45.555 INFO:tasks.workunit.client.0.smithi090.stdout:1/596: write d8/d1a/d1d/d2c/d62/f78 [4549073,53939] 0 2024-04-20T10:54:45.555 INFO:tasks.workunit.client.0.smithi090.stdout:1/597: stat d8/l6f 0 2024-04-20T10:54:45.556 INFO:tasks.workunit.client.0.smithi090.stdout:7/548: rmdir d11/d1a/d3b/d79 39 2024-04-20T10:54:45.557 INFO:tasks.workunit.client.0.smithi090.stdout:4/501: mknod d7/d97/c9c 0 2024-04-20T10:54:45.558 INFO:tasks.workunit.client.0.smithi090.stdout:4/502: truncate d7/f6e 2227707 0 2024-04-20T10:54:45.559 INFO:tasks.workunit.client.0.smithi090.stdout:1/598: symlink d8/lc0 0 2024-04-20T10:54:45.561 INFO:tasks.workunit.client.0.smithi090.stdout:7/549: rename d11/d13/d33/d44/f7c to d11/d13/d33/d44/d89/fbd 0 2024-04-20T10:54:45.562 INFO:tasks.workunit.client.0.smithi090.stdout:4/503: mkdir d7/d9/d17/d56/d66/d9d 0 2024-04-20T10:54:45.566 INFO:tasks.workunit.client.0.smithi090.stdout:7/550: truncate d11/d13/d22/f4b 2761596 0 2024-04-20T10:54:45.575 INFO:tasks.workunit.client.0.smithi090.stdout:1/599: dwrite d8/d1a/d1d/d7a/d9a/f4f [0,4194304] 0 2024-04-20T10:54:45.577 INFO:tasks.workunit.client.0.smithi090.stdout:7/551: unlink d11/d13/d22/d24/f2e 0 2024-04-20T10:54:45.577 INFO:tasks.workunit.client.0.smithi090.stdout:7/552: chown d11/d13/d22/l29 0 1 2024-04-20T10:54:45.579 INFO:tasks.workunit.client.0.smithi090.stdout:1/600: truncate d8/d1a/d1d/f27 114529 0 2024-04-20T10:54:45.582 INFO:tasks.workunit.client.0.smithi090.stdout:4/504: dwrite d7/d9/d47/d63/d42/f67 [0,4194304] 0 2024-04-20T10:54:45.583 INFO:tasks.workunit.client.0.smithi090.stdout:7/553: rename f8 to d11/d1a/fbe 0 2024-04-20T10:54:45.584 INFO:tasks.workunit.client.0.smithi090.stdout:4/505: truncate d7/d9/d17/f2b 1697789 0 2024-04-20T10:54:45.587 INFO:tasks.workunit.client.0.smithi090.stdout:1/601: rename d8/d1a/d1d/f71 to d8/d1a/d1d/d2c/d8f/db4/fc1 0 2024-04-20T10:54:45.588 INFO:tasks.workunit.client.0.smithi090.stdout:4/506: mkdir d7/d9/d47/d63/d3d/d9e 0 2024-04-20T10:54:45.592 INFO:tasks.workunit.client.0.smithi090.stdout:7/554: rename d11/d13/d23/d6c/d72 to d11/d13/d5b/db8/dbf 0 2024-04-20T10:54:45.593 INFO:tasks.workunit.client.0.smithi090.stdout:1/602: unlink d8/d1a/d1d/d2c/d4a/fb7 0 2024-04-20T10:54:45.594 INFO:tasks.workunit.client.0.smithi090.stdout:7/555: dread d11/d13/d23/f38 [0,4194304] 0 2024-04-20T10:54:45.594 INFO:tasks.workunit.client.0.smithi090.stdout:7/556: dread - d11/d1a/d3f/fba zero size 2024-04-20T10:54:45.594 INFO:tasks.workunit.client.0.smithi090.stdout:7/557: dread - d11/d13/d5d/d65/fab zero size 2024-04-20T10:54:45.595 INFO:tasks.workunit.client.0.smithi090.stdout:4/507: rename d7/f6a to d7/d9/d47/d63/d3d/f9f 0 2024-04-20T10:54:45.597 INFO:tasks.workunit.client.0.smithi090.stdout:1/603: mkdir d8/d1a/d1d/d2c/d4a/d93/d9e/dc2 0 2024-04-20T10:54:45.599 INFO:tasks.workunit.client.0.smithi090.stdout:7/558: symlink d11/d13/d23/lc0 0 2024-04-20T10:54:45.601 INFO:tasks.workunit.client.0.smithi090.stdout:5/739: write d1/d2f/d85/fbf [1751869,11532] 0 2024-04-20T10:54:45.602 INFO:tasks.workunit.client.0.smithi090.stdout:9/571: read d0/f37 [3978750,106542] 0 2024-04-20T10:54:45.604 INFO:tasks.workunit.client.0.smithi090.stdout:7/559: creat d11/d13/d22/d24/fc1 x:0 0 0 2024-04-20T10:54:45.605 INFO:tasks.workunit.client.0.smithi090.stdout:4/508: mkdir d7/d9/d17/da0 0 2024-04-20T10:54:45.605 INFO:tasks.workunit.client.0.smithi090.stdout:4/509: chown d7/d9/d17/d56/d66/d70/f81 2079137773 1 2024-04-20T10:54:45.605 INFO:tasks.workunit.client.0.smithi090.stdout:4/510: chown d7/d97/c9c 307472 1 2024-04-20T10:54:45.605 INFO:tasks.workunit.client.0.smithi090.stdout:2/531: dwrite d11/d1f/d2e/f5b [8388608,4194304] 0 2024-04-20T10:54:45.608 INFO:tasks.workunit.client.0.smithi090.stdout:1/604: dread d8/d1a/d1d/d2c/d4a/d93/d5d/f8e [0,4194304] 0 2024-04-20T10:54:45.609 INFO:tasks.workunit.client.0.smithi090.stdout:3/509: dread d7/d15/d2a/d30/f64 [0,4194304] 0 2024-04-20T10:54:45.610 INFO:tasks.workunit.client.0.smithi090.stdout:3/510: read d7/f79 [305553,31695] 0 2024-04-20T10:54:45.611 INFO:tasks.workunit.client.0.smithi090.stdout:5/740: creat d1/da/dce/ffe x:0 0 0 2024-04-20T10:54:45.612 INFO:tasks.workunit.client.0.smithi090.stdout:9/572: truncate d0/d86/f8f 1282916 0 2024-04-20T10:54:45.613 INFO:tasks.workunit.client.0.smithi090.stdout:7/560: mkdir d11/d13/d22/d27/dc2 0 2024-04-20T10:54:45.614 INFO:tasks.workunit.client.0.smithi090.stdout:3/511: dread d7/d15/d2a/d8d/f8e [0,4194304] 0 2024-04-20T10:54:45.614 INFO:tasks.workunit.client.0.smithi090.stdout:4/511: mkdir d7/d9/d17/d56/d66/d70/da1 0 2024-04-20T10:54:45.616 INFO:tasks.workunit.client.0.smithi090.stdout:1/605: symlink d8/d1a/d1d/d7a/db0/lc3 0 2024-04-20T10:54:45.618 INFO:tasks.workunit.client.0.smithi090.stdout:5/741: symlink d1/de/d96/lff 0 2024-04-20T10:54:45.618 INFO:tasks.workunit.client.0.smithi090.stdout:5/742: fsync d1/fb 0 2024-04-20T10:54:45.619 INFO:tasks.workunit.client.0.smithi090.stdout:9/573: truncate d0/d29/f57 2075576 0 2024-04-20T10:54:45.620 INFO:tasks.workunit.client.0.smithi090.stdout:7/561: creat d11/d13/d22/d24/d35/fc3 x:0 0 0 2024-04-20T10:54:45.622 INFO:tasks.workunit.client.0.smithi090.stdout:1/606: symlink d8/d1a/d1d/d2c/d8f/db4/lc4 0 2024-04-20T10:54:45.623 INFO:tasks.workunit.client.0.smithi090.stdout:5/743: symlink d1/da/d14/dda/l100 0 2024-04-20T10:54:45.625 INFO:tasks.workunit.client.0.smithi090.stdout:9/574: rename d0/d29/d36/d63/f1e to d0/d29/d36/d63/fb7 0 2024-04-20T10:54:45.625 INFO:tasks.workunit.client.0.smithi090.stdout:9/575: truncate d0/d29/d36/d63/d1f/d4d/f9c 334400 0 2024-04-20T10:54:45.626 INFO:tasks.workunit.client.0.smithi090.stdout:9/576: write d0/f9 [787864,89575] 0 2024-04-20T10:54:45.626 INFO:tasks.workunit.client.0.smithi090.stdout:2/532: dwrite d11/d1a/d4a/d55/f9a [0,4194304] 0 2024-04-20T10:54:45.626 INFO:tasks.workunit.client.0.smithi090.stdout:3/512: write d7/fa [1787106,94400] 0 2024-04-20T10:54:45.627 INFO:tasks.workunit.client.0.smithi090.stdout:7/562: mknod d11/d13/d33/d44/cc4 0 2024-04-20T10:54:45.627 INFO:tasks.workunit.client.0.smithi090.stdout:7/563: write d11/d1a/d3f/fba [380113,70196] 0 2024-04-20T10:54:45.627 INFO:tasks.workunit.client.0.smithi090.stdout:7/564: truncate d11/d13/d5d/d65/f8b 9853 0 2024-04-20T10:54:45.627 INFO:tasks.workunit.client.0.smithi090.stdout:7/565: stat d11/d1a/d3f/fba 0 2024-04-20T10:54:45.628 INFO:tasks.workunit.client.0.smithi090.stdout:7/566: dread d11/d13/d23/f62 [0,4194304] 0 2024-04-20T10:54:45.628 INFO:tasks.workunit.client.0.smithi090.stdout:3/513: write d7/d15/f8c [585391,114270] 0 2024-04-20T10:54:45.628 INFO:tasks.workunit.client.0.smithi090.stdout:5/744: mkdir d1/d41/d98/d101 0 2024-04-20T10:54:45.635 INFO:tasks.workunit.client.0.smithi090.stdout:9/577: rename d0/d29/d4f/d23/da5 to d0/d29/d36/d63/d1f/d34/d70/db8 0 2024-04-20T10:54:45.635 INFO:tasks.workunit.client.0.smithi090.stdout:9/578: chown d0/d86/f8f 533105658 1 2024-04-20T10:54:45.635 INFO:tasks.workunit.client.0.smithi090.stdout:2/533: unlink d11/d1a/d37/c50 0 2024-04-20T10:54:45.638 INFO:tasks.workunit.client.0.smithi090.stdout:3/514: write d7/d26/f3c [2181248,93593] 0 2024-04-20T10:54:45.638 INFO:tasks.workunit.client.0.smithi090.stdout:3/515: chown d7/f37 8 1 2024-04-20T10:54:45.639 INFO:tasks.workunit.client.0.smithi090.stdout:3/516: read d7/d15/f25 [135086,73166] 0 2024-04-20T10:54:45.640 INFO:tasks.workunit.client.0.smithi090.stdout:2/534: symlink d11/db0/lb6 0 2024-04-20T10:54:45.640 INFO:tasks.workunit.client.0.smithi090.stdout:9/579: dread d0/d29/d36/d63/d1f/d34/fac [0,4194304] 0 2024-04-20T10:54:45.641 INFO:tasks.workunit.client.0.smithi090.stdout:3/517: symlink d7/d15/d47/la6 0 2024-04-20T10:54:45.641 INFO:tasks.workunit.client.0.smithi090.stdout:2/535: creat d11/d1a/d4a/d55/da1/fb7 x:0 0 0 2024-04-20T10:54:45.642 INFO:tasks.workunit.client.0.smithi090.stdout:4/512: dwrite d7/d9/d47/d63/d42/f64 [0,4194304] 0 2024-04-20T10:54:45.643 INFO:tasks.workunit.client.0.smithi090.stdout:1/607: dwrite d8/d1a/fba [0,4194304] 0 2024-04-20T10:54:45.643 INFO:tasks.workunit.client.0.smithi090.stdout:9/580: mknod d0/d86/cb9 0 2024-04-20T10:54:45.644 INFO:tasks.workunit.client.0.smithi090.stdout:9/581: read d0/d29/d4f/f27 [314459,30639] 0 2024-04-20T10:54:45.645 INFO:tasks.workunit.client.0.smithi090.stdout:9/582: write d0/d29/d36/d63/d1f/d79/f8a [427433,85444] 0 2024-04-20T10:54:45.645 INFO:tasks.workunit.client.0.smithi090.stdout:3/518: creat d7/d26/d5e/d88/d8a/fa7 x:0 0 0 2024-04-20T10:54:45.647 INFO:tasks.workunit.client.0.smithi090.stdout:5/745: dwrite d1/d2f/d85/ff6 [0,4194304] 0 2024-04-20T10:54:45.647 INFO:tasks.workunit.client.0.smithi090.stdout:2/536: rename d11/d1a/d30/d8d/f9f to d11/d1a/d37/d85/d87/fb8 0 2024-04-20T10:54:45.649 INFO:tasks.workunit.client.0.smithi090.stdout:5/746: dread d1/d2f/f37 [0,4194304] 0 2024-04-20T10:54:45.660 INFO:tasks.workunit.client.0.smithi090.stdout:1/608: creat d8/d1a/d1d/d2c/d4a/d93/d5d/fc5 x:0 0 0 2024-04-20T10:54:45.661 INFO:tasks.workunit.client.0.smithi090.stdout:9/583: creat d0/d29/d4f/d6b/fba x:0 0 0 2024-04-20T10:54:45.664 INFO:tasks.workunit.client.0.smithi090.stdout:2/537: link d11/d1a/f1b d11/d1f/d2e/fb9 0 2024-04-20T10:54:45.664 INFO:tasks.workunit.client.0.smithi090.stdout:2/538: fdatasync fc 0 2024-04-20T10:54:45.666 INFO:tasks.workunit.client.0.smithi090.stdout:1/609: mkdir d8/d1a/d4d/dc6 0 2024-04-20T10:54:45.667 INFO:tasks.workunit.client.0.smithi090.stdout:9/584: creat d0/d29/d36/d63/d1f/d4d/fbb x:0 0 0 2024-04-20T10:54:45.667 INFO:tasks.workunit.client.0.smithi090.stdout:2/539: write d11/d1f/d2e/f52 [2970725,63614] 0 2024-04-20T10:54:45.667 INFO:tasks.workunit.client.0.smithi090.stdout:2/540: read - d11/d1a/d30/f9d zero size 2024-04-20T10:54:45.667 INFO:tasks.workunit.client.0.smithi090.stdout:2/541: truncate d11/d1f/d2e/fb9 526545 0 2024-04-20T10:54:45.668 INFO:tasks.workunit.client.0.smithi090.stdout:3/519: mkdir d7/d35/da8 0 2024-04-20T10:54:45.668 INFO:tasks.workunit.client.0.smithi090.stdout:3/520: fdatasync d7/d15/d2a/d30/d93/f6d 0 2024-04-20T10:54:45.668 INFO:tasks.workunit.client.0.smithi090.stdout:3/521: write d7/d35/f9c [908690,102238] 0 2024-04-20T10:54:45.670 INFO:tasks.workunit.client.0.smithi090.stdout:1/610: symlink d8/d1a/d1d/d2c/d62/lc7 0 2024-04-20T10:54:45.671 INFO:tasks.workunit.client.0.smithi090.stdout:9/585: mknod d0/d29/d4f/d23/daa/cbc 0 2024-04-20T10:54:45.674 INFO:tasks.workunit.client.0.smithi090.stdout:2/542: rename d11/f76 to d11/d1f/d2e/dad/fba 0 2024-04-20T10:54:45.675 INFO:tasks.workunit.client.0.smithi090.stdout:3/522: write d7/df/f4d [982407,41586] 0 2024-04-20T10:54:45.675 INFO:tasks.workunit.client.0.smithi090.stdout:1/611: creat d8/d1a/d1d/d2c/d62/fc8 x:0 0 0 2024-04-20T10:54:45.675 INFO:tasks.workunit.client.0.smithi090.stdout:1/612: fsync d8/fe 0 2024-04-20T10:54:45.675 INFO:tasks.workunit.client.0.smithi090.stdout:9/586: creat d0/d29/d4f/d82/fbd x:0 0 0 2024-04-20T10:54:45.677 INFO:tasks.workunit.client.0.smithi090.stdout:3/523: rename d7/d26/d5e/f98 to d7/d11/fa9 0 2024-04-20T10:54:45.678 INFO:tasks.workunit.client.0.smithi090.stdout:1/613: rmdir d8/d1a/d1d/d2c/d4a/d7b 39 2024-04-20T10:54:45.679 INFO:tasks.workunit.client.0.smithi090.stdout:9/587: link d0/l38 d0/d29/d36/d63/lbe 0 2024-04-20T10:54:45.679 INFO:tasks.workunit.client.0.smithi090.stdout:9/588: chown d0/d29 0 1 2024-04-20T10:54:45.686 INFO:tasks.workunit.client.0.smithi090.stdout:2/543: dread d11/d1a/d37/f93 [0,4194304] 0 2024-04-20T10:54:45.686 INFO:tasks.workunit.client.0.smithi090.stdout:2/544: write d11/d1f/d2e/f8e [4843005,73571] 0 2024-04-20T10:54:45.687 INFO:tasks.workunit.client.0.smithi090.stdout:9/589: dread d0/d29/d36/d63/d1f/d79/f75 [0,4194304] 0 2024-04-20T10:54:45.688 INFO:tasks.workunit.client.0.smithi090.stdout:3/524: rename d7/d15/d2a/d30/d93/d7f/l97 to d7/d26/d5e/d88/d8a/laa 0 2024-04-20T10:54:45.696 INFO:tasks.workunit.client.0.smithi090.stdout:2/545: read d11/d1f/d2e/f8e [3635991,124028] 0 2024-04-20T10:54:45.696 INFO:tasks.workunit.client.0.smithi090.stdout:2/546: write d11/d1a/f2d [963451,86509] 0 2024-04-20T10:54:45.700 INFO:tasks.workunit.client.0.smithi090.stdout:4/513: dwrite d7/d9/d17/d56/d66/f8a [0,4194304] 0 2024-04-20T10:54:45.700 INFO:tasks.workunit.client.0.smithi090.stdout:4/514: read - d7/d9/d47/d63/d3d/f75 zero size 2024-04-20T10:54:45.700 INFO:tasks.workunit.client.0.smithi090.stdout:4/515: stat d7/d9/d47/d63/c4e 0 2024-04-20T10:54:45.701 INFO:tasks.workunit.client.0.smithi090.stdout:5/747: dwrite d1/de/dcf/f79 [0,4194304] 0 2024-04-20T10:54:45.701 INFO:tasks.workunit.client.0.smithi090.stdout:5/748: truncate d1/da/fc3 804956 0 2024-04-20T10:54:45.701 INFO:tasks.workunit.client.0.smithi090.stdout:9/590: symlink d0/d29/d36/d63/d1f/d34/d70/d52/lbf 0 2024-04-20T10:54:45.701 INFO:tasks.workunit.client.0.smithi090.stdout:9/591: chown d0/d29/d36/d63/d1f/d34/d70/d52/lbf 727819 1 2024-04-20T10:54:45.706 INFO:tasks.workunit.client.0.smithi090.stdout:5/749: unlink d1/de/fae 0 2024-04-20T10:54:45.706 INFO:tasks.workunit.client.0.smithi090.stdout:5/750: dread - d1/da/d1f/dad/dc8/ff5 zero size 2024-04-20T10:54:45.709 INFO:tasks.workunit.client.0.smithi090.stdout:9/592: unlink d0/d29/d4f/f2d 0 2024-04-20T10:54:45.709 INFO:tasks.workunit.client.0.smithi090.stdout:9/593: fdatasync d0/d29/d36/d63/d1c/d94/fab 0 2024-04-20T10:54:45.709 INFO:tasks.workunit.client.0.smithi090.stdout:9/594: write d0/d29/d4f/f84 [455433,5637] 0 2024-04-20T10:54:45.709 INFO:tasks.workunit.client.0.smithi090.stdout:9/595: write d0/d29/d4f/f10 [4539997,117121] 0 2024-04-20T10:54:45.712 INFO:tasks.workunit.client.0.smithi090.stdout:5/751: mknod d1/d41/d98/d101/c102 0 2024-04-20T10:54:45.713 INFO:tasks.workunit.client.0.smithi090.stdout:9/596: mknod d0/d29/d36/d63/d1f/d34/d70/d52/cc0 0 2024-04-20T10:54:45.723 INFO:tasks.workunit.client.0.smithi090.stdout:3/525: dwrite d7/d15/d2a/d30/d93/f6d [0,4194304] 0 2024-04-20T10:54:45.724 INFO:tasks.workunit.client.0.smithi090.stdout:2/547: dwrite d11/f15 [0,4194304] 0 2024-04-20T10:54:45.724 INFO:tasks.workunit.client.0.smithi090.stdout:2/548: readlink d11/l41 0 2024-04-20T10:54:45.724 INFO:tasks.workunit.client.0.smithi090.stdout:2/549: dread - d11/d1a/d4a/d55/da1/fb7 zero size 2024-04-20T10:54:45.724 INFO:tasks.workunit.client.0.smithi090.stdout:4/516: dwrite d7/d9/d47/d63/d3d/f9f [0,4194304] 0 2024-04-20T10:54:45.725 INFO:tasks.workunit.client.0.smithi090.stdout:5/752: rmdir d1/da 39 2024-04-20T10:54:45.725 INFO:tasks.workunit.client.0.smithi090.stdout:5/753: chown d1/da/f1e 2309152 1 2024-04-20T10:54:45.727 INFO:tasks.workunit.client.0.smithi090.stdout:3/526: dread d7/d43/f76 [0,4194304] 0 2024-04-20T10:54:45.727 INFO:tasks.workunit.client.0.smithi090.stdout:3/527: dread - d7/d11/fa9 zero size 2024-04-20T10:54:45.727 INFO:tasks.workunit.client.0.smithi090.stdout:2/550: creat d11/d1f/fbb x:0 0 0 2024-04-20T10:54:45.728 INFO:tasks.workunit.client.0.smithi090.stdout:9/597: dwrite d0/d29/d36/d63/d1f/d34/fb6 [0,4194304] 0 2024-04-20T10:54:45.729 INFO:tasks.workunit.client.0.smithi090.stdout:3/528: rmdir d7/d35 39 2024-04-20T10:54:45.730 INFO:tasks.workunit.client.0.smithi090.stdout:2/551: creat d11/d97/fbc x:0 0 0 2024-04-20T10:54:45.730 INFO:tasks.workunit.client.0.smithi090.stdout:2/552: stat d11/d1a/d37/d85/f98 0 2024-04-20T10:54:45.734 INFO:tasks.workunit.client.0.smithi090.stdout:3/529: getdents d7/d15/d2a/d30/d93 0 2024-04-20T10:54:45.734 INFO:tasks.workunit.client.0.smithi090.stdout:4/517: dread d7/d9/f62 [0,4194304] 0 2024-04-20T10:54:45.736 INFO:tasks.workunit.client.0.smithi090.stdout:9/598: rename d0/l28 to d0/d29/lc1 0 2024-04-20T10:54:45.736 INFO:tasks.workunit.client.0.smithi090.stdout:9/599: dread - d0/d29/d36/d63/d1f/d4d/fb2 zero size 2024-04-20T10:54:45.737 INFO:tasks.workunit.client.0.smithi090.stdout:3/530: symlink d7/d11/lab 0 2024-04-20T10:54:45.737 INFO:tasks.workunit.client.0.smithi090.stdout:2/553: read d11/d1a/d4a/d59/f5c [884762,111709] 0 2024-04-20T10:54:45.738 INFO:tasks.workunit.client.0.smithi090.stdout:4/518: rmdir d7/d9/d47/d63/d42 39 2024-04-20T10:54:45.739 INFO:tasks.workunit.client.0.smithi090.stdout:9/600: mknod d0/d29/d36/d63/cc2 0 2024-04-20T10:54:45.739 INFO:tasks.workunit.client.0.smithi090.stdout:2/554: creat d11/d1f/fbd x:0 0 0 2024-04-20T10:54:45.740 INFO:tasks.workunit.client.0.smithi090.stdout:4/519: mkdir d7/d9/d47/d63/d42/d8f/da2 0 2024-04-20T10:54:45.741 INFO:tasks.workunit.client.0.smithi090.stdout:9/601: creat d0/d29/d4f/d23/daa/fc3 x:0 0 0 2024-04-20T10:54:45.742 INFO:tasks.workunit.client.0.smithi090.stdout:2/555: getdents d11/d1a/d37/d85/d87 0 2024-04-20T10:54:45.743 INFO:tasks.workunit.client.0.smithi090.stdout:3/531: dread d7/d15/d2a/f58 [0,4194304] 0 2024-04-20T10:54:45.743 INFO:tasks.workunit.client.0.smithi090.stdout:9/602: truncate d0/d29/f92 225556 0 2024-04-20T10:54:45.744 INFO:tasks.workunit.client.0.smithi090.stdout:2/556: creat d11/fbe x:0 0 0 2024-04-20T10:54:45.745 INFO:tasks.workunit.client.0.smithi090.stdout:2/557: write d11/d1a/d4a/d55/f69 [191892,9348] 0 2024-04-20T10:54:45.746 INFO:tasks.workunit.client.0.smithi090.stdout:3/532: truncate d7/d15/d2a/d30/f64 4169278 0 2024-04-20T10:54:45.747 INFO:tasks.workunit.client.0.smithi090.stdout:9/603: rmdir d0/d9a 39 2024-04-20T10:54:45.749 INFO:tasks.workunit.client.0.smithi090.stdout:2/558: link d11/d1a/d37/f77 d11/d1a/d4a/d55/d67/fbf 0 2024-04-20T10:54:45.751 INFO:tasks.workunit.client.0.smithi090.stdout:3/533: rename d7/d11/fa9 to d7/d15/d47/d56/fac 0 2024-04-20T10:54:45.751 INFO:tasks.workunit.client.0.smithi090.stdout:3/534: stat d7/d26/d5e/la3 0 2024-04-20T10:54:45.751 INFO:tasks.workunit.client.0.smithi090.stdout:2/559: symlink d11/d1a/d2b/lc0 0 2024-04-20T10:54:45.751 INFO:tasks.workunit.client.0.smithi090.stdout:2/560: fdatasync d11/d1a/d37/d85/f95 0 2024-04-20T10:54:45.752 INFO:tasks.workunit.client.0.smithi090.stdout:3/535: creat d7/d26/d5e/d88/fad x:0 0 0 2024-04-20T10:54:45.756 INFO:tasks.workunit.client.0.smithi090.stdout:2/561: rename c10 to d11/d1a/d37/cc1 0 2024-04-20T10:54:45.763 INFO:tasks.workunit.client.0.smithi090.stdout:4/520: dwrite d7/d9/d17/f37 [0,4194304] 0 2024-04-20T10:54:45.764 INFO:tasks.workunit.client.0.smithi090.stdout:2/562: truncate d11/f31 10987923 0 2024-04-20T10:54:45.765 INFO:tasks.workunit.client.0.smithi090.stdout:4/521: symlink d7/d9/d47/d63/d3d/la3 0 2024-04-20T10:54:45.766 INFO:tasks.workunit.client.0.smithi090.stdout:2/563: creat d11/d97/fc2 x:0 0 0 2024-04-20T10:54:45.769 INFO:tasks.workunit.client.0.smithi090.stdout:9/604: dwrite d0/f37 [8388608,4194304] 0 2024-04-20T10:54:45.770 INFO:tasks.workunit.client.0.smithi090.stdout:4/522: unlink d7/d9/d47/d63/l57 0 2024-04-20T10:54:45.772 INFO:tasks.workunit.client.0.smithi090.stdout:9/605: creat d0/d9a/fc4 x:0 0 0 2024-04-20T10:54:45.788 INFO:tasks.workunit.client.0.smithi090.stdout:2/564: dwrite d11/d1a/d37/f77 [0,4194304] 0 2024-04-20T10:54:45.788 INFO:tasks.workunit.client.0.smithi090.stdout:4/523: getdents d7/d9/d17/d56 0 2024-04-20T10:54:45.789 INFO:tasks.workunit.client.0.smithi090.stdout:9/606: dwrite d0/d29/d36/d63/d1c/f3e [0,4194304] 0 2024-04-20T10:54:45.790 INFO:tasks.workunit.client.0.smithi090.stdout:2/565: getdents d11/d1a/d30/d8d 0 2024-04-20T10:54:45.791 INFO:tasks.workunit.client.0.smithi090.stdout:4/524: symlink d7/d9/d47/d63/d42/d8f/da2/la4 0 2024-04-20T10:54:45.793 INFO:tasks.workunit.client.0.smithi090.stdout:9/607: link d0/d29/d4f/c47 d0/d29/d4f/d82/cc5 0 2024-04-20T10:54:45.803 INFO:tasks.workunit.client.0.smithi090.stdout:9/608: write d0/f91 [7054090,71278] 0 2024-04-20T10:54:45.803 INFO:tasks.workunit.client.0.smithi090.stdout:9/609: fdatasync d0/d29/d36/d63/da1/faf 0 2024-04-20T10:54:45.803 INFO:tasks.workunit.client.0.smithi090.stdout:9/610: write d0/d29/d36/d63/d1c/f2b [643298,127899] 0 2024-04-20T10:54:45.803 INFO:tasks.workunit.client.0.smithi090.stdout:9/611: fsync d0/d29/d36/d63/d1f/d4d/fbb 0 2024-04-20T10:54:45.809 INFO:tasks.workunit.client.0.smithi090.stdout:2/566: dwrite d11/f20 [0,4194304] 0 2024-04-20T10:54:45.809 INFO:tasks.workunit.client.0.smithi090.stdout:2/567: fdatasync d11/d1a/d4a/f8c 0 2024-04-20T10:54:45.810 INFO:tasks.workunit.client.0.smithi090.stdout:4/525: mkdir d7/d9/d17/d56/d66/d70/da5 0 2024-04-20T10:54:45.811 INFO:tasks.workunit.client.0.smithi090.stdout:2/568: creat d11/d1a/fc3 x:0 0 0 2024-04-20T10:54:45.812 INFO:tasks.workunit.client.0.smithi090.stdout:4/526: rename d7/d9/d47/d63/d76/c8b to d7/d9/d17/d56/d66/d70/da5/ca6 0 2024-04-20T10:54:45.815 INFO:tasks.workunit.client.0.smithi090.stdout:4/527: dread d7/f21 [0,4194304] 0 2024-04-20T10:54:45.820 INFO:tasks.workunit.client.0.smithi090.stdout:9/612: dwrite d0/f7c [0,4194304] 0 2024-04-20T10:54:45.821 INFO:tasks.workunit.client.0.smithi090.stdout:4/528: rename d7/d9/d47/d63/d76/c7b to d7/d9/d47/ca7 0 2024-04-20T10:54:45.822 INFO:tasks.workunit.client.0.smithi090.stdout:9/613: mkdir d0/dc6 0 2024-04-20T10:54:45.822 INFO:tasks.workunit.client.0.smithi090.stdout:9/614: chown d0/c73 892828234 1 2024-04-20T10:54:45.823 INFO:tasks.workunit.client.0.smithi090.stdout:9/615: dread d0/d29/d4f/f10 [4194304,4194304] 0 2024-04-20T10:54:45.824 INFO:tasks.workunit.client.0.smithi090.stdout:4/529: rename d7/d9/d47/d63/d3d/c5a to d7/d9/d47/d8d/ca8 0 2024-04-20T10:54:45.825 INFO:tasks.workunit.client.0.smithi090.stdout:4/530: write d7/d9/d17/d56/f8c [959714,109374] 0 2024-04-20T10:54:45.826 INFO:tasks.workunit.client.0.smithi090.stdout:9/616: creat d0/d29/d36/d63/da1/fc7 x:0 0 0 2024-04-20T10:54:45.828 INFO:tasks.workunit.client.0.smithi090.stdout:2/569: truncate d11/f20 410411 0 2024-04-20T10:54:45.828 INFO:tasks.workunit.client.0.smithi090.stdout:2/570: write d11/f7a [1284200,120782] 0 2024-04-20T10:54:45.828 INFO:tasks.workunit.client.0.smithi090.stdout:4/531: truncate d7/d9/d17/f27 476825 0 2024-04-20T10:54:45.830 INFO:tasks.workunit.client.0.smithi090.stdout:2/571: rmdir d11/d1a/d4a 39 2024-04-20T10:54:45.830 INFO:tasks.workunit.client.0.smithi090.stdout:2/572: chown d11/d1a/d4a/d55/f6d 29 1 2024-04-20T10:54:45.831 INFO:tasks.workunit.client.0.smithi090.stdout:2/573: read d11/d1f/d2e/f88 [141250,37254] 0 2024-04-20T10:54:45.835 INFO:tasks.workunit.client.0.smithi090.stdout:5/754: read d1/da/d1f/dad/fd0 [3921869,89610] 0 2024-04-20T10:54:45.836 INFO:tasks.workunit.client.0.smithi090.stdout:2/574: mknod d11/d1f/d2e/d6e/cc4 0 2024-04-20T10:54:45.836 INFO:tasks.workunit.client.0.smithi090.stdout:2/575: chown d11 42736319 1 2024-04-20T10:54:45.837 INFO:tasks.workunit.client.0.smithi090.stdout:4/532: write d7/d9/f10 [1918041,126270] 0 2024-04-20T10:54:45.840 INFO:tasks.workunit.client.0.smithi090.stdout:2/576: rename fa to d11/d1a/d37/fc5 0 2024-04-20T10:54:45.849 INFO:tasks.workunit.client.0.smithi090.stdout:5/755: dread d1/d2f/d85/dbd/f64 [0,4194304] 0 2024-04-20T10:54:45.858 INFO:tasks.workunit.client.0.smithi090.stdout:4/533: dwrite d7/f21 [0,4194304] 0 2024-04-20T10:54:45.859 INFO:tasks.workunit.client.0.smithi090.stdout:2/577: stat d11/d1f/d2e/lb2 0 2024-04-20T10:54:45.860 INFO:tasks.workunit.client.0.smithi090.stdout:4/534: mknod d7/d9/d92/ca9 0 2024-04-20T10:54:45.860 INFO:tasks.workunit.client.0.smithi090.stdout:4/535: dread - d7/d9/d47/d63/d3d/f75 zero size 2024-04-20T10:54:45.860 INFO:tasks.workunit.client.0.smithi090.stdout:2/578: creat d11/d1a/d37/fc6 x:0 0 0 2024-04-20T10:54:45.862 INFO:tasks.workunit.client.0.smithi090.stdout:5/756: dread d1/da/d14/d47/f7e [0,4194304] 0 2024-04-20T10:54:45.863 INFO:tasks.workunit.client.0.smithi090.stdout:4/536: unlink d7/d9/d17/d56/d66/d70/c93 0 2024-04-20T10:54:45.872 INFO:tasks.workunit.client.0.smithi090.stdout:5/757: mkdir d1/d2f/d3d/d40/d70/d103 0 2024-04-20T10:54:45.872 INFO:tasks.workunit.client.0.smithi090.stdout:5/758: write d1/de/f20 [2666069,95856] 0 2024-04-20T10:54:45.874 INFO:tasks.workunit.client.0.smithi090.stdout:1/614: write d8/d1a/f89 [3735267,6718] 0 2024-04-20T10:54:45.874 INFO:tasks.workunit.client.0.smithi090.stdout:1/615: chown d8/d1a 2094741 1 2024-04-20T10:54:45.874 INFO:tasks.workunit.client.0.smithi090.stdout:1/616: chown d8/d1a/d1d/l3c 0 1 2024-04-20T10:54:45.875 INFO:tasks.workunit.client.0.smithi090.stdout:1/617: readlink d8/d1a/d1d/d2c/d4a/d5a/laa 0 2024-04-20T10:54:45.875 INFO:tasks.workunit.client.0.smithi090.stdout:1/618: creat d8/d1a/d1d/d2c/d62/fc9 x:0 0 0 2024-04-20T10:54:45.877 INFO:tasks.workunit.client.0.smithi090.stdout:2/579: dwrite d11/f31 [4194304,4194304] 0 2024-04-20T10:54:45.889 INFO:tasks.workunit.client.0.smithi090.stdout:4/537: dwrite d7/d9/f4a [0,4194304] 0 2024-04-20T10:54:45.890 INFO:tasks.workunit.client.0.smithi090.stdout:4/538: truncate d7/f54 686369 0 2024-04-20T10:54:45.892 INFO:tasks.workunit.client.0.smithi090.stdout:4/539: dread d7/d9/d47/d63/d3d/f60 [0,4194304] 0 2024-04-20T10:54:45.898 INFO:tasks.workunit.client.0.smithi090.stdout:4/540: write d7/d9/d17/f37 [1072130,39113] 0 2024-04-20T10:54:45.898 INFO:tasks.workunit.client.0.smithi090.stdout:4/541: chown d7/d9/d47/d63/d3d/c44 4913904 1 2024-04-20T10:54:45.898 INFO:tasks.workunit.client.0.smithi090.stdout:4/542: write d7/f54 [1506832,13915] 0 2024-04-20T10:54:45.898 INFO:tasks.workunit.client.0.smithi090.stdout:4/543: chown d7/f6e 352807 1 2024-04-20T10:54:45.899 INFO:tasks.workunit.client.0.smithi090.stdout:1/619: symlink d8/d1a/d1d/d2c/d8f/db4/lca 0 2024-04-20T10:54:45.914 INFO:tasks.workunit.client.0.smithi090.stdout:1/620: dwrite d8/fb [0,4194304] 0 2024-04-20T10:54:45.915 INFO:tasks.workunit.client.0.smithi090.stdout:4/544: rmdir d7/d9/d47/d63/d76 39 2024-04-20T10:54:45.916 INFO:tasks.workunit.client.0.smithi090.stdout:4/545: dread d7/d9/f36 [4194304,4194304] 0 2024-04-20T10:54:45.920 INFO:tasks.workunit.client.0.smithi090.stdout:1/621: rename d8/c15 to d8/d1a/d4d/ccb 0 2024-04-20T10:54:45.920 INFO:tasks.workunit.client.0.smithi090.stdout:1/622: fsync d8/d1a/d1d/d2c/d4a/fb9 0 2024-04-20T10:54:45.920 INFO:tasks.workunit.client.0.smithi090.stdout:4/546: creat d7/d9/d47/d63/d42/d8f/da2/faa x:0 0 0 2024-04-20T10:54:45.927 INFO:tasks.workunit.client.0.smithi090.stdout:2/580: write d11/d1a/d4a/d55/f6d [3632994,44754] 0 2024-04-20T10:54:45.930 INFO:tasks.workunit.client.0.smithi090.stdout:8/504: sync 2024-04-20T10:54:45.930 INFO:tasks.workunit.client.0.smithi090.stdout:0/557: sync 2024-04-20T10:54:45.930 INFO:tasks.workunit.client.0.smithi090.stdout:2/581: dread d11/f16 [0,4194304] 0 2024-04-20T10:54:45.932 INFO:tasks.workunit.client.0.smithi090.stdout:1/623: creat d8/d1a/d1d/d7a/d9a/fcc x:0 0 0 2024-04-20T10:54:45.932 INFO:tasks.workunit.client.0.smithi090.stdout:1/624: write d8/d1a/f3b [4498920,116700] 0 2024-04-20T10:54:45.933 INFO:tasks.workunit.client.0.smithi090.stdout:1/625: symlink d8/d1a/d1d/d67/lcd 0 2024-04-20T10:54:45.935 INFO:tasks.workunit.client.0.smithi090.stdout:0/558: rename d14/d19/d2b/c9d to d14/d19/d2b/d61/da0/db1/cb6 0 2024-04-20T10:54:45.935 INFO:tasks.workunit.client.0.smithi090.stdout:0/559: chown d14/d19/d2b/d52/d55/d5b/d7f/fb4 933786 1 2024-04-20T10:54:45.936 INFO:tasks.workunit.client.0.smithi090.stdout:1/626: mknod d8/d1a/d1d/d7a/db0/cce 0 2024-04-20T10:54:45.937 INFO:tasks.workunit.client.0.smithi090.stdout:0/560: truncate d14/d19/d2b/d52/d55/d5b/d7f/f8b 484929 0 2024-04-20T10:54:45.938 INFO:tasks.workunit.client.0.smithi090.stdout:4/547: write d7/f38 [1486646,123859] 0 2024-04-20T10:54:45.938 INFO:tasks.workunit.client.0.smithi090.stdout:2/582: dread d11/d1a/f2c [0,4194304] 0 2024-04-20T10:54:45.938 INFO:tasks.workunit.client.0.smithi090.stdout:2/583: fsync d11/d1f/f6c 0 2024-04-20T10:54:45.939 INFO:tasks.workunit.client.0.smithi090.stdout:2/584: read - d11/d1f/fbb zero size 2024-04-20T10:54:45.939 INFO:tasks.workunit.client.0.smithi090.stdout:1/627: creat d8/d1a/d1d/d2c/d4a/d93/fcf x:0 0 0 2024-04-20T10:54:45.940 INFO:tasks.workunit.client.0.smithi090.stdout:4/548: chown d7/d9/d17/c3e 62275540 1 2024-04-20T10:54:45.941 INFO:tasks.workunit.client.0.smithi090.stdout:1/628: getdents d8/d1a/d1d/d2c/d8f 0 2024-04-20T10:54:45.948 INFO:tasks.workunit.client.0.smithi090.stdout:8/505: dwrite d0/d2d/f93 [0,4194304] 0 2024-04-20T10:54:45.949 INFO:tasks.workunit.client.0.smithi090.stdout:1/629: symlink d8/d1a/d1d/d2c/d8f/db4/ld0 0 2024-04-20T10:54:45.965 INFO:tasks.workunit.client.0.smithi090.stdout:8/506: dwrite d0/f9c [0,4194304] 0 2024-04-20T10:54:45.965 INFO:tasks.workunit.client.0.smithi090.stdout:8/507: fsync d0/d99/fa1 0 2024-04-20T10:54:45.966 INFO:tasks.workunit.client.0.smithi090.stdout:1/630: mkdir d8/d1a/d1d/d2c/d8f/db4/dd1 0 2024-04-20T10:54:45.966 INFO:tasks.workunit.client.0.smithi090.stdout:1/631: write d8/d1a/d1d/d2c/d4a/fbc [1023572,96603] 0 2024-04-20T10:54:45.982 INFO:tasks.workunit.client.0.smithi090.stdout:1/632: dwrite d8/d1a/d1d/d2c/d3f/f87 [0,4194304] 0 2024-04-20T10:54:45.983 INFO:tasks.workunit.client.0.smithi090.stdout:1/633: chown d8/d1a/d4d/da5/cbd 30046734 1 2024-04-20T10:54:45.983 INFO:tasks.workunit.client.0.smithi090.stdout:8/508: unlink d0/d3a/c83 0 2024-04-20T10:54:45.992 INFO:tasks.workunit.client.0.smithi090.stdout:8/509: dread d0/d26/f55 [0,4194304] 0 2024-04-20T10:54:45.993 INFO:tasks.workunit.client.0.smithi090.stdout:1/634: unlink c2 0 2024-04-20T10:54:45.995 INFO:tasks.workunit.client.0.smithi090.stdout:1/635: dread d8/d1a/d1d/f27 [0,4194304] 0 2024-04-20T10:54:45.995 INFO:tasks.workunit.client.0.smithi090.stdout:1/636: stat d8/d1a/d4d 0 2024-04-20T10:54:45.996 INFO:tasks.workunit.client.0.smithi090.stdout:8/510: mkdir d0/d26/da7 0 2024-04-20T10:54:45.996 INFO:tasks.workunit.client.0.smithi090.stdout:8/511: stat d0/f28 0 2024-04-20T10:54:46.013 INFO:tasks.workunit.client.0.smithi090.stdout:8/512: dwrite d0/d26/f4d [0,4194304] 0 2024-04-20T10:54:46.013 INFO:tasks.workunit.client.0.smithi090.stdout:8/513: dread - d0/d3a/d9f/d52/f82 zero size 2024-04-20T10:54:46.029 INFO:tasks.workunit.client.0.smithi090.stdout:8/514: dwrite d0/d3a/d9f/d52/f9a [0,4194304] 0 2024-04-20T10:54:46.029 INFO:tasks.workunit.client.0.smithi090.stdout:8/515: chown d0/d11/l2c 8223 1 2024-04-20T10:54:46.029 INFO:tasks.workunit.client.0.smithi090.stdout:8/516: chown d0/f79 30 1 2024-04-20T10:54:46.030 INFO:tasks.workunit.client.0.smithi090.stdout:1/637: mkdir d8/d1a/d1d/d2c/d4a/d93/dd2 0 2024-04-20T10:54:46.037 INFO:tasks.workunit.client.0.smithi090.stdout:8/517: write d0/fe [2289349,102631] 0 2024-04-20T10:54:46.047 INFO:tasks.workunit.client.0.smithi090.stdout:1/638: dwrite d8/d1a/d1d/d2c/f51 [0,4194304] 0 2024-04-20T10:54:46.047 INFO:tasks.workunit.client.0.smithi090.stdout:1/639: dread - d8/d1a/d1d/d7a/d9a/fcc zero size 2024-04-20T10:54:46.048 INFO:tasks.workunit.client.0.smithi090.stdout:8/518: getdents d0/d3a/d9f/d52 0 2024-04-20T10:54:46.049 INFO:tasks.workunit.client.0.smithi090.stdout:1/640: mkdir d8/d1a/d1d/d2c/d4a/d93/dd2/dd3 0 2024-04-20T10:54:46.058 INFO:tasks.workunit.client.0.smithi090.stdout:1/641: read d8/d1a/fba [3518714,101259] 0 2024-04-20T10:54:46.059 INFO:tasks.workunit.client.0.smithi090.stdout:1/642: rename d8/d1a/f89 to d8/d1a/d1d/d7a/d9a/fd4 0 2024-04-20T10:54:46.063 INFO:tasks.workunit.client.0.smithi090.stdout:8/519: truncate d0/fe 6258330 0 2024-04-20T10:54:46.065 INFO:tasks.workunit.client.0.smithi090.stdout:1/643: dread d8/d1a/d1d/d2c/d4a/d93/d5d/f5e [0,4194304] 0 2024-04-20T10:54:46.066 INFO:tasks.workunit.client.0.smithi090.stdout:8/520: mknod d0/d3a/d9f/ca8 0 2024-04-20T10:54:46.066 INFO:tasks.workunit.client.0.smithi090.stdout:1/644: symlink d8/d1a/d1d/d2c/d8f/ld5 0 2024-04-20T10:54:46.067 INFO:tasks.workunit.client.0.smithi090.stdout:8/521: mkdir d0/d26/da7/da9 0 2024-04-20T10:54:46.074 INFO:tasks.workunit.client.0.smithi090.stdout:1/645: creat d8/d1a/d1d/d2c/d62/fd6 x:0 0 0 2024-04-20T10:54:46.081 INFO:tasks.workunit.client.0.smithi090.stdout:8/522: dwrite d0/d3a/d4a/f95 [0,4194304] 0 2024-04-20T10:54:46.082 INFO:tasks.workunit.client.0.smithi090.stdout:8/523: read d0/d11/f31 [897471,690] 0 2024-04-20T10:54:46.085 INFO:tasks.workunit.client.0.smithi090.stdout:1/646: dread d8/d1a/d1d/d2c/f51 [0,4194304] 0 2024-04-20T10:54:46.104 INFO:tasks.workunit.client.0.smithi090.stdout:8/524: dwrite d0/f27 [0,4194304] 0 2024-04-20T10:54:46.110 INFO:tasks.workunit.client.0.smithi090.stdout:1/647: dwrite d8/d1a/d1d/d2c/d4a/d5a/fb5 [4194304,4194304] 0 2024-04-20T10:54:46.110 INFO:tasks.workunit.client.0.smithi090.stdout:1/648: fsync d8/fe 0 2024-04-20T10:54:46.110 INFO:tasks.workunit.client.0.smithi090.stdout:1/649: write d8/d1a/d1d/d2c/d3f/f53 [1617873,114709] 0 2024-04-20T10:54:46.110 INFO:tasks.workunit.client.0.smithi090.stdout:1/650: truncate d8/d1a/d1d/d2c/d4a/d93/d9e/fa3 507875 0 2024-04-20T10:54:46.111 INFO:tasks.workunit.client.0.smithi090.stdout:1/651: rmdir d8/d1a/d1d/d2c/d3f 39 2024-04-20T10:54:46.111 INFO:tasks.workunit.client.0.smithi090.stdout:1/652: chown d8/d1a/d1d/d67/c26 577 1 2024-04-20T10:54:46.120 INFO:tasks.workunit.client.0.smithi090.stdout:8/525: dwrite d0/d11/d22/d53/d57/f7d [0,4194304] 0 2024-04-20T10:54:46.121 INFO:tasks.workunit.client.0.smithi090.stdout:8/526: mkdir d0/d3a/daa 0 2024-04-20T10:54:46.133 INFO:tasks.workunit.client.0.smithi090.stdout:1/653: dwrite d8/d1a/d1d/d2c/d4a/f8b [0,4194304] 0 2024-04-20T10:54:46.134 INFO:tasks.workunit.client.0.smithi090.stdout:1/654: truncate d8/d1a/d1d/d2c/d3f/f7e 820642 0 2024-04-20T10:54:46.134 INFO:tasks.workunit.client.0.smithi090.stdout:1/655: creat d8/d1a/d1d/d2c/d4a/d93/fd7 x:0 0 0 2024-04-20T10:54:46.136 INFO:tasks.workunit.client.0.smithi090.stdout:8/527: dwrite d0/d11/d22/f34 [4194304,4194304] 0 2024-04-20T10:54:46.139 INFO:tasks.workunit.client.0.smithi090.stdout:8/528: unlink d0/f20 0 2024-04-20T10:54:46.142 INFO:tasks.workunit.client.0.smithi090.stdout:8/529: symlink d0/d2d/d49/d67/lab 0 2024-04-20T10:54:46.143 INFO:tasks.workunit.client.0.smithi090.stdout:8/530: mkdir d0/dac 0 2024-04-20T10:54:46.144 INFO:tasks.workunit.client.0.smithi090.stdout:8/531: symlink d0/d11/d22/lad 0 2024-04-20T10:54:46.144 INFO:tasks.workunit.client.0.smithi090.stdout:8/532: chown d0/d26/da7/da9 94262 1 2024-04-20T10:54:46.144 INFO:tasks.workunit.client.0.smithi090.stdout:8/533: mknod d0/d2d/d49/cae 0 2024-04-20T10:54:46.145 INFO:tasks.workunit.client.0.smithi090.stdout:8/534: creat d0/d2d/d49/faf x:0 0 0 2024-04-20T10:54:46.146 INFO:tasks.workunit.client.0.smithi090.stdout:8/535: unlink d0/d3a/l6b 0 2024-04-20T10:54:46.146 INFO:tasks.workunit.client.0.smithi090.stdout:8/536: creat d0/d11/d22/d53/d8e/fb0 x:0 0 0 2024-04-20T10:54:46.147 INFO:tasks.workunit.client.0.smithi090.stdout:8/537: creat d0/d99/fb1 x:0 0 0 2024-04-20T10:54:46.151 INFO:tasks.workunit.client.0.smithi090.stdout:1/656: dwrite d8/f2d [0,4194304] 0 2024-04-20T10:54:46.151 INFO:tasks.workunit.client.0.smithi090.stdout:1/657: chown d8/d1a/d4d/da5 121 1 2024-04-20T10:54:46.152 INFO:tasks.workunit.client.0.smithi090.stdout:1/658: mknod d8/d1a/d4d/dc6/cd8 0 2024-04-20T10:54:46.152 INFO:tasks.workunit.client.0.smithi090.stdout:1/659: fsync d8/d1a/d1d/f27 0 2024-04-20T10:54:46.152 INFO:tasks.workunit.client.0.smithi090.stdout:1/660: fsync d8/d1a/d1d/d2c/d4a/d93/d5d/fc5 0 2024-04-20T10:54:46.154 INFO:tasks.workunit.client.0.smithi090.stdout:1/661: dread d8/d1a/d1d/d2c/d4a/d5a/f69 [0,4194304] 0 2024-04-20T10:54:46.154 INFO:tasks.workunit.client.0.smithi090.stdout:1/662: truncate d8/d1a/d1d/d67/f97 65972 0 2024-04-20T10:54:46.154 INFO:tasks.workunit.client.0.smithi090.stdout:1/663: rename d8/d1a/d1d/d2c/d4a/d5a/db2 to d8/d1a/d1d/d2c/d4a/d5a/db2/dd9 22 2024-04-20T10:54:46.154 INFO:tasks.workunit.client.0.smithi090.stdout:1/664: creat d8/d1a/d1d/d2c/d4a/d93/fda x:0 0 0 2024-04-20T10:54:46.155 INFO:tasks.workunit.client.0.smithi090.stdout:1/665: getdents d8/d1a/d1d/d2c/d4a/d93/dd2 0 2024-04-20T10:54:46.156 INFO:tasks.workunit.client.0.smithi090.stdout:1/666: mknod d8/d1a/d4d/da5/dad/cdb 0 2024-04-20T10:54:46.162 INFO:tasks.workunit.client.0.smithi090.stdout:8/538: dwrite d0/d3a/d4a/fa6 [0,4194304] 0 2024-04-20T10:54:46.162 INFO:tasks.workunit.client.0.smithi090.stdout:8/539: chown d0/dac 60 1 2024-04-20T10:54:46.180 INFO:tasks.workunit.client.0.smithi090.stdout:8/540: dwrite d0/d11/f31 [0,4194304] 0 2024-04-20T10:54:46.180 INFO:tasks.workunit.client.0.smithi090.stdout:8/541: truncate d0/d3a/d9f/f7f 801845 0 2024-04-20T10:54:46.180 INFO:tasks.workunit.client.0.smithi090.stdout:8/542: chown d0/d3a/d4a/f98 7 1 2024-04-20T10:54:46.180 INFO:tasks.workunit.client.0.smithi090.stdout:8/543: write d0/d11/d22/d53/f54 [731019,89612] 0 2024-04-20T10:54:46.196 INFO:tasks.workunit.client.0.smithi090.stdout:8/544: dwrite d0/d11/f31 [4194304,4194304] 0 2024-04-20T10:54:46.197 INFO:tasks.workunit.client.0.smithi090.stdout:8/545: mknod d0/d26/da7/da9/cb2 0 2024-04-20T10:54:46.197 INFO:tasks.workunit.client.0.smithi090.stdout:8/546: rmdir d0/d3a/d4a 39 2024-04-20T10:54:46.197 INFO:tasks.workunit.client.0.smithi090.stdout:8/547: dread - d0/d99/fb1 zero size 2024-04-20T10:54:46.198 INFO:tasks.workunit.client.0.smithi090.stdout:8/548: creat d0/d11/d22/fb3 x:0 0 0 2024-04-20T10:54:46.199 INFO:tasks.workunit.client.0.smithi090.stdout:8/549: rename d0/d26/f65 to d0/d11/d22/fb4 0 2024-04-20T10:54:46.201 INFO:tasks.workunit.client.0.smithi090.stdout:8/550: dread d0/d99/fa3 [0,4194304] 0 2024-04-20T10:54:46.202 INFO:tasks.workunit.client.0.smithi090.stdout:8/551: mknod d0/d2d/cb5 0 2024-04-20T10:54:46.280 INFO:tasks.workunit.client.0.smithi090.stdout:7/567: sync 2024-04-20T10:54:46.280 INFO:tasks.workunit.client.0.smithi090.stdout:6/465: sync 2024-04-20T10:54:46.281 INFO:tasks.workunit.client.0.smithi090.stdout:7/568: creat d11/d13/d23/fc5 x:0 0 0 2024-04-20T10:54:46.281 INFO:tasks.workunit.client.0.smithi090.stdout:7/569: write d11/d1a/d3f/fba [715076,91642] 0 2024-04-20T10:54:46.281 INFO:tasks.workunit.client.0.smithi090.stdout:7/570: chown d11/d13/d5d/fa8 1582639 1 2024-04-20T10:54:46.282 INFO:tasks.workunit.client.0.smithi090.stdout:7/571: fdatasync d11/d1a/f1b 0 2024-04-20T10:54:46.282 INFO:tasks.workunit.client.0.smithi090.stdout:6/466: unlink d1/d19/d36/d1e/f20 0 2024-04-20T10:54:46.282 INFO:tasks.workunit.client.0.smithi090.stdout:7/572: creat d11/d13/d33/d44/d89/fc6 x:0 0 0 2024-04-20T10:54:46.283 INFO:tasks.workunit.client.0.smithi090.stdout:6/467: getdents d1/d19/d25 0 2024-04-20T10:54:46.284 INFO:tasks.workunit.client.0.smithi090.stdout:8/552: read d0/d3a/f46 [337450,64605] 0 2024-04-20T10:54:46.284 INFO:tasks.workunit.client.0.smithi090.stdout:8/553: readlink d0/d2d/d49/la0 0 2024-04-20T10:54:46.284 INFO:tasks.workunit.client.0.smithi090.stdout:6/468: creat d1/d4/d26/f9e x:0 0 0 2024-04-20T10:54:46.285 INFO:tasks.workunit.client.0.smithi090.stdout:8/554: rename d0/d11/d22/fb4 to d0/d3a/d9f/d52/fb6 0 2024-04-20T10:54:46.285 INFO:tasks.workunit.client.0.smithi090.stdout:8/555: chown d0/d11/f97 0 1 2024-04-20T10:54:46.285 INFO:tasks.workunit.client.0.smithi090.stdout:8/556: read d0/d11/d22/f23 [1059115,77800] 0 2024-04-20T10:54:46.294 INFO:tasks.workunit.client.0.smithi090.stdout:8/557: dread d0/d2d/d49/d67/f69 [0,4194304] 0 2024-04-20T10:54:46.296 INFO:tasks.workunit.client.0.smithi090.stdout:6/469: mkdir d1/d19/d36/d1e/d1f/d3f/d54/d9f 0 2024-04-20T10:54:46.334 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:46.396 INFO:tasks.workunit.client.0.smithi090.stdout:3/536: sync 2024-04-20T10:54:46.396 INFO:tasks.workunit.client.0.smithi090.stdout:9/617: sync 2024-04-20T10:54:46.397 INFO:tasks.workunit.client.0.smithi090.stdout:3/537: dread d7/d15/d2a/d30/d48/f4f [0,4194304] 0 2024-04-20T10:54:46.397 INFO:tasks.workunit.client.0.smithi090.stdout:9/618: unlink d0/d29/d36/d63/d1c/d94/fab 0 2024-04-20T10:54:46.397 INFO:tasks.workunit.client.0.smithi090.stdout:3/538: creat d7/d15/d2a/d30/d93/fae x:0 0 0 2024-04-20T10:54:46.398 INFO:tasks.workunit.client.0.smithi090.stdout:9/619: creat d0/d29/d4f/d6b/fc8 x:0 0 0 2024-04-20T10:54:46.398 INFO:tasks.workunit.client.0.smithi090.stdout:9/620: stat d0 0 2024-04-20T10:54:46.399 INFO:tasks.workunit.client.0.smithi090.stdout:3/539: rename d7/d26/d5e/d88/da1 to d7/df/d2c/daf 0 2024-04-20T10:54:46.399 INFO:tasks.workunit.client.0.smithi090.stdout:9/621: symlink d0/d29/d36/d63/lc9 0 2024-04-20T10:54:46.400 INFO:tasks.workunit.client.0.smithi090.stdout:3/540: creat d7/d11/fb0 x:0 0 0 2024-04-20T10:54:46.401 INFO:tasks.workunit.client.0.smithi090.stdout:9/622: unlink d0/d29/d36/d63/d1f/d4d/c5b 0 2024-04-20T10:54:46.401 INFO:tasks.workunit.client.0.smithi090.stdout:3/541: dread d7/d15/d47/d56/f54 [0,4194304] 0 2024-04-20T10:54:46.401 INFO:tasks.workunit.client.0.smithi090.stdout:3/542: readlink d7/d26/d5e/la3 0 2024-04-20T10:54:46.402 INFO:tasks.workunit.client.0.smithi090.stdout:3/543: readlink d7/d15/d2a/d30/d93/d7f/l9d 0 2024-04-20T10:54:46.402 INFO:tasks.workunit.client.0.smithi090.stdout:3/544: chown d7/d26/d5e/d88/d8a 3097601 1 2024-04-20T10:54:46.402 INFO:tasks.workunit.client.0.smithi090.stdout:9/623: mkdir d0/d29/d36/d63/d1f/dca 0 2024-04-20T10:54:46.402 INFO:tasks.workunit.client.0.smithi090.stdout:9/624: fdatasync d0/d29/d36/d63/d1c/f2a 0 2024-04-20T10:54:46.403 INFO:tasks.workunit.client.0.smithi090.stdout:3/545: write d7/d11/f46 [395806,130389] 0 2024-04-20T10:54:46.403 INFO:tasks.workunit.client.0.smithi090.stdout:9/625: truncate d0/d29/d4f/f10 739160 0 2024-04-20T10:54:46.405 INFO:tasks.workunit.client.0.smithi090.stdout:9/626: mkdir d0/d29/d36/d63/d1c/d94/dcb 0 2024-04-20T10:54:46.405 INFO:tasks.workunit.client.0.smithi090.stdout:9/627: fdatasync d0/f11 0 2024-04-20T10:54:46.406 INFO:tasks.workunit.client.0.smithi090.stdout:9/628: mknod d0/d29/d4f/ccc 0 2024-04-20T10:54:46.407 INFO:tasks.workunit.client.0.smithi090.stdout:9/629: symlink d0/d29/d36/d63/d1f/dca/lcd 0 2024-04-20T10:54:46.408 INFO:tasks.workunit.client.0.smithi090.stdout:9/630: symlink d0/d29/d36/d63/d1c/d94/dcb/lce 0 2024-04-20T10:54:46.412 INFO:tasks.workunit.client.0.smithi090.stdout:9/631: rename d0/d29/d36/d63/c81 to d0/d29/d36/d63/d1c/d94/dcb/ccf 0 2024-04-20T10:54:46.412 INFO:tasks.workunit.client.0.smithi090.stdout:9/632: fdatasync d0/d9a/fc4 0 2024-04-20T10:54:46.413 INFO:tasks.workunit.client.0.smithi090.stdout:3/546: dread d7/d15/d2a/d30/d93/f74 [0,4194304] 0 2024-04-20T10:54:46.415 INFO:tasks.workunit.client.0.smithi090.stdout:3/547: dread d7/d11/f2f [0,4194304] 0 2024-04-20T10:54:46.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/548: creat d7/d15/d2a/d8d/fb1 x:0 0 0 2024-04-20T10:54:46.418 INFO:tasks.workunit.client.0.smithi090.stdout:3/549: rename d7/df/d2c/f6f to d7/d26/d5e/d88/fb2 0 2024-04-20T10:54:46.422 INFO:tasks.workunit.client.0.smithi090.stdout:9/633: write d0/d29/d36/d63/f14 [5399923,32734] 0 2024-04-20T10:54:46.423 INFO:tasks.workunit.client.0.smithi090.stdout:9/634: creat d0/d29/d36/d63/d1f/d79/fd0 x:0 0 0 2024-04-20T10:54:46.424 INFO:tasks.workunit.client.0.smithi090.stdout:9/635: mknod d0/d29/d4f/d23/daa/cd1 0 2024-04-20T10:54:46.425 INFO:tasks.workunit.client.0.smithi090.stdout:9/636: getdents d0/d29/d36/d63/d1f/d79/d7f 0 2024-04-20T10:54:46.426 INFO:tasks.workunit.client.0.smithi090.stdout:9/637: creat d0/d29/d36/d63/d1f/d79/d7f/fd2 x:0 0 0 2024-04-20T10:54:46.426 INFO:tasks.workunit.client.0.smithi090.stdout:9/638: fsync d0/d29/d36/d63/da1/fc7 0 2024-04-20T10:54:46.427 INFO:tasks.workunit.client.0.smithi090.stdout:9/639: creat d0/d29/d4f/fd3 x:0 0 0 2024-04-20T10:54:46.427 INFO:tasks.workunit.client.0.smithi090.stdout:9/640: chown d0/d86/f8f 46 1 2024-04-20T10:54:46.428 INFO:tasks.workunit.client.0.smithi090.stdout:9/641: unlink d0/f7e 0 2024-04-20T10:54:46.437 INFO:tasks.workunit.client.0.smithi090.stdout:3/550: dwrite d7/d26/d5e/d88/fb2 [0,4194304] 0 2024-04-20T10:54:46.445 INFO:tasks.workunit.client.0.smithi090.stdout:9/642: dwrite d0/d29/d4f/d6b/fba [0,4194304] 0 2024-04-20T10:54:46.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.447+0000 7f688cbb2640 1 Processor -- start 2024-04-20T10:54:46.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.447+0000 7f688cbb2640 1 -- start start 2024-04-20T10:54:46.447 INFO:tasks.workunit.client.0.smithi090.stdout:9/643: creat d0/d29/d4f/fd4 x:0 0 0 2024-04-20T10:54:46.448 INFO:tasks.workunit.client.0.smithi090.stdout:9/644: write d0/f4 [2597147,122772] 0 2024-04-20T10:54:46.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f688cbb2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f68880ad720 0x7f6888155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:46.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f688cbb2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f68880705c0 0x7f68880c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:46.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f688cbb2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f688806d450 con 0x7f688806e210 2024-04-20T10:54:46.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f688cbb2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f688806dd80 con 0x7f68880705c0 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f688cbb2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f688806d730 con 0x7f68880ad720 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f6886d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f68880705c0 0x7f68880c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f6886d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f68880705c0 0x7f68880c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36166/0 (socket says 172.21.15.90:36166) 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f6886d9d640 1 -- 172.21.15.90:0/1748352116 learned_addr learned my addr 172.21.15.90:0/1748352116 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.448+0000 7f688659c640 1 --2- 172.21.15.90:0/1748352116 >> v2:172.21.15.175:3300/0 conn(0x7f68880ad720 0x7f6888155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.449+0000 7f6886d9d640 1 -- 172.21.15.90:0/1748352116 >> v2:172.21.15.175:3300/0 conn(0x7f68880ad720 msgr2=0x7f6888155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.449+0000 7f6886d9d640 1 --2- 172.21.15.90:0/1748352116 >> v2:172.21.15.175:3300/0 conn(0x7f68880ad720 0x7f6888155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.449+0000 7f6886d9d640 1 -- 172.21.15.90:0/1748352116 >> v1:172.21.15.175:6789/0 conn(0x7f688806e210 legacy=0x7f6888073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:46.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.449+0000 7f6886d9d640 1 -- 172.21.15.90:0/1748352116 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688806da10 con 0x7f68880705c0 2024-04-20T10:54:46.451 INFO:tasks.workunit.client.0.smithi090.stdout:9/645: unlink d0/d29/d36/d63/d1f/d4d/l8e 0 2024-04-20T10:54:46.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.450+0000 7f6886d9d640 1 --2- 172.21.15.90:0/1748352116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880705c0 0x7f68880c3530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6888070110 tx=0x7f688002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1315ef953df116f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:46.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.450+0000 7f688559a640 1 -- 172.21.15.90:0/1748352116 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f688002ca80 con 0x7f68880705c0 2024-04-20T10:54:46.451 INFO:tasks.workunit.client.0.smithi090.stdout:9/646: symlink d0/d29/d4f/ld5 0 2024-04-20T10:54:46.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.450+0000 7f688559a640 1 -- 172.21.15.90:0/1748352116 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688002cc20 con 0x7f68880705c0 2024-04-20T10:54:46.453 INFO:tasks.workunit.client.0.smithi090.stdout:9/647: dread - d0/d29/d4f/d23/daa/fc3 zero size 2024-04-20T10:54:46.453 INFO:tasks.workunit.client.0.smithi090.stdout:9/648: readlink d0/d29/l87 0 2024-04-20T10:54:46.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.450+0000 7f688559a640 1 -- 172.21.15.90:0/1748352116 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800343f0 con 0x7f68880705c0 2024-04-20T10:54:46.454 INFO:tasks.workunit.client.0.smithi090.stdout:9/649: fsync d0/d29/d36/d63/f13 0 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 -- 172.21.15.90:0/1748352116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880705c0 msgr2=0x7f68880c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 --2- 172.21.15.90:0/1748352116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880705c0 0x7f68880c3530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f6888070110 tx=0x7f688002bee0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 -- 172.21.15.90:0/1748352116 shutdown_connections 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 --2- 172.21.15.90:0/1748352116 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f68880705c0 0x7f68880c3530 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 --2- 172.21.15.90:0/1748352116 >> v2:172.21.15.175:3300/0 conn(0x7f68880ad720 0x7f6888155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 -- 172.21.15.90:0/1748352116 >> 172.21.15.90:0/1748352116 conn(0x7f68880c8080 msgr2=0x7f68880c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 -- 172.21.15.90:0/1748352116 shutdown_connections 2024-04-20T10:54:46.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.451+0000 7f688cbb2640 1 -- 172.21.15.90:0/1748352116 wait complete. 2024-04-20T10:54:46.456 INFO:tasks.workunit.client.0.smithi090.stdout:9/650: creat d0/d29/d36/d63/d1f/d79/fd6 x:0 0 0 2024-04-20T10:54:46.456 INFO:tasks.workunit.client.0.smithi090.stdout:9/651: write d0/d29/d36/f6d [2841575,113805] 0 2024-04-20T10:54:46.456 INFO:tasks.workunit.client.0.smithi090.stdout:9/652: creat d0/d29/d4f/fd7 x:0 0 0 2024-04-20T10:54:46.456 INFO:tasks.workunit.client.0.smithi090.stdout:9/653: chown d0/d29/d36/d63/d1f/d4d/fb2 267802002 1 2024-04-20T10:54:46.457 INFO:tasks.workunit.client.0.smithi090.stdout:9/654: fdatasync d0/d29/d36/d63/d1f/d79/fd0 0 2024-04-20T10:54:46.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 Processor -- start 2024-04-20T10:54:46.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 -- start start 2024-04-20T10:54:46.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f688806e210 0x7f68880c7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:46.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68880705c0 0x7f68881ebd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:46.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68880ad720 0x7f68881ec260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:46.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6888073b40 con 0x7f688806e210 2024-04-20T10:54:46.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6888070b30 con 0x7f68880ad720 2024-04-20T10:54:46.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688cbb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f688814dbb0 con 0x7f68880705c0 2024-04-20T10:54:46.458 INFO:tasks.workunit.client.0.smithi090.stdout:9/655: creat d0/d29/d36/d63/d1f/dca/fd8 x:0 0 0 2024-04-20T10:54:46.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f688806e210 0x7f68880c7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:46.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688659c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f688806e210 0x7f68880c7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36170/0 (socket says 172.21.15.90:36170) 2024-04-20T10:54:46.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f688659c640 1 -- 172.21.15.90:0/734597470 learned_addr learned my addr 172.21.15.90:0/734597470 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:46.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f6885d9b640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68880705c0 0x7f68881ebd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:46.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.453+0000 7f6886d9d640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68880ad720 0x7f68881ec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:46.460 INFO:tasks.workunit.client.0.smithi090.stdout:3/551: dwrite d7/d15/d2a/d30/d93/f74 [4194304,4194304] 0 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6886d9d640 1 -- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68880705c0 msgr2=0x7f68881ebd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6886d9d640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68880705c0 0x7f68881ebd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6886d9d640 1 -- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f688806e210 msgr2=0x7f68880c7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6886d9d640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f688806e210 0x7f68880c7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6886d9d640 1 -- 172.21.15.90:0/734597470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68881dec90 con 0x7f68880ad720 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6886d9d640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68880ad720 0x7f68881ec260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6888074600 tx=0x7f6880004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6876ffd640 1 -- 172.21.15.90:0/734597470 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880043020 con 0x7f68880ad720 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6876ffd640 1 -- 172.21.15.90:0/734597470 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f688003e450 con 0x7f68880ad720 2024-04-20T10:54:46.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68881efb20 con 0x7f68880ad720 2024-04-20T10:54:46.462 INFO:tasks.workunit.client.0.smithi090.stdout:9/656: symlink d0/d29/d36/d63/d1c/d94/dcb/ld9 0 2024-04-20T10:54:46.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f6876ffd640 1 -- 172.21.15.90:0/734597470 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880009510 con 0x7f68880ad720 2024-04-20T10:54:46.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.454+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68880ac420 con 0x7f68880ad720 2024-04-20T10:54:46.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.456+0000 7f6876ffd640 1 -- 172.21.15.90:0/734597470 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6880046020 con 0x7f68880ad720 2024-04-20T10:54:46.463 INFO:tasks.workunit.client.0.smithi090.stdout:1/667: sync 2024-04-20T10:54:46.463 INFO:tasks.workunit.client.0.smithi090.stdout:4/549: sync 2024-04-20T10:54:46.463 INFO:tasks.workunit.client.0.smithi090.stdout:5/759: sync 2024-04-20T10:54:46.463 INFO:tasks.workunit.client.0.smithi090.stdout:8/558: sync 2024-04-20T10:54:46.463 INFO:tasks.workunit.client.0.smithi090.stdout:2/585: sync 2024-04-20T10:54:46.463 INFO:tasks.workunit.client.0.smithi090.stdout:4/550: truncate d7/d9/f62 4990801 0 2024-04-20T10:54:46.464 INFO:tasks.workunit.client.0.smithi090.stdout:4/551: chown d7/d9/d17/f90 0 1 2024-04-20T10:54:46.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.456+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6888076150 con 0x7f68880ad720 2024-04-20T10:54:46.464 INFO:tasks.workunit.client.0.smithi090.stdout:0/561: sync 2024-04-20T10:54:46.464 INFO:tasks.workunit.client.0.smithi090.stdout:0/562: fdatasync d14/f21 0 2024-04-20T10:54:46.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.457+0000 7f6876ffd640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f686806c8f0 0x7f686806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:46.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.457+0000 7f6876ffd640 1 -- 172.21.15.90:0/734597470 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f68800ae600 con 0x7f68880ad720 2024-04-20T10:54:46.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.457+0000 7f688659c640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f686806c8f0 0x7f686806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:46.466 INFO:tasks.workunit.client.0.smithi090.stdout:3/552: truncate d7/d15/f9a 992246 0 2024-04-20T10:54:46.466 INFO:tasks.workunit.client.0.smithi090.stdout:1/668: mknod d8/d1a/d1d/d7a/cdc 0 2024-04-20T10:54:46.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.458+0000 7f688659c640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f686806c8f0 0x7f686806edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f68880ac740 tx=0x7f6878009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:46.466 INFO:tasks.workunit.client.0.smithi090.stdout:8/559: unlink d0/d11/d22/d53/d8e/l91 0 2024-04-20T10:54:46.467 INFO:tasks.workunit.client.0.smithi090.stdout:5/760: mknod d1/d2f/d3d/d40/d70/d103/c104 0 2024-04-20T10:54:46.467 INFO:tasks.workunit.client.0.smithi090.stdout:5/761: fsync d1/da/f1e 0 2024-04-20T10:54:46.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.461+0000 7f6876ffd640 1 -- 172.21.15.90:0/734597470 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f688004d030 con 0x7f68880ad720 2024-04-20T10:54:46.468 INFO:tasks.workunit.client.0.smithi090.stdout:2/586: mkdir d11/d1f/d2e/d6e/dc7 0 2024-04-20T10:54:46.468 INFO:tasks.workunit.client.0.smithi090.stdout:2/587: chown d11/d1a/d4a/f53 231329 1 2024-04-20T10:54:46.468 INFO:tasks.workunit.client.0.smithi090.stdout:4/552: creat d7/d9/d47/d8d/fab x:0 0 0 2024-04-20T10:54:46.468 INFO:tasks.workunit.client.0.smithi090.stdout:3/553: creat d7/d11/fb3 x:0 0 0 2024-04-20T10:54:46.468 INFO:tasks.workunit.client.0.smithi090.stdout:3/554: chown d7/d11/l9f 879 1 2024-04-20T10:54:46.468 INFO:tasks.workunit.client.0.smithi090.stdout:0/563: write d14/f1f [2540298,15719] 0 2024-04-20T10:54:46.469 INFO:tasks.workunit.client.0.smithi090.stdout:1/669: truncate d8/d1a/d1d/d2c/d3f/f87 1241922 0 2024-04-20T10:54:46.470 INFO:tasks.workunit.client.0.smithi090.stdout:6/470: sync 2024-04-20T10:54:46.470 INFO:tasks.workunit.client.0.smithi090.stdout:6/471: dread - d1/d19/d25/f78 zero size 2024-04-20T10:54:46.470 INFO:tasks.workunit.client.0.smithi090.stdout:8/560: creat d0/d26/da7/da9/fb7 x:0 0 0 2024-04-20T10:54:46.470 INFO:tasks.workunit.client.0.smithi090.stdout:8/561: fdatasync d0/d11/d22/d53/d57/fa4 0 2024-04-20T10:54:46.471 INFO:tasks.workunit.client.0.smithi090.stdout:5/762: symlink d1/d55/l105 0 2024-04-20T10:54:46.476 INFO:tasks.workunit.client.0.smithi090.stdout:4/553: symlink d7/d9/lac 0 2024-04-20T10:54:46.479 INFO:tasks.workunit.client.0.smithi090.stdout:0/564: rename d14/l29 to d14/d19/d2b/d8e/d43/d5c/d70/lb7 0 2024-04-20T10:54:46.479 INFO:tasks.workunit.client.0.smithi090.stdout:7/573: read d11/d13/d22/d24/f2a [128145,22565] 0 2024-04-20T10:54:46.480 INFO:tasks.workunit.client.0.smithi090.stdout:1/670: symlink d8/d1a/d1d/d2c/d4a/ldd 0 2024-04-20T10:54:46.482 INFO:tasks.workunit.client.0.smithi090.stdout:6/472: mknod d1/d19/ca0 0 2024-04-20T10:54:46.483 INFO:tasks.workunit.client.0.smithi090.stdout:2/588: getdents d11/d1f/d2e/d6e 0 2024-04-20T10:54:46.483 INFO:tasks.workunit.client.0.smithi090.stdout:1/671: dread d8/d1a/d1d/d7a/d9a/f4b [0,4194304] 0 2024-04-20T10:54:46.483 INFO:tasks.workunit.client.0.smithi090.stdout:1/672: readlink d8/d1a/d1d/d7a/db0/lc3 0 2024-04-20T10:54:46.484 INFO:tasks.workunit.client.0.smithi090.stdout:8/562: creat d0/d3a/d4a/fb8 x:0 0 0 2024-04-20T10:54:46.485 INFO:tasks.workunit.client.0.smithi090.stdout:5/763: creat d1/da/d14/dda/f106 x:0 0 0 2024-04-20T10:54:46.485 INFO:tasks.workunit.client.0.smithi090.stdout:5/764: chown d1/da/c67 2011 1 2024-04-20T10:54:46.487 INFO:tasks.workunit.client.0.smithi090.stdout:4/554: symlink d7/d9/d47/d63/d42/d8f/lad 0 2024-04-20T10:54:46.487 INFO:tasks.workunit.client.0.smithi090.stdout:4/555: readlink d7/d9/d47/l99 0 2024-04-20T10:54:46.489 INFO:tasks.workunit.client.0.smithi090.stdout:9/657: dwrite d0/d29/d36/d63/d1f/d34/f43 [4194304,4194304] 0 2024-04-20T10:54:46.489 INFO:tasks.workunit.client.0.smithi090.stdout:3/555: dwrite d7/d43/f75 [0,4194304] 0 2024-04-20T10:54:46.490 INFO:tasks.workunit.client.0.smithi090.stdout:3/556: truncate d7/d35/f4b 112872 0 2024-04-20T10:54:46.490 INFO:tasks.workunit.client.0.smithi090.stdout:3/557: chown d7/d15/d2a/d30/d48/l72 433963063 1 2024-04-20T10:54:46.490 INFO:tasks.workunit.client.0.smithi090.stdout:7/574: write d11/d13/f8c [3153290,42056] 0 2024-04-20T10:54:46.490 INFO:tasks.workunit.client.0.smithi090.stdout:0/565: symlink d14/d19/d2b/d61/lb8 0 2024-04-20T10:54:46.490 INFO:tasks.workunit.client.0.smithi090.stdout:0/566: stat d14/d19/d2b/d8e/d40/l53 0 2024-04-20T10:54:46.494 INFO:tasks.workunit.client.0.smithi090.stdout:2/589: write d11/d1f/d2e/dad/fba [2754389,24313] 0 2024-04-20T10:54:46.502 INFO:tasks.workunit.client.0.smithi090.stdout:0/567: dread d14/d19/d2b/d52/dab/f75 [0,4194304] 0 2024-04-20T10:54:46.509 INFO:tasks.workunit.client.0.smithi090.stdout:3/558: dwrite d7/d15/d47/d56/fac [0,4194304] 0 2024-04-20T10:54:46.527 INFO:tasks.workunit.client.0.smithi090.stdout:3/559: dwrite d7/d15/d2a/f67 [0,4194304] 0 2024-04-20T10:54:46.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.690+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6888072250 con 0x7f68880ad720 2024-04-20T10:54:46.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.691+0000 7f6876ffd640 1 -- 172.21.15.90:0/734597470 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7f688007bed0 con 0x7f68880ad720 2024-04-20T10:54:46.691 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:46.691 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:46.691 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:46.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f686806c8f0 msgr2=0x7f686806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:46.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f686806c8f0 0x7f686806edb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f68880ac740 tx=0x7f6878009190 comp rx=0 tx=0).stop 2024-04-20T10:54:46.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68880ad720 msgr2=0x7f68881ec260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:46.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68880ad720 0x7f68881ec260 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6888074600 tx=0x7f6880004a40 comp rx=0 tx=0).stop 2024-04-20T10:54:46.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 shutdown_connections 2024-04-20T10:54:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f686806c8f0 0x7f686806edb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f68880ad720 0x7f68881ec260 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f68880705c0 0x7f68881ebd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 --2- 172.21.15.90:0/734597470 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f688806e210 0x7f68880c7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 >> 172.21.15.90:0/734597470 conn(0x7f68880c8080 msgr2=0x7f68880732f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 shutdown_connections 2024-04-20T10:54:46.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:46.693+0000 7f688cbb2640 1 -- 172.21.15.90:0/734597470 wait complete. 2024-04-20T10:54:46.704 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:46.714 INFO:tasks.workunit.client.0.smithi090.stdout:6/473: dwrite d1/d19/d36/d28/f2a [0,4194304] 0 2024-04-20T10:54:46.743 INFO:tasks.workunit.client.0.smithi090.stdout:1/673: stat d8/d1a/d1d/d2c/d4a/d93/l43 0 2024-04-20T10:54:46.743 INFO:tasks.workunit.client.0.smithi090.stdout:8/563: getdents d0/d2d 0 2024-04-20T10:54:46.743 INFO:tasks.workunit.client.0.smithi090.stdout:1/674: write d8/d1a/d1d/d2c/f64 [5476863,87206] 0 2024-04-20T10:54:46.743 INFO:tasks.workunit.client.0.smithi090.stdout:5/765: creat d1/da/d14/dc0/f107 x:0 0 0 2024-04-20T10:54:46.743 INFO:tasks.workunit.client.0.smithi090.stdout:5/766: chown d1/de/dcf 53 1 2024-04-20T10:54:46.743 INFO:tasks.workunit.client.0.smithi090.stdout:4/556: symlink d7/d9/d17/d56/d66/d70/da1/lae 0 2024-04-20T10:54:46.743 INFO:tasks.workunit.client.0.smithi090.stdout:9/658: mknod d0/d29/d4f/d23/daa/cda 0 2024-04-20T10:54:46.744 INFO:tasks.workunit.client.0.smithi090.stdout:7/575: mkdir d11/d13/d33/d44/d89/d98/dc7 0 2024-04-20T10:54:46.744 INFO:tasks.workunit.client.0.smithi090.stdout:0/568: mknod d14/d19/d2b/d52/d55/d5b/d8a/cb9 0 2024-04-20T10:54:46.744 INFO:tasks.workunit.client.0.smithi090.stdout:0/569: fdatasync d14/d41/fb5 0 2024-04-20T10:54:46.746 INFO:tasks.workunit.client.0.smithi090.stdout:3/560: creat d7/d15/d47/fb4 x:0 0 0 2024-04-20T10:54:46.748 INFO:tasks.workunit.client.0.smithi090.stdout:6/474: creat d1/d19/d36/d28/fa1 x:0 0 0 2024-04-20T10:54:46.750 INFO:tasks.workunit.client.0.smithi090.stdout:8/564: getdents d0 0 2024-04-20T10:54:46.750 INFO:tasks.workunit.client.0.smithi090.stdout:8/565: chown d0/d11/l5b 15 1 2024-04-20T10:54:46.751 INFO:tasks.workunit.client.0.smithi090.stdout:5/767: rmdir d1/d2f/d3d/d40/d6c 39 2024-04-20T10:54:46.751 INFO:tasks.workunit.client.0.smithi090.stdout:5/768: stat d1/d2f/df2 0 2024-04-20T10:54:46.753 INFO:tasks.workunit.client.0.smithi090.stdout:9/659: creat d0/d86/fdb x:0 0 0 2024-04-20T10:54:46.754 INFO:tasks.workunit.client.0.smithi090.stdout:6/475: dread d1/d4/d26/d11/d35/f5f [0,4194304] 0 2024-04-20T10:54:46.754 INFO:tasks.workunit.client.0.smithi090.stdout:6/476: truncate d1/d4/d26/d11/d35/d80/f9c 680393 0 2024-04-20T10:54:46.754 INFO:tasks.workunit.client.0.smithi090.stdout:4/557: symlink d7/d9/d47/d63/laf 0 2024-04-20T10:54:46.754 INFO:tasks.workunit.client.0.smithi090.stdout:4/558: chown d7/c2e 20 1 2024-04-20T10:54:46.756 INFO:tasks.workunit.client.0.smithi090.stdout:7/576: mkdir d11/d1a/d3b/dc8 0 2024-04-20T10:54:46.758 INFO:tasks.workunit.client.0.smithi090.stdout:0/570: rmdir d14/daa 0 2024-04-20T10:54:46.759 INFO:tasks.workunit.client.0.smithi090.stdout:3/561: creat d7/d11/fb5 x:0 0 0 2024-04-20T10:54:46.760 INFO:tasks.workunit.client.0.smithi090.stdout:8/566: mkdir d0/d3a/d9f/db9 0 2024-04-20T10:54:46.762 INFO:tasks.workunit.client.0.smithi090.stdout:5/769: symlink d1/de/d75/l108 0 2024-04-20T10:54:46.762 INFO:tasks.workunit.client.0.smithi090.stdout:5/770: fsync d1/da/d14/d47/d50/ff9 0 2024-04-20T10:54:46.762 INFO:tasks.workunit.client.0.smithi090.stdout:5/771: truncate d1/d2f/fc4 487450 0 2024-04-20T10:54:46.763 INFO:tasks.workunit.client.0.smithi090.stdout:6/477: truncate d1/d19/f1a 970623 0 2024-04-20T10:54:46.765 INFO:tasks.workunit.client.0.smithi090.stdout:0/571: link c1 d14/d19/d2b/d52/d55/d5b/d7f/cba 0 2024-04-20T10:54:46.765 INFO:tasks.workunit.client.0.smithi090.stdout:0/572: chown d14/d19/d2b/d8e/c4c 206917 1 2024-04-20T10:54:46.765 INFO:tasks.workunit.client.0.smithi090.stdout:0/573: fdatasync d14/d19/d2b/d52/d55/d5b/d7f/fa2 0 2024-04-20T10:54:46.765 INFO:tasks.workunit.client.0.smithi090.stdout:0/574: fdatasync d14/d19/d2b/d61/fa5 0 2024-04-20T10:54:46.765 INFO:tasks.workunit.client.0.smithi090.stdout:0/575: chown d14/d19/d2b/d52/d55/d5b/d7f/f90 450559 1 2024-04-20T10:54:46.766 INFO:tasks.workunit.client.0.smithi090.stdout:4/559: write d7/d9/f6d [585522,73387] 0 2024-04-20T10:54:46.766 INFO:tasks.workunit.client.0.smithi090.stdout:4/560: write d7/d9/d17/f3f [1038300,95281] 0 2024-04-20T10:54:46.766 INFO:tasks.workunit.client.0.smithi090.stdout:3/562: rmdir d7/d15/d2a/da2/da5 0 2024-04-20T10:54:46.767 INFO:tasks.workunit.client.0.smithi090.stdout:8/567: creat d0/d3a/d9f/d52/fba x:0 0 0 2024-04-20T10:54:46.769 INFO:tasks.workunit.client.0.smithi090.stdout:5/772: link d1/d41/d98/d101/c102 d1/da/dce/c109 0 2024-04-20T10:54:46.769 INFO:tasks.workunit.client.0.smithi090.stdout:5/773: write d1/de/f20 [2292,78599] 0 2024-04-20T10:54:46.769 INFO:tasks.workunit.client.0.smithi090.stdout:5/774: dread - d1/da/d14/d47/d50/ff9 zero size 2024-04-20T10:54:46.770 INFO:tasks.workunit.client.0.smithi090.stdout:9/660: rmdir d0/d29/d36/d63/d1f/d4d 39 2024-04-20T10:54:46.771 INFO:tasks.workunit.client.0.smithi090.stdout:0/576: mkdir d14/d19/d2b/d61/da0/db1/dbb 0 2024-04-20T10:54:46.773 INFO:tasks.workunit.client.0.smithi090.stdout:3/563: rmdir d7/d35 39 2024-04-20T10:54:46.774 INFO:tasks.workunit.client.0.smithi090.stdout:7/577: dwrite d11/d13/d23/f2b [0,4194304] 0 2024-04-20T10:54:46.774 INFO:tasks.workunit.client.0.smithi090.stdout:7/578: write d11/d1a/fbe [1147525,97444] 0 2024-04-20T10:54:46.775 INFO:tasks.workunit.client.0.smithi090.stdout:8/568: rmdir d0/d11/d22/d53 39 2024-04-20T10:54:46.775 INFO:tasks.workunit.client.0.smithi090.stdout:8/569: readlink d0/d11/d22/l9b 0 2024-04-20T10:54:46.777 INFO:tasks.workunit.client.0.smithi090.stdout:9/661: mkdir d0/d29/d4f/ddc 0 2024-04-20T10:54:46.777 INFO:tasks.workunit.client.0.smithi090.stdout:9/662: stat d0/d29/d36/d63/d1f/d34/d70/d52/lbf 0 2024-04-20T10:54:46.777 INFO:tasks.workunit.client.0.smithi090.stdout:9/663: write d0/d29/d4f/fd4 [880847,69404] 0 2024-04-20T10:54:46.777 INFO:tasks.workunit.client.0.smithi090.stdout:9/664: write d0/d29/d36/d63/d1f/d79/f75 [1853337,26883] 0 2024-04-20T10:54:46.780 INFO:tasks.workunit.client.0.smithi090.stdout:8/570: dread d0/d3a/d9f/f2b [0,4194304] 0 2024-04-20T10:54:46.787 INFO:tasks.workunit.client.0.smithi090.stdout:4/561: dwrite d7/d9/d47/f6f [0,4194304] 0 2024-04-20T10:54:46.792 INFO:tasks.workunit.client.0.smithi090.stdout:6/478: dwrite d1/d19/d25/f78 [0,4194304] 0 2024-04-20T10:54:46.794 INFO:tasks.workunit.client.0.smithi090.stdout:7/579: dwrite d11/d13/d5b/fb6 [0,4194304] 0 2024-04-20T10:54:47.031 INFO:tasks.workunit.client.0.smithi090.stdout:0/577: creat d14/d19/d2b/d8e/d40/fbc x:0 0 0 2024-04-20T10:54:47.031 INFO:tasks.workunit.client.0.smithi090.stdout:3/564: rename d7/c53 to d7/d15/d2a/d8d/cb6 0 2024-04-20T10:54:47.031 INFO:tasks.workunit.client.0.smithi090.stdout:0/578: dread - d14/d19/d31/d34/d3b/f9c zero size 2024-04-20T10:54:47.031 INFO:tasks.workunit.client.0.smithi090.stdout:5/775: mknod d1/d2f/d3d/d40/c10a 0 2024-04-20T10:54:47.031 INFO:tasks.workunit.client.0.smithi090.stdout:9/665: mkdir d0/d29/d36/d63/d1f/ddd 0 2024-04-20T10:54:47.031 INFO:tasks.workunit.client.0.smithi090.stdout:1/675: truncate d8/d1a/d1d/d2c/f64 335758 0 2024-04-20T10:54:47.032 INFO:tasks.workunit.client.0.smithi090.stdout:8/571: creat d0/d26/da7/fbb x:0 0 0 2024-04-20T10:54:47.032 INFO:tasks.workunit.client.0.smithi090.stdout:4/562: mknod d7/d9/d47/d63/d42/cb0 0 2024-04-20T10:54:47.034 INFO:tasks.workunit.client.0.smithi090.stdout:6/479: link d1/d19/d25/c45 d1/d4/d26/d11/d4a/d70/ca2 0 2024-04-20T10:54:47.037 INFO:tasks.workunit.client.0.smithi090.stdout:7/580: mkdir d11/d13/d22/d27/dc2/dc9 0 2024-04-20T10:54:47.037 INFO:tasks.workunit.client.0.smithi090.stdout:4/563: dread d7/f7d [0,4194304] 0 2024-04-20T10:54:47.039 INFO:tasks.workunit.client.0.smithi090.stdout:3/565: getdents d7/d26/d78 0 2024-04-20T10:54:47.040 INFO:tasks.workunit.client.0.smithi090.stdout:0/579: mkdir d14/d19/d2b/d52/d55/d5b/dbd 0 2024-04-20T10:54:47.040 INFO:tasks.workunit.client.0.smithi090.stdout:0/580: write d14/d19/d2b/d52/d55/d5b/d7f/fb4 [888037,59639] 0 2024-04-20T10:54:47.042 INFO:tasks.workunit.client.0.smithi090.stdout:5/776: mknod d1/da/d14/d47/c10b 0 2024-04-20T10:54:47.044 INFO:tasks.workunit.client.0.smithi090.stdout:9/666: rename d0/d29/d36/d63/d1f/dca/lcd to d0/d29/d36/d63/d1f/d34/d70/d52/lde 0 2024-04-20T10:54:47.044 INFO:tasks.workunit.client.0.smithi090.stdout:9/667: write d0/d29/d4f/fd7 [543565,75876] 0 2024-04-20T10:54:47.045 INFO:tasks.workunit.client.0.smithi090.stdout:1/676: mkdir d8/d1a/d1d/d2c/d6e/dde 0 2024-04-20T10:54:47.047 INFO:tasks.workunit.client.0.smithi090.stdout:8/572: symlink d0/d11/d22/d53/d57/lbc 0 2024-04-20T10:54:47.047 INFO:tasks.workunit.client.0.smithi090.stdout:8/573: readlink d0/d3a/d9f/l19 0 2024-04-20T10:54:47.047 INFO:tasks.workunit.client.0.smithi090.stdout:8/574: chown d0/d2d/d49/cae 142435 1 2024-04-20T10:54:47.047 INFO:tasks.workunit.client.0.smithi090.stdout:8/575: truncate d0/f63 5078330 0 2024-04-20T10:54:47.047 INFO:tasks.workunit.client.0.smithi090.stdout:6/480: chown d1/d4/c12 85 1 2024-04-20T10:54:47.056 INFO:tasks.workunit.client.0.smithi090.stdout:2/590: dread d11/d1a/d37/f77 [0,4194304] 0 2024-04-20T10:54:47.056 INFO:tasks.workunit.client.0.smithi090.stdout:2/591: truncate d11/d1a/d4a/f53 529763 0 2024-04-20T10:54:47.058 INFO:tasks.workunit.client.0.smithi090.stdout:6/481: link d1/d4/d26/d11/d35/f8c d1/d19/fa3 0 2024-04-20T10:54:47.058 INFO:tasks.workunit.client.0.smithi090.stdout:6/482: chown d1/d4/d26/f4d 115397 1 2024-04-20T10:54:47.059 INFO:tasks.workunit.client.0.smithi090.stdout:6/483: readlink d1/d4/d26/d11/l8f 0 2024-04-20T10:54:47.059 INFO:tasks.workunit.client.0.smithi090.stdout:8/576: write d0/d3a/d4a/fa6 [514034,130670] 0 2024-04-20T10:54:47.060 INFO:tasks.workunit.client.0.smithi090.stdout:2/592: symlink d11/d1a/d4a/d55/d67/lc8 0 2024-04-20T10:54:47.061 INFO:tasks.workunit.client.0.smithi090.stdout:2/593: write d11/d1f/f75 [655785,53587] 0 2024-04-20T10:54:47.061 INFO:tasks.workunit.client.0.smithi090.stdout:2/594: write d11/d1a/d4a/d55/d67/fb4 [905509,36431] 0 2024-04-20T10:54:47.061 INFO:tasks.workunit.client.0.smithi090.stdout:2/595: readlink d11/d1a/d4a/d55/d67/lc8 0 2024-04-20T10:54:47.061 INFO:tasks.workunit.client.0.smithi090.stdout:6/484: rmdir d1/d4/d26/d11/d35/d80 39 2024-04-20T10:54:47.063 INFO:tasks.workunit.client.0.smithi090.stdout:2/596: unlink d11/d1a/d4a/d55/f6d 0 2024-04-20T10:54:47.063 INFO:tasks.workunit.client.0.smithi090.stdout:2/597: stat d11/d1a/d4a/d55/d67 0 2024-04-20T10:54:47.064 INFO:tasks.workunit.client.0.smithi090.stdout:8/577: dread d0/f79 [0,4194304] 0 2024-04-20T10:54:47.064 INFO:tasks.workunit.client.0.smithi090.stdout:8/578: dread - d0/d3a/d4a/fb8 zero size 2024-04-20T10:54:47.065 INFO:tasks.workunit.client.0.smithi090.stdout:6/485: mknod d1/d4/d26/d11/d4a/ca4 0 2024-04-20T10:54:47.066 INFO:tasks.workunit.client.0.smithi090.stdout:2/598: mkdir d11/d1f/d2e/d6e/dc9 0 2024-04-20T10:54:47.066 INFO:tasks.workunit.client.0.smithi090.stdout:2/599: readlink d11/d1f/d2e/l5a 0 2024-04-20T10:54:47.066 INFO:tasks.workunit.client.0.smithi090.stdout:6/486: mknod d1/d10/ca5 0 2024-04-20T10:54:47.067 INFO:tasks.workunit.client.0.smithi090.stdout:2/600: creat d11/d1a/d37/d85/d87/fca x:0 0 0 2024-04-20T10:54:47.068 INFO:tasks.workunit.client.0.smithi090.stdout:6/487: creat d1/d4/d26/d11/d35/fa6 x:0 0 0 2024-04-20T10:54:47.068 INFO:tasks.workunit.client.0.smithi090.stdout:2/601: mknod d11/d1f/d2e/d6e/dc9/ccb 0 2024-04-20T10:54:47.069 INFO:tasks.workunit.client.0.smithi090.stdout:6/488: symlink d1/d19/d36/la7 0 2024-04-20T10:54:47.070 INFO:tasks.workunit.client.0.smithi090.stdout:6/489: fsync d1/d19/d36/d1e/d1f/d3f/f96 0 2024-04-20T10:54:47.070 INFO:tasks.workunit.client.0.smithi090.stdout:6/490: chown d1/d4/d26/d11/d35/d80/f9c 1070557 1 2024-04-20T10:54:47.070 INFO:tasks.workunit.client.0.smithi090.stdout:2/602: getdents d11/d1a/d37/d85 0 2024-04-20T10:54:47.071 INFO:tasks.workunit.client.0.smithi090.stdout:2/603: write d11/d1a/d2b/f35 [4617676,103777] 0 2024-04-20T10:54:47.071 INFO:tasks.workunit.client.0.smithi090.stdout:0/581: dwrite d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:47.072 INFO:tasks.workunit.client.0.smithi090.stdout:1/677: dwrite d8/d1a/d1d/f27 [0,4194304] 0 2024-04-20T10:54:47.073 INFO:tasks.workunit.client.0.smithi090.stdout:1/678: dread - d8/d1a/d1d/d2c/d4a/d93/fd7 zero size 2024-04-20T10:54:47.073 INFO:tasks.workunit.client.0.smithi090.stdout:6/491: creat d1/d4/d26/d11/d4a/d6b/fa8 x:0 0 0 2024-04-20T10:54:47.074 INFO:tasks.workunit.client.0.smithi090.stdout:0/582: creat d14/d19/d2b/d52/d55/d5b/fbe x:0 0 0 2024-04-20T10:54:47.078 INFO:tasks.workunit.client.0.smithi090.stdout:1/679: write d8/d1a/d1d/d2c/d3f/f87 [517745,667] 0 2024-04-20T10:54:47.079 INFO:tasks.workunit.client.0.smithi090.stdout:8/579: dwrite d0/d11/d22/d53/f75 [0,4194304] 0 2024-04-20T10:54:47.082 INFO:tasks.workunit.client.0.smithi090.stdout:6/492: mkdir d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9 0 2024-04-20T10:54:47.096 INFO:tasks.workunit.client.0.smithi090.stdout:8/580: dwrite d0/d11/d22/d53/d57/f61 [0,4194304] 0 2024-04-20T10:54:47.096 INFO:tasks.workunit.client.0.smithi090.stdout:6/493: creat d1/d4/faa x:0 0 0 2024-04-20T10:54:47.098 INFO:tasks.workunit.client.0.smithi090.stdout:8/581: rmdir d0/d3a/d4a/d81 39 2024-04-20T10:54:47.214 INFO:tasks.workunit.client.0.smithi090.stdout:6/494: unlink d1/d4/d26/f4d 0 2024-04-20T10:54:47.215 INFO:tasks.workunit.client.0.smithi090.stdout:6/495: stat d1/d10/f39 0 2024-04-20T10:54:47.215 INFO:tasks.workunit.client.0.smithi090.stdout:6/496: dread - d1/d4/d26/d11/d35/fa6 zero size 2024-04-20T10:54:47.222 INFO:tasks.workunit.client.0.smithi090.stdout:4/564: rename d7/d9/d17/f2b to d7/d9/d47/fb1 0 2024-04-20T10:54:47.223 INFO:tasks.workunit.client.0.smithi090.stdout:6/497: creat d1/d19/d36/d1e/fab x:0 0 0 2024-04-20T10:54:47.223 INFO:tasks.workunit.client.0.smithi090.stdout:6/498: chown d1/d19/f59 0 1 2024-04-20T10:54:47.224 INFO:tasks.workunit.client.0.smithi090.stdout:3/566: rename d7/df/d2c to d7/d43/db7 0 2024-04-20T10:54:47.224 INFO:tasks.workunit.client.0.smithi090.stdout:3/567: write d7/d11/fb5 [949068,82934] 0 2024-04-20T10:54:47.224 INFO:tasks.workunit.client.0.smithi090.stdout:4/565: creat d7/d9/d47/d63/d3d/fb2 x:0 0 0 2024-04-20T10:54:47.225 INFO:tasks.workunit.client.0.smithi090.stdout:5/777: rename d1/d2f/d3d/d40/d70 to d1/d2f/d85/dbd/d10c 0 2024-04-20T10:54:47.226 INFO:tasks.workunit.client.0.smithi090.stdout:3/568: creat d7/d26/d78/fb8 x:0 0 0 2024-04-20T10:54:47.227 INFO:tasks.workunit.client.0.smithi090.stdout:9/668: rename d0/d9a/fc4 to d0/d29/d36/d63/d1f/ddd/fdf 0 2024-04-20T10:54:47.229 INFO:tasks.workunit.client.0.smithi090.stdout:9/669: mkdir d0/d29/d4f/de0 0 2024-04-20T10:54:47.230 INFO:tasks.workunit.client.0.smithi090.stdout:2/604: rename d11/d1a/d4a/d55/d67/lc8 to d11/d97/lcc 0 2024-04-20T10:54:47.231 INFO:tasks.workunit.client.0.smithi090.stdout:5/778: symlink d1/de/l10d 0 2024-04-20T10:54:47.233 INFO:tasks.workunit.client.0.smithi090.stdout:0/583: rename d14/d19/d2b/d52/d55/d5b/d7f/f90 to d14/d19/d2b/d52/dab/fbf 0 2024-04-20T10:54:47.234 INFO:tasks.workunit.client.0.smithi090.stdout:5/779: dread d1/de/d96/fa5 [0,4194304] 0 2024-04-20T10:54:47.234 INFO:tasks.workunit.client.0.smithi090.stdout:2/605: mkdir d11/d1f/d2e/dcd 0 2024-04-20T10:54:47.235 INFO:tasks.workunit.client.0.smithi090.stdout:5/780: truncate d1/d41/d98/ff0 390377 0 2024-04-20T10:54:47.235 INFO:tasks.workunit.client.0.smithi090.stdout:2/606: write fd [3381758,57256] 0 2024-04-20T10:54:47.236 INFO:tasks.workunit.client.0.smithi090.stdout:8/582: rename d0/f17 to d0/d3a/d9f/db9/fbd 0 2024-04-20T10:54:47.238 INFO:tasks.workunit.client.0.smithi090.stdout:0/584: symlink d14/d19/d2b/d52/d55/lc0 0 2024-04-20T10:54:47.238 INFO:tasks.workunit.client.0.smithi090.stdout:0/585: chown d14/d39/da6 211759505 1 2024-04-20T10:54:47.238 INFO:tasks.workunit.client.0.smithi090.stdout:0/586: read - d14/d41/fb5 zero size 2024-04-20T10:54:47.239 INFO:tasks.workunit.client.0.smithi090.stdout:2/607: dread d11/d1a/d4a/d59/f5c [0,4194304] 0 2024-04-20T10:54:47.240 INFO:tasks.workunit.client.0.smithi090.stdout:8/583: mkdir d0/d3a/d9f/db9/dbe 0 2024-04-20T10:54:47.240 INFO:tasks.workunit.client.0.smithi090.stdout:8/584: truncate d0/d11/d22/d53/d8e/fb0 628112 0 2024-04-20T10:54:47.240 INFO:tasks.workunit.client.0.smithi090.stdout:8/585: dread d0/d11/d22/d53/d8e/fb0 [0,4194304] 0 2024-04-20T10:54:47.242 INFO:tasks.workunit.client.0.smithi090.stdout:2/608: unlink d11/d1a/d37/laf 0 2024-04-20T10:54:47.245 INFO:tasks.workunit.client.0.smithi090.stdout:8/586: link d0/l13 d0/d26/lbf 0 2024-04-20T10:54:47.245 INFO:tasks.workunit.client.0.smithi090.stdout:8/587: stat d0/f63 0 2024-04-20T10:54:47.245 INFO:tasks.workunit.client.0.smithi090.stdout:2/609: rmdir d11/d1f/d2e/d6e 39 2024-04-20T10:54:47.246 INFO:tasks.workunit.client.0.smithi090.stdout:4/566: dread d7/f2c [0,4194304] 0 2024-04-20T10:54:47.247 INFO:tasks.workunit.client.0.smithi090.stdout:8/588: creat d0/d3a/d9f/fc0 x:0 0 0 2024-04-20T10:54:47.248 INFO:tasks.workunit.client.0.smithi090.stdout:2/610: dread d11/f1c [0,4194304] 0 2024-04-20T10:54:47.248 INFO:tasks.workunit.client.0.smithi090.stdout:2/611: write d11/d1a/d2b/f84 [235765,1493] 0 2024-04-20T10:54:47.248 INFO:tasks.workunit.client.0.smithi090.stdout:2/612: stat d11/d1a/d37/fc5 0 2024-04-20T10:54:47.249 INFO:tasks.workunit.client.0.smithi090.stdout:2/613: mknod d11/d1a/d4a/d80/cce 0 2024-04-20T10:54:47.251 INFO:tasks.workunit.client.0.smithi090.stdout:3/569: dwrite d7/d43/f45 [0,4194304] 0 2024-04-20T10:54:47.253 INFO:tasks.workunit.client.0.smithi090.stdout:3/570: creat d7/d15/d47/d56/fb9 x:0 0 0 2024-04-20T10:54:47.257 INFO:tasks.workunit.client.0.smithi090.stdout:5/781: dwrite d1/da/d1f/f97 [0,4194304] 0 2024-04-20T10:54:47.259 INFO:tasks.workunit.client.0.smithi090.stdout:5/782: dread d1/d2f/fc4 [0,4194304] 0 2024-04-20T10:54:47.259 INFO:tasks.workunit.client.0.smithi090.stdout:5/783: fdatasync d1/de/d75/fbe 0 2024-04-20T10:54:47.260 INFO:tasks.workunit.client.0.smithi090.stdout:6/499: dwrite d1/d19/d36/d1e/d1f/d3f/d54/f62 [0,4194304] 0 2024-04-20T10:54:47.260 INFO:tasks.workunit.client.0.smithi090.stdout:8/589: write d0/d11/d22/d53/d57/f7d [192488,53135] 0 2024-04-20T10:54:47.263 INFO:tasks.workunit.client.0.smithi090.stdout:6/500: creat d1/d4/d26/d11/d35/d80/fac x:0 0 0 2024-04-20T10:54:47.263 INFO:tasks.workunit.client.0.smithi090.stdout:6/501: dread - d1/d4/d26/d11/d35/fa6 zero size 2024-04-20T10:54:47.263 INFO:tasks.workunit.client.0.smithi090.stdout:6/502: readlink d1/d19/d36/d1e/d1f/d3f/d54/l95 0 2024-04-20T10:54:47.263 INFO:tasks.workunit.client.0.smithi090.stdout:6/503: write d1/d19/d36/f91 [2543351,2542] 0 2024-04-20T10:54:47.266 INFO:tasks.workunit.client.0.smithi090.stdout:8/590: creat d0/d3a/d9f/db9/fc1 x:0 0 0 2024-04-20T10:54:47.266 INFO:tasks.workunit.client.0.smithi090.stdout:8/591: read d0/d3a/d4a/fa6 [4190388,53861] 0 2024-04-20T10:54:47.269 INFO:tasks.workunit.client.0.smithi090.stdout:6/504: mkdir d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad 0 2024-04-20T10:54:47.270 INFO:tasks.workunit.client.0.smithi090.stdout:6/505: unlink d1/d19/d25/c45 0 2024-04-20T10:54:47.272 INFO:tasks.workunit.client.0.smithi090.stdout:9/670: dwrite d0/d29/d36/d63/f13 [0,4194304] 0 2024-04-20T10:54:47.272 INFO:tasks.workunit.client.0.smithi090.stdout:9/671: fsync d0/d29/d36/d63/d1c/fb0 0 2024-04-20T10:54:47.272 INFO:tasks.workunit.client.0.smithi090.stdout:9/672: write d0/d29/d4f/fd4 [1599125,75572] 0 2024-04-20T10:54:47.274 INFO:tasks.workunit.client.0.smithi090.stdout:9/673: creat d0/d29/d36/d63/d1f/dca/fe1 x:0 0 0 2024-04-20T10:54:47.275 INFO:tasks.workunit.client.0.smithi090.stdout:9/674: rmdir d0/d29/d36/d63/d1f/ddd 39 2024-04-20T10:54:47.277 INFO:tasks.workunit.client.0.smithi090.stdout:9/675: unlink d0/d29/d4f/ccc 0 2024-04-20T10:54:47.277 INFO:tasks.workunit.client.0.smithi090.stdout:9/676: write d0/d29/d36/d63/d1c/f83 [1479649,12673] 0 2024-04-20T10:54:47.278 INFO:tasks.workunit.client.0.smithi090.stdout:9/677: creat d0/d29/d36/d63/d1f/d79/d7f/fe2 x:0 0 0 2024-04-20T10:54:47.278 INFO:tasks.workunit.client.0.smithi090.stdout:9/678: write d0/ff [2391653,40353] 0 2024-04-20T10:54:47.283 INFO:tasks.workunit.client.0.smithi090.stdout:8/592: dwrite d0/d2d/f30 [0,4194304] 0 2024-04-20T10:54:47.285 INFO:tasks.workunit.client.0.smithi090.stdout:8/593: link d0/d26/f78 d0/dac/fc2 0 2024-04-20T10:54:47.286 INFO:tasks.workunit.client.0.smithi090.stdout:8/594: stat d0/d11/f97 0 2024-04-20T10:54:47.286 INFO:tasks.workunit.client.0.smithi090.stdout:2/614: dwrite d11/d1a/d2b/f84 [0,4194304] 0 2024-04-20T10:54:47.288 INFO:tasks.workunit.client.0.smithi090.stdout:8/595: symlink d0/d3a/d9f/db9/dbe/lc3 0 2024-04-20T10:54:47.290 INFO:tasks.workunit.client.0.smithi090.stdout:0/587: getdents d14/d19/d2b/d52/dab 0 2024-04-20T10:54:47.290 INFO:tasks.workunit.client.0.smithi090.stdout:0/588: write d14/d19/d2b/d8e/f8c [153515,105487] 0 2024-04-20T10:54:47.290 INFO:tasks.workunit.client.0.smithi090.stdout:0/589: readlink d14/d19/d2b/d8e/d43/d5c/d70/lb7 0 2024-04-20T10:54:47.291 INFO:tasks.workunit.client.0.smithi090.stdout:0/590: link d14/d19/d2b/f83 d14/d19/d2b/d52/d55/fc1 0 2024-04-20T10:54:47.293 INFO:tasks.workunit.client.0.smithi090.stdout:2/615: dread d11/d1a/f2d [0,4194304] 0 2024-04-20T10:54:47.293 INFO:tasks.workunit.client.0.smithi090.stdout:0/591: symlink d14/d19/d2b/d52/d55/d5b/lc2 0 2024-04-20T10:54:47.294 INFO:tasks.workunit.client.0.smithi090.stdout:2/616: creat d11/d1f/d2e/d6e/dc9/fcf x:0 0 0 2024-04-20T10:54:47.295 INFO:tasks.workunit.client.0.smithi090.stdout:2/617: creat d11/d1a/d4a/d55/d67/fd0 x:0 0 0 2024-04-20T10:54:47.297 INFO:tasks.workunit.client.0.smithi090.stdout:2/618: rename d11/d1a/d30/l82 to d11/d1f/d2e/d6e/dc9/ld1 0 2024-04-20T10:54:47.297 INFO:tasks.workunit.client.0.smithi090.stdout:2/619: readlink d11/db0/lb6 0 2024-04-20T10:54:47.299 INFO:tasks.workunit.client.0.smithi090.stdout:2/620: symlink d11/d1f/d2e/d6e/ld2 0 2024-04-20T10:54:47.299 INFO:tasks.workunit.client.0.smithi090.stdout:2/621: stat d11/d1a/d37/d85/d87/fca 0 2024-04-20T10:54:47.299 INFO:tasks.workunit.client.0.smithi090.stdout:8/596: write d0/d2d/f30 [3079127,113533] 0 2024-04-20T10:54:47.299 INFO:tasks.workunit.client.0.smithi090.stdout:8/597: fsync d0/d2d/f93 0 2024-04-20T10:54:47.299 INFO:tasks.workunit.client.0.smithi090.stdout:2/622: creat d11/d1f/d2e/d6e/dc7/fd3 x:0 0 0 2024-04-20T10:54:47.300 INFO:tasks.workunit.client.0.smithi090.stdout:8/598: creat d0/d2d/d49/d67/fc4 x:0 0 0 2024-04-20T10:54:47.301 INFO:tasks.workunit.client.0.smithi090.stdout:2/623: symlink d11/d1a/ld4 0 2024-04-20T10:54:47.301 INFO:tasks.workunit.client.0.smithi090.stdout:2/624: chown d11/d1f/d2e/f5d 1845 1 2024-04-20T10:54:47.301 INFO:tasks.workunit.client.0.smithi090.stdout:2/625: chown d11/d1f/d2e/f4d 129625 1 2024-04-20T10:54:47.301 INFO:tasks.workunit.client.0.smithi090.stdout:2/626: chown d11/d1a/ld4 612 1 2024-04-20T10:54:47.301 INFO:tasks.workunit.client.0.smithi090.stdout:8/599: unlink d0/d11/d22/d53/d57/fa4 0 2024-04-20T10:54:47.302 INFO:tasks.workunit.client.0.smithi090.stdout:2/627: mknod d11/d97/cd5 0 2024-04-20T10:54:47.303 INFO:tasks.workunit.client.0.smithi090.stdout:6/506: dwrite d1/d4/d26/d11/d35/f5f [0,4194304] 0 2024-04-20T10:54:47.303 INFO:tasks.workunit.client.0.smithi090.stdout:8/600: link d0/ca d0/d11/d22/d53/cc5 0 2024-04-20T10:54:47.304 INFO:tasks.workunit.client.0.smithi090.stdout:8/601: chown d0/d3a/d9f/c96 1743 1 2024-04-20T10:54:47.304 INFO:tasks.workunit.client.0.smithi090.stdout:6/507: write d1/d19/f57 [481323,31557] 0 2024-04-20T10:54:47.304 INFO:tasks.workunit.client.0.smithi090.stdout:9/679: dwrite d0/d29/d36/d63/d1c/f3e [0,4194304] 0 2024-04-20T10:54:47.304 INFO:tasks.workunit.client.0.smithi090.stdout:2/628: symlink d11/d1a/d2b/ld6 0 2024-04-20T10:54:47.304 INFO:tasks.workunit.client.0.smithi090.stdout:8/602: mknod d0/d3a/d9f/d52/cc6 0 2024-04-20T10:54:47.304 INFO:tasks.workunit.client.0.smithi090.stdout:8/603: write d0/d3a/d4a/f9d [1560201,4498] 0 2024-04-20T10:54:47.305 INFO:tasks.workunit.client.0.smithi090.stdout:6/508: creat d1/d19/d36/d28/fae x:0 0 0 2024-04-20T10:54:47.306 INFO:tasks.workunit.client.0.smithi090.stdout:9/680: mknod d0/d29/d4f/ddc/ce3 0 2024-04-20T10:54:47.307 INFO:tasks.workunit.client.0.smithi090.stdout:0/592: dread d14/d41/f7d [0,4194304] 0 2024-04-20T10:54:47.308 INFO:tasks.workunit.client.0.smithi090.stdout:0/593: chown d14/d19/d2b/d52/d55/d5b/d7f/f87 0 1 2024-04-20T10:54:47.308 INFO:tasks.workunit.client.0.smithi090.stdout:0/594: dread - d14/d19/d31/d34/fa8 zero size 2024-04-20T10:54:47.308 INFO:tasks.workunit.client.0.smithi090.stdout:8/604: rename d0/d2d/d44/l71 to d0/lc7 0 2024-04-20T10:54:47.309 INFO:tasks.workunit.client.0.smithi090.stdout:9/681: creat d0/d29/d36/d63/d1f/d34/d70/db8/fe4 x:0 0 0 2024-04-20T10:54:47.310 INFO:tasks.workunit.client.0.smithi090.stdout:8/605: creat d0/d2d/d44/fc8 x:0 0 0 2024-04-20T10:54:47.311 INFO:tasks.workunit.client.0.smithi090.stdout:9/682: unlink d0/d29/d4f/d6b/fc8 0 2024-04-20T10:54:47.311 INFO:tasks.workunit.client.0.smithi090.stdout:9/683: write d0/fa6 [379901,5858] 0 2024-04-20T10:54:47.312 INFO:tasks.workunit.client.0.smithi090.stdout:8/606: mknod d0/d3a/d9f/cc9 0 2024-04-20T10:54:47.315 INFO:tasks.workunit.client.0.smithi090.stdout:9/684: unlink d0/f8b 0 2024-04-20T10:54:47.317 INFO:tasks.workunit.client.0.smithi090.stdout:0/595: write d14/f5f [3107140,28207] 0 2024-04-20T10:54:47.319 INFO:tasks.workunit.client.0.smithi090.stdout:9/685: dread d0/d29/d36/d63/d1c/f2a [4194304,4194304] 0 2024-04-20T10:54:47.320 INFO:tasks.workunit.client.0.smithi090.stdout:0/596: rename d14/d19/c27 to d14/d19/d2b/d8e/d40/cc3 0 2024-04-20T10:54:47.320 INFO:tasks.workunit.client.0.smithi090.stdout:0/597: chown c7 2058085 1 2024-04-20T10:54:47.321 INFO:tasks.workunit.client.0.smithi090.stdout:8/607: read d0/d26/f85 [3562855,37478] 0 2024-04-20T10:54:47.322 INFO:tasks.workunit.client.0.smithi090.stdout:8/608: creat d0/d11/d22/d53/fca x:0 0 0 2024-04-20T10:54:47.325 INFO:tasks.workunit.client.0.smithi090.stdout:8/609: rename d0/d11/d22/c59 to d0/d3a/d4a/d81/ccb 0 2024-04-20T10:54:47.325 INFO:tasks.workunit.client.0.smithi090.stdout:8/610: creat d0/d3a/daa/fcc x:0 0 0 2024-04-20T10:54:47.327 INFO:tasks.workunit.client.0.smithi090.stdout:2/629: dwrite d11/d1f/f75 [0,4194304] 0 2024-04-20T10:54:47.328 INFO:tasks.workunit.client.0.smithi090.stdout:2/630: chown d11/c40 22591209 1 2024-04-20T10:54:47.328 INFO:tasks.workunit.client.0.smithi090.stdout:6/509: dwrite d1/d4/d26/d11/d35/d80/fac [0,4194304] 0 2024-04-20T10:54:47.328 INFO:tasks.workunit.client.0.smithi090.stdout:6/510: fdatasync d1/d4/d26/d11/d4a/d56/f61 0 2024-04-20T10:54:47.332 INFO:tasks.workunit.client.0.smithi090.stdout:2/631: creat d11/d1f/d2e/d6e/dc9/fd7 x:0 0 0 2024-04-20T10:54:47.333 INFO:tasks.workunit.client.0.smithi090.stdout:2/632: chown d11/d1a/d30/l68 7575682 1 2024-04-20T10:54:47.333 INFO:tasks.workunit.client.0.smithi090.stdout:2/633: chown d11/d1a/l63 33571 1 2024-04-20T10:54:47.334 INFO:tasks.workunit.client.0.smithi090.stdout:8/611: write d0/d3a/d9f/f7c [4025528,12702] 0 2024-04-20T10:54:47.336 INFO:tasks.workunit.client.0.smithi090.stdout:2/634: unlink d11/d1f/d2e/f3b 0 2024-04-20T10:54:47.336 INFO:tasks.workunit.client.0.smithi090.stdout:2/635: write d11/d1a/d4a/f8c [974791,26222] 0 2024-04-20T10:54:47.337 INFO:tasks.workunit.client.0.smithi090.stdout:8/612: symlink d0/d11/d22/d53/lcd 0 2024-04-20T10:54:47.337 INFO:tasks.workunit.client.0.smithi090.stdout:8/613: chown d0/d26/da7/da9 1 1 2024-04-20T10:54:47.337 INFO:tasks.workunit.client.0.smithi090.stdout:2/636: mknod d11/d1f/d2e/cd8 0 2024-04-20T10:54:47.338 INFO:tasks.workunit.client.0.smithi090.stdout:2/637: symlink d11/d97/ld9 0 2024-04-20T10:54:47.338 INFO:tasks.workunit.client.0.smithi090.stdout:2/638: chown d11/c40 999 1 2024-04-20T10:54:47.342 INFO:tasks.workunit.client.0.smithi090.stdout:9/686: dwrite d0/d29/d36/d63/d1f/d34/fb6 [0,4194304] 0 2024-04-20T10:54:47.343 INFO:tasks.workunit.client.0.smithi090.stdout:0/598: dwrite d14/d19/d2b/d8e/d43/f9a [0,4194304] 0 2024-04-20T10:54:47.347 INFO:tasks.workunit.client.0.smithi090.stdout:9/687: mkdir d0/d29/d4f/d23/de5 0 2024-04-20T10:54:47.350 INFO:tasks.workunit.client.0.smithi090.stdout:0/599: mknod d14/d39/da6/cc4 0 2024-04-20T10:54:47.350 INFO:tasks.workunit.client.0.smithi090.stdout:0/600: write d14/f4b [148047,124377] 0 2024-04-20T10:54:47.351 INFO:tasks.workunit.client.0.smithi090.stdout:9/688: creat d0/d29/d36/fe6 x:0 0 0 2024-04-20T10:54:47.353 INFO:tasks.workunit.client.0.smithi090.stdout:9/689: creat d0/d9a/fe7 x:0 0 0 2024-04-20T10:54:47.355 INFO:tasks.workunit.client.0.smithi090.stdout:8/614: dwrite d0/d3a/d4a/f95 [0,4194304] 0 2024-04-20T10:54:47.359 INFO:tasks.workunit.client.0.smithi090.stdout:8/615: creat d0/d3a/d9f/db9/dbe/fce x:0 0 0 2024-04-20T10:54:47.359 INFO:tasks.workunit.client.0.smithi090.stdout:8/616: write d0/d3a/d9f/d52/f9a [4905605,30128] 0 2024-04-20T10:54:47.359 INFO:tasks.workunit.client.0.smithi090.stdout:8/617: chown d0/d3a/d9f/db9/fc1 698180249 1 2024-04-20T10:54:47.359 INFO:tasks.workunit.client.0.smithi090.stdout:8/618: chown d0/l13 4522 1 2024-04-20T10:54:47.359 INFO:tasks.workunit.client.0.smithi090.stdout:0/601: dread fe [0,4194304] 0 2024-04-20T10:54:47.360 INFO:tasks.workunit.client.0.smithi090.stdout:8/619: fdatasync d0/d3a/d9f/f7c 0 2024-04-20T10:54:47.364 INFO:tasks.workunit.client.0.smithi090.stdout:9/690: dread d0/d29/f6e [0,4194304] 0 2024-04-20T10:54:47.372 INFO:tasks.workunit.client.0.smithi090.stdout:9/691: write d0/d29/d4f/d6b/fba [2562151,113029] 0 2024-04-20T10:54:47.372 INFO:tasks.workunit.client.0.smithi090.stdout:9/692: write d0/f11 [4438808,52847] 0 2024-04-20T10:54:47.373 INFO:tasks.workunit.client.0.smithi090.stdout:8/620: write d0/d11/f31 [3491843,127775] 0 2024-04-20T10:54:47.373 INFO:tasks.workunit.client.0.smithi090.stdout:9/693: symlink d0/d29/d36/d63/d1c/d94/dcb/le8 0 2024-04-20T10:54:47.374 INFO:tasks.workunit.client.0.smithi090.stdout:8/621: mkdir d0/dac/dcf 0 2024-04-20T10:54:47.382 INFO:tasks.workunit.client.0.smithi090.stdout:9/694: dread d0/d29/d36/d63/fb7 [8388608,4194304] 0 2024-04-20T10:54:47.382 INFO:tasks.workunit.client.0.smithi090.stdout:0/602: dwrite d14/f80 [0,4194304] 0 2024-04-20T10:54:47.385 INFO:tasks.workunit.client.0.smithi090.stdout:8/622: dread d0/d11/d22/f34 [0,4194304] 0 2024-04-20T10:54:47.387 INFO:tasks.workunit.client.0.smithi090.stdout:9/695: creat d0/d29/d36/d63/d1f/d79/d9b/fe9 x:0 0 0 2024-04-20T10:54:47.389 INFO:tasks.workunit.client.0.smithi090.stdout:8/623: rename d0/l8c to d0/d2d/ld0 0 2024-04-20T10:54:47.391 INFO:tasks.workunit.client.0.smithi090.stdout:9/696: creat d0/d29/d4f/d82/fea x:0 0 0 2024-04-20T10:54:47.392 INFO:tasks.workunit.client.0.smithi090.stdout:8/624: mknod d0/d3a/daa/cd1 0 2024-04-20T10:54:47.394 INFO:tasks.workunit.client.0.smithi090.stdout:9/697: link d0/d29/d36/d63/d1f/fa2 d0/d29/d4f/d23/feb 0 2024-04-20T10:54:47.406 INFO:tasks.workunit.client.0.smithi090.stdout:9/698: read d0/d29/d36/d63/d1f/fa2 [3971491,24945] 0 2024-04-20T10:54:47.407 INFO:tasks.workunit.client.0.smithi090.stdout:2/639: dwrite d11/d1a/d4a/f53 [0,4194304] 0 2024-04-20T10:54:47.407 INFO:tasks.workunit.client.0.smithi090.stdout:2/640: dread d11/d1a/f1b [0,4194304] 0 2024-04-20T10:54:47.408 INFO:tasks.workunit.client.0.smithi090.stdout:9/699: creat d0/d29/d4f/d23/fec x:0 0 0 2024-04-20T10:54:47.410 INFO:tasks.workunit.client.0.smithi090.stdout:0/603: dwrite d14/f22 [0,4194304] 0 2024-04-20T10:54:47.410 INFO:tasks.workunit.client.0.smithi090.stdout:0/604: fsync d14/d19/d31/f38 0 2024-04-20T10:54:47.410 INFO:tasks.workunit.client.0.smithi090.stdout:0/605: fsync d14/d19/d2b/d61/fa5 0 2024-04-20T10:54:47.662 INFO:tasks.workunit.client.0.smithi090.stdout:2/641: getdents d11/d1f/d2e/d6e/dc9 0 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:9/700: stat d0/d29/c55 0 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:2/642: fsync d11/d1a/d30/f9d 0 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:2/643: stat d11/d1a/d30/c70 0 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:2/644: write d11/d1f/d2e/d6e/f7c [611111,19413] 0 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:8/625: getdents d0/d3a/daa 0 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:8/626: chown d0/d11/d22/f23 1 1 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:8/627: creat d0/fd2 x:0 0 0 2024-04-20T10:54:47.663 INFO:tasks.workunit.client.0.smithi090.stdout:2/645: read d11/f16 [665010,76784] 0 2024-04-20T10:54:47.664 INFO:tasks.workunit.client.0.smithi090.stdout:0/606: symlink d14/lc5 0 2024-04-20T10:54:47.664 INFO:tasks.workunit.client.0.smithi090.stdout:0/607: write d14/d19/d31/d34/d3b/f74 [540995,12384] 0 2024-04-20T10:54:47.664 INFO:tasks.workunit.client.0.smithi090.stdout:0/608: chown d14/d19/d2b/d8e/f4f 29358 1 2024-04-20T10:54:47.664 INFO:tasks.workunit.client.0.smithi090.stdout:8/628: mkdir d0/d11/d22/d53/d57/dd3 0 2024-04-20T10:54:47.665 INFO:tasks.workunit.client.0.smithi090.stdout:2/646: symlink d11/d1a/d4a/lda 0 2024-04-20T10:54:47.665 INFO:tasks.workunit.client.0.smithi090.stdout:2/647: chown d11/d1a/d30/f90 8058 1 2024-04-20T10:54:47.666 INFO:tasks.workunit.client.0.smithi090.stdout:2/648: rename d11/d1a/d37/c6a to d11/d1a/d4a/d55/d67/cdb 0 2024-04-20T10:54:47.667 INFO:tasks.workunit.client.0.smithi090.stdout:0/609: truncate f0 3115568 0 2024-04-20T10:54:47.669 INFO:tasks.workunit.client.0.smithi090.stdout:2/649: unlink d11/c9e 0 2024-04-20T10:54:47.669 INFO:tasks.workunit.client.0.smithi090.stdout:2/650: fdatasync d11/d1f/d2e/f33 0 2024-04-20T10:54:47.669 INFO:tasks.workunit.client.0.smithi090.stdout:2/651: chown d11/d1a/c2a 461 1 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:7/581: sync 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:5/784: sync 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:4/567: sync 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:3/571: sync 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:6/511: sync 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:1/680: sync 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:6/512: write d1/d19/f57 [801902,64877] 0 2024-04-20T10:54:47.671 INFO:tasks.workunit.client.0.smithi090.stdout:0/610: symlink d14/d19/d2b/d52/d55/d5b/d7f/lc6 0 2024-04-20T10:54:47.674 INFO:tasks.workunit.client.0.smithi090.stdout:5/785: unlink d1/d2f/d3d/d40/l72 0 2024-04-20T10:54:47.675 INFO:tasks.workunit.client.0.smithi090.stdout:3/572: dread d7/d35/f4b [0,4194304] 0 2024-04-20T10:54:47.675 INFO:tasks.workunit.client.0.smithi090.stdout:3/573: chown d7/d35/f9c 1893 1 2024-04-20T10:54:47.676 INFO:tasks.workunit.client.0.smithi090.stdout:4/568: mkdir d7/d9/d17/d56/d66/d70/da5/db3 0 2024-04-20T10:54:47.677 INFO:tasks.workunit.client.0.smithi090.stdout:6/513: mkdir d1/d19/d36/d1e/d1f/d3f/d54/daf 0 2024-04-20T10:54:47.678 INFO:tasks.workunit.client.0.smithi090.stdout:0/611: mknod d14/d19/d2b/d8e/d43/d5c/d70/d9b/cc7 0 2024-04-20T10:54:47.681 INFO:tasks.workunit.client.0.smithi090.stdout:5/786: rename d1/da/f1e to d1/da/f10e 0 2024-04-20T10:54:47.682 INFO:tasks.workunit.client.0.smithi090.stdout:1/681: dread d8/fd [8388608,4194304] 0 2024-04-20T10:54:47.682 INFO:tasks.workunit.client.0.smithi090.stdout:3/574: creat d7/d15/d2a/d8d/fba x:0 0 0 2024-04-20T10:54:47.682 INFO:tasks.workunit.client.0.smithi090.stdout:3/575: fdatasync d7/d15/f8c 0 2024-04-20T10:54:47.682 INFO:tasks.workunit.client.0.smithi090.stdout:3/576: write d7/d15/f25 [1062042,15775] 0 2024-04-20T10:54:47.683 INFO:tasks.workunit.client.0.smithi090.stdout:3/577: write d7/d15/f8f [848656,56244] 0 2024-04-20T10:54:47.685 INFO:tasks.workunit.client.0.smithi090.stdout:4/569: mknod d7/d9/d47/d63/d42/d8f/da2/cb4 0 2024-04-20T10:54:47.685 INFO:tasks.workunit.client.0.smithi090.stdout:4/570: read d7/d9/d17/f58 [4051963,73457] 0 2024-04-20T10:54:47.685 INFO:tasks.workunit.client.0.smithi090.stdout:7/582: write d11/fb1 [541659,128186] 0 2024-04-20T10:54:47.686 INFO:tasks.workunit.client.0.smithi090.stdout:6/514: unlink d1/d19/d36/l9d 0 2024-04-20T10:54:47.686 INFO:tasks.workunit.client.0.smithi090.stdout:6/515: write d1/d19/f2d [1568154,119812] 0 2024-04-20T10:54:47.687 INFO:tasks.workunit.client.0.smithi090.stdout:0/612: fdatasync d14/d19/d2b/f3e 0 2024-04-20T10:54:47.691 INFO:tasks.workunit.client.0.smithi090.stdout:3/578: write d7/f3d [3034308,98214] 0 2024-04-20T10:54:47.691 INFO:tasks.workunit.client.0.smithi090.stdout:3/579: read - d7/d11/fb3 zero size 2024-04-20T10:54:47.694 INFO:tasks.workunit.client.0.smithi090.stdout:8/629: dwrite d0/d2d/d49/faf [0,4194304] 0 2024-04-20T10:54:47.694 INFO:tasks.workunit.client.0.smithi090.stdout:5/787: creat d1/da/d1f/dad/f10f x:0 0 0 2024-04-20T10:54:47.694 INFO:tasks.workunit.client.0.smithi090.stdout:1/682: link d8/lc0 d8/d1a/d4d/dc6/ldf 0 2024-04-20T10:54:47.694 INFO:tasks.workunit.client.0.smithi090.stdout:4/571: mkdir d7/d9/d47/d63/d3d/d9e/db5 0 2024-04-20T10:54:47.695 INFO:tasks.workunit.client.0.smithi090.stdout:4/572: truncate d7/d9/f20 1067390 0 2024-04-20T10:54:47.695 INFO:tasks.workunit.client.0.smithi090.stdout:5/788: write d1/da/f10e [533260,86324] 0 2024-04-20T10:54:47.695 INFO:tasks.workunit.client.0.smithi090.stdout:7/583: dread d11/d13/d22/d24/f69 [0,4194304] 0 2024-04-20T10:54:47.695 INFO:tasks.workunit.client.0.smithi090.stdout:0/613: symlink d14/d19/lc8 0 2024-04-20T10:54:47.696 INFO:tasks.workunit.client.0.smithi090.stdout:2/652: dwrite fd [4194304,4194304] 0 2024-04-20T10:54:47.696 INFO:tasks.workunit.client.0.smithi090.stdout:2/653: truncate d11/fbe 273146 0 2024-04-20T10:54:47.697 INFO:tasks.workunit.client.0.smithi090.stdout:3/580: creat d7/d26/fbb x:0 0 0 2024-04-20T10:54:47.697 INFO:tasks.workunit.client.0.smithi090.stdout:4/573: dread d7/d9/d17/d56/f8c [0,4194304] 0 2024-04-20T10:54:47.699 INFO:tasks.workunit.client.0.smithi090.stdout:8/630: mkdir d0/d2d/dd4 0 2024-04-20T10:54:47.703 INFO:tasks.workunit.client.0.smithi090.stdout:7/584: creat d11/d13/d22/d27/fca x:0 0 0 2024-04-20T10:54:47.704 INFO:tasks.workunit.client.0.smithi090.stdout:7/585: write d11/d13/d33/d44/d89/fc6 [872290,21805] 0 2024-04-20T10:54:47.704 INFO:tasks.workunit.client.0.smithi090.stdout:7/586: dread - d11/d13/d5b/db8/dbf/da9/fb9 zero size 2024-04-20T10:54:47.704 INFO:tasks.workunit.client.0.smithi090.stdout:1/683: creat d8/d1a/d1d/d2c/fe0 x:0 0 0 2024-04-20T10:54:47.704 INFO:tasks.workunit.client.0.smithi090.stdout:1/684: write d8/d1a/f3b [3162016,54788] 0 2024-04-20T10:54:47.705 INFO:tasks.workunit.client.0.smithi090.stdout:0/614: truncate d14/d19/d2b/d8e/f92 4056236 0 2024-04-20T10:54:47.705 INFO:tasks.workunit.client.0.smithi090.stdout:0/615: chown d14/d19/d2b/d8e/d43/d5c/d70/lb7 0 1 2024-04-20T10:54:47.705 INFO:tasks.workunit.client.0.smithi090.stdout:4/574: creat d7/d9/d47/d63/d76/fb6 x:0 0 0 2024-04-20T10:54:47.705 INFO:tasks.workunit.client.0.smithi090.stdout:4/575: fsync d7/f54 0 2024-04-20T10:54:47.705 INFO:tasks.workunit.client.0.smithi090.stdout:4/576: dread - d7/d9/d17/d56/d66/d70/f81 zero size 2024-04-20T10:54:47.706 INFO:tasks.workunit.client.0.smithi090.stdout:8/631: getdents d0/d11 0 2024-04-20T10:54:47.709 INFO:tasks.workunit.client.0.smithi090.stdout:0/616: symlink d14/d19/d2b/d61/da0/db1/lc9 0 2024-04-20T10:54:47.709 INFO:tasks.workunit.client.0.smithi090.stdout:4/577: mknod d7/d72/cb7 0 2024-04-20T10:54:47.709 INFO:tasks.workunit.client.0.smithi090.stdout:4/578: getdents d7/d9/d17/d94 0 2024-04-20T10:54:47.709 INFO:tasks.workunit.client.0.smithi090.stdout:4/579: chown d7/d9/f19 100517321 1 2024-04-20T10:54:47.710 INFO:tasks.workunit.client.0.smithi090.stdout:1/685: dread d8/f44 [0,4194304] 0 2024-04-20T10:54:47.710 INFO:tasks.workunit.client.0.smithi090.stdout:1/686: fdatasync d8/d1a/d1d/d2c/d3f/f87 0 2024-04-20T10:54:47.711 INFO:tasks.workunit.client.0.smithi090.stdout:4/580: symlink d7/d9/lb8 0 2024-04-20T10:54:47.713 INFO:tasks.workunit.client.0.smithi090.stdout:1/687: rename d8/d1a/d1d/d2c/d4a/d93/c2b to d8/d1a/d4d/da5/ce1 0 2024-04-20T10:54:47.715 INFO:tasks.workunit.client.0.smithi090.stdout:4/581: link d7/f21 d7/fb9 0 2024-04-20T10:54:47.717 INFO:tasks.workunit.client.0.smithi090.stdout:2/654: dread fd [4194304,4194304] 0 2024-04-20T10:54:47.718 INFO:tasks.workunit.client.0.smithi090.stdout:0/617: rmdir d14/d19/d2b/d8e/d68 0 2024-04-20T10:54:47.718 INFO:tasks.workunit.client.0.smithi090.stdout:5/789: dwrite d1/de/dcf/f6f [0,4194304] 0 2024-04-20T10:54:47.718 INFO:tasks.workunit.client.0.smithi090.stdout:4/582: write d7/d9/d17/f27 [8578,117500] 0 2024-04-20T10:54:47.719 INFO:tasks.workunit.client.0.smithi090.stdout:2/655: rmdir d11/d1f 39 2024-04-20T10:54:47.719 INFO:tasks.workunit.client.0.smithi090.stdout:2/656: chown d11/d1f/d2e/d6e 42 1 2024-04-20T10:54:47.719 INFO:tasks.workunit.client.0.smithi090.stdout:2/657: read d11/d1a/f2d [169484,125712] 0 2024-04-20T10:54:47.720 INFO:tasks.workunit.client.0.smithi090.stdout:0/618: mkdir d14/d19/dca 0 2024-04-20T10:54:47.721 INFO:tasks.workunit.client.0.smithi090.stdout:6/516: dwrite d1/d19/d36/d28/f34 [0,4194304] 0 2024-04-20T10:54:47.722 INFO:tasks.workunit.client.0.smithi090.stdout:5/790: creat d1/d41/d98/f110 x:0 0 0 2024-04-20T10:54:47.723 INFO:tasks.workunit.client.0.smithi090.stdout:4/583: rmdir d7/d9/d17/d56/d66/d70 39 2024-04-20T10:54:47.723 INFO:tasks.workunit.client.0.smithi090.stdout:4/584: chown d7/d9/d47/d63/d42/f67 3011 1 2024-04-20T10:54:47.724 INFO:tasks.workunit.client.0.smithi090.stdout:2/658: rmdir d11/d1a/d30 39 2024-04-20T10:54:47.726 INFO:tasks.workunit.client.0.smithi090.stdout:0/619: creat d14/d19/d2b/d8e/d43/fcb x:0 0 0 2024-04-20T10:54:47.728 INFO:tasks.workunit.client.0.smithi090.stdout:5/791: unlink d1/da/d1f/dad/fc7 0 2024-04-20T10:54:47.729 INFO:tasks.workunit.client.0.smithi090.stdout:8/632: dwrite d0/d11/d22/d53/d8e/fb0 [0,4194304] 0 2024-04-20T10:54:47.729 INFO:tasks.workunit.client.0.smithi090.stdout:8/633: write d0/d2d/d49/f73 [8011896,30674] 0 2024-04-20T10:54:47.729 INFO:tasks.workunit.client.0.smithi090.stdout:8/634: chown d0/d11/d22/fb3 21646304 1 2024-04-20T10:54:47.729 INFO:tasks.workunit.client.0.smithi090.stdout:3/581: dwrite d7/d11/fb0 [0,4194304] 0 2024-04-20T10:54:47.730 INFO:tasks.workunit.client.0.smithi090.stdout:8/635: read d0/f79 [586169,16886] 0 2024-04-20T10:54:47.730 INFO:tasks.workunit.client.0.smithi090.stdout:8/636: dread - d0/d3a/d4a/fb8 zero size 2024-04-20T10:54:47.730 INFO:tasks.workunit.client.0.smithi090.stdout:4/585: mkdir d7/d9/d17/d56/d66/d70/da5/db3/dba 0 2024-04-20T10:54:47.730 INFO:tasks.workunit.client.0.smithi090.stdout:4/586: chown d7/d9/d47/d63/d42/d8f 1507170 1 2024-04-20T10:54:47.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/517: write d1/d19/d36/d1e/f58 [2054227,109889] 0 2024-04-20T10:54:47.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/518: fsync d1/d4/d26/d11/f8a 0 2024-04-20T10:54:47.739 INFO:tasks.workunit.client.0.smithi090.stdout:1/688: dwrite d8/d1a/d1d/d2c/d6e/f72 [0,4194304] 0 2024-04-20T10:54:47.741 INFO:tasks.workunit.client.0.smithi090.stdout:0/620: truncate d14/d19/d2b/f3d 1656175 0 2024-04-20T10:54:47.743 INFO:tasks.workunit.client.0.smithi090.stdout:8/637: read d0/d2d/d49/faf [3379509,22410] 0 2024-04-20T10:54:47.743 INFO:tasks.workunit.client.0.smithi090.stdout:7/587: dwrite d11/d1a/d3f/f66 [0,4194304] 0 2024-04-20T10:54:47.745 INFO:tasks.workunit.client.0.smithi090.stdout:1/689: mkdir d8/d1a/d1d/d67/de2 0 2024-04-20T10:54:47.745 INFO:tasks.workunit.client.0.smithi090.stdout:1/690: chown d8/c22 0 1 2024-04-20T10:54:47.745 INFO:tasks.workunit.client.0.smithi090.stdout:1/691: truncate d8/f34 356467 0 2024-04-20T10:54:47.746 INFO:tasks.workunit.client.0.smithi090.stdout:3/582: read d7/d15/f1d [1142907,71507] 0 2024-04-20T10:54:47.747 INFO:tasks.workunit.client.0.smithi090.stdout:8/638: mkdir d0/dac/dcf/dd5 0 2024-04-20T10:54:47.749 INFO:tasks.workunit.client.0.smithi090.stdout:7/588: unlink d11/d13/d23/f26 0 2024-04-20T10:54:47.750 INFO:tasks.workunit.client.0.smithi090.stdout:7/589: readlink l7 0 2024-04-20T10:54:47.750 INFO:tasks.workunit.client.0.smithi090.stdout:7/590: stat d11/d1a/fbe 0 2024-04-20T10:54:47.750 INFO:tasks.workunit.client.0.smithi090.stdout:7/591: readlink d11/d61/laf 0 2024-04-20T10:54:47.751 INFO:tasks.workunit.client.0.smithi090.stdout:1/692: mknod d8/d1a/d4d/da5/ce3 0 2024-04-20T10:54:47.752 INFO:tasks.workunit.client.0.smithi090.stdout:3/583: rmdir d7/df 39 2024-04-20T10:54:47.752 INFO:tasks.workunit.client.0.smithi090.stdout:0/621: dread d14/d41/f7d [0,4194304] 0 2024-04-20T10:54:47.752 INFO:tasks.workunit.client.0.smithi090.stdout:0/622: write d14/d19/d2b/d52/dab/fbf [1171042,68408] 0 2024-04-20T10:54:47.754 INFO:tasks.workunit.client.0.smithi090.stdout:7/592: creat d11/d13/d33/d44/d89/d98/dc7/fcb x:0 0 0 2024-04-20T10:54:47.757 INFO:tasks.workunit.client.0.smithi090.stdout:3/584: rename d7/d11/lab to d7/d15/d2a/da2/lbc 0 2024-04-20T10:54:47.761 INFO:tasks.workunit.client.0.smithi090.stdout:0/623: rename d14/f4b to d14/d41/fcc 0 2024-04-20T10:54:47.761 INFO:tasks.workunit.client.0.smithi090.stdout:0/624: fdatasync d14/d19/d2b/f30 0 2024-04-20T10:54:47.762 INFO:tasks.workunit.client.0.smithi090.stdout:3/585: creat d7/d15/d47/fbd x:0 0 0 2024-04-20T10:54:47.762 INFO:tasks.workunit.client.0.smithi090.stdout:3/586: fsync d7/d26/d5e/d88/fb2 0 2024-04-20T10:54:47.762 INFO:tasks.workunit.client.0.smithi090.stdout:3/587: fsync d7/d35/f4b 0 2024-04-20T10:54:47.763 INFO:tasks.workunit.client.0.smithi090.stdout:3/588: chown d7/d43/db7/daf 686283 1 2024-04-20T10:54:47.763 INFO:tasks.workunit.client.0.smithi090.stdout:7/593: dread f6 [0,4194304] 0 2024-04-20T10:54:47.763 INFO:tasks.workunit.client.0.smithi090.stdout:5/792: dwrite d1/da/ff8 [0,4194304] 0 2024-04-20T10:54:47.763 INFO:tasks.workunit.client.0.smithi090.stdout:5/793: chown d1/da/fc3 11 1 2024-04-20T10:54:47.765 INFO:tasks.workunit.client.0.smithi090.stdout:4/587: dwrite d7/d9/d47/fb1 [4194304,4194304] 0 2024-04-20T10:54:47.766 INFO:tasks.workunit.client.0.smithi090.stdout:3/589: mknod d7/d15/d2a/d30/d93/d7f/cbe 0 2024-04-20T10:54:47.766 INFO:tasks.workunit.client.0.smithi090.stdout:7/594: read d11/d13/d22/f34 [1781155,40057] 0 2024-04-20T10:54:47.766 INFO:tasks.workunit.client.0.smithi090.stdout:6/519: dwrite d1/d4/d26/ff [0,4194304] 0 2024-04-20T10:54:47.766 INFO:tasks.workunit.client.0.smithi090.stdout:2/659: dwrite d11/f19 [0,4194304] 0 2024-04-20T10:54:47.770 INFO:tasks.workunit.client.0.smithi090.stdout:4/588: unlink d7/d9/d47/d8d/ca8 0 2024-04-20T10:54:47.770 INFO:tasks.workunit.client.0.smithi090.stdout:4/589: chown d7/d9/d17/f48 6008382 1 2024-04-20T10:54:47.775 INFO:tasks.workunit.client.0.smithi090.stdout:6/520: truncate d1/d4/d26/d11/f17 3740719 0 2024-04-20T10:54:47.775 INFO:tasks.workunit.client.0.smithi090.stdout:6/521: read - d1/d19/d36/d1e/d1f/d3f/f79 zero size 2024-04-20T10:54:47.776 INFO:tasks.workunit.client.0.smithi090.stdout:2/660: mkdir d11/d1f/d2e/d6e/ddc 0 2024-04-20T10:54:47.777 INFO:tasks.workunit.client.0.smithi090.stdout:4/590: truncate d7/d9/f19 11859 0 2024-04-20T10:54:47.779 INFO:tasks.workunit.client.0.smithi090.stdout:6/522: symlink d1/d10/lb0 0 2024-04-20T10:54:47.779 INFO:tasks.workunit.client.0.smithi090.stdout:6/523: stat d1/d4/d26/d11/d35 0 2024-04-20T10:54:47.779 INFO:tasks.workunit.client.0.smithi090.stdout:8/639: dwrite d0/d26/f39 [0,4194304] 0 2024-04-20T10:54:47.779 INFO:tasks.workunit.client.0.smithi090.stdout:1/693: dwrite d8/d1a/d1d/d2c/d62/f78 [0,4194304] 0 2024-04-20T10:54:47.781 INFO:tasks.workunit.client.0.smithi090.stdout:4/591: symlink d7/d9/d47/d63/d76/lbb 0 2024-04-20T10:54:47.784 INFO:tasks.workunit.client.0.smithi090.stdout:5/794: dwrite d1/d2f/f83 [0,4194304] 0 2024-04-20T10:54:47.786 INFO:tasks.workunit.client.0.smithi090.stdout:0/625: rename d14/d41/fcc to d14/d19/d2b/d52/d55/d5b/d7f/fcd 0 2024-04-20T10:54:47.788 INFO:tasks.workunit.client.0.smithi090.stdout:8/640: symlink d0/d2d/d49/ld6 0 2024-04-20T10:54:47.789 INFO:tasks.workunit.client.0.smithi090.stdout:1/694: creat d8/d1a/d1d/d2c/d4a/d93/d5d/fe4 x:0 0 0 2024-04-20T10:54:47.791 INFO:tasks.workunit.client.0.smithi090.stdout:5/795: dread d1/f62 [0,4194304] 0 2024-04-20T10:54:47.791 INFO:tasks.workunit.client.0.smithi090.stdout:2/661: dwrite d11/d1a/d30/d8d/f9c [0,4194304] 0 2024-04-20T10:54:47.791 INFO:tasks.workunit.client.0.smithi090.stdout:2/662: fdatasync d11/d1a/d2b/f35 0 2024-04-20T10:54:47.795 INFO:tasks.workunit.client.0.smithi090.stdout:1/695: dread d8/f59 [0,4194304] 0 2024-04-20T10:54:47.799 INFO:tasks.workunit.client.0.smithi090.stdout:0/626: getdents d14/d19/d2b/d8e/d43/d73 0 2024-04-20T10:54:47.799 INFO:tasks.workunit.client.0.smithi090.stdout:0/627: stat d14/d19/d2b/d52/d55/d5b/lc2 0 2024-04-20T10:54:47.800 INFO:tasks.workunit.client.0.smithi090.stdout:0/628: fdatasync d14/d41/f6e 0 2024-04-20T10:54:47.800 INFO:tasks.workunit.client.0.smithi090.stdout:5/796: dread d1/d2f/d85/ff6 [0,4194304] 0 2024-04-20T10:54:47.802 INFO:tasks.workunit.client.0.smithi090.stdout:8/641: link d0/l1d d0/dac/dcf/ld7 0 2024-04-20T10:54:47.802 INFO:tasks.workunit.client.0.smithi090.stdout:8/642: write d0/d3a/d4a/f98 [567584,19436] 0 2024-04-20T10:54:47.802 INFO:tasks.workunit.client.0.smithi090.stdout:8/643: read - d0/d2d/f84 zero size 2024-04-20T10:54:47.802 INFO:tasks.workunit.client.0.smithi090.stdout:8/644: fdatasync d0/d2d/f43 0 2024-04-20T10:54:47.806 INFO:tasks.workunit.client.0.smithi090.stdout:3/590: rename d7/d35/l42 to d7/d43/db7/lbf 0 2024-04-20T10:54:47.806 INFO:tasks.workunit.client.0.smithi090.stdout:0/629: truncate d14/d19/d31/d34/d3b/f59 698970 0 2024-04-20T10:54:47.808 INFO:tasks.workunit.client.0.smithi090.stdout:5/797: creat d1/d2f/f111 x:0 0 0 2024-04-20T10:54:47.810 INFO:tasks.workunit.client.0.smithi090.stdout:5/798: rmdir d1/da/d1f/dad 39 2024-04-20T10:54:47.811 INFO:tasks.workunit.client.0.smithi090.stdout:0/630: write fe [1440351,25204] 0 2024-04-20T10:54:47.821 INFO:tasks.workunit.client.0.smithi090.stdout:3/591: dread d7/d15/d2a/f67 [0,4194304] 0 2024-04-20T10:54:47.821 INFO:tasks.workunit.client.0.smithi090.stdout:3/592: fsync d7/d11/f1c 0 2024-04-20T10:54:47.822 INFO:tasks.workunit.client.0.smithi090.stdout:6/524: rename d1/d19/d36/d28/fa1 to d1/d4/d26/d11/d4a/d70/fb1 0 2024-04-20T10:54:47.822 INFO:tasks.workunit.client.0.smithi090.stdout:6/525: stat d1/d19/d36/d1e/fab 0 2024-04-20T10:54:47.823 INFO:tasks.workunit.client.0.smithi090.stdout:3/593: rmdir d7 39 2024-04-20T10:54:47.824 INFO:tasks.workunit.client.0.smithi090.stdout:3/594: mknod d7/cc0 0 2024-04-20T10:54:47.825 INFO:tasks.workunit.client.0.smithi090.stdout:3/595: fsync d7/d15/d47/d56/f54 0 2024-04-20T10:54:47.825 INFO:tasks.workunit.client.0.smithi090.stdout:3/596: chown d7/d26/d5e/d88/fb2 21566 1 2024-04-20T10:54:47.825 INFO:tasks.workunit.client.0.smithi090.stdout:2/663: dwrite d11/d1a/d37/f77 [0,4194304] 0 2024-04-20T10:54:47.825 INFO:tasks.workunit.client.0.smithi090.stdout:3/597: readlink d7/d15/d2a/l95 0 2024-04-20T10:54:47.825 INFO:tasks.workunit.client.0.smithi090.stdout:3/598: stat d7/f71 0 2024-04-20T10:54:47.825 INFO:tasks.workunit.client.0.smithi090.stdout:2/664: fsync d11/d1a/f2d 0 2024-04-20T10:54:47.825 INFO:tasks.workunit.client.0.smithi090.stdout:2/665: write d11/d1f/fbb [926540,75751] 0 2024-04-20T10:54:47.826 INFO:tasks.workunit.client.0.smithi090.stdout:8/645: dread d0/f63 [0,4194304] 0 2024-04-20T10:54:47.826 INFO:tasks.workunit.client.0.smithi090.stdout:8/646: dread - d0/d11/d22/d53/fca zero size 2024-04-20T10:54:47.826 INFO:tasks.workunit.client.0.smithi090.stdout:8/647: dread - d0/d11/d22/fb3 zero size 2024-04-20T10:54:47.827 INFO:tasks.workunit.client.0.smithi090.stdout:8/648: stat d0/d3a/d9f/db9/dbe 0 2024-04-20T10:54:47.827 INFO:tasks.workunit.client.0.smithi090.stdout:0/631: rename c7 to d14/d19/d31/cce 0 2024-04-20T10:54:47.828 INFO:tasks.workunit.client.0.smithi090.stdout:3/599: mknod d7/cc1 0 2024-04-20T10:54:47.829 INFO:tasks.workunit.client.0.smithi090.stdout:2/666: truncate d11/d1a/f83 2132691 0 2024-04-20T10:54:47.829 INFO:tasks.workunit.client.0.smithi090.stdout:1/696: dwrite d8/d1a/d1d/f27 [0,4194304] 0 2024-04-20T10:54:47.829 INFO:tasks.workunit.client.0.smithi090.stdout:1/697: dread - d8/d1a/d1d/d67/f82 zero size 2024-04-20T10:54:47.830 INFO:tasks.workunit.client.0.smithi090.stdout:8/649: truncate d0/d11/d22/d53/d57/f61 2049855 0 2024-04-20T10:54:47.830 INFO:tasks.workunit.client.0.smithi090.stdout:0/632: mknod d14/d19/d2b/d61/d88/ccf 0 2024-04-20T10:54:47.831 INFO:tasks.workunit.client.0.smithi090.stdout:5/799: dwrite d1/d2f/d3d/fb2 [4194304,4194304] 0 2024-04-20T10:54:47.832 INFO:tasks.workunit.client.0.smithi090.stdout:3/600: creat d7/d15/d47/fc2 x:0 0 0 2024-04-20T10:54:47.832 INFO:tasks.workunit.client.0.smithi090.stdout:4/592: truncate d7/d9/d17/f27 361872 0 2024-04-20T10:54:47.833 INFO:tasks.workunit.client.0.smithi090.stdout:2/667: symlink d11/d1a/d30/da6/ldd 0 2024-04-20T10:54:47.833 INFO:tasks.workunit.client.0.smithi090.stdout:2/668: truncate d11/d1a/d4a/d59/f5c 4490825 0 2024-04-20T10:54:47.836 INFO:tasks.workunit.client.0.smithi090.stdout:1/698: getdents d8/d1a/d1d/d2c/d4a/d7b 0 2024-04-20T10:54:47.836 INFO:tasks.workunit.client.0.smithi090.stdout:8/650: rmdir d0/d11/d22/d53 39 2024-04-20T10:54:47.837 INFO:tasks.workunit.client.0.smithi090.stdout:8/651: readlink d0/d26/l5c 0 2024-04-20T10:54:47.838 INFO:tasks.workunit.client.0.smithi090.stdout:5/800: symlink d1/d41/d98/l112 0 2024-04-20T10:54:47.839 INFO:tasks.workunit.client.0.smithi090.stdout:6/526: dwrite d1/d4/d26/d11/d4a/d70/fb1 [0,4194304] 0 2024-04-20T10:54:47.840 INFO:tasks.workunit.client.0.smithi090.stdout:3/601: mknod d7/d43/db7/daf/cc3 0 2024-04-20T10:54:47.840 INFO:tasks.workunit.client.0.smithi090.stdout:3/602: chown d7/f37 13 1 2024-04-20T10:54:47.841 INFO:tasks.workunit.client.0.smithi090.stdout:4/593: creat d7/d9/d47/fbc x:0 0 0 2024-04-20T10:54:47.841 INFO:tasks.workunit.client.0.smithi090.stdout:4/594: dread - d7/d9/d47/d63/d76/fb6 zero size 2024-04-20T10:54:47.842 INFO:tasks.workunit.client.0.smithi090.stdout:2/669: rmdir d11/d1a/d30/d8d 39 2024-04-20T10:54:47.843 INFO:tasks.workunit.client.0.smithi090.stdout:1/699: mkdir d8/d1a/d4d/da5/dad/de5 0 2024-04-20T10:54:47.843 INFO:tasks.workunit.client.0.smithi090.stdout:1/700: write d8/d1a/d1d/d2c/d62/fc9 [267019,60147] 0 2024-04-20T10:54:47.846 INFO:tasks.workunit.client.0.smithi090.stdout:8/652: dread d0/d26/f40 [0,4194304] 0 2024-04-20T10:54:47.848 INFO:tasks.workunit.client.0.smithi090.stdout:3/603: creat d7/d15/d2a/d30/d48/fc4 x:0 0 0 2024-04-20T10:54:47.848 INFO:tasks.workunit.client.0.smithi090.stdout:3/604: chown d7/f71 86 1 2024-04-20T10:54:47.850 INFO:tasks.workunit.client.0.smithi090.stdout:0/633: dwrite d14/f1f [4194304,4194304] 0 2024-04-20T10:54:47.851 INFO:tasks.workunit.client.0.smithi090.stdout:4/595: mkdir d7/dbd 0 2024-04-20T10:54:47.851 INFO:tasks.workunit.client.0.smithi090.stdout:4/596: fsync d7/d9/d47/d63/d42/f64 0 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/634: dread d14/d19/d2b/d52/d55/d5b/d7f/fb4 [0,4194304] 0 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/635: truncate d14/d19/d2b/d8e/d40/fbc 218386 0 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/636: read - d14/d19/d2b/d61/f6f zero size 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/637: dread - d14/d19/d2b/d52/f69 zero size 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/638: write d14/d19/d2b/d52/d55/d5b/d7f/fcd [1652578,69449] 0 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/639: fdatasync d14/d19/d2b/d61/fa5 0 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/640: chown d14/d19/d2b/d8e/d43/d6d/f91 249374828 1 2024-04-20T10:54:47.855 INFO:tasks.workunit.client.0.smithi090.stdout:0/641: chown f5 1 1 2024-04-20T10:54:47.858 INFO:tasks.workunit.client.0.smithi090.stdout:4/597: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:47.858 INFO:tasks.workunit.client.0.smithi090.stdout:4/598: dread - d7/d9/d17/f79 zero size 2024-04-20T10:54:47.859 INFO:tasks.workunit.client.0.smithi090.stdout:3/605: dread d7/fc [0,4194304] 0 2024-04-20T10:54:47.861 INFO:tasks.workunit.client.0.smithi090.stdout:2/670: creat d11/d1f/d2e/d6e/fde x:0 0 0 2024-04-20T10:54:47.861 INFO:tasks.workunit.client.0.smithi090.stdout:2/671: fdatasync d11/d1a/f7d 0 2024-04-20T10:54:47.862 INFO:tasks.workunit.client.0.smithi090.stdout:5/801: mkdir d1/da/d14/d113 0 2024-04-20T10:54:47.862 INFO:tasks.workunit.client.0.smithi090.stdout:8/653: mknod d0/d11/d22/d53/d57/dd3/cd8 0 2024-04-20T10:54:47.864 INFO:tasks.workunit.client.0.smithi090.stdout:0/642: creat d14/d41/fd0 x:0 0 0 2024-04-20T10:54:47.866 INFO:tasks.workunit.client.0.smithi090.stdout:6/527: dwrite d1/d4/d26/d11/d4a/d70/fb1 [0,4194304] 0 2024-04-20T10:54:47.866 INFO:tasks.workunit.client.0.smithi090.stdout:6/528: readlink d1/d19/d36/la7 0 2024-04-20T10:54:47.867 INFO:tasks.workunit.client.0.smithi090.stdout:3/606: dread d7/d26/d5e/d88/fb2 [0,4194304] 0 2024-04-20T10:54:47.867 INFO:tasks.workunit.client.0.smithi090.stdout:8/654: stat d0/d26/l42 0 2024-04-20T10:54:47.869 INFO:tasks.workunit.client.0.smithi090.stdout:1/701: dwrite d8/d1a/d1d/d67/f61 [0,4194304] 0 2024-04-20T10:54:47.869 INFO:tasks.workunit.client.0.smithi090.stdout:4/599: rename d7/d9/d17/c32 to d7/d9/d47/d63/d42/d8f/cbe 0 2024-04-20T10:54:47.870 INFO:tasks.workunit.client.0.smithi090.stdout:6/529: creat d1/d19/d36/d1e/d1f/d3f/d54/daf/fb2 x:0 0 0 2024-04-20T10:54:47.871 INFO:tasks.workunit.client.0.smithi090.stdout:6/530: chown d1/d4/d26/d11/d4a 1847 1 2024-04-20T10:54:47.872 INFO:tasks.workunit.client.0.smithi090.stdout:5/802: link d1/d2f/d3d/d40/d6c/c88 d1/d41/d98/daf/c114 0 2024-04-20T10:54:47.873 INFO:tasks.workunit.client.0.smithi090.stdout:8/655: mkdir d0/d2d/d44/dd9 0 2024-04-20T10:54:47.874 INFO:tasks.workunit.client.0.smithi090.stdout:1/702: creat d8/d1a/d1d/fe6 x:0 0 0 2024-04-20T10:54:47.875 INFO:tasks.workunit.client.0.smithi090.stdout:0/643: dread d14/d19/d2b/d61/fa5 [0,4194304] 0 2024-04-20T10:54:47.876 INFO:tasks.workunit.client.0.smithi090.stdout:0/644: fdatasync d14/d19/d2b/d61/fa5 0 2024-04-20T10:54:47.876 INFO:tasks.workunit.client.0.smithi090.stdout:4/600: symlink d7/d9/d17/d56/d66/d70/da5/db3/dba/lbf 0 2024-04-20T10:54:47.876 INFO:tasks.workunit.client.0.smithi090.stdout:4/601: truncate d7/d9/d17/f79 651781 0 2024-04-20T10:54:47.876 INFO:tasks.workunit.client.0.smithi090.stdout:4/602: fsync d7/d9/d17/d56/f84 0 2024-04-20T10:54:47.876 INFO:tasks.workunit.client.0.smithi090.stdout:4/603: dread - d7/d9/d47/d8d/fab zero size 2024-04-20T10:54:47.876 INFO:tasks.workunit.client.0.smithi090.stdout:5/803: getdents d1/d2a 0 2024-04-20T10:54:47.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/656: rename d0/d2d/d49/la2 to d0/d99/lda 0 2024-04-20T10:54:47.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/657: fsync d0/d3a/d9f/d52/f9a 0 2024-04-20T10:54:47.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/658: fsync d0/d26/da7/da9/fb7 0 2024-04-20T10:54:47.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/659: chown d0/d11/f1b 1 1 2024-04-20T10:54:47.879 INFO:tasks.workunit.client.0.smithi090.stdout:0/645: rmdir d14/d19/d2b/d8e 39 2024-04-20T10:54:47.881 INFO:tasks.workunit.client.0.smithi090.stdout:4/604: readlink d7/d9/d17/l43 0 2024-04-20T10:54:47.881 INFO:tasks.workunit.client.0.smithi090.stdout:4/605: write d7/d9/d47/d63/d3d/f9f [4549394,3226] 0 2024-04-20T10:54:47.881 INFO:tasks.workunit.client.0.smithi090.stdout:6/531: write d1/f4c [3603497,79673] 0 2024-04-20T10:54:47.881 INFO:tasks.workunit.client.0.smithi090.stdout:2/672: dwrite d11/d1a/f1b [0,4194304] 0 2024-04-20T10:54:47.881 INFO:tasks.workunit.client.0.smithi090.stdout:0/646: chown d14/d19/d2b/d8e/d43/d6d 0 1 2024-04-20T10:54:47.883 INFO:tasks.workunit.client.0.smithi090.stdout:4/606: symlink d7/d9/d47/d63/lc0 0 2024-04-20T10:54:47.883 INFO:tasks.workunit.client.0.smithi090.stdout:4/607: write d7/d9/f10 [798719,9499] 0 2024-04-20T10:54:47.884 INFO:tasks.workunit.client.0.smithi090.stdout:1/703: write f5 [814039,74659] 0 2024-04-20T10:54:47.885 INFO:tasks.workunit.client.0.smithi090.stdout:6/532: mkdir d1/d4/d26/d11/d4a/db3 0 2024-04-20T10:54:47.887 INFO:tasks.workunit.client.0.smithi090.stdout:2/673: creat d11/d1a/d37/d85/fdf x:0 0 0 2024-04-20T10:54:47.887 INFO:tasks.workunit.client.0.smithi090.stdout:2/674: truncate d11/d1f/d2e/f8f 505420 0 2024-04-20T10:54:47.887 INFO:tasks.workunit.client.0.smithi090.stdout:2/675: fsync d11/d1a/f1b 0 2024-04-20T10:54:47.887 INFO:tasks.workunit.client.0.smithi090.stdout:0/647: creat d14/d19/d2b/d61/da0/db1/dbb/fd1 x:0 0 0 2024-04-20T10:54:47.890 INFO:tasks.workunit.client.0.smithi090.stdout:4/608: dread d7/fb9 [0,4194304] 0 2024-04-20T10:54:47.891 INFO:tasks.workunit.client.0.smithi090.stdout:2/676: mknod d11/d1a/d4a/d59/ce0 0 2024-04-20T10:54:47.893 INFO:tasks.workunit.client.0.smithi090.stdout:3/607: dwrite d7/d15/d2a/d30/f64 [0,4194304] 0 2024-04-20T10:54:47.893 INFO:tasks.workunit.client.0.smithi090.stdout:3/608: truncate d7/d15/d47/d56/f9e 498514 0 2024-04-20T10:54:47.893 INFO:tasks.workunit.client.0.smithi090.stdout:3/609: chown d7/d15/f25 96232 1 2024-04-20T10:54:47.893 INFO:tasks.workunit.client.0.smithi090.stdout:4/609: link d7/d9/d47/ca7 d7/d9/d17/d56/d66/d70/da5/db3/dba/cc1 0 2024-04-20T10:54:47.894 INFO:tasks.workunit.client.0.smithi090.stdout:2/677: creat d11/d1a/fe1 x:0 0 0 2024-04-20T10:54:47.896 INFO:tasks.workunit.client.0.smithi090.stdout:3/610: mkdir d7/d43/dc5 0 2024-04-20T10:54:47.898 INFO:tasks.workunit.client.0.smithi090.stdout:6/533: dread d1/d4/f1d [0,4194304] 0 2024-04-20T10:54:47.898 INFO:tasks.workunit.client.0.smithi090.stdout:6/534: readlink d1/d10/lb0 0 2024-04-20T10:54:47.899 INFO:tasks.workunit.client.0.smithi090.stdout:2/678: mkdir d11/d1f/d2e/d6e/dc7/de2 0 2024-04-20T10:54:47.900 INFO:tasks.workunit.client.0.smithi090.stdout:3/611: creat d7/d26/fc6 x:0 0 0 2024-04-20T10:54:47.901 INFO:tasks.workunit.client.0.smithi090.stdout:6/535: creat d1/fb4 x:0 0 0 2024-04-20T10:54:47.903 INFO:tasks.workunit.client.0.smithi090.stdout:2/679: unlink d11/d1a/d37/f44 0 2024-04-20T10:54:47.903 INFO:tasks.workunit.client.0.smithi090.stdout:2/680: fsync d11/d1f/f27 0 2024-04-20T10:54:47.903 INFO:tasks.workunit.client.0.smithi090.stdout:2/681: truncate d11/f20 808067 0 2024-04-20T10:54:47.903 INFO:tasks.workunit.client.0.smithi090.stdout:3/612: creat d7/d35/fc7 x:0 0 0 2024-04-20T10:54:47.910 INFO:tasks.workunit.client.0.smithi090.stdout:0/648: dread d14/f21 [0,4194304] 0 2024-04-20T10:54:47.919 INFO:tasks.workunit.client.0.smithi090.stdout:0/649: dread d14/d19/d2b/d8e/f92 [0,4194304] 0 2024-04-20T10:54:47.919 INFO:tasks.workunit.client.0.smithi090.stdout:0/650: chown d14/d19/d2b/d61/da0/db1/cb6 44150641 1 2024-04-20T10:54:47.924 INFO:tasks.workunit.client.0.smithi090.stdout:3/613: dwrite d7/d35/f4b [0,4194304] 0 2024-04-20T10:54:47.924 INFO:tasks.workunit.client.0.smithi090.stdout:3/614: write d7/d43/f76 [1211383,31039] 0 2024-04-20T10:54:47.925 INFO:tasks.workunit.client.0.smithi090.stdout:4/610: dwrite d7/d9/d47/d63/d3d/f60 [0,4194304] 0 2024-04-20T10:54:47.925 INFO:tasks.workunit.client.0.smithi090.stdout:0/651: dread f5 [0,4194304] 0 2024-04-20T10:54:47.927 INFO:tasks.workunit.client.0.smithi090.stdout:2/682: rename d11/d1a/d4a/f8c to d11/d1a/d30/da6/fe3 0 2024-04-20T10:54:47.927 INFO:tasks.workunit.client.0.smithi090.stdout:1/704: dwrite f5 [0,4194304] 0 2024-04-20T10:54:47.929 INFO:tasks.workunit.client.0.smithi090.stdout:3/615: truncate d7/d15/d47/f5a 1756778 0 2024-04-20T10:54:47.929 INFO:tasks.workunit.client.0.smithi090.stdout:3/616: fdatasync d7/d43/f45 0 2024-04-20T10:54:47.929 INFO:tasks.workunit.client.0.smithi090.stdout:3/617: stat d7/d15/d47/d56/fac 0 2024-04-20T10:54:47.942 INFO:tasks.workunit.client.0.smithi090.stdout:4/611: rename d7/d9/d47/d63/d3d/c44 to d7/d9/d47/d63/d42/cc2 0 2024-04-20T10:54:47.942 INFO:tasks.workunit.client.0.smithi090.stdout:6/536: dwrite d1/d4/d26/d11/d4a/d70/f7f [0,4194304] 0 2024-04-20T10:54:47.943 INFO:tasks.workunit.client.0.smithi090.stdout:2/683: creat d11/d1a/d4a/d55/fe4 x:0 0 0 2024-04-20T10:54:47.943 INFO:tasks.workunit.client.0.smithi090.stdout:2/684: fdatasync d11/d1a/d30/f42 0 2024-04-20T10:54:47.943 INFO:tasks.workunit.client.0.smithi090.stdout:4/612: write d7/f7d [2302434,66038] 0 2024-04-20T10:54:47.948 INFO:tasks.workunit.client.0.smithi090.stdout:2/685: write fd [8173831,88438] 0 2024-04-20T10:54:47.954 INFO:tasks.workunit.client.0.smithi090.stdout:1/705: creat d8/d1a/d4d/fe7 x:0 0 0 2024-04-20T10:54:47.955 INFO:tasks.workunit.client.0.smithi090.stdout:3/618: symlink d7/d26/d5e/d88/lc8 0 2024-04-20T10:54:47.957 INFO:tasks.workunit.client.0.smithi090.stdout:6/537: rmdir d1/d19/d36/d28 39 2024-04-20T10:54:47.957 INFO:tasks.workunit.client.0.smithi090.stdout:6/538: truncate d1/d4/f1d 8897681 0 2024-04-20T10:54:47.958 INFO:tasks.workunit.client.0.smithi090.stdout:4/613: creat d7/d9/d47/d63/d76/fc3 x:0 0 0 2024-04-20T10:54:47.959 INFO:tasks.workunit.client.0.smithi090.stdout:2/686: creat d11/d1f/d2e/dcd/fe5 x:0 0 0 2024-04-20T10:54:47.962 INFO:tasks.workunit.client.0.smithi090.stdout:3/619: mkdir d7/d26/dc9 0 2024-04-20T10:54:47.962 INFO:tasks.workunit.client.0.smithi090.stdout:0/652: dread d14/d19/d2b/d52/d55/d5b/f8f [0,4194304] 0 2024-04-20T10:54:47.964 INFO:tasks.workunit.client.0.smithi090.stdout:0/653: dread d14/d19/d2b/d8e/f8c [0,4194304] 0 2024-04-20T10:54:47.966 INFO:tasks.workunit.client.0.smithi090.stdout:6/539: mkdir d1/d4/d26/d11/d4a/d6b/db5 0 2024-04-20T10:54:47.968 INFO:tasks.workunit.client.0.smithi090.stdout:4/614: write d7/d9/d47/f6f [1290371,107207] 0 2024-04-20T10:54:47.969 INFO:tasks.workunit.client.0.smithi090.stdout:0/654: dread d14/d19/d2b/d8e/d43/f4a [0,4194304] 0 2024-04-20T10:54:47.969 INFO:tasks.workunit.client.0.smithi090.stdout:0/655: chown d14/d19/d2b/f83 1521 1 2024-04-20T10:54:47.970 INFO:tasks.workunit.client.0.smithi090.stdout:6/540: mknod d1/d19/d36/d1e/cb6 0 2024-04-20T10:54:47.972 INFO:tasks.workunit.client.0.smithi090.stdout:0/656: mknod d14/d19/d2b/d8e/d43/d5c/d70/d9b/cd2 0 2024-04-20T10:54:47.974 INFO:tasks.workunit.client.0.smithi090.stdout:6/541: creat d1/d19/d36/d1e/d1f/d3f/d81/fb7 x:0 0 0 2024-04-20T10:54:47.976 INFO:tasks.workunit.client.0.smithi090.stdout:4/615: mkdir d7/d9/d17/dc4 0 2024-04-20T10:54:47.976 INFO:tasks.workunit.client.0.smithi090.stdout:4/616: readlink d7/d9/d47/d63/d3d/l46 0 2024-04-20T10:54:47.976 INFO:tasks.workunit.client.0.smithi090.stdout:4/617: getdents d7/dbd 0 2024-04-20T10:54:47.977 INFO:tasks.workunit.client.0.smithi090.stdout:0/657: creat d14/d19/d2b/d8e/d43/d5c/fd3 x:0 0 0 2024-04-20T10:54:47.978 INFO:tasks.workunit.client.0.smithi090.stdout:6/542: creat d1/fb8 x:0 0 0 2024-04-20T10:54:47.979 INFO:tasks.workunit.client.0.smithi090.stdout:4/618: rmdir d7/d72 39 2024-04-20T10:54:47.980 INFO:tasks.workunit.client.0.smithi090.stdout:9/701: sync 2024-04-20T10:54:47.981 INFO:tasks.workunit.client.0.smithi090.stdout:2/687: dwrite d11/d1f/d2e/f8f [0,4194304] 0 2024-04-20T10:54:47.981 INFO:tasks.workunit.client.0.smithi090.stdout:6/543: stat d1/d4/c8b 0 2024-04-20T10:54:47.982 INFO:tasks.workunit.client.0.smithi090.stdout:9/702: getdents d0/d29/d36/d63/d1f/d34/d70 0 2024-04-20T10:54:47.986 INFO:tasks.workunit.client.0.smithi090.stdout:6/544: rename d1/d19/d36/d1e/d1f/d3f/d54/daf to d1/d4/d26/d11/d4a/d6b/db5/db9 0 2024-04-20T10:54:47.987 INFO:tasks.workunit.client.0.smithi090.stdout:9/703: unlink d0/d29/d4f/f97 0 2024-04-20T10:54:47.987 INFO:tasks.workunit.client.0.smithi090.stdout:0/658: dread f0 [0,4194304] 0 2024-04-20T10:54:47.989 INFO:tasks.workunit.client.0.smithi090.stdout:6/545: rmdir d1/d4/d26 39 2024-04-20T10:54:47.989 INFO:tasks.workunit.client.0.smithi090.stdout:3/620: dwrite d7/d15/f25 [0,4194304] 0 2024-04-20T10:54:47.992 INFO:tasks.workunit.client.0.smithi090.stdout:3/621: dread d7/d15/d2a/d8d/f8e [0,4194304] 0 2024-04-20T10:54:47.992 INFO:tasks.workunit.client.0.smithi090.stdout:3/622: chown d7/d11/f73 89181 1 2024-04-20T10:54:47.993 INFO:tasks.workunit.client.0.smithi090.stdout:2/688: dread d11/f1e [0,4194304] 0 2024-04-20T10:54:47.995 INFO:tasks.workunit.client.0.smithi090.stdout:3/623: truncate d7/d15/d47/d56/fac 2795603 0 2024-04-20T10:54:47.996 INFO:tasks.workunit.client.0.smithi090.stdout:2/689: stat d11/d1a/d2b/f84 0 2024-04-20T10:54:47.996 INFO:tasks.workunit.client.0.smithi090.stdout:2/690: fsync d11/f7a 0 2024-04-20T10:54:47.996 INFO:tasks.workunit.client.0.smithi090.stdout:2/691: fdatasync d11/d1a/d2b/f35 0 2024-04-20T10:54:47.997 INFO:tasks.workunit.client.0.smithi090.stdout:3/624: creat d7/d43/fca x:0 0 0 2024-04-20T10:54:48.000 INFO:tasks.workunit.client.0.smithi090.stdout:9/704: write d0/d29/d36/d63/f3f [683660,24089] 0 2024-04-20T10:54:48.000 INFO:tasks.workunit.client.0.smithi090.stdout:9/705: write d0/d29/d36/d63/f93 [761204,106407] 0 2024-04-20T10:54:48.001 INFO:tasks.workunit.client.0.smithi090.stdout:3/625: link d7/d15/d2a/c44 d7/d43/dc5/ccb 0 2024-04-20T10:54:48.001 INFO:tasks.workunit.client.0.smithi090.stdout:9/706: getdents d0/d29/d4f/ddc 0 2024-04-20T10:54:48.002 INFO:tasks.workunit.client.0.smithi090.stdout:3/626: rmdir d7/d15/d2a/d30/d93 39 2024-04-20T10:54:48.002 INFO:tasks.workunit.client.0.smithi090.stdout:3/627: stat d7/d15/f1d 0 2024-04-20T10:54:48.002 INFO:tasks.workunit.client.0.smithi090.stdout:3/628: truncate d7/d15/d47/fc2 153180 0 2024-04-20T10:54:48.009 INFO:tasks.workunit.client.0.smithi090.stdout:0/659: dwrite d14/d19/d2b/f30 [0,4194304] 0 2024-04-20T10:54:48.010 INFO:tasks.workunit.client.0.smithi090.stdout:9/707: creat d0/d29/d36/d63/d1f/d79/d9b/fed x:0 0 0 2024-04-20T10:54:48.011 INFO:tasks.workunit.client.0.smithi090.stdout:2/692: dread d11/d1a/d37/fc5 [0,4194304] 0 2024-04-20T10:54:48.012 INFO:tasks.workunit.client.0.smithi090.stdout:9/708: unlink d0/f9 0 2024-04-20T10:54:48.013 INFO:tasks.workunit.client.0.smithi090.stdout:2/693: fdatasync d11/d1a/d4a/d55/d67/fb4 0 2024-04-20T10:54:48.013 INFO:tasks.workunit.client.0.smithi090.stdout:2/694: fsync d11/d1a/d4a/d55/d67/fd0 0 2024-04-20T10:54:48.017 INFO:tasks.workunit.client.0.smithi090.stdout:9/709: dread d0/d29/d4f/fd4 [0,4194304] 0 2024-04-20T10:54:48.020 INFO:tasks.workunit.client.0.smithi090.stdout:0/660: write d14/f80 [4056019,46632] 0 2024-04-20T10:54:48.020 INFO:tasks.workunit.client.0.smithi090.stdout:0/661: chown d14/d19/d2b/d8e/d40/l53 0 1 2024-04-20T10:54:48.024 INFO:tasks.workunit.client.0.smithi090.stdout:2/695: creat d11/d1a/d4a/d80/fe6 x:0 0 0 2024-04-20T10:54:48.039 INFO:tasks.workunit.client.0.smithi090.stdout:9/710: dwrite d0/d29/d36/d63/d1f/d79/f6c [0,4194304] 0 2024-04-20T10:54:48.041 INFO:tasks.workunit.client.0.smithi090.stdout:0/662: dwrite d14/d19/d2b/d61/f65 [0,4194304] 0 2024-04-20T10:54:48.041 INFO:tasks.workunit.client.0.smithi090.stdout:0/663: read - d14/d19/d2b/d8e/d43/d5c/fd3 zero size 2024-04-20T10:54:48.041 INFO:tasks.workunit.client.0.smithi090.stdout:0/664: fdatasync d14/d19/d2b/d52/dab/da1/fad 0 2024-04-20T10:54:48.041 INFO:tasks.workunit.client.0.smithi090.stdout:0/665: truncate d14/f21 4359767 0 2024-04-20T10:54:48.088 INFO:tasks.workunit.client.0.smithi090.stdout:2/696: symlink d11/d1f/d2e/d6e/dc7/de2/le7 0 2024-04-20T10:54:48.089 INFO:tasks.workunit.client.0.smithi090.stdout:9/711: chown d0/d29/d36/d63/f2f 523206 1 2024-04-20T10:54:48.091 INFO:tasks.workunit.client.0.smithi090.stdout:0/666: mknod d14/d19/d2b/d61/da0/db1/cd4 0 2024-04-20T10:54:48.091 INFO:tasks.workunit.client.0.smithi090.stdout:0/667: truncate d14/d19/d2b/d52/d55/d5b/fbe 366447 0 2024-04-20T10:54:48.093 INFO:tasks.workunit.client.0.smithi090.stdout:1/706: dread d8/fd [8388608,4194304] 0 2024-04-20T10:54:48.093 INFO:tasks.workunit.client.0.smithi090.stdout:1/707: fsync d8/d1a/d1d/d2c/d4a/d93/fda 0 2024-04-20T10:54:48.093 INFO:tasks.workunit.client.0.smithi090.stdout:1/708: chown d8/f7f 2830 1 2024-04-20T10:54:48.094 INFO:tasks.workunit.client.0.smithi090.stdout:9/712: rename d0/d29/d36/d63/f3f to d0/d29/d36/d63/d1c/d94/fee 0 2024-04-20T10:54:48.094 INFO:tasks.workunit.client.0.smithi090.stdout:9/713: stat d0/d29/d36/d63/f13 0 2024-04-20T10:54:48.095 INFO:tasks.workunit.client.0.smithi090.stdout:0/668: creat d14/d19/fd5 x:0 0 0 2024-04-20T10:54:48.095 INFO:tasks.workunit.client.0.smithi090.stdout:0/669: read - d14/d19/d2b/d8e/d43/d6d/f91 zero size 2024-04-20T10:54:48.096 INFO:tasks.workunit.client.0.smithi090.stdout:1/709: link d8/d1a/d1d/d2c/d4a/f65 d8/d1a/d1d/d7a/fe8 0 2024-04-20T10:54:48.096 INFO:tasks.workunit.client.0.smithi090.stdout:1/710: read - d8/d1a/d1d/d7a/d9a/fac zero size 2024-04-20T10:54:48.096 INFO:tasks.workunit.client.0.smithi090.stdout:9/714: mknod d0/d29/d36/d63/d1c/cef 0 2024-04-20T10:54:48.097 INFO:tasks.workunit.client.0.smithi090.stdout:0/670: unlink d14/d19/d2b/d8e/f92 0 2024-04-20T10:54:48.098 INFO:tasks.workunit.client.0.smithi090.stdout:1/711: mknod d8/d1a/d1d/d2c/d8f/ce9 0 2024-04-20T10:54:48.098 INFO:tasks.workunit.client.0.smithi090.stdout:1/712: chown d8/d1a/d1d/d2c/d4a/d93/fcf 41919 1 2024-04-20T10:54:48.099 INFO:tasks.workunit.client.0.smithi090.stdout:9/715: mkdir d0/d29/d4f/d23/daa/df0 0 2024-04-20T10:54:48.099 INFO:tasks.workunit.client.0.smithi090.stdout:0/671: mknod d14/d19/cd6 0 2024-04-20T10:54:48.100 INFO:tasks.workunit.client.0.smithi090.stdout:1/713: creat d8/d1a/d4d/dc6/fea x:0 0 0 2024-04-20T10:54:48.100 INFO:tasks.workunit.client.0.smithi090.stdout:9/716: truncate d0/d29/f57 1177873 0 2024-04-20T10:54:48.122 INFO:tasks.workunit.client.0.smithi090.stdout:0/672: dwrite d14/d19/d2b/d8e/d43/d5c/fd3 [0,4194304] 0 2024-04-20T10:54:48.123 INFO:tasks.workunit.client.0.smithi090.stdout:0/673: chown d14/d19/d2b/d52/d55/d5b/d7f/fcd 3667905 1 2024-04-20T10:54:48.138 INFO:tasks.workunit.client.0.smithi090.stdout:0/674: dwrite d14/d19/d2b/d52/d55/d5b/d7f/f87 [0,4194304] 0 2024-04-20T10:54:48.156 INFO:tasks.workunit.client.0.smithi090.stdout:2/697: write d11/f20 [801605,68162] 0 2024-04-20T10:54:48.358 INFO:tasks.workunit.client.0.smithi090.stdout:1/714: truncate d8/f44 1303978 0 2024-04-20T10:54:48.359 INFO:tasks.workunit.client.0.smithi090.stdout:9/717: write d0/f4 [4686081,95632] 0 2024-04-20T10:54:48.359 INFO:tasks.workunit.client.0.smithi090.stdout:1/715: read d8/d1a/d1d/d2c/d4a/d93/d5d/f5e [262831,8714] 0 2024-04-20T10:54:48.359 INFO:tasks.workunit.client.0.smithi090.stdout:1/716: truncate d8/d1a/d1d/d67/f3d 2060002 0 2024-04-20T10:54:48.361 INFO:tasks.workunit.client.0.smithi090.stdout:0/675: rename d14/d19/d2b/d52/dab/c63 to d14/d19/d2b/d61/cd7 0 2024-04-20T10:54:48.362 INFO:tasks.workunit.client.0.smithi090.stdout:7/595: sync 2024-04-20T10:54:48.364 INFO:tasks.workunit.client.0.smithi090.stdout:9/718: unlink d0/d29/d36/d63/d1c/d94/dcb/ld9 0 2024-04-20T10:54:48.365 INFO:tasks.workunit.client.0.smithi090.stdout:1/717: creat d8/d1a/d1d/d2c/d4a/d93/feb x:0 0 0 2024-04-20T10:54:48.365 INFO:tasks.workunit.client.0.smithi090.stdout:1/718: stat d8/d1a/d1d/d2c/d4a/d93/d5d 0 2024-04-20T10:54:48.366 INFO:tasks.workunit.client.0.smithi090.stdout:2/698: link d11/d1a/fe1 d11/d1a/d4a/d55/da1/fe8 0 2024-04-20T10:54:48.368 INFO:tasks.workunit.client.0.smithi090.stdout:0/676: write d14/d19/f1b [3996345,29299] 0 2024-04-20T10:54:48.369 INFO:tasks.workunit.client.0.smithi090.stdout:7/596: rmdir d11/d13/d22/d24/d35/da7 0 2024-04-20T10:54:48.370 INFO:tasks.workunit.client.0.smithi090.stdout:7/597: chown d11/d13 30492080 1 2024-04-20T10:54:48.370 INFO:tasks.workunit.client.0.smithi090.stdout:7/598: chown d11/d1a/d3f/f66 1862458 1 2024-04-20T10:54:48.370 INFO:tasks.workunit.client.0.smithi090.stdout:2/699: dread d11/d1f/fbb [0,4194304] 0 2024-04-20T10:54:48.372 INFO:tasks.workunit.client.0.smithi090.stdout:9/719: rename d0/d29/d36/d63/d1c/f3e to d0/d29/d4f/d23/daa/df0/ff1 0 2024-04-20T10:54:48.373 INFO:tasks.workunit.client.0.smithi090.stdout:1/719: mkdir d8/d1a/d1d/d2c/d4a/d5a/dec 0 2024-04-20T10:54:48.373 INFO:tasks.workunit.client.0.smithi090.stdout:1/720: write d8/d1a/d1d/f24 [891108,38559] 0 2024-04-20T10:54:48.373 INFO:tasks.workunit.client.0.smithi090.stdout:9/720: creat d0/d29/ff2 x:0 0 0 2024-04-20T10:54:48.373 INFO:tasks.workunit.client.0.smithi090.stdout:1/721: rmdir d8/d1a 39 2024-04-20T10:54:48.375 INFO:tasks.workunit.client.0.smithi090.stdout:1/722: creat d8/d1a/d1d/d2c/d3f/fed x:0 0 0 2024-04-20T10:54:48.388 INFO:tasks.workunit.client.0.smithi090.stdout:2/700: dread d11/d1a/d37/f93 [0,4194304] 0 2024-04-20T10:54:48.389 INFO:tasks.workunit.client.0.smithi090.stdout:2/701: truncate d11/f28 1334649 0 2024-04-20T10:54:48.390 INFO:tasks.workunit.client.0.smithi090.stdout:2/702: creat d11/d1a/d37/d85/d87/fe9 x:0 0 0 2024-04-20T10:54:48.391 INFO:tasks.workunit.client.0.smithi090.stdout:2/703: creat d11/d1f/d2e/d6e/dc9/fea x:0 0 0 2024-04-20T10:54:48.392 INFO:tasks.workunit.client.0.smithi090.stdout:2/704: truncate d11/d1f/d2e/f8e 2389033 0 2024-04-20T10:54:48.393 INFO:tasks.workunit.client.0.smithi090.stdout:2/705: creat d11/d1f/d2e/d6e/dc9/feb x:0 0 0 2024-04-20T10:54:48.394 INFO:tasks.workunit.client.0.smithi090.stdout:2/706: symlink d11/d1a/d4a/d80/lec 0 2024-04-20T10:54:48.395 INFO:tasks.workunit.client.0.smithi090.stdout:2/707: creat d11/d1a/d30/d8d/fed x:0 0 0 2024-04-20T10:54:48.395 INFO:tasks.workunit.client.0.smithi090.stdout:2/708: write d11/fbe [825703,29052] 0 2024-04-20T10:54:48.396 INFO:tasks.workunit.client.0.smithi090.stdout:7/599: dwrite d11/d13/d22/d24/f5e [0,4194304] 0 2024-04-20T10:54:48.397 INFO:tasks.workunit.client.0.smithi090.stdout:7/600: rmdir d11 39 2024-04-20T10:54:48.399 INFO:tasks.workunit.client.0.smithi090.stdout:0/677: dwrite d14/d19/d2b/d52/dab/da1/fad [0,4194304] 0 2024-04-20T10:54:48.399 INFO:tasks.workunit.client.0.smithi090.stdout:0/678: write f0 [1005764,123905] 0 2024-04-20T10:54:48.399 INFO:tasks.workunit.client.0.smithi090.stdout:9/721: dwrite d0/fa6 [0,4194304] 0 2024-04-20T10:54:48.401 INFO:tasks.workunit.client.0.smithi090.stdout:1/723: dwrite d8/d1a/d1d/f94 [0,4194304] 0 2024-04-20T10:54:48.402 INFO:tasks.workunit.client.0.smithi090.stdout:0/679: link d14/d19/d2b/d61/f72 d14/d19/fd8 0 2024-04-20T10:54:48.402 INFO:tasks.workunit.client.0.smithi090.stdout:0/680: chown d14/d19/cd6 1744 1 2024-04-20T10:54:48.402 INFO:tasks.workunit.client.0.smithi090.stdout:0/681: fdatasync d14/d19/f78 0 2024-04-20T10:54:48.402 INFO:tasks.workunit.client.0.smithi090.stdout:0/682: readlink d14/d39/l4d 0 2024-04-20T10:54:48.404 INFO:tasks.workunit.client.0.smithi090.stdout:3/629: sync 2024-04-20T10:54:48.404 INFO:tasks.workunit.client.0.smithi090.stdout:6/546: sync 2024-04-20T10:54:48.405 INFO:tasks.workunit.client.0.smithi090.stdout:5/804: sync 2024-04-20T10:54:48.405 INFO:tasks.workunit.client.0.smithi090.stdout:4/619: sync 2024-04-20T10:54:48.405 INFO:tasks.workunit.client.0.smithi090.stdout:8/660: sync 2024-04-20T10:54:48.407 INFO:tasks.workunit.client.0.smithi090.stdout:1/724: creat d8/d1a/d1d/d2c/d4a/d93/d5d/fee x:0 0 0 2024-04-20T10:54:48.409 INFO:tasks.workunit.client.0.smithi090.stdout:0/683: mknod d14/d39/da6/cd9 0 2024-04-20T10:54:48.412 INFO:tasks.workunit.client.0.smithi090.stdout:9/722: rename d0/d29/d4f to d0/d29/d36/d63/d1f/d79/df3 0 2024-04-20T10:54:48.412 INFO:tasks.workunit.client.0.smithi090.stdout:9/723: write d0/d29/d36/d63/d1c/fb0 [754443,113956] 0 2024-04-20T10:54:48.412 INFO:tasks.workunit.client.0.smithi090.stdout:9/724: write d0/d29/d36/d63/f1b [754240,92566] 0 2024-04-20T10:54:48.413 INFO:tasks.workunit.client.0.smithi090.stdout:3/630: creat d7/d11/fcc x:0 0 0 2024-04-20T10:54:48.413 INFO:tasks.workunit.client.0.smithi090.stdout:0/684: dread d14/d19/d2b/d8e/d43/f4a [0,4194304] 0 2024-04-20T10:54:48.414 INFO:tasks.workunit.client.0.smithi090.stdout:3/631: dread d7/d15/d47/fc2 [0,4194304] 0 2024-04-20T10:54:48.415 INFO:tasks.workunit.client.0.smithi090.stdout:3/632: fdatasync d7/d11/fb3 0 2024-04-20T10:54:48.415 INFO:tasks.workunit.client.0.smithi090.stdout:5/805: getdents d1/da/d14/dda 0 2024-04-20T10:54:48.415 INFO:tasks.workunit.client.0.smithi090.stdout:4/620: read d7/d9/d47/d63/d42/f67 [3531672,126324] 0 2024-04-20T10:54:48.416 INFO:tasks.workunit.client.0.smithi090.stdout:0/685: dread d14/d19/f71 [0,4194304] 0 2024-04-20T10:54:48.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/633: dread d7/d15/d47/fc2 [0,4194304] 0 2024-04-20T10:54:48.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/634: dread - d7/d35/f6b zero size 2024-04-20T10:54:48.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/635: write d7/d11/f46 [1954240,78050] 0 2024-04-20T10:54:48.417 INFO:tasks.workunit.client.0.smithi090.stdout:8/661: truncate d0/d11/d22/f23 1836252 0 2024-04-20T10:54:48.417 INFO:tasks.workunit.client.0.smithi090.stdout:8/662: readlink d0/l10 0 2024-04-20T10:54:48.418 INFO:tasks.workunit.client.0.smithi090.stdout:1/725: creat d8/d1a/d1d/d2c/d4a/d5a/db2/fef x:0 0 0 2024-04-20T10:54:48.419 INFO:tasks.workunit.client.0.smithi090.stdout:6/547: link d1/d4/d26/d11/c5e d1/d4/cba 0 2024-04-20T10:54:48.420 INFO:tasks.workunit.client.0.smithi090.stdout:9/725: creat d0/d29/d36/d63/d1f/ff4 x:0 0 0 2024-04-20T10:54:48.421 INFO:tasks.workunit.client.0.smithi090.stdout:9/726: chown d0/d29/d36/d63/d1f/d79/df3/cad 86330662 1 2024-04-20T10:54:48.421 INFO:tasks.workunit.client.0.smithi090.stdout:9/727: stat d0/d29/d36/d63/d1f/d34/d70/db8 0 2024-04-20T10:54:48.421 INFO:tasks.workunit.client.0.smithi090.stdout:7/601: dwrite d11/d13/d22/f64 [0,4194304] 0 2024-04-20T10:54:48.421 INFO:tasks.workunit.client.0.smithi090.stdout:7/602: chown d11/d13/d5b/c6e 2117879 1 2024-04-20T10:54:48.422 INFO:tasks.workunit.client.0.smithi090.stdout:5/806: truncate d1/da/d1f/f25 3919768 0 2024-04-20T10:54:48.422 INFO:tasks.workunit.client.0.smithi090.stdout:2/709: dwrite d11/d1a/d30/d8d/fed [0,4194304] 0 2024-04-20T10:54:48.423 INFO:tasks.workunit.client.0.smithi090.stdout:5/807: dread d1/da/d1f/dad/fcc [0,4194304] 0 2024-04-20T10:54:48.424 INFO:tasks.workunit.client.0.smithi090.stdout:0/686: mknod d14/d19/d31/d34/cda 0 2024-04-20T10:54:48.424 INFO:tasks.workunit.client.0.smithi090.stdout:0/687: readlink d14/d19/d2b/d52/d55/d5b/d7f/lc6 0 2024-04-20T10:54:48.424 INFO:tasks.workunit.client.0.smithi090.stdout:0/688: stat d14/d19/d31/d34/d3b 0 2024-04-20T10:54:48.426 INFO:tasks.workunit.client.0.smithi090.stdout:3/636: rename d7/d15/d2a/d8d/fba to d7/d43/fcd 0 2024-04-20T10:54:48.427 INFO:tasks.workunit.client.0.smithi090.stdout:8/663: creat d0/d11/fdb x:0 0 0 2024-04-20T10:54:48.427 INFO:tasks.workunit.client.0.smithi090.stdout:8/664: fdatasync d0/d2d/d44/fc8 0 2024-04-20T10:54:48.431 INFO:tasks.workunit.client.0.smithi090.stdout:1/726: read d8/d1a/d1d/d67/f61 [2498084,129664] 0 2024-04-20T10:54:48.431 INFO:tasks.workunit.client.0.smithi090.stdout:6/548: link d1/d10/lb0 d1/d19/d36/d28/lbb 0 2024-04-20T10:54:48.431 INFO:tasks.workunit.client.0.smithi090.stdout:6/549: fdatasync d1/d19/d36/f91 0 2024-04-20T10:54:48.431 INFO:tasks.workunit.client.0.smithi090.stdout:6/550: chown d1/d10/ca5 234 1 2024-04-20T10:54:48.432 INFO:tasks.workunit.client.0.smithi090.stdout:7/603: link d11/d13/d5b/db8/dbf/da9/fbc d11/d13/d5b/fcc 0 2024-04-20T10:54:48.432 INFO:tasks.workunit.client.0.smithi090.stdout:7/604: dread - d11/d13/d5b/fcc zero size 2024-04-20T10:54:48.433 INFO:tasks.workunit.client.0.smithi090.stdout:4/621: dwrite d7/d9/d17/f18 [0,4194304] 0 2024-04-20T10:54:48.438 INFO:tasks.workunit.client.0.smithi090.stdout:2/710: truncate d11/d1f/d2e/f8f 2209973 0 2024-04-20T10:54:48.438 INFO:tasks.workunit.client.0.smithi090.stdout:5/808: mkdir d1/da/d1f/d115 0 2024-04-20T10:54:48.438 INFO:tasks.workunit.client.0.smithi090.stdout:0/689: creat d14/d19/d2b/d8e/fdb x:0 0 0 2024-04-20T10:54:48.438 INFO:tasks.workunit.client.0.smithi090.stdout:5/809: chown d1/d2f/d85/dbd/d10c/d103 15 1 2024-04-20T10:54:48.438 INFO:tasks.workunit.client.0.smithi090.stdout:0/690: chown d14/d19/d2b/d52/d55/d5b/d7f 2 1 2024-04-20T10:54:48.439 INFO:tasks.workunit.client.0.smithi090.stdout:4/622: write d7/f6e [2049922,121174] 0 2024-04-20T10:54:48.440 INFO:tasks.workunit.client.0.smithi090.stdout:4/623: chown d7/f54 11 1 2024-04-20T10:54:48.447 INFO:tasks.workunit.client.0.smithi090.stdout:8/665: symlink d0/d11/d22/d53/d8e/d92/ldc 0 2024-04-20T10:54:48.447 INFO:tasks.workunit.client.0.smithi090.stdout:5/810: dread d1/da/d1f/dad/dc8/fd9 [0,4194304] 0 2024-04-20T10:54:48.447 INFO:tasks.workunit.client.0.smithi090.stdout:5/811: chown d1/da/d14/d47/d50/cb8 7 1 2024-04-20T10:54:48.448 INFO:tasks.workunit.client.0.smithi090.stdout:1/727: rmdir d8/d1a/d1d/d2c/d4a/d93/d9e 39 2024-04-20T10:54:48.449 INFO:tasks.workunit.client.0.smithi090.stdout:6/551: truncate d1/d19/d36/d1e/d1f/d3f/d54/f62 4158202 0 2024-04-20T10:54:48.451 INFO:tasks.workunit.client.0.smithi090.stdout:7/605: dwrite d11/d1a/d3b/d79/f99 [0,4194304] 0 2024-04-20T10:54:48.452 INFO:tasks.workunit.client.0.smithi090.stdout:2/711: creat d11/d1a/d30/fee x:0 0 0 2024-04-20T10:54:48.452 INFO:tasks.workunit.client.0.smithi090.stdout:2/712: dread - d11/d1f/d2e/d6e/dc9/fd7 zero size 2024-04-20T10:54:48.452 INFO:tasks.workunit.client.0.smithi090.stdout:2/713: write d11/f1c [2034078,25872] 0 2024-04-20T10:54:48.453 INFO:tasks.workunit.client.0.smithi090.stdout:0/691: mkdir d14/d19/d2b/d52/dab/ddc 0 2024-04-20T10:54:48.455 INFO:tasks.workunit.client.0.smithi090.stdout:4/624: mknod d7/dbd/cc5 0 2024-04-20T10:54:48.457 INFO:tasks.workunit.client.0.smithi090.stdout:0/692: dread f13 [0,4194304] 0 2024-04-20T10:54:48.457 INFO:tasks.workunit.client.0.smithi090.stdout:8/666: creat d0/d2d/d49/fdd x:0 0 0 2024-04-20T10:54:48.460 INFO:tasks.workunit.client.0.smithi090.stdout:6/552: mknod d1/d19/cbc 0 2024-04-20T10:54:48.460 INFO:tasks.workunit.client.0.smithi090.stdout:6/553: dread - d1/d19/d36/d1e/d1f/d3f/d81/fb7 zero size 2024-04-20T10:54:48.462 INFO:tasks.workunit.client.0.smithi090.stdout:0/693: dread d14/f80 [0,4194304] 0 2024-04-20T10:54:48.462 INFO:tasks.workunit.client.0.smithi090.stdout:0/694: dread - d14/d19/d2b/d52/f69 zero size 2024-04-20T10:54:48.464 INFO:tasks.workunit.client.0.smithi090.stdout:0/695: dread d14/d19/d31/d34/d3b/f74 [0,4194304] 0 2024-04-20T10:54:48.465 INFO:tasks.workunit.client.0.smithi090.stdout:4/625: getdents d7/d9/d17 0 2024-04-20T10:54:48.465 INFO:tasks.workunit.client.0.smithi090.stdout:4/626: write d7/d9/d17/f48 [370877,89349] 0 2024-04-20T10:54:48.466 INFO:tasks.workunit.client.0.smithi090.stdout:8/667: getdents d0/dac/dcf 0 2024-04-20T10:54:48.466 INFO:tasks.workunit.client.0.smithi090.stdout:8/668: fsync d0/d26/f86 0 2024-04-20T10:54:48.466 INFO:tasks.workunit.client.0.smithi090.stdout:8/669: truncate d0/d26/da7/fbb 522328 0 2024-04-20T10:54:48.468 INFO:tasks.workunit.client.0.smithi090.stdout:5/812: rename d1/d2f/d3d/d40/d6c/c6e to d1/d2f/d85/dbd/d10c/c116 0 2024-04-20T10:54:48.469 INFO:tasks.workunit.client.0.smithi090.stdout:6/554: symlink d1/d19/d25/lbd 0 2024-04-20T10:54:48.470 INFO:tasks.workunit.client.0.smithi090.stdout:0/696: symlink d14/d19/dca/ldd 0 2024-04-20T10:54:48.470 INFO:tasks.workunit.client.0.smithi090.stdout:0/697: write f13 [2113643,119285] 0 2024-04-20T10:54:48.472 INFO:tasks.workunit.client.0.smithi090.stdout:2/714: rename d11/d1a/d4a/d80/lec to d11/d1f/d2e/d6e/dc7/de2/lef 0 2024-04-20T10:54:48.472 INFO:tasks.workunit.client.0.smithi090.stdout:1/728: dwrite d8/d1a/d1d/d7a/d9a/f4b [0,4194304] 0 2024-04-20T10:54:48.474 INFO:tasks.workunit.client.0.smithi090.stdout:5/813: link d1/da/d1f/f25 d1/d2f/f117 0 2024-04-20T10:54:48.476 INFO:tasks.workunit.client.0.smithi090.stdout:6/555: creat d1/d19/d25/fbe x:0 0 0 2024-04-20T10:54:48.477 INFO:tasks.workunit.client.0.smithi090.stdout:4/627: rename d7/c7a to d7/dbd/cc6 0 2024-04-20T10:54:48.477 INFO:tasks.workunit.client.0.smithi090.stdout:4/628: write d7/d9/d47/d63/d3d/f78 [3703982,26344] 0 2024-04-20T10:54:48.479 INFO:tasks.workunit.client.0.smithi090.stdout:2/715: getdents d11/d1a/d37 0 2024-04-20T10:54:48.479 INFO:tasks.workunit.client.0.smithi090.stdout:7/606: dwrite d11/d13/d5b/db8/dbf/f9c [0,4194304] 0 2024-04-20T10:54:48.483 INFO:tasks.workunit.client.0.smithi090.stdout:5/814: mknod d1/da/d1f/d115/c118 0 2024-04-20T10:54:48.483 INFO:tasks.workunit.client.0.smithi090.stdout:5/815: dread - d1/da/d14/d47/fb6 zero size 2024-04-20T10:54:48.485 INFO:tasks.workunit.client.0.smithi090.stdout:4/629: link d7/d9/d17/f27 d7/d9/d92/fc7 0 2024-04-20T10:54:48.486 INFO:tasks.workunit.client.0.smithi090.stdout:2/716: getdents d11/db0 0 2024-04-20T10:54:48.486 INFO:tasks.workunit.client.0.smithi090.stdout:2/717: fsync d11/d1f/d2e/dad/fba 0 2024-04-20T10:54:48.490 INFO:tasks.workunit.client.0.smithi090.stdout:7/607: creat d11/d13/d33/d44/d89/d98/dc7/fcd x:0 0 0 2024-04-20T10:54:48.491 INFO:tasks.workunit.client.0.smithi090.stdout:0/698: rename d14/d19/d2b/d8e/d43/d6d/f91 to d14/d19/d31/fde 0 2024-04-20T10:54:48.491 INFO:tasks.workunit.client.0.smithi090.stdout:0/699: fsync d14/d19/d2b/d8e/f4f 0 2024-04-20T10:54:48.492 INFO:tasks.workunit.client.0.smithi090.stdout:4/630: creat d7/d9/d47/d63/d42/fc8 x:0 0 0 2024-04-20T10:54:48.494 INFO:tasks.workunit.client.0.smithi090.stdout:8/670: dwrite d0/d3a/d9f/d52/fb6 [0,4194304] 0 2024-04-20T10:54:48.494 INFO:tasks.workunit.client.0.smithi090.stdout:1/729: dwrite d8/d1a/d1d/d2c/d62/fd6 [0,4194304] 0 2024-04-20T10:54:48.494 INFO:tasks.workunit.client.0.smithi090.stdout:7/608: unlink d11/d13/d23/f45 0 2024-04-20T10:54:48.496 INFO:tasks.workunit.client.0.smithi090.stdout:0/700: getdents d14/d19/d2b/d8e/d43/d5c/d70 0 2024-04-20T10:54:48.496 INFO:tasks.workunit.client.0.smithi090.stdout:0/701: write d14/f5f [851905,46094] 0 2024-04-20T10:54:48.496 INFO:tasks.workunit.client.0.smithi090.stdout:0/702: chown d14/d19/d2b/d52/d55/d5b/d7f/lc6 7 1 2024-04-20T10:54:48.500 INFO:tasks.workunit.client.0.smithi090.stdout:8/671: creat d0/d3a/d4a/d81/fde x:0 0 0 2024-04-20T10:54:48.501 INFO:tasks.workunit.client.0.smithi090.stdout:2/718: write d11/d1a/f2c [1519201,39060] 0 2024-04-20T10:54:48.502 INFO:tasks.workunit.client.0.smithi090.stdout:6/556: dwrite d1/d4/d26/d11/d4a/d6b/db5/db9/fb2 [0,4194304] 0 2024-04-20T10:54:48.502 INFO:tasks.workunit.client.0.smithi090.stdout:6/557: truncate d1/d4/d26/d11/d4a/d6b/db5/db9/fb2 4208303 0 2024-04-20T10:54:48.502 INFO:tasks.workunit.client.0.smithi090.stdout:7/609: dread d11/d13/d33/d44/d89/fbd [0,4194304] 0 2024-04-20T10:54:48.505 INFO:tasks.workunit.client.0.smithi090.stdout:1/730: creat d8/d1a/d1d/d2c/ff0 x:0 0 0 2024-04-20T10:54:48.505 INFO:tasks.workunit.client.0.smithi090.stdout:1/731: fsync d8/d1a/d1d/d67/f97 0 2024-04-20T10:54:48.505 INFO:tasks.workunit.client.0.smithi090.stdout:5/816: dwrite d1/d2f/d3d/d40/d89/f9a [0,4194304] 0 2024-04-20T10:54:48.507 INFO:tasks.workunit.client.0.smithi090.stdout:0/703: link d14/d19/fd8 d14/d19/d2b/d52/dab/fdf 0 2024-04-20T10:54:48.508 INFO:tasks.workunit.client.0.smithi090.stdout:8/672: rename d0/d11/l4b to d0/d11/ldf 0 2024-04-20T10:54:48.510 INFO:tasks.workunit.client.0.smithi090.stdout:6/558: unlink d1/d4/d26/c53 0 2024-04-20T10:54:48.511 INFO:tasks.workunit.client.0.smithi090.stdout:6/559: chown d1/d19/d36/l51 203102 1 2024-04-20T10:54:48.511 INFO:tasks.workunit.client.0.smithi090.stdout:7/610: symlink d11/d13/d22/d27/dc2/lce 0 2024-04-20T10:54:48.513 INFO:tasks.workunit.client.0.smithi090.stdout:1/732: creat d8/ff1 x:0 0 0 2024-04-20T10:54:48.513 INFO:tasks.workunit.client.0.smithi090.stdout:1/733: fdatasync d8/d1a/d1d/d2c/d4a/fa6 0 2024-04-20T10:54:48.514 INFO:tasks.workunit.client.0.smithi090.stdout:4/631: dwrite d7/d9/d47/d63/d42/d8f/da2/faa [0,4194304] 0 2024-04-20T10:54:48.516 INFO:tasks.workunit.client.0.smithi090.stdout:5/817: rmdir d1/da/d14 39 2024-04-20T10:54:48.518 INFO:tasks.workunit.client.0.smithi090.stdout:0/704: link d14/d19/d2b/d8e/d43/d5c/d70/d9b/cd2 d14/d19/d2b/d52/dab/ddc/ce0 0 2024-04-20T10:54:48.518 INFO:tasks.workunit.client.0.smithi090.stdout:0/705: fsync d14/d19/d2b/f83 0 2024-04-20T10:54:48.518 INFO:tasks.workunit.client.0.smithi090.stdout:0/706: chown d14/d19/d31/d34/d3b/f74 4 1 2024-04-20T10:54:48.518 INFO:tasks.workunit.client.0.smithi090.stdout:0/707: chown d14/d19/d2b/d52/dab/da1/fad 1 1 2024-04-20T10:54:48.519 INFO:tasks.workunit.client.0.smithi090.stdout:8/673: mkdir d0/d11/d22/d53/d57/de0 0 2024-04-20T10:54:48.519 INFO:tasks.workunit.client.0.smithi090.stdout:8/674: write d0/d11/d22/fb3 [229114,103318] 0 2024-04-20T10:54:48.520 INFO:tasks.workunit.client.0.smithi090.stdout:1/734: mkdir d8/d1a/d1d/d2c/d4a/d5a/db2/df2 0 2024-04-20T10:54:48.521 INFO:tasks.workunit.client.0.smithi090.stdout:4/632: creat d7/d9/d17/d56/fc9 x:0 0 0 2024-04-20T10:54:48.522 INFO:tasks.workunit.client.0.smithi090.stdout:5/818: symlink d1/d55/l119 0 2024-04-20T10:54:48.523 INFO:tasks.workunit.client.0.smithi090.stdout:8/675: rename d0/d2d/f93 to d0/d26/da7/fe1 0 2024-04-20T10:54:48.524 INFO:tasks.workunit.client.0.smithi090.stdout:1/735: mkdir d8/d1a/d1d/d67/de2/df3 0 2024-04-20T10:54:48.525 INFO:tasks.workunit.client.0.smithi090.stdout:8/676: write d0/d3a/d9f/f2b [1684785,24422] 0 2024-04-20T10:54:48.526 INFO:tasks.workunit.client.0.smithi090.stdout:4/633: mknod d7/d9/d47/cca 0 2024-04-20T10:54:48.526 INFO:tasks.workunit.client.0.smithi090.stdout:4/634: truncate d7/d9/d47/d63/d3d/f75 83116 0 2024-04-20T10:54:48.527 INFO:tasks.workunit.client.0.smithi090.stdout:5/819: symlink d1/da/d14/dda/l11a 0 2024-04-20T10:54:48.528 INFO:tasks.workunit.client.0.smithi090.stdout:8/677: creat d0/d11/d22/d53/d57/fe2 x:0 0 0 2024-04-20T10:54:48.529 INFO:tasks.workunit.client.0.smithi090.stdout:5/820: creat d1/da/d14/d113/f11b x:0 0 0 2024-04-20T10:54:48.530 INFO:tasks.workunit.client.0.smithi090.stdout:5/821: readlink d1/da/d14/d47/d50/le6 0 2024-04-20T10:54:48.530 INFO:tasks.workunit.client.0.smithi090.stdout:5/822: chown d1/d2f/d85/fd5 820794 1 2024-04-20T10:54:48.530 INFO:tasks.workunit.client.0.smithi090.stdout:5/823: readlink d1/d55/l105 0 2024-04-20T10:54:48.530 INFO:tasks.workunit.client.0.smithi090.stdout:5/824: dread - d1/de/d96/fed zero size 2024-04-20T10:54:48.543 INFO:tasks.workunit.client.0.smithi090.stdout:1/736: write d8/f7f [1650689,27293] 0 2024-04-20T10:54:48.543 INFO:tasks.workunit.client.0.smithi090.stdout:2/719: dwrite d11/d1a/d4a/f4e [0,4194304] 0 2024-04-20T10:54:48.543 INFO:tasks.workunit.client.0.smithi090.stdout:6/560: dwrite d1/fb8 [0,4194304] 0 2024-04-20T10:54:48.543 INFO:tasks.workunit.client.0.smithi090.stdout:6/561: chown d1/f65 1987337 1 2024-04-20T10:54:48.543 INFO:tasks.workunit.client.0.smithi090.stdout:2/720: truncate d11/d1a/d37/d85/d87/fe9 568437 0 2024-04-20T10:54:48.544 INFO:tasks.workunit.client.0.smithi090.stdout:2/721: chown d11/d1a/d2b/f84 192307217 1 2024-04-20T10:54:48.544 INFO:tasks.workunit.client.0.smithi090.stdout:6/562: truncate d1/d19/d36/d1e/d1f/d3f/f96 410839 0 2024-04-20T10:54:48.544 INFO:tasks.workunit.client.0.smithi090.stdout:2/722: stat d11/d1a/d2b/l43 0 2024-04-20T10:54:48.545 INFO:tasks.workunit.client.0.smithi090.stdout:1/737: write d8/d1a/f47 [1309551,27937] 0 2024-04-20T10:54:48.545 INFO:tasks.workunit.client.0.smithi090.stdout:2/723: mkdir d11/d1a/d2b/df0 0 2024-04-20T10:54:48.547 INFO:tasks.workunit.client.0.smithi090.stdout:8/678: dwrite d0/dac/fc2 [0,4194304] 0 2024-04-20T10:54:48.547 INFO:tasks.workunit.client.0.smithi090.stdout:8/679: readlink d0/d2d/l3f 0 2024-04-20T10:54:48.547 INFO:tasks.workunit.client.0.smithi090.stdout:8/680: stat d0/d11/d22/d53/d57/f7d 0 2024-04-20T10:54:48.547 INFO:tasks.workunit.client.0.smithi090.stdout:8/681: write d0/d11/d22/d53/d57/fe2 [227185,48744] 0 2024-04-20T10:54:48.547 INFO:tasks.workunit.client.0.smithi090.stdout:1/738: mknod d8/cf4 0 2024-04-20T10:54:48.547 INFO:tasks.workunit.client.0.smithi090.stdout:2/724: rename d11/d1f/d2e/l5a to d11/d1a/d4a/d55/lf1 0 2024-04-20T10:54:48.548 INFO:tasks.workunit.client.0.smithi090.stdout:8/682: creat d0/d2d/d49/d67/fe3 x:0 0 0 2024-04-20T10:54:48.549 INFO:tasks.workunit.client.0.smithi090.stdout:5/825: dwrite d1/d2f/fc4 [0,4194304] 0 2024-04-20T10:54:48.549 INFO:tasks.workunit.client.0.smithi090.stdout:5/826: write d1/d41/d98/f110 [166938,5623] 0 2024-04-20T10:54:48.550 INFO:tasks.workunit.client.0.smithi090.stdout:1/739: rename d8/l18 to d8/d1a/d1d/d2c/d4a/d7b/lf5 0 2024-04-20T10:54:48.550 INFO:tasks.workunit.client.0.smithi090.stdout:1/740: chown d8/d1a/d1d/d67/f82 7 1 2024-04-20T10:54:48.551 INFO:tasks.workunit.client.0.smithi090.stdout:1/741: stat d8/d1a/d1d/d2c/d4a/d93/dd2 0 2024-04-20T10:54:48.553 INFO:tasks.workunit.client.0.smithi090.stdout:5/827: creat d1/d41/d98/d101/f11c x:0 0 0 2024-04-20T10:54:48.554 INFO:tasks.workunit.client.0.smithi090.stdout:1/742: truncate d8/d1a/d1d/d2c/d4a/f8b 496561 0 2024-04-20T10:54:48.557 INFO:tasks.workunit.client.0.smithi090.stdout:5/828: getdents d1/da/d1f/d115 0 2024-04-20T10:54:48.558 INFO:tasks.workunit.client.0.smithi090.stdout:1/743: symlink d8/d1a/d1d/d7a/lf6 0 2024-04-20T10:54:48.558 INFO:tasks.workunit.client.0.smithi090.stdout:1/744: readlink d8/d1a/d1d/d2c/d4a/l8c 0 2024-04-20T10:54:48.559 INFO:tasks.workunit.client.0.smithi090.stdout:5/829: rmdir d1/de/dcf 39 2024-04-20T10:54:48.561 INFO:tasks.workunit.client.0.smithi090.stdout:1/745: rename d8/d1a/d1d/d2c/d4a/d7b/c9d to d8/d1a/d1d/d2c/d4a/d7b/cf7 0 2024-04-20T10:54:48.562 INFO:tasks.workunit.client.0.smithi090.stdout:5/830: rename d1/da/d16/fef to d1/d2f/d85/dbd/d10c/f11d 0 2024-04-20T10:54:48.563 INFO:tasks.workunit.client.0.smithi090.stdout:5/831: link d1/d2f/d85/fb5 d1/da/d14/dc0/f11e 0 2024-04-20T10:54:48.565 INFO:tasks.workunit.client.0.smithi090.stdout:5/832: symlink d1/d2f/l11f 0 2024-04-20T10:54:48.565 INFO:tasks.workunit.client.0.smithi090.stdout:5/833: fdatasync d1/da/d14/d47/d50/f5c 0 2024-04-20T10:54:48.565 INFO:tasks.workunit.client.0.smithi090.stdout:5/834: stat d1/d41/d98/f110 0 2024-04-20T10:54:48.566 INFO:tasks.workunit.client.0.smithi090.stdout:5/835: symlink d1/d2f/d85/dbd/d10c/l120 0 2024-04-20T10:54:48.569 INFO:tasks.workunit.client.0.smithi090.stdout:8/683: dwrite d0/d2d/d49/f73 [0,4194304] 0 2024-04-20T10:54:48.569 INFO:tasks.workunit.client.0.smithi090.stdout:1/746: dread d8/d1a/d1d/d2c/d4a/f65 [0,4194304] 0 2024-04-20T10:54:48.571 INFO:tasks.workunit.client.0.smithi090.stdout:1/747: getdents d8/d1a/d1d/d2c/d4a/d93/d9e 0 2024-04-20T10:54:48.572 INFO:tasks.workunit.client.0.smithi090.stdout:1/748: creat d8/d1a/d1d/d2c/d6e/dde/ff8 x:0 0 0 2024-04-20T10:54:48.572 INFO:tasks.workunit.client.0.smithi090.stdout:1/749: chown d8/d1a/d1d/l3c 60119 1 2024-04-20T10:54:48.573 INFO:tasks.workunit.client.0.smithi090.stdout:1/750: mknod d8/d1a/d1d/d2c/d8f/db4/dd1/cf9 0 2024-04-20T10:54:48.573 INFO:tasks.workunit.client.0.smithi090.stdout:1/751: readlink d8/d1a/d1d/d67/lcd 0 2024-04-20T10:54:48.575 INFO:tasks.workunit.client.0.smithi090.stdout:5/836: dread d1/da/ff8 [0,4194304] 0 2024-04-20T10:54:48.577 INFO:tasks.workunit.client.0.smithi090.stdout:5/837: rename d1/f58 to d1/d2f/d3d/f121 0 2024-04-20T10:54:48.577 INFO:tasks.workunit.client.0.smithi090.stdout:5/838: dread - d1/da/d1f/dad/de0/ffc zero size 2024-04-20T10:54:48.583 INFO:tasks.workunit.client.0.smithi090.stdout:1/752: dread d8/d1a/f74 [4194304,4194304] 0 2024-04-20T10:54:48.586 INFO:tasks.workunit.client.0.smithi090.stdout:8/684: dwrite d0/d26/f86 [0,4194304] 0 2024-04-20T10:54:48.588 INFO:tasks.workunit.client.0.smithi090.stdout:8/685: link d0/d11/d22/d53/d57/c68 d0/d2d/d49/d67/ce4 0 2024-04-20T10:54:48.599 INFO:tasks.workunit.client.0.smithi090.stdout:1/753: dwrite d8/f44 [0,4194304] 0 2024-04-20T10:54:48.599 INFO:tasks.workunit.client.0.smithi090.stdout:1/754: stat d8/d1a/d1d/d2c/d4a/ldd 0 2024-04-20T10:54:48.600 INFO:tasks.workunit.client.0.smithi090.stdout:1/755: read d8/d1a/d1d/d2c/d62/fc9 [30990,81550] 0 2024-04-20T10:54:48.601 INFO:tasks.workunit.client.0.smithi090.stdout:1/756: rmdir d8/d1a/d1d/d2c/d4a/d5a/dec 0 2024-04-20T10:54:48.602 INFO:tasks.workunit.client.0.smithi090.stdout:1/757: symlink d8/d1a/d1d/lfa 0 2024-04-20T10:54:48.603 INFO:tasks.workunit.client.0.smithi090.stdout:1/758: mkdir d8/d1a/d1d/d67/de2/dfb 0 2024-04-20T10:54:48.604 INFO:tasks.workunit.client.0.smithi090.stdout:8/686: dwrite d0/d2d/f30 [0,4194304] 0 2024-04-20T10:54:48.607 INFO:tasks.workunit.client.0.smithi090.stdout:8/687: rename d0/l72 to d0/d2d/dd4/le5 0 2024-04-20T10:54:48.622 INFO:tasks.workunit.client.0.smithi090.stdout:1/759: dwrite d8/fb [0,4194304] 0 2024-04-20T10:54:48.638 INFO:tasks.workunit.client.0.smithi090.stdout:9/728: sync 2024-04-20T10:54:48.638 INFO:tasks.workunit.client.0.smithi090.stdout:3/637: sync 2024-04-20T10:54:48.638 INFO:tasks.workunit.client.0.smithi090.stdout:9/729: readlink d0/d29/d36/d63/d1f/d79/df3/ld5 0 2024-04-20T10:54:48.639 INFO:tasks.workunit.client.0.smithi090.stdout:9/730: truncate d0/d29/d36/d63/d1f/d34/fac 2322216 0 2024-04-20T10:54:48.639 INFO:tasks.workunit.client.0.smithi090.stdout:9/731: stat d0/d29/d36/d63/d1f/f71 0 2024-04-20T10:54:48.641 INFO:tasks.workunit.client.0.smithi090.stdout:1/760: write d8/d1a/d1d/d67/f3d [3043085,6969] 0 2024-04-20T10:54:48.641 INFO:tasks.workunit.client.0.smithi090.stdout:1/761: truncate d8/d1a/d1d/d2c/d4a/d93/d5d/fc5 598792 0 2024-04-20T10:54:48.641 INFO:tasks.workunit.client.0.smithi090.stdout:1/762: dread - d8/d1a/d1d/d2c/d4a/d5a/db2/fef zero size 2024-04-20T10:54:48.641 INFO:tasks.workunit.client.0.smithi090.stdout:1/763: dread - d8/d1a/d1d/d7a/db0/fb6 zero size 2024-04-20T10:54:48.642 INFO:tasks.workunit.client.0.smithi090.stdout:1/764: symlink d8/d1a/d1d/d7a/lfc 0 2024-04-20T10:54:48.654 INFO:tasks.workunit.client.0.smithi090.stdout:3/638: dwrite d7/d11/fb0 [4194304,4194304] 0 2024-04-20T10:54:48.656 INFO:tasks.workunit.client.0.smithi090.stdout:3/639: link d7/d11/f2e d7/d15/d2a/d30/fce 0 2024-04-20T10:54:48.659 INFO:tasks.workunit.client.0.smithi090.stdout:9/732: dwrite d0/d29/d36/d63/fb7 [0,4194304] 0 2024-04-20T10:54:48.659 INFO:tasks.workunit.client.0.smithi090.stdout:9/733: chown d0/d29/d36/d63/d1c/d94/dcb/ccf 0 1 2024-04-20T10:54:48.664 INFO:tasks.workunit.client.0.smithi090.stdout:1/765: dwrite d8/d1a/d1d/d2c/d6e/f72 [4194304,4194304] 0 2024-04-20T10:54:48.677 INFO:tasks.workunit.client.0.smithi090.stdout:9/734: dread d0/d29/d36/d63/fb7 [0,4194304] 0 2024-04-20T10:54:48.677 INFO:tasks.workunit.client.0.smithi090.stdout:9/735: dread - d0/d29/d36/d63/d1f/d79/df3/d23/fec zero size 2024-04-20T10:54:48.677 INFO:tasks.workunit.client.0.smithi090.stdout:9/736: chown d0/d29/d36/d63/d1f/d34/d70/d52/l77 39 1 2024-04-20T10:54:48.677 INFO:tasks.workunit.client.0.smithi090.stdout:9/737: write d0/f4 [848896,59201] 0 2024-04-20T10:54:48.677 INFO:tasks.workunit.client.0.smithi090.stdout:9/738: creat d0/d29/d36/d63/d1f/d79/d9b/ff5 x:0 0 0 2024-04-20T10:54:48.678 INFO:tasks.workunit.client.0.smithi090.stdout:9/739: mknod d0/d29/d36/d63/d1f/d79/cf6 0 2024-04-20T10:54:48.684 INFO:tasks.workunit.client.0.smithi090.stdout:3/640: dwrite d7/df/f4d [0,4194304] 0 2024-04-20T10:54:48.684 INFO:tasks.workunit.client.0.smithi090.stdout:1/766: dwrite d8/d1a/d1d/d2c/ff0 [0,4194304] 0 2024-04-20T10:54:48.685 INFO:tasks.workunit.client.0.smithi090.stdout:1/767: write d8/d1a/d1d/d7a/d9a/fac [135825,22519] 0 2024-04-20T10:54:48.685 INFO:tasks.workunit.client.0.smithi090.stdout:1/768: write d8/d1a/d1d/d2c/d4a/d93/fda [753074,38199] 0 2024-04-20T10:54:48.685 INFO:tasks.workunit.client.0.smithi090.stdout:3/641: truncate d7/d26/f3c 3034541 0 2024-04-20T10:54:48.686 INFO:tasks.workunit.client.0.smithi090.stdout:1/769: creat d8/d1a/d1d/d2c/d8f/db4/dd1/ffd x:0 0 0 2024-04-20T10:54:48.687 INFO:tasks.workunit.client.0.smithi090.stdout:3/642: mknod d7/d15/d2a/d30/d48/ccf 0 2024-04-20T10:54:48.688 INFO:tasks.workunit.client.0.smithi090.stdout:1/770: getdents d8/d1a/d1d/d67 0 2024-04-20T10:54:48.690 INFO:tasks.workunit.client.0.smithi090.stdout:1/771: creat d8/d1a/d1d/d2c/d6e/ffe x:0 0 0 2024-04-20T10:54:48.690 INFO:tasks.workunit.client.0.smithi090.stdout:1/772: read d8/d1a/d1d/d2c/d4a/d93/d5d/fc5 [511083,54893] 0 2024-04-20T10:54:48.695 INFO:tasks.workunit.client.0.smithi090.stdout:3/643: write d7/d26/d5e/f61 [1510360,53509] 0 2024-04-20T10:54:48.696 INFO:tasks.workunit.client.0.smithi090.stdout:3/644: mkdir d7/d11/dd0 0 2024-04-20T10:54:48.699 INFO:tasks.workunit.client.0.smithi090.stdout:9/740: dwrite d0/f7c [4194304,4194304] 0 2024-04-20T10:54:48.700 INFO:tasks.workunit.client.0.smithi090.stdout:9/741: link d0/f91 d0/d29/ff7 0 2024-04-20T10:54:48.702 INFO:tasks.workunit.client.0.smithi090.stdout:9/742: creat d0/d29/d36/d63/d1f/dca/ff8 x:0 0 0 2024-04-20T10:54:48.702 INFO:tasks.workunit.client.0.smithi090.stdout:9/743: write d0/d29/d36/d63/d1f/d34/fac [2052412,106514] 0 2024-04-20T10:54:48.702 INFO:tasks.workunit.client.0.smithi090.stdout:9/744: write d0/f37 [2179193,72667] 0 2024-04-20T10:54:48.703 INFO:tasks.workunit.client.0.smithi090.stdout:9/745: link d0/d29/d36/d63/d1f/d34/d70/d52/lbf d0/d29/d36/d63/lf9 0 2024-04-20T10:54:48.705 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:48.705 INFO:tasks.workunit.client.0.smithi090.stdout:9/746: creat d0/d9a/ffa x:0 0 0 2024-04-20T10:54:48.708 INFO:tasks.workunit.client.0.smithi090.stdout:9/747: dread d0/d29/d36/d63/d1f/d4d/f9c [0,4194304] 0 2024-04-20T10:54:48.713 INFO:tasks.workunit.client.0.smithi090.stdout:3/645: dwrite d7/d43/f59 [0,4194304] 0 2024-04-20T10:54:48.714 INFO:tasks.workunit.client.0.smithi090.stdout:3/646: fsync d7/d43/fca 0 2024-04-20T10:54:48.714 INFO:tasks.workunit.client.0.smithi090.stdout:3/647: chown d7/d26/d5e/d88/fad 120578844 1 2024-04-20T10:54:48.715 INFO:tasks.workunit.client.0.smithi090.stdout:3/648: getdents d7/d15/d2a/d30/d93/d7f 0 2024-04-20T10:54:48.715 INFO:tasks.workunit.client.0.smithi090.stdout:3/649: mkdir d7/df/dd1 0 2024-04-20T10:54:48.730 INFO:tasks.workunit.client.0.smithi090.stdout:9/748: dwrite d0/d29/d36/d63/d1f/d79/df3/fd4 [0,4194304] 0 2024-04-20T10:54:48.731 INFO:tasks.workunit.client.0.smithi090.stdout:9/749: mknod d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/cfb 0 2024-04-20T10:54:48.731 INFO:tasks.workunit.client.0.smithi090.stdout:9/750: stat d0/d29/d36/d63/d1f/d79/df3/d23/daa 0 2024-04-20T10:54:48.732 INFO:tasks.workunit.client.0.smithi090.stdout:9/751: creat d0/d29/d36/d63/d1f/ddd/ffc x:0 0 0 2024-04-20T10:54:48.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/650: dwrite d7/d15/f8c [0,4194304] 0 2024-04-20T10:54:48.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/651: chown d7/d15/f8c 1276038230 1 2024-04-20T10:54:48.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/652: fdatasync d7/d15/f9a 0 2024-04-20T10:54:48.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/653: write d7/d15/f1d [1241998,123912] 0 2024-04-20T10:54:48.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/654: stat d7/d15/d2a/d30/d48 0 2024-04-20T10:54:48.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/655: chown d7/d15/d47/d56/fb9 3021444 1 2024-04-20T10:54:48.733 INFO:tasks.workunit.client.0.smithi090.stdout:3/656: dread - d7/d26/d78/fb8 zero size 2024-04-20T10:54:48.734 INFO:tasks.workunit.client.0.smithi090.stdout:1/773: rename d8/d1a/d1d/d2c to d8/d1a/d1d/d67/dff 0 2024-04-20T10:54:48.735 INFO:tasks.workunit.client.0.smithi090.stdout:9/752: dread d0/d29/d36/d63/d1f/d79/df3/fd7 [0,4194304] 0 2024-04-20T10:54:48.735 INFO:tasks.workunit.client.0.smithi090.stdout:3/657: getdents d7/d26/d5e/d88 0 2024-04-20T10:54:48.735 INFO:tasks.workunit.client.0.smithi090.stdout:1/774: getdents d8/d1a/d1d/d67/dff/d4a/d93 0 2024-04-20T10:54:48.736 INFO:tasks.workunit.client.0.smithi090.stdout:9/753: truncate d0/d29/d36/d63/f1b 2972063 0 2024-04-20T10:54:48.738 INFO:tasks.workunit.client.0.smithi090.stdout:1/775: symlink d8/d1a/d1d/d67/dff/d4a/d93/l100 0 2024-04-20T10:54:48.742 INFO:tasks.workunit.client.0.smithi090.stdout:9/754: mknod d0/d86/cfd 0 2024-04-20T10:54:48.742 INFO:tasks.workunit.client.0.smithi090.stdout:9/755: dread - d0/d29/d36/d63/d1f/d4d/fbb zero size 2024-04-20T10:54:48.744 INFO:tasks.workunit.client.0.smithi090.stdout:3/658: write d7/f8b [63137,44123] 0 2024-04-20T10:54:48.744 INFO:tasks.workunit.client.0.smithi090.stdout:3/659: fdatasync d7/d15/d47/f5a 0 2024-04-20T10:54:48.757 INFO:tasks.workunit.client.0.smithi090.stdout:1/776: dwrite d8/d1a/d1d/d67/dff/d4a/d93/d9e/fa3 [0,4194304] 0 2024-04-20T10:54:48.758 INFO:tasks.workunit.client.0.smithi090.stdout:1/777: fdatasync d8/d1a/d1d/d67/dff/d4a/d93/fa4 0 2024-04-20T10:54:48.760 INFO:tasks.workunit.client.0.smithi090.stdout:1/778: dread d8/d1a/d1d/d67/dff/d4a/fb9 [0,4194304] 0 2024-04-20T10:54:48.761 INFO:tasks.workunit.client.0.smithi090.stdout:1/779: readlink d8/d1a/d1d/d67/dff/d4a/ldd 0 2024-04-20T10:54:48.761 INFO:tasks.workunit.client.0.smithi090.stdout:1/780: fsync d8/d1a/d1d/d67/f23 0 2024-04-20T10:54:48.766 INFO:tasks.workunit.client.0.smithi090.stdout:1/781: write d8/d1a/f39 [3938537,122377] 0 2024-04-20T10:54:48.768 INFO:tasks.workunit.client.0.smithi090.stdout:1/782: creat d8/d1a/d1d/d67/dff/d4a/d93/dd2/dd3/f101 x:0 0 0 2024-04-20T10:54:48.769 INFO:tasks.workunit.client.0.smithi090.stdout:1/783: unlink d8/d1a/d1d/d7a/db0/cce 0 2024-04-20T10:54:48.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/756: dwrite d0/d29/d36/d63/d1f/d4d/fbb [0,4194304] 0 2024-04-20T10:54:48.771 INFO:tasks.workunit.client.0.smithi090.stdout:9/757: truncate d0/d29/d36/d63/d1f/d79/d7f/fe2 488066 0 2024-04-20T10:54:48.772 INFO:tasks.workunit.client.0.smithi090.stdout:3/660: dwrite d7/f40 [0,4194304] 0 2024-04-20T10:54:48.772 INFO:tasks.workunit.client.0.smithi090.stdout:3/661: fsync d7/d15/d47/fc2 0 2024-04-20T10:54:48.772 INFO:tasks.workunit.client.0.smithi090.stdout:1/784: rename d8/d1a/d1d/d67/f97 to d8/d1a/d4d/da5/dad/de5/f102 0 2024-04-20T10:54:48.775 INFO:tasks.workunit.client.0.smithi090.stdout:9/758: symlink d0/d29/d36/d63/d1f/d79/df3/d23/lfe 0 2024-04-20T10:54:48.775 INFO:tasks.workunit.client.0.smithi090.stdout:9/759: chown d0/d29/d36/d63/d1f 117 1 2024-04-20T10:54:48.780 INFO:tasks.workunit.client.0.smithi090.stdout:3/662: symlink d7/d15/ld2 0 2024-04-20T10:54:48.780 INFO:tasks.workunit.client.0.smithi090.stdout:3/663: dread - d7/d26/d5e/d88/fad zero size 2024-04-20T10:54:48.780 INFO:tasks.workunit.client.0.smithi090.stdout:3/664: chown d7/d43/c5b 490048 1 2024-04-20T10:54:48.781 INFO:tasks.workunit.client.0.smithi090.stdout:1/785: creat d8/d1a/d1d/d67/dff/d8f/db4/dd1/f103 x:0 0 0 2024-04-20T10:54:48.781 INFO:tasks.workunit.client.0.smithi090.stdout:1/786: chown d8/d1a/d1d/d67/dff/d4a/ldd 17159648 1 2024-04-20T10:54:48.781 INFO:tasks.workunit.client.0.smithi090.stdout:9/760: creat d0/d29/d36/d63/d1f/d79/df3/d82/fff x:0 0 0 2024-04-20T10:54:48.782 INFO:tasks.workunit.client.0.smithi090.stdout:9/761: truncate d0/d29/d36/d63/d1f/d79/d9b/fe9 470830 0 2024-04-20T10:54:48.784 INFO:tasks.workunit.client.0.smithi090.stdout:9/762: write d0/d29/f6e [3345658,72009] 0 2024-04-20T10:54:48.797 INFO:tasks.workunit.client.0.smithi090.stdout:3/665: unlink d7/d15/d2a/d8d/f8e 0 2024-04-20T10:54:48.798 INFO:tasks.workunit.client.0.smithi090.stdout:1/787: rename d8/d1a/d1d/d67/dff/f51 to d8/d1a/d1d/d67/dff/d6e/f104 0 2024-04-20T10:54:48.799 INFO:tasks.workunit.client.0.smithi090.stdout:1/788: chown d8/cf4 552420 1 2024-04-20T10:54:48.799 INFO:tasks.workunit.client.0.smithi090.stdout:1/789: chown d8/d1a/d1d/l95 911 1 2024-04-20T10:54:48.799 INFO:tasks.workunit.client.0.smithi090.stdout:9/763: symlink d0/d29/d36/d63/d1f/d34/d70/d52/l100 0 2024-04-20T10:54:48.802 INFO:tasks.workunit.client.0.smithi090.stdout:3/666: rename d7/d26/d5e to d7/df/dd1/dd3 0 2024-04-20T10:54:48.804 INFO:tasks.workunit.client.0.smithi090.stdout:1/790: truncate d8/f59 1601 0 2024-04-20T10:54:48.808 INFO:tasks.workunit.client.0.smithi090.stdout:1/791: dread d8/d1a/d1d/d67/dff/d4a/d93/d5d/fc5 [0,4194304] 0 2024-04-20T10:54:48.808 INFO:tasks.workunit.client.0.smithi090.stdout:9/764: mknod d0/d29/d36/d63/d1f/d79/d7f/c101 0 2024-04-20T10:54:48.808 INFO:tasks.workunit.client.0.smithi090.stdout:9/765: write d0/d29/d36/d63/d1f/f71 [4438039,48952] 0 2024-04-20T10:54:48.808 INFO:tasks.workunit.client.0.smithi090.stdout:9/766: truncate d0/d29/f92 476186 0 2024-04-20T10:54:48.828 INFO:tasks.workunit.client.0.smithi090.stdout:1/792: dwrite d8/d1a/d1d/d67/dff/d8f/db4/dd1/f103 [0,4194304] 0 2024-04-20T10:54:48.828 INFO:tasks.workunit.client.0.smithi090.stdout:3/667: dwrite d7/d43/f59 [0,4194304] 0 2024-04-20T10:54:48.829 INFO:tasks.workunit.client.0.smithi090.stdout:9/767: dwrite d0/d29/d36/d63/d1f/d79/df3/f84 [0,4194304] 0 2024-04-20T10:54:48.829 INFO:tasks.workunit.client.0.smithi090.stdout:9/768: write d0/fa6 [4490000,101211] 0 2024-04-20T10:54:48.829 INFO:tasks.workunit.client.0.smithi090.stdout:9/769: stat d0/d29/d36/d63/d1f/d34/d70 0 2024-04-20T10:54:48.830 INFO:tasks.workunit.client.0.smithi090.stdout:1/793: truncate d8/d1a/d1d/d67/dff/ff0 3392479 0 2024-04-20T10:54:48.830 INFO:tasks.workunit.client.0.smithi090.stdout:1/794: getdents d8/d1a/d1d/d67/de2/df3 0 2024-04-20T10:54:48.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.831+0000 7f8a651a4640 1 Processor -- start 2024-04-20T10:54:48.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.831+0000 7f8a651a4640 1 -- start start 2024-04-20T10:54:48.832 INFO:tasks.workunit.client.0.smithi090.stdout:3/668: rename d7/df/dd1/dd3/d88/d8a to d7/d43/db7/dd4 0 2024-04-20T10:54:48.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.832+0000 7f8a651a4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8a60153d60 0x7f8a600ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:48.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.832+0000 7f8a651a4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a600c4600 0x7f8a600c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:48.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.832+0000 7f8a651a4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a600acaa0 con 0x7f8a600ac2b0 2024-04-20T10:54:48.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.832+0000 7f8a651a4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8a600acdf0 con 0x7f8a600c4600 2024-04-20T10:54:48.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.832+0000 7f8a651a4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8a6015a750 con 0x7f8a60153d60 2024-04-20T10:54:48.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5f59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a600c4600 0x7f8a600c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:48.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5ed9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8a60153d60 0x7f8a600ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:48.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5f59e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a600c4600 0x7f8a600c35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36186/0 (socket says 172.21.15.90:36186) 2024-04-20T10:54:48.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5f59e640 1 -- 172.21.15.90:0/2251519809 learned_addr learned my addr 172.21.15.90:0/2251519809 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:48.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5e59c640 1 --1- 172.21.15.90:0/2251519809 >> v1:172.21.15.175:6789/0 conn(0x7f8a600ac2b0 0x7f8a600c4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:57270/0 (socket says 172.21.15.90:57270) 2024-04-20T10:54:48.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5f59e640 1 -- 172.21.15.90:0/2251519809 >> v2:172.21.15.175:3300/0 conn(0x7f8a60153d60 msgr2=0x7f8a600ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:48.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5f59e640 1 --2- 172.21.15.90:0/2251519809 >> v2:172.21.15.175:3300/0 conn(0x7f8a60153d60 0x7f8a600ab4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:48.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5f59e640 1 -- 172.21.15.90:0/2251519809 >> v1:172.21.15.175:6789/0 conn(0x7f8a600ac2b0 legacy=0x7f8a600c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:48.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.833+0000 7f8a5f59e640 1 -- 172.21.15.90:0/2251519809 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6015aa30 con 0x7f8a600c4600 2024-04-20T10:54:48.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.834+0000 7f8a5f59e640 1 --2- 172.21.15.90:0/2251519809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a600c4600 0x7f8a600c35e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8a600ca8e0 tx=0x7f8a5802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=474f27489dfcc433 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:48.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.834+0000 7f8a5dd9b640 1 -- 172.21.15.90:0/2251519809 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5802c9f0 con 0x7f8a600c4600 2024-04-20T10:54:48.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.834+0000 7f8a5dd9b640 1 -- 172.21.15.90:0/2251519809 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5802cb90 con 0x7f8a600c4600 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.834+0000 7f8a5dd9b640 1 -- 172.21.15.90:0/2251519809 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a580343f0 con 0x7f8a600c4600 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 -- 172.21.15.90:0/2251519809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a600c4600 msgr2=0x7f8a600c35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 --2- 172.21.15.90:0/2251519809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a600c4600 0x7f8a600c35e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f8a600ca8e0 tx=0x7f8a5802be50 comp rx=0 tx=0).stop 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 -- 172.21.15.90:0/2251519809 shutdown_connections 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 --2- 172.21.15.90:0/2251519809 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a600c4600 0x7f8a600c35e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 --2- 172.21.15.90:0/2251519809 >> v2:172.21.15.175:3300/0 conn(0x7f8a60153d60 0x7f8a600ab4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 -- 172.21.15.90:0/2251519809 >> 172.21.15.90:0/2251519809 conn(0x7f8a60067de0 msgr2=0x7f8a600ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 -- 172.21.15.90:0/2251519809 shutdown_connections 2024-04-20T10:54:48.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.835+0000 7f8a651a4640 1 -- 172.21.15.90:0/2251519809 wait complete. 2024-04-20T10:54:48.837 INFO:tasks.workunit.client.0.smithi090.stdout:9/770: mkdir d0/d29/d36/d63/d1f/d34/d70/d52/d102 0 2024-04-20T10:54:48.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.836+0000 7f8a651a4640 1 Processor -- start 2024-04-20T10:54:48.838 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.836+0000 7f8a651a4640 1 -- start start 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a651a4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a600ac2b0 0x7f8a600c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a651a4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a600c4600 0x7f8a60149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a651a4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a60153d60 0x7f8a6014a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a651a4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a60070fa0 con 0x7f8a60153d60 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a651a4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a60070e20 con 0x7f8a600ac2b0 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a651a4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a600c3b20 con 0x7f8a600c4600 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a60153d60 0x7f8a6014a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a60153d60 0x7f8a6014a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36198/0 (socket says 172.21.15.90:36198) 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 -- 172.21.15.90:0/3094800339 learned_addr learned my addr 172.21.15.90:0/3094800339 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5e59c640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a600c4600 0x7f8a60149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5ed9d640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a600ac2b0 0x7f8a600c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:48.839 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 -- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a600c4600 msgr2=0x7f8a60149ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a600c4600 0x7f8a60149ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 -- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a600ac2b0 msgr2=0x7f8a600c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a600ac2b0 0x7f8a600c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.837+0000 7f8a5f59e640 1 -- 172.21.15.90:0/3094800339 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a600af420 con 0x7f8a60153d60 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.838+0000 7f8a5f59e640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a60153d60 0x7f8a6014a1e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8a5802c460 tx=0x7f8a58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.838+0000 7f8a477fe640 1 -- 172.21.15.90:0/3094800339 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58044020 con 0x7f8a60153d60 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.838+0000 7f8a477fe640 1 -- 172.21.15.90:0/3094800339 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a58040470 con 0x7f8a60153d60 2024-04-20T10:54:48.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.838+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a601594f0 con 0x7f8a60153d60 2024-04-20T10:54:48.840 INFO:tasks.workunit.client.0.smithi090.stdout:1/795: rename d8/d1a/d1d/d67/dff/d4a/d5a/db2/df2 to d8/d1a/d1d/d67/dff/d4a/d5a/d105 0 2024-04-20T10:54:48.841 INFO:tasks.workunit.client.0.smithi090.stdout:1/796: stat d8/d1a/d1d/d7a/d9a 0 2024-04-20T10:54:48.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.838+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a600c9800 con 0x7f8a60153d60 2024-04-20T10:54:48.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.838+0000 7f8a477fe640 1 -- 172.21.15.90:0/3094800339 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58040860 con 0x7f8a60153d60 2024-04-20T10:54:48.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.839+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a40005290 con 0x7f8a60153d60 2024-04-20T10:54:48.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.839+0000 7f8a477fe640 1 -- 172.21.15.90:0/3094800339 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a58047020 con 0x7f8a60153d60 2024-04-20T10:54:48.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.840+0000 7f8a477fe640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a4c06c920 0x7f8a4c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:48.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.840+0000 7f8a477fe640 1 -- 172.21.15.90:0/3094800339 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 6981+0+0 (secure 0 0 0) 0x7f8a580ae850 con 0x7f8a60153d60 2024-04-20T10:54:48.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.840+0000 7f8a5ed9d640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a4c06c920 0x7f8a4c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:48.842 INFO:tasks.workunit.client.0.smithi090.stdout:9/771: truncate d0/d29/d36/d63/d1f/d79/df3/f27 237938 0 2024-04-20T10:54:48.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.841+0000 7f8a5ed9d640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a4c06c920 0x7f8a4c06ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009aa0 tx=0x7f8a50009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:48.843 INFO:tasks.workunit.client.0.smithi090.stdout:3/669: symlink d7/d35/ld5 0 2024-04-20T10:54:48.843 INFO:tasks.workunit.client.0.smithi090.stdout:9/772: creat d0/d29/d36/d63/d1f/d79/d7f/f103 x:0 0 0 2024-04-20T10:54:48.843 INFO:tasks.workunit.client.0.smithi090.stdout:9/773: write d0/d29/d36/d63/da1/fc7 [569445,26724] 0 2024-04-20T10:54:48.844 INFO:tasks.workunit.client.0.smithi090.stdout:3/670: symlink d7/d15/d2a/d30/d93/d7f/ld6 0 2024-04-20T10:54:48.845 INFO:tasks.workunit.client.0.smithi090.stdout:9/774: symlink d0/d29/d36/d63/d1f/d79/df3/l104 0 2024-04-20T10:54:48.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:48.846+0000 7f8a477fe640 1 -- 172.21.15.90:0/3094800339 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8a5804e030 con 0x7f8a60153d60 2024-04-20T10:54:48.847 INFO:tasks.workunit.client.0.smithi090.stdout:3/671: creat d7/df/dd1/dd3/fd7 x:0 0 0 2024-04-20T10:54:48.848 INFO:tasks.workunit.client.0.smithi090.stdout:9/775: mknod d0/d29/d36/d63/d1f/d34/c105 0 2024-04-20T10:54:48.848 INFO:tasks.workunit.client.0.smithi090.stdout:9/776: write d0/d29/d36/d63/d1f/d79/df3/fd3 [873463,6636] 0 2024-04-20T10:54:48.848 INFO:tasks.workunit.client.0.smithi090.stdout:9/777: getdents d0/d29/d36/d63/d1f/d79/df3/d23/de5 0 2024-04-20T10:54:48.849 INFO:tasks.workunit.client.0.smithi090.stdout:3/672: creat d7/df/dd1/dd3/fd8 x:0 0 0 2024-04-20T10:54:48.850 INFO:tasks.workunit.client.0.smithi090.stdout:3/673: chown d7/d35/fc7 1 1 2024-04-20T10:54:48.851 INFO:tasks.workunit.client.0.smithi090.stdout:9/778: unlink d0/d86/f8f 0 2024-04-20T10:54:48.851 INFO:tasks.workunit.client.0.smithi090.stdout:1/797: read d8/d1a/d1d/d67/dff/ff0 [82801,33305] 0 2024-04-20T10:54:48.851 INFO:tasks.workunit.client.0.smithi090.stdout:1/798: truncate d8/d1a/d1d/d67/dff/d4a/f8b 680624 0 2024-04-20T10:54:48.851 INFO:tasks.workunit.client.0.smithi090.stdout:9/779: read d0/d29/d36/d63/d1f/d34/d70/d52/f4c [1065964,63275] 0 2024-04-20T10:54:48.852 INFO:tasks.workunit.client.0.smithi090.stdout:9/780: write d0/d29/ff7 [2953913,38844] 0 2024-04-20T10:54:48.852 INFO:tasks.workunit.client.0.smithi090.stdout:1/799: creat d8/d1a/d1d/d67/dff/d6e/dde/f106 x:0 0 0 2024-04-20T10:54:48.853 INFO:tasks.workunit.client.0.smithi090.stdout:9/781: symlink d0/d9a/l106 0 2024-04-20T10:54:48.858 INFO:tasks.workunit.client.0.smithi090.stdout:9/782: creat d0/d29/d36/d63/d1f/d79/d7f/f107 x:0 0 0 2024-04-20T10:54:48.859 INFO:tasks.workunit.client.0.smithi090.stdout:9/783: dread - d0/d29/d36/fe6 zero size 2024-04-20T10:54:48.859 INFO:tasks.workunit.client.0.smithi090.stdout:9/784: rename d0/d29/d36/d63 to d0/d29/d36/d63/d1f/d34/d70/db8/d108 22 2024-04-20T10:54:48.867 INFO:tasks.workunit.client.0.smithi090.stdout:9/785: write d0/d29/d36/d63/d1f/f71 [3851316,19329] 0 2024-04-20T10:54:48.875 INFO:tasks.workunit.client.0.smithi090.stdout:7/611: sync 2024-04-20T10:54:48.875 INFO:tasks.workunit.client.0.smithi090.stdout:9/786: dread d0/d29/d36/d63/d1f/d79/df3/f84 [0,4194304] 0 2024-04-20T10:54:48.875 INFO:tasks.workunit.client.0.smithi090.stdout:9/787: dread - d0/d29/d36/d63/d1c/f8c zero size 2024-04-20T10:54:48.876 INFO:tasks.workunit.client.0.smithi090.stdout:9/788: mkdir d0/d29/d36/d63/d109 0 2024-04-20T10:54:48.876 INFO:tasks.workunit.client.0.smithi090.stdout:9/789: symlink d0/d29/d36/d63/d109/l10a 0 2024-04-20T10:54:48.877 INFO:tasks.workunit.client.0.smithi090.stdout:9/790: mkdir d0/d29/d36/d63/da1/d10b 0 2024-04-20T10:54:48.877 INFO:tasks.workunit.client.0.smithi090.stdout:7/612: dread d11/d1a/d3f/fba [0,4194304] 0 2024-04-20T10:54:48.878 INFO:tasks.workunit.client.0.smithi090.stdout:9/791: symlink d0/d29/d36/d63/d1f/d79/df3/d23/de5/l10c 0 2024-04-20T10:54:48.878 INFO:tasks.workunit.client.0.smithi090.stdout:9/792: chown d0/d29/d36/d63/d1c/fb0 7841043 1 2024-04-20T10:54:48.879 INFO:tasks.workunit.client.0.smithi090.stdout:7/613: unlink d11/d13/d5b/db8/f3e 0 2024-04-20T10:54:48.880 INFO:tasks.workunit.client.0.smithi090.stdout:9/793: truncate d0/d29/d36/d63/d1c/f2a 4095039 0 2024-04-20T10:54:48.880 INFO:tasks.workunit.client.0.smithi090.stdout:9/794: stat d0/f91 0 2024-04-20T10:54:48.880 INFO:tasks.workunit.client.0.smithi090.stdout:9/795: dread - d0/d29/ff2 zero size 2024-04-20T10:54:48.880 INFO:tasks.workunit.client.0.smithi090.stdout:9/796: truncate d0/d29/d36/d63/d1f/d79/df3/f84 4385334 0 2024-04-20T10:54:48.880 INFO:tasks.workunit.client.0.smithi090.stdout:7/614: truncate f9 1174170 0 2024-04-20T10:54:48.881 INFO:tasks.workunit.client.0.smithi090.stdout:7/615: write d11/d13/d22/d24/f2a [450208,70870] 0 2024-04-20T10:54:48.906 INFO:tasks.workunit.client.0.smithi090.stdout:7/616: dwrite d11/d61/f7a [0,4194304] 0 2024-04-20T10:54:48.906 INFO:tasks.workunit.client.0.smithi090.stdout:9/797: dwrite d0/d29/d36/d63/d1f/fa2 [0,4194304] 0 2024-04-20T10:54:48.906 INFO:tasks.workunit.client.0.smithi090.stdout:9/798: fdatasync d0/d29/d36/d63/d1f/ddd/fdf 0 2024-04-20T10:54:48.906 INFO:tasks.workunit.client.0.smithi090.stdout:7/617: truncate d11/d13/d23/fc5 608388 0 2024-04-20T10:54:48.906 INFO:tasks.workunit.client.0.smithi090.stdout:7/618: fdatasync d11/d13/d33/d44/d89/d98/dc7/fcd 0 2024-04-20T10:54:48.907 INFO:tasks.workunit.client.0.smithi090.stdout:9/799: read d0/d29/d36/d63/da1/fc7 [349102,11749] 0 2024-04-20T10:54:48.907 INFO:tasks.workunit.client.0.smithi090.stdout:9/800: chown d0/d29/d36/d63/d1f/d79/f6c 3 1 2024-04-20T10:54:48.907 INFO:tasks.workunit.client.0.smithi090.stdout:7/619: creat d11/d13/fcf x:0 0 0 2024-04-20T10:54:48.908 INFO:tasks.workunit.client.0.smithi090.stdout:9/801: creat d0/d29/d36/d63/d1f/d79/df3/f10d x:0 0 0 2024-04-20T10:54:48.910 INFO:tasks.workunit.client.0.smithi090.stdout:7/620: creat d11/d13/d22/d27/dc2/dc9/fd0 x:0 0 0 2024-04-20T10:54:48.913 INFO:tasks.workunit.client.0.smithi090.stdout:7/621: mkdir d11/d13/d5d/db0/dd1 0 2024-04-20T10:54:48.913 INFO:tasks.workunit.client.0.smithi090.stdout:9/802: symlink d0/l10e 0 2024-04-20T10:54:48.914 INFO:tasks.workunit.client.0.smithi090.stdout:7/622: unlink d11/d13/d22/d27/c8e 0 2024-04-20T10:54:48.915 INFO:tasks.workunit.client.0.smithi090.stdout:7/623: unlink d11/d13/d33/f54 0 2024-04-20T10:54:48.939 INFO:tasks.workunit.client.0.smithi090.stdout:9/803: dwrite d0/d29/d36/d63/d1f/d4d/fb2 [0,4194304] 0 2024-04-20T10:54:48.939 INFO:tasks.workunit.client.0.smithi090.stdout:7/624: dwrite d11/d13/d33/fb3 [0,4194304] 0 2024-04-20T10:54:48.939 INFO:tasks.workunit.client.0.smithi090.stdout:7/625: write d11/d13/d5d/d65/f8b [319286,70450] 0 2024-04-20T10:54:48.950 INFO:tasks.workunit.client.0.smithi090.stdout:9/804: read d0/d29/d36/d63/d1f/d4d/fb2 [561028,72499] 0 2024-04-20T10:54:48.950 INFO:tasks.workunit.client.0.smithi090.stdout:9/805: stat d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/ff1 0 2024-04-20T10:54:48.951 INFO:tasks.workunit.client.0.smithi090.stdout:9/806: creat d0/d29/d36/d63/d1f/d4d/f10f x:0 0 0 2024-04-20T10:54:48.951 INFO:tasks.workunit.client.0.smithi090.stdout:9/807: read d0/d29/d36/d63/f1b [932435,88081] 0 2024-04-20T10:54:48.953 INFO:tasks.workunit.client.0.smithi090.stdout:9/808: link d0/d29/d36/d63/d1f/d4d/fb2 d0/d29/d36/f110 0 2024-04-20T10:54:48.953 INFO:tasks.workunit.client.0.smithi090.stdout:9/809: dread - d0/d86/fdb zero size 2024-04-20T10:54:48.953 INFO:tasks.workunit.client.0.smithi090.stdout:9/810: write d0/d29/d36/d63/d1f/d79/d7f/fd2 [279182,49962] 0 2024-04-20T10:54:48.953 INFO:tasks.workunit.client.0.smithi090.stdout:9/811: write d0/d29/d36/d63/d1f/d79/d9b/fed [359012,106834] 0 2024-04-20T10:54:48.954 INFO:tasks.workunit.client.0.smithi090.stdout:9/812: mknod d0/d29/d36/d63/d1c/d94/c111 0 2024-04-20T10:54:48.954 INFO:tasks.workunit.client.0.smithi090.stdout:9/813: write d0/d29/d36/f110 [607944,65887] 0 2024-04-20T10:54:48.956 INFO:tasks.workunit.client.0.smithi090.stdout:7/626: dwrite f6 [4194304,4194304] 0 2024-04-20T10:54:48.956 INFO:tasks.workunit.client.0.smithi090.stdout:7/627: fdatasync d11/d13/d5b/fcc 0 2024-04-20T10:54:48.956 INFO:tasks.workunit.client.0.smithi090.stdout:7/628: chown d11/d13/d22/d24/f69 1052756145 1 2024-04-20T10:54:48.962 INFO:tasks.workunit.client.0.smithi090.stdout:9/814: dread d0/d29/d36/d63/f14 [0,4194304] 0 2024-04-20T10:54:48.975 INFO:tasks.workunit.client.0.smithi090.stdout:7/629: dwrite d11/d13/d22/d27/dc2/dc9/fd0 [0,4194304] 0 2024-04-20T10:54:48.979 INFO:tasks.workunit.client.0.smithi090.stdout:9/815: dwrite d0/f11 [0,4194304] 0 2024-04-20T10:54:48.980 INFO:tasks.workunit.client.0.smithi090.stdout:9/816: dread - d0/d9a/fe7 zero size 2024-04-20T10:54:48.980 INFO:tasks.workunit.client.0.smithi090.stdout:7/630: unlink d11/d13/d22/d24/d35/l4a 0 2024-04-20T10:54:48.983 INFO:tasks.workunit.client.0.smithi090.stdout:9/817: mkdir d0/d29/d36/d63/d1f/d34/d112 0 2024-04-20T10:54:48.984 INFO:tasks.workunit.client.0.smithi090.stdout:9/818: dread d0/d29/d36/d63/d1f/d4d/f9c [0,4194304] 0 2024-04-20T10:54:48.984 INFO:tasks.workunit.client.0.smithi090.stdout:9/819: truncate d0/d29/d36/d63/d1f/d79/d7f/f107 474011 0 2024-04-20T10:54:48.984 INFO:tasks.workunit.client.0.smithi090.stdout:9/820: readlink d0/d29/d36/d63/d1f/d79/df3/d23/l9f 0 2024-04-20T10:54:49.006 INFO:tasks.workunit.client.0.smithi090.stdout:7/631: dwrite d11/d13/d5b/db8/dbf/fa4 [0,4194304] 0 2024-04-20T10:54:49.006 INFO:tasks.workunit.client.0.smithi090.stdout:9/821: dwrite d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/ff1 [4194304,4194304] 0 2024-04-20T10:54:49.008 INFO:tasks.workunit.client.0.smithi090.stdout:9/822: getdents d0/d29/d36/d63/d1f 0 2024-04-20T10:54:49.009 INFO:tasks.workunit.client.0.smithi090.stdout:9/823: mkdir d0/d9a/d113 0 2024-04-20T10:54:49.010 INFO:tasks.workunit.client.0.smithi090.stdout:9/824: rename d0/d29/d36/d63/d1c/d94 to d0/d29/d36/d63/da1/d10b/d114 0 2024-04-20T10:54:49.013 INFO:tasks.workunit.client.0.smithi090.stdout:7/632: write d11/d13/d22/f3a [3278476,66445] 0 2024-04-20T10:54:49.014 INFO:tasks.workunit.client.0.smithi090.stdout:9/825: rmdir d0/d29/d36/d63/d1f/d34/d70/db8 39 2024-04-20T10:54:49.016 INFO:tasks.workunit.client.0.smithi090.stdout:7/633: mkdir d11/dd2 0 2024-04-20T10:54:49.016 INFO:tasks.workunit.client.0.smithi090.stdout:7/634: fsync d11/d13/d22/d27/fca 0 2024-04-20T10:54:49.042 INFO:tasks.workunit.client.0.smithi090.stdout:4/635: sync 2024-04-20T10:54:49.042 INFO:tasks.workunit.client.0.smithi090.stdout:0/708: sync 2024-04-20T10:54:49.104 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.104+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a40005850 con 0x7f8a60153d60 2024-04-20T10:54:49.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.104+0000 7f8a477fe640 1 -- 172.21.15.90:0/3094800339 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+6530 (secure 0 0 0) 0x7f8a5807c2e0 con 0x7f8a60153d60 2024-04-20T10:54:49.105 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:49.105 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":32}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:20.441524+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":31,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5367},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5367":{"gid":5367,"name":"a","rank":0,"incarnation":27,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/4126797977","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":4126797977},{"type":"v1","addr":"172.21.15.90:6835","nonce":4126797977}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5367,"qdb_cluster":[5367]},"id":2}]} 2024-04-20T10:54:49.105 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 32 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a4c06c920 msgr2=0x7f8a4c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a4c06c920 0x7f8a4c06ede0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009aa0 tx=0x7f8a50009190 comp rx=0 tx=0).stop 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a60153d60 msgr2=0x7f8a6014a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a60153d60 0x7f8a6014a1e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8a5802c460 tx=0x7f8a58004a40 comp rx=0 tx=0).stop 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 shutdown_connections 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a4c06c920 0x7f8a4c06ede0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a60153d60 0x7f8a6014a1e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:49.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a600c4600 0x7f8a60149ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:49.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.106+0000 7f8a651a4640 1 --2- 172.21.15.90:0/3094800339 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a600ac2b0 0x7f8a600c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:49.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.107+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 >> 172.21.15.90:0/3094800339 conn(0x7f8a60067de0 msgr2=0x7f8a601508c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:49.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.107+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 shutdown_connections 2024-04-20T10:54:49.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:49.107+0000 7f8a651a4640 1 -- 172.21.15.90:0/3094800339 wait complete. 2024-04-20T10:54:49.117 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:54:49.270 INFO:tasks.workunit.client.0.smithi090.stdout:7/635: rename d11/d13/d22/d82/faa to d11/d13/d5b/d6b/db7/fd3 0 2024-04-20T10:54:49.271 INFO:tasks.workunit.client.0.smithi090.stdout:0/709: creat d14/d19/d2b/d8e/d43/d5c/d70/d9b/fe1 x:0 0 0 2024-04-20T10:54:49.271 INFO:tasks.workunit.client.0.smithi090.stdout:0/710: truncate d14/d41/fd0 442160 0 2024-04-20T10:54:49.272 INFO:tasks.workunit.client.0.smithi090.stdout:4/636: creat d7/d9/d47/d63/d3d/d9e/db5/fcb x:0 0 0 2024-04-20T10:54:49.274 INFO:tasks.workunit.client.0.smithi090.stdout:7/636: link d11/d1a/d3f/fba d11/d13/d22/d82/fd4 0 2024-04-20T10:54:49.274 INFO:tasks.workunit.client.0.smithi090.stdout:7/637: dread - d11/d13/d33/d44/d89/f9f zero size 2024-04-20T10:54:49.274 INFO:tasks.workunit.client.0.smithi090.stdout:7/638: chown d11/d13/d5b/db8 1524831083 1 2024-04-20T10:54:49.275 INFO:tasks.workunit.client.0.smithi090.stdout:7/639: symlink d11/d13/d33/ld5 0 2024-04-20T10:54:49.275 INFO:tasks.workunit.client.0.smithi090.stdout:7/640: fdatasync d11/d13/d33/d44/d89/d98/dc7/fcd 0 2024-04-20T10:54:49.275 INFO:tasks.workunit.client.0.smithi090.stdout:7/641: write d11/d13/d5d/f96 [374027,130946] 0 2024-04-20T10:54:49.277 INFO:tasks.workunit.client.0.smithi090.stdout:7/642: unlink d11/d13/d5b/fb4 0 2024-04-20T10:54:49.277 INFO:tasks.workunit.client.0.smithi090.stdout:7/643: fdatasync d11/d1a/d3f/fba 0 2024-04-20T10:54:49.277 INFO:tasks.workunit.client.0.smithi090.stdout:7/644: dread - d11/d13/d33/d44/d89/d98/dc7/fcd zero size 2024-04-20T10:54:49.283 INFO:tasks.workunit.client.0.smithi090.stdout:9/826: sync 2024-04-20T10:54:49.283 INFO:tasks.workunit.client.0.smithi090.stdout:3/674: sync 2024-04-20T10:54:49.283 INFO:tasks.workunit.client.0.smithi090.stdout:8/688: sync 2024-04-20T10:54:49.283 INFO:tasks.workunit.client.0.smithi090.stdout:2/725: sync 2024-04-20T10:54:49.283 INFO:tasks.workunit.client.0.smithi090.stdout:2/726: readlink l2 0 2024-04-20T10:54:49.283 INFO:tasks.workunit.client.0.smithi090.stdout:6/563: sync 2024-04-20T10:54:49.283 INFO:tasks.workunit.client.0.smithi090.stdout:5/839: sync 2024-04-20T10:54:49.284 INFO:tasks.workunit.client.0.smithi090.stdout:3/675: write d7/d15/d2a/f67 [4627670,85200] 0 2024-04-20T10:54:49.284 INFO:tasks.workunit.client.0.smithi090.stdout:3/676: readlink d7/la0 0 2024-04-20T10:54:49.284 INFO:tasks.workunit.client.0.smithi090.stdout:1/800: sync 2024-04-20T10:54:49.284 INFO:tasks.workunit.client.0.smithi090.stdout:9/827: link d0/d29/d36/d63/d1f/d34/d70/c4e d0/d29/d36/d63/d1f/d79/df3/d82/c115 0 2024-04-20T10:54:49.285 INFO:tasks.workunit.client.0.smithi090.stdout:7/645: dread f6 [4194304,4194304] 0 2024-04-20T10:54:49.285 INFO:tasks.workunit.client.0.smithi090.stdout:7/646: chown d11/d13/d22/d27 125343 1 2024-04-20T10:54:49.285 INFO:tasks.workunit.client.0.smithi090.stdout:7/647: dread - d11/d13/f90 zero size 2024-04-20T10:54:49.285 INFO:tasks.workunit.client.0.smithi090.stdout:2/727: link d11/d1a/d30/f48 d11/d1a/d37/d85/d87/ff2 0 2024-04-20T10:54:49.286 INFO:tasks.workunit.client.0.smithi090.stdout:5/840: rename d1/d2f/d85/fd5 to d1/da/d1f/d115/f122 0 2024-04-20T10:54:49.289 INFO:tasks.workunit.client.0.smithi090.stdout:3/677: mkdir d7/d43/dd9 0 2024-04-20T10:54:49.290 INFO:tasks.workunit.client.0.smithi090.stdout:1/801: creat d8/d1a/d1d/d67/dff/d4a/d5a/f107 x:0 0 0 2024-04-20T10:54:49.290 INFO:tasks.workunit.client.0.smithi090.stdout:1/802: readlink l1 0 2024-04-20T10:54:49.290 INFO:tasks.workunit.client.0.smithi090.stdout:9/828: truncate d0/f11 4389344 0 2024-04-20T10:54:49.291 INFO:tasks.workunit.client.0.smithi090.stdout:0/711: dwrite d14/d19/f78 [0,4194304] 0 2024-04-20T10:54:49.293 INFO:tasks.workunit.client.0.smithi090.stdout:7/648: unlink d11/d13/d5b/db8/dbf/c78 0 2024-04-20T10:54:49.295 INFO:tasks.workunit.client.0.smithi090.stdout:2/728: mknod d11/d1a/d37/d85/cf3 0 2024-04-20T10:54:49.296 INFO:tasks.workunit.client.0.smithi090.stdout:3/678: symlink d7/d11/lda 0 2024-04-20T10:54:49.298 INFO:tasks.workunit.client.0.smithi090.stdout:1/803: mknod d8/d1a/d1d/d67/dff/d4a/d93/d9e/dc2/c108 0 2024-04-20T10:54:49.298 INFO:tasks.workunit.client.0.smithi090.stdout:1/804: fdatasync d8/f34 0 2024-04-20T10:54:49.298 INFO:tasks.workunit.client.0.smithi090.stdout:1/805: write d8/d1a/d1d/d67/dff/d4a/d93/d5d/fe4 [34706,53641] 0 2024-04-20T10:54:49.298 INFO:tasks.workunit.client.0.smithi090.stdout:1/806: truncate d8/d1a/f39 4994292 0 2024-04-20T10:54:49.298 INFO:tasks.workunit.client.0.smithi090.stdout:9/829: dread d0/f91 [0,4194304] 0 2024-04-20T10:54:49.299 INFO:tasks.workunit.client.0.smithi090.stdout:7/649: rename d11/d13/d23/d6c to d11/d1a/d3b/dd6 0 2024-04-20T10:54:49.302 INFO:tasks.workunit.client.0.smithi090.stdout:2/729: unlink d11/d1f/c45 0 2024-04-20T10:54:49.302 INFO:tasks.workunit.client.0.smithi090.stdout:2/730: dread - d11/d1a/d4a/d55/da1/fe8 zero size 2024-04-20T10:54:49.303 INFO:tasks.workunit.client.0.smithi090.stdout:3/679: creat d7/d43/dd9/fdb x:0 0 0 2024-04-20T10:54:49.305 INFO:tasks.workunit.client.0.smithi090.stdout:0/712: dread d14/d19/d2b/d52/d55/d5b/d7f/f87 [0,4194304] 0 2024-04-20T10:54:49.306 INFO:tasks.workunit.client.0.smithi090.stdout:0/713: getdents d14/d19/d9e 0 2024-04-20T10:54:49.306 INFO:tasks.workunit.client.0.smithi090.stdout:3/680: read d7/df/f27 [17730,30041] 0 2024-04-20T10:54:49.307 INFO:tasks.workunit.client.0.smithi090.stdout:6/564: dwrite d1/d10/f39 [0,4194304] 0 2024-04-20T10:54:49.308 INFO:tasks.workunit.client.0.smithi090.stdout:1/807: rename d8/d1a/d1d/d67/dff/d62 to d8/d1a/d1d/d67/dff/d4a/d5a/d105/d109 0 2024-04-20T10:54:49.308 INFO:tasks.workunit.client.0.smithi090.stdout:1/808: readlink d8/d1a/d1d/d67/dff/d8f/ld5 0 2024-04-20T10:54:49.309 INFO:tasks.workunit.client.0.smithi090.stdout:7/650: truncate d11/d13/d5b/d6b/db7/fd3 2325369 0 2024-04-20T10:54:49.309 INFO:tasks.workunit.client.0.smithi090.stdout:7/651: truncate d11/d13/d5d/d65/fab 599952 0 2024-04-20T10:54:49.311 INFO:tasks.workunit.client.0.smithi090.stdout:0/714: link d14/d19/f25 d14/d19/d9e/fe2 0 2024-04-20T10:54:49.312 INFO:tasks.workunit.client.0.smithi090.stdout:2/731: dread d11/d1a/d37/d85/d87/ff2 [0,4194304] 0 2024-04-20T10:54:49.313 INFO:tasks.workunit.client.0.smithi090.stdout:5/841: dwrite d1/da/d1f/f97 [0,4194304] 0 2024-04-20T10:54:49.314 INFO:tasks.workunit.client.0.smithi090.stdout:6/565: mkdir d1/d19/d36/d1e/d1f/d3f/dbf 0 2024-04-20T10:54:49.315 INFO:tasks.workunit.client.0.smithi090.stdout:3/681: creat d7/d11/dd0/fdc x:0 0 0 2024-04-20T10:54:49.317 INFO:tasks.workunit.client.0.smithi090.stdout:1/809: symlink d8/d1a/d4d/l10a 0 2024-04-20T10:54:49.317 INFO:tasks.workunit.client.0.smithi090.stdout:9/830: dwrite d0/d29/d36/d63/d1f/d79/df3/fd3 [0,4194304] 0 2024-04-20T10:54:49.320 INFO:tasks.workunit.client.0.smithi090.stdout:0/715: link d14/d19/d2b/d8e/d43/d5c/f81 d14/d19/d2b/d8e/d43/d6d/fe3 0 2024-04-20T10:54:49.323 INFO:tasks.workunit.client.0.smithi090.stdout:2/732: creat d11/d1a/d4a/d59/ff4 x:0 0 0 2024-04-20T10:54:49.323 INFO:tasks.workunit.client.0.smithi090.stdout:2/733: write d11/d1a/d4a/d59/f5c [2279442,99837] 0 2024-04-20T10:54:49.326 INFO:tasks.workunit.client.0.smithi090.stdout:6/566: link d1/d19/d36/d1e/d1f/l55 d1/d4/d26/d11/d35/d97/lc0 0 2024-04-20T10:54:49.328 INFO:tasks.workunit.client.0.smithi090.stdout:3/682: dread d7/f6c [0,4194304] 0 2024-04-20T10:54:49.328 INFO:tasks.workunit.client.0.smithi090.stdout:3/683: dread - d7/df/dd1/dd3/d88/fad zero size 2024-04-20T10:54:49.328 INFO:tasks.workunit.client.0.smithi090.stdout:1/810: mkdir d8/d1a/d1d/d67/dff/d6e/dde/d10b 0 2024-04-20T10:54:49.328 INFO:tasks.workunit.client.0.smithi090.stdout:1/811: chown d8/d1a/d1d/d67/dff/d3f/f86 36217684 1 2024-04-20T10:54:49.328 INFO:tasks.workunit.client.0.smithi090.stdout:1/812: fdatasync d8/fe 0 2024-04-20T10:54:49.328 INFO:tasks.workunit.client.0.smithi090.stdout:3/684: chown d7/d11/fb3 523738 1 2024-04-20T10:54:49.331 INFO:tasks.workunit.client.0.smithi090.stdout:9/831: truncate d0/d29/d36/f110 2363228 0 2024-04-20T10:54:49.333 INFO:tasks.workunit.client.0.smithi090.stdout:5/842: dwrite d1/d2f/d85/ff6 [0,4194304] 0 2024-04-20T10:54:49.334 INFO:tasks.workunit.client.0.smithi090.stdout:7/652: dwrite d11/fb1 [0,4194304] 0 2024-04-20T10:54:49.334 INFO:tasks.workunit.client.0.smithi090.stdout:0/716: rename d14/d19/d2b/d52/d55 to d14/d19/d2b/d52/dab/ddc/de4 0 2024-04-20T10:54:49.334 INFO:tasks.workunit.client.0.smithi090.stdout:0/717: dread - d14/d19/d2b/d8e/d43/d5c/f81 zero size 2024-04-20T10:54:49.337 INFO:tasks.workunit.client.0.smithi090.stdout:2/734: link d11/d1a/d37/cae d11/d1a/d4a/cf5 0 2024-04-20T10:54:49.337 INFO:tasks.workunit.client.0.smithi090.stdout:2/735: truncate d11/d1f/d2e/d6e/dc7/fd3 44861 0 2024-04-20T10:54:49.338 INFO:tasks.workunit.client.0.smithi090.stdout:1/813: dread d8/d1a/d1d/d67/dff/d6e/f72 [0,4194304] 0 2024-04-20T10:54:49.340 INFO:tasks.workunit.client.0.smithi090.stdout:3/685: mkdir d7/ddd 0 2024-04-20T10:54:49.340 INFO:tasks.workunit.client.0.smithi090.stdout:3/686: fdatasync d7/d43/fcd 0 2024-04-20T10:54:49.341 INFO:tasks.workunit.client.0.smithi090.stdout:9/832: mknod d0/d29/d36/d63/d1f/d34/d70/c116 0 2024-04-20T10:54:49.344 INFO:tasks.workunit.client.0.smithi090.stdout:6/567: dwrite d1/d4/d26/f9e [0,4194304] 0 2024-04-20T10:54:49.344 INFO:tasks.workunit.client.0.smithi090.stdout:5/843: creat d1/d2f/d3d/d40/f123 x:0 0 0 2024-04-20T10:54:49.345 INFO:tasks.workunit.client.0.smithi090.stdout:7/653: dread d11/d13/d22/f64 [0,4194304] 0 2024-04-20T10:54:49.347 INFO:tasks.workunit.client.0.smithi090.stdout:0/718: symlink d14/d39/d7c/le5 0 2024-04-20T10:54:49.347 INFO:tasks.workunit.client.0.smithi090.stdout:6/568: dread d1/d19/d25/f87 [0,4194304] 0 2024-04-20T10:54:49.350 INFO:tasks.workunit.client.0.smithi090.stdout:1/814: rename d8/c22 to d8/d1a/d1d/d67/dff/d4a/d93/d9e/c10c 0 2024-04-20T10:54:49.352 INFO:tasks.workunit.client.0.smithi090.stdout:9/833: truncate d0/d29/d36/d63/d1f/d79/df3/d6b/f72 531983 0 2024-04-20T10:54:49.352 INFO:tasks.workunit.client.0.smithi090.stdout:9/834: readlink d0/d9a/l106 0 2024-04-20T10:54:49.354 INFO:tasks.workunit.client.0.smithi090.stdout:0/719: write d14/d19/f78 [42977,82033] 0 2024-04-20T10:54:49.356 INFO:tasks.workunit.client.0.smithi090.stdout:5/844: mkdir d1/d2f/d85/dbd/d10c/d124 0 2024-04-20T10:54:49.357 INFO:tasks.workunit.client.0.smithi090.stdout:7/654: link d11/d13/d22/d27/l63 d11/d1a/ld7 0 2024-04-20T10:54:49.358 INFO:tasks.workunit.client.0.smithi090.stdout:6/569: mknod d1/d4/d26/d11/d4a/db3/cc1 0 2024-04-20T10:54:49.358 INFO:tasks.workunit.client.0.smithi090.stdout:0/720: dread d14/d19/d2b/d8e/d43/d5c/d70/d9b/fae [0,4194304] 0 2024-04-20T10:54:49.362 INFO:tasks.workunit.client.0.smithi090.stdout:5/845: unlink d1/d2f/d3d/d40/l92 0 2024-04-20T10:54:49.363 INFO:tasks.workunit.client.0.smithi090.stdout:3/687: dwrite d7/f8b [0,4194304] 0 2024-04-20T10:54:49.363 INFO:tasks.workunit.client.0.smithi090.stdout:3/688: chown d7/d15/d47/d56/c70 70144135 1 2024-04-20T10:54:49.364 INFO:tasks.workunit.client.0.smithi090.stdout:7/655: mkdir d11/d13/d23/dd8 0 2024-04-20T10:54:49.368 INFO:tasks.workunit.client.0.smithi090.stdout:5/846: mkdir d1/d41/d125 0 2024-04-20T10:54:49.368 INFO:tasks.workunit.client.0.smithi090.stdout:3/689: dread d7/fc [0,4194304] 0 2024-04-20T10:54:49.370 INFO:tasks.workunit.client.0.smithi090.stdout:2/736: rmdir d11/d1a/d30/da6 39 2024-04-20T10:54:49.371 INFO:tasks.workunit.client.0.smithi090.stdout:9/835: dwrite d0/f4 [4194304,4194304] 0 2024-04-20T10:54:49.372 INFO:tasks.workunit.client.0.smithi090.stdout:6/570: link d1/d19/d36/c6d d1/d19/d36/d1e/d1f/cc2 0 2024-04-20T10:54:49.373 INFO:tasks.workunit.client.0.smithi090.stdout:5/847: symlink d1/d2f/d3d/d40/d89/l126 0 2024-04-20T10:54:49.375 INFO:tasks.workunit.client.0.smithi090.stdout:2/737: rename d11/d1f/d2e/d6e/dc9/fd7 to d11/d1f/d2e/ff6 0 2024-04-20T10:54:49.380 INFO:tasks.workunit.client.0.smithi090.stdout:5/848: creat d1/da/d1f/dad/de0/f127 x:0 0 0 2024-04-20T10:54:49.380 INFO:tasks.workunit.client.0.smithi090.stdout:0/721: dwrite d14/d19/d31/d34/d3b/f9c [0,4194304] 0 2024-04-20T10:54:49.384 INFO:tasks.workunit.client.0.smithi090.stdout:0/722: creat d14/d19/d31/d34/fe6 x:0 0 0 2024-04-20T10:54:49.385 INFO:tasks.workunit.client.0.smithi090.stdout:0/723: dread d14/d19/d31/f38 [0,4194304] 0 2024-04-20T10:54:49.387 INFO:tasks.workunit.client.0.smithi090.stdout:0/724: creat d14/d19/fe7 x:0 0 0 2024-04-20T10:54:49.389 INFO:tasks.workunit.client.0.smithi090.stdout:9/836: write d0/f51 [6215023,118554] 0 2024-04-20T10:54:49.389 INFO:tasks.workunit.client.0.smithi090.stdout:9/837: write d0/d29/d36/d63/da1/faf [59308,120389] 0 2024-04-20T10:54:49.389 INFO:tasks.workunit.client.0.smithi090.stdout:9/838: write d0/f91 [2124658,13008] 0 2024-04-20T10:54:49.391 INFO:tasks.workunit.client.0.smithi090.stdout:9/839: creat d0/d29/d36/d63/d1f/d79/df3/ddc/f117 x:0 0 0 2024-04-20T10:54:49.394 INFO:tasks.workunit.client.0.smithi090.stdout:7/656: dwrite d11/d13/d5d/fa8 [0,4194304] 0 2024-04-20T10:54:49.394 INFO:tasks.workunit.client.0.smithi090.stdout:7/657: fdatasync d11/d13/d5b/f9a 0 2024-04-20T10:54:49.395 INFO:tasks.workunit.client.0.smithi090.stdout:0/725: write d14/d19/d2b/d52/dab/ddc/de4/d5b/f8f [924814,109775] 0 2024-04-20T10:54:49.396 INFO:tasks.workunit.client.0.smithi090.stdout:7/658: getdents d11/d1a/d3b/dd6 0 2024-04-20T10:54:49.396 INFO:tasks.workunit.client.0.smithi090.stdout:3/690: dwrite d7/d15/d2a/d30/d48/fc4 [0,4194304] 0 2024-04-20T10:54:49.397 INFO:tasks.workunit.client.0.smithi090.stdout:0/726: rmdir d14/d19 39 2024-04-20T10:54:49.399 INFO:tasks.workunit.client.0.smithi090.stdout:7/659: mknod d11/d1a/d3b/d79/cd9 0 2024-04-20T10:54:49.401 INFO:tasks.workunit.client.0.smithi090.stdout:0/727: link d14/d19/d9e/fe2 d14/d19/fe8 0 2024-04-20T10:54:49.402 INFO:tasks.workunit.client.0.smithi090.stdout:0/728: read d14/d19/d31/d34/d3b/f74 [349189,21733] 0 2024-04-20T10:54:49.403 INFO:tasks.workunit.client.0.smithi090.stdout:0/729: mkdir d14/d19/d2b/d8e/d43/de9 0 2024-04-20T10:54:49.404 INFO:tasks.workunit.client.0.smithi090.stdout:0/730: readlink d14/d19/d2b/d61/da0/lac 0 2024-04-20T10:54:49.404 INFO:tasks.workunit.client.0.smithi090.stdout:0/731: readlink d14/d19/lc8 0 2024-04-20T10:54:49.404 INFO:tasks.workunit.client.0.smithi090.stdout:0/732: write d14/d19/f1c [1647850,6479] 0 2024-04-20T10:54:49.408 INFO:tasks.workunit.client.0.smithi090.stdout:7/660: read d11/d61/f7a [451359,126589] 0 2024-04-20T10:54:49.408 INFO:tasks.workunit.client.0.smithi090.stdout:9/840: write d0/d29/d36/d63/d1f/d79/f6c [1012538,127871] 0 2024-04-20T10:54:49.409 INFO:tasks.workunit.client.0.smithi090.stdout:7/661: readlink d11/d13/d22/d24/l97 0 2024-04-20T10:54:49.409 INFO:tasks.workunit.client.0.smithi090.stdout:6/571: dwrite d1/d19/f2d [0,4194304] 0 2024-04-20T10:54:49.409 INFO:tasks.workunit.client.0.smithi090.stdout:3/691: write d7/f8b [3478571,48191] 0 2024-04-20T10:54:49.410 INFO:tasks.workunit.client.0.smithi090.stdout:9/841: write d0/d29/ff7 [2585806,114615] 0 2024-04-20T10:54:49.410 INFO:tasks.workunit.client.0.smithi090.stdout:9/842: write d0/d29/d36/f110 [1295624,125534] 0 2024-04-20T10:54:49.410 INFO:tasks.workunit.client.0.smithi090.stdout:9/843: write d0/d29/d36/d63/d1f/d79/d9b/fe9 [1498418,70090] 0 2024-04-20T10:54:49.410 INFO:tasks.workunit.client.0.smithi090.stdout:7/662: mknod d11/d13/d5b/db8/cda 0 2024-04-20T10:54:49.410 INFO:tasks.workunit.client.0.smithi090.stdout:7/663: read - d11/d13/fcf zero size 2024-04-20T10:54:49.411 INFO:tasks.workunit.client.0.smithi090.stdout:6/572: mknod d1/cc3 0 2024-04-20T10:54:49.413 INFO:tasks.workunit.client.0.smithi090.stdout:3/692: truncate d7/d11/f46 1982775 0 2024-04-20T10:54:49.414 INFO:tasks.workunit.client.0.smithi090.stdout:2/738: dwrite d11/d1a/d4a/d55/f69 [0,4194304] 0 2024-04-20T10:54:49.416 INFO:tasks.workunit.client.0.smithi090.stdout:6/573: rmdir d1/d4/d26/d11/d4a 39 2024-04-20T10:54:49.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/693: creat d7/d35/fde x:0 0 0 2024-04-20T10:54:49.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/694: chown d7/d11/l3a 919 1 2024-04-20T10:54:49.416 INFO:tasks.workunit.client.0.smithi090.stdout:5/849: dwrite d1/d2f/d85/dbd/f64 [4194304,4194304] 0 2024-04-20T10:54:49.419 INFO:tasks.workunit.client.0.smithi090.stdout:5/850: getdents d1/d41 0 2024-04-20T10:54:49.420 INFO:tasks.workunit.client.0.smithi090.stdout:5/851: symlink d1/da/d1f/d115/l128 0 2024-04-20T10:54:49.445 INFO:tasks.workunit.client.0.smithi090.stdout:5/852: write d1/da/d1f/f25 [598683,1098] 0 2024-04-20T10:54:49.451 INFO:tasks.workunit.client.0.smithi090.stdout:2/739: dwrite d11/d1a/d37/d85/d87/fca [0,4194304] 0 2024-04-20T10:54:49.453 INFO:tasks.workunit.client.0.smithi090.stdout:7/664: dwrite d11/d13/d33/d44/d89/d98/dc7/fcd [0,4194304] 0 2024-04-20T10:54:49.454 INFO:tasks.workunit.client.0.smithi090.stdout:9/844: dwrite d0/d29/d36/d63/d1f/f71 [0,4194304] 0 2024-04-20T10:54:49.454 INFO:tasks.workunit.client.0.smithi090.stdout:9/845: stat d0/d29/d36/d63/d1f/d79/df3/d23/daa/fc3 0 2024-04-20T10:54:49.463 INFO:tasks.workunit.client.0.smithi090.stdout:0/733: dwrite d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/fb4 [0,4194304] 0 2024-04-20T10:54:49.477 INFO:tasks.workunit.client.0.smithi090.stdout:3/695: dread d7/d15/f1d [0,4194304] 0 2024-04-20T10:54:49.478 INFO:tasks.workunit.client.0.smithi090.stdout:2/740: dwrite fc [0,4194304] 0 2024-04-20T10:54:49.494 INFO:tasks.workunit.client.0.smithi090.stdout:2/741: dwrite d11/d1f/f6c [0,4194304] 0 2024-04-20T10:54:49.540 INFO:tasks.workunit.client.0.smithi090.stdout:5/853: write d1/da/d16/f32 [2310770,43293] 0 2024-04-20T10:54:49.543 INFO:tasks.workunit.client.0.smithi090.stdout:9/846: stat d0/d29/d36/d63/lf9 0 2024-04-20T10:54:49.545 INFO:tasks.workunit.client.0.smithi090.stdout:0/734: mkdir d14/d19/d2b/d52/dab/ddc/de4/d5b/dea 0 2024-04-20T10:54:49.546 INFO:tasks.workunit.client.0.smithi090.stdout:3/696: mkdir d7/d43/db7/ddf 0 2024-04-20T10:54:49.546 INFO:tasks.workunit.client.0.smithi090.stdout:3/697: dread - d7/d26/d78/fb8 zero size 2024-04-20T10:54:49.546 INFO:tasks.workunit.client.0.smithi090.stdout:3/698: write d7/d15/d47/d56/f54 [848670,35123] 0 2024-04-20T10:54:49.548 INFO:tasks.workunit.client.0.smithi090.stdout:5/854: symlink d1/d41/d98/daf/l129 0 2024-04-20T10:54:49.548 INFO:tasks.workunit.client.0.smithi090.stdout:5/855: stat d1/da/le5 0 2024-04-20T10:54:49.548 INFO:tasks.workunit.client.0.smithi090.stdout:5/856: fsync d1/d2f/d85/dbd/d10c/f11d 0 2024-04-20T10:54:49.549 INFO:tasks.workunit.client.0.smithi090.stdout:9/847: rename d0/d29/d36/d63/d1f/d79/d9b/fed to d0/d29/d36/d63/d1f/d34/d70/d52/d102/f118 0 2024-04-20T10:54:49.550 INFO:tasks.workunit.client.0.smithi090.stdout:3/699: truncate d7/d15/f1d 1740499 0 2024-04-20T10:54:49.550 INFO:tasks.workunit.client.0.smithi090.stdout:3/700: truncate d7/d11/fcc 785727 0 2024-04-20T10:54:49.550 INFO:tasks.workunit.client.0.smithi090.stdout:3/701: chown d7/d43/c87 170 1 2024-04-20T10:54:49.552 INFO:tasks.workunit.client.0.smithi090.stdout:5/857: mkdir d1/da/d16/d12a 0 2024-04-20T10:54:49.552 INFO:tasks.workunit.client.0.smithi090.stdout:5/858: fdatasync d1/da/d14/d113/f11b 0 2024-04-20T10:54:49.552 INFO:tasks.workunit.client.0.smithi090.stdout:5/859: write d1/d2f/fc4 [4941391,118783] 0 2024-04-20T10:54:49.553 INFO:tasks.workunit.client.0.smithi090.stdout:9/848: chown d0/dc6 53562393 1 2024-04-20T10:54:49.554 INFO:tasks.workunit.client.0.smithi090.stdout:5/860: getdents d1/da/d1f/dad/dc8 0 2024-04-20T10:54:49.554 INFO:tasks.workunit.client.0.smithi090.stdout:3/702: dread d7/d15/d47/f5a [0,4194304] 0 2024-04-20T10:54:49.555 INFO:tasks.workunit.client.0.smithi090.stdout:5/861: creat d1/d2f/d85/dbd/d10c/f12b x:0 0 0 2024-04-20T10:54:49.556 INFO:tasks.workunit.client.0.smithi090.stdout:5/862: chown d1/d2f/d3d/l7b 0 1 2024-04-20T10:54:49.565 INFO:tasks.workunit.client.0.smithi090.stdout:5/863: write d1/d2f/d3d/f8b [1417372,27283] 0 2024-04-20T10:54:49.580 INFO:tasks.workunit.client.0.smithi090.stdout:5/864: dread d1/d2f/d85/dbd/f64 [4194304,4194304] 0 2024-04-20T10:54:49.581 INFO:tasks.workunit.client.0.smithi090.stdout:5/865: creat d1/da/d14/d47/d50/f12c x:0 0 0 2024-04-20T10:54:49.582 INFO:tasks.workunit.client.0.smithi090.stdout:5/866: mkdir d1/da/dce/d12d 0 2024-04-20T10:54:49.587 INFO:tasks.workunit.client.0.smithi090.stdout:7/665: dwrite d11/d13/d33/fb3 [4194304,4194304] 0 2024-04-20T10:54:49.588 INFO:tasks.workunit.client.0.smithi090.stdout:9/849: dwrite d0/d29/d36/d63/f66 [0,4194304] 0 2024-04-20T10:54:49.588 INFO:tasks.workunit.client.0.smithi090.stdout:9/850: write d0/d29/d36/d63/f1b [631551,100356] 0 2024-04-20T10:54:49.591 INFO:tasks.workunit.client.0.smithi090.stdout:7/666: unlink d11/d13/d22/d82/c42 0 2024-04-20T10:54:49.591 INFO:tasks.workunit.client.0.smithi090.stdout:7/667: truncate d11/d13/d5b/db8/dbf/da9/fbc 579692 0 2024-04-20T10:54:49.592 INFO:tasks.workunit.client.0.smithi090.stdout:9/851: creat d0/d29/d36/d63/d1f/d79/df3/de0/f119 x:0 0 0 2024-04-20T10:54:49.592 INFO:tasks.workunit.client.0.smithi090.stdout:9/852: truncate d0/d29/d36/d63/d1f/dca/ff8 901033 0 2024-04-20T10:54:49.592 INFO:tasks.workunit.client.0.smithi090.stdout:9/853: write d0/d29/f6e [4749476,79226] 0 2024-04-20T10:54:49.594 INFO:tasks.workunit.client.0.smithi090.stdout:7/668: dread d11/d13/d23/f2b [4194304,4194304] 0 2024-04-20T10:54:49.594 INFO:tasks.workunit.client.0.smithi090.stdout:7/669: chown d11/d13/d5b/db8/dbf/da9/fbc 125557942 1 2024-04-20T10:54:49.594 INFO:tasks.workunit.client.0.smithi090.stdout:7/670: stat d11/d13/d23 0 2024-04-20T10:54:49.600 INFO:tasks.workunit.client.0.smithi090.stdout:3/703: dwrite d7/df/dd1/dd3/d88/fad [0,4194304] 0 2024-04-20T10:54:49.617 INFO:tasks.workunit.client.0.smithi090.stdout:3/704: dwrite d7/df/f4d [0,4194304] 0 2024-04-20T10:54:49.617 INFO:tasks.workunit.client.0.smithi090.stdout:3/705: stat d7/cc0 0 2024-04-20T10:54:49.626 INFO:tasks.workunit.client.0.smithi090.stdout:9/854: dwrite d0/d29/d36/d63/d1f/ff4 [0,4194304] 0 2024-04-20T10:54:49.627 INFO:tasks.workunit.client.0.smithi090.stdout:7/671: dwrite d11/d13/d33/fb3 [0,4194304] 0 2024-04-20T10:54:49.628 INFO:tasks.workunit.client.0.smithi090.stdout:4/637: sync 2024-04-20T10:54:49.628 INFO:tasks.workunit.client.0.smithi090.stdout:4/638: dread - d7/d9/d47/d63/d76/fc3 zero size 2024-04-20T10:54:49.630 INFO:tasks.workunit.client.0.smithi090.stdout:4/639: symlink d7/d9/d47/d63/d42/lcc 0 2024-04-20T10:54:49.634 INFO:tasks.workunit.client.0.smithi090.stdout:9/855: dread d0/fa6 [0,4194304] 0 2024-04-20T10:54:49.635 INFO:tasks.workunit.client.0.smithi090.stdout:3/706: dwrite d7/df/f27 [0,4194304] 0 2024-04-20T10:54:49.638 INFO:tasks.workunit.client.0.smithi090.stdout:4/640: rename d7/d9/d47/d63 to d7/d9/d17/d56/d66/d70/da1/dcd 0 2024-04-20T10:54:49.639 INFO:tasks.workunit.client.0.smithi090.stdout:4/641: creat d7/d9/d17/d94/fce x:0 0 0 2024-04-20T10:54:49.640 INFO:tasks.workunit.client.0.smithi090.stdout:4/642: creat d7/d9/fcf x:0 0 0 2024-04-20T10:54:49.640 INFO:tasks.workunit.client.0.smithi090.stdout:4/643: write d7/d9/d17/d56/d66/d70/da1/dcd/d3d/fb2 [875745,67133] 0 2024-04-20T10:54:49.640 INFO:tasks.workunit.client.0.smithi090.stdout:9/856: dread d0/d29/d36/d63/d1f/d34/d70/d52/f49 [0,4194304] 0 2024-04-20T10:54:49.641 INFO:tasks.workunit.client.0.smithi090.stdout:5/867: dread d1/d55/f74 [0,4194304] 0 2024-04-20T10:54:49.642 INFO:tasks.workunit.client.0.smithi090.stdout:9/857: dread d0/d29/d36/d63/d1f/dca/ff8 [0,4194304] 0 2024-04-20T10:54:49.642 INFO:tasks.workunit.client.0.smithi090.stdout:9/858: write d0/d29/d36/d63/d1f/d79/df3/d23/daa/fc3 [464716,22402] 0 2024-04-20T10:54:49.642 INFO:tasks.workunit.client.0.smithi090.stdout:5/868: symlink d1/d41/l12e 0 2024-04-20T10:54:49.643 INFO:tasks.workunit.client.0.smithi090.stdout:5/869: truncate d1/de/d96/fed 821803 0 2024-04-20T10:54:49.645 INFO:tasks.workunit.client.0.smithi090.stdout:5/870: dread d1/d2f/d3d/d40/d6c/fcb [0,4194304] 0 2024-04-20T10:54:49.647 INFO:tasks.workunit.client.0.smithi090.stdout:5/871: creat d1/d2f/d85/dbd/d10c/d103/f12f x:0 0 0 2024-04-20T10:54:49.652 INFO:tasks.workunit.client.0.smithi090.stdout:7/672: dwrite d11/d13/d5d/d65/fab [0,4194304] 0 2024-04-20T10:54:49.655 INFO:tasks.workunit.client.0.smithi090.stdout:7/673: mkdir d11/d13/d22/d24/ddb 0 2024-04-20T10:54:49.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/674: dread d11/d13/d5d/f80 [0,4194304] 0 2024-04-20T10:54:49.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/675: dread - d11/d13/d22/d24/f7b zero size 2024-04-20T10:54:49.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/676: chown d11/d13/d5b/db8/dbf/fa4 431 1 2024-04-20T10:54:49.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/677: write d11/d13/d5d/d65/fb5 [620900,104445] 0 2024-04-20T10:54:49.664 INFO:tasks.workunit.client.0.smithi090.stdout:5/872: dwrite d1/de/fa3 [0,4194304] 0 2024-04-20T10:54:49.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/873: mknod d1/da/dce/c130 0 2024-04-20T10:54:49.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/874: chown d1/da/d14/dda/l100 2388 1 2024-04-20T10:54:49.666 INFO:tasks.workunit.client.0.smithi090.stdout:5/875: mknod d1/da/d14/c131 0 2024-04-20T10:54:49.667 INFO:tasks.workunit.client.0.smithi090.stdout:7/678: read d11/d13/d5b/d6b/db7/fd3 [950524,72264] 0 2024-04-20T10:54:49.668 INFO:tasks.workunit.client.0.smithi090.stdout:7/679: symlink d11/d13/d5b/d6b/ldc 0 2024-04-20T10:54:49.669 INFO:tasks.workunit.client.0.smithi090.stdout:7/680: symlink d11/d13/d22/d8f/ldd 0 2024-04-20T10:54:49.672 INFO:tasks.workunit.client.0.smithi090.stdout:7/681: getdents d11/d13/d5b/d6b 0 2024-04-20T10:54:49.672 INFO:tasks.workunit.client.0.smithi090.stdout:7/682: truncate d11/d13/d5b/db8/dbf/fac 716853 0 2024-04-20T10:54:49.672 INFO:tasks.workunit.client.0.smithi090.stdout:7/683: fsync d11/d13/d33/fb3 0 2024-04-20T10:54:49.672 INFO:tasks.workunit.client.0.smithi090.stdout:7/684: mknod d11/dd2/cde 0 2024-04-20T10:54:49.673 INFO:tasks.workunit.client.0.smithi090.stdout:7/685: rmdir d11/d13/d22/d27 39 2024-04-20T10:54:49.692 INFO:tasks.workunit.client.0.smithi090.stdout:5/876: dwrite d1/da/d1f/f97 [4194304,4194304] 0 2024-04-20T10:54:49.692 INFO:tasks.workunit.client.0.smithi090.stdout:7/686: dwrite f6 [4194304,4194304] 0 2024-04-20T10:54:49.694 INFO:tasks.workunit.client.0.smithi090.stdout:5/877: getdents d1/da/d1f 0 2024-04-20T10:54:49.695 INFO:tasks.workunit.client.0.smithi090.stdout:5/878: creat d1/da/d1f/d115/f132 x:0 0 0 2024-04-20T10:54:49.696 INFO:tasks.workunit.client.0.smithi090.stdout:5/879: mknod d1/da/d14/d47/c133 0 2024-04-20T10:54:49.697 INFO:tasks.workunit.client.0.smithi090.stdout:5/880: write d1/d2f/d85/dbd/d10c/f11d [437914,78517] 0 2024-04-20T10:54:49.702 INFO:tasks.workunit.client.0.smithi090.stdout:5/881: dread d1/d2f/d85/dbd/f64 [4194304,4194304] 0 2024-04-20T10:54:49.702 INFO:tasks.workunit.client.0.smithi090.stdout:5/882: symlink d1/da/d1f/l134 0 2024-04-20T10:54:49.702 INFO:tasks.workunit.client.0.smithi090.stdout:5/883: chown d1/da/d14/d47/d50/f7c 0 1 2024-04-20T10:54:49.711 INFO:tasks.workunit.client.0.smithi090.stdout:7/687: dwrite d11/d13/d22/d24/d35/fc3 [0,4194304] 0 2024-04-20T10:54:49.711 INFO:tasks.workunit.client.0.smithi090.stdout:7/688: write d11/d13/d33/d44/d89/fc6 [1529225,88548] 0 2024-04-20T10:54:49.713 INFO:tasks.workunit.client.0.smithi090.stdout:7/689: mkdir d11/d1a/d3b/ddf 0 2024-04-20T10:54:49.713 INFO:tasks.workunit.client.0.smithi090.stdout:7/690: read - d11/d13/f92 zero size 2024-04-20T10:54:49.724 INFO:tasks.workunit.client.0.smithi090.stdout:5/884: dwrite d1/da/d1f/dad/fd0 [0,4194304] 0 2024-04-20T10:54:49.725 INFO:tasks.workunit.client.0.smithi090.stdout:5/885: getdents d1/da/d14/d47/d50 0 2024-04-20T10:54:49.726 INFO:tasks.workunit.client.0.smithi090.stdout:5/886: write d1/da/d14/dda/f106 [850091,19632] 0 2024-04-20T10:54:49.726 INFO:tasks.workunit.client.0.smithi090.stdout:5/887: read - d1/da/d1f/d115/f132 zero size 2024-04-20T10:54:49.726 INFO:tasks.workunit.client.0.smithi090.stdout:5/888: mknod d1/da/dce/c135 0 2024-04-20T10:54:49.730 INFO:tasks.workunit.client.0.smithi090.stdout:7/691: dwrite f6 [4194304,4194304] 0 2024-04-20T10:54:49.730 INFO:tasks.workunit.client.0.smithi090.stdout:7/692: chown d11/d13/d5d/l7e 1695 1 2024-04-20T10:54:49.737 INFO:tasks.workunit.client.0.smithi090.stdout:9/859: dread d0/d29/d36/d63/da1/faf [0,4194304] 0 2024-04-20T10:54:49.738 INFO:tasks.workunit.client.0.smithi090.stdout:7/693: truncate f1 851691 0 2024-04-20T10:54:49.740 INFO:tasks.workunit.client.0.smithi090.stdout:7/694: mkdir d11/d13/d5b/db8/de0 0 2024-04-20T10:54:49.740 INFO:tasks.workunit.client.0.smithi090.stdout:9/860: write d0/d29/d36/d63/f14 [4027589,123273] 0 2024-04-20T10:54:49.744 INFO:tasks.workunit.client.0.smithi090.stdout:9/861: dread d0/d29/d36/d63/fb7 [8388608,4194304] 0 2024-04-20T10:54:49.745 INFO:tasks.workunit.client.0.smithi090.stdout:9/862: getdents d0/d29/d36/d63/d1f/d79/df3/d23/daa 0 2024-04-20T10:54:49.745 INFO:tasks.workunit.client.0.smithi090.stdout:9/863: symlink d0/d29/d36/d63/d1f/d4d/l11a 0 2024-04-20T10:54:49.746 INFO:tasks.workunit.client.0.smithi090.stdout:9/864: creat d0/d29/d36/d63/d1f/d79/df3/d6b/f11b x:0 0 0 2024-04-20T10:54:49.747 INFO:tasks.workunit.client.0.smithi090.stdout:9/865: mknod d0/d29/d36/d63/d1f/d34/c11c 0 2024-04-20T10:54:49.747 INFO:tasks.workunit.client.0.smithi090.stdout:9/866: mknod d0/d29/d36/d63/d1f/d34/d70/d52/c11d 0 2024-04-20T10:54:49.748 INFO:tasks.workunit.client.0.smithi090.stdout:9/867: write d0/d86/fdb [965888,80220] 0 2024-04-20T10:54:49.760 INFO:tasks.workunit.client.0.smithi090.stdout:9/868: write d0/d29/d36/d63/d1c/f2a [3051450,87088] 0 2024-04-20T10:54:49.760 INFO:tasks.workunit.client.0.smithi090.stdout:5/889: dwrite d1/d2f/d85/dbd/f4f [4194304,4194304] 0 2024-04-20T10:54:49.760 INFO:tasks.workunit.client.0.smithi090.stdout:7/695: dwrite d11/d13/d5b/db8/dbf/da9/fb9 [0,4194304] 0 2024-04-20T10:54:49.760 INFO:tasks.workunit.client.0.smithi090.stdout:7/696: dread - d11/d13/d22/d27/fca zero size 2024-04-20T10:54:49.761 INFO:tasks.workunit.client.0.smithi090.stdout:9/869: stat d0/d29/d36/l5d 0 2024-04-20T10:54:49.762 INFO:tasks.workunit.client.0.smithi090.stdout:5/890: unlink d1/d41/d98/daf/l129 0 2024-04-20T10:54:49.763 INFO:tasks.workunit.client.0.smithi090.stdout:9/870: dread d0/d29/d36/d63/d1c/f2b [0,4194304] 0 2024-04-20T10:54:49.763 INFO:tasks.workunit.client.0.smithi090.stdout:9/871: truncate d0/d29/d36/d63/d1f/d79/df3/f27 868251 0 2024-04-20T10:54:49.765 INFO:tasks.workunit.client.0.smithi090.stdout:7/697: rename d11/d13/d5b/d6b/db7/fd3 to d11/d1a/d3b/dd6/fe1 0 2024-04-20T10:54:49.766 INFO:tasks.workunit.client.0.smithi090.stdout:9/872: rename d0/d29/d36/d63/d1f/d34/d70/d52/c64 to d0/d29/d36/d63/d1f/ddd/c11e 0 2024-04-20T10:54:49.770 INFO:tasks.workunit.client.0.smithi090.stdout:5/891: write d1/d2f/d85/dbd/d10c/f87 [2841520,13622] 0 2024-04-20T10:54:49.808 INFO:tasks.workunit.client.0.smithi090.stdout:8/689: sync 2024-04-20T10:54:49.809 INFO:tasks.workunit.client.0.smithi090.stdout:8/690: fsync d0/d26/f55 0 2024-04-20T10:54:50.023 INFO:tasks.workunit.client.0.smithi090.stdout:7/698: creat d11/d13/d22/fe2 x:0 0 0 2024-04-20T10:54:50.023 INFO:tasks.workunit.client.0.smithi090.stdout:9/873: creat d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/f11f x:0 0 0 2024-04-20T10:54:50.023 INFO:tasks.workunit.client.0.smithi090.stdout:7/699: fdatasync f1 0 2024-04-20T10:54:50.023 INFO:tasks.workunit.client.0.smithi090.stdout:9/874: dread - d0/d29/d36/d63/d1f/d4d/f10f zero size 2024-04-20T10:54:50.023 INFO:tasks.workunit.client.0.smithi090.stdout:5/892: unlink d1/da/d14/dc0/f11e 0 2024-04-20T10:54:50.023 INFO:tasks.workunit.client.0.smithi090.stdout:5/893: chown d1/d2f/d85/dbd/d10c/c116 21 1 2024-04-20T10:54:50.024 INFO:tasks.workunit.client.0.smithi090.stdout:5/894: read d1/da/fc3 [547374,67257] 0 2024-04-20T10:54:50.027 INFO:tasks.workunit.client.0.smithi090.stdout:8/691: creat d0/d2d/dd4/fe6 x:0 0 0 2024-04-20T10:54:50.029 INFO:tasks.workunit.client.0.smithi090.stdout:7/700: mknod d11/d13/ce3 0 2024-04-20T10:54:50.030 INFO:tasks.workunit.client.0.smithi090.stdout:9/875: getdents d0/d29/d36/d63/d1f/d34/d70/d9d 0 2024-04-20T10:54:50.030 INFO:tasks.workunit.client.0.smithi090.stdout:9/876: write d0/d29/d36/d63/d1f/d79/d7f/f103 [104256,70998] 0 2024-04-20T10:54:50.030 INFO:tasks.workunit.client.0.smithi090.stdout:9/877: read d0/d29/d36/d63/d1f/d79/d7f/fd2 [214842,41459] 0 2024-04-20T10:54:50.031 INFO:tasks.workunit.client.0.smithi090.stdout:5/895: mknod d1/da/c136 0 2024-04-20T10:54:50.031 INFO:tasks.workunit.client.0.smithi090.stdout:5/896: stat d1/da/d14/d47/d50 0 2024-04-20T10:54:50.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/692: mknod d0/d3a/d4a/ce7 0 2024-04-20T10:54:50.034 INFO:tasks.workunit.client.0.smithi090.stdout:9/878: mknod d0/d29/d36/d63/d1f/dca/c120 0 2024-04-20T10:54:50.035 INFO:tasks.workunit.client.0.smithi090.stdout:9/879: chown d0/d29/d36/d63/d1f/d79/df3/d82/c115 20 1 2024-04-20T10:54:50.035 INFO:tasks.workunit.client.0.smithi090.stdout:9/880: chown d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0 162627109 1 2024-04-20T10:54:50.035 INFO:tasks.workunit.client.0.smithi090.stdout:8/693: symlink d0/d3a/d9f/d52/le8 0 2024-04-20T10:54:50.037 INFO:tasks.workunit.client.0.smithi090.stdout:9/881: rename d0/d29/d36/d63/da1/d10b/d114/dcb/le8 to d0/d29/d36/d63/d1c/l121 0 2024-04-20T10:54:50.038 INFO:tasks.workunit.client.0.smithi090.stdout:5/897: dread d1/d2a/f3e [0,4194304] 0 2024-04-20T10:54:50.039 INFO:tasks.workunit.client.0.smithi090.stdout:8/694: rename d0/d99/lda to d0/d11/le9 0 2024-04-20T10:54:50.040 INFO:tasks.workunit.client.0.smithi090.stdout:9/882: rmdir d0/d29/d36/d63/d1f/d79/df3/d82 39 2024-04-20T10:54:50.040 INFO:tasks.workunit.client.0.smithi090.stdout:9/883: stat d0/d29/d36/d63/d1c/f74 0 2024-04-20T10:54:50.040 INFO:tasks.workunit.client.0.smithi090.stdout:9/884: write d0/d29/d36/d63/d1f/d79/df3/d6b/f11b [575874,113650] 0 2024-04-20T10:54:50.042 INFO:tasks.workunit.client.0.smithi090.stdout:5/898: rename d1/da/f2c to d1/d2f/d3d/f137 0 2024-04-20T10:54:50.043 INFO:tasks.workunit.client.0.smithi090.stdout:8/695: mkdir d0/d3a/d4a/dea 0 2024-04-20T10:54:50.045 INFO:tasks.workunit.client.0.smithi090.stdout:7/701: dwrite d11/d13/d5b/fb6 [0,4194304] 0 2024-04-20T10:54:50.046 INFO:tasks.workunit.client.0.smithi090.stdout:5/899: rename d1/d2f/d85/dbd to d1/d41/d98/d101/d138 0 2024-04-20T10:54:50.049 INFO:tasks.workunit.client.0.smithi090.stdout:8/696: unlink d0/d11/c2f 0 2024-04-20T10:54:50.050 INFO:tasks.workunit.client.0.smithi090.stdout:4/644: sync 2024-04-20T10:54:50.050 INFO:tasks.workunit.client.0.smithi090.stdout:0/735: sync 2024-04-20T10:54:50.051 INFO:tasks.workunit.client.0.smithi090.stdout:3/707: sync 2024-04-20T10:54:50.051 INFO:tasks.workunit.client.0.smithi090.stdout:1/815: sync 2024-04-20T10:54:50.051 INFO:tasks.workunit.client.0.smithi090.stdout:2/742: sync 2024-04-20T10:54:50.051 INFO:tasks.workunit.client.0.smithi090.stdout:6/574: sync 2024-04-20T10:54:50.051 INFO:tasks.workunit.client.0.smithi090.stdout:3/708: chown d7/l12 20674 1 2024-04-20T10:54:50.051 INFO:tasks.workunit.client.0.smithi090.stdout:1/816: write d8/f46 [554812,63458] 0 2024-04-20T10:54:50.051 INFO:tasks.workunit.client.0.smithi090.stdout:5/900: read d1/da/d1f/dad/dc8/fd9 [4153307,20428] 0 2024-04-20T10:54:50.052 INFO:tasks.workunit.client.0.smithi090.stdout:5/901: truncate d1/da/d14/d47/fb6 198399 0 2024-04-20T10:54:50.052 INFO:tasks.workunit.client.0.smithi090.stdout:9/885: link d0/c2 d0/d29/d36/d63/d1f/d79/df3/d23/daa/c122 0 2024-04-20T10:54:50.054 INFO:tasks.workunit.client.0.smithi090.stdout:7/702: creat d11/d13/d22/d82/fe4 x:0 0 0 2024-04-20T10:54:50.054 INFO:tasks.workunit.client.0.smithi090.stdout:7/703: chown d11/d13/d22/f34 127 1 2024-04-20T10:54:50.054 INFO:tasks.workunit.client.0.smithi090.stdout:7/704: chown d11/d1a/d3b/d79/f8d 43405 1 2024-04-20T10:54:50.054 INFO:tasks.workunit.client.0.smithi090.stdout:7/705: fsync d11/d1a/d3b/d79/f99 0 2024-04-20T10:54:50.054 INFO:tasks.workunit.client.0.smithi090.stdout:8/697: rmdir d0/d11/d22/d53/d8e/d92 39 2024-04-20T10:54:50.056 INFO:tasks.workunit.client.0.smithi090.stdout:4/645: creat d7/d9/d17/d56/d66/d70/da5/fd0 x:0 0 0 2024-04-20T10:54:50.057 INFO:tasks.workunit.client.0.smithi090.stdout:6/575: rmdir d1/d19/d36/d1e 39 2024-04-20T10:54:50.058 INFO:tasks.workunit.client.0.smithi090.stdout:4/646: dread d7/d9/d17/d56/f8c [0,4194304] 0 2024-04-20T10:54:50.058 INFO:tasks.workunit.client.0.smithi090.stdout:1/817: mkdir d8/d1a/d1d/d67/dff/d6e/d10d 0 2024-04-20T10:54:50.059 INFO:tasks.workunit.client.0.smithi090.stdout:9/886: symlink d0/d29/d36/d63/d1f/d34/d70/d52/d102/l123 0 2024-04-20T10:54:50.061 INFO:tasks.workunit.client.0.smithi090.stdout:7/706: creat d11/d13/d5b/db8/fe5 x:0 0 0 2024-04-20T10:54:50.063 INFO:tasks.workunit.client.0.smithi090.stdout:8/698: rename d0/d3a/d9f/ca8 to d0/d3a/d4a/dea/ceb 0 2024-04-20T10:54:50.063 INFO:tasks.workunit.client.0.smithi090.stdout:8/699: truncate d0/d3a/d4a/f4e 1017215 0 2024-04-20T10:54:50.063 INFO:tasks.workunit.client.0.smithi090.stdout:8/700: fsync d0/d3a/d4a/d81/fde 0 2024-04-20T10:54:50.065 INFO:tasks.workunit.client.0.smithi090.stdout:4/647: creat d7/d9/d17/d56/d66/d70/da1/dcd/d76/fd1 x:0 0 0 2024-04-20T10:54:50.068 INFO:tasks.workunit.client.0.smithi090.stdout:7/707: unlink d11/d13/d22/d82/lad 0 2024-04-20T10:54:50.068 INFO:tasks.workunit.client.0.smithi090.stdout:7/708: chown d11/d1a/d3b/d79/cd9 4 1 2024-04-20T10:54:50.068 INFO:tasks.workunit.client.0.smithi090.stdout:8/701: symlink d0/d3a/lec 0 2024-04-20T10:54:50.070 INFO:tasks.workunit.client.0.smithi090.stdout:6/576: rename d1/d19/d25/fbe to d1/d19/d36/d1e/d1f/d3f/dbf/fc4 0 2024-04-20T10:54:50.071 INFO:tasks.workunit.client.0.smithi090.stdout:6/577: chown d1/d19/d36/d28/f34 4450 1 2024-04-20T10:54:50.075 INFO:tasks.workunit.client.0.smithi090.stdout:6/578: link d1/d4/c8e d1/d19/cc5 0 2024-04-20T10:54:50.075 INFO:tasks.workunit.client.0.smithi090.stdout:6/579: write d1/d4/d26/d11/f71 [244797,49940] 0 2024-04-20T10:54:50.082 INFO:tasks.workunit.client.0.smithi090.stdout:0/736: dwrite d14/d19/d2b/d8e/d40/fbc [0,4194304] 0 2024-04-20T10:54:50.083 INFO:tasks.workunit.client.0.smithi090.stdout:3/709: dwrite d7/d15/d47/fc2 [0,4194304] 0 2024-04-20T10:54:50.084 INFO:tasks.workunit.client.0.smithi090.stdout:3/710: chown d7/d15/l1e 15464547 1 2024-04-20T10:54:50.084 INFO:tasks.workunit.client.0.smithi090.stdout:3/711: readlink d7/d15/l1e 0 2024-04-20T10:54:50.085 INFO:tasks.workunit.client.0.smithi090.stdout:0/737: rmdir d14/d19/d2b/d52/dab/ddc 39 2024-04-20T10:54:50.085 INFO:tasks.workunit.client.0.smithi090.stdout:0/738: dread - d14/d41/fb5 zero size 2024-04-20T10:54:50.086 INFO:tasks.workunit.client.0.smithi090.stdout:8/702: dread d0/d3a/d9f/f7c [0,4194304] 0 2024-04-20T10:54:50.086 INFO:tasks.workunit.client.0.smithi090.stdout:8/703: stat d0/f2 0 2024-04-20T10:54:50.086 INFO:tasks.workunit.client.0.smithi090.stdout:3/712: rename d7/l9 to d7/d15/d2a/d30/le0 0 2024-04-20T10:54:50.087 INFO:tasks.workunit.client.0.smithi090.stdout:0/739: creat d14/d19/d31/d34/d3b/feb x:0 0 0 2024-04-20T10:54:50.087 INFO:tasks.workunit.client.0.smithi090.stdout:0/740: truncate d14/d19/d2b/d8e/d43/d73/f97 2840701 0 2024-04-20T10:54:50.088 INFO:tasks.workunit.client.0.smithi090.stdout:8/704: mknod d0/d11/d22/d53/d57/dd3/ced 0 2024-04-20T10:54:50.089 INFO:tasks.workunit.client.0.smithi090.stdout:3/713: truncate d7/d11/f73 575304 0 2024-04-20T10:54:50.089 INFO:tasks.workunit.client.0.smithi090.stdout:8/705: truncate d0/d3a/d4a/f95 3744295 0 2024-04-20T10:54:50.089 INFO:tasks.workunit.client.0.smithi090.stdout:8/706: fsync d0/d3a/d9f/f41 0 2024-04-20T10:54:50.091 INFO:tasks.workunit.client.0.smithi090.stdout:3/714: rename d7/d15/d47/c94 to d7/d15/d2a/d8d/ce1 0 2024-04-20T10:54:50.091 INFO:tasks.workunit.client.0.smithi090.stdout:3/715: chown d7/cc0 14 1 2024-04-20T10:54:50.101 INFO:tasks.workunit.client.0.smithi090.stdout:2/743: dwrite d11/d1a/d30/f90 [0,4194304] 0 2024-04-20T10:54:50.102 INFO:tasks.workunit.client.0.smithi090.stdout:9/887: dwrite d0/d29/d36/d63/d1f/d79/d7f/fd2 [0,4194304] 0 2024-04-20T10:54:50.103 INFO:tasks.workunit.client.0.smithi090.stdout:1/818: dwrite d8/d1a/d1d/d67/dff/d6e/dde/f106 [0,4194304] 0 2024-04-20T10:54:50.108 INFO:tasks.workunit.client.0.smithi090.stdout:0/741: dread f3 [0,4194304] 0 2024-04-20T10:54:50.112 INFO:tasks.workunit.client.0.smithi090.stdout:1/819: getdents d8/d1a/d4d/da5 0 2024-04-20T10:54:50.112 INFO:tasks.workunit.client.0.smithi090.stdout:4/648: dwrite d7/d9/d17/d56/d66/f8a [4194304,4194304] 0 2024-04-20T10:54:50.112 INFO:tasks.workunit.client.0.smithi090.stdout:8/707: dwrite d0/d11/d22/d53/f54 [0,4194304] 0 2024-04-20T10:54:50.113 INFO:tasks.workunit.client.0.smithi090.stdout:0/742: rmdir d14/d19/d2b/d52 39 2024-04-20T10:54:50.115 INFO:tasks.workunit.client.0.smithi090.stdout:9/888: read d0/d29/d36/d63/d1f/f71 [1978458,14080] 0 2024-04-20T10:54:50.115 INFO:tasks.workunit.client.0.smithi090.stdout:1/820: creat d8/d1a/d1d/d7a/db0/f10e x:0 0 0 2024-04-20T10:54:50.121 INFO:tasks.workunit.client.0.smithi090.stdout:0/743: link f11 d14/d19/d2b/d8e/d43/de9/fec 0 2024-04-20T10:54:50.122 INFO:tasks.workunit.client.0.smithi090.stdout:1/821: mknod d8/d1a/d1d/d67/dff/d4a/d93/dd2/dd3/c10f 0 2024-04-20T10:54:50.123 INFO:tasks.workunit.client.0.smithi090.stdout:2/744: write d11/d1f/d2e/f5d [2382176,77851] 0 2024-04-20T10:54:50.123 INFO:tasks.workunit.client.0.smithi090.stdout:2/745: fdatasync fc 0 2024-04-20T10:54:50.123 INFO:tasks.workunit.client.0.smithi090.stdout:3/716: dwrite d7/d11/fcc [0,4194304] 0 2024-04-20T10:54:50.123 INFO:tasks.workunit.client.0.smithi090.stdout:3/717: chown d7/df/c5f 2641 1 2024-04-20T10:54:50.124 INFO:tasks.workunit.client.0.smithi090.stdout:8/708: rename d0/d3a/d4a/dea/ceb to d0/d3a/d9f/cee 0 2024-04-20T10:54:50.125 INFO:tasks.workunit.client.0.smithi090.stdout:1/822: symlink d8/d1a/d1d/d67/dff/d4a/l110 0 2024-04-20T10:54:50.129 INFO:tasks.workunit.client.0.smithi090.stdout:3/718: creat d7/df/dd1/fe2 x:0 0 0 2024-04-20T10:54:50.131 INFO:tasks.workunit.client.0.smithi090.stdout:9/889: rename d0/d29/d36/d63/d1f/d34/d70/d52/lbf to d0/d29/d36/d63/d1f/dca/l124 0 2024-04-20T10:54:50.131 INFO:tasks.workunit.client.0.smithi090.stdout:9/890: chown d0/d29/d36/d63/d1f/d4d/fbb 861 1 2024-04-20T10:54:50.131 INFO:tasks.workunit.client.0.smithi090.stdout:9/891: fdatasync d0/d29/d36/d63/d1f/dca/fe1 0 2024-04-20T10:54:50.131 INFO:tasks.workunit.client.0.smithi090.stdout:0/744: mknod d14/d19/d2b/d52/dab/ddc/de4/d5b/ced 0 2024-04-20T10:54:50.131 INFO:tasks.workunit.client.0.smithi090.stdout:0/745: write d14/d19/d2b/d8e/d43/d5c/d70/d9b/fae [1246359,56674] 0 2024-04-20T10:54:50.132 INFO:tasks.workunit.client.0.smithi090.stdout:3/719: link d7/d15/d2a/d30/fce d7/d43/dc5/fe3 0 2024-04-20T10:54:50.134 INFO:tasks.workunit.client.0.smithi090.stdout:4/649: dwrite d7/d9/f35 [0,4194304] 0 2024-04-20T10:54:50.134 INFO:tasks.workunit.client.0.smithi090.stdout:4/650: readlink d7/d9/lac 0 2024-04-20T10:54:50.135 INFO:tasks.workunit.client.0.smithi090.stdout:1/823: rename d8/d1a/d4d/l10a to d8/d1a/d1d/d67/dff/d6e/dde/l111 0 2024-04-20T10:54:50.136 INFO:tasks.workunit.client.0.smithi090.stdout:9/892: mknod d0/dc6/c125 0 2024-04-20T10:54:50.137 INFO:tasks.workunit.client.0.smithi090.stdout:0/746: mknod d14/d19/cee 0 2024-04-20T10:54:50.140 INFO:tasks.workunit.client.0.smithi090.stdout:3/720: mkdir d7/d15/d2a/de4 0 2024-04-20T10:54:50.141 INFO:tasks.workunit.client.0.smithi090.stdout:4/651: mkdir d7/d9/d17/d56/d66/d70/da1/dcd/d3d/dd2 0 2024-04-20T10:54:50.143 INFO:tasks.workunit.client.0.smithi090.stdout:1/824: mknod d8/d1a/d1d/d67/dff/d4a/d93/dd2/c112 0 2024-04-20T10:54:50.143 INFO:tasks.workunit.client.0.smithi090.stdout:1/825: chown d8/d1a/d1d/d7a/d9a/f7c 15 1 2024-04-20T10:54:50.144 INFO:tasks.workunit.client.0.smithi090.stdout:9/893: creat d0/d29/d36/d63/d1f/d79/d9b/f126 x:0 0 0 2024-04-20T10:54:50.146 INFO:tasks.workunit.client.0.smithi090.stdout:4/652: rename d7/d9/d17/d56/d66/d70/da1/dcd/d76/fd1 to d7/d9/d17/d56/d66/d70/da1/dcd/d3d/dd2/fd3 0 2024-04-20T10:54:50.147 INFO:tasks.workunit.client.0.smithi090.stdout:4/653: read d7/d9/d17/d56/d66/d70/da1/dcd/f45 [733892,65976] 0 2024-04-20T10:54:50.148 INFO:tasks.workunit.client.0.smithi090.stdout:1/826: creat d8/f113 x:0 0 0 2024-04-20T10:54:50.148 INFO:tasks.workunit.client.0.smithi090.stdout:1/827: write d8/d1a/d4d/da5/dad/de5/f102 [106001,66645] 0 2024-04-20T10:54:50.148 INFO:tasks.workunit.client.0.smithi090.stdout:1/828: write d8/f34 [636100,1381] 0 2024-04-20T10:54:50.149 INFO:tasks.workunit.client.0.smithi090.stdout:8/709: dwrite d0/d26/f55 [0,4194304] 0 2024-04-20T10:54:50.149 INFO:tasks.workunit.client.0.smithi090.stdout:9/894: getdents d0/d29/d36/d63/d1f/d79/df3/ddc 0 2024-04-20T10:54:50.152 INFO:tasks.workunit.client.0.smithi090.stdout:4/654: mkdir d7/d9/d17/d56/d66/dd4 0 2024-04-20T10:54:50.154 INFO:tasks.workunit.client.0.smithi090.stdout:8/710: link d0/f28 d0/d2d/d49/d67/fef 0 2024-04-20T10:54:50.154 INFO:tasks.workunit.client.0.smithi090.stdout:8/711: fsync d0/d26/f78 0 2024-04-20T10:54:50.154 INFO:tasks.workunit.client.0.smithi090.stdout:8/712: readlink d0/d2d/l5f 0 2024-04-20T10:54:50.154 INFO:tasks.workunit.client.0.smithi090.stdout:8/713: truncate d0/d3a/d9f/db9/fc1 1041534 0 2024-04-20T10:54:50.156 INFO:tasks.workunit.client.0.smithi090.stdout:9/895: creat d0/d29/d36/d63/d1f/d34/d70/d52/f127 x:0 0 0 2024-04-20T10:54:50.156 INFO:tasks.workunit.client.0.smithi090.stdout:9/896: fdatasync d0/d29/d36/d63/f14 0 2024-04-20T10:54:50.158 INFO:tasks.workunit.client.0.smithi090.stdout:4/655: creat d7/d9/d47/d8d/fd5 x:0 0 0 2024-04-20T10:54:50.160 INFO:tasks.workunit.client.0.smithi090.stdout:2/746: dwrite d11/d1a/f2d [0,4194304] 0 2024-04-20T10:54:50.160 INFO:tasks.workunit.client.0.smithi090.stdout:2/747: write d11/d1f/d2e/f4b [963957,86654] 0 2024-04-20T10:54:50.160 INFO:tasks.workunit.client.0.smithi090.stdout:7/709: dwrite d11/d13/d5b/db8/dbf/fac [0,4194304] 0 2024-04-20T10:54:50.160 INFO:tasks.workunit.client.0.smithi090.stdout:0/747: dwrite d14/d19/d31/d34/d3b/f9c [0,4194304] 0 2024-04-20T10:54:50.161 INFO:tasks.workunit.client.0.smithi090.stdout:0/748: chown d14/d39/da6/cd9 1233305 1 2024-04-20T10:54:50.161 INFO:tasks.workunit.client.0.smithi090.stdout:8/714: unlink d0/d2d/f84 0 2024-04-20T10:54:50.163 INFO:tasks.workunit.client.0.smithi090.stdout:9/897: unlink d0/d29/d36/d63/d1f/d34/d70/c116 0 2024-04-20T10:54:50.163 INFO:tasks.workunit.client.0.smithi090.stdout:9/898: write d0/d29/d36/f110 [2874140,103526] 0 2024-04-20T10:54:50.163 INFO:tasks.workunit.client.0.smithi090.stdout:9/899: truncate d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/f11f 227513 0 2024-04-20T10:54:50.163 INFO:tasks.workunit.client.0.smithi090.stdout:4/656: rmdir d7/d9/d17/d56/d66/d70/da5/db3/dba 39 2024-04-20T10:54:50.169 INFO:tasks.workunit.client.0.smithi090.stdout:1/829: dwrite d8/d1a/d1d/d67/f3d [0,4194304] 0 2024-04-20T10:54:50.169 INFO:tasks.workunit.client.0.smithi090.stdout:7/710: rmdir d11/d13/d5b/db8 39 2024-04-20T10:54:50.169 INFO:tasks.workunit.client.0.smithi090.stdout:7/711: fdatasync d11/d13/d22/d82/fd4 0 2024-04-20T10:54:50.169 INFO:tasks.workunit.client.0.smithi090.stdout:7/712: chown d11/d13/d5b/db8/l49 55746930 1 2024-04-20T10:54:50.171 INFO:tasks.workunit.client.0.smithi090.stdout:8/715: write d0/d2d/d49/d67/f69 [1935911,35048] 0 2024-04-20T10:54:50.173 INFO:tasks.workunit.client.0.smithi090.stdout:4/657: creat d7/d9/d17/d56/d66/d70/fd6 x:0 0 0 2024-04-20T10:54:50.174 INFO:tasks.workunit.client.0.smithi090.stdout:7/713: mknod d11/d13/d23/ce6 0 2024-04-20T10:54:50.175 INFO:tasks.workunit.client.0.smithi090.stdout:8/716: creat d0/dac/ff0 x:0 0 0 2024-04-20T10:54:50.177 INFO:tasks.workunit.client.0.smithi090.stdout:9/900: symlink d0/d29/d36/d63/d1f/d79/d7f/l128 0 2024-04-20T10:54:50.177 INFO:tasks.workunit.client.0.smithi090.stdout:9/901: dread - d0/d29/d36/d63/d1c/f74 zero size 2024-04-20T10:54:50.179 INFO:tasks.workunit.client.0.smithi090.stdout:4/658: mknod d7/d9/d17/d56/cd7 0 2024-04-20T10:54:50.180 INFO:tasks.workunit.client.0.smithi090.stdout:8/717: creat d0/d3a/d9f/d52/ff1 x:0 0 0 2024-04-20T10:54:50.181 INFO:tasks.workunit.client.0.smithi090.stdout:9/902: creat d0/d29/d36/f129 x:0 0 0 2024-04-20T10:54:50.181 INFO:tasks.workunit.client.0.smithi090.stdout:4/659: dread d7/d9/d17/d56/d66/d70/da1/dcd/d3d/fb2 [0,4194304] 0 2024-04-20T10:54:50.182 INFO:tasks.workunit.client.0.smithi090.stdout:2/748: dwrite d11/d1a/d37/fc5 [0,4194304] 0 2024-04-20T10:54:50.184 INFO:tasks.workunit.client.0.smithi090.stdout:8/718: rename d0/d2d/d49/c80 to d0/dac/dcf/cf2 0 2024-04-20T10:54:50.184 INFO:tasks.workunit.client.0.smithi090.stdout:4/660: rmdir d7/d9/d17/d56/d66/d70/da1/dcd/d3d/d9e/db5 39 2024-04-20T10:54:50.185 INFO:tasks.workunit.client.0.smithi090.stdout:2/749: mknod d11/d1a/d4a/d55/da1/cf7 0 2024-04-20T10:54:50.188 INFO:tasks.workunit.client.0.smithi090.stdout:9/903: rename d0/d29/d36/d63/d1f/d79/d9b/fe9 to d0/d29/d36/d63/da1/f12a 0 2024-04-20T10:54:50.188 INFO:tasks.workunit.client.0.smithi090.stdout:9/904: write d0/d29/d36/d63/d1f/f71 [1835463,23348] 0 2024-04-20T10:54:50.189 INFO:tasks.workunit.client.0.smithi090.stdout:8/719: truncate d0/dac/fc2 929245 0 2024-04-20T10:54:50.189 INFO:tasks.workunit.client.0.smithi090.stdout:4/661: getdents d7/d9/d17/d56/d66/d70/da1/dcd 0 2024-04-20T10:54:50.190 INFO:tasks.workunit.client.0.smithi090.stdout:4/662: fsync d7/d9/d17/d56/d66/d70/da5/fd0 0 2024-04-20T10:54:50.191 INFO:tasks.workunit.client.0.smithi090.stdout:2/750: unlink d11/d1a/d2b/lc0 0 2024-04-20T10:54:50.194 INFO:tasks.workunit.client.0.smithi090.stdout:9/905: creat d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/f12b x:0 0 0 2024-04-20T10:54:50.194 INFO:tasks.workunit.client.0.smithi090.stdout:9/906: fdatasync d0/d29/d36/d63/d1f/d79/d7f/f107 0 2024-04-20T10:54:50.198 INFO:tasks.workunit.client.0.smithi090.stdout:0/749: write d14/d19/d31/d34/d3b/f59 [1639564,101559] 0 2024-04-20T10:54:50.201 INFO:tasks.workunit.client.0.smithi090.stdout:4/663: link d7/f52 d7/d9/d17/d56/d66/d70/da5/db3/fd8 0 2024-04-20T10:54:50.202 INFO:tasks.workunit.client.0.smithi090.stdout:0/750: symlink d14/d19/d2b/d52/lef 0 2024-04-20T10:54:50.205 INFO:tasks.workunit.client.0.smithi090.stdout:4/664: rename d7/d9/d17/f48 to d7/d9/d17/dc4/fd9 0 2024-04-20T10:54:50.207 INFO:tasks.workunit.client.0.smithi090.stdout:0/751: link d14/f5f d14/d19/d2b/d8e/d43/d6d/ff0 0 2024-04-20T10:54:50.208 INFO:tasks.workunit.client.0.smithi090.stdout:9/907: dread d0/d29/d36/d63/d1f/ff4 [0,4194304] 0 2024-04-20T10:54:50.212 INFO:tasks.workunit.client.0.smithi090.stdout:4/665: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:50.212 INFO:tasks.workunit.client.0.smithi090.stdout:4/666: fsync d7/d9/f20 0 2024-04-20T10:54:50.219 INFO:tasks.workunit.client.0.smithi090.stdout:8/720: dwrite d0/d11/f1b [0,4194304] 0 2024-04-20T10:54:50.219 INFO:tasks.workunit.client.0.smithi090.stdout:8/721: truncate d0/d3a/f6e 510555 0 2024-04-20T10:54:50.219 INFO:tasks.workunit.client.0.smithi090.stdout:8/722: chown d0/d11/l77 22 1 2024-04-20T10:54:50.219 INFO:tasks.workunit.client.0.smithi090.stdout:9/908: mkdir d0/d29/d36/d63/da1/d10b/d114/d12c 0 2024-04-20T10:54:50.220 INFO:tasks.workunit.client.0.smithi090.stdout:8/723: symlink d0/d11/d22/d53/d8e/lf3 0 2024-04-20T10:54:50.228 INFO:tasks.workunit.client.0.smithi090.stdout:0/752: dread d14/d19/d31/d34/d3b/f59 [0,4194304] 0 2024-04-20T10:54:50.228 INFO:tasks.workunit.client.0.smithi090.stdout:0/753: chown d14/d19/d2b/d52/dab/ddc/de4/d5b 110851 1 2024-04-20T10:54:50.229 INFO:tasks.workunit.client.0.smithi090.stdout:9/909: creat d0/d29/d36/d63/da1/d10b/d114/dcb/f12d x:0 0 0 2024-04-20T10:54:50.229 INFO:tasks.workunit.client.0.smithi090.stdout:9/910: write d0/d29/d36/d63/da1/fc7 [652023,48330] 0 2024-04-20T10:54:50.229 INFO:tasks.workunit.client.0.smithi090.stdout:9/911: write d0/d29/d36/d63/d1f/d79/df3/d23/daa/fc3 [616390,59457] 0 2024-04-20T10:54:50.230 INFO:tasks.workunit.client.0.smithi090.stdout:9/912: dread d0/d29/d36/d63/da1/faf [0,4194304] 0 2024-04-20T10:54:50.242 INFO:tasks.workunit.client.0.smithi090.stdout:8/724: dwrite d0/d3a/d4a/f98 [0,4194304] 0 2024-04-20T10:54:50.243 INFO:tasks.workunit.client.0.smithi090.stdout:0/754: creat d14/d19/d31/ff1 x:0 0 0 2024-04-20T10:54:50.243 INFO:tasks.workunit.client.0.smithi090.stdout:0/755: read d14/d19/d2b/d8e/d40/f57 [169293,771] 0 2024-04-20T10:54:50.248 INFO:tasks.workunit.client.0.smithi090.stdout:0/756: dread d14/d19/d2b/d52/dab/f75 [0,4194304] 0 2024-04-20T10:54:50.249 INFO:tasks.workunit.client.0.smithi090.stdout:8/725: rename d0/d26/c90 to d0/d3a/d9f/d52/cf4 0 2024-04-20T10:54:50.249 INFO:tasks.workunit.client.0.smithi090.stdout:8/726: chown d0/d2d/d49/c5e 32476229 1 2024-04-20T10:54:50.257 INFO:tasks.workunit.client.0.smithi090.stdout:5/902: sync 2024-04-20T10:54:50.264 INFO:tasks.workunit.client.0.smithi090.stdout:0/757: dwrite d14/d19/d2b/d8e/d43/d5c/d70/d9b/fe1 [0,4194304] 0 2024-04-20T10:54:50.264 INFO:tasks.workunit.client.0.smithi090.stdout:0/758: chown d14/d19/d2b/d8e/d43/d6d/c79 465225 1 2024-04-20T10:54:50.265 INFO:tasks.workunit.client.0.smithi090.stdout:8/727: rename d0/dac to d0/d26/da7/df5 0 2024-04-20T10:54:50.267 INFO:tasks.workunit.client.0.smithi090.stdout:0/759: creat d14/d19/d2b/d61/da0/db1/dbb/ff2 x:0 0 0 2024-04-20T10:54:50.272 INFO:tasks.workunit.client.0.smithi090.stdout:0/760: dread fe [0,4194304] 0 2024-04-20T10:54:50.282 INFO:tasks.workunit.client.0.smithi090.stdout:5/903: dwrite d1/da/d14/ffb [0,4194304] 0 2024-04-20T10:54:50.282 INFO:tasks.workunit.client.0.smithi090.stdout:9/913: read d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/ff1 [5226151,99844] 0 2024-04-20T10:54:50.282 INFO:tasks.workunit.client.0.smithi090.stdout:9/914: write d0/d29/d36/d63/f13 [5386581,112586] 0 2024-04-20T10:54:50.283 INFO:tasks.workunit.client.0.smithi090.stdout:9/915: stat d0/d29/d36/d63/d1f/d34/d70/db8/fe4 0 2024-04-20T10:54:50.283 INFO:tasks.workunit.client.0.smithi090.stdout:5/904: dread d1/da/d14/dc0/feb [0,4194304] 0 2024-04-20T10:54:50.534 INFO:tasks.workunit.client.0.smithi090.stdout:8/728: rmdir d0/d2d/d49/d67 39 2024-04-20T10:54:50.534 INFO:tasks.workunit.client.0.smithi090.stdout:9/916: creat d0/d29/d36/d63/d1f/d79/df3/d23/daa/df0/f12e x:0 0 0 2024-04-20T10:54:50.535 INFO:tasks.workunit.client.0.smithi090.stdout:5/905: getdents d1/da/d1f 0 2024-04-20T10:54:50.537 INFO:tasks.workunit.client.0.smithi090.stdout:9/917: rename d0/d29/d36/d63/d1f/d79/df3/d23/lfe to d0/l12f 0 2024-04-20T10:54:50.537 INFO:tasks.workunit.client.0.smithi090.stdout:9/918: fdatasync d0/d29/d36/d63/d1f/d79/df3/d6b/f72 0 2024-04-20T10:54:50.538 INFO:tasks.workunit.client.0.smithi090.stdout:9/919: creat d0/d86/f130 x:0 0 0 2024-04-20T10:54:50.540 INFO:tasks.workunit.client.0.smithi090.stdout:9/920: link d0/d29/d36/d63/d1f/d34/d70/c5e d0/d9a/d113/c131 0 2024-04-20T10:54:50.545 INFO:tasks.workunit.client.0.smithi090.stdout:8/729: dread d0/d3a/d9f/f41 [4194304,4194304] 0 2024-04-20T10:54:50.545 INFO:tasks.workunit.client.0.smithi090.stdout:8/730: stat d0/d26/f40 0 2024-04-20T10:54:50.545 INFO:tasks.workunit.client.0.smithi090.stdout:8/731: dread - d0/d3a/d9f/d52/fba zero size 2024-04-20T10:54:50.547 INFO:tasks.workunit.client.0.smithi090.stdout:9/921: dread d0/f51 [0,4194304] 0 2024-04-20T10:54:50.547 INFO:tasks.workunit.client.0.smithi090.stdout:9/922: fdatasync d0/d29/d36/d63/d1f/d79/df3/d6b/f11b 0 2024-04-20T10:54:50.548 INFO:tasks.workunit.client.0.smithi090.stdout:9/923: mkdir d0/d29/d36/d63/d1f/d79/df3/ddc/d132 0 2024-04-20T10:54:50.548 INFO:tasks.workunit.client.0.smithi090.stdout:9/924: symlink d0/d29/d36/d63/d1f/d79/df3/ddc/d132/l133 0 2024-04-20T10:54:50.549 INFO:tasks.workunit.client.0.smithi090.stdout:9/925: symlink d0/d29/d36/d63/d1f/d79/df3/ddc/d132/l134 0 2024-04-20T10:54:50.549 INFO:tasks.workunit.client.0.smithi090.stdout:9/926: stat d0/d29/d36/d63/d1f/d79/df3/d23/daa/c122 0 2024-04-20T10:54:50.549 INFO:tasks.workunit.client.0.smithi090.stdout:5/906: dread d1/da/d1f/dad/fcc [0,4194304] 0 2024-04-20T10:54:50.550 INFO:tasks.workunit.client.0.smithi090.stdout:9/927: read d0/d29/d36/d63/d1f/d79/df3/f27 [683560,124721] 0 2024-04-20T10:54:50.550 INFO:tasks.workunit.client.0.smithi090.stdout:5/907: write d1/d2a/f9c [47679,84419] 0 2024-04-20T10:54:50.551 INFO:tasks.workunit.client.0.smithi090.stdout:9/928: chown d0/c73 722871839 1 2024-04-20T10:54:50.558 INFO:tasks.workunit.client.0.smithi090.stdout:5/908: dread d1/da/d1f/f25 [0,4194304] 0 2024-04-20T10:54:50.559 INFO:tasks.workunit.client.0.smithi090.stdout:5/909: creat d1/da/d14/f139 x:0 0 0 2024-04-20T10:54:50.559 INFO:tasks.workunit.client.0.smithi090.stdout:5/910: read - d1/da/d1f/dad/dc8/ff5 zero size 2024-04-20T10:54:50.565 INFO:tasks.workunit.client.0.smithi090.stdout:5/911: write d1/d2f/f44 [3361303,60233] 0 2024-04-20T10:54:50.566 INFO:tasks.workunit.client.0.smithi090.stdout:5/912: mkdir d1/d2f/d3d/d40/d89/d13a 0 2024-04-20T10:54:50.567 INFO:tasks.workunit.client.0.smithi090.stdout:5/913: symlink d1/d2f/d3d/d40/d6c/dd2/l13b 0 2024-04-20T10:54:50.568 INFO:tasks.workunit.client.0.smithi090.stdout:9/929: dwrite d0/d29/d36/d63/d1f/d4d/fbb [4194304,4194304] 0 2024-04-20T10:54:50.570 INFO:tasks.workunit.client.0.smithi090.stdout:9/930: dread d0/d29/d36/d63/d1f/d34/d70/d52/f49 [0,4194304] 0 2024-04-20T10:54:50.572 INFO:tasks.workunit.client.0.smithi090.stdout:9/931: dread d0/d29/f92 [0,4194304] 0 2024-04-20T10:54:50.574 INFO:tasks.workunit.client.0.smithi090.stdout:5/914: write d1/da/d1f/dad/fd0 [1894784,87757] 0 2024-04-20T10:54:50.574 INFO:tasks.workunit.client.0.smithi090.stdout:5/915: write d1/de/d75/f95 [2618720,36258] 0 2024-04-20T10:54:50.576 INFO:tasks.workunit.client.0.smithi090.stdout:5/916: link d1/d2f/d3d/d40/d6c/dd2/l13b d1/d41/d125/l13c 0 2024-04-20T10:54:50.576 INFO:tasks.workunit.client.0.smithi090.stdout:9/932: getdents d0/d29/d36/d63/d1f/d79/df3/ddc/d132 0 2024-04-20T10:54:50.577 INFO:tasks.workunit.client.0.smithi090.stdout:9/933: read - d0/d29/d36/d63/d1f/d79/df3/d82/fff zero size 2024-04-20T10:54:50.578 INFO:tasks.workunit.client.0.smithi090.stdout:5/917: mkdir d1/da/d1f/da4/d13d 0 2024-04-20T10:54:50.580 INFO:tasks.workunit.client.0.smithi090.stdout:9/934: creat d0/d29/d36/d63/d1f/d79/df3/d6b/f135 x:0 0 0 2024-04-20T10:54:50.580 INFO:tasks.workunit.client.0.smithi090.stdout:5/918: fsync d1/d2f/f44 0 2024-04-20T10:54:50.581 INFO:tasks.workunit.client.0.smithi090.stdout:9/935: symlink d0/d29/d36/d63/d1f/d79/df3/de0/l136 0 2024-04-20T10:54:50.584 INFO:tasks.workunit.client.0.smithi090.stdout:5/919: rename d1/d41/d98/d101 to d1/da/d13e 0 2024-04-20T10:54:50.585 INFO:tasks.workunit.client.0.smithi090.stdout:9/936: mknod d0/d29/d36/d63/d1f/d79/df3/d82/c137 0 2024-04-20T10:54:50.586 INFO:tasks.workunit.client.0.smithi090.stdout:5/920: mknod d1/d2f/c13f 0 2024-04-20T10:54:50.586 INFO:tasks.workunit.client.0.smithi090.stdout:5/921: getdents d1/d2a 0 2024-04-20T10:54:50.586 INFO:tasks.workunit.client.0.smithi090.stdout:9/937: readlink d0/d29/d36/l88 0 2024-04-20T10:54:50.587 INFO:tasks.workunit.client.0.smithi090.stdout:9/938: readlink d0/d29/d36/d63/d1f/d79/df3/ddc/d132/l134 0 2024-04-20T10:54:50.587 INFO:tasks.workunit.client.0.smithi090.stdout:5/922: getdents d1/da/d1f/da4 0 2024-04-20T10:54:50.587 INFO:tasks.workunit.client.0.smithi090.stdout:5/923: readlink d1/de/d75/lfa 0 2024-04-20T10:54:50.589 INFO:tasks.workunit.client.0.smithi090.stdout:5/924: truncate d1/da/d1f/f9b 121816 0 2024-04-20T10:54:50.589 INFO:tasks.workunit.client.0.smithi090.stdout:5/925: write d1/da/d13e/d138/d10c/d103/f12f [772572,52172] 0 2024-04-20T10:54:50.590 INFO:tasks.workunit.client.0.smithi090.stdout:5/926: mknod d1/de/c140 0 2024-04-20T10:54:50.591 INFO:tasks.workunit.client.0.smithi090.stdout:5/927: mknod d1/da/d14/d113/c141 0 2024-04-20T10:54:50.593 INFO:tasks.workunit.client.0.smithi090.stdout:5/928: dread d1/da/d1f/dad/fd0 [4194304,4194304] 0 2024-04-20T10:54:50.593 INFO:tasks.workunit.client.0.smithi090.stdout:5/929: readlink d1/d55/l105 0 2024-04-20T10:54:50.594 INFO:tasks.workunit.client.0.smithi090.stdout:5/930: mknod d1/da/d1f/dad/de0/c142 0 2024-04-20T10:54:50.595 INFO:tasks.workunit.client.0.smithi090.stdout:5/931: mkdir d1/d2f/d3d/d40/d6c/d143 0 2024-04-20T10:54:50.595 INFO:tasks.workunit.client.0.smithi090.stdout:5/932: mkdir d1/da/d144 0 2024-04-20T10:54:50.596 INFO:tasks.workunit.client.0.smithi090.stdout:5/933: write d1/d41/d98/f110 [132404,33511] 0 2024-04-20T10:54:50.601 INFO:tasks.workunit.client.0.smithi090.stdout:5/934: dread d1/de/f57 [0,4194304] 0 2024-04-20T10:54:50.618 INFO:tasks.workunit.client.0.smithi090.stdout:5/935: dwrite d1/da/d13e/d138/f64 [4194304,4194304] 0 2024-04-20T10:54:50.620 INFO:tasks.workunit.client.0.smithi090.stdout:5/936: symlink d1/d2f/d3d/l145 0 2024-04-20T10:54:50.620 INFO:tasks.workunit.client.0.smithi090.stdout:5/937: chown d1/da/c27 1831 1 2024-04-20T10:54:50.621 INFO:tasks.workunit.client.0.smithi090.stdout:5/938: mkdir d1/d2f/d146 0 2024-04-20T10:54:50.621 INFO:tasks.workunit.client.0.smithi090.stdout:5/939: readlink d1/d2f/d3d/d40/ld1 0 2024-04-20T10:54:50.621 INFO:tasks.workunit.client.0.smithi090.stdout:5/940: mkdir d1/d41/d98/d147 0 2024-04-20T10:54:50.622 INFO:tasks.workunit.client.0.smithi090.stdout:5/941: read d1/d2f/d3d/d40/fb4 [245951,73618] 0 2024-04-20T10:54:50.623 INFO:tasks.workunit.client.0.smithi090.stdout:5/942: mknod d1/da/d16/c148 0 2024-04-20T10:54:50.624 INFO:tasks.workunit.client.0.smithi090.stdout:5/943: mknod d1/d2f/d3d/d40/d6c/dd2/c149 0 2024-04-20T10:54:50.626 INFO:tasks.workunit.client.0.smithi090.stdout:5/944: rmdir d1/d41/d98/daf/ddd 0 2024-04-20T10:54:50.626 INFO:tasks.workunit.client.0.smithi090.stdout:5/945: dread - d1/da/d1f/d115/f132 zero size 2024-04-20T10:54:50.627 INFO:tasks.workunit.client.0.smithi090.stdout:5/946: rmdir d1/da/d14/dc0 39 2024-04-20T10:54:50.635 INFO:tasks.workunit.client.0.smithi090.stdout:5/947: dread d1/da/d1f/f9b [0,4194304] 0 2024-04-20T10:54:50.636 INFO:tasks.workunit.client.0.smithi090.stdout:5/948: truncate d1/d2f/d3d/d40/f90 366355 0 2024-04-20T10:54:50.636 INFO:tasks.workunit.client.0.smithi090.stdout:5/949: readlink d1/de/l31 0 2024-04-20T10:54:50.637 INFO:tasks.workunit.client.0.smithi090.stdout:5/950: symlink d1/da/d13e/d138/d10c/d103/l14a 0 2024-04-20T10:54:50.639 INFO:tasks.workunit.client.0.smithi090.stdout:5/951: dread d1/d2f/d3d/d40/d89/fd3 [0,4194304] 0 2024-04-20T10:54:50.656 INFO:tasks.workunit.client.0.smithi090.stdout:5/952: dwrite d1/da/d1f/dad/de0/ffc [0,4194304] 0 2024-04-20T10:54:50.657 INFO:tasks.workunit.client.0.smithi090.stdout:5/953: fsync d1/d41/d98/f110 0 2024-04-20T10:54:50.657 INFO:tasks.workunit.client.0.smithi090.stdout:5/954: stat d1/da/d14/dda/l11a 0 2024-04-20T10:54:50.657 INFO:tasks.workunit.client.0.smithi090.stdout:5/955: link d1/d2f/f117 d1/de/d75/f14b 0 2024-04-20T10:54:50.658 INFO:tasks.workunit.client.0.smithi090.stdout:5/956: stat d1/da/d16 0 2024-04-20T10:54:50.658 INFO:tasks.workunit.client.0.smithi090.stdout:5/957: chown d1/de/l10d 17174 1 2024-04-20T10:54:50.658 INFO:tasks.workunit.client.0.smithi090.stdout:5/958: readlink d1/d2f/d3d/le3 0 2024-04-20T10:54:50.658 INFO:tasks.workunit.client.0.smithi090.stdout:5/959: rmdir d1/d2f/d146 0 2024-04-20T10:54:50.660 INFO:tasks.workunit.client.0.smithi090.stdout:5/960: link d1/da/lb0 d1/d2f/l14c 0 2024-04-20T10:54:50.660 INFO:tasks.workunit.client.0.smithi090.stdout:5/961: write d1/d2f/d85/ff6 [4785913,62036] 0 2024-04-20T10:54:50.662 INFO:tasks.workunit.client.0.smithi090.stdout:5/962: rename d1/de/d75/fbe to d1/da/dce/f14d 0 2024-04-20T10:54:50.662 INFO:tasks.workunit.client.0.smithi090.stdout:5/963: dread d1/da/d1f/f9b [0,4194304] 0 2024-04-20T10:54:50.663 INFO:tasks.workunit.client.0.smithi090.stdout:5/964: mkdir d1/da/d14/d47/d50/d14e 0 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/965: creat d1/da/d14/dda/f14f x:0 0 0 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/966: chown d1/da/d1f/l134 64924460 1 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/967: stat d1/d55/la1 0 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/968: fdatasync d1/da/d1f/dad/dc8/fd9 0 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/969: write d1/da/d1f/d115/f132 [836956,129870] 0 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/970: dread - d1/da/d1f/dad/de0/f127 zero size 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/971: fsync d1/da/d13e/d138/d10c/f8e 0 2024-04-20T10:54:50.665 INFO:tasks.workunit.client.0.smithi090.stdout:5/972: stat d1/f23 0 2024-04-20T10:54:50.666 INFO:tasks.workunit.client.0.smithi090.stdout:5/973: mknod d1/da/d1f/dad/de0/c150 0 2024-04-20T10:54:50.666 INFO:tasks.workunit.client.0.smithi090.stdout:5/974: rename d1/da/d1f/da4/lee to d1/d41/d98/daf/l151 0 2024-04-20T10:54:50.666 INFO:tasks.workunit.client.0.smithi090.stdout:5/975: rmdir d1/da/d1f/dad/dc8 39 2024-04-20T10:54:50.667 INFO:tasks.workunit.client.0.smithi090.stdout:5/976: truncate d1/da/d14/d47/fb6 68899 0 2024-04-20T10:54:50.677 INFO:tasks.workunit.client.0.smithi090.stdout:5/977: read d1/d2f/d3d/d40/d6c/f82 [4099331,52179] 0 2024-04-20T10:54:50.689 INFO:tasks.workunit.client.0.smithi090.stdout:8/732: dwrite d0/d3a/d4a/f95 [0,4194304] 0 2024-04-20T10:54:50.690 INFO:tasks.workunit.client.0.smithi090.stdout:8/733: fsync d0/d11/fdb 0 2024-04-20T10:54:50.690 INFO:tasks.workunit.client.0.smithi090.stdout:8/734: fsync d0/d3a/d9f/db9/fc1 0 2024-04-20T10:54:50.691 INFO:tasks.workunit.client.0.smithi090.stdout:8/735: mkdir d0/d11/d22/d53/df6 0 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:4/667: sync 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:3/721: sync 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:2/751: sync 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:0/761: sync 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:7/714: sync 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:6/580: sync 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:4/668: fsync d7/d9/d17/f37 0 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:2/752: dread - d11/d1a/d4a/d55/da1/fb7 zero size 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:6/581: truncate d1/d19/f1a 1945417 0 2024-04-20T10:54:50.693 INFO:tasks.workunit.client.0.smithi090.stdout:1/830: sync 2024-04-20T10:54:50.694 INFO:tasks.workunit.client.0.smithi090.stdout:0/762: symlink d14/d19/d2b/d52/dab/ddc/lf3 0 2024-04-20T10:54:50.696 INFO:tasks.workunit.client.0.smithi090.stdout:2/753: creat d11/d1a/d4a/d59/ff8 x:0 0 0 2024-04-20T10:54:50.698 INFO:tasks.workunit.client.0.smithi090.stdout:4/669: rename d7/d9/d17/d56/d66/d70/da1/dcd/d3d/d9e to d7/d9/d47/d8d/dda 0 2024-04-20T10:54:50.698 INFO:tasks.workunit.client.0.smithi090.stdout:4/670: truncate d7/fb9 5132584 0 2024-04-20T10:54:50.699 INFO:tasks.workunit.client.0.smithi090.stdout:1/831: symlink d8/d1a/d4d/dc6/l114 0 2024-04-20T10:54:50.699 INFO:tasks.workunit.client.0.smithi090.stdout:1/832: fsync d8/fe 0 2024-04-20T10:54:50.701 INFO:tasks.workunit.client.0.smithi090.stdout:0/763: creat d14/d19/d2b/d8e/d43/d5c/d70/d9b/ff4 x:0 0 0 2024-04-20T10:54:50.701 INFO:tasks.workunit.client.0.smithi090.stdout:8/736: dread d0/d26/f39 [0,4194304] 0 2024-04-20T10:54:50.701 INFO:tasks.workunit.client.0.smithi090.stdout:3/722: write d7/d15/d47/d56/fac [2695292,59147] 0 2024-04-20T10:54:50.702 INFO:tasks.workunit.client.0.smithi090.stdout:3/723: dread - d7/d35/fc7 zero size 2024-04-20T10:54:50.702 INFO:tasks.workunit.client.0.smithi090.stdout:4/671: mknod d7/d9/d17/d56/d66/d70/cdb 0 2024-04-20T10:54:50.702 INFO:tasks.workunit.client.0.smithi090.stdout:4/672: fsync d7/d9/d17/dc4/fd9 0 2024-04-20T10:54:50.703 INFO:tasks.workunit.client.0.smithi090.stdout:1/833: getdents d8/d1a/d4d 0 2024-04-20T10:54:50.703 INFO:tasks.workunit.client.0.smithi090.stdout:1/834: chown d8/d1a/d1d/d67/dff/d8f/db4 1380129 1 2024-04-20T10:54:50.703 INFO:tasks.workunit.client.0.smithi090.stdout:1/835: truncate d8/d1a/d1d/d7a/d9a/fcc 284574 0 2024-04-20T10:54:50.703 INFO:tasks.workunit.client.0.smithi090.stdout:1/836: write d8/d1a/d1d/d67/f23 [3664435,113467] 0 2024-04-20T10:54:50.704 INFO:tasks.workunit.client.0.smithi090.stdout:0/764: chown d14/d19/d2b/c6c 96 1 2024-04-20T10:54:50.706 INFO:tasks.workunit.client.0.smithi090.stdout:3/724: link d7/d15/d47/f5a d7/d11/dd0/fe5 0 2024-04-20T10:54:50.706 INFO:tasks.workunit.client.0.smithi090.stdout:3/725: write d7/f71 [659207,96693] 0 2024-04-20T10:54:50.706 INFO:tasks.workunit.client.0.smithi090.stdout:3/726: chown d7/d11/l65 153 1 2024-04-20T10:54:50.707 INFO:tasks.workunit.client.0.smithi090.stdout:4/673: mknod d7/d9/d17/d56/d66/d70/da1/dcd/d42/cdc 0 2024-04-20T10:54:50.707 INFO:tasks.workunit.client.0.smithi090.stdout:5/978: write d1/de/dcf/f76 [1148382,113695] 0 2024-04-20T10:54:50.707 INFO:tasks.workunit.client.0.smithi090.stdout:2/754: getdents d11/d1a/d4a/d59 0 2024-04-20T10:54:50.708 INFO:tasks.workunit.client.0.smithi090.stdout:0/765: mkdir d14/d19/d2b/d52/dab/da1/df5 0 2024-04-20T10:54:50.710 INFO:tasks.workunit.client.0.smithi090.stdout:3/727: mknod d7/d43/dc5/ce6 0 2024-04-20T10:54:50.711 INFO:tasks.workunit.client.0.smithi090.stdout:4/674: rmdir d7/d9/d17/d56/d66/d70/da1/dcd/d3d/dd2 39 2024-04-20T10:54:50.713 INFO:tasks.workunit.client.0.smithi090.stdout:6/582: dwrite d1/d4/d26/d11/f8a [0,4194304] 0 2024-04-20T10:54:50.714 INFO:tasks.workunit.client.0.smithi090.stdout:5/979: creat d1/da/d1f/dad/dc8/f152 x:0 0 0 2024-04-20T10:54:50.714 INFO:tasks.workunit.client.0.smithi090.stdout:5/980: write d1/da/d13e/d138/d10c/f12b [334008,78832] 0 2024-04-20T10:54:50.715 INFO:tasks.workunit.client.0.smithi090.stdout:2/755: creat d11/d1a/d4a/d80/ff9 x:0 0 0 2024-04-20T10:54:50.715 INFO:tasks.workunit.client.0.smithi090.stdout:6/583: dread d1/d4/d26/d11/f71 [0,4194304] 0 2024-04-20T10:54:50.716 INFO:tasks.workunit.client.0.smithi090.stdout:1/837: dread d8/fe [0,4194304] 0 2024-04-20T10:54:50.716 INFO:tasks.workunit.client.0.smithi090.stdout:1/838: write d8/d1a/d1d/d67/dff/d3f/fa7 [47310,28156] 0 2024-04-20T10:54:50.716 INFO:tasks.workunit.client.0.smithi090.stdout:1/839: fdatasync d8/f7f 0 2024-04-20T10:54:50.717 INFO:tasks.workunit.client.0.smithi090.stdout:0/766: unlink d14/d19/fd5 0 2024-04-20T10:54:50.719 INFO:tasks.workunit.client.0.smithi090.stdout:3/728: link d7/d15/d2a/d30/le0 d7/d26/le7 0 2024-04-20T10:54:50.719 INFO:tasks.workunit.client.0.smithi090.stdout:4/675: rmdir d7/d9/d17/d56/d66/d70/da5/db3 39 2024-04-20T10:54:50.723 INFO:tasks.workunit.client.0.smithi090.stdout:1/840: rmdir d8/d1a/d1d/d67/dff/d8f/db4/dd1 39 2024-04-20T10:54:50.723 INFO:tasks.workunit.client.0.smithi090.stdout:1/841: dread - d8/d1a/d1d/d67/dff/d8f/db4/fc1 zero size 2024-04-20T10:54:50.725 INFO:tasks.workunit.client.0.smithi090.stdout:1/842: read d8/d1a/d1d/d67/dff/d4a/d93/fa4 [564232,93572] 0 2024-04-20T10:54:50.725 INFO:tasks.workunit.client.0.smithi090.stdout:6/584: symlink d1/d4/d26/d11/d4a/d70/lc6 0 2024-04-20T10:54:50.728 INFO:tasks.workunit.client.0.smithi090.stdout:2/756: rename d11/d1a/d30/fa8 to d11/db0/ffa 0 2024-04-20T10:54:50.730 INFO:tasks.workunit.client.0.smithi090.stdout:4/676: rmdir d7/d9/d17/d56 39 2024-04-20T10:54:50.730 INFO:tasks.workunit.client.0.smithi090.stdout:6/585: mkdir d1/d4/d26/d11/d4a/d56/dc7 0 2024-04-20T10:54:50.743 INFO:tasks.workunit.client.0.smithi090.stdout:3/729: write d7/d11/fb0 [3665654,47606] 0 2024-04-20T10:54:50.757 INFO:tasks.workunit.client.0.smithi090.stdout:8/737: dwrite d0/f27 [0,4194304] 0 2024-04-20T10:54:50.761 INFO:tasks.workunit.client.0.smithi090.stdout:2/757: dwrite d11/f1c [0,4194304] 0 2024-04-20T10:54:50.761 INFO:tasks.workunit.client.0.smithi090.stdout:5/981: dwrite d1/d2f/d3d/f137 [0,4194304] 0 2024-04-20T10:54:50.761 INFO:tasks.workunit.client.0.smithi090.stdout:0/767: dwrite d14/d19/d2b/d8e/d43/d5c/d70/d9b/fe1 [0,4194304] 0 2024-04-20T10:54:50.761 INFO:tasks.workunit.client.0.smithi090.stdout:0/768: write d14/d19/d2b/d52/dab/ddc/de4/d5b/f8f [586490,111684] 0 2024-04-20T10:54:50.762 INFO:tasks.workunit.client.0.smithi090.stdout:4/677: dwrite d7/d9/d17/d56/d66/d70/da1/dcd/d42/f67 [0,4194304] 0 2024-04-20T10:54:50.762 INFO:tasks.workunit.client.0.smithi090.stdout:4/678: readlink d7/d9/d17/d56/d66/d70/da1/dcd/d3d/l6c 0 2024-04-20T10:54:50.762 INFO:tasks.workunit.client.0.smithi090.stdout:7/715: dwrite d11/d61/f7a [4194304,4194304] 0 2024-04-20T10:54:50.768 INFO:tasks.workunit.client.0.smithi090.stdout:8/738: dread d0/f28 [0,4194304] 0 2024-04-20T10:54:50.771 INFO:tasks.workunit.client.0.smithi090.stdout:1/843: dwrite d8/d1a/d1d/fe6 [0,4194304] 0 2024-04-20T10:54:50.983 INFO:tasks.workunit.client.0.smithi090.stdout:6/586: creat d1/d19/d36/d28/fc8 x:0 0 0 2024-04-20T10:54:50.984 INFO:tasks.workunit.client.0.smithi090.stdout:3/730: mknod d7/d43/db7/dd4/ce8 0 2024-04-20T10:54:50.984 INFO:tasks.workunit.client.0.smithi090.stdout:3/731: dread - d7/d43/fcd zero size 2024-04-20T10:54:50.985 INFO:tasks.workunit.client.0.smithi090.stdout:5/982: truncate d1/de/d75/f14b 2039831 0 2024-04-20T10:54:50.985 INFO:tasks.workunit.client.0.smithi090.stdout:5/983: chown d1/da/d1f/l7d 434402 1 2024-04-20T10:54:50.986 INFO:tasks.workunit.client.0.smithi090.stdout:2/758: dread d11/d1f/d2e/d6e/dc7/fd3 [0,4194304] 0 2024-04-20T10:54:50.988 INFO:tasks.workunit.client.0.smithi090.stdout:7/716: creat d11/d13/d5b/db8/de0/fe7 x:0 0 0 2024-04-20T10:54:50.988 INFO:tasks.workunit.client.0.smithi090.stdout:7/717: chown d11/d13/d33 5615 1 2024-04-20T10:54:50.989 INFO:tasks.workunit.client.0.smithi090.stdout:8/739: mknod d0/d26/da7/da9/cf7 0 2024-04-20T10:54:50.993 INFO:tasks.workunit.client.0.smithi090.stdout:2/759: dread d11/f1c [0,4194304] 0 2024-04-20T10:54:50.993 INFO:tasks.workunit.client.0.smithi090.stdout:2/760: getdents d11/d1f/d2e/d6e/ddc 0 2024-04-20T10:54:50.993 INFO:tasks.workunit.client.0.smithi090.stdout:2/761: chown d11/d1f/d2e/d6e/dc9/fea 1178 1 2024-04-20T10:54:50.994 INFO:tasks.workunit.client.0.smithi090.stdout:2/762: fdatasync d11/d1a/d4a/d55/f9a 0 2024-04-20T10:54:50.994 INFO:tasks.workunit.client.0.smithi090.stdout:2/763: dread - d11/d1a/d37/d85/f99 zero size 2024-04-20T10:54:50.994 INFO:tasks.workunit.client.0.smithi090.stdout:2/764: dread - d11/d1a/d37/d85/f99 zero size 2024-04-20T10:54:50.995 INFO:tasks.workunit.client.0.smithi090.stdout:7/718: write f4 [120040,107333] 0 2024-04-20T10:54:51.002 INFO:tasks.workunit.client.0.smithi090.stdout:7/719: dread f6 [4194304,4194304] 0 2024-04-20T10:54:51.004 INFO:tasks.workunit.client.0.smithi090.stdout:1/844: unlink d8/d1a/d1d/d67/dff/d3f/fa7 0 2024-04-20T10:54:51.005 INFO:tasks.workunit.client.0.smithi090.stdout:6/587: truncate d1/d4/f7e 237249 0 2024-04-20T10:54:51.006 INFO:tasks.workunit.client.0.smithi090.stdout:3/732: link d7/d15/d2a/f58 d7/d15/d2a/d8d/fe9 0 2024-04-20T10:54:51.007 INFO:tasks.workunit.client.0.smithi090.stdout:5/984: getdents d1/d2f/d85 0 2024-04-20T10:54:51.009 INFO:tasks.workunit.client.0.smithi090.stdout:0/769: rename d14/c1d to d14/d19/d2b/d8e/d43/de9/cf6 0 2024-04-20T10:54:51.009 INFO:tasks.workunit.client.0.smithi090.stdout:0/770: readlink d14/d39/d7c/le5 0 2024-04-20T10:54:51.009 INFO:tasks.workunit.client.0.smithi090.stdout:0/771: dread - d14/d19/d31/fde zero size 2024-04-20T10:54:51.010 INFO:tasks.workunit.client.0.smithi090.stdout:8/740: creat d0/d3a/ff8 x:0 0 0 2024-04-20T10:54:51.011 INFO:tasks.workunit.client.0.smithi090.stdout:2/765: creat d11/d1f/d2e/d6e/ddc/ffb x:0 0 0 2024-04-20T10:54:51.011 INFO:tasks.workunit.client.0.smithi090.stdout:2/766: chown d11/d1f/d2e/d6e/dc7/de2 404579701 1 2024-04-20T10:54:51.011 INFO:tasks.workunit.client.0.smithi090.stdout:2/767: truncate d11/d1f/fbb 1345212 0 2024-04-20T10:54:51.012 INFO:tasks.workunit.client.0.smithi090.stdout:7/720: mkdir d11/d13/d5b/de8 0 2024-04-20T10:54:51.013 INFO:tasks.workunit.client.0.smithi090.stdout:1/845: creat d8/d1a/d1d/d67/dff/d3f/f115 x:0 0 0 2024-04-20T10:54:51.013 INFO:tasks.workunit.client.0.smithi090.stdout:6/588: stat d1/d19/c77 0 2024-04-20T10:54:51.015 INFO:tasks.workunit.client.0.smithi090.stdout:5/985: creat d1/da/f153 x:0 0 0 2024-04-20T10:54:51.016 INFO:tasks.workunit.client.0.smithi090.stdout:3/733: rename d7/d43/c87 to d7/d15/d2a/d30/d48/cea 0 2024-04-20T10:54:51.018 INFO:tasks.workunit.client.0.smithi090.stdout:0/772: dread d14/d19/d9e/fe2 [0,4194304] 0 2024-04-20T10:54:51.018 INFO:tasks.workunit.client.0.smithi090.stdout:2/768: mknod d11/d1f/d2e/d6e/dc9/cfc 0 2024-04-20T10:54:51.018 INFO:tasks.workunit.client.0.smithi090.stdout:5/986: dread d1/de/d96/fed [0,4194304] 0 2024-04-20T10:54:51.018 INFO:tasks.workunit.client.0.smithi090.stdout:8/741: dread d0/d3a/f6e [0,4194304] 0 2024-04-20T10:54:51.018 INFO:tasks.workunit.client.0.smithi090.stdout:5/987: write d1/da/d1f/dad/f10f [889804,41613] 0 2024-04-20T10:54:51.019 INFO:tasks.workunit.client.0.smithi090.stdout:1/846: rename d8/d1a/d1d/l3a to d8/d1a/d1d/d67/dff/d6e/d10d/l116 0 2024-04-20T10:54:51.020 INFO:tasks.workunit.client.0.smithi090.stdout:8/742: getdents d0/d3a/d4a 0 2024-04-20T10:54:51.020 INFO:tasks.workunit.client.0.smithi090.stdout:5/988: dread d1/da/d14/fde [0,4194304] 0 2024-04-20T10:54:51.021 INFO:tasks.workunit.client.0.smithi090.stdout:4/679: truncate d7/f21 4423243 0 2024-04-20T10:54:51.023 INFO:tasks.workunit.client.0.smithi090.stdout:3/734: rename d7/df/dd1/dd3/fd8 to d7/d15/d47/feb 0 2024-04-20T10:54:51.032 INFO:tasks.workunit.client.0.smithi090.stdout:7/721: dwrite d11/d13/d5b/fcc [0,4194304] 0 2024-04-20T10:54:51.032 INFO:tasks.workunit.client.0.smithi090.stdout:6/589: write d1/d19/d36/d28/f34 [3276092,66459] 0 2024-04-20T10:54:51.042 INFO:tasks.workunit.client.0.smithi090.stdout:0/773: dwrite d14/f22 [4194304,4194304] 0 2024-04-20T10:54:51.050 INFO:tasks.workunit.client.0.smithi090.stdout:0/774: write d14/f21 [482235,81811] 0 2024-04-20T10:54:51.118 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:51.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.216+0000 7f4d918f2640 1 Processor -- start 2024-04-20T10:54:51.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.216+0000 7f4d918f2640 1 -- start start 2024-04-20T10:54:51.217 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.216+0000 7f4d918f2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4d8c0ab730 0x7f4d8c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.216+0000 7f4d918f2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c15a720 con 0x7f4d8c0c9ee0 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.216+0000 7f4d918f2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d8c15ac80 con 0x7f4d8c153ef0 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.216+0000 7f4d918f2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4d8c15a9a0 con 0x7f4d8c0ab730 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.217+0000 7f4d8a7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4d8c0ab730 0x7f4d8c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.217+0000 7f4d8a7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4d8c0ab730 0x7f4d8c1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36206/0 (socket says 172.21.15.90:36206) 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.217+0000 7f4d8a7fc640 1 -- 172.21.15.90:0/2943288127 learned_addr learned my addr 172.21.15.90:0/2943288127 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.217+0000 7f4d8a7fc640 1 -- 172.21.15.90:0/2943288127 >> v1:172.21.15.175:6789/0 conn(0x7f4d8c153ef0 legacy=0x7f4d8c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.217+0000 7f4d8a7fc640 1 -- 172.21.15.90:0/2943288127 >> v1:172.21.15.90:6789/0 conn(0x7f4d8c0c9ee0 legacy=0x7f4d8c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.217+0000 7f4d8a7fc640 1 -- 172.21.15.90:0/2943288127 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c0c6a90 con 0x7f4d8c0ab730 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d8a7fc640 1 --2- 172.21.15.90:0/2943288127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c0ab730 0x7f4d8c1568c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009870 tx=0x7f4d8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63975fc33ff6aa9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:51.218 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d89ffb640 1 -- 172.21.15.90:0/2943288127 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80035020 con 0x7f4d8c0ab730 2024-04-20T10:54:51.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d89ffb640 1 -- 172.21.15.90:0/2943288127 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d80031870 con 0x7f4d8c0ab730 2024-04-20T10:54:51.219 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d89ffb640 1 -- 172.21.15.90:0/2943288127 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d80031c40 con 0x7f4d8c0ab730 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d918f2640 1 -- 172.21.15.90:0/2943288127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c0ab730 msgr2=0x7f4d8c1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2943288127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c0ab730 0x7f4d8c1568c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f4d80009870 tx=0x7f4d8002b910 comp rx=0 tx=0).stop 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d918f2640 1 -- 172.21.15.90:0/2943288127 shutdown_connections 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2943288127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c0ab730 0x7f4d8c1568c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d918f2640 1 -- 172.21.15.90:0/2943288127 >> 172.21.15.90:0/2943288127 conn(0x7f4d8c0cbfe0 msgr2=0x7f4d8c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d918f2640 1 -- 172.21.15.90:0/2943288127 shutdown_connections 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.218+0000 7f4d918f2640 1 -- 172.21.15.90:0/2943288127 wait complete. 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.219+0000 7f4d918f2640 1 Processor -- start 2024-04-20T10:54:51.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d918f2640 1 -- start start 2024-04-20T10:54:51.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d918f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d8c0ab730 0x7f4d8c0c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d918f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d8c0c9ee0 0x7f4d8c0c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d918f2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c153ef0 0x7f4d8c1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d918f2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c0c9100 con 0x7f4d8c153ef0 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d918f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4d8c157510 con 0x7f4d8c0c9ee0 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d918f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4d8c0c9280 con 0x7f4d8c0ab730 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c153ef0 0x7f4d8c1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c153ef0 0x7f4d8c1509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36222/0 (socket says 172.21.15.90:36222) 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d8b7fe640 1 -- 172.21.15.90:0/2106722139 learned_addr learned my addr 172.21.15.90:0/2106722139 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d8a7fc640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d8c0c9ee0 0x7f4d8c0c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.220+0000 7f4d8affd640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d8c0ab730 0x7f4d8c0c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d8b7fe640 1 -- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d8c0ab730 msgr2=0x7f4d8c0c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d8b7fe640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d8c0ab730 0x7f4d8c0c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d8b7fe640 1 -- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d8c0c9ee0 msgr2=0x7f4d8c0c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d8b7fe640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d8c0c9ee0 0x7f4d8c0c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d8b7fe640 1 -- 172.21.15.90:0/2106722139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d8c15a0c0 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d8b7fe640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c153ef0 0x7f4d8c1509a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c7a0 tx=0x7f4d8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d73fff640 1 -- 172.21.15.90:0/2106722139 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d84003b70 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d73fff640 1 -- 172.21.15.90:0/2106722139 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d84003d30 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d73fff640 1 -- 172.21.15.90:0/2106722139 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8400aa90 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d8c0b1c80 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.221+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8c1ec860 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.222+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d8c0cb7d0 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.222+0000 7f4d73fff640 1 -- 172.21.15.90:0/2106722139 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4d8400ac30 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.223+0000 7f4d73fff640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d7806c8f0 0x7f4d7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.223+0000 7f4d8affd640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d7806c8f0 0x7f4d7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.223+0000 7f4d73fff640 1 -- 172.21.15.90:0/2106722139 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f4d8408beb0 con 0x7f4d8c153ef0 2024-04-20T10:54:51.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.223+0000 7f4d8affd640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d7806c8f0 0x7f4d7806edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c001780 tx=0x7f4d7c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:51.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.227+0000 7f4d73fff640 1 -- 172.21.15.90:0/2106722139 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4d8c0cb7d0 con 0x7f4d8c153ef0 2024-04-20T10:54:51.279 INFO:tasks.workunit.client.0.smithi090.stdout:1/847: link d8/d1a/d1d/d67/dff/d4a/f65 d8/d1a/d1d/d67/dff/f117 0 2024-04-20T10:54:51.279 INFO:tasks.workunit.client.0.smithi090.stdout:1/848: getdents d8/d1a/d4d/da5 0 2024-04-20T10:54:51.279 INFO:tasks.workunit.client.0.smithi090.stdout:3/735: fsync d7/d15/d2a/f58 0 2024-04-20T10:54:51.279 INFO:tasks.workunit.client.0.smithi090.stdout:5/989: symlink d1/d2f/d3d/d40/d89/l154 0 2024-04-20T10:54:51.279 INFO:tasks.workunit.client.0.smithi090.stdout:3/736: read - d7/d35/fc7 zero size 2024-04-20T10:54:51.279 INFO:tasks.workunit.client.0.smithi090.stdout:4/680: symlink d7/d9/d17/d56/d66/d70/da5/ldd 0 2024-04-20T10:54:51.280 INFO:tasks.workunit.client.0.smithi090.stdout:4/681: truncate d7/f6e 2554902 0 2024-04-20T10:54:51.280 INFO:tasks.workunit.client.0.smithi090.stdout:1/849: write d8/d1a/d1d/d7a/d9a/fcc [790383,82749] 0 2024-04-20T10:54:51.280 INFO:tasks.workunit.client.0.smithi090.stdout:8/743: mkdir d0/d26/da7/df5/dcf/dd5/df9 0 2024-04-20T10:54:51.281 INFO:tasks.workunit.client.0.smithi090.stdout:8/744: read d0/f36 [535937,127079] 0 2024-04-20T10:54:51.282 INFO:tasks.workunit.client.0.smithi090.stdout:9/939: sync 2024-04-20T10:54:51.282 INFO:tasks.workunit.client.0.smithi090.stdout:7/722: mknod d11/d13/d5b/db8/de0/ce9 0 2024-04-20T10:54:51.282 INFO:tasks.workunit.client.0.smithi090.stdout:7/723: dread - d11/d13/f90 zero size 2024-04-20T10:54:51.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/850: dread d8/d1a/d1d/f24 [0,4194304] 0 2024-04-20T10:54:51.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/851: chown d8/d1a/d4d/f9c 36 1 2024-04-20T10:54:51.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/852: truncate d8/d1a/d1d/d67/dff/ff0 3725449 0 2024-04-20T10:54:51.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/853: read d8/f7f [1476593,53161] 0 2024-04-20T10:54:51.289 INFO:tasks.workunit.client.0.smithi090.stdout:0/775: creat d14/d19/d2b/d52/dab/ddc/de4/d5b/dbd/ff7 x:0 0 0 2024-04-20T10:54:51.293 INFO:tasks.workunit.client.0.smithi090.stdout:2/769: rename d11/d1a/d4a/d55/l60 to d11/d1a/lfd 0 2024-04-20T10:54:51.293 INFO:tasks.workunit.client.0.smithi090.stdout:2/770: fdatasync d11/d1a/d4a/d80/fe6 0 2024-04-20T10:54:51.293 INFO:tasks.workunit.client.0.smithi090.stdout:5/990: mknod d1/d2f/d3d/d40/d6c/dd2/c155 0 2024-04-20T10:54:51.294 INFO:tasks.workunit.client.0.smithi090.stdout:8/745: unlink d0/d11/d22/d53/d57/f61 0 2024-04-20T10:54:51.295 INFO:tasks.workunit.client.0.smithi090.stdout:8/746: read - d0/d26/da7/df5/ff0 zero size 2024-04-20T10:54:51.296 INFO:tasks.workunit.client.0.smithi090.stdout:9/940: creat d0/d29/d36/d63/d1f/d79/df3/f138 x:0 0 0 2024-04-20T10:54:51.297 INFO:tasks.workunit.client.0.smithi090.stdout:6/590: sync 2024-04-20T10:54:51.297 INFO:tasks.workunit.client.0.smithi090.stdout:6/591: fdatasync d1/d4/d26/d11/d4a/d6b/db5/db9/fb2 0 2024-04-20T10:54:51.298 INFO:tasks.workunit.client.0.smithi090.stdout:1/854: symlink d8/l118 0 2024-04-20T10:54:51.298 INFO:tasks.workunit.client.0.smithi090.stdout:0/776: rmdir d14/d19/d2b/d61/da0/db1/dbb 39 2024-04-20T10:54:51.299 INFO:tasks.workunit.client.0.smithi090.stdout:2/771: creat d11/d1a/d4a/d59/ffe x:0 0 0 2024-04-20T10:54:51.300 INFO:tasks.workunit.client.0.smithi090.stdout:5/991: rename d1/da/d1f/f9b to d1/da/d14/d47/f156 0 2024-04-20T10:54:51.300 INFO:tasks.workunit.client.0.smithi090.stdout:6/592: getdents d1/d19/d36/d1e/d1f/d3f/d81 0 2024-04-20T10:54:51.302 INFO:tasks.workunit.client.0.smithi090.stdout:2/772: mkdir d11/d1a/d2b/dff 0 2024-04-20T10:54:51.302 INFO:tasks.workunit.client.0.smithi090.stdout:3/737: dwrite d7/d15/f25 [0,4194304] 0 2024-04-20T10:54:51.303 INFO:tasks.workunit.client.0.smithi090.stdout:6/593: creat d1/d19/d36/d1e/fc9 x:0 0 0 2024-04-20T10:54:51.305 INFO:tasks.workunit.client.0.smithi090.stdout:8/747: read d0/d26/f55 [3028966,87515] 0 2024-04-20T10:54:51.307 INFO:tasks.workunit.client.0.smithi090.stdout:2/773: rename d11/d1a/d4a/d59/ff4 to d11/d97/f100 0 2024-04-20T10:54:51.307 INFO:tasks.workunit.client.0.smithi090.stdout:2/774: write d11/d1a/d4a/d80/fe6 [787275,107962] 0 2024-04-20T10:54:51.308 INFO:tasks.workunit.client.0.smithi090.stdout:5/992: getdents d1/d2f/d3d/d40/d6c/dd2 0 2024-04-20T10:54:51.308 INFO:tasks.workunit.client.0.smithi090.stdout:5/993: chown d1/d41/d98 1397784 1 2024-04-20T10:54:51.308 INFO:tasks.workunit.client.0.smithi090.stdout:9/941: dread d0/d29/d36/d63/fb7 [4194304,4194304] 0 2024-04-20T10:54:51.310 INFO:tasks.workunit.client.0.smithi090.stdout:8/748: truncate d0/d3a/d4a/fa6 1015409 0 2024-04-20T10:54:51.312 INFO:tasks.workunit.client.0.smithi090.stdout:1/855: dread d8/d1a/d1d/f27 [0,4194304] 0 2024-04-20T10:54:51.312 INFO:tasks.workunit.client.0.smithi090.stdout:6/594: rename d1/d4/d26/d11/d35/d97/lc0 to d1/d19/d25/lca 0 2024-04-20T10:54:51.312 INFO:tasks.workunit.client.0.smithi090.stdout:6/595: chown d1/d19/d36/d1e/d1f/d3f/d54/d9f 1332146 1 2024-04-20T10:54:51.312 INFO:tasks.workunit.client.0.smithi090.stdout:6/596: stat d1/c2f 0 2024-04-20T10:54:51.314 INFO:tasks.workunit.client.0.smithi090.stdout:2/775: chown d11/d1a/d30/da6 0 1 2024-04-20T10:54:51.314 INFO:tasks.workunit.client.0.smithi090.stdout:2/776: truncate d11/d1a/d37/d85/d87/fb8 1366579 0 2024-04-20T10:54:51.314 INFO:tasks.workunit.client.0.smithi090.stdout:2/777: fdatasync d11/d1f/d2e/d6e/dc9/fea 0 2024-04-20T10:54:51.314 INFO:tasks.workunit.client.0.smithi090.stdout:2/778: readlink l7 0 2024-04-20T10:54:51.314 INFO:tasks.workunit.client.0.smithi090.stdout:2/779: truncate d11/d1a/d4a/d55/da1/fb7 960314 0 2024-04-20T10:54:51.314 INFO:tasks.workunit.client.0.smithi090.stdout:2/780: readlink d11/la9 0 2024-04-20T10:54:51.315 INFO:tasks.workunit.client.0.smithi090.stdout:2/781: truncate d11/d1f/d2e/d6e/dc9/fea 364105 0 2024-04-20T10:54:51.315 INFO:tasks.workunit.client.0.smithi090.stdout:8/749: mkdir d0/d3a/d9f/d52/dfa 0 2024-04-20T10:54:51.320 INFO:tasks.workunit.client.0.smithi090.stdout:0/777: dwrite d14/d19/d2b/d52/dab/f75 [0,4194304] 0 2024-04-20T10:54:51.322 INFO:tasks.workunit.client.0.smithi090.stdout:0/778: dread d14/d19/f1c [0,4194304] 0 2024-04-20T10:54:51.331 INFO:tasks.workunit.client.0.smithi090.stdout:5/994: dwrite d1/da/d13e/d138/d10c/f12b [0,4194304] 0 2024-04-20T10:54:51.331 INFO:tasks.workunit.client.0.smithi090.stdout:6/597: dread d1/d19/d36/f27 [0,4194304] 0 2024-04-20T10:54:51.332 INFO:tasks.workunit.client.0.smithi090.stdout:1/856: link d8/d1a/d1d/d67/dff/d6e/dde/l111 d8/d1a/d1d/d67/dff/d4a/d5a/l119 0 2024-04-20T10:54:51.337 INFO:tasks.workunit.client.0.smithi090.stdout:9/942: rename d0/d29/d36/d63/d1f/d34 to d0/d29/d36/d63/da1/d10b/d114/d12c/d139 0 2024-04-20T10:54:51.338 INFO:tasks.workunit.client.0.smithi090.stdout:5/995: truncate d1/f7 2599020 0 2024-04-20T10:54:51.339 INFO:tasks.workunit.client.0.smithi090.stdout:1/857: mknod d8/d1a/d1d/d7a/d9a/c11a 0 2024-04-20T10:54:51.341 INFO:tasks.workunit.client.0.smithi090.stdout:9/943: link d0/d29/d36/d63/d1f/d79/d7f/fe2 d0/d29/d36/d63/da1/d10b/d114/d12c/d139/d70/f13a 0 2024-04-20T10:54:51.342 INFO:tasks.workunit.client.0.smithi090.stdout:8/750: write d0/d11/d22/d53/f54 [1436936,3988] 0 2024-04-20T10:54:51.342 INFO:tasks.workunit.client.0.smithi090.stdout:2/782: dwrite d11/f1c [0,4194304] 0 2024-04-20T10:54:51.342 INFO:tasks.workunit.client.0.smithi090.stdout:2/783: chown fd 27207 1 2024-04-20T10:54:51.344 INFO:tasks.workunit.client.0.smithi090.stdout:5/996: mknod d1/d2f/d85/c157 0 2024-04-20T10:54:51.344 INFO:tasks.workunit.client.0.smithi090.stdout:5/997: fdatasync d1/d2f/d3d/f121 0 2024-04-20T10:54:51.344 INFO:tasks.workunit.client.0.smithi090.stdout:5/998: write d1/da/d14/f139 [913158,30834] 0 2024-04-20T10:54:51.346 INFO:tasks.workunit.client.0.smithi090.stdout:2/784: dread d11/f20 [0,4194304] 0 2024-04-20T10:54:51.348 INFO:tasks.workunit.client.0.smithi090.stdout:8/751: dread d0/fe [4194304,4194304] 0 2024-04-20T10:54:51.349 INFO:tasks.workunit.client.0.smithi090.stdout:5/999: rmdir d1/da/d14/dc0 39 2024-04-20T10:54:51.353 INFO:tasks.workunit.client.0.smithi090.stdout:6/598: dwrite d1/d4/f1d [0,4194304] 0 2024-04-20T10:54:51.355 INFO:tasks.workunit.client.0.smithi090.stdout:8/752: creat d0/d3a/ffb x:0 0 0 2024-04-20T10:54:51.357 INFO:tasks.workunit.client.0.smithi090.stdout:6/599: creat d1/d4/d26/fcb x:0 0 0 2024-04-20T10:54:51.357 INFO:tasks.workunit.client.0.smithi090.stdout:6/600: chown d1/d19/d25/f78 287617 1 2024-04-20T10:54:51.357 INFO:tasks.workunit.client.0.smithi090.stdout:6/601: truncate d1/d4/d26/d11/d4a/d6b/fa8 376627 0 2024-04-20T10:54:51.357 INFO:tasks.workunit.client.0.smithi090.stdout:6/602: chown d1/d19/fa3 642114 1 2024-04-20T10:54:51.362 INFO:tasks.workunit.client.0.smithi090.stdout:0/779: dwrite d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/fb4 [0,4194304] 0 2024-04-20T10:54:51.362 INFO:tasks.workunit.client.0.smithi090.stdout:9/944: dwrite d0/d29/d36/d63/d1f/f71 [0,4194304] 0 2024-04-20T10:54:51.362 INFO:tasks.workunit.client.0.smithi090.stdout:1/858: write d8/d1a/d1d/d67/dff/d4a/d93/d5d/f8e [330208,56012] 0 2024-04-20T10:54:51.362 INFO:tasks.workunit.client.0.smithi090.stdout:1/859: readlink d8/l14 0 2024-04-20T10:54:51.365 INFO:tasks.workunit.client.0.smithi090.stdout:2/785: mknod d11/d1a/d30/c101 0 2024-04-20T10:54:51.365 INFO:tasks.workunit.client.0.smithi090.stdout:2/786: chown d11/d1a/d4a/d55/f9a 4402 1 2024-04-20T10:54:51.367 INFO:tasks.workunit.client.0.smithi090.stdout:8/753: creat d0/d2d/dd4/ffc x:0 0 0 2024-04-20T10:54:51.370 INFO:tasks.workunit.client.0.smithi090.stdout:9/945: link d0/d9a/lb3 d0/d29/d36/d63/d1f/d79/df3/d6b/l13b 0 2024-04-20T10:54:51.370 INFO:tasks.workunit.client.0.smithi090.stdout:9/946: dread - d0/d29/d36/d63/d1f/d79/fd0 zero size 2024-04-20T10:54:51.373 INFO:tasks.workunit.client.0.smithi090.stdout:6/603: dwrite d1/d4/faa [0,4194304] 0 2024-04-20T10:54:51.374 INFO:tasks.workunit.client.0.smithi090.stdout:2/787: mkdir d11/d1a/d2b/dff/d102 0 2024-04-20T10:54:51.376 INFO:tasks.workunit.client.0.smithi090.stdout:8/754: link d0/d11/d22/f23 d0/d11/d22/d53/d8e/d92/ffd 0 2024-04-20T10:54:51.376 INFO:tasks.workunit.client.0.smithi090.stdout:8/755: write d0/d11/d22/d53/d8e/d92/ffd [655432,12237] 0 2024-04-20T10:54:51.380 INFO:tasks.workunit.client.0.smithi090.stdout:6/604: unlink d1/d4/d26/c38 0 2024-04-20T10:54:51.381 INFO:tasks.workunit.client.0.smithi090.stdout:2/788: creat d11/d1a/d37/f103 x:0 0 0 2024-04-20T10:54:51.386 INFO:tasks.workunit.client.0.smithi090.stdout:8/756: dread d0/d3a/d9f/db9/fbd [0,4194304] 0 2024-04-20T10:54:51.386 INFO:tasks.workunit.client.0.smithi090.stdout:8/757: stat d0/d11/d22/d53 0 2024-04-20T10:54:51.386 INFO:tasks.workunit.client.0.smithi090.stdout:8/758: truncate d0/d2d/d49/faf 4610289 0 2024-04-20T10:54:51.386 INFO:tasks.workunit.client.0.smithi090.stdout:1/860: dwrite d8/d1a/d1d/d7a/d9a/fac [0,4194304] 0 2024-04-20T10:54:51.386 INFO:tasks.workunit.client.0.smithi090.stdout:6/605: creat d1/d9a/fcc x:0 0 0 2024-04-20T10:54:51.387 INFO:tasks.workunit.client.0.smithi090.stdout:2/789: mkdir d11/d1f/d2e/dad/d104 0 2024-04-20T10:54:51.388 INFO:tasks.workunit.client.0.smithi090.stdout:8/759: mknod d0/d3a/daa/cfe 0 2024-04-20T10:54:51.389 INFO:tasks.workunit.client.0.smithi090.stdout:0/780: dwrite d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/f8b [0,4194304] 0 2024-04-20T10:54:51.392 INFO:tasks.workunit.client.0.smithi090.stdout:9/947: dwrite d0/d29/d36/d63/d1f/d79/df3/d23/daa/fc3 [0,4194304] 0 2024-04-20T10:54:51.392 INFO:tasks.workunit.client.0.smithi090.stdout:1/861: mknod d8/d1a/d1d/d67/de2/df3/c11b 0 2024-04-20T10:54:51.392 INFO:tasks.workunit.client.0.smithi090.stdout:1/862: fdatasync d8/d1a/d1d/d67/dff/d3f/f86 0 2024-04-20T10:54:51.398 INFO:tasks.workunit.client.0.smithi090.stdout:0/781: mkdir d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/df8 0 2024-04-20T10:54:51.400 INFO:tasks.workunit.client.0.smithi090.stdout:9/948: creat d0/d29/d36/d63/d1f/d79/f13c x:0 0 0 2024-04-20T10:54:51.401 INFO:tasks.workunit.client.0.smithi090.stdout:1/863: symlink d8/d1a/d1d/d67/dff/d4a/d93/dd2/l11c 0 2024-04-20T10:54:51.402 INFO:tasks.workunit.client.0.smithi090.stdout:6/606: mknod d1/d19/d36/d1e/d1f/ccd 0 2024-04-20T10:54:51.402 INFO:tasks.workunit.client.0.smithi090.stdout:6/607: chown d1/d4/d26/d11/f8a 8909 1 2024-04-20T10:54:51.406 INFO:tasks.workunit.client.0.smithi090.stdout:0/782: write f3 [608577,18506] 0 2024-04-20T10:54:51.409 INFO:tasks.workunit.client.0.smithi090.stdout:9/949: write d0/d29/d36/d63/d1f/ff4 [2060748,67155] 0 2024-04-20T10:54:51.409 INFO:tasks.workunit.client.0.smithi090.stdout:9/950: fsync d0/d29/d36/d63/d1f/dca/fe1 0 2024-04-20T10:54:51.410 INFO:tasks.workunit.client.0.smithi090.stdout:8/760: dwrite d0/d3a/d4a/f9d [0,4194304] 0 2024-04-20T10:54:51.411 INFO:tasks.workunit.client.0.smithi090.stdout:8/761: fdatasync d0/d26/da7/fe1 0 2024-04-20T10:54:51.415 INFO:tasks.workunit.client.0.smithi090.stdout:9/951: symlink d0/d29/d36/d63/d1f/d79/df3/l13d 0 2024-04-20T10:54:51.415 INFO:tasks.workunit.client.0.smithi090.stdout:9/952: fsync d0/d29/d36/d63/da1/f12a 0 2024-04-20T10:54:51.415 INFO:tasks.workunit.client.0.smithi090.stdout:0/783: write d14/d19/d31/d34/d3b/f9c [2514893,30407] 0 2024-04-20T10:54:51.415 INFO:tasks.workunit.client.0.smithi090.stdout:2/790: dwrite d11/d1f/d2e/d6e/f7c [0,4194304] 0 2024-04-20T10:54:51.416 INFO:tasks.workunit.client.0.smithi090.stdout:0/784: write d14/d41/fd0 [375649,125134] 0 2024-04-20T10:54:51.419 INFO:tasks.workunit.client.0.smithi090.stdout:9/953: getdents d0/d29/d36/d63/d1f/d79/df3/d23/de5 0 2024-04-20T10:54:51.419 INFO:tasks.workunit.client.0.smithi090.stdout:9/954: chown d0/d29/d36/d63/d1f/d79/d7f/f103 1 1 2024-04-20T10:54:51.419 INFO:tasks.workunit.client.0.smithi090.stdout:9/955: truncate d0/d29/d36/d63/da1/faf 987693 0 2024-04-20T10:54:51.421 INFO:tasks.workunit.client.0.smithi090.stdout:9/956: dread d0/d29/d36/d63/da1/faf [0,4194304] 0 2024-04-20T10:54:51.427 INFO:tasks.workunit.client.0.smithi090.stdout:6/608: dwrite d1/fb8 [0,4194304] 0 2024-04-20T10:54:51.428 INFO:tasks.workunit.client.0.smithi090.stdout:6/609: write d1/d19/d36/f7d [528016,36334] 0 2024-04-20T10:54:51.428 INFO:tasks.workunit.client.0.smithi090.stdout:0/785: read d14/d19/d2b/d8e/d40/fbc [1329679,15727] 0 2024-04-20T10:54:51.428 INFO:tasks.workunit.client.0.smithi090.stdout:6/610: write d1/d19/d36/f7d [1441172,104967] 0 2024-04-20T10:54:51.429 INFO:tasks.workunit.client.0.smithi090.stdout:1/864: dwrite d8/f46 [0,4194304] 0 2024-04-20T10:54:51.431 INFO:tasks.workunit.client.0.smithi090.stdout:9/957: link d0/d29/d36/d63/d1f/d79/d7f/c101 d0/d29/d36/d63/d1f/d79/df3/de0/c13e 0 2024-04-20T10:54:51.431 INFO:tasks.workunit.client.0.smithi090.stdout:9/958: truncate d0/d29/d36/d63/d1f/d79/d9b/f126 679389 0 2024-04-20T10:54:51.440 INFO:tasks.workunit.client.0.smithi090.stdout:6/611: dread d1/d4/faa [0,4194304] 0 2024-04-20T10:54:51.445 INFO:tasks.workunit.client.0.smithi090.stdout:8/762: dwrite d0/f36 [0,4194304] 0 2024-04-20T10:54:51.445 INFO:tasks.workunit.client.0.smithi090.stdout:8/763: truncate d0/d26/f40 1613847 0 2024-04-20T10:54:51.447 INFO:tasks.workunit.client.0.smithi090.stdout:0/786: link d14/d19/d2b/d8e/c6a d14/d19/cf9 0 2024-04-20T10:54:51.447 INFO:tasks.workunit.client.0.smithi090.stdout:0/787: read f3 [446764,128536] 0 2024-04-20T10:54:51.447 INFO:tasks.workunit.client.0.smithi090.stdout:1/865: mkdir d8/d1a/d1d/d67/d11d 0 2024-04-20T10:54:51.448 INFO:tasks.workunit.client.0.smithi090.stdout:2/791: dwrite d11/d1a/f2c [0,4194304] 0 2024-04-20T10:54:51.448 INFO:tasks.workunit.client.0.smithi090.stdout:2/792: write d11/d1a/d37/d85/f95 [788277,110808] 0 2024-04-20T10:54:51.451 INFO:tasks.workunit.client.0.smithi090.stdout:0/788: rename d14/d19/d2b/d52/dab/ddc/de4/d5b/dbd to d14/d19/d2b/d61/da0/db1/dbb/dfa 0 2024-04-20T10:54:51.452 INFO:tasks.workunit.client.0.smithi090.stdout:1/866: rmdir d8 39 2024-04-20T10:54:51.453 INFO:tasks.workunit.client.0.smithi090.stdout:2/793: mkdir d11/d1f/d2e/dcd/d105 0 2024-04-20T10:54:51.460 INFO:tasks.workunit.client.0.smithi090.stdout:2/794: truncate d11/d1f/d2e/fb9 2919375 0 2024-04-20T10:54:51.462 INFO:tasks.workunit.client.0.smithi090.stdout:6/612: dwrite d1/d4/d26/fcb [0,4194304] 0 2024-04-20T10:54:51.463 INFO:tasks.workunit.client.0.smithi090.stdout:1/867: creat d8/d1a/d4d/f11e x:0 0 0 2024-04-20T10:54:51.467 INFO:tasks.workunit.client.0.smithi090.stdout:9/959: dwrite d0/f37 [0,4194304] 0 2024-04-20T10:54:51.468 INFO:tasks.workunit.client.0.smithi090.stdout:0/789: dwrite d14/d19/d2b/d52/dab/ddc/de4/fc1 [0,4194304] 0 2024-04-20T10:54:51.468 INFO:tasks.workunit.client.0.smithi090.stdout:0/790: chown d14/d19/f71 57344 1 2024-04-20T10:54:51.469 INFO:tasks.workunit.client.0.smithi090.stdout:1/868: mknod d8/d1a/d1d/d67/dff/d4a/d5a/d105/c11f 0 2024-04-20T10:54:51.477 INFO:tasks.workunit.client.0.smithi090.stdout:9/960: creat d0/d29/d36/f13f x:0 0 0 2024-04-20T10:54:51.481 INFO:tasks.workunit.client.0.smithi090.stdout:2/795: dwrite d11/d1a/d4a/d55/f69 [0,4194304] 0 2024-04-20T10:54:51.482 INFO:tasks.workunit.client.0.smithi090.stdout:1/869: symlink d8/d1a/d1d/d67/dff/d4a/d5a/l120 0 2024-04-20T10:54:51.487 INFO:tasks.workunit.client.0.smithi090.stdout:4/682: sync 2024-04-20T10:54:51.496 INFO:tasks.workunit.client.0.smithi090.stdout:0/791: dwrite d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/f8b [0,4194304] 0 2024-04-20T10:54:51.501 INFO:tasks.workunit.client.0.smithi090.stdout:9/961: dwrite d0/d29/d36/d63/d1f/d79/fd0 [0,4194304] 0 2024-04-20T10:54:51.502 INFO:tasks.workunit.client.0.smithi090.stdout:9/962: write d0/d29/d36/d63/d1f/d79/df3/f10d [124535,13599] 0 2024-04-20T10:54:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.534+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d8c076150 con 0x7f4d8c153ef0 2024-04-20T10:54:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.535+0000 7f4d73fff640 1 -- 172.21.15.90:0/2106722139 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5697 (secure 0 0 0) 0x7f4d8c15a0c0 con 0x7f4d8c153ef0 2024-04-20T10:54:51.535 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:51.535 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:50.336114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:54:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 33 2024-04-20T10:54:51.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d7806c8f0 msgr2=0x7f4d7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d7806c8f0 0x7f4d7806edb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c001780 tx=0x7f4d7c009040 comp rx=0 tx=0).stop 2024-04-20T10:54:51.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c153ef0 msgr2=0x7f4d8c1509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c153ef0 0x7f4d8c1509a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400c7a0 tx=0x7f4d8400cc60 comp rx=0 tx=0).stop 2024-04-20T10:54:51.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 shutdown_connections 2024-04-20T10:54:51.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4d7806c8f0 0x7f4d7806edb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4d8c153ef0 0x7f4d8c1509a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4d8c0c9ee0 0x7f4d8c0c30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 --2- 172.21.15.90:0/2106722139 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4d8c0ab730 0x7f4d8c0c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 >> 172.21.15.90:0/2106722139 conn(0x7f4d8c0cbfe0 msgr2=0x7f4d8c0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:51.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 shutdown_connections 2024-04-20T10:54:51.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.537+0000 7f4d918f2640 1 -- 172.21.15.90:0/2106722139 wait complete. 2024-04-20T10:54:51.548 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2024-04-20T10:54:51.548 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-20T10:54:51.549 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:51.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.645+0000 7f7de88d9640 1 Processor -- start 2024-04-20T10:54:51.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.645+0000 7f7de88d9640 1 -- start start 2024-04-20T10:54:51.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.645+0000 7f7de88d9640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7de4073810 0x7f7de4154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.645+0000 7f7de88d9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7de4157710 0x7f7de40c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.645+0000 7f7de88d9640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7de40c40d0 con 0x7f7de40ad0c0 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.645+0000 7f7de88d9640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f7de41569e0 con 0x7f7de4157710 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.645+0000 7f7de88d9640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7de4157280 con 0x7f7de4073810 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de1d9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7de4157710 0x7f7de40c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de1d9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7de4157710 0x7f7de40c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36226/0 (socket says 172.21.15.90:36226) 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de1d9b640 1 -- 172.21.15.90:0/1631619127 learned_addr learned my addr 172.21.15.90:0/1631619127 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de259c640 1 --2- 172.21.15.90:0/1631619127 >> v2:172.21.15.175:3300/0 conn(0x7f7de4073810 0x7f7de4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de1d9b640 1 -- 172.21.15.90:0/1631619127 >> v2:172.21.15.175:3300/0 conn(0x7f7de4073810 msgr2=0x7f7de4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de1d9b640 1 --2- 172.21.15.90:0/1631619127 >> v2:172.21.15.175:3300/0 conn(0x7f7de4073810 0x7f7de4154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de1d9b640 1 -- 172.21.15.90:0/1631619127 >> v1:172.21.15.90:6789/0 conn(0x7f7de40ad0c0 legacy=0x7f7de40abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de1d9b640 1 -- 172.21.15.90:0/1631619127 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de40c4370 con 0x7f7de4157710 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.646+0000 7f7de259c640 1 --2- 172.21.15.90:0/1631619127 >> v2:172.21.15.175:3300/0 conn(0x7f7de4073810 0x7f7de4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de1d9b640 1 --2- 172.21.15.90:0/1631619127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4157710 0x7f7de40c3b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7de40c9090 tx=0x7f7dd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635272fe66aee58b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de159a640 1 -- 172.21.15.90:0/1631619127 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8035020 con 0x7f7de4157710 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de159a640 1 -- 172.21.15.90:0/1631619127 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd8031870 con 0x7f7de4157710 2024-04-20T10:54:51.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de159a640 1 -- 172.21.15.90:0/1631619127 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8031c40 con 0x7f7de4157710 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 -- 172.21.15.90:0/1631619127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4157710 msgr2=0x7f7de40c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 --2- 172.21.15.90:0/1631619127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4157710 0x7f7de40c3b90 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7de40c9090 tx=0x7f7dd802b910 comp rx=0 tx=0).stop 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 -- 172.21.15.90:0/1631619127 shutdown_connections 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 --2- 172.21.15.90:0/1631619127 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4157710 0x7f7de40c3b90 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 --2- 172.21.15.90:0/1631619127 >> v2:172.21.15.175:3300/0 conn(0x7f7de4073810 0x7f7de4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 -- 172.21.15.90:0/1631619127 >> 172.21.15.90:0/1631619127 conn(0x7f7de40c8080 msgr2=0x7f7de40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 -- 172.21.15.90:0/1631619127 shutdown_connections 2024-04-20T10:54:51.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.647+0000 7f7de88d9640 1 -- 172.21.15.90:0/1631619127 wait complete. 2024-04-20T10:54:51.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 Processor -- start 2024-04-20T10:54:51.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 -- start start 2024-04-20T10:54:51.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4073810 0x7f7de4072a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de40ad0c0 0x7f7de41e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de4157710 0x7f7de41ec010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4073bf0 con 0x7f7de4073810 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4156f10 con 0x7f7de4157710 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de88d9640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7de40ac2c0 con 0x7f7de40ad0c0 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4073810 0x7f7de4072a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4073810 0x7f7de4072a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36240/0 (socket says 172.21.15.90:36240) 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.649+0000 7f7de259c640 1 -- 172.21.15.90:0/3961581838 learned_addr learned my addr 172.21.15.90:0/3961581838 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de2d9d640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de4157710 0x7f7de41ec010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de1d9b640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de40ad0c0 0x7f7de41e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de259c640 1 -- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de40ad0c0 msgr2=0x7f7de41e10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de259c640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de40ad0c0 0x7f7de41e10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de259c640 1 -- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de4157710 msgr2=0x7f7de41ec010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de259c640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de4157710 0x7f7de41ec010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de259c640 1 -- 172.21.15.90:0/3961581838 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de4153220 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de259c640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4073810 0x7f7de4072a20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009fa0 tx=0x7f7dd400d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7dd2ffd640 1 -- 172.21.15.90:0/3961581838 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd401a070 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7dd2ffd640 1 -- 172.21.15.90:0/3961581838 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dd4003bb0 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de41ef5e0 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7dd2ffd640 1 -- 172.21.15.90:0/3961581838 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd4004030 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.650+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de41efb60 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.651+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de4076150 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.652+0000 7f7dd2ffd640 1 -- 172.21.15.90:0/3961581838 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7dd401d070 con 0x7f7de4073810 2024-04-20T10:54:51.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.652+0000 7f7dd2ffd640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7dc406c8f0 0x7f7dc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:51.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.652+0000 7f7dd2ffd640 1 -- 172.21.15.90:0/3961581838 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f7dd408c1e0 con 0x7f7de4073810 2024-04-20T10:54:51.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.652+0000 7f7de1d9b640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7dc406c8f0 0x7f7dc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:51.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.652+0000 7f7de1d9b640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7dc406c8f0 0x7f7dc406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8036000 tx=0x7f7dd803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:51.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.656+0000 7f7dd2ffd640 1 -- 172.21.15.90:0/3961581838 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7dd4010070 con 0x7f7de4073810 2024-04-20T10:54:51.743 INFO:tasks.workunit.client.0.smithi090.stdout:2/796: mknod d11/d1f/d2e/d6e/c106 0 2024-04-20T10:54:51.743 INFO:tasks.workunit.client.0.smithi090.stdout:2/797: fsync d11/d1a/d4a/d55/da1/fe8 0 2024-04-20T10:54:51.743 INFO:tasks.workunit.client.0.smithi090.stdout:1/870: creat d8/d1a/d4d/da5/f121 x:0 0 0 2024-04-20T10:54:51.743 INFO:tasks.workunit.client.0.smithi090.stdout:4/683: link d7/d9/d17/d56/d66/d70/da1/dcd/d3d/l46 d7/d9/d17/d56/d66/d70/da5/lde 0 2024-04-20T10:54:51.744 INFO:tasks.workunit.client.0.smithi090.stdout:9/963: fdatasync d0/d29/d36/f6d 0 2024-04-20T10:54:51.744 INFO:tasks.workunit.client.0.smithi090.stdout:9/964: dread - d0/d29/d36/d63/d1f/d79/df3/d82/fbd zero size 2024-04-20T10:54:51.744 INFO:tasks.workunit.client.0.smithi090.stdout:2/798: dread d11/d1f/d2e/f33 [0,4194304] 0 2024-04-20T10:54:51.747 INFO:tasks.workunit.client.0.smithi090.stdout:1/871: unlink d8/d1a/d1d/d67/f61 0 2024-04-20T10:54:51.747 INFO:tasks.workunit.client.0.smithi090.stdout:4/684: symlink d7/d9/d47/d8d/dda/db5/ldf 0 2024-04-20T10:54:51.748 INFO:tasks.workunit.client.0.smithi090.stdout:9/965: mkdir d0/d29/d36/d63/d1f/d79/df3/d140 0 2024-04-20T10:54:51.750 INFO:tasks.workunit.client.0.smithi090.stdout:9/966: write d0/d29/d36/d63/d1f/d79/f8a [1066786,55614] 0 2024-04-20T10:54:51.751 INFO:tasks.workunit.client.0.smithi090.stdout:1/872: truncate d8/d1a/d1d/d67/dff/f117 355829 0 2024-04-20T10:54:51.752 INFO:tasks.workunit.client.0.smithi090.stdout:4/685: symlink d7/d9/d17/d56/d66/d9d/le0 0 2024-04-20T10:54:51.752 INFO:tasks.workunit.client.0.smithi090.stdout:4/686: dread - d7/d9/d17/d56/d66/d70/da1/dcd/d76/f96 zero size 2024-04-20T10:54:51.752 INFO:tasks.workunit.client.0.smithi090.stdout:4/687: fdatasync d7/d9/f39 0 2024-04-20T10:54:51.753 INFO:tasks.workunit.client.0.smithi090.stdout:9/967: link d0/d29/d36/d63/l3a d0/d29/d36/d63/d1f/d79/df3/ddc/l141 0 2024-04-20T10:54:51.755 INFO:tasks.workunit.client.0.smithi090.stdout:1/873: creat d8/d1a/d1d/d67/f122 x:0 0 0 2024-04-20T10:54:51.755 INFO:tasks.workunit.client.0.smithi090.stdout:7/724: sync 2024-04-20T10:54:51.756 INFO:tasks.workunit.client.0.smithi090.stdout:9/968: symlink d0/d29/d36/d63/d1f/d79/df3/de0/l142 0 2024-04-20T10:54:51.759 INFO:tasks.workunit.client.0.smithi090.stdout:1/874: unlink d8/d1a/d1d/d67/dff/d4a/d93/d9e/dc2/c108 0 2024-04-20T10:54:51.759 INFO:tasks.workunit.client.0.smithi090.stdout:1/875: stat d8/ff1 0 2024-04-20T10:54:51.759 INFO:tasks.workunit.client.0.smithi090.stdout:9/969: write d0/d29/d36/d63/d1f/d79/d7f/fe2 [475805,21372] 0 2024-04-20T10:54:51.761 INFO:tasks.workunit.client.0.smithi090.stdout:7/725: creat d11/d13/d33/d44/d89/d98/dc7/fea x:0 0 0 2024-04-20T10:54:51.763 INFO:tasks.workunit.client.0.smithi090.stdout:9/970: creat d0/d29/d36/d63/d1f/d79/df3/de0/f143 x:0 0 0 2024-04-20T10:54:51.763 INFO:tasks.workunit.client.0.smithi090.stdout:7/726: symlink d11/d13/d5b/leb 0 2024-04-20T10:54:51.764 INFO:tasks.workunit.client.0.smithi090.stdout:9/971: stat d0/d29/d36/d63/da1/d10b/d114/d12c/d139/d70/d52/lde 0 2024-04-20T10:54:51.765 INFO:tasks.workunit.client.0.smithi090.stdout:7/727: mkdir d11/dd2/dec 0 2024-04-20T10:54:51.775 INFO:tasks.workunit.client.0.smithi090.stdout:1/876: write d8/f46 [2854632,68363] 0 2024-04-20T10:54:51.776 INFO:tasks.workunit.client.0.smithi090.stdout:4/688: dwrite d7/d9/d47/fb1 [0,4194304] 0 2024-04-20T10:54:51.777 INFO:tasks.workunit.client.0.smithi090.stdout:1/877: mkdir d8/d1a/d1d/d67/dff/d4a/d5a/d123 0 2024-04-20T10:54:51.777 INFO:tasks.workunit.client.0.smithi090.stdout:2/799: dwrite d11/d1a/fc3 [0,4194304] 0 2024-04-20T10:54:51.778 INFO:tasks.workunit.client.0.smithi090.stdout:4/689: creat d7/d9/d17/d56/d66/d9d/fe1 x:0 0 0 2024-04-20T10:54:51.778 INFO:tasks.workunit.client.0.smithi090.stdout:4/690: dread - d7/d9/d17/d56/d66/d70/da1/dcd/d42/fc8 zero size 2024-04-20T10:54:51.778 INFO:tasks.workunit.client.0.smithi090.stdout:4/691: read d7/d9/d17/f3f [2419791,59355] 0 2024-04-20T10:54:51.779 INFO:tasks.workunit.client.0.smithi090.stdout:4/692: write d7/d9/d47/fbc [558602,69430] 0 2024-04-20T10:54:51.782 INFO:tasks.workunit.client.0.smithi090.stdout:1/878: rmdir d8/d1a/d1d/d67/dff/d4a/d5a/d105 39 2024-04-20T10:54:51.782 INFO:tasks.workunit.client.0.smithi090.stdout:1/879: readlink d8/d1a/d1d/lb8 0 2024-04-20T10:54:51.782 INFO:tasks.workunit.client.0.smithi090.stdout:1/880: write d8/d1a/d1d/d7a/db0/f10e [912971,18725] 0 2024-04-20T10:54:51.782 INFO:tasks.workunit.client.0.smithi090.stdout:1/881: fdatasync d8/d1a/d1d/d67/dff/d4a/d5a/d105/d109/f78 0 2024-04-20T10:54:51.785 INFO:tasks.workunit.client.0.smithi090.stdout:4/693: unlink d7/d9/d17/d56/d66/d70/da5/fd0 0 2024-04-20T10:54:51.787 INFO:tasks.workunit.client.0.smithi090.stdout:2/800: link d11/d1a/ld4 d11/d1a/d2b/l107 0 2024-04-20T10:54:51.788 INFO:tasks.workunit.client.0.smithi090.stdout:2/801: getdents d11/d1a/d4a/d55/da1 0 2024-04-20T10:54:51.794 INFO:tasks.workunit.client.0.smithi090.stdout:2/802: dread d11/f16 [0,4194304] 0 2024-04-20T10:54:51.795 INFO:tasks.workunit.client.0.smithi090.stdout:7/728: dwrite d11/d1a/d3f/fba [0,4194304] 0 2024-04-20T10:54:51.796 INFO:tasks.workunit.client.0.smithi090.stdout:9/972: dwrite d0/d29/d36/d63/d1f/d79/df3/d6b/fba [4194304,4194304] 0 2024-04-20T10:54:51.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/803: truncate d11/f15 243128 0 2024-04-20T10:54:51.798 INFO:tasks.workunit.client.0.smithi090.stdout:1/882: dwrite d8/d1a/d1d/d67/dff/d4a/d93/d9e/fa3 [0,4194304] 0 2024-04-20T10:54:51.799 INFO:tasks.workunit.client.0.smithi090.stdout:1/883: read d8/f59 [200,98042] 0 2024-04-20T10:54:51.800 INFO:tasks.workunit.client.0.smithi090.stdout:4/694: dread d7/d9/d17/d56/d66/d70/da1/dcd/d3d/f60 [0,4194304] 0 2024-04-20T10:54:51.800 INFO:tasks.workunit.client.0.smithi090.stdout:4/695: truncate d7/d9/fa 4553988 0 2024-04-20T10:54:51.800 INFO:tasks.workunit.client.0.smithi090.stdout:9/973: link d0/d29/d36/d63/d1f/d79/df3/d82/c115 d0/d29/d36/d63/d1f/d79/df3/d6b/c144 0 2024-04-20T10:54:51.806 INFO:tasks.workunit.client.0.smithi090.stdout:1/884: creat d8/d1a/d1d/d67/dff/d4a/d93/d5d/f124 x:0 0 0 2024-04-20T10:54:51.808 INFO:tasks.workunit.client.0.smithi090.stdout:4/696: link d7/d9/d17/c71 d7/d9/d17/d56/d66/d70/da1/dcd/d42/d8f/da2/ce2 0 2024-04-20T10:54:51.808 INFO:tasks.workunit.client.0.smithi090.stdout:4/697: stat d7/d97/c9c 0 2024-04-20T10:54:51.808 INFO:tasks.workunit.client.0.smithi090.stdout:4/698: stat d7/d9/d47/l5d 0 2024-04-20T10:54:51.809 INFO:tasks.workunit.client.0.smithi090.stdout:9/974: link d0/d9a/ffa d0/d29/d36/d63/d1f/d79/df3/d23/f145 0 2024-04-20T10:54:51.809 INFO:tasks.workunit.client.0.smithi090.stdout:9/975: fsync d0/d29/d36/d63/d1f/d79/df3/d23/daa/fc3 0 2024-04-20T10:54:51.810 INFO:tasks.workunit.client.0.smithi090.stdout:2/804: truncate d11/d1a/d30/f48 703113 0 2024-04-20T10:54:51.812 INFO:tasks.workunit.client.0.smithi090.stdout:1/885: mkdir d8/d1a/d1d/d67/dff/d4a/d5a/db2/d125 0 2024-04-20T10:54:51.812 INFO:tasks.workunit.client.0.smithi090.stdout:1/886: chown d8/d1a/d1d/d67/dff/d4a/d5a/db2/fef 123 1 2024-04-20T10:54:51.812 INFO:tasks.workunit.client.0.smithi090.stdout:1/887: chown d8/d1a/d1d/d67/dff/d4a/d7b/lf5 334894 1 2024-04-20T10:54:51.812 INFO:tasks.workunit.client.0.smithi090.stdout:1/888: chown d8/d1a/lae 297891658 1 2024-04-20T10:54:51.812 INFO:tasks.workunit.client.0.smithi090.stdout:4/699: mkdir d7/d9/d17/de3 0 2024-04-20T10:54:51.813 INFO:tasks.workunit.client.0.smithi090.stdout:9/976: getdents d0/d29/d36/d63/da1/d10b/d114/d12c 0 2024-04-20T10:54:51.813 INFO:tasks.workunit.client.0.smithi090.stdout:9/977: write d0/d86/f130 [13558,114088] 0 2024-04-20T10:54:51.814 INFO:tasks.workunit.client.0.smithi090.stdout:9/978: truncate d0/d29/d36/d63/da1/d10b/d114/dcb/f12d 790847 0 2024-04-20T10:54:51.814 INFO:tasks.workunit.client.0.smithi090.stdout:9/979: truncate d0/d29/d36/d63/d1f/d79/d7f/fe2 1212549 0 2024-04-20T10:54:51.815 INFO:tasks.workunit.client.0.smithi090.stdout:2/805: link d11/d1f/faa d11/d1a/d37/d85/d87/f108 0 2024-04-20T10:54:51.816 INFO:tasks.workunit.client.0.smithi090.stdout:1/889: unlink d8/d1a/d1d/d7a/d9a/fd4 0 2024-04-20T10:54:51.817 INFO:tasks.workunit.client.0.smithi090.stdout:9/980: creat d0/d29/d36/d63/da1/d10b/d114/d12c/d139/d70/d9d/f146 x:0 0 0 2024-04-20T10:54:51.820 INFO:tasks.workunit.client.0.smithi090.stdout:4/700: write d7/d9/d17/d56/d66/f8a [1707511,51898] 0 2024-04-20T10:54:51.820 INFO:tasks.workunit.client.0.smithi090.stdout:1/890: symlink d8/d1a/d1d/d67/dff/d4a/d5a/db2/d125/l126 0 2024-04-20T10:54:51.821 INFO:tasks.workunit.client.0.smithi090.stdout:9/981: dread - d0/f6a zero size 2024-04-20T10:54:51.822 INFO:tasks.workunit.client.0.smithi090.stdout:1/891: creat d8/d1a/d1d/d67/dff/d4a/d5a/f127 x:0 0 0 2024-04-20T10:54:51.823 INFO:tasks.workunit.client.0.smithi090.stdout:9/982: creat d0/d29/d36/d63/da1/d10b/d114/d12c/d139/d70/f147 x:0 0 0 2024-04-20T10:54:51.825 INFO:tasks.workunit.client.0.smithi090.stdout:2/806: getdents d11/d1a/d37/d85/d87 0 2024-04-20T10:54:51.825 INFO:tasks.workunit.client.0.smithi090.stdout:1/892: link d8/d1a/d1d/d67/dff/d3f/f86 d8/d1a/d1d/d67/de2/df3/f128 0 2024-04-20T10:54:51.829 INFO:tasks.workunit.client.0.smithi090.stdout:2/807: creat d11/d1a/d37/d85/d87/f109 x:0 0 0 2024-04-20T10:54:51.829 INFO:tasks.workunit.client.0.smithi090.stdout:2/808: stat d11/d1f/d2e/ff6 0 2024-04-20T10:54:51.829 INFO:tasks.workunit.client.0.smithi090.stdout:1/893: symlink d8/d1a/d1d/d7a/l129 0 2024-04-20T10:54:51.835 INFO:tasks.workunit.client.0.smithi090.stdout:2/809: write d11/d1a/d2b/f84 [1404026,3464] 0 2024-04-20T10:54:51.836 INFO:tasks.workunit.client.0.smithi090.stdout:2/810: read - d11/d1a/d30/f9d zero size 2024-04-20T10:54:51.836 INFO:tasks.workunit.client.0.smithi090.stdout:2/811: chown d11/d1a/d4a/c78 25 1 2024-04-20T10:54:51.837 INFO:tasks.workunit.client.0.smithi090.stdout:2/812: rename d11/d1a/d37/d85/d87/fb8 to d11/d1a/d37/d85/d87/f10a 0 2024-04-20T10:54:51.843 INFO:tasks.workunit.client.0.smithi090.stdout:4/701: dwrite d7/d9/d47/d8d/dda/db5/fcb [0,4194304] 0 2024-04-20T10:54:51.845 INFO:tasks.workunit.client.0.smithi090.stdout:4/702: mkdir d7/d9/d17/da0/de4 0 2024-04-20T10:54:51.845 INFO:tasks.workunit.client.0.smithi090.stdout:4/703: chown d7/d9/d17/d56/d66/d70/da5/db3/dba 7256 1 2024-04-20T10:54:51.848 INFO:tasks.workunit.client.0.smithi090.stdout:9/983: dwrite d0/d29/d36/d63/d1c/f83 [0,4194304] 0 2024-04-20T10:54:51.848 INFO:tasks.workunit.client.0.smithi090.stdout:2/813: dread d11/f31 [4194304,4194304] 0 2024-04-20T10:54:51.850 INFO:tasks.workunit.client.0.smithi090.stdout:2/814: stat d11/d1a/d30/fee 0 2024-04-20T10:54:51.851 INFO:tasks.workunit.client.0.smithi090.stdout:2/815: mkdir d11/d1a/d10b 0 2024-04-20T10:54:51.852 INFO:tasks.workunit.client.0.smithi090.stdout:1/894: dwrite d8/d1a/d1d/d67/f3d [0,4194304] 0 2024-04-20T10:54:51.853 INFO:tasks.workunit.client.0.smithi090.stdout:1/895: unlink d8/d1a/d1d/d67/f90 0 2024-04-20T10:54:51.855 INFO:tasks.workunit.client.0.smithi090.stdout:1/896: rename d8/d1a/d1d/d67/dff/d4a/d5a/c6b to d8/d1a/d1d/d67/dff/d6e/dde/c12a 0 2024-04-20T10:54:51.855 INFO:tasks.workunit.client.0.smithi090.stdout:1/897: fdatasync d8/d1a/d1d/d67/dff/d4a/d93/d5d/f124 0 2024-04-20T10:54:51.855 INFO:tasks.workunit.client.0.smithi090.stdout:1/898: mkdir d8/d1a/d1d/d67/dff/d4a/d93/d9e/dc2/d12b 0 2024-04-20T10:54:51.857 INFO:tasks.workunit.client.0.smithi090.stdout:1/899: write d8/d1a/d1d/d67/dff/d4a/fb9 [234601,59660] 0 2024-04-20T10:54:51.858 INFO:tasks.workunit.client.0.smithi090.stdout:4/704: dread d7/d9/d47/fb1 [4194304,4194304] 0 2024-04-20T10:54:51.858 INFO:tasks.workunit.client.0.smithi090.stdout:4/705: stat d7/d9/d17/d56/d66/d70/da1/dcd/d76/fc3 0 2024-04-20T10:54:51.858 INFO:tasks.workunit.client.0.smithi090.stdout:1/900: rename d8/d1a/d4d/dc6/l114 to d8/d1a/d1d/l12c 0 2024-04-20T10:54:51.859 INFO:tasks.workunit.client.0.smithi090.stdout:4/706: symlink d7/d9/d17/d56/le5 0 2024-04-20T10:54:51.859 INFO:tasks.workunit.client.0.smithi090.stdout:1/901: getdents d8/d1a/d4d/da5/dad/de5 0 2024-04-20T10:54:51.860 INFO:tasks.workunit.client.0.smithi090.stdout:4/707: creat d7/d9/d17/d56/d66/d70/da1/dcd/d42/fe6 x:0 0 0 2024-04-20T10:54:51.860 INFO:tasks.workunit.client.0.smithi090.stdout:4/708: chown d7/d9/d17/d56/d66/d70/da5/db3/fd8 3 1 2024-04-20T10:54:51.868 INFO:tasks.workunit.client.0.smithi090.stdout:2/816: dwrite d11/d1a/d30/f48 [0,4194304] 0 2024-04-20T10:54:51.868 INFO:tasks.workunit.client.0.smithi090.stdout:2/817: chown d11/d1a/f2d 0 1 2024-04-20T10:54:51.873 INFO:tasks.workunit.client.0.smithi090.stdout:4/709: dread d7/f12 [0,4194304] 0 2024-04-20T10:54:51.874 INFO:tasks.workunit.client.0.smithi090.stdout:4/710: creat d7/d9/d17/de3/fe7 x:0 0 0 2024-04-20T10:54:51.875 INFO:tasks.workunit.client.0.smithi090.stdout:4/711: getdents d7/d9/d17/d56/d66/d70/da1/dcd/d42/d8f/da2 0 2024-04-20T10:54:51.876 INFO:tasks.workunit.client.0.smithi090.stdout:4/712: creat d7/dbd/fe8 x:0 0 0 2024-04-20T10:54:51.879 INFO:tasks.workunit.client.0.smithi090.stdout:1/902: dwrite d8/d1a/d1d/d67/dff/d4a/d93/dd2/dd3/f101 [0,4194304] 0 2024-04-20T10:54:51.879 INFO:tasks.workunit.client.0.smithi090.stdout:1/903: readlink d8/d1a/d1d/d7a/l129 0 2024-04-20T10:54:51.880 INFO:tasks.workunit.client.0.smithi090.stdout:2/818: dread d11/d1f/d2e/f52 [0,4194304] 0 2024-04-20T10:54:51.880 INFO:tasks.workunit.client.0.smithi090.stdout:2/819: truncate d11/d1a/d37/d85/f99 169170 0 2024-04-20T10:54:51.880 INFO:tasks.workunit.client.0.smithi090.stdout:2/820: readlink l2 0 2024-04-20T10:54:51.880 INFO:tasks.workunit.client.0.smithi090.stdout:2/821: readlink d11/d1f/d2e/d6e/l8b 0 2024-04-20T10:54:51.880 INFO:tasks.workunit.client.0.smithi090.stdout:4/713: dread d7/f52 [0,4194304] 0 2024-04-20T10:54:51.881 INFO:tasks.workunit.client.0.smithi090.stdout:1/904: rmdir d8/d1a/d1d/d67/dff/d6e/dde 39 2024-04-20T10:54:51.884 INFO:tasks.workunit.client.0.smithi090.stdout:9/984: write d0/d29/d36/d63/d1f/d79/df3/fd4 [1091975,1268] 0 2024-04-20T10:54:51.889 INFO:tasks.workunit.client.0.smithi090.stdout:9/985: creat d0/d29/d36/d63/da1/d10b/d114/d12c/d139/d70/d9d/f148 x:0 0 0 2024-04-20T10:54:51.891 INFO:tasks.workunit.client.0.smithi090.stdout:2/822: dread d11/d1a/f83 [0,4194304] 0 2024-04-20T10:54:51.893 INFO:tasks.workunit.client.0.smithi090.stdout:9/986: write d0/d29/d36/d63/f93 [200500,128466] 0 2024-04-20T10:54:51.893 INFO:tasks.workunit.client.0.smithi090.stdout:9/987: chown d0/d29/d36/d63/d1f/d4d/f50 2531990 1 2024-04-20T10:54:51.894 INFO:tasks.workunit.client.0.smithi090.stdout:2/823: mkdir d11/d1f/d2e/d10c 0 2024-04-20T10:54:51.895 INFO:tasks.workunit.client.0.smithi090.stdout:9/988: mknod d0/d29/d36/d63/d1f/d79/df3/d23/daa/c149 0 2024-04-20T10:54:51.896 INFO:tasks.workunit.client.0.smithi090.stdout:2/824: mknod d11/d1f/d2e/d6e/ddc/c10d 0 2024-04-20T10:54:51.897 INFO:tasks.workunit.client.0.smithi090.stdout:9/989: creat d0/d86/f14a x:0 0 0 2024-04-20T10:54:51.897 INFO:tasks.workunit.client.0.smithi090.stdout:2/825: fdatasync d11/d1a/d30/f42 0 2024-04-20T10:54:51.898 INFO:tasks.workunit.client.0.smithi090.stdout:9/990: mkdir d0/dc6/d14b 0 2024-04-20T10:54:51.900 INFO:tasks.workunit.client.0.smithi090.stdout:2/826: link d11/d1a/d2b/l94 d11/d1f/d2e/d6e/dc9/l10e 0 2024-04-20T10:54:51.903 INFO:tasks.workunit.client.0.smithi090.stdout:4/714: dwrite d7/d9/d17/d56/d66/d70/da1/dcd/f45 [0,4194304] 0 2024-04-20T10:54:51.903 INFO:tasks.workunit.client.0.smithi090.stdout:9/991: dread d0/d29/d36/d63/d1f/d79/d7f/fe2 [0,4194304] 0 2024-04-20T10:54:51.907 INFO:tasks.workunit.client.0.smithi090.stdout:2/827: dread d11/f1c [0,4194304] 0 2024-04-20T10:54:51.914 INFO:tasks.workunit.client.0.smithi090.stdout:3/738: sync 2024-04-20T10:54:51.915 INFO:tasks.workunit.client.0.smithi090.stdout:8/764: sync 2024-04-20T10:54:51.915 INFO:tasks.workunit.client.0.smithi090.stdout:3/739: mkdir d7/d43/db7/daf/dec 0 2024-04-20T10:54:51.917 INFO:tasks.workunit.client.0.smithi090.stdout:3/740: mkdir d7/d35/da8/ded 0 2024-04-20T10:54:51.918 INFO:tasks.workunit.client.0.smithi090.stdout:3/741: dread d7/d11/f2f [0,4194304] 0 2024-04-20T10:54:51.919 INFO:tasks.workunit.client.0.smithi090.stdout:8/765: read d0/d26/f39 [2883107,28975] 0 2024-04-20T10:54:51.919 INFO:tasks.workunit.client.0.smithi090.stdout:8/766: stat d0/d3a/f46 0 2024-04-20T10:54:51.920 INFO:tasks.workunit.client.0.smithi090.stdout:4/715: dread d7/d9/d17/f49 [0,4194304] 0 2024-04-20T10:54:51.920 INFO:tasks.workunit.client.0.smithi090.stdout:8/767: creat d0/d11/d22/fff x:0 0 0 2024-04-20T10:54:51.922 INFO:tasks.workunit.client.0.smithi090.stdout:8/768: creat d0/d26/da7/df5/f100 x:0 0 0 2024-04-20T10:54:51.922 INFO:tasks.workunit.client.0.smithi090.stdout:8/769: fsync d0/d2d/dd4/ffc 0 2024-04-20T10:54:51.922 INFO:tasks.workunit.client.0.smithi090.stdout:3/742: truncate d7/d43/db7/f50 537803 0 2024-04-20T10:54:51.923 INFO:tasks.workunit.client.0.smithi090.stdout:3/743: symlink d7/d15/d47/d56/lee 0 2024-04-20T10:54:51.929 INFO:tasks.workunit.client.0.smithi090.stdout:2/828: dwrite d11/db0/ffa [0,4194304] 0 2024-04-20T10:54:51.942 INFO:tasks.workunit.client.0.smithi090.stdout:4/716: dwrite d7/d9/fcf [0,4194304] 0 2024-04-20T10:54:51.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.951+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7de40c8c40 con 0x7f7de4073810 2024-04-20T10:54:51.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.952+0000 7f7dd2ffd640 1 -- 172.21.15.90:0/3961581838 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5697 (secure 0 0 0) 0x7f7dd4059b00 con 0x7f7de4073810 2024-04-20T10:54:51.952 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:51.952 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:50.336114+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:54:51.952 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 33 2024-04-20T10:54:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7dc406c8f0 msgr2=0x7f7dc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7dc406c8f0 0x7f7dc406edb0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8036000 tx=0x7f7dd803c040 comp rx=0 tx=0).stop 2024-04-20T10:54:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4073810 msgr2=0x7f7de4072a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4073810 0x7f7de4072a20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7dd4009fa0 tx=0x7f7dd400d560 comp rx=0 tx=0).stop 2024-04-20T10:54:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 shutdown_connections 2024-04-20T10:54:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7dc406c8f0 0x7f7dc406edb0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.954 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7de4157710 0x7f7de41ec010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7de40ad0c0 0x7f7de41e10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 --2- 172.21.15.90:0/3961581838 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7de4073810 0x7f7de4072a20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 >> 172.21.15.90:0/3961581838 conn(0x7f7de40c8080 msgr2=0x7f7de4153410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 shutdown_connections 2024-04-20T10:54:51.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:51.954+0000 7f7de88d9640 1 -- 172.21.15.90:0/3961581838 wait complete. 2024-04-20T10:54:51.957 INFO:tasks.workunit.client.0.smithi090.stdout:2/829: dwrite d11/d1f/d2e/f4b [0,4194304] 0 2024-04-20T10:54:51.960 INFO:tasks.workunit.client.0.smithi090.stdout:3/744: dwrite d7/d11/f73 [0,4194304] 0 2024-04-20T10:54:51.960 INFO:tasks.workunit.client.0.smithi090.stdout:4/717: dwrite d7/d9/d47/f6f [0,4194304] 0 2024-04-20T10:54:51.963 INFO:tasks.workunit.client.0.smithi090.stdout:4/718: link d7/d9/d47/c4d d7/d9/d17/d56/ce9 0 2024-04-20T10:54:51.963 INFO:tasks.workunit.client.0.smithi090.stdout:4/719: stat d7/d9/d17/d56/d66/d70/da1/dcd/f45 0 2024-04-20T10:54:51.966 INFO:tasks.workunit.client.0.smithi090.stdout:4/720: dread d7/f26 [0,4194304] 0 2024-04-20T10:54:51.968 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 33, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 25, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5271": { "addr": "172.21.15.90:6837/1538296646", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6836", "nonce": 1538296646, "type": "v2" }, { "addr": "172.21.15.90:6837", "nonce": 1538296646, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5271, "incarnation": 21, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 15 } }, "last_failure": 0, "last_failure_osd_epoch": 30, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:53:39.341370+0000", "qdb_cluster": [ 5271 ], "qdb_leader": 5271, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5271 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 33, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5239": { "addr": "172.21.15.175:6833/133567489", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6832", "nonce": 133567489, "type": "v2" }, { "addr": "172.21.15.175:6833", "nonce": 133567489, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5239, "incarnation": 33, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:54:50.336114+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5239 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:54:51.968 INFO:tasks.workunit.client.0.smithi090.stdout:4/721: symlink d7/d97/lea 0 2024-04-20T10:54:51.970 INFO:tasks.workunit.client.0.smithi090.stdout:4/722: write d7/d9/f62 [4025196,16678] 0 2024-04-20T10:54:51.971 INFO:tasks.workunit.client.0.smithi090.stdout:4/723: creat d7/d9/d47/d8d/dda/db5/feb x:0 0 0 2024-04-20T10:54:51.971 INFO:tasks.workunit.client.0.smithi090.stdout:4/724: stat d7/dbd 0 2024-04-20T10:54:51.972 INFO:tasks.workunit.client.0.smithi090.stdout:4/725: mkdir d7/d9/d17/d56/d66/d70/dec 0 2024-04-20T10:54:51.972 INFO:tasks.workunit.client.0.smithi090.stdout:4/726: rmdir d7/d9 39 2024-04-20T10:54:51.974 INFO:tasks.workunit.client.0.smithi090.stdout:2/830: dwrite d11/d1f/f81 [0,4194304] 0 2024-04-20T10:54:51.974 INFO:tasks.workunit.client.0.smithi090.stdout:2/831: readlink d11/d1a/d4a/lda 0 2024-04-20T10:54:51.975 INFO:tasks.workunit.client.0.smithi090.stdout:2/832: mknod d11/d1a/d2b/df0/c10f 0 2024-04-20T10:54:51.976 INFO:tasks.workunit.client.0.smithi090.stdout:2/833: symlink d11/db0/l110 0 2024-04-20T10:54:51.976 INFO:tasks.workunit.client.0.smithi090.stdout:2/834: fsync d11/d1a/d2b/f35 0 2024-04-20T10:54:51.977 INFO:tasks.workunit.client.0.smithi090.stdout:2/835: mkdir d11/d1f/d2e/d6e/dc7/de2/d111 0 2024-04-20T10:54:51.977 INFO:tasks.workunit.client.0.smithi090.stdout:2/836: fsync d11/d1f/fbb 0 2024-04-20T10:54:51.978 INFO:tasks.workunit.client.0.smithi090.stdout:2/837: creat d11/d1a/d4a/d80/f112 x:0 0 0 2024-04-20T10:54:51.980 INFO:tasks.workunit.client.0.smithi090.stdout:4/727: write d7/d9/f4a [3898222,75451] 0 2024-04-20T10:54:51.980 INFO:tasks.workunit.client.0.smithi090.stdout:4/728: write d7/d9/d17/d56/d66/d70/da1/dcd/d3d/f9f [5220313,104993] 0 2024-04-20T10:54:52.006 INFO:tasks.workunit.client.0.smithi090.stdout:2/838: dwrite d11/d1f/f75 [0,4194304] 0 2024-04-20T10:54:52.013 INFO:tasks.workunit.client.0.smithi090.stdout:2/839: creat d11/d1f/d2e/d6e/dc7/de2/d111/f113 x:0 0 0 2024-04-20T10:54:52.021 INFO:tasks.workunit.client.0.smithi090.stdout:2/840: write d11/d1f/f75 [465226,20003] 0 2024-04-20T10:54:52.026 INFO:tasks.workunit.client.0.smithi090.stdout:2/841: fsync d11/d1a/d37/d85/d87/fe9 0 2024-04-20T10:54:52.027 INFO:tasks.workunit.client.0.smithi090.stdout:2/842: dread d11/d1f/d2e/d6e/dc7/fd3 [0,4194304] 0 2024-04-20T10:54:52.029 INFO:tasks.workunit.client.0.smithi090.stdout:4/729: dwrite d7/d9/d17/f18 [0,4194304] 0 2024-04-20T10:54:52.029 INFO:tasks.workunit.client.0.smithi090.stdout:4/730: stat d7/d9/d17/d56/d66/d70/da1/dcd/d42/d8f/da2/faa 0 2024-04-20T10:54:52.029 INFO:tasks.workunit.client.0.smithi090.stdout:4/731: fdatasync d7/f6e 0 2024-04-20T10:54:52.029 INFO:tasks.workunit.client.0.smithi090.stdout:4/732: fsync d7/d9/d17/f3f 0 2024-04-20T10:54:52.043 INFO:tasks.workunit.client.0.smithi090.stdout:2/843: dwrite d11/d1a/d2b/f2f [0,4194304] 0 2024-04-20T10:54:52.147 INFO:tasks.workunit.client.0.smithi090.stdout:4/733: creat d7/d9/d17/fed x:0 0 0 2024-04-20T10:54:52.149 INFO:tasks.workunit.client.0.smithi090.stdout:2/844: creat d11/d1f/d2e/d6e/f114 x:0 0 0 2024-04-20T10:54:52.150 INFO:tasks.workunit.client.0.smithi090.stdout:2/845: creat d11/d1a/d4a/d80/f115 x:0 0 0 2024-04-20T10:54:52.151 INFO:tasks.workunit.client.0.smithi090.stdout:2/846: fdatasync d11/d1a/d30/d8d/f9c 0 2024-04-20T10:54:52.151 INFO:tasks.workunit.client.0.smithi090.stdout:2/847: fdatasync d11/d1a/d37/f77 0 2024-04-20T10:54:52.152 INFO:tasks.workunit.client.0.smithi090.stdout:2/848: fsync d11/d1a/d37/d85/d87/fca 0 2024-04-20T10:54:52.152 INFO:tasks.workunit.client.0.smithi090.stdout:2/849: write d11/d1f/d2e/d6e/f114 [950429,95137] 0 2024-04-20T10:54:52.152 INFO:tasks.workunit.client.0.smithi090.stdout:2/850: truncate d11/d1a/f2c 4488071 0 2024-04-20T10:54:52.153 INFO:tasks.workunit.client.0.smithi090.stdout:2/851: truncate d11/d1a/d4a/d55/f69 1447678 0 2024-04-20T10:54:52.168 INFO:tasks.workunit.client.0.smithi090.stdout:4/734: rmdir d7 39 2024-04-20T10:54:52.169 INFO:tasks.workunit.client.0.smithi090.stdout:4/735: creat d7/d9/d17/de3/fee x:0 0 0 2024-04-20T10:54:52.172 INFO:tasks.workunit.client.0.smithi090.stdout:4/736: rename d7/d9/d17/d56/d66/d70/da1/dcd/d42/d8f/c95 to d7/d9/cef 0 2024-04-20T10:54:52.174 INFO:tasks.workunit.client.0.smithi090.stdout:2/852: dwrite d11/f20 [0,4194304] 0 2024-04-20T10:54:52.189 INFO:tasks.workunit.client.0.smithi090.stdout:2/853: dwrite fd [8388608,4194304] 0 2024-04-20T10:54:52.195 INFO:tasks.workunit.client.0.smithi090.stdout:0/792: sync 2024-04-20T10:54:52.195 INFO:tasks.workunit.client.0.smithi090.stdout:6/613: sync 2024-04-20T10:54:52.196 INFO:tasks.workunit.client.0.smithi090.stdout:6/614: stat d1/d10/lb0 0 2024-04-20T10:54:52.196 INFO:tasks.workunit.client.0.smithi090.stdout:6/615: write d1/d4/d26/d11/f63 [3757527,23571] 0 2024-04-20T10:54:52.196 INFO:tasks.workunit.client.0.smithi090.stdout:6/616: read - d1/d19/d36/d1e/fab zero size 2024-04-20T10:54:52.197 INFO:tasks.workunit.client.0.smithi090.stdout:0/793: creat d14/d19/d2b/d52/dab/da1/ffb x:0 0 0 2024-04-20T10:54:52.200 INFO:tasks.workunit.client.0.smithi090.stdout:0/794: symlink d14/d19/d2b/d8e/d43/d5c/lfc 0 2024-04-20T10:54:52.201 INFO:tasks.workunit.client.0.smithi090.stdout:0/795: rename d14/d19/d2b/ca4 to d14/d19/d2b/d8e/cfd 0 2024-04-20T10:54:52.201 INFO:tasks.workunit.client.0.smithi090.stdout:0/796: readlink d14/d19/d2b/d61/d88/la3 0 2024-04-20T10:54:52.202 INFO:tasks.workunit.client.0.smithi090.stdout:0/797: creat d14/d19/d2b/d61/da0/db1/ffe x:0 0 0 2024-04-20T10:54:52.202 INFO:tasks.workunit.client.0.smithi090.stdout:0/798: symlink d14/d19/d2b/d52/dab/ddc/lff 0 2024-04-20T10:54:52.203 INFO:tasks.workunit.client.0.smithi090.stdout:0/799: symlink d14/d19/d2b/d52/dab/da1/df5/l100 0 2024-04-20T10:54:52.203 INFO:tasks.workunit.client.0.smithi090.stdout:0/800: dread - d14/d19/d2b/d61/da0/db1/dbb/dfa/ff7 zero size 2024-04-20T10:54:52.204 INFO:tasks.workunit.client.0.smithi090.stdout:0/801: link d14/d19/d31/d34/l3a d14/d19/d9e/l101 0 2024-04-20T10:54:52.205 INFO:tasks.workunit.client.0.smithi090.stdout:0/802: truncate d14/d19/d2b/d52/dab/ddc/de4/fc1 2206968 0 2024-04-20T10:54:52.206 INFO:tasks.workunit.client.0.smithi090.stdout:0/803: rmdir d14/d19/d2b/d61/da0/db1/dbb 39 2024-04-20T10:54:52.206 INFO:tasks.workunit.client.0.smithi090.stdout:0/804: chown d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/cba 120999641 1 2024-04-20T10:54:52.206 INFO:tasks.workunit.client.0.smithi090.stdout:0/805: chown d14/d19/d2b/d52/dab/f35 131845 1 2024-04-20T10:54:52.206 INFO:tasks.workunit.client.0.smithi090.stdout:2/854: dwrite d11/d1f/d2e/d6e/dc7/fd3 [0,4194304] 0 2024-04-20T10:54:52.209 INFO:tasks.workunit.client.0.smithi090.stdout:2/855: mknod d11/d1a/d2b/df0/c116 0 2024-04-20T10:54:52.209 INFO:tasks.workunit.client.0.smithi090.stdout:2/856: fdatasync d11/d1a/d37/f103 0 2024-04-20T10:54:52.210 INFO:tasks.workunit.client.0.smithi090.stdout:2/857: readlink d11/d1a/d30/l3f 0 2024-04-20T10:54:52.210 INFO:tasks.workunit.client.0.smithi090.stdout:2/858: truncate d11/d1a/d30/f9d 176767 0 2024-04-20T10:54:52.212 INFO:tasks.workunit.client.0.smithi090.stdout:2/859: creat d11/d1a/d4a/f117 x:0 0 0 2024-04-20T10:54:52.222 INFO:tasks.workunit.client.0.smithi090.stdout:6/617: dwrite d1/d4/d26/fcb [4194304,4194304] 0 2024-04-20T10:54:52.223 INFO:tasks.workunit.client.0.smithi090.stdout:6/618: creat d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9/fce x:0 0 0 2024-04-20T10:54:52.224 INFO:tasks.workunit.client.0.smithi090.stdout:0/806: dwrite d14/d19/d2b/d8e/fdb [0,4194304] 0 2024-04-20T10:54:52.224 INFO:tasks.workunit.client.0.smithi090.stdout:0/807: stat d14/d19/d2b/d52/dab/f35 0 2024-04-20T10:54:52.224 INFO:tasks.workunit.client.0.smithi090.stdout:0/808: truncate d14/d19/d2b/d8e/f8c 946530 0 2024-04-20T10:54:52.225 INFO:tasks.workunit.client.0.smithi090.stdout:6/619: unlink d1/d19/f2d 0 2024-04-20T10:54:52.226 INFO:tasks.workunit.client.0.smithi090.stdout:0/809: getdents d14/d19/d2b/d61/da0 0 2024-04-20T10:54:52.226 INFO:tasks.workunit.client.0.smithi090.stdout:0/810: fdatasync d14/d19/d2b/d52/dab/f75 0 2024-04-20T10:54:52.227 INFO:tasks.workunit.client.0.smithi090.stdout:6/620: creat d1/d19/d36/d1e/d74/fcf x:0 0 0 2024-04-20T10:54:52.228 INFO:tasks.workunit.client.0.smithi090.stdout:6/621: mkdir d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9/dd0 0 2024-04-20T10:54:52.228 INFO:tasks.workunit.client.0.smithi090.stdout:6/622: fdatasync d1/f65 0 2024-04-20T10:54:52.228 INFO:tasks.workunit.client.0.smithi090.stdout:6/623: getdents d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad 0 2024-04-20T10:54:52.229 INFO:tasks.workunit.client.0.smithi090.stdout:6/624: fsync d1/d4/f47 0 2024-04-20T10:54:52.231 INFO:tasks.workunit.client.0.smithi090.stdout:6/625: dread d1/d4/f66 [0,4194304] 0 2024-04-20T10:54:52.231 INFO:tasks.workunit.client.0.smithi090.stdout:6/626: truncate d1/d4/d26/d11/d35/fa6 786830 0 2024-04-20T10:54:52.232 INFO:tasks.workunit.client.0.smithi090.stdout:6/627: dread d1/d4/d26/d11/d4a/d6b/fa8 [0,4194304] 0 2024-04-20T10:54:52.232 INFO:tasks.workunit.client.0.smithi090.stdout:6/628: fsync d1/d19/d36/d28/f73 0 2024-04-20T10:54:52.239 INFO:tasks.workunit.client.0.smithi090.stdout:6/629: write d1/d4/d26/d11/d4a/d56/f61 [1115415,433] 0 2024-04-20T10:54:52.239 INFO:tasks.workunit.client.0.smithi090.stdout:6/630: getdents d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad 0 2024-04-20T10:54:52.243 INFO:tasks.workunit.client.0.smithi090.stdout:0/811: dwrite d14/d19/d2b/d61/da0/db1/ffe [0,4194304] 0 2024-04-20T10:54:52.243 INFO:tasks.workunit.client.0.smithi090.stdout:0/812: chown d14/d39/d7c 1 1 2024-04-20T10:54:52.245 INFO:tasks.workunit.client.0.smithi090.stdout:0/813: mkdir d14/d19/d2b/d52/dab/ddc/de4/d102 0 2024-04-20T10:54:52.245 INFO:tasks.workunit.client.0.smithi090.stdout:0/814: getdents d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f 0 2024-04-20T10:54:52.247 INFO:tasks.workunit.client.0.smithi090.stdout:0/815: mkdir d14/d19/d2b/d8e/d43/d5c/d103 0 2024-04-20T10:54:52.247 INFO:tasks.workunit.client.0.smithi090.stdout:0/816: chown d14/d19/d2b/d8e/d43/d6d 0 1 2024-04-20T10:54:52.250 INFO:tasks.workunit.client.0.smithi090.stdout:0/817: dread d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/fcd [0,4194304] 0 2024-04-20T10:54:52.251 INFO:tasks.workunit.client.0.smithi090.stdout:0/818: mknod d14/d19/d2b/d52/dab/ddc/c104 0 2024-04-20T10:54:52.252 INFO:tasks.workunit.client.0.smithi090.stdout:0/819: symlink d14/l105 0 2024-04-20T10:54:52.252 INFO:tasks.workunit.client.0.smithi090.stdout:0/820: unlink d14/d19/d2b/d8e/d43/f4a 0 2024-04-20T10:54:52.253 INFO:tasks.workunit.client.0.smithi090.stdout:0/821: creat d14/d19/d2b/d61/da0/db1/f106 x:0 0 0 2024-04-20T10:54:52.254 INFO:tasks.workunit.client.0.smithi090.stdout:0/822: creat d14/d19/d2b/d61/da0/db1/f107 x:0 0 0 2024-04-20T10:54:52.254 INFO:tasks.workunit.client.0.smithi090.stdout:0/823: fsync d14/d19/d31/d34/d3b/f74 0 2024-04-20T10:54:52.269 INFO:tasks.workunit.client.0.smithi090.stdout:1/905: sync 2024-04-20T10:54:52.269 INFO:tasks.workunit.client.0.smithi090.stdout:7/729: sync 2024-04-20T10:54:52.269 INFO:tasks.workunit.client.0.smithi090.stdout:7/730: write d11/d13/d22/fe2 [215987,47201] 0 2024-04-20T10:54:52.270 INFO:tasks.workunit.client.0.smithi090.stdout:1/906: unlink d8/f80 0 2024-04-20T10:54:52.271 INFO:tasks.workunit.client.0.smithi090.stdout:7/731: creat d11/d13/d33/d44/d89/d98/fed x:0 0 0 2024-04-20T10:54:52.277 INFO:tasks.workunit.client.0.smithi090.stdout:0/824: dwrite d14/d19/d31/d34/d3b/feb [0,4194304] 0 2024-04-20T10:54:52.278 INFO:tasks.workunit.client.0.smithi090.stdout:0/825: symlink d14/d19/d2b/d52/dab/ddc/l108 0 2024-04-20T10:54:52.278 INFO:tasks.workunit.client.0.smithi090.stdout:0/826: rename d14/d19 to d14/d19/d31/d109 22 2024-04-20T10:54:52.279 INFO:tasks.workunit.client.0.smithi090.stdout:0/827: fdatasync d14/d19/d2b/d61/f72 0 2024-04-20T10:54:52.279 INFO:tasks.workunit.client.0.smithi090.stdout:0/828: read - d14/d19/d2b/d52/dab/f35 zero size 2024-04-20T10:54:52.279 INFO:tasks.workunit.client.0.smithi090.stdout:0/829: link d14/d19/d2b/d8e/d43/d5c/d70/ca9 d14/d19/d2b/d52/dab/ddc/c10a 0 2024-04-20T10:54:52.280 INFO:tasks.workunit.client.0.smithi090.stdout:0/830: chown d14 2080065 1 2024-04-20T10:54:52.280 INFO:tasks.workunit.client.0.smithi090.stdout:0/831: readlink d14/d19/d2b/d52/dab/ddc/de4/d5b/d8a/l9f 0 2024-04-20T10:54:52.280 INFO:tasks.workunit.client.0.smithi090.stdout:0/832: fsync d14/d19/f78 0 2024-04-20T10:54:52.280 INFO:tasks.workunit.client.0.smithi090.stdout:0/833: rename f13 to d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/f10b 0 2024-04-20T10:54:52.281 INFO:tasks.workunit.client.0.smithi090.stdout:0/834: creat d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/f10c x:0 0 0 2024-04-20T10:54:52.281 INFO:tasks.workunit.client.0.smithi090.stdout:0/835: fdatasync d14/d19/d2b/d8e/d43/d5c/fd3 0 2024-04-20T10:54:52.282 INFO:tasks.workunit.client.0.smithi090.stdout:7/732: write d11/d1a/f40 [146021,53693] 0 2024-04-20T10:54:52.282 INFO:tasks.workunit.client.0.smithi090.stdout:0/836: creat d14/d19/d2b/d61/d88/f10d x:0 0 0 2024-04-20T10:54:52.284 INFO:tasks.workunit.client.0.smithi090.stdout:7/733: rmdir d11/d1a/d3f 39 2024-04-20T10:54:52.284 INFO:tasks.workunit.client.0.smithi090.stdout:7/734: readlink d11/d13/d22/d27/l31 0 2024-04-20T10:54:52.284 INFO:tasks.workunit.client.0.smithi090.stdout:7/735: dread - d11/d13/d5b/db8/f85 zero size 2024-04-20T10:54:52.284 INFO:tasks.workunit.client.0.smithi090.stdout:7/736: stat d11/d13/d22/d27/l63 0 2024-04-20T10:54:52.285 INFO:tasks.workunit.client.0.smithi090.stdout:7/737: truncate d11/d13/d5d/f96 1101051 0 2024-04-20T10:54:52.285 INFO:tasks.workunit.client.0.smithi090.stdout:7/738: readlink d11/d13/d33/l48 0 2024-04-20T10:54:52.285 INFO:tasks.workunit.client.0.smithi090.stdout:7/739: write d11/d13/f92 [886817,10264] 0 2024-04-20T10:54:52.287 INFO:tasks.workunit.client.0.smithi090.stdout:7/740: dread d11/d13/d23/f38 [0,4194304] 0 2024-04-20T10:54:52.290 INFO:tasks.workunit.client.0.smithi090.stdout:1/907: dwrite d8/d1a/d1d/d7a/d9a/fac [0,4194304] 0 2024-04-20T10:54:52.311 INFO:tasks.workunit.client.0.smithi090.stdout:6/631: dwrite d1/d4/d26/d11/f17 [0,4194304] 0 2024-04-20T10:54:52.311 INFO:tasks.workunit.client.0.smithi090.stdout:0/837: dwrite d14/d39/da6/fb3 [0,4194304] 0 2024-04-20T10:54:52.312 INFO:tasks.workunit.client.0.smithi090.stdout:6/632: creat d1/d19/d36/d28/fd1 x:0 0 0 2024-04-20T10:54:52.329 INFO:tasks.workunit.client.0.smithi090.stdout:0/838: dwrite d14/d19/d2b/d8e/d43/d5c/d70/d9b/fae [0,4194304] 0 2024-04-20T10:54:52.329 INFO:tasks.workunit.client.0.smithi090.stdout:0/839: write d14/d19/d2b/d61/f6f [251998,5031] 0 2024-04-20T10:54:52.337 INFO:tasks.workunit.client.0.smithi090.stdout:0/840: getdents d14/d19/d2b/d61/d88 0 2024-04-20T10:54:52.337 INFO:tasks.workunit.client.0.smithi090.stdout:0/841: write f11 [2178814,96198] 0 2024-04-20T10:54:52.338 INFO:tasks.workunit.client.0.smithi090.stdout:0/842: getdents d14/d19/d2b/d8e/d43 0 2024-04-20T10:54:52.338 INFO:tasks.workunit.client.0.smithi090.stdout:0/843: readlink d14/d19/d2b/d8e/d43/d5c/d70/lb7 0 2024-04-20T10:54:52.339 INFO:tasks.workunit.client.0.smithi090.stdout:0/844: creat d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/df8/f10e x:0 0 0 2024-04-20T10:54:52.339 INFO:tasks.workunit.client.0.smithi090.stdout:0/845: chown d14/d19/d2b/d8e/d43/d5c/d70/lb7 76512 1 2024-04-20T10:54:52.339 INFO:tasks.workunit.client.0.smithi090.stdout:0/846: symlink d14/d39/da6/l10f 0 2024-04-20T10:54:52.340 INFO:tasks.workunit.client.0.smithi090.stdout:0/847: chown d14/d19/d31/d34/d3b/f74 15171 1 2024-04-20T10:54:52.340 INFO:tasks.workunit.client.0.smithi090.stdout:0/848: truncate d14/d41/f6e 4852763 0 2024-04-20T10:54:52.346 INFO:tasks.workunit.client.0.smithi090.stdout:0/849: dread f5 [0,4194304] 0 2024-04-20T10:54:52.346 INFO:tasks.workunit.client.0.smithi090.stdout:0/850: fsync d14/d19/d2b/d52/dab/f75 0 2024-04-20T10:54:52.347 INFO:tasks.workunit.client.0.smithi090.stdout:0/851: dread d14/d19/d2b/d52/dab/ddc/de4/d5b/fbe [0,4194304] 0 2024-04-20T10:54:52.347 INFO:tasks.workunit.client.0.smithi090.stdout:0/852: dread - d14/d19/d2b/d8e/f4f zero size 2024-04-20T10:54:52.347 INFO:tasks.workunit.client.0.smithi090.stdout:0/853: readlink d14/d19/d2b/d52/lef 0 2024-04-20T10:54:52.350 INFO:tasks.workunit.client.0.smithi090.stdout:0/854: dread d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:52.351 INFO:tasks.workunit.client.0.smithi090.stdout:0/855: rename d14/d19/d2b/c86 to d14/d39/da6/c110 0 2024-04-20T10:54:52.357 INFO:tasks.workunit.client.0.smithi090.stdout:0/856: dread f5 [0,4194304] 0 2024-04-20T10:54:52.363 INFO:tasks.workunit.client.0.smithi090.stdout:0/857: dread d14/d19/d2b/d61/da0/db1/ffe [0,4194304] 0 2024-04-20T10:54:52.367 INFO:tasks.workunit.client.0.smithi090.stdout:0/858: dread d14/d19/f1b [0,4194304] 0 2024-04-20T10:54:52.383 INFO:tasks.workunit.client.0.smithi090.stdout:0/859: dwrite d14/d19/d2b/d61/da0/db1/f107 [0,4194304] 0 2024-04-20T10:54:52.394 INFO:tasks.workunit.client.0.smithi090.stdout:0/860: write d14/d41/f7d [1957539,2401] 0 2024-04-20T10:54:52.395 INFO:tasks.workunit.client.0.smithi090.stdout:0/861: chown d14/d19/c24 299703082 1 2024-04-20T10:54:52.403 INFO:tasks.workunit.client.0.smithi090.stdout:0/862: dread d14/d19/d2b/d61/fa5 [0,4194304] 0 2024-04-20T10:54:52.403 INFO:tasks.workunit.client.0.smithi090.stdout:0/863: fdatasync f3 0 2024-04-20T10:54:52.406 INFO:tasks.workunit.client.0.smithi090.stdout:0/864: rename d14/d19/d2b/f3d to d14/d19/d2b/d8e/d43/d5c/d103/f111 0 2024-04-20T10:54:52.406 INFO:tasks.workunit.client.0.smithi090.stdout:0/865: write d14/d19/f78 [2497154,63688] 0 2024-04-20T10:54:52.406 INFO:tasks.workunit.client.0.smithi090.stdout:0/866: readlink d14/d19/d2b/d61/da0/lac 0 2024-04-20T10:54:52.407 INFO:tasks.workunit.client.0.smithi090.stdout:0/867: truncate d14/d19/f1b 3488512 0 2024-04-20T10:54:52.407 INFO:tasks.workunit.client.0.smithi090.stdout:0/868: fdatasync d14/f80 0 2024-04-20T10:54:52.409 INFO:tasks.workunit.client.0.smithi090.stdout:0/869: mknod d14/d19/d2b/d8e/c112 0 2024-04-20T10:54:52.409 INFO:tasks.workunit.client.0.smithi090.stdout:0/870: write f5 [762131,8351] 0 2024-04-20T10:54:52.410 INFO:tasks.workunit.client.0.smithi090.stdout:0/871: mknod d14/d39/c113 0 2024-04-20T10:54:52.421 INFO:tasks.workunit.client.0.smithi090.stdout:0/872: dread d14/f21 [0,4194304] 0 2024-04-20T10:54:52.429 INFO:tasks.workunit.client.0.smithi090.stdout:0/873: dread d14/d19/d2b/d61/da0/db1/f107 [0,4194304] 0 2024-04-20T10:54:52.432 INFO:tasks.workunit.client.0.smithi090.stdout:0/874: dread d14/d19/d9e/fe2 [0,4194304] 0 2024-04-20T10:54:52.435 INFO:tasks.workunit.client.0.smithi090.stdout:0/875: dread d14/f5f [0,4194304] 0 2024-04-20T10:54:52.436 INFO:tasks.workunit.client.0.smithi090.stdout:0/876: creat d14/d39/da6/f114 x:0 0 0 2024-04-20T10:54:52.463 INFO:tasks.workunit.client.0.smithi090.stdout:9/992: sync 2024-04-20T10:54:52.464 INFO:tasks.workunit.client.0.smithi090.stdout:0/877: mkdir d14/d19/d115 0 2024-04-20T10:54:52.464 INFO:tasks.workunit.client.0.smithi090.stdout:0/878: fdatasync d14/d19/d2b/d8e/d43/d73/f97 0 2024-04-20T10:54:52.465 INFO:tasks.workunit.client.0.smithi090.stdout:9/993: rename d0/d29/d36/d63/d1f/d79/df3/ddc to d0/d29/d36/d63/d1c/d14c 0 2024-04-20T10:54:52.467 INFO:tasks.workunit.client.0.smithi090.stdout:9/994: write d0/d29/d36/d63/d1f/d79/df3/d6b/f72 [369395,106939] 0 2024-04-20T10:54:52.468 INFO:tasks.workunit.client.0.smithi090.stdout:0/879: mknod d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/df8/c116 0 2024-04-20T10:54:52.477 INFO:tasks.workunit.client.0.smithi090.stdout:0/880: write d14/d19/d2b/f30 [2775712,51717] 0 2024-04-20T10:54:52.477 INFO:tasks.workunit.client.0.smithi090.stdout:0/881: write d14/d19/d2b/d61/d88/f10d [566902,102304] 0 2024-04-20T10:54:52.478 INFO:tasks.workunit.client.0.smithi090.stdout:9/995: creat d0/d29/d36/d63/d1c/d14c/f14d x:0 0 0 2024-04-20T10:54:52.480 INFO:tasks.workunit.client.0.smithi090.stdout:0/882: creat d14/d19/d2b/d61/da0/db1/dbb/f117 x:0 0 0 2024-04-20T10:54:52.481 INFO:tasks.workunit.client.0.smithi090.stdout:9/996: creat d0/d29/d36/d63/d1f/d79/df3/d23/daa/f14e x:0 0 0 2024-04-20T10:54:52.482 INFO:tasks.workunit.client.0.smithi090.stdout:0/883: mkdir d14/d19/d2b/d61/da0/db1/dbb/d118 0 2024-04-20T10:54:52.484 INFO:tasks.workunit.client.0.smithi090.stdout:0/884: rename d14/d19/d2b/d52/dab/ddc/l108 to d14/d19/d2b/d52/dab/ddc/de4/d5b/d8a/l119 0 2024-04-20T10:54:52.484 INFO:tasks.workunit.client.0.smithi090.stdout:9/997: symlink d0/d29/d36/d63/d1f/d79/d7f/l14f 0 2024-04-20T10:54:52.486 INFO:tasks.workunit.client.0.smithi090.stdout:9/998: mkdir d0/d29/d36/d63/d1f/d79/df3/d23/d150 0 2024-04-20T10:54:52.486 INFO:tasks.workunit.client.0.smithi090.stdout:9/999: fsync d0/d29/d36/d63/f93 0 2024-04-20T10:54:52.543 INFO:tasks.workunit.client.0.smithi090.stdout:0/885: symlink d14/d19/d31/l11a 0 2024-04-20T10:54:52.613 INFO:tasks.workunit.client.0.smithi090.stdout:0/886: rmdir d14/d19/d2b/d52/dab/ddc/de4/d5b 39 2024-04-20T10:54:52.616 INFO:tasks.workunit.client.0.smithi090.stdout:0/887: dread d14/d19/d31/d34/d3b/f9c [0,4194304] 0 2024-04-20T10:54:52.616 INFO:tasks.workunit.client.0.smithi090.stdout:0/888: stat d14/d19/dca 0 2024-04-20T10:54:52.630 INFO:tasks.workunit.client.0.smithi090.stdout:0/889: mkdir d14/d19/d2b/d8e/d40/d11b 0 2024-04-20T10:54:52.633 INFO:tasks.workunit.client.0.smithi090.stdout:0/890: dread d14/f5f [0,4194304] 0 2024-04-20T10:54:52.639 INFO:tasks.workunit.client.0.smithi090.stdout:3/745: sync 2024-04-20T10:54:52.639 INFO:tasks.workunit.client.0.smithi090.stdout:2/860: sync 2024-04-20T10:54:52.639 INFO:tasks.workunit.client.0.smithi090.stdout:4/737: sync 2024-04-20T10:54:52.639 INFO:tasks.workunit.client.0.smithi090.stdout:8/770: sync 2024-04-20T10:54:52.639 INFO:tasks.workunit.client.0.smithi090.stdout:6/633: sync 2024-04-20T10:54:52.640 INFO:tasks.workunit.client.0.smithi090.stdout:1/908: sync 2024-04-20T10:54:52.640 INFO:tasks.workunit.client.0.smithi090.stdout:7/741: sync 2024-04-20T10:54:52.640 INFO:tasks.workunit.client.0.smithi090.stdout:0/891: creat d14/d39/da6/f11c x:0 0 0 2024-04-20T10:54:52.640 INFO:tasks.workunit.client.0.smithi090.stdout:0/892: stat d14/d19/d2b/d8e/d40 0 2024-04-20T10:54:52.640 INFO:tasks.workunit.client.0.smithi090.stdout:0/893: truncate d14/d19/d2b/d52/f69 148085 0 2024-04-20T10:54:52.641 INFO:tasks.workunit.client.0.smithi090.stdout:1/909: dread d8/d1a/d1d/d67/dff/d4a/d93/d5d/f5e [0,4194304] 0 2024-04-20T10:54:52.641 INFO:tasks.workunit.client.0.smithi090.stdout:3/746: rename d7/f6c to d7/d15/fef 0 2024-04-20T10:54:52.641 INFO:tasks.workunit.client.0.smithi090.stdout:3/747: write d7/d11/f46 [2728495,51935] 0 2024-04-20T10:54:52.641 INFO:tasks.workunit.client.0.smithi090.stdout:2/861: stat d11/d1a/c2a 0 2024-04-20T10:54:52.642 INFO:tasks.workunit.client.0.smithi090.stdout:6/634: unlink d1/d4/d26/d11/d35/d80/f82 0 2024-04-20T10:54:52.643 INFO:tasks.workunit.client.0.smithi090.stdout:6/635: chown d1/d4/d26/d11/d4a/d6b/f89 3 1 2024-04-20T10:54:52.644 INFO:tasks.workunit.client.0.smithi090.stdout:4/738: link d7/d9/f20 d7/d9/d17/d56/d66/d70/da1/dcd/d42/d8f/ff0 0 2024-04-20T10:54:52.644 INFO:tasks.workunit.client.0.smithi090.stdout:8/771: dread d0/d11/d22/f23 [0,4194304] 0 2024-04-20T10:54:52.645 INFO:tasks.workunit.client.0.smithi090.stdout:0/894: creat d14/d19/d2b/d8e/d43/d5c/f11d x:0 0 0 2024-04-20T10:54:52.645 INFO:tasks.workunit.client.0.smithi090.stdout:1/910: creat d8/d1a/d1d/d67/de2/df3/f12d x:0 0 0 2024-04-20T10:54:52.646 INFO:tasks.workunit.client.0.smithi090.stdout:3/748: mkdir d7/d15/d2a/da2/df0 0 2024-04-20T10:54:52.646 INFO:tasks.workunit.client.0.smithi090.stdout:3/749: write d7/d15/d47/d56/f9e [1198197,82918] 0 2024-04-20T10:54:52.647 INFO:tasks.workunit.client.0.smithi090.stdout:6/636: mknod d1/d19/d36/cd2 0 2024-04-20T10:54:52.649 INFO:tasks.workunit.client.0.smithi090.stdout:0/895: rename d14/d19/d31 to d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e 0 2024-04-20T10:54:52.649 INFO:tasks.workunit.client.0.smithi090.stdout:1/911: mknod d8/d1a/d1d/d67/de2/df3/c12e 0 2024-04-20T10:54:52.650 INFO:tasks.workunit.client.0.smithi090.stdout:3/750: creat d7/ddd/ff1 x:0 0 0 2024-04-20T10:54:52.651 INFO:tasks.workunit.client.0.smithi090.stdout:7/742: dread d11/d1a/d3f/f5f [0,4194304] 0 2024-04-20T10:54:52.651 INFO:tasks.workunit.client.0.smithi090.stdout:7/743: write d11/d13/d22/d24/f7b [155018,130569] 0 2024-04-20T10:54:52.651 INFO:tasks.workunit.client.0.smithi090.stdout:2/862: unlink d11/d1a/d30/f7e 0 2024-04-20T10:54:52.651 INFO:tasks.workunit.client.0.smithi090.stdout:2/863: write d11/d1a/d4a/d80/f112 [70697,108706] 0 2024-04-20T10:54:52.652 INFO:tasks.workunit.client.0.smithi090.stdout:6/637: truncate d1/d4/d26/d11/f41 727574 0 2024-04-20T10:54:52.653 INFO:tasks.workunit.client.0.smithi090.stdout:0/896: mkdir d14/d19/d9e/d11f 0 2024-04-20T10:54:52.655 INFO:tasks.workunit.client.0.smithi090.stdout:3/751: unlink d7/df/dd1/dd3/d88/fad 0 2024-04-20T10:54:52.657 INFO:tasks.workunit.client.0.smithi090.stdout:2/864: creat d11/d1f/d2e/d6e/dc9/f118 x:0 0 0 2024-04-20T10:54:52.658 INFO:tasks.workunit.client.0.smithi090.stdout:1/912: dread f5 [0,4194304] 0 2024-04-20T10:54:52.660 INFO:tasks.workunit.client.0.smithi090.stdout:6/638: mkdir d1/d4/d26/d11/d4a/d6b/db5/db9/dd3 0 2024-04-20T10:54:52.660 INFO:tasks.workunit.client.0.smithi090.stdout:6/639: chown d1/fb4 12 1 2024-04-20T10:54:52.660 INFO:tasks.workunit.client.0.smithi090.stdout:0/897: rmdir d14/d19/d2b/d61/da0 39 2024-04-20T10:54:52.660 INFO:tasks.workunit.client.0.smithi090.stdout:0/898: stat d14/d39/da6/cc4 0 2024-04-20T10:54:52.662 INFO:tasks.workunit.client.0.smithi090.stdout:2/865: symlink d11/d1a/d37/l119 0 2024-04-20T10:54:52.664 INFO:tasks.workunit.client.0.smithi090.stdout:6/640: symlink d1/d19/d36/d1e/d1f/d3f/d54/ld4 0 2024-04-20T10:54:52.665 INFO:tasks.workunit.client.0.smithi090.stdout:0/899: rmdir d14/d19/d9e 39 2024-04-20T10:54:52.665 INFO:tasks.workunit.client.0.smithi090.stdout:2/866: mknod d11/d1f/d2e/d6e/c11a 0 2024-04-20T10:54:52.666 INFO:tasks.workunit.client.0.smithi090.stdout:6/641: truncate d1/d19/d36/f27 1265855 0 2024-04-20T10:54:52.668 INFO:tasks.workunit.client.0.smithi090.stdout:0/900: creat d14/d19/d2b/d8e/d40/f120 x:0 0 0 2024-04-20T10:54:52.669 INFO:tasks.workunit.client.0.smithi090.stdout:6/642: fsync d1/d4/f30 0 2024-04-20T10:54:52.669 INFO:tasks.workunit.client.0.smithi090.stdout:6/643: fsync d1/d4/f47 0 2024-04-20T10:54:52.670 INFO:tasks.workunit.client.0.smithi090.stdout:0/901: getdents d14/d19/d2b/d8e/d43/d5c/d103 0 2024-04-20T10:54:52.672 INFO:tasks.workunit.client.0.smithi090.stdout:6/644: truncate d1/d4/f47 5967223 0 2024-04-20T10:54:52.677 INFO:tasks.workunit.client.0.smithi090.stdout:8/772: dwrite d0/d2d/d49/d67/f87 [0,4194304] 0 2024-04-20T10:54:52.678 INFO:tasks.workunit.client.0.smithi090.stdout:1/913: getdents d8/d1a/d1d/d67/de2/df3 0 2024-04-20T10:54:52.680 INFO:tasks.workunit.client.0.smithi090.stdout:6/645: dread d1/d4/d26/d11/d35/d80/fac [0,4194304] 0 2024-04-20T10:54:52.686 INFO:tasks.workunit.client.0.smithi090.stdout:0/902: symlink d14/d19/d2b/d61/da0/db1/l121 0 2024-04-20T10:54:52.686 INFO:tasks.workunit.client.0.smithi090.stdout:0/903: write d14/d19/d2b/d8e/d43/d6d/ff0 [1687660,17613] 0 2024-04-20T10:54:52.686 INFO:tasks.workunit.client.0.smithi090.stdout:0/904: fsync d14/d19/d2b/f83 0 2024-04-20T10:54:52.686 INFO:tasks.workunit.client.0.smithi090.stdout:0/905: chown d14/d19/d2b/d8e/d43/d5c/f81 0 1 2024-04-20T10:54:52.686 INFO:tasks.workunit.client.0.smithi090.stdout:0/906: chown d14/d19/d2b/d8e/d40/fbc 9349 1 2024-04-20T10:54:52.686 INFO:tasks.workunit.client.0.smithi090.stdout:3/752: dwrite d7/f86 [0,4194304] 0 2024-04-20T10:54:52.686 INFO:tasks.workunit.client.0.smithi090.stdout:7/744: dwrite d11/d13/d5b/db8/dbf/da9/fb9 [0,4194304] 0 2024-04-20T10:54:52.688 INFO:tasks.workunit.client.0.smithi090.stdout:6/646: creat d1/d4/d26/d11/d4a/fd5 x:0 0 0 2024-04-20T10:54:52.688 INFO:tasks.workunit.client.0.smithi090.stdout:6/647: fsync d1/d19/f59 0 2024-04-20T10:54:52.689 INFO:tasks.workunit.client.0.smithi090.stdout:2/867: dwrite d11/d1a/d37/d85/d87/ff2 [4194304,4194304] 0 2024-04-20T10:54:52.695 INFO:tasks.workunit.client.0.smithi090.stdout:7/745: mknod d11/d1a/d3b/dd6/cee 0 2024-04-20T10:54:52.697 INFO:tasks.workunit.client.0.smithi090.stdout:4/739: dwrite d7/d9/fa [4194304,4194304] 0 2024-04-20T10:54:52.698 INFO:tasks.workunit.client.0.smithi090.stdout:4/740: write d7/d9/d17/d56/d66/d70/fd6 [82709,7168] 0 2024-04-20T10:54:52.700 INFO:tasks.workunit.client.0.smithi090.stdout:3/753: dread d7/d43/f59 [0,4194304] 0 2024-04-20T10:54:52.701 INFO:tasks.workunit.client.0.smithi090.stdout:7/746: creat d11/d1a/d3b/ddf/fef x:0 0 0 2024-04-20T10:54:52.701 INFO:tasks.workunit.client.0.smithi090.stdout:7/747: getdents d11/dd2/dec 0 2024-04-20T10:54:52.714 INFO:tasks.workunit.client.0.smithi090.stdout:1/914: dwrite d8/d1a/fba [4194304,4194304] 0 2024-04-20T10:54:52.715 INFO:tasks.workunit.client.0.smithi090.stdout:7/748: link d11/l19 d11/d13/d22/d82/lf0 0 2024-04-20T10:54:52.717 INFO:tasks.workunit.client.0.smithi090.stdout:2/868: dwrite d11/d1f/d2e/d6e/ddc/ffb [0,4194304] 0 2024-04-20T10:54:52.717 INFO:tasks.workunit.client.0.smithi090.stdout:2/869: read - d11/d1f/d2e/d6e/dc9/f118 zero size 2024-04-20T10:54:52.718 INFO:tasks.workunit.client.0.smithi090.stdout:7/749: rmdir d11/d13/d33/d44/d89 39 2024-04-20T10:54:52.719 INFO:tasks.workunit.client.0.smithi090.stdout:6/648: dwrite d1/d4/d26/d11/f63 [0,4194304] 0 2024-04-20T10:54:52.726 INFO:tasks.workunit.client.0.smithi090.stdout:4/741: dwrite d7/d9/d17/d56/d66/d70/da1/dcd/d3d/f75 [0,4194304] 0 2024-04-20T10:54:52.727 INFO:tasks.workunit.client.0.smithi090.stdout:8/773: dwrite d0/d11/f97 [4194304,4194304] 0 2024-04-20T10:54:52.727 INFO:tasks.workunit.client.0.smithi090.stdout:8/774: getdents d0/d26/da7/df5/dcf/dd5/df9 0 2024-04-20T10:54:52.727 INFO:tasks.workunit.client.0.smithi090.stdout:8/775: stat d0/d3a 0 2024-04-20T10:54:52.727 INFO:tasks.workunit.client.0.smithi090.stdout:8/776: fdatasync d0/d11/d22/d53/d57/f7d 0 2024-04-20T10:54:52.727 INFO:tasks.workunit.client.0.smithi090.stdout:3/754: dwrite d7/d15/d2a/d8d/fe9 [0,4194304] 0 2024-04-20T10:54:52.727 INFO:tasks.workunit.client.0.smithi090.stdout:3/755: write d7/d15/d2a/d8d/fb1 [473082,93904] 0 2024-04-20T10:54:52.735 INFO:tasks.workunit.client.0.smithi090.stdout:1/915: dwrite d8/d1a/d1d/d67/dff/d3f/fed [0,4194304] 0 2024-04-20T10:54:52.740 INFO:tasks.workunit.client.0.smithi090.stdout:6/649: dwrite d1/fb4 [0,4194304] 0 2024-04-20T10:54:52.747 INFO:tasks.workunit.client.0.smithi090.stdout:1/916: dread d8/d1a/d1d/d67/dff/d3f/f5f [0,4194304] 0 2024-04-20T10:54:52.747 INFO:tasks.workunit.client.0.smithi090.stdout:1/917: chown d8/d1a/d1d/d67/dff/d4a/d7b/lf5 136395335 1 2024-04-20T10:54:52.747 INFO:tasks.workunit.client.0.smithi090.stdout:1/918: stat d8/d1a/f39 0 2024-04-20T10:54:52.974 INFO:tasks.workunit.client.0.smithi090.stdout:2/870: truncate d11/d1a/d37/f93 2177699 0 2024-04-20T10:54:52.975 INFO:tasks.workunit.client.0.smithi090.stdout:7/750: rename d11/d1a/d3b/dd6 to d11/d13/d5b/db8/dbf/df1 0 2024-04-20T10:54:52.975 INFO:tasks.workunit.client.0.smithi090.stdout:4/742: mknod d7/d9/d47/d8d/cf1 0 2024-04-20T10:54:52.977 INFO:tasks.workunit.client.0.smithi090.stdout:8/777: unlink d0/d2d/d49/f73 0 2024-04-20T10:54:52.978 INFO:tasks.workunit.client.0.smithi090.stdout:3/756: link d7/d15/l1e d7/d15/d2a/de4/lf2 0 2024-04-20T10:54:52.983 INFO:tasks.workunit.client.0.smithi090.stdout:1/919: write d8/d1a/d1d/d67/dff/d4a/d93/fd7 [54080,101329] 0 2024-04-20T10:54:52.983 INFO:tasks.workunit.client.0.smithi090.stdout:1/920: readlink d8/d1a/d1d/l95 0 2024-04-20T10:54:52.984 INFO:tasks.workunit.client.0.smithi090.stdout:2/871: mknod d11/d1f/d2e/d10c/c11b 0 2024-04-20T10:54:52.985 INFO:tasks.workunit.client.0.smithi090.stdout:7/751: dread - d11/d13/d33/d44/d89/f9f zero size 2024-04-20T10:54:52.987 INFO:tasks.workunit.client.0.smithi090.stdout:8/778: creat d0/d26/da7/da9/f101 x:0 0 0 2024-04-20T10:54:52.987 INFO:tasks.workunit.client.0.smithi090.stdout:8/779: write d0/d11/fdb [935134,9622] 0 2024-04-20T10:54:52.987 INFO:tasks.workunit.client.0.smithi090.stdout:8/780: chown d0/d2d/dd4/ffc 313368423 1 2024-04-20T10:54:52.989 INFO:tasks.workunit.client.0.smithi090.stdout:3/757: rename d7/d43/f76 to d7/d15/ff3 0 2024-04-20T10:54:52.989 INFO:tasks.workunit.client.0.smithi090.stdout:3/758: stat d7/d15/d2a/d30/d93/f74 0 2024-04-20T10:54:52.990 INFO:tasks.workunit.client.0.smithi090.stdout:6/650: mkdir d1/d4/dd6 0 2024-04-20T10:54:52.990 INFO:tasks.workunit.client.0.smithi090.stdout:1/921: stat d8/d1a/lae 0 2024-04-20T10:54:52.992 INFO:tasks.workunit.client.0.smithi090.stdout:7/752: mknod d11/d13/d5b/d6b/cf2 0 2024-04-20T10:54:52.993 INFO:tasks.workunit.client.0.smithi090.stdout:8/781: unlink d0/d3a/d9f/l35 0 2024-04-20T10:54:52.994 INFO:tasks.workunit.client.0.smithi090.stdout:8/782: chown d0/d11/d22/d53/d57 153 1 2024-04-20T10:54:52.995 INFO:tasks.workunit.client.0.smithi090.stdout:3/759: creat d7/d15/d2a/de4/ff4 x:0 0 0 2024-04-20T10:54:52.996 INFO:tasks.workunit.client.0.smithi090.stdout:6/651: link d1/d4/d26/d11/c3d d1/d4/d26/d11/d4a/d56/dc7/cd7 0 2024-04-20T10:54:52.998 INFO:tasks.workunit.client.0.smithi090.stdout:8/783: rmdir d0/d3a 39 2024-04-20T10:54:52.999 INFO:tasks.workunit.client.0.smithi090.stdout:8/784: write d0/d11/d22/fb3 [1157400,2543] 0 2024-04-20T10:54:52.999 INFO:tasks.workunit.client.0.smithi090.stdout:8/785: truncate d0/d3a/d9f/d52/f82 954084 0 2024-04-20T10:54:52.999 INFO:tasks.workunit.client.0.smithi090.stdout:0/907: sync 2024-04-20T10:54:52.999 INFO:tasks.workunit.client.0.smithi090.stdout:7/753: dread d11/d1a/d3b/d79/f8d [4194304,4194304] 0 2024-04-20T10:54:53.001 INFO:tasks.workunit.client.0.smithi090.stdout:6/652: mkdir d1/d4/dd6/dd8 0 2024-04-20T10:54:53.001 INFO:tasks.workunit.client.0.smithi090.stdout:2/872: dwrite d11/d1a/d30/f90 [0,4194304] 0 2024-04-20T10:54:53.002 INFO:tasks.workunit.client.0.smithi090.stdout:8/786: creat d0/d26/da7/f102 x:0 0 0 2024-04-20T10:54:53.003 INFO:tasks.workunit.client.0.smithi090.stdout:0/908: creat d14/d19/d2b/d8e/d43/d5c/d103/f122 x:0 0 0 2024-04-20T10:54:53.004 INFO:tasks.workunit.client.0.smithi090.stdout:6/653: symlink d1/d19/d36/d1e/d1f/d3f/d54/ld9 0 2024-04-20T10:54:53.005 INFO:tasks.workunit.client.0.smithi090.stdout:6/654: stat d1 0 2024-04-20T10:54:53.009 INFO:tasks.workunit.client.0.smithi090.stdout:2/873: creat d11/d1a/d2b/dff/f11c x:0 0 0 2024-04-20T10:54:53.010 INFO:tasks.workunit.client.0.smithi090.stdout:8/787: creat d0/d3a/d9f/db9/dbe/f103 x:0 0 0 2024-04-20T10:54:53.010 INFO:tasks.workunit.client.0.smithi090.stdout:8/788: write d0/d3a/d4a/d81/f9e [1777647,104972] 0 2024-04-20T10:54:53.010 INFO:tasks.workunit.client.0.smithi090.stdout:8/789: write d0/d3a/d4a/d81/f9e [2736303,10709] 0 2024-04-20T10:54:53.010 INFO:tasks.workunit.client.0.smithi090.stdout:0/909: creat d14/d19/d2b/d8e/d40/f123 x:0 0 0 2024-04-20T10:54:53.010 INFO:tasks.workunit.client.0.smithi090.stdout:0/910: fsync d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/d3b/f9c 0 2024-04-20T10:54:53.010 INFO:tasks.workunit.client.0.smithi090.stdout:6/655: creat d1/d19/d36/d1e/d74/fda x:0 0 0 2024-04-20T10:54:53.012 INFO:tasks.workunit.client.0.smithi090.stdout:1/922: dwrite d8/f44 [0,4194304] 0 2024-04-20T10:54:53.012 INFO:tasks.workunit.client.0.smithi090.stdout:1/923: dread - d8/ff1 zero size 2024-04-20T10:54:53.013 INFO:tasks.workunit.client.0.smithi090.stdout:0/911: link d14/d19/d2b/d52/dab/ddc/de4/d5b/d8a/l9f d14/d19/d2b/d52/dab/da1/l124 0 2024-04-20T10:54:53.015 INFO:tasks.workunit.client.0.smithi090.stdout:6/656: creat d1/d10/fdb x:0 0 0 2024-04-20T10:54:53.015 INFO:tasks.workunit.client.0.smithi090.stdout:6/657: readlink d1/d19/d36/d28/lbb 0 2024-04-20T10:54:53.016 INFO:tasks.workunit.client.0.smithi090.stdout:2/874: link d11/d1a/d37/d85/d87/f108 d11/d1a/d4a/d80/f11d 0 2024-04-20T10:54:53.016 INFO:tasks.workunit.client.0.smithi090.stdout:2/875: chown d11/d1a/d4a/d55/da1/fe8 2018510 1 2024-04-20T10:54:53.017 INFO:tasks.workunit.client.0.smithi090.stdout:6/658: unlink d1/d19/d36/d1e/fab 0 2024-04-20T10:54:53.023 INFO:tasks.workunit.client.0.smithi090.stdout:0/912: write d14/d19/d2b/d8e/d43/f54 [3979669,28078] 0 2024-04-20T10:54:53.025 INFO:tasks.workunit.client.0.smithi090.stdout:2/876: creat d11/d1a/d30/d8d/f11e x:0 0 0 2024-04-20T10:54:53.032 INFO:tasks.workunit.client.0.smithi090.stdout:7/754: dwrite f0 [0,4194304] 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:1/924: dwrite d8/d1a/d1d/d67/dff/d4a/d93/d5d/f124 [0,4194304] 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:1/925: write d8/d1a/d1d/d67/dff/d4a/d5a/d105/d109/fc9 [413995,97785] 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/790: dwrite d0/d11/d22/fff [0,4194304] 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/791: fdatasync d0/d3a/d9f/d52/ff1 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/792: write d0/f79 [1111880,105795] 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/793: readlink d0/d11/l37 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:8/794: readlink d0/l1d 0 2024-04-20T10:54:53.033 INFO:tasks.workunit.client.0.smithi090.stdout:6/659: read d1/d4/d26/d11/d4a/d70/fb1 [1215530,99806] 0 2024-04-20T10:54:53.034 INFO:tasks.workunit.client.0.smithi090.stdout:2/877: mkdir d11/d1f/d2e/dad/d11f 0 2024-04-20T10:54:53.034 INFO:tasks.workunit.client.0.smithi090.stdout:8/795: dread d0/d3a/d9f/d52/f82 [0,4194304] 0 2024-04-20T10:54:53.034 INFO:tasks.workunit.client.0.smithi090.stdout:8/796: chown d0/d26/f78 113090 1 2024-04-20T10:54:53.035 INFO:tasks.workunit.client.0.smithi090.stdout:7/755: rename d11/d13/d5b/d6b to d11/d13/d22/df3 0 2024-04-20T10:54:53.038 INFO:tasks.workunit.client.0.smithi090.stdout:6/660: creat d1/d19/d25/fdc x:0 0 0 2024-04-20T10:54:53.040 INFO:tasks.workunit.client.0.smithi090.stdout:2/878: mkdir d11/d1a/d4a/d55/d67/d120 0 2024-04-20T10:54:53.041 INFO:tasks.workunit.client.0.smithi090.stdout:7/756: dread d11/d13/d22/f4b [0,4194304] 0 2024-04-20T10:54:53.041 INFO:tasks.workunit.client.0.smithi090.stdout:0/913: dwrite d14/d19/d2b/d52/dab/da1/fad [0,4194304] 0 2024-04-20T10:54:53.043 INFO:tasks.workunit.client.0.smithi090.stdout:8/797: mknod d0/d11/d22/d53/d8e/c104 0 2024-04-20T10:54:53.044 INFO:tasks.workunit.client.0.smithi090.stdout:6/661: mkdir d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd 0 2024-04-20T10:54:53.047 INFO:tasks.workunit.client.0.smithi090.stdout:0/914: rename d14/d19/d2b/d8e/d43/d5c/lfc to d14/d19/d2b/d8e/d43/d6d/l125 0 2024-04-20T10:54:53.048 INFO:tasks.workunit.client.0.smithi090.stdout:0/915: truncate d14/d19/d2b/d61/da0/db1/dbb/fd1 23488 0 2024-04-20T10:54:53.049 INFO:tasks.workunit.client.0.smithi090.stdout:8/798: creat d0/d3a/daa/f105 x:0 0 0 2024-04-20T10:54:53.049 INFO:tasks.workunit.client.0.smithi090.stdout:8/799: readlink d0/d11/l2c 0 2024-04-20T10:54:53.051 INFO:tasks.workunit.client.0.smithi090.stdout:7/757: write d11/d13/d33/d44/d89/fbd [2089419,72343] 0 2024-04-20T10:54:53.054 INFO:tasks.workunit.client.0.smithi090.stdout:8/800: creat d0/d2d/f106 x:0 0 0 2024-04-20T10:54:53.057 INFO:tasks.workunit.client.0.smithi090.stdout:1/926: dwrite d8/d1a/d4d/f9c [0,4194304] 0 2024-04-20T10:54:53.063 INFO:tasks.workunit.client.0.smithi090.stdout:0/916: getdents d14/d19/d2b/d8e/d43/d5c 0 2024-04-20T10:54:53.064 INFO:tasks.workunit.client.0.smithi090.stdout:7/758: mkdir d11/d13/d22/d24/df4 0 2024-04-20T10:54:53.064 INFO:tasks.workunit.client.0.smithi090.stdout:7/759: write d11/d13/d22/d24/fc1 [333982,5367] 0 2024-04-20T10:54:53.064 INFO:tasks.workunit.client.0.smithi090.stdout:7/760: readlink d11/d61/la5 0 2024-04-20T10:54:53.065 INFO:tasks.workunit.client.0.smithi090.stdout:7/761: write d11/d13/f8c [29797,85732] 0 2024-04-20T10:54:53.072 INFO:tasks.workunit.client.0.smithi090.stdout:8/801: dwrite d0/fd2 [0,4194304] 0 2024-04-20T10:54:53.072 INFO:tasks.workunit.client.0.smithi090.stdout:8/802: fdatasync d0/d26/da7/da9/fb7 0 2024-04-20T10:54:53.073 INFO:tasks.workunit.client.0.smithi090.stdout:0/917: mkdir d14/d19/dca/d126 0 2024-04-20T10:54:53.073 INFO:tasks.workunit.client.0.smithi090.stdout:0/918: truncate d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/f38 1401694 0 2024-04-20T10:54:53.074 INFO:tasks.workunit.client.0.smithi090.stdout:7/762: mknod d11/d13/d23/dd8/cf5 0 2024-04-20T10:54:53.078 INFO:tasks.workunit.client.0.smithi090.stdout:1/927: dwrite f5 [0,4194304] 0 2024-04-20T10:54:53.078 INFO:tasks.workunit.client.0.smithi090.stdout:1/928: dread - d8/d1a/d1d/d67/dff/d4a/d5a/f107 zero size 2024-04-20T10:54:53.089 INFO:tasks.workunit.client.0.smithi090.stdout:7/763: dwrite d11/d1a/d3b/ddf/fef [0,4194304] 0 2024-04-20T10:54:53.090 INFO:tasks.workunit.client.0.smithi090.stdout:8/803: rename d0/d11/d22/d53/d8e/c94 to d0/d26/c107 0 2024-04-20T10:54:53.091 INFO:tasks.workunit.client.0.smithi090.stdout:1/929: creat d8/d1a/d1d/d67/dff/d6e/d10d/f12f x:0 0 0 2024-04-20T10:54:53.092 INFO:tasks.workunit.client.0.smithi090.stdout:7/764: symlink d11/d13/d22/d27/lf6 0 2024-04-20T10:54:53.102 INFO:tasks.workunit.client.0.smithi090.stdout:0/919: rename d14/d19/d2b/d8e/d40/ca7 to d14/d19/d2b/d61/da0/db1/c127 0 2024-04-20T10:54:53.103 INFO:tasks.workunit.client.0.smithi090.stdout:7/765: write d11/d13/d5d/d65/fab [1284689,11706] 0 2024-04-20T10:54:53.103 INFO:tasks.workunit.client.0.smithi090.stdout:1/930: mkdir d8/d1a/d1d/d67/dff/d4a/d5a/db2/d125/d130 0 2024-04-20T10:54:53.105 INFO:tasks.workunit.client.0.smithi090.stdout:0/920: creat d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/f128 x:0 0 0 2024-04-20T10:54:53.105 INFO:tasks.workunit.client.0.smithi090.stdout:0/921: readlink d14/l64 0 2024-04-20T10:54:53.105 INFO:tasks.workunit.client.0.smithi090.stdout:0/922: stat d14/d19/d2b/d52/dab/da1/df5/l100 0 2024-04-20T10:54:53.105 INFO:tasks.workunit.client.0.smithi090.stdout:0/923: chown d14/d19/d2b/d52/dab/ddc/de4/d5b/c67 30 1 2024-04-20T10:54:53.105 INFO:tasks.workunit.client.0.smithi090.stdout:1/931: dread d8/d1a/d1d/d67/dff/d3f/f87 [0,4194304] 0 2024-04-20T10:54:53.107 INFO:tasks.workunit.client.0.smithi090.stdout:7/766: symlink d11/lf7 0 2024-04-20T10:54:53.108 INFO:tasks.workunit.client.0.smithi090.stdout:0/924: mkdir d14/d19/d2b/d52/dab/ddc/de4/d129 0 2024-04-20T10:54:53.110 INFO:tasks.workunit.client.0.smithi090.stdout:8/804: dwrite d0/d3a/d4a/f98 [0,4194304] 0 2024-04-20T10:54:53.110 INFO:tasks.workunit.client.0.smithi090.stdout:8/805: read d0/d2d/d49/d67/f69 [3793276,117319] 0 2024-04-20T10:54:53.111 INFO:tasks.workunit.client.0.smithi090.stdout:8/806: chown d0/d2d/d49/cae 49271 1 2024-04-20T10:54:53.130 INFO:tasks.workunit.client.0.smithi090.stdout:8/807: dwrite d0/d2d/d49/fdd [0,4194304] 0 2024-04-20T10:54:53.130 INFO:tasks.workunit.client.0.smithi090.stdout:1/932: dwrite d8/d1a/d1d/d7a/db0/fb6 [0,4194304] 0 2024-04-20T10:54:53.183 INFO:tasks.workunit.client.0.smithi090.stdout:8/808: creat d0/d3a/d4a/f108 x:0 0 0 2024-04-20T10:54:53.183 INFO:tasks.workunit.client.0.smithi090.stdout:1/933: getdents d8/d1a/d1d/d67/dff/d8f 0 2024-04-20T10:54:53.184 INFO:tasks.workunit.client.0.smithi090.stdout:1/934: chown d8/d1a/d1d/d67/dff/d3f/f5c 226488 1 2024-04-20T10:54:53.190 INFO:tasks.workunit.client.0.smithi090.stdout:1/935: dread d8/fd [4194304,4194304] 0 2024-04-20T10:54:53.197 INFO:tasks.workunit.client.0.smithi090.stdout:4/743: sync 2024-04-20T10:54:53.198 INFO:tasks.workunit.client.0.smithi090.stdout:8/809: unlink d0/d2d/d44/l4f 0 2024-04-20T10:54:53.199 INFO:tasks.workunit.client.0.smithi090.stdout:8/810: fdatasync d0/d26/f39 0 2024-04-20T10:54:53.199 INFO:tasks.workunit.client.0.smithi090.stdout:1/936: getdents d8/d1a/d1d/d67/dff/d4a/d5a/d105 0 2024-04-20T10:54:53.199 INFO:tasks.workunit.client.0.smithi090.stdout:1/937: fdatasync d8/d1a/d1d/d67/dff/d4a/f8b 0 2024-04-20T10:54:53.207 INFO:tasks.workunit.client.0.smithi090.stdout:1/938: dread f5 [0,4194304] 0 2024-04-20T10:54:53.208 INFO:tasks.workunit.client.0.smithi090.stdout:1/939: write d8/d1a/d1d/d67/dff/d6e/f84 [1305333,127145] 0 2024-04-20T10:54:53.208 INFO:tasks.workunit.client.0.smithi090.stdout:1/940: getdents d8/d1a/d1d/d67/dff/d4a/d5a/d105 0 2024-04-20T10:54:53.208 INFO:tasks.workunit.client.0.smithi090.stdout:1/941: chown d8/d1a/d4d/da5/cbd 1153 1 2024-04-20T10:54:53.208 INFO:tasks.workunit.client.0.smithi090.stdout:4/744: rmdir d7/d9/d17/d56/d66/d70 39 2024-04-20T10:54:53.208 INFO:tasks.workunit.client.0.smithi090.stdout:4/745: stat d7/d9/d17/d56/d66/d70/da1/dcd/f34 0 2024-04-20T10:54:53.209 INFO:tasks.workunit.client.0.smithi090.stdout:8/811: mknod d0/d11/d22/d53/df6/c109 0 2024-04-20T10:54:53.209 INFO:tasks.workunit.client.0.smithi090.stdout:8/812: fsync d0/d11/d22/d53/fca 0 2024-04-20T10:54:53.211 INFO:tasks.workunit.client.0.smithi090.stdout:1/942: creat d8/d1a/d1d/d67/dff/d6e/dde/f131 x:0 0 0 2024-04-20T10:54:53.212 INFO:tasks.workunit.client.0.smithi090.stdout:4/746: creat d7/d9/d17/da0/ff2 x:0 0 0 2024-04-20T10:54:53.212 INFO:tasks.workunit.client.0.smithi090.stdout:4/747: fdatasync d7/d9/d17/d56/d66/d70/da1/dcd/d42/f67 0 2024-04-20T10:54:53.212 INFO:tasks.workunit.client.0.smithi090.stdout:4/748: chown d7/d9/d47/d8d/dda/db5 10 1 2024-04-20T10:54:53.218 INFO:tasks.workunit.client.0.smithi090.stdout:4/749: dread d7/d9/d17/f49 [0,4194304] 0 2024-04-20T10:54:53.218 INFO:tasks.workunit.client.0.smithi090.stdout:4/750: chown d7/d9/d17/f58 23 1 2024-04-20T10:54:53.301 INFO:tasks.workunit.client.0.smithi090.stdout:1/943: unlink d8/d1a/d1d/lfa 0 2024-04-20T10:54:53.301 INFO:tasks.workunit.client.0.smithi090.stdout:1/944: readlink d8/d1a/d1d/d7a/db0/lc3 0 2024-04-20T10:54:53.301 INFO:tasks.workunit.client.0.smithi090.stdout:1/945: readlink d8/d1a/d1d/d7a/l129 0 2024-04-20T10:54:53.301 INFO:tasks.workunit.client.0.smithi090.stdout:4/751: mkdir d7/d9/d17/d94/df3 0 2024-04-20T10:54:53.306 INFO:tasks.workunit.client.0.smithi090.stdout:2/879: sync 2024-04-20T10:54:53.307 INFO:tasks.workunit.client.0.smithi090.stdout:3/760: sync 2024-04-20T10:54:53.311 INFO:tasks.workunit.client.0.smithi090.stdout:4/752: dread d7/d9/d17/d56/d66/d70/da1/dcd/d3d/f75 [0,4194304] 0 2024-04-20T10:54:53.313 INFO:tasks.workunit.client.0.smithi090.stdout:4/753: dread d7/d9/d92/fc7 [0,4194304] 0 2024-04-20T10:54:53.314 INFO:tasks.workunit.client.0.smithi090.stdout:1/946: rename d8/d1a/d1d/d67/dff/d4a/d5a/l119 to d8/d1a/d1d/d67/l132 0 2024-04-20T10:54:53.315 INFO:tasks.workunit.client.0.smithi090.stdout:2/880: creat d11/d1a/d2b/dff/d102/f121 x:0 0 0 2024-04-20T10:54:53.324 INFO:tasks.workunit.client.0.smithi090.stdout:2/881: dread d11/d1a/d30/f48 [0,4194304] 0 2024-04-20T10:54:53.324 INFO:tasks.workunit.client.0.smithi090.stdout:4/754: mknod d7/d9/d47/d8d/dda/cf4 0 2024-04-20T10:54:53.325 INFO:tasks.workunit.client.0.smithi090.stdout:4/755: truncate d7/f7d 4431658 0 2024-04-20T10:54:53.325 INFO:tasks.workunit.client.0.smithi090.stdout:4/756: chown d7/d9/d17/d56/d66/d70/da1/dcd/d42/d8f 45413 1 2024-04-20T10:54:53.326 INFO:tasks.workunit.client.0.smithi090.stdout:4/757: dread d7/d9/f20 [0,4194304] 0 2024-04-20T10:54:53.327 INFO:tasks.workunit.client.0.smithi090.stdout:1/947: truncate d8/d1a/d1d/d67/f23 2834176 0 2024-04-20T10:54:53.350 INFO:tasks.workunit.client.0.smithi090.stdout:4/758: dwrite d7/f52 [0,4194304] 0 2024-04-20T10:54:53.350 INFO:tasks.workunit.client.0.smithi090.stdout:4/759: chown d7/c77 7333135 1 2024-04-20T10:54:53.350 INFO:tasks.workunit.client.0.smithi090.stdout:1/948: dwrite d8/d1a/d1d/f27 [0,4194304] 0 2024-04-20T10:54:53.351 INFO:tasks.workunit.client.0.smithi090.stdout:2/882: creat d11/d1f/d2e/dad/d11f/f122 x:0 0 0 2024-04-20T10:54:53.370 INFO:tasks.workunit.client.0.smithi090.stdout:2/883: dwrite d11/d1f/d2e/f4d [0,4194304] 0 2024-04-20T10:54:53.372 INFO:tasks.workunit.client.0.smithi090.stdout:4/760: symlink d7/d9/d17/d56/d66/lf5 0 2024-04-20T10:54:53.372 INFO:tasks.workunit.client.0.smithi090.stdout:1/949: creat d8/d1a/d1d/d7a/d9a/f133 x:0 0 0 2024-04-20T10:54:53.372 INFO:tasks.workunit.client.0.smithi090.stdout:1/950: readlink d8/d1a/d1d/d7a/l129 0 2024-04-20T10:54:53.381 INFO:tasks.workunit.client.0.smithi090.stdout:2/884: dread d11/d1a/d37/fc5 [0,4194304] 0 2024-04-20T10:54:53.382 INFO:tasks.workunit.client.0.smithi090.stdout:2/885: truncate d11/d1a/d37/d85/d87/f109 31015 0 2024-04-20T10:54:53.382 INFO:tasks.workunit.client.0.smithi090.stdout:2/886: dread - d11/d1a/d4a/d55/fe4 zero size 2024-04-20T10:54:53.382 INFO:tasks.workunit.client.0.smithi090.stdout:4/761: creat d7/d97/ff6 x:0 0 0 2024-04-20T10:54:53.386 INFO:tasks.workunit.client.0.smithi090.stdout:2/887: creat d11/d1f/d2e/d6e/dc7/f123 x:0 0 0 2024-04-20T10:54:53.386 INFO:tasks.workunit.client.0.smithi090.stdout:2/888: chown d11/d1f/d2e/c7b 620831 1 2024-04-20T10:54:53.389 INFO:tasks.workunit.client.0.smithi090.stdout:1/951: dwrite d8/d1a/d1d/d67/dff/d4a/f8b [0,4194304] 0 2024-04-20T10:54:53.399 INFO:tasks.workunit.client.0.smithi090.stdout:4/762: dwrite d7/d9/d47/d8d/dda/db5/feb [0,4194304] 0 2024-04-20T10:54:53.399 INFO:tasks.workunit.client.0.smithi090.stdout:1/952: dread d8/d1a/d1d/d67/dff/d6e/f72 [0,4194304] 0 2024-04-20T10:54:53.400 INFO:tasks.workunit.client.0.smithi090.stdout:2/889: symlink d11/d1a/d4a/d59/l124 0 2024-04-20T10:54:53.401 INFO:tasks.workunit.client.0.smithi090.stdout:4/763: mknod d7/d9/d47/d8d/cf7 0 2024-04-20T10:54:53.402 INFO:tasks.workunit.client.0.smithi090.stdout:1/953: mkdir d8/d1a/d1d/d67/dff/d4a/d5a/d123/d134 0 2024-04-20T10:54:53.402 INFO:tasks.workunit.client.0.smithi090.stdout:1/954: fdatasync d8/d1a/d1d/d67/dff/d4a/d93/d5d/fe4 0 2024-04-20T10:54:53.403 INFO:tasks.workunit.client.0.smithi090.stdout:2/890: creat d11/d1a/d4a/d55/f125 x:0 0 0 2024-04-20T10:54:53.403 INFO:tasks.workunit.client.0.smithi090.stdout:2/891: write d11/d1a/d4a/d59/ffe [193801,49034] 0 2024-04-20T10:54:53.403 INFO:tasks.workunit.client.0.smithi090.stdout:2/892: fdatasync d11/d1a/d2b/f2f 0 2024-04-20T10:54:53.404 INFO:tasks.workunit.client.0.smithi090.stdout:2/893: fdatasync d11/d1f/d2e/d6e/dc9/fcf 0 2024-04-20T10:54:53.405 INFO:tasks.workunit.client.0.smithi090.stdout:1/955: rename d8/d1a/d1d/d67/dff/d4a/d5a/fb5 to d8/d1a/d1d/d67/dff/d4a/d5a/d105/d109/f135 0 2024-04-20T10:54:53.405 INFO:tasks.workunit.client.0.smithi090.stdout:2/894: symlink d11/d1f/d2e/dcd/d105/l126 0 2024-04-20T10:54:53.405 INFO:tasks.workunit.client.0.smithi090.stdout:2/895: fdatasync d11/d1f/f75 0 2024-04-20T10:54:53.407 INFO:tasks.workunit.client.0.smithi090.stdout:2/896: creat d11/d1a/d4a/d80/f127 x:0 0 0 2024-04-20T10:54:53.408 INFO:tasks.workunit.client.0.smithi090.stdout:1/956: link d8/lc0 d8/d1a/d1d/d67/dff/d4a/d93/d5d/l136 0 2024-04-20T10:54:53.409 INFO:tasks.workunit.client.0.smithi090.stdout:2/897: creat d11/d1a/d4a/d55/f128 x:0 0 0 2024-04-20T10:54:53.410 INFO:tasks.workunit.client.0.smithi090.stdout:4/764: dread d7/d9/d17/f3f [0,4194304] 0 2024-04-20T10:54:53.411 INFO:tasks.workunit.client.0.smithi090.stdout:1/957: rmdir d8/d1a/d1d/d67/dff/d8f/db4 39 2024-04-20T10:54:53.417 INFO:tasks.workunit.client.0.smithi090.stdout:4/765: dread d7/d9/d17/d56/d66/f8a [4194304,4194304] 0 2024-04-20T10:54:53.417 INFO:tasks.workunit.client.0.smithi090.stdout:0/925: sync 2024-04-20T10:54:53.418 INFO:tasks.workunit.client.0.smithi090.stdout:7/767: sync 2024-04-20T10:54:53.418 INFO:tasks.workunit.client.0.smithi090.stdout:6/662: sync 2024-04-20T10:54:53.418 INFO:tasks.workunit.client.0.smithi090.stdout:0/926: getdents d14/d19/d2b/d8e/d43 0 2024-04-20T10:54:53.418 INFO:tasks.workunit.client.0.smithi090.stdout:0/927: chown d14/d19/d2b/d8e/fdb 2 1 2024-04-20T10:54:53.418 INFO:tasks.workunit.client.0.smithi090.stdout:6/663: write d1/d19/d36/d1e/d74/fcf [869055,16282] 0 2024-04-20T10:54:53.418 INFO:tasks.workunit.client.0.smithi090.stdout:2/898: link d11/f1c d11/d1a/d4a/d55/d67/f129 0 2024-04-20T10:54:53.419 INFO:tasks.workunit.client.0.smithi090.stdout:7/768: rmdir d11/d13/d22/d24/d35 39 2024-04-20T10:54:53.419 INFO:tasks.workunit.client.0.smithi090.stdout:7/769: readlink d11/d13/d22/d8f/la6 0 2024-04-20T10:54:53.420 INFO:tasks.workunit.client.0.smithi090.stdout:6/664: creat d1/d4/d26/d11/d4a/fde x:0 0 0 2024-04-20T10:54:53.420 INFO:tasks.workunit.client.0.smithi090.stdout:6/665: write d1/d4/d26/d11/d4a/d70/fb1 [1066345,95669] 0 2024-04-20T10:54:53.421 INFO:tasks.workunit.client.0.smithi090.stdout:2/899: mknod d11/d1f/d2e/dad/d11f/c12a 0 2024-04-20T10:54:53.421 INFO:tasks.workunit.client.0.smithi090.stdout:6/666: truncate d1/d10/f39 558925 0 2024-04-20T10:54:53.422 INFO:tasks.workunit.client.0.smithi090.stdout:6/667: dread d1/d4/d26/d11/d4a/f68 [0,4194304] 0 2024-04-20T10:54:53.422 INFO:tasks.workunit.client.0.smithi090.stdout:6/668: chown d1/d19/d36/c6d 610740 1 2024-04-20T10:54:53.422 INFO:tasks.workunit.client.0.smithi090.stdout:6/669: chown d1/d4/d26/d11/d4a/d6b/f89 17862 1 2024-04-20T10:54:53.426 INFO:tasks.workunit.client.0.smithi090.stdout:0/928: dread ff [0,4194304] 0 2024-04-20T10:54:53.426 INFO:tasks.workunit.client.0.smithi090.stdout:4/766: dread d7/f12 [0,4194304] 0 2024-04-20T10:54:53.429 INFO:tasks.workunit.client.0.smithi090.stdout:2/900: mkdir d11/d1a/d2b/d12b 0 2024-04-20T10:54:53.429 INFO:tasks.workunit.client.0.smithi090.stdout:2/901: truncate d11/d1a/d4a/d55/f128 131954 0 2024-04-20T10:54:53.430 INFO:tasks.workunit.client.0.smithi090.stdout:4/767: mkdir d7/d9/d17/d56/d66/d9d/df8 0 2024-04-20T10:54:53.433 INFO:tasks.workunit.client.0.smithi090.stdout:0/929: dread d14/d19/d2b/d61/da0/db1/ffe [0,4194304] 0 2024-04-20T10:54:53.435 INFO:tasks.workunit.client.0.smithi090.stdout:2/902: creat d11/d1a/d4a/f12c x:0 0 0 2024-04-20T10:54:53.435 INFO:tasks.workunit.client.0.smithi090.stdout:1/958: dwrite d8/d1a/d1d/d67/dff/d4a/d93/fd7 [0,4194304] 0 2024-04-20T10:54:53.436 INFO:tasks.workunit.client.0.smithi090.stdout:0/930: symlink d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/d3b/l12a 0 2024-04-20T10:54:53.436 INFO:tasks.workunit.client.0.smithi090.stdout:0/931: fdatasync d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/f10b 0 2024-04-20T10:54:53.437 INFO:tasks.workunit.client.0.smithi090.stdout:2/903: unlink d11/d97/lcc 0 2024-04-20T10:54:53.438 INFO:tasks.workunit.client.0.smithi090.stdout:7/770: write d11/d13/d5b/fb6 [2068551,83746] 0 2024-04-20T10:54:53.438 INFO:tasks.workunit.client.0.smithi090.stdout:7/771: chown d11/d13/d33/d44/l93 967611648 1 2024-04-20T10:54:53.438 INFO:tasks.workunit.client.0.smithi090.stdout:7/772: chown d11/d1a/f40 91692 1 2024-04-20T10:54:53.438 INFO:tasks.workunit.client.0.smithi090.stdout:7/773: fdatasync d11/d13/d23/f38 0 2024-04-20T10:54:53.439 INFO:tasks.workunit.client.0.smithi090.stdout:0/932: rename d14/d19/d2b/d8e/d43/d5c/d70/d9b/fe1 to d14/d41/f12b 0 2024-04-20T10:54:53.442 INFO:tasks.workunit.client.0.smithi090.stdout:2/904: rename d11/d1f/faa to d11/d1f/d2e/f12d 0 2024-04-20T10:54:53.446 INFO:tasks.workunit.client.0.smithi090.stdout:0/933: rename d14/f80 to d14/d19/d2b/d52/dab/da1/df5/f12c 0 2024-04-20T10:54:53.447 INFO:tasks.workunit.client.0.smithi090.stdout:2/905: symlink d11/d1a/d37/d85/l12e 0 2024-04-20T10:54:53.449 INFO:tasks.workunit.client.0.smithi090.stdout:0/934: dread d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/f10b [0,4194304] 0 2024-04-20T10:54:53.449 INFO:tasks.workunit.client.0.smithi090.stdout:0/935: write d14/d19/f71 [1667951,40812] 0 2024-04-20T10:54:53.450 INFO:tasks.workunit.client.0.smithi090.stdout:2/906: mkdir d11/d1f/d2e/d12f 0 2024-04-20T10:54:53.450 INFO:tasks.workunit.client.0.smithi090.stdout:6/670: dwrite d1/d19/d36/d28/f34 [4194304,4194304] 0 2024-04-20T10:54:53.451 INFO:tasks.workunit.client.0.smithi090.stdout:6/671: chown d1/d19/d36/d1e/d1f 78487 1 2024-04-20T10:54:53.451 INFO:tasks.workunit.client.0.smithi090.stdout:6/672: chown d1/d9a 69879744 1 2024-04-20T10:54:53.451 INFO:tasks.workunit.client.0.smithi090.stdout:1/959: dread d8/fe [0,4194304] 0 2024-04-20T10:54:53.451 INFO:tasks.workunit.client.0.smithi090.stdout:0/936: rename c1 to d14/d19/d2b/d61/c12d 0 2024-04-20T10:54:53.452 INFO:tasks.workunit.client.0.smithi090.stdout:2/907: mknod d11/d1a/d2b/dff/d102/c130 0 2024-04-20T10:54:53.452 INFO:tasks.workunit.client.0.smithi090.stdout:2/908: write d11/d1f/d2e/d6e/dc9/f118 [515034,48473] 0 2024-04-20T10:54:53.452 INFO:tasks.workunit.client.0.smithi090.stdout:2/909: readlink d11/d1a/d2b/l107 0 2024-04-20T10:54:53.452 INFO:tasks.workunit.client.0.smithi090.stdout:2/910: dread - d11/d1a/d37/d85/f98 zero size 2024-04-20T10:54:53.452 INFO:tasks.workunit.client.0.smithi090.stdout:6/673: mknod d1/d4/dd6/cdf 0 2024-04-20T10:54:53.453 INFO:tasks.workunit.client.0.smithi090.stdout:1/960: truncate d8/d1a/d1d/d67/dff/d4a/d5a/d105/d109/f135 5147883 0 2024-04-20T10:54:53.453 INFO:tasks.workunit.client.0.smithi090.stdout:1/961: readlink d8/d1a/d1d/d7a/d9a/lbf 0 2024-04-20T10:54:53.454 INFO:tasks.workunit.client.0.smithi090.stdout:0/937: mknod d14/d19/d2b/d61/da0/db1/dbb/d118/c12e 0 2024-04-20T10:54:53.454 INFO:tasks.workunit.client.0.smithi090.stdout:1/962: getdents d8/d1a/d1d/d67/dff/d4a/d5a/d123 0 2024-04-20T10:54:53.455 INFO:tasks.workunit.client.0.smithi090.stdout:1/963: write d8/d1a/d1d/d67/dff/d4a/fb9 [944296,61938] 0 2024-04-20T10:54:53.455 INFO:tasks.workunit.client.0.smithi090.stdout:1/964: write d8/ff1 [524329,64542] 0 2024-04-20T10:54:53.458 INFO:tasks.workunit.client.0.smithi090.stdout:4/768: dwrite d7/d9/d17/d56/d66/d70/da1/dcd/d42/f67 [0,4194304] 0 2024-04-20T10:54:53.458 INFO:tasks.workunit.client.0.smithi090.stdout:4/769: stat d7/d9/d17/d56/d66/d70/da5 0 2024-04-20T10:54:53.458 INFO:tasks.workunit.client.0.smithi090.stdout:4/770: write d7/d9/d17/d56/d66/d9d/fe1 [873492,62815] 0 2024-04-20T10:54:53.459 INFO:tasks.workunit.client.0.smithi090.stdout:2/911: dread d11/d1a/d4a/d80/fe6 [0,4194304] 0 2024-04-20T10:54:53.459 INFO:tasks.workunit.client.0.smithi090.stdout:2/912: getdents d11/d1a/d4a/d55/da1 0 2024-04-20T10:54:53.459 INFO:tasks.workunit.client.0.smithi090.stdout:0/938: unlink d14/d19/d2b/d52/dab/ddc/de4/fc1 0 2024-04-20T10:54:53.460 INFO:tasks.workunit.client.0.smithi090.stdout:0/939: truncate d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/f10c 452222 0 2024-04-20T10:54:53.460 INFO:tasks.workunit.client.0.smithi090.stdout:0/940: fsync d14/d19/d2b/d8e/fdb 0 2024-04-20T10:54:53.460 INFO:tasks.workunit.client.0.smithi090.stdout:0/941: fdatasync d14/d19/d2b/d52/dab/fdf 0 2024-04-20T10:54:53.460 INFO:tasks.workunit.client.0.smithi090.stdout:0/942: chown d14/d19/d2b/d8e/d43/d5c/d70/d9b 670273 1 2024-04-20T10:54:53.465 INFO:tasks.workunit.client.0.smithi090.stdout:1/965: dread d8/d1a/d1d/d67/dff/d4a/d93/fd7 [0,4194304] 0 2024-04-20T10:54:53.465 INFO:tasks.workunit.client.0.smithi090.stdout:1/966: fsync d8/d1a/d1d/d67/f23 0 2024-04-20T10:54:53.467 INFO:tasks.workunit.client.0.smithi090.stdout:4/771: rename d7/d9/d17/d56/d66 to d7/d9/d47/df9 0 2024-04-20T10:54:53.467 INFO:tasks.workunit.client.0.smithi090.stdout:4/772: write d7/d9/d47/df9/d70/da1/dcd/d3d/f9f [5824332,121506] 0 2024-04-20T10:54:53.470 INFO:tasks.workunit.client.0.smithi090.stdout:3/761: sync 2024-04-20T10:54:53.470 INFO:tasks.workunit.client.0.smithi090.stdout:8/813: sync 2024-04-20T10:54:53.473 INFO:tasks.workunit.client.0.smithi090.stdout:1/967: mknod d8/d1a/d1d/d67/dff/d4a/d5a/d105/d109/c137 0 2024-04-20T10:54:53.474 INFO:tasks.workunit.client.0.smithi090.stdout:1/968: truncate d8/d1a/d4d/da5/f121 1036027 0 2024-04-20T10:54:53.479 INFO:tasks.workunit.client.0.smithi090.stdout:1/969: write d8/fe [3270607,86451] 0 2024-04-20T10:54:53.479 INFO:tasks.workunit.client.0.smithi090.stdout:1/970: truncate d8/d1a/f47 2215084 0 2024-04-20T10:54:53.479 INFO:tasks.workunit.client.0.smithi090.stdout:1/971: fdatasync d8/d1a/d1d/f94 0 2024-04-20T10:54:53.483 INFO:tasks.workunit.client.0.smithi090.stdout:6/674: dwrite d1/d19/d36/f7d [0,4194304] 0 2024-04-20T10:54:53.484 INFO:tasks.workunit.client.0.smithi090.stdout:8/814: dread d0/d2d/d49/fdd [0,4194304] 0 2024-04-20T10:54:53.484 INFO:tasks.workunit.client.0.smithi090.stdout:8/815: chown d0/d26/da7/df5/ff0 88099 1 2024-04-20T10:54:53.484 INFO:tasks.workunit.client.0.smithi090.stdout:8/816: fdatasync d0/d2d/d44/fc8 0 2024-04-20T10:54:53.485 INFO:tasks.workunit.client.0.smithi090.stdout:3/762: creat d7/d15/d2a/d30/d48/ff5 x:0 0 0 2024-04-20T10:54:53.485 INFO:tasks.workunit.client.0.smithi090.stdout:3/763: write d7/fc [587640,75646] 0 2024-04-20T10:54:53.486 INFO:tasks.workunit.client.0.smithi090.stdout:2/913: dwrite d11/d1a/d37/fc5 [4194304,4194304] 0 2024-04-20T10:54:53.486 INFO:tasks.workunit.client.0.smithi090.stdout:8/817: mkdir d0/d11/d22/d53/d57/dd3/d10a 0 2024-04-20T10:54:53.487 INFO:tasks.workunit.client.0.smithi090.stdout:3/764: symlink d7/d43/db7/lf6 0 2024-04-20T10:54:53.487 INFO:tasks.workunit.client.0.smithi090.stdout:3/765: write d7/f79 [1179978,30691] 0 2024-04-20T10:54:53.487 INFO:tasks.workunit.client.0.smithi090.stdout:3/766: chown d7/d43/db7/dd4 15192 1 2024-04-20T10:54:53.487 INFO:tasks.workunit.client.0.smithi090.stdout:3/767: write d7/d35/f6b [25730,5472] 0 2024-04-20T10:54:53.490 INFO:tasks.workunit.client.0.smithi090.stdout:2/914: rmdir d11/d1f/d2e/dad/d104 0 2024-04-20T10:54:53.491 INFO:tasks.workunit.client.0.smithi090.stdout:3/768: getdents d7/d43/db7/daf 0 2024-04-20T10:54:53.492 INFO:tasks.workunit.client.0.smithi090.stdout:1/972: write d8/f2d [1738840,36464] 0 2024-04-20T10:54:53.493 INFO:tasks.workunit.client.0.smithi090.stdout:1/973: fsync d8/d1a/d4d/f63 0 2024-04-20T10:54:53.493 INFO:tasks.workunit.client.0.smithi090.stdout:8/818: read d0/d26/da7/df5/fc2 [2801858,106159] 0 2024-04-20T10:54:53.495 INFO:tasks.workunit.client.0.smithi090.stdout:3/769: creat d7/d43/db7/ff7 x:0 0 0 2024-04-20T10:54:53.495 INFO:tasks.workunit.client.0.smithi090.stdout:3/770: stat d7/d35/fc7 0 2024-04-20T10:54:53.495 INFO:tasks.workunit.client.0.smithi090.stdout:3/771: write d7/d26/f3c [254522,117506] 0 2024-04-20T10:54:53.495 INFO:tasks.workunit.client.0.smithi090.stdout:3/772: dread - d7/d43/fcd zero size 2024-04-20T10:54:53.495 INFO:tasks.workunit.client.0.smithi090.stdout:3/773: chown d7/fa 1654193 1 2024-04-20T10:54:53.495 INFO:tasks.workunit.client.0.smithi090.stdout:3/774: write d7/d26/d78/fb8 [43551,61256] 0 2024-04-20T10:54:53.495 INFO:tasks.workunit.client.0.smithi090.stdout:4/773: dwrite d7/d9/d47/df9/d70/da1/dcd/d42/f64 [0,4194304] 0 2024-04-20T10:54:53.498 INFO:tasks.workunit.client.0.smithi090.stdout:0/943: dwrite d14/d41/fd0 [0,4194304] 0 2024-04-20T10:54:53.498 INFO:tasks.workunit.client.0.smithi090.stdout:6/675: dread d1/f4c [0,4194304] 0 2024-04-20T10:54:53.499 INFO:tasks.workunit.client.0.smithi090.stdout:3/775: creat d7/d15/d47/d56/ff8 x:0 0 0 2024-04-20T10:54:53.502 INFO:tasks.workunit.client.0.smithi090.stdout:0/944: symlink d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/l12f 0 2024-04-20T10:54:53.503 INFO:tasks.workunit.client.0.smithi090.stdout:6/676: getdents d1/d19/d36 0 2024-04-20T10:54:53.504 INFO:tasks.workunit.client.0.smithi090.stdout:3/776: truncate d7/df/f27 176392 0 2024-04-20T10:54:53.506 INFO:tasks.workunit.client.0.smithi090.stdout:6/677: mkdir d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0 0 2024-04-20T10:54:53.506 INFO:tasks.workunit.client.0.smithi090.stdout:4/774: write d7/d9/fcf [1449940,123918] 0 2024-04-20T10:54:53.506 INFO:tasks.workunit.client.0.smithi090.stdout:4/775: write d7/d9/d47/fbc [843891,78678] 0 2024-04-20T10:54:53.507 INFO:tasks.workunit.client.0.smithi090.stdout:3/777: rmdir d7/d15/d47 39 2024-04-20T10:54:53.508 INFO:tasks.workunit.client.0.smithi090.stdout:3/778: write d7/d15/d47/d56/f54 [351166,82099] 0 2024-04-20T10:54:53.512 INFO:tasks.workunit.client.0.smithi090.stdout:2/915: rename d11/d1f to d11/d1a/d2b/df0/d131 0 2024-04-20T10:54:53.513 INFO:tasks.workunit.client.0.smithi090.stdout:3/779: getdents d7/df/dd1/dd3/d88 0 2024-04-20T10:54:53.515 INFO:tasks.workunit.client.0.smithi090.stdout:1/974: dwrite d8/d1a/d1d/d7a/d9a/f133 [0,4194304] 0 2024-04-20T10:54:53.516 INFO:tasks.workunit.client.0.smithi090.stdout:2/916: mkdir d11/d97/d132 0 2024-04-20T10:54:53.517 INFO:tasks.workunit.client.0.smithi090.stdout:1/975: read d8/d1a/d1d/d67/dff/d3f/f7e [795161,17966] 0 2024-04-20T10:54:53.517 INFO:tasks.workunit.client.0.smithi090.stdout:1/976: chown d8/d1a/d1d/d67/dff/d4a/d5a/db2/d125/d130 387323177 1 2024-04-20T10:54:53.517 INFO:tasks.workunit.client.0.smithi090.stdout:3/780: symlink d7/d43/lf9 0 2024-04-20T10:54:53.517 INFO:tasks.workunit.client.0.smithi090.stdout:3/781: fsync d7/d43/fcd 0 2024-04-20T10:54:53.519 INFO:tasks.workunit.client.0.smithi090.stdout:2/917: creat d11/d1a/d10b/f133 x:0 0 0 2024-04-20T10:54:53.519 INFO:tasks.workunit.client.0.smithi090.stdout:2/918: fsync d11/f7a 0 2024-04-20T10:54:53.519 INFO:tasks.workunit.client.0.smithi090.stdout:2/919: readlink d11/d1a/d37/d85/l12e 0 2024-04-20T10:54:53.521 INFO:tasks.workunit.client.0.smithi090.stdout:1/977: rmdir d8/d1a/d1d/d67/dff/d4a/d93 39 2024-04-20T10:54:53.521 INFO:tasks.workunit.client.0.smithi090.stdout:1/978: chown d8/d1a/d4d/f11e 318317 1 2024-04-20T10:54:53.521 INFO:tasks.workunit.client.0.smithi090.stdout:1/979: write d8/d1a/d1d/d67/dff/d4a/d93/fa4 [995874,111811] 0 2024-04-20T10:54:53.522 INFO:tasks.workunit.client.0.smithi090.stdout:2/920: mkdir d11/d1a/d4a/d55/d67/d134 0 2024-04-20T10:54:53.522 INFO:tasks.workunit.client.0.smithi090.stdout:2/921: readlink d11/db0/lb3 0 2024-04-20T10:54:53.522 INFO:tasks.workunit.client.0.smithi090.stdout:2/922: dread - d11/d1a/d2b/df0/d131/d2e/d6e/dc7/f123 zero size 2024-04-20T10:54:53.536 INFO:tasks.workunit.client.0.smithi090.stdout:0/945: dwrite d14/f5f [0,4194304] 0 2024-04-20T10:54:53.537 INFO:tasks.workunit.client.0.smithi090.stdout:1/980: symlink d8/d1a/d4d/da5/l138 0 2024-04-20T10:54:53.539 INFO:tasks.workunit.client.0.smithi090.stdout:1/981: unlink d8/d1a/d1d/d67/dff/d4a/d5a/db2/fef 0 2024-04-20T10:54:53.545 INFO:tasks.workunit.client.0.smithi090.stdout:8/819: dwrite d0/f9c [4194304,4194304] 0 2024-04-20T10:54:53.548 INFO:tasks.workunit.client.0.smithi090.stdout:3/782: dwrite d7/d15/d47/d56/fb9 [0,4194304] 0 2024-04-20T10:54:53.548 INFO:tasks.workunit.client.0.smithi090.stdout:3/783: fsync d7/d35/f4b 0 2024-04-20T10:54:53.548 INFO:tasks.workunit.client.0.smithi090.stdout:3/784: dread - d7/d26/fc6 zero size 2024-04-20T10:54:53.548 INFO:tasks.workunit.client.0.smithi090.stdout:4/776: dwrite d7/d9/d17/f90 [0,4194304] 0 2024-04-20T10:54:53.548 INFO:tasks.workunit.client.0.smithi090.stdout:2/923: dwrite d11/d97/f100 [0,4194304] 0 2024-04-20T10:54:53.549 INFO:tasks.workunit.client.0.smithi090.stdout:6/678: dwrite d1/d4/f7e [0,4194304] 0 2024-04-20T10:54:53.549 INFO:tasks.workunit.client.0.smithi090.stdout:1/982: write d8/d1a/d1d/d67/dff/d4a/fa6 [2466740,5103] 0 2024-04-20T10:54:53.549 INFO:tasks.workunit.client.0.smithi090.stdout:8/820: rmdir d0/d3a/d9f/d52/dfa 0 2024-04-20T10:54:53.550 INFO:tasks.workunit.client.0.smithi090.stdout:8/821: chown d0/d11/l2c 3439736 1 2024-04-20T10:54:53.550 INFO:tasks.workunit.client.0.smithi090.stdout:8/822: stat d0/d3a/d4a/f98 0 2024-04-20T10:54:53.552 INFO:tasks.workunit.client.0.smithi090.stdout:8/823: write d0/d3a/f8d [169647,99745] 0 2024-04-20T10:54:53.554 INFO:tasks.workunit.client.0.smithi090.stdout:3/785: rename d7/d15/d2a/d8d/cb6 to d7/d15/d2a/d30/d48/cfa 0 2024-04-20T10:54:53.554 INFO:tasks.workunit.client.0.smithi090.stdout:3/786: truncate d7/d43/f75 5132604 0 2024-04-20T10:54:53.554 INFO:tasks.workunit.client.0.smithi090.stdout:3/787: write d7/f71 [1189558,115664] 0 2024-04-20T10:54:53.555 INFO:tasks.workunit.client.0.smithi090.stdout:4/777: dread d7/d9/f4a [0,4194304] 0 2024-04-20T10:54:53.558 INFO:tasks.workunit.client.0.smithi090.stdout:2/924: getdents d11/d1a/d37/d85/d87 0 2024-04-20T10:54:53.562 INFO:tasks.workunit.client.0.smithi090.stdout:6/679: truncate d1/d19/d36/d28/f2a 3029348 0 2024-04-20T10:54:53.562 INFO:tasks.workunit.client.0.smithi090.stdout:6/680: dread - d1/d19/d36/d1e/fc9 zero size 2024-04-20T10:54:53.565 INFO:tasks.workunit.client.0.smithi090.stdout:1/983: symlink d8/d1a/d1d/d67/dff/d4a/d5a/d105/l139 0 2024-04-20T10:54:53.566 INFO:tasks.workunit.client.0.smithi090.stdout:1/984: getdents d8/d1a/d1d/d67/dff/d8f 0 2024-04-20T10:54:53.566 INFO:tasks.workunit.client.0.smithi090.stdout:8/824: unlink d0/d2d/d49/d67/f69 0 2024-04-20T10:54:53.567 INFO:tasks.workunit.client.0.smithi090.stdout:8/825: write d0/d99/fa3 [1013745,6953] 0 2024-04-20T10:54:53.567 INFO:tasks.workunit.client.0.smithi090.stdout:3/788: dread d7/d15/d2a/f49 [0,4194304] 0 2024-04-20T10:54:53.568 INFO:tasks.workunit.client.0.smithi090.stdout:4/778: creat d7/d9/d47/df9/d70/da5/ffa x:0 0 0 2024-04-20T10:54:53.568 INFO:tasks.workunit.client.0.smithi090.stdout:4/779: chown d7/d9/d47/df9/d70/da1/dcd/d3d/fb2 139 1 2024-04-20T10:54:53.570 INFO:tasks.workunit.client.0.smithi090.stdout:1/985: mknod d8/d1a/d1d/d67/dff/d4a/d5a/db2/d125/c13a 0 2024-04-20T10:54:53.571 INFO:tasks.workunit.client.0.smithi090.stdout:3/789: symlink d7/d35/da8/ded/lfb 0 2024-04-20T10:54:53.573 INFO:tasks.workunit.client.0.smithi090.stdout:4/780: getdents d7/d9 0 2024-04-20T10:54:53.573 INFO:tasks.workunit.client.0.smithi090.stdout:4/781: write d7/d9/f10 [3584385,49397] 0 2024-04-20T10:54:53.577 INFO:tasks.workunit.client.0.smithi090.stdout:3/790: unlink d7/d15/d47/l62 0 2024-04-20T10:54:53.586 INFO:tasks.workunit.client.0.smithi090.stdout:2/925: dwrite d11/d1a/d4a/d55/d67/fb4 [0,4194304] 0 2024-04-20T10:54:53.586 INFO:tasks.workunit.client.0.smithi090.stdout:1/986: dread d8/d1a/d1d/d7a/d9a/f133 [0,4194304] 0 2024-04-20T10:54:53.589 INFO:tasks.workunit.client.0.smithi090.stdout:2/926: creat d11/d1a/d4a/d55/d67/d120/f135 x:0 0 0 2024-04-20T10:54:53.589 INFO:tasks.workunit.client.0.smithi090.stdout:2/927: chown d11/d1a/d4a/d55/da1/cf7 3919 1 2024-04-20T10:54:53.589 INFO:tasks.workunit.client.0.smithi090.stdout:2/928: write d11/d1a/d4a/d80/ff9 [944512,89670] 0 2024-04-20T10:54:53.591 INFO:tasks.workunit.client.0.smithi090.stdout:6/681: dread d1/d19/d36/d28/f2a [0,4194304] 0 2024-04-20T10:54:53.591 INFO:tasks.workunit.client.0.smithi090.stdout:0/946: dwrite d14/d19/d2b/d61/da0/db1/dbb/fd1 [0,4194304] 0 2024-04-20T10:54:53.599 INFO:tasks.workunit.client.0.smithi090.stdout:8/826: dwrite d0/d2d/dd4/fe6 [0,4194304] 0 2024-04-20T10:54:53.600 INFO:tasks.workunit.client.0.smithi090.stdout:4/782: dwrite d7/f21 [4194304,4194304] 0 2024-04-20T10:54:53.607 INFO:tasks.workunit.client.0.smithi090.stdout:0/947: dwrite d14/d19/d2b/d61/da0/db1/f106 [0,4194304] 0 2024-04-20T10:54:53.607 INFO:tasks.workunit.client.0.smithi090.stdout:0/948: stat d14/d41/f7d 0 2024-04-20T10:54:53.607 INFO:tasks.workunit.client.0.smithi090.stdout:0/949: chown d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/d3b/l8d 6847102 1 2024-04-20T10:54:53.607 INFO:tasks.workunit.client.0.smithi090.stdout:0/950: truncate d14/d19/d2b/d61/f6f 437805 0 2024-04-20T10:54:53.607 INFO:tasks.workunit.client.0.smithi090.stdout:0/951: fdatasync d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/fcd 0 2024-04-20T10:54:53.846 INFO:tasks.workunit.client.0.smithi090.stdout:1/987: rmdir d8/d1a/d4d 39 2024-04-20T10:54:53.847 INFO:tasks.workunit.client.0.smithi090.stdout:2/929: creat d11/d1a/d10b/f136 x:0 0 0 2024-04-20T10:54:53.847 INFO:tasks.workunit.client.0.smithi090.stdout:2/930: rename d11 to d11/d1a/d2b/df0/d131/d2e/d10c/d137 22 2024-04-20T10:54:53.847 INFO:tasks.workunit.client.0.smithi090.stdout:6/682: mkdir d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd/de1 0 2024-04-20T10:54:53.851 INFO:tasks.workunit.client.0.smithi090.stdout:8/827: creat d0/d2d/d44/dd9/f10b x:0 0 0 2024-04-20T10:54:53.851 INFO:tasks.workunit.client.0.smithi090.stdout:8/828: stat d0/d3a/f46 0 2024-04-20T10:54:53.851 INFO:tasks.workunit.client.0.smithi090.stdout:4/783: mkdir d7/d9/d47/df9/d70/da1/dfb 0 2024-04-20T10:54:53.857 INFO:tasks.workunit.client.0.smithi090.stdout:0/952: creat d14/d19/d2b/d52/dab/ddc/de4/d5b/dea/f130 x:0 0 0 2024-04-20T10:54:53.858 INFO:tasks.workunit.client.0.smithi090.stdout:1/988: stat d8/d1a/d1d/c1e 0 2024-04-20T10:54:53.859 INFO:tasks.workunit.client.0.smithi090.stdout:1/989: dread - d8/d1a/d1d/d67/dff/d4a/d5a/f107 zero size 2024-04-20T10:54:53.859 INFO:tasks.workunit.client.0.smithi090.stdout:1/990: dread - d8/d1a/d1d/d67/dff/d4a/d93/d5d/fee zero size 2024-04-20T10:54:53.859 INFO:tasks.workunit.client.0.smithi090.stdout:6/683: mkdir d1/d9a/de2 0 2024-04-20T10:54:53.860 INFO:tasks.workunit.client.0.smithi090.stdout:8/829: creat d0/d11/d22/d53/d8e/f10c x:0 0 0 2024-04-20T10:54:53.860 INFO:tasks.workunit.client.0.smithi090.stdout:8/830: truncate d0/d3a/d9f/d52/f9a 5411801 0 2024-04-20T10:54:53.861 INFO:tasks.workunit.client.0.smithi090.stdout:4/784: mkdir d7/d9/d47/df9/d70/da1/dcd/d42/dfc 0 2024-04-20T10:54:53.862 INFO:tasks.workunit.client.0.smithi090.stdout:0/953: mknod d14/d19/d2b/d52/dab/ddc/de4/d5b/dea/c131 0 2024-04-20T10:54:53.864 INFO:tasks.workunit.client.0.smithi090.stdout:1/991: mkdir d8/d1a/d1d/d67/dff/d6e/dde/d10b/d13b 0 2024-04-20T10:54:53.864 INFO:tasks.workunit.client.0.smithi090.stdout:8/831: rmdir d0/d3a/d9f/db9/dbe 39 2024-04-20T10:54:53.866 INFO:tasks.workunit.client.0.smithi090.stdout:1/992: creat d8/d1a/d1d/d67/dff/d6e/f13c x:0 0 0 2024-04-20T10:54:53.866 INFO:tasks.workunit.client.0.smithi090.stdout:4/785: dread d7/d9/d47/df9/d70/da1/dcd/d3d/f75 [0,4194304] 0 2024-04-20T10:54:53.867 INFO:tasks.workunit.client.0.smithi090.stdout:8/832: link d0/d26/da7/da9/cb2 d0/d26/c10d 0 2024-04-20T10:54:53.867 INFO:tasks.workunit.client.0.smithi090.stdout:8/833: chown d0/d3a/d9f/d52/ff1 3926 1 2024-04-20T10:54:53.867 INFO:tasks.workunit.client.0.smithi090.stdout:8/834: chown d0/d26/da7/df5/dcf/dd5/df9 434640 1 2024-04-20T10:54:53.868 INFO:tasks.workunit.client.0.smithi090.stdout:1/993: write d8/d1a/d1d/d67/dff/d4a/d93/fcf [230295,110884] 0 2024-04-20T10:54:53.869 INFO:tasks.workunit.client.0.smithi090.stdout:4/786: mkdir d7/d9/d47/df9/d70/da1/dfb/dfd 0 2024-04-20T10:54:53.870 INFO:tasks.workunit.client.0.smithi090.stdout:8/835: creat d0/d3a/d4a/d81/f10e x:0 0 0 2024-04-20T10:54:53.870 INFO:tasks.workunit.client.0.smithi090.stdout:8/836: write d0/d2d/d44/fc8 [990791,24142] 0 2024-04-20T10:54:53.871 INFO:tasks.workunit.client.0.smithi090.stdout:1/994: creat d8/d1a/d1d/d67/dff/d4a/d7b/f13d x:0 0 0 2024-04-20T10:54:53.872 INFO:tasks.workunit.client.0.smithi090.stdout:4/787: mkdir d7/d9/d47/df9/d70/da1/dcd/d42/dfe 0 2024-04-20T10:54:53.873 INFO:tasks.workunit.client.0.smithi090.stdout:4/788: readlink d7/l15 0 2024-04-20T10:54:53.873 INFO:tasks.workunit.client.0.smithi090.stdout:6/684: write d1/d4/d26/d11/f17 [1962520,106010] 0 2024-04-20T10:54:53.874 INFO:tasks.workunit.client.0.smithi090.stdout:0/954: dread d14/d19/d2b/d52/dab/ddc/de4/d5b/f8f [0,4194304] 0 2024-04-20T10:54:53.874 INFO:tasks.workunit.client.0.smithi090.stdout:0/955: dread - d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/fa8 zero size 2024-04-20T10:54:53.875 INFO:tasks.workunit.client.0.smithi090.stdout:6/685: mkdir d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/de3 0 2024-04-20T10:54:53.875 INFO:tasks.workunit.client.0.smithi090.stdout:6/686: fsync d1/d19/d36/d28/f34 0 2024-04-20T10:54:53.875 INFO:tasks.workunit.client.0.smithi090.stdout:7/774: sync 2024-04-20T10:54:53.876 INFO:tasks.workunit.client.0.smithi090.stdout:6/687: dread d1/d4/d26/d11/d35/d80/f9c [0,4194304] 0 2024-04-20T10:54:53.876 INFO:tasks.workunit.client.0.smithi090.stdout:6/688: readlink d1/d19/d25/lca 0 2024-04-20T10:54:53.878 INFO:tasks.workunit.client.0.smithi090.stdout:0/956: creat d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/f132 x:0 0 0 2024-04-20T10:54:53.878 INFO:tasks.workunit.client.0.smithi090.stdout:3/791: sync 2024-04-20T10:54:53.878 INFO:tasks.workunit.client.0.smithi090.stdout:3/792: write d7/f19 [190763,3388] 0 2024-04-20T10:54:53.878 INFO:tasks.workunit.client.0.smithi090.stdout:7/775: truncate d11/d13/d5b/db8/dbf/da9/fbc 1420250 0 2024-04-20T10:54:53.881 INFO:tasks.workunit.client.0.smithi090.stdout:4/789: dread d7/d9/f36 [0,4194304] 0 2024-04-20T10:54:53.881 INFO:tasks.workunit.client.0.smithi090.stdout:7/776: dread d11/d13/d5d/d65/f8b [0,4194304] 0 2024-04-20T10:54:53.881 INFO:tasks.workunit.client.0.smithi090.stdout:7/777: fdatasync d11/d13/d22/d27/fca 0 2024-04-20T10:54:53.881 INFO:tasks.workunit.client.0.smithi090.stdout:7/778: write f4 [967640,113117] 0 2024-04-20T10:54:53.881 INFO:tasks.workunit.client.0.smithi090.stdout:0/957: creat d14/d19/d2b/d8e/d43/de9/f133 x:0 0 0 2024-04-20T10:54:53.883 INFO:tasks.workunit.client.0.smithi090.stdout:3/793: creat d7/d43/db7/daf/ffc x:0 0 0 2024-04-20T10:54:53.885 INFO:tasks.workunit.client.0.smithi090.stdout:7/779: truncate d11/d13/d22/d24/f2a 2239631 0 2024-04-20T10:54:53.886 INFO:tasks.workunit.client.0.smithi090.stdout:3/794: truncate d7/d11/f73 4166007 0 2024-04-20T10:54:53.889 INFO:tasks.workunit.client.0.smithi090.stdout:8/837: write d0/d3a/f6e [1155006,91426] 0 2024-04-20T10:54:53.889 INFO:tasks.workunit.client.0.smithi090.stdout:8/838: write d0/d11/d22/d53/d8e/d92/ffd [2696762,22466] 0 2024-04-20T10:54:53.894 INFO:tasks.workunit.client.0.smithi090.stdout:6/689: write d1/d4/d26/d11/d35/fa6 [37428,113585] 0 2024-04-20T10:54:53.894 INFO:tasks.workunit.client.0.smithi090.stdout:7/780: write d11/d1a/d3b/d79/f8d [3110906,83906] 0 2024-04-20T10:54:53.896 INFO:tasks.workunit.client.0.smithi090.stdout:6/690: unlink d1/d19/d36/d28/f73 0 2024-04-20T10:54:53.899 INFO:tasks.workunit.client.0.smithi090.stdout:6/691: symlink d1/d4/d26/d11/d4a/db3/le4 0 2024-04-20T10:54:53.899 INFO:tasks.workunit.client.0.smithi090.stdout:7/781: write d11/d13/d22/d27/f50 [827582,10894] 0 2024-04-20T10:54:53.901 INFO:tasks.workunit.client.0.smithi090.stdout:6/692: symlink d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9/dd0/le5 0 2024-04-20T10:54:53.901 INFO:tasks.workunit.client.0.smithi090.stdout:6/693: chown d1/d4/d26/d11/d4a/ca4 29997 1 2024-04-20T10:54:53.901 INFO:tasks.workunit.client.0.smithi090.stdout:6/694: write d1/d19/d36/f91 [2731269,93379] 0 2024-04-20T10:54:53.901 INFO:tasks.workunit.client.0.smithi090.stdout:6/695: chown d1/d10/c98 24010022 1 2024-04-20T10:54:53.902 INFO:tasks.workunit.client.0.smithi090.stdout:7/782: symlink d11/d13/d33/lf8 0 2024-04-20T10:54:53.903 INFO:tasks.workunit.client.0.smithi090.stdout:6/696: creat d1/d4/d26/d11/d4a/d6b/fe6 x:0 0 0 2024-04-20T10:54:53.903 INFO:tasks.workunit.client.0.smithi090.stdout:6/697: chown d1/d9a/fcc 808575727 1 2024-04-20T10:54:53.904 INFO:tasks.workunit.client.0.smithi090.stdout:7/783: creat d11/d13/d22/d82/ff9 x:0 0 0 2024-04-20T10:54:53.904 INFO:tasks.workunit.client.0.smithi090.stdout:8/839: dread d0/d3a/d4a/f9d [0,4194304] 0 2024-04-20T10:54:53.905 INFO:tasks.workunit.client.0.smithi090.stdout:7/784: write d11/d13/f8c [789424,24785] 0 2024-04-20T10:54:53.905 INFO:tasks.workunit.client.0.smithi090.stdout:8/840: write d0/d3a/ff8 [296995,5483] 0 2024-04-20T10:54:53.905 INFO:tasks.workunit.client.0.smithi090.stdout:7/785: fdatasync d11/d13/d5b/db8/dbf/da9/fbc 0 2024-04-20T10:54:53.906 INFO:tasks.workunit.client.0.smithi090.stdout:7/786: rename d11/d1a/d3f/fba to d11/d13/d22/df3/ffa 0 2024-04-20T10:54:53.906 INFO:tasks.workunit.client.0.smithi090.stdout:7/787: dread - d11/d13/d33/d44/d89/d98/fed zero size 2024-04-20T10:54:53.906 INFO:tasks.workunit.client.0.smithi090.stdout:7/788: creat d11/d13/d22/d27/dc2/ffb x:0 0 0 2024-04-20T10:54:53.907 INFO:tasks.workunit.client.0.smithi090.stdout:7/789: symlink d11/d13/d5d/db0/dd1/lfc 0 2024-04-20T10:54:53.907 INFO:tasks.workunit.client.0.smithi090.stdout:7/790: write d11/d13/d22/d27/dc2/ffb [93019,22659] 0 2024-04-20T10:54:53.908 INFO:tasks.workunit.client.0.smithi090.stdout:7/791: chown d11/d61 14 1 2024-04-20T10:54:53.909 INFO:tasks.workunit.client.0.smithi090.stdout:4/790: dwrite d7/d9/d17/f37 [4194304,4194304] 0 2024-04-20T10:54:53.909 INFO:tasks.workunit.client.0.smithi090.stdout:3/795: dwrite d7/df/dd1/dd3/f61 [0,4194304] 0 2024-04-20T10:54:53.910 INFO:tasks.workunit.client.0.smithi090.stdout:4/791: rename d7/d9/d17/l4b to d7/d9/d47/df9/d70/da1/dcd/lff 0 2024-04-20T10:54:53.911 INFO:tasks.workunit.client.0.smithi090.stdout:8/841: dread d0/d3a/d9f/d52/f82 [0,4194304] 0 2024-04-20T10:54:53.912 INFO:tasks.workunit.client.0.smithi090.stdout:3/796: symlink d7/d15/d2a/d8d/lfd 0 2024-04-20T10:54:53.912 INFO:tasks.workunit.client.0.smithi090.stdout:3/797: write d7/d26/f3c [871181,127190] 0 2024-04-20T10:54:53.912 INFO:tasks.workunit.client.0.smithi090.stdout:0/958: dwrite d14/d39/da6/fb3 [0,4194304] 0 2024-04-20T10:54:53.914 INFO:tasks.workunit.client.0.smithi090.stdout:3/798: rmdir d7/d43/dd9 39 2024-04-20T10:54:53.917 INFO:tasks.workunit.client.0.smithi090.stdout:0/959: mkdir d14/d19/d9e/d11f/d134 0 2024-04-20T10:54:53.920 INFO:tasks.workunit.client.0.smithi090.stdout:7/792: dread d11/d13/d22/d24/f5e [0,4194304] 0 2024-04-20T10:54:53.920 INFO:tasks.workunit.client.0.smithi090.stdout:7/793: fsync d11/fb1 0 2024-04-20T10:54:53.923 INFO:tasks.workunit.client.0.smithi090.stdout:0/960: mkdir d14/d19/d2b/d8e/d43/d135 0 2024-04-20T10:54:53.923 INFO:tasks.workunit.client.0.smithi090.stdout:0/961: chown d14/d19/d2b/d61/da0/db1/f106 53 1 2024-04-20T10:54:53.925 INFO:tasks.workunit.client.0.smithi090.stdout:6/698: dwrite d1/d19/f59 [0,4194304] 0 2024-04-20T10:54:53.925 INFO:tasks.workunit.client.0.smithi090.stdout:4/792: getdents d7/d9/d47/df9/d70/da1/dcd 0 2024-04-20T10:54:53.925 INFO:tasks.workunit.client.0.smithi090.stdout:4/793: read - d7/d9/d47/df9/d70/f81 zero size 2024-04-20T10:54:53.926 INFO:tasks.workunit.client.0.smithi090.stdout:4/794: read d7/d9/d17/f79 [480936,52402] 0 2024-04-20T10:54:53.928 INFO:tasks.workunit.client.0.smithi090.stdout:7/794: truncate d11/d13/d5d/d65/f8b 202463 0 2024-04-20T10:54:53.929 INFO:tasks.workunit.client.0.smithi090.stdout:7/795: readlink d11/d61/la5 0 2024-04-20T10:54:53.929 INFO:tasks.workunit.client.0.smithi090.stdout:0/962: mknod d14/d19/d2b/d52/dab/ddc/de4/c136 0 2024-04-20T10:54:53.933 INFO:tasks.workunit.client.0.smithi090.stdout:4/795: rename d7/f26 to d7/d9/d47/df9/dd4/f100 0 2024-04-20T10:54:53.935 INFO:tasks.workunit.client.0.smithi090.stdout:7/796: creat d11/d13/d22/d27/ffd x:0 0 0 2024-04-20T10:54:53.936 INFO:tasks.workunit.client.0.smithi090.stdout:0/963: creat d14/d19/dca/d126/f137 x:0 0 0 2024-04-20T10:54:53.937 INFO:tasks.workunit.client.0.smithi090.stdout:0/964: stat d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/fa2 0 2024-04-20T10:54:53.937 INFO:tasks.workunit.client.0.smithi090.stdout:0/965: write d14/d19/d2b/d8e/d43/d5c/f81 [121953,25129] 0 2024-04-20T10:54:53.939 INFO:tasks.workunit.client.0.smithi090.stdout:7/797: creat d11/dd2/dec/ffe x:0 0 0 2024-04-20T10:54:53.941 INFO:tasks.workunit.client.0.smithi090.stdout:0/966: mknod d14/d19/d2b/d8e/d43/d5c/d70/c138 0 2024-04-20T10:54:53.941 INFO:tasks.workunit.client.0.smithi090.stdout:0/967: chown d14/d19/d2b/d52/dab/ddc/de4/d5b/d8a 0 1 2024-04-20T10:54:53.941 INFO:tasks.workunit.client.0.smithi090.stdout:0/968: write d14/d41/f6e [5374010,17681] 0 2024-04-20T10:54:53.942 INFO:tasks.workunit.client.0.smithi090.stdout:0/969: readlink d14/d19/d2b/d8e/d43/d5c/d70/lb7 0 2024-04-20T10:54:53.942 INFO:tasks.workunit.client.0.smithi090.stdout:4/796: dread d7/d9/d47/df9/d70/da1/dcd/d3d/f9f [0,4194304] 0 2024-04-20T10:54:53.943 INFO:tasks.workunit.client.0.smithi090.stdout:4/797: link d7/c9b d7/d9/d47/d8d/dda/db5/c101 0 2024-04-20T10:54:53.943 INFO:tasks.workunit.client.0.smithi090.stdout:7/798: write d11/d13/d23/f2b [4720301,79065] 0 2024-04-20T10:54:53.944 INFO:tasks.workunit.client.0.smithi090.stdout:4/798: mknod d7/d9/d17/da0/c102 0 2024-04-20T10:54:53.946 INFO:tasks.workunit.client.0.smithi090.stdout:7/799: mknod d11/cff 0 2024-04-20T10:54:53.948 INFO:tasks.workunit.client.0.smithi090.stdout:4/799: mkdir d7/d9/d47/df9/d103 0 2024-04-20T10:54:53.950 INFO:tasks.workunit.client.0.smithi090.stdout:3/799: dwrite d7/d43/f75 [0,4194304] 0 2024-04-20T10:54:53.951 INFO:tasks.workunit.client.0.smithi090.stdout:3/800: mknod d7/ddd/cfe 0 2024-04-20T10:54:53.951 INFO:tasks.workunit.client.0.smithi090.stdout:3/801: fsync d7/d15/d47/d56/fac 0 2024-04-20T10:54:53.953 INFO:tasks.workunit.client.0.smithi090.stdout:6/699: dwrite d1/d4/f88 [0,4194304] 0 2024-04-20T10:54:53.955 INFO:tasks.workunit.client.0.smithi090.stdout:6/700: unlink d1/d19/d36/c6c 0 2024-04-20T10:54:53.956 INFO:tasks.workunit.client.0.smithi090.stdout:6/701: chown d1/d4/d26/d11/d4a/d70/f72 445 1 2024-04-20T10:54:53.956 INFO:tasks.workunit.client.0.smithi090.stdout:6/702: stat d1/d4/d26/d11/l8f 0 2024-04-20T10:54:53.966 INFO:tasks.workunit.client.0.smithi090.stdout:4/800: dwrite d7/d9/d17/d56/f84 [0,4194304] 0 2024-04-20T10:54:53.969 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:53.972 INFO:tasks.workunit.client.0.smithi090.stdout:0/970: dwrite d14/d19/d9e/fe2 [4194304,4194304] 0 2024-04-20T10:54:53.972 INFO:tasks.workunit.client.0.smithi090.stdout:0/971: read f11 [1135140,125399] 0 2024-04-20T10:54:53.972 INFO:tasks.workunit.client.0.smithi090.stdout:0/972: readlink d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/l11a 0 2024-04-20T10:54:53.972 INFO:tasks.workunit.client.0.smithi090.stdout:0/973: readlink d14/d19/lc8 0 2024-04-20T10:54:53.972 INFO:tasks.workunit.client.0.smithi090.stdout:0/974: truncate d14/d19/d2b/d61/f6f 563723 0 2024-04-20T10:54:53.972 INFO:tasks.workunit.client.0.smithi090.stdout:7/800: dwrite d11/d13/d22/d24/fc1 [0,4194304] 0 2024-04-20T10:54:53.973 INFO:tasks.workunit.client.0.smithi090.stdout:0/975: creat d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/f139 x:0 0 0 2024-04-20T10:54:53.974 INFO:tasks.workunit.client.0.smithi090.stdout:6/703: dwrite d1/d9a/fcc [0,4194304] 0 2024-04-20T10:54:53.974 INFO:tasks.workunit.client.0.smithi090.stdout:6/704: chown d1/d4/d26/d11/d4a/d6b/d6f 3716 1 2024-04-20T10:54:53.974 INFO:tasks.workunit.client.0.smithi090.stdout:6/705: readlink d1/d19/d36/d1e/d1f/d3f/d54/ld9 0 2024-04-20T10:54:53.974 INFO:tasks.workunit.client.0.smithi090.stdout:7/801: symlink d11/d13/d22/d24/d35/l100 0 2024-04-20T10:54:53.976 INFO:tasks.workunit.client.0.smithi090.stdout:6/706: symlink d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9/le7 0 2024-04-20T10:54:53.981 INFO:tasks.workunit.client.0.smithi090.stdout:0/976: read d14/d19/d2b/d8e/fdb [4128583,80061] 0 2024-04-20T10:54:53.982 INFO:tasks.workunit.client.0.smithi090.stdout:0/977: dread d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/f38 [0,4194304] 0 2024-04-20T10:54:53.987 INFO:tasks.workunit.client.0.smithi090.stdout:6/707: write d1/d4/d26/d11/d35/f5f [734697,50269] 0 2024-04-20T10:54:53.987 INFO:tasks.workunit.client.0.smithi090.stdout:6/708: chown d1/d19/d36/d1e/cb6 51906 1 2024-04-20T10:54:53.988 INFO:tasks.workunit.client.0.smithi090.stdout:6/709: mknod d1/d4/d26/ce8 0 2024-04-20T10:54:53.989 INFO:tasks.workunit.client.0.smithi090.stdout:6/710: creat d1/d19/d36/d1e/d1f/d3f/d54/d9f/fe9 x:0 0 0 2024-04-20T10:54:53.990 INFO:tasks.workunit.client.0.smithi090.stdout:6/711: truncate d1/d4/d26/d11/f63 278547 0 2024-04-20T10:54:53.991 INFO:tasks.workunit.client.0.smithi090.stdout:6/712: write d1/d4/d26/d11/f17 [1850102,53744] 0 2024-04-20T10:54:53.992 INFO:tasks.workunit.client.0.smithi090.stdout:0/978: dread d14/d19/fe8 [4194304,4194304] 0 2024-04-20T10:54:53.997 INFO:tasks.workunit.client.0.smithi090.stdout:0/979: dread fd [0,4194304] 0 2024-04-20T10:54:53.997 INFO:tasks.workunit.client.0.smithi090.stdout:0/980: write d14/d19/d2b/d8e/d43/d6d/fe3 [551244,16239] 0 2024-04-20T10:54:53.997 INFO:tasks.workunit.client.0.smithi090.stdout:0/981: write d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/df8/f10e [91198,89427] 0 2024-04-20T10:54:54.009 INFO:tasks.workunit.client.0.smithi090.stdout:6/713: dwrite d1/d19/d36/d28/fae [0,4194304] 0 2024-04-20T10:54:54.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.072+0000 7fc2bb375640 1 Processor -- start 2024-04-20T10:54:54.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.072+0000 7fc2bb375640 1 -- start start 2024-04-20T10:54:54.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2bb375640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2b4073810 0x7fc2b4154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:54.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2bb375640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc2b4157710 0x7fc2b40c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:54.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2bb375640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2b40c40d0 con 0x7fc2b40ad0c0 2024-04-20T10:54:54.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2bb375640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b41569e0 con 0x7fc2b4073810 2024-04-20T10:54:54.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2bb375640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc2b4157280 con 0x7fc2b4157710 2024-04-20T10:54:54.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b9111640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2b4073810 0x7fc2b4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b9111640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2b4073810 0x7fc2b4154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36246/0 (socket says 172.21.15.90:36246) 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b9111640 1 -- 172.21.15.90:0/993182674 learned_addr learned my addr 172.21.15.90:0/993182674 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b8910640 1 --2- 172.21.15.90:0/993182674 >> v2:172.21.15.175:3300/0 conn(0x7fc2b4157710 0x7fc2b40c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b9111640 1 -- 172.21.15.90:0/993182674 >> v2:172.21.15.175:3300/0 conn(0x7fc2b4157710 msgr2=0x7fc2b40c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b9111640 1 --2- 172.21.15.90:0/993182674 >> v2:172.21.15.175:3300/0 conn(0x7fc2b4157710 0x7fc2b40c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b9111640 1 -- 172.21.15.90:0/993182674 >> v1:172.21.15.175:6789/0 conn(0x7fc2b40ad0c0 legacy=0x7fc2b40abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.073+0000 7fc2b9111640 1 -- 172.21.15.90:0/993182674 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b40c4370 con 0x7fc2b4073810 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.074+0000 7fc2b9111640 1 --2- 172.21.15.90:0/993182674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4073810 0x7fc2b4154000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40688d0 tx=0x7fc2a402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643c687ce2ef988c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.074+0000 7fc2abfff640 1 -- 172.21.15.90:0/993182674 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4035020 con 0x7fc2b4073810 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.074+0000 7fc2abfff640 1 -- 172.21.15.90:0/993182674 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2a4031870 con 0x7fc2b4073810 2024-04-20T10:54:54.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.074+0000 7fc2abfff640 1 -- 172.21.15.90:0/993182674 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2a4031c40 con 0x7fc2b4073810 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 -- 172.21.15.90:0/993182674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4073810 msgr2=0x7fc2b4154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 --2- 172.21.15.90:0/993182674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4073810 0x7fc2b4154000 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40688d0 tx=0x7fc2a402b910 comp rx=0 tx=0).stop 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 -- 172.21.15.90:0/993182674 shutdown_connections 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 --2- 172.21.15.90:0/993182674 >> v2:172.21.15.175:3300/0 conn(0x7fc2b4157710 0x7fc2b40c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 --2- 172.21.15.90:0/993182674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4073810 0x7fc2b4154000 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 -- 172.21.15.90:0/993182674 >> 172.21.15.90:0/993182674 conn(0x7fc2b40c8080 msgr2=0x7fc2b40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 -- 172.21.15.90:0/993182674 shutdown_connections 2024-04-20T10:54:54.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.075+0000 7fc2bb375640 1 -- 172.21.15.90:0/993182674 wait complete. 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.076+0000 7fc2bb375640 1 Processor -- start 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.076+0000 7fc2bb375640 1 -- start start 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2bb375640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b4073810 0x7fc2b414a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2bb375640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b40ad0c0 0x7fc2b41ec260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2bb375640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4157710 0x7fc2b41ec7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2bb375640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4073bf0 con 0x7fc2b4157710 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2bb375640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b4156f10 con 0x7fc2b40ad0c0 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2bb375640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc2b40ac2c0 con 0x7fc2b4073810 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4157710 0x7fc2b41ec7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9111640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b4073810 0x7fc2b414a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b8910640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b40ad0c0 0x7fc2b41ec260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4157710 0x7fc2b41ec7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36256/0 (socket says 172.21.15.90:36256) 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 -- 172.21.15.90:0/29785052 learned_addr learned my addr 172.21.15.90:0/29785052 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 -- 172.21.15.90:0/29785052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b4073810 msgr2=0x7fc2b414a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:54.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b4073810 0x7fc2b414a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 -- 172.21.15.90:0/29785052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b40ad0c0 msgr2=0x7fc2b41ec260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b40ad0c0 0x7fc2b41ec260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 -- 172.21.15.90:0/29785052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b414dab0 con 0x7fc2b4157710 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2b9912640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4157710 0x7fc2b41ec7a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c760 tx=0x7fc2ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2a9ffb640 1 -- 172.21.15.90:0/29785052 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac003b90 con 0x7fc2b4157710 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2a9ffb640 1 -- 172.21.15.90:0/29785052 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ac003d30 con 0x7fc2b4157710 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b414ce90 con 0x7fc2b4157710 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.077+0000 7fc2a9ffb640 1 -- 172.21.15.90:0/29785052 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ac00aa90 con 0x7fc2b4157710 2024-04-20T10:54:54.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.078+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b414d450 con 0x7fc2b4157710 2024-04-20T10:54:54.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.079+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b4076150 con 0x7fc2b4157710 2024-04-20T10:54:54.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.080+0000 7fc2a9ffb640 1 -- 172.21.15.90:0/29785052 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2ac00ac30 con 0x7fc2b4157710 2024-04-20T10:54:54.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.080+0000 7fc2a9ffb640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc29806c8f0 0x7fc29806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:54.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.080+0000 7fc2a9ffb640 1 -- 172.21.15.90:0/29785052 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7fc2ac08bd50 con 0x7fc2b4157710 2024-04-20T10:54:54.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.080+0000 7fc2b9111640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc29806c8f0 0x7fc29806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:54.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.081+0000 7fc2b9111640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc29806c8f0 0x7fc29806edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4036000 tx=0x7fc2a403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:54.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.085+0000 7fc2a9ffb640 1 -- 172.21.15.90:0/29785052 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc2ac08f030 con 0x7fc2b4157710 2024-04-20T10:54:54.099 INFO:tasks.workunit.client.0.smithi090.stdout:2/931: sync 2024-04-20T10:54:54.100 INFO:tasks.workunit.client.0.smithi090.stdout:2/932: mknod d11/d1a/d2b/df0/d131/d2e/d6e/dc7/de2/d111/c138 0 2024-04-20T10:54:54.101 INFO:tasks.workunit.client.0.smithi090.stdout:2/933: mkdir d11/d1a/d2b/df0/d131/d2e/dad/d139 0 2024-04-20T10:54:54.101 INFO:tasks.workunit.client.0.smithi090.stdout:2/934: chown d11/d1a/d4a/d80/f11d 63052731 1 2024-04-20T10:54:54.102 INFO:tasks.workunit.client.0.smithi090.stdout:2/935: creat d11/d1a/d2b/df0/d131/d2e/dcd/d105/f13a x:0 0 0 2024-04-20T10:54:54.102 INFO:tasks.workunit.client.0.smithi090.stdout:2/936: write d11/d1a/d37/d85/f99 [722515,67783] 0 2024-04-20T10:54:54.102 INFO:tasks.workunit.client.0.smithi090.stdout:2/937: getdents d11/d1a/d2b/da7 0 2024-04-20T10:54:54.102 INFO:tasks.workunit.client.0.smithi090.stdout:2/938: truncate d11/d1a/d37/f93 3081463 0 2024-04-20T10:54:54.103 INFO:tasks.workunit.client.0.smithi090.stdout:2/939: dread - d11/d1a/d2b/df0/d131/d2e/dad/d11f/f122 zero size 2024-04-20T10:54:54.103 INFO:tasks.workunit.client.0.smithi090.stdout:2/940: link d11/d1a/d4a/d55/da1/cf7 d11/d1a/d30/da6/c13b 0 2024-04-20T10:54:54.103 INFO:tasks.workunit.client.0.smithi090.stdout:2/941: truncate d11/d1a/d4a/d80/f11d 661074 0 2024-04-20T10:54:54.104 INFO:tasks.workunit.client.0.smithi090.stdout:2/942: getdents d11/d1a/d2b/dff 0 2024-04-20T10:54:54.111 INFO:tasks.workunit.client.0.smithi090.stdout:2/943: dread d11/d1a/d2b/df0/d131/d2e/d6e/dc7/fd3 [0,4194304] 0 2024-04-20T10:54:54.111 INFO:tasks.workunit.client.0.smithi090.stdout:2/944: stat d11/d1a/d30/d8d/fed 0 2024-04-20T10:54:54.112 INFO:tasks.workunit.client.0.smithi090.stdout:2/945: mknod d11/d1a/d4a/d55/d67/c13c 0 2024-04-20T10:54:54.117 INFO:tasks.workunit.client.0.smithi090.stdout:2/946: dread d11/d1a/d2b/df0/d131/d2e/f8e [0,4194304] 0 2024-04-20T10:54:54.117 INFO:tasks.workunit.client.0.smithi090.stdout:2/947: getdents d11/d1a/d2b/df0/d131/d2e/d12f 0 2024-04-20T10:54:54.118 INFO:tasks.workunit.client.0.smithi090.stdout:2/948: symlink d11/db0/l13d 0 2024-04-20T10:54:54.119 INFO:tasks.workunit.client.0.smithi090.stdout:2/949: symlink d11/l13e 0 2024-04-20T10:54:54.119 INFO:tasks.workunit.client.0.smithi090.stdout:2/950: write d11/d1a/d4a/d55/da1/fb7 [1392234,122697] 0 2024-04-20T10:54:54.119 INFO:tasks.workunit.client.0.smithi090.stdout:2/951: getdents d11/d1a/d2b/df0/d131/d2e/d6e 0 2024-04-20T10:54:54.120 INFO:tasks.workunit.client.0.smithi090.stdout:2/952: fdatasync d11/d1a/d4a/d55/d67/fd0 0 2024-04-20T10:54:54.135 INFO:tasks.workunit.client.0.smithi090.stdout:2/953: dwrite d11/d1a/d2b/df0/d131/f75 [4194304,4194304] 0 2024-04-20T10:54:54.137 INFO:tasks.workunit.client.0.smithi090.stdout:2/954: rename d11/d1a/d37/d85/f99 to d11/d1a/d30/f13f 0 2024-04-20T10:54:54.138 INFO:tasks.workunit.client.0.smithi090.stdout:2/955: mkdir d11/d1a/d2b/df0/d131/d2e/dcd/d105/d140 0 2024-04-20T10:54:54.139 INFO:tasks.workunit.client.0.smithi090.stdout:2/956: mkdir d11/d1a/d30/d141 0 2024-04-20T10:54:54.146 INFO:tasks.workunit.client.0.smithi090.stdout:2/957: dread d11/d1a/d4a/f53 [0,4194304] 0 2024-04-20T10:54:54.147 INFO:tasks.workunit.client.0.smithi090.stdout:2/958: mknod d11/d1a/d30/d8d/c142 0 2024-04-20T10:54:54.148 INFO:tasks.workunit.client.0.smithi090.stdout:2/959: symlink d11/d1a/d2b/dff/l143 0 2024-04-20T10:54:54.148 INFO:tasks.workunit.client.0.smithi090.stdout:2/960: fsync d11/d1a/f1b 0 2024-04-20T10:54:54.155 INFO:tasks.workunit.client.0.smithi090.stdout:2/961: dread d11/d1a/d30/d8d/f9c [0,4194304] 0 2024-04-20T10:54:54.155 INFO:tasks.workunit.client.0.smithi090.stdout:2/962: write d11/d1a/d37/d85/f95 [1564073,103699] 0 2024-04-20T10:54:54.156 INFO:tasks.workunit.client.0.smithi090.stdout:2/963: mkdir d11/d1a/d30/da6/d144 0 2024-04-20T10:54:54.158 INFO:tasks.workunit.client.0.smithi090.stdout:2/964: write d11/d1a/d4a/d80/fe6 [338324,6556] 0 2024-04-20T10:54:54.158 INFO:tasks.workunit.client.0.smithi090.stdout:2/965: mkdir d11/d1a/d2b/da7/d145 0 2024-04-20T10:54:54.159 INFO:tasks.workunit.client.0.smithi090.stdout:2/966: mknod d11/d1a/d2b/d12b/c146 0 2024-04-20T10:54:54.159 INFO:tasks.workunit.client.0.smithi090.stdout:2/967: fdatasync d11/d1a/f7d 0 2024-04-20T10:54:54.159 INFO:tasks.workunit.client.0.smithi090.stdout:2/968: write d11/d1a/d2b/df0/d131/f66 [716943,57303] 0 2024-04-20T10:54:54.178 INFO:tasks.workunit.client.0.smithi090.stdout:2/969: dwrite d11/d1a/d2b/df0/d131/d2e/d6e/dc9/f118 [0,4194304] 0 2024-04-20T10:54:54.179 INFO:tasks.workunit.client.0.smithi090.stdout:2/970: mknod d11/d1a/d2b/df0/d131/d2e/dad/d139/c147 0 2024-04-20T10:54:54.186 INFO:tasks.workunit.client.0.smithi090.stdout:2/971: write d11/d1a/f58 [2936998,8179] 0 2024-04-20T10:54:54.187 INFO:tasks.workunit.client.0.smithi090.stdout:2/972: mknod d11/d1a/d4a/d55/d67/d120/c148 0 2024-04-20T10:54:54.187 INFO:tasks.workunit.client.0.smithi090.stdout:2/973: readlink d11/d1a/ld4 0 2024-04-20T10:54:54.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/995: sync 2024-04-20T10:54:54.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/996: mknod d8/d1a/c13e 0 2024-04-20T10:54:54.287 INFO:tasks.workunit.client.0.smithi090.stdout:1/997: fdatasync d8/d1a/d1d/d67/dff/ff0 0 2024-04-20T10:54:54.296 INFO:tasks.workunit.client.0.smithi090.stdout:1/998: dread d8/d1a/f3b [0,4194304] 0 2024-04-20T10:54:54.297 INFO:tasks.workunit.client.0.smithi090.stdout:1/999: unlink d8/d1a/d1d/d67/dff/d4a/d5a/d105/d109/fd6 0 2024-04-20T10:54:54.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.317+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2b40c8c40 con 0x7fc2b4157710 2024-04-20T10:54:54.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.318+0000 7fc2a9ffb640 1 -- 172.21.15.90:0/29785052 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5698 (secure 0 0 0) 0x7fc2ac059670 con 0x7fc2b4157710 2024-04-20T10:54:54.318 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:54.318 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:52.567205+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:rejoin","state_seq":10,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:54:54.318 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 35 2024-04-20T10:54:54.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc29806c8f0 msgr2=0x7fc29806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:54.320 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc29806c8f0 0x7fc29806edb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4036000 tx=0x7fc2a403c040 comp rx=0 tx=0).stop 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4157710 msgr2=0x7fc2b41ec7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4157710 0x7fc2b41ec7a0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac00c760 tx=0x7fc2ac00cc20 comp rx=0 tx=0).stop 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 shutdown_connections 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc29806c8f0 0x7fc29806edb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2b4157710 0x7fc2b41ec7a0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2b40ad0c0 0x7fc2b41ec260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 --2- 172.21.15.90:0/29785052 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2b4073810 0x7fc2b414a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 >> 172.21.15.90:0/29785052 conn(0x7fc2b40c8080 msgr2=0x7fc2b4154000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 shutdown_connections 2024-04-20T10:54:54.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:54.320+0000 7fc2bb375640 1 -- 172.21.15.90:0/29785052 wait complete. 2024-04-20T10:54:54.331 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:54:54.619 INFO:tasks.workunit.client.0.smithi090.stdout:7/802: sync 2024-04-20T10:54:54.619 INFO:tasks.workunit.client.0.smithi090.stdout:8/842: sync 2024-04-20T10:54:54.619 INFO:tasks.workunit.client.0.smithi090.stdout:2/974: sync 2024-04-20T10:54:54.620 INFO:tasks.workunit.client.0.smithi090.stdout:2/975: fsync d11/d1a/d37/fc6 0 2024-04-20T10:54:54.620 INFO:tasks.workunit.client.0.smithi090.stdout:6/714: sync 2024-04-20T10:54:54.620 INFO:tasks.workunit.client.0.smithi090.stdout:3/802: sync 2024-04-20T10:54:54.620 INFO:tasks.workunit.client.0.smithi090.stdout:0/982: sync 2024-04-20T10:54:54.620 INFO:tasks.workunit.client.0.smithi090.stdout:4/801: sync 2024-04-20T10:54:54.620 INFO:tasks.workunit.client.0.smithi090.stdout:8/843: mkdir d0/d99/d10f 0 2024-04-20T10:54:54.621 INFO:tasks.workunit.client.0.smithi090.stdout:3/803: mknod d7/d11/cff 0 2024-04-20T10:54:54.622 INFO:tasks.workunit.client.0.smithi090.stdout:2/976: truncate d11/d1a/d2b/df0/d131/d2e/d6e/dc9/fea 169545 0 2024-04-20T10:54:54.622 INFO:tasks.workunit.client.0.smithi090.stdout:2/977: dread - d11/d1a/d2b/df0/d131/d2e/d6e/fde zero size 2024-04-20T10:54:54.630 INFO:tasks.workunit.client.0.smithi090.stdout:4/802: rename d7/d9/d47/df9/d70/da1/dcd/d3d/l6c to d7/d9/d47/df9/d9d/df8/l104 0 2024-04-20T10:54:54.630 INFO:tasks.workunit.client.0.smithi090.stdout:8/844: stat d0/l13 0 2024-04-20T10:54:54.630 INFO:tasks.workunit.client.0.smithi090.stdout:8/845: write d0/d2d/d49/faf [4438176,24298] 0 2024-04-20T10:54:54.630 INFO:tasks.workunit.client.0.smithi090.stdout:2/978: mkdir d11/d1a/d2b/df0/d131/d2e/d10c/d149 0 2024-04-20T10:54:54.630 INFO:tasks.workunit.client.0.smithi090.stdout:0/983: link d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/d3b/feb d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/f13a 0 2024-04-20T10:54:54.630 INFO:tasks.workunit.client.0.smithi090.stdout:0/984: readlink d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/d34/d3b/l12a 0 2024-04-20T10:54:54.630 INFO:tasks.workunit.client.0.smithi090.stdout:0/985: chown d14/d19/d2b/d8e/c4c 24594313 1 2024-04-20T10:54:54.631 INFO:tasks.workunit.client.0.smithi090.stdout:7/803: write d11/d1a/d3b/d79/f99 [688503,104698] 0 2024-04-20T10:54:54.638 INFO:tasks.workunit.client.0.smithi090.stdout:0/986: read d14/d19/d2b/f3e [3344759,7419] 0 2024-04-20T10:54:54.638 INFO:tasks.workunit.client.0.smithi090.stdout:0/987: fdatasync d14/d41/f6e 0 2024-04-20T10:54:54.639 INFO:tasks.workunit.client.0.smithi090.stdout:0/988: rename d14/d19/dca/ldd to d14/d19/d2b/d8e/d43/d6d/l13b 0 2024-04-20T10:54:54.644 INFO:tasks.workunit.client.0.smithi090.stdout:8/846: write d0/fd2 [1336574,29482] 0 2024-04-20T10:54:54.644 INFO:tasks.workunit.client.0.smithi090.stdout:8/847: chown d0/d26/lbf 3 1 2024-04-20T10:54:54.644 INFO:tasks.workunit.client.0.smithi090.stdout:8/848: chown d0/d11/l5b 960 1 2024-04-20T10:54:54.646 INFO:tasks.workunit.client.0.smithi090.stdout:6/715: dwrite d1/d19/f59 [0,4194304] 0 2024-04-20T10:54:54.647 INFO:tasks.workunit.client.0.smithi090.stdout:8/849: rename d0/d11/fdb to d0/d3a/d9f/db9/f110 0 2024-04-20T10:54:54.651 INFO:tasks.workunit.client.0.smithi090.stdout:8/850: rename d0/d2d/d49 to d0/d11/d22/d53/d57/dd3/d111 0 2024-04-20T10:54:54.652 INFO:tasks.workunit.client.0.smithi090.stdout:8/851: chown d0/d26/f4d 2121 1 2024-04-20T10:54:54.657 INFO:tasks.workunit.client.0.smithi090.stdout:8/852: write d0/f28 [902532,62939] 0 2024-04-20T10:54:54.657 INFO:tasks.workunit.client.0.smithi090.stdout:8/853: chown d0/d3a/d9f/d52/f82 5315 1 2024-04-20T10:54:54.659 INFO:tasks.workunit.client.0.smithi090.stdout:8/854: link d0/d11/d22/d53/d57/dd3/d111/fdd d0/d3a/daa/f112 0 2024-04-20T10:54:54.660 INFO:tasks.workunit.client.0.smithi090.stdout:8/855: mkdir d0/d26/da7/df5/dcf/dd5/df9/d113 0 2024-04-20T10:54:54.661 INFO:tasks.workunit.client.0.smithi090.stdout:8/856: mkdir d0/d11/d22/d53/d57/dd3/d10a/d114 0 2024-04-20T10:54:54.661 INFO:tasks.workunit.client.0.smithi090.stdout:8/857: truncate d0/d3a/ffb 583127 0 2024-04-20T10:54:54.661 INFO:tasks.workunit.client.0.smithi090.stdout:6/716: dread d1/d4/d26/d11/d35/f5f [0,4194304] 0 2024-04-20T10:54:54.662 INFO:tasks.workunit.client.0.smithi090.stdout:8/858: mkdir d0/d2d/d115 0 2024-04-20T10:54:54.662 INFO:tasks.workunit.client.0.smithi090.stdout:8/859: stat d0/d3a/d9f/d52/le8 0 2024-04-20T10:54:54.663 INFO:tasks.workunit.client.0.smithi090.stdout:6/717: creat d1/fea x:0 0 0 2024-04-20T10:54:54.663 INFO:tasks.workunit.client.0.smithi090.stdout:6/718: fdatasync d1/d19/f59 0 2024-04-20T10:54:54.664 INFO:tasks.workunit.client.0.smithi090.stdout:8/860: symlink d0/d2d/d44/l116 0 2024-04-20T10:54:54.665 INFO:tasks.workunit.client.0.smithi090.stdout:0/989: dwrite d14/d19/f25 [0,4194304] 0 2024-04-20T10:54:54.665 INFO:tasks.workunit.client.0.smithi090.stdout:8/861: symlink d0/d11/d22/d53/l117 0 2024-04-20T10:54:54.666 INFO:tasks.workunit.client.0.smithi090.stdout:6/719: rename d1/d4/c8e to d1/d4/d26/d11/d4a/d70/ceb 0 2024-04-20T10:54:54.666 INFO:tasks.workunit.client.0.smithi090.stdout:8/862: rmdir d0/d26/da7/df5/dcf/dd5/df9 39 2024-04-20T10:54:54.667 INFO:tasks.workunit.client.0.smithi090.stdout:3/804: dwrite d7/d43/f45 [0,4194304] 0 2024-04-20T10:54:54.668 INFO:tasks.workunit.client.0.smithi090.stdout:2/979: dwrite d11/d1a/d2b/df0/d131/d2e/f8e [0,4194304] 0 2024-04-20T10:54:54.668 INFO:tasks.workunit.client.0.smithi090.stdout:4/803: dwrite d7/d9/d17/f27 [0,4194304] 0 2024-04-20T10:54:54.669 INFO:tasks.workunit.client.0.smithi090.stdout:6/720: rename d1/c37 to d1/d19/d36/d1e/d74/cec 0 2024-04-20T10:54:54.669 INFO:tasks.workunit.client.0.smithi090.stdout:7/804: dwrite d11/d13/d5d/d65/fb5 [0,4194304] 0 2024-04-20T10:54:54.671 INFO:tasks.workunit.client.0.smithi090.stdout:2/980: unlink fd 0 2024-04-20T10:54:54.671 INFO:tasks.workunit.client.0.smithi090.stdout:2/981: write d11/d97/fa0 [844678,111172] 0 2024-04-20T10:54:54.671 INFO:tasks.workunit.client.0.smithi090.stdout:2/982: truncate d11/f1e 4404945 0 2024-04-20T10:54:54.673 INFO:tasks.workunit.client.0.smithi090.stdout:4/804: write d7/d9/d47/df9/d70/da1/dcd/d3d/f9f [4138578,11385] 0 2024-04-20T10:54:54.674 INFO:tasks.workunit.client.0.smithi090.stdout:3/805: rename d7/f37 to d7/d43/db7/ddf/f100 0 2024-04-20T10:54:54.682 INFO:tasks.workunit.client.0.smithi090.stdout:4/805: creat d7/d9/d47/df9/d70/da1/dcd/d42/f105 x:0 0 0 2024-04-20T10:54:54.685 INFO:tasks.workunit.client.0.smithi090.stdout:3/806: creat d7/df/dd1/f101 x:0 0 0 2024-04-20T10:54:54.687 INFO:tasks.workunit.client.0.smithi090.stdout:4/806: truncate d7/d9/d17/f90 2607406 0 2024-04-20T10:54:54.688 INFO:tasks.workunit.client.0.smithi090.stdout:6/721: read d1/f65 [3747240,18204] 0 2024-04-20T10:54:54.688 INFO:tasks.workunit.client.0.smithi090.stdout:6/722: chown d1/d19/ca0 12 1 2024-04-20T10:54:54.689 INFO:tasks.workunit.client.0.smithi090.stdout:3/807: symlink d7/d15/d2a/d8d/l102 0 2024-04-20T10:54:54.689 INFO:tasks.workunit.client.0.smithi090.stdout:3/808: chown d7/l83 19 1 2024-04-20T10:54:54.689 INFO:tasks.workunit.client.0.smithi090.stdout:3/809: chown d7/d15/d2a/d30/d93/d7f/l9d 17418825 1 2024-04-20T10:54:54.691 INFO:tasks.workunit.client.0.smithi090.stdout:4/807: rmdir d7/d9/d47/df9/d70/da1/dcd/d42/dfe 0 2024-04-20T10:54:54.699 INFO:tasks.workunit.client.0.smithi090.stdout:8/863: dwrite d0/d26/da7/df5/ff0 [0,4194304] 0 2024-04-20T10:54:54.699 INFO:tasks.workunit.client.0.smithi090.stdout:8/864: write d0/d3a/d9f/f7f [440061,64295] 0 2024-04-20T10:54:54.702 INFO:tasks.workunit.client.0.smithi090.stdout:2/983: dwrite d11/d1a/d37/f103 [0,4194304] 0 2024-04-20T10:54:54.702 INFO:tasks.workunit.client.0.smithi090.stdout:2/984: chown d11/d97/d132 595419120 1 2024-04-20T10:54:54.702 INFO:tasks.workunit.client.0.smithi090.stdout:2/985: chown d11/d1a/d2b/da7/d145 2 1 2024-04-20T10:54:54.703 INFO:tasks.workunit.client.0.smithi090.stdout:0/990: dwrite f5 [0,4194304] 0 2024-04-20T10:54:54.704 INFO:tasks.workunit.client.0.smithi090.stdout:4/808: write d7/d9/d17/f49 [2092469,19305] 0 2024-04-20T10:54:54.705 INFO:tasks.workunit.client.0.smithi090.stdout:0/991: truncate d14/d39/da6/fb3 676545 0 2024-04-20T10:54:54.705 INFO:tasks.workunit.client.0.smithi090.stdout:0/992: fsync d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/f139 0 2024-04-20T10:54:54.706 INFO:tasks.workunit.client.0.smithi090.stdout:4/809: mknod d7/d9/d47/df9/d70/da1/dcd/d42/c106 0 2024-04-20T10:54:54.706 INFO:tasks.workunit.client.0.smithi090.stdout:4/810: write d7/d9/d17/f27 [4745811,12918] 0 2024-04-20T10:54:54.708 INFO:tasks.workunit.client.0.smithi090.stdout:4/811: link d7/f7d d7/d9/d17/d94/f107 0 2024-04-20T10:54:54.709 INFO:tasks.workunit.client.0.smithi090.stdout:3/810: dread d7/d15/d2a/f67 [0,4194304] 0 2024-04-20T10:54:54.709 INFO:tasks.workunit.client.0.smithi090.stdout:0/993: dread d14/d19/d2b/d8e/d43/d5c/d103/f111 [0,4194304] 0 2024-04-20T10:54:54.711 INFO:tasks.workunit.client.0.smithi090.stdout:7/805: dwrite f6 [0,4194304] 0 2024-04-20T10:54:54.711 INFO:tasks.workunit.client.0.smithi090.stdout:4/812: mkdir d7/d108 0 2024-04-20T10:54:54.711 INFO:tasks.workunit.client.0.smithi090.stdout:4/813: fsync d7/f21 0 2024-04-20T10:54:54.711 INFO:tasks.workunit.client.0.smithi090.stdout:6/723: dwrite d1/d4/d26/ff [0,4194304] 0 2024-04-20T10:54:54.711 INFO:tasks.workunit.client.0.smithi090.stdout:6/724: fsync d1/d10/f39 0 2024-04-20T10:54:54.711 INFO:tasks.workunit.client.0.smithi090.stdout:6/725: dread - d1/d19/d36/d1e/d1f/d3f/f79 zero size 2024-04-20T10:54:54.711 INFO:tasks.workunit.client.0.smithi090.stdout:3/811: mknod d7/d43/db7/ddf/c103 0 2024-04-20T10:54:54.712 INFO:tasks.workunit.client.0.smithi090.stdout:0/994: creat d14/d19/d2b/d8e/d43/d6d/f13c x:0 0 0 2024-04-20T10:54:54.712 INFO:tasks.workunit.client.0.smithi090.stdout:0/995: read - d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/fde zero size 2024-04-20T10:54:54.714 INFO:tasks.workunit.client.0.smithi090.stdout:7/806: creat d11/d13/d22/d27/dc2/f101 x:0 0 0 2024-04-20T10:54:54.718 INFO:tasks.workunit.client.0.smithi090.stdout:7/807: read d11/d13/d22/f4b [1348788,61224] 0 2024-04-20T10:54:54.718 INFO:tasks.workunit.client.0.smithi090.stdout:3/812: rmdir d7/df/dd1/dd3 39 2024-04-20T10:54:54.718 INFO:tasks.workunit.client.0.smithi090.stdout:7/808: read - d11/d13/d5b/db8/de0/fe7 zero size 2024-04-20T10:54:54.718 INFO:tasks.workunit.client.0.smithi090.stdout:3/813: chown d7/d26/d78/c7b 62616 1 2024-04-20T10:54:54.718 INFO:tasks.workunit.client.0.smithi090.stdout:3/814: getdents d7/d35/da8 0 2024-04-20T10:54:54.719 INFO:tasks.workunit.client.0.smithi090.stdout:3/815: fsync d7/d11/f46 0 2024-04-20T10:54:54.720 INFO:tasks.workunit.client.0.smithi090.stdout:7/809: symlink d11/d1a/l102 0 2024-04-20T10:54:54.720 INFO:tasks.workunit.client.0.smithi090.stdout:7/810: fdatasync d11/d13/d22/d24/f69 0 2024-04-20T10:54:54.728 INFO:tasks.workunit.client.0.smithi090.stdout:6/726: read d1/d19/f1a [1036845,60980] 0 2024-04-20T10:54:54.728 INFO:tasks.workunit.client.0.smithi090.stdout:7/811: write d11/d13/fae [2350388,68469] 0 2024-04-20T10:54:54.728 INFO:tasks.workunit.client.0.smithi090.stdout:7/812: chown d11/d13/d33/l48 55386 1 2024-04-20T10:54:54.729 INFO:tasks.workunit.client.0.smithi090.stdout:6/727: unlink d1/d19/d25/l43 0 2024-04-20T10:54:54.730 INFO:tasks.workunit.client.0.smithi090.stdout:6/728: truncate d1/d19/d25/f87 1184177 0 2024-04-20T10:54:54.730 INFO:tasks.workunit.client.0.smithi090.stdout:8/865: dwrite d0/d2d/d44/fc8 [0,4194304] 0 2024-04-20T10:54:54.731 INFO:tasks.workunit.client.0.smithi090.stdout:7/813: symlink d11/d13/d5b/db8/l103 0 2024-04-20T10:54:54.731 INFO:tasks.workunit.client.0.smithi090.stdout:2/986: dwrite d11/d1a/d37/d85/f98 [0,4194304] 0 2024-04-20T10:54:54.731 INFO:tasks.workunit.client.0.smithi090.stdout:6/729: rmdir d1/d4/dd6 39 2024-04-20T10:54:54.733 INFO:tasks.workunit.client.0.smithi090.stdout:8/866: mknod d0/d26/da7/df5/dcf/dd5/df9/d113/c118 0 2024-04-20T10:54:54.733 INFO:tasks.workunit.client.0.smithi090.stdout:7/814: symlink d11/d13/l104 0 2024-04-20T10:54:54.734 INFO:tasks.workunit.client.0.smithi090.stdout:4/814: dwrite d7/d9/d17/f79 [0,4194304] 0 2024-04-20T10:54:54.734 INFO:tasks.workunit.client.0.smithi090.stdout:4/815: write d7/d9/f6d [5054528,6364] 0 2024-04-20T10:54:54.735 INFO:tasks.workunit.client.0.smithi090.stdout:2/987: truncate d11/d1a/d37/d85/f95 623139 0 2024-04-20T10:54:54.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/730: creat d1/d4/d26/d11/d4a/d56/fed x:0 0 0 2024-04-20T10:54:54.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/731: chown d1/d4/d26/d11/f71 296 1 2024-04-20T10:54:54.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/732: chown d1/d19/d36/d1e/d74/fda 252632653 1 2024-04-20T10:54:54.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/733: chown d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd/de1 136778 1 2024-04-20T10:54:54.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/734: chown d1/d4/d26/d11/d4a 808410604 1 2024-04-20T10:54:54.736 INFO:tasks.workunit.client.0.smithi090.stdout:6/735: write d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9/fce [25672,89223] 0 2024-04-20T10:54:54.739 INFO:tasks.workunit.client.0.smithi090.stdout:4/816: symlink d7/d9/d17/de3/l109 0 2024-04-20T10:54:54.740 INFO:tasks.workunit.client.0.smithi090.stdout:2/988: dread d11/d1a/f58 [0,4194304] 0 2024-04-20T10:54:54.740 INFO:tasks.workunit.client.0.smithi090.stdout:4/817: rmdir d7/d9 39 2024-04-20T10:54:54.742 INFO:tasks.workunit.client.0.smithi090.stdout:4/818: symlink d7/d97/l10a 0 2024-04-20T10:54:54.743 INFO:tasks.workunit.client.0.smithi090.stdout:4/819: unlink d7/d9/f36 0 2024-04-20T10:54:54.747 INFO:tasks.workunit.client.0.smithi090.stdout:0/996: dwrite d14/d19/d2b/d61/da0/db1/ffe [0,4194304] 0 2024-04-20T10:54:54.749 INFO:tasks.workunit.client.0.smithi090.stdout:0/997: creat d14/d19/d2b/d52/dab/ddc/de4/d129/f13d x:0 0 0 2024-04-20T10:54:54.751 INFO:tasks.workunit.client.0.smithi090.stdout:3/816: dwrite d7/f79 [0,4194304] 0 2024-04-20T10:54:54.751 INFO:tasks.workunit.client.0.smithi090.stdout:6/736: dread d1/d19/d25/f78 [0,4194304] 0 2024-04-20T10:54:54.751 INFO:tasks.workunit.client.0.smithi090.stdout:3/817: chown d7/d26/f3c 0 1 2024-04-20T10:54:54.755 INFO:tasks.workunit.client.0.smithi090.stdout:8/867: dwrite d0/f9 [0,4194304] 0 2024-04-20T10:54:54.756 INFO:tasks.workunit.client.0.smithi090.stdout:4/820: dread d7/d9/f10 [0,4194304] 0 2024-04-20T10:54:54.756 INFO:tasks.workunit.client.0.smithi090.stdout:0/998: unlink d14/d19/d2b/d52/dab/ddc/de4/d5b/d7f/lc6 0 2024-04-20T10:54:54.756 INFO:tasks.workunit.client.0.smithi090.stdout:7/815: write d11/d13/d33/d44/d89/d98/dc7/fcd [3263078,48522] 0 2024-04-20T10:54:54.764 INFO:tasks.workunit.client.0.smithi090.stdout:4/821: symlink d7/d9/d47/df9/d70/da5/db3/l10b 0 2024-04-20T10:54:54.765 INFO:tasks.workunit.client.0.smithi090.stdout:3/818: dread d7/f71 [0,4194304] 0 2024-04-20T10:54:54.767 INFO:tasks.workunit.client.0.smithi090.stdout:0/999: link d14/d19/d2b/d52/dab/ddc/de4/d5b/d11e/ff1 d14/d19/d2b/d52/dab/ddc/de4/d5b/f13e 0 2024-04-20T10:54:54.768 INFO:tasks.workunit.client.0.smithi090.stdout:4/822: symlink d7/d9/l10c 0 2024-04-20T10:54:54.776 INFO:tasks.workunit.client.0.smithi090.stdout:2/989: dwrite d11/d1a/d37/d85/fdf [0,4194304] 0 2024-04-20T10:54:54.777 INFO:tasks.workunit.client.0.smithi090.stdout:6/737: dwrite d1/d19/d25/f87 [0,4194304] 0 2024-04-20T10:54:54.778 INFO:tasks.workunit.client.0.smithi090.stdout:2/990: creat d11/d1a/f14a x:0 0 0 2024-04-20T10:54:54.783 INFO:tasks.workunit.client.0.smithi090.stdout:7/816: dwrite d11/d13/d5b/fb6 [0,4194304] 0 2024-04-20T10:54:54.784 INFO:tasks.workunit.client.0.smithi090.stdout:8/868: dwrite d0/d3a/d9f/db9/dbe/fce [0,4194304] 0 2024-04-20T10:54:54.784 INFO:tasks.workunit.client.0.smithi090.stdout:2/991: mknod d11/d97/d132/c14b 0 2024-04-20T10:54:54.791 INFO:tasks.workunit.client.0.smithi090.stdout:8/869: symlink d0/d11/d22/d53/d57/dd3/d10a/l119 0 2024-04-20T10:54:54.792 INFO:tasks.workunit.client.0.smithi090.stdout:2/992: mknod d11/d1a/d2b/df0/d131/d2e/d6e/dc7/de2/c14c 0 2024-04-20T10:54:54.793 INFO:tasks.workunit.client.0.smithi090.stdout:2/993: truncate d11/d97/fbc 863503 0 2024-04-20T10:54:54.795 INFO:tasks.workunit.client.0.smithi090.stdout:8/870: rmdir d0/d11/d22/d53/d57 39 2024-04-20T10:54:54.796 INFO:tasks.workunit.client.0.smithi090.stdout:2/994: chown d11/d1a/d30/c6b 2974561 1 2024-04-20T10:54:54.797 INFO:tasks.workunit.client.0.smithi090.stdout:8/871: creat d0/d3a/d9f/f11a x:0 0 0 2024-04-20T10:54:54.798 INFO:tasks.workunit.client.0.smithi090.stdout:6/738: dwrite d1/d4/d26/d11/d35/d80/fac [0,4194304] 0 2024-04-20T10:54:54.800 INFO:tasks.workunit.client.0.smithi090.stdout:6/739: write d1/d4/f30 [30256,48229] 0 2024-04-20T10:54:54.800 INFO:tasks.workunit.client.0.smithi090.stdout:2/995: link d11/d1a/d4a/d55/lf1 d11/d1a/d10b/l14d 0 2024-04-20T10:54:54.800 INFO:tasks.workunit.client.0.smithi090.stdout:6/740: chown d1/d4/d26/d11/d4a/ca4 249178601 1 2024-04-20T10:54:54.800 INFO:tasks.workunit.client.0.smithi090.stdout:2/996: chown d11/d1a/d4a/d55/d67/f129 17844230 1 2024-04-20T10:54:54.802 INFO:tasks.workunit.client.0.smithi090.stdout:6/741: mknod d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9/dd0/cee 0 2024-04-20T10:54:54.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/817: dwrite d11/d13/d22/d27/fca [0,4194304] 0 2024-04-20T10:54:54.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/818: chown d11/d1a/d3b/d79/f99 76 1 2024-04-20T10:54:54.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/819: read - d11/d13/d33/d44/d89/d98/dc7/fcb zero size 2024-04-20T10:54:54.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/820: readlink d11/d13/d22/d24/l97 0 2024-04-20T10:54:54.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/821: truncate d11/d13/d5b/db8/f85 968129 0 2024-04-20T10:54:54.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/822: truncate d11/dd2/dec/ffe 998610 0 2024-04-20T10:54:54.804 INFO:tasks.workunit.client.0.smithi090.stdout:2/997: creat d11/d1a/d37/d85/d87/f14e x:0 0 0 2024-04-20T10:54:54.805 INFO:tasks.workunit.client.0.smithi090.stdout:7/823: mknod d11/d13/d22/d24/d35/c105 0 2024-04-20T10:54:54.806 INFO:tasks.workunit.client.0.smithi090.stdout:2/998: symlink d11/d1a/d2b/df0/d131/d2e/d12f/l14f 0 2024-04-20T10:54:54.808 INFO:tasks.workunit.client.0.smithi090.stdout:8/872: dread d0/d26/f55 [0,4194304] 0 2024-04-20T10:54:54.808 INFO:tasks.workunit.client.0.smithi090.stdout:8/873: write d0/d26/f86 [4592521,95405] 0 2024-04-20T10:54:54.809 INFO:tasks.workunit.client.0.smithi090.stdout:7/824: mknod d11/d13/d22/d24/df4/c106 0 2024-04-20T10:54:54.812 INFO:tasks.workunit.client.0.smithi090.stdout:6/742: write d1/d4/d26/d11/f41 [1174807,31358] 0 2024-04-20T10:54:54.813 INFO:tasks.workunit.client.0.smithi090.stdout:7/825: getdents d11/d1a/d3b/d79 0 2024-04-20T10:54:54.813 INFO:tasks.workunit.client.0.smithi090.stdout:6/743: truncate d1/d4/d26/d11/d35/fa6 58535 0 2024-04-20T10:54:54.814 INFO:tasks.workunit.client.0.smithi090.stdout:7/826: mkdir d11/d1a/d3b/d107 0 2024-04-20T10:54:54.821 INFO:tasks.workunit.client.0.smithi090.stdout:7/827: read d11/d1a/d3f/f6f [3627378,35821] 0 2024-04-20T10:54:54.822 INFO:tasks.workunit.client.0.smithi090.stdout:6/744: getdents d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0 0 2024-04-20T10:54:54.831 INFO:tasks.workunit.client.0.smithi090.stdout:6/745: write d1/d19/d36/d28/fae [1814585,118843] 0 2024-04-20T10:54:54.832 INFO:tasks.workunit.client.0.smithi090.stdout:7/828: symlink d11/d13/d22/d24/ddb/l108 0 2024-04-20T10:54:54.832 INFO:tasks.workunit.client.0.smithi090.stdout:6/746: write d1/d4/f30 [771081,109683] 0 2024-04-20T10:54:54.888 INFO:tasks.workunit.client.0.smithi090.stdout:6/747: symlink d1/d4/d26/lef 0 2024-04-20T10:54:54.888 INFO:tasks.workunit.client.0.smithi090.stdout:6/748: chown d1/d4/d26/c33 419279757 1 2024-04-20T10:54:54.888 INFO:tasks.workunit.client.0.smithi090.stdout:6/749: fsync d1/d4/d26/d11/f8a 0 2024-04-20T10:54:55.067 INFO:tasks.workunit.client.0.smithi090.stdout:6/750: mknod d1/d9a/cf0 0 2024-04-20T10:54:55.067 INFO:tasks.workunit.client.0.smithi090.stdout:6/751: stat d1/d19/d25/f78 0 2024-04-20T10:54:55.092 INFO:tasks.workunit.client.0.smithi090.stdout:4/823: sync 2024-04-20T10:54:55.092 INFO:tasks.workunit.client.0.smithi090.stdout:7/829: sync 2024-04-20T10:54:55.092 INFO:tasks.workunit.client.0.smithi090.stdout:2/999: sync 2024-04-20T10:54:55.092 INFO:tasks.workunit.client.0.smithi090.stdout:8/874: sync 2024-04-20T10:54:55.092 INFO:tasks.workunit.client.0.smithi090.stdout:7/830: fdatasync d11/d13/d5b/db8/dbf/f9c 0 2024-04-20T10:54:55.092 INFO:tasks.workunit.client.0.smithi090.stdout:4/824: truncate d7/d97/ff6 361586 0 2024-04-20T10:54:55.092 INFO:tasks.workunit.client.0.smithi090.stdout:3/819: sync 2024-04-20T10:54:55.094 INFO:tasks.workunit.client.0.smithi090.stdout:6/752: dread d1/d4/f50 [0,4194304] 0 2024-04-20T10:54:55.098 INFO:tasks.workunit.client.0.smithi090.stdout:7/831: write d11/d1a/d3b/d79/f8d [6285836,91169] 0 2024-04-20T10:54:55.111 INFO:tasks.workunit.client.0.smithi090.stdout:3/820: dwrite d7/df/f4d [0,4194304] 0 2024-04-20T10:54:55.614 INFO:tasks.workunit.client.1.smithi175.stdout:9/368: truncate d6/f16 2869380 0 2024-04-20T10:54:55.622 INFO:tasks.workunit.client.1.smithi175.stdout:3/288: truncate d7/d21/fb 158350 0 2024-04-20T10:54:55.628 INFO:tasks.workunit.client.1.smithi175.stdout:2/292: rename d1/d7/d1e to d1/d7/d63 0 2024-04-20T10:54:55.630 INFO:tasks.workunit.client.1.smithi175.stdout:5/399: dread db/d11/f43 [0,4194304] 0 2024-04-20T10:54:55.631 INFO:tasks.workunit.client.1.smithi175.stdout:2/293: mkdir d1/d7/d63/d64 0 2024-04-20T10:54:55.665 INFO:tasks.workunit.client.1.smithi175.stdout:5/400: truncate db/d11/d1a/f28 7845036 0 2024-04-20T10:54:55.672 INFO:tasks.workunit.client.1.smithi175.stdout:2/294: truncate d1/d7/ff 64383 0 2024-04-20T10:54:55.686 INFO:tasks.workunit.client.1.smithi175.stdout:8/362: sync 2024-04-20T10:54:55.686 INFO:tasks.workunit.client.1.smithi175.stdout:4/393: sync 2024-04-20T10:54:55.686 INFO:tasks.workunit.client.1.smithi175.stdout:6/406: sync 2024-04-20T10:54:55.697 INFO:tasks.workunit.client.1.smithi175.stdout:9/369: stat d6/d1b/d2f/f38 0 2024-04-20T10:54:55.697 INFO:tasks.workunit.client.1.smithi175.stdout:1/300: sync 2024-04-20T10:54:55.697 INFO:tasks.workunit.client.1.smithi175.stdout:7/438: sync 2024-04-20T10:54:55.698 INFO:tasks.workunit.client.1.smithi175.stdout:0/323: sync 2024-04-20T10:54:55.699 INFO:tasks.workunit.client.1.smithi175.stdout:6/407: creat d1/d40/d63/d7c/f94 x:0 0 0 2024-04-20T10:54:55.699 INFO:tasks.workunit.client.1.smithi175.stdout:9/370: chown d6/d1b/d2f/f64 2040312070 1 2024-04-20T10:54:55.704 INFO:tasks.workunit.client.1.smithi175.stdout:2/295: mkdir d1/d48/d38/d65 0 2024-04-20T10:54:55.705 INFO:tasks.workunit.client.1.smithi175.stdout:1/301: mknod d0/d29/c62 0 2024-04-20T10:54:55.705 INFO:tasks.workunit.client.1.smithi175.stdout:1/302: chown d0/d3e 132735178 1 2024-04-20T10:54:55.710 INFO:tasks.workunit.client.1.smithi175.stdout:4/394: write d4/dd/d2d/f4c [534952,123052] 0 2024-04-20T10:54:55.717 INFO:tasks.workunit.client.1.smithi175.stdout:2/296: dread d1/d48/d21/d29/f24 [0,4194304] 0 2024-04-20T10:54:55.719 INFO:tasks.workunit.client.1.smithi175.stdout:6/408: dwrite d1/d40/d63/d7c/f94 [0,4194304] 0 2024-04-20T10:54:55.719 INFO:tasks.workunit.client.1.smithi175.stdout:9/371: creat d6/d58/f68 x:0 0 0 2024-04-20T10:54:55.720 INFO:tasks.workunit.client.1.smithi175.stdout:7/439: creat db/d1d/d29/d2a/fa8 x:0 0 0 2024-04-20T10:54:55.721 INFO:tasks.workunit.client.1.smithi175.stdout:0/324: mknod df/d1a/d3f/d5e/c64 0 2024-04-20T10:54:55.721 INFO:tasks.workunit.client.1.smithi175.stdout:2/297: fsync d1/f57 0 2024-04-20T10:54:55.722 INFO:tasks.workunit.client.1.smithi175.stdout:6/409: dread - d1/d40/f32 zero size 2024-04-20T10:54:55.723 INFO:tasks.workunit.client.1.smithi175.stdout:7/440: read - db/d1d/d29/d2a/f86 zero size 2024-04-20T10:54:55.725 INFO:tasks.workunit.client.1.smithi175.stdout:9/372: mknod d6/d1b/d2f/c69 0 2024-04-20T10:54:55.728 INFO:tasks.workunit.client.1.smithi175.stdout:7/441: mknod db/d1d/d29/d2a/ca9 0 2024-04-20T10:54:55.730 INFO:tasks.workunit.client.1.smithi175.stdout:6/410: chown d1/d5/d12/d22/f44 4255 1 2024-04-20T10:54:55.731 INFO:tasks.workunit.client.1.smithi175.stdout:8/363: dwrite d7/d13/d1d/f4e [0,4194304] 0 2024-04-20T10:54:55.732 INFO:tasks.workunit.client.1.smithi175.stdout:5/401: dwrite db/d11/d1a/f36 [0,4194304] 0 2024-04-20T10:54:55.734 INFO:tasks.workunit.client.1.smithi175.stdout:0/325: dread - df/d1a/d22/d24/d37/d48/d4e/f61 zero size 2024-04-20T10:54:55.735 INFO:tasks.workunit.client.1.smithi175.stdout:1/303: creat d0/d8/d13/d2e/d35/f63 x:0 0 0 2024-04-20T10:54:55.735 INFO:tasks.workunit.client.1.smithi175.stdout:6/411: symlink d1/d5/l95 0 2024-04-20T10:54:55.739 INFO:tasks.workunit.client.1.smithi175.stdout:2/298: write d1/d7/f34 [1101273,106683] 0 2024-04-20T10:54:55.739 INFO:tasks.workunit.client.1.smithi175.stdout:5/402: chown db/d1f/d31/l54 38 1 2024-04-20T10:54:55.742 INFO:tasks.workunit.client.1.smithi175.stdout:8/364: rename d7/d13/d1d/l23 to d7/d13/l6b 0 2024-04-20T10:54:55.742 INFO:tasks.workunit.client.1.smithi175.stdout:6/412: chown d1/d40/d46/f58 48132051 1 2024-04-20T10:54:55.743 INFO:tasks.workunit.client.1.smithi175.stdout:9/373: write d6/d10/f32 [253963,88214] 0 2024-04-20T10:54:55.744 INFO:tasks.workunit.client.1.smithi175.stdout:7/442: unlink db/d1d/d29/d2a/d41/f80 0 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:6/753: rename d1/d4/d26/d11/d4a/d70 to d1/d4/d26/d11/d4a/d6b/db5/df1 0 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:8/875: creat d0/d11/d22/d53/f11b x:0 0 0 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:8/876: dread - d0/d11/d22/d53/d8e/f10c zero size 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:8/877: write d0/f12 [4352287,52658] 0 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:7/832: getdents d11/d13/d22/d24/df4 0 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:7/833: write d11/d1a/d3f/f5f [5055761,5610] 0 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:7/834: write d11/d13/d5d/fa8 [4423008,31644] 0 2024-04-20T10:54:55.855 INFO:tasks.workunit.client.0.smithi090.stdout:7/835: stat f6 0 2024-04-20T10:54:55.856 INFO:tasks.workunit.client.0.smithi090.stdout:3/821: symlink d7/df/l104 0 2024-04-20T10:54:55.858 INFO:tasks.workunit.client.0.smithi090.stdout:6/754: mknod d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/cf2 0 2024-04-20T10:54:55.858 INFO:tasks.workunit.client.0.smithi090.stdout:6/755: write d1/d4/d26/d11/d35/fa6 [600703,117809] 0 2024-04-20T10:54:55.859 INFO:tasks.workunit.client.0.smithi090.stdout:6/756: chown d1/d4/d26/f9e 163 1 2024-04-20T10:54:55.859 INFO:tasks.workunit.client.0.smithi090.stdout:8/878: mknod d0/d11/d22/d53/d8e/d92/c11c 0 2024-04-20T10:54:55.863 INFO:tasks.workunit.client.0.smithi090.stdout:3/822: mknod d7/d43/dc5/c105 0 2024-04-20T10:54:55.864 INFO:tasks.workunit.client.0.smithi090.stdout:8/879: mkdir d0/d11/d22/d53/d57/d11d 0 2024-04-20T10:54:55.865 INFO:tasks.workunit.client.0.smithi090.stdout:3/823: getdents d7/df/dd1/dd3 0 2024-04-20T10:54:55.866 INFO:tasks.workunit.client.0.smithi090.stdout:7/836: write d11/d13/d22/d24/d35/fc3 [4125249,33003] 0 2024-04-20T10:54:55.866 INFO:tasks.workunit.client.0.smithi090.stdout:3/824: truncate d7/f40 3047607 0 2024-04-20T10:54:55.867 INFO:tasks.workunit.client.0.smithi090.stdout:7/837: truncate d11/d13/d23/f62 326501 0 2024-04-20T10:54:55.868 INFO:tasks.workunit.client.0.smithi090.stdout:3/825: creat d7/d15/d2a/d8d/f106 x:0 0 0 2024-04-20T10:54:55.868 INFO:tasks.workunit.client.0.smithi090.stdout:6/757: dread d1/d4/d26/d11/d35/f5f [0,4194304] 0 2024-04-20T10:54:55.872 INFO:tasks.workunit.client.0.smithi090.stdout:4/825: sync 2024-04-20T10:54:55.874 INFO:tasks.workunit.client.0.smithi090.stdout:7/838: mknod d11/d13/d22/df3/c109 0 2024-04-20T10:54:55.875 INFO:tasks.workunit.client.0.smithi090.stdout:7/839: chown d11/d13/d5b/db8/de0/ce9 513 1 2024-04-20T10:54:55.875 INFO:tasks.workunit.client.0.smithi090.stdout:3/826: rmdir d7/d43 39 2024-04-20T10:54:55.878 INFO:tasks.workunit.client.0.smithi090.stdout:4/826: mkdir d7/d9/d47/df9/d10d 0 2024-04-20T10:54:55.880 INFO:tasks.workunit.client.0.smithi090.stdout:6/758: mknod d1/d19/d36/d1e/d1f/cf3 0 2024-04-20T10:54:55.880 INFO:tasks.workunit.client.0.smithi090.stdout:6/759: write d1/d4/d26/d11/d4a/d6b/db5/df1/fb1 [1536605,127512] 0 2024-04-20T10:54:55.880 INFO:tasks.workunit.client.0.smithi090.stdout:6/760: fdatasync d1/d4/d26/d11/d35/f8c 0 2024-04-20T10:54:55.880 INFO:tasks.workunit.client.0.smithi090.stdout:6/761: write d1/f65 [312958,4896] 0 2024-04-20T10:54:55.880 INFO:tasks.workunit.client.0.smithi090.stdout:4/827: rename d7/d9/d17/f79 to d7/d9/d47/df9/d103/f10e 0 2024-04-20T10:54:55.883 INFO:tasks.workunit.client.0.smithi090.stdout:4/828: creat d7/d9/d47/d8d/f10f x:0 0 0 2024-04-20T10:54:55.883 INFO:tasks.workunit.client.0.smithi090.stdout:4/829: dread - d7/d9/d47/df9/d70/da1/dcd/d76/f96 zero size 2024-04-20T10:54:55.885 INFO:tasks.workunit.client.0.smithi090.stdout:6/762: symlink d1/d4/d26/d11/d4a/d6b/db5/df1/lf4 0 2024-04-20T10:54:55.885 INFO:tasks.workunit.client.0.smithi090.stdout:6/763: fsync d1/d4/d26/ff 0 2024-04-20T10:54:55.886 INFO:tasks.workunit.client.0.smithi090.stdout:6/764: creat d1/d4/d26/d11/d35/d97/ff5 x:0 0 0 2024-04-20T10:54:55.888 INFO:tasks.workunit.client.0.smithi090.stdout:6/765: rename d1/d4/d26/d11/d4a/d6b/db5/df1/fb1 to d1/d4/d26/d11/d4a/d6b/db5/db9/ff6 0 2024-04-20T10:54:55.888 INFO:tasks.workunit.client.0.smithi090.stdout:6/766: fsync d1/d19/d36/d1e/d1f/d3f/f96 0 2024-04-20T10:54:55.888 INFO:tasks.workunit.client.0.smithi090.stdout:6/767: mkdir d1/d19/d36/d1e/d1f/d3f/df7 0 2024-04-20T10:54:55.888 INFO:tasks.workunit.client.0.smithi090.stdout:6/768: truncate d1/d19/d36/d1e/d74/fda 224706 0 2024-04-20T10:54:55.890 INFO:tasks.workunit.client.0.smithi090.stdout:4/830: write d7/f21 [62188,87588] 0 2024-04-20T10:54:55.890 INFO:tasks.workunit.client.0.smithi090.stdout:4/831: truncate d7/d9/d47/df9/d70/da1/dcd/f45 4554897 0 2024-04-20T10:54:55.891 INFO:tasks.workunit.client.0.smithi090.stdout:6/769: creat d1/d4/d26/d11/d35/d97/ff8 x:0 0 0 2024-04-20T10:54:55.891 INFO:tasks.workunit.client.0.smithi090.stdout:6/770: write d1/d4/f30 [542617,15249] 0 2024-04-20T10:54:55.892 INFO:tasks.workunit.client.0.smithi090.stdout:4/832: truncate d7/d9/d47/f6f 2653486 0 2024-04-20T10:54:55.893 INFO:tasks.workunit.client.0.smithi090.stdout:6/771: creat d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/ff9 x:0 0 0 2024-04-20T10:54:55.894 INFO:tasks.workunit.client.0.smithi090.stdout:4/833: symlink d7/d9/d47/df9/d103/l110 0 2024-04-20T10:54:55.896 INFO:tasks.workunit.client.0.smithi090.stdout:6/772: creat d1/d19/d36/d1e/d1f/d3f/d54/d9f/ffa x:0 0 0 2024-04-20T10:54:55.899 INFO:tasks.workunit.client.0.smithi090.stdout:3/827: dwrite d7/d11/dd0/fe5 [0,4194304] 0 2024-04-20T10:54:55.919 INFO:tasks.workunit.client.0.smithi090.stdout:4/834: dwrite d7/f21 [4194304,4194304] 0 2024-04-20T10:54:55.919 INFO:tasks.workunit.client.0.smithi090.stdout:4/835: dread - d7/d9/d17/fed zero size 2024-04-20T10:54:55.919 INFO:tasks.workunit.client.0.smithi090.stdout:4/836: truncate d7/d9/d47/df9/d70/da1/dcd/d76/f96 139360 0 2024-04-20T10:54:55.920 INFO:tasks.workunit.client.0.smithi090.stdout:4/837: stat d7/f52 0 2024-04-20T10:54:55.920 INFO:tasks.workunit.client.0.smithi090.stdout:6/773: dwrite d1/d4/d26/d11/d35/d97/ff5 [0,4194304] 0 2024-04-20T10:54:55.921 INFO:tasks.workunit.client.0.smithi090.stdout:3/828: mknod d7/d15/c107 0 2024-04-20T10:54:55.922 INFO:tasks.workunit.client.0.smithi090.stdout:3/829: dread d7/d26/d78/fb8 [0,4194304] 0 2024-04-20T10:54:55.923 INFO:tasks.workunit.client.0.smithi090.stdout:6/774: creat d1/d4/d26/d11/d4a/d6b/d6f/ffb x:0 0 0 2024-04-20T10:54:55.933 INFO:tasks.workunit.client.0.smithi090.stdout:6/775: write d1/d19/f59 [445386,50528] 0 2024-04-20T10:54:55.933 INFO:tasks.workunit.client.0.smithi090.stdout:6/776: chown d1/d4/cba 0 1 2024-04-20T10:54:55.933 INFO:tasks.workunit.client.0.smithi090.stdout:6/777: chown d1/d4/d26/d11/d4a/fde 13274370 1 2024-04-20T10:54:55.934 INFO:tasks.workunit.client.0.smithi090.stdout:3/830: mkdir d7/d26/d108 0 2024-04-20T10:54:55.935 INFO:tasks.workunit.client.0.smithi090.stdout:6/778: rename d1/d19/d36/d1e/cb6 to d1/d19/d36/cfc 0 2024-04-20T10:54:55.935 INFO:tasks.workunit.client.0.smithi090.stdout:6/779: chown d1/d4/d26/d11/d4a/f83 480604 1 2024-04-20T10:54:55.936 INFO:tasks.workunit.client.0.smithi090.stdout:3/831: creat d7/d43/dd9/f109 x:0 0 0 2024-04-20T10:54:55.937 INFO:tasks.workunit.client.0.smithi090.stdout:3/832: dread - d7/d35/fde zero size 2024-04-20T10:54:55.937 INFO:tasks.workunit.client.0.smithi090.stdout:3/833: chown d7/d43/db7 0 1 2024-04-20T10:54:55.937 INFO:tasks.workunit.client.0.smithi090.stdout:4/838: dwrite d7/d9/d47/df9/d70/da1/dcd/d42/f105 [0,4194304] 0 2024-04-20T10:54:55.937 INFO:tasks.workunit.client.0.smithi090.stdout:4/839: dread - d7/d9/d17/da0/ff2 zero size 2024-04-20T10:54:55.938 INFO:tasks.workunit.client.0.smithi090.stdout:6/780: link d1/d4/d26/d11/d4a/d6b/db5/df1/ceb d1/d4/d26/d11/d4a/d6b/db5/cfd 0 2024-04-20T10:54:55.938 INFO:tasks.workunit.client.0.smithi090.stdout:6/781: write d1/d4/d26/d11/d4a/d56/fed [682166,51154] 0 2024-04-20T10:54:55.942 INFO:tasks.workunit.client.0.smithi090.stdout:3/834: dread d7/f19 [0,4194304] 0 2024-04-20T10:54:55.946 INFO:tasks.workunit.client.0.smithi090.stdout:4/840: write d7/f21 [7032602,121003] 0 2024-04-20T10:54:55.947 INFO:tasks.workunit.client.0.smithi090.stdout:4/841: readlink d7/d9/l3b 0 2024-04-20T10:54:55.950 INFO:tasks.workunit.client.0.smithi090.stdout:6/782: rename d1/d19/d36/d1e/d74/fda to d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/ffe 0 2024-04-20T10:54:55.996 INFO:tasks.workunit.client.1.smithi175.stdout:5/403: creat db/d11/d25/d62/f7c x:0 0 0 2024-04-20T10:54:55.997 INFO:tasks.workunit.client.1.smithi175.stdout:9/374: write d6/d33/f5c [69364,130901] 0 2024-04-20T10:54:55.998 INFO:tasks.workunit.client.1.smithi175.stdout:1/304: rename d0/d8/d13/c16 to d0/d29/c64 0 2024-04-20T10:54:55.999 INFO:tasks.workunit.client.1.smithi175.stdout:5/404: dread - db/d30/d46/d4b/d4f/f52 zero size 2024-04-20T10:54:55.999 INFO:tasks.workunit.client.1.smithi175.stdout:9/375: rmdir d6/d58 39 2024-04-20T10:54:56.004 INFO:tasks.workunit.client.1.smithi175.stdout:6/413: mknod d1/d5/d12/d7f/c96 0 2024-04-20T10:54:56.006 INFO:tasks.workunit.client.1.smithi175.stdout:0/326: write df/d17/f2a [3184969,76056] 0 2024-04-20T10:54:56.007 INFO:tasks.workunit.client.1.smithi175.stdout:2/299: rename d1/c5a to d1/d7/c66 0 2024-04-20T10:54:56.008 INFO:tasks.workunit.client.1.smithi175.stdout:8/365: mkdir d7/d55/d6c 0 2024-04-20T10:54:56.008 INFO:tasks.workunit.client.1.smithi175.stdout:1/305: mknod d0/d57/c65 0 2024-04-20T10:54:56.010 INFO:tasks.workunit.client.1.smithi175.stdout:0/327: stat df/f11 0 2024-04-20T10:54:56.010 INFO:tasks.workunit.client.1.smithi175.stdout:9/376: read d6/f4c [485774,49191] 0 2024-04-20T10:54:56.015 INFO:tasks.workunit.client.1.smithi175.stdout:5/405: write db/d11/f2d [249802,44228] 0 2024-04-20T10:54:56.016 INFO:tasks.workunit.client.1.smithi175.stdout:9/377: readlink d6/d10/l37 0 2024-04-20T10:54:56.017 INFO:tasks.workunit.client.1.smithi175.stdout:6/414: dread d1/f16 [0,4194304] 0 2024-04-20T10:54:56.017 INFO:tasks.workunit.client.1.smithi175.stdout:1/306: symlink d0/l66 0 2024-04-20T10:54:56.018 INFO:tasks.workunit.client.1.smithi175.stdout:0/328: dread - df/d1a/d28/f42 zero size 2024-04-20T10:54:56.020 INFO:tasks.workunit.client.1.smithi175.stdout:1/307: stat d0/d51 0 2024-04-20T10:54:56.022 INFO:tasks.workunit.client.1.smithi175.stdout:0/329: creat df/d1a/d22/d24/d37/f65 x:0 0 0 2024-04-20T10:54:56.023 INFO:tasks.workunit.client.1.smithi175.stdout:2/300: rename d1/d48/d38/c5d to d1/d7/d63/d36/c67 0 2024-04-20T10:54:56.023 INFO:tasks.workunit.client.1.smithi175.stdout:5/406: readlink db/d1f/d31/d35/l64 0 2024-04-20T10:54:56.024 INFO:tasks.workunit.client.1.smithi175.stdout:9/378: mknod d6/c6a 0 2024-04-20T10:54:56.028 INFO:tasks.workunit.client.1.smithi175.stdout:2/301: fdatasync d1/d48/f1b 0 2024-04-20T10:54:56.029 INFO:tasks.workunit.client.1.smithi175.stdout:9/379: readlink d6/d10/l30 0 2024-04-20T10:54:56.029 INFO:tasks.workunit.client.1.smithi175.stdout:9/380: stat d6/d1b/c67 0 2024-04-20T10:54:56.030 INFO:tasks.workunit.client.1.smithi175.stdout:0/330: fsync df/d19/f1e 0 2024-04-20T10:54:56.031 INFO:tasks.workunit.client.1.smithi175.stdout:2/302: stat d1/d48/d21/d29/c28 0 2024-04-20T10:54:56.031 INFO:tasks.workunit.client.1.smithi175.stdout:5/407: chown db/d30/d46/d4b/d4f/d5a/c61 73063820 1 2024-04-20T10:54:56.032 INFO:tasks.workunit.client.1.smithi175.stdout:9/381: creat d6/d1b/d2f/f6b x:0 0 0 2024-04-20T10:54:56.032 INFO:tasks.workunit.client.1.smithi175.stdout:0/331: readlink df/d1a/d28/l2c 0 2024-04-20T10:54:56.033 INFO:tasks.workunit.client.1.smithi175.stdout:8/366: dwrite d7/d13/f3a [4194304,4194304] 0 2024-04-20T10:54:56.033 INFO:tasks.workunit.client.1.smithi175.stdout:0/332: read - df/d1a/d22/d24/d37/d48/d4e/f61 zero size 2024-04-20T10:54:56.034 INFO:tasks.workunit.client.1.smithi175.stdout:2/303: truncate d1/d48/f41 8757 0 2024-04-20T10:54:56.036 INFO:tasks.workunit.client.1.smithi175.stdout:1/308: dread d0/f1e [0,4194304] 0 2024-04-20T10:54:56.037 INFO:tasks.workunit.client.1.smithi175.stdout:5/408: link db/d30/d46/d4b/d4f/f78 db/d1f/f7d 0 2024-04-20T10:54:56.038 INFO:tasks.workunit.client.1.smithi175.stdout:7/443: dwrite db/d1d/d39/d50/d12/d47/d6a/f72 [0,4194304] 0 2024-04-20T10:54:56.040 INFO:tasks.workunit.client.1.smithi175.stdout:2/304: mkdir d1/d48/d38/d68 0 2024-04-20T10:54:56.042 INFO:tasks.workunit.client.1.smithi175.stdout:1/309: link d0/d8/d13/d2e/d35/f63 d0/d3e/d61/f67 0 2024-04-20T10:54:56.042 INFO:tasks.workunit.client.1.smithi175.stdout:5/409: chown db/d11/d1a/f72 102318855 1 2024-04-20T10:54:56.043 INFO:tasks.workunit.client.1.smithi175.stdout:6/415: write d1/d40/d46/d60/f86 [204709,41692] 0 2024-04-20T10:54:56.046 INFO:tasks.workunit.client.1.smithi175.stdout:7/444: dread db/d1d/d39/d50/f55 [0,4194304] 0 2024-04-20T10:54:56.047 INFO:tasks.workunit.client.1.smithi175.stdout:2/305: read d1/d7/ff [5219,118356] 0 2024-04-20T10:54:56.047 INFO:tasks.workunit.client.1.smithi175.stdout:9/382: symlink d6/d1b/d26/l6c 0 2024-04-20T10:54:56.048 INFO:tasks.workunit.client.1.smithi175.stdout:0/333: write df/d17/d2f/f5b [830480,41447] 0 2024-04-20T10:54:56.049 INFO:tasks.workunit.client.1.smithi175.stdout:5/410: creat db/d30/d46/f7e x:0 0 0 2024-04-20T10:54:56.052 INFO:tasks.workunit.client.1.smithi175.stdout:7/445: readlink db/d1d/d39/d50/d12/l62 0 2024-04-20T10:54:56.053 INFO:tasks.workunit.client.1.smithi175.stdout:0/334: readlink df/d1a/d22/l59 0 2024-04-20T10:54:56.056 INFO:tasks.workunit.client.1.smithi175.stdout:2/306: rename d1/d7/d63/d36/c67 to d1/d7/d63/c69 0 2024-04-20T10:54:56.062 INFO:tasks.workunit.client.1.smithi175.stdout:7/446: stat db/d1d/d29/d8e/c8b 0 2024-04-20T10:54:56.063 INFO:tasks.workunit.client.1.smithi175.stdout:9/383: mknod d6/d33/d63/c6d 0 2024-04-20T10:54:56.067 INFO:tasks.workunit.client.1.smithi175.stdout:0/335: rmdir df/d1a/d22/d24/d5f 0 2024-04-20T10:54:56.068 INFO:tasks.workunit.client.1.smithi175.stdout:6/416: symlink d1/d40/d46/d60/d68/d7e/l97 0 2024-04-20T10:54:56.069 INFO:tasks.workunit.client.1.smithi175.stdout:7/447: fdatasync db/d1d/d29/f3c 0 2024-04-20T10:54:56.072 INFO:tasks.workunit.client.1.smithi175.stdout:7/448: getdents db/d1d/d29/d8e 0 2024-04-20T10:54:56.074 INFO:tasks.workunit.client.1.smithi175.stdout:9/384: mknod d6/c6e 0 2024-04-20T10:54:56.079 INFO:tasks.workunit.client.1.smithi175.stdout:7/449: unlink db/d1d/d29/d2a/d41/f6c 0 2024-04-20T10:54:56.080 INFO:tasks.workunit.client.1.smithi175.stdout:7/450: truncate db/d1d/d39/d50/d12/d47/f9b 990964 0 2024-04-20T10:54:56.083 INFO:tasks.workunit.client.1.smithi175.stdout:0/336: write df/d17/f18 [4338497,61169] 0 2024-04-20T10:54:56.084 INFO:tasks.workunit.client.1.smithi175.stdout:1/310: dwrite d0/d29/f5c [0,4194304] 0 2024-04-20T10:54:56.084 INFO:tasks.workunit.client.1.smithi175.stdout:0/337: creat df/d17/d2f/f66 x:0 0 0 2024-04-20T10:54:56.085 INFO:tasks.workunit.client.1.smithi175.stdout:5/411: dwrite db/d1f/d31/f33 [0,4194304] 0 2024-04-20T10:54:56.086 INFO:tasks.workunit.client.0.smithi090.stdout:3/835: rename d7/d43/db7/ff7 to d7/d15/d2a/d30/f10a 0 2024-04-20T10:54:56.086 INFO:tasks.workunit.client.0.smithi090.stdout:3/836: readlink d7/d15/d2a/d30/d93/d7f/l91 0 2024-04-20T10:54:56.087 INFO:tasks.workunit.client.0.smithi090.stdout:6/783: rename d1/d19/d36/c6d to d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/cff 0 2024-04-20T10:54:56.090 INFO:tasks.workunit.client.1.smithi175.stdout:5/412: creat db/d11/f7f x:0 0 0 2024-04-20T10:54:56.090 INFO:tasks.workunit.client.1.smithi175.stdout:0/338: dread df/d1a/d22/f44 [0,4194304] 0 2024-04-20T10:54:56.094 INFO:tasks.workunit.client.1.smithi175.stdout:5/413: unlink db/f63 0 2024-04-20T10:54:56.096 INFO:tasks.workunit.client.1.smithi175.stdout:5/414: fsync db/d30/d46/d4b/f5c 0 2024-04-20T10:54:56.097 INFO:tasks.workunit.client.0.smithi090.stdout:3/837: dread d7/d15/d2a/d30/d93/f6d [0,4194304] 0 2024-04-20T10:54:56.097 INFO:tasks.workunit.client.0.smithi090.stdout:3/838: write d7/d26/f3c [1959681,78580] 0 2024-04-20T10:54:56.097 INFO:tasks.workunit.client.0.smithi090.stdout:3/839: readlink d7/d26/l80 0 2024-04-20T10:54:56.099 INFO:tasks.workunit.client.0.smithi090.stdout:6/784: link d1/d4/d26/ca d1/d4/d26/d11/d35/c100 0 2024-04-20T10:54:56.100 INFO:tasks.workunit.client.0.smithi090.stdout:3/840: mkdir d7/d15/d2a/da2/df0/d10b 0 2024-04-20T10:54:56.100 INFO:tasks.workunit.client.0.smithi090.stdout:3/841: write d7/d15/d47/fbd [538047,10330] 0 2024-04-20T10:54:56.100 INFO:tasks.workunit.client.0.smithi090.stdout:3/842: truncate d7/d15/d2a/d30/d93/fae 234386 0 2024-04-20T10:54:56.102 INFO:tasks.workunit.client.0.smithi090.stdout:6/785: rename d1/d19/d36/d1e/d1f/d3f/d54/ld4 to d1/d4/d26/l101 0 2024-04-20T10:54:56.103 INFO:tasks.workunit.client.0.smithi090.stdout:3/843: mkdir d7/ddd/d10c 0 2024-04-20T10:54:56.106 INFO:tasks.workunit.client.0.smithi090.stdout:6/786: rename d1/d19/d36/d1e/d1f/d3f/d81/fb7 to d1/d4/d26/d11/d4a/d6b/db5/db9/f102 0 2024-04-20T10:54:56.110 INFO:tasks.workunit.client.1.smithi175.stdout:1/311: write d0/d8/d13/f26 [1373116,99813] 0 2024-04-20T10:54:56.111 INFO:tasks.workunit.client.1.smithi175.stdout:1/312: truncate d0/d29/f4f 3646429 0 2024-04-20T10:54:56.112 INFO:tasks.workunit.client.1.smithi175.stdout:1/313: mknod d0/c68 0 2024-04-20T10:54:56.118 INFO:tasks.workunit.client.1.smithi175.stdout:0/339: dwrite df/d1a/d22/f44 [0,4194304] 0 2024-04-20T10:54:56.120 INFO:tasks.workunit.client.1.smithi175.stdout:5/415: dread db/d11/d1a/f39 [0,4194304] 0 2024-04-20T10:54:56.130 INFO:tasks.workunit.client.0.smithi090.stdout:8/880: sync 2024-04-20T10:54:56.130 INFO:tasks.workunit.client.0.smithi090.stdout:7/840: sync 2024-04-20T10:54:56.130 INFO:tasks.workunit.client.0.smithi090.stdout:8/881: stat d0/d26/da7/df5/dcf/dd5/df9/d113/c118 0 2024-04-20T10:54:56.130 INFO:tasks.workunit.client.0.smithi090.stdout:8/882: fsync d0/d26/da7/da9/fb7 0 2024-04-20T10:54:56.131 INFO:tasks.workunit.client.0.smithi090.stdout:6/787: mkdir d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/d103 0 2024-04-20T10:54:56.131 INFO:tasks.workunit.client.0.smithi090.stdout:6/788: write d1/d19/d36/d28/fd1 [902220,108177] 0 2024-04-20T10:54:56.132 INFO:tasks.workunit.client.1.smithi175.stdout:1/314: symlink d0/d3e/l69 0 2024-04-20T10:54:56.134 INFO:tasks.workunit.client.1.smithi175.stdout:1/315: link d0/d3e/c4a d0/d57/c6a 0 2024-04-20T10:54:56.134 INFO:tasks.workunit.client.1.smithi175.stdout:7/451: dwrite db/d1d/d29/d2a/f84 [0,4194304] 0 2024-04-20T10:54:56.134 INFO:tasks.workunit.client.1.smithi175.stdout:0/340: symlink df/d2e/l67 0 2024-04-20T10:54:56.137 INFO:tasks.workunit.client.1.smithi175.stdout:7/452: mkdir db/d1d/d39/d50/d12/daa 0 2024-04-20T10:54:56.137 INFO:tasks.workunit.client.0.smithi090.stdout:8/883: dread d0/d3a/d9f/f7c [0,4194304] 0 2024-04-20T10:54:56.138 INFO:tasks.workunit.client.1.smithi175.stdout:7/453: creat db/d1d/d29/fab x:0 0 0 2024-04-20T10:54:56.139 INFO:tasks.workunit.client.1.smithi175.stdout:6/417: dwrite d1/d40/d49/f62 [0,4194304] 0 2024-04-20T10:54:56.140 INFO:tasks.workunit.client.0.smithi090.stdout:8/884: dread d0/d3a/f6e [0,4194304] 0 2024-04-20T10:54:56.140 INFO:tasks.workunit.client.1.smithi175.stdout:7/454: getdents db/d1d/d39 0 2024-04-20T10:54:56.141 INFO:tasks.workunit.client.0.smithi090.stdout:7/841: symlink d11/d13/d5d/db0/l10a 0 2024-04-20T10:54:56.142 INFO:tasks.workunit.client.0.smithi090.stdout:8/885: rename d0/d11/d22/d53/d57/dd3/d10a/d114 to d0/d26/da7/da9/d11e 0 2024-04-20T10:54:56.143 INFO:tasks.workunit.client.0.smithi090.stdout:8/886: chown d0/d26/f39 99 1 2024-04-20T10:54:56.143 INFO:tasks.workunit.client.0.smithi090.stdout:7/842: truncate d11/d13/d5b/db8/dbf/fac 32199 0 2024-04-20T10:54:56.147 INFO:tasks.workunit.client.1.smithi175.stdout:1/316: mkdir d0/d51/d6b 0 2024-04-20T10:54:56.148 INFO:tasks.workunit.client.1.smithi175.stdout:1/317: symlink d0/d57/l6c 0 2024-04-20T10:54:56.149 INFO:tasks.workunit.client.1.smithi175.stdout:7/455: mkdir db/d1d/d39/d50/d12/d47/dac 0 2024-04-20T10:54:56.150 INFO:tasks.workunit.client.1.smithi175.stdout:7/456: fdatasync db/d1d/d29/f3c 0 2024-04-20T10:54:56.151 INFO:tasks.workunit.client.1.smithi175.stdout:1/318: mknod d0/d8/d13/d2e/c6d 0 2024-04-20T10:54:56.153 INFO:tasks.workunit.client.1.smithi175.stdout:1/319: rmdir d0/d51 39 2024-04-20T10:54:56.154 INFO:tasks.workunit.client.1.smithi175.stdout:1/320: mknod d0/c6e 0 2024-04-20T10:54:56.156 INFO:tasks.workunit.client.0.smithi090.stdout:7/843: write d11/d1a/d3b/ddf/fef [4133067,20769] 0 2024-04-20T10:54:56.159 INFO:tasks.workunit.client.0.smithi090.stdout:7/844: creat d11/d13/d22/d27/f10b x:0 0 0 2024-04-20T10:54:56.162 INFO:tasks.workunit.client.0.smithi090.stdout:3/844: dwrite d7/f40 [0,4194304] 0 2024-04-20T10:54:56.162 INFO:tasks.workunit.client.0.smithi090.stdout:3/845: write d7/df/dd1/f101 [95019,116743] 0 2024-04-20T10:54:56.163 INFO:tasks.workunit.client.0.smithi090.stdout:6/789: dwrite d1/d4/f66 [0,4194304] 0 2024-04-20T10:54:56.164 INFO:tasks.workunit.client.1.smithi175.stdout:9/385: dwrite d6/d33/d63/f49 [0,4194304] 0 2024-04-20T10:54:56.164 INFO:tasks.workunit.client.1.smithi175.stdout:0/341: dwrite df/d17/f18 [0,4194304] 0 2024-04-20T10:54:56.165 INFO:tasks.workunit.client.0.smithi090.stdout:3/846: symlink d7/df/dd1/dd3/l10d 0 2024-04-20T10:54:56.167 INFO:tasks.workunit.client.0.smithi090.stdout:6/790: creat d1/d4/f104 x:0 0 0 2024-04-20T10:54:56.168 INFO:tasks.workunit.client.0.smithi090.stdout:6/791: stat d1/d4/d26/d11/d35/f8c 0 2024-04-20T10:54:56.168 INFO:tasks.workunit.client.1.smithi175.stdout:9/386: truncate d6/d1b/d26/f2b 334423 0 2024-04-20T10:54:56.169 INFO:tasks.workunit.client.0.smithi090.stdout:3/847: creat d7/d43/db7/ddf/f10e x:0 0 0 2024-04-20T10:54:56.170 INFO:tasks.workunit.client.1.smithi175.stdout:0/342: truncate df/d17/d2f/f5b 75522 0 2024-04-20T10:54:56.171 INFO:tasks.workunit.client.0.smithi090.stdout:3/848: getdents d7/d15/d47/d56 0 2024-04-20T10:54:56.173 INFO:tasks.workunit.client.1.smithi175.stdout:0/343: creat df/d1a/d22/d24/f68 x:0 0 0 2024-04-20T10:54:56.179 INFO:tasks.workunit.client.1.smithi175.stdout:7/457: write db/d1d/d39/d50/d12/f6b [457311,81689] 0 2024-04-20T10:54:56.179 INFO:tasks.workunit.client.1.smithi175.stdout:7/458: write db/d1d/d29/d2a/fa8 [1030469,87256] 0 2024-04-20T10:54:56.180 INFO:tasks.workunit.client.1.smithi175.stdout:7/459: creat db/d1d/d39/fad x:0 0 0 2024-04-20T10:54:56.180 INFO:tasks.workunit.client.0.smithi090.stdout:4/842: sync 2024-04-20T10:54:56.181 INFO:tasks.workunit.client.0.smithi090.stdout:4/843: getdents d7/d97 0 2024-04-20T10:54:56.183 INFO:tasks.workunit.client.0.smithi090.stdout:4/844: mkdir d7/d9/d92/d111 0 2024-04-20T10:54:56.183 INFO:tasks.workunit.client.0.smithi090.stdout:4/845: write d7/d9/d47/d8d/dda/db5/feb [4788950,70064] 0 2024-04-20T10:54:56.185 INFO:tasks.workunit.client.1.smithi175.stdout:0/344: creat df/d1a/d22/d24/d37/d48/d4e/f69 x:0 0 0 2024-04-20T10:54:56.185 INFO:tasks.workunit.client.0.smithi090.stdout:4/846: unlink d7/d9/d17/c5e 0 2024-04-20T10:54:56.186 INFO:tasks.workunit.client.0.smithi090.stdout:7/845: dwrite d11/d13/d5b/fb6 [0,4194304] 0 2024-04-20T10:54:56.186 INFO:tasks.workunit.client.0.smithi090.stdout:7/846: fdatasync d11/d13/d22/d27/fca 0 2024-04-20T10:54:56.186 INFO:tasks.workunit.client.0.smithi090.stdout:7/847: readlink d11/d13/d5d/l83 0 2024-04-20T10:54:56.187 INFO:tasks.workunit.client.0.smithi090.stdout:6/792: dwrite d1/d4/d26/d11/d4a/f68 [0,4194304] 0 2024-04-20T10:54:56.188 INFO:tasks.workunit.client.0.smithi090.stdout:4/847: symlink d7/d9/d47/df9/d70/da1/dcd/d3d/dd2/l112 0 2024-04-20T10:54:56.188 INFO:tasks.workunit.client.0.smithi090.stdout:4/848: fdatasync d7/d9/f39 0 2024-04-20T10:54:56.189 INFO:tasks.workunit.client.0.smithi090.stdout:7/848: mknod d11/d1a/d3f/c10c 0 2024-04-20T10:54:56.190 INFO:tasks.workunit.client.1.smithi175.stdout:6/418: dwrite d1/d5/fa [0,4194304] 0 2024-04-20T10:54:56.191 INFO:tasks.workunit.client.0.smithi090.stdout:7/849: mkdir d11/d1a/d3b/dc8/d10d 0 2024-04-20T10:54:56.191 INFO:tasks.workunit.client.0.smithi090.stdout:7/850: stat d11/lf7 0 2024-04-20T10:54:56.191 INFO:tasks.workunit.client.0.smithi090.stdout:7/851: read - d11/d13/d33/d44/d89/d98/dc7/fea zero size 2024-04-20T10:54:56.191 INFO:tasks.workunit.client.0.smithi090.stdout:7/852: read d11/d13/d23/fc5 [292278,19189] 0 2024-04-20T10:54:56.198 INFO:tasks.workunit.client.1.smithi175.stdout:0/345: dread df/f38 [0,4194304] 0 2024-04-20T10:54:56.200 INFO:tasks.workunit.client.1.smithi175.stdout:0/346: mkdir df/d1a/d22/d6a 0 2024-04-20T10:54:56.201 INFO:tasks.workunit.client.1.smithi175.stdout:0/347: fsync df/d1a/d22/d24/d37/d48/d4e/f5d 0 2024-04-20T10:54:56.202 INFO:tasks.workunit.client.0.smithi090.stdout:6/793: dread d1/d4/d26/d11/f17 [0,4194304] 0 2024-04-20T10:54:56.204 INFO:tasks.workunit.client.0.smithi090.stdout:6/794: creat d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/de3/f105 x:0 0 0 2024-04-20T10:54:56.204 INFO:tasks.workunit.client.0.smithi090.stdout:3/849: dwrite d7/d15/d2a/d30/f4c [0,4194304] 0 2024-04-20T10:54:56.204 INFO:tasks.workunit.client.0.smithi090.stdout:6/795: write d1/d4/d26/d11/d35/d80/f9c [1084714,56621] 0 2024-04-20T10:54:56.206 INFO:tasks.workunit.client.0.smithi090.stdout:6/796: mknod d1/d19/d36/d1e/d1f/d3f/df7/c106 0 2024-04-20T10:54:56.206 INFO:tasks.workunit.client.1.smithi175.stdout:6/419: mknod d1/d40/d46/d60/d6b/c98 0 2024-04-20T10:54:56.207 INFO:tasks.workunit.client.1.smithi175.stdout:1/321: dwrite d0/d8/f18 [0,4194304] 0 2024-04-20T10:54:56.207 INFO:tasks.workunit.client.0.smithi090.stdout:4/849: write d7/d9/d92/fc7 [2553750,127766] 0 2024-04-20T10:54:56.207 INFO:tasks.workunit.client.0.smithi090.stdout:6/797: truncate d1/d4/f88 2465046 0 2024-04-20T10:54:56.208 INFO:tasks.workunit.client.1.smithi175.stdout:9/387: dwrite d6/f1d [0,4194304] 0 2024-04-20T10:54:56.208 INFO:tasks.workunit.client.1.smithi175.stdout:6/420: creat d1/d40/f99 x:0 0 0 2024-04-20T10:54:56.209 INFO:tasks.workunit.client.0.smithi090.stdout:4/850: creat d7/d9/d47/df9/d70/da1/dcd/d42/d8f/f113 x:0 0 0 2024-04-20T10:54:56.210 INFO:tasks.workunit.client.0.smithi090.stdout:4/851: symlink d7/d9/d47/df9/d9d/df8/l114 0 2024-04-20T10:54:56.210 INFO:tasks.workunit.client.1.smithi175.stdout:1/322: truncate d0/fe 4842646 0 2024-04-20T10:54:56.212 INFO:tasks.workunit.client.0.smithi090.stdout:4/852: rename d7/d9/d47/df9/c7f to d7/d9/d47/df9/d70/da1/dcd/d3d/dd2/c115 0 2024-04-20T10:54:56.214 INFO:tasks.workunit.client.1.smithi175.stdout:0/348: dread df/f10 [0,4194304] 0 2024-04-20T10:54:56.216 INFO:tasks.workunit.client.1.smithi175.stdout:1/323: rename d0/d8/d13/c58 to d0/d29/c6f 0 2024-04-20T10:54:56.217 INFO:tasks.workunit.client.0.smithi090.stdout:7/853: dwrite d11/d1a/f1b [0,4194304] 0 2024-04-20T10:54:56.217 INFO:tasks.workunit.client.0.smithi090.stdout:7/854: readlink d11/l19 0 2024-04-20T10:54:56.217 INFO:tasks.workunit.client.0.smithi090.stdout:3/850: dread d7/d15/fef [0,4194304] 0 2024-04-20T10:54:56.219 INFO:tasks.workunit.client.1.smithi175.stdout:0/349: truncate df/f1c 4718675 0 2024-04-20T10:54:56.220 INFO:tasks.workunit.client.0.smithi090.stdout:3/851: creat d7/d43/f10f x:0 0 0 2024-04-20T10:54:56.221 INFO:tasks.workunit.client.0.smithi090.stdout:3/852: write d7/df/dd1/dd3/fd7 [901035,79907] 0 2024-04-20T10:54:56.221 INFO:tasks.workunit.client.0.smithi090.stdout:3/853: fdatasync d7/d15/d2a/d30/d48/f4f 0 2024-04-20T10:54:56.221 INFO:tasks.workunit.client.0.smithi090.stdout:3/854: dread - d7/d35/fc7 zero size 2024-04-20T10:54:56.221 INFO:tasks.workunit.client.0.smithi090.stdout:3/855: fdatasync d7/d15/d2a/d30/d48/f4f 0 2024-04-20T10:54:56.221 INFO:tasks.workunit.client.0.smithi090.stdout:3/856: rename d7/d15/d2a/l96 to d7/d15/d2a/de4/l110 0 2024-04-20T10:54:56.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/421: creat d1/d5/d12/d73/d7a/f9a x:0 0 0 2024-04-20T10:54:56.227 INFO:tasks.workunit.client.0.smithi090.stdout:6/798: dwrite d1/d4/d26/d11/f41 [0,4194304] 0 2024-04-20T10:54:56.228 INFO:tasks.workunit.client.1.smithi175.stdout:6/422: mkdir d1/d5/d12/d22/d9b 0 2024-04-20T10:54:56.228 INFO:tasks.workunit.client.1.smithi175.stdout:0/350: dread df/d19/f31 [0,4194304] 0 2024-04-20T10:54:56.228 INFO:tasks.workunit.client.1.smithi175.stdout:7/460: dwrite db/d1d/d39/d50/d12/d47/f9b [0,4194304] 0 2024-04-20T10:54:56.231 INFO:tasks.workunit.client.0.smithi090.stdout:6/799: symlink d1/d4/d26/d11/d4a/db3/l107 0 2024-04-20T10:54:56.231 INFO:tasks.workunit.client.1.smithi175.stdout:6/423: truncate d1/d40/d29/f4b 713699 0 2024-04-20T10:54:56.231 INFO:tasks.workunit.client.1.smithi175.stdout:0/351: mknod df/d1a/d22/d24/c6b 0 2024-04-20T10:54:56.232 INFO:tasks.workunit.client.1.smithi175.stdout:6/424: chown d1/d5/d12/f35 114798 1 2024-04-20T10:54:56.234 INFO:tasks.workunit.client.1.smithi175.stdout:0/352: chown df/d2e/f47 41864 1 2024-04-20T10:54:56.234 INFO:tasks.workunit.client.1.smithi175.stdout:0/353: truncate df/d1a/d22/d24/f68 959816 0 2024-04-20T10:54:56.234 INFO:tasks.workunit.client.1.smithi175.stdout:0/354: chown df/d2e/f47 50 1 2024-04-20T10:54:56.234 INFO:tasks.workunit.client.1.smithi175.stdout:0/355: fsync df/d1a/d28/f42 0 2024-04-20T10:54:56.234 INFO:tasks.workunit.client.1.smithi175.stdout:0/356: fsync df/d1a/d22/d24/f68 0 2024-04-20T10:54:56.235 INFO:tasks.workunit.client.1.smithi175.stdout:7/461: dread db/d1d/d29/d8e/f2d [0,4194304] 0 2024-04-20T10:54:56.237 INFO:tasks.workunit.client.1.smithi175.stdout:6/425: symlink d1/d40/l9c 0 2024-04-20T10:54:56.238 INFO:tasks.workunit.client.1.smithi175.stdout:0/357: rmdir df/d1a/d22/d24/d37/d48/d5c 0 2024-04-20T10:54:56.240 INFO:tasks.workunit.client.1.smithi175.stdout:0/358: chown df/l32 4970 1 2024-04-20T10:54:56.240 INFO:tasks.workunit.client.1.smithi175.stdout:0/359: stat df/d1a/c2b 0 2024-04-20T10:54:56.242 INFO:tasks.workunit.client.0.smithi090.stdout:3/857: dwrite d7/df/dd1/dd3/f89 [0,4194304] 0 2024-04-20T10:54:56.243 INFO:tasks.workunit.client.1.smithi175.stdout:8/367: dwrite d7/d13/d1d/d24/d39/f3b [4194304,4194304] 0 2024-04-20T10:54:56.244 INFO:tasks.workunit.client.0.smithi090.stdout:6/800: creat d1/d4/d26/d11/d4a/d56/dc7/f108 x:0 0 0 2024-04-20T10:54:56.247 INFO:tasks.workunit.client.0.smithi090.stdout:3/858: unlink d7/d15/d2a/l66 0 2024-04-20T10:54:56.247 INFO:tasks.workunit.client.0.smithi090.stdout:3/859: chown d7/d43/db7 948 1 2024-04-20T10:54:56.248 INFO:tasks.workunit.client.0.smithi090.stdout:6/801: link d1/d4/d26/d11/d4a/d6b/db5/db9/f102 d1/d4/d26/d11/d4a/db3/f109 0 2024-04-20T10:54:56.248 INFO:tasks.workunit.client.0.smithi090.stdout:6/802: fsync d1/d19/d36/f24 0 2024-04-20T10:54:56.248 INFO:tasks.workunit.client.0.smithi090.stdout:6/803: chown d1/d19/d36/d1e/d1f/d3f/df7/c106 2002526 1 2024-04-20T10:54:56.264 INFO:tasks.workunit.client.0.smithi090.stdout:6/804: dwrite d1/d4/d26/d11/d4a/d6b/f89 [0,4194304] 0 2024-04-20T10:54:56.264 INFO:tasks.workunit.client.0.smithi090.stdout:3/860: getdents d7/d15/d2a/d30/d48 0 2024-04-20T10:54:56.292 INFO:tasks.workunit.client.0.smithi090.stdout:3/861: dwrite d7/f8b [0,4194304] 0 2024-04-20T10:54:56.292 INFO:tasks.workunit.client.0.smithi090.stdout:3/862: chown d7/d26/le7 190853030 1 2024-04-20T10:54:56.293 INFO:tasks.workunit.client.0.smithi090.stdout:6/805: unlink d1/d4/d26/d11/d4a/db3/le4 0 2024-04-20T10:54:56.294 INFO:tasks.workunit.client.0.smithi090.stdout:3/863: symlink d7/ddd/d10c/l111 0 2024-04-20T10:54:56.294 INFO:tasks.workunit.client.0.smithi090.stdout:3/864: dread - d7/d43/db7/daf/ffc zero size 2024-04-20T10:54:56.295 INFO:tasks.workunit.client.1.smithi175.stdout:7/462: dwrite db/d1d/d39/d50/f52 [0,4194304] 0 2024-04-20T10:54:56.296 INFO:tasks.workunit.client.1.smithi175.stdout:7/463: stat db/d1d/d29/d2a/f4b 0 2024-04-20T10:54:56.298 INFO:tasks.workunit.client.1.smithi175.stdout:6/426: dwrite d1/d5/d12/d22/f44 [0,4194304] 0 2024-04-20T10:54:56.298 INFO:tasks.workunit.client.1.smithi175.stdout:8/368: mknod d7/d55/c6d 0 2024-04-20T10:54:56.302 INFO:tasks.workunit.client.1.smithi175.stdout:7/464: chown db/d61/c65 0 1 2024-04-20T10:54:56.304 INFO:tasks.workunit.client.1.smithi175.stdout:6/427: creat d1/d40/d46/d60/d6b/f9d x:0 0 0 2024-04-20T10:54:56.306 INFO:tasks.workunit.client.1.smithi175.stdout:6/428: stat d1/d40/f3c 0 2024-04-20T10:54:56.307 INFO:tasks.workunit.client.1.smithi175.stdout:7/465: unlink db/d1d/d39/d50/l20 0 2024-04-20T10:54:56.311 INFO:tasks.workunit.client.1.smithi175.stdout:6/429: unlink d1/d5/d12/d22/f8d 0 2024-04-20T10:54:56.312 INFO:tasks.workunit.client.1.smithi175.stdout:8/369: dread d7/d13/d1d/d24/f2b [0,4194304] 0 2024-04-20T10:54:56.314 INFO:tasks.workunit.client.1.smithi175.stdout:8/370: creat d7/d13/f6e x:0 0 0 2024-04-20T10:54:56.315 INFO:tasks.workunit.client.0.smithi090.stdout:3/865: dwrite d7/d15/f8f [0,4194304] 0 2024-04-20T10:54:56.315 INFO:tasks.workunit.client.0.smithi090.stdout:3/866: write d7/df/dd1/fe2 [421950,107399] 0 2024-04-20T10:54:56.316 INFO:tasks.workunit.client.1.smithi175.stdout:6/430: truncate d1/d37/f61 941844 0 2024-04-20T10:54:56.316 INFO:tasks.workunit.client.0.smithi090.stdout:6/806: mknod d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd/de1/c10a 0 2024-04-20T10:54:56.316 INFO:tasks.workunit.client.0.smithi090.stdout:6/807: fdatasync d1/d19/d36/d28/f34 0 2024-04-20T10:54:56.318 INFO:tasks.workunit.client.1.smithi175.stdout:6/431: creat d1/d40/d46/d60/d68/d7e/f9e x:0 0 0 2024-04-20T10:54:56.319 INFO:tasks.workunit.client.0.smithi090.stdout:4/853: dread d7/d9/f1c [0,4194304] 0 2024-04-20T10:54:56.319 INFO:tasks.workunit.client.0.smithi090.stdout:4/854: readlink d7/d9/d47/df9/d70/da1/dcd/d76/lbb 0 2024-04-20T10:54:56.320 INFO:tasks.workunit.client.0.smithi090.stdout:3/867: mkdir d7/d26/d108/d112 0 2024-04-20T10:54:56.331 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:56.333 INFO:tasks.workunit.client.0.smithi090.stdout:3/868: dread d7/d11/fcc [0,4194304] 0 2024-04-20T10:54:56.335 INFO:tasks.workunit.client.0.smithi090.stdout:4/855: link d7/f2c d7/d9/d47/df9/d103/f116 0 2024-04-20T10:54:56.335 INFO:tasks.workunit.client.0.smithi090.stdout:4/856: getdents d7/d9/d17/d94/df3 0 2024-04-20T10:54:56.335 INFO:tasks.workunit.client.0.smithi090.stdout:4/857: chown d7/d9/d47/df9 919 1 2024-04-20T10:54:56.335 INFO:tasks.workunit.client.0.smithi090.stdout:3/869: getdents d7/d43/db7 0 2024-04-20T10:54:56.341 INFO:tasks.workunit.client.0.smithi090.stdout:6/808: dwrite d1/d19/d36/d1e/fc9 [0,4194304] 0 2024-04-20T10:54:56.341 INFO:tasks.workunit.client.0.smithi090.stdout:6/809: truncate d1/d19/d36/d1e/d1f/d3f/f79 273374 0 2024-04-20T10:54:56.345 INFO:tasks.workunit.client.0.smithi090.stdout:3/870: dread d7/f86 [0,4194304] 0 2024-04-20T10:54:56.347 INFO:tasks.workunit.client.0.smithi090.stdout:6/810: rename d1/d19/d36/d28/fd1 to d1/d4/d26/d11/d35/f10b 0 2024-04-20T10:54:56.348 INFO:tasks.workunit.client.0.smithi090.stdout:3/871: creat d7/d35/da8/f113 x:0 0 0 2024-04-20T10:54:56.348 INFO:tasks.workunit.client.0.smithi090.stdout:3/872: readlink d7/d15/d2a/d8d/l102 0 2024-04-20T10:54:56.348 INFO:tasks.workunit.client.0.smithi090.stdout:6/811: creat d1/d19/f10c x:0 0 0 2024-04-20T10:54:56.354 INFO:tasks.workunit.client.0.smithi090.stdout:4/858: dwrite d7/d9/d47/df9/d70/da1/dcd/d42/f64 [0,4194304] 0 2024-04-20T10:54:56.354 INFO:tasks.workunit.client.0.smithi090.stdout:4/859: stat d7/d9/d47/df9/d9d/df8/l114 0 2024-04-20T10:54:56.357 INFO:tasks.workunit.client.0.smithi090.stdout:3/873: mknod d7/d43/c114 0 2024-04-20T10:54:56.359 INFO:tasks.workunit.client.0.smithi090.stdout:4/860: creat d7/d9/d17/d56/f117 x:0 0 0 2024-04-20T10:54:56.359 INFO:tasks.workunit.client.0.smithi090.stdout:4/861: truncate d7/d9/d47/d8d/f10f 246869 0 2024-04-20T10:54:56.360 INFO:tasks.workunit.client.0.smithi090.stdout:3/874: creat d7/d26/dc9/f115 x:0 0 0 2024-04-20T10:54:56.375 INFO:tasks.workunit.client.0.smithi090.stdout:3/875: dwrite d7/f86 [4194304,4194304] 0 2024-04-20T10:54:56.375 INFO:tasks.workunit.client.0.smithi090.stdout:3/876: fdatasync d7/d15/d2a/d30/d93/fae 0 2024-04-20T10:54:56.376 INFO:tasks.workunit.client.0.smithi090.stdout:4/862: truncate d7/d9/d47/fbc 754123 0 2024-04-20T10:54:56.378 INFO:tasks.workunit.client.0.smithi090.stdout:3/877: creat d7/d26/d108/f116 x:0 0 0 2024-04-20T10:54:56.378 INFO:tasks.workunit.client.0.smithi090.stdout:4/863: creat d7/d9/d47/df9/d70/da1/dcd/f118 x:0 0 0 2024-04-20T10:54:56.383 INFO:tasks.workunit.client.0.smithi090.stdout:6/812: dwrite d1/d19/d36/d1e/f58 [0,4194304] 0 2024-04-20T10:54:56.383 INFO:tasks.workunit.client.0.smithi090.stdout:3/878: unlink d7/d15/d2a/d30/d48/ff5 0 2024-04-20T10:54:56.385 INFO:tasks.workunit.client.0.smithi090.stdout:6/813: creat d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/f10d x:0 0 0 2024-04-20T10:54:56.386 INFO:tasks.workunit.client.0.smithi090.stdout:3/879: mknod d7/d26/d108/c117 0 2024-04-20T10:54:56.386 INFO:tasks.workunit.client.0.smithi090.stdout:3/880: dread - d7/d15/d2a/d8d/f106 zero size 2024-04-20T10:54:56.387 INFO:tasks.workunit.client.0.smithi090.stdout:6/814: creat d1/d4/d26/d11/f10e x:0 0 0 2024-04-20T10:54:56.389 INFO:tasks.workunit.client.0.smithi090.stdout:3/881: link d7/d35/c69 d7/d15/d2a/de4/c118 0 2024-04-20T10:54:56.389 INFO:tasks.workunit.client.0.smithi090.stdout:3/882: fdatasync d7/d26/dc9/f115 0 2024-04-20T10:54:56.389 INFO:tasks.workunit.client.0.smithi090.stdout:3/883: truncate d7/d15/d2a/d30/d93/fae 837923 0 2024-04-20T10:54:56.397 INFO:tasks.workunit.client.0.smithi090.stdout:6/815: symlink d1/d9a/de2/l10f 0 2024-04-20T10:54:56.398 INFO:tasks.workunit.client.1.smithi175.stdout:0/360: creat df/d17/d2f/d4f/f6c x:0 0 0 2024-04-20T10:54:56.399 INFO:tasks.workunit.client.0.smithi090.stdout:3/884: dread d7/d15/d2a/d30/fce [0,4194304] 0 2024-04-20T10:54:56.399 INFO:tasks.workunit.client.0.smithi090.stdout:3/885: chown d7/df/f27 11 1 2024-04-20T10:54:56.400 INFO:tasks.workunit.client.0.smithi090.stdout:4/864: dwrite d7/d9/d92/fc7 [0,4194304] 0 2024-04-20T10:54:56.403 INFO:tasks.workunit.client.0.smithi090.stdout:4/865: rename d7/d9/d92/fc7 to d7/d9/d17/da0/f119 0 2024-04-20T10:54:56.404 INFO:tasks.workunit.client.0.smithi090.stdout:6/816: mknod d1/d4/c110 0 2024-04-20T10:54:56.406 INFO:tasks.workunit.client.0.smithi090.stdout:4/866: rename d7/d9/d47/df9/d70/da5/db3/dba/lbf to d7/d9/d47/df9/d103/l11a 0 2024-04-20T10:54:56.406 INFO:tasks.workunit.client.0.smithi090.stdout:4/867: chown d7/d9/d17/dc4/fd9 150539 1 2024-04-20T10:54:56.406 INFO:tasks.workunit.client.0.smithi090.stdout:4/868: write d7/d9/d47/df9/d70/da1/dcd/d76/fc3 [10754,61737] 0 2024-04-20T10:54:56.406 INFO:tasks.workunit.client.0.smithi090.stdout:4/869: readlink d7/d97/lea 0 2024-04-20T10:54:56.417 INFO:tasks.workunit.client.1.smithi175.stdout:7/466: write db/d1d/d29/f9e [4791834,3665] 0 2024-04-20T10:54:56.422 INFO:tasks.workunit.client.0.smithi090.stdout:4/870: dwrite d7/d9/d47/df9/d70/da1/dcd/d42/f105 [4194304,4194304] 0 2024-04-20T10:54:56.423 INFO:tasks.workunit.client.1.smithi175.stdout:8/371: rename d7/d13/d1d/d5b to d7/d13/d1d/d24/d39/d6f 0 2024-04-20T10:54:56.425 INFO:tasks.workunit.client.0.smithi090.stdout:6/817: creat d1/d4/d26/d11/d4a/d6b/db5/db9/f111 x:0 0 0 2024-04-20T10:54:56.425 INFO:tasks.workunit.client.0.smithi090.stdout:6/818: chown d1/d9a/de2/l10f 4 1 2024-04-20T10:54:56.428 INFO:tasks.workunit.client.1.smithi175.stdout:0/361: rename df/d1a/d22/d24/c63 to df/d17/d2f/c6d 0 2024-04-20T10:54:56.434 INFO:tasks.workunit.client.1.smithi175.stdout:0/362: dread df/d19/f1e [0,4194304] 0 2024-04-20T10:54:56.436 INFO:tasks.workunit.client.1.smithi175.stdout:0/363: read df/d19/f1e [1288124,119006] 0 2024-04-20T10:54:56.446 INFO:tasks.workunit.client.0.smithi090.stdout:4/871: dwrite d7/d9/d47/df9/d70/f81 [0,4194304] 0 2024-04-20T10:54:56.448 INFO:tasks.workunit.client.0.smithi090.stdout:4/872: mkdir d7/d9/d47/df9/d70/da5/db3/d11b 0 2024-04-20T10:54:56.448 INFO:tasks.workunit.client.0.smithi090.stdout:4/873: truncate d7/f38 1668489 0 2024-04-20T10:54:56.455 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-20T10:54:56.455+0000 7fc1fcee9640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:54:56.458 INFO:tasks.workunit.client.1.smithi175.stdout:7/467: mknod db/d61/d6d/d9c/cae 0 2024-04-20T10:54:56.458 INFO:tasks.workunit.client.0.smithi090.stdout:4/874: dread d7/d9/d17/d94/f107 [0,4194304] 0 2024-04-20T10:54:56.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.461+0000 7fcc55315640 1 Processor -- start 2024-04-20T10:54:56.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.462+0000 7fcc55315640 1 -- start start 2024-04-20T10:54:56.462 INFO:tasks.workunit.client.1.smithi175.stdout:6/432: dwrite d1/d5/d12/f31 [0,4194304] 0 2024-04-20T10:54:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.462+0000 7fcc55315640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcc500c9ee0 0x7fcc50156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc55315640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5015a720 con 0x7fcc500ab730 2024-04-20T10:54:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc55315640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc5015ac80 con 0x7fcc50153ef0 2024-04-20T10:54:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc55315640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fcc5015a9a0 con 0x7fcc500c9ee0 2024-04-20T10:54:56.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc4f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcc500c9ee0 0x7fcc50156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc4f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcc500c9ee0 0x7fcc50156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58796/0 (socket says 172.21.15.90:58796) 2024-04-20T10:54:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc4f7fe640 1 -- 172.21.15.90:0/1827396160 learned_addr learned my addr 172.21.15.90:0/1827396160 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc4f7fe640 1 -- 172.21.15.90:0/1827396160 >> v1:172.21.15.175:6789/0 conn(0x7fcc50153ef0 legacy=0x7fcc500c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc4dffb640 1 -- 172.21.15.90:0/1827396160 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58537589 0 0) 0x7fcc5015ac80 con 0x7fcc50153ef0 2024-04-20T10:54:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc4f7fe640 1 -- 172.21.15.90:0/1827396160 >> v1:172.21.15.90:6789/0 conn(0x7fcc500ab730 legacy=0x7fcc501568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.463+0000 7fcc4f7fe640 1 -- 172.21.15.90:0/1827396160 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500c6a90 con 0x7fcc500c9ee0 2024-04-20T10:54:56.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.464+0000 7fcc4f7fe640 1 --2- 172.21.15.90:0/1827396160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc50156fd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009e50 tx=0x7fcc4802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde1e4c53b60a5ad server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:56.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.464+0000 7fcc4dffb640 1 -- 172.21.15.90:0/1827396160 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc4802c9f0 con 0x7fcc500c9ee0 2024-04-20T10:54:56.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.465+0000 7fcc4dffb640 1 -- 172.21.15.90:0/1827396160 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc4802cb90 con 0x7fcc500c9ee0 2024-04-20T10:54:56.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.465+0000 7fcc4dffb640 1 -- 172.21.15.90:0/1827396160 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc480343f0 con 0x7fcc500c9ee0 2024-04-20T10:54:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.465+0000 7fcc55315640 1 -- 172.21.15.90:0/1827396160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 msgr2=0x7fcc50156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.465+0000 7fcc55315640 1 --2- 172.21.15.90:0/1827396160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc50156fd0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fcc48009e50 tx=0x7fcc4802be50 comp rx=0 tx=0).stop 2024-04-20T10:54:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.465+0000 7fcc55315640 1 -- 172.21.15.90:0/1827396160 shutdown_connections 2024-04-20T10:54:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.466+0000 7fcc55315640 1 --2- 172.21.15.90:0/1827396160 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc50156fd0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.466+0000 7fcc55315640 1 -- 172.21.15.90:0/1827396160 >> 172.21.15.90:0/1827396160 conn(0x7fcc500cbfe0 msgr2=0x7fcc500cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.466+0000 7fcc55315640 1 -- 172.21.15.90:0/1827396160 shutdown_connections 2024-04-20T10:54:56.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.466+0000 7fcc55315640 1 -- 172.21.15.90:0/1827396160 wait complete. 2024-04-20T10:54:56.466 INFO:tasks.workunit.client.1.smithi175.stdout:0/364: unlink df/d2e/f54 0 2024-04-20T10:54:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.467+0000 7fcc55315640 1 Processor -- start 2024-04-20T10:54:56.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.467+0000 7fcc55315640 1 -- start start 2024-04-20T10:54:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc55315640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc500ab730 0x7fcc500c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc55315640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc500b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc55315640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc50153ef0 0x7fcc501ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc55315640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcc500c9100 con 0x7fcc500c9ee0 2024-04-20T10:54:56.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc55315640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcc50157510 con 0x7fcc500ab730 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc55315640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcc500c9280 con 0x7fcc50153ef0 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc500b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc500b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58810/0 (socket says 172.21.15.90:58810) 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 -- 172.21.15.90:0/3744257674 learned_addr learned my addr 172.21.15.90:0/3744257674 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4effd640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc500ab730 0x7fcc500c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4f7fe640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc50153ef0 0x7fcc501ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 -- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc50153ef0 msgr2=0x7fcc501ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc50153ef0 0x7fcc501ec330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 -- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc500ab730 msgr2=0x7fcc500c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc500ab730 0x7fcc500c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 -- 172.21.15.90:0/3744257674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc500c30b0 con 0x7fcc500c9ee0 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.468+0000 7fcc4e7fc640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc500b0fa0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400b3c0 tx=0x7fcc4400b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:56.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.469+0000 7fcc377fe640 1 -- 172.21.15.90:0/3744257674 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44011830 con 0x7fcc500c9ee0 2024-04-20T10:54:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.469+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc500c3370 con 0x7fcc500c9ee0 2024-04-20T10:54:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.469+0000 7fcc377fe640 1 -- 172.21.15.90:0/3744257674 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc44016070 con 0x7fcc500c9ee0 2024-04-20T10:54:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.469+0000 7fcc377fe640 1 -- 172.21.15.90:0/3744257674 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc44011c50 con 0x7fcc500c9ee0 2024-04-20T10:54:56.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.469+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc500b0a80 con 0x7fcc500c9ee0 2024-04-20T10:54:56.472 INFO:tasks.workunit.client.1.smithi175.stdout:0/365: readlink df/d19/l41 0 2024-04-20T10:54:56.472 INFO:tasks.workunit.client.1.smithi175.stdout:8/372: write d7/d13/d1d/d24/f2b [2352261,69376] 0 2024-04-20T10:54:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.470+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc500b0c80 con 0x7fcc500c9ee0 2024-04-20T10:54:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.470+0000 7fcc377fe640 1 -- 172.21.15.90:0/3744257674 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc4401b460 con 0x7fcc500c9ee0 2024-04-20T10:54:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.471+0000 7fcc377fe640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.471+0000 7fcc377fe640 1 -- 172.21.15.90:0/3744257674 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7fcc4408bcf0 con 0x7fcc500c9ee0 2024-04-20T10:54:56.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.471+0000 7fcc4effd640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.471+0000 7fcc4effd640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcc40000f60 tx=0x7fcc40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:56.473 INFO:tasks.workunit.client.1.smithi175.stdout:0/366: symlink df/d1a/d22/l6e 0 2024-04-20T10:54:56.473 INFO:tasks.workunit.client.0.smithi090.stdout:4/875: dwrite d7/d9/d17/d56/f117 [0,4194304] 0 2024-04-20T10:54:56.474 INFO:tasks.workunit.client.0.smithi090.stdout:4/876: creat d7/d9/d17/d94/f11c x:0 0 0 2024-04-20T10:54:56.475 INFO:tasks.workunit.client.1.smithi175.stdout:7/468: link db/d1d/d29/f6f db/d1d/d29/d8f/faf 0 2024-04-20T10:54:56.476 INFO:tasks.workunit.client.1.smithi175.stdout:8/373: truncate d7/d13/d1d/d24/d26/f51 4198349 0 2024-04-20T10:54:56.476 INFO:tasks.workunit.client.0.smithi090.stdout:4/877: unlink d7/d9/d47/df9/d70/da1/dcd/c31 0 2024-04-20T10:54:56.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.476+0000 7fcc377fe640 1 -- 172.21.15.90:0/3744257674 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fcc500b0c80 con 0x7fcc500c9ee0 2024-04-20T10:54:56.477 INFO:tasks.workunit.client.0.smithi090.stdout:6/819: fsync d1/d4/d26/d11/d4a/d6b/db5/db9/f111 0 2024-04-20T10:54:56.477 INFO:tasks.workunit.client.0.smithi090.stdout:4/878: symlink d7/d9/d47/df9/d70/da5/db3/d11b/l11d 0 2024-04-20T10:54:56.477 INFO:tasks.workunit.client.1.smithi175.stdout:8/374: chown d7/d13/d1d/d24/c54 51 1 2024-04-20T10:54:56.478 INFO:tasks.workunit.client.1.smithi175.stdout:7/469: symlink db/d1d/d29/d2a/lb0 0 2024-04-20T10:54:56.478 INFO:tasks.workunit.client.0.smithi090.stdout:6/820: dread d1/d19/d36/d28/f34 [0,4194304] 0 2024-04-20T10:54:56.479 INFO:tasks.workunit.client.1.smithi175.stdout:8/375: chown d7/d13/d1d/d24/d38/f64 3206 1 2024-04-20T10:54:56.479 INFO:tasks.workunit.client.0.smithi090.stdout:6/821: symlink d1/d4/d26/d11/d4a/d56/l112 0 2024-04-20T10:54:56.480 INFO:tasks.workunit.client.1.smithi175.stdout:7/470: symlink db/d1d/d29/d2a/d41/lb1 0 2024-04-20T10:54:56.480 INFO:tasks.workunit.client.1.smithi175.stdout:7/471: dread - db/d1d/d39/fad zero size 2024-04-20T10:54:56.480 INFO:tasks.workunit.client.0.smithi090.stdout:6/822: creat d1/d4/d26/d11/d4a/d6b/db5/f113 x:0 0 0 2024-04-20T10:54:56.484 INFO:tasks.workunit.client.1.smithi175.stdout:0/367: creat df/d1a/d3f/f6f x:0 0 0 2024-04-20T10:54:56.489 INFO:tasks.workunit.client.1.smithi175.stdout:8/376: write d7/d13/f22 [4314845,100190] 0 2024-04-20T10:54:56.495 INFO:tasks.workunit.client.1.smithi175.stdout:0/368: dread df/d19/f1f [0,4194304] 0 2024-04-20T10:54:56.501 INFO:tasks.workunit.client.1.smithi175.stdout:6/433: dwrite d1/d40/d46/d60/d6b/f72 [0,4194304] 0 2024-04-20T10:54:56.502 INFO:tasks.workunit.client.0.smithi090.stdout:6/823: dwrite d1/d4/d26/d11/d4a/d6b/db5/db9/f111 [0,4194304] 0 2024-04-20T10:54:56.502 INFO:tasks.workunit.client.0.smithi090.stdout:6/824: fdatasync d1/d19/d36/d28/f2a 0 2024-04-20T10:54:56.504 INFO:tasks.workunit.client.0.smithi090.stdout:6/825: symlink d1/d4/d26/d11/d4a/d6b/db5/l114 0 2024-04-20T10:54:56.504 INFO:tasks.workunit.client.1.smithi175.stdout:7/472: write db/d1d/d39/d50/d12/d47/f94 [204917,115322] 0 2024-04-20T10:54:56.505 INFO:tasks.workunit.client.0.smithi090.stdout:6/826: getdents d1/d19/d36/d1e/d1f/d3f/d54/d9f 0 2024-04-20T10:54:56.505 INFO:tasks.workunit.client.1.smithi175.stdout:0/369: creat df/d19/f70 x:0 0 0 2024-04-20T10:54:56.505 INFO:tasks.workunit.client.1.smithi175.stdout:0/370: write df/d19/f70 [345506,81737] 0 2024-04-20T10:54:56.506 INFO:tasks.workunit.client.0.smithi090.stdout:6/827: creat d1/d19/d36/f115 x:0 0 0 2024-04-20T10:54:56.507 INFO:tasks.workunit.client.0.smithi090.stdout:6/828: creat d1/d4/d26/d11/d35/d80/f116 x:0 0 0 2024-04-20T10:54:56.509 INFO:tasks.workunit.client.1.smithi175.stdout:8/377: unlink d7/d13/d1d/d24/d39/d6f/c68 0 2024-04-20T10:54:56.510 INFO:tasks.workunit.client.1.smithi175.stdout:7/473: getdents db/d1d/d29/d2a/d41/d59 0 2024-04-20T10:54:56.512 INFO:tasks.workunit.client.1.smithi175.stdout:0/371: mkdir df/d17/d71 0 2024-04-20T10:54:56.515 INFO:tasks.workunit.client.1.smithi175.stdout:6/434: creat d1/d40/d29/f9f x:0 0 0 2024-04-20T10:54:56.521 INFO:tasks.workunit.client.1.smithi175.stdout:6/435: read d1/d5/d12/f35 [2465022,52810] 0 2024-04-20T10:54:56.521 INFO:tasks.workunit.client.1.smithi175.stdout:6/436: stat d1/d40/d46 0 2024-04-20T10:54:56.522 INFO:tasks.workunit.client.1.smithi175.stdout:0/372: readlink df/d1a/d22/d24/l30 0 2024-04-20T10:54:56.531 INFO:tasks.workunit.client.0.smithi090.stdout:6/829: read d1/d4/faa [1183096,15230] 0 2024-04-20T10:54:56.532 INFO:tasks.workunit.client.0.smithi090.stdout:4/879: dwrite d7/f38 [0,4194304] 0 2024-04-20T10:54:56.532 INFO:tasks.workunit.client.0.smithi090.stdout:6/830: mknod d1/d4/d26/d11/d4a/d6b/d6f/c117 0 2024-04-20T10:54:56.533 INFO:tasks.workunit.client.0.smithi090.stdout:4/880: creat d7/d9/d47/df9/d70/dec/f11e x:0 0 0 2024-04-20T10:54:56.534 INFO:tasks.workunit.client.0.smithi090.stdout:4/881: symlink d7/d9/d47/df9/d70/da5/db3/d11b/l11f 0 2024-04-20T10:54:56.534 INFO:tasks.workunit.client.0.smithi090.stdout:4/882: readlink d7/d9/d17/de3/l109 0 2024-04-20T10:54:56.534 INFO:tasks.workunit.client.0.smithi090.stdout:4/883: symlink d7/d9/d47/df9/d70/da1/dfb/l120 0 2024-04-20T10:54:56.535 INFO:tasks.workunit.client.0.smithi090.stdout:4/884: mknod d7/d9/d47/d8d/dda/db5/c121 0 2024-04-20T10:54:56.553 INFO:tasks.workunit.client.0.smithi090.stdout:6/831: dwrite d1/d4/d26/d11/d4a/d6b/db5/df1/f72 [0,4194304] 0 2024-04-20T10:54:56.554 INFO:tasks.workunit.client.0.smithi090.stdout:6/832: mkdir d1/d4/d26/d11/d4a/d56/d118 0 2024-04-20T10:54:56.555 INFO:tasks.workunit.client.0.smithi090.stdout:4/885: dwrite d7/d9/d47/df9/d70/da1/dcd/d42/f105 [0,4194304] 0 2024-04-20T10:54:56.556 INFO:tasks.workunit.client.0.smithi090.stdout:6/833: link d1/d4/d26/d11/d4a/d6b/fe6 d1/d10/f119 0 2024-04-20T10:54:56.556 INFO:tasks.workunit.client.0.smithi090.stdout:6/834: truncate d1/d19/d36/d28/f34 466788 0 2024-04-20T10:54:56.556 INFO:tasks.workunit.client.0.smithi090.stdout:6/835: write d1/d19/f10c [10885,71892] 0 2024-04-20T10:54:56.556 INFO:tasks.workunit.client.0.smithi090.stdout:6/836: mkdir d1/d19/d36/d1e/d1f/d3f/df7/d11a 0 2024-04-20T10:54:56.556 INFO:tasks.workunit.client.0.smithi090.stdout:4/886: read d7/d9/f6d [4168020,130827] 0 2024-04-20T10:54:56.560 INFO:tasks.workunit.client.0.smithi090.stdout:6/837: write d1/d19/d25/f78 [2826158,114291] 0 2024-04-20T10:54:56.560 INFO:tasks.workunit.client.0.smithi090.stdout:6/838: readlink d1/d4/d26/l9b 0 2024-04-20T10:54:56.567 INFO:tasks.workunit.client.0.smithi090.stdout:6/839: dread d1/d19/d25/f87 [0,4194304] 0 2024-04-20T10:54:56.567 INFO:tasks.workunit.client.0.smithi090.stdout:6/840: chown d1/d4/cba 325 1 2024-04-20T10:54:56.567 INFO:tasks.workunit.client.0.smithi090.stdout:6/841: rmdir d1/d4/d26/d11/d4a 39 2024-04-20T10:54:56.568 INFO:tasks.workunit.client.0.smithi090.stdout:6/842: creat d1/d4/dd6/dd8/f11b x:0 0 0 2024-04-20T10:54:56.569 INFO:tasks.workunit.client.0.smithi090.stdout:6/843: fsync d1/d4/d26/d11/d35/d97/ff5 0 2024-04-20T10:54:56.569 INFO:tasks.workunit.client.0.smithi090.stdout:6/844: chown d1/d4/d26/d11/f71 122601399 1 2024-04-20T10:54:56.569 INFO:tasks.workunit.client.0.smithi090.stdout:6/845: rmdir d1/d4/d26/d11/d4a/d56 39 2024-04-20T10:54:56.569 INFO:tasks.workunit.client.0.smithi090.stdout:6/846: stat d1/d4/d26/d11/d4a 0 2024-04-20T10:54:56.580 INFO:tasks.workunit.client.0.smithi090.stdout:4/887: dwrite d7/d9/d47/df9/d70/da1/dcd/d3d/f61 [0,4194304] 0 2024-04-20T10:54:56.583 INFO:tasks.workunit.client.0.smithi090.stdout:4/888: creat d7/d9/d47/df9/d70/da1/dcd/d42/d8f/f122 x:0 0 0 2024-04-20T10:54:56.589 INFO:tasks.workunit.client.0.smithi090.stdout:4/889: write d7/d9/d47/df9/d70/da1/dcd/d3d/f75 [2095063,79033] 0 2024-04-20T10:54:56.590 INFO:tasks.workunit.client.0.smithi090.stdout:4/890: link d7/d9/d17/c7c d7/d9/d92/d111/c123 0 2024-04-20T10:54:56.591 INFO:tasks.workunit.client.0.smithi090.stdout:6/847: dwrite d1/d9a/fcc [0,4194304] 0 2024-04-20T10:54:56.592 INFO:tasks.workunit.client.0.smithi090.stdout:4/891: link d7/d9/d47/df9/d70/dec/f11e d7/d9/d47/df9/d70/da5/db3/dba/f124 0 2024-04-20T10:54:56.592 INFO:tasks.workunit.client.0.smithi090.stdout:4/892: fsync d7/d9/d47/df9/d70/da5/ffa 0 2024-04-20T10:54:56.592 INFO:tasks.workunit.client.0.smithi090.stdout:4/893: chown d7/d9/d17/da0/ff2 8223772 1 2024-04-20T10:54:56.592 INFO:tasks.workunit.client.0.smithi090.stdout:4/894: truncate d7/d9/d47/df9/d70/da1/dcd/d42/d8f/da2/faa 4222643 0 2024-04-20T10:54:56.594 INFO:tasks.workunit.client.0.smithi090.stdout:6/848: unlink d1/d4/d26/d11/d4a/d6b/d6f/c117 0 2024-04-20T10:54:56.594 INFO:tasks.workunit.client.0.smithi090.stdout:4/895: mknod d7/d9/d47/df9/d70/da1/dcd/d42/dfc/c125 0 2024-04-20T10:54:56.595 INFO:tasks.workunit.client.0.smithi090.stdout:4/896: creat d7/d9/d47/df9/d70/f126 x:0 0 0 2024-04-20T10:54:56.602 INFO:tasks.workunit.client.0.smithi090.stdout:8/887: sync 2024-04-20T10:54:56.603 INFO:tasks.workunit.client.0.smithi090.stdout:8/888: rmdir d0/d3a/d4a/d81 39 2024-04-20T10:54:56.604 INFO:tasks.workunit.client.0.smithi090.stdout:8/889: mknod d0/d3a/d9f/c11f 0 2024-04-20T10:54:56.618 INFO:tasks.workunit.client.1.smithi175.stdout:1/324: write d0/d8/f28 [1925691,41806] 0 2024-04-20T10:54:56.618 INFO:tasks.workunit.client.0.smithi090.stdout:4/897: dwrite d7/d9/d17/da0/ff2 [0,4194304] 0 2024-04-20T10:54:56.619 INFO:tasks.workunit.client.1.smithi175.stdout:6/437: creat d1/d5/d12/d22/d9b/fa0 x:0 0 0 2024-04-20T10:54:56.620 INFO:tasks.workunit.client.0.smithi090.stdout:8/890: mknod d0/d11/d22/d53/d57/dd3/d10a/c120 0 2024-04-20T10:54:56.621 INFO:tasks.workunit.client.1.smithi175.stdout:0/373: rename df/d1a/d22/d24/d37 to df/d1a/d22/d6a/d72 0 2024-04-20T10:54:56.622 INFO:tasks.workunit.client.0.smithi090.stdout:6/849: dwrite d1/d19/d36/d1e/d1f/d3f/d54/f62 [0,4194304] 0 2024-04-20T10:54:56.623 INFO:tasks.workunit.client.0.smithi090.stdout:4/898: creat d7/d9/d47/df9/d70/da1/dcd/d76/f127 x:0 0 0 2024-04-20T10:54:56.623 INFO:tasks.workunit.client.0.smithi090.stdout:4/899: stat d7/d9/d17/f90 0 2024-04-20T10:54:56.624 INFO:tasks.workunit.client.1.smithi175.stdout:6/438: getdents d1/d40/d46/d60/d68/d7e 0 2024-04-20T10:54:56.625 INFO:tasks.workunit.client.0.smithi090.stdout:6/850: truncate d1/d19/f1a 1172322 0 2024-04-20T10:54:56.625 INFO:tasks.workunit.client.0.smithi090.stdout:6/851: fdatasync d1/d19/d36/d28/fae 0 2024-04-20T10:54:56.626 INFO:tasks.workunit.client.0.smithi090.stdout:8/891: dread d0/d11/d22/d53/f75 [0,4194304] 0 2024-04-20T10:54:56.627 INFO:tasks.workunit.client.0.smithi090.stdout:4/900: mkdir d7/d9/d17/d94/df3/d128 0 2024-04-20T10:54:56.628 INFO:tasks.workunit.client.0.smithi090.stdout:6/852: truncate d1/d19/d36/d1e/d74/fcf 797137 0 2024-04-20T10:54:56.635 INFO:tasks.workunit.client.0.smithi090.stdout:7/855: sync 2024-04-20T10:54:56.635 INFO:tasks.workunit.client.0.smithi090.stdout:3/886: sync 2024-04-20T10:54:56.635 INFO:tasks.workunit.client.0.smithi090.stdout:7/856: chown d11/d1a/d3f 0 1 2024-04-20T10:54:56.636 INFO:tasks.workunit.client.0.smithi090.stdout:4/901: rmdir d7/d9/d47/df9/d70/da5 39 2024-04-20T10:54:56.636 INFO:tasks.workunit.client.0.smithi090.stdout:4/902: chown d7/f6e 3665345 1 2024-04-20T10:54:56.636 INFO:tasks.workunit.client.0.smithi090.stdout:3/887: creat d7/d43/db7/dd4/f119 x:0 0 0 2024-04-20T10:54:56.637 INFO:tasks.workunit.client.0.smithi090.stdout:8/892: write d0/f8 [450149,11137] 0 2024-04-20T10:54:56.653 INFO:tasks.workunit.client.1.smithi175.stdout:8/378: dwrite d7/d13/d1d/d24/d39/f48 [0,4194304] 0 2024-04-20T10:54:56.654 INFO:tasks.workunit.client.0.smithi090.stdout:3/888: write d7/d11/f73 [906094,43610] 0 2024-04-20T10:54:56.654 INFO:tasks.workunit.client.0.smithi090.stdout:6/853: dwrite d1/d4/d26/d11/d4a/d6b/f89 [0,4194304] 0 2024-04-20T10:54:56.654 INFO:tasks.workunit.client.0.smithi090.stdout:6/854: chown d1/d19/d25/c3e 179135 1 2024-04-20T10:54:56.654 INFO:tasks.workunit.client.0.smithi090.stdout:7/857: mkdir d11/d13/d5d/db0/d10e 0 2024-04-20T10:54:56.656 INFO:tasks.workunit.client.0.smithi090.stdout:3/889: creat d7/d15/d2a/d30/d93/d7f/f11a x:0 0 0 2024-04-20T10:54:56.657 INFO:tasks.workunit.client.0.smithi090.stdout:6/855: rename d1/d4/d26/d11/c5e to d1/d10/c11c 0 2024-04-20T10:54:56.658 INFO:tasks.workunit.client.0.smithi090.stdout:7/858: mkdir d11/d1a/d3b/d107/d10f 0 2024-04-20T10:54:56.663 INFO:tasks.workunit.client.0.smithi090.stdout:3/890: dread d7/d15/d47/d56/f54 [0,4194304] 0 2024-04-20T10:54:56.663 INFO:tasks.workunit.client.0.smithi090.stdout:3/891: fsync d7/df/dd1/dd3/fd7 0 2024-04-20T10:54:56.665 INFO:tasks.workunit.client.0.smithi090.stdout:3/892: mkdir d7/ddd/d10c/d11b 0 2024-04-20T10:54:56.665 INFO:tasks.workunit.client.0.smithi090.stdout:3/893: write d7/d43/dd9/fdb [1040104,125598] 0 2024-04-20T10:54:56.666 INFO:tasks.workunit.client.0.smithi090.stdout:8/893: dwrite d0/f9 [4194304,4194304] 0 2024-04-20T10:54:56.667 INFO:tasks.workunit.client.0.smithi090.stdout:6/856: symlink d1/d4/l11d 0 2024-04-20T10:54:56.668 INFO:tasks.workunit.client.0.smithi090.stdout:4/903: dwrite d7/d9/d17/f18 [0,4194304] 0 2024-04-20T10:54:56.677 INFO:tasks.workunit.client.0.smithi090.stdout:3/894: dread d7/d15/d2a/f49 [0,4194304] 0 2024-04-20T10:54:56.677 INFO:tasks.workunit.client.0.smithi090.stdout:4/904: dread d7/d9/f1c [0,4194304] 0 2024-04-20T10:54:56.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.752+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc50076150 con 0x7fcc500c9ee0 2024-04-20T10:54:56.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.753+0000 7fcc377fe640 1 -- 172.21.15.90:0/3744257674 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5705 (secure 0 0 0) 0x7fcc44090070 con 0x7fcc500c9ee0 2024-04-20T10:54:56.753 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:56.753 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:54:56.753 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 37 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcc3c06c8f0 msgr2=0x7fcc3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcc40000f60 tx=0x7fcc40009040 comp rx=0 tx=0).stop 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 msgr2=0x7fcc500b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc500b0fa0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fcc4400b3c0 tx=0x7fcc4400b880 comp rx=0 tx=0).stop 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 shutdown_connections 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcc3c06c8f0 0x7fcc3c06edb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcc50153ef0 0x7fcc501ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcc500c9ee0 0x7fcc500b0fa0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 --2- 172.21.15.90:0/3744257674 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcc500ab730 0x7fcc500c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 >> 172.21.15.90:0/3744257674 conn(0x7fcc500cbfe0 msgr2=0x7fcc50152b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 shutdown_connections 2024-04-20T10:54:56.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.755+0000 7fcc55315640 1 -- 172.21.15.90:0/3744257674 wait complete. 2024-04-20T10:54:56.766 INFO:tasks.mds_thrash.fs.[b]:mds.b has gained rank=0, replacing gid=5367 2024-04-20T10:54:56.766 INFO:tasks.mds_thrash.fs.[b]:waiting for 0 secs before reviving mds.a 2024-04-20T10:54:56.766 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2024-04-20T10:54:56.766 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-20T10:54:56.766 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-20T10:54:56.799 INFO:tasks.workunit.client.1.smithi175.stdout:7/474: write db/d1d/d39/d50/f28 [1156176,74681] 0 2024-04-20T10:54:56.800 INFO:tasks.workunit.client.1.smithi175.stdout:8/379: mknod d7/d13/c70 0 2024-04-20T10:54:56.803 INFO:tasks.workunit.client.1.smithi175.stdout:6/439: link d1/d40/d46/f4f d1/d5/d12/d22/fa1 0 2024-04-20T10:54:56.808 INFO:tasks.ceph.mds.a:Started 2024-04-20T10:54:56.808 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:56.811 INFO:tasks.workunit.client.1.smithi175.stdout:1/325: write d0/f1a [5037674,82742] 0 2024-04-20T10:54:56.811 INFO:tasks.workunit.client.1.smithi175.stdout:1/326: truncate d0/d8/d13/f26 4418472 0 2024-04-20T10:54:56.812 INFO:tasks.workunit.client.1.smithi175.stdout:0/374: link df/d19/f3b df/d1a/d28/f73 0 2024-04-20T10:54:56.881 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.906+0000 7f4c786a5640 1 Processor -- start 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.906+0000 7f4c786a5640 1 -- start start 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.906+0000 7f4c786a5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4c700ab730 0x7f4c701568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.906+0000 7f4c786a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c70156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.906+0000 7f4c786a5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7015a720 con 0x7f4c70153ef0 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.906+0000 7f4c786a5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4c7015ac80 con 0x7f4c700ab730 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.906+0000 7f4c786a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4c7015a9a0 con 0x7f4c700c9ee0 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c75c40640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4c700ab730 0x7f4c701568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c75c40640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4c700ab730 0x7f4c701568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58826/0 (socket says 172.21.15.90:58826) 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c75c40640 1 -- 172.21.15.90:0/4035162036 learned_addr learned my addr 172.21.15.90:0/4035162036 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c76c42640 1 --2- 172.21.15.90:0/4035162036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c70156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c75c40640 1 -- 172.21.15.90:0/4035162036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 msgr2=0x7f4c70156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c75c40640 1 --2- 172.21.15.90:0/4035162036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c70156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c75c40640 1 -- 172.21.15.90:0/4035162036 >> v1:172.21.15.175:6789/0 conn(0x7f4c70153ef0 legacy=0x7f4c700c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c75c40640 1 -- 172.21.15.90:0/4035162036 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c700c6a90 con 0x7f4c700ab730 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.907+0000 7f4c76c42640 1 --2- 172.21.15.90:0/4035162036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c70156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c75c40640 1 --2- 172.21.15.90:0/4035162036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701568c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009870 tx=0x7f4c6c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b321ce57145eef15 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c7543f640 1 -- 172.21.15.90:0/4035162036 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0317c0 con 0x7f4c700ab730 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c7543f640 1 -- 172.21.15.90:0/4035162036 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c6c037070 con 0x7f4c700ab730 2024-04-20T10:54:56.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c7543f640 1 -- 172.21.15.90:0/4035162036 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c031b80 con 0x7f4c700ab730 2024-04-20T10:54:56.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 -- 172.21.15.90:0/4035162036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 msgr2=0x7f4c701568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 --2- 172.21.15.90:0/4035162036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701568c0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c009870 tx=0x7f4c6c02b860 comp rx=0 tx=0).stop 2024-04-20T10:54:56.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 -- 172.21.15.90:0/4035162036 shutdown_connections 2024-04-20T10:54:56.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 --2- 172.21.15.90:0/4035162036 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c70156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 --2- 172.21.15.90:0/4035162036 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701568c0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 -- 172.21.15.90:0/4035162036 >> 172.21.15.90:0/4035162036 conn(0x7f4c700cbfe0 msgr2=0x7f4c700cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 -- 172.21.15.90:0/4035162036 shutdown_connections 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.908+0000 7f4c786a5640 1 -- 172.21.15.90:0/4035162036 wait complete. 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.909+0000 7f4c786a5640 1 Processor -- start 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c786a5640 1 -- start start 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c786a5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c786a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c700b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c786a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c701509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c786a5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4c700c9280 con 0x7f4c700ab730 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c786a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4c700c9100 con 0x7f4c70153ef0 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c786a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4c700bf800 con 0x7f4c700c9ee0 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c76441640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c76441640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701efbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58828/0 (socket says 172.21.15.90:58828) 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c76441640 1 -- 172.21.15.90:0/2692262468 learned_addr learned my addr 172.21.15.90:0/2692262468 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.910+0000 7f4c75c40640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c700b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c76c42640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c701509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c76441640 1 -- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 msgr2=0x7f4c700b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c76441640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c700b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c76441640 1 -- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 msgr2=0x7f4c701509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c76441640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c701509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c76441640 1 -- 172.21.15.90:0/2692262468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c701515d0 con 0x7f4c700ab730 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c76441640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701efbe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c430 tx=0x7f4c6000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c66ffd640 1 -- 172.21.15.90:0/2692262468 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60017070 con 0x7f4c700ab730 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c66ffd640 1 -- 172.21.15.90:0/2692262468 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c600052d0 con 0x7f4c700ab730 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c700b0a90 con 0x7f4c700ab730 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c66ffd640 1 -- 172.21.15.90:0/2692262468 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c60003850 con 0x7f4c700ab730 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.911+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c700b0d30 con 0x7f4c700ab730 2024-04-20T10:54:56.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.912+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c70076150 con 0x7f4c700ab730 2024-04-20T10:54:56.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.912+0000 7f4c66ffd640 1 -- 172.21.15.90:0/2692262468 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4c6001a070 con 0x7f4c700ab730 2024-04-20T10:54:56.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.913+0000 7f4c66ffd640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5406c920 0x7f4c5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:56.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.913+0000 7f4c75c40640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5406c920 0x7f4c5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:56.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.913+0000 7f4c66ffd640 1 -- 172.21.15.90:0/2692262468 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f4c6008b380 con 0x7f4c700ab730 2024-04-20T10:54:56.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.913+0000 7f4c75c40640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5406c920 0x7f4c5406ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c036000 tx=0x7f4c6c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:56.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:56.917+0000 7f4c66ffd640 1 -- 172.21.15.90:0/2692262468 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4c7015a720 con 0x7f4c700ab730 2024-04-20T10:54:56.918 INFO:tasks.workunit.client.0.smithi090.stdout:8/894: rename d0/d26/da7/fe1 to d0/d3a/daa/f121 0 2024-04-20T10:54:56.918 INFO:tasks.workunit.client.0.smithi090.stdout:6/857: link d1/d4/d26/d11/f63 d1/d19/d36/d1e/d1f/d3f/df7/d11a/f11e 0 2024-04-20T10:54:56.920 INFO:tasks.workunit.client.0.smithi090.stdout:3/895: mkdir d7/d15/d2a/de4/d11c 0 2024-04-20T10:54:56.921 INFO:tasks.workunit.client.0.smithi090.stdout:4/905: truncate d7/d9/d17/da0/f119 4192159 0 2024-04-20T10:54:56.925 INFO:tasks.workunit.client.0.smithi090.stdout:8/895: creat d0/d26/da7/f122 x:0 0 0 2024-04-20T10:54:56.926 INFO:tasks.workunit.client.0.smithi090.stdout:6/858: creat d1/d4/d26/d11/d35/f11f x:0 0 0 2024-04-20T10:54:56.927 INFO:tasks.workunit.client.0.smithi090.stdout:3/896: mkdir d7/d15/d2a/de4/d11d 0 2024-04-20T10:54:56.928 INFO:tasks.workunit.client.0.smithi090.stdout:4/906: mknod d7/d9/d47/c129 0 2024-04-20T10:54:56.928 INFO:tasks.workunit.client.0.smithi090.stdout:4/907: stat d7/d9/d47/df9/d70/da1/dcd/d42/f67 0 2024-04-20T10:54:56.928 INFO:tasks.workunit.client.0.smithi090.stdout:8/896: rmdir d0/d11/d22/d53 39 2024-04-20T10:54:56.929 INFO:tasks.workunit.client.0.smithi090.stdout:3/897: rmdir d7/d43/db7/daf 39 2024-04-20T10:54:56.929 INFO:tasks.workunit.client.0.smithi090.stdout:3/898: read - d7/d43/fca zero size 2024-04-20T10:54:56.929 INFO:tasks.workunit.client.0.smithi090.stdout:4/908: creat d7/f12a x:0 0 0 2024-04-20T10:54:56.930 INFO:tasks.workunit.client.0.smithi090.stdout:8/897: creat d0/d99/d10f/f123 x:0 0 0 2024-04-20T10:54:56.932 INFO:tasks.workunit.client.0.smithi090.stdout:3/899: link d7/d15/d2a/c44 d7/d43/dc5/c11e 0 2024-04-20T10:54:56.932 INFO:tasks.workunit.client.0.smithi090.stdout:3/900: chown d7/f3d 4 1 2024-04-20T10:54:56.932 INFO:tasks.workunit.client.0.smithi090.stdout:3/901: write d7/d15/d47/d56/fac [2871265,90843] 0 2024-04-20T10:54:56.932 INFO:tasks.workunit.client.0.smithi090.stdout:3/902: chown d7/d15/d2a/d30 2306922 1 2024-04-20T10:54:56.932 INFO:tasks.workunit.client.0.smithi090.stdout:3/903: stat d7/c3b 0 2024-04-20T10:54:56.933 INFO:tasks.workunit.client.0.smithi090.stdout:4/909: creat d7/d9/d47/df9/d70/da1/dcd/d3d/dd2/f12b x:0 0 0 2024-04-20T10:54:56.933 INFO:tasks.workunit.client.0.smithi090.stdout:3/904: rename d7/d15/d2a/d30/d93/d7f/cbe to d7/d15/d47/c11f 0 2024-04-20T10:54:56.934 INFO:tasks.workunit.client.0.smithi090.stdout:4/910: creat d7/d9/d47/df9/dd4/f12c x:0 0 0 2024-04-20T10:54:56.934 INFO:tasks.workunit.client.0.smithi090.stdout:4/911: readlink d7/d97/l10a 0 2024-04-20T10:54:56.934 INFO:tasks.workunit.client.0.smithi090.stdout:4/912: stat d7/d9/fcf 0 2024-04-20T10:54:56.934 INFO:tasks.workunit.client.0.smithi090.stdout:6/859: dread d1/d4/d26/d11/f8a [0,4194304] 0 2024-04-20T10:54:56.934 INFO:tasks.workunit.client.0.smithi090.stdout:6/860: fsync d1/d4/f7e 0 2024-04-20T10:54:56.935 INFO:tasks.workunit.client.0.smithi090.stdout:6/861: stat d1/fb4 0 2024-04-20T10:54:56.935 INFO:tasks.workunit.client.0.smithi090.stdout:6/862: stat d1/d19/d36/d1e/d74 0 2024-04-20T10:54:56.935 INFO:tasks.workunit.client.0.smithi090.stdout:3/905: rename d7/d15/d2a/de4/c118 to d7/d43/db7/c120 0 2024-04-20T10:54:56.936 INFO:tasks.workunit.client.0.smithi090.stdout:4/913: rmdir d7/d72 39 2024-04-20T10:54:56.936 INFO:tasks.workunit.client.0.smithi090.stdout:8/898: dread d0/d11/d22/d53/d57/dd3/d111/fdd [0,4194304] 0 2024-04-20T10:54:56.936 INFO:tasks.workunit.client.0.smithi090.stdout:6/863: symlink d1/d4/d26/d11/l120 0 2024-04-20T10:54:56.937 INFO:tasks.workunit.client.0.smithi090.stdout:3/906: getdents d7/d15/d2a/d30/d93 0 2024-04-20T10:54:56.937 INFO:tasks.workunit.client.0.smithi090.stdout:3/907: read d7/d11/f2f [104572,29760] 0 2024-04-20T10:54:56.938 INFO:tasks.workunit.client.0.smithi090.stdout:4/914: creat d7/d9/d47/d8d/dda/db5/f12d x:0 0 0 2024-04-20T10:54:56.938 INFO:tasks.workunit.client.0.smithi090.stdout:4/915: truncate d7/d9/f4a 4761802 0 2024-04-20T10:54:56.938 INFO:tasks.workunit.client.0.smithi090.stdout:4/916: dread - d7/d9/d17/d94/f11c zero size 2024-04-20T10:54:56.938 INFO:tasks.workunit.client.0.smithi090.stdout:8/899: creat d0/d11/d22/d53/d8e/f124 x:0 0 0 2024-04-20T10:54:56.940 INFO:tasks.workunit.client.0.smithi090.stdout:6/864: rename d1/d19/d25/lca to d1/d4/dd6/l121 0 2024-04-20T10:54:56.940 INFO:tasks.workunit.client.0.smithi090.stdout:3/908: creat d7/d35/f121 x:0 0 0 2024-04-20T10:54:56.940 INFO:tasks.workunit.client.0.smithi090.stdout:8/900: mknod d0/d11/c125 0 2024-04-20T10:54:56.941 INFO:tasks.workunit.client.0.smithi090.stdout:8/901: write d0/d3a/d9f/db9/fc1 [2025236,124767] 0 2024-04-20T10:54:56.941 INFO:tasks.workunit.client.0.smithi090.stdout:8/902: rmdir d0/d26/da7/df5/dcf/dd5/df9/d113 39 2024-04-20T10:54:56.950 INFO:tasks.workunit.client.0.smithi090.stdout:6/865: write d1/d4/f7e [814238,34265] 0 2024-04-20T10:54:56.951 INFO:tasks.workunit.client.0.smithi090.stdout:6/866: mknod d1/d19/d36/d1e/d1f/d3f/df7/c122 0 2024-04-20T10:54:56.952 INFO:tasks.workunit.client.0.smithi090.stdout:6/867: rmdir d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd/de1 39 2024-04-20T10:54:56.953 INFO:tasks.workunit.client.0.smithi090.stdout:6/868: mkdir d1/d4/d26/d11/d4a/d6b/d123 0 2024-04-20T10:54:56.954 INFO:tasks.workunit.client.0.smithi090.stdout:6/869: truncate d1/d4/d26/d11/d4a/d6b/db5/df1/f7f 1211128 0 2024-04-20T10:54:56.954 INFO:tasks.workunit.client.0.smithi090.stdout:6/870: chown d1/d19/d36/d1e/l52 3649111 1 2024-04-20T10:54:56.955 INFO:tasks.workunit.client.0.smithi090.stdout:6/871: symlink d1/d4/d26/d11/d4a/d6b/db5/l124 0 2024-04-20T10:54:56.956 INFO:tasks.workunit.client.0.smithi090.stdout:6/872: creat d1/d19/d36/d1e/d1f/d3f/df7/d11a/f125 x:0 0 0 2024-04-20T10:54:56.956 INFO:tasks.workunit.client.0.smithi090.stdout:6/873: chown d1/d4/d26/ce8 8362294 1 2024-04-20T10:54:56.957 INFO:tasks.workunit.client.0.smithi090.stdout:7/859: sync 2024-04-20T10:54:56.959 INFO:tasks.workunit.client.0.smithi090.stdout:7/860: truncate d11/d13/d33/d44/d89/fc6 424947 0 2024-04-20T10:54:56.959 INFO:tasks.workunit.client.0.smithi090.stdout:7/861: truncate d11/d13/d22/d82/ff9 15791 0 2024-04-20T10:54:56.959 INFO:tasks.workunit.client.0.smithi090.stdout:7/862: rmdir d11/d1a/d3b/d79 39 2024-04-20T10:54:56.964 INFO:tasks.workunit.client.0.smithi090.stdout:8/903: dwrite d0/d3a/d4a/f9d [0,4194304] 0 2024-04-20T10:54:56.973 INFO:tasks.workunit.client.0.smithi090.stdout:4/917: rename d7/d9/d47/d8d/dda/db5 to d7/d9/d12e 0 2024-04-20T10:54:56.974 INFO:tasks.workunit.client.0.smithi090.stdout:4/918: mkdir d7/d9/d47/df9/d70/da5/d12f 0 2024-04-20T10:54:56.975 INFO:tasks.workunit.client.0.smithi090.stdout:4/919: stat d7/d9/c22 0 2024-04-20T10:54:56.976 INFO:tasks.workunit.client.0.smithi090.stdout:4/920: mkdir d7/d97/d130 0 2024-04-20T10:54:56.976 INFO:tasks.workunit.client.0.smithi090.stdout:4/921: stat d7/d9 0 2024-04-20T10:54:56.977 INFO:tasks.workunit.client.0.smithi090.stdout:4/922: truncate d7/d9/d47/df9/f8a 2769111 0 2024-04-20T10:54:56.979 INFO:tasks.workunit.client.0.smithi090.stdout:4/923: link d7/d9/d47/df9/dd4/f12c d7/d9/d47/df9/d70/da5/f131 0 2024-04-20T10:54:56.979 INFO:tasks.workunit.client.0.smithi090.stdout:4/924: chown d7/d9/d47/df9/dd4/f100 1308305 1 2024-04-20T10:54:56.979 INFO:tasks.workunit.client.0.smithi090.stdout:8/904: read d0/d26/f4d [2941389,61229] 0 2024-04-20T10:54:56.979 INFO:tasks.workunit.client.0.smithi090.stdout:4/925: truncate d7/d9/d47/df9/d103/f10e 1695145 0 2024-04-20T10:54:56.981 INFO:tasks.workunit.client.0.smithi090.stdout:8/905: link d0/d26/f78 d0/d11/d22/d53/d57/d11d/f126 0 2024-04-20T10:54:56.983 INFO:tasks.workunit.client.0.smithi090.stdout:3/909: dwrite d7/df/f4d [0,4194304] 0 2024-04-20T10:54:56.985 INFO:tasks.workunit.client.0.smithi090.stdout:3/910: truncate d7/f19 2335516 0 2024-04-20T10:54:56.985 INFO:tasks.workunit.client.0.smithi090.stdout:3/911: chown d7/d15/d2a/c44 451417 1 2024-04-20T10:54:56.987 INFO:tasks.workunit.client.0.smithi090.stdout:4/926: dread d7/d9/d47/df9/d70/da1/dcd/d3d/f75 [0,4194304] 0 2024-04-20T10:54:56.987 INFO:tasks.workunit.client.0.smithi090.stdout:3/912: link d7/d43/db7/lf6 d7/d26/dc9/l122 0 2024-04-20T10:54:57.000 INFO:tasks.workunit.client.0.smithi090.stdout:6/874: dwrite d1/d19/d36/d1e/d1f/d3f/f79 [0,4194304] 0 2024-04-20T10:54:57.000 INFO:tasks.workunit.client.0.smithi090.stdout:8/906: dwrite d0/d3a/d9f/f7f [0,4194304] 0 2024-04-20T10:54:57.000 INFO:tasks.workunit.client.0.smithi090.stdout:8/907: chown d0/d11/d22/d53/df6 201 1 2024-04-20T10:54:57.013 INFO:tasks.workunit.client.0.smithi090.stdout:4/927: symlink d7/d9/d92/d111/l132 0 2024-04-20T10:54:57.013 INFO:tasks.workunit.client.0.smithi090.stdout:4/928: write d7/d9/d47/df9/d70/da1/dcd/d42/d8f/ff0 [1106495,125413] 0 2024-04-20T10:54:57.014 INFO:tasks.workunit.client.0.smithi090.stdout:3/913: unlink d7/f79 0 2024-04-20T10:54:57.021 INFO:tasks.workunit.client.0.smithi090.stdout:6/875: symlink d1/d4/d26/d11/d4a/d56/l126 0 2024-04-20T10:54:57.021 INFO:tasks.workunit.client.0.smithi090.stdout:6/876: chown d1/d4/d26/d11/d4a/d6b/db5/l114 16734409 1 2024-04-20T10:54:57.021 INFO:tasks.workunit.client.0.smithi090.stdout:8/908: symlink d0/d11/d22/d53/d57/d11d/l127 0 2024-04-20T10:54:57.024 INFO:tasks.workunit.client.0.smithi090.stdout:4/929: truncate d7/d9/d17/f58 3697891 0 2024-04-20T10:54:57.024 INFO:tasks.workunit.client.0.smithi090.stdout:4/930: chown d7/d9/d47/df9/d70/da1/dcd/d3d/dd2 175546 1 2024-04-20T10:54:57.030 INFO:tasks.workunit.client.0.smithi090.stdout:6/877: mknod d1/d4/d26/d11/d35/d80/c127 0 2024-04-20T10:54:57.032 INFO:tasks.workunit.client.0.smithi090.stdout:8/909: rename d0/cf to d0/d26/da7/da9/c128 0 2024-04-20T10:54:57.037 INFO:tasks.workunit.client.0.smithi090.stdout:4/931: truncate d7/f7d 3971265 0 2024-04-20T10:54:57.039 INFO:tasks.workunit.client.0.smithi090.stdout:6/878: unlink d1/d19/d36/d1e/d1f/d3f/d54/d9f/da9/fce 0 2024-04-20T10:54:57.041 INFO:tasks.workunit.client.0.smithi090.stdout:7/863: dwrite d11/d13/d23/f62 [0,4194304] 0 2024-04-20T10:54:57.043 INFO:tasks.workunit.client.0.smithi090.stdout:4/932: creat d7/d9/d17/d94/f133 x:0 0 0 2024-04-20T10:54:57.044 INFO:tasks.workunit.client.0.smithi090.stdout:7/864: dread d11/d1a/d3f/f6f [0,4194304] 0 2024-04-20T10:54:57.044 INFO:tasks.workunit.client.0.smithi090.stdout:7/865: stat d11/d13/d22/d27/lf6 0 2024-04-20T10:54:57.071 INFO:tasks.workunit.client.0.smithi090.stdout:8/910: rename d0/d99/d10f to d0/d11/d22/d53/d8e/d129 0 2024-04-20T10:54:57.071 INFO:tasks.workunit.client.0.smithi090.stdout:8/911: chown d0/d11/d22/d53/d57/dd3/d111/d67/lab 1 1 2024-04-20T10:54:57.073 INFO:tasks.workunit.client.0.smithi090.stdout:8/912: creat d0/d11/f12a x:0 0 0 2024-04-20T10:54:57.078 INFO:tasks.workunit.client.0.smithi090.stdout:8/913: dread d0/d3a/daa/f112 [0,4194304] 0 2024-04-20T10:54:57.078 INFO:tasks.workunit.client.0.smithi090.stdout:8/914: fdatasync d0/d2d/f30 0 2024-04-20T10:54:57.078 INFO:tasks.workunit.client.0.smithi090.stdout:8/915: fsync d0/d3a/d9f/f11a 0 2024-04-20T10:54:57.078 INFO:tasks.workunit.client.0.smithi090.stdout:8/916: chown d0/d11/d22/d53/d8e/f124 4 1 2024-04-20T10:54:57.078 INFO:tasks.workunit.client.0.smithi090.stdout:4/933: unlink d7/d9/d17/d56/le5 0 2024-04-20T10:54:57.079 INFO:tasks.workunit.client.0.smithi090.stdout:8/917: truncate d0/d3a/d9f/db9/dbe/fce 2541496 0 2024-04-20T10:54:57.079 INFO:tasks.workunit.client.0.smithi090.stdout:8/918: stat d0/d11/d22/d53/d57/fe2 0 2024-04-20T10:54:57.079 INFO:tasks.workunit.client.0.smithi090.stdout:8/919: write d0/d11/d22/d53/d57/d11d/f126 [2768897,78872] 0 2024-04-20T10:54:57.080 INFO:tasks.workunit.client.0.smithi090.stdout:4/934: creat d7/d9/d47/df9/d70/da1/dcd/d76/f134 x:0 0 0 2024-04-20T10:54:57.102 INFO:tasks.workunit.client.0.smithi090.stdout:4/935: dwrite d7/d9/f6d [0,4194304] 0 2024-04-20T10:54:57.102 INFO:tasks.workunit.client.0.smithi090.stdout:4/936: truncate d7/d9/d17/de3/fee 895301 0 2024-04-20T10:54:57.102 INFO:tasks.workunit.client.0.smithi090.stdout:8/920: dwrite d0/d3a/d9f/db9/f110 [0,4194304] 0 2024-04-20T10:54:57.104 INFO:tasks.workunit.client.0.smithi090.stdout:4/937: truncate d7/d9/d47/df9/d70/da1/dcd/d42/d8f/ff0 796455 0 2024-04-20T10:54:57.105 INFO:tasks.workunit.client.0.smithi090.stdout:4/938: dread - d7/d9/d12e/f12d zero size 2024-04-20T10:54:57.105 INFO:tasks.workunit.client.0.smithi090.stdout:4/939: chown d7/d97/c98 3687876 1 2024-04-20T10:54:57.106 INFO:tasks.workunit.client.0.smithi090.stdout:4/940: mkdir d7/d72/d135 0 2024-04-20T10:54:57.107 INFO:tasks.workunit.client.0.smithi090.stdout:8/921: dread d0/f8 [0,4194304] 0 2024-04-20T10:54:57.108 INFO:tasks.workunit.client.0.smithi090.stdout:4/941: dread d7/d9/d47/df9/d70/da1/dcd/d76/fc3 [0,4194304] 0 2024-04-20T10:54:57.127 INFO:tasks.workunit.client.0.smithi090.stdout:4/942: write d7/d9/fa [8152373,48685] 0 2024-04-20T10:54:57.128 INFO:tasks.workunit.client.0.smithi090.stdout:8/922: dwrite d0/d2d/f106 [0,4194304] 0 2024-04-20T10:54:57.128 INFO:tasks.workunit.client.0.smithi090.stdout:4/943: write d7/d9/d47/df9/d70/da1/dcd/d3d/dd2/fd3 [240889,72634] 0 2024-04-20T10:54:57.166 INFO:tasks.workunit.client.1.smithi175.stdout:1/327: creat d0/d3e/d61/f70 x:0 0 0 2024-04-20T10:54:57.184 INFO:tasks.workunit.client.1.smithi175.stdout:0/375: dwrite df/d17/d2f/d4f/f6c [0,4194304] 0 2024-04-20T10:54:57.185 INFO:tasks.workunit.client.1.smithi175.stdout:0/376: fsync df/d1a/d22/d24/f68 0 2024-04-20T10:54:57.187 INFO:tasks.workunit.client.1.smithi175.stdout:0/377: mknod df/d1a/d22/d6a/d72/d48/c74 0 2024-04-20T10:54:57.189 INFO:tasks.workunit.client.1.smithi175.stdout:7/475: write db/d1d/d29/d8e/f4d [481366,106078] 0 2024-04-20T10:54:57.189 INFO:tasks.workunit.client.1.smithi175.stdout:7/476: read - db/d1d/d29/d2a/d41/d59/fa0 zero size 2024-04-20T10:54:57.190 INFO:tasks.workunit.client.1.smithi175.stdout:0/378: rename df/d1a/d28/f4b to df/d1a/d3f/f75 0 2024-04-20T10:54:57.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.201+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4c7006d070 con 0x7f4c700ab730 2024-04-20T10:54:57.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.201+0000 7f4c66ffd640 1 -- 172.21.15.90:0/2692262468 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5705 (secure 0 0 0) 0x7f4c600592f0 con 0x7f4c700ab730 2024-04-20T10:54:57.202 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:57.202 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:54:57.202 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 37 2024-04-20T10:54:57.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5406c920 msgr2=0x7f4c5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:57.204 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5406c920 0x7f4c5406ede0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c036000 tx=0x7f4c6c03d040 comp rx=0 tx=0).stop 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 msgr2=0x7f4c701efbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701efbe0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f4c6000c430 tx=0x7f4c6000c8f0 comp rx=0 tx=0).stop 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 shutdown_connections 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4c5406c920 0x7f4c5406ede0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4c70153ef0 0x7f4c701509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4c700c9ee0 0x7f4c700b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 --2- 172.21.15.90:0/2692262468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4c700ab730 0x7f4c701efbe0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 >> 172.21.15.90:0/2692262468 conn(0x7f4c700cbfe0 msgr2=0x7f4c700ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 shutdown_connections 2024-04-20T10:54:57.205 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:57.204+0000 7f4c786a5640 1 -- 172.21.15.90:0/2692262468 wait complete. 2024-04-20T10:54:57.209 INFO:tasks.workunit.client.1.smithi175.stdout:6/440: dwrite d1/d37/f66 [0,4194304] 0 2024-04-20T10:54:57.210 INFO:tasks.workunit.client.1.smithi175.stdout:0/379: dwrite df/d17/d2f/f66 [0,4194304] 0 2024-04-20T10:54:57.212 INFO:tasks.workunit.client.1.smithi175.stdout:0/380: write df/d17/f2a [4646311,62802] 0 2024-04-20T10:54:57.213 INFO:tasks.workunit.client.1.smithi175.stdout:7/477: symlink db/d1d/d60/d76/lb2 0 2024-04-20T10:54:57.213 INFO:tasks.workunit.client.1.smithi175.stdout:0/381: rmdir df 39 2024-04-20T10:54:57.214 INFO:tasks.workunit.client.1.smithi175.stdout:7/478: mkdir db/d1d/d29/d2a/d41/d59/db3 0 2024-04-20T10:54:57.215 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is in active, standby or standby-replay 2024-04-20T10:54:57.215 INFO:tasks.workunit.client.1.smithi175.stdout:7/479: rmdir db 39 2024-04-20T10:54:57.216 INFO:tasks.workunit.client.1.smithi175.stdout:0/382: rename df/d1a/c2b to df/d1a/d28/c76 0 2024-04-20T10:54:57.217 INFO:tasks.workunit.client.1.smithi175.stdout:7/480: chown db/d1d/d60/c95 1020256 1 2024-04-20T10:54:57.217 INFO:tasks.workunit.client.1.smithi175.stdout:7/481: fsync db/d1d/d39/d50/f28 0 2024-04-20T10:54:57.219 INFO:tasks.workunit.client.1.smithi175.stdout:7/482: creat db/d1d/d29/fb4 x:0 0 0 2024-04-20T10:54:57.219 INFO:tasks.workunit.client.1.smithi175.stdout:0/383: symlink df/d2e/l77 0 2024-04-20T10:54:57.222 INFO:tasks.workunit.client.1.smithi175.stdout:7/483: mknod db/d1d/d29/d9a/cb5 0 2024-04-20T10:54:57.236 INFO:tasks.workunit.client.1.smithi175.stdout:1/328: dwrite d0/d8/f5f [0,4194304] 0 2024-04-20T10:54:57.237 INFO:tasks.workunit.client.1.smithi175.stdout:1/329: chown d0/l66 221478640 1 2024-04-20T10:54:57.238 INFO:tasks.workunit.client.1.smithi175.stdout:1/330: creat d0/d8/f71 x:0 0 0 2024-04-20T10:54:57.239 INFO:tasks.workunit.client.1.smithi175.stdout:7/484: truncate db/d1d/d29/d8f/faf 2701348 0 2024-04-20T10:54:57.245 INFO:tasks.workunit.client.1.smithi175.stdout:6/441: dwrite d1/f18 [0,4194304] 0 2024-04-20T10:54:57.246 INFO:tasks.workunit.client.1.smithi175.stdout:7/485: mkdir db/d1d/d60/d76/db6 0 2024-04-20T10:54:57.247 INFO:tasks.workunit.client.1.smithi175.stdout:6/442: chown d1/d5/d12/f47 54 1 2024-04-20T10:54:57.249 INFO:tasks.workunit.client.1.smithi175.stdout:7/486: chown db/d1d/d29/d2a/c4f 993884719 1 2024-04-20T10:54:57.255 INFO:tasks.workunit.client.1.smithi175.stdout:0/384: write f1 [3809952,73948] 0 2024-04-20T10:54:57.257 INFO:tasks.workunit.client.1.smithi175.stdout:7/487: truncate db/f7e 1041436 0 2024-04-20T10:54:57.257 INFO:tasks.workunit.client.1.smithi175.stdout:0/385: write df/d1a/d22/d6a/d72/d48/d4e/f5d [225838,56709] 0 2024-04-20T10:54:57.259 INFO:tasks.workunit.client.1.smithi175.stdout:7/488: rename db/d1d/d60/c95 to db/d1d/d29/d9a/cb7 0 2024-04-20T10:54:57.260 INFO:tasks.workunit.client.1.smithi175.stdout:0/386: mknod df/d19/c78 0 2024-04-20T10:54:57.261 INFO:tasks.workunit.client.1.smithi175.stdout:7/489: creat db/d1d/fb8 x:0 0 0 2024-04-20T10:54:57.268 INFO:tasks.workunit.client.1.smithi175.stdout:0/387: dread df/d1a/d3f/f75 [0,4194304] 0 2024-04-20T10:54:57.268 INFO:tasks.workunit.client.1.smithi175.stdout:0/388: truncate df/d1a/d22/d6a/d72/d48/d4e/f69 273234 0 2024-04-20T10:54:57.269 INFO:tasks.workunit.client.1.smithi175.stdout:0/389: creat df/d1a/d22/f79 x:0 0 0 2024-04-20T10:54:57.270 INFO:tasks.workunit.client.1.smithi175.stdout:7/490: mkdir db/d1d/d39/d50/d12/d47/da6/db9 0 2024-04-20T10:54:57.273 INFO:tasks.workunit.client.1.smithi175.stdout:1/331: dwrite d0/d8/d13/d2e/f38 [0,4194304] 0 2024-04-20T10:54:57.274 INFO:tasks.workunit.client.1.smithi175.stdout:0/390: read - df/d1a/d28/f43 zero size 2024-04-20T10:54:57.275 INFO:tasks.workunit.client.1.smithi175.stdout:1/332: creat d0/d8/d13/d2e/f72 x:0 0 0 2024-04-20T10:54:57.275 INFO:tasks.workunit.client.1.smithi175.stdout:1/333: stat d0/d3e/l69 0 2024-04-20T10:54:57.276 INFO:tasks.workunit.client.1.smithi175.stdout:0/391: creat df/d19/f7a x:0 0 0 2024-04-20T10:54:57.276 INFO:tasks.workunit.client.1.smithi175.stdout:0/392: chown df/d1a 5801 1 2024-04-20T10:54:57.276 INFO:tasks.workunit.client.1.smithi175.stdout:0/393: read - df/d19/f7a zero size 2024-04-20T10:54:57.282 INFO:tasks.workunit.client.1.smithi175.stdout:0/394: truncate df/d1a/d22/d24/f68 940546 0 2024-04-20T10:54:57.298 INFO:tasks.workunit.client.1.smithi175.stdout:7/491: dwrite db/d1d/d29/fb4 [0,4194304] 0 2024-04-20T10:54:57.298 INFO:tasks.workunit.client.1.smithi175.stdout:7/492: dread - db/d1d/d29/d2a/f4b zero size 2024-04-20T10:54:57.299 INFO:tasks.workunit.client.1.smithi175.stdout:0/395: write df/f10 [2861344,42630] 0 2024-04-20T10:54:57.301 INFO:tasks.workunit.client.1.smithi175.stdout:1/334: write d0/d8/f12 [4133257,51682] 0 2024-04-20T10:54:57.301 INFO:tasks.workunit.client.1.smithi175.stdout:7/493: rename db/d1d/d39/d50/d12 to db/d1d/d39/d50/dba 0 2024-04-20T10:54:57.301 INFO:tasks.workunit.client.1.smithi175.stdout:0/396: creat df/d1a/d3f/d5e/f7b x:0 0 0 2024-04-20T10:54:57.302 INFO:tasks.workunit.client.1.smithi175.stdout:1/335: fsync d0/d51/f48 0 2024-04-20T10:54:57.305 INFO:tasks.workunit.client.1.smithi175.stdout:1/336: mkdir d0/d3e/d61/d73 0 2024-04-20T10:54:57.305 INFO:tasks.workunit.client.1.smithi175.stdout:1/337: truncate d0/d8/d13/d2e/f5b 48872 0 2024-04-20T10:54:57.306 INFO:tasks.workunit.client.1.smithi175.stdout:1/338: truncate d0/d8/f4d 231062 0 2024-04-20T10:54:57.307 INFO:tasks.workunit.client.1.smithi175.stdout:7/494: dread f2 [0,4194304] 0 2024-04-20T10:54:57.310 INFO:tasks.workunit.client.1.smithi175.stdout:1/339: dread d0/f23 [4194304,4194304] 0 2024-04-20T10:54:57.311 INFO:tasks.workunit.client.1.smithi175.stdout:1/340: creat d0/d57/f74 x:0 0 0 2024-04-20T10:54:57.312 INFO:tasks.workunit.client.1.smithi175.stdout:1/341: readlink d0/d8/d13/d2e/l34 0 2024-04-20T10:54:57.312 INFO:tasks.workunit.client.1.smithi175.stdout:0/397: dread f0 [0,4194304] 0 2024-04-20T10:54:57.313 INFO:tasks.workunit.client.1.smithi175.stdout:0/398: chown df/d1a/c1b 595473142 1 2024-04-20T10:54:57.314 INFO:tasks.workunit.client.1.smithi175.stdout:7/495: symlink db/d1d/d29/d8e/lbb 0 2024-04-20T10:54:57.314 INFO:tasks.workunit.client.1.smithi175.stdout:1/342: mkdir d0/d8/d13/d75 0 2024-04-20T10:54:57.315 INFO:tasks.workunit.client.1.smithi175.stdout:0/399: creat df/d1a/d28/f7c x:0 0 0 2024-04-20T10:54:57.320 INFO:tasks.workunit.client.1.smithi175.stdout:1/343: dread d0/fd [0,4194304] 0 2024-04-20T10:54:57.320 INFO:tasks.workunit.client.1.smithi175.stdout:1/344: mknod d0/d8/d13/d75/c76 0 2024-04-20T10:54:57.321 INFO:tasks.workunit.client.1.smithi175.stdout:1/345: creat d0/f77 x:0 0 0 2024-04-20T10:54:57.322 INFO:tasks.workunit.client.1.smithi175.stdout:1/346: rename d0/d57/c65 to d0/d51/d6b/c78 0 2024-04-20T10:54:57.324 INFO:tasks.workunit.client.1.smithi175.stdout:1/347: mkdir d0/d8/d13/d79 0 2024-04-20T10:54:57.342 INFO:tasks.workunit.client.1.smithi175.stdout:7/496: dwrite f2 [0,4194304] 0 2024-04-20T10:54:57.382 INFO:tasks.workunit.client.0.smithi090.stdout:6/879: mknod d1/d19/d36/d1e/d1f/d3f/d54/c128 0 2024-04-20T10:54:57.382 INFO:tasks.workunit.client.0.smithi090.stdout:8/923: creat d0/d26/f12b x:0 0 0 2024-04-20T10:54:57.382 INFO:tasks.workunit.client.0.smithi090.stdout:7/866: rename d11/d13/d22/d27/f10b to d11/d1a/d3b/ddf/f110 0 2024-04-20T10:54:57.382 INFO:tasks.workunit.client.0.smithi090.stdout:7/867: write d11/d13/d33/f9d [4635232,67632] 0 2024-04-20T10:54:57.383 INFO:tasks.workunit.client.0.smithi090.stdout:4/944: mkdir d7/d9/d47/df9/d70/da1/dcd/d76/d136 0 2024-04-20T10:54:57.386 INFO:tasks.workunit.client.0.smithi090.stdout:6/880: rename d1/d10/fdb to d1/d19/d36/d1e/d74/f129 0 2024-04-20T10:54:57.388 INFO:tasks.workunit.client.0.smithi090.stdout:4/945: symlink d7/d9/d47/df9/d70/da1/dcd/d42/l137 0 2024-04-20T10:54:57.388 INFO:tasks.workunit.client.0.smithi090.stdout:6/881: mknod d1/d4/d26/d11/d4a/d6b/d123/c12a 0 2024-04-20T10:54:57.389 INFO:tasks.workunit.client.0.smithi090.stdout:4/946: creat d7/d9/d47/df9/d70/da1/dcd/d42/d8f/da2/f138 x:0 0 0 2024-04-20T10:54:57.390 INFO:tasks.workunit.client.0.smithi090.stdout:8/924: write d0/d2d/d44/fc8 [694198,41825] 0 2024-04-20T10:54:57.390 INFO:tasks.workunit.client.0.smithi090.stdout:8/925: getdents d0/d2d/d44/dd9 0 2024-04-20T10:54:57.396 INFO:tasks.workunit.client.0.smithi090.stdout:7/868: truncate d11/d13/d22/d24/f5e 1396957 0 2024-04-20T10:54:57.397 INFO:tasks.workunit.client.0.smithi090.stdout:6/882: dread d1/d4/d26/d11/d4a/d56/f61 [0,4194304] 0 2024-04-20T10:54:57.397 INFO:tasks.workunit.client.0.smithi090.stdout:6/883: fsync d1/d19/d36/f91 0 2024-04-20T10:54:57.397 INFO:tasks.workunit.client.0.smithi090.stdout:6/884: getdents d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/d103 0 2024-04-20T10:54:57.397 INFO:tasks.workunit.client.0.smithi090.stdout:6/885: truncate d1/d4/d26/d11/d35/d80/f116 82583 0 2024-04-20T10:54:57.398 INFO:tasks.workunit.client.0.smithi090.stdout:7/869: mknod d11/d13/c111 0 2024-04-20T10:54:57.398 INFO:tasks.workunit.client.0.smithi090.stdout:7/870: chown d11/d13/d5d 5142 1 2024-04-20T10:54:57.398 INFO:tasks.workunit.client.0.smithi090.stdout:6/886: rmdir d1/d4/d26/d11/d4a/d6b/db5/df1 39 2024-04-20T10:54:57.398 INFO:tasks.workunit.client.0.smithi090.stdout:6/887: stat d1/d19/d36/d1e/d1f/d3f/f4b 0 2024-04-20T10:54:57.399 INFO:tasks.workunit.client.0.smithi090.stdout:7/871: rename d11/d13/d22/d82/fd4 to d11/d1a/d3b/dc8/d10d/f112 0 2024-04-20T10:54:57.400 INFO:tasks.workunit.client.0.smithi090.stdout:7/872: dread - d11/d13/f90 zero size 2024-04-20T10:54:57.400 INFO:tasks.workunit.client.0.smithi090.stdout:7/873: write f4 [4312587,64722] 0 2024-04-20T10:54:57.400 INFO:tasks.workunit.client.0.smithi090.stdout:7/874: write d11/d13/fae [3045206,25916] 0 2024-04-20T10:54:57.400 INFO:tasks.workunit.client.0.smithi090.stdout:7/875: write d11/d13/d22/fe2 [348982,47828] 0 2024-04-20T10:54:57.402 INFO:tasks.workunit.client.0.smithi090.stdout:6/888: rename d1/d9a/fcc to d1/d9a/de2/f12b 0 2024-04-20T10:54:57.402 INFO:tasks.workunit.client.0.smithi090.stdout:6/889: write d1/d19/d36/d1e/d1f/d3f/d54/d9f/ffa [98754,59730] 0 2024-04-20T10:54:57.402 INFO:tasks.workunit.client.0.smithi090.stdout:6/890: write d1/d4/d26/d11/d4a/db3/f109 [902561,42488] 0 2024-04-20T10:54:57.402 INFO:tasks.workunit.client.0.smithi090.stdout:3/914: sync 2024-04-20T10:54:57.402 INFO:tasks.workunit.client.0.smithi090.stdout:3/915: fdatasync d7/d15/d2a/f58 0 2024-04-20T10:54:57.404 INFO:tasks.workunit.client.0.smithi090.stdout:6/891: unlink d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/cff 0 2024-04-20T10:54:57.404 INFO:tasks.workunit.client.0.smithi090.stdout:6/892: fsync d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/ffe 0 2024-04-20T10:54:57.404 INFO:tasks.workunit.client.0.smithi090.stdout:3/916: rmdir d7/d15/d2a/de4 39 2024-04-20T10:54:57.405 INFO:tasks.workunit.client.0.smithi090.stdout:6/893: mkdir d1/d4/d26/d12c 0 2024-04-20T10:54:57.406 INFO:tasks.workunit.client.0.smithi090.stdout:3/917: truncate d7/f8b 4118718 0 2024-04-20T10:54:57.407 INFO:tasks.workunit.client.0.smithi090.stdout:6/894: symlink d1/d4/d26/d11/d4a/d56/d118/l12d 0 2024-04-20T10:54:57.408 INFO:tasks.workunit.client.0.smithi090.stdout:3/918: truncate d7/d15/f1d 646075 0 2024-04-20T10:54:57.408 INFO:tasks.workunit.client.0.smithi090.stdout:3/919: fdatasync d7/d26/dc9/f115 0 2024-04-20T10:54:57.409 INFO:tasks.workunit.client.0.smithi090.stdout:3/920: creat d7/d15/d47/d56/f123 x:0 0 0 2024-04-20T10:54:57.411 INFO:tasks.workunit.client.0.smithi090.stdout:3/921: getdents d7 0 2024-04-20T10:54:57.411 INFO:tasks.workunit.client.0.smithi090.stdout:3/922: fdatasync d7/d15/d2a/d8d/fb1 0 2024-04-20T10:54:57.411 INFO:tasks.workunit.client.0.smithi090.stdout:3/923: mkdir d7/d11/dd0/d124 0 2024-04-20T10:54:57.413 INFO:tasks.workunit.client.0.smithi090.stdout:3/924: mknod d7/d15/d2a/da2/df0/c125 0 2024-04-20T10:54:57.414 INFO:tasks.workunit.client.0.smithi090.stdout:3/925: unlink d7/d43/db7/f50 0 2024-04-20T10:54:57.415 INFO:tasks.workunit.client.0.smithi090.stdout:3/926: dread - d7/d43/dd9/f109 zero size 2024-04-20T10:54:57.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/927: mkdir d7/d43/db7/dd4/d126 0 2024-04-20T10:54:57.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/928: chown d7/d43/f45 15164513 1 2024-04-20T10:54:57.416 INFO:tasks.workunit.client.0.smithi090.stdout:3/929: symlink d7/d43/dd9/l127 0 2024-04-20T10:54:57.418 INFO:tasks.workunit.client.0.smithi090.stdout:4/947: dwrite d7/d9/d17/f3f [0,4194304] 0 2024-04-20T10:54:57.419 INFO:tasks.workunit.client.0.smithi090.stdout:4/948: chown d7/d9/d47/df9/d70/da5/d12f 1053177 1 2024-04-20T10:54:57.419 INFO:tasks.workunit.client.0.smithi090.stdout:4/949: fdatasync d7/d9/d17/d56/f8c 0 2024-04-20T10:54:57.419 INFO:tasks.workunit.client.0.smithi090.stdout:6/895: dread d1/d9a/de2/f12b [0,4194304] 0 2024-04-20T10:54:57.419 INFO:tasks.workunit.client.0.smithi090.stdout:6/896: write d1/d19/f59 [1093881,17333] 0 2024-04-20T10:54:57.419 INFO:tasks.workunit.client.0.smithi090.stdout:8/926: dwrite d0/d3a/d9f/d52/f82 [0,4194304] 0 2024-04-20T10:54:57.419 INFO:tasks.workunit.client.0.smithi090.stdout:4/950: creat d7/d97/d130/f139 x:0 0 0 2024-04-20T10:54:57.420 INFO:tasks.workunit.client.0.smithi090.stdout:4/951: fdatasync d7/d9/d47/d8d/fd5 0 2024-04-20T10:54:57.420 INFO:tasks.workunit.client.0.smithi090.stdout:6/897: rmdir d1/d4/dd6 39 2024-04-20T10:54:57.421 INFO:tasks.workunit.client.0.smithi090.stdout:7/876: dwrite d11/d13/d5d/d65/f8b [0,4194304] 0 2024-04-20T10:54:57.422 INFO:tasks.workunit.client.0.smithi090.stdout:8/927: symlink d0/d11/d22/d53/d57/d11d/l12c 0 2024-04-20T10:54:57.423 INFO:tasks.workunit.client.0.smithi090.stdout:4/952: rename d7/d9/d17/d94/fce to d7/d9/d17/d94/f13a 0 2024-04-20T10:54:57.424 INFO:tasks.workunit.client.0.smithi090.stdout:6/898: unlink d1/d19/cbc 0 2024-04-20T10:54:57.424 INFO:tasks.workunit.client.0.smithi090.stdout:6/899: fdatasync d1/d19/d36/d1e/d1f/d3f/f96 0 2024-04-20T10:54:57.428 INFO:tasks.workunit.client.0.smithi090.stdout:7/877: creat d11/d13/d22/df3/f113 x:0 0 0 2024-04-20T10:54:57.430 INFO:tasks.workunit.client.0.smithi090.stdout:8/928: unlink d0/d11/d22/d53/lcd 0 2024-04-20T10:54:57.432 INFO:tasks.workunit.client.0.smithi090.stdout:7/878: creat d11/d13/d5d/f114 x:0 0 0 2024-04-20T10:54:57.434 INFO:tasks.workunit.client.0.smithi090.stdout:7/879: creat d11/d13/d22/d8f/f115 x:0 0 0 2024-04-20T10:54:57.434 INFO:tasks.workunit.client.0.smithi090.stdout:7/880: write d11/d1a/d3b/ddf/f110 [316859,9566] 0 2024-04-20T10:54:57.435 INFO:tasks.workunit.client.0.smithi090.stdout:7/881: creat d11/d13/d23/dd8/f116 x:0 0 0 2024-04-20T10:54:57.438 INFO:tasks.workunit.client.0.smithi090.stdout:6/900: dread d1/d4/d26/d11/d35/d97/ff5 [0,4194304] 0 2024-04-20T10:54:57.439 INFO:tasks.workunit.client.0.smithi090.stdout:3/930: dwrite d7/df/dd1/f101 [0,4194304] 0 2024-04-20T10:54:57.439 INFO:tasks.workunit.client.0.smithi090.stdout:3/931: chown d7/d43/db7/lf6 30 1 2024-04-20T10:54:57.440 INFO:tasks.workunit.client.0.smithi090.stdout:6/901: mkdir d1/d19/d36/d1e/d1f/d3f/df7/d11a/d12e 0 2024-04-20T10:54:57.444 INFO:tasks.workunit.client.0.smithi090.stdout:8/929: dread d0/d3a/d4a/f95 [0,4194304] 0 2024-04-20T10:54:57.444 INFO:tasks.workunit.client.0.smithi090.stdout:8/930: dread - d0/d99/fa1 zero size 2024-04-20T10:54:57.448 INFO:tasks.workunit.client.0.smithi090.stdout:4/953: dwrite d7/f52 [0,4194304] 0 2024-04-20T10:54:57.449 INFO:tasks.workunit.client.0.smithi090.stdout:4/954: fdatasync d7/d9/d17/fed 0 2024-04-20T10:54:57.452 INFO:tasks.workunit.client.0.smithi090.stdout:8/931: read d0/d11/d22/d53/d57/dd3/d111/d67/f87 [1733401,33432] 0 2024-04-20T10:54:57.453 INFO:tasks.workunit.client.0.smithi090.stdout:3/932: dwrite d7/d43/fca [0,4194304] 0 2024-04-20T10:54:57.580 INFO:tasks.workunit.client.1.smithi175.stdout:1/348: truncate d0/d8/f1f 4338122 0 2024-04-20T10:54:57.582 INFO:tasks.workunit.client.1.smithi175.stdout:7/497: mkdir db/d61/d6d/dbc 0 2024-04-20T10:54:57.583 INFO:tasks.workunit.client.1.smithi175.stdout:7/498: creat db/d1d/d29/d8e/fbd x:0 0 0 2024-04-20T10:54:57.583 INFO:tasks.workunit.client.1.smithi175.stdout:7/499: stat db/d1d/d39/d50/dba/d47/da6/db9 0 2024-04-20T10:54:57.584 INFO:tasks.workunit.client.1.smithi175.stdout:7/500: mknod db/d61/d6d/dbc/cbe 0 2024-04-20T10:54:57.588 INFO:tasks.workunit.client.1.smithi175.stdout:7/501: dread db/d1d/d39/d50/f55 [0,4194304] 0 2024-04-20T10:54:57.596 INFO:tasks.workunit.client.1.smithi175.stdout:1/349: write d0/ff [259856,87524] 0 2024-04-20T10:54:57.597 INFO:tasks.workunit.client.1.smithi175.stdout:1/350: getdents d0/d8/d13/d2e/d35 0 2024-04-20T10:54:57.597 INFO:tasks.workunit.client.1.smithi175.stdout:1/351: mkdir d0/d57/d7a 0 2024-04-20T10:54:57.598 INFO:tasks.workunit.client.1.smithi175.stdout:0/400: dwrite df/d19/f51 [0,4194304] 0 2024-04-20T10:54:57.598 INFO:tasks.workunit.client.1.smithi175.stdout:1/352: chown d0/d8/c1d 1099855 1 2024-04-20T10:54:57.601 INFO:tasks.workunit.client.1.smithi175.stdout:0/401: mknod df/d1a/d22/d24/c7d 0 2024-04-20T10:54:57.601 INFO:tasks.workunit.client.1.smithi175.stdout:1/353: mkdir d0/d8/d13/d7b 0 2024-04-20T10:54:57.604 INFO:tasks.workunit.client.1.smithi175.stdout:1/354: creat d0/d8/d13/d2e/d35/f7c x:0 0 0 2024-04-20T10:54:57.606 INFO:tasks.workunit.client.1.smithi175.stdout:0/402: dread df/d19/f1f [0,4194304] 0 2024-04-20T10:54:57.606 INFO:tasks.workunit.client.1.smithi175.stdout:7/502: mkdir db/d1d/d39/d50/dba/d47/d6a/dbf 0 2024-04-20T10:54:57.607 INFO:tasks.workunit.client.1.smithi175.stdout:0/403: write df/d19/f1e [63876,101147] 0 2024-04-20T10:54:57.608 INFO:tasks.workunit.client.1.smithi175.stdout:7/503: fdatasync db/d1d/d29/d2a/f30 0 2024-04-20T10:54:57.610 INFO:tasks.workunit.client.1.smithi175.stdout:0/404: link df/d1a/d22/d24/l30 df/d1a/d3f/d5e/l7e 0 2024-04-20T10:54:57.611 INFO:tasks.workunit.client.1.smithi175.stdout:0/405: fsync df/d19/f1f 0 2024-04-20T10:54:57.611 INFO:tasks.workunit.client.1.smithi175.stdout:1/355: write d0/d8/f5e [4790940,120057] 0 2024-04-20T10:54:57.615 INFO:tasks.workunit.client.1.smithi175.stdout:7/504: link db/d1d/d39/d50/dba/f88 db/d1d/d39/d50/dba/d47/da6/fc0 0 2024-04-20T10:54:57.615 INFO:tasks.workunit.client.0.smithi090.stdout:6/902: rename d1/d19/d25/lbd to d1/d4/d26/d11/d4a/l12f 0 2024-04-20T10:54:57.623 INFO:tasks.workunit.client.0.smithi090.stdout:6/903: dread d1/d4/f1d [0,4194304] 0 2024-04-20T10:54:57.625 INFO:tasks.workunit.client.0.smithi090.stdout:4/955: mkdir d7/d9/d47/df9/d70/da1/dcd/d13b 0 2024-04-20T10:54:57.625 INFO:tasks.workunit.client.0.smithi090.stdout:4/956: truncate d7/d9/d47/df9/d70/da1/dcd/d42/d8f/da2/f138 542913 0 2024-04-20T10:54:57.625 INFO:tasks.workunit.client.0.smithi090.stdout:4/957: write d7/d9/d47/df9/d70/da1/dcd/d3d/dd2/fd3 [1212499,1703] 0 2024-04-20T10:54:57.625 INFO:tasks.workunit.client.0.smithi090.stdout:8/932: mknod d0/d11/d22/d53/df6/c12d 0 2024-04-20T10:54:57.629 INFO:tasks.workunit.client.0.smithi090.stdout:3/933: link d7/df/c4e d7/d11/c128 0 2024-04-20T10:54:57.632 INFO:tasks.workunit.client.0.smithi090.stdout:3/934: rename d7/ddd/d10c/d11b to d7/df/dd1/dd3/d129 0 2024-04-20T10:54:57.632 INFO:tasks.workunit.client.0.smithi090.stdout:3/935: truncate d7/d26/d78/fb8 162965 0 2024-04-20T10:54:57.632 INFO:tasks.workunit.client.0.smithi090.stdout:8/933: write d0/d3a/daa/f112 [546560,15837] 0 2024-04-20T10:54:57.632 INFO:tasks.workunit.client.0.smithi090.stdout:3/936: write d7/d43/db7/dd4/fa7 [1016673,88899] 0 2024-04-20T10:54:57.634 INFO:tasks.workunit.client.0.smithi090.stdout:3/937: symlink d7/d43/db7/l12a 0 2024-04-20T10:54:57.634 INFO:tasks.workunit.client.0.smithi090.stdout:4/958: dread d7/d9/d47/df9/d70/da1/dcd/d42/f64 [0,4194304] 0 2024-04-20T10:54:57.635 INFO:tasks.workunit.client.0.smithi090.stdout:3/938: mknod d7/d15/d47/c12b 0 2024-04-20T10:54:57.635 INFO:tasks.workunit.client.0.smithi090.stdout:3/939: fdatasync d7/d43/db7/ddf/f100 0 2024-04-20T10:54:57.635 INFO:tasks.workunit.client.0.smithi090.stdout:3/940: read - d7/d26/d108/f116 zero size 2024-04-20T10:54:57.638 INFO:tasks.workunit.client.0.smithi090.stdout:3/941: dread d7/f71 [0,4194304] 0 2024-04-20T10:54:57.639 INFO:tasks.workunit.client.0.smithi090.stdout:3/942: creat d7/d15/d2a/d30/d93/d7f/f12c x:0 0 0 2024-04-20T10:54:57.640 INFO:tasks.workunit.client.0.smithi090.stdout:3/943: unlink d7/d26/d78/c7b 0 2024-04-20T10:54:57.643 INFO:tasks.workunit.client.0.smithi090.stdout:4/959: read d7/d9/d47/df9/d70/da1/dcd/d42/f67 [3845077,125892] 0 2024-04-20T10:54:57.648 INFO:tasks.workunit.client.0.smithi090.stdout:3/944: unlink d7/cc0 0 2024-04-20T10:54:57.648 INFO:tasks.workunit.client.0.smithi090.stdout:3/945: fsync d7/d15/d2a/d30/f4c 0 2024-04-20T10:54:57.649 INFO:tasks.workunit.client.0.smithi090.stdout:6/904: getdents d1/d4/d26/d11/d4a 0 2024-04-20T10:54:57.650 INFO:tasks.workunit.client.0.smithi090.stdout:3/946: symlink d7/ddd/l12d 0 2024-04-20T10:54:57.650 INFO:tasks.workunit.client.0.smithi090.stdout:3/947: chown d7/d11/l9f 0 1 2024-04-20T10:54:57.661 INFO:tasks.workunit.client.0.smithi090.stdout:4/960: dwrite d7/d9/d47/df9/d70/da1/dcd/f34 [4194304,4194304] 0 2024-04-20T10:54:57.661 INFO:tasks.workunit.client.0.smithi090.stdout:4/961: chown d7/d9/d47/df9/d70/da1/dcd/d42/c88 10771298 1 2024-04-20T10:54:57.684 INFO:tasks.workunit.client.0.smithi090.stdout:3/948: dwrite d7/d43/fcd [0,4194304] 0 2024-04-20T10:54:57.685 INFO:tasks.workunit.client.0.smithi090.stdout:6/905: dwrite d1/d19/d25/f7a [0,4194304] 0 2024-04-20T10:54:57.685 INFO:tasks.workunit.client.0.smithi090.stdout:6/906: chown d1/d4/d26/d11/f41 3803 1 2024-04-20T10:54:57.688 INFO:tasks.workunit.client.0.smithi090.stdout:3/949: mkdir d7/d43/db7/dd4/d126/d12e 0 2024-04-20T10:54:57.688 INFO:tasks.workunit.client.0.smithi090.stdout:3/950: read - d7/d26/dc9/f115 zero size 2024-04-20T10:54:57.690 INFO:tasks.workunit.client.0.smithi090.stdout:4/962: dwrite d7/d9/f4a [0,4194304] 0 2024-04-20T10:54:57.705 INFO:tasks.workunit.client.0.smithi090.stdout:4/963: write d7/f12 [1193200,96165] 0 2024-04-20T10:54:57.705 INFO:tasks.workunit.client.0.smithi090.stdout:3/951: dread d7/d15/d47/fc2 [0,4194304] 0 2024-04-20T10:54:57.705 INFO:tasks.workunit.client.0.smithi090.stdout:3/952: write d7/d15/d47/d56/ff8 [558996,110918] 0 2024-04-20T10:54:57.705 INFO:tasks.workunit.client.0.smithi090.stdout:4/964: symlink d7/d9/d47/df9/d70/da1/l13c 0 2024-04-20T10:54:57.706 INFO:tasks.workunit.client.0.smithi090.stdout:4/965: unlink d7/d9/d47/df9/d70/da1/dcd/d42/fc8 0 2024-04-20T10:54:57.707 INFO:tasks.workunit.client.0.smithi090.stdout:6/907: dwrite d1/d4/d26/d11/d35/d97/ff5 [0,4194304] 0 2024-04-20T10:54:57.707 INFO:tasks.workunit.client.0.smithi090.stdout:6/908: write d1/d4/f104 [491167,49046] 0 2024-04-20T10:54:57.708 INFO:tasks.workunit.client.0.smithi090.stdout:4/966: truncate d7/f6e 750301 0 2024-04-20T10:54:57.708 INFO:tasks.workunit.client.0.smithi090.stdout:4/967: chown d7/d9/d92/d111/l132 14030 1 2024-04-20T10:54:57.710 INFO:tasks.workunit.client.0.smithi090.stdout:4/968: unlink d7/d9/d47/cca 0 2024-04-20T10:54:57.725 INFO:tasks.workunit.client.0.smithi090.stdout:3/953: dwrite d7/d15/d47/fc2 [4194304,4194304] 0 2024-04-20T10:54:57.729 INFO:tasks.workunit.client.0.smithi090.stdout:6/909: dwrite d1/d10/f39 [0,4194304] 0 2024-04-20T10:54:57.730 INFO:tasks.workunit.client.0.smithi090.stdout:6/910: creat d1/d4/dd6/f130 x:0 0 0 2024-04-20T10:54:57.730 INFO:tasks.workunit.client.0.smithi090.stdout:4/969: dwrite d7/d9/d47/df9/d70/f126 [0,4194304] 0 2024-04-20T10:54:57.734 INFO:tasks.workunit.client.0.smithi090.stdout:4/970: unlink d7/l5f 0 2024-04-20T10:54:57.737 INFO:tasks.workunit.client.0.smithi090.stdout:4/971: link d7/d9/d47/d8d/cf7 d7/d9/d47/d8d/c13d 0 2024-04-20T10:54:57.758 INFO:tasks.workunit.client.0.smithi090.stdout:6/911: dwrite d1/d4/f47 [4194304,4194304] 0 2024-04-20T10:54:57.758 INFO:tasks.workunit.client.0.smithi090.stdout:6/912: dread - d1/d10/f119 zero size 2024-04-20T10:54:57.758 INFO:tasks.workunit.client.0.smithi090.stdout:6/913: truncate d1/d4/d26/d11/d4a/d6b/db5/f113 451777 0 2024-04-20T10:54:57.759 INFO:tasks.workunit.client.0.smithi090.stdout:3/954: dwrite d7/df/dd1/fe2 [0,4194304] 0 2024-04-20T10:54:57.759 INFO:tasks.workunit.client.0.smithi090.stdout:3/955: fsync d7/d15/f25 0 2024-04-20T10:54:57.759 INFO:tasks.workunit.client.0.smithi090.stdout:4/972: dwrite d7/d9/d47/df9/d70/da1/dcd/d76/f127 [0,4194304] 0 2024-04-20T10:54:57.759 INFO:tasks.workunit.client.0.smithi090.stdout:4/973: stat d7/d9/d47/df9/dd4/f12c 0 2024-04-20T10:54:57.759 INFO:tasks.workunit.client.0.smithi090.stdout:6/914: link d1/c49 d1/d4/d26/d11/d4a/c131 0 2024-04-20T10:54:57.760 INFO:tasks.workunit.client.0.smithi090.stdout:3/956: truncate d7/d15/d2a/d8d/fb1 229733 0 2024-04-20T10:54:57.760 INFO:tasks.workunit.client.0.smithi090.stdout:3/957: stat d7/d15/d2a/d30/d93/d7f/f12c 0 2024-04-20T10:54:57.761 INFO:tasks.workunit.client.0.smithi090.stdout:4/974: creat d7/d9/d47/df9/d70/f13e x:0 0 0 2024-04-20T10:54:57.761 INFO:tasks.workunit.client.0.smithi090.stdout:6/915: mknod d1/d19/d25/c132 0 2024-04-20T10:54:57.762 INFO:tasks.workunit.client.0.smithi090.stdout:3/958: symlink d7/d43/db7/dd4/d126/d12e/l12f 0 2024-04-20T10:54:57.763 INFO:tasks.workunit.client.0.smithi090.stdout:4/975: link d7/f6e d7/d9/d47/df9/d70/da1/dcd/d13b/f13f 0 2024-04-20T10:54:57.764 INFO:tasks.workunit.client.0.smithi090.stdout:6/916: chown d1/d4/f46 0 1 2024-04-20T10:54:57.764 INFO:tasks.workunit.client.0.smithi090.stdout:6/917: read - d1/d4/d26/d11/d4a/f83 zero size 2024-04-20T10:54:57.765 INFO:tasks.workunit.client.0.smithi090.stdout:3/959: stat d7/d15/d47/c85 0 2024-04-20T10:54:57.766 INFO:tasks.workunit.client.0.smithi090.stdout:4/976: truncate d7/d9/d47/df9/d70/da1/dcd/f45 754050 0 2024-04-20T10:54:57.767 INFO:tasks.workunit.client.0.smithi090.stdout:6/918: creat d1/d19/d36/f133 x:0 0 0 2024-04-20T10:54:57.768 INFO:tasks.workunit.client.0.smithi090.stdout:3/960: link d7/d35/l38 d7/ddd/d10c/l130 0 2024-04-20T10:54:57.770 INFO:tasks.workunit.client.0.smithi090.stdout:4/977: mkdir d7/d9/d17/d94/df3/d128/d140 0 2024-04-20T10:54:57.771 INFO:tasks.workunit.client.0.smithi090.stdout:4/978: mknod d7/d9/d47/df9/d70/da1/dcd/d42/c141 0 2024-04-20T10:54:57.772 INFO:tasks.workunit.client.0.smithi090.stdout:6/919: mknod d1/d19/d36/d1e/d1f/d3f/df7/d11a/d12e/c134 0 2024-04-20T10:54:57.772 INFO:tasks.workunit.client.0.smithi090.stdout:3/961: creat d7/d43/dc5/f131 x:0 0 0 2024-04-20T10:54:57.773 INFO:tasks.workunit.client.0.smithi090.stdout:4/979: symlink d7/d9/d47/df9/d70/da1/l142 0 2024-04-20T10:54:57.774 INFO:tasks.workunit.client.0.smithi090.stdout:6/920: dread d1/d4/d26/d11/f71 [0,4194304] 0 2024-04-20T10:54:57.774 INFO:tasks.workunit.client.0.smithi090.stdout:3/962: readlink d7/d43/l5c 0 2024-04-20T10:54:57.774 INFO:tasks.workunit.client.0.smithi090.stdout:3/963: fsync d7/d43/db7/dd4/f119 0 2024-04-20T10:54:57.775 INFO:tasks.workunit.client.0.smithi090.stdout:4/980: mkdir d7/d9/d47/df9/d143 0 2024-04-20T10:54:57.776 INFO:tasks.workunit.client.0.smithi090.stdout:6/921: link d1/d4/d26/ca d1/d4/d26/d12c/c135 0 2024-04-20T10:54:57.776 INFO:tasks.workunit.client.0.smithi090.stdout:6/922: readlink d1/d19/d36/d1e/d74/l86 0 2024-04-20T10:54:57.777 INFO:tasks.workunit.client.0.smithi090.stdout:6/923: fsync d1/d4/f50 0 2024-04-20T10:54:57.777 INFO:tasks.workunit.client.0.smithi090.stdout:6/924: write d1/d4/d26/d11/d4a/fd5 [280065,56480] 0 2024-04-20T10:54:57.777 INFO:tasks.workunit.client.0.smithi090.stdout:3/964: symlink d7/d26/d108/d112/l132 0 2024-04-20T10:54:57.779 INFO:tasks.workunit.client.0.smithi090.stdout:4/981: mknod d7/dbd/c144 0 2024-04-20T10:54:57.786 INFO:tasks.workunit.client.0.smithi090.stdout:4/982: rmdir d7/d9/d12e 39 2024-04-20T10:54:57.787 INFO:tasks.workunit.client.0.smithi090.stdout:4/983: stat d7/d9/d47/ca7 0 2024-04-20T10:54:57.787 INFO:tasks.workunit.client.0.smithi090.stdout:4/984: chown d7/d9/d12e/f12d 7002971 1 2024-04-20T10:54:57.794 INFO:tasks.workunit.client.0.smithi090.stdout:3/965: write d7/d43/fcd [52183,105559] 0 2024-04-20T10:54:57.794 INFO:tasks.workunit.client.0.smithi090.stdout:6/925: dwrite d1/d19/d36/d1e/d1f/d3f/d54/d9f/ffa [0,4194304] 0 2024-04-20T10:54:57.794 INFO:tasks.workunit.client.0.smithi090.stdout:6/926: chown d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd/de1 261152924 1 2024-04-20T10:54:57.794 INFO:tasks.workunit.client.0.smithi090.stdout:6/927: write d1/d4/d26/d11/d4a/d56/dc7/f108 [373154,38943] 0 2024-04-20T10:54:57.794 INFO:tasks.workunit.client.0.smithi090.stdout:6/928: chown d1/d4/d26/d11/d4a/d6b/db5/db9/dd3/de0/ff9 3399 1 2024-04-20T10:54:57.795 INFO:tasks.workunit.client.0.smithi090.stdout:4/985: dread d7/d9/d47/df9/d70/da1/dcd/d3d/f75 [0,4194304] 0 2024-04-20T10:54:57.795 INFO:tasks.workunit.client.0.smithi090.stdout:3/966: unlink d7/d15/d2a/d30/d48/cea 0 2024-04-20T10:54:57.797 INFO:tasks.workunit.client.0.smithi090.stdout:7/882: sync 2024-04-20T10:54:57.799 INFO:tasks.workunit.client.0.smithi090.stdout:6/929: rename d1/d4/d26/d11/d35/d97/ff8 to d1/d4/d26/f136 0 2024-04-20T10:54:57.801 INFO:tasks.workunit.client.0.smithi090.stdout:7/883: symlink d11/d61/l117 0 2024-04-20T10:54:57.801 INFO:tasks.workunit.client.0.smithi090.stdout:4/986: dread d7/d9/f39 [0,4194304] 0 2024-04-20T10:54:57.801 INFO:tasks.workunit.client.0.smithi090.stdout:6/930: mknod d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd/c137 0 2024-04-20T10:54:57.803 INFO:tasks.workunit.client.0.smithi090.stdout:7/884: creat d11/dd2/f118 x:0 0 0 2024-04-20T10:54:57.804 INFO:tasks.workunit.client.0.smithi090.stdout:6/931: mkdir d1/d138 0 2024-04-20T10:54:57.806 INFO:tasks.workunit.client.0.smithi090.stdout:7/885: mkdir d11/d13/d22/d8f/d119 0 2024-04-20T10:54:57.806 INFO:tasks.workunit.client.0.smithi090.stdout:7/886: write d11/d13/d5d/fa8 [2880609,45575] 0 2024-04-20T10:54:57.806 INFO:tasks.workunit.client.0.smithi090.stdout:7/887: chown d11/d13/d5b/db8/f85 474475 1 2024-04-20T10:54:57.806 INFO:tasks.workunit.client.0.smithi090.stdout:8/934: sync 2024-04-20T10:54:57.817 INFO:tasks.workunit.client.0.smithi090.stdout:6/932: read d1/d4/f66 [1612478,25380] 0 2024-04-20T10:54:57.818 INFO:tasks.workunit.client.0.smithi090.stdout:6/933: mkdir d1/d19/d36/d1e/d1f/d3f/d139 0 2024-04-20T10:54:57.820 INFO:tasks.workunit.client.0.smithi090.stdout:6/934: rename d1/d4/faa to d1/d19/d36/f13a 0 2024-04-20T10:54:57.820 INFO:tasks.workunit.client.0.smithi090.stdout:6/935: rmdir d1/d4/d26/d11/d4a/d6b/db5/df1 39 2024-04-20T10:54:57.821 INFO:tasks.workunit.client.0.smithi090.stdout:6/936: write d1/d4/d26/d11/d4a/d6b/fe6 [967752,130407] 0 2024-04-20T10:54:57.821 INFO:tasks.workunit.client.0.smithi090.stdout:6/937: rmdir d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad 39 2024-04-20T10:54:57.821 INFO:tasks.workunit.client.0.smithi090.stdout:8/935: dread d0/d11/d22/d53/d57/dd3/d111/d67/f87 [0,4194304] 0 2024-04-20T10:54:57.822 INFO:tasks.workunit.client.0.smithi090.stdout:6/938: symlink d1/d4/d26/d11/d4a/d56/dc7/l13b 0 2024-04-20T10:54:57.823 INFO:tasks.workunit.client.0.smithi090.stdout:6/939: symlink d1/d4/l13c 0 2024-04-20T10:54:57.825 INFO:tasks.workunit.client.0.smithi090.stdout:6/940: dread d1/d19/d36/d28/f34 [0,4194304] 0 2024-04-20T10:54:57.826 INFO:tasks.workunit.client.0.smithi090.stdout:6/941: creat d1/d19/f13d x:0 0 0 2024-04-20T10:54:57.827 INFO:tasks.workunit.client.0.smithi090.stdout:4/987: dwrite d7/d9/d47/df9/dd4/f12c [0,4194304] 0 2024-04-20T10:54:57.828 INFO:tasks.workunit.client.0.smithi090.stdout:4/988: chown d7/d9/d47/df9/d70/da1/dcd/d3d/f60 77 1 2024-04-20T10:54:57.829 INFO:tasks.workunit.client.0.smithi090.stdout:4/989: chown d7/d9/d47/df9/d70/da1/dcd/d3d/f60 700 1 2024-04-20T10:54:57.829 INFO:tasks.workunit.client.0.smithi090.stdout:4/990: chown d7/d9/d47/f6f 5408 1 2024-04-20T10:54:57.829 INFO:tasks.workunit.client.0.smithi090.stdout:4/991: creat d7/d72/f145 x:0 0 0 2024-04-20T10:54:57.831 INFO:tasks.workunit.client.0.smithi090.stdout:3/967: dwrite d7/d15/f1d [0,4194304] 0 2024-04-20T10:54:57.832 INFO:tasks.workunit.client.0.smithi090.stdout:7/888: dwrite d11/d13/d22/d82/fe4 [0,4194304] 0 2024-04-20T10:54:57.836 INFO:tasks.workunit.client.0.smithi090.stdout:4/992: dread d7/d9/d47/df9/d70/da1/dcd/d3d/f9f [0,4194304] 0 2024-04-20T10:54:57.836 INFO:tasks.workunit.client.0.smithi090.stdout:3/968: unlink d7/d15/d2a/f67 0 2024-04-20T10:54:57.841 INFO:tasks.workunit.client.0.smithi090.stdout:7/889: rename d11/d13/d33/d44/d89/d98 to d11/dd2/d11a 0 2024-04-20T10:54:57.843 INFO:tasks.workunit.client.0.smithi090.stdout:4/993: rename d7/d9/d47/df9/d70/da1/dcd/d42/c106 to d7/d9/d47/df9/d70/da5/db3/dba/c146 0 2024-04-20T10:54:57.843 INFO:tasks.workunit.client.0.smithi090.stdout:4/994: stat d7/d9/d47/df9/d70/da5/ffa 0 2024-04-20T10:54:57.843 INFO:tasks.workunit.client.0.smithi090.stdout:4/995: fsync d7/d9/d47/df9/d70/da1/dcd/d42/d8f/f122 0 2024-04-20T10:54:57.848 INFO:tasks.workunit.client.0.smithi090.stdout:8/936: dwrite d0/d26/f85 [0,4194304] 0 2024-04-20T10:54:57.851 INFO:tasks.workunit.client.0.smithi090.stdout:8/937: unlink d0/d11/l37 0 2024-04-20T10:54:57.851 INFO:tasks.workunit.client.0.smithi090.stdout:8/938: dread - d0/d26/da7/f122 zero size 2024-04-20T10:54:57.851 INFO:tasks.workunit.client.0.smithi090.stdout:8/939: mknod d0/d2d/c12e 0 2024-04-20T10:54:57.851 INFO:tasks.workunit.client.0.smithi090.stdout:4/996: read d7/d9/d17/f18 [3693183,40186] 0 2024-04-20T10:54:57.853 INFO:tasks.workunit.client.0.smithi090.stdout:4/997: mknod d7/d9/d47/c147 0 2024-04-20T10:54:57.853 INFO:tasks.workunit.client.0.smithi090.stdout:4/998: write d7/d9/f4a [4827739,21114] 0 2024-04-20T10:54:57.853 INFO:tasks.workunit.client.0.smithi090.stdout:4/999: truncate d7/d9/fa 2987910 0 2024-04-20T10:54:57.856 INFO:tasks.workunit.client.0.smithi090.stdout:6/942: dwrite d1/d4/d26/fcb [8388608,4194304] 0 2024-04-20T10:54:57.856 INFO:tasks.workunit.client.0.smithi090.stdout:6/943: stat d1/d9a/de2 0 2024-04-20T10:54:57.856 INFO:tasks.workunit.client.0.smithi090.stdout:6/944: dread - d1/d4/d26/d11/d4a/d6b/d6f/ffb zero size 2024-04-20T10:54:57.856 INFO:tasks.workunit.client.0.smithi090.stdout:6/945: chown d1/d4/c8b 9477856 1 2024-04-20T10:54:57.857 INFO:tasks.workunit.client.0.smithi090.stdout:6/946: link d1/d4/d26/d12c/c135 d1/d4/d26/d11/c13e 0 2024-04-20T10:54:57.859 INFO:tasks.workunit.client.0.smithi090.stdout:8/940: dread d0/f28 [0,4194304] 0 2024-04-20T10:54:57.859 INFO:tasks.workunit.client.0.smithi090.stdout:6/947: creat d1/d4/d26/d11/d4a/d6b/db5/db9/f13f x:0 0 0 2024-04-20T10:54:57.860 INFO:tasks.workunit.client.0.smithi090.stdout:7/890: truncate d11/d13/d5d/fa8 2182410 0 2024-04-20T10:54:57.860 INFO:tasks.workunit.client.0.smithi090.stdout:7/891: write d11/d13/d5b/db8/f85 [1697692,34038] 0 2024-04-20T10:54:57.861 INFO:tasks.workunit.client.0.smithi090.stdout:6/948: getdents d1/d4 0 2024-04-20T10:54:57.861 INFO:tasks.workunit.client.0.smithi090.stdout:6/949: chown d1/d9a/de2/l10f 28064 1 2024-04-20T10:54:57.861 INFO:tasks.workunit.client.0.smithi090.stdout:6/950: fsync d1/d19/d36/d1e/f58 0 2024-04-20T10:54:57.862 INFO:tasks.workunit.client.0.smithi090.stdout:7/892: mkdir d11/d61/d11b 0 2024-04-20T10:54:57.865 INFO:tasks.workunit.client.0.smithi090.stdout:8/941: dread d0/d3a/d9f/db9/fbd [0,4194304] 0 2024-04-20T10:54:57.866 INFO:tasks.workunit.client.0.smithi090.stdout:7/893: mknod d11/d13/d5b/de8/c11c 0 2024-04-20T10:54:57.867 INFO:tasks.workunit.client.0.smithi090.stdout:7/894: chown d11/l1c 1970407420 1 2024-04-20T10:54:57.867 INFO:tasks.workunit.client.0.smithi090.stdout:8/942: getdents d0/d11/d22/d53 0 2024-04-20T10:54:57.868 INFO:tasks.workunit.client.1.smithi175.stdout:0/406: mkdir df/d1a/d22/d6a/d72/d7f 0 2024-04-20T10:54:57.871 INFO:tasks.workunit.client.0.smithi090.stdout:7/895: dread d11/d13/d22/d24/f2a [0,4194304] 0 2024-04-20T10:54:57.871 INFO:tasks.workunit.client.1.smithi175.stdout:7/505: truncate db/d1d/d29/f6f 1394249 0 2024-04-20T10:54:57.872 INFO:tasks.workunit.client.0.smithi090.stdout:7/896: rmdir d11/d13/d22/d27 39 2024-04-20T10:54:57.872 INFO:tasks.workunit.client.1.smithi175.stdout:0/407: creat df/d1a/d22/d55/f80 x:0 0 0 2024-04-20T10:54:57.875 INFO:tasks.workunit.client.1.smithi175.stdout:0/408: rename df/d1a/d28/f7c to df/f81 0 2024-04-20T10:54:57.876 INFO:tasks.workunit.client.1.smithi175.stdout:0/409: symlink df/d17/d2f/d4f/l82 0 2024-04-20T10:54:57.877 INFO:tasks.workunit.client.1.smithi175.stdout:0/410: rmdir df 39 2024-04-20T10:54:57.878 INFO:tasks.workunit.client.0.smithi090.stdout:8/943: dread d0/d3a/d4a/d81/f9e [0,4194304] 0 2024-04-20T10:54:57.879 INFO:tasks.workunit.client.0.smithi090.stdout:8/944: rename d0/d2d/l5f to d0/d11/d22/d53/d57/dd3/d111/l12f 0 2024-04-20T10:54:57.880 INFO:tasks.workunit.client.1.smithi175.stdout:0/411: symlink df/d17/d2f/l83 0 2024-04-20T10:54:57.880 INFO:tasks.workunit.client.1.smithi175.stdout:0/412: creat df/d17/d2f/d4f/f84 x:0 0 0 2024-04-20T10:54:57.881 INFO:tasks.workunit.client.0.smithi090.stdout:6/951: dwrite d1/d4/f46 [0,4194304] 0 2024-04-20T10:54:57.881 INFO:tasks.workunit.client.0.smithi090.stdout:8/945: rename d0/d2d/d44/dd9 to d0/d3a/d4a/dea/d130 0 2024-04-20T10:54:57.883 INFO:tasks.workunit.client.1.smithi175.stdout:0/413: rename df/d1a/d22/d55/f80 to df/d17/f85 0 2024-04-20T10:54:57.895 INFO:tasks.workunit.client.0.smithi090.stdout:7/897: dwrite d11/d13/d22/f64 [4194304,4194304] 0 2024-04-20T10:54:57.960 INFO:tasks.workunit.client.0.smithi090.stdout:6/952: mkdir d1/d19/d36/d28/d140 0 2024-04-20T10:54:57.961 INFO:tasks.workunit.client.0.smithi090.stdout:8/946: mknod d0/d3a/d9f/db9/c131 0 2024-04-20T10:54:57.961 INFO:tasks.workunit.client.0.smithi090.stdout:8/947: fsync d0/d11/d22/d53/d57/dd3/d111/d67/fef 0 2024-04-20T10:54:57.962 INFO:tasks.workunit.client.1.smithi175.stdout:7/506: dwrite db/d1d/d39/d50/f55 [0,4194304] 0 2024-04-20T10:54:57.963 INFO:tasks.workunit.client.0.smithi090.stdout:7/898: link d11/d13/d5b/db8/dbf/df1/fe1 d11/d13/d5b/de8/f11d 0 2024-04-20T10:54:57.963 INFO:tasks.workunit.client.0.smithi090.stdout:7/899: chown d11/l68 20444343 1 2024-04-20T10:54:57.964 INFO:tasks.workunit.client.0.smithi090.stdout:6/953: rename d1/d19/d25/c132 to d1/d19/d36/d1e/d74/c141 0 2024-04-20T10:54:57.966 INFO:tasks.workunit.client.0.smithi090.stdout:8/948: symlink d0/l132 0 2024-04-20T10:54:57.966 INFO:tasks.workunit.client.0.smithi090.stdout:8/949: readlink d0/d2d/ld0 0 2024-04-20T10:54:57.966 INFO:tasks.workunit.client.0.smithi090.stdout:8/950: write d0/d3a/d9f/db9/fbd [5393389,65483] 0 2024-04-20T10:54:57.967 INFO:tasks.workunit.client.0.smithi090.stdout:7/900: symlink d11/d13/d22/d82/l11e 0 2024-04-20T10:54:57.968 INFO:tasks.workunit.client.0.smithi090.stdout:6/954: creat d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/f142 x:0 0 0 2024-04-20T10:54:57.970 INFO:tasks.workunit.client.0.smithi090.stdout:7/901: mknod d11/d1a/d3f/c11f 0 2024-04-20T10:54:57.971 INFO:tasks.workunit.client.0.smithi090.stdout:6/955: symlink d1/d19/d36/l143 0 2024-04-20T10:54:57.971 INFO:tasks.workunit.client.0.smithi090.stdout:6/956: dread - d1/d4/d26/d11/d4a/d6b/db5/db9/f13f zero size 2024-04-20T10:54:57.971 INFO:tasks.workunit.client.0.smithi090.stdout:6/957: dread - d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/f142 zero size 2024-04-20T10:54:57.973 INFO:tasks.workunit.client.0.smithi090.stdout:6/958: rename d1/d4/d26/d11/d4a/d56/dc7/l13b to d1/d19/d25/l144 0 2024-04-20T10:54:57.973 INFO:tasks.workunit.client.0.smithi090.stdout:6/959: write d1/d4/d26/d11/f71 [556180,29359] 0 2024-04-20T10:54:57.974 INFO:tasks.workunit.client.0.smithi090.stdout:6/960: mkdir d1/d19/d36/d28/d145 0 2024-04-20T10:54:57.975 INFO:tasks.workunit.client.0.smithi090.stdout:6/961: rmdir d1/d19/d36/d1e/d1f/d3f/df7/d11a/d12e 39 2024-04-20T10:54:57.976 INFO:tasks.workunit.client.0.smithi090.stdout:6/962: unlink d1/d4/f104 0 2024-04-20T10:54:57.977 INFO:tasks.workunit.client.0.smithi090.stdout:6/963: fdatasync d1/d19/d36/d1e/d1f/d3f/df7/d11a/f125 0 2024-04-20T10:54:57.977 INFO:tasks.workunit.client.0.smithi090.stdout:7/902: write d11/d13/d22/d82/fe4 [2662479,76245] 0 2024-04-20T10:54:57.977 INFO:tasks.workunit.client.0.smithi090.stdout:7/903: fdatasync d11/d13/d5d/d65/fb5 0 2024-04-20T10:54:57.977 INFO:tasks.workunit.client.0.smithi090.stdout:7/904: chown d11/d13/d5b/db8/dbf/df1/c9e 13 1 2024-04-20T10:54:57.978 INFO:tasks.workunit.client.0.smithi090.stdout:7/905: creat d11/d1a/d3b/dc8/f120 x:0 0 0 2024-04-20T10:54:57.979 INFO:tasks.workunit.client.0.smithi090.stdout:7/906: mknod d11/d13/d23/c121 0 2024-04-20T10:54:57.980 INFO:tasks.workunit.client.0.smithi090.stdout:7/907: symlink d11/d13/d5b/db8/de0/l122 0 2024-04-20T10:54:57.980 INFO:tasks.workunit.client.0.smithi090.stdout:7/908: stat d11/d1a/d3b/dc8 0 2024-04-20T10:54:57.980 INFO:tasks.workunit.client.0.smithi090.stdout:8/951: dwrite d0/d26/f86 [4194304,4194304] 0 2024-04-20T10:54:57.981 INFO:tasks.workunit.client.0.smithi090.stdout:7/909: unlink d11/d1a/c1f 0 2024-04-20T10:54:57.982 INFO:tasks.workunit.client.0.smithi090.stdout:8/952: rename d0/d11/c76 to d0/d11/d22/d53/d8e/d129/c133 0 2024-04-20T10:54:57.983 INFO:tasks.workunit.client.0.smithi090.stdout:8/953: symlink d0/d3a/d4a/d81/l134 0 2024-04-20T10:54:57.985 INFO:tasks.workunit.client.0.smithi090.stdout:8/954: creat d0/d26/da7/df5/dcf/dd5/f135 x:0 0 0 2024-04-20T10:54:57.985 INFO:tasks.workunit.client.0.smithi090.stdout:8/955: write d0/d3a/daa/fcc [287369,47389] 0 2024-04-20T10:54:57.985 INFO:tasks.workunit.client.0.smithi090.stdout:8/956: stat d0/l1d 0 2024-04-20T10:54:57.985 INFO:tasks.workunit.client.0.smithi090.stdout:8/957: truncate d0/d11/f12a 878727 0 2024-04-20T10:54:57.985 INFO:tasks.workunit.client.0.smithi090.stdout:8/958: truncate d0/d11/d22/d53/d8e/f124 30736 0 2024-04-20T10:54:57.986 INFO:tasks.workunit.client.0.smithi090.stdout:6/964: dread d1/d19/d36/d1e/f58 [0,4194304] 0 2024-04-20T10:54:57.986 INFO:tasks.workunit.client.0.smithi090.stdout:6/965: fsync d1/d19/f1a 0 2024-04-20T10:54:57.986 INFO:tasks.workunit.client.0.smithi090.stdout:8/959: creat d0/d26/da7/df5/dcf/f136 x:0 0 0 2024-04-20T10:54:57.987 INFO:tasks.workunit.client.0.smithi090.stdout:8/960: mknod d0/d26/da7/c137 0 2024-04-20T10:54:58.009 INFO:tasks.workunit.client.0.smithi090.stdout:6/966: dread d1/d19/d36/d1e/f60 [0,4194304] 0 2024-04-20T10:54:58.011 INFO:tasks.workunit.client.0.smithi090.stdout:6/967: rename d1/d4/f30 to d1/d19/d36/d1e/d1f/f146 0 2024-04-20T10:54:58.011 INFO:tasks.workunit.client.0.smithi090.stdout:6/968: chown d1/fea 52769 1 2024-04-20T10:54:58.012 INFO:tasks.workunit.client.0.smithi090.stdout:6/969: rename d1/d4/d26/d11/d4a/d6b to d1/d19/d36/d28/d145/d147 0 2024-04-20T10:54:58.016 INFO:tasks.workunit.client.0.smithi090.stdout:8/961: write d0/f9c [7021324,4617] 0 2024-04-20T10:54:58.017 INFO:tasks.workunit.client.0.smithi090.stdout:8/962: stat d0/d11/d22/d53/fca 0 2024-04-20T10:54:58.019 INFO:tasks.workunit.client.0.smithi090.stdout:6/970: write d1/d19/d36/f7d [207362,46915] 0 2024-04-20T10:54:58.019 INFO:tasks.workunit.client.0.smithi090.stdout:6/971: truncate d1/d19/d36/d1e/d1f/d3f/dbf/fc4 673624 0 2024-04-20T10:54:58.019 INFO:tasks.workunit.client.0.smithi090.stdout:6/972: fsync d1/d4/d26/d11/d35/d97/ff5 0 2024-04-20T10:54:58.024 INFO:tasks.workunit.client.0.smithi090.stdout:7/910: dwrite d11/d13/d5b/db8/dbf/df1/fe1 [0,4194304] 0 2024-04-20T10:54:58.024 INFO:tasks.workunit.client.0.smithi090.stdout:7/911: chown d11/d13/d5b/db8/dbf/fac 156932570 1 2024-04-20T10:54:58.027 INFO:tasks.workunit.client.1.smithi175.stdout:7/507: write db/d1d/d29/d8e/f32 [990094,98047] 0 2024-04-20T10:54:58.027 INFO:tasks.workunit.client.1.smithi175.stdout:7/508: fdatasync db/d1d/d29/f3c 0 2024-04-20T10:54:58.028 INFO:tasks.workunit.client.1.smithi175.stdout:7/509: symlink db/d1d/d60/d76/db6/lc1 0 2024-04-20T10:54:58.029 INFO:tasks.workunit.client.1.smithi175.stdout:7/510: chown db/l1a 52 1 2024-04-20T10:54:58.030 INFO:tasks.workunit.client.1.smithi175.stdout:7/511: truncate db/d1d/d39/d50/f9d 387852 0 2024-04-20T10:54:58.032 INFO:tasks.workunit.client.1.smithi175.stdout:7/512: link db/d1d/d29/f6f db/d1d/d39/d50/dba/d47/da6/db9/fc2 0 2024-04-20T10:54:58.033 INFO:tasks.workunit.client.1.smithi175.stdout:7/513: mknod db/d1d/d39/d50/dba/d47/cc3 0 2024-04-20T10:54:58.034 INFO:tasks.workunit.client.1.smithi175.stdout:7/514: readlink db/d1d/l36 0 2024-04-20T10:54:58.034 INFO:tasks.workunit.client.1.smithi175.stdout:7/515: write db/d1d/d29/d8e/f32 [4443278,5180] 0 2024-04-20T10:54:58.034 INFO:tasks.workunit.client.1.smithi175.stdout:7/516: mkdir db/d61/d6d/dbc/dc4 0 2024-04-20T10:54:58.035 INFO:tasks.workunit.client.1.smithi175.stdout:7/517: chown db/d1d/d39/d50/dba/d47/l4c 239 1 2024-04-20T10:54:58.037 INFO:tasks.workunit.client.0.smithi090.stdout:8/963: dwrite d0/d3a/d9f/db9/dbe/fce [0,4194304] 0 2024-04-20T10:54:58.044 INFO:tasks.workunit.client.0.smithi090.stdout:6/973: dwrite d1/d4/d26/d11/d4a/db3/f109 [0,4194304] 0 2024-04-20T10:54:58.046 INFO:tasks.workunit.client.0.smithi090.stdout:6/974: mknod d1/d19/d36/d1e/d1f/d3f/df7/c148 0 2024-04-20T10:54:58.047 INFO:tasks.workunit.client.0.smithi090.stdout:7/912: dwrite d11/d1a/d3f/f66 [0,4194304] 0 2024-04-20T10:54:58.048 INFO:tasks.workunit.client.0.smithi090.stdout:8/964: write d0/d3a/d9f/db9/f110 [2898416,63047] 0 2024-04-20T10:54:58.048 INFO:tasks.workunit.client.1.smithi175.stdout:7/518: write db/d1d/d29/fb4 [2246524,93164] 0 2024-04-20T10:54:58.048 INFO:tasks.workunit.client.1.smithi175.stdout:7/519: getdents db 0 2024-04-20T10:54:58.050 INFO:tasks.workunit.client.1.smithi175.stdout:7/520: truncate db/d1d/d39/d50/f3e 2973750 0 2024-04-20T10:54:58.060 INFO:tasks.workunit.client.0.smithi090.stdout:8/965: creat d0/d11/d22/d53/d57/dd3/f138 x:0 0 0 2024-04-20T10:54:58.060 INFO:tasks.workunit.client.0.smithi090.stdout:8/966: write d0/d3a/d9f/f7c [4428274,126830] 0 2024-04-20T10:54:58.060 INFO:tasks.workunit.client.0.smithi090.stdout:8/967: read d0/d99/fa3 [877724,22472] 0 2024-04-20T10:54:58.061 INFO:tasks.workunit.client.0.smithi090.stdout:8/968: read d0/d3a/d4a/fa6 [794675,124484] 0 2024-04-20T10:54:58.061 INFO:tasks.workunit.client.0.smithi090.stdout:8/969: creat d0/d2d/f139 x:0 0 0 2024-04-20T10:54:58.063 INFO:tasks.workunit.client.0.smithi090.stdout:8/970: creat d0/d11/d22/d53/d57/f13a x:0 0 0 2024-04-20T10:54:58.066 INFO:tasks.workunit.client.0.smithi090.stdout:6/975: dwrite d1/fea [0,4194304] 0 2024-04-20T10:54:58.067 INFO:tasks.workunit.client.0.smithi090.stdout:3/969: sync 2024-04-20T10:54:58.068 INFO:tasks.workunit.client.0.smithi090.stdout:6/976: link d1/d19/d36/d1e/f60 d1/d4/d26/d11/d35/d80/f149 0 2024-04-20T10:54:58.068 INFO:tasks.workunit.client.0.smithi090.stdout:6/977: write d1/d19/d25/fdc [84193,1294] 0 2024-04-20T10:54:58.068 INFO:tasks.workunit.client.0.smithi090.stdout:3/970: creat d7/d15/d47/d56/f133 x:0 0 0 2024-04-20T10:54:58.069 INFO:tasks.workunit.client.0.smithi090.stdout:8/971: dread d0/d3a/d4a/fa6 [0,4194304] 0 2024-04-20T10:54:58.069 INFO:tasks.workunit.client.0.smithi090.stdout:6/978: creat d1/d19/d36/d28/d145/f14a x:0 0 0 2024-04-20T10:54:58.069 INFO:tasks.workunit.client.0.smithi090.stdout:6/979: write d1/d19/d36/d28/d145/d147/db5/db9/ff6 [427699,85594] 0 2024-04-20T10:54:58.070 INFO:tasks.workunit.client.0.smithi090.stdout:3/971: mknod d7/d43/db7/c134 0 2024-04-20T10:54:58.070 INFO:tasks.workunit.client.0.smithi090.stdout:3/972: mknod d7/d15/d2a/c135 0 2024-04-20T10:54:58.072 INFO:tasks.workunit.client.0.smithi090.stdout:3/973: link d7/d43/c114 d7/d43/db7/dd4/c136 0 2024-04-20T10:54:58.072 INFO:tasks.workunit.client.0.smithi090.stdout:3/974: write d7/d11/dd0/fdc [285520,91869] 0 2024-04-20T10:54:58.072 INFO:tasks.workunit.client.0.smithi090.stdout:3/975: creat d7/d15/d2a/d30/d93/d7f/f137 x:0 0 0 2024-04-20T10:54:58.073 INFO:tasks.workunit.client.0.smithi090.stdout:7/913: dwrite d11/d13/d22/d82/ff9 [0,4194304] 0 2024-04-20T10:54:58.074 INFO:tasks.workunit.client.0.smithi090.stdout:7/914: truncate d11/d13/d22/d24/fc1 397378 0 2024-04-20T10:54:58.074 INFO:tasks.workunit.client.0.smithi090.stdout:7/915: dread - d11/d13/d5d/f114 zero size 2024-04-20T10:54:58.078 INFO:tasks.workunit.client.1.smithi175.stdout:7/521: dwrite db/d61/d6d/f90 [0,4194304] 0 2024-04-20T10:54:58.079 INFO:tasks.workunit.client.1.smithi175.stdout:7/522: rmdir db/d1d/d29/d2a 39 2024-04-20T10:54:58.083 INFO:tasks.workunit.client.0.smithi090.stdout:7/916: dread d11/d13/d5b/de8/f11d [0,4194304] 0 2024-04-20T10:54:58.085 INFO:tasks.workunit.client.1.smithi175.stdout:7/523: dread db/d1d/d29/d8f/faf [0,4194304] 0 2024-04-20T10:54:58.087 INFO:tasks.workunit.client.1.smithi175.stdout:7/524: mknod db/d1d/d39/d50/dba/d47/d6a/dbf/cc5 0 2024-04-20T10:54:58.087 INFO:tasks.workunit.client.0.smithi090.stdout:6/980: dread d1/d10/f39 [0,4194304] 0 2024-04-20T10:54:58.087 INFO:tasks.workunit.client.1.smithi175.stdout:7/525: stat db/d1d/c93 0 2024-04-20T10:54:58.088 INFO:tasks.workunit.client.1.smithi175.stdout:7/526: creat db/d1d/d29/d9a/fc6 x:0 0 0 2024-04-20T10:54:58.089 INFO:tasks.workunit.client.0.smithi090.stdout:6/981: mknod d1/d4/d26/d11/d4a/d56/c14b 0 2024-04-20T10:54:58.089 INFO:tasks.workunit.client.1.smithi175.stdout:7/527: creat db/d1d/d39/d50/dba/d47/fc7 x:0 0 0 2024-04-20T10:54:58.090 INFO:tasks.workunit.client.0.smithi090.stdout:6/982: rename d1/d4/l11d to d1/d19/d36/d28/d140/l14c 0 2024-04-20T10:54:58.091 INFO:tasks.workunit.client.1.smithi175.stdout:7/528: unlink db/d1d/d29/d8e/l44 0 2024-04-20T10:54:58.091 INFO:tasks.workunit.client.0.smithi090.stdout:3/976: dwrite d7/d15/d47/fc2 [4194304,4194304] 0 2024-04-20T10:54:58.091 INFO:tasks.workunit.client.0.smithi090.stdout:6/983: symlink d1/d19/d36/d28/d145/d147/db5/db9/dd3/de0/l14d 0 2024-04-20T10:54:58.091 INFO:tasks.workunit.client.1.smithi175.stdout:7/529: dread - db/d1d/d39/fa4 zero size 2024-04-20T10:54:58.092 INFO:tasks.workunit.client.0.smithi090.stdout:3/977: rmdir d7/d15/d2a/d8d 39 2024-04-20T10:54:58.092 INFO:tasks.workunit.client.0.smithi090.stdout:3/978: mkdir d7/df/d138 0 2024-04-20T10:54:58.094 INFO:tasks.workunit.client.0.smithi090.stdout:8/972: dwrite d0/f9 [4194304,4194304] 0 2024-04-20T10:54:58.094 INFO:tasks.workunit.client.0.smithi090.stdout:3/979: mkdir d7/d43/dd9/d139 0 2024-04-20T10:54:58.095 INFO:tasks.workunit.client.0.smithi090.stdout:8/973: link d0/d11/d22/d53/df6/c109 d0/d26/c13b 0 2024-04-20T10:54:58.095 INFO:tasks.workunit.client.0.smithi090.stdout:3/980: stat d7/d15/d2a/c44 0 2024-04-20T10:54:58.095 INFO:tasks.workunit.client.0.smithi090.stdout:8/974: mkdir d0/d11/d22/d53/d8e/d13c 0 2024-04-20T10:54:58.096 INFO:tasks.workunit.client.0.smithi090.stdout:8/975: creat d0/d3a/d9f/db9/dbe/f13d x:0 0 0 2024-04-20T10:54:58.097 INFO:tasks.workunit.client.0.smithi090.stdout:8/976: rmdir d0/d2d/d44 39 2024-04-20T10:54:58.098 INFO:tasks.workunit.client.0.smithi090.stdout:8/977: getdents d0/d11/d22/d53/d57/dd3/d10a 0 2024-04-20T10:54:58.098 INFO:tasks.workunit.client.0.smithi090.stdout:8/978: dread - d0/d26/f12b zero size 2024-04-20T10:54:58.098 INFO:tasks.workunit.client.0.smithi090.stdout:8/979: fdatasync d0/d3a/d4a/f9d 0 2024-04-20T10:54:58.098 INFO:tasks.workunit.client.0.smithi090.stdout:8/980: mknod d0/d11/d22/d53/d8e/c13e 0 2024-04-20T10:54:58.099 INFO:tasks.workunit.client.0.smithi090.stdout:8/981: symlink d0/d2d/d115/l13f 0 2024-04-20T10:54:58.099 INFO:tasks.workunit.client.0.smithi090.stdout:8/982: creat d0/d26/da7/da9/d11e/f140 x:0 0 0 2024-04-20T10:54:58.105 INFO:tasks.workunit.client.0.smithi090.stdout:7/917: dwrite d11/d13/d5b/db8/de0/fe7 [0,4194304] 0 2024-04-20T10:54:58.107 INFO:tasks.workunit.client.0.smithi090.stdout:8/983: write d0/d11/f1b [1861662,81797] 0 2024-04-20T10:54:58.110 INFO:tasks.workunit.client.0.smithi090.stdout:8/984: write d0/d3a/d9f/db9/fc1 [84878,98213] 0 2024-04-20T10:54:58.118 INFO:tasks.workunit.client.0.smithi090.stdout:6/984: dwrite d1/d4/d26/d11/d35/fa6 [0,4194304] 0 2024-04-20T10:54:58.119 INFO:tasks.workunit.client.0.smithi090.stdout:3/981: dwrite d7/d43/f45 [0,4194304] 0 2024-04-20T10:54:58.119 INFO:tasks.workunit.client.0.smithi090.stdout:6/985: rmdir d1/d4/dd6 39 2024-04-20T10:54:58.120 INFO:tasks.workunit.client.0.smithi090.stdout:3/982: mknod d7/c13a 0 2024-04-20T10:54:58.121 INFO:tasks.workunit.client.0.smithi090.stdout:6/986: symlink d1/d19/d36/d1e/l14e 0 2024-04-20T10:54:58.122 INFO:tasks.workunit.client.0.smithi090.stdout:3/983: link d7/df/dd1/dd3/fd7 d7/f13b 0 2024-04-20T10:54:58.125 INFO:tasks.workunit.client.0.smithi090.stdout:6/987: mknod d1/d4/d26/d11/d4a/db3/c14f 0 2024-04-20T10:54:58.125 INFO:tasks.workunit.client.0.smithi090.stdout:6/988: readlink d1/d19/d36/l143 0 2024-04-20T10:54:58.125 INFO:tasks.workunit.client.0.smithi090.stdout:6/989: write d1/d19/d36/d1e/d74/fcf [1208425,67343] 0 2024-04-20T10:54:58.126 INFO:tasks.workunit.client.0.smithi090.stdout:6/990: mknod d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/ddd/c150 0 2024-04-20T10:54:58.126 INFO:tasks.workunit.client.0.smithi090.stdout:6/991: fsync d1/d19/d36/d28/d145/d147/db5/db9/fb2 0 2024-04-20T10:54:58.126 INFO:tasks.workunit.client.0.smithi090.stdout:7/918: dwrite d11/d13/d33/d44/d89/fbd [0,4194304] 0 2024-04-20T10:54:58.127 INFO:tasks.workunit.client.0.smithi090.stdout:6/992: mkdir d1/d4/d26/d11/d35/d80/d151 0 2024-04-20T10:54:58.130 INFO:tasks.workunit.client.0.smithi090.stdout:6/993: creat d1/d4/dd6/dd8/f152 x:0 0 0 2024-04-20T10:54:58.132 INFO:tasks.workunit.client.0.smithi090.stdout:6/994: truncate d1/fb4 1032137 0 2024-04-20T10:54:58.132 INFO:tasks.workunit.client.0.smithi090.stdout:6/995: write d1/d4/d26/d11/d35/f11f [342220,15225] 0 2024-04-20T10:54:58.132 INFO:tasks.workunit.client.0.smithi090.stdout:6/996: chown d1/d19/d36/d28/d145/d147/db5/df1 926220 1 2024-04-20T10:54:58.132 INFO:tasks.workunit.client.0.smithi090.stdout:6/997: dread - d1/d19/d36/d1e/d1f/d3f/d54/d9f/dad/f142 zero size 2024-04-20T10:54:58.137 INFO:tasks.workunit.client.0.smithi090.stdout:8/985: dwrite d0/f9c [0,4194304] 0 2024-04-20T10:54:58.143 INFO:tasks.workunit.client.0.smithi090.stdout:3/984: dwrite d7/d43/f10f [0,4194304] 0 2024-04-20T10:54:58.143 INFO:tasks.workunit.client.0.smithi090.stdout:3/985: write d7/ddd/ff1 [367852,107153] 0 2024-04-20T10:54:58.144 INFO:tasks.workunit.client.0.smithi090.stdout:3/986: chown d7/d35/da8/f113 1156 1 2024-04-20T10:54:58.145 INFO:tasks.workunit.client.0.smithi090.stdout:3/987: stat d7/d43/c6e 0 2024-04-20T10:54:58.149 INFO:tasks.workunit.client.0.smithi090.stdout:3/988: read d7/df/f27 [19624,108154] 0 2024-04-20T10:54:58.149 INFO:tasks.workunit.client.0.smithi090.stdout:3/989: mknod d7/d11/dd0/d124/c13c 0 2024-04-20T10:54:58.150 INFO:tasks.workunit.client.0.smithi090.stdout:3/990: mknod d7/df/dd1/dd3/d88/c13d 0 2024-04-20T10:54:58.151 INFO:tasks.workunit.client.0.smithi090.stdout:3/991: symlink d7/d15/d2a/d30/d93/l13e 0 2024-04-20T10:54:58.158 INFO:tasks.workunit.client.0.smithi090.stdout:7/919: dwrite d11/d13/d22/d24/fc1 [0,4194304] 0 2024-04-20T10:54:58.160 INFO:tasks.workunit.client.0.smithi090.stdout:7/920: link d11/d13/d5d/f114 d11/d1a/d3b/d107/d10f/f123 0 2024-04-20T10:54:58.162 INFO:tasks.workunit.client.0.smithi090.stdout:3/992: dread d7/d35/f4b [0,4194304] 0 2024-04-20T10:54:58.162 INFO:tasks.workunit.client.0.smithi090.stdout:3/993: truncate d7/d26/dc9/f115 401054 0 2024-04-20T10:54:58.163 INFO:tasks.workunit.client.0.smithi090.stdout:3/994: mkdir d7/d26/d13f 0 2024-04-20T10:54:58.164 INFO:tasks.workunit.client.0.smithi090.stdout:3/995: link d7/df/l104 d7/df/d138/l140 0 2024-04-20T10:54:58.164 INFO:tasks.workunit.client.0.smithi090.stdout:6/998: dwrite d1/d19/d36/f115 [0,4194304] 0 2024-04-20T10:54:58.165 INFO:tasks.workunit.client.0.smithi090.stdout:3/996: creat d7/d15/d2a/da2/df0/f141 x:0 0 0 2024-04-20T10:54:58.168 INFO:tasks.workunit.client.0.smithi090.stdout:3/997: mkdir d7/df/dd1/dd3/d88/d142 0 2024-04-20T10:54:58.169 INFO:tasks.workunit.client.0.smithi090.stdout:3/998: link d7/d43/c114 d7/df/dd1/dd3/d88/d142/c143 0 2024-04-20T10:54:58.177 INFO:tasks.workunit.client.0.smithi090.stdout:7/921: dwrite d11/d13/d22/f4b [0,4194304] 0 2024-04-20T10:54:58.177 INFO:tasks.workunit.client.0.smithi090.stdout:3/999: getdents d7/d35/da8/ded 0 2024-04-20T10:54:58.226 INFO:tasks.workunit.client.1.smithi175.stdout:3/289: sync 2024-04-20T10:54:58.228 INFO:tasks.workunit.client.1.smithi175.stdout:3/290: dread d7/d19/d2a/f2b [0,4194304] 0 2024-04-20T10:54:58.233 INFO:tasks.workunit.client.1.smithi175.stdout:3/291: write d7/f15 [1184866,117921] 0 2024-04-20T10:54:58.235 INFO:tasks.workunit.client.1.smithi175.stdout:3/292: link d7/d21/d16/c36 d7/c5f 0 2024-04-20T10:54:58.243 INFO:tasks.workunit.client.1.smithi175.stdout:3/293: rename d7/d19/d35 to d7/d19/d33/d60 0 2024-04-20T10:54:58.243 INFO:tasks.workunit.client.1.smithi175.stdout:3/294: chown c6 3 1 2024-04-20T10:54:58.251 INFO:tasks.workunit.client.1.smithi175.stdout:3/295: creat d7/d21/d16/d22/d2c/d1f/d48/f61 x:0 0 0 2024-04-20T10:54:58.253 INFO:tasks.workunit.client.1.smithi175.stdout:3/296: rename d7/d19/d33/c45 to d7/d21/d16/d22/c62 0 2024-04-20T10:54:58.253 INFO:tasks.workunit.client.1.smithi175.stdout:3/297: dread - d7/d19/d33/d60/f44 zero size 2024-04-20T10:54:58.254 INFO:tasks.workunit.client.1.smithi175.stdout:3/298: creat d7/d21/d16/d49/f63 x:0 0 0 2024-04-20T10:54:58.277 INFO:tasks.workunit.client.1.smithi175.stdout:3/299: dwrite d7/d19/d33/f3b [0,4194304] 0 2024-04-20T10:54:58.279 INFO:tasks.workunit.client.1.smithi175.stdout:3/300: truncate d7/d21/d16/d22/d2c/d1f/f5b 306664 0 2024-04-20T10:54:58.281 INFO:tasks.workunit.client.1.smithi175.stdout:3/301: unlink d7/d21/d16/d22/d2c/c29 0 2024-04-20T10:54:58.281 INFO:tasks.workunit.client.1.smithi175.stdout:3/302: fdatasync d7/d21/f41 0 2024-04-20T10:54:58.282 INFO:tasks.workunit.client.1.smithi175.stdout:3/303: mkdir d7/d21/d16/d22/d2c/d64 0 2024-04-20T10:54:58.282 INFO:tasks.workunit.client.1.smithi175.stdout:3/304: stat d7/d21 0 2024-04-20T10:54:58.314 INFO:tasks.workunit.client.0.smithi090.stdout:8/986: sync 2024-04-20T10:54:58.330 INFO:tasks.workunit.client.0.smithi090.stdout:8/987: dwrite d0/d3a/d9f/db9/fbd [0,4194304] 0 2024-04-20T10:54:58.352 INFO:tasks.workunit.client.1.smithi175.stdout:5/416: sync 2024-04-20T10:54:58.352 INFO:tasks.workunit.client.1.smithi175.stdout:4/395: sync 2024-04-20T10:54:58.352 INFO:tasks.workunit.client.1.smithi175.stdout:8/380: sync 2024-04-20T10:54:58.352 INFO:tasks.workunit.client.1.smithi175.stdout:2/307: sync 2024-04-20T10:54:58.352 INFO:tasks.workunit.client.1.smithi175.stdout:7/530: sync 2024-04-20T10:54:58.352 INFO:tasks.workunit.client.1.smithi175.stdout:6/443: sync 2024-04-20T10:54:58.352 INFO:tasks.workunit.client.1.smithi175.stdout:1/356: sync 2024-04-20T10:54:58.353 INFO:tasks.workunit.client.1.smithi175.stdout:1/357: fsync d0/d8/f5e 0 2024-04-20T10:54:58.353 INFO:tasks.workunit.client.1.smithi175.stdout:9/388: sync 2024-04-20T10:54:58.353 INFO:tasks.workunit.client.1.smithi175.stdout:0/414: sync 2024-04-20T10:54:58.353 INFO:tasks.workunit.client.1.smithi175.stdout:2/308: chown d1/d7/l15 2268553 1 2024-04-20T10:54:58.358 INFO:tasks.workunit.client.1.smithi175.stdout:1/358: link d0/d3e/c4a d0/d8/d13/d2e/d35/c7d 0 2024-04-20T10:54:58.358 INFO:tasks.workunit.client.1.smithi175.stdout:1/359: chown d0/c6e 255246894 1 2024-04-20T10:54:58.361 INFO:tasks.workunit.client.1.smithi175.stdout:5/417: mkdir db/d11/d80 0 2024-04-20T10:54:58.364 INFO:tasks.workunit.client.1.smithi175.stdout:0/415: dread df/d19/f31 [0,4194304] 0 2024-04-20T10:54:58.367 INFO:tasks.workunit.client.1.smithi175.stdout:2/309: rmdir d1/d48/d38/d65 0 2024-04-20T10:54:58.369 INFO:tasks.workunit.client.0.smithi090.stdout:8/988: link d0/d3a/f46 d0/d11/d22/d53/d57/dd3/d111/d67/f141 0 2024-04-20T10:54:58.369 INFO:tasks.workunit.client.1.smithi175.stdout:4/396: creat d4/dd/d54/d5d/f8e x:0 0 0 2024-04-20T10:54:58.369 INFO:tasks.workunit.client.1.smithi175.stdout:6/444: write d1/d5/d12/f14 [2657771,21642] 0 2024-04-20T10:54:58.370 INFO:tasks.workunit.client.1.smithi175.stdout:2/310: chown d1/d7/d63/d4b 1237344808 1 2024-04-20T10:54:58.372 INFO:tasks.workunit.client.1.smithi175.stdout:1/360: rename d0/f56 to d0/d8/f7e 0 2024-04-20T10:54:58.374 INFO:tasks.workunit.client.1.smithi175.stdout:6/445: dread d1/d5/d12/f47 [0,4194304] 0 2024-04-20T10:54:58.375 INFO:tasks.workunit.client.1.smithi175.stdout:1/361: creat d0/d8/d13/d2e/d35/f7f x:0 0 0 2024-04-20T10:54:58.375 INFO:tasks.workunit.client.1.smithi175.stdout:2/311: mkdir d1/d6a 0 2024-04-20T10:54:58.378 INFO:tasks.workunit.client.1.smithi175.stdout:1/362: creat d0/d3e/f80 x:0 0 0 2024-04-20T10:54:58.379 INFO:tasks.workunit.client.1.smithi175.stdout:2/312: fsync d1/d7/d63/d36/f47 0 2024-04-20T10:54:58.380 INFO:tasks.workunit.client.1.smithi175.stdout:4/397: mknod d4/dd/d2d/d33/d3c/c8f 0 2024-04-20T10:54:58.380 INFO:tasks.workunit.client.1.smithi175.stdout:8/381: dwrite d7/d13/d1d/d24/d39/f48 [0,4194304] 0 2024-04-20T10:54:58.381 INFO:tasks.workunit.client.1.smithi175.stdout:5/418: rename db/d11/d1a/c3d to db/d11/d25/c81 0 2024-04-20T10:54:58.384 INFO:tasks.workunit.client.1.smithi175.stdout:1/363: unlink d0/f20 0 2024-04-20T10:54:58.384 INFO:tasks.workunit.client.1.smithi175.stdout:7/531: dwrite db/d1d/d29/d8f/f98 [0,4194304] 0 2024-04-20T10:54:58.388 INFO:tasks.workunit.client.0.smithi090.stdout:7/922: sync 2024-04-20T10:54:58.388 INFO:tasks.workunit.client.0.smithi090.stdout:6/999: sync 2024-04-20T10:54:58.391 INFO:tasks.workunit.client.1.smithi175.stdout:9/389: rmdir d6/d10/d62 0 2024-04-20T10:54:58.392 INFO:tasks.workunit.client.1.smithi175.stdout:7/532: fsync db/fd 0 2024-04-20T10:54:58.394 INFO:tasks.workunit.client.0.smithi090.stdout:8/989: dwrite d0/d11/f31 [4194304,4194304] 0 2024-04-20T10:54:58.397 INFO:tasks.workunit.client.1.smithi175.stdout:5/419: unlink db/d11/d25/d38/c6e 0 2024-04-20T10:54:58.398 INFO:tasks.workunit.client.1.smithi175.stdout:6/446: dwrite d1/d40/f99 [0,4194304] 0 2024-04-20T10:54:58.398 INFO:tasks.workunit.client.1.smithi175.stdout:9/390: getdents d6 0 2024-04-20T10:54:58.401 INFO:tasks.workunit.client.1.smithi175.stdout:7/533: mkdir db/d1d/d39/d50/dba/d47/da6/db9/dc8 0 2024-04-20T10:54:58.407 INFO:tasks.workunit.client.1.smithi175.stdout:7/534: dread db/d1d/d39/d50/dba/d47/f94 [0,4194304] 0 2024-04-20T10:54:58.407 INFO:tasks.workunit.client.1.smithi175.stdout:7/535: dread - db/d1d/d39/fad zero size 2024-04-20T10:54:58.410 INFO:tasks.workunit.client.1.smithi175.stdout:2/313: mknod d1/d7/d1f/c6b 0 2024-04-20T10:54:58.413 INFO:tasks.workunit.client.1.smithi175.stdout:6/447: getdents d1/d40/d46/d60/d68 0 2024-04-20T10:54:58.413 INFO:tasks.workunit.client.1.smithi175.stdout:6/448: write d1/f18 [4986534,65686] 0 2024-04-20T10:54:58.414 INFO:tasks.workunit.client.1.smithi175.stdout:7/536: chown db/d1d/d39/d50/ff 32157806 1 2024-04-20T10:54:58.416 INFO:tasks.workunit.client.1.smithi175.stdout:9/391: dread d6/d1b/d2f/f38 [0,4194304] 0 2024-04-20T10:54:58.416 INFO:tasks.workunit.client.1.smithi175.stdout:8/382: creat d7/d13/d1d/d56/f71 x:0 0 0 2024-04-20T10:54:58.420 INFO:tasks.workunit.client.1.smithi175.stdout:7/537: dread db/fd [0,4194304] 0 2024-04-20T10:54:58.420 INFO:tasks.workunit.client.1.smithi175.stdout:7/538: chown db/d1d/d39/d50/f3e 14447 1 2024-04-20T10:54:58.421 INFO:tasks.workunit.client.1.smithi175.stdout:6/449: symlink d1/d5/d12/la2 0 2024-04-20T10:54:58.421 INFO:tasks.workunit.client.1.smithi175.stdout:7/539: fdatasync db/d1d/d39/f3f 0 2024-04-20T10:54:58.423 INFO:tasks.workunit.client.1.smithi175.stdout:6/450: symlink d1/d40/la3 0 2024-04-20T10:54:58.423 INFO:tasks.workunit.client.1.smithi175.stdout:7/540: dread db/f7e [0,4194304] 0 2024-04-20T10:54:58.424 INFO:tasks.workunit.client.1.smithi175.stdout:6/451: readlink d1/d40/d46/d60/l6d 0 2024-04-20T10:54:58.427 INFO:tasks.workunit.client.1.smithi175.stdout:7/541: rename db/d1d/d39/d50/f8c to db/d1d/d60/d76/db6/fc9 0 2024-04-20T10:54:58.427 INFO:tasks.workunit.client.1.smithi175.stdout:7/542: mknod db/d1d/d39/d50/dba/d47/dac/cca 0 2024-04-20T10:54:58.428 INFO:tasks.workunit.client.1.smithi175.stdout:9/392: read d6/f1d [3460590,116438] 0 2024-04-20T10:54:58.428 INFO:tasks.workunit.client.1.smithi175.stdout:6/452: symlink d1/d40/d63/d7c/la4 0 2024-04-20T10:54:58.428 INFO:tasks.workunit.client.1.smithi175.stdout:9/393: dread - d6/d58/f61 zero size 2024-04-20T10:54:58.430 INFO:tasks.workunit.client.1.smithi175.stdout:9/394: getdents d6 0 2024-04-20T10:54:58.430 INFO:tasks.workunit.client.1.smithi175.stdout:9/395: chown d6/c6e 44887 1 2024-04-20T10:54:58.430 INFO:tasks.workunit.client.1.smithi175.stdout:9/396: chown d6/c13 35325 1 2024-04-20T10:54:58.431 INFO:tasks.workunit.client.1.smithi175.stdout:6/453: chown d1/d40/d49/f69 24 1 2024-04-20T10:54:58.431 INFO:tasks.workunit.client.1.smithi175.stdout:5/420: dwrite db/d11/f7f [0,4194304] 0 2024-04-20T10:54:58.433 INFO:tasks.workunit.client.1.smithi175.stdout:9/397: getdents d6/d33/d60 0 2024-04-20T10:54:58.433 INFO:tasks.workunit.client.1.smithi175.stdout:9/398: dread - d6/f43 zero size 2024-04-20T10:54:58.433 INFO:tasks.workunit.client.0.smithi090.stdout:8/990: dwrite d0/f12 [0,4194304] 0 2024-04-20T10:54:58.433 INFO:tasks.workunit.client.0.smithi090.stdout:7/923: dwrite d11/d13/d5b/db8/dbf/da9/fb9 [0,4194304] 0 2024-04-20T10:54:58.435 INFO:tasks.workunit.client.1.smithi175.stdout:0/416: dwrite df/d2e/f47 [0,4194304] 0 2024-04-20T10:54:58.435 INFO:tasks.workunit.client.1.smithi175.stdout:1/364: dwrite d0/d8/f28 [0,4194304] 0 2024-04-20T10:54:58.436 INFO:tasks.workunit.client.0.smithi090.stdout:8/991: rmdir d0/d11/d22/d53/d8e/d92 39 2024-04-20T10:54:58.436 INFO:tasks.workunit.client.1.smithi175.stdout:4/398: symlink d4/d27/d61/l90 0 2024-04-20T10:54:58.438 INFO:tasks.workunit.client.0.smithi090.stdout:7/924: symlink d11/d13/d5b/de8/l124 0 2024-04-20T10:54:58.438 INFO:tasks.workunit.client.1.smithi175.stdout:5/421: getdents db/d30/d46/d4b/d4f 0 2024-04-20T10:54:58.439 INFO:tasks.workunit.client.0.smithi090.stdout:8/992: mknod d0/d26/c142 0 2024-04-20T10:54:58.444 INFO:tasks.workunit.client.1.smithi175.stdout:1/365: creat d0/d8/d13/f81 x:0 0 0 2024-04-20T10:54:58.445 INFO:tasks.workunit.client.1.smithi175.stdout:4/399: creat d4/d27/f91 x:0 0 0 2024-04-20T10:54:58.445 INFO:tasks.workunit.client.0.smithi090.stdout:7/925: read d11/d13/d5b/db8/f85 [1663433,71218] 0 2024-04-20T10:54:58.447 INFO:tasks.workunit.client.1.smithi175.stdout:6/454: link d1/d40/d46/d60/d68/d7e/f9e d1/d40/d63/fa5 0 2024-04-20T10:54:58.448 INFO:tasks.workunit.client.1.smithi175.stdout:8/383: unlink d7/d13/d1d/d24/d38/l43 0 2024-04-20T10:54:58.448 INFO:tasks.workunit.client.1.smithi175.stdout:5/422: rmdir db/d11/d1a 39 2024-04-20T10:54:58.453 INFO:tasks.workunit.client.1.smithi175.stdout:2/314: write d1/f3 [381227,4891] 0 2024-04-20T10:54:58.454 INFO:tasks.workunit.client.1.smithi175.stdout:0/417: dwrite df/d17/f2a [4194304,4194304] 0 2024-04-20T10:54:58.456 INFO:tasks.workunit.client.1.smithi175.stdout:7/543: write db/f46 [4879297,14530] 0 2024-04-20T10:54:58.460 INFO:tasks.workunit.client.1.smithi175.stdout:0/418: mknod df/d1a/d22/d6a/d72/d7f/c86 0 2024-04-20T10:54:58.461 INFO:tasks.workunit.client.1.smithi175.stdout:5/423: mknod db/d1f/d31/c82 0 2024-04-20T10:54:58.462 INFO:tasks.workunit.client.0.smithi090.stdout:7/926: dwrite d11/d13/d33/f9d [0,4194304] 0 2024-04-20T10:54:58.463 INFO:tasks.workunit.client.0.smithi090.stdout:7/927: dread - d11/dd2/f118 zero size 2024-04-20T10:54:58.463 INFO:tasks.workunit.client.0.smithi090.stdout:7/928: chown d11/d13/d5b/db8/dbf/da9 0 1 2024-04-20T10:54:58.463 INFO:tasks.workunit.client.0.smithi090.stdout:8/993: symlink d0/d11/l143 0 2024-04-20T10:54:58.463 INFO:tasks.workunit.client.0.smithi090.stdout:7/929: getdents d11/dd2/d11a 0 2024-04-20T10:54:58.464 INFO:tasks.workunit.client.1.smithi175.stdout:0/419: mknod df/d1a/d22/d6a/d72/d48/c87 0 2024-04-20T10:54:58.465 INFO:tasks.workunit.client.1.smithi175.stdout:6/455: creat d1/d40/d49/fa6 x:0 0 0 2024-04-20T10:54:58.467 INFO:tasks.workunit.client.0.smithi090.stdout:7/930: dread d11/d1a/fbe [0,4194304] 0 2024-04-20T10:54:58.468 INFO:tasks.workunit.client.0.smithi090.stdout:8/994: symlink d0/d11/d22/d53/d8e/d13c/l144 0 2024-04-20T10:54:58.468 INFO:tasks.workunit.client.0.smithi090.stdout:8/995: readlink d0/d11/d22/d53/d57/dd3/d111/la0 0 2024-04-20T10:54:58.469 INFO:tasks.workunit.client.0.smithi090.stdout:7/931: mknod d11/d13/d22/d27/dc2/c125 0 2024-04-20T10:54:58.470 INFO:tasks.workunit.client.1.smithi175.stdout:9/399: rename d6/d10/c22 to d6/d33/c6f 0 2024-04-20T10:54:58.472 INFO:tasks.workunit.client.1.smithi175.stdout:0/420: unlink df/d19/l25 0 2024-04-20T10:54:58.472 INFO:tasks.workunit.client.1.smithi175.stdout:4/400: write d4/d23/f32 [3364667,130762] 0 2024-04-20T10:54:58.472 INFO:tasks.workunit.client.1.smithi175.stdout:2/315: write d1/d48/d21/d29/f39 [1975811,35436] 0 2024-04-20T10:54:58.473 INFO:tasks.workunit.client.1.smithi175.stdout:0/421: chown df/f3a 7 1 2024-04-20T10:54:58.475 INFO:tasks.workunit.client.1.smithi175.stdout:0/422: getdents df/d1a 0 2024-04-20T10:54:58.476 INFO:tasks.workunit.client.1.smithi175.stdout:4/401: creat d4/d27/d61/f92 x:0 0 0 2024-04-20T10:54:58.477 INFO:tasks.workunit.client.0.smithi090.stdout:7/932: dread d11/d13/d5b/f9a [0,4194304] 0 2024-04-20T10:54:58.485 INFO:tasks.workunit.client.1.smithi175.stdout:5/424: dwrite db/d30/d46/f7e [0,4194304] 0 2024-04-20T10:54:58.493 INFO:tasks.workunit.client.1.smithi175.stdout:8/384: dwrite d7/d13/f50 [0,4194304] 0 2024-04-20T10:54:58.493 INFO:tasks.workunit.client.1.smithi175.stdout:7/544: rename db/d1d/d39/d50/c2b to db/d1d/d39/d50/dba/d47/ccb 0 2024-04-20T10:54:58.493 INFO:tasks.workunit.client.1.smithi175.stdout:7/545: write db/d1d/d29/d2a/fa8 [1370441,94977] 0 2024-04-20T10:54:58.494 INFO:tasks.workunit.client.1.smithi175.stdout:1/366: dwrite d0/f49 [0,4194304] 0 2024-04-20T10:54:58.494 INFO:tasks.workunit.client.0.smithi090.stdout:7/933: dread d11/d13/d22/df3/ffa [0,4194304] 0 2024-04-20T10:54:58.495 INFO:tasks.workunit.client.0.smithi090.stdout:7/934: write d11/d13/d22/d24/f2a [1308970,67530] 0 2024-04-20T10:54:58.495 INFO:tasks.workunit.client.0.smithi090.stdout:7/935: truncate d11/d1a/d3f/f66 4668337 0 2024-04-20T10:54:58.499 INFO:tasks.workunit.client.1.smithi175.stdout:8/385: mknod d7/d55/d6c/c72 0 2024-04-20T10:54:58.500 INFO:tasks.workunit.client.1.smithi175.stdout:7/546: truncate db/d1d/d29/f9e 2455432 0 2024-04-20T10:54:58.500 INFO:tasks.workunit.client.1.smithi175.stdout:1/367: creat d0/d51/f82 x:0 0 0 2024-04-20T10:54:58.501 INFO:tasks.workunit.client.1.smithi175.stdout:4/402: symlink d4/dd/d2d/d33/l93 0 2024-04-20T10:54:58.502 INFO:tasks.workunit.client.1.smithi175.stdout:5/425: mkdir db/d11/d25/d41/d83 0 2024-04-20T10:54:58.503 INFO:tasks.workunit.client.1.smithi175.stdout:7/547: chown db/d1d/d39/d50/dba/c5f 401 1 2024-04-20T10:54:58.505 INFO:tasks.workunit.client.1.smithi175.stdout:2/316: dwrite d1/d48/d21/f37 [0,4194304] 0 2024-04-20T10:54:58.507 INFO:tasks.workunit.client.1.smithi175.stdout:6/456: write d1/d5/d12/f1c [2813150,106659] 0 2024-04-20T10:54:58.507 INFO:tasks.workunit.client.1.smithi175.stdout:3/305: sync 2024-04-20T10:54:58.514 INFO:tasks.workunit.client.1.smithi175.stdout:5/426: dread db/d1f/f20 [0,4194304] 0 2024-04-20T10:54:58.514 INFO:tasks.workunit.client.1.smithi175.stdout:4/403: rmdir d4/dd/d2d/d33/d58/d67 39 2024-04-20T10:54:58.516 INFO:tasks.workunit.client.1.smithi175.stdout:6/457: truncate d1/fb 393302 0 2024-04-20T10:54:58.517 INFO:tasks.workunit.client.1.smithi175.stdout:5/427: creat db/f84 x:0 0 0 2024-04-20T10:54:58.518 INFO:tasks.workunit.client.1.smithi175.stdout:4/404: fdatasync d4/dd/f50 0 2024-04-20T10:54:58.519 INFO:tasks.workunit.client.1.smithi175.stdout:6/458: getdents d1/d40/d63 0 2024-04-20T10:54:58.521 INFO:tasks.workunit.client.1.smithi175.stdout:7/548: write db/d1d/d39/d50/f25 [677695,75816] 0 2024-04-20T10:54:58.523 INFO:tasks.workunit.client.1.smithi175.stdout:2/317: creat d1/d48/d21/d29/f6c x:0 0 0 2024-04-20T10:54:58.523 INFO:tasks.workunit.client.1.smithi175.stdout:4/405: dread d4/f9 [0,4194304] 0 2024-04-20T10:54:58.524 INFO:tasks.workunit.client.1.smithi175.stdout:2/318: creat d1/f6d x:0 0 0 2024-04-20T10:54:58.525 INFO:tasks.workunit.client.1.smithi175.stdout:2/319: stat d1/d48/l45 0 2024-04-20T10:54:58.527 INFO:tasks.workunit.client.1.smithi175.stdout:4/406: symlink d4/dd/d54/d5f/l94 0 2024-04-20T10:54:58.528 INFO:tasks.workunit.client.1.smithi175.stdout:8/386: write d7/d13/d1d/d24/d26/f51 [3030570,98930] 0 2024-04-20T10:54:58.528 INFO:tasks.workunit.client.1.smithi175.stdout:4/407: unlink d4/dd/d2d/d33/l93 0 2024-04-20T10:54:58.530 INFO:tasks.workunit.client.1.smithi175.stdout:8/387: dread - d7/d13/f33 zero size 2024-04-20T10:54:58.532 INFO:tasks.workunit.client.1.smithi175.stdout:5/428: write db/d30/d46/f7e [2168210,77521] 0 2024-04-20T10:54:58.532 INFO:tasks.workunit.client.1.smithi175.stdout:8/388: chown d7/d13/d1d/d24/c60 14523608 1 2024-04-20T10:54:58.537 INFO:tasks.workunit.client.0.smithi090.stdout:7/936: dwrite d11/d1a/f40 [0,4194304] 0 2024-04-20T10:54:58.538 INFO:tasks.workunit.client.0.smithi090.stdout:7/937: readlink d11/d13/d5b/db8/dbf/l91 0 2024-04-20T10:54:58.538 INFO:tasks.workunit.client.0.smithi090.stdout:7/938: chown d11/d13/d22/f3a 19717 1 2024-04-20T10:54:58.538 INFO:tasks.workunit.client.0.smithi090.stdout:8/996: mknod d0/d3a/d9f/db9/c145 0 2024-04-20T10:54:58.538 INFO:tasks.workunit.client.0.smithi090.stdout:8/997: dread - d0/d26/da7/f122 zero size 2024-04-20T10:54:58.538 INFO:tasks.workunit.client.1.smithi175.stdout:4/408: unlink d4/dd/d5e/f85 0 2024-04-20T10:54:58.540 INFO:tasks.workunit.client.1.smithi175.stdout:5/429: rename db/c57 to db/c85 0 2024-04-20T10:54:58.542 INFO:tasks.workunit.client.1.smithi175.stdout:4/409: truncate d4/d27/d25/f77 55933 0 2024-04-20T10:54:58.544 INFO:tasks.workunit.client.1.smithi175.stdout:5/430: creat db/d11/d25/d38/d40/d66/f86 x:0 0 0 2024-04-20T10:54:58.544 INFO:tasks.workunit.client.1.smithi175.stdout:5/431: fdatasync db/f84 0 2024-04-20T10:54:58.546 INFO:tasks.workunit.client.1.smithi175.stdout:5/432: creat db/d11/d25/d62/f87 x:0 0 0 2024-04-20T10:54:58.546 INFO:tasks.workunit.client.1.smithi175.stdout:5/433: stat db/d1f/d31/d35/l64 0 2024-04-20T10:54:58.547 INFO:tasks.workunit.client.1.smithi175.stdout:4/410: link d4/f20 d4/d23/f95 0 2024-04-20T10:54:58.548 INFO:tasks.workunit.client.1.smithi175.stdout:5/434: mkdir db/d30/d46/d88 0 2024-04-20T10:54:58.549 INFO:tasks.workunit.client.1.smithi175.stdout:5/435: write db/d11/d25/d62/f87 [136514,5380] 0 2024-04-20T10:54:58.549 INFO:tasks.workunit.client.1.smithi175.stdout:6/459: dwrite d1/d40/d63/d7c/f94 [0,4194304] 0 2024-04-20T10:54:58.550 INFO:tasks.workunit.client.0.smithi090.stdout:8/998: dread d0/f27 [0,4194304] 0 2024-04-20T10:54:58.550 INFO:tasks.workunit.client.1.smithi175.stdout:0/423: dwrite df/f3a [0,4194304] 0 2024-04-20T10:54:58.551 INFO:tasks.workunit.client.1.smithi175.stdout:4/411: mkdir d4/dd/d5e/d96 0 2024-04-20T10:54:58.551 INFO:tasks.workunit.client.1.smithi175.stdout:4/412: stat d4/dd/d54/d5f 0 2024-04-20T10:54:58.551 INFO:tasks.workunit.client.1.smithi175.stdout:0/424: dread df/d1a/d22/d6a/d72/d48/d4e/f5d [0,4194304] 0 2024-04-20T10:54:58.551 INFO:tasks.workunit.client.1.smithi175.stdout:6/460: getdents d1/d40/d49 0 2024-04-20T10:54:58.552 INFO:tasks.workunit.client.1.smithi175.stdout:0/425: write df/d1a/d22/d6a/d72/d48/d4e/f5d [85640,115520] 0 2024-04-20T10:54:58.553 INFO:tasks.workunit.client.1.smithi175.stdout:5/436: mkdir db/d11/d25/d38/d89 0 2024-04-20T10:54:58.558 INFO:tasks.workunit.client.1.smithi175.stdout:4/413: fdatasync d4/d27/d25/f29 0 2024-04-20T10:54:58.558 INFO:tasks.workunit.client.1.smithi175.stdout:8/389: write d7/d13/d1d/f1e [1894122,20994] 0 2024-04-20T10:54:58.559 INFO:tasks.workunit.client.1.smithi175.stdout:0/426: creat df/d1a/d3f/f88 x:0 0 0 2024-04-20T10:54:58.559 INFO:tasks.workunit.client.1.smithi175.stdout:0/427: fsync df/d19/f7a 0 2024-04-20T10:54:58.560 INFO:tasks.workunit.client.1.smithi175.stdout:4/414: fsync d4/f31 0 2024-04-20T10:54:58.562 INFO:tasks.workunit.client.1.smithi175.stdout:5/437: symlink db/d11/d25/d41/l8a 0 2024-04-20T10:54:58.564 INFO:tasks.workunit.client.1.smithi175.stdout:8/390: dread d7/fd [0,4194304] 0 2024-04-20T10:54:58.564 INFO:tasks.workunit.client.1.smithi175.stdout:8/391: chown d7/d13/d1d/d24/d39/d6f 13775409 1 2024-04-20T10:54:58.573 INFO:tasks.workunit.client.1.smithi175.stdout:4/415: write d4/dd/d2d/d33/d3c/f80 [193261,99002] 0 2024-04-20T10:54:58.574 INFO:tasks.workunit.client.1.smithi175.stdout:4/416: dread - d4/d27/d61/f7a zero size 2024-04-20T10:54:58.574 INFO:tasks.workunit.client.1.smithi175.stdout:4/417: dread - d4/d27/d61/f7a zero size 2024-04-20T10:54:58.574 INFO:tasks.workunit.client.1.smithi175.stdout:0/428: write df/d1a/d3f/f75 [329575,75258] 0 2024-04-20T10:54:58.581 INFO:tasks.workunit.client.1.smithi175.stdout:4/418: dread d4/d27/d25/f29 [0,4194304] 0 2024-04-20T10:54:58.581 INFO:tasks.workunit.client.1.smithi175.stdout:4/419: fdatasync d4/d27/d25/f77 0 2024-04-20T10:54:58.583 INFO:tasks.workunit.client.1.smithi175.stdout:4/420: truncate d4/d27/f1c 1558116 0 2024-04-20T10:54:58.585 INFO:tasks.workunit.client.1.smithi175.stdout:4/421: symlink d4/dd/d2d/d43/l97 0 2024-04-20T10:54:58.586 INFO:tasks.workunit.client.1.smithi175.stdout:5/438: write db/d11/d1a/f28 [4721829,81003] 0 2024-04-20T10:54:58.586 INFO:tasks.workunit.client.1.smithi175.stdout:5/439: write db/d11/f7f [5192128,100174] 0 2024-04-20T10:54:58.589 INFO:tasks.workunit.client.1.smithi175.stdout:0/429: read df/f1c [2803908,31759] 0 2024-04-20T10:54:58.589 INFO:tasks.workunit.client.1.smithi175.stdout:0/430: truncate df/d19/f7a 614146 0 2024-04-20T10:54:58.591 INFO:tasks.workunit.client.1.smithi175.stdout:0/431: mknod df/d17/c89 0 2024-04-20T10:54:58.592 INFO:tasks.workunit.client.1.smithi175.stdout:0/432: creat df/d19/f8a x:0 0 0 2024-04-20T10:54:58.592 INFO:tasks.workunit.client.1.smithi175.stdout:0/433: fsync df/d1a/d22/f79 0 2024-04-20T10:54:58.592 INFO:tasks.workunit.client.1.smithi175.stdout:0/434: write df/d1a/d3f/f88 [769097,81823] 0 2024-04-20T10:54:58.593 INFO:tasks.workunit.client.1.smithi175.stdout:0/435: creat df/d17/d2f/f8b x:0 0 0 2024-04-20T10:54:58.594 INFO:tasks.workunit.client.1.smithi175.stdout:0/436: getdents df/d1a/d22/d6a 0 2024-04-20T10:54:58.595 INFO:tasks.workunit.client.1.smithi175.stdout:4/422: write d4/dd/d2d/d43/f87 [3584919,101047] 0 2024-04-20T10:54:58.596 INFO:tasks.workunit.client.1.smithi175.stdout:8/392: dwrite d7/d13/d1d/d24/d63/f69 [0,4194304] 0 2024-04-20T10:54:58.596 INFO:tasks.workunit.client.1.smithi175.stdout:5/440: write db/d1f/f29 [2105838,119952] 0 2024-04-20T10:54:58.596 INFO:tasks.workunit.client.1.smithi175.stdout:0/437: unlink df/d19/c78 0 2024-04-20T10:54:58.598 INFO:tasks.workunit.client.1.smithi175.stdout:8/393: readlink d7/d55/l31 0 2024-04-20T10:54:58.600 INFO:tasks.workunit.client.1.smithi175.stdout:0/438: rename df/d2e/l67 to df/d1a/l8c 0 2024-04-20T10:54:58.600 INFO:tasks.workunit.client.1.smithi175.stdout:0/439: readlink df/d1a/l4c 0 2024-04-20T10:54:58.601 INFO:tasks.workunit.client.1.smithi175.stdout:0/440: readlink df/d1a/d22/l6e 0 2024-04-20T10:54:58.602 INFO:tasks.workunit.client.1.smithi175.stdout:0/441: read - df/d1a/d3f/d5e/f7b zero size 2024-04-20T10:54:58.612 INFO:tasks.workunit.client.1.smithi175.stdout:0/442: dread df/d17/d2f/d4f/f6c [0,4194304] 0 2024-04-20T10:54:58.612 INFO:tasks.workunit.client.1.smithi175.stdout:0/443: readlink df/l32 0 2024-04-20T10:54:58.613 INFO:tasks.workunit.client.1.smithi175.stdout:4/423: write d4/d27/f8 [3478944,98181] 0 2024-04-20T10:54:58.627 INFO:tasks.workunit.client.1.smithi175.stdout:5/441: dwrite db/d1f/d31/f3a [0,4194304] 0 2024-04-20T10:54:58.628 INFO:tasks.workunit.client.1.smithi175.stdout:8/394: dwrite d7/d13/d1d/f1e [4194304,4194304] 0 2024-04-20T10:54:58.631 INFO:tasks.workunit.client.1.smithi175.stdout:5/442: creat db/d11/d6d/f8b x:0 0 0 2024-04-20T10:54:58.632 INFO:tasks.workunit.client.1.smithi175.stdout:5/443: rename db/d11/f2c to db/d11/d25/d38/d40/d66/f8c 0 2024-04-20T10:54:58.633 INFO:tasks.workunit.client.1.smithi175.stdout:5/444: getdents db/d11/d25/d41 0 2024-04-20T10:54:58.636 INFO:tasks.workunit.client.1.smithi175.stdout:5/445: link db/d11/l12 db/d30/d46/d88/l8d 0 2024-04-20T10:54:58.638 INFO:tasks.workunit.client.1.smithi175.stdout:8/395: dread d7/d13/f40 [0,4194304] 0 2024-04-20T10:54:58.644 INFO:tasks.workunit.client.1.smithi175.stdout:4/424: dwrite d4/f38 [0,4194304] 0 2024-04-20T10:54:58.646 INFO:tasks.workunit.client.1.smithi175.stdout:8/396: mkdir d7/d13/d1d/d24/d38/d73 0 2024-04-20T10:54:58.650 INFO:tasks.workunit.client.1.smithi175.stdout:4/425: read d4/d27/f2c [2455126,88037] 0 2024-04-20T10:54:58.655 INFO:tasks.workunit.client.1.smithi175.stdout:8/397: mknod d7/d13/d1d/d24/d26/c74 0 2024-04-20T10:54:58.655 INFO:tasks.workunit.client.1.smithi175.stdout:4/426: symlink d4/d27/d8c/l98 0 2024-04-20T10:54:58.667 INFO:tasks.workunit.client.1.smithi175.stdout:5/446: dwrite db/d11/d1a/f72 [0,4194304] 0 2024-04-20T10:54:58.673 INFO:tasks.workunit.client.1.smithi175.stdout:8/398: write d7/d13/d1d/d24/f5d [823473,9119] 0 2024-04-20T10:54:58.675 INFO:tasks.workunit.client.1.smithi175.stdout:5/447: creat db/d11/d1a/f8e x:0 0 0 2024-04-20T10:54:58.675 INFO:tasks.workunit.client.1.smithi175.stdout:5/448: write db/d11/d25/d38/d40/d66/f86 [765408,27153] 0 2024-04-20T10:54:58.675 INFO:tasks.workunit.client.1.smithi175.stdout:5/449: chown db/d11/d1a/l68 16681982 1 2024-04-20T10:54:58.680 INFO:tasks.workunit.client.1.smithi175.stdout:8/399: rename d7/d13/f3a to d7/d13/f75 0 2024-04-20T10:54:58.681 INFO:tasks.workunit.client.1.smithi175.stdout:4/427: dwrite d4/d27/d25/f86 [0,4194304] 0 2024-04-20T10:54:58.681 INFO:tasks.workunit.client.1.smithi175.stdout:4/428: fsync d4/d23/f95 0 2024-04-20T10:54:58.688 INFO:tasks.workunit.client.1.smithi175.stdout:5/450: read db/d11/d1a/f72 [199065,21886] 0 2024-04-20T10:54:58.688 INFO:tasks.workunit.client.1.smithi175.stdout:5/451: dread - db/d11/d25/d62/f7c zero size 2024-04-20T10:54:58.691 INFO:tasks.workunit.client.1.smithi175.stdout:5/452: dread db/d1f/d31/d35/f44 [0,4194304] 0 2024-04-20T10:54:58.692 INFO:tasks.workunit.client.1.smithi175.stdout:4/429: mknod d4/d27/c99 0 2024-04-20T10:54:58.693 INFO:tasks.workunit.client.1.smithi175.stdout:4/430: fsync d4/d27/d61/f49 0 2024-04-20T10:54:58.693 INFO:tasks.workunit.client.1.smithi175.stdout:5/453: symlink db/d11/d25/d38/d40/d66/l8f 0 2024-04-20T10:54:58.695 INFO:tasks.workunit.client.1.smithi175.stdout:5/454: creat db/d11/d25/d41/f90 x:0 0 0 2024-04-20T10:54:58.696 INFO:tasks.workunit.client.1.smithi175.stdout:5/455: mkdir db/d30/d46/d4b/d4f/d75/d91 0 2024-04-20T10:54:58.697 INFO:tasks.workunit.client.1.smithi175.stdout:4/431: link d4/f1a d4/dd/d54/f9a 0 2024-04-20T10:54:58.698 INFO:tasks.workunit.client.1.smithi175.stdout:5/456: rmdir db/d11/d25/d41 39 2024-04-20T10:54:58.698 INFO:tasks.workunit.client.1.smithi175.stdout:4/432: write d4/dd/d54/d5d/f8e [907796,27234] 0 2024-04-20T10:54:58.700 INFO:tasks.workunit.client.1.smithi175.stdout:4/433: getdents d4/d27/d61 0 2024-04-20T10:54:58.700 INFO:tasks.workunit.client.1.smithi175.stdout:8/400: dwrite d7/d13/d1d/f1e [4194304,4194304] 0 2024-04-20T10:54:58.701 INFO:tasks.workunit.client.1.smithi175.stdout:5/457: mknod db/d11/d25/d38/d40/d47/c92 0 2024-04-20T10:54:58.702 INFO:tasks.workunit.client.1.smithi175.stdout:8/401: read - d7/d55/f4d zero size 2024-04-20T10:54:58.704 INFO:tasks.workunit.client.1.smithi175.stdout:5/458: mkdir db/d1f/d31/d93 0 2024-04-20T10:54:58.704 INFO:tasks.workunit.client.1.smithi175.stdout:5/459: fdatasync db/d11/f2d 0 2024-04-20T10:54:58.705 INFO:tasks.workunit.client.1.smithi175.stdout:8/402: symlink d7/d13/d1d/d24/d26/l76 0 2024-04-20T10:54:58.723 INFO:tasks.workunit.client.1.smithi175.stdout:8/403: dwrite d7/d13/d1d/f1e [0,4194304] 0 2024-04-20T10:54:58.726 INFO:tasks.workunit.client.1.smithi175.stdout:4/434: dwrite d4/dd/d2d/d43/d69/f75 [0,4194304] 0 2024-04-20T10:54:58.727 INFO:tasks.workunit.client.1.smithi175.stdout:8/404: creat d7/d13/d1d/d24/d38/f77 x:0 0 0 2024-04-20T10:54:58.728 INFO:tasks.workunit.client.1.smithi175.stdout:5/460: dread db/d11/d1a/f39 [0,4194304] 0 2024-04-20T10:54:58.729 INFO:tasks.workunit.client.1.smithi175.stdout:4/435: rmdir d4/dd/d73 0 2024-04-20T10:54:58.729 INFO:tasks.workunit.client.1.smithi175.stdout:8/405: symlink d7/d13/l78 0 2024-04-20T10:54:58.730 INFO:tasks.workunit.client.1.smithi175.stdout:5/461: dread - db/d11/d1a/f76 zero size 2024-04-20T10:54:58.731 INFO:tasks.workunit.client.1.smithi175.stdout:4/436: truncate d4/dd/d54/d5d/f8e 1293388 0 2024-04-20T10:54:58.732 INFO:tasks.workunit.client.1.smithi175.stdout:8/406: creat d7/d55/d6c/f79 x:0 0 0 2024-04-20T10:54:58.733 INFO:tasks.workunit.client.1.smithi175.stdout:8/407: creat d7/d13/d1d/d24/d39/f7a x:0 0 0 2024-04-20T10:54:58.733 INFO:tasks.workunit.client.1.smithi175.stdout:4/437: chown d4/dd/d2d/d33/d3c/c57 45327703 1 2024-04-20T10:54:58.741 INFO:tasks.workunit.client.1.smithi175.stdout:4/438: write d4/d27/f1c [611489,3942] 0 2024-04-20T10:54:58.742 INFO:tasks.workunit.client.1.smithi175.stdout:8/408: rename d7/d55/f4d to d7/d13/d1d/d24/d26/f7b 0 2024-04-20T10:54:58.743 INFO:tasks.workunit.client.1.smithi175.stdout:8/409: fsync d7/f1b 0 2024-04-20T10:54:58.743 INFO:tasks.workunit.client.1.smithi175.stdout:4/439: mknod d4/dd/d2d/d33/d58/c9b 0 2024-04-20T10:54:58.744 INFO:tasks.workunit.client.1.smithi175.stdout:8/410: creat d7/d13/d1d/d24/d38/f7c x:0 0 0 2024-04-20T10:54:58.746 INFO:tasks.workunit.client.1.smithi175.stdout:4/440: creat d4/dd/d54/d5d/d8a/f9c x:0 0 0 2024-04-20T10:54:58.748 INFO:tasks.workunit.client.1.smithi175.stdout:5/462: dwrite db/d11/f2d [0,4194304] 0 2024-04-20T10:54:58.751 INFO:tasks.workunit.client.1.smithi175.stdout:5/463: dread db/d1f/f29 [0,4194304] 0 2024-04-20T10:54:58.755 INFO:tasks.workunit.client.1.smithi175.stdout:4/441: mkdir d4/dd/d54/d5d/d79/d9d 0 2024-04-20T10:54:58.760 INFO:tasks.workunit.client.1.smithi175.stdout:4/442: write d4/d27/d61/f7a [897660,27724] 0 2024-04-20T10:54:58.762 INFO:tasks.workunit.client.1.smithi175.stdout:5/464: unlink db/d1f/d31/d35/l45 0 2024-04-20T10:54:58.764 INFO:tasks.workunit.client.1.smithi175.stdout:4/443: rename d4/d27/d25 to d4/dd/d54/d5d/d9e 0 2024-04-20T10:54:58.765 INFO:tasks.workunit.client.1.smithi175.stdout:5/465: mkdir db/d11/d25/d38/d40/d66/d94 0 2024-04-20T10:54:58.768 INFO:tasks.workunit.client.1.smithi175.stdout:5/466: rename db/d30/d46/d4b/d4f/f52 to db/d1f/f95 0 2024-04-20T10:54:58.768 INFO:tasks.workunit.client.1.smithi175.stdout:5/467: dread - db/f84 zero size 2024-04-20T10:54:58.769 INFO:tasks.workunit.client.1.smithi175.stdout:5/468: dread - db/d30/d46/d4b/d4f/f78 zero size 2024-04-20T10:54:58.771 INFO:tasks.workunit.client.1.smithi175.stdout:4/444: link d4/d23/d2e/f82 d4/dd/d2d/d33/d58/f9f 0 2024-04-20T10:54:58.772 INFO:tasks.workunit.client.1.smithi175.stdout:5/469: creat db/d11/d25/d38/f96 x:0 0 0 2024-04-20T10:54:58.774 INFO:tasks.workunit.client.1.smithi175.stdout:8/411: dwrite d7/d13/d1d/d24/d38/f64 [0,4194304] 0 2024-04-20T10:54:58.775 INFO:tasks.workunit.client.1.smithi175.stdout:5/470: read db/d1f/f20 [1866166,13336] 0 2024-04-20T10:54:58.779 INFO:tasks.workunit.client.1.smithi175.stdout:5/471: dread db/d11/d1a/f39 [0,4194304] 0 2024-04-20T10:54:58.781 INFO:tasks.workunit.client.1.smithi175.stdout:8/412: link d7/d13/d1d/d56/f71 d7/d13/d1d/d24/d39/f7d 0 2024-04-20T10:54:58.782 INFO:tasks.workunit.client.1.smithi175.stdout:5/472: creat db/d30/d46/d4b/d4f/d75/f97 x:0 0 0 2024-04-20T10:54:58.782 INFO:tasks.workunit.client.1.smithi175.stdout:5/473: readlink db/d11/d25/d41/l58 0 2024-04-20T10:54:58.785 INFO:tasks.workunit.client.1.smithi175.stdout:4/445: write d4/dd/d54/f5a [1405035,31128] 0 2024-04-20T10:54:58.785 INFO:tasks.workunit.client.1.smithi175.stdout:4/446: write d4/dd/d54/f5a [1156060,3699] 0 2024-04-20T10:54:58.786 INFO:tasks.workunit.client.1.smithi175.stdout:4/447: dread d4/dd/d2d/f4c [0,4194304] 0 2024-04-20T10:54:58.787 INFO:tasks.workunit.client.1.smithi175.stdout:5/474: creat db/d11/d25/d41/f98 x:0 0 0 2024-04-20T10:54:58.792 INFO:tasks.workunit.client.1.smithi175.stdout:8/413: write d7/d13/d1d/d24/d39/f3b [5351901,120037] 0 2024-04-20T10:54:58.795 INFO:tasks.workunit.client.1.smithi175.stdout:8/414: creat d7/d13/d1d/d24/d38/f7e x:0 0 0 2024-04-20T10:54:58.796 INFO:tasks.workunit.client.1.smithi175.stdout:4/448: creat d4/dd/d54/d5d/d9e/fa0 x:0 0 0 2024-04-20T10:54:58.797 INFO:tasks.workunit.client.1.smithi175.stdout:8/415: fdatasync d7/d13/d1d/d24/d39/d6f/f61 0 2024-04-20T10:54:58.803 INFO:tasks.workunit.client.1.smithi175.stdout:8/416: dread d7/d13/f40 [0,4194304] 0 2024-04-20T10:54:58.803 INFO:tasks.workunit.client.1.smithi175.stdout:4/449: chown d4/d23/d2e/f63 77658978 1 2024-04-20T10:54:58.803 INFO:tasks.workunit.client.1.smithi175.stdout:4/450: chown d4/d27/c99 1016 1 2024-04-20T10:54:58.811 INFO:tasks.workunit.client.1.smithi175.stdout:5/475: dwrite db/d1f/f27 [0,4194304] 0 2024-04-20T10:54:58.812 INFO:tasks.workunit.client.1.smithi175.stdout:4/451: truncate d4/dd/d2d/d33/d58/f59 34291 0 2024-04-20T10:54:58.812 INFO:tasks.workunit.client.1.smithi175.stdout:4/452: chown d4/dd/d54/d5d 104 1 2024-04-20T10:54:58.814 INFO:tasks.workunit.client.1.smithi175.stdout:8/417: write d7/d13/f32 [731496,100520] 0 2024-04-20T10:54:58.815 INFO:tasks.workunit.client.1.smithi175.stdout:4/453: chown d4/d27/fa 395511138 1 2024-04-20T10:54:58.818 INFO:tasks.workunit.client.1.smithi175.stdout:5/476: dread db/d11/d1a/f72 [0,4194304] 0 2024-04-20T10:54:58.937 INFO:tasks.workunit.client.0.smithi090.stdout:8/999: dwrite d0/d26/da7/df5/ff0 [4194304,4194304] 0 2024-04-20T10:54:58.939 INFO:tasks.workunit.client.0.smithi090.stdout:7/939: link d11/d13/d22/fe2 d11/dd2/d11a/dc7/f126 0 2024-04-20T10:54:59.068 INFO:tasks.workunit.client.1.smithi175.stdout:8/418: creat d7/d13/d1d/d24/d63/f7f x:0 0 0 2024-04-20T10:54:59.069 INFO:tasks.workunit.client.1.smithi175.stdout:8/419: write d7/d13/d1d/d24/d63/f7f [448716,15214] 0 2024-04-20T10:54:59.069 INFO:tasks.workunit.client.1.smithi175.stdout:5/477: truncate db/d11/d1a/f28 1534840 0 2024-04-20T10:54:59.069 INFO:tasks.workunit.client.1.smithi175.stdout:5/478: fdatasync db/d11/d25/d38/d40/d66/f8c 0 2024-04-20T10:54:59.070 INFO:tasks.workunit.client.0.smithi090.stdout:7/940: truncate d11/d13/d5b/db8/dbf/df1/fe1 98095 0 2024-04-20T10:54:59.071 INFO:tasks.workunit.client.1.smithi175.stdout:1/368: sync 2024-04-20T10:54:59.071 INFO:tasks.workunit.client.1.smithi175.stdout:3/306: sync 2024-04-20T10:54:59.071 INFO:tasks.workunit.client.1.smithi175.stdout:9/400: sync 2024-04-20T10:54:59.074 INFO:tasks.workunit.client.1.smithi175.stdout:2/320: sync 2024-04-20T10:54:59.074 INFO:tasks.workunit.client.1.smithi175.stdout:6/461: sync 2024-04-20T10:54:59.074 INFO:tasks.workunit.client.1.smithi175.stdout:7/549: sync 2024-04-20T10:54:59.074 INFO:tasks.workunit.client.1.smithi175.stdout:0/444: sync 2024-04-20T10:54:59.075 INFO:tasks.workunit.client.1.smithi175.stdout:3/307: mknod d7/d21/d16/d22/d2c/d64/c65 0 2024-04-20T10:54:59.075 INFO:tasks.workunit.client.1.smithi175.stdout:3/308: fsync d7/d19/d33/f3b 0 2024-04-20T10:54:59.077 INFO:tasks.workunit.client.1.smithi175.stdout:6/462: chown d1/d5/d12/c59 0 1 2024-04-20T10:54:59.078 INFO:tasks.workunit.client.1.smithi175.stdout:2/321: chown d1/d48/d38/f58 2 1 2024-04-20T10:54:59.080 INFO:tasks.workunit.client.1.smithi175.stdout:3/309: creat d7/d21/d16/d22/f66 x:0 0 0 2024-04-20T10:54:59.081 INFO:tasks.workunit.client.1.smithi175.stdout:4/454: mkdir d4/dd/d5e/d74/da1 0 2024-04-20T10:54:59.081 INFO:tasks.workunit.client.1.smithi175.stdout:4/455: write d4/dd/d54/d5d/d9e/fa0 [543344,21255] 0 2024-04-20T10:54:59.082 INFO:tasks.workunit.client.1.smithi175.stdout:0/445: unlink df/l16 0 2024-04-20T10:54:59.084 INFO:tasks.workunit.client.1.smithi175.stdout:2/322: creat d1/d6a/f6e x:0 0 0 2024-04-20T10:54:59.085 INFO:tasks.workunit.client.1.smithi175.stdout:7/550: mkdir db/d1d/d29/d8f/dcc 0 2024-04-20T10:54:59.085 INFO:tasks.workunit.client.1.smithi175.stdout:1/369: write d0/f1e [2195673,110026] 0 2024-04-20T10:54:59.086 INFO:tasks.workunit.client.1.smithi175.stdout:3/310: fsync d7/f12 0 2024-04-20T10:54:59.088 INFO:tasks.workunit.client.1.smithi175.stdout:0/446: creat df/d17/f8d x:0 0 0 2024-04-20T10:54:59.088 INFO:tasks.workunit.client.1.smithi175.stdout:0/447: chown df/d17/f2a 2462 1 2024-04-20T10:54:59.088 INFO:tasks.workunit.client.1.smithi175.stdout:6/463: symlink d1/d37/d83/la7 0 2024-04-20T10:54:59.090 INFO:tasks.workunit.client.1.smithi175.stdout:3/311: unlink d7/f15 0 2024-04-20T10:54:59.091 INFO:tasks.workunit.client.1.smithi175.stdout:4/456: symlink d4/dd/d54/d5d/d79/la2 0 2024-04-20T10:54:59.091 INFO:tasks.workunit.client.1.smithi175.stdout:4/457: chown d4/dd/d2d/d33/d3c 1516 1 2024-04-20T10:54:59.092 INFO:tasks.workunit.client.1.smithi175.stdout:0/448: mknod df/d17/d2f/c8e 0 2024-04-20T10:54:59.094 INFO:tasks.workunit.client.1.smithi175.stdout:2/323: rename d1/d7/d1f/f3d to d1/d7/f6f 0 2024-04-20T10:54:59.094 INFO:tasks.workunit.client.1.smithi175.stdout:3/312: read - d7/d21/d16/d22/d2c/d1f/d48/f53 zero size 2024-04-20T10:54:59.095 INFO:tasks.workunit.client.1.smithi175.stdout:5/479: dwrite db/d11/d25/d41/d60/f6c [0,4194304] 0 2024-04-20T10:54:59.096 INFO:tasks.workunit.client.0.smithi090.stdout:7/941: dwrite d11/d13/f8c [0,4194304] 0 2024-04-20T10:54:59.098 INFO:tasks.workunit.client.1.smithi175.stdout:7/551: rename db/d1d/d29/d2a/d41/d59/c6e to db/d61/d6d/ccd 0 2024-04-20T10:54:59.099 INFO:tasks.workunit.client.0.smithi090.stdout:7/942: rmdir d11/d13/d22/df3/db7 0 2024-04-20T10:54:59.099 INFO:tasks.workunit.client.1.smithi175.stdout:3/313: mkdir d7/d21/d67 0 2024-04-20T10:54:59.101 INFO:tasks.workunit.client.0.smithi090.stdout:7/943: rename d11/d1a/d3b/ddf/fef to d11/d13/d5d/f127 0 2024-04-20T10:54:59.101 INFO:tasks.workunit.client.0.smithi090.stdout:7/944: mknod d11/d1a/d3b/c128 0 2024-04-20T10:54:59.102 INFO:tasks.workunit.client.0.smithi090.stdout:7/945: mkdir d11/d1a/d3b/d107/d129 0 2024-04-20T10:54:59.106 INFO:tasks.workunit.client.1.smithi175.stdout:2/324: link d1/d48/f3b d1/d48/d21/d29/f70 0 2024-04-20T10:54:59.106 INFO:tasks.workunit.client.1.smithi175.stdout:1/370: rename d0/d8/d13/f81 to d0/d51/f83 0 2024-04-20T10:54:59.106 INFO:tasks.workunit.client.1.smithi175.stdout:1/371: dread - d0/d8/d13/d2e/d35/f63 zero size 2024-04-20T10:54:59.106 INFO:tasks.workunit.client.1.smithi175.stdout:1/372: chown d0/d8/f18 80804857 1 2024-04-20T10:54:59.106 INFO:tasks.workunit.client.1.smithi175.stdout:2/325: creat d1/d7/d63/f71 x:0 0 0 2024-04-20T10:54:59.107 INFO:tasks.workunit.client.1.smithi175.stdout:1/373: symlink d0/d8/d13/d79/l84 0 2024-04-20T10:54:59.108 INFO:tasks.workunit.client.1.smithi175.stdout:0/449: read df/d19/f31 [2613430,56034] 0 2024-04-20T10:54:59.109 INFO:tasks.workunit.client.1.smithi175.stdout:1/374: link d0/d57/f74 d0/d3e/d61/f85 0 2024-04-20T10:54:59.109 INFO:tasks.workunit.client.1.smithi175.stdout:6/464: dwrite d1/d40/d49/f62 [0,4194304] 0 2024-04-20T10:54:59.110 INFO:tasks.workunit.client.1.smithi175.stdout:6/465: fdatasync d1/d40/d46/d60/d6b/f72 0 2024-04-20T10:54:59.110 INFO:tasks.workunit.client.1.smithi175.stdout:9/401: dwrite d6/d1b/f57 [0,4194304] 0 2024-04-20T10:54:59.111 INFO:tasks.workunit.client.1.smithi175.stdout:4/458: rename d4/dd/d54/d5d/d79/f8b to d4/dd/d54/d5d/fa3 0 2024-04-20T10:54:59.113 INFO:tasks.workunit.client.1.smithi175.stdout:0/450: dread df/d1a/d22/d6a/d72/d48/f49 [0,4194304] 0 2024-04-20T10:54:59.113 INFO:tasks.workunit.client.1.smithi175.stdout:1/375: mknod d0/d8/d13/d7b/c86 0 2024-04-20T10:54:59.114 INFO:tasks.workunit.client.1.smithi175.stdout:1/376: chown d0/d8/d13/d2e/d35/c7d 718 1 2024-04-20T10:54:59.117 INFO:tasks.workunit.client.1.smithi175.stdout:9/402: creat d6/d1b/d2f/f70 x:0 0 0 2024-04-20T10:54:59.117 INFO:tasks.workunit.client.1.smithi175.stdout:7/552: write db/d1d/d39/d50/f52 [1629786,112404] 0 2024-04-20T10:54:59.118 INFO:tasks.workunit.client.1.smithi175.stdout:0/451: dread f1 [4194304,4194304] 0 2024-04-20T10:54:59.118 INFO:tasks.workunit.client.1.smithi175.stdout:0/452: fsync df/f3a 0 2024-04-20T10:54:59.118 INFO:tasks.workunit.client.1.smithi175.stdout:1/377: mknod d0/d8/d13/d2e/d35/c87 0 2024-04-20T10:54:59.118 INFO:tasks.workunit.client.1.smithi175.stdout:5/480: dwrite db/d11/d1a/f39 [0,4194304] 0 2024-04-20T10:54:59.119 INFO:tasks.workunit.client.1.smithi175.stdout:2/326: rename d1/d48/f1b to d1/d7/f72 0 2024-04-20T10:54:59.120 INFO:tasks.workunit.client.1.smithi175.stdout:4/459: mkdir d4/dd/d54/d5d/d8a/da4 0 2024-04-20T10:54:59.120 INFO:tasks.workunit.client.1.smithi175.stdout:4/460: write d4/dd/d54/d5d/d8a/f9c [354523,92421] 0 2024-04-20T10:54:59.122 INFO:tasks.workunit.client.1.smithi175.stdout:5/481: creat db/d30/f99 x:0 0 0 2024-04-20T10:54:59.126 INFO:tasks.workunit.client.1.smithi175.stdout:7/553: mknod db/d1d/d39/d50/dba/cce 0 2024-04-20T10:54:59.128 INFO:tasks.workunit.client.1.smithi175.stdout:4/461: stat d4/dd/d2d/d33/d5b/d65 0 2024-04-20T10:54:59.130 INFO:tasks.workunit.client.1.smithi175.stdout:1/378: dread d0/d8/f45 [0,4194304] 0 2024-04-20T10:54:59.131 INFO:tasks.workunit.client.1.smithi175.stdout:5/482: rename db/c85 to db/d30/d46/d4b/d4f/d5a/c9a 0 2024-04-20T10:54:59.132 INFO:tasks.workunit.client.1.smithi175.stdout:1/379: mknod d0/d8/d13/d7b/c88 0 2024-04-20T10:54:59.134 INFO:tasks.workunit.client.1.smithi175.stdout:5/483: symlink db/d11/d25/d38/d40/d66/d94/l9b 0 2024-04-20T10:54:59.134 INFO:tasks.workunit.client.1.smithi175.stdout:4/462: dread f1 [0,4194304] 0 2024-04-20T10:54:59.135 INFO:tasks.workunit.client.1.smithi175.stdout:1/380: mknod d0/d3e/d61/c89 0 2024-04-20T10:54:59.136 INFO:tasks.workunit.client.1.smithi175.stdout:5/484: rmdir db/d30/d46/d4b/d4f 39 2024-04-20T10:54:59.136 INFO:tasks.workunit.client.1.smithi175.stdout:5/485: chown db/d11/f43 1007 1 2024-04-20T10:54:59.138 INFO:tasks.workunit.client.1.smithi175.stdout:5/486: creat db/d11/d25/f9c x:0 0 0 2024-04-20T10:54:59.138 INFO:tasks.workunit.client.1.smithi175.stdout:4/463: mkdir d4/d23/d2e/da5 0 2024-04-20T10:54:59.139 INFO:tasks.workunit.client.1.smithi175.stdout:1/381: truncate d0/f10 506774 0 2024-04-20T10:54:59.142 INFO:tasks.workunit.client.1.smithi175.stdout:5/487: rename db/d1f/d31/d35 to db/d9d 0 2024-04-20T10:54:59.142 INFO:tasks.workunit.client.1.smithi175.stdout:5/488: chown db/d11/d25/d41/c65 65623 1 2024-04-20T10:54:59.148 INFO:tasks.workunit.client.1.smithi175.stdout:7/554: dwrite db/d1d/d39/f3f [0,4194304] 0 2024-04-20T10:54:59.149 INFO:tasks.workunit.client.1.smithi175.stdout:4/464: dread d4/dd/d5e/f6b [0,4194304] 0 2024-04-20T10:54:59.149 INFO:tasks.workunit.client.1.smithi175.stdout:1/382: dread d0/f23 [0,4194304] 0 2024-04-20T10:54:59.152 INFO:tasks.workunit.client.1.smithi175.stdout:1/383: mkdir d0/d8/d13/d2e/d35/d8a 0 2024-04-20T10:54:59.153 INFO:tasks.workunit.client.1.smithi175.stdout:6/466: write d1/d40/d46/f4f [345919,72054] 0 2024-04-20T10:54:59.154 INFO:tasks.workunit.client.1.smithi175.stdout:5/489: dread db/d30/d46/d4b/f4d [0,4194304] 0 2024-04-20T10:54:59.157 INFO:tasks.workunit.client.1.smithi175.stdout:2/327: write d1/d48/d21/d29/f50 [336554,52333] 0 2024-04-20T10:54:59.158 INFO:tasks.workunit.client.1.smithi175.stdout:5/490: truncate db/d1f/d31/f33 3835257 0 2024-04-20T10:54:59.160 INFO:tasks.workunit.client.1.smithi175.stdout:6/467: dread d1/d5/f6 [0,4194304] 0 2024-04-20T10:54:59.160 INFO:tasks.workunit.client.1.smithi175.stdout:1/384: link d0/d29/c62 d0/d8/d13/c8b 0 2024-04-20T10:54:59.160 INFO:tasks.workunit.client.1.smithi175.stdout:1/385: chown d0/d29/f5c 1 1 2024-04-20T10:54:59.160 INFO:tasks.workunit.client.1.smithi175.stdout:2/328: rmdir d1/d7 39 2024-04-20T10:54:59.161 INFO:tasks.workunit.client.1.smithi175.stdout:5/491: creat db/d11/d25/d38/f9e x:0 0 0 2024-04-20T10:54:59.161 INFO:tasks.workunit.client.1.smithi175.stdout:5/492: readlink db/d30/d46/d88/l8d 0 2024-04-20T10:54:59.161 INFO:tasks.workunit.client.1.smithi175.stdout:6/468: readlink d1/l15 0 2024-04-20T10:54:59.162 INFO:tasks.workunit.client.1.smithi175.stdout:1/386: mkdir d0/d8/d13/d79/d8c 0 2024-04-20T10:54:59.163 INFO:tasks.workunit.client.1.smithi175.stdout:5/493: symlink db/d11/d25/d38/d40/d66/d94/l9f 0 2024-04-20T10:54:59.164 INFO:tasks.workunit.client.1.smithi175.stdout:1/387: creat d0/d8/d13/d79/d8c/f8d x:0 0 0 2024-04-20T10:54:59.165 INFO:tasks.workunit.client.1.smithi175.stdout:6/469: unlink d1/d5/f52 0 2024-04-20T10:54:59.166 INFO:tasks.workunit.client.1.smithi175.stdout:1/388: stat d0/d8/cb 0 2024-04-20T10:54:59.166 INFO:tasks.workunit.client.1.smithi175.stdout:2/329: read d1/d48/d21/d29/f39 [956986,48741] 0 2024-04-20T10:54:59.166 INFO:tasks.workunit.client.1.smithi175.stdout:5/494: mkdir db/d1f/d31/da0 0 2024-04-20T10:54:59.168 INFO:tasks.workunit.client.1.smithi175.stdout:4/465: dwrite d4/d27/d61/f49 [0,4194304] 0 2024-04-20T10:54:59.168 INFO:tasks.workunit.client.1.smithi175.stdout:6/470: getdents d1/d5/d12 0 2024-04-20T10:54:59.168 INFO:tasks.workunit.client.1.smithi175.stdout:6/471: chown d1/d5/d12/la2 260 1 2024-04-20T10:54:59.169 INFO:tasks.workunit.client.1.smithi175.stdout:6/472: chown d1/d40/d46/d60/d6b 904596705 1 2024-04-20T10:54:59.169 INFO:tasks.workunit.client.1.smithi175.stdout:6/473: fdatasync d1/d40/d46/d60/f86 0 2024-04-20T10:54:59.169 INFO:tasks.workunit.client.1.smithi175.stdout:1/389: stat d0/d8/d13/d2e/f5b 0 2024-04-20T10:54:59.178 INFO:tasks.workunit.client.1.smithi175.stdout:7/555: write db/d1d/d39/d50/dba/f88 [196093,90043] 0 2024-04-20T10:54:59.179 INFO:tasks.workunit.client.1.smithi175.stdout:4/466: link d4/c3e d4/dd/d54/d5f/ca6 0 2024-04-20T10:54:59.180 INFO:tasks.workunit.client.1.smithi175.stdout:4/467: rmdir d4/dd 39 2024-04-20T10:54:59.181 INFO:tasks.workunit.client.1.smithi175.stdout:1/390: dread d0/d8/d13/d2e/d35/f4b [0,4194304] 0 2024-04-20T10:54:59.186 INFO:tasks.workunit.client.1.smithi175.stdout:1/391: rename d0/d8/f12 to d0/f8e 0 2024-04-20T10:54:59.186 INFO:tasks.workunit.client.1.smithi175.stdout:1/392: write d0/d51/f82 [917334,69754] 0 2024-04-20T10:54:59.186 INFO:tasks.workunit.client.1.smithi175.stdout:5/495: dwrite db/d11/d25/d38/d40/d66/f86 [0,4194304] 0 2024-04-20T10:54:59.187 INFO:tasks.workunit.client.1.smithi175.stdout:1/393: readlink d0/d8/l19 0 2024-04-20T10:54:59.192 INFO:tasks.workunit.client.1.smithi175.stdout:1/394: symlink d0/d8/d13/d2e/d35/l8f 0 2024-04-20T10:54:59.193 INFO:tasks.workunit.client.1.smithi175.stdout:5/496: mkdir db/d11/d6d/da1 0 2024-04-20T10:54:59.194 INFO:tasks.workunit.client.1.smithi175.stdout:5/497: getdents db/d11/d6d/da1 0 2024-04-20T10:54:59.194 INFO:tasks.workunit.client.1.smithi175.stdout:1/395: chown d0/d3e/f41 992092 1 2024-04-20T10:54:59.197 INFO:tasks.workunit.client.1.smithi175.stdout:7/556: write db/d1d/d29/d2a/d41/d59/fa0 [966590,104357] 0 2024-04-20T10:54:59.197 INFO:tasks.workunit.client.1.smithi175.stdout:4/468: write d4/d27/f15 [4893445,34708] 0 2024-04-20T10:54:59.200 INFO:tasks.workunit.client.1.smithi175.stdout:5/498: rename db/d11/d1a/f39 to db/d11/d25/fa2 0 2024-04-20T10:54:59.200 INFO:tasks.workunit.client.1.smithi175.stdout:7/557: chown db/d1d/d39/d50/dba/f19 282 1 2024-04-20T10:54:59.202 INFO:tasks.workunit.client.1.smithi175.stdout:1/396: rename d0/d51/f82 to d0/d51/f90 0 2024-04-20T10:54:59.204 INFO:tasks.workunit.client.1.smithi175.stdout:5/499: creat db/d11/d25/d38/d40/d66/fa3 x:0 0 0 2024-04-20T10:54:59.204 INFO:tasks.workunit.client.1.smithi175.stdout:5/500: chown db/d1f/f20 44480 1 2024-04-20T10:54:59.206 INFO:tasks.workunit.client.1.smithi175.stdout:1/397: mkdir d0/d8/d13/d2e/d35/d8a/d91 0 2024-04-20T10:54:59.207 INFO:tasks.workunit.client.1.smithi175.stdout:4/469: getdents d4/dd/d2d/d33/d3c 0 2024-04-20T10:54:59.211 INFO:tasks.workunit.client.1.smithi175.stdout:5/501: rename db/d11/d1a/f72 to db/d1f/d31/fa4 0 2024-04-20T10:54:59.214 INFO:tasks.workunit.client.1.smithi175.stdout:6/474: dwrite d1/d40/d63/f77 [0,4194304] 0 2024-04-20T10:54:59.216 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:54:59.217 INFO:tasks.workunit.client.1.smithi175.stdout:2/330: dwrite d1/d53/f54 [0,4194304] 0 2024-04-20T10:54:59.225 INFO:tasks.workunit.client.1.smithi175.stdout:7/558: dwrite db/d1d/d39/d50/dba/d47/f9b [4194304,4194304] 0 2024-04-20T10:54:59.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/475: mkdir d1/d40/d46/d60/d6b/da8 0 2024-04-20T10:54:59.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/476: chown d1/d40/f99 15575489 1 2024-04-20T10:54:59.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/477: fsync d1/d40/d49/fa6 0 2024-04-20T10:54:59.233 INFO:tasks.workunit.client.1.smithi175.stdout:5/502: dwrite db/d11/d25/d41/f90 [0,4194304] 0 2024-04-20T10:54:59.234 INFO:tasks.workunit.client.1.smithi175.stdout:7/559: dread - db/d1d/d60/d76/db6/fc9 zero size 2024-04-20T10:54:59.234 INFO:tasks.workunit.client.1.smithi175.stdout:7/560: fdatasync db/d61/d6d/f90 0 2024-04-20T10:54:59.236 INFO:tasks.workunit.client.1.smithi175.stdout:5/503: chown db/c2f 151818 1 2024-04-20T10:54:59.236 INFO:tasks.workunit.client.1.smithi175.stdout:5/504: readlink db/d11/d25/d38/d40/d66/l8f 0 2024-04-20T10:54:59.237 INFO:tasks.workunit.client.1.smithi175.stdout:7/561: truncate db/d1d/d29/f9e 1422815 0 2024-04-20T10:54:59.237 INFO:tasks.workunit.client.1.smithi175.stdout:7/562: chown db/d1d/d29/d2a/d41/d59/c78 3 1 2024-04-20T10:54:59.237 INFO:tasks.workunit.client.1.smithi175.stdout:5/505: chown db/d1f/d31/f4c 40372312 1 2024-04-20T10:54:59.238 INFO:tasks.workunit.client.1.smithi175.stdout:1/398: write d0/f2a [1384705,129782] 0 2024-04-20T10:54:59.238 INFO:tasks.workunit.client.1.smithi175.stdout:7/563: readlink db/d1d/d39/d50/dba/l62 0 2024-04-20T10:54:59.239 INFO:tasks.workunit.client.1.smithi175.stdout:6/478: dread d1/d5/d12/f47 [0,4194304] 0 2024-04-20T10:54:59.239 INFO:tasks.workunit.client.1.smithi175.stdout:7/564: chown db/d1d/d29/f96 368370 1 2024-04-20T10:54:59.239 INFO:tasks.workunit.client.1.smithi175.stdout:7/565: truncate db/d1d/d29/d2a/fa8 2309525 0 2024-04-20T10:54:59.240 INFO:tasks.workunit.client.1.smithi175.stdout:5/506: mknod db/d30/d46/d4b/d4f/d75/ca5 0 2024-04-20T10:54:59.240 INFO:tasks.workunit.client.1.smithi175.stdout:5/507: chown db/d1f/d31 0 1 2024-04-20T10:54:59.240 INFO:tasks.workunit.client.1.smithi175.stdout:2/331: creat d1/d53/f73 x:0 0 0 2024-04-20T10:54:59.241 INFO:tasks.workunit.client.1.smithi175.stdout:1/399: mknod d0/d8/d13/d2e/c92 0 2024-04-20T10:54:59.243 INFO:tasks.workunit.client.1.smithi175.stdout:5/508: symlink db/d11/d6d/da1/la6 0 2024-04-20T10:54:59.243 INFO:tasks.workunit.client.1.smithi175.stdout:4/470: dwrite d4/d27/f7b [0,4194304] 0 2024-04-20T10:54:59.243 INFO:tasks.workunit.client.1.smithi175.stdout:2/332: stat d1/d7/d63/f3e 0 2024-04-20T10:54:59.244 INFO:tasks.workunit.client.1.smithi175.stdout:2/333: readlink d1/d7/d1f/l5f 0 2024-04-20T10:54:59.244 INFO:tasks.workunit.client.1.smithi175.stdout:1/400: creat d0/f93 x:0 0 0 2024-04-20T10:54:59.244 INFO:tasks.workunit.client.1.smithi175.stdout:2/334: write d1/d48/d21/d29/f50 [66431,104307] 0 2024-04-20T10:54:59.246 INFO:tasks.workunit.client.1.smithi175.stdout:7/566: dread db/d1d/d29/d2a/f87 [0,4194304] 0 2024-04-20T10:54:59.268 INFO:tasks.workunit.client.1.smithi175.stdout:4/471: truncate d4/dd/d54/f4a 5237107 0 2024-04-20T10:54:59.269 INFO:tasks.workunit.client.1.smithi175.stdout:6/479: rename d1/d5/c74 to d1/d5/d12/d7f/ca9 0 2024-04-20T10:54:59.270 INFO:tasks.workunit.client.1.smithi175.stdout:1/401: stat d0/l7 0 2024-04-20T10:54:59.271 INFO:tasks.workunit.client.1.smithi175.stdout:5/509: mknod db/d11/d25/d38/ca7 0 2024-04-20T10:54:59.274 INFO:tasks.workunit.client.1.smithi175.stdout:4/472: dread - d4/dd/d5e/d74/f8d zero size 2024-04-20T10:54:59.275 INFO:tasks.workunit.client.1.smithi175.stdout:6/480: fdatasync d1/d40/d46/d60/f91 0 2024-04-20T10:54:59.276 INFO:tasks.workunit.client.1.smithi175.stdout:2/335: dread d1/d48/f3b [0,4194304] 0 2024-04-20T10:54:59.276 INFO:tasks.workunit.client.1.smithi175.stdout:2/336: fdatasync d1/d7/f34 0 2024-04-20T10:54:59.276 INFO:tasks.workunit.client.1.smithi175.stdout:5/510: chown db/d1f/d31/f77 148448328 1 2024-04-20T10:54:59.276 INFO:tasks.workunit.client.1.smithi175.stdout:5/511: truncate db/d1f/f29 5075566 0 2024-04-20T10:54:59.278 INFO:tasks.workunit.client.1.smithi175.stdout:4/473: rename d4/d27/d61/d88 to d4/dd/d54/d5d/d8a/da4/da7 0 2024-04-20T10:54:59.279 INFO:tasks.workunit.client.1.smithi175.stdout:6/481: fdatasync d1/d5/f45 0 2024-04-20T10:54:59.281 INFO:tasks.workunit.client.1.smithi175.stdout:2/337: mkdir d1/d6a/d74 0 2024-04-20T10:54:59.282 INFO:tasks.workunit.client.1.smithi175.stdout:5/512: chown db/d11/d25/d38/c70 7146 1 2024-04-20T10:54:59.283 INFO:tasks.workunit.client.1.smithi175.stdout:7/567: link db/d1d/d39/d50/dba/d47/d6a/f72 db/d1d/d39/d50/fcf 0 2024-04-20T10:54:59.283 INFO:tasks.workunit.client.1.smithi175.stdout:7/568: dread - db/d1d/d39/fa4 zero size 2024-04-20T10:54:59.285 INFO:tasks.workunit.client.1.smithi175.stdout:6/482: chown d1/d5/f10 162 1 2024-04-20T10:54:59.285 INFO:tasks.workunit.client.1.smithi175.stdout:6/483: read - d1/d40/d29/f9f zero size 2024-04-20T10:54:59.287 INFO:tasks.workunit.client.1.smithi175.stdout:7/569: unlink db/d1d/d29/d2a/c4f 0 2024-04-20T10:54:59.287 INFO:tasks.workunit.client.1.smithi175.stdout:7/570: stat db/d1d/d29/d9a/cb5 0 2024-04-20T10:54:59.287 INFO:tasks.workunit.client.1.smithi175.stdout:7/571: chown db/d1d/d29/f6f 0 1 2024-04-20T10:54:59.288 INFO:tasks.workunit.client.1.smithi175.stdout:6/484: creat d1/faa x:0 0 0 2024-04-20T10:54:59.289 INFO:tasks.workunit.client.1.smithi175.stdout:2/338: symlink d1/d48/l75 0 2024-04-20T10:54:59.289 INFO:tasks.workunit.client.1.smithi175.stdout:2/339: read - d1/f6d zero size 2024-04-20T10:54:59.289 INFO:tasks.workunit.client.1.smithi175.stdout:2/340: chown d1/d7/f34 1 1 2024-04-20T10:54:59.289 INFO:tasks.workunit.client.1.smithi175.stdout:7/572: symlink db/d1d/d39/d50/dba/d47/da6/db9/ld0 0 2024-04-20T10:54:59.291 INFO:tasks.workunit.client.1.smithi175.stdout:7/573: creat db/d1d/d29/d2a/d41/d59/fd1 x:0 0 0 2024-04-20T10:54:59.291 INFO:tasks.workunit.client.1.smithi175.stdout:7/574: fsync db/d1d/d29/d8e/f4d 0 2024-04-20T10:54:59.292 INFO:tasks.workunit.client.1.smithi175.stdout:6/485: fdatasync d1/d40/d46/d60/d68/d7e/f81 0 2024-04-20T10:54:59.292 INFO:tasks.workunit.client.1.smithi175.stdout:6/486: truncate d1/d40/d46/d60/f91 473977 0 2024-04-20T10:54:59.294 INFO:tasks.workunit.client.1.smithi175.stdout:2/341: rename d1/d7/d1f to d1/d48/d21/d76 0 2024-04-20T10:54:59.294 INFO:tasks.workunit.client.1.smithi175.stdout:2/342: dread - d1/d48/d21/d29/f6c zero size 2024-04-20T10:54:59.298 INFO:tasks.workunit.client.1.smithi175.stdout:5/513: dwrite db/d11/d25/d62/f87 [0,4194304] 0 2024-04-20T10:54:59.299 INFO:tasks.workunit.client.1.smithi175.stdout:4/474: write d4/dd/d2d/d33/d3c/d44/f48 [530171,45656] 0 2024-04-20T10:54:59.300 INFO:tasks.workunit.client.1.smithi175.stdout:6/487: fdatasync d1/f16 0 2024-04-20T10:54:59.300 INFO:tasks.workunit.client.1.smithi175.stdout:6/488: readlink d1/d40/d46/d60/d68/d7e/l97 0 2024-04-20T10:54:59.314 INFO:tasks.workunit.client.1.smithi175.stdout:1/402: dwrite d0/d3e/f41 [0,4194304] 0 2024-04-20T10:54:59.315 INFO:tasks.workunit.client.0.smithi090.stdout:7/946: sync 2024-04-20T10:54:59.316 INFO:tasks.workunit.client.0.smithi090.stdout:7/947: creat d11/dd2/d11a/f12a x:0 0 0 2024-04-20T10:54:59.317 INFO:tasks.workunit.client.1.smithi175.stdout:2/343: dwrite d1/d48/d21/d29/f6c [0,4194304] 0 2024-04-20T10:54:59.318 INFO:tasks.workunit.client.1.smithi175.stdout:1/403: link d0/c68 d0/d8/d13/d2e/d35/d8a/d91/c94 0 2024-04-20T10:54:59.318 INFO:tasks.workunit.client.1.smithi175.stdout:6/489: truncate d1/d5/d12/f35 5076755 0 2024-04-20T10:54:59.318 INFO:tasks.workunit.client.1.smithi175.stdout:6/490: truncate d1/d40/d49/f62 4224764 0 2024-04-20T10:54:59.319 INFO:tasks.workunit.client.1.smithi175.stdout:2/344: creat d1/d7/d63/d4b/f77 x:0 0 0 2024-04-20T10:54:59.326 INFO:tasks.workunit.client.1.smithi175.stdout:5/514: dwrite db/d30/f99 [0,4194304] 0 2024-04-20T10:54:59.327 INFO:tasks.workunit.client.1.smithi175.stdout:4/475: write d4/dd/d2d/d33/d58/f9f [4407397,37413] 0 2024-04-20T10:54:59.328 INFO:tasks.workunit.client.0.smithi090.stdout:7/948: dwrite d11/d1a/d3b/dc8/f120 [0,4194304] 0 2024-04-20T10:54:59.330 INFO:tasks.workunit.client.1.smithi175.stdout:6/491: mknod d1/d40/d46/d60/cab 0 2024-04-20T10:54:59.332 INFO:tasks.workunit.client.1.smithi175.stdout:8/420: sync 2024-04-20T10:54:59.332 INFO:tasks.workunit.client.1.smithi175.stdout:8/421: write d7/d13/d1d/d24/d39/f7d [957326,108991] 0 2024-04-20T10:54:59.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.333+0000 7f8713ae4640 1 Processor -- start 2024-04-20T10:54:59.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.333+0000 7f8713ae4640 1 -- start start 2024-04-20T10:54:59.334 INFO:tasks.workunit.client.0.smithi090.stdout:7/949: getdents d11/dd2/d11a 0 2024-04-20T10:54:59.334 INFO:tasks.workunit.client.1.smithi175.stdout:1/404: dread d0/d8/d13/d2e/f44 [0,4194304] 0 2024-04-20T10:54:59.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8713ae4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f870c072850 0x7f870c0c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:59.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8713ae4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f870c0bfb30 0x7f870c150600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:59.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8713ae4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f870c0bf2f0 con 0x7f870c072470 2024-04-20T10:54:59.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8713ae4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f870c1545f0 con 0x7f870c0bfb30 2024-04-20T10:54:59.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8713ae4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f870c0bed30 con 0x7f870c072850 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8712081640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f870c0bfb30 0x7f870c150600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f871107f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f870c072850 0x7f870c0c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8712081640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f870c0bfb30 0x7f870c150600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58838/0 (socket says 172.21.15.90:58838) 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.334+0000 7f8712081640 1 -- 172.21.15.90:0/3284447839 learned_addr learned my addr 172.21.15.90:0/3284447839 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.335+0000 7f8712081640 1 -- 172.21.15.90:0/3284447839 >> v2:172.21.15.175:3300/0 conn(0x7f870c072850 msgr2=0x7f870c0c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.335+0000 7f8712081640 1 --2- 172.21.15.90:0/3284447839 >> v2:172.21.15.175:3300/0 conn(0x7f870c072850 0x7f870c0c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.335+0000 7f8712081640 1 -- 172.21.15.90:0/3284447839 >> v1:172.21.15.175:6789/0 conn(0x7f870c072470 legacy=0x7f870c153ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.335+0000 7f8712081640 1 -- 172.21.15.90:0/3284447839 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c0bf010 con 0x7f870c0bfb30 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.335+0000 7f871087e640 1 -- 172.21.15.90:0/3284447839 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410428931 0 0) 0x7f870c0bf2f0 con 0x7f870c072470 2024-04-20T10:54:59.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.335+0000 7f871107f640 1 --2- 172.21.15.90:0/3284447839 >> v2:172.21.15.175:3300/0 conn(0x7f870c072850 0x7f870c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:54:59.337 INFO:tasks.workunit.client.0.smithi090.stdout:7/950: creat d11/d1a/d3b/d107/d129/f12b x:0 0 0 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.336+0000 7f8712081640 1 --2- 172.21.15.90:0/3284447839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c0bfb30 0x7f870c150600 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f870c0c6bc0 tx=0x7f870402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde4110358a5299b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.336+0000 7f871087e640 1 -- 172.21.15.90:0/3284447839 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870402ca80 con 0x7f870c0bfb30 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.336+0000 7f871087e640 1 -- 172.21.15.90:0/3284447839 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f870402cc20 con 0x7f870c0bfb30 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.336+0000 7f871087e640 1 -- 172.21.15.90:0/3284447839 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87040343f0 con 0x7f870c0bfb30 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.337+0000 7f8713ae4640 1 -- 172.21.15.90:0/3284447839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c0bfb30 msgr2=0x7f870c150600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.337+0000 7f8713ae4640 1 --2- 172.21.15.90:0/3284447839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c0bfb30 0x7f870c150600 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f870c0c6bc0 tx=0x7f870402bee0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.337+0000 7f8713ae4640 1 -- 172.21.15.90:0/3284447839 shutdown_connections 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.337+0000 7f8713ae4640 1 --2- 172.21.15.90:0/3284447839 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c0bfb30 0x7f870c150600 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.337+0000 7f8713ae4640 1 --2- 172.21.15.90:0/3284447839 >> v2:172.21.15.175:3300/0 conn(0x7f870c072850 0x7f870c0c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.337+0000 7f8713ae4640 1 -- 172.21.15.90:0/3284447839 >> 172.21.15.90:0/3284447839 conn(0x7f870c0c91e0 msgr2=0x7f870c0c95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:59.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.338+0000 7f8713ae4640 1 -- 172.21.15.90:0/3284447839 shutdown_connections 2024-04-20T10:54:59.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.338+0000 7f8713ae4640 1 -- 172.21.15.90:0/3284447839 wait complete. 2024-04-20T10:54:59.339 INFO:tasks.workunit.client.1.smithi175.stdout:2/345: mknod d1/d7/d63/d36/c78 0 2024-04-20T10:54:59.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.339+0000 7f8713ae4640 1 Processor -- start 2024-04-20T10:54:59.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.339+0000 7f8713ae4640 1 -- start start 2024-04-20T10:54:59.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.340+0000 7f8713ae4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f870c072470 0x7f870c0ac210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.340+0000 7f8713ae4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c072850 0x7f870c1443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.340+0000 7f8713ae4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f870c0bfb30 0x7f870c06e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.340+0000 7f8713ae4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f870c071f20 con 0x7f870c072850 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.340+0000 7f8713ae4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f870c1539c0 con 0x7f870c0bfb30 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.340+0000 7f8713ae4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f870c0bffe0 con 0x7f870c072470 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f871107f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c072850 0x7f870c1443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f8712081640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f870c0bfb30 0x7f870c06e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f8711880640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f870c072470 0x7f870c0ac210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f871107f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c072850 0x7f870c1443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58842/0 (socket says 172.21.15.90:58842) 2024-04-20T10:54:59.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f871107f640 1 -- 172.21.15.90:0/662964876 learned_addr learned my addr 172.21.15.90:0/662964876 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f8711880640 1 -- 172.21.15.90:0/662964876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f870c0bfb30 msgr2=0x7f870c06e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f8711880640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f870c0bfb30 0x7f870c06e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f8711880640 1 -- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c072850 msgr2=0x7f870c1443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f8711880640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c072850 0x7f870c1443a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.341+0000 7f8711880640 1 -- 172.21.15.90:0/662964876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f870c1e8bc0 con 0x7f870c072470 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.342+0000 7f8711880640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f870c072470 0x7f870c0ac210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f870800c430 tx=0x7f870800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.342+0000 7f87027fc640 1 -- 172.21.15.90:0/662964876 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8708017070 con 0x7f870c072470 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.342+0000 7f87027fc640 1 -- 172.21.15.90:0/662964876 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87080035f0 con 0x7f870c072470 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.342+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f870c1e8ea0 con 0x7f870c072470 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.342+0000 7f87027fc640 1 -- 172.21.15.90:0/662964876 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87080039e0 con 0x7f870c072470 2024-04-20T10:54:59.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.342+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f870c0c8600 con 0x7f870c072470 2024-04-20T10:54:59.344 INFO:tasks.workunit.client.1.smithi175.stdout:7/575: dwrite db/d1d/d29/f6f [0,4194304] 0 2024-04-20T10:54:59.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.344+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870c076150 con 0x7f870c072470 2024-04-20T10:54:59.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.345+0000 7f87027fc640 1 -- 172.21.15.90:0/662964876 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f870801a070 con 0x7f870c072470 2024-04-20T10:54:59.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.345+0000 7f87027fc640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f86f006c920 0x7f86f006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:54:59.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.346+0000 7f87027fc640 1 -- 172.21.15.90:0/662964876 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f870808b290 con 0x7f870c072470 2024-04-20T10:54:59.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.346+0000 7f871107f640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f86f006c920 0x7f86f006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:54:59.346 INFO:tasks.workunit.client.1.smithi175.stdout:5/515: symlink db/la8 0 2024-04-20T10:54:59.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.346+0000 7f871107f640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f86f006c920 0x7f86f006ede0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00b800 tx=0x7f86fc00b3a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:54:59.349 INFO:tasks.workunit.client.1.smithi175.stdout:1/405: truncate d0/d8/d13/d2e/d35/f42 561071 0 2024-04-20T10:54:59.352 INFO:tasks.workunit.client.1.smithi175.stdout:5/516: fsync db/d1f/f18 0 2024-04-20T10:54:59.352 INFO:tasks.workunit.client.1.smithi175.stdout:5/517: dread - db/d11/d25/d62/f7c zero size 2024-04-20T10:54:59.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.352+0000 7f87027fc640 1 -- 172.21.15.90:0/662964876 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8708058c90 con 0x7f870c072470 2024-04-20T10:54:59.353 INFO:tasks.workunit.client.1.smithi175.stdout:6/492: dread d1/d40/d63/f77 [0,4194304] 0 2024-04-20T10:54:59.359 INFO:tasks.workunit.client.1.smithi175.stdout:2/346: dwrite d1/d48/d21/d29/f50 [0,4194304] 0 2024-04-20T10:54:59.361 INFO:tasks.workunit.client.1.smithi175.stdout:5/518: creat db/d11/d25/d38/d40/d47/fa9 x:0 0 0 2024-04-20T10:54:59.362 INFO:tasks.workunit.client.1.smithi175.stdout:6/493: creat d1/d40/d46/d60/fac x:0 0 0 2024-04-20T10:54:59.364 INFO:tasks.workunit.client.1.smithi175.stdout:1/406: dread d0/d8/f30 [0,4194304] 0 2024-04-20T10:54:59.364 INFO:tasks.workunit.client.1.smithi175.stdout:1/407: chown d0/f23 211530 1 2024-04-20T10:54:59.364 INFO:tasks.workunit.client.0.smithi090.stdout:7/951: dwrite d11/d13/d5b/db8/dbf/da9/fbc [0,4194304] 0 2024-04-20T10:54:59.365 INFO:tasks.workunit.client.1.smithi175.stdout:2/347: creat d1/d7/d63/f79 x:0 0 0 2024-04-20T10:54:59.365 INFO:tasks.workunit.client.1.smithi175.stdout:2/348: chown d1/d48/d21 13 1 2024-04-20T10:54:59.366 INFO:tasks.workunit.client.1.smithi175.stdout:5/519: dread db/d9d/f44 [0,4194304] 0 2024-04-20T10:54:59.366 INFO:tasks.workunit.client.1.smithi175.stdout:5/520: chown db/d9d 20200 1 2024-04-20T10:54:59.368 INFO:tasks.workunit.client.1.smithi175.stdout:4/476: creat d4/dd/d2d/d43/d69/fa8 x:0 0 0 2024-04-20T10:54:59.369 INFO:tasks.workunit.client.1.smithi175.stdout:1/408: creat d0/d8/d13/d2e/d35/d8a/d91/f95 x:0 0 0 2024-04-20T10:54:59.370 INFO:tasks.workunit.client.1.smithi175.stdout:2/349: getdents d1/d48/d21 0 2024-04-20T10:54:59.371 INFO:tasks.workunit.client.1.smithi175.stdout:6/494: symlink d1/d5/d12/d22/lad 0 2024-04-20T10:54:59.373 INFO:tasks.workunit.client.1.smithi175.stdout:4/477: creat d4/dd/d2d/d33/d3c/fa9 x:0 0 0 2024-04-20T10:54:59.374 INFO:tasks.workunit.client.1.smithi175.stdout:5/521: write db/d11/d25/d38/d40/d66/f86 [135544,97008] 0 2024-04-20T10:54:59.374 INFO:tasks.workunit.client.1.smithi175.stdout:2/350: chown d1/l51 17109181 1 2024-04-20T10:54:59.377 INFO:tasks.workunit.client.1.smithi175.stdout:1/409: symlink d0/l96 0 2024-04-20T10:54:59.377 INFO:tasks.workunit.client.1.smithi175.stdout:1/410: chown d0/d29/f5c 5 1 2024-04-20T10:54:59.378 INFO:tasks.workunit.client.1.smithi175.stdout:2/351: symlink d1/d6a/d74/l7a 0 2024-04-20T10:54:59.387 INFO:tasks.workunit.client.1.smithi175.stdout:4/478: mkdir d4/dd/d2d/d43/d69/daa 0 2024-04-20T10:54:59.388 INFO:tasks.workunit.client.1.smithi175.stdout:5/522: truncate f2 1024027 0 2024-04-20T10:54:59.388 INFO:tasks.workunit.client.1.smithi175.stdout:5/523: stat db/d11/f7f 0 2024-04-20T10:54:59.389 INFO:tasks.workunit.client.1.smithi175.stdout:2/352: rmdir d1/d7/d63/d64 0 2024-04-20T10:54:59.390 INFO:tasks.workunit.client.1.smithi175.stdout:5/524: creat db/d11/d25/faa x:0 0 0 2024-04-20T10:54:59.398 INFO:tasks.workunit.client.1.smithi175.stdout:5/525: write db/d1f/d31/f33 [964300,100148] 0 2024-04-20T10:54:59.399 INFO:tasks.workunit.client.1.smithi175.stdout:4/479: mknod d4/d23/d2e/da5/cab 0 2024-04-20T10:54:59.400 INFO:tasks.workunit.client.1.smithi175.stdout:1/411: rename d0/f54 to d0/d8/d13/d2e/f97 0 2024-04-20T10:54:59.407 INFO:tasks.workunit.client.1.smithi175.stdout:4/480: dread d4/d27/f17 [4194304,4194304] 0 2024-04-20T10:54:59.408 INFO:tasks.workunit.client.1.smithi175.stdout:1/412: mknod d0/d3e/d61/c98 0 2024-04-20T10:54:59.419 INFO:tasks.workunit.client.1.smithi175.stdout:6/495: write d1/d40/f5e [1460727,27832] 0 2024-04-20T10:54:59.420 INFO:tasks.workunit.client.1.smithi175.stdout:1/413: readlink d0/d8/l2c 0 2024-04-20T10:54:59.422 INFO:tasks.workunit.client.1.smithi175.stdout:8/422: dwrite d7/f18 [0,4194304] 0 2024-04-20T10:54:59.423 INFO:tasks.workunit.client.1.smithi175.stdout:4/481: symlink d4/dd/d5e/lac 0 2024-04-20T10:54:59.424 INFO:tasks.workunit.client.1.smithi175.stdout:6/496: dread d1/fb [0,4194304] 0 2024-04-20T10:54:59.428 INFO:tasks.workunit.client.1.smithi175.stdout:1/414: dread d0/d8/f5e [0,4194304] 0 2024-04-20T10:54:59.428 INFO:tasks.workunit.client.1.smithi175.stdout:1/415: readlink d0/d8/l2c 0 2024-04-20T10:54:59.429 INFO:tasks.workunit.client.1.smithi175.stdout:5/526: truncate f2 1358885 0 2024-04-20T10:54:59.430 INFO:tasks.workunit.client.1.smithi175.stdout:6/497: dread - d1/d40/d46/d60/d6b/f9d zero size 2024-04-20T10:54:59.431 INFO:tasks.workunit.client.1.smithi175.stdout:8/423: mkdir d7/d13/d1d/d24/d38/d80 0 2024-04-20T10:54:59.433 INFO:tasks.workunit.client.1.smithi175.stdout:4/482: write d4/d23/d2e/f82 [2136063,73512] 0 2024-04-20T10:54:59.434 INFO:tasks.workunit.client.1.smithi175.stdout:5/527: link db/d30/d46/f7e db/d30/d46/fab 0 2024-04-20T10:54:59.437 INFO:tasks.workunit.client.1.smithi175.stdout:5/528: creat db/d30/d46/d4b/d4f/fac x:0 0 0 2024-04-20T10:54:59.438 INFO:tasks.workunit.client.1.smithi175.stdout:6/498: mkdir d1/d5/d12/d7f/dae 0 2024-04-20T10:54:59.438 INFO:tasks.workunit.client.1.smithi175.stdout:1/416: dread d0/d29/f32 [0,4194304] 0 2024-04-20T10:54:59.439 INFO:tasks.workunit.client.1.smithi175.stdout:8/424: rename d7/d13/d1d/d24/c54 to d7/d13/d1d/d56/c81 0 2024-04-20T10:54:59.440 INFO:tasks.workunit.client.1.smithi175.stdout:5/529: creat db/d11/d25/d38/d40/fad x:0 0 0 2024-04-20T10:54:59.441 INFO:tasks.workunit.client.1.smithi175.stdout:1/417: chown d0/d8/d13/l55 59278061 1 2024-04-20T10:54:59.441 INFO:tasks.workunit.client.1.smithi175.stdout:1/418: chown d0/d8/l19 155751209 1 2024-04-20T10:54:59.442 INFO:tasks.workunit.client.1.smithi175.stdout:4/483: dread d4/d27/f7b [0,4194304] 0 2024-04-20T10:54:59.442 INFO:tasks.workunit.client.1.smithi175.stdout:2/353: write d1/d48/f3b [1525129,58918] 0 2024-04-20T10:54:59.442 INFO:tasks.workunit.client.1.smithi175.stdout:5/530: mknod db/d11/d25/d41/d83/cae 0 2024-04-20T10:54:59.443 INFO:tasks.workunit.client.1.smithi175.stdout:6/499: mknod d1/caf 0 2024-04-20T10:54:59.444 INFO:tasks.workunit.client.1.smithi175.stdout:2/354: stat d1/d48/d38/l59 0 2024-04-20T10:54:59.446 INFO:tasks.workunit.client.1.smithi175.stdout:4/484: symlink d4/dd/d5e/d74/lad 0 2024-04-20T10:54:59.446 INFO:tasks.workunit.client.1.smithi175.stdout:2/355: getdents d1/d6a/d74 0 2024-04-20T10:54:59.446 INFO:tasks.workunit.client.1.smithi175.stdout:5/531: getdents db/d11/d25/d38/d40/d66/d94 0 2024-04-20T10:54:59.448 INFO:tasks.workunit.client.1.smithi175.stdout:2/356: chown d1/d7/d63/f26 13608 1 2024-04-20T10:54:59.448 INFO:tasks.workunit.client.1.smithi175.stdout:2/357: fsync d1/d7/ff 0 2024-04-20T10:54:59.449 INFO:tasks.workunit.client.1.smithi175.stdout:5/532: mknod db/d30/d46/d4b/d4f/d75/d91/caf 0 2024-04-20T10:54:59.455 INFO:tasks.workunit.client.1.smithi175.stdout:2/358: creat d1/d7/d63/f7b x:0 0 0 2024-04-20T10:54:59.456 INFO:tasks.workunit.client.1.smithi175.stdout:5/533: creat db/d1f/d31/fb0 x:0 0 0 2024-04-20T10:54:59.456 INFO:tasks.workunit.client.1.smithi175.stdout:5/534: fsync db/d1f/d31/f77 0 2024-04-20T10:54:59.457 INFO:tasks.workunit.client.1.smithi175.stdout:5/535: dread db/d11/d25/d38/d40/d66/f8c [0,4194304] 0 2024-04-20T10:54:59.462 INFO:tasks.workunit.client.0.smithi090.stdout:7/952: truncate d11/d13/d22/d24/fc1 2041531 0 2024-04-20T10:54:59.462 INFO:tasks.workunit.client.1.smithi175.stdout:2/359: creat d1/d53/f7c x:0 0 0 2024-04-20T10:54:59.472 INFO:tasks.workunit.client.1.smithi175.stdout:2/360: dread d1/d48/d21/d76/f2c [0,4194304] 0 2024-04-20T10:54:59.472 INFO:tasks.workunit.client.1.smithi175.stdout:2/361: chown d1/d7/l15 120124444 1 2024-04-20T10:54:59.474 INFO:tasks.workunit.client.1.smithi175.stdout:5/536: dwrite db/d30/d46/d4b/d4f/d75/f97 [0,4194304] 0 2024-04-20T10:54:59.474 INFO:tasks.workunit.client.1.smithi175.stdout:5/537: readlink db/d30/l7a 0 2024-04-20T10:54:59.474 INFO:tasks.workunit.client.1.smithi175.stdout:5/538: fsync db/d11/d25/f9c 0 2024-04-20T10:54:59.474 INFO:tasks.workunit.client.1.smithi175.stdout:2/362: fdatasync d1/d48/d21/d29/f24 0 2024-04-20T10:54:59.477 INFO:tasks.workunit.client.1.smithi175.stdout:5/539: creat db/d30/d46/d4b/d4f/d5a/fb1 x:0 0 0 2024-04-20T10:54:59.478 INFO:tasks.workunit.client.1.smithi175.stdout:5/540: stat db/d30/l59 0 2024-04-20T10:54:59.479 INFO:tasks.workunit.client.1.smithi175.stdout:2/363: mkdir d1/d7/d63/d36/d7d 0 2024-04-20T10:54:59.531 INFO:tasks.workunit.client.1.smithi175.stdout:5/541: dwrite db/d11/d25/d38/d40/d47/fa9 [0,4194304] 0 2024-04-20T10:54:59.532 INFO:tasks.workunit.client.1.smithi175.stdout:5/542: truncate db/d30/d46/d4b/d4f/d75/f97 5131909 0 2024-04-20T10:54:59.534 INFO:tasks.workunit.client.1.smithi175.stdout:5/543: mkdir db/d30/d46/d88/db2 0 2024-04-20T10:54:59.541 INFO:tasks.workunit.client.1.smithi175.stdout:3/314: sync 2024-04-20T10:54:59.542 INFO:tasks.workunit.client.1.smithi175.stdout:9/403: sync 2024-04-20T10:54:59.543 INFO:tasks.workunit.client.1.smithi175.stdout:5/544: creat db/d11/d6d/fb3 x:0 0 0 2024-04-20T10:54:59.546 INFO:tasks.workunit.client.1.smithi175.stdout:5/545: link db/d11/d25/d38/d40/d66/fa3 db/d30/d46/d4b/d4f/d75/d91/fb4 0 2024-04-20T10:54:59.546 INFO:tasks.workunit.client.1.smithi175.stdout:5/546: dread - db/d11/d1a/f8e zero size 2024-04-20T10:54:59.548 INFO:tasks.workunit.client.1.smithi175.stdout:9/404: truncate d6/d1b/d2f/f4f 7108579 0 2024-04-20T10:54:59.550 INFO:tasks.workunit.client.1.smithi175.stdout:1/419: write d0/d8/d13/f60 [526523,16964] 0 2024-04-20T10:54:59.550 INFO:tasks.workunit.client.1.smithi175.stdout:5/547: mknod db/d1f/d31/cb5 0 2024-04-20T10:54:59.551 INFO:tasks.workunit.client.1.smithi175.stdout:6/500: symlink d1/d37/lb0 0 2024-04-20T10:54:59.557 INFO:tasks.workunit.client.1.smithi175.stdout:3/315: mknod d7/d19/d2a/c68 0 2024-04-20T10:54:59.559 INFO:tasks.workunit.client.1.smithi175.stdout:9/405: rename d6/d10/f32 to d6/d33/d63/f71 0 2024-04-20T10:54:59.560 INFO:tasks.workunit.client.1.smithi175.stdout:3/316: dread - d7/d21/d16/d22/f52 zero size 2024-04-20T10:54:59.563 INFO:tasks.workunit.client.1.smithi175.stdout:3/317: truncate d7/d19/d33/f3b 1158078 0 2024-04-20T10:54:59.565 INFO:tasks.workunit.client.1.smithi175.stdout:1/420: rename d0/d29/c62 to d0/d3e/c99 0 2024-04-20T10:54:59.565 INFO:tasks.workunit.client.1.smithi175.stdout:1/421: write d0/d8/f45 [5921958,82491] 0 2024-04-20T10:54:59.566 INFO:tasks.workunit.client.1.smithi175.stdout:1/422: rmdir d0/d3e 39 2024-04-20T10:54:59.567 INFO:tasks.workunit.client.1.smithi175.stdout:9/406: mkdir d6/d1b/d42/d5b/d72 0 2024-04-20T10:54:59.567 INFO:tasks.workunit.client.1.smithi175.stdout:9/407: chown d6/d1b/d2f 7 1 2024-04-20T10:54:59.567 INFO:tasks.workunit.client.1.smithi175.stdout:3/318: symlink d7/d19/d33/d60/d50/l69 0 2024-04-20T10:54:59.568 INFO:tasks.workunit.client.1.smithi175.stdout:1/423: symlink d0/d8/d13/d79/d8c/l9a 0 2024-04-20T10:54:59.568 INFO:tasks.workunit.client.1.smithi175.stdout:9/408: read - d6/d1b/d42/f44 zero size 2024-04-20T10:54:59.569 INFO:tasks.workunit.client.1.smithi175.stdout:3/319: mknod d7/d21/d16/d22/d2c/d64/c6a 0 2024-04-20T10:54:59.569 INFO:tasks.workunit.client.1.smithi175.stdout:1/424: symlink d0/d57/d7a/l9b 0 2024-04-20T10:54:59.570 INFO:tasks.workunit.client.1.smithi175.stdout:9/409: truncate d6/d33/d63/f71 61754 0 2024-04-20T10:54:59.570 INFO:tasks.workunit.client.1.smithi175.stdout:9/410: stat d6/d33/f5c 0 2024-04-20T10:54:59.570 INFO:tasks.workunit.client.1.smithi175.stdout:9/411: dread - d6/f4a zero size 2024-04-20T10:54:59.572 INFO:tasks.workunit.client.1.smithi175.stdout:1/425: truncate d0/f49 466969 0 2024-04-20T10:54:59.572 INFO:tasks.workunit.client.1.smithi175.stdout:1/426: fsync d0/f10 0 2024-04-20T10:54:59.573 INFO:tasks.workunit.client.1.smithi175.stdout:9/412: creat d6/d33/d63/f73 x:0 0 0 2024-04-20T10:54:59.577 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.577+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f870c071960 con 0x7f870c072470 2024-04-20T10:54:59.579 INFO:tasks.workunit.client.1.smithi175.stdout:5/548: dwrite db/d1f/d31/f3a [4194304,4194304] 0 2024-04-20T10:54:59.580 INFO:tasks.workunit.client.1.smithi175.stdout:9/413: read - d6/d33/d63/f4d zero size 2024-04-20T10:54:59.580 INFO:tasks.workunit.client.1.smithi175.stdout:6/501: dwrite d1/d40/d46/d60/f91 [0,4194304] 0 2024-04-20T10:54:59.581 INFO:tasks.workunit.client.1.smithi175.stdout:5/549: symlink db/d30/d46/d88/lb6 0 2024-04-20T10:54:59.581 INFO:tasks.workunit.client.1.smithi175.stdout:5/550: truncate db/d1f/d31/f77 25103 0 2024-04-20T10:54:59.581 INFO:tasks.workunit.client.1.smithi175.stdout:5/551: chown db/d1f/d31/fa4 7318 1 2024-04-20T10:54:59.581 INFO:tasks.workunit.client.1.smithi175.stdout:9/414: rmdir d6/d33 39 2024-04-20T10:54:59.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.582+0000 7f87027fc640 1 -- 172.21.15.90:0/662964876 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7f870805cf90 con 0x7f870c072470 2024-04-20T10:54:59.582 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:54:59.582 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:54:59.583 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:54:59.584 INFO:tasks.workunit.client.1.smithi175.stdout:1/427: dread d0/d3e/f41 [0,4194304] 0 2024-04-20T10:54:59.584 INFO:tasks.workunit.client.1.smithi175.stdout:1/428: fdatasync d0/d8/f5e 0 2024-04-20T10:54:59.584 INFO:tasks.workunit.client.1.smithi175.stdout:6/502: write d1/d40/d29/f2f [793214,29003] 0 2024-04-20T10:54:59.584 INFO:tasks.workunit.client.1.smithi175.stdout:6/503: getdents d1/d40/d63 0 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f86f006c920 msgr2=0x7f86f006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f86f006c920 0x7f86f006ede0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f86fc00b800 tx=0x7f86fc00b3a0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f870c072470 msgr2=0x7f870c0ac210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f870c072470 0x7f870c0ac210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f870800c430 tx=0x7f870800c8f0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 shutdown_connections 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f86f006c920 0x7f86f006ede0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f870c0bfb30 0x7f870c06e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f870c072850 0x7f870c1443a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 --2- 172.21.15.90:0/662964876 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f870c072470 0x7f870c0ac210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.584+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 >> 172.21.15.90:0/662964876 conn(0x7f870c0c91e0 msgr2=0x7f870c14a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:54:59.585 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.585+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 shutdown_connections 2024-04-20T10:54:59.586 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:54:59.585+0000 7f8713ae4640 1 -- 172.21.15.90:0/662964876 wait complete. 2024-04-20T10:54:59.592 INFO:tasks.workunit.client.1.smithi175.stdout:5/552: mknod db/d11/d1a/cb7 0 2024-04-20T10:54:59.595 INFO:tasks.workunit.client.1.smithi175.stdout:9/415: mknod d6/d1b/d42/c74 0 2024-04-20T10:54:59.595 INFO:tasks.workunit.client.1.smithi175.stdout:9/416: write d6/d33/f5c [666756,92862] 0 2024-04-20T10:54:59.595 INFO:tasks.workunit.client.1.smithi175.stdout:3/320: write d7/d19/d33/d60/f5d [581421,119145] 0 2024-04-20T10:54:59.596 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2024-04-20T10:54:59.596 INFO:tasks.mds_thrash.fs.[b]:waiting for 48 secs before thrashing 2024-04-20T10:54:59.619 INFO:tasks.workunit.client.1.smithi175.stdout:5/553: rmdir db/d30/d46 39 2024-04-20T10:54:59.619 INFO:tasks.workunit.client.1.smithi175.stdout:9/417: truncate d6/d58/f61 1002875 0 2024-04-20T10:54:59.619 INFO:tasks.workunit.client.1.smithi175.stdout:9/418: fdatasync d6/d1b/d26/f2b 0 2024-04-20T10:54:59.619 INFO:tasks.workunit.client.1.smithi175.stdout:0/453: sync 2024-04-20T10:54:59.619 INFO:tasks.workunit.client.1.smithi175.stdout:0/454: chown df/d19 5355725 1 2024-04-20T10:54:59.620 INFO:tasks.workunit.client.1.smithi175.stdout:7/576: sync 2024-04-20T10:54:59.620 INFO:tasks.workunit.client.1.smithi175.stdout:4/485: sync 2024-04-20T10:54:59.620 INFO:tasks.workunit.client.1.smithi175.stdout:2/364: sync 2024-04-20T10:54:59.620 INFO:tasks.workunit.client.1.smithi175.stdout:8/425: sync 2024-04-20T10:54:59.620 INFO:tasks.workunit.client.1.smithi175.stdout:2/365: stat d1/d7 0 2024-04-20T10:54:59.621 INFO:tasks.workunit.client.1.smithi175.stdout:5/554: rename db/d11/d6d/f8b to db/d11/d6d/da1/fb8 0 2024-04-20T10:54:59.621 INFO:tasks.workunit.client.1.smithi175.stdout:5/555: getdents db/d30/d46/d88/db2 0 2024-04-20T10:54:59.622 INFO:tasks.workunit.client.1.smithi175.stdout:8/426: getdents d7/d13/d1d/d24/d38/d73 0 2024-04-20T10:54:59.625 INFO:tasks.workunit.client.1.smithi175.stdout:1/429: write d0/fd [2049168,36666] 0 2024-04-20T10:54:59.625 INFO:tasks.workunit.client.1.smithi175.stdout:1/430: truncate d0/d8/d13/d79/d8c/f8d 1044887 0 2024-04-20T10:54:59.629 INFO:tasks.workunit.client.1.smithi175.stdout:3/321: write d7/d21/d16/d22/d2c/f3c [2526613,97698] 0 2024-04-20T10:54:59.648 INFO:tasks.workunit.client.1.smithi175.stdout:8/427: dwrite d7/d13/f6e [0,4194304] 0 2024-04-20T10:54:59.648 INFO:tasks.workunit.client.1.smithi175.stdout:7/577: dwrite db/d61/d6d/f90 [0,4194304] 0 2024-04-20T10:54:59.727 INFO:tasks.workunit.client.1.smithi175.stdout:0/455: symlink df/d1a/d22/d6a/d72/d48/d4e/l8f 0 2024-04-20T10:54:59.728 INFO:tasks.workunit.client.1.smithi175.stdout:4/486: mknod d4/d27/d8c/cae 0 2024-04-20T10:54:59.730 INFO:tasks.workunit.client.1.smithi175.stdout:5/556: mknod db/d11/d1a/cb9 0 2024-04-20T10:54:59.733 INFO:tasks.workunit.client.1.smithi175.stdout:3/322: creat d7/d19/f6b x:0 0 0 2024-04-20T10:54:59.733 INFO:tasks.workunit.client.1.smithi175.stdout:8/428: truncate d7/d13/d1d/d24/d39/d6f/f61 249703 0 2024-04-20T10:54:59.733 INFO:tasks.workunit.client.1.smithi175.stdout:8/429: write d7/f1b [2034681,120802] 0 2024-04-20T10:54:59.734 INFO:tasks.workunit.client.1.smithi175.stdout:7/578: dread - db/d1d/d39/d50/dba/d47/f79 zero size 2024-04-20T10:54:59.741 INFO:tasks.workunit.client.1.smithi175.stdout:0/456: readlink df/d2e/l45 0 2024-04-20T10:54:59.742 INFO:tasks.workunit.client.1.smithi175.stdout:9/419: rename d6/d1b/d2f/l54 to d6/l75 0 2024-04-20T10:54:59.742 INFO:tasks.workunit.client.1.smithi175.stdout:9/420: stat d6/d1b/d2f/f38 0 2024-04-20T10:54:59.742 INFO:tasks.workunit.client.1.smithi175.stdout:3/323: readlink d7/d21/d16/l32 0 2024-04-20T10:54:59.742 INFO:tasks.workunit.client.1.smithi175.stdout:9/421: write d6/d58/f68 [277812,115001] 0 2024-04-20T10:54:59.745 INFO:tasks.workunit.client.1.smithi175.stdout:8/430: link d7/d13/d1d/d24/d38/f77 d7/d13/d1d/d24/d39/d6f/f82 0 2024-04-20T10:54:59.749 INFO:tasks.workunit.client.1.smithi175.stdout:1/431: rename d0/d8/d13/d75/c76 to d0/d8/d13/d79/c9c 0 2024-04-20T10:54:59.749 INFO:tasks.workunit.client.1.smithi175.stdout:4/487: dread d4/f9 [0,4194304] 0 2024-04-20T10:54:59.750 INFO:tasks.workunit.client.1.smithi175.stdout:0/457: dread - df/d1a/d28/f42 zero size 2024-04-20T10:54:59.750 INFO:tasks.workunit.client.1.smithi175.stdout:0/458: write df/d1a/d22/d6a/d72/d48/d4e/f69 [1216899,43063] 0 2024-04-20T10:54:59.752 INFO:tasks.workunit.client.1.smithi175.stdout:8/431: symlink d7/d13/d1d/d24/d38/d73/l83 0 2024-04-20T10:54:59.752 INFO:tasks.workunit.client.1.smithi175.stdout:8/432: write d7/d13/d1d/d24/d38/f7c [382941,5794] 0 2024-04-20T10:54:59.752 INFO:tasks.workunit.client.1.smithi175.stdout:8/433: fsync d7/d13/f33 0 2024-04-20T10:54:59.754 INFO:tasks.workunit.client.1.smithi175.stdout:3/324: rename d7/d19/d33/d60/f5d to d7/d19/d33/d60/f6c 0 2024-04-20T10:54:59.754 INFO:tasks.workunit.client.1.smithi175.stdout:3/325: chown d7/d21/fb 599526 1 2024-04-20T10:54:59.756 INFO:tasks.workunit.client.1.smithi175.stdout:1/432: link d0/d8/f5e d0/d8/d13/d2e/d35/d8a/f9d 0 2024-04-20T10:54:59.759 INFO:tasks.workunit.client.1.smithi175.stdout:3/326: creat d7/d21/d16/d22/d2c/d1f/d48/f6d x:0 0 0 2024-04-20T10:54:59.760 INFO:tasks.workunit.client.1.smithi175.stdout:3/327: dread - d7/d21/d16/d22/d2c/d1f/d48/f53 zero size 2024-04-20T10:54:59.760 INFO:tasks.workunit.client.1.smithi175.stdout:3/328: write d7/d21/d16/d22/d2c/f3c [4983805,3358] 0 2024-04-20T10:54:59.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/557: dwrite db/d11/d25/d38/d40/d66/f8c [0,4194304] 0 2024-04-20T10:54:59.760 INFO:tasks.workunit.client.1.smithi175.stdout:8/434: dread d7/d13/d1d/d24/d39/f3b [4194304,4194304] 0 2024-04-20T10:54:59.760 INFO:tasks.workunit.client.1.smithi175.stdout:1/433: dread d0/d8/f1f [4194304,4194304] 0 2024-04-20T10:54:59.760 INFO:tasks.workunit.client.1.smithi175.stdout:4/488: symlink d4/dd/d2d/laf 0 2024-04-20T10:54:59.761 INFO:tasks.workunit.client.1.smithi175.stdout:0/459: link df/d17/d2f/c6d df/d1a/d22/d6a/d72/c90 0 2024-04-20T10:54:59.763 INFO:tasks.workunit.client.1.smithi175.stdout:7/579: dwrite db/d1d/d39/d50/fcf [0,4194304] 0 2024-04-20T10:54:59.763 INFO:tasks.workunit.client.1.smithi175.stdout:3/329: dread d7/d19/d33/f3b [0,4194304] 0 2024-04-20T10:54:59.763 INFO:tasks.workunit.client.1.smithi175.stdout:8/435: creat d7/f84 x:0 0 0 2024-04-20T10:54:59.765 INFO:tasks.workunit.client.1.smithi175.stdout:1/434: mkdir d0/d51/d6b/d9e 0 2024-04-20T10:54:59.766 INFO:tasks.workunit.client.1.smithi175.stdout:4/489: mkdir d4/dd/d5e/d74/da1/db0 0 2024-04-20T10:54:59.776 INFO:tasks.workunit.client.1.smithi175.stdout:4/490: truncate d4/dd/d5e/f6b 1722022 0 2024-04-20T10:54:59.776 INFO:tasks.workunit.client.1.smithi175.stdout:4/491: readlink d4/dd/d54/d5f/l94 0 2024-04-20T10:54:59.782 INFO:tasks.workunit.client.1.smithi175.stdout:5/558: truncate db/d11/d25/d38/d40/d66/f8c 2950705 0 2024-04-20T10:54:59.782 INFO:tasks.workunit.client.1.smithi175.stdout:5/559: chown db/d11/d25/d62/f87 14982 1 2024-04-20T10:54:59.782 INFO:tasks.workunit.client.1.smithi175.stdout:7/580: read db/d1d/d29/d2a/f84 [2763114,10603] 0 2024-04-20T10:54:59.782 INFO:tasks.workunit.client.1.smithi175.stdout:4/492: write d4/dd/d54/d5d/d9e/f29 [604124,74832] 0 2024-04-20T10:54:59.787 INFO:tasks.workunit.client.1.smithi175.stdout:8/436: chown d7/d13/d1d/l34 404 1 2024-04-20T10:54:59.788 INFO:tasks.workunit.client.1.smithi175.stdout:7/581: readlink db/d1d/d60/l71 0 2024-04-20T10:54:59.789 INFO:tasks.workunit.client.1.smithi175.stdout:4/493: symlink d4/d23/d2e/lb1 0 2024-04-20T10:54:59.790 INFO:tasks.workunit.client.1.smithi175.stdout:8/437: mkdir d7/d13/d1d/d24/d39/d85 0 2024-04-20T10:54:59.791 INFO:tasks.workunit.client.1.smithi175.stdout:7/582: mkdir db/d1d/d29/d9a/dd2 0 2024-04-20T10:54:59.792 INFO:tasks.workunit.client.1.smithi175.stdout:8/438: mknod d7/d13/d1d/d24/d38/d80/c86 0 2024-04-20T10:54:59.793 INFO:tasks.workunit.client.1.smithi175.stdout:7/583: creat db/d1d/d39/d50/dba/d47/da6/fd3 x:0 0 0 2024-04-20T10:54:59.794 INFO:tasks.workunit.client.1.smithi175.stdout:7/584: unlink db/d1d/d39/d50/fcf 0 2024-04-20T10:54:59.801 INFO:tasks.workunit.client.1.smithi175.stdout:4/494: dread d4/dd/d54/d5d/d9e/f64 [0,4194304] 0 2024-04-20T10:54:59.802 INFO:tasks.workunit.client.1.smithi175.stdout:8/439: rmdir d7/d13/d1d/d24/d63 39 2024-04-20T10:54:59.803 INFO:tasks.workunit.client.1.smithi175.stdout:7/585: write db/f46 [2798218,11762] 0 2024-04-20T10:54:59.803 INFO:tasks.workunit.client.1.smithi175.stdout:8/440: creat d7/d13/f87 x:0 0 0 2024-04-20T10:54:59.804 INFO:tasks.workunit.client.1.smithi175.stdout:8/441: creat d7/d13/d1d/f88 x:0 0 0 2024-04-20T10:54:59.805 INFO:tasks.workunit.client.1.smithi175.stdout:4/495: mknod d4/dd/d2d/d33/d58/cb2 0 2024-04-20T10:54:59.807 INFO:tasks.workunit.client.1.smithi175.stdout:0/460: dwrite df/d1a/d22/f44 [0,4194304] 0 2024-04-20T10:54:59.807 INFO:tasks.workunit.client.1.smithi175.stdout:0/461: chown df/d19/f7a 65 1 2024-04-20T10:54:59.809 INFO:tasks.workunit.client.1.smithi175.stdout:4/496: dread d4/d27/d61/f46 [0,4194304] 0 2024-04-20T10:54:59.809 INFO:tasks.workunit.client.1.smithi175.stdout:0/462: symlink df/d17/d71/l91 0 2024-04-20T10:54:59.809 INFO:tasks.workunit.client.1.smithi175.stdout:9/422: dwrite d6/d1b/d2f/f41 [0,4194304] 0 2024-04-20T10:54:59.810 INFO:tasks.workunit.client.1.smithi175.stdout:3/330: write d7/d21/fd [2371813,37700] 0 2024-04-20T10:54:59.813 INFO:tasks.workunit.client.1.smithi175.stdout:1/435: dwrite d0/d8/d13/d79/d8c/f8d [0,4194304] 0 2024-04-20T10:54:59.813 INFO:tasks.workunit.client.1.smithi175.stdout:1/436: write d0/f1e [3409658,107937] 0 2024-04-20T10:54:59.813 INFO:tasks.workunit.client.1.smithi175.stdout:5/560: dwrite db/d30/d46/fab [0,4194304] 0 2024-04-20T10:54:59.813 INFO:tasks.workunit.client.1.smithi175.stdout:9/423: dread d6/f39 [0,4194304] 0 2024-04-20T10:54:59.813 INFO:tasks.workunit.client.1.smithi175.stdout:4/497: mknod d4/dd/d54/cb3 0 2024-04-20T10:54:59.814 INFO:tasks.workunit.client.1.smithi175.stdout:8/442: write d7/d13/f22 [3062288,82890] 0 2024-04-20T10:54:59.815 INFO:tasks.workunit.client.1.smithi175.stdout:0/463: mknod df/d19/c92 0 2024-04-20T10:54:59.824 INFO:tasks.workunit.client.1.smithi175.stdout:8/443: dread d7/d13/f6e [0,4194304] 0 2024-04-20T10:54:59.828 INFO:tasks.workunit.client.1.smithi175.stdout:5/561: write db/d30/f99 [1797761,46607] 0 2024-04-20T10:54:59.828 INFO:tasks.workunit.client.1.smithi175.stdout:7/586: write db/d1d/d29/d2a/f4b [657196,129843] 0 2024-04-20T10:54:59.832 INFO:tasks.workunit.client.1.smithi175.stdout:9/424: readlink d6/d10/l2d 0 2024-04-20T10:54:59.833 INFO:tasks.workunit.client.1.smithi175.stdout:3/331: symlink d7/d21/d16/d22/d2c/d1f/l6e 0 2024-04-20T10:54:59.839 INFO:tasks.workunit.client.0.smithi090.stdout:7/953: unlink d11/d13/d5b/de8/l124 0 2024-04-20T10:54:59.839 INFO:tasks.workunit.client.1.smithi175.stdout:5/562: rename db/d11/d25/d38/d40/f5f to db/d30/d46/fba 0 2024-04-20T10:54:59.840 INFO:tasks.workunit.client.1.smithi175.stdout:5/563: dread - db/d1f/f95 zero size 2024-04-20T10:54:59.840 INFO:tasks.workunit.client.1.smithi175.stdout:5/564: creat db/d11/d25/d38/d40/d66/d94/fbb x:0 0 0 2024-04-20T10:54:59.840 INFO:tasks.workunit.client.1.smithi175.stdout:5/565: write db/d11/d25/d38/d40/d66/fa3 [871450,69712] 0 2024-04-20T10:54:59.840 INFO:tasks.workunit.client.1.smithi175.stdout:4/498: dwrite d4/dd/d54/f5a [0,4194304] 0 2024-04-20T10:54:59.840 INFO:tasks.workunit.client.0.smithi090.stdout:7/954: creat d11/d1a/d3b/dc8/d10d/f12c x:0 0 0 2024-04-20T10:54:59.840 INFO:tasks.workunit.client.0.smithi090.stdout:7/955: creat d11/d13/d5b/db8/dbf/da9/f12d x:0 0 0 2024-04-20T10:54:59.841 INFO:tasks.workunit.client.1.smithi175.stdout:9/425: mkdir d6/d1b/d42/d5b/d76 0 2024-04-20T10:54:59.844 INFO:tasks.workunit.client.1.smithi175.stdout:4/499: rmdir d4/dd/d5e/d74/da1/db0 0 2024-04-20T10:54:59.847 INFO:tasks.workunit.client.1.smithi175.stdout:0/464: dwrite df/f3a [0,4194304] 0 2024-04-20T10:54:59.848 INFO:tasks.workunit.client.1.smithi175.stdout:5/566: unlink db/d1f/c73 0 2024-04-20T10:54:59.849 INFO:tasks.workunit.client.1.smithi175.stdout:8/444: fsync d7/f1b 0 2024-04-20T10:54:59.850 INFO:tasks.workunit.client.1.smithi175.stdout:1/437: dwrite d0/f2a [0,4194304] 0 2024-04-20T10:54:59.850 INFO:tasks.workunit.client.1.smithi175.stdout:4/500: fdatasync d4/d27/d61/f42 0 2024-04-20T10:54:59.853 INFO:tasks.workunit.client.1.smithi175.stdout:5/567: symlink db/d11/d25/d38/d40/d66/d94/lbc 0 2024-04-20T10:54:59.857 INFO:tasks.workunit.client.1.smithi175.stdout:4/501: chown d4/f1a 413 1 2024-04-20T10:54:59.860 INFO:tasks.workunit.client.1.smithi175.stdout:6/504: sync 2024-04-20T10:54:59.860 INFO:tasks.workunit.client.1.smithi175.stdout:2/366: sync 2024-04-20T10:54:59.861 INFO:tasks.workunit.client.1.smithi175.stdout:8/445: unlink d7/d55/d6c/f79 0 2024-04-20T10:54:59.863 INFO:tasks.workunit.client.1.smithi175.stdout:1/438: symlink d0/l9f 0 2024-04-20T10:54:59.864 INFO:tasks.workunit.client.1.smithi175.stdout:5/568: mknod db/d11/d25/d62/cbd 0 2024-04-20T10:54:59.865 INFO:tasks.workunit.client.1.smithi175.stdout:6/505: truncate d1/d40/d46/f58 916829 0 2024-04-20T10:54:59.865 INFO:tasks.workunit.client.1.smithi175.stdout:6/506: chown d1/fb 436783408 1 2024-04-20T10:54:59.869 INFO:tasks.workunit.client.1.smithi175.stdout:5/569: getdents db/d30/d46/d4b/d4f/d75/d91 0 2024-04-20T10:54:59.872 INFO:tasks.workunit.client.1.smithi175.stdout:2/367: truncate d1/d48/f27 394182 0 2024-04-20T10:54:59.872 INFO:tasks.workunit.client.1.smithi175.stdout:9/426: write d6/d10/f3b [996566,90444] 0 2024-04-20T10:54:59.874 INFO:tasks.workunit.client.1.smithi175.stdout:9/427: chown d6/d10/l30 29 1 2024-04-20T10:54:59.874 INFO:tasks.workunit.client.1.smithi175.stdout:9/428: chown d6/d58 161777 1 2024-04-20T10:54:59.874 INFO:tasks.workunit.client.1.smithi175.stdout:3/332: dwrite d7/d21/d16/d49/f63 [0,4194304] 0 2024-04-20T10:54:59.875 INFO:tasks.workunit.client.1.smithi175.stdout:2/368: symlink d1/d7/d63/d4b/l7e 0 2024-04-20T10:54:59.876 INFO:tasks.workunit.client.1.smithi175.stdout:7/587: dwrite db/d1d/d29/d2a/f84 [0,4194304] 0 2024-04-20T10:54:59.876 INFO:tasks.workunit.client.1.smithi175.stdout:9/429: rmdir d6/d1b/d42/d5b/d76 0 2024-04-20T10:54:59.877 INFO:tasks.workunit.client.0.smithi090.stdout:7/956: dwrite d11/d13/d22/d82/ff9 [0,4194304] 0 2024-04-20T10:54:59.880 INFO:tasks.workunit.client.1.smithi175.stdout:8/446: write d7/d13/d1d/d24/d38/f64 [2337961,125318] 0 2024-04-20T10:54:59.880 INFO:tasks.workunit.client.1.smithi175.stdout:0/465: dwrite df/d19/f1f [0,4194304] 0 2024-04-20T10:54:59.884 INFO:tasks.workunit.client.1.smithi175.stdout:9/430: creat d6/d10/f77 x:0 0 0 2024-04-20T10:54:59.887 INFO:tasks.workunit.client.1.smithi175.stdout:1/439: getdents d0 0 2024-04-20T10:54:59.888 INFO:tasks.workunit.client.1.smithi175.stdout:9/431: mkdir d6/d33/d60/d78 0 2024-04-20T10:54:59.889 INFO:tasks.workunit.client.1.smithi175.stdout:1/440: truncate d0/d8/f28 2380558 0 2024-04-20T10:54:59.889 INFO:tasks.workunit.client.1.smithi175.stdout:6/507: write d1/d40/d46/d60/d6b/f78 [1414688,124222] 0 2024-04-20T10:54:59.890 INFO:tasks.workunit.client.1.smithi175.stdout:2/369: write d1/d53/f54 [2624468,116372] 0 2024-04-20T10:54:59.891 INFO:tasks.workunit.client.1.smithi175.stdout:5/570: write db/d1f/f95 [971668,4325] 0 2024-04-20T10:54:59.891 INFO:tasks.workunit.client.1.smithi175.stdout:5/571: chown db/d11/d25/d41/c65 30 1 2024-04-20T10:54:59.891 INFO:tasks.workunit.client.1.smithi175.stdout:5/572: dread - db/d30/d46/d4b/d4f/fac zero size 2024-04-20T10:54:59.892 INFO:tasks.workunit.client.1.smithi175.stdout:1/441: mknod d0/d8/d13/d2e/d35/d8a/d91/ca0 0 2024-04-20T10:54:59.892 INFO:tasks.workunit.client.1.smithi175.stdout:1/442: stat d0/d8/d13/l55 0 2024-04-20T10:54:59.892 INFO:tasks.workunit.client.1.smithi175.stdout:6/508: chown d1/d37/f92 173799089 1 2024-04-20T10:54:59.893 INFO:tasks.workunit.client.1.smithi175.stdout:8/447: write d7/d13/d1d/f4e [968101,96975] 0 2024-04-20T10:54:59.894 INFO:tasks.workunit.client.1.smithi175.stdout:9/432: mkdir d6/d1b/d42/d79 0 2024-04-20T10:54:59.897 INFO:tasks.workunit.client.1.smithi175.stdout:8/448: creat d7/d13/d1d/d24/d38/f89 x:0 0 0 2024-04-20T10:54:59.901 INFO:tasks.workunit.client.1.smithi175.stdout:6/509: creat d1/d40/d46/d60/d68/d7e/fb1 x:0 0 0 2024-04-20T10:54:59.906 INFO:tasks.workunit.client.1.smithi175.stdout:5/573: dread db/d30/d46/d4b/f4d [0,4194304] 0 2024-04-20T10:54:59.907 INFO:tasks.workunit.client.1.smithi175.stdout:2/370: write d1/d48/d21/d29/f50 [3571690,6461] 0 2024-04-20T10:54:59.907 INFO:tasks.workunit.client.1.smithi175.stdout:9/433: truncate d6/d1b/f56 476395 0 2024-04-20T10:54:59.908 INFO:tasks.workunit.client.1.smithi175.stdout:6/510: rmdir d1/d40/d46/d60 39 2024-04-20T10:54:59.909 INFO:tasks.workunit.client.1.smithi175.stdout:8/449: symlink d7/d13/d1d/d24/d39/d85/l8a 0 2024-04-20T10:54:59.910 INFO:tasks.workunit.client.1.smithi175.stdout:8/450: truncate d7/f1b 686460 0 2024-04-20T10:54:59.911 INFO:tasks.workunit.client.1.smithi175.stdout:6/511: dread d1/d40/d29/f2f [0,4194304] 0 2024-04-20T10:54:59.912 INFO:tasks.workunit.client.1.smithi175.stdout:5/574: truncate f2 2334599 0 2024-04-20T10:54:59.912 INFO:tasks.workunit.client.1.smithi175.stdout:5/575: fsync db/d9d/f44 0 2024-04-20T10:54:59.912 INFO:tasks.workunit.client.1.smithi175.stdout:1/443: dread d0/d57/f5d [0,4194304] 0 2024-04-20T10:54:59.912 INFO:tasks.workunit.client.1.smithi175.stdout:1/444: write d0/d8/f28 [2957937,72366] 0 2024-04-20T10:54:59.915 INFO:tasks.workunit.client.1.smithi175.stdout:5/576: creat db/fbe x:0 0 0 2024-04-20T10:54:59.915 INFO:tasks.workunit.client.1.smithi175.stdout:5/577: read - db/d11/d6d/fb3 zero size 2024-04-20T10:54:59.915 INFO:tasks.workunit.client.1.smithi175.stdout:6/512: write d1/f16 [3208459,41172] 0 2024-04-20T10:54:59.920 INFO:tasks.workunit.client.1.smithi175.stdout:5/578: truncate db/d30/d46/d4b/d4f/f78 395536 0 2024-04-20T10:54:59.921 INFO:tasks.workunit.client.1.smithi175.stdout:3/333: dwrite d7/d21/f2f [0,4194304] 0 2024-04-20T10:54:59.921 INFO:tasks.workunit.client.1.smithi175.stdout:7/588: dwrite db/d1d/d39/d50/dba/d47/f49 [0,4194304] 0 2024-04-20T10:54:59.923 INFO:tasks.workunit.client.1.smithi175.stdout:5/579: symlink db/d11/d6d/da1/lbf 0 2024-04-20T10:54:59.926 INFO:tasks.workunit.client.1.smithi175.stdout:7/589: dread db/d1d/d29/d2a/fa8 [0,4194304] 0 2024-04-20T10:54:59.926 INFO:tasks.workunit.client.1.smithi175.stdout:6/513: read d1/d5/fa [1981035,3240] 0 2024-04-20T10:54:59.926 INFO:tasks.workunit.client.1.smithi175.stdout:6/514: chown d1/d5/f10 6 1 2024-04-20T10:54:59.928 INFO:tasks.workunit.client.1.smithi175.stdout:5/580: creat db/d30/d46/d4b/d4f/fc0 x:0 0 0 2024-04-20T10:54:59.930 INFO:tasks.workunit.client.1.smithi175.stdout:7/590: rename db/d1d/d39/d50/f25 to db/d1d/d39/d50/dba/d47/da6/db9/dc8/fd4 0 2024-04-20T10:54:59.934 INFO:tasks.workunit.client.1.smithi175.stdout:6/515: mknod d1/d5/d12/d73/cb2 0 2024-04-20T10:54:59.934 INFO:tasks.workunit.client.1.smithi175.stdout:6/516: chown d1/d37 459832 1 2024-04-20T10:54:59.936 INFO:tasks.workunit.client.1.smithi175.stdout:5/581: unlink db/d11/d1a/c69 0 2024-04-20T10:54:59.941 INFO:tasks.workunit.client.1.smithi175.stdout:8/451: write d7/fd [85746,72634] 0 2024-04-20T10:54:59.946 INFO:tasks.workunit.client.1.smithi175.stdout:3/334: dwrite d7/d21/f2f [0,4194304] 0 2024-04-20T10:54:59.947 INFO:tasks.workunit.client.1.smithi175.stdout:8/452: creat d7/d13/d1d/d24/d39/d6f/f8b x:0 0 0 2024-04-20T10:54:59.950 INFO:tasks.workunit.client.1.smithi175.stdout:5/582: rename db/d30/d46/d4b to db/dc1 0 2024-04-20T10:54:59.952 INFO:tasks.workunit.client.1.smithi175.stdout:9/434: dwrite d6/f4a [0,4194304] 0 2024-04-20T10:54:59.957 INFO:tasks.workunit.client.1.smithi175.stdout:5/583: mknod db/d1f/d31/d93/cc2 0 2024-04-20T10:54:59.957 INFO:tasks.workunit.client.1.smithi175.stdout:5/584: write db/d11/d25/d62/f87 [4554572,123775] 0 2024-04-20T10:54:59.959 INFO:tasks.workunit.client.1.smithi175.stdout:6/517: dwrite d1/d37/f6f [0,4194304] 0 2024-04-20T10:54:59.969 INFO:tasks.workunit.client.1.smithi175.stdout:5/585: write db/d11/d25/d41/d60/f6c [2320896,34016] 0 2024-04-20T10:54:59.970 INFO:tasks.workunit.client.1.smithi175.stdout:5/586: unlink db/d11/d25/d41/f98 0 2024-04-20T10:54:59.985 INFO:tasks.workunit.client.1.smithi175.stdout:5/587: dwrite db/d9d/f44 [0,4194304] 0 2024-04-20T10:54:59.990 INFO:tasks.workunit.client.1.smithi175.stdout:5/588: dread db/d11/d25/d38/d40/d66/f8c [0,4194304] 0 2024-04-20T10:54:59.992 INFO:tasks.workunit.client.1.smithi175.stdout:5/589: write db/d11/d25/d38/d40/d66/f8c [57569,4034] 0 2024-04-20T10:55:00.001 INFO:tasks.workunit.client.1.smithi175.stdout:5/590: write db/d11/d25/d38/d40/d47/fa9 [4177087,44722] 0 2024-04-20T10:55:00.002 INFO:tasks.workunit.client.1.smithi175.stdout:6/518: mknod d1/d40/d46/d60/d68/cb3 0 2024-04-20T10:55:00.003 INFO:tasks.workunit.client.1.smithi175.stdout:8/453: dread d7/d13/d1d/d24/d39/d6f/f61 [0,4194304] 0 2024-04-20T10:55:00.026 INFO:tasks.workunit.client.0.smithi090.stdout:7/957: sync 2024-04-20T10:55:00.035 INFO:tasks.workunit.client.0.smithi090.stdout:7/958: read d11/d13/d22/f64 [5759420,40937] 0 2024-04-20T10:55:00.036 INFO:tasks.workunit.client.0.smithi090.stdout:7/959: rename d11/cff to d11/d1a/d3b/c12e 0 2024-04-20T10:55:00.037 INFO:tasks.workunit.client.0.smithi090.stdout:7/960: mknod d11/d61/d11b/c12f 0 2024-04-20T10:55:00.038 INFO:tasks.workunit.client.0.smithi090.stdout:7/961: rename d11/d13/l104 to d11/d13/d22/d82/l130 0 2024-04-20T10:55:00.039 INFO:tasks.workunit.client.0.smithi090.stdout:7/962: unlink d11/d13/d33/l36 0 2024-04-20T10:55:00.040 INFO:tasks.workunit.client.0.smithi090.stdout:7/963: creat d11/d13/d5b/de8/f131 x:0 0 0 2024-04-20T10:55:00.041 INFO:tasks.workunit.client.0.smithi090.stdout:7/964: creat d11/d1a/d3b/d107/d129/f132 x:0 0 0 2024-04-20T10:55:00.042 INFO:tasks.workunit.client.0.smithi090.stdout:7/965: symlink d11/d13/d22/d82/l133 0 2024-04-20T10:55:00.042 INFO:tasks.workunit.client.0.smithi090.stdout:7/966: read - d11/d13/d22/d27/dc2/f101 zero size 2024-04-20T10:55:00.042 INFO:tasks.workunit.client.0.smithi090.stdout:7/967: mkdir d11/d13/d5d/db0/d134 0 2024-04-20T10:55:00.059 INFO:tasks.workunit.client.0.smithi090.stdout:7/968: dwrite d11/d13/d5b/db8/de0/fe7 [4194304,4194304] 0 2024-04-20T10:55:00.060 INFO:tasks.workunit.client.0.smithi090.stdout:7/969: truncate d11/d13/f8c 1336986 0 2024-04-20T10:55:00.061 INFO:tasks.workunit.client.0.smithi090.stdout:7/970: symlink d11/d1a/d3b/d107/l135 0 2024-04-20T10:55:00.065 INFO:tasks.workunit.client.1.smithi175.stdout:7/591: dwrite db/f7e [0,4194304] 0 2024-04-20T10:55:00.066 INFO:tasks.workunit.client.1.smithi175.stdout:5/591: mkdir db/d11/d80/dc3 0 2024-04-20T10:55:00.066 INFO:tasks.workunit.client.0.smithi090.stdout:7/971: dread d11/d13/d5b/db8/f85 [0,4194304] 0 2024-04-20T10:55:00.066 INFO:tasks.workunit.client.1.smithi175.stdout:8/454: unlink d7/d13/f33 0 2024-04-20T10:55:00.067 INFO:tasks.workunit.client.0.smithi090.stdout:7/972: symlink d11/l136 0 2024-04-20T10:55:00.067 INFO:tasks.workunit.client.0.smithi090.stdout:7/973: mknod d11/c137 0 2024-04-20T10:55:00.068 INFO:tasks.workunit.client.1.smithi175.stdout:7/592: creat db/d61/d6d/dbc/fd5 x:0 0 0 2024-04-20T10:55:00.069 INFO:tasks.workunit.client.1.smithi175.stdout:5/592: mknod db/d30/d46/d88/db2/cc4 0 2024-04-20T10:55:00.070 INFO:tasks.workunit.client.1.smithi175.stdout:8/455: creat d7/d13/d1d/d24/d39/d85/f8c x:0 0 0 2024-04-20T10:55:00.071 INFO:tasks.workunit.client.1.smithi175.stdout:7/593: readlink db/d61/d6d/l83 0 2024-04-20T10:55:00.082 INFO:tasks.workunit.client.1.smithi175.stdout:3/335: dwrite d7/d21/d16/d22/d2c/d1f/f5b [0,4194304] 0 2024-04-20T10:55:00.083 INFO:tasks.workunit.client.1.smithi175.stdout:7/594: rmdir db/d1d/d39/d50/dba/d47/da6/db9 39 2024-04-20T10:55:00.083 INFO:tasks.workunit.client.1.smithi175.stdout:8/456: dread d7/d13/d1d/d24/f2b [0,4194304] 0 2024-04-20T10:55:00.089 INFO:tasks.workunit.client.0.smithi090.stdout:7/974: dwrite d11/d13/d22/d82/fe4 [0,4194304] 0 2024-04-20T10:55:00.091 INFO:tasks.workunit.client.0.smithi090.stdout:7/975: unlink d11/d13/d22/d27/dc2/ffb 0 2024-04-20T10:55:00.091 INFO:tasks.workunit.client.0.smithi090.stdout:7/976: write d11/d1a/d3f/f6f [1566645,82060] 0 2024-04-20T10:55:00.091 INFO:tasks.workunit.client.0.smithi090.stdout:7/977: readlink d11/d13/d5b/db8/l49 0 2024-04-20T10:55:00.091 INFO:tasks.workunit.client.1.smithi175.stdout:7/595: dread db/d1d/d29/d8f/faf [0,4194304] 0 2024-04-20T10:55:00.092 INFO:tasks.workunit.client.0.smithi090.stdout:7/978: rename d11/d13/d22/f64 to d11/d13/d5b/db8/dbf/df1/f138 0 2024-04-20T10:55:00.093 INFO:tasks.workunit.client.1.smithi175.stdout:3/336: creat d7/d21/d67/f6f x:0 0 0 2024-04-20T10:55:00.093 INFO:tasks.workunit.client.0.smithi090.stdout:7/979: creat d11/d1a/d3b/d107/d10f/f139 x:0 0 0 2024-04-20T10:55:00.093 INFO:tasks.workunit.client.1.smithi175.stdout:8/457: stat d7/d13/d1d/d24/c60 0 2024-04-20T10:55:00.094 INFO:tasks.workunit.client.0.smithi090.stdout:7/980: creat d11/dd2/f13a x:0 0 0 2024-04-20T10:55:00.094 INFO:tasks.workunit.client.0.smithi090.stdout:7/981: getdents d11/d13/d5d/db0/d10e 0 2024-04-20T10:55:00.094 INFO:tasks.workunit.client.1.smithi175.stdout:7/596: getdents db/d1d/d39/d50/dba/d47/d6a 0 2024-04-20T10:55:00.095 INFO:tasks.workunit.client.0.smithi090.stdout:7/982: rename d11/d13/d22/d82/ff9 to d11/d13/d5b/db8/dbf/df1/f13b 0 2024-04-20T10:55:00.096 INFO:tasks.workunit.client.0.smithi090.stdout:7/983: creat d11/d13/d5b/f13c x:0 0 0 2024-04-20T10:55:00.096 INFO:tasks.workunit.client.0.smithi090.stdout:7/984: dread - d11/dd2/d11a/dc7/fcb zero size 2024-04-20T10:55:00.096 INFO:tasks.workunit.client.0.smithi090.stdout:7/985: stat d11/d1a/d3b/dc8/d10d/f12c 0 2024-04-20T10:55:00.097 INFO:tasks.workunit.client.1.smithi175.stdout:5/593: link db/d11/d25/d38/f96 db/d11/d25/d41/d60/fc5 0 2024-04-20T10:55:00.097 INFO:tasks.workunit.client.1.smithi175.stdout:5/594: chown db/d11/d25/d38/d40/d66/f86 7 1 2024-04-20T10:55:00.097 INFO:tasks.workunit.client.0.smithi090.stdout:7/986: rmdir d11/d1a/d3b 39 2024-04-20T10:55:00.097 INFO:tasks.workunit.client.0.smithi090.stdout:7/987: symlink d11/l13d 0 2024-04-20T10:55:00.097 INFO:tasks.workunit.client.0.smithi090.stdout:7/988: dread - d11/d13/d22/d8f/f115 zero size 2024-04-20T10:55:00.098 INFO:tasks.workunit.client.1.smithi175.stdout:8/458: creat d7/d13/d1d/d24/d38/f8d x:0 0 0 2024-04-20T10:55:00.098 INFO:tasks.workunit.client.0.smithi090.stdout:7/989: creat d11/d13/d5d/db0/f13e x:0 0 0 2024-04-20T10:55:00.098 INFO:tasks.workunit.client.0.smithi090.stdout:7/990: symlink d11/d13/d22/d27/dc2/l13f 0 2024-04-20T10:55:00.099 INFO:tasks.workunit.client.1.smithi175.stdout:3/337: symlink d7/d21/d16/d22/d2c/d1f/l70 0 2024-04-20T10:55:00.100 INFO:tasks.workunit.client.1.smithi175.stdout:8/459: unlink d7/d13/d1d/d24/d39/d85/f8c 0 2024-04-20T10:55:00.100 INFO:tasks.workunit.client.1.smithi175.stdout:7/597: symlink db/d1d/ld6 0 2024-04-20T10:55:00.101 INFO:tasks.workunit.client.1.smithi175.stdout:5/595: rename db/l71 to db/d11/d25/d41/d83/lc6 0 2024-04-20T10:55:00.104 INFO:tasks.workunit.client.1.smithi175.stdout:7/598: creat db/d1d/d39/d50/dba/d47/da6/db9/dc8/fd7 x:0 0 0 2024-04-20T10:55:00.106 INFO:tasks.workunit.client.1.smithi175.stdout:3/338: link d7/d21/d16/d22/d2c/d1f/l70 d7/d21/l71 0 2024-04-20T10:55:00.117 INFO:tasks.workunit.client.0.smithi090.stdout:7/991: dwrite d11/d1a/d3b/dc8/d10d/f112 [0,4194304] 0 2024-04-20T10:55:00.126 INFO:tasks.workunit.client.1.smithi175.stdout:8/460: dwrite d7/d13/d1d/d24/d26/f51 [0,4194304] 0 2024-04-20T10:55:00.127 INFO:tasks.workunit.client.1.smithi175.stdout:8/461: truncate d7/d13/d1d/d24/d38/f77 278487 0 2024-04-20T10:55:00.136 INFO:tasks.workunit.client.0.smithi090.stdout:7/992: dwrite d11/dd2/f13a [0,4194304] 0 2024-04-20T10:55:00.143 INFO:tasks.workunit.client.0.smithi090.stdout:7/993: getdents d11 0 2024-04-20T10:55:00.143 INFO:tasks.workunit.client.1.smithi175.stdout:8/462: dwrite d7/d13/d1d/d24/d38/f8d [0,4194304] 0 2024-04-20T10:55:00.144 INFO:tasks.workunit.client.1.smithi175.stdout:7/599: truncate db/d1d/d29/d2a/fa8 727578 0 2024-04-20T10:55:00.145 INFO:tasks.workunit.client.1.smithi175.stdout:5/596: mknod db/d11/d6d/cc7 0 2024-04-20T10:55:00.150 INFO:tasks.workunit.client.0.smithi090.stdout:7/994: dread f4 [0,4194304] 0 2024-04-20T10:55:00.150 INFO:tasks.workunit.client.1.smithi175.stdout:7/600: rmdir db/d1d/d29/d8f 39 2024-04-20T10:55:00.151 INFO:tasks.workunit.client.0.smithi090.stdout:7/995: mknod d11/d1a/d3f/c140 0 2024-04-20T10:55:00.151 INFO:tasks.workunit.client.1.smithi175.stdout:5/597: creat db/d1f/d31/da0/fc8 x:0 0 0 2024-04-20T10:55:00.152 INFO:tasks.workunit.client.1.smithi175.stdout:3/339: dread - d7/d10/f4a zero size 2024-04-20T10:55:00.152 INFO:tasks.workunit.client.0.smithi090.stdout:7/996: link d11/d13/d5b/db8/l103 d11/d13/d5b/de8/l141 0 2024-04-20T10:55:00.153 INFO:tasks.workunit.client.0.smithi090.stdout:7/997: chown d11/d1a/d3b/c12e 80610 1 2024-04-20T10:55:00.153 INFO:tasks.workunit.client.0.smithi090.stdout:7/998: mkdir d11/d13/d22/d27/dc2/d142 0 2024-04-20T10:55:00.154 INFO:tasks.workunit.client.1.smithi175.stdout:8/463: mknod d7/d13/d1d/d24/d39/d6f/c8e 0 2024-04-20T10:55:00.155 INFO:tasks.workunit.client.1.smithi175.stdout:7/601: getdents db/d1d/d29/d2a/d41 0 2024-04-20T10:55:00.155 INFO:tasks.workunit.client.1.smithi175.stdout:7/602: truncate db/d1d/d29/f3c 705794 0 2024-04-20T10:55:00.155 INFO:tasks.workunit.client.1.smithi175.stdout:7/603: read db/d1d/d39/d50/dba/d47/f94 [310876,19876] 0 2024-04-20T10:55:00.156 INFO:tasks.workunit.client.1.smithi175.stdout:5/598: getdents db/d1f/d31 0 2024-04-20T10:55:00.156 INFO:tasks.workunit.client.1.smithi175.stdout:2/371: sync 2024-04-20T10:55:00.156 INFO:tasks.workunit.client.1.smithi175.stdout:0/466: sync 2024-04-20T10:55:00.156 INFO:tasks.workunit.client.1.smithi175.stdout:4/502: sync 2024-04-20T10:55:00.156 INFO:tasks.workunit.client.1.smithi175.stdout:0/467: write df/f10 [3275836,47798] 0 2024-04-20T10:55:00.157 INFO:tasks.workunit.client.1.smithi175.stdout:1/445: sync 2024-04-20T10:55:00.158 INFO:tasks.workunit.client.1.smithi175.stdout:8/464: creat d7/d13/d1d/f8f x:0 0 0 2024-04-20T10:55:00.158 INFO:tasks.workunit.client.1.smithi175.stdout:6/519: read d1/d40/d49/f69 [80071,13914] 0 2024-04-20T10:55:00.159 INFO:tasks.workunit.client.1.smithi175.stdout:1/446: dread d0/d8/d13/f60 [0,4194304] 0 2024-04-20T10:55:00.160 INFO:tasks.workunit.client.1.smithi175.stdout:5/599: creat db/d11/d25/d41/d60/fc9 x:0 0 0 2024-04-20T10:55:00.160 INFO:tasks.workunit.client.1.smithi175.stdout:5/600: chown db/d1f/f18 770 1 2024-04-20T10:55:00.160 INFO:tasks.workunit.client.1.smithi175.stdout:5/601: write db/d11/d6d/da1/fb8 [328981,12623] 0 2024-04-20T10:55:00.161 INFO:tasks.workunit.client.1.smithi175.stdout:2/372: unlink d1/d53/f54 0 2024-04-20T10:55:00.162 INFO:tasks.workunit.client.1.smithi175.stdout:8/465: stat d7/d13/d1d/d56/f62 0 2024-04-20T10:55:00.163 INFO:tasks.workunit.client.1.smithi175.stdout:9/435: sync 2024-04-20T10:55:00.164 INFO:tasks.workunit.client.1.smithi175.stdout:7/604: unlink f6 0 2024-04-20T10:55:00.165 INFO:tasks.workunit.client.1.smithi175.stdout:1/447: rename d0/d29/f32 to d0/d8/d13/d75/fa1 0 2024-04-20T10:55:00.166 INFO:tasks.workunit.client.1.smithi175.stdout:5/602: mknod db/d11/d80/cca 0 2024-04-20T10:55:00.167 INFO:tasks.workunit.client.1.smithi175.stdout:2/373: creat d1/d48/d38/d68/f7f x:0 0 0 2024-04-20T10:55:00.169 INFO:tasks.workunit.client.1.smithi175.stdout:6/520: unlink d1/d40/d46/c6a 0 2024-04-20T10:55:00.170 INFO:tasks.workunit.client.1.smithi175.stdout:9/436: creat d6/d1b/f7a x:0 0 0 2024-04-20T10:55:00.171 INFO:tasks.workunit.client.1.smithi175.stdout:7/605: unlink db/d1d/d39/fad 0 2024-04-20T10:55:00.171 INFO:tasks.workunit.client.0.smithi090.stdout:7/999: dwrite d11/d13/d5b/db8/dbf/f9c [0,4194304] 0 2024-04-20T10:55:00.173 INFO:tasks.workunit.client.1.smithi175.stdout:1/448: truncate d0/d29/f4f 304483 0 2024-04-20T10:55:00.173 INFO:tasks.workunit.client.1.smithi175.stdout:5/603: mkdir db/d1f/d31/da0/dcb 0 2024-04-20T10:55:00.174 INFO:tasks.workunit.client.0.smithi090.stderr:+ rm -rf -- ./tmp.JYLQy7chn9 2024-04-20T10:55:00.174 INFO:tasks.workunit.client.1.smithi175.stdout:2/374: mkdir d1/d7/d63/d36/d7d/d80 0 2024-04-20T10:55:00.178 INFO:tasks.workunit.client.1.smithi175.stdout:9/437: symlink d6/d1b/d42/d79/l7b 0 2024-04-20T10:55:00.178 INFO:tasks.workunit.client.1.smithi175.stdout:7/606: rmdir db/d1d/d29/d9a 39 2024-04-20T10:55:00.179 INFO:tasks.workunit.client.1.smithi175.stdout:7/607: readlink db/d1d/d29/d2a/d41/l8a 0 2024-04-20T10:55:00.185 INFO:tasks.workunit.client.1.smithi175.stdout:6/521: mknod d1/d40/d46/cb4 0 2024-04-20T10:55:00.186 INFO:tasks.workunit.client.1.smithi175.stdout:6/522: truncate d1/d40/d46/d60/d6b/f9d 429973 0 2024-04-20T10:55:00.187 INFO:tasks.workunit.client.1.smithi175.stdout:2/375: dread d1/d7/f5b [0,4194304] 0 2024-04-20T10:55:00.188 INFO:tasks.workunit.client.1.smithi175.stdout:9/438: creat d6/d1b/d42/d5b/d72/f7c x:0 0 0 2024-04-20T10:55:00.190 INFO:tasks.workunit.client.1.smithi175.stdout:1/449: mknod d0/d3e/ca2 0 2024-04-20T10:55:00.197 INFO:tasks.workunit.client.1.smithi175.stdout:5/604: dread db/f1b [0,4194304] 0 2024-04-20T10:55:00.198 INFO:tasks.workunit.client.1.smithi175.stdout:8/466: dwrite d7/d13/f17 [0,4194304] 0 2024-04-20T10:55:00.199 INFO:tasks.workunit.client.1.smithi175.stdout:2/376: creat d1/f81 x:0 0 0 2024-04-20T10:55:00.199 INFO:tasks.workunit.client.1.smithi175.stdout:2/377: fsync d1/d48/d21/d29/f39 0 2024-04-20T10:55:00.200 INFO:tasks.workunit.client.1.smithi175.stdout:9/439: unlink d6/d33/d63/f49 0 2024-04-20T10:55:00.201 INFO:tasks.workunit.client.1.smithi175.stdout:5/605: mkdir db/d11/d6d/da1/dcc 0 2024-04-20T10:55:00.202 INFO:tasks.workunit.client.1.smithi175.stdout:5/606: read db/d30/f99 [2390109,82264] 0 2024-04-20T10:55:00.204 INFO:tasks.workunit.client.1.smithi175.stdout:0/468: dread df/d17/d2f/f66 [0,4194304] 0 2024-04-20T10:55:00.204 INFO:tasks.workunit.client.1.smithi175.stdout:0/469: fsync df/d19/f7a 0 2024-04-20T10:55:00.205 INFO:tasks.workunit.client.1.smithi175.stdout:7/608: unlink db/d1d/d39/d50/dba/d47/c5a 0 2024-04-20T10:55:00.205 INFO:tasks.workunit.client.1.smithi175.stdout:7/609: write db/d1d/d39/d50/dba/d47/da6/fd3 [490445,104780] 0 2024-04-20T10:55:00.205 INFO:tasks.workunit.client.1.smithi175.stdout:7/610: fsync db/d1d/d39/d50/f55 0 2024-04-20T10:55:00.205 INFO:tasks.workunit.client.1.smithi175.stdout:5/607: creat db/d1f/d31/fcd x:0 0 0 2024-04-20T10:55:00.205 INFO:tasks.workunit.client.1.smithi175.stdout:5/608: truncate db/dc1/d4f/fac 951018 0 2024-04-20T10:55:00.206 INFO:tasks.workunit.client.1.smithi175.stdout:9/440: getdents d6/d1b/d42/d5b/d72 0 2024-04-20T10:55:00.208 INFO:tasks.workunit.client.1.smithi175.stdout:2/378: rename d1/d48/d38/d68 to d1/d48/d38/d82 0 2024-04-20T10:55:00.208 INFO:tasks.workunit.client.1.smithi175.stdout:0/470: truncate df/d17/d2f/f66 2930277 0 2024-04-20T10:55:00.209 INFO:tasks.workunit.client.1.smithi175.stdout:7/611: rmdir db/d1d/d39/d50 39 2024-04-20T10:55:00.211 INFO:tasks.workunit.client.1.smithi175.stdout:9/441: mkdir d6/d1b/d42/d5b/d72/d7d 0 2024-04-20T10:55:00.211 INFO:tasks.workunit.client.1.smithi175.stdout:6/523: dwrite d1/d40/d46/d60/d68/d7e/f81 [0,4194304] 0 2024-04-20T10:55:00.215 INFO:tasks.workunit.client.1.smithi175.stdout:1/450: dwrite d0/d29/f4f [0,4194304] 0 2024-04-20T10:55:00.215 INFO:tasks.workunit.client.1.smithi175.stdout:0/471: creat df/d1a/d3f/d5e/f93 x:0 0 0 2024-04-20T10:55:00.216 INFO:tasks.workunit.client.1.smithi175.stdout:7/612: mkdir db/d1d/d39/d50/dba/d47/da6/db9/dc8/dd8 0 2024-04-20T10:55:00.217 INFO:tasks.workunit.client.1.smithi175.stdout:2/379: mknod d1/d48/d21/d76/c83 0 2024-04-20T10:55:00.223 INFO:tasks.workunit.client.1.smithi175.stdout:9/442: dread d6/f4a [0,4194304] 0 2024-04-20T10:55:00.225 INFO:tasks.workunit.client.1.smithi175.stdout:7/613: rename db/d1d/d39/d50/dba/d47/d6a/dbf to db/d1d/d39/d50/dba/d47/dac/dd9 0 2024-04-20T10:55:00.225 INFO:tasks.workunit.client.1.smithi175.stdout:7/614: truncate db/d1d/d29/fab 685770 0 2024-04-20T10:55:00.226 INFO:tasks.workunit.client.1.smithi175.stdout:2/380: mkdir d1/d7/d63/d36/d7d/d84 0 2024-04-20T10:55:00.227 INFO:tasks.workunit.client.1.smithi175.stdout:9/443: fsync d6/d1b/f47 0 2024-04-20T10:55:00.228 INFO:tasks.workunit.client.1.smithi175.stdout:7/615: mknod db/d1d/d39/d50/dba/d47/dac/dd9/cda 0 2024-04-20T10:55:00.230 INFO:tasks.workunit.client.1.smithi175.stdout:8/467: dwrite d7/d13/d1d/d24/d26/f7b [0,4194304] 0 2024-04-20T10:55:00.231 INFO:tasks.workunit.client.1.smithi175.stdout:9/444: getdents d6/d33/d60 0 2024-04-20T10:55:00.232 INFO:tasks.workunit.client.1.smithi175.stdout:0/472: link df/d1a/f27 df/d1a/d22/d6a/d72/f94 0 2024-04-20T10:55:00.233 INFO:tasks.workunit.client.1.smithi175.stdout:7/616: symlink db/d1d/d39/d50/dba/d47/da6/db9/ldb 0 2024-04-20T10:55:00.239 INFO:tasks.workunit.client.1.smithi175.stdout:1/451: dwrite d0/d8/f4d [0,4194304] 0 2024-04-20T10:55:00.240 INFO:tasks.workunit.client.1.smithi175.stdout:0/473: creat df/d1a/d22/d6a/d72/f95 x:0 0 0 2024-04-20T10:55:00.240 INFO:tasks.workunit.client.1.smithi175.stdout:0/474: write df/d19/f70 [669236,65383] 0 2024-04-20T10:55:00.240 INFO:tasks.workunit.client.1.smithi175.stdout:0/475: fdatasync df/d1a/f27 0 2024-04-20T10:55:00.241 INFO:tasks.workunit.client.1.smithi175.stdout:2/381: write d1/d7/f8 [43013,95549] 0 2024-04-20T10:55:00.242 INFO:tasks.workunit.client.1.smithi175.stdout:1/452: truncate d0/f10 18170 0 2024-04-20T10:55:00.245 INFO:tasks.workunit.client.1.smithi175.stdout:7/617: rename db/l26 to db/d1d/d39/d50/ldc 0 2024-04-20T10:55:00.246 INFO:tasks.workunit.client.1.smithi175.stdout:2/382: chown d1/d48/d21/d29/c14 4 1 2024-04-20T10:55:00.246 INFO:tasks.workunit.client.1.smithi175.stdout:2/383: dread - d1/d7/d63/f71 zero size 2024-04-20T10:55:00.246 INFO:tasks.workunit.client.1.smithi175.stdout:2/384: readlink d1/d48/d21/d76/l2a 0 2024-04-20T10:55:00.247 INFO:tasks.workunit.client.1.smithi175.stdout:1/453: creat d0/d51/d6b/d9e/fa3 x:0 0 0 2024-04-20T10:55:00.248 INFO:tasks.workunit.client.1.smithi175.stdout:8/468: dwrite d7/d13/d1d/d24/d26/f51 [0,4194304] 0 2024-04-20T10:55:00.248 INFO:tasks.workunit.client.1.smithi175.stdout:8/469: truncate d7/d13/d1d/d24/d39/d6f/f82 794500 0 2024-04-20T10:55:00.249 INFO:tasks.workunit.client.1.smithi175.stdout:0/476: symlink df/d1a/d22/d24/l96 0 2024-04-20T10:55:00.250 INFO:tasks.workunit.client.1.smithi175.stdout:0/477: write df/d1a/d3f/f75 [1185456,45648] 0 2024-04-20T10:55:00.251 INFO:tasks.workunit.client.1.smithi175.stdout:7/618: creat db/d1d/d39/d50/dba/d47/dac/fdd x:0 0 0 2024-04-20T10:55:00.251 INFO:tasks.workunit.client.1.smithi175.stdout:2/385: dread d1/d7/f34 [0,4194304] 0 2024-04-20T10:55:00.253 INFO:tasks.workunit.client.1.smithi175.stdout:1/454: rename d0/d8/l19 to d0/d8/d13/d2e/d35/la4 0 2024-04-20T10:55:00.254 INFO:tasks.workunit.client.1.smithi175.stdout:8/470: chown d7/d13/d1d/d24/c5c 386332 1 2024-04-20T10:55:00.256 INFO:tasks.workunit.client.1.smithi175.stdout:7/619: getdents db/d1d/d39/d50/dba/d47/da6/db9/dc8 0 2024-04-20T10:55:00.261 INFO:tasks.workunit.client.1.smithi175.stdout:2/386: truncate d1/d48/d21/d29/f50 1246588 0 2024-04-20T10:55:00.262 INFO:tasks.workunit.client.1.smithi175.stdout:0/478: mknod df/d1a/d3f/c97 0 2024-04-20T10:55:00.262 INFO:tasks.workunit.client.1.smithi175.stdout:0/479: truncate df/f3a 4752143 0 2024-04-20T10:55:00.279 INFO:tasks.workunit.client.1.smithi175.stdout:7/620: dwrite db/d1d/d39/d50/dba/d47/da6/fd3 [0,4194304] 0 2024-04-20T10:55:00.279 INFO:tasks.workunit.client.1.smithi175.stdout:7/621: fsync db/d1d/d39/d50/dba/d47/f94 0 2024-04-20T10:55:00.279 INFO:tasks.workunit.client.1.smithi175.stdout:7/622: chown db/d61 48 1 2024-04-20T10:55:00.279 INFO:tasks.workunit.client.1.smithi175.stdout:9/445: dwrite d6/f28 [0,4194304] 0 2024-04-20T10:55:00.279 INFO:tasks.workunit.client.1.smithi175.stdout:7/623: chown db/d1d/d39/d50/f55 6 1 2024-04-20T10:55:00.279 INFO:tasks.workunit.client.1.smithi175.stdout:7/624: chown db/d1d/d29/d2a/d41/d59/fd1 11 1 2024-04-20T10:55:00.279 INFO:tasks.workunit.client.1.smithi175.stdout:7/625: chown db/d1d/d60/d76/db6/fc9 5970 1 2024-04-20T10:55:00.280 INFO:tasks.workunit.client.1.smithi175.stdout:2/387: rmdir d1 39 2024-04-20T10:55:00.280 INFO:tasks.workunit.client.1.smithi175.stdout:2/388: chown d1/f81 126225 1 2024-04-20T10:55:00.281 INFO:tasks.workunit.client.1.smithi175.stdout:8/471: rename d7/d13/d1d/d24/d39/d6f/f82 to d7/d13/d1d/d24/d39/d6f/f90 0 2024-04-20T10:55:00.283 INFO:tasks.workunit.client.1.smithi175.stdout:9/446: rmdir d6/d1b/d42/d5b/d72 39 2024-04-20T10:55:00.286 INFO:tasks.workunit.client.1.smithi175.stdout:0/480: mkdir df/d1a/d98 0 2024-04-20T10:55:00.287 INFO:tasks.workunit.client.1.smithi175.stdout:7/626: symlink db/lde 0 2024-04-20T10:55:00.288 INFO:tasks.workunit.client.1.smithi175.stdout:2/389: symlink d1/d7/l85 0 2024-04-20T10:55:00.288 INFO:tasks.workunit.client.1.smithi175.stdout:0/481: rmdir df/d1a/d3f 39 2024-04-20T10:55:00.289 INFO:tasks.workunit.client.1.smithi175.stdout:9/447: symlink d6/d1b/d2f/l7e 0 2024-04-20T10:55:00.289 INFO:tasks.workunit.client.1.smithi175.stdout:7/627: creat db/fdf x:0 0 0 2024-04-20T10:55:00.293 INFO:tasks.workunit.client.1.smithi175.stdout:2/390: fsync f0 0 2024-04-20T10:55:00.293 INFO:tasks.workunit.client.1.smithi175.stdout:2/391: stat d1/d48/d21/d29/c14 0 2024-04-20T10:55:00.293 INFO:tasks.workunit.client.1.smithi175.stdout:1/455: dwrite d0/d29/f5c [0,4194304] 0 2024-04-20T10:55:00.294 INFO:tasks.workunit.client.1.smithi175.stdout:9/448: read - d6/d1b/d42/f50 zero size 2024-04-20T10:55:00.297 INFO:tasks.workunit.client.1.smithi175.stdout:1/456: rmdir d0/d3e/d61 39 2024-04-20T10:55:00.298 INFO:tasks.workunit.client.1.smithi175.stdout:0/482: link df/d19/f7a df/d17/d2f/f99 0 2024-04-20T10:55:00.305 INFO:tasks.workunit.client.1.smithi175.stdout:9/449: write d6/d1b/d42/f52 [823103,7945] 0 2024-04-20T10:55:00.305 INFO:tasks.workunit.client.1.smithi175.stdout:1/457: creat d0/d51/d6b/d9e/fa5 x:0 0 0 2024-04-20T10:55:00.307 INFO:tasks.workunit.client.1.smithi175.stdout:1/458: dread d0/d8/f18 [4194304,4194304] 0 2024-04-20T10:55:00.313 INFO:tasks.workunit.client.1.smithi175.stdout:2/392: dwrite d1/d48/d21/f37 [0,4194304] 0 2024-04-20T10:55:00.315 INFO:tasks.workunit.client.1.smithi175.stdout:1/459: dread d0/f1a [0,4194304] 0 2024-04-20T10:55:00.316 INFO:tasks.workunit.client.1.smithi175.stdout:0/483: readlink df/d1a/d28/l2c 0 2024-04-20T10:55:00.316 INFO:tasks.workunit.client.1.smithi175.stdout:0/484: truncate df/d1a/d3f/d5e/f7b 838460 0 2024-04-20T10:55:00.316 INFO:tasks.workunit.client.1.smithi175.stdout:0/485: chown df/d1a/d3f/d5e/f7b 216 1 2024-04-20T10:55:00.321 INFO:tasks.workunit.client.1.smithi175.stdout:7/628: dwrite db/d61/d6d/f7c [0,4194304] 0 2024-04-20T10:55:00.323 INFO:tasks.workunit.client.1.smithi175.stdout:9/450: rename d6/d33/d63/f4d to d6/d33/d60/d78/f7f 0 2024-04-20T10:55:00.323 INFO:tasks.workunit.client.1.smithi175.stdout:1/460: truncate d0/d8/d13/f26 4404238 0 2024-04-20T10:55:00.326 INFO:tasks.workunit.client.1.smithi175.stdout:9/451: creat d6/d1b/d42/d5b/d72/d7d/f80 x:0 0 0 2024-04-20T10:55:00.327 INFO:tasks.workunit.client.1.smithi175.stdout:1/461: creat d0/d8/d13/d2e/fa6 x:0 0 0 2024-04-20T10:55:00.329 INFO:tasks.workunit.client.1.smithi175.stdout:7/629: write db/d61/d6d/f7c [2012935,6530] 0 2024-04-20T10:55:00.331 INFO:tasks.workunit.client.1.smithi175.stdout:2/393: rename d1/c61 to d1/d48/d21/d76/c86 0 2024-04-20T10:55:00.331 INFO:tasks.workunit.client.1.smithi175.stdout:2/394: chown d1/d48/d38/d82/f7f 32 1 2024-04-20T10:55:00.331 INFO:tasks.workunit.client.1.smithi175.stdout:9/452: mkdir d6/d1b/d42/d79/d81 0 2024-04-20T10:55:00.332 INFO:tasks.workunit.client.1.smithi175.stdout:1/462: mknod d0/d3e/d61/ca7 0 2024-04-20T10:55:00.340 INFO:tasks.workunit.client.1.smithi175.stdout:0/486: write df/d17/d2f/d4f/f57 [2072807,112357] 0 2024-04-20T10:55:00.351 INFO:tasks.workunit.client.1.smithi175.stdout:1/463: dwrite d0/d8/d13/f60 [0,4194304] 0 2024-04-20T10:55:00.352 INFO:tasks.workunit.client.1.smithi175.stdout:2/395: symlink d1/d48/d38/d82/l87 0 2024-04-20T10:55:00.352 INFO:tasks.workunit.client.1.smithi175.stdout:9/453: chown d6/d1b/d26/c36 286352 1 2024-04-20T10:55:00.352 INFO:tasks.workunit.client.1.smithi175.stdout:9/454: truncate d6/d1b/f7a 920443 0 2024-04-20T10:55:00.355 INFO:tasks.workunit.client.1.smithi175.stdout:7/630: unlink db/d1d/f7d 0 2024-04-20T10:55:00.361 INFO:tasks.workunit.client.1.smithi175.stdout:1/464: write d0/d8/f30 [2070855,68175] 0 2024-04-20T10:55:00.362 INFO:tasks.workunit.client.1.smithi175.stdout:2/396: chown d1/d48/c2b 19983968 1 2024-04-20T10:55:00.362 INFO:tasks.workunit.client.1.smithi175.stdout:0/487: mkdir df/d1a/d22/d24/d9a 0 2024-04-20T10:55:00.373 INFO:tasks.workunit.client.1.smithi175.stdout:7/631: dwrite db/d1d/d39/d50/dba/d47/da6/db9/fc2 [0,4194304] 0 2024-04-20T10:55:00.373 INFO:tasks.workunit.client.1.smithi175.stdout:2/397: stat d1/d48/l1c 0 2024-04-20T10:55:00.373 INFO:tasks.workunit.client.1.smithi175.stdout:2/398: chown d1/d6a/f6e 464 1 2024-04-20T10:55:00.374 INFO:tasks.workunit.client.1.smithi175.stdout:0/488: mknod df/d1a/d22/d6a/c9b 0 2024-04-20T10:55:00.377 INFO:tasks.workunit.client.1.smithi175.stdout:9/455: write d6/fe [3885821,31491] 0 2024-04-20T10:55:00.380 INFO:tasks.workunit.client.1.smithi175.stdout:7/632: fsync db/d61/d6d/f7f 0 2024-04-20T10:55:00.380 INFO:tasks.workunit.client.1.smithi175.stdout:7/633: stat db/d61/d6d/dbc/cbe 0 2024-04-20T10:55:00.381 INFO:tasks.workunit.client.1.smithi175.stdout:1/465: mkdir d0/d51/da8 0 2024-04-20T10:55:00.382 INFO:tasks.workunit.client.1.smithi175.stdout:2/399: creat d1/d48/d38/f88 x:0 0 0 2024-04-20T10:55:00.382 INFO:tasks.workunit.client.1.smithi175.stdout:2/400: write d1/d48/d21/d29/f70 [899972,69570] 0 2024-04-20T10:55:00.386 INFO:tasks.workunit.client.1.smithi175.stdout:3/340: sync 2024-04-20T10:55:00.387 INFO:tasks.workunit.client.1.smithi175.stdout:5/609: sync 2024-04-20T10:55:00.387 INFO:tasks.workunit.client.1.smithi175.stdout:6/524: sync 2024-04-20T10:55:00.387 INFO:tasks.workunit.client.1.smithi175.stdout:4/503: sync 2024-04-20T10:55:00.387 INFO:tasks.workunit.client.1.smithi175.stdout:5/610: fdatasync db/d1f/d31/f33 0 2024-04-20T10:55:00.387 INFO:tasks.workunit.client.1.smithi175.stdout:5/611: fdatasync db/dc1/d4f/d5a/fb1 0 2024-04-20T10:55:00.390 INFO:tasks.workunit.client.1.smithi175.stdout:7/634: creat db/d1d/d39/fe0 x:0 0 0 2024-04-20T10:55:00.391 INFO:tasks.workunit.client.1.smithi175.stdout:2/401: symlink d1/d7/d63/d36/d7d/d84/l89 0 2024-04-20T10:55:00.391 INFO:tasks.workunit.client.1.smithi175.stdout:2/402: stat d1/d48/d38 0 2024-04-20T10:55:00.392 INFO:tasks.workunit.client.1.smithi175.stdout:3/341: getdents d7/d10 0 2024-04-20T10:55:00.396 INFO:tasks.workunit.client.1.smithi175.stdout:6/525: dread d1/d40/d46/d60/d68/d7e/f81 [0,4194304] 0 2024-04-20T10:55:00.398 INFO:tasks.workunit.client.1.smithi175.stdout:8/472: dread d7/d13/d1d/d56/f71 [0,4194304] 0 2024-04-20T10:55:00.400 INFO:tasks.workunit.client.1.smithi175.stdout:5/612: symlink db/d11/d25/d41/d83/lce 0 2024-04-20T10:55:00.400 INFO:tasks.workunit.client.1.smithi175.stdout:5/613: chown db/dc1 2338 1 2024-04-20T10:55:00.402 INFO:tasks.workunit.client.1.smithi175.stdout:1/466: dwrite d0/f8e [0,4194304] 0 2024-04-20T10:55:00.404 INFO:tasks.workunit.client.1.smithi175.stdout:7/635: creat db/d1d/d29/d2a/fe1 x:0 0 0 2024-04-20T10:55:00.405 INFO:tasks.workunit.client.1.smithi175.stdout:8/473: creat d7/d13/f91 x:0 0 0 2024-04-20T10:55:00.407 INFO:tasks.workunit.client.1.smithi175.stdout:0/489: dread df/d19/f34 [4194304,4194304] 0 2024-04-20T10:55:00.407 INFO:tasks.workunit.client.1.smithi175.stdout:0/490: chown df/d17/d2f/d4f/l82 837 1 2024-04-20T10:55:00.408 INFO:tasks.workunit.client.1.smithi175.stdout:5/614: symlink db/d11/d25/d38/d40/d66/d94/lcf 0 2024-04-20T10:55:00.408 INFO:tasks.workunit.client.1.smithi175.stdout:5/615: chown db/d1f/d31/da0/dcb 142381 1 2024-04-20T10:55:00.408 INFO:tasks.workunit.client.1.smithi175.stdout:5/616: chown db/d11/d25/d41/d60/fc5 60 1 2024-04-20T10:55:00.408 INFO:tasks.workunit.client.1.smithi175.stdout:1/467: creat d0/d3e/fa9 x:0 0 0 2024-04-20T10:55:00.409 INFO:tasks.workunit.client.1.smithi175.stdout:2/403: mkdir d1/d7/d63/d4b/d8a 0 2024-04-20T10:55:00.410 INFO:tasks.workunit.client.1.smithi175.stdout:0/491: creat df/d17/d2f/d4f/f9c x:0 0 0 2024-04-20T10:55:00.411 INFO:tasks.workunit.client.1.smithi175.stdout:0/492: chown df/d1a/d22/d55 5665 1 2024-04-20T10:55:00.411 INFO:tasks.workunit.client.1.smithi175.stdout:5/617: stat db/d9d/l64 0 2024-04-20T10:55:00.411 INFO:tasks.workunit.client.1.smithi175.stdout:5/618: truncate db/fbe 105525 0 2024-04-20T10:55:00.411 INFO:tasks.workunit.client.1.smithi175.stdout:9/456: dwrite d6/d1b/d42/f50 [0,4194304] 0 2024-04-20T10:55:00.413 INFO:tasks.workunit.client.1.smithi175.stdout:7/636: mknod db/d1d/d29/d9a/ce2 0 2024-04-20T10:55:00.414 INFO:tasks.workunit.client.1.smithi175.stdout:4/504: dwrite d4/d27/d61/f7a [0,4194304] 0 2024-04-20T10:55:00.415 INFO:tasks.workunit.client.1.smithi175.stdout:2/404: dread d1/d48/f27 [0,4194304] 0 2024-04-20T10:55:00.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/493: mknod df/d1a/d22/d6a/c9d 0 2024-04-20T10:55:00.417 INFO:tasks.workunit.client.1.smithi175.stdout:1/468: rename d0/d8/d13/f1b to d0/d8/d13/faa 0 2024-04-20T10:55:00.417 INFO:tasks.workunit.client.1.smithi175.stdout:1/469: dread - d0/d8/f71 zero size 2024-04-20T10:55:00.419 INFO:tasks.workunit.client.1.smithi175.stdout:3/342: dwrite d7/d21/f2f [0,4194304] 0 2024-04-20T10:55:00.419 INFO:tasks.workunit.client.1.smithi175.stdout:4/505: readlink d4/dd/d54/l7c 0 2024-04-20T10:55:00.420 INFO:tasks.workunit.client.1.smithi175.stdout:2/405: mkdir d1/d7/d63/d36/d7d/d84/d8b 0 2024-04-20T10:55:00.422 INFO:tasks.workunit.client.1.smithi175.stdout:7/637: mknod db/d1d/d60/ce3 0 2024-04-20T10:55:00.422 INFO:tasks.workunit.client.1.smithi175.stdout:7/638: fsync db/d1d/d29/d8e/f32 0 2024-04-20T10:55:00.423 INFO:tasks.workunit.client.1.smithi175.stdout:6/526: dread d1/d5/d12/d22/f44 [0,4194304] 0 2024-04-20T10:55:00.424 INFO:tasks.workunit.client.1.smithi175.stdout:2/406: readlink d1/d7/l2e 0 2024-04-20T10:55:00.425 INFO:tasks.workunit.client.1.smithi175.stdout:0/494: unlink df/d19/l41 0 2024-04-20T10:55:00.425 INFO:tasks.workunit.client.1.smithi175.stdout:8/474: dwrite d7/d13/f22 [0,4194304] 0 2024-04-20T10:55:00.426 INFO:tasks.workunit.client.1.smithi175.stdout:1/470: unlink d0/d8/d13/d2e/f47 0 2024-04-20T10:55:00.426 INFO:tasks.workunit.client.1.smithi175.stdout:1/471: chown d0/f1e 2 1 2024-04-20T10:55:00.428 INFO:tasks.workunit.client.1.smithi175.stdout:3/343: mknod d7/d19/d33/d60/d50/c72 0 2024-04-20T10:55:00.428 INFO:tasks.workunit.client.1.smithi175.stdout:4/506: dread d4/f31 [0,4194304] 0 2024-04-20T10:55:00.428 INFO:tasks.workunit.client.1.smithi175.stdout:4/507: fdatasync d4/dd/d54/d5d/f8e 0 2024-04-20T10:55:00.430 INFO:tasks.workunit.client.1.smithi175.stdout:4/508: write d4/dd/d5e/f6b [399632,30197] 0 2024-04-20T10:55:00.431 INFO:tasks.workunit.client.1.smithi175.stdout:6/527: creat d1/d40/d63/d7c/fb5 x:0 0 0 2024-04-20T10:55:00.431 INFO:tasks.workunit.client.1.smithi175.stdout:6/528: chown d1/d40 154 1 2024-04-20T10:55:00.431 INFO:tasks.workunit.client.1.smithi175.stdout:6/529: readlink d1/d5/d12/d22/lad 0 2024-04-20T10:55:00.432 INFO:tasks.workunit.client.1.smithi175.stdout:2/407: creat d1/d48/d21/d29/f8c x:0 0 0 2024-04-20T10:55:00.434 INFO:tasks.workunit.client.1.smithi175.stdout:8/475: write d7/d13/d1d/d24/f5d [1654765,78303] 0 2024-04-20T10:55:00.434 INFO:tasks.workunit.client.1.smithi175.stdout:8/476: truncate d7/d13/d1d/d24/d38/f77 1173845 0 2024-04-20T10:55:00.435 INFO:tasks.workunit.client.1.smithi175.stdout:1/472: creat d0/d8/d13/d79/d8c/fab x:0 0 0 2024-04-20T10:55:00.438 INFO:tasks.workunit.client.1.smithi175.stdout:6/530: getdents d1/d5/d12/d22 0 2024-04-20T10:55:00.439 INFO:tasks.workunit.client.1.smithi175.stdout:0/495: symlink df/d1a/d3f/l9e 0 2024-04-20T10:55:00.440 INFO:tasks.workunit.client.1.smithi175.stdout:7/639: dwrite db/d1d/d29/d2a/f84 [0,4194304] 0 2024-04-20T10:55:00.440 INFO:tasks.workunit.client.1.smithi175.stdout:8/477: fdatasync d7/d13/d1d/d24/d38/f57 0 2024-04-20T10:55:00.442 INFO:tasks.workunit.client.1.smithi175.stdout:1/473: mkdir d0/d8/d13/d79/d8c/dac 0 2024-04-20T10:55:00.442 INFO:tasks.workunit.client.1.smithi175.stdout:3/344: creat d7/d19/d2a/d59/f73 x:0 0 0 2024-04-20T10:55:00.445 INFO:tasks.workunit.client.1.smithi175.stdout:8/478: getdents d7/d13/d1d/d24/d26 0 2024-04-20T10:55:00.445 INFO:tasks.workunit.client.1.smithi175.stdout:8/479: fdatasync d7/d13/f40 0 2024-04-20T10:55:00.446 INFO:tasks.workunit.client.1.smithi175.stdout:1/474: truncate d0/d8/f1f 4422382 0 2024-04-20T10:55:00.448 INFO:tasks.workunit.client.1.smithi175.stdout:6/531: symlink d1/lb6 0 2024-04-20T10:55:00.449 INFO:tasks.workunit.client.1.smithi175.stdout:2/408: dwrite d1/f6d [0,4194304] 0 2024-04-20T10:55:00.450 INFO:tasks.workunit.client.1.smithi175.stdout:0/496: symlink df/d1a/d22/d6a/d72/d48/d4e/l9f 0 2024-04-20T10:55:00.450 INFO:tasks.workunit.client.1.smithi175.stdout:0/497: fdatasync df/d1a/d3f/d5e/f7b 0 2024-04-20T10:55:00.451 INFO:tasks.workunit.client.1.smithi175.stdout:7/640: symlink db/d1d/d60/d76/db6/le4 0 2024-04-20T10:55:00.455 INFO:tasks.workunit.client.1.smithi175.stdout:1/475: rename d0/d8/f5f to d0/d51/d6b/fad 0 2024-04-20T10:55:00.460 INFO:tasks.workunit.client.1.smithi175.stdout:2/409: creat d1/d7/d63/d36/f8d x:0 0 0 2024-04-20T10:55:00.460 INFO:tasks.workunit.client.1.smithi175.stdout:2/410: write f0 [105415,99765] 0 2024-04-20T10:55:00.462 INFO:tasks.workunit.client.1.smithi175.stdout:4/509: mknod d4/dd/d2d/d33/d3c/d44/cb4 0 2024-04-20T10:55:00.465 INFO:tasks.workunit.client.1.smithi175.stdout:1/476: creat d0/d57/d7a/fae x:0 0 0 2024-04-20T10:55:00.465 INFO:tasks.workunit.client.1.smithi175.stdout:1/477: stat d0/c31 0 2024-04-20T10:55:00.473 INFO:tasks.workunit.client.1.smithi175.stdout:6/532: dwrite d1/d40/d46/d60/fac [0,4194304] 0 2024-04-20T10:55:00.475 INFO:tasks.workunit.client.1.smithi175.stdout:0/498: symlink df/d1a/la0 0 2024-04-20T10:55:00.476 INFO:tasks.workunit.client.1.smithi175.stdout:0/499: read - df/d1a/d3f/f6f zero size 2024-04-20T10:55:00.476 INFO:tasks.workunit.client.1.smithi175.stdout:0/500: dread - df/d1a/d22/d6a/d72/f95 zero size 2024-04-20T10:55:00.476 INFO:tasks.workunit.client.1.smithi175.stdout:0/501: write df/d1a/d22/d6a/d72/f95 [915927,66130] 0 2024-04-20T10:55:00.476 INFO:tasks.workunit.client.1.smithi175.stdout:4/510: chown d4/dd/d2d/d33/l45 56 1 2024-04-20T10:55:00.479 INFO:tasks.workunit.client.1.smithi175.stdout:1/478: dread d0/fe [0,4194304] 0 2024-04-20T10:55:00.480 INFO:tasks.workunit.client.1.smithi175.stdout:2/411: dwrite d1/d48/d21/d29/f6c [0,4194304] 0 2024-04-20T10:55:00.480 INFO:tasks.workunit.client.1.smithi175.stdout:2/412: read d1/d7/f34 [1191079,105887] 0 2024-04-20T10:55:00.480 INFO:tasks.workunit.client.1.smithi175.stdout:2/413: chown d1/d7/d63/f79 68250362 1 2024-04-20T10:55:00.484 INFO:tasks.workunit.client.1.smithi175.stdout:0/502: mkdir df/d1a/da1 0 2024-04-20T10:55:00.485 INFO:tasks.workunit.client.1.smithi175.stdout:8/480: truncate d7/d13/d1d/d24/d39/d6f/f90 186460 0 2024-04-20T10:55:00.487 INFO:tasks.workunit.client.1.smithi175.stdout:3/345: dwrite d7/d19/d33/d60/f44 [0,4194304] 0 2024-04-20T10:55:00.487 INFO:tasks.workunit.client.1.smithi175.stdout:3/346: stat d7/d19/d2a/d59/f73 0 2024-04-20T10:55:00.487 INFO:tasks.workunit.client.1.smithi175.stdout:3/347: chown d7/d21/d16/d22/d2c/d1f 158803209 1 2024-04-20T10:55:00.487 INFO:tasks.workunit.client.1.smithi175.stdout:3/348: truncate d7/d21/d67/f6f 780203 0 2024-04-20T10:55:00.487 INFO:tasks.workunit.client.1.smithi175.stdout:2/414: readlink d1/d7/l3c 0 2024-04-20T10:55:00.488 INFO:tasks.workunit.client.1.smithi175.stdout:2/415: chown d1/d48/d21/c3f 52 1 2024-04-20T10:55:00.488 INFO:tasks.workunit.client.1.smithi175.stdout:6/533: symlink d1/d37/d83/lb7 0 2024-04-20T10:55:00.489 INFO:tasks.workunit.client.1.smithi175.stdout:1/479: mkdir d0/d8/d13/d2e/daf 0 2024-04-20T10:55:00.490 INFO:tasks.workunit.client.1.smithi175.stdout:8/481: stat d7/d13/d1d/d24/l65 0 2024-04-20T10:55:00.499 INFO:tasks.workunit.client.1.smithi175.stdout:4/511: dwrite d4/d27/d61/f92 [0,4194304] 0 2024-04-20T10:55:00.500 INFO:tasks.workunit.client.1.smithi175.stdout:6/534: rmdir d1 39 2024-04-20T10:55:00.501 INFO:tasks.workunit.client.1.smithi175.stdout:0/503: mkdir df/d1a/d22/d55/da2 0 2024-04-20T10:55:00.501 INFO:tasks.workunit.client.1.smithi175.stdout:0/504: chown df/d19/f34 11080 1 2024-04-20T10:55:00.502 INFO:tasks.workunit.client.1.smithi175.stdout:3/349: symlink d7/d21/d16/d49/d54/l74 0 2024-04-20T10:55:00.504 INFO:tasks.workunit.client.1.smithi175.stdout:1/480: dread d0/d8/d13/d2e/f38 [0,4194304] 0 2024-04-20T10:55:00.504 INFO:tasks.workunit.client.1.smithi175.stdout:1/481: chown d0/d8/d13/d79/c9c 1929940 1 2024-04-20T10:55:00.504 INFO:tasks.workunit.client.1.smithi175.stdout:1/482: chown d0/f93 1599 1 2024-04-20T10:55:00.505 INFO:tasks.workunit.client.1.smithi175.stdout:4/512: dread - d4/dd/d54/f7e zero size 2024-04-20T10:55:00.509 INFO:tasks.workunit.client.1.smithi175.stdout:4/513: dread d4/d27/f2c [0,4194304] 0 2024-04-20T10:55:00.511 INFO:tasks.workunit.client.1.smithi175.stdout:0/505: creat df/d17/fa3 x:0 0 0 2024-04-20T10:55:00.511 INFO:tasks.workunit.client.1.smithi175.stdout:0/506: write df/d17/d2f/f8b [525486,112570] 0 2024-04-20T10:55:00.512 INFO:tasks.workunit.client.1.smithi175.stdout:1/483: getdents d0/d51 0 2024-04-20T10:55:00.512 INFO:tasks.workunit.client.1.smithi175.stdout:1/484: write d0/d8/d13/f26 [2890878,28191] 0 2024-04-20T10:55:00.513 INFO:tasks.workunit.client.1.smithi175.stdout:4/514: creat d4/dd/d54/d5d/d8a/da4/fb5 x:0 0 0 2024-04-20T10:55:00.516 INFO:tasks.workunit.client.1.smithi175.stdout:8/482: dwrite d7/d13/d1d/f88 [0,4194304] 0 2024-04-20T10:55:00.518 INFO:tasks.workunit.client.1.smithi175.stdout:6/535: rename d1/d40/d46 to d1/d37/d83/db8 0 2024-04-20T10:55:00.521 INFO:tasks.workunit.client.1.smithi175.stdout:3/350: mknod d7/d21/d16/c75 0 2024-04-20T10:55:00.521 INFO:tasks.workunit.client.1.smithi175.stdout:1/485: truncate d0/d8/f5e 2034321 0 2024-04-20T10:55:00.522 INFO:tasks.workunit.client.1.smithi175.stdout:2/416: dwrite d1/d48/f41 [0,4194304] 0 2024-04-20T10:55:00.525 INFO:tasks.workunit.client.1.smithi175.stdout:5/619: dread db/fbe [0,4194304] 0 2024-04-20T10:55:00.530 INFO:tasks.workunit.client.1.smithi175.stdout:1/486: dread d0/d8/d13/f2d [0,4194304] 0 2024-04-20T10:55:00.535 INFO:tasks.workunit.client.1.smithi175.stdout:4/515: dwrite d4/d27/f7b [0,4194304] 0 2024-04-20T10:55:00.538 INFO:tasks.workunit.client.1.smithi175.stdout:2/417: creat d1/d7/d63/d36/d7d/f8e x:0 0 0 2024-04-20T10:55:00.538 INFO:tasks.workunit.client.1.smithi175.stdout:2/418: readlink d1/d48/d21/l4f 0 2024-04-20T10:55:00.538 INFO:tasks.workunit.client.1.smithi175.stdout:2/419: chown d1/d48/l75 3720400 1 2024-04-20T10:55:00.538 INFO:tasks.workunit.client.1.smithi175.stdout:2/420: write d1/d7/d63/f79 [44803,16729] 0 2024-04-20T10:55:00.540 INFO:tasks.workunit.client.1.smithi175.stdout:0/507: write f3 [2333658,101287] 0 2024-04-20T10:55:00.540 INFO:tasks.workunit.client.1.smithi175.stdout:0/508: fsync df/d1a/d28/f73 0 2024-04-20T10:55:00.540 INFO:tasks.workunit.client.1.smithi175.stdout:0/509: fsync df/d1a/d22/d6a/d72/d48/f49 0 2024-04-20T10:55:00.541 INFO:tasks.workunit.client.1.smithi175.stdout:8/483: rename d7/d55 to d7/d13/d1d/d92 0 2024-04-20T10:55:00.541 INFO:tasks.workunit.client.1.smithi175.stdout:8/484: chown d7/d13/f87 1375 1 2024-04-20T10:55:00.541 INFO:tasks.workunit.client.1.smithi175.stdout:8/485: chown d7/d13/d1d/f1e 49148233 1 2024-04-20T10:55:00.541 INFO:tasks.workunit.client.1.smithi175.stdout:8/486: fdatasync d7/d13/f17 0 2024-04-20T10:55:00.541 INFO:tasks.workunit.client.1.smithi175.stdout:4/516: chown d4/d27/l37 0 1 2024-04-20T10:55:00.544 INFO:tasks.workunit.client.1.smithi175.stdout:8/487: mknod d7/d13/d1d/d92/d6c/c93 0 2024-04-20T10:55:00.545 INFO:tasks.workunit.client.1.smithi175.stdout:2/421: truncate d1/d48/d21/d29/f19 5878337 0 2024-04-20T10:55:00.547 INFO:tasks.workunit.client.1.smithi175.stdout:5/620: dwrite db/dc1/f5c [0,4194304] 0 2024-04-20T10:55:00.547 INFO:tasks.workunit.client.1.smithi175.stdout:1/487: dread d0/d8/d13/d2e/f38 [0,4194304] 0 2024-04-20T10:55:00.549 INFO:tasks.workunit.client.1.smithi175.stdout:2/422: rmdir d1/d48 39 2024-04-20T10:55:00.550 INFO:tasks.workunit.client.1.smithi175.stdout:8/488: symlink d7/d13/d1d/d24/l94 0 2024-04-20T10:55:00.550 INFO:tasks.workunit.client.1.smithi175.stdout:8/489: truncate d7/d13/d1d/d24/d38/f77 1184793 0 2024-04-20T10:55:00.551 INFO:tasks.workunit.client.1.smithi175.stdout:3/351: write d7/d10/f31 [80167,16394] 0 2024-04-20T10:55:00.552 INFO:tasks.workunit.client.1.smithi175.stdout:5/621: rmdir db/dc1/d4f/d75/d91 39 2024-04-20T10:55:00.552 INFO:tasks.workunit.client.1.smithi175.stdout:1/488: truncate d0/d8/f45 4616927 0 2024-04-20T10:55:00.554 INFO:tasks.workunit.client.1.smithi175.stdout:4/517: link d4/f38 d4/dd/d2d/d33/d3c/d44/fb6 0 2024-04-20T10:55:00.554 INFO:tasks.workunit.client.1.smithi175.stdout:4/518: read d4/d27/f17 [2750447,82497] 0 2024-04-20T10:55:00.554 INFO:tasks.workunit.client.1.smithi175.stdout:2/423: creat d1/d7/d63/d36/d7d/f8f x:0 0 0 2024-04-20T10:55:00.555 INFO:tasks.workunit.client.1.smithi175.stdout:8/490: fsync d7/d13/d1d/f47 0 2024-04-20T10:55:00.557 INFO:tasks.workunit.client.1.smithi175.stdout:1/489: creat d0/d8/d13/d2e/d35/d8a/fb0 x:0 0 0 2024-04-20T10:55:00.561 INFO:tasks.workunit.client.1.smithi175.stdout:5/622: write db/d30/d46/f7e [3073904,104668] 0 2024-04-20T10:55:00.563 INFO:tasks.workunit.client.1.smithi175.stdout:4/519: dread d4/f38 [0,4194304] 0 2024-04-20T10:55:00.564 INFO:tasks.workunit.client.1.smithi175.stdout:2/424: symlink d1/d48/d21/l90 0 2024-04-20T10:55:00.564 INFO:tasks.workunit.client.1.smithi175.stdout:2/425: read - d1/d7/d63/d36/d7d/f8f zero size 2024-04-20T10:55:00.565 INFO:tasks.workunit.client.1.smithi175.stdout:0/510: dwrite df/d1a/d3f/f88 [0,4194304] 0 2024-04-20T10:55:00.567 INFO:tasks.workunit.client.1.smithi175.stdout:3/352: link d7/d19/d33/d60/f6c d7/d21/f76 0 2024-04-20T10:55:00.570 INFO:tasks.workunit.client.1.smithi175.stdout:6/536: read d1/f3e [3233039,29316] 0 2024-04-20T10:55:00.570 INFO:tasks.workunit.client.1.smithi175.stdout:4/520: creat d4/dd/fb7 x:0 0 0 2024-04-20T10:55:00.570 INFO:tasks.workunit.client.1.smithi175.stdout:4/521: fsync d4/dd/d2d/d33/d58/f9f 0 2024-04-20T10:55:00.574 INFO:tasks.workunit.client.1.smithi175.stdout:5/623: dread db/d30/d46/fab [0,4194304] 0 2024-04-20T10:55:00.599 INFO:tasks.workunit.client.1.smithi175.stdout:1/490: dwrite d0/d29/f4f [0,4194304] 0 2024-04-20T10:55:00.601 INFO:tasks.workunit.client.1.smithi175.stdout:2/426: dwrite d1/d48/f41 [0,4194304] 0 2024-04-20T10:55:00.601 INFO:tasks.workunit.client.1.smithi175.stdout:5/624: getdents db/d11/d6d 0 2024-04-20T10:55:00.601 INFO:tasks.workunit.client.1.smithi175.stdout:5/625: dread - db/d11/d25/d38/d40/fad zero size 2024-04-20T10:55:00.602 INFO:tasks.workunit.client.1.smithi175.stdout:5/626: dread - db/d11/d1a/f76 zero size 2024-04-20T10:55:00.602 INFO:tasks.workunit.client.1.smithi175.stdout:8/491: dwrite d7/d13/d1d/d24/d63/f69 [0,4194304] 0 2024-04-20T10:55:00.602 INFO:tasks.workunit.client.1.smithi175.stdout:3/353: dwrite d7/d21/f76 [0,4194304] 0 2024-04-20T10:55:00.602 INFO:tasks.workunit.client.1.smithi175.stdout:2/427: write d1/d48/d21/d29/f24 [508919,27365] 0 2024-04-20T10:55:00.602 INFO:tasks.workunit.client.1.smithi175.stdout:2/428: write d1/d7/f6f [555514,84121] 0 2024-04-20T10:55:00.603 INFO:tasks.workunit.client.1.smithi175.stdout:2/429: chown d1/d6a/d74 100848 1 2024-04-20T10:55:00.603 INFO:tasks.workunit.client.1.smithi175.stdout:2/430: write f0 [2031179,45785] 0 2024-04-20T10:55:00.603 INFO:tasks.workunit.client.1.smithi175.stdout:1/491: chown d0/d8/lc 224 1 2024-04-20T10:55:00.605 INFO:tasks.workunit.client.1.smithi175.stdout:6/537: mkdir d1/d37/d83/db8/db9 0 2024-04-20T10:55:00.605 INFO:tasks.workunit.client.1.smithi175.stdout:0/511: dread df/d17/d2f/f99 [0,4194304] 0 2024-04-20T10:55:00.606 INFO:tasks.workunit.client.1.smithi175.stdout:5/627: rmdir db/d11/d25/d41 39 2024-04-20T10:55:00.606 INFO:tasks.workunit.client.1.smithi175.stdout:6/538: read d1/d5/f6 [727238,102101] 0 2024-04-20T10:55:00.606 INFO:tasks.workunit.client.1.smithi175.stdout:2/431: dread d1/d7/d63/f79 [0,4194304] 0 2024-04-20T10:55:00.607 INFO:tasks.workunit.client.1.smithi175.stdout:8/492: creat d7/d13/d1d/d24/f95 x:0 0 0 2024-04-20T10:55:00.610 INFO:tasks.workunit.client.1.smithi175.stdout:3/354: readlink d7/d19/l24 0 2024-04-20T10:55:00.610 INFO:tasks.workunit.client.1.smithi175.stdout:3/355: truncate d7/d19/d33/d60/f6c 4590067 0 2024-04-20T10:55:00.611 INFO:tasks.workunit.client.1.smithi175.stdout:4/522: mknod d4/dd/d2d/d33/d58/d67/cb8 0 2024-04-20T10:55:00.611 INFO:tasks.workunit.client.1.smithi175.stdout:4/523: stat d4/d27/f1c 0 2024-04-20T10:55:00.612 INFO:tasks.workunit.client.1.smithi175.stdout:0/512: creat df/d1a/d3f/d5e/fa4 x:0 0 0 2024-04-20T10:55:00.612 INFO:tasks.workunit.client.1.smithi175.stdout:0/513: truncate df/d19/f8a 945462 0 2024-04-20T10:55:00.613 INFO:tasks.workunit.client.1.smithi175.stdout:5/628: creat db/d30/d46/fd0 x:0 0 0 2024-04-20T10:55:00.614 INFO:tasks.workunit.client.1.smithi175.stdout:5/629: stat db/d30/d46/d88/db2 0 2024-04-20T10:55:00.614 INFO:tasks.workunit.client.1.smithi175.stdout:6/539: write d1/d37/d83/db8/d60/d6b/f7d [730825,34074] 0 2024-04-20T10:55:00.615 INFO:tasks.workunit.client.1.smithi175.stdout:2/432: getdents d1/d7/d63/d36/d7d 0 2024-04-20T10:55:00.615 INFO:tasks.workunit.client.1.smithi175.stdout:2/433: readlink d1/d7/l2e 0 2024-04-20T10:55:00.616 INFO:tasks.workunit.client.1.smithi175.stdout:8/493: creat d7/d13/d1d/d56/f96 x:0 0 0 2024-04-20T10:55:00.618 INFO:tasks.workunit.client.1.smithi175.stdout:0/514: truncate df/d1a/d22/d24/f68 253605 0 2024-04-20T10:55:00.618 INFO:tasks.workunit.client.1.smithi175.stdout:0/515: dread - df/f81 zero size 2024-04-20T10:55:00.618 INFO:tasks.workunit.client.1.smithi175.stdout:0/516: dread - df/d17/d2f/d4f/f84 zero size 2024-04-20T10:55:00.619 INFO:tasks.workunit.client.1.smithi175.stdout:6/540: creat d1/d37/fba x:0 0 0 2024-04-20T10:55:00.620 INFO:tasks.workunit.client.1.smithi175.stdout:2/434: creat d1/f91 x:0 0 0 2024-04-20T10:55:00.621 INFO:tasks.workunit.client.1.smithi175.stdout:5/630: write db/d1f/f27 [2539505,68977] 0 2024-04-20T10:55:00.623 INFO:tasks.workunit.client.1.smithi175.stdout:3/356: unlink d7/d19/l3f 0 2024-04-20T10:55:00.625 INFO:tasks.workunit.client.1.smithi175.stdout:4/524: rename d4/dd/ce to d4/dd/d2d/d33/d5b/d65/cb9 0 2024-04-20T10:55:00.625 INFO:tasks.workunit.client.1.smithi175.stdout:9/457: sync 2024-04-20T10:55:00.625 INFO:tasks.workunit.client.1.smithi175.stdout:7/641: sync 2024-04-20T10:55:00.625 INFO:tasks.workunit.client.1.smithi175.stdout:9/458: fsync d6/d1b/d2f/f41 0 2024-04-20T10:55:00.628 INFO:tasks.workunit.client.1.smithi175.stdout:8/494: link d7/f18 d7/d13/d1d/d92/d6c/f97 0 2024-04-20T10:55:00.630 INFO:tasks.workunit.client.1.smithi175.stdout:5/631: symlink db/d11/d25/d38/d89/ld1 0 2024-04-20T10:55:00.630 INFO:tasks.workunit.client.1.smithi175.stdout:5/632: dread - db/d11/d25/d38/f96 zero size 2024-04-20T10:55:00.631 INFO:tasks.workunit.client.1.smithi175.stdout:7/642: rmdir db/d1d/d29 39 2024-04-20T10:55:00.633 INFO:tasks.workunit.client.1.smithi175.stdout:8/495: chown d7/d13/f12 29 1 2024-04-20T10:55:00.633 INFO:tasks.workunit.client.1.smithi175.stdout:5/633: creat db/d30/d46/fd2 x:0 0 0 2024-04-20T10:55:00.634 INFO:tasks.workunit.client.1.smithi175.stdout:4/525: mkdir d4/dd/dba 0 2024-04-20T10:55:00.635 INFO:tasks.workunit.client.1.smithi175.stdout:9/459: symlink d6/d10/l82 0 2024-04-20T10:55:00.635 INFO:tasks.workunit.client.1.smithi175.stdout:9/460: chown d6/d1b/d2f/l66 527857 1 2024-04-20T10:55:00.635 INFO:tasks.workunit.client.1.smithi175.stdout:9/461: readlink d6/d10/l82 0 2024-04-20T10:55:00.636 INFO:tasks.workunit.client.1.smithi175.stdout:8/496: creat d7/d13/d1d/f98 x:0 0 0 2024-04-20T10:55:00.636 INFO:tasks.workunit.client.1.smithi175.stdout:8/497: chown d7/d13/d1d/d92/c6d 35735438 1 2024-04-20T10:55:00.636 INFO:tasks.workunit.client.1.smithi175.stdout:8/498: chown d7/d13/d1d/d24/d39/d6f/f61 42526610 1 2024-04-20T10:55:00.636 INFO:tasks.workunit.client.1.smithi175.stdout:7/643: dread db/d1d/d39/d50/f28 [0,4194304] 0 2024-04-20T10:55:00.638 INFO:tasks.workunit.client.1.smithi175.stdout:7/644: dread db/fd [0,4194304] 0 2024-04-20T10:55:00.639 INFO:tasks.workunit.client.1.smithi175.stdout:5/634: rmdir db/d11/d25/d41 39 2024-04-20T10:55:00.644 INFO:tasks.workunit.client.1.smithi175.stdout:0/517: dwrite df/d1a/d3f/f88 [0,4194304] 0 2024-04-20T10:55:00.644 INFO:tasks.workunit.client.1.smithi175.stdout:0/518: write df/d17/d2f/f5b [940514,7853] 0 2024-04-20T10:55:00.645 INFO:tasks.workunit.client.1.smithi175.stdout:7/645: symlink db/d1d/d29/d2a/d41/d59/db3/le5 0 2024-04-20T10:55:00.645 INFO:tasks.workunit.client.1.smithi175.stdout:3/357: dwrite d7/d21/f41 [0,4194304] 0 2024-04-20T10:55:00.645 INFO:tasks.workunit.client.1.smithi175.stdout:0/519: creat df/d19/fa5 x:0 0 0 2024-04-20T10:55:00.646 INFO:tasks.workunit.client.1.smithi175.stdout:0/520: chown df/d17/d2f/d4f 18967851 1 2024-04-20T10:55:00.646 INFO:tasks.workunit.client.1.smithi175.stdout:4/526: rename d4/dd/d5e/d74/f8d to d4/dd/d54/d5d/d8a/fbb 0 2024-04-20T10:55:00.647 INFO:tasks.workunit.client.1.smithi175.stdout:9/462: mknod d6/d1b/c83 0 2024-04-20T10:55:00.647 INFO:tasks.workunit.client.1.smithi175.stdout:9/463: chown d6/d33/d63/f73 2803733 1 2024-04-20T10:55:00.647 INFO:tasks.workunit.client.1.smithi175.stdout:3/358: chown d7/d21/f5c 135101620 1 2024-04-20T10:55:00.651 INFO:tasks.workunit.client.1.smithi175.stdout:5/635: link db/d11/d25/c5e db/d30/d46/cd3 0 2024-04-20T10:55:00.651 INFO:tasks.workunit.client.1.smithi175.stdout:0/521: truncate df/d19/f3b 654812 0 2024-04-20T10:55:00.651 INFO:tasks.workunit.client.1.smithi175.stdout:4/527: dread d4/dd/d54/d5d/d9e/f64 [0,4194304] 0 2024-04-20T10:55:00.653 INFO:tasks.workunit.client.1.smithi175.stdout:3/359: unlink d7/d21/f5c 0 2024-04-20T10:55:00.654 INFO:tasks.workunit.client.1.smithi175.stdout:5/636: link db/dc1/d4f/d75/f97 db/d11/d6d/da1/dcc/fd4 0 2024-04-20T10:55:00.656 INFO:tasks.workunit.client.1.smithi175.stdout:4/528: mkdir d4/dd/d5e/d74/da1/dbc 0 2024-04-20T10:55:00.656 INFO:tasks.workunit.client.1.smithi175.stdout:4/529: getdents d4/dd/dba 0 2024-04-20T10:55:00.658 INFO:tasks.workunit.client.1.smithi175.stdout:8/499: rename d7/d13/d1d/l34 to d7/d13/d1d/d24/d39/l99 0 2024-04-20T10:55:00.658 INFO:tasks.workunit.client.1.smithi175.stdout:5/637: dread db/d30/d46/f7e [0,4194304] 0 2024-04-20T10:55:00.660 INFO:tasks.workunit.client.1.smithi175.stdout:0/522: symlink df/la6 0 2024-04-20T10:55:00.662 INFO:tasks.workunit.client.1.smithi175.stdout:5/638: creat db/d11/d80/dc3/fd5 x:0 0 0 2024-04-20T10:55:00.663 INFO:tasks.workunit.client.1.smithi175.stdout:7/646: dwrite db/d1d/d29/d8e/f4d [0,4194304] 0 2024-04-20T10:55:00.666 INFO:tasks.workunit.client.1.smithi175.stdout:2/435: dwrite d1/d7/f72 [0,4194304] 0 2024-04-20T10:55:00.666 INFO:tasks.workunit.client.1.smithi175.stdout:2/436: readlink d1/d48/d38/d82/l87 0 2024-04-20T10:55:00.667 INFO:tasks.workunit.client.1.smithi175.stdout:2/437: dread - d1/f91 zero size 2024-04-20T10:55:00.669 INFO:tasks.workunit.client.1.smithi175.stdout:2/438: symlink d1/d48/d38/d82/l92 0 2024-04-20T10:55:00.669 INFO:tasks.workunit.client.1.smithi175.stdout:2/439: readlink d1/d6a/d74/l7a 0 2024-04-20T10:55:00.670 INFO:tasks.workunit.client.1.smithi175.stdout:2/440: dread - d1/f91 zero size 2024-04-20T10:55:00.676 INFO:tasks.workunit.client.1.smithi175.stdout:5/639: getdents db/d11/d6d/da1/dcc 0 2024-04-20T10:55:00.681 INFO:tasks.workunit.client.1.smithi175.stdout:5/640: dread db/f1b [0,4194304] 0 2024-04-20T10:55:00.681 INFO:tasks.workunit.client.1.smithi175.stdout:5/641: fsync db/d11/d25/faa 0 2024-04-20T10:55:00.683 INFO:tasks.workunit.client.1.smithi175.stdout:0/523: dwrite df/d1a/d22/d6a/d72/f95 [0,4194304] 0 2024-04-20T10:55:00.684 INFO:tasks.workunit.client.1.smithi175.stdout:4/530: dwrite d4/d27/f17 [0,4194304] 0 2024-04-20T10:55:00.686 INFO:tasks.workunit.client.1.smithi175.stdout:0/524: rmdir df/d1a/d22/d24 39 2024-04-20T10:55:00.687 INFO:tasks.workunit.client.1.smithi175.stdout:5/642: mknod db/dc1/cd6 0 2024-04-20T10:55:00.687 INFO:tasks.workunit.client.1.smithi175.stdout:5/643: write db/dc1/d4f/d5a/fb1 [88658,20639] 0 2024-04-20T10:55:00.687 INFO:tasks.workunit.client.1.smithi175.stdout:5/644: truncate db/d1f/d31/fcd 244740 0 2024-04-20T10:55:00.690 INFO:tasks.workunit.client.1.smithi175.stdout:4/531: rename d4/dd/d54/d5d/d79/la2 to d4/dd/d5e/lbd 0 2024-04-20T10:55:00.690 INFO:tasks.workunit.client.1.smithi175.stdout:0/525: mknod df/d1a/d3f/d5e/ca7 0 2024-04-20T10:55:00.691 INFO:tasks.workunit.client.1.smithi175.stdout:5/645: mkdir db/dd7 0 2024-04-20T10:55:00.691 INFO:tasks.workunit.client.1.smithi175.stdout:5/646: fdatasync db/d30/d46/fd0 0 2024-04-20T10:55:00.692 INFO:tasks.workunit.client.1.smithi175.stdout:4/532: truncate d4/dd/d2d/d43/d69/fa8 942206 0 2024-04-20T10:55:00.692 INFO:tasks.workunit.client.1.smithi175.stdout:4/533: readlink d4/dd/d2d/laf 0 2024-04-20T10:55:00.692 INFO:tasks.workunit.client.1.smithi175.stdout:4/534: write d4/dd/d2d/d33/d58/f9f [2668820,75665] 0 2024-04-20T10:55:00.692 INFO:tasks.workunit.client.1.smithi175.stdout:0/526: fsync df/d17/f62 0 2024-04-20T10:55:00.694 INFO:tasks.workunit.client.1.smithi175.stdout:5/647: mknod db/d1f/d31/da0/dcb/cd8 0 2024-04-20T10:55:00.696 INFO:tasks.workunit.client.1.smithi175.stdout:3/360: dwrite d7/d10/f42 [0,4194304] 0 2024-04-20T10:55:00.697 INFO:tasks.workunit.client.1.smithi175.stdout:4/535: mkdir d4/dd/d54/d5d/d8a/da4/dbe 0 2024-04-20T10:55:00.700 INFO:tasks.workunit.client.1.smithi175.stdout:4/536: unlink d4/dd/d54/l7c 0 2024-04-20T10:55:00.703 INFO:tasks.workunit.client.1.smithi175.stdout:0/527: dread df/f11 [0,4194304] 0 2024-04-20T10:55:00.704 INFO:tasks.workunit.client.1.smithi175.stdout:3/361: stat d7/d21/d16/d22/d2c/c43 0 2024-04-20T10:55:00.705 INFO:tasks.workunit.client.1.smithi175.stdout:0/528: unlink df/d1a/d22/d24/l96 0 2024-04-20T10:55:00.706 INFO:tasks.workunit.client.1.smithi175.stdout:0/529: chown df/d1a/d22/d6a/d72/f95 407319058 1 2024-04-20T10:55:00.706 INFO:tasks.workunit.client.1.smithi175.stdout:0/530: creat df/d1a/d3f/d5e/fa8 x:0 0 0 2024-04-20T10:55:00.707 INFO:tasks.workunit.client.1.smithi175.stdout:3/362: unlink d7/d21/d16/f23 0 2024-04-20T10:55:00.722 INFO:tasks.workunit.client.1.smithi175.stdout:3/363: dwrite d7/d21/d16/d22/d2c/d1f/d48/f6d [0,4194304] 0 2024-04-20T10:55:00.723 INFO:tasks.workunit.client.1.smithi175.stdout:0/531: link df/d1a/l4c df/d1a/d22/d6a/d72/d48/la9 0 2024-04-20T10:55:00.725 INFO:tasks.workunit.client.1.smithi175.stdout:3/364: readlink l4 0 2024-04-20T10:55:00.726 INFO:tasks.workunit.client.1.smithi175.stdout:0/532: unlink df/d1a/d3f/d5e/l7e 0 2024-04-20T10:55:00.726 INFO:tasks.workunit.client.1.smithi175.stdout:0/533: write df/d1a/d3f/d5e/f93 [1039941,44787] 0 2024-04-20T10:55:00.727 INFO:tasks.workunit.client.1.smithi175.stdout:0/534: dread - df/d17/f85 zero size 2024-04-20T10:55:00.727 INFO:tasks.workunit.client.1.smithi175.stdout:0/535: stat df/d1a/d3f/d5e/f93 0 2024-04-20T10:55:00.727 INFO:tasks.workunit.client.1.smithi175.stdout:3/365: rmdir d7/d21/d16/d22/d2c/d1f 39 2024-04-20T10:55:00.727 INFO:tasks.workunit.client.1.smithi175.stdout:0/536: mkdir df/d1a/da1/daa 0 2024-04-20T10:55:00.728 INFO:tasks.workunit.client.1.smithi175.stdout:3/366: read d7/d21/d16/d22/d2c/f34 [1669,96645] 0 2024-04-20T10:55:00.735 INFO:tasks.workunit.client.1.smithi175.stdout:3/367: dread d7/d21/d16/d22/d2c/d1f/f5b [0,4194304] 0 2024-04-20T10:55:00.735 INFO:tasks.workunit.client.1.smithi175.stdout:3/368: readlink d7/d21/l71 0 2024-04-20T10:55:00.736 INFO:tasks.workunit.client.1.smithi175.stdout:0/537: mknod df/d17/d2f/d4f/cab 0 2024-04-20T10:55:00.753 INFO:tasks.workunit.client.1.smithi175.stdout:6/541: dwrite d1/d40/d29/f55 [0,4194304] 0 2024-04-20T10:55:00.754 INFO:tasks.workunit.client.1.smithi175.stdout:3/369: symlink d7/d19/d33/d60/l77 0 2024-04-20T10:55:00.763 INFO:tasks.workunit.client.1.smithi175.stdout:3/370: dread d7/d19/d33/d60/f44 [0,4194304] 0 2024-04-20T10:55:00.764 INFO:tasks.workunit.client.1.smithi175.stdout:6/542: creat d1/d5/d12/d7f/dae/fbb x:0 0 0 2024-04-20T10:55:00.764 INFO:tasks.workunit.client.1.smithi175.stdout:6/543: truncate d1/d40/d49/fa6 555927 0 2024-04-20T10:55:00.765 INFO:tasks.workunit.client.1.smithi175.stdout:3/371: creat d7/d21/d16/d22/d2c/d1f/d48/f78 x:0 0 0 2024-04-20T10:55:00.767 INFO:tasks.workunit.client.1.smithi175.stdout:6/544: chown d1/d40/d29/l53 27 1 2024-04-20T10:55:00.767 INFO:tasks.workunit.client.1.smithi175.stdout:6/545: fdatasync d1/d40/d63/fa5 0 2024-04-20T10:55:00.772 INFO:tasks.workunit.client.1.smithi175.stdout:3/372: dread d7/d21/f76 [0,4194304] 0 2024-04-20T10:55:00.772 INFO:tasks.workunit.client.1.smithi175.stdout:6/546: rmdir d1/d37/d83/db8/d60/d6b 39 2024-04-20T10:55:00.772 INFO:tasks.workunit.client.1.smithi175.stdout:6/547: chown d1/d5/f10 677 1 2024-04-20T10:55:00.774 INFO:tasks.workunit.client.1.smithi175.stdout:6/548: chown d1/d37/f50 0 1 2024-04-20T10:55:00.804 INFO:tasks.workunit.client.1.smithi175.stdout:0/538: dwrite df/d17/d2f/f99 [0,4194304] 0 2024-04-20T10:55:00.805 INFO:tasks.workunit.client.1.smithi175.stdout:6/549: creat d1/d37/d83/db8/d60/d68/fbc x:0 0 0 2024-04-20T10:55:00.930 INFO:tasks.workunit.client.1.smithi175.stdout:0/539: truncate df/d1a/d3f/f88 688080 0 2024-04-20T10:55:00.949 INFO:tasks.workunit.client.1.smithi175.stdout:0/540: dwrite df/d17/f85 [0,4194304] 0 2024-04-20T10:55:00.951 INFO:tasks.workunit.client.1.smithi175.stdout:3/373: write d7/f14 [5082256,63206] 0 2024-04-20T10:55:00.951 INFO:tasks.workunit.client.1.smithi175.stdout:3/374: read d7/d21/d16/d22/d2c/f34 [149357,66431] 0 2024-04-20T10:55:00.951 INFO:tasks.workunit.client.1.smithi175.stdout:3/375: chown d7/d21/d16 3 1 2024-04-20T10:55:00.952 INFO:tasks.workunit.client.1.smithi175.stdout:3/376: chown d7/d19/d33/d60/f6c 0 1 2024-04-20T10:55:00.952 INFO:tasks.workunit.client.1.smithi175.stdout:0/541: truncate df/d1a/d3f/f75 31898 0 2024-04-20T10:55:00.954 INFO:tasks.workunit.client.1.smithi175.stdout:3/377: mkdir d7/d19/d33/d60/d79 0 2024-04-20T10:55:00.958 INFO:tasks.workunit.client.1.smithi175.stdout:3/378: dread d7/d19/d33/d60/f6c [0,4194304] 0 2024-04-20T10:55:00.965 INFO:tasks.workunit.client.1.smithi175.stdout:8/500: sync 2024-04-20T10:55:00.965 INFO:tasks.workunit.client.1.smithi175.stdout:7/647: sync 2024-04-20T10:55:00.965 INFO:tasks.workunit.client.1.smithi175.stdout:9/464: sync 2024-04-20T10:55:00.965 INFO:tasks.workunit.client.1.smithi175.stdout:1/492: sync 2024-04-20T10:55:00.966 INFO:tasks.workunit.client.1.smithi175.stdout:3/379: creat d7/d21/d16/f7a x:0 0 0 2024-04-20T10:55:00.966 INFO:tasks.workunit.client.1.smithi175.stdout:0/542: write df/d17/f52 [736591,114774] 0 2024-04-20T10:55:00.967 INFO:tasks.workunit.client.1.smithi175.stdout:8/501: dread d7/fd [0,4194304] 0 2024-04-20T10:55:00.968 INFO:tasks.workunit.client.1.smithi175.stdout:1/493: mkdir d0/d8/d13/d79/d8c/dac/db1 0 2024-04-20T10:55:00.972 INFO:tasks.workunit.client.1.smithi175.stdout:5/648: sync 2024-04-20T10:55:00.972 INFO:tasks.workunit.client.1.smithi175.stdout:2/441: sync 2024-04-20T10:55:00.972 INFO:tasks.workunit.client.1.smithi175.stdout:4/537: sync 2024-04-20T10:55:00.972 INFO:tasks.workunit.client.1.smithi175.stdout:4/538: write d4/dd/d5e/f6b [345161,49583] 0 2024-04-20T10:55:00.973 INFO:tasks.workunit.client.1.smithi175.stdout:7/648: rename db/d1d/d39/d50/dba/cce to db/d1d/d39/d50/ce6 0 2024-04-20T10:55:00.974 INFO:tasks.workunit.client.1.smithi175.stdout:1/494: write d0/d8/d13/f2d [449134,128457] 0 2024-04-20T10:55:00.974 INFO:tasks.workunit.client.1.smithi175.stdout:5/649: mknod db/d11/d6d/da1/cd9 0 2024-04-20T10:55:00.975 INFO:tasks.workunit.client.1.smithi175.stdout:5/650: write db/d1f/d31/f77 [773190,30088] 0 2024-04-20T10:55:00.975 INFO:tasks.workunit.client.1.smithi175.stdout:2/442: mknod d1/d6a/d74/c93 0 2024-04-20T10:55:00.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/380: dread d7/d19/d2a/f2b [0,4194304] 0 2024-04-20T10:55:00.978 INFO:tasks.workunit.client.1.smithi175.stdout:8/502: write d7/d13/d1d/f1e [1800970,39954] 0 2024-04-20T10:55:00.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/381: chown d7/f14 4125 1 2024-04-20T10:55:00.978 INFO:tasks.workunit.client.1.smithi175.stdout:1/495: dread d0/d8/d13/d75/fa1 [0,4194304] 0 2024-04-20T10:55:00.978 INFO:tasks.workunit.client.1.smithi175.stdout:5/651: creat db/d1f/d31/da0/dcb/fda x:0 0 0 2024-04-20T10:55:00.981 INFO:tasks.workunit.client.1.smithi175.stdout:8/503: creat d7/d13/d1d/d24/d63/f9a x:0 0 0 2024-04-20T10:55:00.982 INFO:tasks.workunit.client.1.smithi175.stdout:5/652: getdents db/d11/d25/d38/d40/d66/d94 0 2024-04-20T10:55:00.984 INFO:tasks.workunit.client.1.smithi175.stdout:2/443: rename d1/d48/d21/d29/c14 to d1/d48/d21/d76/c94 0 2024-04-20T10:55:00.986 INFO:tasks.workunit.client.1.smithi175.stdout:3/382: mknod d7/d19/d33/d60/d50/c7b 0 2024-04-20T10:55:00.986 INFO:tasks.workunit.client.1.smithi175.stdout:3/383: dread - d7/d21/d16/d22/f52 zero size 2024-04-20T10:55:00.987 INFO:tasks.workunit.client.1.smithi175.stdout:3/384: stat d7/c1a 0 2024-04-20T10:55:00.987 INFO:tasks.workunit.client.1.smithi175.stdout:5/653: rmdir db/d1f/d31/d93 39 2024-04-20T10:55:00.988 INFO:tasks.workunit.client.1.smithi175.stdout:8/504: mknod d7/d13/c9b 0 2024-04-20T10:55:00.990 INFO:tasks.workunit.client.1.smithi175.stdout:5/654: link db/d11/d25/d41/d83/lce db/d11/d25/d38/d40/d66/ldb 0 2024-04-20T10:55:00.992 INFO:tasks.workunit.client.1.smithi175.stdout:5/655: unlink db/d1f/d31/fa4 0 2024-04-20T10:55:00.996 INFO:tasks.workunit.client.1.smithi175.stdout:9/465: write d6/d10/f1a [981618,88640] 0 2024-04-20T10:55:00.996 INFO:tasks.workunit.client.1.smithi175.stdout:5/656: rmdir db/dc1/d4f/d5a 39 2024-04-20T10:55:01.003 INFO:tasks.workunit.client.1.smithi175.stdout:0/543: write df/d1a/d28/f43 [503168,107904] 0 2024-04-20T10:55:01.004 INFO:tasks.workunit.client.1.smithi175.stdout:7/649: dwrite db/d1d/d39/d50/dba/d47/f94 [0,4194304] 0 2024-04-20T10:55:01.004 INFO:tasks.workunit.client.1.smithi175.stdout:9/466: mknod d6/d33/c84 0 2024-04-20T10:55:01.006 INFO:tasks.workunit.client.1.smithi175.stdout:0/544: creat df/fac x:0 0 0 2024-04-20T10:55:01.007 INFO:tasks.workunit.client.1.smithi175.stdout:1/496: dwrite d0/d3e/d61/f67 [0,4194304] 0 2024-04-20T10:55:01.016 INFO:tasks.workunit.client.1.smithi175.stdout:3/385: dwrite d7/d21/f41 [4194304,4194304] 0 2024-04-20T10:55:01.018 INFO:tasks.workunit.client.1.smithi175.stdout:7/650: mkdir db/d1d/d39/de7 0 2024-04-20T10:55:01.018 INFO:tasks.workunit.client.1.smithi175.stdout:7/651: readlink db/d1d/ld6 0 2024-04-20T10:55:01.031 INFO:tasks.workunit.client.1.smithi175.stdout:5/657: dwrite db/d1f/d31/f3a [0,4194304] 0 2024-04-20T10:55:01.031 INFO:tasks.workunit.client.1.smithi175.stdout:5/658: fsync db/d11/d25/d41/d60/fc9 0 2024-04-20T10:55:01.032 INFO:tasks.workunit.client.1.smithi175.stdout:3/386: creat d7/d21/d16/d49/f7c x:0 0 0 2024-04-20T10:55:01.032 INFO:tasks.workunit.client.1.smithi175.stdout:3/387: chown d7/d21/d16/c75 246 1 2024-04-20T10:55:01.033 INFO:tasks.workunit.client.1.smithi175.stdout:3/388: mkdir d7/d21/d67/d7d 0 2024-04-20T10:55:01.035 INFO:tasks.workunit.client.1.smithi175.stdout:5/659: unlink db/d11/d25/d41/d60/f6c 0 2024-04-20T10:55:01.035 INFO:tasks.workunit.client.1.smithi175.stdout:5/660: stat db/d30/d46/d88/db2 0 2024-04-20T10:55:01.035 INFO:tasks.workunit.client.1.smithi175.stdout:3/389: rmdir d7/d21/d67 39 2024-04-20T10:55:01.037 INFO:tasks.workunit.client.1.smithi175.stdout:5/661: creat db/d1f/d31/fdc x:0 0 0 2024-04-20T10:55:01.037 INFO:tasks.workunit.client.1.smithi175.stdout:5/662: chown db/d11/d25/d38/d40/d66/d94/l9b 265 1 2024-04-20T10:55:01.037 INFO:tasks.workunit.client.1.smithi175.stdout:0/545: dwrite df/d2e/f47 [0,4194304] 0 2024-04-20T10:55:01.037 INFO:tasks.workunit.client.1.smithi175.stdout:1/497: dwrite d0/d29/f4f [0,4194304] 0 2024-04-20T10:55:01.038 INFO:tasks.workunit.client.1.smithi175.stdout:0/546: mkdir df/d1a/d22/d24/d9a/dad 0 2024-04-20T10:55:01.039 INFO:tasks.workunit.client.1.smithi175.stdout:1/498: rmdir d0/d3e/d61 39 2024-04-20T10:55:01.040 INFO:tasks.workunit.client.1.smithi175.stdout:4/539: write d4/dd/d54/d5d/fa3 [492079,75909] 0 2024-04-20T10:55:01.042 INFO:tasks.workunit.client.1.smithi175.stdout:5/663: dread db/d11/d25/d38/d40/d47/fa9 [0,4194304] 0 2024-04-20T10:55:01.042 INFO:tasks.workunit.client.1.smithi175.stdout:5/664: chown db/la8 166 1 2024-04-20T10:55:01.042 INFO:tasks.workunit.client.1.smithi175.stdout:5/665: chown db/d1f/d31/f77 572654 1 2024-04-20T10:55:01.043 INFO:tasks.workunit.client.1.smithi175.stdout:8/505: write d7/d13/d1d/d56/f62 [886165,20789] 0 2024-04-20T10:55:01.045 INFO:tasks.workunit.client.1.smithi175.stdout:3/390: mkdir d7/d19/d33/d7e 0 2024-04-20T10:55:01.047 INFO:tasks.workunit.client.1.smithi175.stdout:8/506: creat d7/d13/d1d/d24/f9c x:0 0 0 2024-04-20T10:55:01.048 INFO:tasks.workunit.client.1.smithi175.stdout:3/391: mkdir d7/d21/d67/d7f 0 2024-04-20T10:55:01.049 INFO:tasks.workunit.client.1.smithi175.stdout:4/540: dread d4/dd/d54/d5d/d9e/f64 [0,4194304] 0 2024-04-20T10:55:01.050 INFO:tasks.workunit.client.1.smithi175.stdout:8/507: creat d7/f9d x:0 0 0 2024-04-20T10:55:01.050 INFO:tasks.workunit.client.1.smithi175.stdout:8/508: chown d7/d13/d1d/d56/f71 23311 1 2024-04-20T10:55:01.050 INFO:tasks.workunit.client.1.smithi175.stdout:3/392: chown d7/d21/d16/c36 11241 1 2024-04-20T10:55:01.051 INFO:tasks.workunit.client.1.smithi175.stdout:7/652: write db/d1d/d39/d50/dba/d47/f94 [4265959,23520] 0 2024-04-20T10:55:01.052 INFO:tasks.workunit.client.1.smithi175.stdout:4/541: creat d4/dd/d2d/d33/d5b/d65/fbf x:0 0 0 2024-04-20T10:55:01.052 INFO:tasks.workunit.client.1.smithi175.stdout:4/542: readlink d4/dd/d5e/lac 0 2024-04-20T10:55:01.053 INFO:tasks.workunit.client.1.smithi175.stdout:3/393: readlink d7/d19/d2a/l4f 0 2024-04-20T10:55:01.055 INFO:tasks.workunit.client.1.smithi175.stdout:4/543: mkdir d4/dd/d5e/d74/da1/dc0 0 2024-04-20T10:55:01.056 INFO:tasks.workunit.client.1.smithi175.stdout:8/509: mknod d7/d13/d1d/d56/c9e 0 2024-04-20T10:55:01.056 INFO:tasks.workunit.client.1.smithi175.stdout:6/550: sync 2024-04-20T10:55:01.057 INFO:tasks.workunit.client.1.smithi175.stdout:4/544: creat d4/dd/d5e/d74/fc1 x:0 0 0 2024-04-20T10:55:01.058 INFO:tasks.workunit.client.1.smithi175.stdout:8/510: dread d7/fd [0,4194304] 0 2024-04-20T10:55:01.058 INFO:tasks.workunit.client.1.smithi175.stdout:8/511: fdatasync d7/d13/d1d/f98 0 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:8/512: truncate d7/d13/d1d/f8f 480876 0 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:8/513: chown d7/d13/d1d/d92/d6c/c72 14862 1 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:8/514: fsync d7/d13/d1d/d24/d38/f7e 0 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/653: rename db/d1d/d29 to db/d61/d6d/d9c/de8 0 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/654: chown db/d1d/d39/d50/f52 1355797 1 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/655: readlink db/d1d/l36 0 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:1/499: dwrite d0/d8/d13/d2e/f72 [0,4194304] 0 2024-04-20T10:55:01.059 INFO:tasks.workunit.client.1.smithi175.stdout:7/656: read db/d61/d6d/d9c/de8/d2a/f87 [266456,13864] 0 2024-04-20T10:55:01.061 INFO:tasks.workunit.client.1.smithi175.stdout:4/545: rename d4/d27/f8 to d4/dd/d5e/d74/da1/dbc/fc2 0 2024-04-20T10:55:01.061 INFO:tasks.workunit.client.1.smithi175.stdout:4/546: chown d4/d27/l37 27662784 1 2024-04-20T10:55:01.062 INFO:tasks.workunit.client.1.smithi175.stdout:0/547: dwrite df/d17/f2a [4194304,4194304] 0 2024-04-20T10:55:01.062 INFO:tasks.workunit.client.1.smithi175.stdout:3/394: dread d7/d21/d16/d22/d2c/f3c [0,4194304] 0 2024-04-20T10:55:01.063 INFO:tasks.workunit.client.1.smithi175.stdout:4/547: write d4/dd/d54/f4a [4710468,34423] 0 2024-04-20T10:55:01.063 INFO:tasks.workunit.client.1.smithi175.stdout:6/551: dread d1/d37/d83/db8/d60/d68/d7e/f8f [0,4194304] 0 2024-04-20T10:55:01.063 INFO:tasks.workunit.client.1.smithi175.stdout:6/552: getdents d1/d40/d63 0 2024-04-20T10:55:01.063 INFO:tasks.workunit.client.1.smithi175.stdout:8/515: link d7/d13/d1d/d24/f2b d7/d13/d1d/d24/d63/f9f 0 2024-04-20T10:55:01.063 INFO:tasks.workunit.client.1.smithi175.stdout:8/516: chown d7/d13/d1d/d92/d6c/c72 106666022 1 2024-04-20T10:55:01.063 INFO:tasks.workunit.client.1.smithi175.stdout:8/517: dread - d7/d13/f91 zero size 2024-04-20T10:55:01.064 INFO:tasks.workunit.client.1.smithi175.stdout:0/548: creat df/d1a/d22/d6a/d72/d48/d4e/fae x:0 0 0 2024-04-20T10:55:01.064 INFO:tasks.workunit.client.1.smithi175.stdout:0/549: truncate df/d19/f1f 4234131 0 2024-04-20T10:55:01.065 INFO:tasks.workunit.client.1.smithi175.stdout:3/395: creat d7/d19/d33/d60/f80 x:0 0 0 2024-04-20T10:55:01.066 INFO:tasks.workunit.client.1.smithi175.stdout:6/553: creat d1/fbd x:0 0 0 2024-04-20T10:55:01.069 INFO:tasks.workunit.client.1.smithi175.stdout:1/500: rename d0/l96 to d0/d8/lb2 0 2024-04-20T10:55:01.069 INFO:tasks.workunit.client.1.smithi175.stdout:1/501: fdatasync d0/d8/f45 0 2024-04-20T10:55:01.071 INFO:tasks.workunit.client.1.smithi175.stdout:3/396: creat d7/d19/d33/d60/d79/f81 x:0 0 0 2024-04-20T10:55:01.071 INFO:tasks.workunit.client.1.smithi175.stdout:3/397: write d7/d21/f76 [4754655,100835] 0 2024-04-20T10:55:01.071 INFO:tasks.workunit.client.1.smithi175.stdout:5/666: dread db/d9d/f44 [0,4194304] 0 2024-04-20T10:55:01.072 INFO:tasks.workunit.client.1.smithi175.stdout:6/554: creat d1/d5/fbe x:0 0 0 2024-04-20T10:55:01.072 INFO:tasks.workunit.client.1.smithi175.stdout:6/555: write d1/d40/d49/fa6 [1573481,47982] 0 2024-04-20T10:55:01.072 INFO:tasks.workunit.client.1.smithi175.stdout:4/548: dread d4/d27/f15 [0,4194304] 0 2024-04-20T10:55:01.072 INFO:tasks.workunit.client.1.smithi175.stdout:4/549: stat d4/dd/d2d/d43/d69 0 2024-04-20T10:55:01.076 INFO:tasks.workunit.client.1.smithi175.stdout:1/502: rename d0/d8/d13/f2d to d0/d51/da8/fb3 0 2024-04-20T10:55:01.077 INFO:tasks.workunit.client.1.smithi175.stdout:0/550: symlink df/d17/d2f/laf 0 2024-04-20T10:55:01.077 INFO:tasks.workunit.client.1.smithi175.stdout:0/551: fsync df/d19/f34 0 2024-04-20T10:55:01.077 INFO:tasks.workunit.client.1.smithi175.stdout:0/552: chown df/d1a/d3f/d5e/f7b 36 1 2024-04-20T10:55:01.086 INFO:tasks.workunit.client.1.smithi175.stdout:3/398: dwrite d7/d21/fd [0,4194304] 0 2024-04-20T10:55:01.090 INFO:tasks.workunit.client.1.smithi175.stdout:7/657: dread db/d61/d6d/d9c/de8/f9e [0,4194304] 0 2024-04-20T10:55:01.093 INFO:tasks.workunit.client.1.smithi175.stdout:6/556: symlink d1/d37/d83/db8/d60/lbf 0 2024-04-20T10:55:01.093 INFO:tasks.workunit.client.1.smithi175.stdout:5/667: rename db/d11/l12 to db/d11/d25/d62/ldd 0 2024-04-20T10:55:01.093 INFO:tasks.workunit.client.1.smithi175.stdout:5/668: dread - db/d11/d6d/fb3 zero size 2024-04-20T10:55:01.093 INFO:tasks.workunit.client.1.smithi175.stdout:0/553: truncate df/d1a/d22/d6a/d72/d48/d4e/f61 725270 0 2024-04-20T10:55:01.093 INFO:tasks.workunit.client.1.smithi175.stdout:1/503: getdents d0/d8/d13 0 2024-04-20T10:55:01.094 INFO:tasks.workunit.client.1.smithi175.stdout:6/557: truncate d1/d5/f10 269253 0 2024-04-20T10:55:01.096 INFO:tasks.workunit.client.1.smithi175.stdout:3/399: rename d7/d19/d33/d60/d50/l69 to d7/d21/d67/d7d/l82 0 2024-04-20T10:55:01.097 INFO:tasks.workunit.client.1.smithi175.stdout:5/669: creat db/d11/d6d/da1/dcc/fde x:0 0 0 2024-04-20T10:55:01.100 INFO:tasks.workunit.client.1.smithi175.stdout:6/558: dread d1/d37/f48 [0,4194304] 0 2024-04-20T10:55:01.100 INFO:tasks.workunit.client.1.smithi175.stdout:5/670: creat db/d11/d25/d38/d40/d47/fdf x:0 0 0 2024-04-20T10:55:01.114 INFO:tasks.workunit.client.1.smithi175.stdout:0/554: dwrite df/d17/f52 [0,4194304] 0 2024-04-20T10:55:01.117 INFO:tasks.workunit.client.1.smithi175.stdout:0/555: unlink df/d2e/f47 0 2024-04-20T10:55:01.122 INFO:tasks.workunit.client.1.smithi175.stdout:0/556: mknod df/d1a/d22/d6a/d72/d48/cb0 0 2024-04-20T10:55:01.122 INFO:tasks.workunit.client.1.smithi175.stdout:0/557: symlink df/d1a/d22/d6a/lb1 0 2024-04-20T10:55:01.122 INFO:tasks.workunit.client.1.smithi175.stdout:0/558: read df/d17/f2a [3456343,32061] 0 2024-04-20T10:55:01.122 INFO:tasks.workunit.client.1.smithi175.stdout:0/559: creat df/d1a/fb2 x:0 0 0 2024-04-20T10:55:01.125 INFO:tasks.workunit.client.1.smithi175.stdout:8/518: dwrite d7/d13/d1d/f2f [0,4194304] 0 2024-04-20T10:55:01.125 INFO:tasks.workunit.client.1.smithi175.stdout:8/519: stat d7/d13/d1d/d24/d38 0 2024-04-20T10:55:01.126 INFO:tasks.workunit.client.1.smithi175.stdout:8/520: symlink d7/d13/d1d/d24/la0 0 2024-04-20T10:55:01.127 INFO:tasks.workunit.client.1.smithi175.stdout:8/521: creat d7/d13/d1d/d24/d38/d73/fa1 x:0 0 0 2024-04-20T10:55:01.127 INFO:tasks.workunit.client.1.smithi175.stdout:8/522: write d7/d13/d1d/d24/d38/f89 [933777,49996] 0 2024-04-20T10:55:01.128 INFO:tasks.workunit.client.1.smithi175.stdout:8/523: fsync d7/f9d 0 2024-04-20T10:55:01.128 INFO:tasks.workunit.client.1.smithi175.stdout:8/524: rmdir d7/d13/d1d/d24/d38/d80 39 2024-04-20T10:55:01.128 INFO:tasks.workunit.client.1.smithi175.stdout:8/525: chown d7/d13/c9b 1615 1 2024-04-20T10:55:01.128 INFO:tasks.workunit.client.1.smithi175.stdout:3/400: dwrite d7/d19/d2a/d59/f73 [0,4194304] 0 2024-04-20T10:55:01.129 INFO:tasks.workunit.client.1.smithi175.stdout:3/401: mknod d7/d21/d67/c83 0 2024-04-20T10:55:01.132 INFO:tasks.workunit.client.1.smithi175.stdout:4/550: dwrite d4/d27/f7b [4194304,4194304] 0 2024-04-20T10:55:01.142 INFO:tasks.workunit.client.1.smithi175.stdout:4/551: mkdir d4/dd/d2d/d33/d58/dc3 0 2024-04-20T10:55:01.142 INFO:tasks.workunit.client.1.smithi175.stdout:4/552: write d4/dd/d54/d5d/d9e/f29 [1495915,30483] 0 2024-04-20T10:55:01.143 INFO:tasks.workunit.client.1.smithi175.stdout:5/671: dwrite db/d9d/f44 [0,4194304] 0 2024-04-20T10:55:01.145 INFO:tasks.workunit.client.1.smithi175.stdout:6/559: dwrite d1/d37/d83/db8/f75 [0,4194304] 0 2024-04-20T10:55:01.147 INFO:tasks.workunit.client.1.smithi175.stdout:6/560: unlink d1/d37/lb0 0 2024-04-20T10:55:01.147 INFO:tasks.workunit.client.1.smithi175.stdout:2/444: sync 2024-04-20T10:55:01.149 INFO:tasks.workunit.client.1.smithi175.stdout:9/467: sync 2024-04-20T10:55:01.150 INFO:tasks.workunit.client.1.smithi175.stdout:9/468: dread d6/d1b/d26/f2b [0,4194304] 0 2024-04-20T10:55:01.152 INFO:tasks.workunit.client.1.smithi175.stdout:2/445: creat d1/d7/d63/d36/f95 x:0 0 0 2024-04-20T10:55:01.154 INFO:tasks.workunit.client.1.smithi175.stdout:6/561: rename d1/d40 to d1/dc0 0 2024-04-20T10:55:01.155 INFO:tasks.workunit.client.1.smithi175.stdout:4/553: write d4/d23/f62 [518090,128278] 0 2024-04-20T10:55:01.157 INFO:tasks.workunit.client.1.smithi175.stdout:6/562: mkdir d1/d5/d12/d22/dc1 0 2024-04-20T10:55:01.157 INFO:tasks.workunit.client.1.smithi175.stdout:6/563: dread - d1/d37/d83/db8/d60/d68/d7e/fb1 zero size 2024-04-20T10:55:01.159 INFO:tasks.workunit.client.1.smithi175.stdout:9/469: rename d6/lc to d6/d1b/d42/d5b/d72/d7d/l85 0 2024-04-20T10:55:01.160 INFO:tasks.workunit.client.1.smithi175.stdout:9/470: stat d6/d33/f5c 0 2024-04-20T10:55:01.160 INFO:tasks.workunit.client.1.smithi175.stdout:9/471: chown d6/lf 23217530 1 2024-04-20T10:55:01.160 INFO:tasks.workunit.client.1.smithi175.stdout:9/472: dread - d6/f43 zero size 2024-04-20T10:55:01.165 INFO:tasks.workunit.client.1.smithi175.stdout:3/402: dwrite d7/f51 [0,4194304] 0 2024-04-20T10:55:01.170 INFO:tasks.workunit.client.1.smithi175.stdout:3/403: unlink d7/fe 0 2024-04-20T10:55:01.175 INFO:tasks.workunit.client.1.smithi175.stdout:2/446: dwrite d1/d48/d21/d29/f39 [0,4194304] 0 2024-04-20T10:55:01.177 INFO:tasks.workunit.client.1.smithi175.stdout:2/447: creat d1/f96 x:0 0 0 2024-04-20T10:55:01.178 INFO:tasks.workunit.client.1.smithi175.stdout:2/448: chown d1/d48/d21/d29/f46 126376 1 2024-04-20T10:55:01.178 INFO:tasks.workunit.client.1.smithi175.stdout:2/449: dread - d1/f81 zero size 2024-04-20T10:55:01.179 INFO:tasks.workunit.client.1.smithi175.stdout:2/450: rename d1/d7/d63/d36/f8d to d1/d53/f97 0 2024-04-20T10:55:01.181 INFO:tasks.workunit.client.1.smithi175.stdout:4/554: dwrite d4/dd/d2d/d43/d69/f75 [0,4194304] 0 2024-04-20T10:55:01.182 INFO:tasks.workunit.client.1.smithi175.stdout:4/555: creat d4/dd/d2d/d33/d58/fc4 x:0 0 0 2024-04-20T10:55:01.186 INFO:tasks.workunit.client.1.smithi175.stdout:9/473: dwrite d6/d10/f1a [0,4194304] 0 2024-04-20T10:55:01.186 INFO:tasks.workunit.client.1.smithi175.stdout:8/526: write d7/d13/d1d/d24/d26/f7b [2381918,21338] 0 2024-04-20T10:55:01.187 INFO:tasks.workunit.client.1.smithi175.stdout:8/527: write d7/d13/d1d/d24/d39/d6f/f61 [206034,83867] 0 2024-04-20T10:55:01.187 INFO:tasks.workunit.client.1.smithi175.stdout:9/474: rmdir d6/d1b/d42 39 2024-04-20T10:55:01.189 INFO:tasks.workunit.client.1.smithi175.stdout:8/528: rename d7/d13/f87 to d7/d13/d1d/d24/d38/d73/fa2 0 2024-04-20T10:55:01.189 INFO:tasks.workunit.client.1.smithi175.stdout:8/529: fdatasync d7/f9d 0 2024-04-20T10:55:01.191 INFO:tasks.workunit.client.1.smithi175.stdout:8/530: mkdir d7/d13/da3 0 2024-04-20T10:55:01.191 INFO:tasks.workunit.client.1.smithi175.stdout:8/531: stat d7/d13/d1d/d24/d26/c74 0 2024-04-20T10:55:01.191 INFO:tasks.workunit.client.1.smithi175.stdout:8/532: readlink d7/d13/d1d/d92/l31 0 2024-04-20T10:55:01.192 INFO:tasks.workunit.client.1.smithi175.stdout:8/533: rename d7/d13/l6b to d7/d13/da3/la4 0 2024-04-20T10:55:01.202 INFO:tasks.workunit.client.1.smithi175.stdout:9/475: dread d6/f17 [0,4194304] 0 2024-04-20T10:55:01.202 INFO:tasks.workunit.client.1.smithi175.stdout:9/476: chown d6/f4c 0 1 2024-04-20T10:55:01.202 INFO:tasks.workunit.client.1.smithi175.stdout:9/477: chown d6/d1b/d2f/f64 945332245 1 2024-04-20T10:55:01.203 INFO:tasks.workunit.client.1.smithi175.stdout:8/534: write d7/d13/f22 [637576,99778] 0 2024-04-20T10:55:01.204 INFO:tasks.workunit.client.1.smithi175.stdout:8/535: dread - d7/d13/d1d/f98 zero size 2024-04-20T10:55:01.204 INFO:tasks.workunit.client.1.smithi175.stdout:8/536: dread d7/d13/d1d/d24/d38/f77 [0,4194304] 0 2024-04-20T10:55:01.204 INFO:tasks.workunit.client.1.smithi175.stdout:8/537: stat d7/d13/d1d/f88 0 2024-04-20T10:55:01.205 INFO:tasks.workunit.client.1.smithi175.stdout:8/538: getdents d7 0 2024-04-20T10:55:01.206 INFO:tasks.workunit.client.1.smithi175.stdout:3/404: dwrite d7/d19/d33/f3b [0,4194304] 0 2024-04-20T10:55:01.206 INFO:tasks.workunit.client.1.smithi175.stdout:2/451: dwrite d1/f81 [0,4194304] 0 2024-04-20T10:55:01.206 INFO:tasks.workunit.client.1.smithi175.stdout:3/405: write d7/f12 [5095777,42684] 0 2024-04-20T10:55:01.206 INFO:tasks.workunit.client.1.smithi175.stdout:4/556: dwrite d4/dd/d2d/d43/d69/f75 [0,4194304] 0 2024-04-20T10:55:01.208 INFO:tasks.workunit.client.1.smithi175.stdout:2/452: truncate d1/f33 2349038 0 2024-04-20T10:55:01.209 INFO:tasks.workunit.client.1.smithi175.stdout:3/406: symlink d7/d21/d16/d22/d2c/d1f/l84 0 2024-04-20T10:55:01.210 INFO:tasks.workunit.client.1.smithi175.stdout:2/453: symlink d1/d7/d63/d4b/d8a/l98 0 2024-04-20T10:55:01.214 INFO:tasks.workunit.client.1.smithi175.stdout:8/539: write d7/d13/d1d/d24/d39/f48 [2911418,114081] 0 2024-04-20T10:55:01.216 INFO:tasks.workunit.client.1.smithi175.stdout:6/564: write d1/d37/f61 [172504,1470] 0 2024-04-20T10:55:01.216 INFO:tasks.workunit.client.1.smithi175.stdout:6/565: read - d1/d37/f50 zero size 2024-04-20T10:55:01.217 INFO:tasks.workunit.client.1.smithi175.stdout:2/454: fsync d1/d48/d21/d76/f42 0 2024-04-20T10:55:01.220 INFO:tasks.workunit.client.1.smithi175.stdout:9/478: dwrite d6/d33/d63/f73 [0,4194304] 0 2024-04-20T10:55:01.221 INFO:tasks.workunit.client.1.smithi175.stdout:6/566: symlink d1/d37/d83/db8/d60/d68/lc2 0 2024-04-20T10:55:01.227 INFO:tasks.workunit.client.1.smithi175.stdout:6/567: symlink d1/d37/d83/db8/d60/d68/lc3 0 2024-04-20T10:55:01.227 INFO:tasks.workunit.client.1.smithi175.stdout:6/568: dread - d1/dc0/d63/fa5 zero size 2024-04-20T10:55:01.229 INFO:tasks.workunit.client.1.smithi175.stdout:6/569: creat d1/d5/d12/d22/d9b/fc4 x:0 0 0 2024-04-20T10:55:01.230 INFO:tasks.workunit.client.1.smithi175.stdout:6/570: mknod d1/d5/d12/d7f/cc5 0 2024-04-20T10:55:01.230 INFO:tasks.workunit.client.1.smithi175.stdout:6/571: chown d1/dc0/d29/f9f 9173714 1 2024-04-20T10:55:01.231 INFO:tasks.workunit.client.1.smithi175.stdout:6/572: symlink d1/dc0/d29/lc6 0 2024-04-20T10:55:01.231 INFO:tasks.workunit.client.1.smithi175.stdout:6/573: truncate d1/d37/d83/db8/d60/d68/d7e/f9e 995777 0 2024-04-20T10:55:01.231 INFO:tasks.workunit.client.1.smithi175.stdout:6/574: truncate d1/dc0/d49/f62 3439004 0 2024-04-20T10:55:01.235 INFO:tasks.workunit.client.1.smithi175.stdout:4/557: dwrite d4/d27/f17 [0,4194304] 0 2024-04-20T10:55:01.235 INFO:tasks.workunit.client.1.smithi175.stdout:4/558: chown d4/d27/c18 4767 1 2024-04-20T10:55:01.236 INFO:tasks.workunit.client.1.smithi175.stdout:4/559: symlink d4/dd/dba/lc5 0 2024-04-20T10:55:01.239 INFO:tasks.workunit.client.1.smithi175.stdout:4/560: dread d4/d23/d2e/f82 [0,4194304] 0 2024-04-20T10:55:01.248 INFO:tasks.workunit.client.1.smithi175.stdout:6/575: dread d1/dc0/d29/f67 [0,4194304] 0 2024-04-20T10:55:01.251 INFO:tasks.workunit.client.1.smithi175.stdout:2/455: write d1/f6 [1433252,90658] 0 2024-04-20T10:55:01.254 INFO:tasks.workunit.client.1.smithi175.stdout:9/479: dwrite d6/d1b/d42/f50 [0,4194304] 0 2024-04-20T10:55:01.254 INFO:tasks.workunit.client.1.smithi175.stdout:3/407: dwrite d7/d21/fa [4194304,4194304] 0 2024-04-20T10:55:01.304 INFO:tasks.workunit.client.1.smithi175.stdout:2/456: mkdir d1/d7/d63/d36/d7d/d84/d8b/d99 0 2024-04-20T10:55:01.319 INFO:tasks.workunit.client.1.smithi175.stdout:4/561: write d4/d27/f2c [1456421,57772] 0 2024-04-20T10:55:01.337 INFO:tasks.workunit.client.1.smithi175.stdout:4/562: dwrite d4/dd/d54/d5d/d9e/f29 [0,4194304] 0 2024-04-20T10:55:01.339 INFO:tasks.workunit.client.1.smithi175.stdout:4/563: link d4/d27/f17 d4/dd/d2d/d43/d69/daa/fc6 0 2024-04-20T10:55:01.422 INFO:tasks.workunit.client.1.smithi175.stdout:2/457: dwrite d1/d7/d63/f3e [0,4194304] 0 2024-04-20T10:55:01.432 INFO:tasks.workunit.client.1.smithi175.stdout:2/458: dread d1/f40 [0,4194304] 0 2024-04-20T10:55:01.436 INFO:tasks.workunit.client.1.smithi175.stdout:2/459: truncate d1/f11 4083419 0 2024-04-20T10:55:01.437 INFO:tasks.workunit.client.1.smithi175.stdout:2/460: mknod d1/d7/d63/d4b/d8a/c9a 0 2024-04-20T10:55:01.446 INFO:tasks.workunit.client.1.smithi175.stdout:2/461: dread d1/d7/d63/f26 [0,4194304] 0 2024-04-20T10:55:01.446 INFO:tasks.workunit.client.1.smithi175.stdout:2/462: getdents d1/d7/d63/d36/d7d/d84/d8b/d99 0 2024-04-20T10:55:01.446 INFO:tasks.workunit.client.1.smithi175.stdout:2/463: read d1/d7/d63/f79 [20112,50441] 0 2024-04-20T10:55:01.454 INFO:tasks.workunit.client.1.smithi175.stdout:9/480: rmdir d6/d1b/d42/d5b 39 2024-04-20T10:55:01.455 INFO:tasks.workunit.client.1.smithi175.stdout:4/564: mkdir d4/dd/d2d/d43/dc7 0 2024-04-20T10:55:01.456 INFO:tasks.workunit.client.1.smithi175.stdout:9/481: creat d6/d33/d60/f86 x:0 0 0 2024-04-20T10:55:01.457 INFO:tasks.workunit.client.1.smithi175.stdout:9/482: fdatasync d6/f1d 0 2024-04-20T10:55:01.458 INFO:tasks.workunit.client.1.smithi175.stdout:9/483: creat d6/d33/f87 x:0 0 0 2024-04-20T10:55:01.459 INFO:tasks.workunit.client.1.smithi175.stdout:6/576: rmdir d1/d37/d83/db8/d60/d6b 39 2024-04-20T10:55:01.461 INFO:tasks.workunit.client.1.smithi175.stdout:6/577: mknod d1/d37/d83/db8/d60/d6b/da8/cc7 0 2024-04-20T10:55:01.463 INFO:tasks.workunit.client.1.smithi175.stdout:7/658: sync 2024-04-20T10:55:01.463 INFO:tasks.workunit.client.1.smithi175.stdout:7/659: chown db/d61/d6d/dbc/cbe 2211375 1 2024-04-20T10:55:01.464 INFO:tasks.workunit.client.1.smithi175.stdout:7/660: symlink db/d61/d6d/d9c/de8/d8f/dcc/le9 0 2024-04-20T10:55:01.465 INFO:tasks.workunit.client.1.smithi175.stdout:2/464: dwrite d1/d48/d38/d82/f7f [0,4194304] 0 2024-04-20T10:55:01.466 INFO:tasks.workunit.client.1.smithi175.stdout:3/408: dread d7/d10/f31 [0,4194304] 0 2024-04-20T10:55:01.466 INFO:tasks.workunit.client.1.smithi175.stdout:4/565: dread d4/d27/d61/f7a [0,4194304] 0 2024-04-20T10:55:01.468 INFO:tasks.workunit.client.1.smithi175.stdout:2/465: mknod d1/d48/d38/d82/c9b 0 2024-04-20T10:55:01.470 INFO:tasks.workunit.client.1.smithi175.stdout:2/466: truncate d1/d48/d21/d76/f2c 3350555 0 2024-04-20T10:55:01.471 INFO:tasks.workunit.client.1.smithi175.stdout:4/566: dread d4/dd/d2d/d33/f3d [0,4194304] 0 2024-04-20T10:55:01.472 INFO:tasks.workunit.client.1.smithi175.stdout:3/409: mkdir d7/d21/d16/d85 0 2024-04-20T10:55:01.472 INFO:tasks.workunit.client.1.smithi175.stdout:3/410: chown d7/d21/d16/d22/d2c/f34 12346 1 2024-04-20T10:55:01.473 INFO:tasks.workunit.client.1.smithi175.stdout:7/661: rename db/d1d/c40 to db/d61/cea 0 2024-04-20T10:55:01.473 INFO:tasks.workunit.client.1.smithi175.stdout:7/662: chown db/d1d/d39/f3f 2704 1 2024-04-20T10:55:01.474 INFO:tasks.workunit.client.1.smithi175.stdout:2/467: mkdir d1/d48/d21/d9c 0 2024-04-20T10:55:01.476 INFO:tasks.workunit.client.1.smithi175.stdout:9/484: dread d6/f4a [0,4194304] 0 2024-04-20T10:55:01.476 INFO:tasks.workunit.client.1.smithi175.stdout:3/411: unlink d7/d21/d16/d22/c62 0 2024-04-20T10:55:01.477 INFO:tasks.workunit.client.1.smithi175.stdout:7/663: creat db/d1d/d39/de7/feb x:0 0 0 2024-04-20T10:55:01.477 INFO:tasks.workunit.client.1.smithi175.stdout:0/560: sync 2024-04-20T10:55:01.477 INFO:tasks.workunit.client.1.smithi175.stdout:1/504: sync 2024-04-20T10:55:01.477 INFO:tasks.workunit.client.1.smithi175.stdout:5/672: sync 2024-04-20T10:55:01.477 INFO:tasks.workunit.client.1.smithi175.stdout:8/540: sync 2024-04-20T10:55:01.479 INFO:tasks.workunit.client.1.smithi175.stdout:3/412: rename d7/d21/d67 to d7/d19/d33/d7e/d86 0 2024-04-20T10:55:01.480 INFO:tasks.workunit.client.1.smithi175.stdout:8/541: link d7/f84 d7/fa5 0 2024-04-20T10:55:01.481 INFO:tasks.workunit.client.1.smithi175.stdout:1/505: link d0/d3e/d61/c89 d0/d8/d13/d75/cb4 0 2024-04-20T10:55:01.483 INFO:tasks.workunit.client.1.smithi175.stdout:0/561: creat df/d1a/d22/d55/fb3 x:0 0 0 2024-04-20T10:55:01.485 INFO:tasks.workunit.client.1.smithi175.stdout:2/468: dread d1/d48/d21/d29/f46 [0,4194304] 0 2024-04-20T10:55:01.486 INFO:tasks.workunit.client.1.smithi175.stdout:6/578: write d1/d5/d12/d73/d7a/f80 [115205,79957] 0 2024-04-20T10:55:01.486 INFO:tasks.workunit.client.1.smithi175.stdout:6/579: fsync d1/f16 0 2024-04-20T10:55:01.486 INFO:tasks.workunit.client.1.smithi175.stdout:6/580: chown d1/d5/d12/d22/f44 601 1 2024-04-20T10:55:01.487 INFO:tasks.workunit.client.1.smithi175.stdout:3/413: creat d7/d19/d2a/f87 x:0 0 0 2024-04-20T10:55:01.487 INFO:tasks.workunit.client.1.smithi175.stdout:7/664: unlink db/d1d/d60/l71 0 2024-04-20T10:55:01.488 INFO:tasks.workunit.client.1.smithi175.stdout:8/542: creat d7/d13/d1d/d24/d38/d73/fa6 x:0 0 0 2024-04-20T10:55:01.489 INFO:tasks.workunit.client.1.smithi175.stdout:4/567: write d4/f31 [138460,34328] 0 2024-04-20T10:55:01.489 INFO:tasks.workunit.client.1.smithi175.stdout:1/506: link d0/d8/lb2 d0/d8/d13/d7b/lb5 0 2024-04-20T10:55:01.491 INFO:tasks.workunit.client.1.smithi175.stdout:0/562: creat df/d1a/d22/d6a/d72/fb4 x:0 0 0 2024-04-20T10:55:01.493 INFO:tasks.workunit.client.1.smithi175.stdout:0/563: dread df/d1a/d3f/f88 [0,4194304] 0 2024-04-20T10:55:01.494 INFO:tasks.workunit.client.1.smithi175.stdout:3/414: truncate d7/d10/f4a 14564 0 2024-04-20T10:55:01.494 INFO:tasks.workunit.client.1.smithi175.stdout:3/415: write d7/f14 [5898349,4537] 0 2024-04-20T10:55:01.497 INFO:tasks.workunit.client.1.smithi175.stdout:4/568: dread d4/d27/fa [0,4194304] 0 2024-04-20T10:55:01.498 INFO:tasks.workunit.client.1.smithi175.stdout:2/469: rename d1/d48/d21/d76/l5f to d1/d7/d63/l9d 0 2024-04-20T10:55:01.500 INFO:tasks.workunit.client.1.smithi175.stdout:6/581: symlink d1/dc0/d63/d7c/lc8 0 2024-04-20T10:55:01.500 INFO:tasks.workunit.client.1.smithi175.stdout:6/582: read d1/d5/d12/f27 [3930700,79354] 0 2024-04-20T10:55:01.501 INFO:tasks.workunit.client.1.smithi175.stdout:0/564: symlink df/d1a/d22/d55/da2/lb5 0 2024-04-20T10:55:01.501 INFO:tasks.workunit.client.1.smithi175.stdout:9/485: write d6/f43 [841126,120164] 0 2024-04-20T10:55:01.504 INFO:tasks.workunit.client.1.smithi175.stdout:8/543: link d7/d13/d1d/d24/d38/f7c d7/d13/d1d/d24/d39/d6f/fa7 0 2024-04-20T10:55:01.505 INFO:tasks.workunit.client.1.smithi175.stdout:1/507: mknod d0/d8/d13/d2e/cb6 0 2024-04-20T10:55:01.506 INFO:tasks.workunit.client.1.smithi175.stdout:4/569: creat d4/dd/d2d/d33/d3c/d44/fc8 x:0 0 0 2024-04-20T10:55:01.509 INFO:tasks.workunit.client.1.smithi175.stdout:3/416: mknod d7/d21/d16/d22/c88 0 2024-04-20T10:55:01.510 INFO:tasks.workunit.client.1.smithi175.stdout:8/544: creat d7/d13/d1d/d92/fa8 x:0 0 0 2024-04-20T10:55:01.514 INFO:tasks.workunit.client.1.smithi175.stdout:1/508: mkdir d0/d57/db7 0 2024-04-20T10:55:01.517 INFO:tasks.workunit.client.1.smithi175.stdout:4/570: rmdir d4/dd/d2d/d33/d58/dc3 0 2024-04-20T10:55:01.518 INFO:tasks.workunit.client.1.smithi175.stdout:7/665: dread db/d1d/d39/d50/f52 [0,4194304] 0 2024-04-20T10:55:01.519 INFO:tasks.workunit.client.1.smithi175.stdout:9/486: rename d6/d10/f1a to d6/d1b/d26/f88 0 2024-04-20T10:55:01.519 INFO:tasks.workunit.client.1.smithi175.stdout:9/487: chown d6/c1f 10878 1 2024-04-20T10:55:01.520 INFO:tasks.workunit.client.1.smithi175.stdout:3/417: truncate d7/d19/d33/f3b 4413944 0 2024-04-20T10:55:01.520 INFO:tasks.workunit.client.1.smithi175.stdout:8/545: truncate d7/d13/d1d/d24/d63/f69 3565472 0 2024-04-20T10:55:01.521 INFO:tasks.workunit.client.1.smithi175.stdout:8/546: write d7/d13/d1d/d24/d39/d6f/f90 [118277,42611] 0 2024-04-20T10:55:01.522 INFO:tasks.workunit.client.1.smithi175.stdout:9/488: creat d6/d33/f89 x:0 0 0 2024-04-20T10:55:01.523 INFO:tasks.workunit.client.1.smithi175.stdout:3/418: rmdir d7/d19/d2a/d59 39 2024-04-20T10:55:01.523 INFO:tasks.workunit.client.1.smithi175.stdout:3/419: chown d7/d21/d16/d49 276 1 2024-04-20T10:55:01.523 INFO:tasks.workunit.client.1.smithi175.stdout:3/420: dread - d7/d21/d16/f7a zero size 2024-04-20T10:55:01.523 INFO:tasks.workunit.client.1.smithi175.stdout:3/421: chown d7/d21 6450 1 2024-04-20T10:55:01.524 INFO:tasks.workunit.client.1.smithi175.stdout:7/666: creat db/d61/d6d/d9c/de8/d2a/d41/fec x:0 0 0 2024-04-20T10:55:01.526 INFO:tasks.workunit.client.1.smithi175.stdout:9/489: chown d6/d1b/d2f/c5a 2731563 1 2024-04-20T10:55:01.527 INFO:tasks.workunit.client.1.smithi175.stdout:3/422: getdents d7/d21/d16/d22/d2c/d64 0 2024-04-20T10:55:01.527 INFO:tasks.workunit.client.1.smithi175.stdout:2/470: dwrite d1/d53/f7c [0,4194304] 0 2024-04-20T10:55:01.527 INFO:tasks.workunit.client.1.smithi175.stdout:6/583: dwrite d1/d5/d12/f31 [0,4194304] 0 2024-04-20T10:55:01.528 INFO:tasks.workunit.client.1.smithi175.stdout:7/667: mknod db/d1d/d39/d50/dba/d47/da6/db9/dc8/dd8/ced 0 2024-04-20T10:55:01.529 INFO:tasks.workunit.client.1.smithi175.stdout:8/547: link d7/d13/d1d/d24/d38/d73/l83 d7/d13/d1d/d92/la9 0 2024-04-20T10:55:01.531 INFO:tasks.workunit.client.1.smithi175.stdout:4/571: rename d4/dd/d2d/c78 to d4/dd/d54/d5d/d9e/cc9 0 2024-04-20T10:55:01.532 INFO:tasks.workunit.client.1.smithi175.stdout:6/584: read d1/dc0/d63/f77 [2636296,115512] 0 2024-04-20T10:55:01.532 INFO:tasks.workunit.client.1.smithi175.stdout:3/423: mkdir d7/d19/d33/d7e/d89 0 2024-04-20T10:55:01.536 INFO:tasks.workunit.client.1.smithi175.stdout:7/668: creat db/d1d/d39/d50/dba/d47/dac/fee x:0 0 0 2024-04-20T10:55:01.537 INFO:tasks.workunit.client.1.smithi175.stdout:8/548: readlink d7/d13/d1d/d92/l52 0 2024-04-20T10:55:01.537 INFO:tasks.workunit.client.1.smithi175.stdout:8/549: read d7/d13/d1d/f1e [3963641,86261] 0 2024-04-20T10:55:01.539 INFO:tasks.workunit.client.1.smithi175.stdout:3/424: creat d7/d19/d2a/d59/f8a x:0 0 0 2024-04-20T10:55:01.540 INFO:tasks.workunit.client.1.smithi175.stdout:2/471: mknod d1/d48/c9e 0 2024-04-20T10:55:01.540 INFO:tasks.workunit.client.1.smithi175.stdout:2/472: fdatasync d1/f57 0 2024-04-20T10:55:01.541 INFO:tasks.workunit.client.1.smithi175.stdout:7/669: unlink db/d61/d6d/d9c/de8/d2a/fe1 0 2024-04-20T10:55:01.542 INFO:tasks.workunit.client.1.smithi175.stdout:8/550: chown d7/d13/d1d/c4b 0 1 2024-04-20T10:55:01.542 INFO:tasks.workunit.client.1.smithi175.stdout:1/509: dwrite d0/d8/f5e [0,4194304] 0 2024-04-20T10:55:01.543 INFO:tasks.workunit.client.1.smithi175.stdout:5/673: dwrite db/d1f/d31/fdc [0,4194304] 0 2024-04-20T10:55:01.543 INFO:tasks.workunit.client.1.smithi175.stdout:8/551: getdents d7/d13/d1d/d24/d39 0 2024-04-20T10:55:01.544 INFO:tasks.workunit.client.1.smithi175.stdout:8/552: write d7/d13/d1d/d24/d63/f9a [643034,17184] 0 2024-04-20T10:55:01.545 INFO:tasks.workunit.client.1.smithi175.stdout:9/490: rename d6/d33/d63/c4e to d6/d1b/d2f/c8a 0 2024-04-20T10:55:01.546 INFO:tasks.workunit.client.1.smithi175.stdout:2/473: mknod d1/d48/d21/d76/c9f 0 2024-04-20T10:55:01.553 INFO:tasks.workunit.client.1.smithi175.stdout:4/572: rename d4/dd/d2d/d33/d58/f59 to d4/dd/d54/d5d/d79/fca 0 2024-04-20T10:55:01.555 INFO:tasks.workunit.client.1.smithi175.stdout:2/474: mknod d1/d7/d63/ca0 0 2024-04-20T10:55:01.559 INFO:tasks.workunit.client.1.smithi175.stdout:3/425: rename d7/d19/d2a/c68 to d7/d19/c8b 0 2024-04-20T10:55:01.560 INFO:tasks.workunit.client.1.smithi175.stdout:2/475: mknod d1/d7/ca1 0 2024-04-20T10:55:01.561 INFO:tasks.workunit.client.1.smithi175.stdout:3/426: truncate d7/d21/d16/d22/f52 761996 0 2024-04-20T10:55:01.563 INFO:tasks.workunit.client.1.smithi175.stdout:3/427: mkdir d7/d10/d8c 0 2024-04-20T10:55:01.564 INFO:tasks.workunit.client.1.smithi175.stdout:7/670: rename db/d61/d6d/d9c/de8/d8e/c48 to db/d1d/d39/d50/dba/cef 0 2024-04-20T10:55:01.565 INFO:tasks.workunit.client.1.smithi175.stdout:7/671: chown db/d1d/d39/d50/dba/d47/da6/db9 19093 1 2024-04-20T10:55:01.568 INFO:tasks.workunit.client.1.smithi175.stdout:4/573: dwrite d4/dd/d54/d5d/fa3 [0,4194304] 0 2024-04-20T10:55:01.572 INFO:tasks.workunit.client.1.smithi175.stdout:5/674: rename db/d1f/d31/l54 to db/d11/d25/d38/d40/le0 0 2024-04-20T10:55:01.577 INFO:tasks.workunit.client.1.smithi175.stdout:4/574: creat d4/dd/d5e/fcb x:0 0 0 2024-04-20T10:55:01.577 INFO:tasks.workunit.client.1.smithi175.stdout:7/672: symlink db/lf0 0 2024-04-20T10:55:01.579 INFO:tasks.workunit.client.1.smithi175.stdout:3/428: write d7/d10/f4a [723308,2944] 0 2024-04-20T10:55:01.582 INFO:tasks.workunit.client.1.smithi175.stdout:2/476: rename d1/d7/ca to d1/d6a/ca2 0 2024-04-20T10:55:01.582 INFO:tasks.workunit.client.1.smithi175.stdout:2/477: fdatasync d1/d48/f27 0 2024-04-20T10:55:01.582 INFO:tasks.workunit.client.1.smithi175.stdout:3/429: creat d7/d21/f8d x:0 0 0 2024-04-20T10:55:01.583 INFO:tasks.workunit.client.1.smithi175.stdout:1/510: dwrite d0/d8/d13/d2e/d35/f37 [0,4194304] 0 2024-04-20T10:55:01.584 INFO:tasks.workunit.client.1.smithi175.stdout:7/673: link db/d1d/d60/d76/db6/fc9 db/d61/d6d/d9c/de8/d8e/ff1 0 2024-04-20T10:55:01.587 INFO:tasks.workunit.client.1.smithi175.stdout:6/585: dread d1/d37/d83/db8/d60/d6b/f72 [0,4194304] 0 2024-04-20T10:55:01.587 INFO:tasks.workunit.client.1.smithi175.stdout:3/430: creat d7/d10/d8c/f8e x:0 0 0 2024-04-20T10:55:01.587 INFO:tasks.workunit.client.1.smithi175.stdout:4/575: write d4/dd/d54/d5d/d9e/f86 [2233140,59654] 0 2024-04-20T10:55:01.588 INFO:tasks.workunit.client.1.smithi175.stdout:6/586: truncate d1/d37/d83/db8/f75 1533800 0 2024-04-20T10:55:01.589 INFO:tasks.workunit.client.1.smithi175.stdout:6/587: getdents d1/dc0 0 2024-04-20T10:55:01.592 INFO:tasks.workunit.client.1.smithi175.stdout:6/588: rename d1/dc0/d29/lc6 to d1/d5/d12/d22/lc9 0 2024-04-20T10:55:01.592 INFO:tasks.workunit.client.1.smithi175.stdout:6/589: getdents d1/d37/d83/db8/db9 0 2024-04-20T10:55:01.593 INFO:tasks.workunit.client.1.smithi175.stdout:7/674: dread db/d1d/d39/d50/dba/d47/f49 [0,4194304] 0 2024-04-20T10:55:01.593 INFO:tasks.workunit.client.1.smithi175.stdout:7/675: dread db/d61/d6d/d9c/de8/f3c [0,4194304] 0 2024-04-20T10:55:01.594 INFO:tasks.workunit.client.1.smithi175.stdout:7/676: dread - db/d1d/d60/d76/db6/fc9 zero size 2024-04-20T10:55:01.594 INFO:tasks.workunit.client.1.smithi175.stdout:7/677: write db/d1d/d39/d50/dba/d47/da6/fc0 [1029725,51638] 0 2024-04-20T10:55:01.595 INFO:tasks.workunit.client.1.smithi175.stdout:7/678: mknod db/d1d/cf2 0 2024-04-20T10:55:01.596 INFO:tasks.workunit.client.1.smithi175.stdout:3/431: dread d7/d21/d16/d49/f63 [0,4194304] 0 2024-04-20T10:55:01.597 INFO:tasks.workunit.client.1.smithi175.stdout:7/679: read db/d1d/d39/d50/f28 [202309,38912] 0 2024-04-20T10:55:01.598 INFO:tasks.workunit.client.1.smithi175.stdout:3/432: rename d7/d21/f41 to d7/d21/d16/d22/d2c/d1f/f8f 0 2024-04-20T10:55:01.599 INFO:tasks.workunit.client.1.smithi175.stdout:5/675: dwrite db/fbe [0,4194304] 0 2024-04-20T10:55:01.600 INFO:tasks.workunit.client.1.smithi175.stdout:1/511: write d0/d29/f5c [4086986,114688] 0 2024-04-20T10:55:01.602 INFO:tasks.workunit.client.1.smithi175.stdout:3/433: write d7/d10/f42 [4784570,29949] 0 2024-04-20T10:55:01.604 INFO:tasks.workunit.client.1.smithi175.stdout:6/590: write d1/d37/d83/db8/d60/d68/d7e/f81 [145162,40445] 0 2024-04-20T10:55:01.604 INFO:tasks.workunit.client.1.smithi175.stdout:6/591: write d1/dc0/d29/f2f [1288534,107923] 0 2024-04-20T10:55:01.605 INFO:tasks.workunit.client.1.smithi175.stdout:1/512: creat d0/d8/d13/d79/d8c/dac/fb8 x:0 0 0 2024-04-20T10:55:01.608 INFO:tasks.workunit.client.1.smithi175.stdout:3/434: creat d7/d21/d16/d22/d2c/d1f/d48/f90 x:0 0 0 2024-04-20T10:55:01.608 INFO:tasks.workunit.client.1.smithi175.stdout:6/592: fsync d1/d37/d83/db8/d60/f86 0 2024-04-20T10:55:01.609 INFO:tasks.workunit.client.1.smithi175.stdout:1/513: mkdir d0/d8/d13/db9 0 2024-04-20T10:55:01.610 INFO:tasks.workunit.client.1.smithi175.stdout:3/435: readlink d7/d21/d16/l32 0 2024-04-20T10:55:01.613 INFO:tasks.workunit.client.1.smithi175.stdout:1/514: creat d0/d8/fba x:0 0 0 2024-04-20T10:55:01.615 INFO:tasks.workunit.client.1.smithi175.stdout:6/593: link d1/d37/d83/db8/f75 d1/d5/fca 0 2024-04-20T10:55:01.615 INFO:tasks.workunit.client.1.smithi175.stdout:6/594: fsync d1/d37/d83/db8/d60/d6b/f9d 0 2024-04-20T10:55:01.616 INFO:tasks.workunit.client.1.smithi175.stdout:1/515: creat d0/d8/d13/fbb x:0 0 0 2024-04-20T10:55:01.617 INFO:tasks.workunit.client.1.smithi175.stdout:3/436: rename d7/d19/d2a to d7/d21/d16/d22/d2c/d91 0 2024-04-20T10:55:01.618 INFO:tasks.workunit.client.1.smithi175.stdout:3/437: creat d7/d21/d16/d22/d2c/f92 x:0 0 0 2024-04-20T10:55:01.619 INFO:tasks.workunit.client.1.smithi175.stdout:6/595: symlink d1/d5/d12/lcb 0 2024-04-20T10:55:01.619 INFO:tasks.workunit.client.1.smithi175.stdout:6/596: read d1/dc0/d29/f2f [1324789,4450] 0 2024-04-20T10:55:01.619 INFO:tasks.workunit.client.1.smithi175.stdout:6/597: chown d1/dc0/d29/l53 439942 1 2024-04-20T10:55:01.621 INFO:tasks.workunit.client.1.smithi175.stdout:3/438: rename c3 to d7/d10/d8c/c93 0 2024-04-20T10:55:01.621 INFO:tasks.workunit.client.1.smithi175.stdout:3/439: chown d7/d19/d33/d60/l77 7 1 2024-04-20T10:55:01.622 INFO:tasks.workunit.client.1.smithi175.stdout:3/440: mknod d7/d21/d16/d85/c94 0 2024-04-20T10:55:01.623 INFO:tasks.workunit.client.1.smithi175.stdout:5/676: dwrite db/d11/d25/d38/d40/d66/d94/fbb [0,4194304] 0 2024-04-20T10:55:01.623 INFO:tasks.workunit.client.1.smithi175.stdout:5/677: chown db/d1f/d31/da0/fc8 25710077 1 2024-04-20T10:55:01.624 INFO:tasks.workunit.client.1.smithi175.stdout:1/516: read d0/d8/d13/d2e/d35/d8a/f9d [3424137,106095] 0 2024-04-20T10:55:01.626 INFO:tasks.workunit.client.1.smithi175.stdout:3/441: dread d7/d21/f76 [0,4194304] 0 2024-04-20T10:55:01.630 INFO:tasks.workunit.client.1.smithi175.stdout:3/442: rename d7/d19/c2d to d7/d21/d16/d85/c95 0 2024-04-20T10:55:01.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/443: mknod d7/d19/d33/d7e/d86/c96 0 2024-04-20T10:55:01.633 INFO:tasks.workunit.client.1.smithi175.stdout:5/678: write db/d11/d25/d41/f90 [3406651,23453] 0 2024-04-20T10:55:01.633 INFO:tasks.workunit.client.1.smithi175.stdout:3/444: creat d7/d19/f97 x:0 0 0 2024-04-20T10:55:01.639 INFO:tasks.workunit.client.1.smithi175.stdout:6/598: write d1/d37/f48 [243357,79084] 0 2024-04-20T10:55:01.640 INFO:tasks.workunit.client.1.smithi175.stdout:7/680: dwrite db/d61/f68 [0,4194304] 0 2024-04-20T10:55:01.640 INFO:tasks.workunit.client.1.smithi175.stdout:6/599: mknod d1/d5/d12/d7f/dae/ccc 0 2024-04-20T10:55:01.641 INFO:tasks.workunit.client.1.smithi175.stdout:5/679: dread db/d11/d25/d38/d40/d66/d94/fbb [0,4194304] 0 2024-04-20T10:55:01.642 INFO:tasks.workunit.client.1.smithi175.stdout:7/681: mkdir db/d1d/d39/d50/dba/daa/df3 0 2024-04-20T10:55:01.644 INFO:tasks.workunit.client.1.smithi175.stdout:7/682: creat db/d61/d6d/dbc/dc4/ff4 x:0 0 0 2024-04-20T10:55:01.650 INFO:tasks.workunit.client.1.smithi175.stdout:6/600: dread d1/d5/f45 [0,4194304] 0 2024-04-20T10:55:01.650 INFO:tasks.workunit.client.1.smithi175.stdout:6/601: getdents d1/d5/d12/d22/dc1 0 2024-04-20T10:55:01.652 INFO:tasks.workunit.client.1.smithi175.stdout:6/602: creat d1/d5/d12/d73/fcd x:0 0 0 2024-04-20T10:55:01.652 INFO:tasks.workunit.client.1.smithi175.stdout:6/603: chown d1/d5/d12/f27 318278 1 2024-04-20T10:55:01.653 INFO:tasks.workunit.client.1.smithi175.stdout:6/604: creat d1/d5/d12/d7f/dae/fce x:0 0 0 2024-04-20T10:55:01.653 INFO:tasks.workunit.client.1.smithi175.stdout:3/445: dwrite d7/d21/d16/d22/f66 [0,4194304] 0 2024-04-20T10:55:01.657 INFO:tasks.workunit.client.1.smithi175.stdout:1/517: write d0/d8/d13/d2e/f46 [1378085,25207] 0 2024-04-20T10:55:01.657 INFO:tasks.workunit.client.1.smithi175.stdout:1/518: chown d0/d8/d13/c59 3 1 2024-04-20T10:55:01.659 INFO:tasks.workunit.client.1.smithi175.stdout:1/519: unlink d0/d3e/fa9 0 2024-04-20T10:55:01.661 INFO:tasks.workunit.client.1.smithi175.stdout:1/520: symlink d0/d51/d6b/lbc 0 2024-04-20T10:55:01.661 INFO:tasks.workunit.client.1.smithi175.stdout:7/683: dwrite db/d61/d6d/f7f [0,4194304] 0 2024-04-20T10:55:01.664 INFO:tasks.workunit.client.1.smithi175.stdout:7/684: mknod db/d1d/d39/d50/dba/daa/cf5 0 2024-04-20T10:55:01.665 INFO:tasks.workunit.client.1.smithi175.stdout:1/521: dread d0/d8/f30 [0,4194304] 0 2024-04-20T10:55:01.666 INFO:tasks.workunit.client.1.smithi175.stdout:1/522: rename d0/d8/d13/d79/c9c to d0/d51/da8/cbd 0 2024-04-20T10:55:01.667 INFO:tasks.workunit.client.1.smithi175.stdout:1/523: link d0/d8/d13/l55 d0/lbe 0 2024-04-20T10:55:01.669 INFO:tasks.workunit.client.1.smithi175.stdout:6/605: truncate d1/d37/d83/db8/d60/d68/d7e/f81 1923960 0 2024-04-20T10:55:01.672 INFO:tasks.workunit.client.1.smithi175.stdout:1/524: dread d0/d8/f30 [0,4194304] 0 2024-04-20T10:55:01.672 INFO:tasks.workunit.client.1.smithi175.stdout:6/606: link d1/l15 d1/d5/d12/d22/dc1/lcf 0 2024-04-20T10:55:01.672 INFO:tasks.workunit.client.1.smithi175.stdout:6/607: stat d1/d37/f61 0 2024-04-20T10:55:01.674 INFO:tasks.workunit.client.1.smithi175.stdout:7/685: write f2 [3429654,97667] 0 2024-04-20T10:55:01.674 INFO:tasks.workunit.client.1.smithi175.stdout:7/686: read db/d61/d6d/d9c/de8/d8e/f32 [2995277,48552] 0 2024-04-20T10:55:01.674 INFO:tasks.workunit.client.1.smithi175.stdout:7/687: fsync db/d1d/d39/d50/dba/d47/f9b 0 2024-04-20T10:55:01.674 INFO:tasks.workunit.client.1.smithi175.stdout:1/525: symlink d0/d51/lbf 0 2024-04-20T10:55:01.675 INFO:tasks.workunit.client.1.smithi175.stdout:6/608: getdents d1/d37/d83/db8/d60/d6b 0 2024-04-20T10:55:01.675 INFO:tasks.workunit.client.1.smithi175.stdout:1/526: truncate d0/d29/f4f 2822707 0 2024-04-20T10:55:01.677 INFO:tasks.workunit.client.1.smithi175.stdout:6/609: link d1/f3e d1/dc0/d63/d7c/fd0 0 2024-04-20T10:55:01.678 INFO:tasks.workunit.client.1.smithi175.stdout:6/610: symlink d1/d5/d12/d7f/ld1 0 2024-04-20T10:55:01.679 INFO:tasks.workunit.client.1.smithi175.stdout:6/611: readlink d1/dc0/l54 0 2024-04-20T10:55:01.680 INFO:tasks.workunit.client.1.smithi175.stdout:6/612: creat d1/d5/fd2 x:0 0 0 2024-04-20T10:55:01.682 INFO:tasks.workunit.client.1.smithi175.stdout:6/613: creat d1/d5/d12/d7f/fd3 x:0 0 0 2024-04-20T10:55:01.682 INFO:tasks.workunit.client.1.smithi175.stdout:6/614: fsync d1/d37/d83/db8/f75 0 2024-04-20T10:55:01.682 INFO:tasks.workunit.client.1.smithi175.stdout:6/615: chown d1/dc0/d29/f5d 3624395 1 2024-04-20T10:55:01.683 INFO:tasks.workunit.client.1.smithi175.stdout:6/616: symlink d1/dc0/d63/ld4 0 2024-04-20T10:55:01.684 INFO:tasks.workunit.client.1.smithi175.stdout:6/617: truncate d1/d5/fca 542742 0 2024-04-20T10:55:01.684 INFO:tasks.workunit.client.1.smithi175.stdout:1/527: read d0/d8/d13/d2e/f72 [67928,41754] 0 2024-04-20T10:55:01.685 INFO:tasks.workunit.client.1.smithi175.stdout:1/528: getdents d0/d8/d13/d2e/d35/d8a/d91 0 2024-04-20T10:55:01.686 INFO:tasks.workunit.client.1.smithi175.stdout:6/618: rename d1/d5/d12/d7f/dae/ccc to d1/dc0/cd5 0 2024-04-20T10:55:01.687 INFO:tasks.workunit.client.1.smithi175.stdout:1/529: rmdir d0/d8/d13/d75 39 2024-04-20T10:55:01.687 INFO:tasks.workunit.client.1.smithi175.stdout:1/530: write d0/d8/f30 [535877,125519] 0 2024-04-20T10:55:01.689 INFO:tasks.workunit.client.1.smithi175.stdout:1/531: fsync d0/d8/f30 0 2024-04-20T10:55:01.691 INFO:tasks.workunit.client.1.smithi175.stdout:1/532: rename d0/d8/d13/d79/l84 to d0/d8/lc0 0 2024-04-20T10:55:01.693 INFO:tasks.workunit.client.1.smithi175.stdout:1/533: mknod d0/d8/d13/d2e/cc1 0 2024-04-20T10:55:01.709 INFO:tasks.workunit.client.1.smithi175.stdout:7/688: dwrite db/d61/d6d/d9c/de8/f9e [0,4194304] 0 2024-04-20T10:55:01.710 INFO:tasks.workunit.client.1.smithi175.stdout:3/446: dwrite d7/d21/f11 [0,4194304] 0 2024-04-20T10:55:01.710 INFO:tasks.workunit.client.1.smithi175.stdout:1/534: dwrite d0/d8/f18 [4194304,4194304] 0 2024-04-20T10:55:01.710 INFO:tasks.workunit.client.1.smithi175.stdout:7/689: write db/d1d/d39/d50/dba/d47/da6/fc0 [885883,47608] 0 2024-04-20T10:55:01.713 INFO:tasks.workunit.client.1.smithi175.stdout:1/535: creat d0/fc2 x:0 0 0 2024-04-20T10:55:01.713 INFO:tasks.workunit.client.1.smithi175.stdout:1/536: read d0/d8/d13/d2e/d35/d8a/f9d [1285929,77228] 0 2024-04-20T10:55:01.720 INFO:tasks.workunit.client.1.smithi175.stdout:3/447: dread d7/d21/f2f [0,4194304] 0 2024-04-20T10:55:01.736 INFO:tasks.workunit.client.1.smithi175.stdout:1/537: rename d0/f23 to d0/d57/fc3 0 2024-04-20T10:55:01.737 INFO:tasks.workunit.client.1.smithi175.stdout:3/448: chown d7/d21/d16/d22/d2c/d1f/l5a 108352287 1 2024-04-20T10:55:01.739 INFO:tasks.workunit.client.1.smithi175.stdout:1/538: creat d0/d3e/d61/fc4 x:0 0 0 2024-04-20T10:55:01.739 INFO:tasks.workunit.client.1.smithi175.stdout:1/539: readlink d0/d3e/l69 0 2024-04-20T10:55:01.740 INFO:tasks.workunit.client.1.smithi175.stdout:1/540: mknod d0/d29/cc5 0 2024-04-20T10:55:01.741 INFO:tasks.workunit.client.1.smithi175.stdout:1/541: creat d0/fc6 x:0 0 0 2024-04-20T10:55:01.744 INFO:tasks.workunit.client.1.smithi175.stdout:7/690: dwrite db/d61/d6d/d9c/de8/d2a/f84 [0,4194304] 0 2024-04-20T10:55:01.746 INFO:tasks.workunit.client.1.smithi175.stdout:7/691: creat db/d1d/d39/d50/dba/d47/da6/ff6 x:0 0 0 2024-04-20T10:55:01.748 INFO:tasks.workunit.client.1.smithi175.stdout:3/449: dread d7/d21/f11 [0,4194304] 0 2024-04-20T10:55:01.748 INFO:tasks.workunit.client.1.smithi175.stdout:3/450: truncate d7/d19/d33/d60/d79/f81 296279 0 2024-04-20T10:55:01.748 INFO:tasks.workunit.client.1.smithi175.stdout:3/451: write d7/d21/d16/d22/d2c/f92 [525921,93011] 0 2024-04-20T10:55:01.758 INFO:tasks.workunit.client.1.smithi175.stdout:1/542: dwrite d0/d3e/d61/f67 [0,4194304] 0 2024-04-20T10:55:01.758 INFO:tasks.workunit.client.1.smithi175.stdout:1/543: getdents d0/d8/d13/db9 0 2024-04-20T10:55:01.768 INFO:tasks.workunit.client.1.smithi175.stdout:1/544: dread d0/d8/d13/d2e/f97 [4194304,4194304] 0 2024-04-20T10:55:01.783 INFO:tasks.workunit.client.1.smithi175.stdout:1/545: dwrite d0/f93 [0,4194304] 0 2024-04-20T10:55:01.789 INFO:tasks.workunit.client.1.smithi175.stdout:7/692: write db/d1d/d39/d50/f9d [550713,46555] 0 2024-04-20T10:55:01.794 INFO:tasks.workunit.client.1.smithi175.stdout:7/693: dread db/f66 [0,4194304] 0 2024-04-20T10:55:01.794 INFO:tasks.workunit.client.1.smithi175.stdout:7/694: chown db/d61/d6d/d9c/de8/d9a 2035673117 1 2024-04-20T10:55:01.858 INFO:tasks.workunit.client.1.smithi175.stdout:1/546: write d0/d57/f5d [1732852,35937] 0 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:8/553: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:8/554: fdatasync d7/d13/d1d/f1e 0 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:4/576: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:1/547: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:5/680: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:3/452: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:2/478: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:0/565: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:2/479: fdatasync d1/d7/d63/f7b 0 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:6/619: sync 2024-04-20T10:55:02.254 INFO:tasks.workunit.client.1.smithi175.stdout:9/491: sync 2024-04-20T10:55:02.255 INFO:tasks.workunit.client.1.smithi175.stdout:7/695: sync 2024-04-20T10:55:02.255 INFO:tasks.workunit.client.1.smithi175.stdout:8/555: rmdir d7/d13/d1d 39 2024-04-20T10:55:02.255 INFO:tasks.workunit.client.1.smithi175.stdout:4/577: mkdir d4/dd/d5e/d74/da1/dbc/dcc 0 2024-04-20T10:55:02.255 INFO:tasks.workunit.client.1.smithi175.stdout:1/548: mknod d0/d8/d13/d2e/d35/d8a/cc7 0 2024-04-20T10:55:02.256 INFO:tasks.workunit.client.1.smithi175.stdout:5/681: rename db/d11/d25/d38/d40/d47/fdf to db/d30/d46/fe1 0 2024-04-20T10:55:02.256 INFO:tasks.workunit.client.1.smithi175.stdout:5/682: readlink db/la8 0 2024-04-20T10:55:02.257 INFO:tasks.workunit.client.1.smithi175.stdout:3/453: creat d7/d21/d16/d22/d2c/d64/f98 x:0 0 0 2024-04-20T10:55:02.258 INFO:tasks.workunit.client.1.smithi175.stdout:6/620: truncate d1/d37/f92 838219 0 2024-04-20T10:55:02.259 INFO:tasks.workunit.client.1.smithi175.stdout:9/492: link d6/d1b/c83 d6/d1b/d42/d79/c8b 0 2024-04-20T10:55:02.259 INFO:tasks.workunit.client.1.smithi175.stdout:7/696: symlink db/d1d/d39/d50/dba/d47/da6/db9/dc8/dd8/lf7 0 2024-04-20T10:55:02.261 INFO:tasks.workunit.client.1.smithi175.stdout:4/578: chown d4/d23/d2e/l68 1 1 2024-04-20T10:55:02.262 INFO:tasks.workunit.client.1.smithi175.stdout:1/549: mknod d0/d8/d13/d2e/d35/cc8 0 2024-04-20T10:55:02.262 INFO:tasks.workunit.client.1.smithi175.stdout:3/454: write d7/d21/f11 [3643275,43317] 0 2024-04-20T10:55:02.262 INFO:tasks.workunit.client.1.smithi175.stdout:3/455: dread - d7/d21/d16/d22/d2c/d64/f98 zero size 2024-04-20T10:55:02.264 INFO:tasks.workunit.client.1.smithi175.stdout:2/480: rename d1/d7/f6f to d1/d7/d63/d36/d7d/d84/d8b/fa3 0 2024-04-20T10:55:02.264 INFO:tasks.workunit.client.1.smithi175.stdout:5/683: getdents db 0 2024-04-20T10:55:02.265 INFO:tasks.workunit.client.1.smithi175.stdout:5/684: dread - db/d11/d1a/f76 zero size 2024-04-20T10:55:02.266 INFO:tasks.workunit.client.1.smithi175.stdout:0/566: link df/d1a/d22/f44 df/d17/fb6 0 2024-04-20T10:55:02.266 INFO:tasks.workunit.client.1.smithi175.stdout:6/621: getdents d1/dc0/d63/d7c 0 2024-04-20T10:55:02.267 INFO:tasks.workunit.client.1.smithi175.stdout:6/622: write d1/d5/d12/d73/d7a/f9a [210516,129326] 0 2024-04-20T10:55:02.267 INFO:tasks.workunit.client.1.smithi175.stdout:6/623: fsync d1/dc0/d49/f62 0 2024-04-20T10:55:02.268 INFO:tasks.workunit.client.1.smithi175.stdout:7/697: getdents db/d1d 0 2024-04-20T10:55:02.270 INFO:tasks.workunit.client.1.smithi175.stdout:4/579: write d4/d27/d61/f49 [2086136,126596] 0 2024-04-20T10:55:02.270 INFO:tasks.workunit.client.1.smithi175.stdout:8/556: symlink d7/d13/d1d/d24/d38/laa 0 2024-04-20T10:55:02.271 INFO:tasks.workunit.client.1.smithi175.stdout:1/550: mknod d0/d8/d13/db9/cc9 0 2024-04-20T10:55:02.271 INFO:tasks.workunit.client.1.smithi175.stdout:3/456: stat d7/d10/f31 0 2024-04-20T10:55:02.271 INFO:tasks.workunit.client.1.smithi175.stdout:3/457: chown d7/d19/d33/d60/c5e 170 1 2024-04-20T10:55:02.272 INFO:tasks.workunit.client.1.smithi175.stdout:2/481: rename d1/d7/f8 to d1/d48/d38/d82/fa4 0 2024-04-20T10:55:02.272 INFO:tasks.workunit.client.1.smithi175.stdout:2/482: fdatasync d1/d48/f41 0 2024-04-20T10:55:02.273 INFO:tasks.workunit.client.1.smithi175.stdout:0/567: chown df/d19/l50 6116641 1 2024-04-20T10:55:02.273 INFO:tasks.workunit.client.1.smithi175.stdout:0/568: truncate df/d17/d2f/d4f/f6c 4579449 0 2024-04-20T10:55:02.273 INFO:tasks.workunit.client.1.smithi175.stdout:0/569: truncate df/d1a/f27 2034560 0 2024-04-20T10:55:02.273 INFO:tasks.workunit.client.1.smithi175.stdout:0/570: readlink df/d1a/d22/l6e 0 2024-04-20T10:55:02.273 INFO:tasks.workunit.client.1.smithi175.stdout:0/571: stat df/d19/f1f 0 2024-04-20T10:55:02.274 INFO:tasks.workunit.client.1.smithi175.stdout:1/551: dread d0/d3e/f41 [0,4194304] 0 2024-04-20T10:55:02.276 INFO:tasks.workunit.client.1.smithi175.stdout:8/557: getdents d7/d13/d1d/d24/d63 0 2024-04-20T10:55:02.277 INFO:tasks.workunit.client.1.smithi175.stdout:0/572: read df/f11 [2813596,116042] 0 2024-04-20T10:55:02.278 INFO:tasks.workunit.client.1.smithi175.stdout:0/573: fdatasync df/d17/d2f/f5b 0 2024-04-20T10:55:02.278 INFO:tasks.workunit.client.1.smithi175.stdout:9/493: dwrite d6/fe [0,4194304] 0 2024-04-20T10:55:02.278 INFO:tasks.workunit.client.1.smithi175.stdout:3/458: rename d7/d21/d16/d22/d2c/d91/d59 to d7/d19/d33/d60/d79/d99 0 2024-04-20T10:55:02.281 INFO:tasks.workunit.client.1.smithi175.stdout:4/580: mknod d4/dd/d54/d5d/ccd 0 2024-04-20T10:55:02.282 INFO:tasks.workunit.client.1.smithi175.stdout:8/558: rename d7/d13/d1d/d24/d39/c3f to d7/d13/d1d/d24/d39/cab 0 2024-04-20T10:55:02.282 INFO:tasks.workunit.client.1.smithi175.stdout:8/559: chown d7/fd 489 1 2024-04-20T10:55:02.283 INFO:tasks.workunit.client.1.smithi175.stdout:1/552: rename d0/f2a to d0/d3e/d61/d73/fca 0 2024-04-20T10:55:02.283 INFO:tasks.workunit.client.1.smithi175.stdout:1/553: read - d0/d51/d6b/d9e/fa3 zero size 2024-04-20T10:55:02.284 INFO:tasks.workunit.client.1.smithi175.stdout:7/698: dread db/d1d/d39/f3f [0,4194304] 0 2024-04-20T10:55:02.284 INFO:tasks.workunit.client.1.smithi175.stdout:7/699: dread - db/d1d/d39/d50/dba/d47/fc7 zero size 2024-04-20T10:55:02.285 INFO:tasks.workunit.client.1.smithi175.stdout:3/459: truncate d7/d21/fd 3085837 0 2024-04-20T10:55:02.289 INFO:tasks.workunit.client.1.smithi175.stdout:0/574: dread df/d17/f85 [0,4194304] 0 2024-04-20T10:55:02.291 INFO:tasks.workunit.client.1.smithi175.stdout:3/460: truncate d7/d21/d16/d22/d2c/d1f/d48/f53 407850 0 2024-04-20T10:55:02.294 INFO:tasks.workunit.client.1.smithi175.stdout:8/560: rename d7/d13/d1d/d24/c5c to d7/d13/d1d/d56/cac 0 2024-04-20T10:55:02.296 INFO:tasks.workunit.client.1.smithi175.stdout:2/483: dwrite d1/d48/d21/d29/f24 [0,4194304] 0 2024-04-20T10:55:02.296 INFO:tasks.workunit.client.1.smithi175.stdout:2/484: dread - d1/d7/d63/d36/f95 zero size 2024-04-20T10:55:02.296 INFO:tasks.workunit.client.1.smithi175.stdout:2/485: fsync d1/d7/d63/f3e 0 2024-04-20T10:55:02.301 INFO:tasks.workunit.client.1.smithi175.stdout:1/554: mkdir d0/d8/dcb 0 2024-04-20T10:55:02.304 INFO:tasks.workunit.client.1.smithi175.stdout:2/486: getdents d1/d48/d38/d82 0 2024-04-20T10:55:02.306 INFO:tasks.workunit.client.1.smithi175.stdout:1/555: link d0/d3e/d61/c98 d0/d3e/d61/d73/ccc 0 2024-04-20T10:55:02.306 INFO:tasks.workunit.client.1.smithi175.stdout:1/556: fdatasync d0/d8/d13/faa 0 2024-04-20T10:55:02.308 INFO:tasks.workunit.client.1.smithi175.stdout:2/487: rename d1/d48/d21/d76/c94 to d1/d7/d63/d36/d7d/ca5 0 2024-04-20T10:55:02.310 INFO:tasks.workunit.client.1.smithi175.stdout:7/700: dwrite db/d1d/d39/d50/dba/d47/f9b [0,4194304] 0 2024-04-20T10:55:02.310 INFO:tasks.workunit.client.1.smithi175.stdout:4/581: dwrite d4/dd/d2d/d33/d58/fc4 [0,4194304] 0 2024-04-20T10:55:02.312 INFO:tasks.workunit.client.1.smithi175.stdout:3/461: truncate d7/d21/d16/d22/d2c/d1f/d48/f53 313974 0 2024-04-20T10:55:02.313 INFO:tasks.workunit.client.1.smithi175.stdout:3/462: chown d7/d21/d16 173498891 1 2024-04-20T10:55:02.314 INFO:tasks.workunit.client.1.smithi175.stdout:7/701: mknod db/d61/d6d/d9c/de8/d9a/dd2/cf8 0 2024-04-20T10:55:02.314 INFO:tasks.workunit.client.1.smithi175.stdout:5/685: write db/d1f/d31/f4c [192112,8325] 0 2024-04-20T10:55:02.318 INFO:tasks.workunit.client.1.smithi175.stdout:7/702: readlink db/d1d/d60/d76/l97 0 2024-04-20T10:55:02.318 INFO:tasks.workunit.client.1.smithi175.stdout:7/703: readlink db/d1d/d60/d76/lb2 0 2024-04-20T10:55:02.318 INFO:tasks.workunit.client.1.smithi175.stdout:7/704: truncate db/d61/d6d/d9c/de8/d2a/d41/fec 581570 0 2024-04-20T10:55:02.320 INFO:tasks.workunit.client.1.smithi175.stdout:5/686: creat db/d11/d25/d62/fe2 x:0 0 0 2024-04-20T10:55:02.321 INFO:tasks.workunit.client.1.smithi175.stdout:4/582: link d4/d27/c1b d4/dd/d5e/d96/cce 0 2024-04-20T10:55:02.322 INFO:tasks.workunit.client.1.smithi175.stdout:7/705: creat db/d1d/d39/ff9 x:0 0 0 2024-04-20T10:55:02.323 INFO:tasks.workunit.client.1.smithi175.stdout:0/575: dwrite df/d1a/d3f/f88 [0,4194304] 0 2024-04-20T10:55:02.323 INFO:tasks.workunit.client.1.smithi175.stdout:5/687: creat db/d11/d6d/fe3 x:0 0 0 2024-04-20T10:55:02.327 INFO:tasks.workunit.client.1.smithi175.stdout:1/557: dwrite d0/d8/d13/d2e/f38 [0,4194304] 0 2024-04-20T10:55:02.327 INFO:tasks.workunit.client.1.smithi175.stdout:5/688: dread db/d30/d46/f7e [0,4194304] 0 2024-04-20T10:55:02.327 INFO:tasks.workunit.client.1.smithi175.stdout:8/561: dwrite d7/d13/d1d/d56/f96 [0,4194304] 0 2024-04-20T10:55:02.327 INFO:tasks.workunit.client.1.smithi175.stdout:8/562: fsync d7/d13/d1d/d24/d38/f77 0 2024-04-20T10:55:02.328 INFO:tasks.workunit.client.1.smithi175.stdout:0/576: link df/d1a/d28/c76 df/d1a/d22/d6a/cb7 0 2024-04-20T10:55:02.329 INFO:tasks.workunit.client.1.smithi175.stdout:1/558: rmdir d0/d8/d13/d79/d8c/dac/db1 0 2024-04-20T10:55:02.332 INFO:tasks.workunit.client.1.smithi175.stdout:4/583: write d4/dd/d54/d5d/d9e/f29 [1475658,50123] 0 2024-04-20T10:55:02.332 INFO:tasks.workunit.client.1.smithi175.stdout:5/689: read db/d9d/f37 [103416,42661] 0 2024-04-20T10:55:02.334 INFO:tasks.workunit.client.1.smithi175.stdout:8/563: truncate d7/d13/d1d/f2f 1347414 0 2024-04-20T10:55:02.334 INFO:tasks.workunit.client.1.smithi175.stdout:2/488: dwrite d1/f96 [0,4194304] 0 2024-04-20T10:55:02.335 INFO:tasks.workunit.client.1.smithi175.stdout:4/584: chown d4/dd/l6f 44239 1 2024-04-20T10:55:02.337 INFO:tasks.workunit.client.1.smithi175.stdout:8/564: getdents d7/d13/d1d/d92/d6c 0 2024-04-20T10:55:02.342 INFO:tasks.workunit.client.1.smithi175.stdout:4/585: rmdir d4/dd/d54/d5d/d8a/da4/da7 0 2024-04-20T10:55:02.344 INFO:tasks.workunit.client.1.smithi175.stdout:2/489: write d1/d48/d21/d29/f24 [2410569,88524] 0 2024-04-20T10:55:02.345 INFO:tasks.workunit.client.1.smithi175.stdout:8/565: symlink d7/d13/d1d/d24/d39/d85/lad 0 2024-04-20T10:55:02.347 INFO:tasks.workunit.client.1.smithi175.stdout:5/690: rename db/d11/d25/d38/c49 to db/d11/d25/d38/ce4 0 2024-04-20T10:55:02.347 INFO:tasks.workunit.client.1.smithi175.stdout:5/691: chown db/d9d 27 1 2024-04-20T10:55:02.347 INFO:tasks.workunit.client.1.smithi175.stdout:5/692: dread - db/d11/d80/dc3/fd5 zero size 2024-04-20T10:55:02.350 INFO:tasks.workunit.client.1.smithi175.stdout:8/566: dread d7/d13/f12 [0,4194304] 0 2024-04-20T10:55:02.350 INFO:tasks.workunit.client.1.smithi175.stdout:2/490: rename d1/d7/l3c to d1/d7/d63/d36/d7d/d84/d8b/la6 0 2024-04-20T10:55:02.350 INFO:tasks.workunit.client.1.smithi175.stdout:2/491: readlink d1/d7/d63/l9d 0 2024-04-20T10:55:02.353 INFO:tasks.workunit.client.1.smithi175.stdout:1/559: dwrite d0/d8/d13/d2e/d35/d8a/f9d [0,4194304] 0 2024-04-20T10:55:02.353 INFO:tasks.workunit.client.1.smithi175.stdout:0/577: dwrite df/d17/fb6 [0,4194304] 0 2024-04-20T10:55:02.353 INFO:tasks.workunit.client.1.smithi175.stdout:5/693: getdents db/d11/d1a 0 2024-04-20T10:55:02.354 INFO:tasks.workunit.client.1.smithi175.stdout:5/694: chown db/d1f/d31/f3a 1250737389 1 2024-04-20T10:55:02.354 INFO:tasks.workunit.client.1.smithi175.stdout:2/492: mkdir d1/d7/d63/d36/d7d/d84/d8b/da7 0 2024-04-20T10:55:02.355 INFO:tasks.workunit.client.1.smithi175.stdout:1/560: getdents d0/d8/d13/db9 0 2024-04-20T10:55:02.355 INFO:tasks.workunit.client.1.smithi175.stdout:1/561: chown d0/d8/d13/d79/d8c/l9a 41 1 2024-04-20T10:55:02.356 INFO:tasks.workunit.client.1.smithi175.stdout:0/578: getdents df/d1a/da1 0 2024-04-20T10:55:02.357 INFO:tasks.workunit.client.1.smithi175.stdout:5/695: stat ca 0 2024-04-20T10:55:02.357 INFO:tasks.workunit.client.1.smithi175.stdout:5/696: chown db/d11/d80/dc3/fd5 0 1 2024-04-20T10:55:02.357 INFO:tasks.workunit.client.1.smithi175.stdout:5/697: chown db/d9d 1528210541 1 2024-04-20T10:55:02.358 INFO:tasks.workunit.client.1.smithi175.stdout:8/567: symlink d7/d13/lae 0 2024-04-20T10:55:02.360 INFO:tasks.workunit.client.1.smithi175.stdout:5/698: creat db/d11/d25/d41/d60/fe5 x:0 0 0 2024-04-20T10:55:02.360 INFO:tasks.workunit.client.1.smithi175.stdout:4/586: dwrite d4/dd/d2d/d33/d3c/fa9 [0,4194304] 0 2024-04-20T10:55:02.362 INFO:tasks.workunit.client.1.smithi175.stdout:2/493: unlink d1/d48/d21/d29/c4a 0 2024-04-20T10:55:02.363 INFO:tasks.workunit.client.1.smithi175.stdout:5/699: creat db/d11/d25/d38/d40/fe6 x:0 0 0 2024-04-20T10:55:02.363 INFO:tasks.workunit.client.1.smithi175.stdout:5/700: fdatasync db/d30/d46/fab 0 2024-04-20T10:55:02.366 INFO:tasks.workunit.client.1.smithi175.stdout:4/587: rmdir d4/dd/d2d/d43/d69/daa 39 2024-04-20T10:55:02.369 INFO:tasks.workunit.client.1.smithi175.stdout:5/701: rename db/d11/d25/d41/c79 to db/d11/d80/dc3/ce7 0 2024-04-20T10:55:02.370 INFO:tasks.workunit.client.1.smithi175.stdout:5/702: fdatasync db/d11/d25/d62/f7c 0 2024-04-20T10:55:02.371 INFO:tasks.workunit.client.1.smithi175.stdout:4/588: unlink d4/dd/d2d/d33/f3d 0 2024-04-20T10:55:02.371 INFO:tasks.workunit.client.1.smithi175.stdout:4/589: stat d4/dd/d54/d5d/d8a/da4 0 2024-04-20T10:55:02.372 INFO:tasks.workunit.client.1.smithi175.stdout:8/568: link d7/d13/d1d/c21 d7/d13/d1d/d24/d38/caf 0 2024-04-20T10:55:02.373 INFO:tasks.workunit.client.1.smithi175.stdout:5/703: creat db/d11/d25/fe8 x:0 0 0 2024-04-20T10:55:02.373 INFO:tasks.workunit.client.1.smithi175.stdout:4/590: getdents d4/dd/d54/d5d 0 2024-04-20T10:55:02.375 INFO:tasks.workunit.client.1.smithi175.stdout:4/591: fdatasync d4/f20 0 2024-04-20T10:55:02.376 INFO:tasks.workunit.client.1.smithi175.stdout:8/569: rename d7/d13/d1d/d24/d26/f6a to d7/d13/d1d/d24/fb0 0 2024-04-20T10:55:02.376 INFO:tasks.workunit.client.1.smithi175.stdout:8/570: write d7/d13/d1d/f8f [1150349,51196] 0 2024-04-20T10:55:02.376 INFO:tasks.workunit.client.1.smithi175.stdout:8/571: fdatasync d7/d13/d1d/d24/d26/f7b 0 2024-04-20T10:55:02.378 INFO:tasks.workunit.client.1.smithi175.stdout:5/704: rename db/d11/d25/d38/d40/fe6 to db/d30/d46/fe9 0 2024-04-20T10:55:02.390 INFO:tasks.workunit.client.1.smithi175.stdout:1/562: dwrite d0/d8/d13/f60 [0,4194304] 0 2024-04-20T10:55:02.391 INFO:tasks.workunit.client.1.smithi175.stdout:1/563: dread - d0/d8/d13/d2e/fa6 zero size 2024-04-20T10:55:02.391 INFO:tasks.workunit.client.1.smithi175.stdout:2/494: dwrite d1/d7/f34 [0,4194304] 0 2024-04-20T10:55:02.391 INFO:tasks.workunit.client.1.smithi175.stdout:0/579: dwrite df/d1a/d22/d6a/d72/f95 [0,4194304] 0 2024-04-20T10:55:02.399 INFO:tasks.workunit.client.1.smithi175.stdout:1/564: dread d0/d8/d13/d2e/d35/f37 [0,4194304] 0 2024-04-20T10:55:02.408 INFO:tasks.workunit.client.1.smithi175.stdout:1/565: write d0/d51/da8/fb3 [3857790,113573] 0 2024-04-20T10:55:02.409 INFO:tasks.workunit.client.1.smithi175.stdout:1/566: read d0/d8/f30 [1675777,112429] 0 2024-04-20T10:55:02.409 INFO:tasks.workunit.client.1.smithi175.stdout:2/495: dwrite d1/d53/f97 [0,4194304] 0 2024-04-20T10:55:02.426 INFO:tasks.workunit.client.1.smithi175.stdout:4/592: mkdir d4/dd/d2d/d43/d69/d83/dcf 0 2024-04-20T10:55:02.429 INFO:tasks.workunit.client.1.smithi175.stdout:0/580: creat df/d2e/fb8 x:0 0 0 2024-04-20T10:55:02.430 INFO:tasks.workunit.client.1.smithi175.stdout:1/567: creat d0/d8/d13/db9/fcd x:0 0 0 2024-04-20T10:55:02.430 INFO:tasks.workunit.client.1.smithi175.stdout:1/568: dread - d0/f77 zero size 2024-04-20T10:55:02.430 INFO:tasks.workunit.client.1.smithi175.stdout:1/569: chown d0/d8/f4d 892127211 1 2024-04-20T10:55:02.430 INFO:tasks.workunit.client.1.smithi175.stdout:1/570: read d0/ff [1430006,34892] 0 2024-04-20T10:55:02.430 INFO:tasks.workunit.client.1.smithi175.stdout:1/571: fdatasync d0/d8/d13/fbb 0 2024-04-20T10:55:02.442 INFO:tasks.workunit.client.1.smithi175.stdout:4/593: rmdir d4/dd/d5e/d74/da1/dbc/dcc 0 2024-04-20T10:55:02.444 INFO:tasks.workunit.client.1.smithi175.stdout:8/572: rename d7/d13/d1d/d24/d38/laa to d7/d13/d1d/d92/lb1 0 2024-04-20T10:55:02.444 INFO:tasks.workunit.client.1.smithi175.stdout:4/594: write d4/dd/d54/d5d/d9e/fa0 [273906,112632] 0 2024-04-20T10:55:02.444 INFO:tasks.workunit.client.1.smithi175.stdout:5/705: truncate f2 29166 0 2024-04-20T10:55:02.446 INFO:tasks.workunit.client.1.smithi175.stdout:2/496: mkdir d1/d48/d21/d76/da8 0 2024-04-20T10:55:02.450 INFO:tasks.workunit.client.1.smithi175.stdout:8/573: truncate d7/d13/d1d/d24/d63/f69 2599993 0 2024-04-20T10:55:02.452 INFO:tasks.workunit.client.1.smithi175.stdout:4/595: creat d4/dd/d2d/d43/d69/fd0 x:0 0 0 2024-04-20T10:55:02.452 INFO:tasks.workunit.client.1.smithi175.stdout:4/596: truncate d4/dd/d2d/d43/d69/fa8 1554748 0 2024-04-20T10:55:02.455 INFO:tasks.workunit.client.1.smithi175.stdout:8/574: symlink d7/d13/d1d/d24/d38/d73/lb2 0 2024-04-20T10:55:02.455 INFO:tasks.workunit.client.1.smithi175.stdout:8/575: chown d7/f9d 3 1 2024-04-20T10:55:02.455 INFO:tasks.workunit.client.1.smithi175.stdout:8/576: readlink d7/d13/d1d/d92/lb1 0 2024-04-20T10:55:02.457 INFO:tasks.workunit.client.1.smithi175.stdout:1/572: dwrite d0/f49 [0,4194304] 0 2024-04-20T10:55:02.457 INFO:tasks.workunit.client.1.smithi175.stdout:1/573: fdatasync d0/f8e 0 2024-04-20T10:55:02.457 INFO:tasks.workunit.client.1.smithi175.stdout:4/597: dread d4/d27/f52 [0,4194304] 0 2024-04-20T10:55:02.458 INFO:tasks.workunit.client.1.smithi175.stdout:5/706: rename db/d11/f43 to db/d11/d25/fea 0 2024-04-20T10:55:02.460 INFO:tasks.workunit.client.1.smithi175.stdout:8/577: creat d7/fb3 x:0 0 0 2024-04-20T10:55:02.464 INFO:tasks.workunit.client.1.smithi175.stdout:4/598: rmdir d4/dd/d54/d5d/d8a/da4/dbe 0 2024-04-20T10:55:02.468 INFO:tasks.workunit.client.1.smithi175.stdout:5/707: rmdir db/d11/d25/d62 39 2024-04-20T10:55:02.468 INFO:tasks.workunit.client.1.smithi175.stdout:5/708: truncate db/d11/d25/f9c 172426 0 2024-04-20T10:55:02.469 INFO:tasks.workunit.client.1.smithi175.stdout:5/709: dread db/d11/d25/f9c [0,4194304] 0 2024-04-20T10:55:02.470 INFO:tasks.workunit.client.1.smithi175.stdout:5/710: getdents db/d11/d25/d38/d40/d66/d94 0 2024-04-20T10:55:02.472 INFO:tasks.workunit.client.1.smithi175.stdout:2/497: rename d1/d48/d21/c60 to d1/d6a/d74/ca9 0 2024-04-20T10:55:02.477 INFO:tasks.workunit.client.1.smithi175.stdout:8/578: dread d7/d13/f50 [0,4194304] 0 2024-04-20T10:55:02.478 INFO:tasks.workunit.client.1.smithi175.stdout:4/599: write d4/d27/f17 [1541715,94559] 0 2024-04-20T10:55:02.479 INFO:tasks.workunit.client.1.smithi175.stdout:2/498: creat d1/d48/d21/d76/faa x:0 0 0 2024-04-20T10:55:02.479 INFO:tasks.workunit.client.1.smithi175.stdout:5/711: symlink db/d11/d25/d38/d40/d47/leb 0 2024-04-20T10:55:02.482 INFO:tasks.workunit.client.1.smithi175.stdout:1/574: dwrite d0/d8/f71 [0,4194304] 0 2024-04-20T10:55:02.482 INFO:tasks.workunit.client.1.smithi175.stdout:5/712: rename db/d11/d25/fe8 to db/d1f/d31/fec 0 2024-04-20T10:55:02.484 INFO:tasks.workunit.client.1.smithi175.stdout:1/575: rmdir d0/d8/d13/d2e 39 2024-04-20T10:55:02.485 INFO:tasks.workunit.client.1.smithi175.stdout:1/576: chown d0/d8/f45 13171 1 2024-04-20T10:55:02.485 INFO:tasks.workunit.client.1.smithi175.stdout:1/577: chown d0/d8/d13/faa 2339 1 2024-04-20T10:55:02.485 INFO:tasks.workunit.client.1.smithi175.stdout:0/581: write df/f38 [1174641,72170] 0 2024-04-20T10:55:02.485 INFO:tasks.workunit.client.1.smithi175.stdout:0/582: truncate df/fac 305920 0 2024-04-20T10:55:02.485 INFO:tasks.workunit.client.1.smithi175.stdout:0/583: dread - df/f81 zero size 2024-04-20T10:55:02.488 INFO:tasks.workunit.client.1.smithi175.stdout:4/600: dread d4/d27/d61/f46 [0,4194304] 0 2024-04-20T10:55:02.488 INFO:tasks.workunit.client.1.smithi175.stdout:4/601: write d4/dd/d54/d5d/d9e/fa0 [26247,82090] 0 2024-04-20T10:55:02.489 INFO:tasks.workunit.client.1.smithi175.stdout:5/713: symlink db/d30/d46/d88/db2/led 0 2024-04-20T10:55:02.489 INFO:tasks.workunit.client.1.smithi175.stdout:0/584: creat df/d1a/d22/d6a/d72/d48/fb9 x:0 0 0 2024-04-20T10:55:02.494 INFO:tasks.workunit.client.1.smithi175.stdout:4/602: link d4/d23/d2e/f82 d4/dd/d5e/d74/fd1 0 2024-04-20T10:55:02.494 INFO:tasks.workunit.client.1.smithi175.stdout:5/714: mknod db/d11/cee 0 2024-04-20T10:55:02.495 INFO:tasks.workunit.client.1.smithi175.stdout:0/585: mknod df/d1a/d22/d6a/d72/d48/cba 0 2024-04-20T10:55:02.495 INFO:tasks.workunit.client.1.smithi175.stdout:0/586: fdatasync df/d17/f85 0 2024-04-20T10:55:02.497 INFO:tasks.workunit.client.1.smithi175.stdout:6/624: sync 2024-04-20T10:55:02.497 INFO:tasks.workunit.client.1.smithi175.stdout:4/603: mknod d4/dd/d2d/d33/d3c/cd2 0 2024-04-20T10:55:02.498 INFO:tasks.workunit.client.1.smithi175.stdout:5/715: dread db/d1f/f20 [0,4194304] 0 2024-04-20T10:55:02.499 INFO:tasks.workunit.client.1.smithi175.stdout:6/625: creat d1/d5/d12/d22/fd6 x:0 0 0 2024-04-20T10:55:02.499 INFO:tasks.workunit.client.1.smithi175.stdout:6/626: write d1/d5/d12/d22/f44 [475705,22852] 0 2024-04-20T10:55:02.500 INFO:tasks.workunit.client.1.smithi175.stdout:0/587: read df/d17/f85 [2970360,100371] 0 2024-04-20T10:55:02.501 INFO:tasks.workunit.client.1.smithi175.stdout:5/716: symlink db/d11/d25/d41/lef 0 2024-04-20T10:55:02.504 INFO:tasks.workunit.client.1.smithi175.stdout:4/604: symlink d4/dd/d2d/d33/d3c/d44/ld3 0 2024-04-20T10:55:02.504 INFO:tasks.workunit.client.1.smithi175.stdout:4/605: chown d4/d27/d61/f7a 1110 1 2024-04-20T10:55:02.506 INFO:tasks.workunit.client.1.smithi175.stdout:8/579: dwrite d7/d13/d1d/d24/d38/f8d [0,4194304] 0 2024-04-20T10:55:02.506 INFO:tasks.workunit.client.1.smithi175.stdout:0/588: rmdir df/d1a/da1/daa 0 2024-04-20T10:55:02.510 INFO:tasks.workunit.client.1.smithi175.stdout:6/627: symlink d1/d37/d83/db8/d60/d68/ld7 0 2024-04-20T10:55:02.510 INFO:tasks.workunit.client.1.smithi175.stdout:6/628: chown d1/d5/d12/f56 58 1 2024-04-20T10:55:02.512 INFO:tasks.workunit.client.1.smithi175.stdout:4/606: unlink d4/d27/f2c 0 2024-04-20T10:55:02.515 INFO:tasks.workunit.client.1.smithi175.stdout:8/580: rename d7/d13/d1d/d24/d63/f69 to d7/d13/d1d/d24/d38/d73/fb4 0 2024-04-20T10:55:02.515 INFO:tasks.workunit.client.1.smithi175.stdout:5/717: dread db/dc1/f4d [0,4194304] 0 2024-04-20T10:55:02.516 INFO:tasks.workunit.client.1.smithi175.stdout:0/589: creat df/d1a/d22/d6a/d72/fbb x:0 0 0 2024-04-20T10:55:02.517 INFO:tasks.workunit.client.1.smithi175.stdout:0/590: stat df/d19/f7a 0 2024-04-20T10:55:02.517 INFO:tasks.workunit.client.1.smithi175.stdout:6/629: rmdir d1/d37/d83/db8 39 2024-04-20T10:55:02.519 INFO:tasks.workunit.client.1.smithi175.stdout:4/607: mkdir d4/dd/d54/d5d/d79/d9d/dd4 0 2024-04-20T10:55:02.521 INFO:tasks.workunit.client.1.smithi175.stdout:0/591: creat df/fbc x:0 0 0 2024-04-20T10:55:02.526 INFO:tasks.workunit.client.1.smithi175.stdout:4/608: read - d4/d23/d2e/f63 zero size 2024-04-20T10:55:02.528 INFO:tasks.workunit.client.1.smithi175.stdout:0/592: creat df/d1a/d22/d24/fbd x:0 0 0 2024-04-20T10:55:02.528 INFO:tasks.workunit.client.1.smithi175.stdout:0/593: chown df/d1a/d22/d55/da2/lb5 31 1 2024-04-20T10:55:02.528 INFO:tasks.workunit.client.1.smithi175.stdout:0/594: write df/d17/d2f/d4f/f84 [153795,19943] 0 2024-04-20T10:55:02.528 INFO:tasks.workunit.client.1.smithi175.stdout:0/595: fsync df/d1a/d22/d24/f68 0 2024-04-20T10:55:02.539 INFO:tasks.workunit.client.1.smithi175.stdout:6/630: dwrite d1/d37/d83/db8/d60/d6b/f78 [0,4194304] 0 2024-04-20T10:55:02.539 INFO:tasks.workunit.client.1.smithi175.stdout:6/631: chown d1/d37/d83/db8/d60/d68/d7e/l97 129095 1 2024-04-20T10:55:02.539 INFO:tasks.workunit.client.1.smithi175.stdout:6/632: chown d1/d37/d83/db8/d60/d6b/da8 183 1 2024-04-20T10:55:02.542 INFO:tasks.workunit.client.1.smithi175.stdout:0/596: read df/d19/f7a [1395844,106369] 0 2024-04-20T10:55:02.542 INFO:tasks.workunit.client.1.smithi175.stdout:0/597: write df/d17/fa3 [674924,62810] 0 2024-04-20T10:55:02.542 INFO:tasks.workunit.client.1.smithi175.stdout:0/598: dread - df/d19/fa5 zero size 2024-04-20T10:55:02.542 INFO:tasks.workunit.client.1.smithi175.stdout:6/633: creat d1/d5/d12/fd8 x:0 0 0 2024-04-20T10:55:02.553 INFO:tasks.workunit.client.1.smithi175.stdout:4/609: dwrite d4/f1f [0,4194304] 0 2024-04-20T10:55:02.556 INFO:tasks.workunit.client.1.smithi175.stdout:1/578: dwrite d0/d8/d13/d2e/f97 [0,4194304] 0 2024-04-20T10:55:02.558 INFO:tasks.workunit.client.1.smithi175.stdout:1/579: rmdir d0/d8/d13/d2e/daf 0 2024-04-20T10:55:02.560 INFO:tasks.workunit.client.1.smithi175.stdout:5/718: dread db/d30/f99 [0,4194304] 0 2024-04-20T10:55:02.560 INFO:tasks.workunit.client.1.smithi175.stdout:4/610: write d4/dd/d54/f7e [260713,58124] 0 2024-04-20T10:55:02.568 INFO:tasks.workunit.client.1.smithi175.stdout:5/719: read db/d11/f7f [2361369,114533] 0 2024-04-20T10:55:02.572 INFO:tasks.workunit.client.1.smithi175.stdout:8/581: dwrite d7/d13/f12 [4194304,4194304] 0 2024-04-20T10:55:02.573 INFO:tasks.workunit.client.1.smithi175.stdout:8/582: dread - d7/d13/d1d/d24/fb0 zero size 2024-04-20T10:55:02.573 INFO:tasks.workunit.client.1.smithi175.stdout:0/599: dwrite f0 [0,4194304] 0 2024-04-20T10:55:02.573 INFO:tasks.workunit.client.1.smithi175.stdout:0/600: write df/d1a/d22/d6a/d72/d48/fb9 [919587,32617] 0 2024-04-20T10:55:02.574 INFO:tasks.workunit.client.1.smithi175.stdout:8/583: mkdir d7/d13/d1d/d24/d38/d73/db5 0 2024-04-20T10:55:02.577 INFO:tasks.workunit.client.1.smithi175.stdout:6/634: dwrite d1/d5/d12/f31 [0,4194304] 0 2024-04-20T10:55:02.579 INFO:tasks.workunit.client.1.smithi175.stdout:6/635: creat d1/d37/d83/db8/d60/d6b/da8/fd9 x:0 0 0 2024-04-20T10:55:02.581 INFO:tasks.workunit.client.1.smithi175.stdout:8/584: dread d7/d13/d1d/f2f [0,4194304] 0 2024-04-20T10:55:02.581 INFO:tasks.workunit.client.1.smithi175.stdout:8/585: chown d7/d13/d1d/d24 24138672 1 2024-04-20T10:55:02.582 INFO:tasks.workunit.client.1.smithi175.stdout:8/586: mkdir d7/d13/d1d/d24/d38/db6 0 2024-04-20T10:55:02.584 INFO:tasks.workunit.client.1.smithi175.stdout:0/601: dread df/d17/fa3 [0,4194304] 0 2024-04-20T10:55:02.584 INFO:tasks.workunit.client.1.smithi175.stdout:0/602: getdents df/d1a/d98 0 2024-04-20T10:55:02.584 INFO:tasks.workunit.client.1.smithi175.stdout:8/587: dread d7/d13/d1d/f2f [0,4194304] 0 2024-04-20T10:55:02.585 INFO:tasks.workunit.client.1.smithi175.stdout:0/603: rmdir df/d1a/d22/d24/d9a/dad 0 2024-04-20T10:55:02.585 INFO:tasks.workunit.client.1.smithi175.stdout:0/604: stat df/la6 0 2024-04-20T10:55:02.586 INFO:tasks.workunit.client.1.smithi175.stdout:0/605: creat df/d1a/d98/fbe x:0 0 0 2024-04-20T10:55:02.586 INFO:tasks.workunit.client.1.smithi175.stdout:8/588: mkdir d7/d13/d1d/d24/d39/d6f/db7 0 2024-04-20T10:55:02.587 INFO:tasks.workunit.client.1.smithi175.stdout:4/611: dwrite d4/dd/d2d/f4c [0,4194304] 0 2024-04-20T10:55:02.587 INFO:tasks.workunit.client.1.smithi175.stdout:4/612: fsync d4/d23/d2e/f82 0 2024-04-20T10:55:02.587 INFO:tasks.workunit.client.1.smithi175.stdout:4/613: fsync d4/dd/fb7 0 2024-04-20T10:55:02.587 INFO:tasks.workunit.client.1.smithi175.stdout:5/720: dwrite db/dc1/d4f/fc0 [0,4194304] 0 2024-04-20T10:55:02.590 INFO:tasks.workunit.client.1.smithi175.stdout:0/606: dread df/d1a/d22/d6a/d72/d48/d4e/f61 [0,4194304] 0 2024-04-20T10:55:02.594 INFO:tasks.workunit.client.1.smithi175.stdout:4/614: symlink d4/dd/d54/d5d/d8a/ld5 0 2024-04-20T10:55:02.595 INFO:tasks.workunit.client.1.smithi175.stdout:5/721: link db/l15 db/dc1/lf0 0 2024-04-20T10:55:02.596 INFO:tasks.workunit.client.1.smithi175.stdout:5/722: stat db/d11/d25/d41/d83/lce 0 2024-04-20T10:55:02.597 INFO:tasks.workunit.client.1.smithi175.stdout:1/580: read d0/d8/f45 [2070920,77097] 0 2024-04-20T10:55:02.597 INFO:tasks.workunit.client.1.smithi175.stdout:1/581: chown d0/d8 1180079 1 2024-04-20T10:55:02.599 INFO:tasks.workunit.client.1.smithi175.stdout:1/582: mknod d0/d8/d13/d7b/cce 0 2024-04-20T10:55:02.601 INFO:tasks.workunit.client.1.smithi175.stdout:5/723: rename db/d30/d46/d88/db2 to db/dc1/d4f/d75/df1 0 2024-04-20T10:55:02.601 INFO:tasks.workunit.client.1.smithi175.stdout:1/583: getdents d0/d57/d7a 0 2024-04-20T10:55:02.601 INFO:tasks.workunit.client.1.smithi175.stdout:1/584: chown d0/d8/f4d 56 1 2024-04-20T10:55:02.602 INFO:tasks.workunit.client.1.smithi175.stdout:6/636: dwrite d1/d5/d12/f56 [0,4194304] 0 2024-04-20T10:55:02.602 INFO:tasks.workunit.client.1.smithi175.stdout:6/637: write d1/fbd [1044538,45799] 0 2024-04-20T10:55:02.602 INFO:tasks.workunit.client.1.smithi175.stdout:6/638: readlink d1/dc0/d63/d7c/lc8 0 2024-04-20T10:55:02.602 INFO:tasks.workunit.client.1.smithi175.stdout:6/639: chown d1/d5/d12/l4c 0 1 2024-04-20T10:55:02.603 INFO:tasks.workunit.client.1.smithi175.stdout:5/724: creat db/dc1/d4f/d75/d91/ff2 x:0 0 0 2024-04-20T10:55:02.603 INFO:tasks.workunit.client.1.smithi175.stdout:5/725: truncate db/d1f/d31/fec 665197 0 2024-04-20T10:55:02.603 INFO:tasks.workunit.client.1.smithi175.stdout:5/726: read db/d1f/d31/f33 [2254411,115578] 0 2024-04-20T10:55:02.604 INFO:tasks.workunit.client.1.smithi175.stdout:1/585: rename d0/d8/d13/d2e/f44 to d0/d8/d13/fcf 0 2024-04-20T10:55:02.610 INFO:tasks.workunit.client.1.smithi175.stdout:6/640: creat d1/d5/d12/d7f/fda x:0 0 0 2024-04-20T10:55:02.611 INFO:tasks.workunit.client.1.smithi175.stdout:4/615: dwrite d4/d27/f7b [0,4194304] 0 2024-04-20T10:55:02.611 INFO:tasks.workunit.client.1.smithi175.stdout:4/616: write d4/dd/d2d/d43/d69/f75 [4232326,27243] 0 2024-04-20T10:55:02.611 INFO:tasks.workunit.client.1.smithi175.stdout:5/727: symlink db/d11/d25/d38/d89/lf3 0 2024-04-20T10:55:02.612 INFO:tasks.workunit.client.1.smithi175.stdout:1/586: rename d0/d3e/l69 to d0/d8/d13/ld0 0 2024-04-20T10:55:02.613 INFO:tasks.workunit.client.1.smithi175.stdout:1/587: readlink d0/d8/d13/d2e/d35/l8f 0 2024-04-20T10:55:02.613 INFO:tasks.workunit.client.1.smithi175.stdout:6/641: chown d1/dc0/d29/l76 1 1 2024-04-20T10:55:02.613 INFO:tasks.workunit.client.1.smithi175.stdout:4/617: chown d4/dd/d5e/f72 63127 1 2024-04-20T10:55:02.614 INFO:tasks.workunit.client.1.smithi175.stdout:6/642: dread d1/dc0/d49/f69 [0,4194304] 0 2024-04-20T10:55:02.614 INFO:tasks.workunit.client.1.smithi175.stdout:6/643: stat d1/dc0/d63/d7c/la4 0 2024-04-20T10:55:02.614 INFO:tasks.workunit.client.1.smithi175.stdout:6/644: chown d1/dc0/d63/d7c 748882 1 2024-04-20T10:55:02.614 INFO:tasks.workunit.client.1.smithi175.stdout:5/728: creat db/d11/d25/d41/d83/ff4 x:0 0 0 2024-04-20T10:55:02.615 INFO:tasks.workunit.client.1.smithi175.stdout:1/588: rename d0/d8/d13/db9/cc9 to d0/d51/cd1 0 2024-04-20T10:55:02.615 INFO:tasks.workunit.client.1.smithi175.stdout:1/589: write d0/d8/f30 [2947762,46008] 0 2024-04-20T10:55:02.616 INFO:tasks.workunit.client.1.smithi175.stdout:4/618: symlink d4/d23/d2e/da5/ld6 0 2024-04-20T10:55:02.616 INFO:tasks.workunit.client.1.smithi175.stdout:6/645: mknod d1/d5/d12/d22/dc1/cdb 0 2024-04-20T10:55:02.619 INFO:tasks.workunit.client.1.smithi175.stdout:1/590: symlink d0/d8/d13/d2e/d35/d8a/d91/ld2 0 2024-04-20T10:55:02.621 INFO:tasks.workunit.client.1.smithi175.stdout:5/729: symlink db/d11/d25/d41/d60/lf5 0 2024-04-20T10:55:02.623 INFO:tasks.workunit.client.1.smithi175.stdout:1/591: link d0/f25 d0/d57/db7/fd3 0 2024-04-20T10:55:02.624 INFO:tasks.workunit.client.1.smithi175.stdout:5/730: creat db/dc1/d4f/d75/d91/ff6 x:0 0 0 2024-04-20T10:55:02.624 INFO:tasks.workunit.client.1.smithi175.stdout:6/646: write d1/d37/d83/db8/d60/f91 [3641580,124206] 0 2024-04-20T10:55:02.625 INFO:tasks.workunit.client.1.smithi175.stdout:1/592: mknod d0/cd4 0 2024-04-20T10:55:02.626 INFO:tasks.workunit.client.1.smithi175.stdout:1/593: write d0/d57/d7a/fae [699473,127719] 0 2024-04-20T10:55:02.626 INFO:tasks.workunit.client.1.smithi175.stdout:6/647: creat d1/d37/fdc x:0 0 0 2024-04-20T10:55:02.628 INFO:tasks.workunit.client.1.smithi175.stdout:5/731: dread db/d1f/f7d [0,4194304] 0 2024-04-20T10:55:02.628 INFO:tasks.workunit.client.1.smithi175.stdout:1/594: creat d0/d8/d13/d7b/fd5 x:0 0 0 2024-04-20T10:55:02.628 INFO:tasks.workunit.client.1.smithi175.stdout:1/595: dread - d0/d3e/d61/fc4 zero size 2024-04-20T10:55:02.628 INFO:tasks.workunit.client.1.smithi175.stdout:9/494: sync 2024-04-20T10:55:02.630 INFO:tasks.workunit.client.1.smithi175.stdout:1/596: rmdir d0/d3e 39 2024-04-20T10:55:02.632 INFO:tasks.workunit.client.1.smithi175.stdout:5/732: symlink db/dc1/d4f/d5a/lf7 0 2024-04-20T10:55:02.634 INFO:tasks.workunit.client.1.smithi175.stdout:5/733: dread db/dc1/d4f/fac [0,4194304] 0 2024-04-20T10:55:02.634 INFO:tasks.workunit.client.1.smithi175.stdout:9/495: mkdir d6/d1b/d26/d8c 0 2024-04-20T10:55:02.635 INFO:tasks.workunit.client.1.smithi175.stdout:5/734: dread db/d1f/d31/fec [0,4194304] 0 2024-04-20T10:55:02.635 INFO:tasks.workunit.client.1.smithi175.stdout:5/735: readlink db/d11/d25/d41/d83/lce 0 2024-04-20T10:55:02.636 INFO:tasks.workunit.client.1.smithi175.stdout:9/496: mknod d6/d1b/d42/d5b/c8d 0 2024-04-20T10:55:02.638 INFO:tasks.workunit.client.1.smithi175.stdout:9/497: getdents d6/d1b/d2f 0 2024-04-20T10:55:02.638 INFO:tasks.workunit.client.1.smithi175.stdout:4/619: dwrite d4/d23/f32 [0,4194304] 0 2024-04-20T10:55:02.639 INFO:tasks.workunit.client.1.smithi175.stdout:1/597: dread d0/d8/d13/f26 [0,4194304] 0 2024-04-20T10:55:02.641 INFO:tasks.workunit.client.1.smithi175.stdout:4/620: mkdir d4/dd/d5e/d96/dd7 0 2024-04-20T10:55:02.642 INFO:tasks.workunit.client.1.smithi175.stdout:1/598: unlink d0/d8/d13/d2e/d35/d8a/f9d 0 2024-04-20T10:55:02.642 INFO:tasks.workunit.client.1.smithi175.stdout:1/599: chown d0/d3e/d61/fc4 5783 1 2024-04-20T10:55:02.642 INFO:tasks.workunit.client.1.smithi175.stdout:1/600: chown d0/d29 78 1 2024-04-20T10:55:02.642 INFO:tasks.workunit.client.1.smithi175.stdout:1/601: fsync d0/d8/d13/d79/d8c/f8d 0 2024-04-20T10:55:02.643 INFO:tasks.workunit.client.1.smithi175.stdout:1/602: symlink d0/d8/d13/ld6 0 2024-04-20T10:55:02.645 INFO:tasks.workunit.client.1.smithi175.stdout:1/603: rmdir d0/d51/da8 39 2024-04-20T10:55:02.647 INFO:tasks.workunit.client.1.smithi175.stdout:6/648: dwrite d1/f16 [0,4194304] 0 2024-04-20T10:55:02.647 INFO:tasks.workunit.client.1.smithi175.stdout:1/604: unlink d0/d8/d13/d2e/d35/c87 0 2024-04-20T10:55:02.647 INFO:tasks.workunit.client.1.smithi175.stdout:4/621: fsync d4/dd/d2d/d43/d69/f75 0 2024-04-20T10:55:02.648 INFO:tasks.workunit.client.1.smithi175.stdout:0/607: dwrite df/d1a/d22/d55/fb3 [0,4194304] 0 2024-04-20T10:55:02.648 INFO:tasks.workunit.client.1.smithi175.stdout:6/649: creat d1/d37/d83/db8/fdd x:0 0 0 2024-04-20T10:55:02.653 INFO:tasks.workunit.client.1.smithi175.stdout:0/608: creat df/d1a/d22/d6a/d72/d7f/fbf x:0 0 0 2024-04-20T10:55:02.654 INFO:tasks.workunit.client.1.smithi175.stdout:6/650: dread d1/d5/d12/d73/d7a/f80 [0,4194304] 0 2024-04-20T10:55:02.654 INFO:tasks.workunit.client.1.smithi175.stdout:6/651: fsync d1/dc0/d49/f69 0 2024-04-20T10:55:02.654 INFO:tasks.workunit.client.1.smithi175.stdout:6/652: write d1/d5/fd2 [801764,90447] 0 2024-04-20T10:55:02.655 INFO:tasks.workunit.client.1.smithi175.stdout:4/622: write d4/d27/f7b [2018051,62769] 0 2024-04-20T10:55:02.657 INFO:tasks.workunit.client.1.smithi175.stdout:0/609: mkdir df/d17/dc0 0 2024-04-20T10:55:02.657 INFO:tasks.workunit.client.1.smithi175.stdout:0/610: write df/d1a/d3f/f75 [976403,39939] 0 2024-04-20T10:55:02.658 INFO:tasks.workunit.client.1.smithi175.stdout:5/736: dread db/d1f/f95 [0,4194304] 0 2024-04-20T10:55:02.659 INFO:tasks.workunit.client.1.smithi175.stdout:4/623: creat d4/dd/d2d/d33/d58/d67/fd8 x:0 0 0 2024-04-20T10:55:02.661 INFO:tasks.workunit.client.1.smithi175.stdout:0/611: creat df/d17/d2f/d4f/fc1 x:0 0 0 2024-04-20T10:55:02.661 INFO:tasks.workunit.client.1.smithi175.stdout:0/612: stat df/d17/d2f/d4f/fc1 0 2024-04-20T10:55:02.665 INFO:tasks.workunit.client.1.smithi175.stdout:4/624: rmdir d4/dd/d54/d5d/d79/d9d 39 2024-04-20T10:55:02.667 INFO:tasks.workunit.client.1.smithi175.stdout:9/498: write f5 [3345013,22246] 0 2024-04-20T10:55:02.669 INFO:tasks.workunit.client.1.smithi175.stdout:1/605: dwrite d0/d3e/d61/d73/fca [0,4194304] 0 2024-04-20T10:55:02.670 INFO:tasks.workunit.client.1.smithi175.stdout:4/625: dread d4/dd/d2d/d33/d3c/f80 [0,4194304] 0 2024-04-20T10:55:02.670 INFO:tasks.workunit.client.1.smithi175.stdout:9/499: creat d6/d33/d60/d78/f8e x:0 0 0 2024-04-20T10:55:02.671 INFO:tasks.workunit.client.1.smithi175.stdout:9/500: dread - d6/d1b/d2f/f6b zero size 2024-04-20T10:55:02.671 INFO:tasks.workunit.client.1.smithi175.stdout:9/501: read - d6/d33/d60/d78/f8e zero size 2024-04-20T10:55:02.676 INFO:tasks.workunit.client.1.smithi175.stdout:4/626: creat d4/dd/d2d/d33/fd9 x:0 0 0 2024-04-20T10:55:02.676 INFO:tasks.workunit.client.1.smithi175.stdout:4/627: chown d4/dd/d2d/d43/d69 4 1 2024-04-20T10:55:02.677 INFO:tasks.workunit.client.1.smithi175.stdout:9/502: unlink d6/d1b/d2f/c5a 0 2024-04-20T10:55:02.678 INFO:tasks.workunit.client.1.smithi175.stdout:4/628: mkdir d4/dd/d54/d5d/d79/d9d/dd4/dda 0 2024-04-20T10:55:02.679 INFO:tasks.workunit.client.1.smithi175.stdout:9/503: creat d6/d1b/d42/d5b/d72/f8f x:0 0 0 2024-04-20T10:55:02.680 INFO:tasks.workunit.client.1.smithi175.stdout:4/629: link d4/d27/d61/f46 d4/dd/d2d/d43/d69/daa/fdb 0 2024-04-20T10:55:02.680 INFO:tasks.workunit.client.1.smithi175.stdout:9/504: chown d6/d58/f59 29877 1 2024-04-20T10:55:02.680 INFO:tasks.workunit.client.1.smithi175.stdout:9/505: fdatasync d6/d33/d60/f86 0 2024-04-20T10:55:02.680 INFO:tasks.workunit.client.1.smithi175.stdout:9/506: dread - d6/d1b/d42/d5b/d72/d7d/f80 zero size 2024-04-20T10:55:02.682 INFO:tasks.workunit.client.1.smithi175.stdout:9/507: rmdir d6/d1b 39 2024-04-20T10:55:02.683 INFO:tasks.workunit.client.1.smithi175.stdout:4/630: mknod d4/dd/d2d/d33/d58/d67/cdc 0 2024-04-20T10:55:02.684 INFO:tasks.workunit.client.1.smithi175.stdout:4/631: creat d4/dd/d2d/d33/d5b/d65/fdd x:0 0 0 2024-04-20T10:55:02.686 INFO:tasks.workunit.client.1.smithi175.stdout:9/508: mkdir d6/d58/d90 0 2024-04-20T10:55:02.686 INFO:tasks.workunit.client.1.smithi175.stdout:0/613: write f3 [763891,75487] 0 2024-04-20T10:55:02.687 INFO:tasks.workunit.client.1.smithi175.stdout:4/632: creat d4/dd/d54/d5d/d8a/fde x:0 0 0 2024-04-20T10:55:02.687 INFO:tasks.workunit.client.1.smithi175.stdout:4/633: write d4/dd/d54/d5d/d9e/fa0 [575857,83854] 0 2024-04-20T10:55:02.688 INFO:tasks.workunit.client.1.smithi175.stdout:9/509: unlink d6/d33/f87 0 2024-04-20T10:55:02.689 INFO:tasks.workunit.client.1.smithi175.stdout:4/634: mkdir d4/d23/d2e/da5/ddf 0 2024-04-20T10:55:02.690 INFO:tasks.workunit.client.1.smithi175.stdout:4/635: truncate d4/d27/d61/f42 756312 0 2024-04-20T10:55:02.690 INFO:tasks.workunit.client.1.smithi175.stdout:4/636: truncate d4/dd/d54/f7e 481398 0 2024-04-20T10:55:02.691 INFO:tasks.workunit.client.1.smithi175.stdout:4/637: write d4/dd/d2d/d33/d3c/d44/f48 [1531238,98912] 0 2024-04-20T10:55:02.692 INFO:tasks.workunit.client.1.smithi175.stdout:4/638: readlink d4/l22 0 2024-04-20T10:55:02.694 INFO:tasks.workunit.client.1.smithi175.stdout:4/639: link d4/dd/d2d/d33/d3c/d44/cb4 d4/dd/d54/d5d/ce0 0 2024-04-20T10:55:02.695 INFO:tasks.workunit.client.1.smithi175.stdout:4/640: symlink d4/dd/d5e/d74/da1/le1 0 2024-04-20T10:55:02.696 INFO:tasks.workunit.client.1.smithi175.stdout:1/606: dwrite d0/d57/d7a/fae [0,4194304] 0 2024-04-20T10:55:02.696 INFO:tasks.workunit.client.1.smithi175.stdout:1/607: chown d0/c2f 113 1 2024-04-20T10:55:02.696 INFO:tasks.workunit.client.1.smithi175.stdout:4/641: creat d4/d27/fe2 x:0 0 0 2024-04-20T10:55:02.698 INFO:tasks.workunit.client.1.smithi175.stdout:5/737: dwrite db/d11/f2a [8388608,4194304] 0 2024-04-20T10:55:02.699 INFO:tasks.workunit.client.1.smithi175.stdout:5/738: dread - db/d30/d46/fe1 zero size 2024-04-20T10:55:02.699 INFO:tasks.workunit.client.1.smithi175.stdout:5/739: readlink db/d11/d25/d38/d40/le0 0 2024-04-20T10:55:02.699 INFO:tasks.workunit.client.1.smithi175.stdout:1/608: creat d0/d3e/fd7 x:0 0 0 2024-04-20T10:55:02.702 INFO:tasks.workunit.client.1.smithi175.stdout:1/609: creat d0/d57/db7/fd8 x:0 0 0 2024-04-20T10:55:02.702 INFO:tasks.workunit.client.1.smithi175.stdout:1/610: stat d0/d8/d13/d7b/c86 0 2024-04-20T10:55:02.702 INFO:tasks.workunit.client.1.smithi175.stdout:9/510: dwrite d6/d33/d60/d78/f8e [0,4194304] 0 2024-04-20T10:55:02.703 INFO:tasks.workunit.client.1.smithi175.stdout:4/642: symlink d4/dd/d54/d5d/d79/le3 0 2024-04-20T10:55:02.703 INFO:tasks.workunit.client.1.smithi175.stdout:4/643: write d4/dd/d2d/d33/d3c/d44/f48 [2213235,111831] 0 2024-04-20T10:55:02.704 INFO:tasks.workunit.client.1.smithi175.stdout:1/611: mknod d0/d3e/d61/d73/cd9 0 2024-04-20T10:55:02.705 INFO:tasks.workunit.client.1.smithi175.stdout:1/612: dread d0/d8/d13/faa [0,4194304] 0 2024-04-20T10:55:02.709 INFO:tasks.workunit.client.1.smithi175.stdout:1/613: creat d0/d8/d13/d2e/d35/d8a/fda x:0 0 0 2024-04-20T10:55:02.712 INFO:tasks.workunit.client.1.smithi175.stdout:1/614: creat d0/d51/d6b/fdb x:0 0 0 2024-04-20T10:55:02.713 INFO:tasks.workunit.client.1.smithi175.stdout:9/511: symlink d6/d1b/d42/d51/l91 0 2024-04-20T10:55:02.714 INFO:tasks.workunit.client.1.smithi175.stdout:4/644: rename d4/d27/d61/l35 to d4/dd/d54/d5d/d9e/le4 0 2024-04-20T10:55:02.716 INFO:tasks.workunit.client.1.smithi175.stdout:4/645: dread d4/f31 [0,4194304] 0 2024-04-20T10:55:02.717 INFO:tasks.workunit.client.1.smithi175.stdout:9/512: rename d6/d58/f59 to d6/d1b/d42/d5b/d72/f92 0 2024-04-20T10:55:02.725 INFO:tasks.workunit.client.1.smithi175.stdout:9/513: dread d6/fe [0,4194304] 0 2024-04-20T10:55:02.726 INFO:tasks.workunit.client.1.smithi175.stdout:9/514: chown d6/d1b/d42/d5b/d72/f8f 33 1 2024-04-20T10:55:02.729 INFO:tasks.workunit.client.1.smithi175.stdout:1/615: dwrite d0/d8/d13/d2e/d35/f7f [0,4194304] 0 2024-04-20T10:55:02.731 INFO:tasks.workunit.client.1.smithi175.stdout:1/616: creat d0/d57/d7a/fdc x:0 0 0 2024-04-20T10:55:02.731 INFO:tasks.workunit.client.1.smithi175.stdout:1/617: chown d0/d8/d13/db9 110 1 2024-04-20T10:55:02.734 INFO:tasks.workunit.client.1.smithi175.stdout:9/515: write d6/d1b/d2f/f38 [2770995,103406] 0 2024-04-20T10:55:02.735 INFO:tasks.workunit.client.1.smithi175.stdout:9/516: truncate d6/f4a 3732221 0 2024-04-20T10:55:02.735 INFO:tasks.workunit.client.1.smithi175.stdout:1/618: write d0/d57/fc3 [6353355,125283] 0 2024-04-20T10:55:02.736 INFO:tasks.workunit.client.1.smithi175.stdout:9/517: creat d6/d58/d90/f93 x:0 0 0 2024-04-20T10:55:02.737 INFO:tasks.workunit.client.1.smithi175.stdout:9/518: rmdir d6/d1b/d2f 39 2024-04-20T10:55:02.739 INFO:tasks.workunit.client.1.smithi175.stdout:9/519: mknod d6/d1b/d26/c94 0 2024-04-20T10:55:02.751 INFO:tasks.workunit.client.1.smithi175.stdout:5/740: dwrite db/d1f/f27 [0,4194304] 0 2024-04-20T10:55:02.752 INFO:tasks.workunit.client.1.smithi175.stdout:5/741: write db/d30/d46/f7e [4197799,102239] 0 2024-04-20T10:55:02.753 INFO:tasks.workunit.client.1.smithi175.stdout:5/742: creat db/d11/d6d/da1/ff8 x:0 0 0 2024-04-20T10:55:02.753 INFO:tasks.workunit.client.1.smithi175.stdout:5/743: getdents db/d1f/d31/d93 0 2024-04-20T10:55:02.755 INFO:tasks.workunit.client.1.smithi175.stdout:5/744: getdents db/d1f/d31 0 2024-04-20T10:55:02.755 INFO:tasks.workunit.client.1.smithi175.stdout:5/745: truncate db/d11/d1a/f8e 767514 0 2024-04-20T10:55:02.755 INFO:tasks.workunit.client.1.smithi175.stdout:5/746: dread - db/d11/d6d/da1/dcc/fde zero size 2024-04-20T10:55:02.755 INFO:tasks.workunit.client.1.smithi175.stdout:5/747: write db/d30/d46/fe1 [259864,60647] 0 2024-04-20T10:55:02.755 INFO:tasks.workunit.client.1.smithi175.stdout:5/748: fdatasync db/d11/d6d/fb3 0 2024-04-20T10:55:02.755 INFO:tasks.workunit.client.1.smithi175.stdout:5/749: chown db/dc1/d4f/d5a/c9a 6276946 1 2024-04-20T10:55:02.756 INFO:tasks.workunit.client.1.smithi175.stdout:5/750: fsync db/d11/d1a/f76 0 2024-04-20T10:55:02.757 INFO:tasks.workunit.client.1.smithi175.stdout:5/751: creat db/d11/d25/d38/d40/d66/ff9 x:0 0 0 2024-04-20T10:55:02.757 INFO:tasks.workunit.client.1.smithi175.stdout:5/752: write db/d1f/d31/f33 [2239346,45594] 0 2024-04-20T10:55:02.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/753: dread db/d11/d1a/f28 [0,4194304] 0 2024-04-20T10:55:02.760 INFO:tasks.workunit.client.1.smithi175.stdout:5/754: chown db/dc1/d4f/d5a 1015 1 2024-04-20T10:55:02.761 INFO:tasks.workunit.client.1.smithi175.stdout:1/619: dwrite d0/d8/d13/d2e/f72 [4194304,4194304] 0 2024-04-20T10:55:02.767 INFO:tasks.workunit.client.1.smithi175.stdout:1/620: mkdir d0/d57/d7a/ddd 0 2024-04-20T10:55:02.767 INFO:tasks.workunit.client.1.smithi175.stdout:1/621: write d0/d8/d13/d7b/fd5 [292300,42807] 0 2024-04-20T10:55:02.767 INFO:tasks.workunit.client.1.smithi175.stdout:1/622: stat d0/d8/d13/d2e 0 2024-04-20T10:55:02.767 INFO:tasks.workunit.client.1.smithi175.stdout:1/623: fsync d0/d8/f28 0 2024-04-20T10:55:02.768 INFO:tasks.workunit.client.1.smithi175.stdout:1/624: chown d0/d8/f5e 310757765 1 2024-04-20T10:55:02.768 INFO:tasks.workunit.client.1.smithi175.stdout:9/520: dwrite d6/d1b/d42/f44 [0,4194304] 0 2024-04-20T10:55:02.768 INFO:tasks.workunit.client.1.smithi175.stdout:9/521: fsync d6/d1b/d2f/f4f 0 2024-04-20T10:55:02.768 INFO:tasks.workunit.client.1.smithi175.stdout:9/522: write d6/d1b/d2f/f64 [1444834,96357] 0 2024-04-20T10:55:02.770 INFO:tasks.workunit.client.1.smithi175.stdout:3/463: sync 2024-04-20T10:55:02.773 INFO:tasks.workunit.client.1.smithi175.stdout:3/464: creat d7/d10/f9a x:0 0 0 2024-04-20T10:55:02.775 INFO:tasks.workunit.client.1.smithi175.stdout:3/465: creat d7/d19/d33/d60/d50/f9b x:0 0 0 2024-04-20T10:55:02.775 INFO:tasks.workunit.client.1.smithi175.stdout:3/466: write d7/f14 [6042989,76643] 0 2024-04-20T10:55:02.775 INFO:tasks.workunit.client.1.smithi175.stdout:3/467: dread - d7/d10/f9a zero size 2024-04-20T10:55:02.775 INFO:tasks.workunit.client.1.smithi175.stdout:3/468: write d7/d21/d16/d22/d2c/d91/f87 [943009,18158] 0 2024-04-20T10:55:02.775 INFO:tasks.workunit.client.1.smithi175.stdout:3/469: chown d7/f51 11145299 1 2024-04-20T10:55:02.775 INFO:tasks.workunit.client.1.smithi175.stdout:3/470: rmdir d7/d19 39 2024-04-20T10:55:02.776 INFO:tasks.workunit.client.1.smithi175.stdout:3/471: creat d7/d21/d16/d22/d2c/d1f/d48/f9c x:0 0 0 2024-04-20T10:55:02.777 INFO:tasks.workunit.client.1.smithi175.stdout:5/755: dwrite db/d1f/d31/fec [0,4194304] 0 2024-04-20T10:55:02.779 INFO:tasks.workunit.client.1.smithi175.stdout:5/756: getdents db/d30/d46/d88 0 2024-04-20T10:55:02.781 INFO:tasks.workunit.client.1.smithi175.stdout:1/625: dread d0/d8/f28 [0,4194304] 0 2024-04-20T10:55:02.785 INFO:tasks.workunit.client.1.smithi175.stdout:3/472: dread d7/d10/f42 [0,4194304] 0 2024-04-20T10:55:02.785 INFO:tasks.workunit.client.1.smithi175.stdout:3/473: readlink l4 0 2024-04-20T10:55:02.786 INFO:tasks.workunit.client.1.smithi175.stdout:3/474: mknod d7/d21/d16/d85/c9d 0 2024-04-20T10:55:02.797 INFO:tasks.workunit.client.1.smithi175.stdout:9/523: dwrite d6/d1b/d42/f52 [0,4194304] 0 2024-04-20T10:55:02.797 INFO:tasks.workunit.client.1.smithi175.stdout:1/626: dread d0/d8/d13/d2e/d35/f7f [0,4194304] 0 2024-04-20T10:55:02.797 INFO:tasks.workunit.client.1.smithi175.stdout:9/524: fsync d6/d1b/f47 0 2024-04-20T10:55:02.797 INFO:tasks.workunit.client.1.smithi175.stdout:9/525: write d6/d58/f68 [644391,39902] 0 2024-04-20T10:55:02.797 INFO:tasks.workunit.client.1.smithi175.stdout:9/526: dread - d6/d1b/d2f/f6b zero size 2024-04-20T10:55:02.799 INFO:tasks.workunit.client.1.smithi175.stdout:1/627: creat d0/d8/d13/d2e/fde x:0 0 0 2024-04-20T10:55:02.799 INFO:tasks.workunit.client.1.smithi175.stdout:1/628: chown d0/d8/d13/c8b 4851129 1 2024-04-20T10:55:02.799 INFO:tasks.workunit.client.1.smithi175.stdout:1/629: chown d0/d8/d13/d79/d8c 1 1 2024-04-20T10:55:02.799 INFO:tasks.workunit.client.1.smithi175.stdout:5/757: dwrite db/d11/d25/d41/f90 [0,4194304] 0 2024-04-20T10:55:02.800 INFO:tasks.workunit.client.1.smithi175.stdout:5/758: dread db/d1f/f7d [0,4194304] 0 2024-04-20T10:55:02.802 INFO:tasks.workunit.client.1.smithi175.stdout:5/759: truncate db/d1f/d31/f4c 3138315 0 2024-04-20T10:55:02.802 INFO:tasks.workunit.client.1.smithi175.stdout:5/760: dread - db/d11/d25/d62/fe2 zero size 2024-04-20T10:55:02.805 INFO:tasks.workunit.client.1.smithi175.stdout:9/527: write d6/d58/f61 [1539832,67908] 0 2024-04-20T10:55:02.805 INFO:tasks.workunit.client.1.smithi175.stdout:9/528: fdatasync d6/f39 0 2024-04-20T10:55:02.807 INFO:tasks.workunit.client.1.smithi175.stdout:9/529: unlink d6/d1b/d42/f52 0 2024-04-20T10:55:02.811 INFO:tasks.workunit.client.1.smithi175.stdout:4/646: write d4/d27/f17 [6423021,45699] 0 2024-04-20T10:55:02.813 INFO:tasks.workunit.client.1.smithi175.stdout:9/530: dread d6/f39 [0,4194304] 0 2024-04-20T10:55:02.814 INFO:tasks.workunit.client.1.smithi175.stdout:9/531: symlink d6/l95 0 2024-04-20T10:55:02.814 INFO:tasks.workunit.client.1.smithi175.stdout:9/532: chown d6/d33/d60/d78 343 1 2024-04-20T10:55:02.815 INFO:tasks.workunit.client.1.smithi175.stdout:9/533: chown d6/d10/l37 249 1 2024-04-20T10:55:02.815 INFO:tasks.workunit.client.1.smithi175.stdout:9/534: mknod d6/d1b/d42/d51/c96 0 2024-04-20T10:55:02.823 INFO:tasks.workunit.client.1.smithi175.stdout:5/761: write db/dc1/d4f/fac [459516,21624] 0 2024-04-20T10:55:02.825 INFO:tasks.workunit.client.1.smithi175.stdout:1/630: dwrite d0/d8/d13/d75/fa1 [0,4194304] 0 2024-04-20T10:55:02.830 INFO:tasks.workunit.client.1.smithi175.stdout:4/647: dwrite d4/dd/d2d/d33/d3c/fa9 [0,4194304] 0 2024-04-20T10:55:02.835 INFO:tasks.workunit.client.1.smithi175.stdout:9/535: read d6/d33/d63/f73 [48140,111519] 0 2024-04-20T10:55:02.836 INFO:tasks.workunit.client.1.smithi175.stdout:9/536: creat d6/d1b/d42/d79/d81/f97 x:0 0 0 2024-04-20T10:55:02.837 INFO:tasks.workunit.client.1.smithi175.stdout:9/537: write d6/d1b/d2f/f38 [1302364,88037] 0 2024-04-20T10:55:02.837 INFO:tasks.workunit.client.1.smithi175.stdout:1/631: dread d0/ff [0,4194304] 0 2024-04-20T10:55:02.837 INFO:tasks.workunit.client.1.smithi175.stdout:1/632: write d0/d8/d13/d79/d8c/dac/fb8 [1010,14304] 0 2024-04-20T10:55:02.837 INFO:tasks.workunit.client.1.smithi175.stdout:1/633: creat d0/d8/d13/d7b/fdf x:0 0 0 2024-04-20T10:55:02.837 INFO:tasks.workunit.client.1.smithi175.stdout:1/634: fdatasync d0/f10 0 2024-04-20T10:55:02.838 INFO:tasks.workunit.client.1.smithi175.stdout:9/538: mkdir d6/d1b/d42/d5b/d72/d98 0 2024-04-20T10:55:02.838 INFO:tasks.workunit.client.1.smithi175.stdout:9/539: truncate d6/d1b/f47 3046428 0 2024-04-20T10:55:02.838 INFO:tasks.workunit.client.1.smithi175.stdout:9/540: write d6/d1b/d42/d79/d81/f97 [320782,26384] 0 2024-04-20T10:55:02.839 INFO:tasks.workunit.client.1.smithi175.stdout:9/541: creat d6/d33/f99 x:0 0 0 2024-04-20T10:55:02.839 INFO:tasks.workunit.client.1.smithi175.stdout:9/542: dread - d6/d1b/d2f/f6b zero size 2024-04-20T10:55:02.841 INFO:tasks.workunit.client.1.smithi175.stdout:5/762: dwrite db/d11/d25/d38/d40/d66/d94/fbb [0,4194304] 0 2024-04-20T10:55:02.841 INFO:tasks.workunit.client.1.smithi175.stdout:9/543: rename d6/d1b/f56 to d6/d1b/d42/d51/f9a 0 2024-04-20T10:55:02.845 INFO:tasks.workunit.client.1.smithi175.stdout:1/635: dread d0/d8/d13/f60 [0,4194304] 0 2024-04-20T10:55:02.846 INFO:tasks.workunit.client.1.smithi175.stdout:9/544: symlink d6/d1b/d42/d79/l9b 0 2024-04-20T10:55:02.846 INFO:tasks.workunit.client.1.smithi175.stdout:5/763: mknod db/d11/d25/d38/d40/d47/cfa 0 2024-04-20T10:55:02.847 INFO:tasks.workunit.client.1.smithi175.stdout:1/636: mkdir d0/d51/d6b/d9e/de0 0 2024-04-20T10:55:02.848 INFO:tasks.workunit.client.1.smithi175.stdout:9/545: chown d6/d10/l23 0 1 2024-04-20T10:55:02.849 INFO:tasks.workunit.client.1.smithi175.stdout:5/764: mkdir db/d11/d25/d38/d40/d66/d94/dfb 0 2024-04-20T10:55:02.850 INFO:tasks.workunit.client.1.smithi175.stdout:1/637: rmdir d0/d57/d7a/ddd 0 2024-04-20T10:55:02.851 INFO:tasks.workunit.client.1.smithi175.stdout:9/546: rmdir d6/d33/d60/d78 39 2024-04-20T10:55:02.851 INFO:tasks.workunit.client.1.smithi175.stdout:9/547: truncate d6/f39 1175770 0 2024-04-20T10:55:02.852 INFO:tasks.workunit.client.1.smithi175.stdout:5/765: link db/dc1/d4f/d75/f97 db/ffc 0 2024-04-20T10:55:02.856 INFO:tasks.workunit.client.1.smithi175.stdout:9/548: write d6/f4a [929191,70809] 0 2024-04-20T10:55:02.860 INFO:tasks.workunit.client.1.smithi175.stdout:9/549: link d6/d33/f5c d6/d1b/d42/d5b/f9c 0 2024-04-20T10:55:02.860 INFO:tasks.workunit.client.1.smithi175.stdout:9/550: chown d6/l5e 21 1 2024-04-20T10:55:02.861 INFO:tasks.workunit.client.1.smithi175.stdout:1/638: dread d0/f25 [0,4194304] 0 2024-04-20T10:55:02.863 INFO:tasks.workunit.client.1.smithi175.stdout:9/551: dread d6/d1b/d42/d5b/f9c [0,4194304] 0 2024-04-20T10:55:02.863 INFO:tasks.workunit.client.1.smithi175.stdout:1/639: rmdir d0/d8/d13/d75 39 2024-04-20T10:55:02.863 INFO:tasks.workunit.client.1.smithi175.stdout:9/552: chown d6/d33/d63/c4b 0 1 2024-04-20T10:55:02.864 INFO:tasks.workunit.client.1.smithi175.stdout:9/553: creat d6/d33/d60/f9d x:0 0 0 2024-04-20T10:55:02.865 INFO:tasks.workunit.client.1.smithi175.stdout:9/554: chown d6/f1d 583666278 1 2024-04-20T10:55:02.866 INFO:tasks.workunit.client.1.smithi175.stdout:9/555: mkdir d6/d1b/d42/d5b/d72/d9e 0 2024-04-20T10:55:02.868 INFO:tasks.workunit.client.1.smithi175.stdout:9/556: rmdir d6/d58/d90 39 2024-04-20T10:55:02.870 INFO:tasks.workunit.client.1.smithi175.stdout:9/557: fsync d6/d1b/d42/d79/d81/f97 0 2024-04-20T10:55:02.881 INFO:tasks.workunit.client.1.smithi175.stdout:9/558: write f3 [3642561,30109] 0 2024-04-20T10:55:02.881 INFO:tasks.workunit.client.1.smithi175.stdout:9/559: chown d6/f4a 26 1 2024-04-20T10:55:02.881 INFO:tasks.workunit.client.1.smithi175.stdout:9/560: write d6/d1b/d42/d5b/d72/d7d/f80 [64888,54493] 0 2024-04-20T10:55:02.882 INFO:tasks.workunit.client.1.smithi175.stdout:5/766: dwrite db/d1f/d31/da0/fc8 [0,4194304] 0 2024-04-20T10:55:02.882 INFO:tasks.workunit.client.1.smithi175.stdout:1/640: dwrite d0/d51/d6b/fdb [0,4194304] 0 2024-04-20T10:55:02.884 INFO:tasks.workunit.client.1.smithi175.stdout:5/767: rmdir db/d11/d25/d41/d83 39 2024-04-20T10:55:02.906 INFO:tasks.workunit.client.1.smithi175.stdout:9/561: dwrite d6/d1b/d42/d5b/d72/d7d/f80 [0,4194304] 0 2024-04-20T10:55:02.906 INFO:tasks.workunit.client.1.smithi175.stdout:9/562: truncate d6/f4a 3906010 0 2024-04-20T10:55:02.906 INFO:tasks.workunit.client.1.smithi175.stdout:1/641: dwrite d0/f93 [4194304,4194304] 0 2024-04-20T10:55:02.906 INFO:tasks.workunit.client.1.smithi175.stdout:1/642: chown d0/d57/d7a/fae 93505002 1 2024-04-20T10:55:02.907 INFO:tasks.workunit.client.1.smithi175.stdout:5/768: creat db/d11/d25/d38/ffd x:0 0 0 2024-04-20T10:55:02.909 INFO:tasks.workunit.client.1.smithi175.stdout:1/643: getdents d0 0 2024-04-20T10:55:02.909 INFO:tasks.workunit.client.1.smithi175.stdout:1/644: chown d0/d8/d13/d79/d8c/f8d 109488 1 2024-04-20T10:55:02.909 INFO:tasks.workunit.client.1.smithi175.stdout:1/645: truncate d0/d3e/d61/d73/fca 4475374 0 2024-04-20T10:55:02.909 INFO:tasks.workunit.client.1.smithi175.stdout:1/646: chown d0/d8/f28 841884760 1 2024-04-20T10:55:02.909 INFO:tasks.workunit.client.1.smithi175.stdout:1/647: fdatasync d0/d8/d13/d75/fa1 0 2024-04-20T10:55:02.910 INFO:tasks.workunit.client.1.smithi175.stdout:5/769: truncate db/dc1/d4f/d75/f97 4994778 0 2024-04-20T10:55:02.910 INFO:tasks.workunit.client.1.smithi175.stdout:9/563: mkdir d6/d1b/d42/d51/d9f 0 2024-04-20T10:55:02.911 INFO:tasks.workunit.client.1.smithi175.stdout:9/564: chown d6/d1b/d42/d5b/d72/f92 727605357 1 2024-04-20T10:55:02.912 INFO:tasks.workunit.client.1.smithi175.stdout:9/565: truncate d6/d1b/d26/f88 4476635 0 2024-04-20T10:55:02.913 INFO:tasks.workunit.client.1.smithi175.stdout:5/770: mkdir db/d11/dfe 0 2024-04-20T10:55:02.921 INFO:tasks.workunit.client.1.smithi175.stdout:1/648: dread d0/d29/f4f [0,4194304] 0 2024-04-20T10:55:02.922 INFO:tasks.workunit.client.1.smithi175.stdout:9/566: creat d6/d33/d60/d78/fa0 x:0 0 0 2024-04-20T10:55:02.923 INFO:tasks.workunit.client.1.smithi175.stdout:1/649: symlink d0/d51/le1 0 2024-04-20T10:55:02.924 INFO:tasks.workunit.client.1.smithi175.stdout:9/567: mknod d6/d1b/d42/d51/d9f/ca1 0 2024-04-20T10:55:02.925 INFO:tasks.workunit.client.1.smithi175.stdout:1/650: unlink d0/d8/d13/ld6 0 2024-04-20T10:55:02.925 INFO:tasks.workunit.client.1.smithi175.stdout:1/651: write d0/f1e [511491,68012] 0 2024-04-20T10:55:02.925 INFO:tasks.workunit.client.1.smithi175.stdout:1/652: chown d0/d8/f7e 951442 1 2024-04-20T10:55:02.926 INFO:tasks.workunit.client.1.smithi175.stdout:9/568: symlink d6/d1b/d42/d79/d81/la2 0 2024-04-20T10:55:02.927 INFO:tasks.workunit.client.1.smithi175.stdout:1/653: link d0/d8/f18 d0/d8/d13/d75/fe2 0 2024-04-20T10:55:02.927 INFO:tasks.workunit.client.1.smithi175.stdout:1/654: chown d0/d8/d13/d2e/d35/c7d 110 1 2024-04-20T10:55:02.929 INFO:tasks.workunit.client.1.smithi175.stdout:9/569: rename d6/d1b/d42/d5b/d72/f8f to d6/d58/d90/fa3 0 2024-04-20T10:55:02.930 INFO:tasks.workunit.client.1.smithi175.stdout:9/570: dread d6/d33/f5c [0,4194304] 0 2024-04-20T10:55:02.931 INFO:tasks.workunit.client.1.smithi175.stdout:1/655: creat d0/d8/d13/d2e/d35/fe3 x:0 0 0 2024-04-20T10:55:02.931 INFO:tasks.workunit.client.1.smithi175.stdout:1/656: chown d0/d8/d13/fcf 128962 1 2024-04-20T10:55:02.936 INFO:tasks.workunit.client.1.smithi175.stdout:5/771: dwrite db/d11/d25/fa2 [0,4194304] 0 2024-04-20T10:55:02.936 INFO:tasks.workunit.client.1.smithi175.stdout:5/772: truncate db/dc1/d4f/d75/f97 5622723 0 2024-04-20T10:55:02.936 INFO:tasks.workunit.client.1.smithi175.stdout:5/773: truncate db/d11/d25/d41/d60/fc5 294311 0 2024-04-20T10:55:02.936 INFO:tasks.workunit.client.1.smithi175.stdout:5/774: write db/d11/d25/d38/d40/fad [805231,93964] 0 2024-04-20T10:55:02.937 INFO:tasks.workunit.client.1.smithi175.stdout:9/571: link d6/d33/d60/f86 d6/d1b/d42/d79/d81/fa4 0 2024-04-20T10:55:02.937 INFO:tasks.workunit.client.1.smithi175.stdout:9/572: write d6/d33/d60/f86 [662302,61404] 0 2024-04-20T10:55:02.937 INFO:tasks.workunit.client.1.smithi175.stdout:9/573: readlink d6/l5e 0 2024-04-20T10:55:02.938 INFO:tasks.workunit.client.1.smithi175.stdout:5/775: rename db/d11/d25/d38/d40/d66/l8f to db/d11/d6d/da1/dcc/lff 0 2024-04-20T10:55:02.939 INFO:tasks.workunit.client.1.smithi175.stdout:5/776: creat db/d1f/d31/d93/f100 x:0 0 0 2024-04-20T10:55:02.940 INFO:tasks.workunit.client.1.smithi175.stdout:9/574: mknod d6/d33/d63/ca5 0 2024-04-20T10:55:02.944 INFO:tasks.workunit.client.1.smithi175.stdout:1/657: dwrite d0/d8/d13/d2e/d35/d8a/fb0 [0,4194304] 0 2024-04-20T10:55:02.945 INFO:tasks.workunit.client.1.smithi175.stdout:1/658: chown d0/d8/d13/d75 7175307 1 2024-04-20T10:55:02.946 INFO:tasks.workunit.client.1.smithi175.stdout:5/777: rename db/d11/d25/faa to db/d11/d25/d41/d83/f101 0 2024-04-20T10:55:02.946 INFO:tasks.workunit.client.1.smithi175.stdout:5/778: chown db/d11/d25/d38/d40 29547374 1 2024-04-20T10:55:02.946 INFO:tasks.workunit.client.1.smithi175.stdout:5/779: chown db/d1f/d31/cb5 262879 1 2024-04-20T10:55:02.956 INFO:tasks.workunit.client.1.smithi175.stdout:1/659: write d0/d8/f4d [65905,80196] 0 2024-04-20T10:55:02.957 INFO:tasks.workunit.client.1.smithi175.stdout:9/575: rename d6/d33/f89 to d6/d1b/d42/fa6 0 2024-04-20T10:55:02.972 INFO:tasks.workunit.client.1.smithi175.stdout:9/576: dwrite d6/d33/d60/d78/fa0 [0,4194304] 0 2024-04-20T10:55:02.973 INFO:tasks.workunit.client.1.smithi175.stdout:5/780: link f2 db/d11/d25/d38/d40/d66/f102 0 2024-04-20T10:55:02.976 INFO:tasks.workunit.client.1.smithi175.stdout:9/577: creat d6/d33/fa7 x:0 0 0 2024-04-20T10:55:02.977 INFO:tasks.workunit.client.1.smithi175.stdout:1/660: rename d0/d8/fba to d0/d8/fe4 0 2024-04-20T10:55:03.042 INFO:tasks.workunit.client.1.smithi175.stdout:5/781: symlink db/d9d/l103 0 2024-04-20T10:55:03.042 INFO:tasks.workunit.client.1.smithi175.stdout:5/782: readlink db/d11/d25/d38/d40/d66/d94/lcf 0 2024-04-20T10:55:03.043 INFO:tasks.workunit.client.1.smithi175.stdout:1/661: creat d0/d51/d6b/d9e/fe5 x:0 0 0 2024-04-20T10:55:03.044 INFO:tasks.workunit.client.1.smithi175.stdout:5/783: rename db/d11/d80/dc3/fd5 to db/d1f/d31/f104 0 2024-04-20T10:55:03.044 INFO:tasks.workunit.client.1.smithi175.stdout:1/662: mknod d0/d8/d13/ce6 0 2024-04-20T10:55:03.044 INFO:tasks.workunit.client.1.smithi175.stdout:1/663: write d0/f93 [8741759,95013] 0 2024-04-20T10:55:03.045 INFO:tasks.workunit.client.1.smithi175.stdout:1/664: stat d0/d8/d13/d2e/d35/f42 0 2024-04-20T10:55:03.046 INFO:tasks.workunit.client.1.smithi175.stdout:5/784: unlink db/d11/d25/d38/l6b 0 2024-04-20T10:55:03.048 INFO:tasks.workunit.client.1.smithi175.stdout:5/785: creat db/d11/d25/d38/d40/d47/f105 x:0 0 0 2024-04-20T10:55:03.049 INFO:tasks.workunit.client.1.smithi175.stdout:1/665: rename d0/d29/c64 to d0/d8/d13/d2e/ce7 0 2024-04-20T10:55:03.049 INFO:tasks.workunit.client.1.smithi175.stdout:1/666: chown d0/d51/da8 5623524 1 2024-04-20T10:55:03.049 INFO:tasks.workunit.client.1.smithi175.stdout:1/667: write d0/d8/d13/d7b/fd5 [1285090,115336] 0 2024-04-20T10:55:03.049 INFO:tasks.workunit.client.1.smithi175.stdout:5/786: stat db/d30/d46/d88/l8d 0 2024-04-20T10:55:03.050 INFO:tasks.workunit.client.1.smithi175.stdout:1/668: mkdir d0/de8 0 2024-04-20T10:55:03.050 INFO:tasks.workunit.client.1.smithi175.stdout:1/669: write d0/fd [376946,22112] 0 2024-04-20T10:55:03.051 INFO:tasks.workunit.client.1.smithi175.stdout:5/787: chown c6 1141 1 2024-04-20T10:55:03.051 INFO:tasks.workunit.client.1.smithi175.stdout:5/788: write db/d1f/d31/fb0 [542129,13424] 0 2024-04-20T10:55:03.053 INFO:tasks.workunit.client.1.smithi175.stdout:1/670: stat d0/d8/f7e 0 2024-04-20T10:55:03.053 INFO:tasks.workunit.client.1.smithi175.stdout:1/671: read - d0/d3e/fd7 zero size 2024-04-20T10:55:03.060 INFO:tasks.workunit.client.1.smithi175.stdout:6/653: sync 2024-04-20T10:55:03.060 INFO:tasks.workunit.client.1.smithi175.stdout:2/499: sync 2024-04-20T10:55:03.060 INFO:tasks.workunit.client.1.smithi175.stdout:7/706: sync 2024-04-20T10:55:03.060 INFO:tasks.workunit.client.1.smithi175.stdout:8/589: sync 2024-04-20T10:55:03.060 INFO:tasks.workunit.client.1.smithi175.stdout:6/654: fdatasync d1/dc0/d63/d7c/f94 0 2024-04-20T10:55:03.060 INFO:tasks.workunit.client.1.smithi175.stdout:8/590: chown d7/d13/f17 3 1 2024-04-20T10:55:03.060 INFO:tasks.workunit.client.1.smithi175.stdout:7/707: truncate db/d61/d6d/dbc/dc4/ff4 592784 0 2024-04-20T10:55:03.061 INFO:tasks.workunit.client.1.smithi175.stdout:1/672: dread d0/d8/d13/d2e/d35/d8a/fb0 [0,4194304] 0 2024-04-20T10:55:03.061 INFO:tasks.workunit.client.1.smithi175.stdout:6/655: truncate d1/d5/d12/f47 393093 0 2024-04-20T10:55:03.061 INFO:tasks.workunit.client.1.smithi175.stdout:6/656: getdents d1/d37/d83/db8/db9 0 2024-04-20T10:55:03.061 INFO:tasks.workunit.client.1.smithi175.stdout:7/708: chown db/d1d/d39/d50/dba/c38 1951641 1 2024-04-20T10:55:03.062 INFO:tasks.workunit.client.1.smithi175.stdout:8/591: link d7/d13/d1d/d56/f71 d7/d13/d1d/d24/d39/d6f/db7/fb8 0 2024-04-20T10:55:03.064 INFO:tasks.workunit.client.1.smithi175.stdout:1/673: mkdir d0/d57/db7/de9 0 2024-04-20T10:55:03.064 INFO:tasks.workunit.client.1.smithi175.stdout:1/674: stat d0/d3e/d61/ca7 0 2024-04-20T10:55:03.064 INFO:tasks.workunit.client.1.smithi175.stdout:1/675: write d0/d3e/d61/f85 [635788,50272] 0 2024-04-20T10:55:03.064 INFO:tasks.workunit.client.1.smithi175.stdout:1/676: stat d0/d51/d6b/d9e/fa3 0 2024-04-20T10:55:03.064 INFO:tasks.workunit.client.1.smithi175.stdout:6/657: write d1/d37/f66 [5108786,24314] 0 2024-04-20T10:55:03.065 INFO:tasks.workunit.client.1.smithi175.stdout:2/500: rename d1/c20 to d1/d48/d38/cab 0 2024-04-20T10:55:03.065 INFO:tasks.workunit.client.1.smithi175.stdout:2/501: chown d1/d48/l1c 0 1 2024-04-20T10:55:03.067 INFO:tasks.workunit.client.1.smithi175.stdout:1/677: symlink d0/d57/db7/lea 0 2024-04-20T10:55:03.069 INFO:tasks.workunit.client.1.smithi175.stdout:7/709: unlink db/d61/c65 0 2024-04-20T10:55:03.069 INFO:tasks.workunit.client.1.smithi175.stdout:7/710: write db/d1d/d39/d50/dba/d47/da6/fc0 [1744470,19201] 0 2024-04-20T10:55:03.071 INFO:tasks.workunit.client.1.smithi175.stdout:1/678: truncate d0/d8/d13/d75/fe2 7285155 0 2024-04-20T10:55:03.072 INFO:tasks.workunit.client.1.smithi175.stdout:7/711: chown db/d1d/d39/d50/dba/d47/la7 6838 1 2024-04-20T10:55:03.074 INFO:tasks.workunit.client.1.smithi175.stdout:8/592: rename d7/d13/f32 to d7/d13/d1d/d24/d38/fb9 0 2024-04-20T10:55:03.075 INFO:tasks.workunit.client.1.smithi175.stdout:2/502: link d1/d7/l2e d1/d48/lac 0 2024-04-20T10:55:03.076 INFO:tasks.workunit.client.1.smithi175.stdout:1/679: symlink d0/d57/d7a/leb 0 2024-04-20T10:55:03.078 INFO:tasks.workunit.client.1.smithi175.stdout:7/712: creat db/d61/d6d/d9c/de8/d2a/d41/d59/ffa x:0 0 0 2024-04-20T10:55:03.079 INFO:tasks.workunit.client.1.smithi175.stdout:8/593: rmdir d7/d13 39 2024-04-20T10:55:03.079 INFO:tasks.workunit.client.1.smithi175.stdout:8/594: fdatasync d7/d13/d1d/d24/d63/f7f 0 2024-04-20T10:55:03.082 INFO:tasks.workunit.client.1.smithi175.stdout:8/595: link d7/d13/f75 d7/d13/d1d/d24/d39/d85/fba 0 2024-04-20T10:55:03.085 INFO:tasks.workunit.client.1.smithi175.stdout:1/680: link d0/d3e/c5a d0/d8/d13/d2e/d35/cec 0 2024-04-20T10:55:03.085 INFO:tasks.workunit.client.1.smithi175.stdout:1/681: chown d0/d8/d13/d79/d8c/fab 114 1 2024-04-20T10:55:03.085 INFO:tasks.workunit.client.1.smithi175.stdout:1/682: chown d0/d8/d13/d2e/d35/d8a/d91/c94 1 1 2024-04-20T10:55:03.093 INFO:tasks.workunit.client.1.smithi175.stdout:7/713: write db/d1d/d39/d50/dba/d47/d6a/f72 [2791826,57172] 0 2024-04-20T10:55:03.094 INFO:tasks.workunit.client.1.smithi175.stdout:1/683: dread d0/f8e [0,4194304] 0 2024-04-20T10:55:03.100 INFO:tasks.workunit.client.1.smithi175.stdout:2/503: dwrite d1/d7/d63/d36/f47 [4194304,4194304] 0 2024-04-20T10:55:03.100 INFO:tasks.workunit.client.1.smithi175.stdout:6/658: dwrite d1/d37/d83/db8/f58 [0,4194304] 0 2024-04-20T10:55:03.101 INFO:tasks.workunit.client.1.smithi175.stdout:8/596: symlink d7/d13/d1d/lbb 0 2024-04-20T10:55:03.101 INFO:tasks.workunit.client.1.smithi175.stdout:8/597: chown d7/d13/d1d/d92/fa8 953582 1 2024-04-20T10:55:03.103 INFO:tasks.workunit.client.1.smithi175.stdout:2/504: creat d1/fad x:0 0 0 2024-04-20T10:55:03.103 INFO:tasks.workunit.client.1.smithi175.stdout:2/505: chown d1/d48/d21/d76/c83 132643 1 2024-04-20T10:55:03.112 INFO:tasks.workunit.client.1.smithi175.stdout:6/659: read d1/d5/f10 [178966,3530] 0 2024-04-20T10:55:03.114 INFO:tasks.workunit.client.1.smithi175.stdout:1/684: dwrite d0/d8/f18 [4194304,4194304] 0 2024-04-20T10:55:03.114 INFO:tasks.workunit.client.1.smithi175.stdout:1/685: truncate d0/d8/d13/d2e/f97 8551436 0 2024-04-20T10:55:03.115 INFO:tasks.workunit.client.1.smithi175.stdout:8/598: mkdir d7/d13/d1d/d24/d39/d6f/db7/dbc 0 2024-04-20T10:55:03.119 INFO:tasks.workunit.client.1.smithi175.stdout:2/506: dwrite d1/d48/d38/f88 [0,4194304] 0 2024-04-20T10:55:03.120 INFO:tasks.workunit.client.1.smithi175.stdout:1/686: creat d0/d8/d13/d79/fed x:0 0 0 2024-04-20T10:55:03.125 INFO:tasks.workunit.client.1.smithi175.stdout:1/687: write d0/d8/d13/f60 [324538,3640] 0 2024-04-20T10:55:03.131 INFO:tasks.workunit.client.1.smithi175.stdout:6/660: dwrite d1/d5/d12/d22/fd6 [0,4194304] 0 2024-04-20T10:55:03.131 INFO:tasks.workunit.client.1.smithi175.stdout:1/688: read d0/d57/fc3 [5325640,52564] 0 2024-04-20T10:55:03.131 INFO:tasks.workunit.client.1.smithi175.stdout:6/661: write d1/d37/d83/db8/d60/d6b/f9d [1184753,107109] 0 2024-04-20T10:55:03.131 INFO:tasks.workunit.client.1.smithi175.stdout:6/662: write d1/d5/fa [69812,120316] 0 2024-04-20T10:55:03.131 INFO:tasks.workunit.client.1.smithi175.stdout:8/599: dwrite d7/d13/d1d/d24/d39/d6f/f61 [0,4194304] 0 2024-04-20T10:55:03.131 INFO:tasks.workunit.client.1.smithi175.stdout:8/600: chown d7/d13/d1d/d24/d39/d85/fba 15 1 2024-04-20T10:55:03.132 INFO:tasks.workunit.client.1.smithi175.stdout:2/507: rmdir d1/d48/d38/d82 39 2024-04-20T10:55:03.132 INFO:tasks.workunit.client.1.smithi175.stdout:2/508: readlink d1/d48/d38/l59 0 2024-04-20T10:55:03.132 INFO:tasks.workunit.client.1.smithi175.stdout:2/509: write f0 [2989570,31533] 0 2024-04-20T10:55:03.132 INFO:tasks.workunit.client.1.smithi175.stdout:2/510: chown d1/d7/l2e 44 1 2024-04-20T10:55:03.133 INFO:tasks.workunit.client.1.smithi175.stdout:1/689: truncate d0/d8/d13/d2e/d35/f7f 131186 0 2024-04-20T10:55:03.134 INFO:tasks.workunit.client.1.smithi175.stdout:6/663: creat d1/dc0/d63/d7c/fde x:0 0 0 2024-04-20T10:55:03.139 INFO:tasks.workunit.client.1.smithi175.stdout:1/690: getdents d0/d51/d6b 0 2024-04-20T10:55:03.141 INFO:tasks.workunit.client.1.smithi175.stdout:6/664: getdents d1/d5/d12 0 2024-04-20T10:55:03.158 INFO:tasks.workunit.client.1.smithi175.stdout:6/665: dwrite d1/d5/d12/d7f/fd3 [0,4194304] 0 2024-04-20T10:55:03.159 INFO:tasks.workunit.client.1.smithi175.stdout:2/511: link d1/d7/d63/d36/d7d/d84/d8b/fa3 d1/d48/d21/d29/fae 0 2024-04-20T10:55:03.159 INFO:tasks.workunit.client.1.smithi175.stdout:1/691: symlink d0/lee 0 2024-04-20T10:55:03.160 INFO:tasks.workunit.client.1.smithi175.stdout:6/666: symlink d1/dc0/d63/d7c/ldf 0 2024-04-20T10:55:03.165 INFO:tasks.workunit.client.1.smithi175.stdout:9/578: dread d6/f16 [0,4194304] 0 2024-04-20T10:55:03.165 INFO:tasks.workunit.client.1.smithi175.stdout:9/579: chown d6/d10/f3b 808 1 2024-04-20T10:55:03.167 INFO:tasks.workunit.client.1.smithi175.stdout:9/580: creat d6/d1b/d42/d5b/d72/d7d/fa8 x:0 0 0 2024-04-20T10:55:03.168 INFO:tasks.workunit.client.1.smithi175.stdout:6/667: dread d1/d5/d12/f1c [0,4194304] 0 2024-04-20T10:55:03.168 INFO:tasks.workunit.client.1.smithi175.stdout:9/581: mknod d6/d1b/d42/d5b/d72/d9e/ca9 0 2024-04-20T10:55:03.168 INFO:tasks.workunit.client.1.smithi175.stdout:9/582: dread - d6/d1b/d42/fa6 zero size 2024-04-20T10:55:03.168 INFO:tasks.workunit.client.1.smithi175.stdout:9/583: chown d6/l18 1479 1 2024-04-20T10:55:03.168 INFO:tasks.workunit.client.1.smithi175.stdout:9/584: getdents d6/d1b/d42/d51/d9f 0 2024-04-20T10:55:03.174 INFO:tasks.workunit.client.1.smithi175.stdout:6/668: dread d1/d37/d83/db8/d60/d68/d7e/f81 [0,4194304] 0 2024-04-20T10:55:03.175 INFO:tasks.workunit.client.1.smithi175.stdout:6/669: truncate d1/dc0/d29/f55 2969215 0 2024-04-20T10:55:03.176 INFO:tasks.workunit.client.1.smithi175.stdout:6/670: symlink d1/d5/d12/le0 0 2024-04-20T10:55:03.176 INFO:tasks.workunit.client.1.smithi175.stdout:6/671: fsync d1/d37/d83/db8/fdd 0 2024-04-20T10:55:03.178 INFO:tasks.workunit.client.1.smithi175.stdout:6/672: mkdir d1/d5/d12/de1 0 2024-04-20T10:55:03.181 INFO:tasks.workunit.client.1.smithi175.stdout:1/692: dwrite d0/d57/db7/fd8 [0,4194304] 0 2024-04-20T10:55:03.181 INFO:tasks.workunit.client.1.smithi175.stdout:9/585: dread d6/d1b/d42/f50 [0,4194304] 0 2024-04-20T10:55:03.181 INFO:tasks.workunit.client.1.smithi175.stdout:9/586: chown d6/d1b/d26 7416 1 2024-04-20T10:55:03.182 INFO:tasks.workunit.client.1.smithi175.stdout:8/601: dread d7/d13/d1d/d24/d39/d6f/f90 [0,4194304] 0 2024-04-20T10:55:03.182 INFO:tasks.workunit.client.1.smithi175.stdout:8/602: write d7/d13/f40 [4800212,71292] 0 2024-04-20T10:55:03.182 INFO:tasks.workunit.client.1.smithi175.stdout:9/587: mkdir d6/d58/d90/daa 0 2024-04-20T10:55:03.183 INFO:tasks.workunit.client.1.smithi175.stdout:8/603: mknod d7/d13/d1d/d92/d6c/cbd 0 2024-04-20T10:55:03.183 INFO:tasks.workunit.client.1.smithi175.stdout:9/588: mknod d6/d1b/d26/d8c/cab 0 2024-04-20T10:55:03.184 INFO:tasks.workunit.client.1.smithi175.stdout:9/589: mknod d6/d1b/d2f/cac 0 2024-04-20T10:55:03.189 INFO:tasks.workunit.client.1.smithi175.stdout:2/512: dread d1/d48/d21/d29/f6c [0,4194304] 0 2024-04-20T10:55:03.190 INFO:tasks.workunit.client.1.smithi175.stdout:9/590: symlink d6/d1b/d2f/lad 0 2024-04-20T10:55:03.193 INFO:tasks.workunit.client.1.smithi175.stdout:2/513: truncate d1/f4e 881096 0 2024-04-20T10:55:03.206 INFO:tasks.workunit.client.1.smithi175.stdout:8/604: dwrite d7/fa5 [0,4194304] 0 2024-04-20T10:55:03.206 INFO:tasks.workunit.client.1.smithi175.stdout:8/605: readlink d7/d13/l78 0 2024-04-20T10:55:03.206 INFO:tasks.workunit.client.1.smithi175.stdout:8/606: write d7/fd [2682908,44226] 0 2024-04-20T10:55:03.206 INFO:tasks.workunit.client.1.smithi175.stdout:8/607: fdatasync d7/d13/d1d/d24/d39/f7a 0 2024-04-20T10:55:03.211 INFO:tasks.workunit.client.1.smithi175.stdout:8/608: dread d7/d13/f40 [0,4194304] 0 2024-04-20T10:55:03.219 INFO:tasks.workunit.client.1.smithi175.stdout:6/673: dwrite d1/d37/f92 [0,4194304] 0 2024-04-20T10:55:03.219 INFO:tasks.workunit.client.1.smithi175.stdout:6/674: chown d1/d37/d83/la7 11569970 1 2024-04-20T10:55:03.220 INFO:tasks.workunit.client.1.smithi175.stdout:8/609: link d7/d13/d1d/f47 d7/d13/d1d/d24/d38/fbe 0 2024-04-20T10:55:03.221 INFO:tasks.workunit.client.1.smithi175.stdout:6/675: getdents d1/d5/d12/d73/d7a 0 2024-04-20T10:55:03.221 INFO:tasks.workunit.client.1.smithi175.stdout:6/676: chown d1/dc0 148738 1 2024-04-20T10:55:03.221 INFO:tasks.workunit.client.1.smithi175.stdout:8/610: chown d7/d13/d1d/d92/c4c 1456549 1 2024-04-20T10:55:03.223 INFO:tasks.workunit.client.1.smithi175.stdout:8/611: creat d7/d13/d1d/d24/d39/fbf x:0 0 0 2024-04-20T10:55:03.223 INFO:tasks.workunit.client.1.smithi175.stdout:8/612: dread - d7/d13/d1d/d24/d38/d73/fa6 zero size 2024-04-20T10:55:03.223 INFO:tasks.workunit.client.1.smithi175.stdout:6/677: truncate d1/d5/f39 3873627 0 2024-04-20T10:55:03.223 INFO:tasks.workunit.client.1.smithi175.stdout:6/678: readlink d1/d5/d12/la2 0 2024-04-20T10:55:03.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/679: dread d1/d37/d83/db8/f75 [0,4194304] 0 2024-04-20T10:55:03.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/680: write d1/d5/d12/d7f/fd3 [4620350,30283] 0 2024-04-20T10:55:03.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/681: chown d1/d37/d83/db8/d60/d6b/c98 63007567 1 2024-04-20T10:55:03.339 INFO:tasks.workunit.client.1.smithi175.stdout:9/591: dwrite d6/f4c [4194304,4194304] 0 2024-04-20T10:55:03.340 INFO:tasks.workunit.client.1.smithi175.stdout:6/682: unlink d1/d37/d83/lb7 0 2024-04-20T10:55:03.340 INFO:tasks.workunit.client.1.smithi175.stdout:8/613: symlink d7/d13/d1d/d24/d39/d6f/lc0 0 2024-04-20T10:55:03.341 INFO:tasks.workunit.client.1.smithi175.stdout:9/592: mkdir d6/d1b/d42/d5b/d72/d7d/dae 0 2024-04-20T10:55:03.353 INFO:tasks.workunit.client.1.smithi175.stdout:9/593: dread d6/d33/d63/f73 [0,4194304] 0 2024-04-20T10:55:03.354 INFO:tasks.workunit.client.1.smithi175.stdout:9/594: chown d6/d1b/c67 7 1 2024-04-20T10:55:03.354 INFO:tasks.workunit.client.1.smithi175.stdout:9/595: fdatasync d6/d58/d90/f93 0 2024-04-20T10:55:03.354 INFO:tasks.workunit.client.1.smithi175.stdout:6/683: symlink d1/d5/d12/d22/dc1/le2 0 2024-04-20T10:55:03.354 INFO:tasks.workunit.client.1.smithi175.stdout:6/684: dread - d1/d5/d12/fd8 zero size 2024-04-20T10:55:03.355 INFO:tasks.workunit.client.1.smithi175.stdout:9/596: symlink d6/d1b/d42/d5b/d72/d7d/laf 0 2024-04-20T10:55:03.356 INFO:tasks.workunit.client.1.smithi175.stdout:9/597: truncate d6/d1b/d42/d5b/f9c 403647 0 2024-04-20T10:55:03.361 INFO:tasks.workunit.client.1.smithi175.stdout:8/614: dwrite d7/d13/d1d/d24/d38/d73/fa6 [0,4194304] 0 2024-04-20T10:55:03.361 INFO:tasks.workunit.client.1.smithi175.stdout:6/685: mkdir d1/d5/d12/d7f/de3 0 2024-04-20T10:55:03.362 INFO:tasks.workunit.client.1.smithi175.stdout:6/686: write d1/d37/fdc [551667,102647] 0 2024-04-20T10:55:03.363 INFO:tasks.workunit.client.1.smithi175.stdout:8/615: link d7/d13/d1d/d24/d39/cab d7/d13/d1d/d24/d39/d85/cc1 0 2024-04-20T10:55:03.366 INFO:tasks.workunit.client.1.smithi175.stdout:8/616: creat d7/d13/d1d/d24/d38/d73/db5/fc2 x:0 0 0 2024-04-20T10:55:03.367 INFO:tasks.workunit.client.1.smithi175.stdout:6/687: symlink d1/le4 0 2024-04-20T10:55:03.368 INFO:tasks.workunit.client.1.smithi175.stdout:8/617: creat d7/fc3 x:0 0 0 2024-04-20T10:55:03.369 INFO:tasks.workunit.client.1.smithi175.stdout:6/688: rmdir d1/d37/d83/db8/d60/d68 39 2024-04-20T10:55:03.369 INFO:tasks.workunit.client.1.smithi175.stdout:6/689: write d1/d37/d83/db8/d60/f86 [953575,125248] 0 2024-04-20T10:55:03.369 INFO:tasks.workunit.client.1.smithi175.stdout:6/690: dread - d1/dc0/d29/f9f zero size 2024-04-20T10:55:03.369 INFO:tasks.workunit.client.1.smithi175.stdout:6/691: getdents d1/d37/d83/db8/d60/d6b 0 2024-04-20T10:55:03.375 INFO:tasks.workunit.client.1.smithi175.stdout:6/692: dread d1/d5/d12/d7f/fd3 [0,4194304] 0 2024-04-20T10:55:03.376 INFO:tasks.workunit.client.1.smithi175.stdout:8/618: unlink d7/d13/d1d/d92/c4c 0 2024-04-20T10:55:03.377 INFO:tasks.workunit.client.1.smithi175.stdout:8/619: creat d7/d13/d1d/fc4 x:0 0 0 2024-04-20T10:55:03.378 INFO:tasks.workunit.client.1.smithi175.stdout:6/693: mknod d1/d5/d12/d73/ce5 0 2024-04-20T10:55:03.379 INFO:tasks.workunit.client.1.smithi175.stdout:8/620: link d7/d13/d1d/d24/d39/d6f/lc0 d7/d13/d1d/d24/d38/d73/lc5 0 2024-04-20T10:55:03.379 INFO:tasks.workunit.client.1.smithi175.stdout:8/621: truncate d7/d13/d1d/d24/d38/f89 1389003 0 2024-04-20T10:55:03.380 INFO:tasks.workunit.client.1.smithi175.stdout:6/694: symlink d1/d37/d83/db8/db9/le6 0 2024-04-20T10:55:03.380 INFO:tasks.workunit.client.1.smithi175.stdout:6/695: chown d1/dc0/d63/d7c/lc8 1919154 1 2024-04-20T10:55:03.381 INFO:tasks.workunit.client.1.smithi175.stdout:8/622: symlink d7/lc6 0 2024-04-20T10:55:03.381 INFO:tasks.workunit.client.1.smithi175.stdout:8/623: chown d7/d13/d1d/d24/d39/cab 1966780 1 2024-04-20T10:55:03.381 INFO:tasks.workunit.client.1.smithi175.stdout:8/624: stat d7/f1b 0 2024-04-20T10:55:03.381 INFO:tasks.workunit.client.1.smithi175.stdout:8/625: fsync d7/d13/d1d/d24/d38/f7e 0 2024-04-20T10:55:03.382 INFO:tasks.workunit.client.1.smithi175.stdout:6/696: link d1/d37/fdc d1/d37/d83/db8/d60/d6b/da8/fe7 0 2024-04-20T10:55:03.383 INFO:tasks.workunit.client.1.smithi175.stdout:8/626: mknod d7/d13/d1d/d24/cc7 0 2024-04-20T10:55:03.384 INFO:tasks.workunit.client.1.smithi175.stdout:8/627: getdents d7/d13/d1d/d24/d38 0 2024-04-20T10:55:03.385 INFO:tasks.workunit.client.1.smithi175.stdout:8/628: creat d7/d13/d1d/d24/d38/d73/fc8 x:0 0 0 2024-04-20T10:55:03.393 INFO:tasks.workunit.client.1.smithi175.stdout:8/629: write d7/f84 [1737524,60629] 0 2024-04-20T10:55:03.393 INFO:tasks.workunit.client.1.smithi175.stdout:4/648: sync 2024-04-20T10:55:03.393 INFO:tasks.workunit.client.1.smithi175.stdout:3/475: sync 2024-04-20T10:55:03.393 INFO:tasks.workunit.client.1.smithi175.stdout:0/614: sync 2024-04-20T10:55:03.393 INFO:tasks.workunit.client.1.smithi175.stdout:8/630: fdatasync d7/d13/d1d/d56/f62 0 2024-04-20T10:55:03.393 INFO:tasks.workunit.client.1.smithi175.stdout:0/615: chown df/d1a/d28/f73 8 1 2024-04-20T10:55:03.395 INFO:tasks.workunit.client.1.smithi175.stdout:4/649: mkdir d4/dd/d2d/d33/d3c/de5 0 2024-04-20T10:55:03.396 INFO:tasks.workunit.client.1.smithi175.stdout:9/598: dread d6/d1b/f7a [0,4194304] 0 2024-04-20T10:55:03.396 INFO:tasks.workunit.client.1.smithi175.stdout:8/631: rename d7/d13/d1d/d92/la9 to d7/d13/d1d/d24/d39/d85/lc9 0 2024-04-20T10:55:03.397 INFO:tasks.workunit.client.1.smithi175.stdout:0/616: truncate df/d1a/d22/f44 2135791 0 2024-04-20T10:55:03.399 INFO:tasks.workunit.client.1.smithi175.stdout:3/476: symlink d7/d21/d16/d22/d2c/d1f/l9e 0 2024-04-20T10:55:03.400 INFO:tasks.workunit.client.1.smithi175.stdout:9/599: creat d6/d1b/d26/d8c/fb0 x:0 0 0 2024-04-20T10:55:03.400 INFO:tasks.workunit.client.1.smithi175.stdout:9/600: dread - d6/d1b/d2f/f6b zero size 2024-04-20T10:55:03.400 INFO:tasks.workunit.client.1.smithi175.stdout:9/601: readlink d6/d1b/d42/d79/l7b 0 2024-04-20T10:55:03.401 INFO:tasks.workunit.client.1.smithi175.stdout:0/617: creat df/d1a/d22/d24/fc2 x:0 0 0 2024-04-20T10:55:03.402 INFO:tasks.workunit.client.1.smithi175.stdout:3/477: creat d7/d19/d33/f9f x:0 0 0 2024-04-20T10:55:03.403 INFO:tasks.workunit.client.1.smithi175.stdout:9/602: symlink d6/d1b/d42/d79/d81/lb1 0 2024-04-20T10:55:03.404 INFO:tasks.workunit.client.1.smithi175.stdout:8/632: dread d7/d13/d1d/d24/d26/f7b [0,4194304] 0 2024-04-20T10:55:03.405 INFO:tasks.workunit.client.1.smithi175.stdout:8/633: dread d7/d13/d1d/d24/d39/d6f/f90 [0,4194304] 0 2024-04-20T10:55:03.406 INFO:tasks.workunit.client.1.smithi175.stdout:9/603: unlink d6/f43 0 2024-04-20T10:55:03.408 INFO:tasks.workunit.client.1.smithi175.stdout:2/514: sync 2024-04-20T10:55:03.408 INFO:tasks.workunit.client.1.smithi175.stdout:7/714: sync 2024-04-20T10:55:03.408 INFO:tasks.workunit.client.1.smithi175.stdout:5/789: sync 2024-04-20T10:55:03.409 INFO:tasks.workunit.client.1.smithi175.stdout:1/693: sync 2024-04-20T10:55:03.409 INFO:tasks.workunit.client.1.smithi175.stdout:2/515: chown d1/d48/d38/d82/f7f 0 1 2024-04-20T10:55:03.409 INFO:tasks.workunit.client.1.smithi175.stdout:7/715: chown db/d61/d6d/d9c/de8/d8e/c3d 2 1 2024-04-20T10:55:03.409 INFO:tasks.workunit.client.1.smithi175.stdout:0/618: symlink df/d1a/d3f/d5e/lc3 0 2024-04-20T10:55:03.409 INFO:tasks.workunit.client.1.smithi175.stdout:0/619: write df/d1a/d22/d6a/d72/d48/d4e/fae [865318,28497] 0 2024-04-20T10:55:03.410 INFO:tasks.workunit.client.1.smithi175.stdout:5/790: mknod db/d11/d6d/da1/c106 0 2024-04-20T10:55:03.411 INFO:tasks.workunit.client.1.smithi175.stdout:6/697: write d1/dc0/d29/f5d [64556,53564] 0 2024-04-20T10:55:03.411 INFO:tasks.workunit.client.1.smithi175.stdout:5/791: dread - db/d11/d1a/f76 zero size 2024-04-20T10:55:03.411 INFO:tasks.workunit.client.1.smithi175.stdout:1/694: creat d0/d8/dcb/fef x:0 0 0 2024-04-20T10:55:03.412 INFO:tasks.workunit.client.1.smithi175.stdout:2/516: symlink d1/d48/d38/d82/laf 0 2024-04-20T10:55:03.412 INFO:tasks.workunit.client.1.smithi175.stdout:8/634: dread d7/d13/f40 [4194304,4194304] 0 2024-04-20T10:55:03.412 INFO:tasks.workunit.client.1.smithi175.stdout:8/635: truncate d7/d13/d1d/d56/f62 1262559 0 2024-04-20T10:55:03.414 INFO:tasks.workunit.client.1.smithi175.stdout:5/792: rename db/d11/d25/d41/d83/ff4 to db/d1f/d31/d93/f107 0 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:4/650: dread d4/dd/d5e/f6b [0,4194304] 0 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:4/651: dread - d4/dd/fb7 zero size 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:4/652: stat d4/f1a 0 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:4/653: chown d4/dd/d2d/d33/d58/f9f 5430085 1 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:0/620: link la df/d1a/d22/d55/da2/lc4 0 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:0/621: write df/d1a/d22/d6a/d72/fbb [767990,101924] 0 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:0/622: write df/d17/d2f/d4f/f9c [949136,121766] 0 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:0/623: fsync df/d17/fa3 0 2024-04-20T10:55:03.416 INFO:tasks.workunit.client.1.smithi175.stdout:8/636: dread d7/d13/d1d/d24/d63/f7f [0,4194304] 0 2024-04-20T10:55:03.417 INFO:tasks.workunit.client.1.smithi175.stdout:8/637: fsync d7/d13/d1d/f4e 0 2024-04-20T10:55:03.417 INFO:tasks.workunit.client.1.smithi175.stdout:6/698: symlink d1/d37/d83/db8/d60/d68/d7e/le8 0 2024-04-20T10:55:03.417 INFO:tasks.workunit.client.1.smithi175.stdout:1/695: rename d0/d8/cb to d0/d51/da8/cf0 0 2024-04-20T10:55:03.420 INFO:tasks.workunit.client.1.smithi175.stdout:4/654: symlink d4/dd/d2d/d33/d3c/de5/le6 0 2024-04-20T10:55:03.420 INFO:tasks.workunit.client.1.smithi175.stdout:4/655: fsync d4/dd/d54/d5d/d8a/da4/fb5 0 2024-04-20T10:55:03.420 INFO:tasks.workunit.client.1.smithi175.stdout:6/699: creat d1/d5/d12/d73/d7a/fe9 x:0 0 0 2024-04-20T10:55:03.420 INFO:tasks.workunit.client.1.smithi175.stdout:1/696: mknod d0/d3e/d61/cf1 0 2024-04-20T10:55:03.423 INFO:tasks.workunit.client.1.smithi175.stdout:7/716: dread db/d1d/d39/d50/dba/d47/f9b [4194304,4194304] 0 2024-04-20T10:55:03.423 INFO:tasks.workunit.client.1.smithi175.stdout:4/656: dread d4/d27/f52 [0,4194304] 0 2024-04-20T10:55:03.424 INFO:tasks.workunit.client.1.smithi175.stdout:6/700: chown d1/d5/l21 27 1 2024-04-20T10:55:03.425 INFO:tasks.workunit.client.1.smithi175.stdout:8/638: dread d7/fa5 [0,4194304] 0 2024-04-20T10:55:03.425 INFO:tasks.workunit.client.1.smithi175.stdout:8/639: write d7/d13/d1d/f2f [1823072,14511] 0 2024-04-20T10:55:03.426 INFO:tasks.workunit.client.1.smithi175.stdout:4/657: getdents d4/dd/d54 0 2024-04-20T10:55:03.427 INFO:tasks.workunit.client.1.smithi175.stdout:6/701: link d1/caf d1/d37/d83/db8/d60/d6b/da8/cea 0 2024-04-20T10:55:03.430 INFO:tasks.workunit.client.1.smithi175.stdout:8/640: rename d7/d13/d1d/d56/cac to d7/d13/d1d/d24/d38/d73/cca 0 2024-04-20T10:55:03.431 INFO:tasks.workunit.client.1.smithi175.stdout:7/717: dread db/d61/d6d/d9c/de8/d8e/f2d [0,4194304] 0 2024-04-20T10:55:03.431 INFO:tasks.workunit.client.1.smithi175.stdout:7/718: chown db/d61/d6d/f7c 0 1 2024-04-20T10:55:03.431 INFO:tasks.workunit.client.1.smithi175.stdout:7/719: chown db/d61/d6d/d9c/de8/d9a/cb5 6 1 2024-04-20T10:55:03.431 INFO:tasks.workunit.client.1.smithi175.stdout:4/658: creat d4/dd/d2d/d43/d69/daa/fe7 x:0 0 0 2024-04-20T10:55:03.432 INFO:tasks.workunit.client.1.smithi175.stdout:8/641: unlink d7/c29 0 2024-04-20T10:55:03.432 INFO:tasks.workunit.client.1.smithi175.stdout:7/720: truncate db/d61/d6d/f90 3704629 0 2024-04-20T10:55:03.433 INFO:tasks.workunit.client.1.smithi175.stdout:4/659: getdents d4/dd/d2d 0 2024-04-20T10:55:03.438 INFO:tasks.workunit.client.1.smithi175.stdout:9/604: dwrite d6/f39 [0,4194304] 0 2024-04-20T10:55:03.439 INFO:tasks.workunit.client.1.smithi175.stdout:9/605: chown d6/d1b/d2f/lad 1851 1 2024-04-20T10:55:03.442 INFO:tasks.workunit.client.1.smithi175.stdout:8/642: mkdir d7/d13/d1d/d24/d26/dcb 0 2024-04-20T10:55:03.442 INFO:tasks.workunit.client.1.smithi175.stdout:7/721: dread db/d61/d6d/d9c/de8/d8f/f98 [0,4194304] 0 2024-04-20T10:55:03.442 INFO:tasks.workunit.client.1.smithi175.stdout:0/624: dwrite df/d17/f8d [0,4194304] 0 2024-04-20T10:55:03.442 INFO:tasks.workunit.client.1.smithi175.stdout:0/625: truncate df/d19/f51 4306488 0 2024-04-20T10:55:03.442 INFO:tasks.workunit.client.1.smithi175.stdout:8/643: dread d7/d13/d1d/d24/d63/f7f [0,4194304] 0 2024-04-20T10:55:03.442 INFO:tasks.workunit.client.1.smithi175.stdout:8/644: chown d7/d13/d1d/d24/d38/f77 1 1 2024-04-20T10:55:03.443 INFO:tasks.workunit.client.1.smithi175.stdout:7/722: creat db/d61/d6d/dbc/ffb x:0 0 0 2024-04-20T10:55:03.443 INFO:tasks.workunit.client.1.smithi175.stdout:7/723: chown db/d1d/d39/d50/f52 5125 1 2024-04-20T10:55:03.443 INFO:tasks.workunit.client.1.smithi175.stdout:7/724: fdatasync db/d61/d6d/dbc/dc4/ff4 0 2024-04-20T10:55:03.445 INFO:tasks.workunit.client.1.smithi175.stdout:6/702: dread d1/d37/fdc [0,4194304] 0 2024-04-20T10:55:03.445 INFO:tasks.workunit.client.1.smithi175.stdout:0/626: dread df/d17/d2f/f8b [0,4194304] 0 2024-04-20T10:55:03.445 INFO:tasks.workunit.client.1.smithi175.stdout:5/793: read db/d30/d46/fba [2869282,4387] 0 2024-04-20T10:55:03.445 INFO:tasks.workunit.client.1.smithi175.stdout:5/794: chown db/d1f/d31/f33 875395 1 2024-04-20T10:55:03.445 INFO:tasks.workunit.client.1.smithi175.stdout:0/627: write df/d19/f34 [672720,118784] 0 2024-04-20T10:55:03.445 INFO:tasks.workunit.client.1.smithi175.stdout:3/478: dwrite d7/d19/d33/d60/d79/d99/f73 [4194304,4194304] 0 2024-04-20T10:55:03.446 INFO:tasks.workunit.client.1.smithi175.stdout:8/645: mkdir d7/d13/d1d/d24/d38/d73/db5/dcc 0 2024-04-20T10:55:03.446 INFO:tasks.workunit.client.1.smithi175.stdout:9/606: truncate d6/d1b/d42/d51/f9a 1446827 0 2024-04-20T10:55:03.446 INFO:tasks.workunit.client.1.smithi175.stdout:9/607: write d6/d10/f77 [483907,38319] 0 2024-04-20T10:55:03.447 INFO:tasks.workunit.client.1.smithi175.stdout:1/697: dwrite d0/d51/f48 [0,4194304] 0 2024-04-20T10:55:03.451 INFO:tasks.workunit.client.1.smithi175.stdout:8/646: mknod d7/d13/d1d/d24/d26/ccd 0 2024-04-20T10:55:03.451 INFO:tasks.workunit.client.1.smithi175.stdout:8/647: dread - d7/d13/d1d/d24/d38/f7e zero size 2024-04-20T10:55:03.454 INFO:tasks.workunit.client.1.smithi175.stdout:5/795: mknod db/d11/d25/d62/c108 0 2024-04-20T10:55:03.456 INFO:tasks.workunit.client.1.smithi175.stdout:7/725: dread db/d1d/d39/d50/dba/d47/da6/fd3 [0,4194304] 0 2024-04-20T10:55:03.458 INFO:tasks.workunit.client.1.smithi175.stdout:0/628: write df/d17/f8d [1087403,108069] 0 2024-04-20T10:55:03.458 INFO:tasks.workunit.client.1.smithi175.stdout:2/517: write d1/d7/d63/d36/d7d/d84/d8b/fa3 [974277,106811] 0 2024-04-20T10:55:03.461 INFO:tasks.workunit.client.1.smithi175.stdout:6/703: dread d1/d5/d12/d7f/fd3 [4194304,4194304] 0 2024-04-20T10:55:03.461 INFO:tasks.workunit.client.1.smithi175.stdout:3/479: dwrite d7/d10/f9a [0,4194304] 0 2024-04-20T10:55:03.462 INFO:tasks.workunit.client.1.smithi175.stdout:3/480: fsync d7/d21/d16/d22/f52 0 2024-04-20T10:55:03.464 INFO:tasks.workunit.client.1.smithi175.stdout:5/796: dread db/d1f/d31/fdc [0,4194304] 0 2024-04-20T10:55:03.464 INFO:tasks.workunit.client.1.smithi175.stdout:0/629: truncate df/f3a 3957938 0 2024-04-20T10:55:03.464 INFO:tasks.workunit.client.1.smithi175.stdout:0/630: write df/d1a/d28/f73 [1634003,101580] 0 2024-04-20T10:55:03.465 INFO:tasks.workunit.client.1.smithi175.stdout:3/481: write d7/d21/d16/d49/f63 [3419943,116654] 0 2024-04-20T10:55:03.466 INFO:tasks.workunit.client.1.smithi175.stdout:2/518: creat d1/d7/d63/d36/fb0 x:0 0 0 2024-04-20T10:55:03.472 INFO:tasks.workunit.client.1.smithi175.stdout:5/797: link db/dc1/d4f/d5a/fb1 db/d1f/d31/f109 0 2024-04-20T10:55:03.474 INFO:tasks.workunit.client.1.smithi175.stdout:0/631: creat df/d17/dc0/fc5 x:0 0 0 2024-04-20T10:55:03.478 INFO:tasks.workunit.client.1.smithi175.stdout:5/798: rmdir db/dc1/d4f/d75/df1 39 2024-04-20T10:55:03.479 INFO:tasks.workunit.client.1.smithi175.stdout:0/632: getdents df/d17/d2f/d4f 0 2024-04-20T10:55:03.482 INFO:tasks.workunit.client.1.smithi175.stdout:3/482: rename d7/d19/d33/d7e/d86/d7f to d7/d21/d16/d49/da0 0 2024-04-20T10:55:03.483 INFO:tasks.workunit.client.1.smithi175.stdout:3/483: dread d7/d10/f31 [0,4194304] 0 2024-04-20T10:55:03.484 INFO:tasks.workunit.client.1.smithi175.stdout:0/633: creat df/d19/fc6 x:0 0 0 2024-04-20T10:55:03.484 INFO:tasks.workunit.client.1.smithi175.stdout:0/634: chown df/d17/d2f/d4f/l82 1345185187 1 2024-04-20T10:55:03.486 INFO:tasks.workunit.client.1.smithi175.stdout:5/799: mknod db/d11/d25/d62/c10a 0 2024-04-20T10:55:03.487 INFO:tasks.workunit.client.1.smithi175.stdout:3/484: rmdir d7/d21/d16/d85 39 2024-04-20T10:55:03.489 INFO:tasks.workunit.client.1.smithi175.stdout:9/608: dwrite d6/d1b/d42/d79/d81/fa4 [0,4194304] 0 2024-04-20T10:55:03.489 INFO:tasks.workunit.client.1.smithi175.stdout:6/704: dwrite d1/d5/d12/f47 [0,4194304] 0 2024-04-20T10:55:03.490 INFO:tasks.workunit.client.1.smithi175.stdout:6/705: stat d1/d5/d12/d22/d9b/fc4 0 2024-04-20T10:55:03.490 INFO:tasks.workunit.client.1.smithi175.stdout:2/519: dwrite d1/f3 [0,4194304] 0 2024-04-20T10:55:03.490 INFO:tasks.workunit.client.1.smithi175.stdout:7/726: dwrite db/d1d/d39/d50/dba/d47/dac/fdd [0,4194304] 0 2024-04-20T10:55:03.492 INFO:tasks.workunit.client.1.smithi175.stdout:9/609: link d6/d1b/d2f/l66 d6/d58/d90/daa/lb2 0 2024-04-20T10:55:03.492 INFO:tasks.workunit.client.1.smithi175.stdout:9/610: write d6/d33/fa7 [862095,113430] 0 2024-04-20T10:55:03.494 INFO:tasks.workunit.client.1.smithi175.stdout:6/706: truncate d1/dc0/d49/f62 485863 0 2024-04-20T10:55:03.495 INFO:tasks.workunit.client.1.smithi175.stdout:5/800: mknod db/dc1/d4f/d5a/c10b 0 2024-04-20T10:55:03.500 INFO:tasks.workunit.client.1.smithi175.stdout:9/611: symlink d6/d58/d90/lb3 0 2024-04-20T10:55:03.500 INFO:tasks.workunit.client.1.smithi175.stdout:9/612: chown d6/d33/c6f 1342287 1 2024-04-20T10:55:03.500 INFO:tasks.workunit.client.1.smithi175.stdout:9/613: chown d6/d10/f3b 17 1 2024-04-20T10:55:03.501 INFO:tasks.workunit.client.1.smithi175.stdout:7/727: dread db/d1d/d39/d50/dba/f88 [0,4194304] 0 2024-04-20T10:55:03.501 INFO:tasks.workunit.client.1.smithi175.stdout:6/707: chown d1/d37/d83/db8/d60/l6d 2113 1 2024-04-20T10:55:03.501 INFO:tasks.workunit.client.1.smithi175.stdout:7/728: chown db/d61/d6d/d9c/de8/fb4 467 1 2024-04-20T10:55:03.501 INFO:tasks.workunit.client.1.smithi175.stdout:7/729: dread - db/d61/d6d/dbc/fd5 zero size 2024-04-20T10:55:03.501 INFO:tasks.workunit.client.1.smithi175.stdout:7/730: stat db/d1d/d39/d50/dba/d47/dac/fee 0 2024-04-20T10:55:03.501 INFO:tasks.workunit.client.1.smithi175.stdout:7/731: chown db/d61/d6d/dbc/cbe 1051305401 1 2024-04-20T10:55:03.501 INFO:tasks.workunit.client.1.smithi175.stdout:6/708: write d1/d5/d12/fd8 [78424,71377] 0 2024-04-20T10:55:03.502 INFO:tasks.workunit.client.1.smithi175.stdout:5/801: getdents db/d11/d25/d38/d40/d66/d94 0 2024-04-20T10:55:03.503 INFO:tasks.workunit.client.1.smithi175.stdout:9/614: rename d6/d1b/l65 to d6/d1b/d42/d79/lb4 0 2024-04-20T10:55:03.505 INFO:tasks.workunit.client.1.smithi175.stdout:7/732: mkdir db/d61/d6d/d9c/de8/d9a/dd2/dfc 0 2024-04-20T10:55:03.507 INFO:tasks.workunit.client.1.smithi175.stdout:5/802: mknod db/d11/d25/d38/d40/d66/d94/dfb/c10c 0 2024-04-20T10:55:03.508 INFO:tasks.workunit.client.1.smithi175.stdout:9/615: unlink d6/c5d 0 2024-04-20T10:55:03.510 INFO:tasks.workunit.client.1.smithi175.stdout:7/733: rename db/d1d/d60/d76/l97 to db/d1d/d39/d50/dba/d47/da6/db9/dc8/dd8/lfd 0 2024-04-20T10:55:03.511 INFO:tasks.workunit.client.1.smithi175.stdout:7/734: chown db/d1d/d39/d50/dba/d47/cc3 1622 1 2024-04-20T10:55:03.511 INFO:tasks.workunit.client.1.smithi175.stdout:7/735: dread - db/fdf zero size 2024-04-20T10:55:03.521 INFO:tasks.workunit.client.1.smithi175.stdout:9/616: dread d6/d33/d63/f73 [0,4194304] 0 2024-04-20T10:55:03.522 INFO:tasks.workunit.client.1.smithi175.stdout:7/736: creat db/d61/d6d/d9c/de8/d9a/dd2/dfc/ffe x:0 0 0 2024-04-20T10:55:03.522 INFO:tasks.workunit.client.1.smithi175.stdout:7/737: truncate db/d1d/d39/d50/dba/d47/da6/db9/dc8/fd7 612207 0 2024-04-20T10:55:03.523 INFO:tasks.workunit.client.1.smithi175.stdout:7/738: read - db/d1d/d39/fa4 zero size 2024-04-20T10:55:03.523 INFO:tasks.workunit.client.1.smithi175.stdout:6/709: dwrite d1/d37/f66 [0,4194304] 0 2024-04-20T10:55:03.525 INFO:tasks.workunit.client.1.smithi175.stdout:7/739: dread db/d1d/d39/d50/dba/d47/f49 [0,4194304] 0 2024-04-20T10:55:03.528 INFO:tasks.workunit.client.1.smithi175.stdout:9/617: symlink d6/d1b/d26/lb5 0 2024-04-20T10:55:03.528 INFO:tasks.workunit.client.1.smithi175.stdout:5/803: dwrite db/d30/d46/fd2 [0,4194304] 0 2024-04-20T10:55:03.529 INFO:tasks.workunit.client.1.smithi175.stdout:7/740: mknod db/d61/d6d/d9c/de8/cff 0 2024-04-20T10:55:03.530 INFO:tasks.workunit.client.1.smithi175.stdout:9/618: mknod d6/d1b/d26/d8c/cb6 0 2024-04-20T10:55:03.531 INFO:tasks.workunit.client.1.smithi175.stdout:7/741: rmdir db/d61/d6d/d9c/de8/d8e 39 2024-04-20T10:55:03.533 INFO:tasks.workunit.client.1.smithi175.stdout:5/804: link db/dc1/d4f/d75/d91/ff6 db/d30/f10d 0 2024-04-20T10:55:03.533 INFO:tasks.workunit.client.1.smithi175.stdout:5/805: dread - db/d30/f10d zero size 2024-04-20T10:55:03.534 INFO:tasks.workunit.client.1.smithi175.stdout:7/742: creat db/d61/d6d/d9c/de8/d8f/f100 x:0 0 0 2024-04-20T10:55:03.537 INFO:tasks.workunit.client.1.smithi175.stdout:5/806: creat db/dc1/f10e x:0 0 0 2024-04-20T10:55:03.537 INFO:tasks.workunit.client.1.smithi175.stdout:5/807: readlink db/d11/d25/d38/d40/d66/d94/l9f 0 2024-04-20T10:55:03.538 INFO:tasks.workunit.client.1.smithi175.stdout:7/743: unlink db/d61/d6d/d9c/de8/d9a/fc6 0 2024-04-20T10:55:03.539 INFO:tasks.workunit.client.1.smithi175.stdout:5/808: truncate db/dc1/d4f/d75/f97 1275918 0 2024-04-20T10:55:03.539 INFO:tasks.workunit.client.1.smithi175.stdout:5/809: truncate db/d30/d46/fd0 134822 0 2024-04-20T10:55:03.540 INFO:tasks.workunit.client.1.smithi175.stdout:5/810: read db/d1f/d31/fcd [102961,44788] 0 2024-04-20T10:55:03.540 INFO:tasks.workunit.client.1.smithi175.stdout:5/811: write db/d1f/d31/fcd [11724,30823] 0 2024-04-20T10:55:03.540 INFO:tasks.workunit.client.1.smithi175.stdout:6/710: dwrite d1/d5/f45 [0,4194304] 0 2024-04-20T10:55:03.541 INFO:tasks.workunit.client.1.smithi175.stdout:7/744: unlink db/d1d/l36 0 2024-04-20T10:55:03.542 INFO:tasks.workunit.client.1.smithi175.stdout:5/812: creat db/d30/d46/d88/f10f x:0 0 0 2024-04-20T10:55:03.543 INFO:tasks.workunit.client.1.smithi175.stdout:6/711: rmdir d1/d5 39 2024-04-20T10:55:03.544 INFO:tasks.workunit.client.1.smithi175.stdout:7/745: mknod db/d61/d6d/dbc/c101 0 2024-04-20T10:55:03.544 INFO:tasks.workunit.client.1.smithi175.stdout:7/746: dread - db/d1d/d39/d50/dba/d47/f79 zero size 2024-04-20T10:55:03.546 INFO:tasks.workunit.client.1.smithi175.stdout:7/747: truncate db/d1d/d39/fa4 209283 0 2024-04-20T10:55:03.547 INFO:tasks.workunit.client.1.smithi175.stdout:7/748: fdatasync db/d1d/d39/d50/f52 0 2024-04-20T10:55:03.547 INFO:tasks.workunit.client.1.smithi175.stdout:7/749: fsync db/fdf 0 2024-04-20T10:55:03.548 INFO:tasks.workunit.client.1.smithi175.stdout:5/813: symlink db/d11/l110 0 2024-04-20T10:55:03.548 INFO:tasks.workunit.client.1.smithi175.stdout:5/814: fdatasync db/d1f/f20 0 2024-04-20T10:55:03.549 INFO:tasks.workunit.client.1.smithi175.stdout:5/815: read db/d30/d46/fd0 [4320,23434] 0 2024-04-20T10:55:03.549 INFO:tasks.workunit.client.1.smithi175.stdout:5/816: truncate db/d11/d25/d38/f9e 625515 0 2024-04-20T10:55:03.549 INFO:tasks.workunit.client.1.smithi175.stdout:5/817: fsync db/fbe 0 2024-04-20T10:55:03.550 INFO:tasks.workunit.client.1.smithi175.stdout:5/818: dread db/d11/d25/d38/d40/d66/fa3 [0,4194304] 0 2024-04-20T10:55:03.554 INFO:tasks.workunit.client.1.smithi175.stdout:9/619: write d6/f3c [172393,82043] 0 2024-04-20T10:55:03.573 INFO:tasks.workunit.client.1.smithi175.stdout:7/750: dwrite db/d1d/d39/d50/dba/d47/f94 [0,4194304] 0 2024-04-20T10:55:03.588 INFO:tasks.workunit.client.1.smithi175.stdout:9/620: dwrite d6/d1b/d42/f50 [0,4194304] 0 2024-04-20T10:55:03.589 INFO:tasks.workunit.client.1.smithi175.stdout:5/819: dwrite db/d30/d46/d88/f10f [0,4194304] 0 2024-04-20T10:55:03.589 INFO:tasks.workunit.client.1.smithi175.stdout:6/712: dwrite d1/d5/f38 [0,4194304] 0 2024-04-20T10:55:03.589 INFO:tasks.workunit.client.1.smithi175.stdout:7/751: creat db/d1d/d39/de7/f102 x:0 0 0 2024-04-20T10:55:03.592 INFO:tasks.workunit.client.1.smithi175.stdout:6/713: rmdir d1/d5/d12/de1 0 2024-04-20T10:55:03.593 INFO:tasks.workunit.client.1.smithi175.stdout:5/820: mknod db/d30/c111 0 2024-04-20T10:55:03.594 INFO:tasks.workunit.client.1.smithi175.stdout:7/752: mknod db/d61/d6d/d9c/de8/d8f/c103 0 2024-04-20T10:55:03.595 INFO:tasks.workunit.client.1.smithi175.stdout:5/821: rename db/d1f/d31/fcd to db/d1f/d31/f112 0 2024-04-20T10:55:03.597 INFO:tasks.workunit.client.1.smithi175.stdout:6/714: mkdir d1/d5/d12/deb 0 2024-04-20T10:55:03.597 INFO:tasks.workunit.client.1.smithi175.stdout:6/715: read - d1/d5/d12/d7f/dae/fbb zero size 2024-04-20T10:55:03.597 INFO:tasks.workunit.client.1.smithi175.stdout:9/621: dread d6/d1b/f57 [0,4194304] 0 2024-04-20T10:55:03.597 INFO:tasks.workunit.client.1.smithi175.stdout:7/753: rmdir db/d1d/d60/d76 39 2024-04-20T10:55:03.599 INFO:tasks.workunit.client.1.smithi175.stdout:7/754: dread db/d61/d6d/dbc/dc4/ff4 [0,4194304] 0 2024-04-20T10:55:03.599 INFO:tasks.workunit.client.1.smithi175.stdout:5/822: creat db/d11/d25/d38/d40/f113 x:0 0 0 2024-04-20T10:55:03.599 INFO:tasks.workunit.client.1.smithi175.stdout:6/716: rmdir d1/dc0/d63 39 2024-04-20T10:55:03.599 INFO:tasks.workunit.client.1.smithi175.stdout:6/717: fdatasync d1/dc0/f5e 0 2024-04-20T10:55:03.599 INFO:tasks.workunit.client.1.smithi175.stdout:5/823: creat db/d11/d25/d38/d40/d66/f114 x:0 0 0 2024-04-20T10:55:03.600 INFO:tasks.workunit.client.1.smithi175.stdout:5/824: mkdir db/d11/d6d/da1/dcc/d115 0 2024-04-20T10:55:03.603 INFO:tasks.workunit.client.1.smithi175.stdout:5/825: dread db/d1f/f7d [0,4194304] 0 2024-04-20T10:55:03.603 INFO:tasks.workunit.client.1.smithi175.stdout:7/755: dread db/d1d/d39/f3f [0,4194304] 0 2024-04-20T10:55:03.604 INFO:tasks.workunit.client.1.smithi175.stdout:6/718: link d1/d5/d12/l4c d1/d37/d83/db8/d60/d68/d7e/lec 0 2024-04-20T10:55:03.604 INFO:tasks.workunit.client.1.smithi175.stdout:7/756: truncate db/d1d/d39/d50/dba/d47/dac/fee 512941 0 2024-04-20T10:55:03.608 INFO:tasks.workunit.client.1.smithi175.stdout:0/635: write df/f3a [912059,10763] 0 2024-04-20T10:55:03.610 INFO:tasks.workunit.client.1.smithi175.stdout:7/757: rename db/d61/f68 to db/d61/d6d/dbc/f104 0 2024-04-20T10:55:03.610 INFO:tasks.workunit.client.1.smithi175.stdout:7/758: readlink db/d1d/ld6 0 2024-04-20T10:55:03.612 INFO:tasks.workunit.client.1.smithi175.stdout:6/719: dread d1/dc0/d63/d7c/f94 [0,4194304] 0 2024-04-20T10:55:03.612 INFO:tasks.workunit.client.1.smithi175.stdout:6/720: write d1/dc0/d63/d7c/fde [474726,26017] 0 2024-04-20T10:55:03.613 INFO:tasks.workunit.client.1.smithi175.stdout:0/636: truncate df/d19/f1e 843430 0 2024-04-20T10:55:03.616 INFO:tasks.workunit.client.1.smithi175.stdout:6/721: rename d1/d5/d12/d22 to d1/d37/d83/db8/d60/ded 0 2024-04-20T10:55:03.616 INFO:tasks.workunit.client.1.smithi175.stdout:6/722: write d1/d5/fbe [165629,9323] 0 2024-04-20T10:55:03.617 INFO:tasks.workunit.client.1.smithi175.stdout:6/723: write d1/d37/d83/db8/d60/d6b/f9d [2048857,45982] 0 2024-04-20T10:55:03.617 INFO:tasks.workunit.client.1.smithi175.stdout:6/724: fdatasync d1/d37/f50 0 2024-04-20T10:55:03.617 INFO:tasks.workunit.client.1.smithi175.stdout:0/637: symlink df/d1a/d22/d6a/d72/d48/lc7 0 2024-04-20T10:55:03.617 INFO:tasks.workunit.client.1.smithi175.stdout:0/638: readlink df/d19/l50 0 2024-04-20T10:55:03.617 INFO:tasks.workunit.client.1.smithi175.stdout:0/639: chown df/d17/d2f 17656890 1 2024-04-20T10:55:03.618 INFO:tasks.workunit.client.1.smithi175.stdout:6/725: rename d1/d37/d83/db8/d60/ded/d9b to d1/d5/d12/d73/d7a/dee 0 2024-04-20T10:55:03.619 INFO:tasks.workunit.client.1.smithi175.stdout:6/726: creat d1/d37/fef x:0 0 0 2024-04-20T10:55:03.620 INFO:tasks.workunit.client.1.smithi175.stdout:0/640: symlink df/d17/lc8 0 2024-04-20T10:55:03.620 INFO:tasks.workunit.client.1.smithi175.stdout:0/641: readlink df/d1a/d22/d6a/lb1 0 2024-04-20T10:55:03.621 INFO:tasks.workunit.client.1.smithi175.stdout:6/727: truncate d1/d37/d83/db8/d60/d68/d7e/f81 1568749 0 2024-04-20T10:55:03.622 INFO:tasks.workunit.client.1.smithi175.stdout:0/642: getdents df/d1a/d3f 0 2024-04-20T10:55:03.622 INFO:tasks.workunit.client.1.smithi175.stdout:6/728: truncate d1/d37/d83/db8/d60/d6b/f72 2317689 0 2024-04-20T10:55:03.624 INFO:tasks.workunit.client.1.smithi175.stdout:6/729: creat d1/d5/ff0 x:0 0 0 2024-04-20T10:55:03.626 INFO:tasks.workunit.client.1.smithi175.stdout:6/730: creat d1/d37/d83/db8/d60/ded/ff1 x:0 0 0 2024-04-20T10:55:03.629 INFO:tasks.workunit.client.1.smithi175.stdout:5/826: dwrite db/d11/d6d/da1/fb8 [0,4194304] 0 2024-04-20T10:55:03.631 INFO:tasks.workunit.client.1.smithi175.stdout:7/759: dwrite db/d61/d6d/d9c/de8/f96 [0,4194304] 0 2024-04-20T10:55:03.631 INFO:tasks.workunit.client.1.smithi175.stdout:7/760: fsync db/d61/d6d/d9c/de8/d2a/d41/d59/fd1 0 2024-04-20T10:55:03.634 INFO:tasks.workunit.client.1.smithi175.stdout:5/827: rename db/d11/d25/d38/d40/d47/fa9 to db/d11/d25/d41/d60/f116 0 2024-04-20T10:55:03.635 INFO:tasks.workunit.client.1.smithi175.stdout:5/828: mkdir db/d11/dfe/d117 0 2024-04-20T10:55:03.635 INFO:tasks.workunit.client.1.smithi175.stdout:5/829: stat db/dc1/d4f/fac 0 2024-04-20T10:55:03.636 INFO:tasks.workunit.client.1.smithi175.stdout:7/761: dread db/d1d/d39/d50/f52 [0,4194304] 0 2024-04-20T10:55:03.636 INFO:tasks.workunit.client.1.smithi175.stdout:5/830: mknod db/d11/d6d/da1/c118 0 2024-04-20T10:55:03.637 INFO:tasks.workunit.client.1.smithi175.stdout:9/622: dread d6/d1b/d42/d5b/f9c [0,4194304] 0 2024-04-20T10:55:03.638 INFO:tasks.workunit.client.1.smithi175.stdout:5/831: unlink db/d11/d25/d38/d40/d66/l6a 0 2024-04-20T10:55:03.639 INFO:tasks.workunit.client.1.smithi175.stdout:9/623: creat d6/d58/d90/daa/fb7 x:0 0 0 2024-04-20T10:55:03.639 INFO:tasks.workunit.client.1.smithi175.stdout:9/624: stat d6/d1b/d42/d79/l7b 0 2024-04-20T10:55:03.639 INFO:tasks.workunit.client.1.smithi175.stdout:9/625: stat d6/d1b/d2f/cac 0 2024-04-20T10:55:03.639 INFO:tasks.workunit.client.1.smithi175.stdout:0/643: dwrite df/d1a/d28/f43 [0,4194304] 0 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:8/648: sync 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:8/649: truncate d7/d13/d1d/d24/f9c 728748 0 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:2/520: sync 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:2/521: fdatasync d1/d48/d21/d29/f19 0 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:2/522: chown d1/f3 13081983 1 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:3/485: sync 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:3/486: write d7/d21/d16/d22/d2c/d64/f98 [230504,55249] 0 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:4/660: sync 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:1/698: sync 2024-04-20T10:55:03.642 INFO:tasks.workunit.client.1.smithi175.stdout:1/699: fsync d0/f1a 0 2024-04-20T10:55:03.645 INFO:tasks.workunit.client.1.smithi175.stdout:0/644: link df/d1a/d22/d6a/d72/d48/d4e/l9f df/d1a/da1/lc9 0 2024-04-20T10:55:03.645 INFO:tasks.workunit.client.1.smithi175.stdout:5/832: dread db/d11/d25/fea [0,4194304] 0 2024-04-20T10:55:03.645 INFO:tasks.workunit.client.1.smithi175.stdout:5/833: write db/d11/d25/d62/f7c [748668,95960] 0 2024-04-20T10:55:03.647 INFO:tasks.workunit.client.1.smithi175.stdout:8/650: mkdir d7/d13/d1d/d24/d39/d6f/db7/dce 0 2024-04-20T10:55:03.647 INFO:tasks.workunit.client.1.smithi175.stdout:8/651: fdatasync d7/d13/d1d/d24/d38/f77 0 2024-04-20T10:55:03.649 INFO:tasks.workunit.client.1.smithi175.stdout:6/731: getdents d1/d37 0 2024-04-20T10:55:03.650 INFO:tasks.workunit.client.1.smithi175.stdout:2/523: rmdir d1/d7 39 2024-04-20T10:55:03.650 INFO:tasks.workunit.client.1.smithi175.stdout:2/524: read - d1/f57 zero size 2024-04-20T10:55:03.650 INFO:tasks.workunit.client.1.smithi175.stdout:2/525: readlink d1/d48/d21/d76/l2a 0 2024-04-20T10:55:03.651 INFO:tasks.workunit.client.1.smithi175.stdout:3/487: creat d7/d21/d16/d22/d2c/d91/fa1 x:0 0 0 2024-04-20T10:55:03.652 INFO:tasks.workunit.client.1.smithi175.stdout:4/661: truncate d4/f1a 4093446 0 2024-04-20T10:55:03.654 INFO:tasks.workunit.client.1.smithi175.stdout:6/732: dread d1/dc0/d49/fa6 [0,4194304] 0 2024-04-20T10:55:03.654 INFO:tasks.workunit.client.1.smithi175.stdout:1/700: rename d0/d57/db7/lea to d0/d8/dcb/lf2 0 2024-04-20T10:55:03.657 INFO:tasks.workunit.client.1.smithi175.stdout:5/834: creat db/d11/d25/d38/d40/d66/d94/f119 x:0 0 0 2024-04-20T10:55:03.659 INFO:tasks.workunit.client.1.smithi175.stdout:7/762: write db/d61/d6d/d9c/de8/d2a/fa8 [566754,32788] 0 2024-04-20T10:55:03.659 INFO:tasks.workunit.client.1.smithi175.stdout:7/763: fsync db/d61/d6d/dbc/ffb 0 2024-04-20T10:55:03.659 INFO:tasks.workunit.client.1.smithi175.stdout:8/652: creat d7/d13/d1d/d24/d39/d85/fcf x:0 0 0 2024-04-20T10:55:03.659 INFO:tasks.workunit.client.1.smithi175.stdout:8/653: chown d7/d13/d1d/d24/d39/d85/lad 65350 1 2024-04-20T10:55:03.659 INFO:tasks.workunit.client.1.smithi175.stdout:8/654: chown d7/d13/d1d/d24/d38/f77 0 1 2024-04-20T10:55:03.664 INFO:tasks.workunit.client.1.smithi175.stdout:5/835: dread db/dc1/f4d [0,4194304] 0 2024-04-20T10:55:03.664 INFO:tasks.workunit.client.1.smithi175.stdout:0/645: symlink df/d1a/d22/d6a/d72/d48/lca 0 2024-04-20T10:55:03.665 INFO:tasks.workunit.client.1.smithi175.stdout:6/733: dread d1/dc0/d29/f55 [0,4194304] 0 2024-04-20T10:55:03.665 INFO:tasks.workunit.client.1.smithi175.stdout:9/626: dwrite d6/d1b/d42/d5b/d72/d7d/fa8 [0,4194304] 0 2024-04-20T10:55:03.666 INFO:tasks.workunit.client.1.smithi175.stdout:5/836: dread db/d1f/d31/fb0 [0,4194304] 0 2024-04-20T10:55:03.670 INFO:tasks.workunit.client.1.smithi175.stdout:7/764: mkdir db/d1d/d39/d50/dba/daa/df3/d105 0 2024-04-20T10:55:03.670 INFO:tasks.workunit.client.1.smithi175.stdout:3/488: mkdir d7/d19/da2 0 2024-04-20T10:55:03.672 INFO:tasks.workunit.client.1.smithi175.stdout:2/526: dwrite d1/d7/d63/d36/d7d/d84/d8b/fa3 [0,4194304] 0 2024-04-20T10:55:03.672 INFO:tasks.workunit.client.1.smithi175.stdout:2/527: fdatasync d1/d48/d21/d29/f19 0 2024-04-20T10:55:03.675 INFO:tasks.workunit.client.1.smithi175.stdout:4/662: dwrite d4/dd/d54/d5d/d8a/da4/fb5 [0,4194304] 0 2024-04-20T10:55:03.678 INFO:tasks.workunit.client.1.smithi175.stdout:8/655: symlink d7/d13/ld0 0 2024-04-20T10:55:03.679 INFO:tasks.workunit.client.1.smithi175.stdout:7/765: creat db/d61/d6d/d9c/de8/d9a/dd2/dfc/f106 x:0 0 0 2024-04-20T10:55:03.679 INFO:tasks.workunit.client.1.smithi175.stdout:7/766: truncate db/d61/d6d/d9c/de8/f3c 1707557 0 2024-04-20T10:55:03.679 INFO:tasks.workunit.client.1.smithi175.stdout:3/489: getdents d7/d19/d33/d7e 0 2024-04-20T10:55:03.680 INFO:tasks.workunit.client.1.smithi175.stdout:3/490: dread - d7/d19/d33/d60/d50/f9b zero size 2024-04-20T10:55:03.685 INFO:tasks.workunit.client.1.smithi175.stdout:0/646: dwrite df/d1a/d22/d6a/d72/f94 [0,4194304] 0 2024-04-20T10:55:03.686 INFO:tasks.workunit.client.1.smithi175.stdout:6/734: mkdir d1/dc0/df2 0 2024-04-20T10:55:03.688 INFO:tasks.workunit.client.1.smithi175.stdout:5/837: dwrite db/dc1/d4f/fac [0,4194304] 0 2024-04-20T10:55:03.688 INFO:tasks.workunit.client.1.smithi175.stdout:9/627: mknod d6/d1b/d42/cb8 0 2024-04-20T10:55:03.690 INFO:tasks.workunit.client.1.smithi175.stdout:8/656: rename d7/d13/d1d/d24/d39/cab to d7/d13/d1d/d24/d38/d73/cd1 0 2024-04-20T10:55:03.692 INFO:tasks.workunit.client.1.smithi175.stdout:2/528: symlink d1/d7/d63/d4b/lb1 0 2024-04-20T10:55:03.692 INFO:tasks.workunit.client.1.smithi175.stdout:4/663: mknod d4/dd/d2d/d33/d5b/d65/ce8 0 2024-04-20T10:55:03.696 INFO:tasks.workunit.client.1.smithi175.stdout:5/838: unlink db/dc1/lf0 0 2024-04-20T10:55:03.696 INFO:tasks.workunit.client.1.smithi175.stdout:5/839: write db/d30/d46/fe9 [603960,15123] 0 2024-04-20T10:55:03.696 INFO:tasks.workunit.client.1.smithi175.stdout:5/840: stat db/ffc 0 2024-04-20T10:55:03.697 INFO:tasks.workunit.client.1.smithi175.stdout:8/657: symlink d7/d13/d1d/d24/d63/ld2 0 2024-04-20T10:55:03.697 INFO:tasks.workunit.client.1.smithi175.stdout:8/658: stat d7/d13/c70 0 2024-04-20T10:55:03.698 INFO:tasks.workunit.client.1.smithi175.stdout:7/767: mkdir db/d1d/d39/d50/dba/d47/da6/d107 0 2024-04-20T10:55:03.699 INFO:tasks.workunit.client.1.smithi175.stdout:0/647: symlink df/d1a/d22/d6a/d72/lcb 0 2024-04-20T10:55:03.701 INFO:tasks.workunit.client.1.smithi175.stdout:5/841: mkdir db/d11/d6d/d11a 0 2024-04-20T10:55:03.701 INFO:tasks.workunit.client.1.smithi175.stdout:5/842: truncate db/d11/d1a/f76 841000 0 2024-04-20T10:55:03.701 INFO:tasks.workunit.client.1.smithi175.stdout:0/648: dread df/d19/f8a [0,4194304] 0 2024-04-20T10:55:03.701 INFO:tasks.workunit.client.1.smithi175.stdout:0/649: write df/d17/fb6 [2918897,122031] 0 2024-04-20T10:55:03.701 INFO:tasks.workunit.client.1.smithi175.stdout:7/768: truncate db/f66 1366369 0 2024-04-20T10:55:03.701 INFO:tasks.workunit.client.1.smithi175.stdout:7/769: fdatasync db/d1d/d39/d50/dba/d47/da6/fd3 0 2024-04-20T10:55:03.702 INFO:tasks.workunit.client.1.smithi175.stdout:2/529: mknod d1/d48/d21/d29/cb2 0 2024-04-20T10:55:03.704 INFO:tasks.workunit.client.1.smithi175.stdout:3/491: dwrite d7/d19/f6b [0,4194304] 0 2024-04-20T10:55:03.705 INFO:tasks.workunit.client.1.smithi175.stdout:9/628: dread f3 [4194304,4194304] 0 2024-04-20T10:55:03.705 INFO:tasks.workunit.client.1.smithi175.stdout:7/770: mknod db/d1d/c108 0 2024-04-20T10:55:03.707 INFO:tasks.workunit.client.1.smithi175.stdout:4/664: dread d4/dd/f50 [0,4194304] 0 2024-04-20T10:55:03.707 INFO:tasks.workunit.client.1.smithi175.stdout:4/665: truncate d4/d27/f91 377383 0 2024-04-20T10:55:03.707 INFO:tasks.workunit.client.1.smithi175.stdout:2/530: link d1/d7/d63/f79 d1/d7/d63/d36/d7d/d84/d8b/da7/fb3 0 2024-04-20T10:55:03.707 INFO:tasks.workunit.client.1.smithi175.stdout:2/531: chown d1/d48/d21 542904 1 2024-04-20T10:55:03.708 INFO:tasks.workunit.client.1.smithi175.stdout:0/650: mknod df/d1a/d28/ccc 0 2024-04-20T10:55:03.711 INFO:tasks.workunit.client.1.smithi175.stdout:3/492: creat d7/d21/d16/d22/d2c/d64/fa3 x:0 0 0 2024-04-20T10:55:03.713 INFO:tasks.workunit.client.1.smithi175.stdout:9/629: link d6/f16 d6/d1b/d42/d5b/d72/d98/fb9 0 2024-04-20T10:55:03.713 INFO:tasks.workunit.client.1.smithi175.stdout:9/630: fdatasync d6/d33/d60/d78/f7f 0 2024-04-20T10:55:03.713 INFO:tasks.workunit.client.1.smithi175.stdout:9/631: chown d6/d1b/d42/d79/d81 1 1 2024-04-20T10:55:03.713 INFO:tasks.workunit.client.1.smithi175.stdout:9/632: chown d6/fe 203288 1 2024-04-20T10:55:03.714 INFO:tasks.workunit.client.1.smithi175.stdout:4/666: fsync d4/dd/f13 0 2024-04-20T10:55:03.716 INFO:tasks.workunit.client.1.smithi175.stdout:2/532: creat d1/d48/d38/d82/fb4 x:0 0 0 2024-04-20T10:55:03.717 INFO:tasks.workunit.client.1.smithi175.stdout:0/651: mkdir df/d17/d2f/d4f/dcd 0 2024-04-20T10:55:03.717 INFO:tasks.workunit.client.1.smithi175.stdout:0/652: stat df/d1a/d28/f42 0 2024-04-20T10:55:03.719 INFO:tasks.workunit.client.1.smithi175.stdout:3/493: dread d7/d19/d33/d60/f44 [0,4194304] 0 2024-04-20T10:55:03.721 INFO:tasks.workunit.client.1.smithi175.stdout:8/659: dwrite d7/d13/d1d/d56/f96 [0,4194304] 0 2024-04-20T10:55:03.723 INFO:tasks.workunit.client.1.smithi175.stdout:2/533: unlink d1/d6a/d74/l7a 0 2024-04-20T10:55:03.723 INFO:tasks.workunit.client.1.smithi175.stdout:2/534: dread - d1/f91 zero size 2024-04-20T10:55:03.723 INFO:tasks.workunit.client.1.smithi175.stdout:5/843: dwrite db/d11/d1a/f76 [0,4194304] 0 2024-04-20T10:55:03.724 INFO:tasks.workunit.client.1.smithi175.stdout:3/494: truncate d7/d21/d16/d22/d2c/d1f/d48/f6d 2908682 0 2024-04-20T10:55:03.726 INFO:tasks.workunit.client.1.smithi175.stdout:9/633: rename d6/d33/d60/f86 to d6/d33/d63/fba 0 2024-04-20T10:55:03.726 INFO:tasks.workunit.client.1.smithi175.stdout:7/771: read db/d61/d6d/d9c/de8/d8e/f53 [3796130,10793] 0 2024-04-20T10:55:03.728 INFO:tasks.workunit.client.1.smithi175.stdout:8/660: link d7/d13/d1d/f8f d7/d13/d1d/d24/d39/d6f/db7/dce/fd3 0 2024-04-20T10:55:03.728 INFO:tasks.workunit.client.1.smithi175.stdout:8/661: truncate d7/d13/d1d/d24/d38/d73/fa1 717446 0 2024-04-20T10:55:03.728 INFO:tasks.workunit.client.1.smithi175.stdout:7/772: dread db/d61/d6d/d9c/de8/d2a/f4b [0,4194304] 0 2024-04-20T10:55:03.738 INFO:tasks.workunit.client.1.smithi175.stdout:5/844: rmdir db/dc1/d4f/d5a 39 2024-04-20T10:55:03.738 INFO:tasks.workunit.client.1.smithi175.stdout:0/653: dwrite df/f81 [0,4194304] 0 2024-04-20T10:55:03.740 INFO:tasks.workunit.client.1.smithi175.stdout:9/634: unlink d6/f16 0 2024-04-20T10:55:03.741 INFO:tasks.workunit.client.1.smithi175.stdout:6/735: dwrite d1/d5/f39 [4194304,4194304] 0 2024-04-20T10:55:03.996 INFO:tasks.workunit.client.1.smithi175.stdout:8/662: creat d7/d13/d1d/d24/d38/d80/fd4 x:0 0 0 2024-04-20T10:55:03.997 INFO:tasks.workunit.client.1.smithi175.stdout:5/845: creat db/d11/d6d/da1/dcc/d115/f11b x:0 0 0 2024-04-20T10:55:03.997 INFO:tasks.workunit.client.1.smithi175.stdout:2/535: rename d1/d48/d21/d76/c86 to d1/d48/d38/cb5 0 2024-04-20T10:55:03.997 INFO:tasks.workunit.client.1.smithi175.stdout:5/846: write db/d1f/d31/d93/f107 [660901,67047] 0 2024-04-20T10:55:03.997 INFO:tasks.workunit.client.1.smithi175.stdout:2/536: fdatasync d1/d48/d21/d29/f6c 0 2024-04-20T10:55:03.998 INFO:tasks.workunit.client.1.smithi175.stdout:3/495: link d7/d21/d16/d22/d2c/d1f/l6e d7/d19/d33/d60/d50/la4 0 2024-04-20T10:55:03.998 INFO:tasks.workunit.client.1.smithi175.stdout:9/635: truncate d6/d1b/d2f/f64 2387655 0 2024-04-20T10:55:03.998 INFO:tasks.workunit.client.1.smithi175.stdout:9/636: chown d6/d33/c84 3 1 2024-04-20T10:55:04.003 INFO:tasks.workunit.client.1.smithi175.stdout:5/847: symlink db/d11/d25/d41/l11c 0 2024-04-20T10:55:04.004 INFO:tasks.workunit.client.1.smithi175.stdout:0/654: rename df/d1a/d22/d6a/d72/f65 to df/d1a/d28/fce 0 2024-04-20T10:55:04.006 INFO:tasks.workunit.client.1.smithi175.stdout:6/736: mknod d1/d5/d12/d73/cf3 0 2024-04-20T10:55:04.009 INFO:tasks.workunit.client.1.smithi175.stdout:0/655: getdents df/d17 0 2024-04-20T10:55:04.009 INFO:tasks.workunit.client.1.smithi175.stdout:1/701: sync 2024-04-20T10:55:04.009 INFO:tasks.workunit.client.1.smithi175.stdout:1/702: write d0/d8/d13/d2e/f38 [1315642,125952] 0 2024-04-20T10:55:04.009 INFO:tasks.workunit.client.1.smithi175.stdout:1/703: write d0/d8/d13/d2e/f5b [95032,60345] 0 2024-04-20T10:55:04.010 INFO:tasks.workunit.client.1.smithi175.stdout:0/656: truncate df/f38 1581279 0 2024-04-20T10:55:04.011 INFO:tasks.workunit.client.1.smithi175.stdout:1/704: mknod d0/d51/cf3 0 2024-04-20T10:55:04.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/737: mknod d1/dc0/d49/cf4 0 2024-04-20T10:55:04.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/738: truncate d1/d37/f92 4471018 0 2024-04-20T10:55:04.015 INFO:tasks.workunit.client.1.smithi175.stdout:1/705: link d0/l66 d0/lf4 0 2024-04-20T10:55:04.015 INFO:tasks.workunit.client.1.smithi175.stdout:1/706: chown d0/d8/d13/d2e/f5b 348371 1 2024-04-20T10:55:04.015 INFO:tasks.workunit.client.1.smithi175.stdout:2/537: write d1/d48/d21/d76/f42 [969549,66011] 0 2024-04-20T10:55:04.015 INFO:tasks.workunit.client.1.smithi175.stdout:1/707: write d0/d8/d13/d2e/f97 [9072507,12615] 0 2024-04-20T10:55:04.015 INFO:tasks.workunit.client.1.smithi175.stdout:1/708: stat d0/d8/d13/d2e/d35/d8a/d91 0 2024-04-20T10:55:04.016 INFO:tasks.workunit.client.1.smithi175.stdout:2/538: getdents d1/d7/d63/d4b/d8a 0 2024-04-20T10:55:04.016 INFO:tasks.workunit.client.1.smithi175.stdout:2/539: stat d1/d48/d21/d76/faa 0 2024-04-20T10:55:04.017 INFO:tasks.workunit.client.1.smithi175.stdout:5/848: dread db/dc1/f5c [0,4194304] 0 2024-04-20T10:55:04.019 INFO:tasks.workunit.client.1.smithi175.stdout:1/709: read d0/d29/f4f [912806,57371] 0 2024-04-20T10:55:04.020 INFO:tasks.workunit.client.1.smithi175.stdout:1/710: mkdir d0/d57/db7/df5 0 2024-04-20T10:55:04.020 INFO:tasks.workunit.client.1.smithi175.stdout:0/657: read df/d17/d2f/f66 [280063,62762] 0 2024-04-20T10:55:04.023 INFO:tasks.workunit.client.1.smithi175.stdout:6/739: dread d1/d37/d83/db8/d60/fac [0,4194304] 0 2024-04-20T10:55:04.027 INFO:tasks.workunit.client.1.smithi175.stdout:6/740: truncate d1/f18 530114 0 2024-04-20T10:55:04.030 INFO:tasks.workunit.client.1.smithi175.stdout:5/849: read db/dc1/f5c [3291210,48908] 0 2024-04-20T10:55:04.030 INFO:tasks.workunit.client.1.smithi175.stdout:3/496: dwrite d7/d21/d16/d22/d2c/d1f/d48/f61 [0,4194304] 0 2024-04-20T10:55:04.034 INFO:tasks.workunit.client.1.smithi175.stdout:3/497: getdents d7/d21/d16/d22/d2c/d1f 0 2024-04-20T10:55:04.034 INFO:tasks.workunit.client.1.smithi175.stdout:2/540: write d1/f6d [3388965,63274] 0 2024-04-20T10:55:04.034 INFO:tasks.workunit.client.1.smithi175.stdout:2/541: stat d1/d48/d21/d29/fae 0 2024-04-20T10:55:04.034 INFO:tasks.workunit.client.1.smithi175.stdout:2/542: chown d1/d7/d63/d36/f95 0 1 2024-04-20T10:55:04.035 INFO:tasks.workunit.client.1.smithi175.stdout:3/498: read d7/d21/d16/d22/d2c/d64/f98 [190099,53241] 0 2024-04-20T10:55:04.035 INFO:tasks.workunit.client.1.smithi175.stdout:5/850: mknod db/d9d/c11d 0 2024-04-20T10:55:04.035 INFO:tasks.workunit.client.1.smithi175.stdout:5/851: readlink db/d11/d25/d41/l8a 0 2024-04-20T10:55:04.037 INFO:tasks.workunit.client.1.smithi175.stdout:8/663: dwrite d7/d13/d1d/d24/d39/d85/fba [0,4194304] 0 2024-04-20T10:55:04.037 INFO:tasks.workunit.client.1.smithi175.stdout:2/543: mkdir d1/d48/d21/db6 0 2024-04-20T10:55:04.038 INFO:tasks.workunit.client.1.smithi175.stdout:2/544: symlink d1/d48/d21/db6/lb7 0 2024-04-20T10:55:04.040 INFO:tasks.workunit.client.1.smithi175.stdout:5/852: link db/d1f/d31/f109 db/d11/d25/d41/d60/f11e 0 2024-04-20T10:55:04.041 INFO:tasks.workunit.client.1.smithi175.stdout:3/499: dread d7/d21/fd [0,4194304] 0 2024-04-20T10:55:04.041 INFO:tasks.workunit.client.1.smithi175.stdout:3/500: chown d7/d21/d16/d22/d2c/d91/f2b 2 1 2024-04-20T10:55:04.041 INFO:tasks.workunit.client.1.smithi175.stdout:5/853: dread db/d11/d25/d41/d60/fc5 [0,4194304] 0 2024-04-20T10:55:04.042 INFO:tasks.workunit.client.1.smithi175.stdout:2/545: creat d1/d7/d63/d36/d7d/d84/d8b/da7/fb8 x:0 0 0 2024-04-20T10:55:04.042 INFO:tasks.workunit.client.1.smithi175.stdout:2/546: fsync d1/d7/d63/f3e 0 2024-04-20T10:55:04.043 INFO:tasks.workunit.client.1.smithi175.stdout:5/854: getdents db/d11/d25 0 2024-04-20T10:55:04.045 INFO:tasks.workunit.client.1.smithi175.stdout:2/547: link d1/d48/lac d1/d7/d63/d36/d7d/d84/d8b/lb9 0 2024-04-20T10:55:04.046 INFO:tasks.workunit.client.1.smithi175.stdout:5/855: creat db/d11/d25/d38/d40/f11f x:0 0 0 2024-04-20T10:55:04.046 INFO:tasks.workunit.client.1.smithi175.stdout:5/856: dread - db/dc1/f10e zero size 2024-04-20T10:55:04.046 INFO:tasks.workunit.client.1.smithi175.stdout:5/857: chown db/d30/d46/cd3 2986 1 2024-04-20T10:55:04.046 INFO:tasks.workunit.client.1.smithi175.stdout:8/664: write d7/d13/f12 [252176,62944] 0 2024-04-20T10:55:04.047 INFO:tasks.workunit.client.1.smithi175.stdout:8/665: chown d7/d13/d1d/d24/d38/d73 75159571 1 2024-04-20T10:55:04.047 INFO:tasks.workunit.client.1.smithi175.stdout:8/666: stat d7/d13 0 2024-04-20T10:55:04.047 INFO:tasks.workunit.client.1.smithi175.stdout:7/773: dwrite db/d1d/d39/d50/ff [0,4194304] 0 2024-04-20T10:55:04.048 INFO:tasks.workunit.client.1.smithi175.stdout:5/858: dread db/d1f/f95 [0,4194304] 0 2024-04-20T10:55:04.050 INFO:tasks.workunit.client.1.smithi175.stdout:7/774: rename db/d61/d6d/d9c/de8/c45 to db/d1d/d39/de7/c109 0 2024-04-20T10:55:04.051 INFO:tasks.workunit.client.1.smithi175.stdout:7/775: mknod db/d61/d6d/dbc/dc4/c10a 0 2024-04-20T10:55:04.051 INFO:tasks.workunit.client.1.smithi175.stdout:7/776: stat db/d1d/d39/d50/dba/d47/dac/fee 0 2024-04-20T10:55:04.051 INFO:tasks.workunit.client.1.smithi175.stdout:7/777: fsync db/d1d/d39/d50/f52 0 2024-04-20T10:55:04.052 INFO:tasks.workunit.client.1.smithi175.stdout:7/778: creat db/d61/d6d/f10b x:0 0 0 2024-04-20T10:55:04.053 INFO:tasks.workunit.client.1.smithi175.stdout:7/779: symlink db/d61/d6d/dbc/l10c 0 2024-04-20T10:55:04.053 INFO:tasks.workunit.client.1.smithi175.stdout:7/780: chown db/d61/d6d/d9c 0 1 2024-04-20T10:55:04.054 INFO:tasks.workunit.client.1.smithi175.stdout:4/667: write d4/dd/d54/f4a [101126,50214] 0 2024-04-20T10:55:04.055 INFO:tasks.workunit.client.1.smithi175.stdout:7/781: mkdir db/d61/d6d/d9c/de8/d9a/dd2/d10d 0 2024-04-20T10:55:04.058 INFO:tasks.workunit.client.1.smithi175.stdout:7/782: mkdir db/d61/d6d/d9c/de8/d9a/dd2/dfc/d10e 0 2024-04-20T10:55:04.061 INFO:tasks.workunit.client.1.smithi175.stdout:8/667: write d7/d13/d1d/d24/d38/d73/fb4 [2064563,3148] 0 2024-04-20T10:55:04.065 INFO:tasks.workunit.client.1.smithi175.stdout:5/859: dread db/d1f/d31/da0/fc8 [0,4194304] 0 2024-04-20T10:55:04.068 INFO:tasks.workunit.client.1.smithi175.stdout:1/711: truncate d0/d8/d13/d2e/f97 7790220 0 2024-04-20T10:55:04.071 INFO:tasks.workunit.client.1.smithi175.stdout:3/501: dwrite d7/d21/d16/d49/f7c [0,4194304] 0 2024-04-20T10:55:04.074 INFO:tasks.workunit.client.1.smithi175.stdout:3/502: rmdir d7/d19/d33/d7e/d86/d7d 39 2024-04-20T10:55:04.075 INFO:tasks.workunit.client.1.smithi175.stdout:2/548: write d1/d48/d21/d29/f39 [2502930,11419] 0 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:2/549: write d1/d48/d38/d82/fa4 [1940085,93530] 0 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:5/860: dread db/d11/d25/d38/f9e [0,4194304] 0 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:5/861: truncate db/d30/d46/f7e 5347855 0 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:5/862: dread - db/d11/d25/d38/d40/f11f zero size 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:5/863: fdatasync db/d11/f2a 0 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:5/864: chown db/dc1/f5c 3 1 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:5/865: readlink db/d11/d25/d38/d89/lf3 0 2024-04-20T10:55:04.076 INFO:tasks.workunit.client.1.smithi175.stdout:3/503: mkdir d7/d19/d33/d7e/da5 0 2024-04-20T10:55:04.077 INFO:tasks.workunit.client.1.smithi175.stdout:2/550: unlink d1/d7/d63/d36/d7d/ca5 0 2024-04-20T10:55:04.082 INFO:tasks.workunit.client.1.smithi175.stdout:3/504: dread d7/d21/d16/d22/d2c/f92 [0,4194304] 0 2024-04-20T10:55:04.086 INFO:tasks.workunit.client.1.smithi175.stdout:7/783: dwrite db/d61/d6d/d9c/de8/d2a/fa8 [0,4194304] 0 2024-04-20T10:55:04.089 INFO:tasks.workunit.client.1.smithi175.stdout:5/866: dread db/d11/d25/d38/d40/d66/d94/fbb [0,4194304] 0 2024-04-20T10:55:04.090 INFO:tasks.workunit.client.1.smithi175.stdout:5/867: unlink db/d11/d6d/cc7 0 2024-04-20T10:55:04.091 INFO:tasks.workunit.client.1.smithi175.stdout:3/505: dread d7/f14 [0,4194304] 0 2024-04-20T10:55:04.091 INFO:tasks.workunit.client.1.smithi175.stdout:3/506: readlink d7/d21/d16/d22/d2c/d1f/l84 0 2024-04-20T10:55:04.091 INFO:tasks.workunit.client.1.smithi175.stdout:5/868: mknod db/dd7/c120 0 2024-04-20T10:55:04.091 INFO:tasks.workunit.client.1.smithi175.stdout:5/869: stat db/d11/d6d/da1/lbf 0 2024-04-20T10:55:04.092 INFO:tasks.workunit.client.1.smithi175.stdout:5/870: mkdir db/dc1/d4f/d75/d91/d121 0 2024-04-20T10:55:04.093 INFO:tasks.workunit.client.1.smithi175.stdout:3/507: rename d7/c3a to d7/d19/d33/d7e/da5/ca6 0 2024-04-20T10:55:04.093 INFO:tasks.workunit.client.1.smithi175.stdout:3/508: readlink d7/d21/d16/d22/d2c/d1f/l5a 0 2024-04-20T10:55:04.094 INFO:tasks.workunit.client.1.smithi175.stdout:5/871: rename db/d1f/d31/fdc to db/d11/d6d/f122 0 2024-04-20T10:55:04.094 INFO:tasks.workunit.client.1.smithi175.stdout:1/712: dwrite d0/fc2 [0,4194304] 0 2024-04-20T10:55:04.096 INFO:tasks.workunit.client.1.smithi175.stdout:1/713: creat d0/d8/d13/db9/ff6 x:0 0 0 2024-04-20T10:55:04.097 INFO:tasks.workunit.client.1.smithi175.stdout:2/551: dwrite d1/f81 [0,4194304] 0 2024-04-20T10:55:04.097 INFO:tasks.workunit.client.1.smithi175.stdout:2/552: dread - d1/d48/d38/d82/fb4 zero size 2024-04-20T10:55:04.097 INFO:tasks.workunit.client.1.smithi175.stdout:4/668: dwrite d4/d27/f7b [0,4194304] 0 2024-04-20T10:55:04.098 INFO:tasks.workunit.client.1.smithi175.stdout:5/872: rename db/d11/d25/d38/d40/f11f to db/d11/d25/d38/d40/d66/f123 0 2024-04-20T10:55:04.098 INFO:tasks.workunit.client.1.smithi175.stdout:1/714: mknod d0/d57/db7/de9/cf7 0 2024-04-20T10:55:04.099 INFO:tasks.workunit.client.1.smithi175.stdout:5/873: dread db/d1f/d31/d93/f107 [0,4194304] 0 2024-04-20T10:55:04.102 INFO:tasks.workunit.client.1.smithi175.stdout:4/669: getdents d4/d27 0 2024-04-20T10:55:04.102 INFO:tasks.workunit.client.1.smithi175.stdout:4/670: write d4/dd/d54/d5d/d8a/f9c [1411954,55010] 0 2024-04-20T10:55:04.106 INFO:tasks.workunit.client.1.smithi175.stdout:4/671: dread d4/f20 [4194304,4194304] 0 2024-04-20T10:55:04.110 INFO:tasks.workunit.client.1.smithi175.stdout:3/509: dread d7/d21/f11 [0,4194304] 0 2024-04-20T10:55:04.110 INFO:tasks.workunit.client.1.smithi175.stdout:3/510: stat d7/d19 0 2024-04-20T10:55:04.112 INFO:tasks.workunit.client.1.smithi175.stdout:2/553: dread d1/f6d [0,4194304] 0 2024-04-20T10:55:04.112 INFO:tasks.workunit.client.1.smithi175.stdout:5/874: mknod db/dc1/d4f/d75/d91/c124 0 2024-04-20T10:55:04.113 INFO:tasks.workunit.client.1.smithi175.stdout:4/672: getdents d4 0 2024-04-20T10:55:04.114 INFO:tasks.workunit.client.1.smithi175.stdout:3/511: creat d7/d21/d16/d22/d2c/fa7 x:0 0 0 2024-04-20T10:55:04.116 INFO:tasks.workunit.client.1.smithi175.stdout:5/875: creat db/d1f/f125 x:0 0 0 2024-04-20T10:55:04.117 INFO:tasks.workunit.client.1.smithi175.stdout:4/673: creat d4/dd/fe9 x:0 0 0 2024-04-20T10:55:04.117 INFO:tasks.workunit.client.1.smithi175.stdout:4/674: stat d4/dd/d2d/d33/fd9 0 2024-04-20T10:55:04.118 INFO:tasks.workunit.client.1.smithi175.stdout:2/554: rename d1/d7/l2e to d1/d7/lba 0 2024-04-20T10:55:04.121 INFO:tasks.workunit.client.1.smithi175.stdout:5/876: unlink db/d9d/c11d 0 2024-04-20T10:55:04.121 INFO:tasks.workunit.client.1.smithi175.stdout:5/877: readlink db/l15 0 2024-04-20T10:55:04.122 INFO:tasks.workunit.client.1.smithi175.stdout:3/512: mkdir d7/d21/d16/d49/da8 0 2024-04-20T10:55:04.123 INFO:tasks.workunit.client.1.smithi175.stdout:5/878: creat db/dd7/f126 x:0 0 0 2024-04-20T10:55:04.123 INFO:tasks.workunit.client.1.smithi175.stdout:5/879: dread - db/d11/d6d/fe3 zero size 2024-04-20T10:55:04.124 INFO:tasks.workunit.client.1.smithi175.stdout:1/715: dwrite d0/f93 [0,4194304] 0 2024-04-20T10:55:04.125 INFO:tasks.workunit.client.1.smithi175.stdout:4/675: rename d4/dd/d54/d5d/ccd to d4/d27/cea 0 2024-04-20T10:55:04.126 INFO:tasks.workunit.client.1.smithi175.stdout:3/513: rmdir d7 39 2024-04-20T10:55:04.126 INFO:tasks.workunit.client.1.smithi175.stdout:3/514: stat d7/d19/da2 0 2024-04-20T10:55:04.126 INFO:tasks.workunit.client.1.smithi175.stdout:3/515: read - d7/d21/d16/d22/d2c/fa7 zero size 2024-04-20T10:55:04.126 INFO:tasks.workunit.client.1.smithi175.stdout:3/516: readlink d7/d19/d33/d7e/d86/d7d/l82 0 2024-04-20T10:55:04.127 INFO:tasks.workunit.client.1.smithi175.stdout:7/784: write db/d1d/d39/d50/dba/d47/dac/fdd [1095206,97003] 0 2024-04-20T10:55:04.127 INFO:tasks.workunit.client.1.smithi175.stdout:5/880: creat db/dc1/d4f/d75/d91/f127 x:0 0 0 2024-04-20T10:55:04.129 INFO:tasks.workunit.client.1.smithi175.stdout:1/716: creat d0/d8/d13/d75/ff8 x:0 0 0 2024-04-20T10:55:04.130 INFO:tasks.workunit.client.1.smithi175.stdout:3/517: getdents d7/d21/d16/d22/d2c/d64 0 2024-04-20T10:55:04.132 INFO:tasks.workunit.client.1.smithi175.stdout:7/785: truncate db/d1d/d39/d50/dba/d47/f94 2978619 0 2024-04-20T10:55:04.134 INFO:tasks.workunit.client.1.smithi175.stdout:5/881: rename db/d11/d25/d38/d40/d66/d94/lbc to db/d11/d25/d38/d40/d66/d94/l128 0 2024-04-20T10:55:04.135 INFO:tasks.workunit.client.1.smithi175.stdout:1/717: unlink d0/l66 0 2024-04-20T10:55:04.137 INFO:tasks.workunit.client.1.smithi175.stdout:7/786: mknod db/d61/d6d/d9c/de8/d9a/dd2/dfc/d10e/c10f 0 2024-04-20T10:55:04.137 INFO:tasks.workunit.client.1.smithi175.stdout:7/787: fsync db/d61/d6d/d9c/de8/d9a/dd2/dfc/f106 0 2024-04-20T10:55:04.138 INFO:tasks.workunit.client.1.smithi175.stdout:5/882: truncate db/d11/d25/d41/f90 1972174 0 2024-04-20T10:55:04.140 INFO:tasks.workunit.client.1.smithi175.stdout:1/718: link d0/d3e/d61/c98 d0/d8/cf9 0 2024-04-20T10:55:04.142 INFO:tasks.workunit.client.1.smithi175.stdout:1/719: rename d0/d3e/d61/f85 to d0/d8/dcb/ffa 0 2024-04-20T10:55:04.142 INFO:tasks.workunit.client.1.smithi175.stdout:1/720: dread - d0/d8/d13/db9/ff6 zero size 2024-04-20T10:55:04.143 INFO:tasks.workunit.client.1.smithi175.stdout:1/721: link d0/d8/d13/l39 d0/d51/d6b/d9e/de0/lfb 0 2024-04-20T10:55:04.145 INFO:tasks.workunit.client.1.smithi175.stdout:1/722: creat d0/d8/d13/d79/ffc x:0 0 0 2024-04-20T10:55:04.149 INFO:tasks.workunit.client.1.smithi175.stdout:3/518: dwrite d7/d21/d16/d22/f52 [0,4194304] 0 2024-04-20T10:55:04.150 INFO:tasks.workunit.client.1.smithi175.stdout:3/519: read - d7/d19/d33/f9f zero size 2024-04-20T10:55:04.154 INFO:tasks.workunit.client.1.smithi175.stdout:4/676: mknod d4/dd/d2d/d33/d5b/ceb 0 2024-04-20T10:55:04.156 INFO:tasks.workunit.client.1.smithi175.stdout:3/520: dread d7/d21/d16/d22/d2c/d1f/d48/f6d [0,4194304] 0 2024-04-20T10:55:04.156 INFO:tasks.workunit.client.1.smithi175.stdout:3/521: readlink d7/d19/d33/d60/d50/la4 0 2024-04-20T10:55:04.156 INFO:tasks.workunit.client.1.smithi175.stdout:3/522: chown d7/d19/d33 38 1 2024-04-20T10:55:04.160 INFO:tasks.workunit.client.1.smithi175.stdout:4/677: link d4/dd/d54/d5d/f8e d4/dd/d54/d5d/d79/fec 0 2024-04-20T10:55:04.160 INFO:tasks.workunit.client.1.smithi175.stdout:4/678: symlink d4/d23/d2e/da5/led 0 2024-04-20T10:55:04.161 INFO:tasks.workunit.client.1.smithi175.stdout:4/679: mknod d4/dd/d54/d5d/d79/d9d/cee 0 2024-04-20T10:55:04.163 INFO:tasks.workunit.client.1.smithi175.stdout:4/680: creat d4/dd/d54/d5d/d79/d9d/fef x:0 0 0 2024-04-20T10:55:04.163 INFO:tasks.workunit.client.1.smithi175.stdout:8/668: dwrite d7/fa5 [0,4194304] 0 2024-04-20T10:55:04.165 INFO:tasks.workunit.client.1.smithi175.stdout:4/681: unlink d4/dd/d2d/d43/d69/fa8 0 2024-04-20T10:55:04.165 INFO:tasks.workunit.client.1.smithi175.stdout:4/682: readlink d4/d23/d2e/l68 0 2024-04-20T10:55:04.168 INFO:tasks.workunit.client.1.smithi175.stdout:4/683: chown d4/dd/d2d/d33/c4f 231215 1 2024-04-20T10:55:04.168 INFO:tasks.workunit.client.1.smithi175.stdout:4/684: chown d4/d27/d61/f46 552394 1 2024-04-20T10:55:04.173 INFO:tasks.workunit.client.1.smithi175.stdout:3/523: write d7/d19/f6b [699174,94518] 0 2024-04-20T10:55:04.182 INFO:tasks.workunit.client.1.smithi175.stdout:3/524: write d7/d21/d16/d22/d2c/d1f/f5b [2687309,77842] 0 2024-04-20T10:55:04.182 INFO:tasks.workunit.client.1.smithi175.stdout:3/525: dread - d7/d19/f97 zero size 2024-04-20T10:55:04.183 INFO:tasks.workunit.client.1.smithi175.stdout:3/526: truncate d7/d19/d33/d60/d79/d99/f73 1651323 0 2024-04-20T10:55:04.189 INFO:tasks.workunit.client.1.smithi175.stdout:8/669: dwrite d7/d13/d1d/d24/d39/f3b [0,4194304] 0 2024-04-20T10:55:04.190 INFO:tasks.workunit.client.1.smithi175.stdout:4/685: read d4/dd/d2d/d33/d3c/f80 [52323,35319] 0 2024-04-20T10:55:04.190 INFO:tasks.workunit.client.1.smithi175.stdout:1/723: dwrite d0/f8e [0,4194304] 0 2024-04-20T10:55:04.192 INFO:tasks.workunit.client.1.smithi175.stdout:8/670: symlink d7/d13/d1d/d24/d63/ld5 0 2024-04-20T10:55:04.192 INFO:tasks.workunit.client.1.smithi175.stdout:1/724: chown d0/d51/f90 12961037 1 2024-04-20T10:55:04.193 INFO:tasks.workunit.client.1.smithi175.stdout:1/725: symlink d0/d51/d6b/d9e/lfd 0 2024-04-20T10:55:04.194 INFO:tasks.workunit.client.1.smithi175.stdout:1/726: write d0/d8/d13/faa [103689,115824] 0 2024-04-20T10:55:04.194 INFO:tasks.workunit.client.1.smithi175.stdout:1/727: fsync d0/d8/d13/f60 0 2024-04-20T10:55:04.194 INFO:tasks.workunit.client.1.smithi175.stdout:1/728: mkdir d0/d51/da8/dfe 0 2024-04-20T10:55:04.195 INFO:tasks.workunit.client.1.smithi175.stdout:1/729: mknod d0/d57/cff 0 2024-04-20T10:55:04.200 INFO:tasks.workunit.client.1.smithi175.stdout:8/671: read d7/f19 [2317771,70461] 0 2024-04-20T10:55:04.207 INFO:tasks.workunit.client.1.smithi175.stdout:3/527: dwrite d7/d21/f2f [0,4194304] 0 2024-04-20T10:55:04.218 INFO:tasks.workunit.client.1.smithi175.stdout:8/672: dwrite d7/d13/d1d/d24/d26/f7b [0,4194304] 0 2024-04-20T10:55:04.260 INFO:tasks.workunit.client.1.smithi175.stdout:3/528: mknod d7/d19/d33/d7e/d89/ca9 0 2024-04-20T10:55:04.260 INFO:tasks.workunit.client.1.smithi175.stdout:1/730: getdents d0/d3e 0 2024-04-20T10:55:04.261 INFO:tasks.workunit.client.1.smithi175.stdout:3/529: unlink d7/d19/d33/d60/f44 0 2024-04-20T10:55:04.262 INFO:tasks.workunit.client.1.smithi175.stdout:8/673: mkdir d7/d13/d1d/dd6 0 2024-04-20T10:55:04.264 INFO:tasks.workunit.client.1.smithi175.stdout:3/530: readlink d7/d19/l30 0 2024-04-20T10:55:04.264 INFO:tasks.workunit.client.1.smithi175.stdout:3/531: write d7/d21/d16/d22/d2c/f92 [1018559,10702] 0 2024-04-20T10:55:04.264 INFO:tasks.workunit.client.1.smithi175.stdout:3/532: dread - d7/d19/f97 zero size 2024-04-20T10:55:04.267 INFO:tasks.workunit.client.1.smithi175.stdout:1/731: mknod d0/d8/c100 0 2024-04-20T10:55:04.269 INFO:tasks.workunit.client.1.smithi175.stdout:8/674: read d7/d13/f17 [1706730,63895] 0 2024-04-20T10:55:04.270 INFO:tasks.workunit.client.1.smithi175.stdout:3/533: rename d7/d21/d16/d22/d2c/d1f/d48/f6d to d7/d21/d16/d22/faa 0 2024-04-20T10:55:04.270 INFO:tasks.workunit.client.1.smithi175.stdout:8/675: symlink d7/d13/d1d/d24/d39/d6f/db7/ld7 0 2024-04-20T10:55:04.272 INFO:tasks.workunit.client.1.smithi175.stdout:8/676: rmdir d7/d13/d1d/d24/d39 39 2024-04-20T10:55:04.273 INFO:tasks.workunit.client.1.smithi175.stdout:3/534: rename d7/d21/d16/d22/d2c/d91/f87 to d7/d19/d33/d60/d79/d99/fab 0 2024-04-20T10:55:04.273 INFO:tasks.workunit.client.1.smithi175.stdout:3/535: write d7/d21/d16/d22/d2c/f3c [5958840,14422] 0 2024-04-20T10:55:04.274 INFO:tasks.workunit.client.1.smithi175.stdout:8/677: creat d7/d13/d1d/d92/d6c/fd8 x:0 0 0 2024-04-20T10:55:04.274 INFO:tasks.workunit.client.1.smithi175.stdout:3/536: rmdir d7/d10/d8c 39 2024-04-20T10:55:04.287 INFO:tasks.workunit.client.1.smithi175.stdout:1/732: dwrite d0/fc2 [0,4194304] 0 2024-04-20T10:55:04.289 INFO:tasks.workunit.client.1.smithi175.stdout:1/733: creat d0/d8/d13/d7b/f101 x:0 0 0 2024-04-20T10:55:04.290 INFO:tasks.workunit.client.1.smithi175.stdout:1/734: truncate d0/d8/d13/d75/fa1 1742516 0 2024-04-20T10:55:04.291 INFO:tasks.workunit.client.1.smithi175.stdout:1/735: mkdir d0/d102 0 2024-04-20T10:55:04.292 INFO:tasks.workunit.client.1.smithi175.stdout:1/736: creat d0/d57/db7/de9/f103 x:0 0 0 2024-04-20T10:55:04.293 INFO:tasks.workunit.client.1.smithi175.stdout:8/678: dwrite d7/d13/d1d/d92/d6c/f97 [0,4194304] 0 2024-04-20T10:55:04.293 INFO:tasks.workunit.client.1.smithi175.stdout:1/737: mkdir d0/d8/d13/d2e/d35/d8a/d104 0 2024-04-20T10:55:04.294 INFO:tasks.workunit.client.1.smithi175.stdout:8/679: mkdir d7/d13/d1d/d24/d63/dd9 0 2024-04-20T10:55:04.296 INFO:tasks.workunit.client.1.smithi175.stdout:8/680: rename d7/fb3 to d7/d13/d1d/d24/d39/d6f/db7/dbc/fda 0 2024-04-20T10:55:04.297 INFO:tasks.workunit.client.1.smithi175.stdout:8/681: read - d7/d13/d1d/d24/d39/fbf zero size 2024-04-20T10:55:04.303 INFO:tasks.workunit.client.1.smithi175.stdout:1/738: write d0/d8/f7e [721576,4182] 0 2024-04-20T10:55:04.303 INFO:tasks.workunit.client.1.smithi175.stdout:1/739: chown d0/d51/d6b 65403 1 2024-04-20T10:55:04.304 INFO:tasks.workunit.client.1.smithi175.stdout:1/740: mkdir d0/d57/db7/df5/d105 0 2024-04-20T10:55:04.304 INFO:tasks.workunit.client.1.smithi175.stdout:1/741: chown d0/d8/d13/d2e/d35/d8a/d91/f95 23287 1 2024-04-20T10:55:04.318 INFO:tasks.workunit.client.1.smithi175.stdout:8/682: dwrite d7/d13/d1d/d92/d6c/fd8 [0,4194304] 0 2024-04-20T10:55:04.320 INFO:tasks.workunit.client.1.smithi175.stdout:1/742: dwrite d0/d3e/d61/f70 [0,4194304] 0 2024-04-20T10:55:04.320 INFO:tasks.workunit.client.1.smithi175.stdout:1/743: chown d0/d8/d13/d2e/d35/la4 8979977 1 2024-04-20T10:55:04.322 INFO:tasks.workunit.client.1.smithi175.stdout:1/744: creat d0/d51/d6b/d9e/f106 x:0 0 0 2024-04-20T10:55:04.341 INFO:tasks.workunit.client.1.smithi175.stdout:5/883: dread db/d1f/d31/fec [0,4194304] 0 2024-04-20T10:55:04.342 INFO:tasks.workunit.client.1.smithi175.stdout:5/884: creat db/d11/d25/d38/d40/d66/d94/dfb/f129 x:0 0 0 2024-04-20T10:55:04.342 INFO:tasks.workunit.client.1.smithi175.stdout:5/885: mknod db/d1f/c12a 0 2024-04-20T10:55:04.344 INFO:tasks.workunit.client.1.smithi175.stdout:8/683: dwrite d7/d13/f17 [0,4194304] 0 2024-04-20T10:55:04.349 INFO:tasks.workunit.client.1.smithi175.stdout:8/684: read d7/d13/f50 [406434,83421] 0 2024-04-20T10:55:04.349 INFO:tasks.workunit.client.1.smithi175.stdout:1/745: dwrite d0/d8/f18 [0,4194304] 0 2024-04-20T10:55:04.349 INFO:tasks.workunit.client.1.smithi175.stdout:1/746: chown d0/d8/d13/d2e/d35/d8a/d91 2730393 1 2024-04-20T10:55:04.350 INFO:tasks.workunit.client.1.smithi175.stdout:1/747: rename d0/d57/db7/de9 to d0/d51/d6b/d9e/de0/d107 0 2024-04-20T10:55:04.352 INFO:tasks.workunit.client.1.smithi175.stdout:4/686: dread d4/dd/d54/d5d/d9e/f64 [0,4194304] 0 2024-04-20T10:55:04.352 INFO:tasks.workunit.client.1.smithi175.stdout:1/748: truncate d0/d8/f5e 2413523 0 2024-04-20T10:55:04.354 INFO:tasks.workunit.client.1.smithi175.stdout:1/749: truncate d0/d8/d13/d2e/f46 1274514 0 2024-04-20T10:55:04.356 INFO:tasks.workunit.client.1.smithi175.stdout:1/750: rename d0/d8/d13/d79/d8c/l9a to d0/d3e/d61/d73/l108 0 2024-04-20T10:55:04.360 INFO:tasks.workunit.client.1.smithi175.stdout:1/751: rename d0/d3e/d61/c89 to d0/d8/d13/d2e/d35/d8a/d104/c109 0 2024-04-20T10:55:04.362 INFO:tasks.workunit.client.1.smithi175.stdout:1/752: mkdir d0/d57/db7/df5/d10a 0 2024-04-20T10:55:04.362 INFO:tasks.workunit.client.1.smithi175.stdout:1/753: write d0/d8/d13/d7b/fd5 [2363949,42371] 0 2024-04-20T10:55:04.362 INFO:tasks.workunit.client.1.smithi175.stdout:1/754: stat d0/d8/lc 0 2024-04-20T10:55:04.362 INFO:tasks.workunit.client.1.smithi175.stdout:1/755: write d0/d3e/fd7 [142086,127360] 0 2024-04-20T10:55:04.362 INFO:tasks.workunit.client.1.smithi175.stdout:1/756: write d0/d8/f30 [3190670,117223] 0 2024-04-20T10:55:04.363 INFO:tasks.workunit.client.1.smithi175.stdout:1/757: chown d0/d8/d13/fbb 572625 1 2024-04-20T10:55:04.363 INFO:tasks.workunit.client.1.smithi175.stdout:4/687: dread d4/dd/d5e/f6b [0,4194304] 0 2024-04-20T10:55:04.363 INFO:tasks.workunit.client.1.smithi175.stdout:4/688: dread - d4/dd/d2d/d33/d3c/d44/fc8 zero size 2024-04-20T10:55:04.364 INFO:tasks.workunit.client.1.smithi175.stdout:4/689: mknod d4/d27/d8c/cf0 0 2024-04-20T10:55:04.366 INFO:tasks.workunit.client.1.smithi175.stdout:4/690: creat d4/d23/ff1 x:0 0 0 2024-04-20T10:55:04.368 INFO:tasks.workunit.client.1.smithi175.stdout:4/691: symlink d4/dd/d54/d5f/lf2 0 2024-04-20T10:55:04.377 INFO:tasks.workunit.client.1.smithi175.stdout:5/886: dwrite db/d11/d25/d38/d40/d66/f8c [0,4194304] 0 2024-04-20T10:55:04.377 INFO:tasks.workunit.client.1.smithi175.stdout:5/887: fdatasync db/d11/d6d/da1/ff8 0 2024-04-20T10:55:04.377 INFO:tasks.workunit.client.1.smithi175.stdout:8/685: dwrite d7/d13/d1d/d24/d63/f9f [0,4194304] 0 2024-04-20T10:55:04.379 INFO:tasks.workunit.client.1.smithi175.stdout:5/888: creat db/d11/d6d/da1/f12b x:0 0 0 2024-04-20T10:55:04.379 INFO:tasks.workunit.client.1.smithi175.stdout:5/889: chown db/d30/d46/fba 7 1 2024-04-20T10:55:04.381 INFO:tasks.workunit.client.1.smithi175.stdout:8/686: truncate d7/d13/d1d/d24/d38/d73/fa6 2914166 0 2024-04-20T10:55:04.381 INFO:tasks.workunit.client.1.smithi175.stdout:5/890: dread db/d1f/d31/fb0 [0,4194304] 0 2024-04-20T10:55:04.382 INFO:tasks.workunit.client.1.smithi175.stdout:5/891: rename db/d11/d25/c81 to db/d11/d6d/da1/dcc/c12c 0 2024-04-20T10:55:04.384 INFO:tasks.workunit.client.1.smithi175.stdout:4/692: dwrite d4/dd/d54/d5d/d9e/f77 [0,4194304] 0 2024-04-20T10:55:04.384 INFO:tasks.workunit.client.1.smithi175.stdout:4/693: chown d4/dd/d54/d5d/d79 103081 1 2024-04-20T10:55:04.384 INFO:tasks.workunit.client.1.smithi175.stdout:4/694: readlink d4/d27/l37 0 2024-04-20T10:55:04.386 INFO:tasks.workunit.client.1.smithi175.stdout:4/695: creat d4/dd/d5e/ff3 x:0 0 0 2024-04-20T10:55:04.389 INFO:tasks.workunit.client.1.smithi175.stdout:4/696: dread d4/dd/d54/d5d/d8a/f9c [0,4194304] 0 2024-04-20T10:55:04.389 INFO:tasks.workunit.client.1.smithi175.stdout:4/697: dread - d4/dd/d54/d5d/d8a/fde zero size 2024-04-20T10:55:04.394 INFO:tasks.workunit.client.1.smithi175.stdout:8/687: dread d7/d13/d1d/d24/d38/f8d [0,4194304] 0 2024-04-20T10:55:04.395 INFO:tasks.workunit.client.1.smithi175.stdout:5/892: write db/d9d/f44 [3653434,130201] 0 2024-04-20T10:55:04.395 INFO:tasks.workunit.client.1.smithi175.stdout:5/893: chown db/d11/d25/d38/d40/d66/d94/dfb/c10c 693 1 2024-04-20T10:55:04.404 INFO:tasks.workunit.client.1.smithi175.stdout:8/688: write d7/d13/d1d/f88 [3018360,46142] 0 2024-04-20T10:55:04.405 INFO:tasks.workunit.client.1.smithi175.stdout:8/689: mkdir d7/d13/d1d/d24/d38/d73/db5/ddb 0 2024-04-20T10:55:04.405 INFO:tasks.workunit.client.1.smithi175.stdout:8/690: rmdir d7/d13/d1d/d24/d39/d6f/db7/dce 39 2024-04-20T10:55:04.406 INFO:tasks.workunit.client.1.smithi175.stdout:8/691: creat d7/d13/d1d/d24/d38/d73/db5/dcc/fdc x:0 0 0 2024-04-20T10:55:04.407 INFO:tasks.workunit.client.1.smithi175.stdout:8/692: symlink d7/d13/d1d/d24/d38/d73/db5/ldd 0 2024-04-20T10:55:04.407 INFO:tasks.workunit.client.1.smithi175.stdout:8/693: creat d7/d13/d1d/fde x:0 0 0 2024-04-20T10:55:04.413 INFO:tasks.workunit.client.1.smithi175.stdout:4/698: dwrite d4/dd/d54/f5a [4194304,4194304] 0 2024-04-20T10:55:04.413 INFO:tasks.workunit.client.1.smithi175.stdout:4/699: chown d4/dd/d54/d5d/d79/d9d/cee 22468524 1 2024-04-20T10:55:04.413 INFO:tasks.workunit.client.1.smithi175.stdout:4/700: write d4/dd/d2d/d33/d3c/d44/fc8 [318824,96365] 0 2024-04-20T10:55:04.414 INFO:tasks.workunit.client.1.smithi175.stdout:9/637: sync 2024-04-20T10:55:04.414 INFO:tasks.workunit.client.1.smithi175.stdout:6/741: sync 2024-04-20T10:55:04.414 INFO:tasks.workunit.client.1.smithi175.stdout:0/658: sync 2024-04-20T10:55:04.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/659: fdatasync df/d17/d2f/f36 0 2024-04-20T10:55:04.415 INFO:tasks.workunit.client.1.smithi175.stdout:0/660: write df/fac [442089,78858] 0 2024-04-20T10:55:04.416 INFO:tasks.workunit.client.1.smithi175.stdout:6/742: chown d1/d37/d83/db8/d60/c65 95030 1 2024-04-20T10:55:04.416 INFO:tasks.workunit.client.1.smithi175.stdout:6/743: chown d1/d37/d83 7422224 1 2024-04-20T10:55:04.416 INFO:tasks.workunit.client.1.smithi175.stdout:6/744: truncate d1/d5/d12/d73/d7a/dee/fa0 372883 0 2024-04-20T10:55:04.417 INFO:tasks.workunit.client.1.smithi175.stdout:9/638: mknod d6/d1b/d42/d5b/d72/d7d/dae/cbb 0 2024-04-20T10:55:04.418 INFO:tasks.workunit.client.1.smithi175.stdout:9/639: creat d6/d10/fbc x:0 0 0 2024-04-20T10:55:04.419 INFO:tasks.workunit.client.1.smithi175.stdout:6/745: dread d1/dc0/d49/fa6 [0,4194304] 0 2024-04-20T10:55:04.420 INFO:tasks.workunit.client.1.smithi175.stdout:9/640: mkdir d6/d58/d90/daa/dbd 0 2024-04-20T10:55:04.423 INFO:tasks.workunit.client.1.smithi175.stdout:6/746: creat d1/d37/d83/db8/d60/ff5 x:0 0 0 2024-04-20T10:55:04.427 INFO:tasks.workunit.client.1.smithi175.stdout:9/641: creat d6/d1b/d42/d5b/d72/d9e/fbe x:0 0 0 2024-04-20T10:55:04.429 INFO:tasks.workunit.client.1.smithi175.stdout:9/642: getdents d6/d1b/d42/d51 0 2024-04-20T10:55:04.431 INFO:tasks.workunit.client.1.smithi175.stdout:9/643: mkdir d6/d1b/d42/d5b/d72/d7d/dae/dbf 0 2024-04-20T10:55:04.438 INFO:tasks.workunit.client.1.smithi175.stdout:4/701: dwrite d4/f31 [0,4194304] 0 2024-04-20T10:55:04.442 INFO:tasks.workunit.client.1.smithi175.stdout:4/702: creat d4/d23/ff4 x:0 0 0 2024-04-20T10:55:04.443 INFO:tasks.workunit.client.1.smithi175.stdout:4/703: chown d4/dd/d2d/d33/d3c/d44/c81 456 1 2024-04-20T10:55:04.445 INFO:tasks.workunit.client.1.smithi175.stdout:4/704: creat d4/dd/d2d/d33/d58/d67/ff5 x:0 0 0 2024-04-20T10:55:04.456 INFO:tasks.workunit.client.1.smithi175.stdout:4/705: dread d4/dd/f11 [0,4194304] 0 2024-04-20T10:55:04.457 INFO:tasks.workunit.client.1.smithi175.stdout:4/706: write d4/dd/d5e/f6b [808267,10678] 0 2024-04-20T10:55:04.457 INFO:tasks.workunit.client.1.smithi175.stdout:4/707: getdents d4/d23/d2e/da5 0 2024-04-20T10:55:04.457 INFO:tasks.workunit.client.1.smithi175.stdout:4/708: fsync d4/dd/d54/d5d/d9e/f86 0 2024-04-20T10:55:04.458 INFO:tasks.workunit.client.1.smithi175.stdout:4/709: chown d4/dd/d2d/d33/d5b/d65/ce8 3 1 2024-04-20T10:55:04.461 INFO:tasks.workunit.client.1.smithi175.stdout:4/710: readlink d4/dd/d54/d5f/l66 0 2024-04-20T10:55:04.461 INFO:tasks.workunit.client.1.smithi175.stdout:4/711: chown d4/dd/d54/d5d/ce0 1204243 1 2024-04-20T10:55:04.466 INFO:tasks.workunit.client.1.smithi175.stdout:4/712: dread d4/d27/d61/f42 [0,4194304] 0 2024-04-20T10:55:04.467 INFO:tasks.workunit.client.1.smithi175.stdout:4/713: rmdir d4/dd/d54/d5d/d9e 39 2024-04-20T10:55:04.469 INFO:tasks.workunit.client.1.smithi175.stdout:4/714: stat d4/dd/d2d/d33/d5b/d65/cb9 0 2024-04-20T10:55:04.469 INFO:tasks.workunit.client.1.smithi175.stdout:6/747: write d1/d5/f10 [1303752,90992] 0 2024-04-20T10:55:04.469 INFO:tasks.workunit.client.1.smithi175.stdout:6/748: write d1/d5/d12/fd8 [762990,40641] 0 2024-04-20T10:55:04.471 INFO:tasks.workunit.client.1.smithi175.stdout:6/749: mknod d1/cf6 0 2024-04-20T10:55:04.478 INFO:tasks.workunit.client.1.smithi175.stdout:4/715: dread d4/f38 [0,4194304] 0 2024-04-20T10:55:04.494 INFO:tasks.workunit.client.1.smithi175.stdout:4/716: dwrite d4/f1f [0,4194304] 0 2024-04-20T10:55:04.494 INFO:tasks.workunit.client.1.smithi175.stdout:4/717: creat d4/dd/d54/d5d/d79/d9d/dd4/ff6 x:0 0 0 2024-04-20T10:55:04.495 INFO:tasks.workunit.client.1.smithi175.stdout:4/718: creat d4/dd/d54/d5d/d79/ff7 x:0 0 0 2024-04-20T10:55:04.495 INFO:tasks.workunit.client.1.smithi175.stdout:4/719: rmdir d4/dd/d54/d5f 39 2024-04-20T10:55:04.496 INFO:tasks.workunit.client.1.smithi175.stdout:4/720: truncate d4/dd/d54/d5d/d9e/f29 312858 0 2024-04-20T10:55:04.497 INFO:tasks.workunit.client.1.smithi175.stdout:4/721: symlink d4/dd/d2d/d33/d3c/de5/lf8 0 2024-04-20T10:55:04.499 INFO:tasks.workunit.client.1.smithi175.stdout:2/555: sync 2024-04-20T10:55:04.507 INFO:tasks.workunit.client.1.smithi175.stdout:2/556: write d1/d7/f72 [634533,28835] 0 2024-04-20T10:55:04.518 INFO:tasks.workunit.client.1.smithi175.stdout:4/722: dwrite d4/f9 [0,4194304] 0 2024-04-20T10:55:04.520 INFO:tasks.workunit.client.1.smithi175.stdout:4/723: fsync d4/d27/f14 0 2024-04-20T10:55:04.520 INFO:tasks.workunit.client.1.smithi175.stdout:4/724: chown d4/d27/f17 7680 1 2024-04-20T10:55:04.525 INFO:tasks.workunit.client.1.smithi175.stdout:4/725: dread d4/dd/d54/d5d/d9e/f29 [0,4194304] 0 2024-04-20T10:55:04.533 INFO:tasks.workunit.client.1.smithi175.stdout:4/726: dread d4/dd/d54/f5a [0,4194304] 0 2024-04-20T10:55:04.534 INFO:tasks.workunit.client.1.smithi175.stdout:2/557: write d1/d7/d63/f26 [1938423,81504] 0 2024-04-20T10:55:04.535 INFO:tasks.workunit.client.1.smithi175.stdout:2/558: stat d1/f6 0 2024-04-20T10:55:04.537 INFO:tasks.workunit.client.1.smithi175.stdout:2/559: unlink d1/f91 0 2024-04-20T10:55:04.537 INFO:tasks.workunit.client.1.smithi175.stdout:2/560: stat d1/d7/d63/d4b/d8a/l98 0 2024-04-20T10:55:04.537 INFO:tasks.workunit.client.1.smithi175.stdout:2/561: stat d1/fad 0 2024-04-20T10:55:04.537 INFO:tasks.workunit.client.1.smithi175.stdout:2/562: write d1/d48/f3b [3050351,84455] 0 2024-04-20T10:55:04.538 INFO:tasks.workunit.client.1.smithi175.stdout:2/563: creat d1/d7/d63/d36/d7d/fbb x:0 0 0 2024-04-20T10:55:04.539 INFO:tasks.workunit.client.1.smithi175.stdout:2/564: creat d1/d48/d21/d76/da8/fbc x:0 0 0 2024-04-20T10:55:04.540 INFO:tasks.workunit.client.1.smithi175.stdout:2/565: creat d1/d7/d63/d36/d7d/d80/fbd x:0 0 0 2024-04-20T10:55:04.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/566: dread d1/d7/f34 [0,4194304] 0 2024-04-20T10:55:04.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/567: write d1/d7/d63/d36/d7d/f8e [592906,36573] 0 2024-04-20T10:55:04.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/568: dread - d1/d7/d63/d36/d7d/fbb zero size 2024-04-20T10:55:04.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/569: write d1/d48/d38/d82/fb4 [178140,89237] 0 2024-04-20T10:55:04.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/570: fdatasync d1/f40 0 2024-04-20T10:55:04.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/571: write d1/fad [668461,88573] 0 2024-04-20T10:55:04.551 INFO:tasks.workunit.client.1.smithi175.stdout:2/572: mknod d1/d48/cbe 0 2024-04-20T10:55:04.551 INFO:tasks.workunit.client.1.smithi175.stdout:4/727: dwrite d4/dd/d2d/d33/d3c/f80 [0,4194304] 0 2024-04-20T10:55:04.552 INFO:tasks.workunit.client.1.smithi175.stdout:2/573: mknod d1/d48/d21/db6/cbf 0 2024-04-20T10:55:04.552 INFO:tasks.workunit.client.1.smithi175.stdout:2/574: chown d1/d6a/d74 6555 1 2024-04-20T10:55:04.552 INFO:tasks.workunit.client.1.smithi175.stdout:2/575: write d1/d7/d63/f26 [3602168,109709] 0 2024-04-20T10:55:04.554 INFO:tasks.workunit.client.1.smithi175.stdout:4/728: mkdir d4/d27/df9 0 2024-04-20T10:55:04.577 INFO:tasks.workunit.client.1.smithi175.stdout:2/576: dwrite d1/d7/d63/d36/d7d/d80/fbd [0,4194304] 0 2024-04-20T10:55:04.577 INFO:tasks.workunit.client.1.smithi175.stdout:2/577: read d1/d48/f3b [375778,90939] 0 2024-04-20T10:55:04.577 INFO:tasks.workunit.client.1.smithi175.stdout:4/729: dwrite d4/dd/d2d/d33/d5b/d65/fdd [0,4194304] 0 2024-04-20T10:55:04.578 INFO:tasks.workunit.client.1.smithi175.stdout:4/730: getdents d4/d23/d2e/da5/ddf 0 2024-04-20T10:55:04.578 INFO:tasks.workunit.client.1.smithi175.stdout:4/731: readlink d4/dd/d54/d5f/lf2 0 2024-04-20T10:55:04.579 INFO:tasks.workunit.client.1.smithi175.stdout:4/732: dread d4/dd/d54/f7e [0,4194304] 0 2024-04-20T10:55:04.580 INFO:tasks.workunit.client.1.smithi175.stdout:2/578: rename d1/d53/f97 to d1/d53/fc0 0 2024-04-20T10:55:04.588 INFO:tasks.workunit.client.1.smithi175.stdout:4/733: write d4/d23/f32 [3681671,106377] 0 2024-04-20T10:55:04.597 INFO:tasks.workunit.client.1.smithi175.stdout:4/734: dread d4/d27/f7b [0,4194304] 0 2024-04-20T10:55:04.597 INFO:tasks.workunit.client.1.smithi175.stdout:4/735: truncate d4/dd/d2d/d43/d69/fd0 252991 0 2024-04-20T10:55:04.597 INFO:tasks.workunit.client.1.smithi175.stdout:4/736: fsync d4/dd/d2d/d43/d69/fd0 0 2024-04-20T10:55:04.599 INFO:tasks.workunit.client.1.smithi175.stdout:4/737: rename d4/dd/d54/f3f to d4/dd/d2d/d33/d58/ffa 0 2024-04-20T10:55:04.599 INFO:tasks.workunit.client.1.smithi175.stdout:4/738: chown d4/d23/d2e/da5/led 0 1 2024-04-20T10:55:04.599 INFO:tasks.workunit.client.1.smithi175.stdout:2/579: dwrite d1/d7/d63/d36/d7d/f8e [0,4194304] 0 2024-04-20T10:55:04.601 INFO:tasks.workunit.client.1.smithi175.stdout:2/580: getdents d1/d53 0 2024-04-20T10:55:04.602 INFO:tasks.workunit.client.1.smithi175.stdout:4/739: dread d4/d27/d61/f46 [0,4194304] 0 2024-04-20T10:55:04.602 INFO:tasks.workunit.client.1.smithi175.stdout:2/581: mkdir d1/d48/d21/db6/dc1 0 2024-04-20T10:55:04.602 INFO:tasks.workunit.client.1.smithi175.stdout:2/582: truncate d1/d48/d21/d29/fae 4977800 0 2024-04-20T10:55:04.603 INFO:tasks.workunit.client.1.smithi175.stdout:4/740: rmdir d4/dd/d2d/d43/d69/d83 39 2024-04-20T10:55:04.603 INFO:tasks.workunit.client.1.smithi175.stdout:4/741: fdatasync d4/dd/d54/d5d/d9e/f64 0 2024-04-20T10:55:04.604 INFO:tasks.workunit.client.1.smithi175.stdout:2/583: truncate d1/d53/fc0 3854007 0 2024-04-20T10:55:04.604 INFO:tasks.workunit.client.1.smithi175.stdout:2/584: rename d1/d48/d21/d76/da8 to d1/d48/d21/d76/da8/dc2 22 2024-04-20T10:55:04.606 INFO:tasks.workunit.client.1.smithi175.stdout:2/585: rename d1/d7/d63/d36/d7d/f8f to d1/d7/d63/d36/d7d/d84/d8b/d99/fc3 0 2024-04-20T10:55:04.606 INFO:tasks.workunit.client.1.smithi175.stdout:2/586: write d1/d7/f34 [4733395,14645] 0 2024-04-20T10:55:04.608 INFO:tasks.workunit.client.1.smithi175.stdout:2/587: rename d1/d7/d63/d36/d7d/d84/d8b/fa3 to d1/d48/d21/d76/da8/fc4 0 2024-04-20T10:55:04.611 INFO:tasks.workunit.client.1.smithi175.stdout:4/742: dread d4/dd/d2d/d33/d3c/fa9 [0,4194304] 0 2024-04-20T10:55:04.612 INFO:tasks.workunit.client.1.smithi175.stdout:4/743: creat d4/ffb x:0 0 0 2024-04-20T10:55:04.614 INFO:tasks.workunit.client.1.smithi175.stdout:4/744: dread d4/dd/d54/d5d/d79/fec [0,4194304] 0 2024-04-20T10:55:04.617 INFO:tasks.workunit.client.1.smithi175.stdout:4/745: symlink d4/d23/d2e/lfc 0 2024-04-20T10:55:04.617 INFO:tasks.workunit.client.1.smithi175.stdout:4/746: fdatasync d4/d23/f95 0 2024-04-20T10:55:04.617 INFO:tasks.workunit.client.1.smithi175.stdout:4/747: chown d4/dd/d2d/d33/fd9 5131811 1 2024-04-20T10:55:04.617 INFO:tasks.workunit.client.1.smithi175.stdout:4/748: readlink d4/d27/l37 0 2024-04-20T10:55:04.617 INFO:tasks.workunit.client.1.smithi175.stdout:4/749: readlink d4/dd/d54/d5f/l94 0 2024-04-20T10:55:04.617 INFO:tasks.workunit.client.1.smithi175.stdout:2/588: write d1/f96 [3205548,52982] 0 2024-04-20T10:55:04.618 INFO:tasks.workunit.client.1.smithi175.stdout:2/589: write d1/fad [131882,7907] 0 2024-04-20T10:55:04.618 INFO:tasks.workunit.client.1.smithi175.stdout:4/750: unlink d4/dd/d2d/d33/d3c/c8f 0 2024-04-20T10:55:04.618 INFO:tasks.workunit.client.1.smithi175.stdout:2/590: creat d1/d6a/fc5 x:0 0 0 2024-04-20T10:55:04.625 INFO:tasks.workunit.client.1.smithi175.stdout:3/537: sync 2024-04-20T10:55:04.625 INFO:tasks.workunit.client.1.smithi175.stdout:7/788: sync 2024-04-20T10:55:04.625 INFO:tasks.workunit.client.1.smithi175.stdout:3/538: write d7/d21/d16/d49/f7c [4536654,113209] 0 2024-04-20T10:55:04.626 INFO:tasks.workunit.client.1.smithi175.stdout:3/539: truncate d7/d21/f11 3739346 0 2024-04-20T10:55:04.643 INFO:tasks.workunit.client.1.smithi175.stdout:2/591: dwrite d1/d48/f27 [0,4194304] 0 2024-04-20T10:55:04.643 INFO:tasks.workunit.client.1.smithi175.stdout:2/592: chown d1/d48/d38/cab 79140 1 2024-04-20T10:55:04.644 INFO:tasks.workunit.client.1.smithi175.stdout:4/751: dwrite d4/dd/d54/f7e [0,4194304] 0 2024-04-20T10:55:04.644 INFO:tasks.workunit.client.1.smithi175.stdout:4/752: stat d4/dd/d54/d5d/d9e/fa0 0 2024-04-20T10:55:04.647 INFO:tasks.workunit.client.1.smithi175.stdout:4/753: creat d4/dd/d2d/d33/d3c/d44/ffd x:0 0 0 2024-04-20T10:55:04.647 INFO:tasks.workunit.client.1.smithi175.stdout:4/754: chown d4/dd/d2d/d43/d69/daa 4 1 2024-04-20T10:55:04.648 INFO:tasks.workunit.client.1.smithi175.stdout:2/593: mkdir d1/d48/d21/d29/dc6 0 2024-04-20T10:55:04.648 INFO:tasks.workunit.client.1.smithi175.stdout:2/594: fdatasync d1/d48/d21/d29/f50 0 2024-04-20T10:55:04.651 INFO:tasks.workunit.client.1.smithi175.stdout:7/789: dwrite db/d61/d6d/d9c/de8/d2a/f86 [0,4194304] 0 2024-04-20T10:55:04.652 INFO:tasks.workunit.client.1.smithi175.stdout:3/540: dwrite d7/d10/f4a [0,4194304] 0 2024-04-20T10:55:04.654 INFO:tasks.workunit.client.1.smithi175.stdout:7/790: getdents db/d1d/d60/d76/db6 0 2024-04-20T10:55:04.656 INFO:tasks.workunit.client.1.smithi175.stdout:3/541: rmdir d7/d21 39 2024-04-20T10:55:04.656 INFO:tasks.workunit.client.1.smithi175.stdout:3/542: truncate d7/d21/d16/d22/d2c/d1f/d48/f9c 576053 0 2024-04-20T10:55:04.657 INFO:tasks.workunit.client.1.smithi175.stdout:7/791: mknod db/d1d/d39/d50/dba/daa/df3/c110 0 2024-04-20T10:55:04.660 INFO:tasks.workunit.client.1.smithi175.stdout:7/792: creat db/d1d/d39/d50/f111 x:0 0 0 2024-04-20T10:55:04.661 INFO:tasks.workunit.client.1.smithi175.stdout:3/543: mkdir d7/d19/d33/d60/d79/d99/dac 0 2024-04-20T10:55:04.662 INFO:tasks.workunit.client.1.smithi175.stdout:7/793: write db/d1d/d39/d50/dba/f6b [628625,103838] 0 2024-04-20T10:55:04.662 INFO:tasks.workunit.client.1.smithi175.stdout:7/794: write db/d1d/d39/ff9 [995176,68294] 0 2024-04-20T10:55:04.663 INFO:tasks.workunit.client.1.smithi175.stdout:3/544: mkdir d7/d19/d33/d60/d79/d99/dac/dad 0 2024-04-20T10:55:04.665 INFO:tasks.workunit.client.1.smithi175.stdout:7/795: getdents db/d61/d6d/d9c/de8/d2a 0 2024-04-20T10:55:04.673 INFO:tasks.workunit.client.1.smithi175.stdout:4/755: dwrite d4/d23/ff1 [0,4194304] 0 2024-04-20T10:55:04.673 INFO:tasks.workunit.client.1.smithi175.stdout:4/756: fsync d4/d23/f32 0 2024-04-20T10:55:04.673 INFO:tasks.workunit.client.1.smithi175.stdout:7/796: write db/d1d/d39/d50/dba/d47/f94 [373128,88192] 0 2024-04-20T10:55:04.674 INFO:tasks.workunit.client.1.smithi175.stdout:2/595: dwrite d1/d7/d63/d36/d7d/fbb [0,4194304] 0 2024-04-20T10:55:04.676 INFO:tasks.workunit.client.1.smithi175.stdout:4/757: rmdir d4/d23 39 2024-04-20T10:55:04.680 INFO:tasks.workunit.client.1.smithi175.stdout:2/596: readlink d1/d48/d38/l43 0 2024-04-20T10:55:04.681 INFO:tasks.workunit.client.1.smithi175.stdout:2/597: mkdir d1/d6a/d74/dc7 0 2024-04-20T10:55:04.681 INFO:tasks.workunit.client.1.smithi175.stdout:2/598: write d1/d6a/f6e [660897,102121] 0 2024-04-20T10:55:04.682 INFO:tasks.workunit.client.1.smithi175.stdout:2/599: unlink d1/d7/l15 0 2024-04-20T10:55:04.684 INFO:tasks.workunit.client.1.smithi175.stdout:2/600: mknod d1/d48/d21/d29/cc8 0 2024-04-20T10:55:04.686 INFO:tasks.workunit.client.1.smithi175.stdout:2/601: unlink d1/d7/ff 0 2024-04-20T10:55:04.687 INFO:tasks.workunit.client.1.smithi175.stdout:2/602: mknod d1/d7/d63/d36/d7d/d84/cc9 0 2024-04-20T10:55:04.692 INFO:tasks.workunit.client.1.smithi175.stdout:2/603: dread d1/d7/f72 [0,4194304] 0 2024-04-20T10:55:04.692 INFO:tasks.workunit.client.1.smithi175.stdout:2/604: fsync d1/d48/d21/d76/da8/fbc 0 2024-04-20T10:55:04.692 INFO:tasks.workunit.client.1.smithi175.stdout:2/605: fdatasync d1/d48/f41 0 2024-04-20T10:55:04.693 INFO:tasks.workunit.client.1.smithi175.stdout:2/606: symlink d1/lca 0 2024-04-20T10:55:04.694 INFO:tasks.workunit.client.1.smithi175.stdout:2/607: link d1/d48/l1c d1/d7/d63/d4b/d8a/lcb 0 2024-04-20T10:55:04.696 INFO:tasks.workunit.client.1.smithi175.stdout:2/608: unlink d1/lca 0 2024-04-20T10:55:04.696 INFO:tasks.workunit.client.1.smithi175.stdout:2/609: chown d1/d48/f27 1 1 2024-04-20T10:55:04.696 INFO:tasks.workunit.client.1.smithi175.stdout:2/610: rmdir d1/d7/d63/d36 39 2024-04-20T10:55:04.696 INFO:tasks.workunit.client.1.smithi175.stdout:2/611: chown d1/f40 11 1 2024-04-20T10:55:04.697 INFO:tasks.workunit.client.1.smithi175.stdout:2/612: creat d1/d48/fcc x:0 0 0 2024-04-20T10:55:04.697 INFO:tasks.workunit.client.1.smithi175.stdout:2/613: truncate d1/d48/d21/f37 4745527 0 2024-04-20T10:55:04.700 INFO:tasks.workunit.client.1.smithi175.stdout:2/614: dread d1/d7/f72 [0,4194304] 0 2024-04-20T10:55:04.700 INFO:tasks.workunit.client.1.smithi175.stdout:4/758: dwrite d4/d23/ff4 [0,4194304] 0 2024-04-20T10:55:04.701 INFO:tasks.workunit.client.1.smithi175.stdout:4/759: getdents d4/dd/d2d 0 2024-04-20T10:55:04.701 INFO:tasks.workunit.client.1.smithi175.stdout:4/760: write d4/d27/f15 [4488881,43981] 0 2024-04-20T10:55:04.701 INFO:tasks.workunit.client.1.smithi175.stdout:7/797: dwrite db/d1d/d39/d50/dba/d47/f94 [0,4194304] 0 2024-04-20T10:55:04.702 INFO:tasks.workunit.client.1.smithi175.stdout:7/798: dread - db/d61/d6d/d9c/de8/d2a/d41/fa5 zero size 2024-04-20T10:55:04.703 INFO:tasks.workunit.client.1.smithi175.stdout:7/799: symlink db/d61/d6d/dbc/l112 0 2024-04-20T10:55:04.710 INFO:tasks.workunit.client.1.smithi175.stdout:2/615: dread d1/d48/d21/d29/f46 [0,4194304] 0 2024-04-20T10:55:04.712 INFO:tasks.workunit.client.1.smithi175.stdout:2/616: rename d1/l51 to d1/d48/d21/lcd 0 2024-04-20T10:55:04.712 INFO:tasks.workunit.client.1.smithi175.stdout:2/617: mknod d1/d7/d63/d36/d7d/d84/cce 0 2024-04-20T10:55:04.713 INFO:tasks.workunit.client.1.smithi175.stdout:2/618: rmdir d1/d53 39 2024-04-20T10:55:04.714 INFO:tasks.workunit.client.1.smithi175.stdout:2/619: symlink d1/d7/d63/d36/d7d/d84/d8b/d99/lcf 0 2024-04-20T10:55:04.722 INFO:tasks.workunit.client.1.smithi175.stdout:4/761: dwrite d4/dd/d54/d5d/d9e/f64 [0,4194304] 0 2024-04-20T10:55:04.723 INFO:tasks.workunit.client.1.smithi175.stdout:4/762: creat d4/d27/df9/ffe x:0 0 0 2024-04-20T10:55:04.724 INFO:tasks.workunit.client.1.smithi175.stdout:4/763: creat d4/dd/d2d/d33/fff x:0 0 0 2024-04-20T10:55:04.725 INFO:tasks.workunit.client.1.smithi175.stdout:4/764: truncate d4/d27/d61/f7a 1022158 0 2024-04-20T10:55:04.727 INFO:tasks.workunit.client.1.smithi175.stdout:7/800: dwrite db/d1d/d39/de7/f102 [0,4194304] 0 2024-04-20T10:55:04.727 INFO:tasks.workunit.client.1.smithi175.stdout:7/801: readlink db/d1d/d60/d76/db6/lc1 0 2024-04-20T10:55:04.729 INFO:tasks.workunit.client.1.smithi175.stdout:7/802: symlink db/d1d/d60/l113 0 2024-04-20T10:55:04.736 INFO:tasks.workunit.client.1.smithi175.stdout:4/765: dread d4/dd/d2d/d33/d3c/f80 [0,4194304] 0 2024-04-20T10:55:04.736 INFO:tasks.workunit.client.1.smithi175.stdout:2/620: dwrite d1/d48/d38/d82/f7f [0,4194304] 0 2024-04-20T10:55:04.738 INFO:tasks.workunit.client.1.smithi175.stdout:2/621: symlink d1/d48/d38/d82/ld0 0 2024-04-20T10:55:04.738 INFO:tasks.workunit.client.1.smithi175.stdout:2/622: fdatasync d1/f11 0 2024-04-20T10:55:04.739 INFO:tasks.workunit.client.1.smithi175.stdout:1/758: sync 2024-04-20T10:55:04.740 INFO:tasks.workunit.client.1.smithi175.stdout:4/766: write d4/d27/f7b [428528,50811] 0 2024-04-20T10:55:04.741 INFO:tasks.workunit.client.1.smithi175.stdout:2/623: rename d1/d7/d63/d36/d7d/d84/d8b/lb9 to d1/d48/d38/d82/ld1 0 2024-04-20T10:55:04.742 INFO:tasks.workunit.client.1.smithi175.stdout:1/759: stat d0/d8/lb2 0 2024-04-20T10:55:04.745 INFO:tasks.workunit.client.1.smithi175.stdout:2/624: symlink d1/d48/d21/d76/da8/ld2 0 2024-04-20T10:55:04.745 INFO:tasks.workunit.client.1.smithi175.stdout:2/625: stat d1/d48/d21/l4f 0 2024-04-20T10:55:04.745 INFO:tasks.workunit.client.1.smithi175.stdout:2/626: dread - d1/d7/d63/f7b zero size 2024-04-20T10:55:04.746 INFO:tasks.workunit.client.1.smithi175.stdout:4/767: mknod d4/dd/d54/d5f/c100 0 2024-04-20T10:55:04.746 INFO:tasks.workunit.client.1.smithi175.stdout:4/768: read d4/dd/d54/d5d/d9e/f29 [275112,46031] 0 2024-04-20T10:55:04.746 INFO:tasks.workunit.client.1.smithi175.stdout:4/769: chown d4/dd/l6f 10236503 1 2024-04-20T10:55:04.746 INFO:tasks.workunit.client.1.smithi175.stdout:2/627: creat d1/d48/fd3 x:0 0 0 2024-04-20T10:55:04.746 INFO:tasks.workunit.client.1.smithi175.stdout:4/770: creat d4/d23/d2e/da5/ddf/f101 x:0 0 0 2024-04-20T10:55:04.747 INFO:tasks.workunit.client.1.smithi175.stdout:2/628: stat d1/le 0 2024-04-20T10:55:04.747 INFO:tasks.workunit.client.1.smithi175.stdout:7/803: dwrite db/d61/d6d/d9c/de8/d9a/dd2/dfc/ffe [0,4194304] 0 2024-04-20T10:55:04.748 INFO:tasks.workunit.client.1.smithi175.stdout:4/771: creat d4/f102 x:0 0 0 2024-04-20T10:55:04.749 INFO:tasks.workunit.client.1.smithi175.stdout:4/772: stat d4 0 2024-04-20T10:55:04.749 INFO:tasks.workunit.client.1.smithi175.stdout:4/773: write d4/d27/f17 [7835924,40200] 0 2024-04-20T10:55:04.749 INFO:tasks.workunit.client.1.smithi175.stdout:2/629: creat d1/d48/d21/db6/dc1/fd4 x:0 0 0 2024-04-20T10:55:04.749 INFO:tasks.workunit.client.1.smithi175.stdout:2/630: write d1/d48/d21/d76/da8/fc4 [1288534,15122] 0 2024-04-20T10:55:04.749 INFO:tasks.workunit.client.1.smithi175.stdout:2/631: dread - d1/d7/d63/f71 zero size 2024-04-20T10:55:04.751 INFO:tasks.workunit.client.1.smithi175.stdout:7/804: creat db/d61/d6d/d9c/de8/d8e/f114 x:0 0 0 2024-04-20T10:55:04.766 INFO:tasks.workunit.client.1.smithi175.stdout:2/632: dwrite d1/d48/d21/d29/f50 [0,4194304] 0 2024-04-20T10:55:04.766 INFO:tasks.workunit.client.1.smithi175.stdout:2/633: read d1/f6d [10254,119696] 0 2024-04-20T10:55:04.767 INFO:tasks.workunit.client.1.smithi175.stdout:2/634: mknod d1/d6a/cd5 0 2024-04-20T10:55:04.767 INFO:tasks.workunit.client.1.smithi175.stdout:2/635: write d1/d7/d63/f7b [869894,117551] 0 2024-04-20T10:55:04.990 INFO:tasks.workunit.client.1.smithi175.stdout:4/774: write d4/d27/f91 [695343,22966] 0 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:7/805: sync 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:1/760: sync 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:0/661: sync 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:7/806: chown db/d61/d6d/d9c/de8/d2a/d41/d59/fa0 804277 1 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:2/636: sync 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:6/750: sync 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:9/644: sync 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:9/645: readlink d6/d1b/d42/d79/l7b 0 2024-04-20T10:55:04.993 INFO:tasks.workunit.client.1.smithi175.stdout:3/545: sync 2024-04-20T10:55:04.994 INFO:tasks.workunit.client.1.smithi175.stdout:5/894: sync 2024-04-20T10:55:04.994 INFO:tasks.workunit.client.1.smithi175.stdout:8/694: sync 2024-04-20T10:55:04.995 INFO:tasks.workunit.client.1.smithi175.stdout:2/637: symlink d1/d7/d63/d36/d7d/d84/d8b/da7/ld6 0 2024-04-20T10:55:04.995 INFO:tasks.workunit.client.1.smithi175.stdout:2/638: readlink d1/d48/l1c 0 2024-04-20T10:55:04.995 INFO:tasks.workunit.client.1.smithi175.stdout:6/751: dread d1/d37/d83/db8/d60/d6b/da8/fe7 [0,4194304] 0 2024-04-20T10:55:04.997 INFO:tasks.workunit.client.1.smithi175.stdout:3/546: unlink d7/d10/d8c/c93 0 2024-04-20T10:55:04.997 INFO:tasks.workunit.client.1.smithi175.stdout:3/547: read d7/d21/d16/d22/d2c/f3c [2330119,99123] 0 2024-04-20T10:55:04.999 INFO:tasks.workunit.client.1.smithi175.stdout:5/895: unlink db/d1f/f29 0 2024-04-20T10:55:04.999 INFO:tasks.workunit.client.1.smithi175.stdout:1/761: dread d0/d8/f45 [0,4194304] 0 2024-04-20T10:55:04.999 INFO:tasks.workunit.client.1.smithi175.stdout:8/695: creat d7/d13/d1d/fdf x:0 0 0 2024-04-20T10:55:05.001 INFO:tasks.workunit.client.1.smithi175.stdout:8/696: write d7/d13/d1d/d24/d63/f9a [358450,112958] 0 2024-04-20T10:55:05.001 INFO:tasks.workunit.client.1.smithi175.stdout:0/662: rename df/d17/f2a to df/fcf 0 2024-04-20T10:55:05.003 INFO:tasks.workunit.client.1.smithi175.stdout:3/548: link d7/d19/d33/d7e/d86/d7d/l82 d7/d19/d33/d60/d79/d99/dac/lae 0 2024-04-20T10:55:05.003 INFO:tasks.workunit.client.1.smithi175.stdout:3/549: chown d7/d21/d16/c36 104 1 2024-04-20T10:55:05.003 INFO:tasks.workunit.client.1.smithi175.stdout:3/550: dread - d7/d21/d16/d22/d2c/d64/fa3 zero size 2024-04-20T10:55:05.003 INFO:tasks.workunit.client.1.smithi175.stdout:7/807: dread db/d1d/d39/d50/dba/d47/f94 [0,4194304] 0 2024-04-20T10:55:05.003 INFO:tasks.workunit.client.1.smithi175.stdout:5/896: rmdir db/d11/d1a 39 2024-04-20T10:55:05.003 INFO:tasks.workunit.client.1.smithi175.stdout:5/897: fsync db/d11/d6d/fb3 0 2024-04-20T10:55:05.004 INFO:tasks.workunit.client.1.smithi175.stdout:5/898: dread db/d30/d46/fd0 [0,4194304] 0 2024-04-20T10:55:05.004 INFO:tasks.workunit.client.1.smithi175.stdout:5/899: rename db/d1f/d31 to db/d1f/d31/d93/d12d 22 2024-04-20T10:55:05.004 INFO:tasks.workunit.client.1.smithi175.stdout:5/900: dread - db/dd7/f126 zero size 2024-04-20T10:55:05.004 INFO:tasks.workunit.client.1.smithi175.stdout:1/762: write d0/f77 [940259,115389] 0 2024-04-20T10:55:05.005 INFO:tasks.workunit.client.1.smithi175.stdout:0/663: creat df/d1a/da1/fd0 x:0 0 0 2024-04-20T10:55:05.006 INFO:tasks.workunit.client.1.smithi175.stdout:3/551: symlink d7/d19/da2/laf 0 2024-04-20T10:55:05.006 INFO:tasks.workunit.client.1.smithi175.stdout:7/808: getdents db/d61/d6d/d9c/de8 0 2024-04-20T10:55:05.010 INFO:tasks.workunit.client.1.smithi175.stdout:0/664: rename df/d17/d2f/f66 to df/d1a/d3f/fd1 0 2024-04-20T10:55:05.011 INFO:tasks.workunit.client.1.smithi175.stdout:3/552: dread d7/d21/d16/d49/f63 [0,4194304] 0 2024-04-20T10:55:05.012 INFO:tasks.workunit.client.1.smithi175.stdout:7/809: symlink db/d61/d6d/d9c/de8/d8f/dcc/l115 0 2024-04-20T10:55:05.015 INFO:tasks.workunit.client.1.smithi175.stdout:0/665: fsync fe 0 2024-04-20T10:55:05.015 INFO:tasks.workunit.client.1.smithi175.stdout:3/553: link d7/f51 d7/d10/d8c/fb0 0 2024-04-20T10:55:05.017 INFO:tasks.workunit.client.1.smithi175.stdout:7/810: rename db/d1d/d39/d50/f28 to db/d1d/d39/d50/dba/d47/da6/d107/f116 0 2024-04-20T10:55:05.017 INFO:tasks.workunit.client.1.smithi175.stdout:7/811: write db/d1d/d39/d50/dba/d47/da6/db9/dc8/fd4 [1570792,11089] 0 2024-04-20T10:55:05.018 INFO:tasks.workunit.client.1.smithi175.stdout:5/901: link db/dc1/d4f/d5a/c61 db/d11/d25/d38/d40/d47/c12e 0 2024-04-20T10:55:05.018 INFO:tasks.workunit.client.1.smithi175.stdout:0/666: mknod df/d1a/d98/cd2 0 2024-04-20T10:55:05.019 INFO:tasks.workunit.client.1.smithi175.stdout:3/554: rmdir d7/d21/d16/d49 39 2024-04-20T10:55:05.019 INFO:tasks.workunit.client.1.smithi175.stdout:3/555: dread - d7/d19/d33/d60/f80 zero size 2024-04-20T10:55:05.019 INFO:tasks.workunit.client.1.smithi175.stdout:3/556: dread - d7/d21/d16/d22/d2c/d1f/d48/f90 zero size 2024-04-20T10:55:05.021 INFO:tasks.workunit.client.1.smithi175.stdout:7/812: symlink db/d61/d6d/d9c/de8/d9a/dd2/dfc/l117 0 2024-04-20T10:55:05.021 INFO:tasks.workunit.client.1.smithi175.stdout:5/902: mkdir db/d30/d46/d12f 0 2024-04-20T10:55:05.023 INFO:tasks.workunit.client.1.smithi175.stdout:7/813: creat db/d61/d6d/d9c/de8/d2a/d41/f118 x:0 0 0 2024-04-20T10:55:05.031 INFO:tasks.workunit.client.1.smithi175.stdout:9/646: dwrite d6/d58/d90/f93 [0,4194304] 0 2024-04-20T10:55:05.031 INFO:tasks.workunit.client.1.smithi175.stdout:6/752: dwrite d1/d37/fba [0,4194304] 0 2024-04-20T10:55:05.031 INFO:tasks.workunit.client.1.smithi175.stdout:6/753: readlink d1/d37/d83/db8/d60/lbf 0 2024-04-20T10:55:05.035 INFO:tasks.workunit.client.1.smithi175.stdout:0/667: rename df/d1a/d22/d6a/c9b to df/cd3 0 2024-04-20T10:55:05.035 INFO:tasks.workunit.client.1.smithi175.stdout:0/668: write df/d1a/d22/f79 [736725,99379] 0 2024-04-20T10:55:05.035 INFO:tasks.workunit.client.1.smithi175.stdout:0/669: chown df/d1a/d3f/d5e/fa4 737 1 2024-04-20T10:55:05.036 INFO:tasks.workunit.client.1.smithi175.stdout:3/557: dwrite d7/d21/d16/d22/d2c/d64/fa3 [0,4194304] 0 2024-04-20T10:55:05.041 INFO:tasks.workunit.client.1.smithi175.stdout:6/754: creat d1/d37/d83/ff7 x:0 0 0 2024-04-20T10:55:05.041 INFO:tasks.workunit.client.1.smithi175.stdout:6/755: chown d1/caf 1899 1 2024-04-20T10:55:05.041 INFO:tasks.workunit.client.1.smithi175.stdout:5/903: dwrite db/d11/d25/d41/d60/fe5 [0,4194304] 0 2024-04-20T10:55:05.042 INFO:tasks.workunit.client.1.smithi175.stdout:9/647: write d6/d1b/f57 [3417708,101403] 0 2024-04-20T10:55:05.044 INFO:tasks.workunit.client.1.smithi175.stdout:0/670: getdents df/d1a/da1 0 2024-04-20T10:55:05.055 INFO:tasks.workunit.client.1.smithi175.stdout:7/814: rename db/d1d/d60/d76/c81 to db/d1d/d39/d50/dba/d47/da6/db9/dc8/c119 0 2024-04-20T10:55:05.055 INFO:tasks.workunit.client.1.smithi175.stdout:7/815: chown db/d1d/c108 0 1 2024-04-20T10:55:05.056 INFO:tasks.workunit.client.1.smithi175.stdout:9/648: symlink d6/d33/lc0 0 2024-04-20T10:55:05.057 INFO:tasks.workunit.client.1.smithi175.stdout:5/904: dread db/d30/f99 [0,4194304] 0 2024-04-20T10:55:05.058 INFO:tasks.workunit.client.1.smithi175.stdout:7/816: truncate db/f7e 3917370 0 2024-04-20T10:55:05.069 INFO:tasks.workunit.client.1.smithi175.stdout:6/756: dwrite d1/dc0/d49/fa6 [0,4194304] 0 2024-04-20T10:55:05.069 INFO:tasks.workunit.client.1.smithi175.stdout:0/671: dwrite df/d19/f70 [0,4194304] 0 2024-04-20T10:55:05.069 INFO:tasks.workunit.client.1.smithi175.stdout:0/672: truncate df/d17/d2f/d4f/fc1 536525 0 2024-04-20T10:55:05.073 INFO:tasks.workunit.client.1.smithi175.stdout:0/673: creat df/d1a/d22/fd4 x:0 0 0 2024-04-20T10:55:05.073 INFO:tasks.workunit.client.1.smithi175.stdout:0/674: write df/d1a/d22/d24/fc2 [50988,62491] 0 2024-04-20T10:55:05.074 INFO:tasks.workunit.client.1.smithi175.stdout:5/905: symlink db/d11/d25/d41/d60/l130 0 2024-04-20T10:55:05.074 INFO:tasks.workunit.client.1.smithi175.stdout:5/906: truncate db/d1f/d31/fec 4506242 0 2024-04-20T10:55:05.075 INFO:tasks.workunit.client.1.smithi175.stdout:0/675: mknod df/d1a/d22/d24/d9a/cd5 0 2024-04-20T10:55:05.077 INFO:tasks.workunit.client.1.smithi175.stdout:5/907: mkdir db/d11/d1a/d131 0 2024-04-20T10:55:05.077 INFO:tasks.workunit.client.1.smithi175.stdout:5/908: readlink db/dc1/d4f/d5a/lf7 0 2024-04-20T10:55:05.082 INFO:tasks.workunit.client.1.smithi175.stdout:9/649: dwrite d6/d58/f61 [0,4194304] 0 2024-04-20T10:55:05.085 INFO:tasks.workunit.client.1.smithi175.stdout:0/676: dread fe [0,4194304] 0 2024-04-20T10:55:05.086 INFO:tasks.workunit.client.1.smithi175.stdout:5/909: write db/d11/d1a/f28 [123221,76682] 0 2024-04-20T10:55:05.087 INFO:tasks.workunit.client.1.smithi175.stdout:9/650: symlink d6/d1b/d42/d5b/d72/d7d/dae/dbf/lc1 0 2024-04-20T10:55:05.087 INFO:tasks.workunit.client.1.smithi175.stdout:7/817: dwrite db/d1d/d60/d76/f8d [0,4194304] 0 2024-04-20T10:55:05.087 INFO:tasks.workunit.client.1.smithi175.stdout:7/818: fsync db/d1d/d39/d50/dba/d47/dac/fee 0 2024-04-20T10:55:05.087 INFO:tasks.workunit.client.1.smithi175.stdout:6/757: dwrite d1/d37/d83/db8/d60/d68/d7e/fb1 [0,4194304] 0 2024-04-20T10:55:05.089 INFO:tasks.workunit.client.1.smithi175.stdout:7/819: unlink db/d1d/d39/d50/dba/d47/l4c 0 2024-04-20T10:55:05.090 INFO:tasks.workunit.client.1.smithi175.stdout:9/651: read d6/d10/f1e [5224415,3101] 0 2024-04-20T10:55:05.090 INFO:tasks.workunit.client.1.smithi175.stdout:9/652: fsync d6/d1b/d42/fa6 0 2024-04-20T10:55:05.090 INFO:tasks.workunit.client.1.smithi175.stdout:0/677: rename df/d2e/c3e to df/d1a/d98/cd6 0 2024-04-20T10:55:05.094 INFO:tasks.workunit.client.1.smithi175.stdout:5/910: creat db/d11/d25/d38/d40/d66/d94/dfb/f132 x:0 0 0 2024-04-20T10:55:05.095 INFO:tasks.workunit.client.1.smithi175.stdout:7/820: mknod db/d61/d6d/d9c/de8/d9a/dd2/dfc/c11a 0 2024-04-20T10:55:05.095 INFO:tasks.workunit.client.1.smithi175.stdout:7/821: readlink db/d1d/d60/d76/lb2 0 2024-04-20T10:55:05.095 INFO:tasks.workunit.client.1.smithi175.stdout:7/822: truncate db/fd 4658142 0 2024-04-20T10:55:05.095 INFO:tasks.workunit.client.1.smithi175.stdout:7/823: readlink db/d61/d6d/d9c/de8/d8f/dcc/l115 0 2024-04-20T10:55:05.096 INFO:tasks.workunit.client.1.smithi175.stdout:0/678: creat df/d1a/d22/fd7 x:0 0 0 2024-04-20T10:55:05.142 INFO:tasks.workunit.client.1.smithi175.stdout:6/758: link d1/d37/fba d1/d37/d83/db8/ff8 0 2024-04-20T10:55:05.142 INFO:tasks.workunit.client.1.smithi175.stdout:6/759: fsync d1/d5/d12/f56 0 2024-04-20T10:55:05.143 INFO:tasks.workunit.client.1.smithi175.stdout:5/911: creat db/d11/d25/d38/d40/d66/f133 x:0 0 0 2024-04-20T10:55:05.143 INFO:tasks.workunit.client.1.smithi175.stdout:6/760: dread d1/d37/d83/db8/d60/d6b/da8/fe7 [0,4194304] 0 2024-04-20T10:55:05.144 INFO:tasks.workunit.client.1.smithi175.stdout:9/653: link d6/d1b/d26/c94 d6/d1b/cc2 0 2024-04-20T10:55:05.144 INFO:tasks.workunit.client.1.smithi175.stdout:0/679: creat df/d17/d2f/fd8 x:0 0 0 2024-04-20T10:55:05.148 INFO:tasks.workunit.client.1.smithi175.stdout:5/912: creat db/d11/d25/d41/d60/f134 x:0 0 0 2024-04-20T10:55:05.149 INFO:tasks.workunit.client.1.smithi175.stdout:6/761: creat d1/d37/d83/db8/db9/ff9 x:0 0 0 2024-04-20T10:55:05.151 INFO:tasks.workunit.client.1.smithi175.stdout:9/654: mknod d6/d1b/d42/d79/cc3 0 2024-04-20T10:55:05.152 INFO:tasks.workunit.client.1.smithi175.stdout:5/913: mkdir db/d11/d80/d135 0 2024-04-20T10:55:05.153 INFO:tasks.workunit.client.1.smithi175.stdout:5/914: fdatasync db/d30/d46/d88/f10f 0 2024-04-20T10:55:05.156 INFO:tasks.workunit.client.1.smithi175.stdout:9/655: unlink d6/d1b/d42/d5b/d72/d7d/l85 0 2024-04-20T10:55:05.157 INFO:tasks.workunit.client.1.smithi175.stdout:5/915: readlink db/d9d/l55 0 2024-04-20T10:55:05.158 INFO:tasks.workunit.client.1.smithi175.stdout:5/916: stat db/d11/d25/d38/d40/d66/d94/lcf 0 2024-04-20T10:55:05.158 INFO:tasks.workunit.client.1.smithi175.stdout:5/917: dread - db/d1f/d31/d93/f100 zero size 2024-04-20T10:55:05.158 INFO:tasks.workunit.client.1.smithi175.stdout:6/762: rename d1/dc0/d29/f5d to d1/dc0/d29/ffa 0 2024-04-20T10:55:05.160 INFO:tasks.workunit.client.1.smithi175.stdout:9/656: unlink d6/d33/fa7 0 2024-04-20T10:55:05.161 INFO:tasks.workunit.client.1.smithi175.stdout:5/918: creat db/d1f/d31/d93/f136 x:0 0 0 2024-04-20T10:55:05.161 INFO:tasks.workunit.client.1.smithi175.stdout:5/919: chown db/d11/d25/d38/c70 6242466 1 2024-04-20T10:55:05.162 INFO:tasks.workunit.client.1.smithi175.stdout:9/657: rename d6/d1b/d42/d5b/d72/f92 to d6/d33/d60/fc4 0 2024-04-20T10:55:05.163 INFO:tasks.workunit.client.1.smithi175.stdout:0/680: dwrite df/f3a [0,4194304] 0 2024-04-20T10:55:05.163 INFO:tasks.workunit.client.1.smithi175.stdout:0/681: readlink df/d1a/d22/d6a/d72/d48/lc7 0 2024-04-20T10:55:05.163 INFO:tasks.workunit.client.1.smithi175.stdout:5/920: symlink db/d1f/d31/da0/dcb/l137 0 2024-04-20T10:55:05.163 INFO:tasks.workunit.client.1.smithi175.stdout:5/921: stat db/d11/f2d 0 2024-04-20T10:55:05.164 INFO:tasks.workunit.client.1.smithi175.stdout:6/763: symlink d1/d5/lfb 0 2024-04-20T10:55:05.165 INFO:tasks.workunit.client.1.smithi175.stdout:0/682: creat df/d17/d2f/d4f/dcd/fd9 x:0 0 0 2024-04-20T10:55:05.166 INFO:tasks.workunit.client.1.smithi175.stdout:5/922: mknod db/dc1/d4f/d75/d91/c138 0 2024-04-20T10:55:05.166 INFO:tasks.workunit.client.1.smithi175.stdout:5/923: write db/d11/d25/d41/d60/f11e [616310,109086] 0 2024-04-20T10:55:05.166 INFO:tasks.workunit.client.1.smithi175.stdout:6/764: write d1/d37/d83/db8/f4f [590979,127645] 0 2024-04-20T10:55:05.167 INFO:tasks.workunit.client.1.smithi175.stdout:9/658: mkdir d6/d1b/d42/d5b/d72/dc5 0 2024-04-20T10:55:05.168 INFO:tasks.workunit.client.1.smithi175.stdout:5/924: mknod db/d11/d1a/d131/c139 0 2024-04-20T10:55:05.169 INFO:tasks.workunit.client.1.smithi175.stdout:9/659: mkdir d6/d1b/d26/d8c/dc6 0 2024-04-20T10:55:05.171 INFO:tasks.workunit.client.1.smithi175.stdout:0/683: link df/d1a/d3f/d5e/lc3 df/d1a/lda 0 2024-04-20T10:55:05.171 INFO:tasks.workunit.client.1.smithi175.stdout:0/684: fsync df/d19/f31 0 2024-04-20T10:55:05.171 INFO:tasks.workunit.client.1.smithi175.stdout:0/685: readlink df/d1a/da1/lc9 0 2024-04-20T10:55:05.172 INFO:tasks.workunit.client.1.smithi175.stdout:7/824: write db/f1c [3888691,34236] 0 2024-04-20T10:55:05.172 INFO:tasks.workunit.client.1.smithi175.stdout:5/925: creat db/d11/d25/f13a x:0 0 0 2024-04-20T10:55:05.175 INFO:tasks.workunit.client.1.smithi175.stdout:7/825: getdents db/d61/d6d/d9c/de8/d2a/d41 0 2024-04-20T10:55:05.185 INFO:tasks.workunit.client.1.smithi175.stdout:6/765: dwrite d1/d37/d83/db8/d60/ff5 [0,4194304] 0 2024-04-20T10:55:05.185 INFO:tasks.workunit.client.1.smithi175.stdout:6/766: write d1/dc0/d29/f9f [869252,8831] 0 2024-04-20T10:55:05.186 INFO:tasks.workunit.client.1.smithi175.stdout:4/775: sync 2024-04-20T10:55:05.190 INFO:tasks.workunit.client.1.smithi175.stdout:6/767: mkdir d1/d37/d83/db8/d60/ded/dc1/dfc 0 2024-04-20T10:55:05.191 INFO:tasks.workunit.client.1.smithi175.stdout:4/776: symlink d4/dd/d54/d5d/l103 0 2024-04-20T10:55:05.191 INFO:tasks.workunit.client.1.smithi175.stdout:6/768: mkdir d1/d37/dfd 0 2024-04-20T10:55:05.193 INFO:tasks.workunit.client.1.smithi175.stdout:4/777: rename d4/d23/d2e/da5 to d4/dd/d54/d5d/d79/d9d/d104 0 2024-04-20T10:55:05.193 INFO:tasks.workunit.client.1.smithi175.stdout:7/826: dwrite db/d1d/d39/d50/ff [0,4194304] 0 2024-04-20T10:55:05.194 INFO:tasks.workunit.client.1.smithi175.stdout:6/769: symlink d1/dc0/df2/lfe 0 2024-04-20T10:55:05.213 INFO:tasks.workunit.client.1.smithi175.stdout:7/827: dwrite db/d1d/d39/d50/dba/d47/f94 [0,4194304] 0 2024-04-20T10:55:05.214 INFO:tasks.workunit.client.1.smithi175.stdout:7/828: read db/f66 [1358171,109683] 0 2024-04-20T10:55:05.223 INFO:tasks.workunit.client.1.smithi175.stdout:9/660: dwrite d6/d10/f1e [4194304,4194304] 0 2024-04-20T10:55:05.224 INFO:tasks.workunit.client.1.smithi175.stdout:4/778: rename d4/d27/d61/f42 to d4/dd/d2d/d33/d58/f105 0 2024-04-20T10:55:05.225 INFO:tasks.workunit.client.1.smithi175.stdout:4/779: fdatasync d4/f31 0 2024-04-20T10:55:05.226 INFO:tasks.workunit.client.1.smithi175.stdout:6/770: dwrite d1/f18 [0,4194304] 0 2024-04-20T10:55:05.226 INFO:tasks.workunit.client.1.smithi175.stdout:9/661: link d6/d33/d60/f9d d6/d10/fc7 0 2024-04-20T10:55:05.227 INFO:tasks.workunit.client.1.smithi175.stdout:4/780: link d4/c3e d4/dd/d2d/d33/d3c/d44/c106 0 2024-04-20T10:55:05.229 INFO:tasks.workunit.client.1.smithi175.stdout:9/662: chown d6/d1b/d42/d5b/d72/d98/fb9 12779 1 2024-04-20T10:55:05.230 INFO:tasks.workunit.client.1.smithi175.stdout:7/829: rename db/d61/d6d/d9c/de8/d2a/f30 to db/d1d/d39/d50/dba/d47/f11b 0 2024-04-20T10:55:05.231 INFO:tasks.workunit.client.1.smithi175.stdout:4/781: creat d4/d27/d8c/f107 x:0 0 0 2024-04-20T10:55:05.232 INFO:tasks.workunit.client.1.smithi175.stdout:4/782: fdatasync d4/dd/d2d/d33/d5b/d65/fdd 0 2024-04-20T10:55:05.232 INFO:tasks.workunit.client.1.smithi175.stdout:4/783: fdatasync d4/d27/f14 0 2024-04-20T10:55:05.232 INFO:tasks.workunit.client.1.smithi175.stdout:4/784: fsync d4/dd/d2d/d43/d69/daa/fe7 0 2024-04-20T10:55:05.232 INFO:tasks.workunit.client.1.smithi175.stdout:6/771: symlink d1/dc0/d49/lff 0 2024-04-20T10:55:05.232 INFO:tasks.workunit.client.1.smithi175.stdout:6/772: write d1/d37/d83/db8/d60/f91 [2009426,18498] 0 2024-04-20T10:55:05.233 INFO:tasks.workunit.client.1.smithi175.stdout:9/663: mkdir d6/d1b/d26/d8c/dc6/dc8 0 2024-04-20T10:55:05.234 INFO:tasks.workunit.client.1.smithi175.stdout:7/830: mkdir db/d1d/d39/d50/dba/daa/df3/d105/d11c 0 2024-04-20T10:55:05.235 INFO:tasks.workunit.client.1.smithi175.stdout:4/785: rmdir d4/dd/d54/d5d/d79/d9d/dd4/dda 0 2024-04-20T10:55:05.236 INFO:tasks.workunit.client.1.smithi175.stdout:7/831: symlink db/d61/d6d/dbc/dc4/l11d 0 2024-04-20T10:55:05.237 INFO:tasks.workunit.client.1.smithi175.stdout:4/786: creat d4/dd/d54/d5d/f108 x:0 0 0 2024-04-20T10:55:05.237 INFO:tasks.workunit.client.1.smithi175.stdout:4/787: read - d4/dd/d54/d5d/f108 zero size 2024-04-20T10:55:05.238 INFO:tasks.workunit.client.1.smithi175.stdout:4/788: creat d4/dd/d5e/d74/da1/dbc/f109 x:0 0 0 2024-04-20T10:55:05.239 INFO:tasks.workunit.client.1.smithi175.stdout:6/773: dread d1/dc0/d29/f9f [0,4194304] 0 2024-04-20T10:55:05.240 INFO:tasks.workunit.client.1.smithi175.stdout:6/774: readlink d1/d37/d83/db8/d60/d68/d7e/le8 0 2024-04-20T10:55:05.240 INFO:tasks.workunit.client.1.smithi175.stdout:6/775: write d1/d5/d12/d7f/dae/fce [484692,104190] 0 2024-04-20T10:55:05.240 INFO:tasks.workunit.client.1.smithi175.stdout:6/776: dread - d1/d37/d83/ff7 zero size 2024-04-20T10:55:05.240 INFO:tasks.workunit.client.1.smithi175.stdout:7/832: rename db/f1c to db/d1d/d39/d50/dba/d47/f11e 0 2024-04-20T10:55:05.240 INFO:tasks.workunit.client.1.smithi175.stdout:4/789: creat d4/dd/d54/d5d/d79/d9d/dd4/f10a x:0 0 0 2024-04-20T10:55:05.241 INFO:tasks.workunit.client.1.smithi175.stdout:7/833: mkdir db/d61/d6d/d9c/de8/d2a/d41/d59/db3/d11f 0 2024-04-20T10:55:05.241 INFO:tasks.workunit.client.1.smithi175.stdout:9/664: write d6/d33/d60/d78/fa0 [3577560,14980] 0 2024-04-20T10:55:05.242 INFO:tasks.workunit.client.1.smithi175.stdout:4/790: rename d4/dd/d54/d5d to d4/dd/d54/d5d/d79/d10b 22 2024-04-20T10:55:05.242 INFO:tasks.workunit.client.1.smithi175.stdout:4/791: chown d4/dd/d54/d5f/ca6 529383 1 2024-04-20T10:55:05.242 INFO:tasks.workunit.client.1.smithi175.stdout:4/792: write d4/ffb [70131,103870] 0 2024-04-20T10:55:05.242 INFO:tasks.workunit.client.1.smithi175.stdout:4/793: dread - d4/d27/df9/ffe zero size 2024-04-20T10:55:05.243 INFO:tasks.workunit.client.1.smithi175.stdout:4/794: dread - d4/dd/d54/d5d/d79/ff7 zero size 2024-04-20T10:55:05.243 INFO:tasks.workunit.client.1.smithi175.stdout:7/834: rmdir db/d61/d6d/d9c/de8/d2a 39 2024-04-20T10:55:05.243 INFO:tasks.workunit.client.1.smithi175.stdout:7/835: mkdir db/d61/d6d/dbc/d120 0 2024-04-20T10:55:05.244 INFO:tasks.workunit.client.1.smithi175.stdout:4/795: symlink d4/dd/d5e/d74/l10c 0 2024-04-20T10:55:05.246 INFO:tasks.workunit.client.1.smithi175.stdout:7/836: rename db/d61/d6d/d9c/de8/d9a/cb5 to db/d61/d6d/d9c/de8/d2a/d41/d59/db3/d11f/c121 0 2024-04-20T10:55:05.247 INFO:tasks.workunit.client.1.smithi175.stdout:6/777: read d1/d37/fba [1613331,40747] 0 2024-04-20T10:55:05.247 INFO:tasks.workunit.client.1.smithi175.stdout:6/778: write d1/d37/fba [15296,66911] 0 2024-04-20T10:55:05.247 INFO:tasks.workunit.client.1.smithi175.stdout:6/779: write d1/d5/fbe [340214,109494] 0 2024-04-20T10:55:05.247 INFO:tasks.workunit.client.1.smithi175.stdout:4/796: creat d4/dd/d2d/f10d x:0 0 0 2024-04-20T10:55:05.250 INFO:tasks.workunit.client.1.smithi175.stdout:9/665: write d6/d1b/d42/d5b/d72/d7d/fa8 [3298928,22903] 0 2024-04-20T10:55:05.250 INFO:tasks.workunit.client.1.smithi175.stdout:6/780: creat d1/d37/d83/db8/d60/d6b/da8/f100 x:0 0 0 2024-04-20T10:55:05.251 INFO:tasks.workunit.client.1.smithi175.stdout:4/797: rename d4/d27/df9 to d4/dd/d54/d5d/d79/d9d/dd4/d10e 0 2024-04-20T10:55:05.252 INFO:tasks.workunit.client.1.smithi175.stdout:4/798: getdents d4/dd/d5e/d74/da1/dc0 0 2024-04-20T10:55:05.252 INFO:tasks.workunit.client.1.smithi175.stdout:4/799: write d4/dd/d5e/ff3 [129306,94153] 0 2024-04-20T10:55:05.252 INFO:tasks.workunit.client.1.smithi175.stdout:4/800: fdatasync d4/dd/d54/d5d/d79/d9d/d104/ddf/f101 0 2024-04-20T10:55:05.252 INFO:tasks.workunit.client.1.smithi175.stdout:7/837: unlink db/d1d/d39/d50/c56 0 2024-04-20T10:55:05.254 INFO:tasks.workunit.client.1.smithi175.stdout:6/781: symlink d1/d5/d12/l101 0 2024-04-20T10:55:05.254 INFO:tasks.workunit.client.1.smithi175.stdout:6/782: stat d1/dc0/f99 0 2024-04-20T10:55:05.254 INFO:tasks.workunit.client.1.smithi175.stdout:6/783: truncate d1/d37/d83/db8/d60/ded/ff1 643100 0 2024-04-20T10:55:05.255 INFO:tasks.workunit.client.1.smithi175.stdout:4/801: mkdir d4/d27/d8c/d10f 0 2024-04-20T10:55:05.255 INFO:tasks.workunit.client.1.smithi175.stdout:4/802: fdatasync d4/dd/d54/d5d/d8a/fde 0 2024-04-20T10:55:05.256 INFO:tasks.workunit.client.1.smithi175.stdout:6/784: rmdir d1/d5 39 2024-04-20T10:55:05.258 INFO:tasks.workunit.client.1.smithi175.stdout:4/803: chown d4/dd/d54/d5d/d79/l89 11286307 1 2024-04-20T10:55:05.258 INFO:tasks.workunit.client.1.smithi175.stdout:4/804: fdatasync d4/dd/d54/d5d/d79/ff7 0 2024-04-20T10:55:05.259 INFO:tasks.workunit.client.1.smithi175.stdout:9/666: write d6/d1b/d2f/f41 [4104197,128353] 0 2024-04-20T10:55:05.260 INFO:tasks.workunit.client.1.smithi175.stdout:6/785: write d1/dc0/d29/f9f [710241,127520] 0 2024-04-20T10:55:05.266 INFO:tasks.workunit.client.1.smithi175.stdout:4/805: dread d4/d27/f17 [0,4194304] 0 2024-04-20T10:55:05.276 INFO:tasks.workunit.client.1.smithi175.stdout:9/667: dwrite d6/d10/fbc [0,4194304] 0 2024-04-20T10:55:05.283 INFO:tasks.workunit.client.1.smithi175.stdout:4/806: dwrite d4/dd/d2d/d33/d3c/d44/fb6 [0,4194304] 0 2024-04-20T10:55:05.285 INFO:tasks.workunit.client.1.smithi175.stdout:6/786: mknod d1/d37/d83/db8/d60/c102 0 2024-04-20T10:55:05.285 INFO:tasks.workunit.client.1.smithi175.stdout:6/787: write d1/dc0/d63/d7c/fd0 [2632671,2945] 0 2024-04-20T10:55:05.308 INFO:tasks.workunit.client.1.smithi175.stdout:9/668: dwrite d6/d58/d90/fa3 [0,4194304] 0 2024-04-20T10:55:05.308 INFO:tasks.workunit.client.1.smithi175.stdout:9/669: chown d6/d1b/d42/f50 1886367282 1 2024-04-20T10:55:05.309 INFO:tasks.workunit.client.1.smithi175.stdout:6/788: dwrite d1/d37/d83/db8/d60/f91 [4194304,4194304] 0 2024-04-20T10:55:05.309 INFO:tasks.workunit.client.1.smithi175.stdout:4/807: mkdir d4/dd/d54/d5d/d79/d9d/d104/d110 0 2024-04-20T10:55:05.311 INFO:tasks.workunit.client.1.smithi175.stdout:9/670: creat d6/d1b/d2f/fc9 x:0 0 0 2024-04-20T10:55:05.312 INFO:tasks.workunit.client.1.smithi175.stdout:9/671: truncate d6/d10/f77 601077 0 2024-04-20T10:55:05.314 INFO:tasks.workunit.client.1.smithi175.stdout:2/639: sync 2024-04-20T10:55:05.315 INFO:tasks.workunit.client.1.smithi175.stdout:6/789: rename d1/d5/d12/d73/fcd to d1/dc0/d63/f103 0 2024-04-20T10:55:05.316 INFO:tasks.workunit.client.1.smithi175.stdout:4/808: dread d4/f38 [0,4194304] 0 2024-04-20T10:55:05.317 INFO:tasks.workunit.client.1.smithi175.stdout:6/790: getdents d1/dc0/d29 0 2024-04-20T10:55:05.318 INFO:tasks.workunit.client.1.smithi175.stdout:4/809: getdents d4/dd/d2d/d33/d5b/d65 0 2024-04-20T10:55:05.318 INFO:tasks.workunit.client.1.smithi175.stdout:4/810: chown d4/dd/d54/d5d/c7d 645076 1 2024-04-20T10:55:05.327 INFO:tasks.workunit.client.1.smithi175.stdout:9/672: read d6/d1b/f24 [5590115,11548] 0 2024-04-20T10:55:05.327 INFO:tasks.workunit.client.1.smithi175.stdout:9/673: read d6/d1b/f57 [3682545,14349] 0 2024-04-20T10:55:05.327 INFO:tasks.workunit.client.1.smithi175.stdout:9/674: write d6/d33/d63/f73 [1547255,129961] 0 2024-04-20T10:55:05.328 INFO:tasks.workunit.client.1.smithi175.stdout:2/640: mknod d1/d48/cd7 0 2024-04-20T10:55:05.329 INFO:tasks.workunit.client.1.smithi175.stdout:9/675: dread d6/d1b/d42/d51/f9a [0,4194304] 0 2024-04-20T10:55:05.329 INFO:tasks.workunit.client.1.smithi175.stdout:6/791: unlink d1/dc0/l5b 0 2024-04-20T10:55:05.339 INFO:tasks.workunit.client.1.smithi175.stdout:9/676: write d6/d1b/d42/f44 [2268041,72083] 0 2024-04-20T10:55:05.339 INFO:tasks.workunit.client.1.smithi175.stdout:4/811: dwrite d4/dd/d54/d5d/d8a/fde [0,4194304] 0 2024-04-20T10:55:05.342 INFO:tasks.workunit.client.1.smithi175.stdout:6/792: creat d1/d37/d83/f104 x:0 0 0 2024-04-20T10:55:05.351 INFO:tasks.workunit.client.1.smithi175.stdout:2/641: dread d1/d48/f31 [8388608,4194304] 0 2024-04-20T10:55:05.352 INFO:tasks.workunit.client.1.smithi175.stdout:9/677: mkdir d6/d1b/d42/d51/dca 0 2024-04-20T10:55:05.353 INFO:tasks.workunit.client.1.smithi175.stdout:6/793: write d1/d5/f45 [1960657,30467] 0 2024-04-20T10:55:05.353 INFO:tasks.workunit.client.1.smithi175.stdout:2/642: mknod d1/d7/d63/d4b/d8a/cd8 0 2024-04-20T10:55:05.354 INFO:tasks.workunit.client.1.smithi175.stdout:6/794: dread d1/dc0/d29/ffa [0,4194304] 0 2024-04-20T10:55:05.356 INFO:tasks.workunit.client.1.smithi175.stdout:6/795: creat d1/d37/d83/db8/d60/d68/d7e/f105 x:0 0 0 2024-04-20T10:55:05.358 INFO:tasks.workunit.client.1.smithi175.stdout:2/643: dread d1/d7/f5b [0,4194304] 0 2024-04-20T10:55:05.361 INFO:tasks.workunit.client.1.smithi175.stdout:9/678: rename d6/d1b/d26/d8c/dc6/dc8 to d6/dcb 0 2024-04-20T10:55:05.391 INFO:tasks.workunit.client.1.smithi175.stdout:2/644: rename d1/d48/d21/db6/dc1 to d1/d7/d63/d4b/d8a/dd9 0 2024-04-20T10:55:05.392 INFO:tasks.workunit.client.1.smithi175.stdout:9/679: unlink d6/d1b/f57 0 2024-04-20T10:55:05.412 INFO:tasks.workunit.client.1.smithi175.stdout:9/680: dwrite d6/d33/d60/f9d [0,4194304] 0 2024-04-20T10:55:05.412 INFO:tasks.workunit.client.1.smithi175.stdout:9/681: getdents d6/d58/d90/daa/dbd 0 2024-04-20T10:55:05.413 INFO:tasks.workunit.client.1.smithi175.stdout:2/645: dwrite d1/d48/f3b [4194304,4194304] 0 2024-04-20T10:55:05.418 INFO:tasks.workunit.client.1.smithi175.stdout:4/812: write d4/d23/d2e/f63 [236258,122702] 0 2024-04-20T10:55:05.421 INFO:tasks.workunit.client.1.smithi175.stdout:4/813: dread d4/dd/d2d/d33/d3c/fa9 [0,4194304] 0 2024-04-20T10:55:05.421 INFO:tasks.workunit.client.1.smithi175.stdout:4/814: stat d4/dd/d5e/d74/fc1 0 2024-04-20T10:55:05.469 INFO:tasks.workunit.client.1.smithi175.stdout:2/646: link d1/d48/lac d1/d7/d63/d36/d7d/d80/lda 0 2024-04-20T10:55:05.469 INFO:tasks.workunit.client.1.smithi175.stdout:2/647: stat d1/d48/d21/db6/cbf 0 2024-04-20T10:55:05.469 INFO:tasks.workunit.client.1.smithi175.stdout:4/815: getdents d4/dd/d54/d5d/d79/d9d/dd4 0 2024-04-20T10:55:05.502 INFO:tasks.workunit.client.1.smithi175.stdout:2/648: unlink d1/d48/d21/l4f 0 2024-04-20T10:55:05.503 INFO:tasks.workunit.client.1.smithi175.stdout:8/697: sync 2024-04-20T10:55:05.503 INFO:tasks.workunit.client.1.smithi175.stdout:1/763: sync 2024-04-20T10:55:05.505 INFO:tasks.workunit.client.1.smithi175.stdout:2/649: creat d1/d6a/d74/dc7/fdb x:0 0 0 2024-04-20T10:55:05.505 INFO:tasks.workunit.client.1.smithi175.stdout:2/650: readlink d1/d7/d63/d36/d7d/d84/l89 0 2024-04-20T10:55:05.506 INFO:tasks.workunit.client.1.smithi175.stdout:1/764: mknod d0/d57/db7/df5/d105/c10b 0 2024-04-20T10:55:05.507 INFO:tasks.workunit.client.1.smithi175.stdout:8/698: mknod d7/d13/d1d/d24/d38/db6/ce0 0 2024-04-20T10:55:05.531 INFO:tasks.workunit.client.1.smithi175.stdout:2/651: dwrite d1/d48/d21/d76/f2c [0,4194304] 0 2024-04-20T10:55:05.532 INFO:tasks.workunit.client.1.smithi175.stdout:1/765: rename d0/d8/d13/l55 to d0/d8/d13/d2e/d35/d8a/l10c 0 2024-04-20T10:55:05.547 INFO:tasks.workunit.client.1.smithi175.stdout:1/766: dwrite d0/d8/d13/d79/ffc [0,4194304] 0 2024-04-20T10:55:05.547 INFO:tasks.workunit.client.1.smithi175.stdout:8/699: symlink d7/d13/da3/le1 0 2024-04-20T10:55:05.548 INFO:tasks.workunit.client.1.smithi175.stdout:2/652: creat d1/d48/d21/d76/fdc x:0 0 0 2024-04-20T10:55:05.551 INFO:tasks.workunit.client.1.smithi175.stdout:1/767: unlink d0/d8/d13/d2e/f5b 0 2024-04-20T10:55:05.553 INFO:tasks.workunit.client.1.smithi175.stdout:1/768: dread d0/d8/f7e [0,4194304] 0 2024-04-20T10:55:05.553 INFO:tasks.workunit.client.1.smithi175.stdout:1/769: fsync d0/d8/d13/d2e/f46 0 2024-04-20T10:55:05.553 INFO:tasks.workunit.client.1.smithi175.stdout:1/770: chown d0/d8/f28 18064025 1 2024-04-20T10:55:05.553 INFO:tasks.workunit.client.1.smithi175.stdout:0/686: sync 2024-04-20T10:55:05.553 INFO:tasks.workunit.client.1.smithi175.stdout:3/558: sync 2024-04-20T10:55:05.553 INFO:tasks.workunit.client.1.smithi175.stdout:3/559: chown d7/d21/d16/d22/d2c/d1f/l9e 5 1 2024-04-20T10:55:05.553 INFO:tasks.workunit.client.1.smithi175.stdout:0/687: dread - df/d1a/d22/d6a/d72/d7f/fbf zero size 2024-04-20T10:55:05.554 INFO:tasks.workunit.client.1.smithi175.stdout:2/653: creat d1/d7/d63/d36/d7d/d84/d8b/fdd x:0 0 0 2024-04-20T10:55:05.555 INFO:tasks.workunit.client.1.smithi175.stdout:1/771: unlink d0/d3e/d61/f67 0 2024-04-20T10:55:05.555 INFO:tasks.workunit.client.1.smithi175.stdout:1/772: fsync d0/d8/d13/d79/ffc 0 2024-04-20T10:55:05.555 INFO:tasks.workunit.client.1.smithi175.stdout:1/773: write d0/d8/f4d [1476908,21542] 0 2024-04-20T10:55:05.556 INFO:tasks.workunit.client.1.smithi175.stdout:8/700: rename d7/d13/d1d/f4e to d7/d13/d1d/d56/fe2 0 2024-04-20T10:55:05.556 INFO:tasks.workunit.client.1.smithi175.stdout:3/560: creat d7/d21/fb1 x:0 0 0 2024-04-20T10:55:05.558 INFO:tasks.workunit.client.1.smithi175.stdout:8/701: creat d7/d13/d1d/d24/d38/d73/db5/fe3 x:0 0 0 2024-04-20T10:55:05.562 INFO:tasks.workunit.client.1.smithi175.stdout:0/688: dread df/d1a/f27 [0,4194304] 0 2024-04-20T10:55:05.563 INFO:tasks.workunit.client.1.smithi175.stdout:2/654: rename d1/d48/d21/d29/cb2 to d1/d48/d21/d29/cde 0 2024-04-20T10:55:05.564 INFO:tasks.workunit.client.1.smithi175.stdout:1/774: creat d0/de8/f10d x:0 0 0 2024-04-20T10:55:05.565 INFO:tasks.workunit.client.1.smithi175.stdout:0/689: unlink df/d1a/d3f/d5e/fa8 0 2024-04-20T10:55:05.580 INFO:tasks.workunit.client.1.smithi175.stdout:8/702: dwrite d7/d13/d1d/d92/fa8 [0,4194304] 0 2024-04-20T10:55:05.580 INFO:tasks.workunit.client.1.smithi175.stdout:3/561: dwrite d7/d21/d16/d22/d2c/d1f/d48/f9c [0,4194304] 0 2024-04-20T10:55:05.580 INFO:tasks.workunit.client.1.smithi175.stdout:8/703: dread d7/d13/d1d/d24/d63/f7f [0,4194304] 0 2024-04-20T10:55:05.599 INFO:tasks.workunit.client.1.smithi175.stdout:8/704: dwrite d7/d13/d1d/d24/d39/f7a [0,4194304] 0 2024-04-20T10:55:05.820 INFO:tasks.workunit.client.1.smithi175.stdout:2/655: creat d1/d48/d21/d29/fdf x:0 0 0 2024-04-20T10:55:05.821 INFO:tasks.workunit.client.1.smithi175.stdout:1/775: creat d0/d8/d13/f10e x:0 0 0 2024-04-20T10:55:05.821 INFO:tasks.workunit.client.1.smithi175.stdout:0/690: symlink df/d1a/da1/ldb 0 2024-04-20T10:55:05.825 INFO:tasks.workunit.client.1.smithi175.stdout:3/562: mkdir d7/d19/d33/d60/d79/d99/dac/dad/db2 0 2024-04-20T10:55:05.841 INFO:tasks.workunit.client.1.smithi175.stdout:3/563: dwrite d7/d21/d16/d22/d2c/d1f/d48/f90 [0,4194304] 0 2024-04-20T10:55:05.841 INFO:tasks.workunit.client.1.smithi175.stdout:3/564: dread - d7/d21/d16/d22/d2c/fa7 zero size 2024-04-20T10:55:05.841 INFO:tasks.workunit.client.1.smithi175.stdout:3/565: fsync d7/d21/d16/d22/d2c/d1f/d48/f9c 0 2024-04-20T10:55:05.857 INFO:tasks.workunit.client.1.smithi175.stdout:3/566: dwrite d7/d19/d33/d60/f6c [0,4194304] 0 2024-04-20T10:55:06.085 INFO:tasks.workunit.client.1.smithi175.stdout:1/776: creat d0/d51/f10f x:0 0 0 2024-04-20T10:55:06.085 INFO:tasks.workunit.client.1.smithi175.stdout:0/691: symlink df/d17/d2f/d4f/dcd/ldc 0 2024-04-20T10:55:06.085 INFO:tasks.workunit.client.1.smithi175.stdout:8/705: symlink d7/d13/le4 0 2024-04-20T10:55:06.085 INFO:tasks.workunit.client.1.smithi175.stdout:8/706: write d7/d13/d1d/d24/d38/f57 [794139,36483] 0 2024-04-20T10:55:06.085 INFO:tasks.workunit.client.1.smithi175.stdout:2/656: mkdir d1/d48/d38/de0 0 2024-04-20T10:55:06.086 INFO:tasks.workunit.client.1.smithi175.stdout:5/926: sync 2024-04-20T10:55:06.086 INFO:tasks.workunit.client.1.smithi175.stdout:7/838: sync 2024-04-20T10:55:06.086 INFO:tasks.workunit.client.1.smithi175.stdout:6/796: sync 2024-04-20T10:55:06.087 INFO:tasks.workunit.client.1.smithi175.stdout:6/797: chown d1/d37/d83/db8/d60/ded/c64 42514 1 2024-04-20T10:55:06.087 INFO:tasks.workunit.client.1.smithi175.stdout:4/816: sync 2024-04-20T10:55:06.087 INFO:tasks.workunit.client.1.smithi175.stdout:6/798: write d1/faa [374753,32575] 0 2024-04-20T10:55:06.087 INFO:tasks.workunit.client.1.smithi175.stdout:9/682: sync 2024-04-20T10:55:06.087 INFO:tasks.workunit.client.1.smithi175.stdout:6/799: write d1/d5/d12/d7f/dae/fce [1039142,84220] 0 2024-04-20T10:55:06.087 INFO:tasks.workunit.client.1.smithi175.stdout:3/567: unlink d7/d21/d16/d22/d2c/d1f/l5a 0 2024-04-20T10:55:06.088 INFO:tasks.workunit.client.1.smithi175.stdout:1/777: link d0/d8/d13/d2e/d35/l4c d0/d3e/l110 0 2024-04-20T10:55:06.088 INFO:tasks.workunit.client.1.smithi175.stdout:1/778: chown d0/d51/le1 23313992 1 2024-04-20T10:55:06.090 INFO:tasks.workunit.client.1.smithi175.stdout:0/692: truncate df/d1a/d22/d6a/d72/d48/d4e/f69 59489 0 2024-04-20T10:55:06.090 INFO:tasks.workunit.client.1.smithi175.stdout:3/568: dread d7/d21/f76 [4194304,4194304] 0 2024-04-20T10:55:06.090 INFO:tasks.workunit.client.1.smithi175.stdout:3/569: fsync d7/d21/fb 0 2024-04-20T10:55:06.092 INFO:tasks.workunit.client.1.smithi175.stdout:8/707: creat d7/d13/d1d/d24/d63/fe5 x:0 0 0 2024-04-20T10:55:06.094 INFO:tasks.workunit.client.1.smithi175.stdout:2/657: mkdir d1/d48/d38/d82/de1 0 2024-04-20T10:55:06.094 INFO:tasks.workunit.client.1.smithi175.stdout:2/658: fdatasync d1/d53/f7c 0 2024-04-20T10:55:06.094 INFO:tasks.workunit.client.1.smithi175.stdout:0/693: dread df/d1a/d22/d6a/d72/f94 [0,4194304] 0 2024-04-20T10:55:06.095 INFO:tasks.workunit.client.1.smithi175.stdout:0/694: readlink df/d1a/d22/d6a/lb1 0 2024-04-20T10:55:06.097 INFO:tasks.workunit.client.1.smithi175.stdout:5/927: unlink db/d11/d25/d38/d40/d66/fa3 0 2024-04-20T10:55:06.098 INFO:tasks.workunit.client.1.smithi175.stdout:7/839: getdents db/d1d/d39/d50/dba/d47/da6/db9/dc8 0 2024-04-20T10:55:06.098 INFO:tasks.workunit.client.1.smithi175.stdout:3/570: write d7/d10/d8c/fb0 [250940,73146] 0 2024-04-20T10:55:06.100 INFO:tasks.workunit.client.1.smithi175.stdout:4/817: creat d4/dd/d2d/d33/f111 x:0 0 0 2024-04-20T10:55:06.100 INFO:tasks.workunit.client.1.smithi175.stdout:9/683: rmdir d6/d1b/d42/d5b 39 2024-04-20T10:55:06.100 INFO:tasks.workunit.client.1.smithi175.stdout:6/800: symlink d1/dc0/d29/l106 0 2024-04-20T10:55:06.101 INFO:tasks.workunit.client.1.smithi175.stdout:6/801: fsync d1/dc0/f3c 0 2024-04-20T10:55:06.101 INFO:tasks.workunit.client.1.smithi175.stdout:1/779: fsync d0/d29/f4f 0 2024-04-20T10:55:06.101 INFO:tasks.workunit.client.1.smithi175.stdout:1/780: dread - d0/d8/d13/fbb zero size 2024-04-20T10:55:06.103 INFO:tasks.workunit.client.1.smithi175.stdout:0/695: unlink df/d1a/d22/d6a/d72/c90 0 2024-04-20T10:55:06.103 INFO:tasks.workunit.client.1.smithi175.stdout:0/696: truncate df/d17/d2f/f5b 1733775 0 2024-04-20T10:55:06.104 INFO:tasks.workunit.client.1.smithi175.stdout:5/928: getdents db/dc1/d4f/d5a 0 2024-04-20T10:55:06.104 INFO:tasks.workunit.client.1.smithi175.stdout:7/840: creat db/d61/d6d/d9c/de8/d8e/f122 x:0 0 0 2024-04-20T10:55:06.105 INFO:tasks.workunit.client.1.smithi175.stdout:9/684: truncate d6/d1b/d42/d5b/d72/d7d/f80 277717 0 2024-04-20T10:55:06.106 INFO:tasks.workunit.client.1.smithi175.stdout:1/781: getdents d0/d8/d13/db9 0 2024-04-20T10:55:06.107 INFO:tasks.workunit.client.1.smithi175.stdout:3/571: dread d7/f12 [0,4194304] 0 2024-04-20T10:55:06.108 INFO:tasks.workunit.client.1.smithi175.stdout:2/659: rename d1/d48/d38/d82/ld1 to d1/d7/d63/d4b/le2 0 2024-04-20T10:55:06.109 INFO:tasks.workunit.client.1.smithi175.stdout:5/929: symlink db/dc1/d4f/l13b 0 2024-04-20T10:55:06.110 INFO:tasks.workunit.client.1.smithi175.stdout:8/708: dwrite d7/d13/d1d/d24/d38/f7c [0,4194304] 0 2024-04-20T10:55:06.111 INFO:tasks.workunit.client.1.smithi175.stdout:7/841: mkdir db/d1d/d39/d50/dba/d47/da6/db9/dc8/d123 0 2024-04-20T10:55:06.112 INFO:tasks.workunit.client.1.smithi175.stdout:1/782: symlink d0/d51/da8/l111 0 2024-04-20T10:55:06.113 INFO:tasks.workunit.client.1.smithi175.stdout:6/802: dread d1/d5/d12/f35 [0,4194304] 0 2024-04-20T10:55:06.113 INFO:tasks.workunit.client.1.smithi175.stdout:6/803: readlink d1/d37/d83/db8/d60/lbf 0 2024-04-20T10:55:06.113 INFO:tasks.workunit.client.1.smithi175.stdout:6/804: truncate d1/dc0/d29/f55 3591471 0 2024-04-20T10:55:06.113 INFO:tasks.workunit.client.1.smithi175.stdout:6/805: fsync d1/dc0/d63/d7c/fd0 0 2024-04-20T10:55:06.114 INFO:tasks.workunit.client.1.smithi175.stdout:2/660: creat d1/d7/fe3 x:0 0 0 2024-04-20T10:55:06.114 INFO:tasks.workunit.client.1.smithi175.stdout:2/661: fsync d1/d7/d63/d4b/f77 0 2024-04-20T10:55:06.117 INFO:tasks.workunit.client.1.smithi175.stdout:5/930: unlink db/d11/d80/dc3/ce7 0 2024-04-20T10:55:06.118 INFO:tasks.workunit.client.1.smithi175.stdout:7/842: rmdir db/d1d/d39/d50 39 2024-04-20T10:55:06.121 INFO:tasks.workunit.client.1.smithi175.stdout:3/572: symlink d7/d19/d33/lb3 0 2024-04-20T10:55:06.121 INFO:tasks.workunit.client.1.smithi175.stdout:3/573: chown d7/d21/d16/d22/d2c/d1f/l6e 136544 1 2024-04-20T10:55:06.121 INFO:tasks.workunit.client.1.smithi175.stdout:2/662: truncate d1/fad 55288 0 2024-04-20T10:55:06.122 INFO:tasks.workunit.client.1.smithi175.stdout:8/709: write d7/d13/d1d/d92/d6c/f97 [1526711,26268] 0 2024-04-20T10:55:06.124 INFO:tasks.workunit.client.1.smithi175.stdout:4/818: rename d4/dd/d5e/d74/fd1 to d4/dd/d54/d5d/d79/f112 0 2024-04-20T10:55:06.128 INFO:tasks.workunit.client.1.smithi175.stdout:6/806: dread d1/d37/d83/db8/d60/d6b/f7d [0,4194304] 0 2024-04-20T10:55:06.128 INFO:tasks.workunit.client.1.smithi175.stdout:6/807: readlink d1/d37/d83/db8/db9/le6 0 2024-04-20T10:55:06.128 INFO:tasks.workunit.client.1.smithi175.stdout:6/808: chown d1/d5/d12/l20 88 1 2024-04-20T10:55:06.128 INFO:tasks.workunit.client.1.smithi175.stdout:6/809: chown d1/d5/d12/d73/d7a/l90 3 1 2024-04-20T10:55:06.128 INFO:tasks.workunit.client.1.smithi175.stdout:3/574: stat d7/d10/c4e 0 2024-04-20T10:55:06.128 INFO:tasks.workunit.client.1.smithi175.stdout:3/575: chown d7/d21 9571024 1 2024-04-20T10:55:06.129 INFO:tasks.workunit.client.1.smithi175.stdout:2/663: creat d1/d6a/d74/dc7/fe4 x:0 0 0 2024-04-20T10:55:06.131 INFO:tasks.workunit.client.1.smithi175.stdout:8/710: mkdir d7/d13/d1d/d92/d6c/de6 0 2024-04-20T10:55:06.133 INFO:tasks.workunit.client.1.smithi175.stdout:4/819: link d4/dd/d54/d5d/d8a/da4/fb5 d4/dd/d2d/d33/d5b/d65/f113 0 2024-04-20T10:55:06.133 INFO:tasks.workunit.client.1.smithi175.stdout:9/685: dwrite d6/d58/d90/fa3 [0,4194304] 0 2024-04-20T10:55:06.133 INFO:tasks.workunit.client.1.smithi175.stdout:9/686: write d6/f1d [1753596,43836] 0 2024-04-20T10:55:06.136 INFO:tasks.workunit.client.1.smithi175.stdout:1/783: dwrite d0/d29/f4f [4194304,4194304] 0 2024-04-20T10:55:06.136 INFO:tasks.workunit.client.1.smithi175.stdout:1/784: readlink d0/d57/d7a/l9b 0 2024-04-20T10:55:06.136 INFO:tasks.workunit.client.1.smithi175.stdout:1/785: dread - d0/d57/d7a/fdc zero size 2024-04-20T10:55:06.136 INFO:tasks.workunit.client.1.smithi175.stdout:5/931: mknod db/dc1/d4f/d75/c13c 0 2024-04-20T10:55:06.136 INFO:tasks.workunit.client.1.smithi175.stdout:5/932: write db/d30/d46/fab [2874875,47221] 0 2024-04-20T10:55:06.139 INFO:tasks.workunit.client.1.smithi175.stdout:3/576: getdents d7/d19/d33/d7e/da5 0 2024-04-20T10:55:06.143 INFO:tasks.workunit.client.1.smithi175.stdout:4/820: link d4/dd/d5e/d74/l10c d4/dd/d5e/d74/da1/dc0/l114 0 2024-04-20T10:55:06.143 INFO:tasks.workunit.client.1.smithi175.stdout:8/711: write d7/d13/d1d/d24/d38/f7c [704051,57820] 0 2024-04-20T10:55:06.145 INFO:tasks.workunit.client.1.smithi175.stdout:4/821: dread d4/dd/d54/d5d/d8a/f9c [0,4194304] 0 2024-04-20T10:55:06.145 INFO:tasks.workunit.client.1.smithi175.stdout:4/822: chown d4/dd/d54/d5d/d79/d9d/fef 12 1 2024-04-20T10:55:06.146 INFO:tasks.workunit.client.1.smithi175.stdout:1/786: creat d0/d51/d6b/d9e/f112 x:0 0 0 2024-04-20T10:55:06.147 INFO:tasks.workunit.client.1.smithi175.stdout:7/843: dwrite db/d61/d6d/f7c [4194304,4194304] 0 2024-04-20T10:55:06.147 INFO:tasks.workunit.client.1.smithi175.stdout:7/844: fdatasync db/d61/d6d/d9c/de8/d2a/d41/d59/fd1 0 2024-04-20T10:55:06.149 INFO:tasks.workunit.client.1.smithi175.stdout:5/933: creat db/d11/dfe/f13d x:0 0 0 2024-04-20T10:55:06.150 INFO:tasks.workunit.client.1.smithi175.stdout:6/810: dwrite d1/dc0/f5e [0,4194304] 0 2024-04-20T10:55:06.152 INFO:tasks.workunit.client.1.smithi175.stdout:3/577: truncate d7/d21/d16/d22/d2c/d1f/d48/f53 22245 0 2024-04-20T10:55:06.154 INFO:tasks.workunit.client.1.smithi175.stdout:2/664: link d1/d48/d21/d76/f42 d1/d48/d38/fe5 0 2024-04-20T10:55:06.155 INFO:tasks.workunit.client.1.smithi175.stdout:6/811: write d1/d37/d83/db8/d60/fac [1502438,2514] 0 2024-04-20T10:55:06.156 INFO:tasks.workunit.client.1.smithi175.stdout:8/712: symlink d7/d13/d1d/d24/d38/d73/le7 0 2024-04-20T10:55:06.157 INFO:tasks.workunit.client.1.smithi175.stdout:8/713: write d7/d13/f50 [2780130,106493] 0 2024-04-20T10:55:06.159 INFO:tasks.workunit.client.1.smithi175.stdout:4/823: rename d4/dd/d2d/d43/dc7 to d4/dd/dba/d115 0 2024-04-20T10:55:06.164 INFO:tasks.workunit.client.1.smithi175.stdout:1/787: dwrite d0/d3e/d61/d73/fca [0,4194304] 0 2024-04-20T10:55:06.164 INFO:tasks.workunit.client.1.smithi175.stdout:7/845: unlink db/d61/d6d/d9c/de8/d2a/d41/c5b 0 2024-04-20T10:55:06.166 INFO:tasks.workunit.client.1.smithi175.stdout:5/934: rename db/d1f/d31/f109 to db/d1f/d31/f13e 0 2024-04-20T10:55:06.174 INFO:tasks.workunit.client.1.smithi175.stdout:5/935: read db/d30/d46/fd2 [1098912,123063] 0 2024-04-20T10:55:06.177 INFO:tasks.workunit.client.1.smithi175.stdout:4/824: rename d4/dd/d54/d5f/l94 to d4/dd/d2d/d43/d69/d83/dcf/l116 0 2024-04-20T10:55:06.177 INFO:tasks.workunit.client.1.smithi175.stdout:4/825: stat d4/d27/l37 0 2024-04-20T10:55:06.178 INFO:tasks.workunit.client.1.smithi175.stdout:7/846: unlink db/d1d/d39/d50/dba/d47/da6/db9/dc8/fd7 0 2024-04-20T10:55:06.179 INFO:tasks.workunit.client.1.smithi175.stdout:0/697: dwrite df/d17/f20 [4194304,4194304] 0 2024-04-20T10:55:06.180 INFO:tasks.workunit.client.1.smithi175.stdout:3/578: mknod d7/d19/d33/d60/d79/d99/cb4 0 2024-04-20T10:55:06.181 INFO:tasks.workunit.client.1.smithi175.stdout:8/714: dwrite d7/d13/d1d/d24/d38/d73/fa1 [0,4194304] 0 2024-04-20T10:55:06.181 INFO:tasks.workunit.client.1.smithi175.stdout:2/665: mknod d1/d7/d63/d36/ce6 0 2024-04-20T10:55:06.184 INFO:tasks.workunit.client.1.smithi175.stdout:1/788: rename d0/d51/d6b/d9e/lfd to d0/d8/d13/db9/l113 0 2024-04-20T10:55:06.185 INFO:tasks.workunit.client.1.smithi175.stdout:4/826: symlink d4/dd/d5e/d96/dd7/l117 0 2024-04-20T10:55:06.185 INFO:tasks.workunit.client.1.smithi175.stdout:4/827: write d4/d27/d8c/f107 [256830,51601] 0 2024-04-20T10:55:06.185 INFO:tasks.workunit.client.1.smithi175.stdout:4/828: chown d4/dd/d54/d5d/f8e 183642 1 2024-04-20T10:55:06.188 INFO:tasks.workunit.client.1.smithi175.stdout:3/579: rmdir d7/d21/d16/d22/d2c/d1f 39 2024-04-20T10:55:06.197 INFO:tasks.workunit.client.1.smithi175.stdout:8/715: unlink d7/d13/d1d/d24/f95 0 2024-04-20T10:55:06.197 INFO:tasks.workunit.client.1.smithi175.stdout:8/716: dread - d7/fc3 zero size 2024-04-20T10:55:06.197 INFO:tasks.workunit.client.1.smithi175.stdout:8/717: read d7/d13/d1d/d24/d63/f9a [201055,50427] 0 2024-04-20T10:55:06.199 INFO:tasks.workunit.client.1.smithi175.stdout:2/666: creat d1/d48/d38/de0/fe7 x:0 0 0 2024-04-20T10:55:06.200 INFO:tasks.workunit.client.1.smithi175.stdout:5/936: dwrite db/d11/d25/d41/d60/f116 [0,4194304] 0 2024-04-20T10:55:06.201 INFO:tasks.workunit.client.1.smithi175.stdout:1/789: mkdir d0/d8/dcb/d114 0 2024-04-20T10:55:06.201 INFO:tasks.workunit.client.1.smithi175.stdout:7/847: dwrite db/d61/d6d/d9c/de8/fab [0,4194304] 0 2024-04-20T10:55:06.202 INFO:tasks.workunit.client.1.smithi175.stdout:4/829: truncate d4/dd/d2d/f4c 1487864 0 2024-04-20T10:55:06.205 INFO:tasks.workunit.client.1.smithi175.stdout:2/667: dread d1/d7/d63/f7b [0,4194304] 0 2024-04-20T10:55:06.207 INFO:tasks.workunit.client.1.smithi175.stdout:8/718: symlink d7/d13/d1d/d24/d39/d6f/db7/dce/le8 0 2024-04-20T10:55:06.208 INFO:tasks.workunit.client.1.smithi175.stdout:1/790: stat d0/d8/dcb/lf2 0 2024-04-20T10:55:06.212 INFO:tasks.workunit.client.1.smithi175.stdout:6/812: dwrite d1/d5/d12/d73/d7a/dee/fa0 [0,4194304] 0 2024-04-20T10:55:06.213 INFO:tasks.workunit.client.1.smithi175.stdout:6/813: stat d1/dc0/d49/fa6 0 2024-04-20T10:55:06.213 INFO:tasks.workunit.client.1.smithi175.stdout:7/848: dread db/d61/d6d/d9c/de8/d2a/f87 [0,4194304] 0 2024-04-20T10:55:06.213 INFO:tasks.workunit.client.1.smithi175.stdout:7/849: dread - db/d61/d6d/d9c/de8/d2a/d41/d59/fd1 zero size 2024-04-20T10:55:06.213 INFO:tasks.workunit.client.1.smithi175.stdout:4/830: rename d4/dd/d2d/d33/d3c/fa9 to d4/d27/d8c/d10f/f118 0 2024-04-20T10:55:06.214 INFO:tasks.workunit.client.1.smithi175.stdout:3/580: mkdir d7/d21/d16/d49/db5 0 2024-04-20T10:55:06.215 INFO:tasks.workunit.client.1.smithi175.stdout:2/668: rmdir d1/d48/d21/db6 39 2024-04-20T10:55:06.215 INFO:tasks.workunit.client.1.smithi175.stdout:2/669: chown d1/d48/d21/d29/f6c 55 1 2024-04-20T10:55:06.215 INFO:tasks.workunit.client.1.smithi175.stdout:2/670: write d1/d48/d21/d29/fdf [431698,6538] 0 2024-04-20T10:55:06.216 INFO:tasks.workunit.client.1.smithi175.stdout:2/671: chown d1/d6a/d74/dc7 1003 1 2024-04-20T10:55:06.216 INFO:tasks.workunit.client.1.smithi175.stdout:1/791: creat d0/d8/dcb/f115 x:0 0 0 2024-04-20T10:55:06.220 INFO:tasks.workunit.client.1.smithi175.stdout:6/814: creat d1/d37/dfd/f107 x:0 0 0 2024-04-20T10:55:06.222 INFO:tasks.workunit.client.1.smithi175.stdout:7/850: creat db/d1d/d39/d50/dba/daa/f124 x:0 0 0 2024-04-20T10:55:06.223 INFO:tasks.workunit.client.1.smithi175.stdout:4/831: rmdir d4/dd/d5e/d74 39 2024-04-20T10:55:06.223 INFO:tasks.workunit.client.1.smithi175.stdout:4/832: chown d4/d27/d8c/cae 3 1 2024-04-20T10:55:06.224 INFO:tasks.workunit.client.1.smithi175.stdout:3/581: mknod d7/d21/d16/d22/d2c/d1f/cb6 0 2024-04-20T10:55:06.225 INFO:tasks.workunit.client.1.smithi175.stdout:2/672: getdents d1/d48/d21/d76/da8 0 2024-04-20T10:55:06.227 INFO:tasks.workunit.client.1.smithi175.stdout:1/792: link d0/d57/d7a/fdc d0/d51/d6b/d9e/de0/f116 0 2024-04-20T10:55:06.227 INFO:tasks.workunit.client.1.smithi175.stdout:1/793: write d0/d8/d13/d2e/fde [666007,14743] 0 2024-04-20T10:55:06.233 INFO:tasks.workunit.client.1.smithi175.stdout:8/719: dwrite d7/d13/d1d/d92/d6c/f97 [4194304,4194304] 0 2024-04-20T10:55:06.236 INFO:tasks.workunit.client.1.smithi175.stdout:0/698: dwrite df/d19/f51 [0,4194304] 0 2024-04-20T10:55:06.236 INFO:tasks.workunit.client.1.smithi175.stdout:5/937: dwrite db/d1f/d31/f13e [0,4194304] 0 2024-04-20T10:55:06.236 INFO:tasks.workunit.client.1.smithi175.stdout:8/720: dread d7/fd [0,4194304] 0 2024-04-20T10:55:06.246 INFO:tasks.workunit.client.1.smithi175.stdout:3/582: dwrite d7/d21/d16/d22/d2c/d1f/f5b [0,4194304] 0 2024-04-20T10:55:06.246 INFO:tasks.workunit.client.1.smithi175.stdout:3/583: write d7/d21/d16/d22/d2c/d91/fa1 [655194,65521] 0 2024-04-20T10:55:06.246 INFO:tasks.workunit.client.1.smithi175.stdout:3/584: chown d7/d19/d33/d7e 26 1 2024-04-20T10:55:06.249 INFO:tasks.workunit.client.1.smithi175.stdout:5/938: write db/d30/d46/d88/f10f [1169028,38158] 0 2024-04-20T10:55:06.252 INFO:tasks.workunit.client.1.smithi175.stdout:3/585: dread d7/d21/d16/d22/faa [0,4194304] 0 2024-04-20T10:55:06.254 INFO:tasks.workunit.client.1.smithi175.stdout:3/586: write d7/d19/d33/d60/d79/d99/fab [535326,42143] 0 2024-04-20T10:55:06.484 INFO:tasks.workunit.client.1.smithi175.stdout:2/673: rmdir d1/d48/d38 39 2024-04-20T10:55:06.485 INFO:tasks.workunit.client.1.smithi175.stdout:6/815: mknod d1/dc0/d49/c108 0 2024-04-20T10:55:06.487 INFO:tasks.workunit.client.1.smithi175.stdout:8/721: creat d7/d13/d1d/d24/d63/dd9/fe9 x:0 0 0 2024-04-20T10:55:06.487 INFO:tasks.workunit.client.1.smithi175.stdout:8/722: chown d7/d13/d1d/d56/f71 71982926 1 2024-04-20T10:55:06.487 INFO:tasks.workunit.client.1.smithi175.stdout:8/723: stat d7/d13/d1d/d56/f96 0 2024-04-20T10:55:06.488 INFO:tasks.workunit.client.1.smithi175.stdout:3/587: creat d7/d21/d16/d22/d2c/d91/fb7 x:0 0 0 2024-04-20T10:55:06.495 INFO:tasks.workunit.client.1.smithi175.stdout:7/851: rename db/d1d/d39/d50/dba/c99 to db/d61/d6d/d9c/de8/d8f/dcc/c125 0 2024-04-20T10:55:06.495 INFO:tasks.workunit.client.1.smithi175.stdout:7/852: write db/d61/d6d/d9c/de8/d8e/f114 [1023140,4763] 0 2024-04-20T10:55:06.495 INFO:tasks.workunit.client.1.smithi175.stdout:7/853: write db/d61/d6d/d9c/de8/d8e/fbd [269031,97476] 0 2024-04-20T10:55:06.495 INFO:tasks.workunit.client.1.smithi175.stdout:4/833: mknod d4/dd/d2d/d33/d58/c119 0 2024-04-20T10:55:06.496 INFO:tasks.workunit.client.1.smithi175.stdout:2/674: creat d1/d53/fe8 x:0 0 0 2024-04-20T10:55:06.496 INFO:tasks.workunit.client.1.smithi175.stdout:2/675: chown d1/d7/d63/d36/d7d/d84/d8b/da7/fb8 1840714 1 2024-04-20T10:55:06.497 INFO:tasks.workunit.client.1.smithi175.stdout:1/794: symlink d0/d29/l117 0 2024-04-20T10:55:06.498 INFO:tasks.workunit.client.1.smithi175.stdout:6/816: truncate d1/d37/d83/db8/d60/ded/f44 782605 0 2024-04-20T10:55:06.499 INFO:tasks.workunit.client.1.smithi175.stdout:0/699: mkdir df/ddd 0 2024-04-20T10:55:06.499 INFO:tasks.workunit.client.1.smithi175.stdout:5/939: symlink db/d1f/l13f 0 2024-04-20T10:55:06.500 INFO:tasks.workunit.client.1.smithi175.stdout:5/940: truncate db/d11/d25/d38/d40/d66/f123 110169 0 2024-04-20T10:55:06.500 INFO:tasks.workunit.client.1.smithi175.stdout:3/588: creat d7/d21/d16/d85/fb8 x:0 0 0 2024-04-20T10:55:06.501 INFO:tasks.workunit.client.1.smithi175.stdout:7/854: fdatasync db/d1d/d39/f7a 0 2024-04-20T10:55:06.501 INFO:tasks.workunit.client.1.smithi175.stdout:7/855: dread - db/d61/d6d/d9c/de8/d2a/d41/f118 zero size 2024-04-20T10:55:06.502 INFO:tasks.workunit.client.1.smithi175.stdout:4/834: unlink d4/dd/d2d/d43/d69/fd0 0 2024-04-20T10:55:06.503 INFO:tasks.workunit.client.1.smithi175.stdout:2/676: mknod d1/d7/d63/d36/d7d/ce9 0 2024-04-20T10:55:06.505 INFO:tasks.workunit.client.1.smithi175.stdout:1/795: creat d0/d3e/f118 x:0 0 0 2024-04-20T10:55:06.505 INFO:tasks.workunit.client.1.smithi175.stdout:1/796: truncate d0/d8/d13/d2e/fa6 830750 0 2024-04-20T10:55:06.506 INFO:tasks.workunit.client.1.smithi175.stdout:6/817: rename d1/dc0/l54 to d1/d37/d83/db8/d60/ded/l109 0 2024-04-20T10:55:06.506 INFO:tasks.workunit.client.1.smithi175.stdout:6/818: write d1/d37/f61 [1512290,74826] 0 2024-04-20T10:55:06.508 INFO:tasks.workunit.client.1.smithi175.stdout:8/724: mknod d7/d13/d1d/d56/cea 0 2024-04-20T10:55:06.508 INFO:tasks.workunit.client.1.smithi175.stdout:8/725: write d7/d13/d1d/d24/d63/fe5 [112386,22372] 0 2024-04-20T10:55:06.510 INFO:tasks.workunit.client.1.smithi175.stdout:3/589: mkdir d7/d19/d33/d7e/d86/db9 0 2024-04-20T10:55:06.513 INFO:tasks.workunit.client.1.smithi175.stdout:7/856: creat db/d1d/d39/d50/dba/d47/da6/db9/f126 x:0 0 0 2024-04-20T10:55:06.515 INFO:tasks.workunit.client.1.smithi175.stdout:2/677: creat d1/d48/d21/db6/fea x:0 0 0 2024-04-20T10:55:06.515 INFO:tasks.workunit.client.1.smithi175.stdout:2/678: write d1/d6a/d74/dc7/fe4 [931960,43466] 0 2024-04-20T10:55:06.516 INFO:tasks.workunit.client.1.smithi175.stdout:1/797: mkdir d0/d57/db7/df5/d105/d119 0 2024-04-20T10:55:06.517 INFO:tasks.workunit.client.1.smithi175.stdout:6/819: mknod d1/d37/d83/db8/d60/d6b/c10a 0 2024-04-20T10:55:06.517 INFO:tasks.workunit.client.1.smithi175.stdout:6/820: readlink d1/d5/d12/le0 0 2024-04-20T10:55:06.518 INFO:tasks.workunit.client.1.smithi175.stdout:8/726: symlink d7/d13/d1d/d24/d38/d73/db5/ddb/leb 0 2024-04-20T10:55:06.520 INFO:tasks.workunit.client.1.smithi175.stdout:9/687: sync 2024-04-20T10:55:06.521 INFO:tasks.workunit.client.1.smithi175.stdout:4/835: mknod d4/dd/d54/d5d/d79/c11a 0 2024-04-20T10:55:06.521 INFO:tasks.workunit.client.1.smithi175.stdout:2/679: symlink d1/d48/d38/d82/leb 0 2024-04-20T10:55:06.523 INFO:tasks.workunit.client.1.smithi175.stdout:1/798: symlink d0/d3e/d61/d73/l11a 0 2024-04-20T10:55:06.523 INFO:tasks.workunit.client.1.smithi175.stdout:1/799: fsync d0/d8/d13/d2e/f97 0 2024-04-20T10:55:06.523 INFO:tasks.workunit.client.1.smithi175.stdout:1/800: chown d0/d51/d6b/fdb 6 1 2024-04-20T10:55:06.523 INFO:tasks.workunit.client.1.smithi175.stdout:5/941: dwrite db/d11/d6d/da1/dcc/fd4 [0,4194304] 0 2024-04-20T10:55:06.529 INFO:tasks.workunit.client.1.smithi175.stdout:9/688: rename d6/d33/d60 to d6/d1b/d42/d5b/d72/d7d/dcc 0 2024-04-20T10:55:06.529 INFO:tasks.workunit.client.1.smithi175.stdout:9/689: truncate d6/d1b/d26/f2b 1232107 0 2024-04-20T10:55:06.529 INFO:tasks.workunit.client.1.smithi175.stdout:4/836: creat d4/dd/d54/f11b x:0 0 0 2024-04-20T10:55:06.529 INFO:tasks.workunit.client.1.smithi175.stdout:4/837: fsync d4/dd/d2d/d33/fd9 0 2024-04-20T10:55:06.530 INFO:tasks.workunit.client.1.smithi175.stdout:8/727: dread d7/d13/f50 [0,4194304] 0 2024-04-20T10:55:06.530 INFO:tasks.workunit.client.1.smithi175.stdout:8/728: read - d7/d13/d1d/d24/d38/d73/fc8 zero size 2024-04-20T10:55:06.530 INFO:tasks.workunit.client.1.smithi175.stdout:8/729: truncate d7/d13/d1d/d24/d38/d73/fa2 553939 0 2024-04-20T10:55:06.530 INFO:tasks.workunit.client.1.smithi175.stdout:2/680: link d1/d48/d21/d29/f39 d1/d48/d21/d9c/fec 0 2024-04-20T10:55:06.532 INFO:tasks.workunit.client.1.smithi175.stdout:1/801: mknod d0/d8/dcb/c11b 0 2024-04-20T10:55:06.532 INFO:tasks.workunit.client.1.smithi175.stdout:4/838: write d4/dd/d2d/f4c [281055,12800] 0 2024-04-20T10:55:06.534 INFO:tasks.workunit.client.1.smithi175.stdout:6/821: mkdir d1/d37/d83/db8/d60/d68/d10b 0 2024-04-20T10:55:06.534 INFO:tasks.workunit.client.1.smithi175.stdout:5/942: dread db/f1b [0,4194304] 0 2024-04-20T10:55:06.534 INFO:tasks.workunit.client.1.smithi175.stdout:6/822: fdatasync d1/d5/fd2 0 2024-04-20T10:55:06.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/690: link d6/f4c d6/d1b/d42/d51/fcd 0 2024-04-20T10:55:06.541 INFO:tasks.workunit.client.1.smithi175.stdout:7/857: dwrite db/d1d/d39/d50/ff [0,4194304] 0 2024-04-20T10:55:06.542 INFO:tasks.workunit.client.1.smithi175.stdout:1/802: creat d0/d3e/f11c x:0 0 0 2024-04-20T10:55:06.542 INFO:tasks.workunit.client.1.smithi175.stdout:1/803: truncate d0/d8/d13/d79/d8c/fab 579492 0 2024-04-20T10:55:06.542 INFO:tasks.workunit.client.1.smithi175.stdout:5/943: dread - db/dc1/d4f/d75/d91/ff6 zero size 2024-04-20T10:55:06.543 INFO:tasks.workunit.client.1.smithi175.stdout:9/691: mkdir d6/dcb/dce 0 2024-04-20T10:55:06.544 INFO:tasks.workunit.client.1.smithi175.stdout:2/681: mkdir d1/d48/d38/ded 0 2024-04-20T10:55:06.545 INFO:tasks.workunit.client.1.smithi175.stdout:7/858: symlink db/d61/d6d/d9c/de8/d9a/dd2/d10d/l127 0 2024-04-20T10:55:06.546 INFO:tasks.workunit.client.1.smithi175.stdout:1/804: creat d0/d51/d6b/d9e/f11d x:0 0 0 2024-04-20T10:55:06.546 INFO:tasks.workunit.client.1.smithi175.stdout:1/805: chown d0/d8/d13/db9/l113 0 1 2024-04-20T10:55:06.547 INFO:tasks.workunit.client.1.smithi175.stdout:9/692: getdents d6/d58/d90/daa 0 2024-04-20T10:55:06.547 INFO:tasks.workunit.client.1.smithi175.stdout:9/693: stat d6/c3f 0 2024-04-20T10:55:06.547 INFO:tasks.workunit.client.1.smithi175.stdout:9/694: fdatasync d6/d1b/d42/f50 0 2024-04-20T10:55:06.547 INFO:tasks.workunit.client.1.smithi175.stdout:9/695: chown d6/d1b/d42/d51/d9f 2442490 1 2024-04-20T10:55:06.548 INFO:tasks.workunit.client.1.smithi175.stdout:2/682: truncate d1/d48/d38/f58 1154258 0 2024-04-20T10:55:06.551 INFO:tasks.workunit.client.1.smithi175.stdout:9/696: link d6/d1b/d2f/c69 d6/d1b/d42/d5b/d72/d7d/ccf 0 2024-04-20T10:55:06.551 INFO:tasks.workunit.client.1.smithi175.stdout:7/859: symlink db/d61/d6d/d9c/de8/d8e/l128 0 2024-04-20T10:55:06.553 INFO:tasks.workunit.client.1.smithi175.stdout:1/806: rename d0/fc6 to d0/d51/d6b/d9e/de0/f11e 0 2024-04-20T10:55:06.553 INFO:tasks.workunit.client.1.smithi175.stdout:8/730: dwrite d7/d13/d1d/d56/f62 [0,4194304] 0 2024-04-20T10:55:06.554 INFO:tasks.workunit.client.1.smithi175.stdout:9/697: truncate d6/d1b/d42/d5b/d72/d98/fb9 1573474 0 2024-04-20T10:55:06.554 INFO:tasks.workunit.client.1.smithi175.stdout:9/698: chown d6/d1b/d42 85375637 1 2024-04-20T10:55:06.555 INFO:tasks.workunit.client.1.smithi175.stdout:6/823: dwrite d1/dc0/f99 [0,4194304] 0 2024-04-20T10:55:06.556 INFO:tasks.workunit.client.1.smithi175.stdout:7/860: link db/d61/d6d/l83 db/d1d/d39/d50/dba/daa/df3/d105/l129 0 2024-04-20T10:55:06.556 INFO:tasks.workunit.client.1.smithi175.stdout:7/861: fdatasync db/d1d/d39/d50/dba/d47/da6/db9/fc2 0 2024-04-20T10:55:06.560 INFO:tasks.workunit.client.1.smithi175.stdout:1/807: unlink d0/d8/d13/db9/l113 0 2024-04-20T10:55:06.564 INFO:tasks.workunit.client.1.smithi175.stdout:8/731: mknod d7/d13/d1d/d24/d39/d6f/db7/dce/cec 0 2024-04-20T10:55:06.567 INFO:tasks.workunit.client.1.smithi175.stdout:1/808: chown d0/f1a 106325 1 2024-04-20T10:55:06.575 INFO:tasks.workunit.client.1.smithi175.stdout:7/862: dwrite db/d1d/d39/d50/dba/d47/f9b [8388608,4194304] 0 2024-04-20T10:55:06.575 INFO:tasks.workunit.client.1.smithi175.stdout:7/863: readlink db/d1d/d39/d50/ldc 0 2024-04-20T10:55:06.575 INFO:tasks.workunit.client.1.smithi175.stdout:7/864: stat db/d61/d6d/dbc 0 2024-04-20T10:55:06.583 INFO:tasks.workunit.client.1.smithi175.stdout:2/683: rename d1/d48/d21/d29 to d1/d7/d63/dee 0 2024-04-20T10:55:06.583 INFO:tasks.workunit.client.1.smithi175.stdout:2/684: fdatasync d1/d48/d21/d76/fdc 0 2024-04-20T10:55:06.585 INFO:tasks.workunit.client.1.smithi175.stdout:6/824: rename d1/d37/d83/db8/db9/ff9 to d1/dc0/d49/f10c 0 2024-04-20T10:55:06.585 INFO:tasks.workunit.client.1.smithi175.stdout:6/825: write d1/dc0/d63/d7c/fde [1355280,56842] 0 2024-04-20T10:55:06.586 INFO:tasks.workunit.client.1.smithi175.stdout:7/865: dread db/d61/d6d/dbc/f104 [0,4194304] 0 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:2/685: truncate d1/d7/f22 63589 0 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:2/686: write d1/d7/d63/dee/f24 [1954170,36640] 0 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:2/687: write d1/fad [775264,85920] 0 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:2/688: chown d1/d48/d38/de0 13583985 1 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:6/826: write d1/d5/d12/fd8 [443555,37383] 0 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:6/827: fdatasync d1/d5/d12/d73/d7a/f9a 0 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:6/828: chown d1/d5/d12/d73/d7a/fe9 24534 1 2024-04-20T10:55:06.587 INFO:tasks.workunit.client.1.smithi175.stdout:7/866: symlink db/d1d/d39/d50/dba/d47/da6/db9/l12a 0 2024-04-20T10:55:06.589 INFO:tasks.workunit.client.1.smithi175.stdout:2/689: creat d1/d7/d63/dee/fef x:0 0 0 2024-04-20T10:55:06.589 INFO:tasks.workunit.client.1.smithi175.stdout:2/690: write d1/d6a/d74/dc7/fdb [569187,109914] 0 2024-04-20T10:55:06.589 INFO:tasks.workunit.client.1.smithi175.stdout:6/829: mkdir d1/d37/d83/db8/d60/d6b/d10d 0 2024-04-20T10:55:06.590 INFO:tasks.workunit.client.1.smithi175.stdout:2/691: creat d1/ff0 x:0 0 0 2024-04-20T10:55:06.590 INFO:tasks.workunit.client.1.smithi175.stdout:2/692: fsync d1/d7/f72 0 2024-04-20T10:55:06.592 INFO:tasks.workunit.client.1.smithi175.stdout:6/830: link d1/d5/d12/f27 d1/d37/d83/db8/db9/f10e 0 2024-04-20T10:55:06.593 INFO:tasks.workunit.client.1.smithi175.stdout:2/693: rename d1/d48/d21/db6/fea to d1/d7/d63/d36/d7d/d80/ff1 0 2024-04-20T10:55:06.595 INFO:tasks.workunit.client.1.smithi175.stdout:8/732: dwrite d7/d13/d1d/d24/d39/d6f/f90 [0,4194304] 0 2024-04-20T10:55:06.595 INFO:tasks.workunit.client.1.smithi175.stdout:6/831: unlink d1/d5/fa 0 2024-04-20T10:55:06.599 INFO:tasks.workunit.client.1.smithi175.stdout:1/809: dwrite d0/d57/fc3 [0,4194304] 0 2024-04-20T10:55:06.599 INFO:tasks.workunit.client.1.smithi175.stdout:6/832: dread d1/d5/d12/d73/d7a/f80 [0,4194304] 0 2024-04-20T10:55:06.600 INFO:tasks.workunit.client.1.smithi175.stdout:2/694: symlink d1/d7/d63/dee/lf2 0 2024-04-20T10:55:06.601 INFO:tasks.workunit.client.1.smithi175.stdout:0/700: dwrite df/f1c [4194304,4194304] 0 2024-04-20T10:55:06.601 INFO:tasks.workunit.client.1.smithi175.stdout:0/701: readlink df/d1a/d28/l2c 0 2024-04-20T10:55:06.601 INFO:tasks.workunit.client.1.smithi175.stdout:1/810: mknod d0/d8/d13/d2e/d35/d8a/d91/c11f 0 2024-04-20T10:55:06.602 INFO:tasks.workunit.client.1.smithi175.stdout:6/833: rmdir d1/d5/d12/d73/d7a 39 2024-04-20T10:55:06.605 INFO:tasks.workunit.client.1.smithi175.stdout:2/695: rename d1/d7/d63/f7b to d1/d7/d63/d4b/d8a/dd9/ff3 0 2024-04-20T10:55:06.605 INFO:tasks.workunit.client.1.smithi175.stdout:2/696: fdatasync d1/d7/d63/dee/f8c 0 2024-04-20T10:55:06.605 INFO:tasks.workunit.client.1.smithi175.stdout:8/733: write d7/d13/d1d/d24/d39/d6f/f90 [3887513,11103] 0 2024-04-20T10:55:06.606 INFO:tasks.workunit.client.1.smithi175.stdout:6/834: creat d1/d37/d83/db8/d60/d6b/d10d/f10f x:0 0 0 2024-04-20T10:55:06.608 INFO:tasks.workunit.client.1.smithi175.stdout:2/697: link d1/d7/d63/d36/d7d/d84/d8b/la6 d1/d48/d21/d9c/lf4 0 2024-04-20T10:55:06.609 INFO:tasks.workunit.client.1.smithi175.stdout:8/734: getdents d7/d13/d1d/d24/d38/d73/db5/ddb 0 2024-04-20T10:55:06.612 INFO:tasks.workunit.client.1.smithi175.stdout:6/835: getdents d1/d37/d83/db8/d60/ded/dc1 0 2024-04-20T10:55:06.613 INFO:tasks.workunit.client.1.smithi175.stdout:1/811: read d0/d57/db7/fd3 [1045107,11143] 0 2024-04-20T10:55:06.614 INFO:tasks.workunit.client.1.smithi175.stdout:8/735: unlink d7/d13/d1d/d24/d39/d6f/db7/dbc/fda 0 2024-04-20T10:55:06.615 INFO:tasks.workunit.client.1.smithi175.stdout:6/836: creat d1/d37/d83/db8/d60/f110 x:0 0 0 2024-04-20T10:55:06.616 INFO:tasks.workunit.client.1.smithi175.stdout:8/736: write d7/d13/d1d/d24/d38/f89 [816764,81896] 0 2024-04-20T10:55:06.616 INFO:tasks.workunit.client.1.smithi175.stdout:8/737: chown d7/d13/d1d/d24/d63 169 1 2024-04-20T10:55:06.617 INFO:tasks.workunit.client.1.smithi175.stdout:2/698: mknod d1/d48/d21/d76/cf5 0 2024-04-20T10:55:06.617 INFO:tasks.workunit.client.1.smithi175.stdout:2/699: write d1/d48/d21/d76/faa [652322,24760] 0 2024-04-20T10:55:06.617 INFO:tasks.workunit.client.1.smithi175.stdout:7/867: dwrite db/d1d/d39/d50/dba/d47/da6/db9/f126 [0,4194304] 0 2024-04-20T10:55:06.620 INFO:tasks.workunit.client.1.smithi175.stdout:6/837: creat d1/dc0/f111 x:0 0 0 2024-04-20T10:55:06.622 INFO:tasks.workunit.client.1.smithi175.stdout:8/738: mkdir d7/d13/d1d/d24/d26/dcb/ded 0 2024-04-20T10:55:06.626 INFO:tasks.workunit.client.1.smithi175.stdout:1/812: write d0/d3e/d61/d73/fca [105848,890] 0 2024-04-20T10:55:06.626 INFO:tasks.workunit.client.1.smithi175.stdout:4/839: dwrite d4/dd/d2d/d43/d69/daa/fdb [0,4194304] 0 2024-04-20T10:55:06.626 INFO:tasks.workunit.client.1.smithi175.stdout:4/840: chown d4/d27/f17 6209 1 2024-04-20T10:55:06.626 INFO:tasks.workunit.client.1.smithi175.stdout:1/813: write d0/d3e/f80 [42501,77435] 0 2024-04-20T10:55:06.626 INFO:tasks.workunit.client.1.smithi175.stdout:4/841: write d4/dd/d54/d5d/d8a/fde [5076689,86832] 0 2024-04-20T10:55:06.627 INFO:tasks.workunit.client.1.smithi175.stdout:6/838: creat d1/d37/d83/db8/d60/d6b/da8/f112 x:0 0 0 2024-04-20T10:55:06.629 INFO:tasks.workunit.client.1.smithi175.stdout:1/814: write d0/f10 [637225,108250] 0 2024-04-20T10:55:06.630 INFO:tasks.workunit.client.1.smithi175.stdout:1/815: fdatasync d0/d57/db7/fd8 0 2024-04-20T10:55:06.630 INFO:tasks.workunit.client.1.smithi175.stdout:1/816: write d0/d8/dcb/ffa [1119670,63504] 0 2024-04-20T10:55:06.630 INFO:tasks.workunit.client.1.smithi175.stdout:1/817: fsync d0/d51/f10f 0 2024-04-20T10:55:06.630 INFO:tasks.workunit.client.1.smithi175.stdout:4/842: getdents d4/dd/d54/d5d/d79/d9d/dd4/d10e 0 2024-04-20T10:55:06.632 INFO:tasks.workunit.client.1.smithi175.stdout:1/818: creat d0/d3e/f120 x:0 0 0 2024-04-20T10:55:06.632 INFO:tasks.workunit.client.1.smithi175.stdout:1/819: write d0/d51/d6b/d9e/f106 [193408,81247] 0 2024-04-20T10:55:06.634 INFO:tasks.workunit.client.1.smithi175.stdout:4/843: rename d4/d27/d8c/cf0 to d4/dd/d2d/d33/d5b/d65/c11c 0 2024-04-20T10:55:06.634 INFO:tasks.workunit.client.1.smithi175.stdout:4/844: chown d4/d27/d8c/f107 8891 1 2024-04-20T10:55:06.636 INFO:tasks.workunit.client.1.smithi175.stdout:4/845: rmdir d4/dd/d2d/d43/d69 39 2024-04-20T10:55:06.636 INFO:tasks.workunit.client.1.smithi175.stdout:8/739: dread d7/d13/d1d/d24/d38/fb9 [0,4194304] 0 2024-04-20T10:55:06.642 INFO:tasks.workunit.client.1.smithi175.stdout:7/868: dwrite db/d61/d6d/d9c/de8/fab [0,4194304] 0 2024-04-20T10:55:06.643 INFO:tasks.workunit.client.1.smithi175.stdout:4/846: rename d4/f102 to d4/dd/d5e/d74/f11d 0 2024-04-20T10:55:06.646 INFO:tasks.workunit.client.1.smithi175.stdout:7/869: rename db/d61/d6d/d9c/de8/d9a/dd2/dfc to db/d1d/d39/d50/dba/d47/da6/db9/dc8/d12b 0 2024-04-20T10:55:06.648 INFO:tasks.workunit.client.1.smithi175.stdout:4/847: mknod d4/dd/d54/d5d/d9e/c11e 0 2024-04-20T10:55:06.649 INFO:tasks.workunit.client.1.smithi175.stdout:7/870: mkdir db/d1d/d60/d76/d12c 0 2024-04-20T10:55:06.650 INFO:tasks.workunit.client.1.smithi175.stdout:7/871: truncate db/d1d/d39/d50/dba/d47/da6/db9/f126 5223799 0 2024-04-20T10:55:06.650 INFO:tasks.workunit.client.1.smithi175.stdout:7/872: chown db/d1d/d39/d50/dba/c38 8 1 2024-04-20T10:55:06.651 INFO:tasks.workunit.client.1.smithi175.stdout:4/848: creat d4/dd/d2d/d43/d69/daa/f11f x:0 0 0 2024-04-20T10:55:06.652 INFO:tasks.workunit.client.1.smithi175.stdout:1/820: dwrite d0/d3e/f11c [0,4194304] 0 2024-04-20T10:55:06.652 INFO:tasks.workunit.client.1.smithi175.stdout:1/821: chown d0/d3e/f11c 583087641 1 2024-04-20T10:55:06.657 INFO:tasks.workunit.client.1.smithi175.stdout:1/822: mknod d0/d8/d13/d2e/d35/d8a/d91/c121 0 2024-04-20T10:55:06.657 INFO:tasks.workunit.client.1.smithi175.stdout:1/823: stat d0/d8/f45 0 2024-04-20T10:55:06.657 INFO:tasks.workunit.client.1.smithi175.stdout:8/740: dwrite d7/d13/d1d/d24/d63/f9f [0,4194304] 0 2024-04-20T10:55:06.659 INFO:tasks.workunit.client.1.smithi175.stdout:8/741: creat d7/d13/d1d/d24/d38/d80/fee x:0 0 0 2024-04-20T10:55:06.665 INFO:tasks.workunit.client.1.smithi175.stdout:1/824: read d0/d8/d13/d79/d8c/f8d [4087983,15246] 0 2024-04-20T10:55:06.676 INFO:tasks.workunit.client.1.smithi175.stdout:1/825: write d0/d8/d13/d79/ffc [993117,60236] 0 2024-04-20T10:55:06.676 INFO:tasks.workunit.client.1.smithi175.stdout:1/826: write d0/d8/d13/d79/d8c/fab [1102887,56050] 0 2024-04-20T10:55:06.677 INFO:tasks.workunit.client.1.smithi175.stdout:4/849: dwrite d4/dd/d2d/d43/d69/daa/fc6 [4194304,4194304] 0 2024-04-20T10:55:06.677 INFO:tasks.workunit.client.1.smithi175.stdout:4/850: write d4/d27/f1c [463365,97806] 0 2024-04-20T10:55:06.678 INFO:tasks.workunit.client.1.smithi175.stdout:1/827: rename d0/d8/d13/d7b/cce to d0/d57/db7/df5/d105/c122 0 2024-04-20T10:55:06.678 INFO:tasks.workunit.client.1.smithi175.stdout:7/873: write db/d1d/d39/d50/f3e [1303292,38494] 0 2024-04-20T10:55:06.679 INFO:tasks.workunit.client.1.smithi175.stdout:7/874: write db/d1d/d39/d50/dba/d47/da6/db9/dc8/fd4 [1704516,46828] 0 2024-04-20T10:55:06.679 INFO:tasks.workunit.client.1.smithi175.stdout:1/828: rmdir d0/d51/d6b/d9e/de0/d107 39 2024-04-20T10:55:06.679 INFO:tasks.workunit.client.1.smithi175.stdout:1/829: chown d0/d3e/c53 969710 1 2024-04-20T10:55:06.689 INFO:tasks.workunit.client.1.smithi175.stdout:8/742: dwrite d7/d13/d1d/d24/d39/f7a [0,4194304] 0 2024-04-20T10:55:06.690 INFO:tasks.workunit.client.1.smithi175.stdout:8/743: getdents d7/d13/d1d/d24/d39/d6f/db7/dce 0 2024-04-20T10:55:06.690 INFO:tasks.workunit.client.1.smithi175.stdout:8/744: stat d7/d13/d1d/d24/fb0 0 2024-04-20T10:55:06.691 INFO:tasks.workunit.client.1.smithi175.stdout:1/830: write d0/d8/f1f [1263394,79710] 0 2024-04-20T10:55:06.692 INFO:tasks.workunit.client.1.smithi175.stdout:8/745: read d7/d13/d1d/f2f [829308,25048] 0 2024-04-20T10:55:06.693 INFO:tasks.workunit.client.1.smithi175.stdout:1/831: creat d0/d102/f123 x:0 0 0 2024-04-20T10:55:06.693 INFO:tasks.workunit.client.1.smithi175.stdout:1/832: fsync d0/d8/dcb/f115 0 2024-04-20T10:55:06.693 INFO:tasks.workunit.client.1.smithi175.stdout:8/746: creat d7/d13/d1d/d24/d39/d6f/db7/dbc/fef x:0 0 0 2024-04-20T10:55:06.694 INFO:tasks.workunit.client.1.smithi175.stdout:1/833: creat d0/d57/db7/df5/d105/f124 x:0 0 0 2024-04-20T10:55:06.695 INFO:tasks.workunit.client.1.smithi175.stdout:1/834: fdatasync d0/d8/d13/d2e/f46 0 2024-04-20T10:55:06.695 INFO:tasks.workunit.client.1.smithi175.stdout:1/835: mkdir d0/d8/d13/d125 0 2024-04-20T10:55:06.698 INFO:tasks.workunit.client.1.smithi175.stdout:1/836: dread d0/d29/f4f [0,4194304] 0 2024-04-20T10:55:06.699 INFO:tasks.workunit.client.1.smithi175.stdout:1/837: creat d0/d51/da8/f126 x:0 0 0 2024-04-20T10:55:06.701 INFO:tasks.workunit.client.1.smithi175.stdout:1/838: dread d0/d8/d13/d79/d8c/dac/fb8 [0,4194304] 0 2024-04-20T10:55:06.701 INFO:tasks.workunit.client.1.smithi175.stdout:4/851: dwrite d4/dd/d5e/d74/da1/dbc/fc2 [0,4194304] 0 2024-04-20T10:55:06.701 INFO:tasks.workunit.client.1.smithi175.stdout:7/875: dwrite db/d61/d6d/d9c/de8/d8e/f114 [0,4194304] 0 2024-04-20T10:55:06.702 INFO:tasks.workunit.client.1.smithi175.stdout:1/839: creat d0/d8/d13/d79/d8c/dac/f127 x:0 0 0 2024-04-20T10:55:06.702 INFO:tasks.workunit.client.1.smithi175.stdout:8/747: read d7/d13/f75 [7721245,51818] 0 2024-04-20T10:55:06.703 INFO:tasks.workunit.client.1.smithi175.stdout:4/852: mkdir d4/dd/d2d/d120 0 2024-04-20T10:55:06.705 INFO:tasks.workunit.client.1.smithi175.stdout:7/876: creat db/d61/d6d/d9c/f12d x:0 0 0 2024-04-20T10:55:06.706 INFO:tasks.workunit.client.1.smithi175.stdout:1/840: rmdir d0/d8/d13/d79/d8c/dac 39 2024-04-20T10:55:06.712 INFO:tasks.workunit.client.1.smithi175.stdout:8/748: write d7/d13/d1d/d56/f96 [2518749,92269] 0 2024-04-20T10:55:06.720 INFO:tasks.workunit.client.1.smithi175.stdout:4/853: dwrite d4/d27/d61/f46 [4194304,4194304] 0 2024-04-20T10:55:06.720 INFO:tasks.workunit.client.1.smithi175.stdout:4/854: fdatasync d4/d27/d8c/d10f/f118 0 2024-04-20T10:55:06.721 INFO:tasks.workunit.client.1.smithi175.stdout:1/841: mknod d0/d8/d13/d2e/d35/d8a/d104/c128 0 2024-04-20T10:55:06.721 INFO:tasks.workunit.client.1.smithi175.stdout:1/842: fsync d0/d3e/f11c 0 2024-04-20T10:55:06.723 INFO:tasks.workunit.client.1.smithi175.stdout:4/855: mknod d4/dd/d5e/d74/da1/dc0/c121 0 2024-04-20T10:55:06.725 INFO:tasks.workunit.client.1.smithi175.stdout:7/877: rename db/d61/d6d/d9c/de8/d2a/d41/d59/l5d to db/l12e 0 2024-04-20T10:55:06.727 INFO:tasks.workunit.client.1.smithi175.stdout:4/856: rmdir d4/dd/d54/d5d/d79/d9d/d104/d110 0 2024-04-20T10:55:06.728 INFO:tasks.workunit.client.1.smithi175.stdout:4/857: write d4/d23/ff1 [4805236,73959] 0 2024-04-20T10:55:06.728 INFO:tasks.workunit.client.1.smithi175.stdout:8/749: dwrite d7/d13/d1d/d24/d26/f7b [0,4194304] 0 2024-04-20T10:55:06.729 INFO:tasks.workunit.client.1.smithi175.stdout:7/878: mknod db/d1d/d60/d76/d12c/c12f 0 2024-04-20T10:55:06.739 INFO:tasks.workunit.client.1.smithi175.stdout:7/879: dread db/d1d/d39/d50/dba/d47/f94 [0,4194304] 0 2024-04-20T10:55:06.740 INFO:tasks.workunit.client.1.smithi175.stdout:7/880: dread - db/d61/d6d/d9c/de8/d2a/d41/f118 zero size 2024-04-20T10:55:06.741 INFO:tasks.workunit.client.1.smithi175.stdout:7/881: mkdir db/d61/d6d/d9c/de8/d2a/d41/d130 0 2024-04-20T10:55:06.741 INFO:tasks.workunit.client.1.smithi175.stdout:7/882: mkdir db/d1d/d60/d131 0 2024-04-20T10:55:06.744 INFO:tasks.workunit.client.1.smithi175.stdout:1/843: dwrite d0/d8/dcb/fef [0,4194304] 0 2024-04-20T10:55:06.744 INFO:tasks.workunit.client.1.smithi175.stdout:7/883: dread db/d61/d6d/d9c/de8/d8e/f2d [0,4194304] 0 2024-04-20T10:55:06.746 INFO:tasks.workunit.client.1.smithi175.stdout:7/884: unlink db/d61/d6d/d9c/de8/fab 0 2024-04-20T10:55:06.746 INFO:tasks.workunit.client.1.smithi175.stdout:7/885: write db/d1d/d39/fe0 [766113,23413] 0 2024-04-20T10:55:06.747 INFO:tasks.workunit.client.1.smithi175.stdout:1/844: rename d0/d8/d13/d75 to d0/d51/d6b/d129 0 2024-04-20T10:55:06.747 INFO:tasks.workunit.client.1.smithi175.stdout:1/845: stat d0/d8/c100 0 2024-04-20T10:55:06.748 INFO:tasks.workunit.client.1.smithi175.stdout:1/846: truncate d0/d8/d13/d2e/f38 1893830 0 2024-04-20T10:55:06.754 INFO:tasks.workunit.client.1.smithi175.stdout:8/750: dwrite d7/d13/d1d/d56/fe2 [0,4194304] 0 2024-04-20T10:55:06.757 INFO:tasks.workunit.client.1.smithi175.stdout:4/858: dwrite d4/dd/d2d/d33/d58/fc4 [0,4194304] 0 2024-04-20T10:55:06.757 INFO:tasks.workunit.client.1.smithi175.stdout:7/886: dread db/f7e [0,4194304] 0 2024-04-20T10:55:06.758 INFO:tasks.workunit.client.1.smithi175.stdout:8/751: unlink d7/d13/d1d/d24/d39/l99 0 2024-04-20T10:55:06.758 INFO:tasks.workunit.client.1.smithi175.stdout:8/752: chown d7/d13/d1d/d24/d39/d6f/db7/dbc/fef 947800601 1 2024-04-20T10:55:06.759 INFO:tasks.workunit.client.1.smithi175.stdout:4/859: creat d4/dd/d5e/d96/dd7/f122 x:0 0 0 2024-04-20T10:55:06.760 INFO:tasks.workunit.client.1.smithi175.stdout:8/753: mknod d7/d13/d1d/d24/d39/d6f/db7/dce/cf0 0 2024-04-20T10:55:06.761 INFO:tasks.workunit.client.1.smithi175.stdout:4/860: creat d4/dd/d2d/d33/d58/f123 x:0 0 0 2024-04-20T10:55:06.764 INFO:tasks.workunit.client.1.smithi175.stdout:8/754: rename d7/d13/d1d/d92/d6c/de6 to d7/d13/d1d/d24/d38/d73/db5/ddb/df1 0 2024-04-20T10:55:06.766 INFO:tasks.workunit.client.1.smithi175.stdout:1/847: dwrite d0/d3e/f120 [0,4194304] 0 2024-04-20T10:55:06.766 INFO:tasks.workunit.client.1.smithi175.stdout:1/848: write d0/d57/db7/fd3 [1330496,37943] 0 2024-04-20T10:55:06.766 INFO:tasks.workunit.client.1.smithi175.stdout:4/861: creat d4/dd/d54/d5d/d79/d9d/dd4/d10e/f124 x:0 0 0 2024-04-20T10:55:06.770 INFO:tasks.workunit.client.1.smithi175.stdout:1/849: creat d0/d51/d6b/d129/f12a x:0 0 0 2024-04-20T10:55:06.772 INFO:tasks.workunit.client.1.smithi175.stdout:8/755: dread d7/d13/f12 [4194304,4194304] 0 2024-04-20T10:55:06.773 INFO:tasks.workunit.client.1.smithi175.stdout:4/862: symlink d4/dd/d54/d5d/d79/d9d/dd4/l125 0 2024-04-20T10:55:06.774 INFO:tasks.workunit.client.1.smithi175.stdout:8/756: creat d7/d13/d1d/ff2 x:0 0 0 2024-04-20T10:55:06.802 INFO:tasks.workunit.client.1.smithi175.stdout:1/850: dwrite d0/d8/d13/d2e/d35/f7f [0,4194304] 0 2024-04-20T10:55:06.922 INFO:tasks.workunit.client.1.smithi175.stdout:1/851: dread d0/d8/d13/d79/d8c/fab [0,4194304] 0 2024-04-20T10:55:06.922 INFO:tasks.workunit.client.1.smithi175.stdout:8/757: dwrite d7/d13/d1d/fde [0,4194304] 0 2024-04-20T10:55:06.922 INFO:tasks.workunit.client.1.smithi175.stdout:4/863: mknod d4/dd/dba/d115/c126 0 2024-04-20T10:55:06.922 INFO:tasks.workunit.client.1.smithi175.stdout:1/852: creat d0/d51/d6b/d129/f12b x:0 0 0 2024-04-20T10:55:06.922 INFO:tasks.workunit.client.1.smithi175.stdout:8/758: readlink d7/d13/l53 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:8/759: chown d7/d13/d1d/d24/d39/d6f/db7/dce/cec 2510 1 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:7/887: dwrite db/d61/d6d/d9c/de8/d8e/f2d [0,4194304] 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:7/888: readlink db/d1d/d39/d50/ldc 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:7/889: truncate db/d61/d6d/dbc/ffb 866104 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:4/864: rmdir d4/dd/dba/d115 39 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:8/760: creat d7/d13/d1d/d24/d39/d6f/db7/ff3 x:0 0 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:1/853: mknod d0/d29/c12c 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:8/761: chown d7/d13/d1d/d92/l5f 15217 1 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:1/854: mknod d0/d57/db7/df5/d105/c12d 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:4/865: write d4/dd/f11 [1261597,675] 0 2024-04-20T10:55:06.923 INFO:tasks.workunit.client.1.smithi175.stdout:4/866: dread d4/dd/d54/d5d/d9e/f86 [0,4194304] 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:1/855: dwrite d0/d51/f10f [0,4194304] 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/762: mknod d7/d13/d1d/d24/cf4 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/763: dwrite d7/d13/d1d/d24/f2b [4194304,4194304] 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:1/856: symlink d0/d51/l12e 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:1/857: fdatasync d0/d51/d6b/d9e/de0/d107/f103 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/764: creat d7/d13/d1d/d24/d39/d85/ff5 x:0 0 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/765: fsync d7/d13/d1d/d24/d39/f7a 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/766: dwrite d7/d13/d1d/d24/d39/d6f/db7/fb8 [0,4194304] 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/767: read d7/d13/f22 [4315812,38040] 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:1/858: symlink d0/d51/da8/l12f 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:1/859: truncate d0/d51/d6b/d9e/fa3 560274 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:1/860: dread d0/d8/d13/d79/d8c/f8d [0,4194304] 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/768: truncate d7/d13/d1d/f47 482407 0 2024-04-20T10:55:06.924 INFO:tasks.workunit.client.1.smithi175.stdout:1/861: read d0/f93 [1077211,25509] 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:1/862: write d0/d8/d13/db9/ff6 [735536,126375] 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:1/863: dwrite d0/d3e/f41 [0,4194304] 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:8/769: rmdir d7/d13/d1d/d24/d26 39 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:8/770: symlink d7/d13/d1d/d24/d63/lf6 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:8/771: dread d7/d13/d1d/f8f [0,4194304] 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:8/772: write d7/d13/d1d/d24/d38/d73/fa6 [3571270,32484] 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:8/773: read d7/d13/d1d/d24/d39/d6f/fa7 [2544282,93972] 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:3/590: sync 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:5/944: sync 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:5/945: dread - db/dc1/f10e zero size 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:3/591: write d7/d19/d33/d60/d79/d99/fab [377392,86855] 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:3/592: stat d7/d21/d16/d22/d2c/d1f/c56 0 2024-04-20T10:55:06.925 INFO:tasks.workunit.client.1.smithi175.stdout:1/864: dwrite d0/d51/d6b/d9e/f112 [0,4194304] 0 2024-04-20T10:55:06.926 INFO:tasks.workunit.client.1.smithi175.stdout:1/865: fsync d0/d3e/d61/fc4 0 2024-04-20T10:55:06.926 INFO:tasks.workunit.client.1.smithi175.stdout:3/593: mknod d7/d21/d16/d49/da8/cba 0 2024-04-20T10:55:06.926 INFO:tasks.workunit.client.1.smithi175.stdout:5/946: write db/d11/d6d/da1/dcc/fd4 [2756300,109928] 0 2024-04-20T10:55:06.927 INFO:tasks.workunit.client.1.smithi175.stdout:5/947: readlink db/d11/d25/d41/d83/lc6 0 2024-04-20T10:55:06.927 INFO:tasks.workunit.client.1.smithi175.stdout:5/948: chown db/d11/d25/d38/d40/d66/f102 558190867 1 2024-04-20T10:55:06.927 INFO:tasks.workunit.client.1.smithi175.stdout:5/949: write db/d1f/d31/fb0 [591611,109381] 0 2024-04-20T10:55:06.927 INFO:tasks.workunit.client.1.smithi175.stdout:5/950: write db/dc1/d4f/d75/f97 [4708718,51017] 0 2024-04-20T10:55:06.927 INFO:tasks.workunit.client.1.smithi175.stdout:1/866: creat d0/d51/d6b/d129/f130 x:0 0 0 2024-04-20T10:55:06.927 INFO:tasks.workunit.client.1.smithi175.stdout:3/594: creat d7/d21/d16/d85/fbb x:0 0 0 2024-04-20T10:55:06.929 INFO:tasks.workunit.client.1.smithi175.stdout:8/774: dwrite d7/d13/d1d/d24/d38/f89 [0,4194304] 0 2024-04-20T10:55:06.929 INFO:tasks.workunit.client.1.smithi175.stdout:8/775: dread - d7/d13/d1d/fdf zero size 2024-04-20T10:55:06.929 INFO:tasks.workunit.client.1.smithi175.stdout:8/776: write d7/d13/d1d/d24/d38/fb9 [2970107,6851] 0 2024-04-20T10:55:06.930 INFO:tasks.workunit.client.1.smithi175.stdout:5/951: link db/d1f/d31/d93/f100 db/d11/dfe/f140 0 2024-04-20T10:55:06.931 INFO:tasks.workunit.client.1.smithi175.stdout:1/867: truncate d0/f1a 894765 0 2024-04-20T10:55:06.935 INFO:tasks.workunit.client.1.smithi175.stdout:5/952: unlink db/d11/d6d/da1/fb8 0 2024-04-20T10:55:06.935 INFO:tasks.workunit.client.1.smithi175.stdout:5/953: fsync db/d1f/d31/f104 0 2024-04-20T10:55:06.937 INFO:tasks.workunit.client.1.smithi175.stdout:3/595: write d7/d21/d16/d22/d2c/d1f/d48/f9c [2253472,91722] 0 2024-04-20T10:55:06.937 INFO:tasks.workunit.client.1.smithi175.stdout:3/596: write d7/d10/f31 [537212,43972] 0 2024-04-20T10:55:06.940 INFO:tasks.workunit.client.1.smithi175.stdout:5/954: mknod db/d1f/d31/d93/c141 0 2024-04-20T10:55:06.940 INFO:tasks.workunit.client.1.smithi175.stdout:5/955: fsync db/d11/d6d/da1/dcc/fde 0 2024-04-20T10:55:06.940 INFO:tasks.workunit.client.1.smithi175.stdout:5/956: chown db/d11/d80/dc3 37430 1 2024-04-20T10:55:06.942 INFO:tasks.workunit.client.1.smithi175.stdout:1/868: dread d0/d8/d13/d2e/d35/f7f [0,4194304] 0 2024-04-20T10:55:06.942 INFO:tasks.workunit.client.1.smithi175.stdout:1/869: truncate d0/d3e/f118 11868 0 2024-04-20T10:55:06.960 INFO:tasks.workunit.client.1.smithi175.stdout:1/870: dwrite d0/d8/f5e [0,4194304] 0 2024-04-20T10:55:06.960 INFO:tasks.workunit.client.1.smithi175.stdout:1/871: write d0/d8/d13/d2e/fa6 [1827039,84828] 0 2024-04-20T10:55:06.960 INFO:tasks.workunit.client.1.smithi175.stdout:1/872: dread - d0/d51/d6b/d9e/f11d zero size 2024-04-20T10:55:06.960 INFO:tasks.workunit.client.1.smithi175.stdout:1/873: fdatasync d0/d8/f5e 0 2024-04-20T10:55:06.962 INFO:tasks.workunit.client.1.smithi175.stdout:3/597: link d7/d19/f6b d7/d19/d33/d60/d79/d99/dac/dad/db2/fbc 0 2024-04-20T10:55:06.962 INFO:tasks.workunit.client.1.smithi175.stdout:3/598: readlink d7/d21/d16/d22/d2c/d91/l4f 0 2024-04-20T10:55:06.962 INFO:tasks.workunit.client.1.smithi175.stdout:1/874: dread d0/d3e/fd7 [0,4194304] 0 2024-04-20T10:55:06.962 INFO:tasks.workunit.client.1.smithi175.stdout:5/957: symlink db/d11/d25/d38/d40/d66/d94/l142 0 2024-04-20T10:55:06.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/599: dwrite d7/d21/d16/d22/d2c/d1f/d48/f78 [0,4194304] 0 2024-04-20T10:55:06.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/600: write d7/d19/d33/d60/f80 [852299,86038] 0 2024-04-20T10:55:06.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/601: stat d7/d21/d16/d22/d2c/d1f/c56 0 2024-04-20T10:55:06.979 INFO:tasks.workunit.client.1.smithi175.stdout:1/875: getdents d0/d8/d13/d2e/d35 0 2024-04-20T10:55:06.980 INFO:tasks.workunit.client.1.smithi175.stdout:5/958: truncate db/d30/d46/fba 375473 0 2024-04-20T10:55:06.981 INFO:tasks.workunit.client.1.smithi175.stdout:3/602: getdents d7/d19/d33/d7e/d89 0 2024-04-20T10:55:06.997 INFO:tasks.workunit.client.1.smithi175.stdout:1/876: dwrite d0/d8/f45 [0,4194304] 0 2024-04-20T10:55:06.998 INFO:tasks.workunit.client.1.smithi175.stdout:5/959: mkdir db/d11/d1a/d131/d143 0 2024-04-20T10:55:06.998 INFO:tasks.workunit.client.1.smithi175.stdout:5/960: chown db/d11/d80/d135 7 1 2024-04-20T10:55:07.007 INFO:tasks.workunit.client.1.smithi175.stdout:3/603: dwrite d7/d21/d16/d22/d2c/d91/fb7 [0,4194304] 0 2024-04-20T10:55:07.009 INFO:tasks.workunit.client.1.smithi175.stdout:1/877: creat d0/d51/d6b/d9e/de0/d107/f131 x:0 0 0 2024-04-20T10:55:07.010 INFO:tasks.workunit.client.1.smithi175.stdout:3/604: dread d7/d21/d16/d22/d2c/f34 [0,4194304] 0 2024-04-20T10:55:07.019 INFO:tasks.workunit.client.1.smithi175.stdout:5/961: dwrite db/d30/f10d [0,4194304] 0 2024-04-20T10:55:07.019 INFO:tasks.workunit.client.1.smithi175.stdout:1/878: symlink d0/d57/db7/df5/d105/l132 0 2024-04-20T10:55:07.020 INFO:tasks.workunit.client.1.smithi175.stdout:3/605: mkdir d7/d21/d16/d22/d2c/d64/dbd 0 2024-04-20T10:55:07.022 INFO:tasks.workunit.client.1.smithi175.stdout:5/962: mkdir db/d11/d1a/d144 0 2024-04-20T10:55:07.024 INFO:tasks.workunit.client.1.smithi175.stdout:1/879: truncate d0/d51/d6b/fdb 1504455 0 2024-04-20T10:55:07.024 INFO:tasks.workunit.client.1.smithi175.stdout:1/880: chown d0/d3e/d61/d73 41805 1 2024-04-20T10:55:07.025 INFO:tasks.workunit.client.1.smithi175.stdout:3/606: mknod d7/d19/d33/d60/d79/d99/dac/dad/db2/cbe 0 2024-04-20T10:55:07.025 INFO:tasks.workunit.client.1.smithi175.stdout:3/607: chown d7/d21/d16/d22/faa 263069250 1 2024-04-20T10:55:07.025 INFO:tasks.workunit.client.1.smithi175.stdout:5/963: truncate db/d11/d25/d38/d40/fad 742950 0 2024-04-20T10:55:07.026 INFO:tasks.workunit.client.1.smithi175.stdout:1/881: getdents d0/d8/d13/d2e/d35/d8a/d104 0 2024-04-20T10:55:07.027 INFO:tasks.workunit.client.1.smithi175.stdout:5/964: chown db/d11/d25/d62/c10a 48004798 1 2024-04-20T10:55:07.029 INFO:tasks.workunit.client.1.smithi175.stdout:1/882: rename d0/d57/db7/df5/d105 to d0/d51/d6b/d133 0 2024-04-20T10:55:07.030 INFO:tasks.workunit.client.1.smithi175.stdout:3/608: symlink d7/d21/d16/d49/lbf 0 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:6/839: sync 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:9/699: sync 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:0/702: sync 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:6/840: chown d1/d37/d83/db8/d60/d68/d7e 22 1 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:2/700: sync 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:2/701: dread - d1/d7/d63/dee/f8c zero size 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:9/700: write d6/d1b/d42/d5b/d72/d7d/dcc/d78/f7f [672057,112207] 0 2024-04-20T10:55:07.032 INFO:tasks.workunit.client.1.smithi175.stdout:9/701: fsync d6/f3c 0 2024-04-20T10:55:07.033 INFO:tasks.workunit.client.1.smithi175.stdout:9/702: fsync d6/f4a 0 2024-04-20T10:55:07.033 INFO:tasks.workunit.client.1.smithi175.stdout:2/702: write d1/f57 [630954,112781] 0 2024-04-20T10:55:07.033 INFO:tasks.workunit.client.1.smithi175.stdout:5/965: creat db/d11/d1a/d131/d143/f145 x:0 0 0 2024-04-20T10:55:07.033 INFO:tasks.workunit.client.1.smithi175.stdout:5/966: fdatasync db/d1f/f95 0 2024-04-20T10:55:07.033 INFO:tasks.workunit.client.1.smithi175.stdout:1/883: creat d0/d51/da8/dfe/f134 x:0 0 0 2024-04-20T10:55:07.034 INFO:tasks.workunit.client.1.smithi175.stdout:3/609: unlink d7/d21/d16/d22/d2c/d1f/d48/f90 0 2024-04-20T10:55:07.035 INFO:tasks.workunit.client.1.smithi175.stdout:6/841: truncate d1/dc0/d29/f4b 448480 0 2024-04-20T10:55:07.036 INFO:tasks.workunit.client.1.smithi175.stdout:9/703: mkdir d6/d1b/d42/d79/d81/dd0 0 2024-04-20T10:55:07.037 INFO:tasks.workunit.client.1.smithi175.stdout:2/703: mkdir d1/d48/d38/d82/df6 0 2024-04-20T10:55:07.040 INFO:tasks.workunit.client.1.smithi175.stdout:1/884: rename d0/d8/d13/d79/d8c/f8d to d0/d51/d6b/d9e/de0/d107/f135 0 2024-04-20T10:55:07.040 INFO:tasks.workunit.client.1.smithi175.stdout:1/885: fsync d0/d8/d13/f60 0 2024-04-20T10:55:07.044 INFO:tasks.workunit.client.1.smithi175.stdout:9/704: creat d6/d1b/d42/d5b/d72/d7d/dcc/d78/fd1 x:0 0 0 2024-04-20T10:55:07.044 INFO:tasks.workunit.client.1.smithi175.stdout:0/703: write df/d19/f1f [81683,73480] 0 2024-04-20T10:55:07.045 INFO:tasks.workunit.client.1.smithi175.stdout:2/704: rmdir d1/d7/d63/d4b 39 2024-04-20T10:55:07.046 INFO:tasks.workunit.client.1.smithi175.stdout:5/967: truncate f2 12038 0 2024-04-20T10:55:07.047 INFO:tasks.workunit.client.1.smithi175.stdout:1/886: creat d0/d3e/d61/d73/f136 x:0 0 0 2024-04-20T10:55:07.049 INFO:tasks.workunit.client.1.smithi175.stdout:9/705: mknod d6/d1b/d26/d8c/dc6/cd2 0 2024-04-20T10:55:07.052 INFO:tasks.workunit.client.1.smithi175.stdout:2/705: rename d1/d48/d21/d76/faa to d1/d53/ff7 0 2024-04-20T10:55:07.052 INFO:tasks.workunit.client.1.smithi175.stdout:2/706: chown d1/f6d 2 1 2024-04-20T10:55:07.057 INFO:tasks.workunit.client.1.smithi175.stdout:3/610: dwrite d7/f12 [4194304,4194304] 0 2024-04-20T10:55:07.057 INFO:tasks.workunit.client.1.smithi175.stdout:3/611: fsync d7/d21/d16/d22/d2c/f3c 0 2024-04-20T10:55:07.058 INFO:tasks.workunit.client.1.smithi175.stdout:1/887: truncate d0/d57/f74 632357 0 2024-04-20T10:55:07.058 INFO:tasks.workunit.client.1.smithi175.stdout:9/706: symlink d6/d1b/d42/d5b/d72/d7d/dcc/d78/ld3 0 2024-04-20T10:55:07.058 INFO:tasks.workunit.client.1.smithi175.stdout:1/888: dread - d0/d8/d13/d79/d8c/dac/f127 zero size 2024-04-20T10:55:07.058 INFO:tasks.workunit.client.1.smithi175.stdout:1/889: chown d0/d51/le1 233637 1 2024-04-20T10:55:07.058 INFO:tasks.workunit.client.1.smithi175.stdout:2/707: chown d1/d7/l4d 0 1 2024-04-20T10:55:07.058 INFO:tasks.workunit.client.1.smithi175.stdout:6/842: dwrite d1/d37/d83/db8/fdd [0,4194304] 0 2024-04-20T10:55:07.059 INFO:tasks.workunit.client.1.smithi175.stdout:3/612: mkdir d7/d19/d33/d60/d79/d99/dac/dc0 0 2024-04-20T10:55:07.059 INFO:tasks.workunit.client.1.smithi175.stdout:2/708: mkdir d1/d48/d21/d9c/df8 0 2024-04-20T10:55:07.061 INFO:tasks.workunit.client.1.smithi175.stdout:6/843: mknod d1/d5/d12/d73/d7a/dee/c113 0 2024-04-20T10:55:07.062 INFO:tasks.workunit.client.1.smithi175.stdout:6/844: readlink d1/d37/d83/db8/d60/d68/d7e/lec 0 2024-04-20T10:55:07.062 INFO:tasks.workunit.client.1.smithi175.stdout:3/613: truncate d7/d21/d16/d22/faa 1776954 0 2024-04-20T10:55:07.063 INFO:tasks.workunit.client.1.smithi175.stdout:2/709: mknod d1/d48/d38/ded/cf9 0 2024-04-20T10:55:07.065 INFO:tasks.workunit.client.1.smithi175.stdout:6/845: truncate d1/dc0/f32 730732 0 2024-04-20T10:55:07.065 INFO:tasks.workunit.client.1.smithi175.stdout:9/707: dread d6/fe [0,4194304] 0 2024-04-20T10:55:07.067 INFO:tasks.workunit.client.1.smithi175.stdout:3/614: mknod d7/d19/da2/cc1 0 2024-04-20T10:55:07.067 INFO:tasks.workunit.client.1.smithi175.stdout:0/704: write df/d1a/d22/d6a/d72/d48/d4e/f61 [1348126,76774] 0 2024-04-20T10:55:07.069 INFO:tasks.workunit.client.1.smithi175.stdout:2/710: mknod d1/d6a/cfa 0 2024-04-20T10:55:07.069 INFO:tasks.workunit.client.1.smithi175.stdout:2/711: chown d1/d7/d63/dee/cc8 32 1 2024-04-20T10:55:07.071 INFO:tasks.workunit.client.1.smithi175.stdout:5/968: dread f2 [0,4194304] 0 2024-04-20T10:55:07.071 INFO:tasks.workunit.client.1.smithi175.stdout:5/969: dread - db/d11/d25/d38/d40/d66/ff9 zero size 2024-04-20T10:55:07.078 INFO:tasks.workunit.client.1.smithi175.stdout:5/970: mkdir db/d30/d46/d88/d146 0 2024-04-20T10:55:07.078 INFO:tasks.workunit.client.1.smithi175.stdout:5/971: write db/d11/d25/d38/d40/d66/d94/f119 [160098,16958] 0 2024-04-20T10:55:07.080 INFO:tasks.workunit.client.1.smithi175.stdout:0/705: mkdir df/d1a/d28/dde 0 2024-04-20T10:55:07.080 INFO:tasks.workunit.client.1.smithi175.stdout:0/706: chown df/d1a/d22/fd4 3618061 1 2024-04-20T10:55:07.080 INFO:tasks.workunit.client.1.smithi175.stdout:0/707: dread - df/d1a/d3f/f6f zero size 2024-04-20T10:55:07.085 INFO:tasks.workunit.client.1.smithi175.stdout:7/890: sync 2024-04-20T10:55:07.085 INFO:tasks.workunit.client.1.smithi175.stdout:0/708: dread fe [0,4194304] 0 2024-04-20T10:55:07.085 INFO:tasks.workunit.client.1.smithi175.stdout:0/709: fdatasync df/d1a/fb2 0 2024-04-20T10:55:07.085 INFO:tasks.workunit.client.1.smithi175.stdout:1/890: dread d0/d8/dcb/ffa [0,4194304] 0 2024-04-20T10:55:07.085 INFO:tasks.workunit.client.1.smithi175.stdout:1/891: chown d0/d8/d13/f26 32543 1 2024-04-20T10:55:07.086 INFO:tasks.workunit.client.1.smithi175.stdout:1/892: creat d0/d57/f137 x:0 0 0 2024-04-20T10:55:07.088 INFO:tasks.workunit.client.1.smithi175.stdout:1/893: rmdir d0/d51/d6b/d133/d119 0 2024-04-20T10:55:07.089 INFO:tasks.workunit.client.1.smithi175.stdout:1/894: mknod d0/d51/d6b/d9e/de0/d107/c138 0 2024-04-20T10:55:07.091 INFO:tasks.workunit.client.1.smithi175.stdout:9/708: dwrite d6/d1b/d2f/f38 [4194304,4194304] 0 2024-04-20T10:55:07.091 INFO:tasks.workunit.client.1.smithi175.stdout:0/710: dread df/d1a/d22/d6a/d72/d48/d4e/f61 [0,4194304] 0 2024-04-20T10:55:07.091 INFO:tasks.workunit.client.1.smithi175.stdout:0/711: dread - df/fbc zero size 2024-04-20T10:55:07.091 INFO:tasks.workunit.client.1.smithi175.stdout:0/712: fdatasync f0 0 2024-04-20T10:55:07.091 INFO:tasks.workunit.client.1.smithi175.stdout:6/846: dwrite d1/d37/d83/db8/d60/d68/d7e/fb1 [0,4194304] 0 2024-04-20T10:55:07.096 INFO:tasks.workunit.client.1.smithi175.stdout:0/713: write df/d1a/f27 [922340,73138] 0 2024-04-20T10:55:07.097 INFO:tasks.workunit.client.1.smithi175.stdout:6/847: creat d1/d37/d83/db8/d60/f114 x:0 0 0 2024-04-20T10:55:07.097 INFO:tasks.workunit.client.1.smithi175.stdout:3/615: dwrite d7/d19/f6b [0,4194304] 0 2024-04-20T10:55:07.097 INFO:tasks.workunit.client.1.smithi175.stdout:3/616: chown d7/d21/d16/d49/f7c 253 1 2024-04-20T10:55:07.097 INFO:tasks.workunit.client.1.smithi175.stdout:3/617: stat d7/d21/d16/d49/f7c 0 2024-04-20T10:55:07.097 INFO:tasks.workunit.client.1.smithi175.stdout:3/618: fsync d7/d10/f31 0 2024-04-20T10:55:07.098 INFO:tasks.workunit.client.1.smithi175.stdout:9/709: rename d6/d10/fbc to d6/d58/fd4 0 2024-04-20T10:55:07.102 INFO:tasks.workunit.client.1.smithi175.stdout:1/895: dread d0/d8/f45 [0,4194304] 0 2024-04-20T10:55:07.102 INFO:tasks.workunit.client.1.smithi175.stdout:2/712: dwrite d1/d48/d38/fe5 [0,4194304] 0 2024-04-20T10:55:07.105 INFO:tasks.workunit.client.1.smithi175.stdout:3/619: creat d7/d19/d33/d60/d50/fc2 x:0 0 0 2024-04-20T10:55:07.110 INFO:tasks.workunit.client.1.smithi175.stdout:7/891: dwrite db/d61/d6d/d9c/de8/d2a/f4b [0,4194304] 0 2024-04-20T10:55:07.110 INFO:tasks.workunit.client.1.smithi175.stdout:7/892: chown db/d1d/d39/d50/dba/daa 8 1 2024-04-20T10:55:07.110 INFO:tasks.workunit.client.1.smithi175.stdout:7/893: read db/d61/d6d/dbc/ffb [231153,53002] 0 2024-04-20T10:55:07.111 INFO:tasks.workunit.client.1.smithi175.stdout:7/894: dread - db/d61/d6d/d9c/de8/d8f/f100 zero size 2024-04-20T10:55:07.111 INFO:tasks.workunit.client.1.smithi175.stdout:7/895: chown db/d61/d6d/dbc/c101 1048025199 1 2024-04-20T10:55:07.111 INFO:tasks.workunit.client.1.smithi175.stdout:7/896: chown db/d1d/d39/d50/dba/d47/fc7 312014 1 2024-04-20T10:55:07.112 INFO:tasks.workunit.client.1.smithi175.stdout:3/620: creat d7/d19/d33/d60/d50/fc3 x:0 0 0 2024-04-20T10:55:07.114 INFO:tasks.workunit.client.1.smithi175.stdout:7/897: symlink db/d1d/d39/d50/dba/d47/da6/db9/dc8/l132 0 2024-04-20T10:55:07.115 INFO:tasks.workunit.client.1.smithi175.stdout:2/713: rename d1/d53/f7c to d1/ffb 0 2024-04-20T10:55:07.116 INFO:tasks.workunit.client.1.smithi175.stdout:7/898: symlink db/d61/d6d/d9c/l133 0 2024-04-20T10:55:07.116 INFO:tasks.workunit.client.1.smithi175.stdout:3/621: write d7/f14 [612480,112088] 0 2024-04-20T10:55:07.116 INFO:tasks.workunit.client.1.smithi175.stdout:7/899: write db/d1d/d39/f7a [6400,90007] 0 2024-04-20T10:55:07.134 INFO:tasks.workunit.client.1.smithi175.stdout:0/714: dwrite df/fac [0,4194304] 0 2024-04-20T10:55:07.134 INFO:tasks.workunit.client.1.smithi175.stdout:6/848: dwrite d1/dc0/d49/f10c [0,4194304] 0 2024-04-20T10:55:07.134 INFO:tasks.workunit.client.1.smithi175.stdout:6/849: fdatasync d1/d5/f38 0 2024-04-20T10:55:07.137 INFO:tasks.workunit.client.1.smithi175.stdout:0/715: dread df/d1a/d3f/fd1 [0,4194304] 0 2024-04-20T10:55:07.138 INFO:tasks.workunit.client.1.smithi175.stdout:2/714: dwrite d1/d53/fe8 [0,4194304] 0 2024-04-20T10:55:07.141 INFO:tasks.workunit.client.1.smithi175.stdout:3/622: dread d7/f14 [0,4194304] 0 2024-04-20T10:55:07.142 INFO:tasks.workunit.client.1.smithi175.stdout:9/710: dwrite d6/d1b/d26/d8c/fb0 [0,4194304] 0 2024-04-20T10:55:07.142 INFO:tasks.workunit.client.1.smithi175.stdout:3/623: dread d7/d19/d33/d7e/d86/f6f [0,4194304] 0 2024-04-20T10:55:07.142 INFO:tasks.workunit.client.1.smithi175.stdout:3/624: chown d7/d19/d33/d60/d79/d99/dac/lae 1937 1 2024-04-20T10:55:07.144 INFO:tasks.workunit.client.1.smithi175.stdout:2/715: dread d1/d7/f22 [0,4194304] 0 2024-04-20T10:55:07.147 INFO:tasks.workunit.client.1.smithi175.stdout:8/777: sync 2024-04-20T10:55:07.147 INFO:tasks.workunit.client.1.smithi175.stdout:4/867: sync 2024-04-20T10:55:07.147 INFO:tasks.workunit.client.1.smithi175.stdout:8/778: chown d7/d13/d1d/f1e 1 1 2024-04-20T10:55:07.147 INFO:tasks.workunit.client.1.smithi175.stdout:4/868: chown d4/dd/d2d/d33/d3c/c76 3307 1 2024-04-20T10:55:07.148 INFO:tasks.workunit.client.1.smithi175.stdout:8/779: symlink d7/d13/d1d/d24/d39/d6f/db7/lf7 0 2024-04-20T10:55:07.150 INFO:tasks.workunit.client.1.smithi175.stdout:4/869: creat d4/dd/d5e/d74/f127 x:0 0 0 2024-04-20T10:55:07.150 INFO:tasks.workunit.client.1.smithi175.stdout:4/870: truncate d4/d23/d2e/f82 5283691 0 2024-04-20T10:55:07.150 INFO:tasks.workunit.client.1.smithi175.stdout:4/871: truncate d4/d27/f14 2568924 0 2024-04-20T10:55:07.151 INFO:tasks.workunit.client.1.smithi175.stdout:8/780: getdents d7/d13/d1d/d24 0 2024-04-20T10:55:07.152 INFO:tasks.workunit.client.1.smithi175.stdout:4/872: mknod d4/dd/d54/d5d/d79/d9d/d104/ddf/c128 0 2024-04-20T10:55:07.154 INFO:tasks.workunit.client.1.smithi175.stdout:4/873: rename d4/dd/d2d/d43/d69/daa/f11f to d4/dd/d54/d5d/f129 0 2024-04-20T10:55:07.159 INFO:tasks.workunit.client.1.smithi175.stdout:2/716: read d1/d7/d63/dee/f50 [1256466,31975] 0 2024-04-20T10:55:07.160 INFO:tasks.workunit.client.1.smithi175.stdout:2/717: truncate d1/f3 3404262 0 2024-04-20T10:55:07.160 INFO:tasks.workunit.client.1.smithi175.stdout:2/718: chown d1/d7/d63/d36/d7d/d84/d8b/d99/lcf 227418784 1 2024-04-20T10:55:07.161 INFO:tasks.workunit.client.1.smithi175.stdout:1/896: write d0/d8/d13/fcf [653690,121783] 0 2024-04-20T10:55:07.161 INFO:tasks.workunit.client.1.smithi175.stdout:2/719: symlink d1/d48/d21/d76/da8/lfc 0 2024-04-20T10:55:07.163 INFO:tasks.workunit.client.1.smithi175.stdout:2/720: creat d1/d48/d21/db6/ffd x:0 0 0 2024-04-20T10:55:07.164 INFO:tasks.workunit.client.1.smithi175.stdout:2/721: symlink d1/d48/d38/lfe 0 2024-04-20T10:55:07.165 INFO:tasks.workunit.client.1.smithi175.stdout:6/850: dwrite d1/d37/f48 [0,4194304] 0 2024-04-20T10:55:07.165 INFO:tasks.workunit.client.1.smithi175.stdout:9/711: dwrite d6/d58/d90/fa3 [0,4194304] 0 2024-04-20T10:55:07.165 INFO:tasks.workunit.client.1.smithi175.stdout:0/716: dwrite df/d1a/d22/d6a/d72/fb4 [0,4194304] 0 2024-04-20T10:55:07.165 INFO:tasks.workunit.client.1.smithi175.stdout:2/722: creat d1/fff x:0 0 0 2024-04-20T10:55:07.167 INFO:tasks.workunit.client.1.smithi175.stdout:9/712: dread d6/d1b/d42/d51/f9a [0,4194304] 0 2024-04-20T10:55:07.167 INFO:tasks.workunit.client.1.smithi175.stdout:8/781: dread d7/d13/d1d/d24/f2b [0,4194304] 0 2024-04-20T10:55:07.167 INFO:tasks.workunit.client.1.smithi175.stdout:8/782: fsync d7/d13/d1d/d24/d38/d73/db5/fe3 0 2024-04-20T10:55:07.167 INFO:tasks.workunit.client.1.smithi175.stdout:6/851: creat d1/d37/f115 x:0 0 0 2024-04-20T10:55:07.167 INFO:tasks.workunit.client.1.smithi175.stdout:6/852: chown d1/d37/d83/db8/d60/d68/d7e/lec 53539 1 2024-04-20T10:55:07.169 INFO:tasks.workunit.client.1.smithi175.stdout:2/723: getdents d1/d48/d38/ded 0 2024-04-20T10:55:07.171 INFO:tasks.workunit.client.1.smithi175.stdout:8/783: rmdir d7/d13/d1d/dd6 0 2024-04-20T10:55:07.171 INFO:tasks.workunit.client.1.smithi175.stdout:8/784: chown d7/d13/d1d/d92/d6c/cbd 1279780 1 2024-04-20T10:55:07.171 INFO:tasks.workunit.client.1.smithi175.stdout:8/785: dread - d7/d13/d1d/d24/d38/d73/db5/dcc/fdc zero size 2024-04-20T10:55:07.171 INFO:tasks.workunit.client.1.smithi175.stdout:8/786: dread - d7/d13/d1d/d24/d39/d6f/db7/dbc/fef zero size 2024-04-20T10:55:07.171 INFO:tasks.workunit.client.1.smithi175.stdout:8/787: getdents d7/d13/d1d/d24/d26/dcb/ded 0 2024-04-20T10:55:07.174 INFO:tasks.workunit.client.1.smithi175.stdout:1/897: dread d0/d3e/f11c [0,4194304] 0 2024-04-20T10:55:07.174 INFO:tasks.workunit.client.1.smithi175.stdout:1/898: fsync d0/d51/d6b/fdb 0 2024-04-20T10:55:07.174 INFO:tasks.workunit.client.1.smithi175.stdout:1/899: stat d0/f77 0 2024-04-20T10:55:07.174 INFO:tasks.workunit.client.1.smithi175.stdout:4/874: dwrite d4/dd/d54/f11b [0,4194304] 0 2024-04-20T10:55:07.174 INFO:tasks.workunit.client.1.smithi175.stdout:2/724: creat d1/d48/d38/d82/df6/f100 x:0 0 0 2024-04-20T10:55:07.175 INFO:tasks.workunit.client.1.smithi175.stdout:6/853: unlink d1/d37/d83/db8/d60/l89 0 2024-04-20T10:55:07.175 INFO:tasks.workunit.client.1.smithi175.stdout:6/854: chown d1/d37/d83/la7 683921010 1 2024-04-20T10:55:07.181 INFO:tasks.workunit.client.1.smithi175.stdout:2/725: rename d1/d53 to d1/d7/d63/d36/d7d/d84/d8b/d101 0 2024-04-20T10:55:07.182 INFO:tasks.workunit.client.1.smithi175.stdout:2/726: dread d1/d7/f22 [0,4194304] 0 2024-04-20T10:55:07.182 INFO:tasks.workunit.client.1.smithi175.stdout:2/727: chown d1/f96 5937 1 2024-04-20T10:55:07.182 INFO:tasks.workunit.client.1.smithi175.stdout:1/900: link d0/d8/d13/d79/d8c/dac/f127 d0/d8/f139 0 2024-04-20T10:55:07.184 INFO:tasks.workunit.client.1.smithi175.stdout:1/901: rename d0/d3e/d61/d73/cd9 to d0/d51/da8/dfe/c13a 0 2024-04-20T10:55:07.185 INFO:tasks.workunit.client.1.smithi175.stdout:1/902: mkdir d0/d57/db7/d13b 0 2024-04-20T10:55:07.185 INFO:tasks.workunit.client.1.smithi175.stdout:1/903: rmdir d0/d57/db7 39 2024-04-20T10:55:07.186 INFO:tasks.workunit.client.1.smithi175.stdout:0/717: write df/d19/f1e [638359,115610] 0 2024-04-20T10:55:07.187 INFO:tasks.workunit.client.1.smithi175.stdout:1/904: read d0/d8/d13/d7b/fd5 [2233493,117358] 0 2024-04-20T10:55:07.187 INFO:tasks.workunit.client.1.smithi175.stdout:0/718: mkdir df/d1a/d22/d6a/ddf 0 2024-04-20T10:55:07.189 INFO:tasks.workunit.client.1.smithi175.stdout:1/905: symlink d0/d51/l13c 0 2024-04-20T10:55:07.189 INFO:tasks.workunit.client.1.smithi175.stdout:1/906: write d0/d51/d6b/d9e/de0/d107/f135 [4551691,122488] 0 2024-04-20T10:55:07.189 INFO:tasks.workunit.client.1.smithi175.stdout:1/907: creat d0/d57/db7/df5/d10a/f13d x:0 0 0 2024-04-20T10:55:07.191 INFO:tasks.workunit.client.1.smithi175.stdout:1/908: truncate d0/d8/d13/f26 2962540 0 2024-04-20T10:55:07.191 INFO:tasks.workunit.client.1.smithi175.stdout:1/909: dread - d0/d51/d6b/d129/f130 zero size 2024-04-20T10:55:07.192 INFO:tasks.workunit.client.1.smithi175.stdout:1/910: symlink d0/de8/l13e 0 2024-04-20T10:55:07.192 INFO:tasks.workunit.client.1.smithi175.stdout:1/911: fsync d0/d8/d13/d79/fed 0 2024-04-20T10:55:07.195 INFO:tasks.workunit.client.1.smithi175.stdout:4/875: dread d4/f1a [0,4194304] 0 2024-04-20T10:55:07.196 INFO:tasks.workunit.client.1.smithi175.stdout:9/713: dwrite d6/d58/d90/fa3 [4194304,4194304] 0 2024-04-20T10:55:07.196 INFO:tasks.workunit.client.1.smithi175.stdout:9/714: chown d6/d1b/d42/d79/d81/lb1 471775892 1 2024-04-20T10:55:07.199 INFO:tasks.workunit.client.1.smithi175.stdout:8/788: dwrite d7/d13/d1d/d24/d39/fbf [0,4194304] 0 2024-04-20T10:55:07.200 INFO:tasks.workunit.client.1.smithi175.stdout:1/912: dread d0/d29/f5c [0,4194304] 0 2024-04-20T10:55:07.200 INFO:tasks.workunit.client.1.smithi175.stdout:1/913: dread - d0/d51/d6b/d9e/de0/d107/f131 zero size 2024-04-20T10:55:07.202 INFO:tasks.workunit.client.1.smithi175.stdout:0/719: write df/d1a/d22/d55/fb3 [228051,13073] 0 2024-04-20T10:55:07.204 INFO:tasks.workunit.client.1.smithi175.stdout:8/789: mknod d7/d13/d1d/d24/d26/cf8 0 2024-04-20T10:55:07.204 INFO:tasks.workunit.client.1.smithi175.stdout:8/790: fdatasync d7/d13/d1d/d24/d26/f51 0 2024-04-20T10:55:07.212 INFO:tasks.workunit.client.1.smithi175.stdout:0/720: dread df/d17/d2f/f99 [0,4194304] 0 2024-04-20T10:55:07.213 INFO:tasks.workunit.client.1.smithi175.stdout:0/721: fsync df/d17/f52 0 2024-04-20T10:55:07.214 INFO:tasks.workunit.client.1.smithi175.stdout:0/722: mkdir df/d19/de0 0 2024-04-20T10:55:07.218 INFO:tasks.workunit.client.1.smithi175.stdout:4/876: dwrite d4/d23/ff1 [0,4194304] 0 2024-04-20T10:55:07.219 INFO:tasks.workunit.client.1.smithi175.stdout:0/723: link df/d1a/d22/d24/fc2 df/d19/de0/fe1 0 2024-04-20T10:55:07.221 INFO:tasks.workunit.client.1.smithi175.stdout:4/877: mknod d4/dd/d54/d5d/d8a/da4/c12a 0 2024-04-20T10:55:07.224 INFO:tasks.workunit.client.1.smithi175.stdout:9/715: dwrite d6/f1d [0,4194304] 0 2024-04-20T10:55:07.224 INFO:tasks.workunit.client.1.smithi175.stdout:9/716: chown d6/d1b/d42/d5b/d72/d7d/dae/cbb 1571924 1 2024-04-20T10:55:07.225 INFO:tasks.workunit.client.1.smithi175.stdout:1/914: dwrite d0/d8/d13/d2e/d35/f7c [0,4194304] 0 2024-04-20T10:55:07.227 INFO:tasks.workunit.client.1.smithi175.stdout:4/878: creat d4/dd/d54/d5d/d9e/f12b x:0 0 0 2024-04-20T10:55:07.229 INFO:tasks.workunit.client.1.smithi175.stdout:1/915: mkdir d0/d8/d13/d79/d13f 0 2024-04-20T10:55:07.231 INFO:tasks.workunit.client.1.smithi175.stdout:4/879: symlink d4/dd/d2d/l12c 0 2024-04-20T10:55:07.237 INFO:tasks.workunit.client.1.smithi175.stdout:0/724: dwrite df/d1a/da1/fd0 [0,4194304] 0 2024-04-20T10:55:07.237 INFO:tasks.workunit.client.1.smithi175.stdout:0/725: write df/d17/d2f/d4f/dcd/fd9 [127836,86128] 0 2024-04-20T10:55:07.238 INFO:tasks.workunit.client.1.smithi175.stdout:1/916: link d0/d8/d13/d2e/d35/cc8 d0/d102/c140 0 2024-04-20T10:55:07.238 INFO:tasks.workunit.client.1.smithi175.stdout:1/917: stat d0/d51/lbf 0 2024-04-20T10:55:07.241 INFO:tasks.workunit.client.1.smithi175.stdout:0/726: rename df/d17/d2f/laf to df/d1a/d22/d6a/le2 0 2024-04-20T10:55:07.243 INFO:tasks.workunit.client.1.smithi175.stdout:9/717: dwrite d6/d1b/f7a [0,4194304] 0 2024-04-20T10:55:07.244 INFO:tasks.workunit.client.1.smithi175.stdout:5/972: sync 2024-04-20T10:55:07.246 INFO:tasks.workunit.client.1.smithi175.stdout:1/918: truncate d0/fe 597765 0 2024-04-20T10:55:07.246 INFO:tasks.workunit.client.1.smithi175.stdout:1/919: truncate d0/d8/d13/d7b/f101 458329 0 2024-04-20T10:55:07.247 INFO:tasks.workunit.client.1.smithi175.stdout:1/920: write d0/d57/f74 [1315485,52634] 0 2024-04-20T10:55:07.247 INFO:tasks.workunit.client.1.smithi175.stdout:9/718: mkdir d6/d1b/d42/dd5 0 2024-04-20T10:55:07.249 INFO:tasks.workunit.client.1.smithi175.stdout:1/921: creat d0/d8/d13/db9/f141 x:0 0 0 2024-04-20T10:55:07.249 INFO:tasks.workunit.client.1.smithi175.stdout:4/880: dwrite d4/dd/d54/d5d/d79/d9d/dd4/f10a [0,4194304] 0 2024-04-20T10:55:07.251 INFO:tasks.workunit.client.1.smithi175.stdout:1/922: creat d0/f142 x:0 0 0 2024-04-20T10:55:07.251 INFO:tasks.workunit.client.1.smithi175.stdout:9/719: mknod d6/d1b/d42/cd6 0 2024-04-20T10:55:07.254 INFO:tasks.workunit.client.1.smithi175.stdout:1/923: symlink d0/d57/db7/df5/l143 0 2024-04-20T10:55:07.258 INFO:tasks.workunit.client.1.smithi175.stdout:0/727: write df/d1a/d22/d6a/d72/fb4 [3922103,41491] 0 2024-04-20T10:55:07.260 INFO:tasks.workunit.client.1.smithi175.stdout:9/720: rename d6/d1b/d42/d5b/d72/f7c to d6/d1b/fd7 0 2024-04-20T10:55:07.260 INFO:tasks.workunit.client.1.smithi175.stdout:9/721: truncate d6/d1b/d42/d5b/d72/d7d/dcc/d78/fd1 89879 0 2024-04-20T10:55:07.265 INFO:tasks.workunit.client.1.smithi175.stdout:9/722: dread d6/d1b/f47 [0,4194304] 0 2024-04-20T10:55:07.267 INFO:tasks.workunit.client.1.smithi175.stdout:5/973: dwrite db/d11/f2a [4194304,4194304] 0 2024-04-20T10:55:07.268 INFO:tasks.workunit.client.1.smithi175.stdout:0/728: link df/d1a/d3f/d5e/c64 df/d17/d2f/ce3 0 2024-04-20T10:55:07.269 INFO:tasks.workunit.client.1.smithi175.stdout:9/723: link d6/c13 d6/d1b/cd8 0 2024-04-20T10:55:07.273 INFO:tasks.workunit.client.1.smithi175.stdout:1/924: dwrite d0/d8/f4d [0,4194304] 0 2024-04-20T10:55:07.273 INFO:tasks.workunit.client.1.smithi175.stdout:1/925: write d0/d51/da8/dfe/f134 [895512,46777] 0 2024-04-20T10:55:07.274 INFO:tasks.workunit.client.1.smithi175.stdout:0/729: mknod df/d17/d2f/d4f/dcd/ce4 0 2024-04-20T10:55:07.274 INFO:tasks.workunit.client.1.smithi175.stdout:0/730: read - df/d17/dc0/fc5 zero size 2024-04-20T10:55:07.277 INFO:tasks.workunit.client.1.smithi175.stdout:9/724: write d6/d1b/d42/d5b/d72/d98/fb9 [1509822,101137] 0 2024-04-20T10:55:07.277 INFO:tasks.workunit.client.1.smithi175.stdout:9/725: truncate d6/f3c 546643 0 2024-04-20T10:55:07.277 INFO:tasks.workunit.client.1.smithi175.stdout:9/726: write d6/d1b/d42/f44 [3058883,27508] 0 2024-04-20T10:55:07.288 INFO:tasks.workunit.client.1.smithi175.stdout:0/731: creat df/d1a/d22/d6a/d72/fe5 x:0 0 0 2024-04-20T10:55:07.297 INFO:tasks.workunit.client.1.smithi175.stdout:5/974: dwrite db/d11/d25/fa2 [4194304,4194304] 0 2024-04-20T10:55:07.298 INFO:tasks.workunit.client.1.smithi175.stdout:1/926: mkdir d0/d144 0 2024-04-20T10:55:07.298 INFO:tasks.workunit.client.1.smithi175.stdout:1/927: truncate d0/d51/d6b/d129/f12a 542617 0 2024-04-20T10:55:07.298 INFO:tasks.workunit.client.1.smithi175.stdout:0/732: creat df/d1a/d22/d24/fe6 x:0 0 0 2024-04-20T10:55:07.300 INFO:tasks.workunit.client.1.smithi175.stdout:5/975: truncate db/ffc 780844 0 2024-04-20T10:55:07.302 INFO:tasks.workunit.client.1.smithi175.stdout:9/727: dwrite d6/f4c [4194304,4194304] 0 2024-04-20T10:55:07.303 INFO:tasks.workunit.client.1.smithi175.stdout:1/928: creat d0/d8/f145 x:0 0 0 2024-04-20T10:55:07.309 INFO:tasks.workunit.client.1.smithi175.stdout:4/881: write d4/dd/d5e/f72 [994148,12850] 0 2024-04-20T10:55:07.313 INFO:tasks.workunit.client.1.smithi175.stdout:0/733: symlink df/d2e/le7 0 2024-04-20T10:55:07.314 INFO:tasks.workunit.client.1.smithi175.stdout:9/728: symlink d6/d58/ld9 0 2024-04-20T10:55:07.315 INFO:tasks.workunit.client.1.smithi175.stdout:4/882: mknod d4/dd/d54/c12d 0 2024-04-20T10:55:07.318 INFO:tasks.workunit.client.1.smithi175.stdout:0/734: creat df/d17/d2f/d4f/fe8 x:0 0 0 2024-04-20T10:55:07.318 INFO:tasks.workunit.client.1.smithi175.stdout:0/735: chown df/d1a/da1 1052924 1 2024-04-20T10:55:07.318 INFO:tasks.workunit.client.1.smithi175.stdout:0/736: chown df/d17/d2f/c8e 58052 1 2024-04-20T10:55:07.319 INFO:tasks.workunit.client.1.smithi175.stdout:9/729: creat d6/d1b/d42/d51/d9f/fda x:0 0 0 2024-04-20T10:55:07.321 INFO:tasks.workunit.client.1.smithi175.stdout:5/976: dwrite db/d11/d6d/da1/dcc/fde [0,4194304] 0 2024-04-20T10:55:07.321 INFO:tasks.workunit.client.1.smithi175.stdout:5/977: chown db/d11/d25/d41/d83/cae 28676 1 2024-04-20T10:55:07.322 INFO:tasks.workunit.client.1.smithi175.stdout:0/737: creat df/d17/fe9 x:0 0 0 2024-04-20T10:55:07.323 INFO:tasks.workunit.client.1.smithi175.stdout:9/730: symlink d6/d1b/d26/d8c/dc6/ldb 0 2024-04-20T10:55:07.340 INFO:tasks.workunit.client.1.smithi175.stdout:0/738: dwrite df/d1a/f27 [4194304,4194304] 0 2024-04-20T10:55:07.340 INFO:tasks.workunit.client.1.smithi175.stdout:0/739: write df/d1a/d22/d55/fb3 [932410,22368] 0 2024-04-20T10:55:07.340 INFO:tasks.workunit.client.1.smithi175.stdout:5/978: creat db/d11/d25/d38/d40/d66/d94/f147 x:0 0 0 2024-04-20T10:55:07.342 INFO:tasks.workunit.client.1.smithi175.stdout:0/740: mkdir df/d19/de0/dea 0 2024-04-20T10:55:07.343 INFO:tasks.workunit.client.1.smithi175.stdout:9/731: mknod d6/cdc 0 2024-04-20T10:55:07.343 INFO:tasks.workunit.client.1.smithi175.stdout:9/732: fdatasync d6/d1b/d42/d79/d81/fa4 0 2024-04-20T10:55:07.362 INFO:tasks.workunit.client.1.smithi175.stdout:9/733: dwrite d6/d1b/d42/d5b/d72/d7d/fa8 [0,4194304] 0 2024-04-20T10:55:07.363 INFO:tasks.workunit.client.1.smithi175.stdout:0/741: rename df/d17/d2f/d4f/f84 to df/d19/de0/feb 0 2024-04-20T10:55:07.363 INFO:tasks.workunit.client.1.smithi175.stdout:0/742: write df/d1a/d22/d6a/d72/d48/d4e/f61 [2026693,48719] 0 2024-04-20T10:55:07.364 INFO:tasks.workunit.client.1.smithi175.stdout:5/979: mkdir db/dc1/d4f/d75/d91/d148 0 2024-04-20T10:55:07.379 INFO:tasks.workunit.client.1.smithi175.stdout:0/743: dwrite df/d1a/d28/f73 [0,4194304] 0 2024-04-20T10:55:07.380 INFO:tasks.workunit.client.1.smithi175.stdout:9/734: rmdir d6/d1b/d26/d8c 39 2024-04-20T10:55:07.381 INFO:tasks.workunit.client.1.smithi175.stdout:5/980: creat db/d11/d25/d38/d40/d66/d94/f149 x:0 0 0 2024-04-20T10:55:07.399 INFO:tasks.workunit.client.1.smithi175.stdout:5/981: dwrite db/d30/d46/fd0 [0,4194304] 0 2024-04-20T10:55:07.399 INFO:tasks.workunit.client.1.smithi175.stdout:5/982: fdatasync db/d11/d25/d38/d40/d66/f86 0 2024-04-20T10:55:07.399 INFO:tasks.workunit.client.1.smithi175.stdout:7/900: sync 2024-04-20T10:55:07.399 INFO:tasks.workunit.client.1.smithi175.stdout:3/625: sync 2024-04-20T10:55:07.400 INFO:tasks.workunit.client.1.smithi175.stdout:5/983: dread db/dc1/d4f/f78 [0,4194304] 0 2024-04-20T10:55:07.400 INFO:tasks.workunit.client.1.smithi175.stdout:5/984: write db/d11/d6d/da1/dcc/d115/f11b [729068,38764] 0 2024-04-20T10:55:07.400 INFO:tasks.workunit.client.1.smithi175.stdout:0/744: getdents df/d1a/d22/d55/da2 0 2024-04-20T10:55:07.403 INFO:tasks.workunit.client.1.smithi175.stdout:3/626: read d7/d19/d33/d60/d79/d99/f73 [1143088,59859] 0 2024-04-20T10:55:07.403 INFO:tasks.workunit.client.1.smithi175.stdout:3/627: chown d7/d21/d16 917 1 2024-04-20T10:55:07.410 INFO:tasks.workunit.client.1.smithi175.stdout:0/745: write df/d1a/d3f/f88 [637203,44560] 0 2024-04-20T10:55:07.412 INFO:tasks.workunit.client.1.smithi175.stdout:3/628: dread d7/d10/f4a [0,4194304] 0 2024-04-20T10:55:07.412 INFO:tasks.workunit.client.1.smithi175.stdout:5/985: truncate db/d1f/f7d 338198 0 2024-04-20T10:55:07.429 INFO:tasks.workunit.client.1.smithi175.stdout:5/986: dwrite db/d1f/f95 [0,4194304] 0 2024-04-20T10:55:07.431 INFO:tasks.workunit.client.1.smithi175.stdout:0/746: mkdir df/d1a/d22/d24/dec 0 2024-04-20T10:55:07.433 INFO:tasks.workunit.client.1.smithi175.stdout:3/629: dwrite d7/d19/d33/d60/d50/f9b [0,4194304] 0 2024-04-20T10:55:07.434 INFO:tasks.workunit.client.1.smithi175.stdout:3/630: truncate d7/d19/d33/d60/d79/f81 981791 0 2024-04-20T10:55:07.434 INFO:tasks.workunit.client.1.smithi175.stdout:0/747: dread df/d1a/d3f/f75 [0,4194304] 0 2024-04-20T10:55:08.063 INFO:tasks.workunit.client.1.smithi175.stdout:8/791: sync 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:0/748: sync 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:8/792: chown d7/d13/d1d/d24/d26/l49 45 1 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:1/929: sync 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:7/901: sync 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:6/855: sync 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:1/930: chown d0/d3e 1806 1 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:1/931: truncate d0/d8/d13/d79/ffc 4288719 0 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:2/728: sync 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:8/793: write d7/d13/d1d/d56/f96 [2672019,100968] 0 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:0/749: write df/d19/fc6 [236450,84202] 0 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:8/794: chown d7/d13/d1d/f47 6738 1 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:4/883: sync 2024-04-20T10:55:08.064 INFO:tasks.workunit.client.1.smithi175.stdout:0/750: stat df/d1a/da1 0 2024-04-20T10:55:08.065 INFO:tasks.workunit.client.1.smithi175.stdout:1/932: write d0/d8/d13/d2e/f46 [1712043,91276] 0 2024-04-20T10:55:08.065 INFO:tasks.workunit.client.1.smithi175.stdout:5/987: sync 2024-04-20T10:55:08.065 INFO:tasks.workunit.client.1.smithi175.stdout:3/631: sync 2024-04-20T10:55:08.066 INFO:tasks.workunit.client.1.smithi175.stdout:0/751: mknod df/d19/de0/dea/ced 0 2024-04-20T10:55:08.066 INFO:tasks.workunit.client.1.smithi175.stdout:0/752: write df/d1a/d22/fd4 [950863,54874] 0 2024-04-20T10:55:08.066 INFO:tasks.workunit.client.1.smithi175.stdout:0/753: chown df/d1a/d22/d6a/d72/f95 65584627 1 2024-04-20T10:55:08.067 INFO:tasks.workunit.client.1.smithi175.stdout:1/933: symlink d0/d8/d13/d125/l146 0 2024-04-20T10:55:08.068 INFO:tasks.workunit.client.1.smithi175.stdout:1/934: fsync d0/d8/d13/fcf 0 2024-04-20T10:55:08.068 INFO:tasks.workunit.client.1.smithi175.stdout:3/632: dread d7/f14 [4194304,4194304] 0 2024-04-20T10:55:08.068 INFO:tasks.workunit.client.1.smithi175.stdout:5/988: symlink db/d11/d80/dc3/l14a 0 2024-04-20T10:55:08.070 INFO:tasks.workunit.client.1.smithi175.stdout:0/754: rename df/d1a/d3f/c97 to df/d1a/d22/d6a/ddf/cee 0 2024-04-20T10:55:08.071 INFO:tasks.workunit.client.1.smithi175.stdout:8/795: write d7/d13/d1d/d24/d63/f9f [923635,72214] 0 2024-04-20T10:55:08.072 INFO:tasks.workunit.client.1.smithi175.stdout:5/989: truncate db/d1f/f95 263843 0 2024-04-20T10:55:08.073 INFO:tasks.workunit.client.1.smithi175.stdout:4/884: dread d4/ffb [0,4194304] 0 2024-04-20T10:55:08.073 INFO:tasks.workunit.client.1.smithi175.stdout:1/935: creat d0/d57/db7/f147 x:0 0 0 2024-04-20T10:55:08.074 INFO:tasks.workunit.client.1.smithi175.stdout:8/796: creat d7/d13/d1d/d92/ff9 x:0 0 0 2024-04-20T10:55:08.074 INFO:tasks.workunit.client.1.smithi175.stdout:8/797: write d7/d13/d1d/d24/d39/d85/ff5 [683130,24598] 0 2024-04-20T10:55:08.074 INFO:tasks.workunit.client.1.smithi175.stdout:5/990: symlink db/d30/d46/d88/l14b 0 2024-04-20T10:55:08.077 INFO:tasks.workunit.client.1.smithi175.stdout:1/936: mkdir d0/d8/d13/d7b/d148 0 2024-04-20T10:55:08.077 INFO:tasks.workunit.client.1.smithi175.stdout:7/902: dread db/d61/d6d/d9c/de8/d2a/f84 [0,4194304] 0 2024-04-20T10:55:08.078 INFO:tasks.workunit.client.1.smithi175.stdout:8/798: creat d7/ffa x:0 0 0 2024-04-20T10:55:08.083 INFO:tasks.workunit.client.1.smithi175.stdout:5/991: rename db/d11/d25/d62/f7c to db/d1f/d31/d93/f14c 0 2024-04-20T10:55:08.083 INFO:tasks.workunit.client.1.smithi175.stdout:5/992: write db/d1f/f7d [1082874,99918] 0 2024-04-20T10:55:08.088 INFO:tasks.workunit.client.1.smithi175.stdout:7/903: write db/d61/d6d/d9c/de8/d8e/f2d [954701,54262] 0 2024-04-20T10:55:08.088 INFO:tasks.workunit.client.1.smithi175.stdout:7/904: chown db/d61/d6d/d9c/de8/d8f/dcc 342032 1 2024-04-20T10:55:08.089 INFO:tasks.workunit.client.1.smithi175.stdout:1/937: creat d0/d51/d6b/d129/f149 x:0 0 0 2024-04-20T10:55:08.089 INFO:tasks.workunit.client.1.smithi175.stdout:1/938: write d0/d51/d6b/d133/f124 [867824,93779] 0 2024-04-20T10:55:08.090 INFO:tasks.workunit.client.1.smithi175.stdout:8/799: creat d7/d13/da3/ffb x:0 0 0 2024-04-20T10:55:08.090 INFO:tasks.workunit.client.1.smithi175.stdout:8/800: chown d7/d13/d1d/d24/d38/d73/cd1 527609 1 2024-04-20T10:55:08.091 INFO:tasks.workunit.client.1.smithi175.stdout:7/905: mknod db/d1d/d39/d50/dba/daa/df3/c134 0 2024-04-20T10:55:08.092 INFO:tasks.workunit.client.1.smithi175.stdout:8/801: mkdir d7/d13/d1d/d24/d39/d6f/db7/dce/dfc 0 2024-04-20T10:55:08.093 INFO:tasks.workunit.client.1.smithi175.stdout:7/906: creat db/d1d/d39/d50/dba/d47/f135 x:0 0 0 2024-04-20T10:55:08.093 INFO:tasks.workunit.client.1.smithi175.stdout:7/907: write db/d61/d6d/f90 [4333830,80188] 0 2024-04-20T10:55:08.093 INFO:tasks.workunit.client.1.smithi175.stdout:7/908: write db/d1d/d39/d50/f111 [302042,31269] 0 2024-04-20T10:55:08.094 INFO:tasks.workunit.client.1.smithi175.stdout:9/735: dwrite d6/d1b/d2f/f45 [0,4194304] 0 2024-04-20T10:55:08.095 INFO:tasks.workunit.client.1.smithi175.stdout:5/993: fdatasync db/d1f/f7d 0 2024-04-20T10:55:08.096 INFO:tasks.workunit.client.1.smithi175.stdout:5/994: write db/d1f/f18 [881453,69608] 0 2024-04-20T10:55:08.096 INFO:tasks.workunit.client.1.smithi175.stdout:3/633: dwrite d7/d10/d8c/f8e [0,4194304] 0 2024-04-20T10:55:08.096 INFO:tasks.workunit.client.1.smithi175.stdout:3/634: truncate d7/d21/d16/d85/fbb 356574 0 2024-04-20T10:55:08.098 INFO:tasks.workunit.client.1.smithi175.stdout:5/995: mknod db/d11/d80/dc3/c14d 0 2024-04-20T10:55:08.100 INFO:tasks.workunit.client.1.smithi175.stdout:7/909: dread db/d61/d6d/dbc/f104 [0,4194304] 0 2024-04-20T10:55:08.100 INFO:tasks.workunit.client.1.smithi175.stdout:9/736: dread d6/fe [0,4194304] 0 2024-04-20T10:55:08.100 INFO:tasks.workunit.client.1.smithi175.stdout:4/885: dwrite d4/dd/d5e/ff3 [0,4194304] 0 2024-04-20T10:55:08.101 INFO:tasks.workunit.client.1.smithi175.stdout:3/635: creat d7/d19/d33/d60/d50/fc4 x:0 0 0 2024-04-20T10:55:08.101 INFO:tasks.workunit.client.1.smithi175.stdout:3/636: fsync d7/d21/d16/d85/fbb 0 2024-04-20T10:55:08.101 INFO:tasks.workunit.client.1.smithi175.stdout:3/637: fsync d7/d10/d8c/f8e 0 2024-04-20T10:55:08.102 INFO:tasks.workunit.client.1.smithi175.stdout:0/755: dwrite df/d1a/f27 [0,4194304] 0 2024-04-20T10:55:08.103 INFO:tasks.workunit.client.1.smithi175.stdout:5/996: getdents db 0 2024-04-20T10:55:08.104 INFO:tasks.workunit.client.1.smithi175.stdout:7/910: rmdir db/d1d/d39/d50/dba/d47/da6/db9/dc8/dd8 39 2024-04-20T10:55:08.106 INFO:tasks.workunit.client.1.smithi175.stdout:3/638: dread d7/d21/d16/d22/d2c/f92 [0,4194304] 0 2024-04-20T10:55:08.106 INFO:tasks.workunit.client.1.smithi175.stdout:3/639: write d7/d10/f42 [4885016,80207] 0 2024-04-20T10:55:08.109 INFO:tasks.workunit.client.1.smithi175.stdout:1/939: dwrite d0/d57/fc3 [0,4194304] 0 2024-04-20T10:55:08.109 INFO:tasks.workunit.client.1.smithi175.stdout:9/737: mknod d6/d58/d90/daa/cdd 0 2024-04-20T10:55:08.112 INFO:tasks.workunit.client.1.smithi175.stdout:0/756: mknod df/d1a/da1/cef 0 2024-04-20T10:55:08.112 INFO:tasks.workunit.client.1.smithi175.stdout:0/757: dread - df/d1a/d28/fce zero size 2024-04-20T10:55:08.112 INFO:tasks.workunit.client.1.smithi175.stdout:0/758: write df/d1a/d3f/d5e/f7b [1651297,113037] 0 2024-04-20T10:55:08.112 INFO:tasks.workunit.client.1.smithi175.stdout:0/759: write df/d17/d2f/d4f/f57 [1791006,115385] 0 2024-04-20T10:55:08.113 INFO:tasks.workunit.client.1.smithi175.stdout:7/911: symlink db/d1d/d39/d50/dba/d47/da6/db9/dc8/d12b/d10e/l136 0 2024-04-20T10:55:08.114 INFO:tasks.workunit.client.1.smithi175.stdout:4/886: mkdir d4/dd/d54/d5d/d79/d12e 0 2024-04-20T10:55:08.115 INFO:tasks.workunit.client.1.smithi175.stdout:8/802: dwrite d7/f18 [0,4194304] 0 2024-04-20T10:55:08.116 INFO:tasks.workunit.client.1.smithi175.stdout:1/940: mknod d0/d8/d13/d7b/c14a 0 2024-04-20T10:55:08.118 INFO:tasks.workunit.client.1.smithi175.stdout:9/738: creat d6/d1b/d42/d51/d9f/fde x:0 0 0 2024-04-20T10:55:08.121 INFO:tasks.workunit.client.1.smithi175.stdout:7/912: truncate db/d1d/d39/d50/dba/f6b 651541 0 2024-04-20T10:55:08.124 INFO:tasks.workunit.client.1.smithi175.stdout:4/887: read d4/dd/d54/f9a [2328,11777] 0 2024-04-20T10:55:08.124 INFO:tasks.workunit.client.1.smithi175.stdout:1/941: symlink d0/d57/db7/d13b/l14b 0 2024-04-20T10:55:08.124 INFO:tasks.workunit.client.1.smithi175.stdout:1/942: fdatasync d0/f10 0 2024-04-20T10:55:08.124 INFO:tasks.workunit.client.1.smithi175.stdout:1/943: fsync d0/d51/da8/fb3 0 2024-04-20T10:55:08.125 INFO:tasks.workunit.client.1.smithi175.stdout:5/997: dwrite db/d30/d46/f7e [4194304,4194304] 0 2024-04-20T10:55:08.125 INFO:tasks.workunit.client.1.smithi175.stdout:5/998: truncate db/d1f/d31/f77 1213135 0 2024-04-20T10:55:08.126 INFO:tasks.workunit.client.1.smithi175.stdout:9/739: creat d6/d1b/d42/d5b/d72/d7d/dcc/d78/fdf x:0 0 0 2024-04-20T10:55:08.127 INFO:tasks.workunit.client.1.smithi175.stdout:4/888: dread d4/d27/f14 [0,4194304] 0 2024-04-20T10:55:08.127 INFO:tasks.workunit.client.1.smithi175.stdout:4/889: chown d4/dd/d2d/d33/d3c/d44/fc8 4 1 2024-04-20T10:55:08.127 INFO:tasks.workunit.client.1.smithi175.stdout:0/760: symlink df/d1a/d3f/d5e/lf0 0 2024-04-20T10:55:08.129 INFO:tasks.workunit.client.1.smithi175.stdout:1/944: truncate d0/d29/f5c 369379 0 2024-04-20T10:55:08.131 INFO:tasks.workunit.client.1.smithi175.stdout:5/999: symlink db/d11/d80/d135/l14e 0 2024-04-20T10:55:08.131 INFO:tasks.workunit.client.1.smithi175.stdout:7/913: dread f2 [0,4194304] 0 2024-04-20T10:55:08.131 INFO:tasks.workunit.client.1.smithi175.stdout:7/914: fdatasync db/d61/d6d/d9c/de8/d8f/f98 0 2024-04-20T10:55:08.132 INFO:tasks.workunit.client.1.smithi175.stdout:4/890: creat d4/dd/d2d/d33/d3c/d44/f12f x:0 0 0 2024-04-20T10:55:08.133 INFO:tasks.workunit.client.1.smithi175.stdout:0/761: creat df/d1a/d28/ff1 x:0 0 0 2024-04-20T10:55:08.135 INFO:tasks.workunit.client.1.smithi175.stdout:7/915: symlink db/d61/d6d/dbc/l137 0 2024-04-20T10:55:08.135 INFO:tasks.workunit.client.1.smithi175.stdout:7/916: fsync db/d1d/d39/de7/f102 0 2024-04-20T10:55:08.138 INFO:tasks.workunit.client.1.smithi175.stdout:0/762: link df/d1a/d22/d55/fb3 df/d1a/d22/d6a/d72/d48/d4e/ff2 0 2024-04-20T10:55:08.139 INFO:tasks.workunit.client.1.smithi175.stdout:0/763: getdents df/d19/de0 0 2024-04-20T10:55:08.139 INFO:tasks.workunit.client.1.smithi175.stdout:0/764: truncate df/d1a/d22/d6a/d72/d7f/fbf 598702 0 2024-04-20T10:55:08.140 INFO:tasks.workunit.client.1.smithi175.stdout:3/640: dwrite d7/d21/d16/d22/faa [0,4194304] 0 2024-04-20T10:55:08.141 INFO:tasks.workunit.client.1.smithi175.stdout:7/917: write db/d61/d6d/dbc/f104 [4039675,107739] 0 2024-04-20T10:55:08.143 INFO:tasks.workunit.client.1.smithi175.stdout:3/641: mkdir d7/d21/d16/d49/dc5 0 2024-04-20T10:55:08.143 INFO:tasks.workunit.client.1.smithi175.stdout:3/642: chown d7/f51 64060661 1 2024-04-20T10:55:08.150 INFO:tasks.workunit.client.1.smithi175.stdout:8/803: dwrite d7/d13/d1d/d24/d39/f7d [0,4194304] 0 2024-04-20T10:55:08.150 INFO:tasks.workunit.client.1.smithi175.stdout:8/804: fdatasync d7/fc3 0 2024-04-20T10:55:08.152 INFO:tasks.workunit.client.1.smithi175.stdout:8/805: mkdir d7/d13/d1d/d24/dfd 0 2024-04-20T10:55:08.152 INFO:tasks.workunit.client.1.smithi175.stdout:7/918: dread db/d61/d6d/f7c [4194304,4194304] 0 2024-04-20T10:55:08.161 INFO:tasks.workunit.client.1.smithi175.stdout:7/919: write db/d1d/d39/d50/dba/d47/f9b [3170753,112545] 0 2024-04-20T10:55:08.161 INFO:tasks.workunit.client.1.smithi175.stdout:7/920: chown db/d61/d6d/d9c/de8/d2a/d41/d130 205899327 1 2024-04-20T10:55:08.162 INFO:tasks.workunit.client.1.smithi175.stdout:7/921: readlink l4 0 2024-04-20T10:55:08.163 INFO:tasks.workunit.client.1.smithi175.stdout:7/922: truncate db/d61/d6d/d9c/de8/d8f/faf 1716546 0 2024-04-20T10:55:08.164 INFO:tasks.workunit.client.1.smithi175.stdout:7/923: mkdir db/d61/d6d/d9c/de8/d2a/d41/d59/db3/d138 0 2024-04-20T10:55:08.166 INFO:tasks.workunit.client.1.smithi175.stdout:1/945: dwrite d0/d8/d13/fcf [0,4194304] 0 2024-04-20T10:55:08.167 INFO:tasks.workunit.client.1.smithi175.stdout:1/946: truncate d0/d8/d13/d2e/d35/d8a/fb0 3296898 0 2024-04-20T10:55:08.169 INFO:tasks.workunit.client.1.smithi175.stdout:1/947: rename d0/d51/d6b/d9e/de0/f11e to d0/de8/f14c 0 2024-04-20T10:55:08.173 INFO:tasks.workunit.client.1.smithi175.stdout:9/740: dwrite d6/f17 [0,4194304] 0 2024-04-20T10:55:08.173 INFO:tasks.workunit.client.1.smithi175.stdout:9/741: write d6/d33/d63/f73 [5067037,44315] 0 2024-04-20T10:55:08.174 INFO:tasks.workunit.client.1.smithi175.stdout:9/742: creat d6/d1b/d42/d5b/d72/d9e/fe0 x:0 0 0 2024-04-20T10:55:08.174 INFO:tasks.workunit.client.1.smithi175.stdout:9/743: write d6/d1b/d42/d5b/d72/d7d/f80 [302670,123487] 0 2024-04-20T10:55:08.174 INFO:tasks.workunit.client.1.smithi175.stdout:3/643: dwrite d7/d19/f97 [0,4194304] 0 2024-04-20T10:55:08.175 INFO:tasks.workunit.client.1.smithi175.stdout:9/744: creat d6/d1b/d42/d5b/d72/d7d/dcc/d78/fe1 x:0 0 0 2024-04-20T10:55:08.176 INFO:tasks.workunit.client.1.smithi175.stdout:7/924: dread db/d1d/d39/d50/dba/d47/da6/db9/f126 [0,4194304] 0 2024-04-20T10:55:08.177 INFO:tasks.workunit.client.1.smithi175.stdout:3/644: creat d7/d19/d33/d60/d79/d99/dac/dc0/fc6 x:0 0 0 2024-04-20T10:55:08.177 INFO:tasks.workunit.client.1.smithi175.stdout:3/645: chown l4 484193 1 2024-04-20T10:55:08.183 INFO:tasks.workunit.client.1.smithi175.stdout:3/646: dread d7/d19/d33/d60/d79/d99/fab [0,4194304] 0 2024-04-20T10:55:08.184 INFO:tasks.workunit.client.1.smithi175.stdout:3/647: mkdir d7/d19/d33/d60/d79/d99/dac/dc7 0 2024-04-20T10:55:08.186 INFO:tasks.workunit.client.1.smithi175.stdout:0/765: dwrite df/d17/d2f/d4f/dcd/fd9 [0,4194304] 0 2024-04-20T10:55:08.186 INFO:tasks.workunit.client.1.smithi175.stdout:4/891: dwrite d4/d27/d61/f46 [4194304,4194304] 0 2024-04-20T10:55:08.186 INFO:tasks.workunit.client.1.smithi175.stdout:3/648: rename d7/c1a to d7/d19/d33/d60/d79/d99/dac/dc7/cc8 0 2024-04-20T10:55:08.187 INFO:tasks.workunit.client.1.smithi175.stdout:9/745: write d6/d1b/d42/d5b/d72/d7d/fa8 [1598365,49126] 0 2024-04-20T10:55:08.192 INFO:tasks.workunit.client.1.smithi175.stdout:8/806: dwrite d7/d13/d1d/d24/d38/d73/db5/dcc/fdc [0,4194304] 0 2024-04-20T10:55:08.192 INFO:tasks.workunit.client.1.smithi175.stdout:8/807: fsync d7/d13/d1d/ff2 0 2024-04-20T10:55:08.192 INFO:tasks.workunit.client.1.smithi175.stdout:8/808: fdatasync d7/d13/d1d/d24/d39/f48 0 2024-04-20T10:55:08.193 INFO:tasks.workunit.client.1.smithi175.stdout:8/809: chown d7/d13/d1d/d56/f96 27390313 1 2024-04-20T10:55:08.193 INFO:tasks.workunit.client.1.smithi175.stdout:8/810: fsync d7/d13/d1d/d92/ff9 0 2024-04-20T10:55:08.193 INFO:tasks.workunit.client.1.smithi175.stdout:1/948: dwrite d0/d57/f74 [0,4194304] 0 2024-04-20T10:55:08.193 INFO:tasks.workunit.client.1.smithi175.stdout:8/811: write d7/d13/d1d/d24/d39/d6f/db7/dce/fd3 [1652968,48165] 0 2024-04-20T10:55:08.193 INFO:tasks.workunit.client.1.smithi175.stdout:7/925: dwrite db/d1d/d39/d50/dba/f88 [0,4194304] 0 2024-04-20T10:55:08.196 INFO:tasks.workunit.client.1.smithi175.stdout:0/766: mknod df/d1a/d28/dde/cf3 0 2024-04-20T10:55:08.197 INFO:tasks.workunit.client.1.smithi175.stdout:4/892: rmdir d4/dd/d54/d5d/d79/d9d 39 2024-04-20T10:55:08.198 INFO:tasks.workunit.client.1.smithi175.stdout:3/649: creat d7/d10/fc9 x:0 0 0 2024-04-20T10:55:08.201 INFO:tasks.workunit.client.1.smithi175.stdout:9/746: rename d6/d1b/d42/f44 to d6/d1b/d42/d79/fe2 0 2024-04-20T10:55:08.206 INFO:tasks.workunit.client.1.smithi175.stdout:4/893: write d4/dd/d5e/d74/da1/dbc/fc2 [4132980,30880] 0 2024-04-20T10:55:08.207 INFO:tasks.workunit.client.1.smithi175.stdout:1/949: creat d0/d51/da8/f14d x:0 0 0 2024-04-20T10:55:08.212 INFO:tasks.workunit.client.1.smithi175.stdout:7/926: mkdir db/d61/d6d/dbc/d139 0 2024-04-20T10:55:08.213 INFO:tasks.workunit.client.1.smithi175.stdout:0/767: mkdir df/d1a/d22/d24/d9a/df4 0 2024-04-20T10:55:08.213 INFO:tasks.workunit.client.1.smithi175.stdout:1/950: write d0/d8/d13/d2e/d35/f37 [127724,9233] 0 2024-04-20T10:55:08.215 INFO:tasks.workunit.client.1.smithi175.stdout:3/650: dwrite d7/d21/d16/d85/fb8 [0,4194304] 0 2024-04-20T10:55:08.216 INFO:tasks.workunit.client.1.smithi175.stdout:4/894: dread d4/dd/d54/f4a [0,4194304] 0 2024-04-20T10:55:08.216 INFO:tasks.workunit.client.1.smithi175.stdout:8/812: mknod d7/d13/d1d/cfe 0 2024-04-20T10:55:08.217 INFO:tasks.workunit.client.1.smithi175.stdout:0/768: unlink df/d2e/l77 0 2024-04-20T10:55:08.218 INFO:tasks.workunit.client.1.smithi175.stdout:1/951: creat d0/d8/d13/d7b/f14e x:0 0 0 2024-04-20T10:55:08.218 INFO:tasks.workunit.client.1.smithi175.stdout:9/747: mknod d6/d58/ce3 0 2024-04-20T10:55:08.221 INFO:tasks.workunit.client.1.smithi175.stdout:4/895: creat d4/dd/d2d/d43/d69/daa/f130 x:0 0 0 2024-04-20T10:55:08.221 INFO:tasks.workunit.client.1.smithi175.stdout:8/813: creat d7/d13/d1d/d92/d6c/fff x:0 0 0 2024-04-20T10:55:08.222 INFO:tasks.workunit.client.1.smithi175.stdout:0/769: symlink df/d1a/d28/dde/lf5 0 2024-04-20T10:55:08.223 INFO:tasks.workunit.client.1.smithi175.stdout:9/748: rename d6/d1b/fd7 to d6/d1b/d26/d8c/fe4 0 2024-04-20T10:55:08.224 INFO:tasks.workunit.client.1.smithi175.stdout:4/896: creat d4/d23/f131 x:0 0 0 2024-04-20T10:55:08.225 INFO:tasks.workunit.client.1.smithi175.stdout:8/814: creat d7/d13/d1d/f100 x:0 0 0 2024-04-20T10:55:08.226 INFO:tasks.workunit.client.1.smithi175.stdout:8/815: fdatasync d7/d13/d1d/d24/d39/d85/fba 0 2024-04-20T10:55:08.226 INFO:tasks.workunit.client.1.smithi175.stdout:8/816: truncate d7/d13/d1d/d92/d6c/fff 533845 0 2024-04-20T10:55:08.226 INFO:tasks.workunit.client.1.smithi175.stdout:3/651: read d7/d21/d16/d22/d2c/d1f/d48/f61 [1163714,124717] 0 2024-04-20T10:55:08.226 INFO:tasks.workunit.client.1.smithi175.stdout:0/770: mknod df/d17/d2f/d4f/dcd/cf6 0 2024-04-20T10:55:08.226 INFO:tasks.workunit.client.1.smithi175.stdout:9/749: mknod d6/d1b/d42/d5b/d72/d9e/ce5 0 2024-04-20T10:55:08.227 INFO:tasks.workunit.client.1.smithi175.stdout:4/897: creat d4/dd/d5e/f132 x:0 0 0 2024-04-20T10:55:08.227 INFO:tasks.workunit.client.1.smithi175.stdout:4/898: read - d4/dd/d54/d5d/d79/ff7 zero size 2024-04-20T10:55:08.228 INFO:tasks.workunit.client.1.smithi175.stdout:8/817: mknod d7/d13/d1d/d24/d38/d73/db5/ddb/c101 0 2024-04-20T10:55:08.228 INFO:tasks.workunit.client.1.smithi175.stdout:8/818: chown d7/d13/d1d/d24/d38/d73/db5/ddb/c101 97 1 2024-04-20T10:55:08.230 INFO:tasks.workunit.client.1.smithi175.stdout:3/652: creat d7/d19/fca x:0 0 0 2024-04-20T10:55:08.230 INFO:tasks.workunit.client.1.smithi175.stdout:0/771: symlink df/d1a/d22/d24/d9a/lf7 0 2024-04-20T10:55:08.232 INFO:tasks.workunit.client.1.smithi175.stdout:6/856: sync 2024-04-20T10:55:08.232 INFO:tasks.workunit.client.1.smithi175.stdout:2/729: sync 2024-04-20T10:55:08.232 INFO:tasks.workunit.client.1.smithi175.stdout:0/772: dread df/d19/f8a [0,4194304] 0 2024-04-20T10:55:08.232 INFO:tasks.workunit.client.1.smithi175.stdout:9/750: unlink d6/d1b/d42/d79/l9b 0 2024-04-20T10:55:08.233 INFO:tasks.workunit.client.1.smithi175.stdout:7/927: dwrite db/d1d/d39/d50/dba/d47/da6/db9/fc2 [0,4194304] 0 2024-04-20T10:55:08.233 INFO:tasks.workunit.client.1.smithi175.stdout:7/928: write db/d1d/d39/d50/f3e [3754006,28589] 0 2024-04-20T10:55:08.233 INFO:tasks.workunit.client.1.smithi175.stdout:4/899: getdents d4/dd/d2d/d33 0 2024-04-20T10:55:08.235 INFO:tasks.workunit.client.1.smithi175.stdout:8/819: creat d7/d13/da3/f102 x:0 0 0 2024-04-20T10:55:08.236 INFO:tasks.workunit.client.1.smithi175.stdout:1/952: dwrite d0/d51/f48 [0,4194304] 0 2024-04-20T10:55:08.236 INFO:tasks.workunit.client.1.smithi175.stdout:1/953: fsync d0/f142 0 2024-04-20T10:55:08.236 INFO:tasks.workunit.client.1.smithi175.stdout:1/954: stat d0/d102/f123 0 2024-04-20T10:55:08.238 INFO:tasks.workunit.client.1.smithi175.stdout:3/653: rename d7/d19/d33/d60 to d7/d19/d33/d7e/d86/d7d/dcb 0 2024-04-20T10:55:08.240 INFO:tasks.workunit.client.1.smithi175.stdout:2/730: truncate d1/d7/d63/dee/f6c 1933128 0 2024-04-20T10:55:08.240 INFO:tasks.workunit.client.1.smithi175.stdout:3/654: fdatasync d7/d10/f42 0 2024-04-20T10:55:08.243 INFO:tasks.workunit.client.1.smithi175.stdout:0/773: symlink df/d17/dc0/lf8 0 2024-04-20T10:55:08.246 INFO:tasks.workunit.client.1.smithi175.stdout:4/900: write d4/dd/d54/d5d/d8a/fde [2116427,77653] 0 2024-04-20T10:55:08.246 INFO:tasks.workunit.client.1.smithi175.stdout:9/751: mkdir d6/d1b/d42/d51/de6 0 2024-04-20T10:55:08.246 INFO:tasks.workunit.client.1.smithi175.stdout:9/752: stat d6/d58/d90/daa/fb7 0 2024-04-20T10:55:08.248 INFO:tasks.workunit.client.1.smithi175.stdout:6/857: dwrite d1/d37/d83/db8/d60/d68/d7e/f81 [0,4194304] 0 2024-04-20T10:55:08.249 INFO:tasks.workunit.client.1.smithi175.stdout:4/901: mknod d4/dd/d54/d5d/d79/d12e/c133 0 2024-04-20T10:55:08.249 INFO:tasks.workunit.client.1.smithi175.stdout:4/902: write d4/dd/d2d/f4c [69634,20411] 0 2024-04-20T10:55:08.249 INFO:tasks.workunit.client.1.smithi175.stdout:3/655: write d7/f12 [3759853,24775] 0 2024-04-20T10:55:08.251 INFO:tasks.workunit.client.1.smithi175.stdout:6/858: creat d1/d37/d83/db8/d60/ded/dc1/dfc/f116 x:0 0 0 2024-04-20T10:55:08.251 INFO:tasks.workunit.client.1.smithi175.stdout:6/859: fsync d1/d5/f45 0 2024-04-20T10:55:08.253 INFO:tasks.workunit.client.1.smithi175.stdout:9/753: mkdir d6/d33/de7 0 2024-04-20T10:55:08.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/656: creat d7/d10/d8c/fcc x:0 0 0 2024-04-20T10:55:08.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/657: chown d7/d21/d16/d22/d2c/d64 788391 1 2024-04-20T10:55:08.257 INFO:tasks.workunit.client.1.smithi175.stdout:6/860: truncate d1/dc0/d29/f55 771097 0 2024-04-20T10:55:08.259 INFO:tasks.workunit.client.1.smithi175.stdout:4/903: mkdir d4/dd/d54/d5d/d8a/d134 0 2024-04-20T10:55:08.259 INFO:tasks.workunit.client.1.smithi175.stdout:7/929: dwrite db/d61/d6d/d9c/de8/d8e/f4d [4194304,4194304] 0 2024-04-20T10:55:08.261 INFO:tasks.workunit.client.1.smithi175.stdout:3/658: link d7/f14 d7/d21/d16/d85/fcd 0 2024-04-20T10:55:08.264 INFO:tasks.workunit.client.1.smithi175.stdout:7/930: truncate db/d1d/d39/d50/dba/f88 3032254 0 2024-04-20T10:55:08.264 INFO:tasks.workunit.client.1.smithi175.stdout:7/931: fdatasync db/d61/d6d/d9c/de8/f3c 0 2024-04-20T10:55:08.265 INFO:tasks.workunit.client.1.smithi175.stdout:3/659: mkdir d7/d21/d16/d22/d2c/d64/dbd/dce 0 2024-04-20T10:55:08.267 INFO:tasks.workunit.client.1.smithi175.stdout:4/904: rename d4/dd/d54/d5d/d79/d9d/dd4/d10e/ffe to d4/dd/d2d/d33/d5b/f135 0 2024-04-20T10:55:08.269 INFO:tasks.workunit.client.1.smithi175.stdout:3/660: creat d7/d21/d16/d49/d54/fcf x:0 0 0 2024-04-20T10:55:08.269 INFO:tasks.workunit.client.1.smithi175.stdout:3/661: truncate d7/d21/f8d 164346 0 2024-04-20T10:55:08.270 INFO:tasks.workunit.client.1.smithi175.stdout:3/662: chown d7/d19/d33/d7e/d89/ca9 1427562 1 2024-04-20T10:55:08.272 INFO:tasks.workunit.client.1.smithi175.stdout:7/932: link db/d1d/d39/d50/dba/d47/da6/db9/l12a db/d61/d6d/d9c/de8/d9a/l13a 0 2024-04-20T10:55:08.274 INFO:tasks.workunit.client.1.smithi175.stdout:1/955: dwrite d0/d51/da8/f126 [0,4194304] 0 2024-04-20T10:55:08.276 INFO:tasks.workunit.client.1.smithi175.stdout:6/861: dread d1/d37/f48 [0,4194304] 0 2024-04-20T10:55:08.276 INFO:tasks.workunit.client.1.smithi175.stdout:9/754: dwrite d6/d1b/d42/d5b/d72/d7d/dcc/d78/f7f [0,4194304] 0 2024-04-20T10:55:08.277 INFO:tasks.workunit.client.1.smithi175.stdout:0/774: dwrite df/d1a/d22/d6a/d72/d7f/fbf [0,4194304] 0 2024-04-20T10:55:08.277 INFO:tasks.workunit.client.1.smithi175.stdout:0/775: fdatasync df/d19/fc6 0 2024-04-20T10:55:08.284 INFO:tasks.workunit.client.1.smithi175.stdout:1/956: write d0/d8/dcb/ffa [1542417,120496] 0 2024-04-20T10:55:08.533 INFO:tasks.workunit.client.1.smithi175.stdout:4/905: link d4/dd/d2d/d43/d69/daa/fc6 d4/dd/d5e/f136 0 2024-04-20T10:55:08.533 INFO:tasks.workunit.client.1.smithi175.stdout:2/731: fsync d1/d7/d63/dee/f6c 0 2024-04-20T10:55:08.533 INFO:tasks.workunit.client.1.smithi175.stdout:8/820: write d7/d13/d1d/d24/fb0 [190940,24537] 0 2024-04-20T10:55:08.533 INFO:tasks.workunit.client.1.smithi175.stdout:7/933: truncate db/d1d/d39/d50/dba/f88 3391882 0 2024-04-20T10:55:08.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/755: mknod d6/d1b/d42/d51/d9f/ce8 0 2024-04-20T10:55:08.535 INFO:tasks.workunit.client.1.smithi175.stdout:9/756: readlink d6/lf 0 2024-04-20T10:55:08.536 INFO:tasks.workunit.client.1.smithi175.stdout:0/776: readlink df/d2e/l53 0 2024-04-20T10:55:08.540 INFO:tasks.workunit.client.1.smithi175.stdout:1/957: rmdir d0/d51/da8 39 2024-04-20T10:55:08.543 INFO:tasks.workunit.client.1.smithi175.stdout:4/906: truncate d4/dd/d2d/d33/d3c/f80 359189 0 2024-04-20T10:55:08.543 INFO:tasks.workunit.client.1.smithi175.stdout:4/907: fsync d4/dd/d54/d5d/d79/d9d/dd4/f10a 0 2024-04-20T10:55:08.543 INFO:tasks.workunit.client.1.smithi175.stdout:4/908: chown d4/l22 2 1 2024-04-20T10:55:08.553 INFO:tasks.workunit.client.1.smithi175.stdout:8/821: creat d7/d13/d1d/d24/d39/d85/f103 x:0 0 0 2024-04-20T10:55:08.555 INFO:tasks.workunit.client.1.smithi175.stdout:6/862: rename d1/dc0/d29/l53 to d1/l117 0 2024-04-20T10:55:08.556 INFO:tasks.workunit.client.1.smithi175.stdout:9/757: getdents d6/d1b/d42/d5b/d72/d7d/dae 0 2024-04-20T10:55:08.557 INFO:tasks.workunit.client.1.smithi175.stdout:0/777: creat df/d1a/d3f/ff9 x:0 0 0 2024-04-20T10:55:08.560 INFO:tasks.workunit.client.1.smithi175.stdout:7/934: link db/d61/d6d/f10b db/d1d/d39/d50/dba/f13b 0 2024-04-20T10:55:08.562 INFO:tasks.workunit.client.1.smithi175.stdout:9/758: mkdir d6/d58/d90/daa/dbd/de9 0 2024-04-20T10:55:08.562 INFO:tasks.workunit.client.1.smithi175.stdout:9/759: write d6/d1b/d42/d5b/d72/d7d/dcc/d78/fe1 [877989,106239] 0 2024-04-20T10:55:08.563 INFO:tasks.workunit.client.1.smithi175.stdout:0/778: unlink df/d1a/l8c 0 2024-04-20T10:55:08.563 INFO:tasks.workunit.client.1.smithi175.stdout:0/779: readlink df/d1a/lda 0 2024-04-20T10:55:08.563 INFO:tasks.workunit.client.1.smithi175.stdout:0/780: chown df/d1a/d3f/d5e/lf0 51092 1 2024-04-20T10:55:08.564 INFO:tasks.workunit.client.1.smithi175.stdout:4/909: symlink d4/d23/d2e/l137 0 2024-04-20T10:55:08.564 INFO:tasks.workunit.client.1.smithi175.stdout:4/910: fdatasync d4/d27/fe2 0 2024-04-20T10:55:08.565 INFO:tasks.workunit.client.1.smithi175.stdout:2/732: rename d1/d48/d38/d82 to d1/d48/d102 0 2024-04-20T10:55:08.566 INFO:tasks.workunit.client.1.smithi175.stdout:6/863: mkdir d1/d5/d12/d7f/d118 0 2024-04-20T10:55:08.566 INFO:tasks.workunit.client.1.smithi175.stdout:6/864: truncate d1/d37/d83/db8/d60/d6b/d10d/f10f 842054 0 2024-04-20T10:55:08.567 INFO:tasks.workunit.client.1.smithi175.stdout:9/760: unlink d6/d33/d63/ca5 0 2024-04-20T10:55:08.567 INFO:tasks.workunit.client.1.smithi175.stdout:9/761: stat d6/d58/d90/daa/dbd 0 2024-04-20T10:55:08.569 INFO:tasks.workunit.client.1.smithi175.stdout:6/865: mkdir d1/d37/d83/db8/d60/d6b/d119 0 2024-04-20T10:55:08.570 INFO:tasks.workunit.client.1.smithi175.stdout:3/663: sync 2024-04-20T10:55:08.570 INFO:tasks.workunit.client.1.smithi175.stdout:8/822: dwrite d7/d13/d1d/d92/fa8 [0,4194304] 0 2024-04-20T10:55:08.571 INFO:tasks.workunit.client.1.smithi175.stdout:0/781: mkdir df/d17/d2f/dfa 0 2024-04-20T10:55:08.571 INFO:tasks.workunit.client.1.smithi175.stdout:0/782: readlink df/d17/d2f/d4f/l82 0 2024-04-20T10:55:08.572 INFO:tasks.workunit.client.1.smithi175.stdout:2/733: mkdir d1/d7/d103 0 2024-04-20T10:55:08.572 INFO:tasks.workunit.client.1.smithi175.stdout:6/866: dread d1/d5/d12/f35 [4194304,4194304] 0 2024-04-20T10:55:08.573 INFO:tasks.workunit.client.1.smithi175.stdout:0/783: rename df/d1a/d22/d24/d9a to df/d19/de0/dfb 0 2024-04-20T10:55:08.573 INFO:tasks.workunit.client.1.smithi175.stdout:0/784: chown df/d17/d2f/d4f/dcd/ldc 153 1 2024-04-20T10:55:08.574 INFO:tasks.workunit.client.1.smithi175.stdout:6/867: symlink d1/d37/d83/l11a 0 2024-04-20T10:55:08.575 INFO:tasks.workunit.client.1.smithi175.stdout:6/868: chown d1/dc0/d63/f103 712491978 1 2024-04-20T10:55:08.576 INFO:tasks.workunit.client.1.smithi175.stdout:2/734: rename d1/d48/d21/d76/l2a to d1/d7/d63/dee/l104 0 2024-04-20T10:55:08.577 INFO:tasks.workunit.client.1.smithi175.stdout:4/911: write d4/d27/f7b [6763149,22383] 0 2024-04-20T10:55:08.577 INFO:tasks.workunit.client.1.smithi175.stdout:6/869: creat d1/d37/d83/db8/d60/d6b/f11b x:0 0 0 2024-04-20T10:55:08.581 INFO:tasks.workunit.client.1.smithi175.stdout:2/735: symlink d1/d7/l105 0 2024-04-20T10:55:08.582 INFO:tasks.workunit.client.1.smithi175.stdout:8/823: write d7/d13/d1d/d24/d38/d73/fa6 [3084732,50560] 0 2024-04-20T10:55:08.582 INFO:tasks.workunit.client.1.smithi175.stdout:8/824: chown d7/d13/d1d/d24/d39/d6f/db7/ff3 1689844 1 2024-04-20T10:55:08.583 INFO:tasks.workunit.client.1.smithi175.stdout:8/825: write d7/fc3 [334275,100397] 0 2024-04-20T10:55:08.594 INFO:tasks.workunit.client.1.smithi175.stdout:9/762: dwrite d6/fe [4194304,4194304] 0 2024-04-20T10:55:08.595 INFO:tasks.workunit.client.1.smithi175.stdout:8/826: write d7/d13/d1d/d56/fe2 [2978304,125897] 0 2024-04-20T10:55:08.595 INFO:tasks.workunit.client.1.smithi175.stdout:8/827: stat d7/d13/d1d/d24/d38/d73/db5/ddb/c101 0 2024-04-20T10:55:08.595 INFO:tasks.workunit.client.1.smithi175.stdout:8/828: read - d7/d13/d1d/f100 zero size 2024-04-20T10:55:08.603 INFO:tasks.workunit.client.1.smithi175.stdout:6/870: dwrite d1/d37/d83/db8/d60/f86 [0,4194304] 0 2024-04-20T10:55:08.603 INFO:tasks.workunit.client.1.smithi175.stdout:2/736: dwrite d1/d7/d63/f71 [0,4194304] 0 2024-04-20T10:55:08.605 INFO:tasks.workunit.client.1.smithi175.stdout:0/785: rename df/d17/d2f to df/d17/dc0/dfc 0 2024-04-20T10:55:08.606 INFO:tasks.workunit.client.1.smithi175.stdout:0/786: chown df/d17/f62 30 1 2024-04-20T10:55:08.608 INFO:tasks.workunit.client.1.smithi175.stdout:9/763: dwrite d6/d1b/d42/d51/d9f/fde [0,4194304] 0 2024-04-20T10:55:08.611 INFO:tasks.workunit.client.1.smithi175.stdout:2/737: dread d1/d48/f31 [4194304,4194304] 0 2024-04-20T10:55:08.611 INFO:tasks.workunit.client.1.smithi175.stdout:2/738: write d1/d7/d63/d36/d7d/d80/ff1 [1025498,90878] 0 2024-04-20T10:55:08.612 INFO:tasks.workunit.client.1.smithi175.stdout:6/871: symlink d1/d37/d83/db8/d60/d68/d7e/l11c 0 2024-04-20T10:55:08.612 INFO:tasks.workunit.client.1.smithi175.stdout:6/872: readlink d1/d5/d12/lcb 0 2024-04-20T10:55:08.614 INFO:tasks.workunit.client.1.smithi175.stdout:0/787: dread df/f10 [0,4194304] 0 2024-04-20T10:55:08.615 INFO:tasks.workunit.client.1.smithi175.stdout:9/764: creat d6/d1b/d42/d51/dca/fea x:0 0 0 2024-04-20T10:55:08.617 INFO:tasks.workunit.client.1.smithi175.stdout:4/912: rename d4/dd/d54/d5d/c7d to d4/dd/d5e/c138 0 2024-04-20T10:55:08.618 INFO:tasks.workunit.client.1.smithi175.stdout:0/788: rmdir df/d2e 39 2024-04-20T10:55:08.618 INFO:tasks.workunit.client.1.smithi175.stdout:0/789: truncate df/d1a/d28/ff1 313746 0 2024-04-20T10:55:08.619 INFO:tasks.workunit.client.1.smithi175.stdout:9/765: symlink d6/d58/d90/daa/dbd/de9/leb 0 2024-04-20T10:55:08.621 INFO:tasks.workunit.client.1.smithi175.stdout:8/829: rename d7/d13/f50 to d7/d13/d1d/d24/dfd/f104 0 2024-04-20T10:55:08.621 INFO:tasks.workunit.client.1.smithi175.stdout:8/830: write d7/d13/d1d/d24/d38/d80/fee [277094,89376] 0 2024-04-20T10:55:08.621 INFO:tasks.workunit.client.1.smithi175.stdout:9/766: dread d6/d10/f3b [0,4194304] 0 2024-04-20T10:55:08.622 INFO:tasks.workunit.client.1.smithi175.stdout:4/913: creat d4/dd/d54/d5d/f139 x:0 0 0 2024-04-20T10:55:08.623 INFO:tasks.workunit.client.1.smithi175.stdout:6/873: mkdir d1/d5/d11d 0 2024-04-20T10:55:08.628 INFO:tasks.workunit.client.1.smithi175.stdout:2/739: rename d1/d7/d63/d4b/d8a/c9a to d1/d6a/c106 0 2024-04-20T10:55:08.629 INFO:tasks.workunit.client.1.smithi175.stdout:9/767: mkdir d6/d58/d90/daa/dbd/dec 0 2024-04-20T10:55:08.630 INFO:tasks.workunit.client.1.smithi175.stdout:8/831: rename d7/d13/d1d/d24/d39/d6f/db7/lf7 to d7/l105 0 2024-04-20T10:55:08.631 INFO:tasks.workunit.client.1.smithi175.stdout:8/832: fdatasync d7/fa5 0 2024-04-20T10:55:08.631 INFO:tasks.workunit.client.1.smithi175.stdout:2/740: creat d1/d7/d63/d4b/f107 x:0 0 0 2024-04-20T10:55:08.633 INFO:tasks.workunit.client.1.smithi175.stdout:9/768: truncate d6/d1b/d42/d5b/d72/d98/fb9 418210 0 2024-04-20T10:55:08.634 INFO:tasks.workunit.client.1.smithi175.stdout:2/741: rename d1/d48/d38 to d1/d7/d63/d4b/d8a/dd9/d108 0 2024-04-20T10:55:08.635 INFO:tasks.workunit.client.1.smithi175.stdout:8/833: link d7/d13/d1d/d24/d38/d73/db5/ddb/c101 d7/d13/d1d/d24/d39/d6f/c106 0 2024-04-20T10:55:08.636 INFO:tasks.workunit.client.1.smithi175.stdout:2/742: unlink d1/d7/f5b 0 2024-04-20T10:55:08.640 INFO:tasks.workunit.client.1.smithi175.stdout:6/874: dwrite d1/d37/f66 [0,4194304] 0 2024-04-20T10:55:08.641 INFO:tasks.workunit.client.1.smithi175.stdout:6/875: creat d1/d37/d83/db8/d60/d68/f11e x:0 0 0 2024-04-20T10:55:08.642 INFO:tasks.workunit.client.1.smithi175.stdout:6/876: rmdir d1/d37/d83/db8/d60/ded/dc1 39 2024-04-20T10:55:08.642 INFO:tasks.workunit.client.1.smithi175.stdout:4/914: dwrite d4/dd/d54/d5d/f108 [0,4194304] 0 2024-04-20T10:55:08.642 INFO:tasks.workunit.client.1.smithi175.stdout:6/877: mknod d1/d37/d83/db8/db9/c11f 0 2024-04-20T10:55:08.643 INFO:tasks.workunit.client.1.smithi175.stdout:4/915: mknod d4/dd/d54/d5d/d79/d9d/c13a 0 2024-04-20T10:55:08.644 INFO:tasks.workunit.client.1.smithi175.stdout:4/916: write d4/d23/f62 [552112,99134] 0 2024-04-20T10:55:08.661 INFO:tasks.workunit.client.1.smithi175.stdout:6/878: dwrite d1/d37/d83/db8/d60/ff5 [4194304,4194304] 0 2024-04-20T10:55:08.661 INFO:tasks.workunit.client.1.smithi175.stdout:6/879: chown d1/d37/d83/db8/d60/ded/dc1/le2 0 1 2024-04-20T10:55:08.662 INFO:tasks.workunit.client.1.smithi175.stdout:6/880: mknod d1/d5/d12/d7f/c120 0 2024-04-20T10:55:08.662 INFO:tasks.workunit.client.1.smithi175.stdout:6/881: truncate d1/d5/f38 5289020 0 2024-04-20T10:55:08.663 INFO:tasks.workunit.client.1.smithi175.stdout:6/882: mknod d1/d5/d12/d7f/d118/c121 0 2024-04-20T10:55:08.677 INFO:tasks.workunit.client.1.smithi175.stdout:6/883: dwrite d1/d37/d83/db8/d60/d6b/f78 [4194304,4194304] 0 2024-04-20T10:55:08.678 INFO:tasks.workunit.client.1.smithi175.stdout:6/884: truncate d1/d37/d83/db8/d60/f114 901834 0 2024-04-20T10:55:08.678 INFO:tasks.workunit.client.1.smithi175.stdout:6/885: chown d1/d37/d83/db8/d60/c102 3 1 2024-04-20T10:55:08.678 INFO:tasks.workunit.client.1.smithi175.stdout:6/886: chown d1/d37/fef 55994 1 2024-04-20T10:55:08.680 INFO:tasks.workunit.client.1.smithi175.stdout:6/887: dread d1/d37/d83/db8/db9/f10e [0,4194304] 0 2024-04-20T10:55:08.681 INFO:tasks.workunit.client.1.smithi175.stdout:6/888: creat d1/d37/d83/db8/d60/f122 x:0 0 0 2024-04-20T10:55:08.698 INFO:tasks.workunit.client.1.smithi175.stdout:6/889: dwrite d1/d37/d83/db8/d60/d68/d7e/f81 [0,4194304] 0 2024-04-20T10:55:08.700 INFO:tasks.workunit.client.1.smithi175.stdout:6/890: truncate d1/dc0/f32 865257 0 2024-04-20T10:55:08.700 INFO:tasks.workunit.client.1.smithi175.stdout:6/891: dread - d1/dc0/f111 zero size 2024-04-20T10:55:08.700 INFO:tasks.workunit.client.1.smithi175.stdout:6/892: creat d1/dc0/df2/f123 x:0 0 0 2024-04-20T10:55:08.709 INFO:tasks.workunit.client.1.smithi175.stdout:6/893: write d1/d37/d83/db8/d60/d6b/f78 [5592247,63621] 0 2024-04-20T10:55:08.709 INFO:tasks.workunit.client.1.smithi175.stdout:6/894: fdatasync d1/dc0/f99 0 2024-04-20T10:55:08.794 INFO:tasks.workunit.client.1.smithi175.stdout:6/895: truncate d1/d37/f6f 3877061 0 2024-04-20T10:55:08.794 INFO:tasks.workunit.client.1.smithi175.stdout:6/896: dread d1/d37/d83/db8/d60/f114 [0,4194304] 0 2024-04-20T10:55:08.797 INFO:tasks.workunit.client.1.smithi175.stdout:6/897: rename d1/c34 to d1/d5/d12/c124 0 2024-04-20T10:55:08.797 INFO:tasks.workunit.client.1.smithi175.stdout:6/898: fdatasync d1/d5/fd2 0 2024-04-20T10:55:08.797 INFO:tasks.workunit.client.1.smithi175.stdout:6/899: write d1/dc0/f111 [295020,76097] 0 2024-04-20T10:55:08.797 INFO:tasks.workunit.client.1.smithi175.stdout:6/900: write d1/d5/fd2 [1049193,6572] 0 2024-04-20T10:55:08.797 INFO:tasks.workunit.client.1.smithi175.stdout:6/901: chown d1/d5/d12/d73/d7a/dee/fa0 18185 1 2024-04-20T10:55:08.798 INFO:tasks.workunit.client.1.smithi175.stdout:6/902: mkdir d1/d5/d12/d73/d7a/d125 0 2024-04-20T10:55:08.814 INFO:tasks.workunit.client.1.smithi175.stdout:6/903: dwrite d1/d5/d12/d73/d7a/fe9 [0,4194304] 0 2024-04-20T10:55:08.815 INFO:tasks.workunit.client.1.smithi175.stdout:6/904: dread d1/d5/d12/d73/d7a/f9a [0,4194304] 0 2024-04-20T10:55:08.816 INFO:tasks.workunit.client.1.smithi175.stdout:6/905: symlink d1/dc0/d63/d7c/l126 0 2024-04-20T10:55:08.817 INFO:tasks.workunit.client.1.smithi175.stdout:6/906: creat d1/d37/d83/db8/d60/d6b/d119/f127 x:0 0 0 2024-04-20T10:55:08.818 INFO:tasks.workunit.client.1.smithi175.stdout:6/907: write d1/d5/f45 [4497722,43241] 0 2024-04-20T10:55:08.818 INFO:tasks.workunit.client.1.smithi175.stdout:6/908: chown d1/f16 2 1 2024-04-20T10:55:08.818 INFO:tasks.workunit.client.1.smithi175.stdout:6/909: creat d1/d37/d83/db8/d60/d68/d7e/f128 x:0 0 0 2024-04-20T10:55:08.818 INFO:tasks.workunit.client.1.smithi175.stdout:6/910: chown d1/dc0/c42 9305464 1 2024-04-20T10:55:08.818 INFO:tasks.workunit.client.1.smithi175.stdout:6/911: fdatasync d1/d5/d12/d7f/dae/fce 0 2024-04-20T10:55:08.825 INFO:tasks.workunit.client.1.smithi175.stdout:3/664: sync 2024-04-20T10:55:08.825 INFO:tasks.workunit.client.1.smithi175.stdout:7/935: sync 2024-04-20T10:55:08.826 INFO:tasks.workunit.client.1.smithi175.stdout:1/958: sync 2024-04-20T10:55:08.826 INFO:tasks.workunit.client.1.smithi175.stdout:7/936: unlink db/d61/d6d/f7c 0 2024-04-20T10:55:08.827 INFO:tasks.workunit.client.1.smithi175.stdout:1/959: mknod d0/d8/dcb/d114/c14f 0 2024-04-20T10:55:08.828 INFO:tasks.workunit.client.1.smithi175.stdout:7/937: creat db/d61/d6d/dbc/d139/f13c x:0 0 0 2024-04-20T10:55:08.828 INFO:tasks.workunit.client.1.smithi175.stdout:7/938: chown db/d61/d6d/d9c/de8/f96 166347 1 2024-04-20T10:55:08.828 INFO:tasks.workunit.client.1.smithi175.stdout:7/939: write db/d1d/d39/d50/dba/d47/da6/db9/dc8/fd4 [2250367,54165] 0 2024-04-20T10:55:08.829 INFO:tasks.workunit.client.1.smithi175.stdout:1/960: symlink d0/l150 0 2024-04-20T10:55:08.829 INFO:tasks.workunit.client.1.smithi175.stdout:1/961: chown d0/d3e/d61/fc4 102 1 2024-04-20T10:55:08.830 INFO:tasks.workunit.client.1.smithi175.stdout:1/962: stat d0/ff 0 2024-04-20T10:55:08.830 INFO:tasks.workunit.client.1.smithi175.stdout:1/963: fsync d0/d29/f4f 0 2024-04-20T10:55:08.834 INFO:tasks.workunit.client.1.smithi175.stdout:3/665: write d7/d21/d16/d49/f7c [565476,1371] 0 2024-04-20T10:55:08.835 INFO:tasks.workunit.client.1.smithi175.stdout:3/666: symlink d7/d21/d16/d22/d2c/d64/dbd/dce/ld0 0 2024-04-20T10:55:08.838 INFO:tasks.workunit.client.1.smithi175.stdout:1/964: dread d0/d3e/f41 [0,4194304] 0 2024-04-20T10:55:08.843 INFO:tasks.workunit.client.1.smithi175.stdout:6/912: dwrite d1/dc0/f99 [0,4194304] 0 2024-04-20T10:55:08.851 INFO:tasks.workunit.client.1.smithi175.stdout:6/913: write d1/d37/f6f [3217887,40666] 0 2024-04-20T10:55:08.851 INFO:tasks.workunit.client.1.smithi175.stdout:6/914: getdents d1/d5/d12/d7f/de3 0 2024-04-20T10:55:08.851 INFO:tasks.workunit.client.1.smithi175.stdout:6/915: fsync d1/fbd 0 2024-04-20T10:55:08.865 INFO:tasks.workunit.client.1.smithi175.stdout:6/916: dwrite d1/d37/d83/db8/f75 [0,4194304] 0 2024-04-20T10:55:09.092 INFO:tasks.workunit.client.1.smithi175.stdout:3/667: mknod d7/d21/d16/d49/da8/cd1 0 2024-04-20T10:55:09.093 INFO:tasks.workunit.client.1.smithi175.stdout:1/965: rmdir d0/d8/d13/d2e/d35/d8a/d91 39 2024-04-20T10:55:09.093 INFO:tasks.workunit.client.1.smithi175.stdout:1/966: write d0/d8/d13/d2e/f72 [2317265,51647] 0 2024-04-20T10:55:09.093 INFO:tasks.workunit.client.1.smithi175.stdout:1/967: write d0/d57/d7a/fdc [364724,65534] 0 2024-04-20T10:55:09.094 INFO:tasks.workunit.client.1.smithi175.stdout:1/968: dread d0/d3e/d61/d73/fca [4194304,4194304] 0 2024-04-20T10:55:09.094 INFO:tasks.workunit.client.1.smithi175.stdout:6/917: creat d1/d5/d12/d7f/d118/f129 x:0 0 0 2024-04-20T10:55:09.095 INFO:tasks.workunit.client.1.smithi175.stdout:6/918: truncate d1/d37/d83/f104 589508 0 2024-04-20T10:55:09.095 INFO:tasks.workunit.client.1.smithi175.stdout:6/919: fdatasync d1/d37/d83/db8/f4f 0 2024-04-20T10:55:09.095 INFO:tasks.workunit.client.1.smithi175.stdout:6/920: write d1/dc0/d63/fa5 [879346,11218] 0 2024-04-20T10:55:09.104 INFO:tasks.workunit.client.1.smithi175.stdout:6/921: dread d1/d37/d83/db8/d60/ded/fd6 [0,4194304] 0 2024-04-20T10:55:09.104 INFO:tasks.workunit.client.1.smithi175.stdout:9/769: sync 2024-04-20T10:55:09.104 INFO:tasks.workunit.client.1.smithi175.stdout:0/790: sync 2024-04-20T10:55:09.104 INFO:tasks.workunit.client.1.smithi175.stdout:8/834: sync 2024-04-20T10:55:09.104 INFO:tasks.workunit.client.1.smithi175.stdout:2/743: sync 2024-04-20T10:55:09.104 INFO:tasks.workunit.client.1.smithi175.stdout:8/835: chown d7/d13/d1d/d56/f96 1230015402 1 2024-04-20T10:55:09.104 INFO:tasks.workunit.client.1.smithi175.stdout:7/940: sync 2024-04-20T10:55:09.105 INFO:tasks.workunit.client.1.smithi175.stdout:4/917: sync 2024-04-20T10:55:09.105 INFO:tasks.workunit.client.1.smithi175.stdout:7/941: write db/d1d/d39/d50/dba/d47/da6/fd3 [4847387,89611] 0 2024-04-20T10:55:09.105 INFO:tasks.workunit.client.1.smithi175.stdout:7/942: write db/d1d/d39/d50/dba/d47/fc7 [822647,114082] 0 2024-04-20T10:55:09.106 INFO:tasks.workunit.client.1.smithi175.stdout:2/744: read d1/d6a/f6e [636324,107162] 0 2024-04-20T10:55:09.106 INFO:tasks.workunit.client.1.smithi175.stdout:2/745: truncate d1/d7/d63/d4b/d8a/dd9/d108/de0/fe7 1047469 0 2024-04-20T10:55:09.107 INFO:tasks.workunit.client.1.smithi175.stdout:0/791: creat df/d17/ffd x:0 0 0 2024-04-20T10:55:09.109 INFO:tasks.workunit.client.1.smithi175.stdout:9/770: unlink d6/d1b/d26/d8c/cab 0 2024-04-20T10:55:09.109 INFO:tasks.workunit.client.1.smithi175.stdout:9/771: write d6/d58/f68 [1022524,78055] 0 2024-04-20T10:55:09.109 INFO:tasks.workunit.client.1.smithi175.stdout:4/918: mknod d4/dd/d5e/d96/c13b 0 2024-04-20T10:55:09.111 INFO:tasks.workunit.client.1.smithi175.stdout:7/943: unlink f2 0 2024-04-20T10:55:09.113 INFO:tasks.workunit.client.1.smithi175.stdout:2/746: unlink d1/d7/d63/d36/d7d/d84/d8b/da7/fb8 0 2024-04-20T10:55:09.114 INFO:tasks.workunit.client.1.smithi175.stdout:9/772: dread d6/d1b/d42/d79/fe2 [0,4194304] 0 2024-04-20T10:55:09.114 INFO:tasks.workunit.client.1.smithi175.stdout:9/773: fsync d6/d1b/d42/d79/fe2 0 2024-04-20T10:55:09.114 INFO:tasks.workunit.client.1.smithi175.stdout:6/922: symlink d1/l12a 0 2024-04-20T10:55:09.114 INFO:tasks.workunit.client.1.smithi175.stdout:6/923: chown d1/d37/d83/db8/cb4 121 1 2024-04-20T10:55:09.115 INFO:tasks.workunit.client.1.smithi175.stdout:0/792: mkdir df/d19/de0/dfb/dfe 0 2024-04-20T10:55:09.116 INFO:tasks.workunit.client.1.smithi175.stdout:7/944: rename db/d1d/d39/d50/f52 to db/d61/d6d/d9c/de8/d9a/dd2/d10d/f13d 0 2024-04-20T10:55:09.117 INFO:tasks.workunit.client.1.smithi175.stdout:1/969: dwrite d0/d51/d6b/d9e/de0/d107/f135 [0,4194304] 0 2024-04-20T10:55:09.118 INFO:tasks.workunit.client.1.smithi175.stdout:2/747: creat d1/d48/f109 x:0 0 0 2024-04-20T10:55:09.119 INFO:tasks.workunit.client.1.smithi175.stdout:6/924: dread d1/dc0/d63/fa5 [0,4194304] 0 2024-04-20T10:55:09.119 INFO:tasks.workunit.client.1.smithi175.stdout:9/774: mkdir d6/d1b/d42/d51/dca/ded 0 2024-04-20T10:55:09.121 INFO:tasks.workunit.client.1.smithi175.stdout:8/836: dwrite d7/d13/d1d/d56/f96 [0,4194304] 0 2024-04-20T10:55:09.121 INFO:tasks.workunit.client.1.smithi175.stdout:8/837: chown d7/d13/da3/f102 72499309 1 2024-04-20T10:55:09.121 INFO:tasks.workunit.client.1.smithi175.stdout:8/838: chown d7/d13/d1d/d56/c81 18 1 2024-04-20T10:55:09.121 INFO:tasks.workunit.client.1.smithi175.stdout:8/839: read - d7/d13/d1d/fc4 zero size 2024-04-20T10:55:09.122 INFO:tasks.workunit.client.1.smithi175.stdout:4/919: read d4/d23/f95 [6883779,66058] 0 2024-04-20T10:55:09.122 INFO:tasks.workunit.client.1.smithi175.stdout:9/775: write d6/f3c [37934,49097] 0 2024-04-20T10:55:09.122 INFO:tasks.workunit.client.1.smithi175.stdout:8/840: symlink d7/d13/da3/l107 0 2024-04-20T10:55:09.123 INFO:tasks.workunit.client.1.smithi175.stdout:4/920: creat d4/d27/d8c/f13c x:0 0 0 2024-04-20T10:55:09.125 INFO:tasks.workunit.client.1.smithi175.stdout:9/776: creat d6/d58/d90/daa/dbd/fee x:0 0 0 2024-04-20T10:55:09.127 INFO:tasks.workunit.client.1.smithi175.stdout:8/841: link d7/d13/da3/le1 d7/d13/d1d/d24/d26/dcb/ded/l108 0 2024-04-20T10:55:09.129 INFO:tasks.workunit.client.1.smithi175.stdout:4/921: creat d4/dd/d2d/d43/d69/d83/f13d x:0 0 0 2024-04-20T10:55:09.131 INFO:tasks.workunit.client.1.smithi175.stdout:9/777: creat d6/d1b/d42/fef x:0 0 0 2024-04-20T10:55:09.133 INFO:tasks.workunit.client.1.smithi175.stdout:8/842: rmdir d7/d13/d1d/d24/d38/d73/db5/ddb/df1 0 2024-04-20T10:55:09.136 INFO:tasks.workunit.client.1.smithi175.stdout:8/843: unlink d7/d13/d1d/d24/la0 0 2024-04-20T10:55:09.136 INFO:tasks.workunit.client.1.smithi175.stdout:2/748: dwrite d1/d7/d63/f3e [0,4194304] 0 2024-04-20T10:55:09.137 INFO:tasks.workunit.client.1.smithi175.stdout:0/793: dwrite df/d1a/d22/d24/f68 [0,4194304] 0 2024-04-20T10:55:09.137 INFO:tasks.workunit.client.1.smithi175.stdout:4/922: mknod d4/d27/d8c/c13e 0 2024-04-20T10:55:09.137 INFO:tasks.workunit.client.1.smithi175.stdout:4/923: chown d4/dd/dba/lc5 0 1 2024-04-20T10:55:09.137 INFO:tasks.workunit.client.1.smithi175.stdout:4/924: read d4/dd/d54/f9a [2489644,100777] 0 2024-04-20T10:55:09.137 INFO:tasks.workunit.client.1.smithi175.stdout:4/925: fsync d4/dd/d5e/ff3 0 2024-04-20T10:55:09.139 INFO:tasks.workunit.client.1.smithi175.stdout:2/749: unlink d1/d7/d63/dee/l104 0 2024-04-20T10:55:09.139 INFO:tasks.workunit.client.1.smithi175.stdout:7/945: write db/d61/d6d/d9c/de8/d2a/d41/fa5 [663296,98718] 0 2024-04-20T10:55:09.142 INFO:tasks.workunit.client.1.smithi175.stdout:2/750: creat d1/d6a/d74/dc7/f10a x:0 0 0 2024-04-20T10:55:09.143 INFO:tasks.workunit.client.1.smithi175.stdout:7/946: creat db/d1d/d39/d50/dba/daa/df3/d105/f13e x:0 0 0 2024-04-20T10:55:09.145 INFO:tasks.workunit.client.1.smithi175.stdout:7/947: creat db/d1d/d60/d76/f13f x:0 0 0 2024-04-20T10:55:09.145 INFO:tasks.workunit.client.1.smithi175.stdout:4/926: write d4/d27/d8c/d10f/f118 [757520,121756] 0 2024-04-20T10:55:09.146 INFO:tasks.workunit.client.1.smithi175.stdout:9/778: write d6/d1b/d42/d5b/d72/d7d/dcc/d78/f7f [2892688,115082] 0 2024-04-20T10:55:09.146 INFO:tasks.workunit.client.1.smithi175.stdout:9/779: fdatasync d6/d1b/d42/d5b/d72/d7d/dcc/fc4 0 2024-04-20T10:55:09.147 INFO:tasks.workunit.client.1.smithi175.stdout:2/751: rename d1/d6a/fc5 to d1/d7/d63/dee/f10b 0 2024-04-20T10:55:09.148 INFO:tasks.workunit.client.1.smithi175.stdout:4/927: symlink d4/dd/d5e/d74/da1/dbc/l13f 0 2024-04-20T10:55:09.152 INFO:tasks.workunit.client.1.smithi175.stdout:7/948: dread db/d61/d6d/d9c/de8/d2a/f84 [0,4194304] 0 2024-04-20T10:55:09.152 INFO:tasks.workunit.client.1.smithi175.stdout:9/780: creat d6/d1b/d42/d5b/d72/ff0 x:0 0 0 2024-04-20T10:55:09.153 INFO:tasks.workunit.client.1.smithi175.stdout:2/752: creat d1/d48/f10c x:0 0 0 2024-04-20T10:55:09.153 INFO:tasks.workunit.client.1.smithi175.stdout:7/949: dread db/f66 [0,4194304] 0 2024-04-20T10:55:09.154 INFO:tasks.workunit.client.1.smithi175.stdout:4/928: symlink d4/dd/d54/d5d/d8a/da4/l140 0 2024-04-20T10:55:09.155 INFO:tasks.workunit.client.1.smithi175.stdout:4/929: write d4/dd/d2d/d33/d58/fc4 [4201771,89133] 0 2024-04-20T10:55:09.155 INFO:tasks.workunit.client.1.smithi175.stdout:8/844: dwrite d7/d13/d1d/fdf [0,4194304] 0 2024-04-20T10:55:09.155 INFO:tasks.workunit.client.1.smithi175.stdout:8/845: fdatasync d7/d13/d1d/d24/d39/d6f/db7/fb8 0 2024-04-20T10:55:09.155 INFO:tasks.workunit.client.1.smithi175.stdout:7/950: dread db/d1d/d39/fe0 [0,4194304] 0 2024-04-20T10:55:09.157 INFO:tasks.workunit.client.1.smithi175.stdout:9/781: mknod d6/dcb/dce/cf1 0 2024-04-20T10:55:09.157 INFO:tasks.workunit.client.1.smithi175.stdout:9/782: fdatasync d6/d1b/f24 0 2024-04-20T10:55:09.158 INFO:tasks.workunit.client.1.smithi175.stdout:4/930: write d4/f20 [1906238,115488] 0 2024-04-20T10:55:09.158 INFO:tasks.workunit.client.1.smithi175.stdout:4/931: fsync d4/d27/d61/f7a 0 2024-04-20T10:55:09.158 INFO:tasks.workunit.client.1.smithi175.stdout:2/753: creat d1/d7/d63/d4b/f10d x:0 0 0 2024-04-20T10:55:09.161 INFO:tasks.workunit.client.1.smithi175.stdout:8/846: mkdir d7/d13/d1d/d24/d38/d73/db5/d109 0 2024-04-20T10:55:09.162 INFO:tasks.workunit.client.1.smithi175.stdout:0/794: write df/d1a/d22/d6a/d72/d48/d4e/f69 [1031451,78425] 0 2024-04-20T10:55:09.164 INFO:tasks.workunit.client.1.smithi175.stdout:9/783: stat d6/d10/c21 0 2024-04-20T10:55:09.166 INFO:tasks.workunit.client.1.smithi175.stdout:8/847: mkdir d7/d13/d1d/d24/d38/db6/d10a 0 2024-04-20T10:55:09.167 INFO:tasks.workunit.client.1.smithi175.stdout:0/795: symlink df/d1a/d98/lff 0 2024-04-20T10:55:09.167 INFO:tasks.workunit.client.1.smithi175.stdout:0/796: read - df/d1a/d22/d24/fe6 zero size 2024-04-20T10:55:09.169 INFO:tasks.workunit.client.1.smithi175.stdout:7/951: link db/d61/d6d/d9c/de8/d2a/f84 db/d1d/d39/f140 0 2024-04-20T10:55:09.170 INFO:tasks.workunit.client.1.smithi175.stdout:9/784: creat d6/dcb/dce/ff2 x:0 0 0 2024-04-20T10:55:09.171 INFO:tasks.workunit.client.1.smithi175.stdout:4/932: symlink d4/dd/l141 0 2024-04-20T10:55:09.171 INFO:tasks.workunit.client.1.smithi175.stdout:4/933: read - d4/dd/d54/d5d/f139 zero size 2024-04-20T10:55:09.173 INFO:tasks.workunit.client.1.smithi175.stdout:8/848: getdents d7 0 2024-04-20T10:55:09.173 INFO:tasks.workunit.client.1.smithi175.stdout:8/849: truncate d7/f1b 1568696 0 2024-04-20T10:55:09.173 INFO:tasks.workunit.client.1.smithi175.stdout:8/850: readlink d7/d13/d1d/d24/d26/l49 0 2024-04-20T10:55:09.173 INFO:tasks.workunit.client.1.smithi175.stdout:8/851: chown d7/d13/d1d/d24/d38/d73/db5/d109 1706 1 2024-04-20T10:55:09.173 INFO:tasks.workunit.client.1.smithi175.stdout:8/852: fsync d7/d13/d1d/d24/d38/d73/fb4 0 2024-04-20T10:55:09.174 INFO:tasks.workunit.client.1.smithi175.stdout:0/797: symlink df/d19/de0/dea/l100 0 2024-04-20T10:55:09.174 INFO:tasks.workunit.client.1.smithi175.stdout:0/798: write df/d17/dc0/dfc/d4f/fc1 [645579,113416] 0 2024-04-20T10:55:09.175 INFO:tasks.workunit.client.1.smithi175.stdout:2/754: dwrite d1/d7/d63/d4b/d8a/dd9/d108/de0/fe7 [0,4194304] 0 2024-04-20T10:55:09.176 INFO:tasks.workunit.client.1.smithi175.stdout:9/785: symlink d6/d33/de7/lf3 0 2024-04-20T10:55:09.176 INFO:tasks.workunit.client.1.smithi175.stdout:9/786: write d6/d58/d90/daa/dbd/fee [1037188,48330] 0 2024-04-20T10:55:09.177 INFO:tasks.workunit.client.1.smithi175.stdout:4/934: symlink d4/dd/d54/d5d/d8a/d134/l142 0 2024-04-20T10:55:09.178 INFO:tasks.workunit.client.1.smithi175.stdout:8/853: mkdir d7/d13/d1d/d24/d38/d73/d10b 0 2024-04-20T10:55:09.179 INFO:tasks.workunit.client.1.smithi175.stdout:0/799: symlink df/d1a/d3f/l101 0 2024-04-20T10:55:09.180 INFO:tasks.workunit.client.1.smithi175.stdout:7/952: mkdir db/d1d/d39/d50/dba/d141 0 2024-04-20T10:55:09.182 INFO:tasks.workunit.client.1.smithi175.stdout:2/755: creat d1/f10e x:0 0 0 2024-04-20T10:55:09.193 INFO:tasks.workunit.client.1.smithi175.stdout:9/787: rmdir d6/d58/d90/daa 39 2024-04-20T10:55:09.194 INFO:tasks.workunit.client.1.smithi175.stdout:8/854: dwrite d7/d13/d1d/d24/d39/d6f/fa7 [4194304,4194304] 0 2024-04-20T10:55:09.197 INFO:tasks.workunit.client.1.smithi175.stdout:2/756: symlink d1/d7/d63/d36/d7d/d84/d8b/l10f 0 2024-04-20T10:55:09.197 INFO:tasks.workunit.client.1.smithi175.stdout:2/757: fsync d1/d48/d21/d9c/fec 0 2024-04-20T10:55:09.198 INFO:tasks.workunit.client.1.smithi175.stdout:8/855: rmdir d7/d13/d1d/d24/d38/d73/db5/d109 0 2024-04-20T10:55:09.199 INFO:tasks.workunit.client.1.smithi175.stdout:4/935: symlink d4/dd/l143 0 2024-04-20T10:55:09.200 INFO:tasks.workunit.client.1.smithi175.stdout:2/758: symlink d1/d48/d102/l110 0 2024-04-20T10:55:09.202 INFO:tasks.workunit.client.1.smithi175.stdout:8/856: link d7/d13/d1d/d24/d38/f77 d7/d13/d1d/d24/d39/d6f/db7/f10c 0 2024-04-20T10:55:09.203 INFO:tasks.workunit.client.1.smithi175.stdout:4/936: mknod d4/dd/d2d/d33/d3c/c144 0 2024-04-20T10:55:09.203 INFO:tasks.workunit.client.1.smithi175.stdout:4/937: chown d4/d27/d8c/f13c 11586 1 2024-04-20T10:55:09.203 INFO:tasks.workunit.client.1.smithi175.stdout:7/953: dwrite db/d1d/d39/d50/dba/d47/d6a/f72 [4194304,4194304] 0 2024-04-20T10:55:09.204 INFO:tasks.workunit.client.1.smithi175.stdout:0/800: rename cb to df/c102 0 2024-04-20T10:55:09.205 INFO:tasks.workunit.client.1.smithi175.stdout:2/759: unlink d1/d7/d63/dee/f6c 0 2024-04-20T10:55:09.206 INFO:tasks.workunit.client.1.smithi175.stdout:8/857: mkdir d7/d13/d1d/d24/d38/d73/db5/ddb/d10d 0 2024-04-20T10:55:09.207 INFO:tasks.workunit.client.1.smithi175.stdout:4/938: rmdir d4/dd/d2d/d33/d3c/de5 39 2024-04-20T10:55:09.208 INFO:tasks.workunit.client.1.smithi175.stdout:7/954: link db/d1d/d39/d50/f55 db/d1d/d39/d50/dba/d47/dac/f142 0 2024-04-20T10:55:09.209 INFO:tasks.workunit.client.1.smithi175.stdout:7/955: chown db/d1d/d39/ff9 70564532 1 2024-04-20T10:55:09.209 INFO:tasks.workunit.client.1.smithi175.stdout:0/801: creat df/d1a/d22/d55/f103 x:0 0 0 2024-04-20T10:55:09.211 INFO:tasks.workunit.client.1.smithi175.stdout:2/760: creat d1/d48/d21/f111 x:0 0 0 2024-04-20T10:55:09.211 INFO:tasks.workunit.client.1.smithi175.stdout:8/858: rmdir d7/d13/d1d/d24/dfd 39 2024-04-20T10:55:09.213 INFO:tasks.workunit.client.1.smithi175.stdout:4/939: creat d4/dd/d5e/f145 x:0 0 0 2024-04-20T10:55:09.213 INFO:tasks.workunit.client.1.smithi175.stdout:4/940: write d4/d23/f95 [5503086,68671] 0 2024-04-20T10:55:09.218 INFO:tasks.workunit.client.1.smithi175.stdout:0/802: mkdir df/d1a/d28/d104 0 2024-04-20T10:55:09.218 INFO:tasks.workunit.client.1.smithi175.stdout:0/803: write df/d17/dc0/dfc/f99 [4569534,3990] 0 2024-04-20T10:55:09.219 INFO:tasks.workunit.client.1.smithi175.stdout:2/761: symlink d1/d48/d21/d76/l112 0 2024-04-20T10:55:09.221 INFO:tasks.workunit.client.1.smithi175.stdout:4/941: link d4/dd/d5e/d74/f127 d4/dd/f146 0 2024-04-20T10:55:09.221 INFO:tasks.workunit.client.1.smithi175.stdout:4/942: write d4/dd/d54/d5d/d79/d9d/fef [218337,48323] 0 2024-04-20T10:55:09.221 INFO:tasks.workunit.client.1.smithi175.stdout:4/943: chown d4/dd/d54/d5d/d9e/f12b 1388576 1 2024-04-20T10:55:09.222 INFO:tasks.workunit.client.1.smithi175.stdout:0/804: rename df/d1a/da1/ldb to df/d17/l105 0 2024-04-20T10:55:09.223 INFO:tasks.workunit.client.1.smithi175.stdout:4/944: truncate d4/dd/d54/d5d/d9e/f86 2184828 0 2024-04-20T10:55:09.223 INFO:tasks.workunit.client.1.smithi175.stdout:0/805: creat df/d1a/d22/d24/f106 x:0 0 0 2024-04-20T10:55:09.236 INFO:tasks.workunit.client.1.smithi175.stdout:2/762: read d1/d7/d63/d36/d7d/d80/fbd [1311344,37344] 0 2024-04-20T10:55:09.237 INFO:tasks.workunit.client.1.smithi175.stdout:7/956: dwrite db/d61/d6d/d9c/de8/d9a/dd2/d10d/f13d [0,4194304] 0 2024-04-20T10:55:09.237 INFO:tasks.workunit.client.1.smithi175.stdout:8/859: dwrite d7/d13/f40 [4194304,4194304] 0 2024-04-20T10:55:09.237 INFO:tasks.workunit.client.1.smithi175.stdout:4/945: creat d4/dd/d2d/d33/d3c/d44/f147 x:0 0 0 2024-04-20T10:55:09.238 INFO:tasks.workunit.client.1.smithi175.stdout:2/763: getdents d1/d48/d21/db6 0 2024-04-20T10:55:09.239 INFO:tasks.workunit.client.1.smithi175.stdout:0/806: dwrite df/d17/dc0/dfc/d4f/fc1 [0,4194304] 0 2024-04-20T10:55:09.242 INFO:tasks.workunit.client.1.smithi175.stdout:7/957: unlink db/d61/d6d/dbc/cbe 0 2024-04-20T10:55:09.245 INFO:tasks.workunit.client.1.smithi175.stdout:8/860: creat d7/d13/d1d/f10e x:0 0 0 2024-04-20T10:55:09.246 INFO:tasks.workunit.client.1.smithi175.stdout:2/764: mknod d1/d48/d21/c113 0 2024-04-20T10:55:09.246 INFO:tasks.workunit.client.1.smithi175.stdout:4/946: write d4/dd/d54/d5d/d9e/f77 [124236,3892] 0 2024-04-20T10:55:09.247 INFO:tasks.workunit.client.1.smithi175.stdout:4/947: fdatasync d4/dd/d2d/d33/d5b/f135 0 2024-04-20T10:55:09.247 INFO:tasks.workunit.client.1.smithi175.stdout:4/948: write d4/dd/d2d/d43/d69/d83/f13d [678927,71810] 0 2024-04-20T10:55:09.247 INFO:tasks.workunit.client.1.smithi175.stdout:4/949: write d4/dd/d2d/d33/d3c/d44/f12f [944183,66627] 0 2024-04-20T10:55:09.249 INFO:tasks.workunit.client.1.smithi175.stdout:2/765: mknod d1/d7/d63/d4b/d8a/dd9/d108/de0/c114 0 2024-04-20T10:55:09.252 INFO:tasks.workunit.client.1.smithi175.stdout:0/807: mkdir df/d2e/d107 0 2024-04-20T10:55:09.252 INFO:tasks.workunit.client.1.smithi175.stdout:0/808: stat df/d17/dc0/dfc/d4f/dcd/cf6 0 2024-04-20T10:55:09.252 INFO:tasks.workunit.client.1.smithi175.stdout:7/958: mkdir db/d61/d6d/d9c/d143 0 2024-04-20T10:55:09.253 INFO:tasks.workunit.client.1.smithi175.stdout:7/959: readlink db/d1d/d39/d50/dba/d47/da6/db9/dc8/d12b/d10e/l136 0 2024-04-20T10:55:09.254 INFO:tasks.workunit.client.1.smithi175.stdout:8/861: symlink d7/d13/d1d/l10f 0 2024-04-20T10:55:09.254 INFO:tasks.workunit.client.1.smithi175.stdout:3/668: sync 2024-04-20T10:55:09.254 INFO:tasks.workunit.client.1.smithi175.stdout:3/669: fdatasync d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/f8a 0 2024-04-20T10:55:09.254 INFO:tasks.workunit.client.1.smithi175.stdout:4/950: write d4/d23/ff4 [3061500,14988] 0 2024-04-20T10:55:09.255 INFO:tasks.workunit.client.1.smithi175.stdout:2/766: symlink d1/d48/d21/l115 0 2024-04-20T10:55:09.255 INFO:tasks.workunit.client.1.smithi175.stdout:2/767: readlink d1/d7/d63/d36/d7d/d84/d8b/da7/ld6 0 2024-04-20T10:55:09.255 INFO:tasks.workunit.client.1.smithi175.stdout:2/768: dread - d1/d48/f10c zero size 2024-04-20T10:55:09.256 INFO:tasks.workunit.client.1.smithi175.stdout:4/951: fsync d4/dd/d54/d5d/d9e/f77 0 2024-04-20T10:55:09.257 INFO:tasks.workunit.client.1.smithi175.stdout:7/960: symlink db/d1d/d39/d50/dba/d47/dac/dd9/l144 0 2024-04-20T10:55:09.258 INFO:tasks.workunit.client.1.smithi175.stdout:8/862: mkdir d7/d13/d1d/d92/d6c/d110 0 2024-04-20T10:55:09.258 INFO:tasks.workunit.client.1.smithi175.stdout:3/670: getdents d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc7 0 2024-04-20T10:55:09.258 INFO:tasks.workunit.client.1.smithi175.stdout:3/671: fdatasync d7/d19/d33/d7e/d86/d7d/dcb/d50/fc2 0 2024-04-20T10:55:09.260 INFO:tasks.workunit.client.1.smithi175.stdout:0/809: mknod df/d1a/d22/c108 0 2024-04-20T10:55:09.260 INFO:tasks.workunit.client.1.smithi175.stdout:0/810: truncate df/d19/fa5 525642 0 2024-04-20T10:55:09.261 INFO:tasks.workunit.client.1.smithi175.stdout:8/863: symlink d7/d13/d1d/d24/d63/dd9/l111 0 2024-04-20T10:55:09.261 INFO:tasks.workunit.client.1.smithi175.stdout:0/811: symlink df/d17/dc0/dfc/dfa/l109 0 2024-04-20T10:55:09.261 INFO:tasks.workunit.client.1.smithi175.stdout:0/812: write df/d17/dc0/dfc/f99 [790610,94987] 0 2024-04-20T10:55:09.263 INFO:tasks.workunit.client.1.smithi175.stdout:4/952: mkdir d4/dd/d54/d5f/d148 0 2024-04-20T10:55:09.263 INFO:tasks.workunit.client.1.smithi175.stdout:4/953: write d4/dd/d2d/d43/d69/daa/f130 [455439,84491] 0 2024-04-20T10:55:09.266 INFO:tasks.workunit.client.1.smithi175.stdout:0/813: mknod df/d17/dc0/dfc/dfa/c10a 0 2024-04-20T10:55:09.266 INFO:tasks.workunit.client.1.smithi175.stdout:0/814: stat df/d19/de0/dfb/dfe 0 2024-04-20T10:55:09.268 INFO:tasks.workunit.client.1.smithi175.stdout:3/672: write d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/fbc [2329129,67959] 0 2024-04-20T10:55:09.272 INFO:tasks.workunit.client.1.smithi175.stdout:7/961: write db/d1d/d39/d50/ff [2665785,56603] 0 2024-04-20T10:55:09.273 INFO:tasks.workunit.client.1.smithi175.stdout:4/954: mkdir d4/d27/d61/d149 0 2024-04-20T10:55:09.277 INFO:tasks.workunit.client.1.smithi175.stdout:2/769: dwrite d1/f3 [4194304,4194304] 0 2024-04-20T10:55:09.277 INFO:tasks.workunit.client.1.smithi175.stdout:2/770: chown d1/d7/d63/d4b 50565791 1 2024-04-20T10:55:09.278 INFO:tasks.workunit.client.1.smithi175.stdout:7/962: mknod db/d1d/d39/d50/dba/d47/da6/db9/dc8/d12b/d10e/c145 0 2024-04-20T10:55:09.278 INFO:tasks.workunit.client.1.smithi175.stdout:4/955: mkdir d4/dd/d5e/d96/dd7/d14a 0 2024-04-20T10:55:09.279 INFO:tasks.workunit.client.1.smithi175.stdout:4/956: fsync d4/d27/f7b 0 2024-04-20T10:55:09.290 INFO:tasks.workunit.client.1.smithi175.stdout:8/864: dwrite d7/d13/d1d/d92/fa8 [0,4194304] 0 2024-04-20T10:55:09.290 INFO:tasks.workunit.client.1.smithi175.stdout:8/865: stat d7/d13/d1d/d24/d39/d6f/db7 0 2024-04-20T10:55:09.291 INFO:tasks.workunit.client.1.smithi175.stdout:2/771: symlink d1/d48/d102/df6/l116 0 2024-04-20T10:55:09.291 INFO:tasks.workunit.client.1.smithi175.stdout:2/772: fdatasync d1/f11 0 2024-04-20T10:55:09.291 INFO:tasks.workunit.client.1.smithi175.stdout:4/957: rmdir d4/dd/d2d/d33/d58/d67 39 2024-04-20T10:55:09.292 INFO:tasks.workunit.client.1.smithi175.stdout:4/958: chown d4/dd/d2d/d33/d58/cb2 4 1 2024-04-20T10:55:09.292 INFO:tasks.workunit.client.1.smithi175.stdout:8/866: creat d7/f112 x:0 0 0 2024-04-20T10:55:09.293 INFO:tasks.workunit.client.1.smithi175.stdout:2/773: rmdir d1/d7/d63/dee 39 2024-04-20T10:55:09.293 INFO:tasks.workunit.client.1.smithi175.stdout:2/774: truncate d1/d7/d63/d36/d7d/d84/d8b/fdd 499356 0 2024-04-20T10:55:09.293 INFO:tasks.workunit.client.1.smithi175.stdout:2/775: chown d1/d48/d21/f111 4070 1 2024-04-20T10:55:09.298 INFO:tasks.workunit.client.1.smithi175.stdout:0/815: dwrite df/d17/ffd [0,4194304] 0 2024-04-20T10:55:09.299 INFO:tasks.workunit.client.1.smithi175.stdout:8/867: rmdir d7/d13/d1d/d56 39 2024-04-20T10:55:09.299 INFO:tasks.workunit.client.1.smithi175.stdout:7/963: dwrite db/d61/d6d/d9c/de8/d2a/d41/f118 [0,4194304] 0 2024-04-20T10:55:09.301 INFO:tasks.workunit.client.1.smithi175.stdout:0/816: truncate df/d1a/d22/d6a/d72/d48/f49 150397 0 2024-04-20T10:55:09.316 INFO:tasks.workunit.client.1.smithi175.stdout:2/776: dwrite d1/f57 [0,4194304] 0 2024-04-20T10:55:09.317 INFO:tasks.workunit.client.1.smithi175.stdout:8/868: dwrite d7/d13/d1d/d56/f62 [0,4194304] 0 2024-04-20T10:55:09.319 INFO:tasks.workunit.client.1.smithi175.stdout:7/964: link db/d1d/d39/d50/dba/d47/la7 db/d1d/d39/d50/l146 0 2024-04-20T10:55:09.321 INFO:tasks.workunit.client.1.smithi175.stdout:2/777: getdents d1/d48 0 2024-04-20T10:55:09.323 INFO:tasks.workunit.client.1.smithi175.stdout:2/778: dread d1/d7/d63/d36/d7d/d84/d8b/d101/ff7 [0,4194304] 0 2024-04-20T10:55:09.323 INFO:tasks.workunit.client.1.smithi175.stdout:2/779: write d1/d7/d63/d4b/d8a/dd9/fd4 [871113,127839] 0 2024-04-20T10:55:09.332 INFO:tasks.workunit.client.1.smithi175.stdout:8/869: dwrite d7/d13/d1d/d24/d39/d85/fcf [0,4194304] 0 2024-04-20T10:55:09.332 INFO:tasks.workunit.client.1.smithi175.stdout:8/870: write d7/fd [3025730,80764] 0 2024-04-20T10:55:09.333 INFO:tasks.workunit.client.1.smithi175.stdout:7/965: readlink db/d61/d6d/d9c/de8/d2a/lb0 0 2024-04-20T10:55:09.333 INFO:tasks.workunit.client.1.smithi175.stdout:7/966: truncate db/d1d/d39/d50/dba/daa/f124 347833 0 2024-04-20T10:55:09.334 INFO:tasks.workunit.client.1.smithi175.stdout:2/780: rmdir d1/d48/d21/d76 39 2024-04-20T10:55:09.334 INFO:tasks.workunit.client.1.smithi175.stdout:2/781: readlink d1/d48/l45 0 2024-04-20T10:55:09.334 INFO:tasks.workunit.client.1.smithi175.stdout:2/782: readlink d1/d7/d63/d4b/d8a/l98 0 2024-04-20T10:55:09.383 INFO:tasks.workunit.client.1.smithi175.stdout:8/871: mkdir d7/d13/d1d/d24/d26/dcb/d113 0 2024-04-20T10:55:09.384 INFO:tasks.workunit.client.1.smithi175.stdout:8/872: fsync d7/f18 0 2024-04-20T10:55:09.384 INFO:tasks.workunit.client.1.smithi175.stdout:8/873: fsync d7/d13/d1d/f47 0 2024-04-20T10:55:09.384 INFO:tasks.workunit.client.1.smithi175.stdout:8/874: write d7/d13/d1d/d24/d38/d80/fd4 [215974,91746] 0 2024-04-20T10:55:09.384 INFO:tasks.workunit.client.1.smithi175.stdout:7/967: creat db/d61/d6d/dbc/f147 x:0 0 0 2024-04-20T10:55:09.384 INFO:tasks.workunit.client.1.smithi175.stdout:7/968: readlink db/lf0 0 2024-04-20T10:55:09.384 INFO:tasks.workunit.client.1.smithi175.stdout:7/969: stat db/d1d/d39/de7 0 2024-04-20T10:55:09.384 INFO:tasks.workunit.client.1.smithi175.stdout:2/783: creat d1/d7/d63/d4b/d8a/dd9/d108/de0/f117 x:0 0 0 2024-04-20T10:55:09.399 INFO:tasks.workunit.client.1.smithi175.stdout:8/875: symlink d7/d13/d1d/d24/d39/d6f/db7/dce/dfc/l114 0 2024-04-20T10:55:09.399 INFO:tasks.workunit.client.1.smithi175.stdout:8/876: dread - d7/d13/d1d/f10e zero size 2024-04-20T10:55:09.404 INFO:tasks.workunit.client.1.smithi175.stdout:8/877: dread d7/d13/d1d/f88 [0,4194304] 0 2024-04-20T10:55:09.405 INFO:tasks.workunit.client.1.smithi175.stdout:7/970: getdents db/d1d/d39/d50/dba/d47/da6/db9/dc8/d12b 0 2024-04-20T10:55:09.408 INFO:tasks.workunit.client.1.smithi175.stdout:7/971: dread db/d1d/d39/d50/f3e [0,4194304] 0 2024-04-20T10:55:09.409 INFO:tasks.workunit.client.1.smithi175.stdout:2/784: symlink d1/d48/d102/l118 0 2024-04-20T10:55:09.422 INFO:tasks.workunit.client.1.smithi175.stdout:2/785: dwrite d1/d48/d21/db6/ffd [0,4194304] 0 2024-04-20T10:55:09.424 INFO:tasks.workunit.client.1.smithi175.stdout:8/878: creat d7/d13/d1d/d24/d39/d6f/db7/dce/dfc/f115 x:0 0 0 2024-04-20T10:55:09.443 INFO:tasks.workunit.client.1.smithi175.stdout:2/786: dwrite d1/f10e [0,4194304] 0 2024-04-20T10:55:09.443 INFO:tasks.workunit.client.1.smithi175.stdout:2/787: write d1/d7/d63/d36/d7d/d84/d8b/fdd [1473639,124852] 0 2024-04-20T10:55:09.445 INFO:tasks.workunit.client.1.smithi175.stdout:7/972: chown db/d61/d6d/d9c/de8/d2a/l74 158649 1 2024-04-20T10:55:09.445 INFO:tasks.workunit.client.1.smithi175.stdout:7/973: fsync db/d1d/d39/ff9 0 2024-04-20T10:55:09.446 INFO:tasks.workunit.client.1.smithi175.stdout:1/970: sync 2024-04-20T10:55:09.449 INFO:tasks.workunit.client.1.smithi175.stdout:1/971: dread d0/f77 [0,4194304] 0 2024-04-20T10:55:09.455 INFO:tasks.workunit.client.1.smithi175.stdout:8/879: dread d7/f1b [0,4194304] 0 2024-04-20T10:55:09.456 INFO:tasks.workunit.client.1.smithi175.stdout:8/880: creat d7/d13/d1d/d24/d39/d85/f116 x:0 0 0 2024-04-20T10:55:09.457 INFO:tasks.workunit.client.1.smithi175.stdout:7/974: write db/d1d/d39/d50/dba/d47/da6/db9/dc8/d12b/ffe [2404648,64354] 0 2024-04-20T10:55:09.458 INFO:tasks.workunit.client.1.smithi175.stdout:7/975: rmdir db/d1d/d39/d50/dba/d47/dac 39 2024-04-20T10:55:09.459 INFO:tasks.workunit.client.1.smithi175.stdout:7/976: truncate db/d61/d6d/d9c/de8/d2a/f4b 1507910 0 2024-04-20T10:55:09.460 INFO:tasks.workunit.client.1.smithi175.stdout:7/977: symlink db/d1d/d39/d50/dba/d47/da6/db9/l148 0 2024-04-20T10:55:09.460 INFO:tasks.workunit.client.1.smithi175.stdout:7/978: fdatasync db/d1d/d39/d50/dba/d47/f11e 0 2024-04-20T10:55:09.460 INFO:tasks.workunit.client.1.smithi175.stdout:7/979: dread - db/d61/d6d/d9c/fa1 zero size 2024-04-20T10:55:09.461 INFO:tasks.workunit.client.1.smithi175.stdout:7/980: creat db/d61/d6d/d9c/de8/d2a/d41/d59/db3/f149 x:0 0 0 2024-04-20T10:55:09.463 INFO:tasks.workunit.client.1.smithi175.stdout:7/981: mknod db/d1d/d39/d50/dba/d47/da6/db9/c14a 0 2024-04-20T10:55:09.472 INFO:tasks.workunit.client.1.smithi175.stdout:2/788: dwrite d1/d7/d63/dee/fef [0,4194304] 0 2024-04-20T10:55:09.473 INFO:tasks.workunit.client.1.smithi175.stdout:1/972: dwrite d0/d57/db7/df5/d10a/f13d [0,4194304] 0 2024-04-20T10:55:09.474 INFO:tasks.workunit.client.1.smithi175.stdout:2/789: creat d1/d7/f119 x:0 0 0 2024-04-20T10:55:09.475 INFO:tasks.workunit.client.1.smithi175.stdout:1/973: creat d0/d8/d13/d79/f151 x:0 0 0 2024-04-20T10:55:09.476 INFO:tasks.workunit.client.1.smithi175.stdout:2/790: symlink d1/d48/d102/df6/l11a 0 2024-04-20T10:55:09.477 INFO:tasks.workunit.client.1.smithi175.stdout:1/974: unlink d0/d8/d13/d2e/fa6 0 2024-04-20T10:55:09.477 INFO:tasks.workunit.client.1.smithi175.stdout:8/881: dread d7/f19 [0,4194304] 0 2024-04-20T10:55:09.477 INFO:tasks.workunit.client.1.smithi175.stdout:2/791: creat d1/d48/d102/de1/f11b x:0 0 0 2024-04-20T10:55:09.477 INFO:tasks.workunit.client.1.smithi175.stdout:2/792: chown d1/d7/d63/d4b/d8a/dd9/d108/de0/fe7 43 1 2024-04-20T10:55:09.478 INFO:tasks.workunit.client.1.smithi175.stdout:2/793: readlink d1/d7/lba 0 2024-04-20T10:55:09.478 INFO:tasks.workunit.client.1.smithi175.stdout:2/794: symlink d1/d7/d63/d36/d7d/d80/l11c 0 2024-04-20T10:55:09.479 INFO:tasks.workunit.client.1.smithi175.stdout:1/975: link d0/d8/f45 d0/d29/f152 0 2024-04-20T10:55:09.479 INFO:tasks.workunit.client.1.smithi175.stdout:2/795: creat d1/d48/d21/d76/f11d x:0 0 0 2024-04-20T10:55:09.480 INFO:tasks.workunit.client.1.smithi175.stdout:1/976: rename d0/d8/d13/d2e/d35/d8a/d91/ca0 to d0/d102/c153 0 2024-04-20T10:55:09.481 INFO:tasks.workunit.client.1.smithi175.stdout:2/796: link d1/d48/d102/ld0 d1/d7/d63/d36/d7d/d84/l11e 0 2024-04-20T10:55:09.481 INFO:tasks.workunit.client.1.smithi175.stdout:2/797: fsync d1/d7/f72 0 2024-04-20T10:55:09.482 INFO:tasks.workunit.client.1.smithi175.stdout:1/977: creat d0/d51/da8/f154 x:0 0 0 2024-04-20T10:55:09.482 INFO:tasks.workunit.client.1.smithi175.stdout:2/798: mknod d1/d48/c11f 0 2024-04-20T10:55:09.483 INFO:tasks.workunit.client.1.smithi175.stdout:1/978: truncate d0/d8/d13/d2e/f38 759806 0 2024-04-20T10:55:09.484 INFO:tasks.workunit.client.1.smithi175.stdout:2/799: mkdir d1/d6a/d120 0 2024-04-20T10:55:09.484 INFO:tasks.workunit.client.1.smithi175.stdout:2/800: readlink d1/d48/d102/df6/l11a 0 2024-04-20T10:55:09.486 INFO:tasks.workunit.client.1.smithi175.stdout:1/979: truncate d0/f8e 3947546 0 2024-04-20T10:55:09.486 INFO:tasks.workunit.client.1.smithi175.stdout:1/980: dread - d0/d8/f139 zero size 2024-04-20T10:55:09.491 INFO:tasks.workunit.client.1.smithi175.stdout:7/982: dwrite db/d1d/d39/d50/dba/d47/f135 [0,4194304] 0 2024-04-20T10:55:09.494 INFO:tasks.workunit.client.1.smithi175.stdout:1/981: dread d0/d51/da8/f126 [0,4194304] 0 2024-04-20T10:55:09.495 INFO:tasks.workunit.client.1.smithi175.stdout:1/982: mkdir d0/d57/d155 0 2024-04-20T10:55:09.495 INFO:tasks.workunit.client.1.smithi175.stdout:1/983: fdatasync d0/d51/d6b/d9e/f112 0 2024-04-20T10:55:09.496 INFO:tasks.workunit.client.1.smithi175.stdout:1/984: rename d0/d8/d13/d2e/d35/d8a/d104 to d0/d8/dcb/d114/d156 0 2024-04-20T10:55:09.514 INFO:tasks.workunit.client.1.smithi175.stdout:8/882: dwrite d7/d13/d1d/f100 [0,4194304] 0 2024-04-20T10:55:09.516 INFO:tasks.workunit.client.1.smithi175.stdout:8/883: creat d7/d13/d1d/d24/d26/dcb/d113/f117 x:0 0 0 2024-04-20T10:55:09.520 INFO:tasks.workunit.client.1.smithi175.stdout:2/801: dwrite d1/f40 [0,4194304] 0 2024-04-20T10:55:09.520 INFO:tasks.workunit.client.1.smithi175.stdout:7/983: dwrite db/d61/d6d/dbc/ffb [0,4194304] 0 2024-04-20T10:55:09.520 INFO:tasks.workunit.client.1.smithi175.stdout:2/802: creat d1/d7/d63/dee/f121 x:0 0 0 2024-04-20T10:55:09.522 INFO:tasks.workunit.client.1.smithi175.stdout:7/984: stat db/d1d/d39/l9f 0 2024-04-20T10:55:09.523 INFO:tasks.workunit.client.1.smithi175.stdout:7/985: symlink db/d61/d6d/d9c/de8/d2a/d41/d59/db3/l14b 0 2024-04-20T10:55:09.524 INFO:tasks.workunit.client.1.smithi175.stdout:2/803: rename d1/d7/d63/dee/c28 to d1/d7/d63/d36/d7d/d84/d8b/c122 0 2024-04-20T10:55:09.524 INFO:tasks.workunit.client.1.smithi175.stdout:2/804: write d1/d7/d63/d4b/d8a/dd9/fd4 [1452450,10665] 0 2024-04-20T10:55:09.524 INFO:tasks.workunit.client.1.smithi175.stdout:2/805: chown d1/d48/d21/d76/c9f 7730104 1 2024-04-20T10:55:09.524 INFO:tasks.workunit.client.1.smithi175.stdout:2/806: fdatasync d1/d48/f1d 0 2024-04-20T10:55:09.525 INFO:tasks.workunit.client.1.smithi175.stdout:7/986: mkdir db/d1d/d39/d50/dba/daa/df3/d105/d14c 0 2024-04-20T10:55:09.525 INFO:tasks.workunit.client.1.smithi175.stdout:2/807: symlink d1/d48/d102/df6/l123 0 2024-04-20T10:55:09.525 INFO:tasks.workunit.client.1.smithi175.stdout:2/808: chown d1/d7/d63/d4b/d8a/dd9/d108/de0/fe7 30588555 1 2024-04-20T10:55:09.525 INFO:tasks.workunit.client.1.smithi175.stdout:2/809: stat d1/d7/d63/d36/d7d/d84/d8b/fdd 0 2024-04-20T10:55:09.526 INFO:tasks.workunit.client.1.smithi175.stdout:7/987: mkdir db/d61/d6d/d9c/de8/d2a/d41/d59/db3/d138/d14d 0 2024-04-20T10:55:09.526 INFO:tasks.workunit.client.1.smithi175.stdout:7/988: chown db/d61/d6d/d9c/de8/d9a/dd2/d10d 536 1 2024-04-20T10:55:09.527 INFO:tasks.workunit.client.1.smithi175.stdout:2/810: getdents d1/d48/d21/d76/da8 0 2024-04-20T10:55:09.548 INFO:tasks.workunit.client.1.smithi175.stdout:7/989: dwrite db/d61/d6d/d9c/de8/d2a/d41/d59/fa0 [0,4194304] 0 2024-04-20T10:55:09.549 INFO:tasks.workunit.client.1.smithi175.stdout:2/811: dwrite d1/d7/d63/dee/f8c [0,4194304] 0 2024-04-20T10:55:09.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/812: chown d1/d7/d63/d36/d7d/d84/d8b/fdd 72 1 2024-04-20T10:55:09.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/813: write d1/d7/d63/f79 [963816,96381] 0 2024-04-20T10:55:09.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/814: stat d1/f10e 0 2024-04-20T10:55:09.550 INFO:tasks.workunit.client.1.smithi175.stdout:2/815: read d1/d7/f72 [2010880,79258] 0 2024-04-20T10:55:09.551 INFO:tasks.workunit.client.1.smithi175.stdout:7/990: dread db/d1d/d39/d50/dba/d47/fc7 [0,4194304] 0 2024-04-20T10:55:09.592 INFO:tasks.workunit.client.1.smithi175.stdout:2/816: mkdir d1/d7/d63/d36/d7d/d80/d124 0 2024-04-20T10:55:09.593 INFO:tasks.workunit.client.1.smithi175.stdout:2/817: chown d1/d7/f119 3 1 2024-04-20T10:55:09.594 INFO:tasks.workunit.client.1.smithi175.stdout:7/991: creat db/d61/d6d/f14e x:0 0 0 2024-04-20T10:55:09.595 INFO:tasks.workunit.client.1.smithi175.stdout:6/925: sync 2024-04-20T10:55:09.596 INFO:tasks.workunit.client.1.smithi175.stdout:2/818: creat d1/d6a/d120/f125 x:0 0 0 2024-04-20T10:55:09.597 INFO:tasks.workunit.client.1.smithi175.stdout:2/819: getdents d1/d7/d63/d4b/d8a 0 2024-04-20T10:55:09.599 INFO:tasks.workunit.client.1.smithi175.stdout:7/992: link db/d61/d6d/d9c/la3 db/d1d/d39/d50/dba/l14f 0 2024-04-20T10:55:09.599 INFO:tasks.workunit.client.1.smithi175.stdout:2/820: mknod d1/d48/d21/d76/c126 0 2024-04-20T10:55:09.602 INFO:tasks.workunit.client.1.smithi175.stdout:2/821: write d1/d7/d63/d36/d7d/d80/ff1 [167864,80192] 0 2024-04-20T10:55:09.603 INFO:tasks.workunit.client.1.smithi175.stdout:2/822: write d1/d48/d102/de1/f11b [146339,5985] 0 2024-04-20T10:55:09.610 INFO:tasks.workunit.client.1.smithi175.stdout:7/993: read db/d61/d6d/d9c/de8/f96 [1170463,17239] 0 2024-04-20T10:55:09.610 INFO:tasks.workunit.client.1.smithi175.stdout:7/994: chown db/d61/d6d/d9c/de8/cff 40 1 2024-04-20T10:55:09.611 INFO:tasks.workunit.client.1.smithi175.stdout:7/995: dread - db/d1d/d39/d50/dba/d47/f79 zero size 2024-04-20T10:55:09.612 INFO:tasks.workunit.client.1.smithi175.stdout:2/823: dread d1/d7/d63/d36/d7d/d84/d8b/d101/fe8 [0,4194304] 0 2024-04-20T10:55:09.612 INFO:tasks.workunit.client.1.smithi175.stdout:7/996: rename db/d61/d6d/dbc/ffb to db/d1d/d39/d50/dba/d141/f150 0 2024-04-20T10:55:09.614 INFO:tasks.workunit.client.1.smithi175.stdout:2/824: creat d1/d48/d21/d76/da8/f127 x:0 0 0 2024-04-20T10:55:09.614 INFO:tasks.workunit.client.1.smithi175.stdout:2/825: chown d1/d7/d63/d36/d7d/d84/d8b/d101 507813643 1 2024-04-20T10:55:09.614 INFO:tasks.workunit.client.1.smithi175.stdout:2/826: write d1/d7/d63/d4b/d8a/dd9/d108/de0/f117 [408842,26063] 0 2024-04-20T10:55:09.614 INFO:tasks.workunit.client.1.smithi175.stdout:2/827: write d1/fad [1766350,45731] 0 2024-04-20T10:55:09.615 INFO:tasks.workunit.client.1.smithi175.stdout:7/997: creat db/d1d/d39/d50/dba/daa/df3/f151 x:0 0 0 2024-04-20T10:55:09.615 INFO:tasks.workunit.client.1.smithi175.stdout:2/828: creat d1/d6a/f128 x:0 0 0 2024-04-20T10:55:09.622 INFO:tasks.workunit.client.1.smithi175.stdout:6/926: dwrite d1/dc0/f99 [4194304,4194304] 0 2024-04-20T10:55:09.623 INFO:tasks.workunit.client.1.smithi175.stdout:6/927: write d1/d37/d83/db8/f4f [3104143,1943] 0 2024-04-20T10:55:09.623 INFO:tasks.workunit.client.1.smithi175.stdout:2/829: dread d1/ffb [0,4194304] 0 2024-04-20T10:55:09.623 INFO:tasks.workunit.client.1.smithi175.stdout:2/830: write d1/d48/d21/f111 [580350,17084] 0 2024-04-20T10:55:09.623 INFO:tasks.workunit.client.1.smithi175.stdout:2/831: chown d1/d7/d63/dee/cde 25360 1 2024-04-20T10:55:09.628 INFO:tasks.workunit.client.1.smithi175.stdout:7/998: dread db/d1d/d39/d50/dba/d141/f150 [0,4194304] 0 2024-04-20T10:55:09.628 INFO:tasks.workunit.client.1.smithi175.stdout:7/999: write db/d1d/d39/d50/dba/d47/f11b [5079027,117302] 0 2024-04-20T10:55:09.645 INFO:tasks.workunit.client.1.smithi175.stdout:2/832: dwrite d1/d7/f119 [0,4194304] 0 2024-04-20T10:55:09.645 INFO:tasks.workunit.client.1.smithi175.stdout:6/928: dwrite d1/dc0/f99 [0,4194304] 0 2024-04-20T10:55:09.645 INFO:tasks.workunit.client.1.smithi175.stdout:6/929: truncate d1/dc0/d29/f55 1392407 0 2024-04-20T10:55:09.669 INFO:tasks.workunit.client.1.smithi175.stdout:6/930: dwrite d1/d5/d12/f27 [0,4194304] 0 2024-04-20T10:55:09.670 INFO:tasks.workunit.client.1.smithi175.stdout:6/931: symlink d1/d5/d12/d7f/dae/l12b 0 2024-04-20T10:55:09.671 INFO:tasks.workunit.client.1.smithi175.stdout:6/932: symlink d1/d37/d83/db8/d60/d6b/l12c 0 2024-04-20T10:55:09.671 INFO:tasks.workunit.client.1.smithi175.stdout:6/933: write d1/d37/fef [389087,12563] 0 2024-04-20T10:55:09.671 INFO:tasks.workunit.client.1.smithi175.stdout:6/934: write d1/dc0/df2/f123 [127351,113991] 0 2024-04-20T10:55:09.677 INFO:tasks.workunit.client.1.smithi175.stdout:6/935: dread d1/d37/f92 [0,4194304] 0 2024-04-20T10:55:09.677 INFO:tasks.workunit.client.1.smithi175.stdout:6/936: truncate d1/d5/ff0 379094 0 2024-04-20T10:55:09.694 INFO:tasks.workunit.client.1.smithi175.stdout:6/937: dwrite d1/fb [0,4194304] 0 2024-04-20T10:55:09.696 INFO:tasks.workunit.client.1.smithi175.stdout:6/938: rename d1/d37/d83/db8/c8c to d1/d5/d12/c12d 0 2024-04-20T10:55:09.744 INFO:tasks.workunit.client.1.smithi175.stdout:9/788: sync 2024-04-20T10:55:09.744 INFO:tasks.workunit.client.1.smithi175.stdout:4/959: sync 2024-04-20T10:55:09.744 INFO:tasks.workunit.client.1.smithi175.stdout:3/673: sync 2024-04-20T10:55:09.745 INFO:tasks.workunit.client.1.smithi175.stdout:4/960: mkdir d4/dd/d54/d5d/d79/d9d/d104/d14b 0 2024-04-20T10:55:09.745 INFO:tasks.workunit.client.1.smithi175.stdout:4/961: chown d4/dd/dba/d115 2530582 1 2024-04-20T10:55:09.746 INFO:tasks.workunit.client.1.smithi175.stdout:9/789: rename d6/d1b/d42/d51/d9f/ce8 to d6/d33/de7/cf4 0 2024-04-20T10:55:09.746 INFO:tasks.workunit.client.1.smithi175.stdout:9/790: chown d6/d1b/d2f/f6b 32136 1 2024-04-20T10:55:09.746 INFO:tasks.workunit.client.1.smithi175.stdout:9/791: readlink d6/l5e 0 2024-04-20T10:55:09.747 INFO:tasks.workunit.client.1.smithi175.stdout:9/792: truncate d6/d1b/d42/d5b/d72/d7d/dcc/d78/fdf 375512 0 2024-04-20T10:55:09.747 INFO:tasks.workunit.client.1.smithi175.stdout:3/674: getdents d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad 0 2024-04-20T10:55:09.747 INFO:tasks.workunit.client.1.smithi175.stdout:9/793: creat d6/d1b/d42/d5b/d72/dc5/ff5 x:0 0 0 2024-04-20T10:55:09.748 INFO:tasks.workunit.client.1.smithi175.stdout:3/675: mknod d7/d21/d16/d49/cd2 0 2024-04-20T10:55:09.748 INFO:tasks.workunit.client.1.smithi175.stdout:3/676: dread - d7/d19/d33/d7e/d86/d7d/dcb/d50/fc4 zero size 2024-04-20T10:55:09.748 INFO:tasks.workunit.client.1.smithi175.stdout:3/677: chown d7/d19/d33/d7e/d86/c83 94423 1 2024-04-20T10:55:09.750 INFO:tasks.workunit.client.1.smithi175.stdout:3/678: dread d7/d21/d16/d22/d2c/d1f/d48/f53 [0,4194304] 0 2024-04-20T10:55:09.751 INFO:tasks.workunit.client.1.smithi175.stdout:3/679: creat d7/d21/d16/d22/d2c/d64/dbd/fd3 x:0 0 0 2024-04-20T10:55:09.751 INFO:tasks.workunit.client.1.smithi175.stdout:3/680: dread - d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fc6 zero size 2024-04-20T10:55:09.752 INFO:tasks.workunit.client.1.smithi175.stdout:3/681: dread d7/d21/d16/d85/fbb [0,4194304] 0 2024-04-20T10:55:09.754 INFO:tasks.workunit.client.1.smithi175.stdout:3/682: symlink d7/d19/d33/d7e/d86/d7d/ld4 0 2024-04-20T10:55:09.754 INFO:tasks.workunit.client.1.smithi175.stdout:3/683: fdatasync d7/d19/d33/d7e/d86/d7d/dcb/d50/fc2 0 2024-04-20T10:55:09.757 INFO:tasks.workunit.client.1.smithi175.stdout:3/684: link d7/d21/d16/d22/d2c/d1f/f5b d7/fd5 0 2024-04-20T10:55:09.758 INFO:tasks.workunit.client.1.smithi175.stdout:3/685: unlink d7/d19/d33/d7e/d86/d7d/dcb/l77 0 2024-04-20T10:55:09.759 INFO:tasks.workunit.client.1.smithi175.stdout:3/686: creat d7/d19/d33/d7e/d89/fd6 x:0 0 0 2024-04-20T10:55:09.765 INFO:tasks.workunit.client.1.smithi175.stdout:3/687: dread d7/d21/f11 [0,4194304] 0 2024-04-20T10:55:09.766 INFO:tasks.workunit.client.1.smithi175.stdout:3/688: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fd7 x:0 0 0 2024-04-20T10:55:09.767 INFO:tasks.workunit.client.1.smithi175.stdout:4/962: dwrite d4/dd/d5e/ff3 [0,4194304] 0 2024-04-20T10:55:09.767 INFO:tasks.workunit.client.1.smithi175.stdout:9/794: dwrite d6/fe [0,4194304] 0 2024-04-20T10:55:09.769 INFO:tasks.workunit.client.1.smithi175.stdout:4/963: symlink d4/dd/d54/d5d/d79/d9d/d104/l14c 0 2024-04-20T10:55:09.770 INFO:tasks.workunit.client.1.smithi175.stdout:9/795: mkdir d6/dcb/dce/df6 0 2024-04-20T10:55:09.773 INFO:tasks.workunit.client.1.smithi175.stdout:4/964: rename d4/dd/d54/d5f/ca6 to d4/dd/d2d/d43/d69/c14d 0 2024-04-20T10:55:09.773 INFO:tasks.workunit.client.1.smithi175.stdout:3/689: write d7/d21/f2f [712409,114441] 0 2024-04-20T10:55:09.775 INFO:tasks.workunit.client.1.smithi175.stdout:4/965: truncate d4/d23/ff1 3912711 0 2024-04-20T10:55:09.775 INFO:tasks.workunit.client.1.smithi175.stdout:4/966: fdatasync d4/dd/d54/f11b 0 2024-04-20T10:55:09.775 INFO:tasks.workunit.client.1.smithi175.stdout:4/967: write d4/d23/f62 [2066977,20456] 0 2024-04-20T10:55:09.775 INFO:tasks.workunit.client.1.smithi175.stdout:4/968: dread - d4/dd/d54/d5d/d79/d9d/dd4/d10e/f124 zero size 2024-04-20T10:55:09.776 INFO:tasks.workunit.client.1.smithi175.stdout:3/690: read d7/d21/f8d [93254,6714] 0 2024-04-20T10:55:09.776 INFO:tasks.workunit.client.1.smithi175.stdout:3/691: write d7/d21/d16/d22/d2c/d1f/d48/f9c [259316,44877] 0 2024-04-20T10:55:09.776 INFO:tasks.workunit.client.1.smithi175.stdout:4/969: rmdir d4/dd/d54/d5d/d79/d9d/d104/ddf 39 2024-04-20T10:55:09.776 INFO:tasks.workunit.client.1.smithi175.stdout:4/970: dread - d4/dd/d2d/d33/d5b/d65/fbf zero size 2024-04-20T10:55:09.776 INFO:tasks.workunit.client.1.smithi175.stdout:4/971: read d4/dd/f11 [3087222,64248] 0 2024-04-20T10:55:09.777 INFO:tasks.workunit.client.1.smithi175.stdout:3/692: rename d7/d21/d16/d22/d2c/c43 to d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/cd8 0 2024-04-20T10:55:09.778 INFO:tasks.workunit.client.1.smithi175.stdout:4/972: getdents d4/dd/d2d/d33/d3c/de5 0 2024-04-20T10:55:09.780 INFO:tasks.workunit.client.1.smithi175.stdout:3/693: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fd9 x:0 0 0 2024-04-20T10:55:09.782 INFO:tasks.workunit.client.1.smithi175.stdout:4/973: creat d4/dd/d2d/d33/d58/f14e x:0 0 0 2024-04-20T10:55:09.782 INFO:tasks.workunit.client.1.smithi175.stdout:4/974: truncate d4/dd/d2d/d33/d58/f14e 126291 0 2024-04-20T10:55:09.784 INFO:tasks.workunit.client.1.smithi175.stdout:3/694: rename d7/d19/d33/d7e/d86/c83 to d7/d19/da2/cda 0 2024-04-20T10:55:09.785 INFO:tasks.workunit.client.1.smithi175.stdout:4/975: mknod d4/dd/d54/d5d/d79/d9d/dd4/d10e/c14f 0 2024-04-20T10:55:09.788 INFO:tasks.workunit.client.1.smithi175.stdout:3/695: link d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fd9 d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fdb 0 2024-04-20T10:55:09.791 INFO:tasks.workunit.client.1.smithi175.stdout:4/976: rename d4/dd/d54/d5f/d148 to d4/dd/d5e/d74/d150 0 2024-04-20T10:55:09.792 INFO:tasks.workunit.client.1.smithi175.stdout:4/977: chown d4/dd/c1d 2364 1 2024-04-20T10:55:09.794 INFO:tasks.workunit.client.1.smithi175.stdout:4/978: symlink d4/dd/d2d/d43/d69/d83/dcf/l151 0 2024-04-20T10:55:09.794 INFO:tasks.workunit.client.1.smithi175.stdout:4/979: stat d4/d27/d8c/l98 0 2024-04-20T10:55:09.801 INFO:tasks.workunit.client.1.smithi175.stdout:4/980: dread d4/d27/d8c/d10f/f118 [0,4194304] 0 2024-04-20T10:55:09.803 INFO:tasks.workunit.client.1.smithi175.stdout:4/981: creat d4/dd/d54/d5d/d79/f152 x:0 0 0 2024-04-20T10:55:09.803 INFO:tasks.workunit.client.1.smithi175.stdout:0/817: sync 2024-04-20T10:55:09.803 INFO:tasks.workunit.client.1.smithi175.stdout:1/985: sync 2024-04-20T10:55:09.803 INFO:tasks.workunit.client.1.smithi175.stdout:1/986: chown d0/f8e 1649098681 1 2024-04-20T10:55:09.803 INFO:tasks.workunit.client.1.smithi175.stdout:4/982: getdents d4/dd/d5e/d74/da1/dc0 0 2024-04-20T10:55:09.804 INFO:tasks.workunit.client.1.smithi175.stdout:0/818: creat df/ddd/f10b x:0 0 0 2024-04-20T10:55:09.805 INFO:tasks.workunit.client.1.smithi175.stdout:4/983: creat d4/dd/d5e/d74/da1/dbc/f153 x:0 0 0 2024-04-20T10:55:09.805 INFO:tasks.workunit.client.1.smithi175.stdout:4/984: write d4/f31 [4938350,16244] 0 2024-04-20T10:55:09.806 INFO:tasks.workunit.client.1.smithi175.stdout:4/985: mkdir d4/dd/d2d/d33/d5b/d65/d154 0 2024-04-20T10:55:09.806 INFO:tasks.workunit.client.1.smithi175.stdout:4/986: truncate d4/dd/d5e/f6b 1767284 0 2024-04-20T10:55:09.806 INFO:tasks.workunit.client.1.smithi175.stdout:4/987: write d4/dd/d5e/d74/fc1 [1043553,86901] 0 2024-04-20T10:55:09.807 INFO:tasks.workunit.client.1.smithi175.stdout:4/988: creat d4/dd/d54/d5d/d8a/d134/f155 x:0 0 0 2024-04-20T10:55:09.808 INFO:tasks.workunit.client.1.smithi175.stdout:4/989: mknod d4/dd/d5e/d74/da1/c156 0 2024-04-20T10:55:09.809 INFO:tasks.workunit.client.1.smithi175.stdout:4/990: rename d4/dd/f11 to d4/dd/d54/d5d/d8a/d134/f157 0 2024-04-20T10:55:09.809 INFO:tasks.workunit.client.1.smithi175.stdout:4/991: chown d4/dd/d2d/d33/d3c/d44/c106 6 1 2024-04-20T10:55:09.809 INFO:tasks.workunit.client.1.smithi175.stdout:4/992: fdatasync d4/dd/d54/d5d/d9e/f12b 0 2024-04-20T10:55:09.809 INFO:tasks.workunit.client.1.smithi175.stdout:3/696: dwrite d7/d21/d16/d49/f63 [0,4194304] 0 2024-04-20T10:55:09.810 INFO:tasks.workunit.client.1.smithi175.stdout:4/993: write d4/dd/d2d/d43/d69/d83/f13d [440414,45774] 0 2024-04-20T10:55:09.810 INFO:tasks.workunit.client.1.smithi175.stdout:3/697: mkdir d7/d21/d16/d49/dc5/ddc 0 2024-04-20T10:55:09.811 INFO:tasks.workunit.client.1.smithi175.stdout:4/994: rmdir d4/dd/d2d/d33/d58 39 2024-04-20T10:55:09.813 INFO:tasks.workunit.client.1.smithi175.stdout:4/995: read d4/dd/d54/d5d/d79/fec [562649,13688] 0 2024-04-20T10:55:09.813 INFO:tasks.workunit.client.1.smithi175.stdout:4/996: write d4/dd/d54/d5d/d79/d9d/dd4/ff6 [364366,31348] 0 2024-04-20T10:55:09.814 INFO:tasks.workunit.client.1.smithi175.stdout:4/997: rename d4/d27/d8c/d10f/f118 to d4/dd/d5e/d74/da1/f158 0 2024-04-20T10:55:09.815 INFO:tasks.workunit.client.1.smithi175.stdout:1/987: dread d0/d51/d6b/d129/fa1 [0,4194304] 0 2024-04-20T10:55:09.828 INFO:tasks.workunit.client.1.smithi175.stdout:4/998: dread d4/dd/d2d/d43/d69/f75 [0,4194304] 0 2024-04-20T10:55:09.829 INFO:tasks.workunit.client.1.smithi175.stdout:4/999: creat d4/dd/d5e/d74/d150/f159 x:0 0 0 2024-04-20T10:55:09.829 INFO:tasks.workunit.client.1.smithi175.stdout:0/819: dwrite df/d1a/d3f/f6f [0,4194304] 0 2024-04-20T10:55:09.832 INFO:tasks.workunit.client.1.smithi175.stdout:9/796: dwrite d6/d1b/d42/d51/f9a [0,4194304] 0 2024-04-20T10:55:09.833 INFO:tasks.workunit.client.1.smithi175.stdout:9/797: mknod d6/d33/cf7 0 2024-04-20T10:55:09.834 INFO:tasks.workunit.client.1.smithi175.stdout:9/798: mkdir d6/d1b/d42/d5b/d72/df8 0 2024-04-20T10:55:09.835 INFO:tasks.workunit.client.1.smithi175.stdout:9/799: symlink d6/dcb/dce/df6/lf9 0 2024-04-20T10:55:09.836 INFO:tasks.workunit.client.1.smithi175.stdout:9/800: mknod d6/cfa 0 2024-04-20T10:55:09.838 INFO:tasks.workunit.client.1.smithi175.stdout:0/820: read df/d17/dc0/dfc/d4f/fc1 [773882,61780] 0 2024-04-20T10:55:09.838 INFO:tasks.workunit.client.1.smithi175.stdout:0/821: fsync df/d1a/d22/d55/f103 0 2024-04-20T10:55:09.838 INFO:tasks.workunit.client.1.smithi175.stdout:9/801: link d6/d58/ld9 d6/d1b/d26/d8c/dc6/lfb 0 2024-04-20T10:55:09.838 INFO:tasks.workunit.client.1.smithi175.stdout:0/822: mkdir df/d1a/d28/d104/d10c 0 2024-04-20T10:55:09.839 INFO:tasks.workunit.client.1.smithi175.stdout:9/802: dread d6/d1b/d42/d5b/d72/d98/fb9 [0,4194304] 0 2024-04-20T10:55:09.839 INFO:tasks.workunit.client.1.smithi175.stdout:0/823: mkdir df/d17/d71/d10d 0 2024-04-20T10:55:09.840 INFO:tasks.workunit.client.1.smithi175.stdout:9/803: rename d6/cdc to d6/d58/d90/daa/dbd/cfc 0 2024-04-20T10:55:09.841 INFO:tasks.workunit.client.1.smithi175.stdout:0/824: creat df/d19/de0/dfb/dfe/f10e x:0 0 0 2024-04-20T10:55:09.841 INFO:tasks.workunit.client.1.smithi175.stdout:3/698: dwrite d7/d21/d16/d22/d2c/d1f/f5b [4194304,4194304] 0 2024-04-20T10:55:09.841 INFO:tasks.workunit.client.1.smithi175.stdout:1/988: dwrite d0/d51/d6b/d9e/fe5 [0,4194304] 0 2024-04-20T10:55:09.842 INFO:tasks.workunit.client.1.smithi175.stdout:9/804: mkdir d6/d1b/d42/d5b/d72/df8/dfd 0 2024-04-20T10:55:09.842 INFO:tasks.workunit.client.1.smithi175.stdout:9/805: write d6/d1b/d42/d79/fe2 [2019129,52150] 0 2024-04-20T10:55:09.842 INFO:tasks.workunit.client.1.smithi175.stdout:9/806: fsync d6/d1b/d42/d5b/f9c 0 2024-04-20T10:55:09.844 INFO:tasks.workunit.client.1.smithi175.stdout:0/825: creat df/d17/dc0/f10f x:0 0 0 2024-04-20T10:55:09.852 INFO:tasks.workunit.client.1.smithi175.stdout:2/833: sync 2024-04-20T10:55:09.852 INFO:tasks.workunit.client.1.smithi175.stdout:8/884: sync 2024-04-20T10:55:09.852 INFO:tasks.workunit.client.1.smithi175.stdout:1/989: unlink d0/d51/d6b/fad 0 2024-04-20T10:55:09.855 INFO:tasks.workunit.client.1.smithi175.stdout:0/826: mknod df/d17/d71/c110 0 2024-04-20T10:55:09.855 INFO:tasks.workunit.client.1.smithi175.stdout:0/827: dread - df/d17/dc0/fc5 zero size 2024-04-20T10:55:09.857 INFO:tasks.workunit.client.1.smithi175.stdout:2/834: truncate d1/f10e 3231956 0 2024-04-20T10:55:09.858 INFO:tasks.workunit.client.1.smithi175.stdout:8/885: truncate d7/d13/d1d/d24/d39/d6f/f61 1973078 0 2024-04-20T10:55:09.859 INFO:tasks.workunit.client.1.smithi175.stdout:1/990: dread d0/d8/d13/fcf [0,4194304] 0 2024-04-20T10:55:09.859 INFO:tasks.workunit.client.1.smithi175.stdout:9/807: link d6/f28 d6/d33/ffe 0 2024-04-20T10:55:09.860 INFO:tasks.workunit.client.1.smithi175.stdout:9/808: read d6/d33/d63/f71 [44031,24200] 0 2024-04-20T10:55:09.860 INFO:tasks.workunit.client.1.smithi175.stdout:0/828: mknod df/d1a/d3f/c111 0 2024-04-20T10:55:09.861 INFO:tasks.workunit.client.1.smithi175.stdout:2/835: creat d1/f129 x:0 0 0 2024-04-20T10:55:09.863 INFO:tasks.workunit.client.1.smithi175.stdout:8/886: creat d7/d13/d1d/d24/d63/dd9/f118 x:0 0 0 2024-04-20T10:55:09.865 INFO:tasks.workunit.client.1.smithi175.stdout:1/991: unlink d0/d3e/d61/d73/l11a 0 2024-04-20T10:55:09.868 INFO:tasks.workunit.client.1.smithi175.stdout:2/836: symlink d1/d6a/d74/dc7/l12a 0 2024-04-20T10:55:09.868 INFO:tasks.workunit.client.1.smithi175.stdout:2/837: read d1/d7/d63/dee/f24 [2573378,119911] 0 2024-04-20T10:55:09.869 INFO:tasks.workunit.client.1.smithi175.stdout:2/838: truncate d1/d7/d63/f3e 4996868 0 2024-04-20T10:55:09.869 INFO:tasks.workunit.client.1.smithi175.stdout:2/839: stat d1/fad 0 2024-04-20T10:55:09.869 INFO:tasks.workunit.client.1.smithi175.stdout:2/840: fsync d1/d48/d102/f7f 0 2024-04-20T10:55:09.869 INFO:tasks.workunit.client.1.smithi175.stdout:8/887: symlink d7/d13/d1d/d24/d38/d73/db5/ddb/d10d/l119 0 2024-04-20T10:55:09.869 INFO:tasks.workunit.client.1.smithi175.stdout:8/888: chown d7/d13/d1d/d24/d39/d85/ff5 820349 1 2024-04-20T10:55:09.869 INFO:tasks.workunit.client.1.smithi175.stdout:8/889: chown d7/d13/d1d/d24/d26/dcb/ded 4500 1 2024-04-20T10:55:09.872 INFO:tasks.workunit.client.1.smithi175.stdout:9/809: rename d6/d1b/d42/d79 to d6/d33/d63/dff 0 2024-04-20T10:55:09.873 INFO:tasks.workunit.client.1.smithi175.stdout:0/829: mknod df/d1a/d28/c112 0 2024-04-20T10:55:09.874 INFO:tasks.workunit.client.1.smithi175.stdout:2/841: truncate d1/d48/f31 9255730 0 2024-04-20T10:55:09.875 INFO:tasks.workunit.client.1.smithi175.stdout:9/810: truncate d6/d1b/d42/f50 7014 0 2024-04-20T10:55:09.876 INFO:tasks.workunit.client.1.smithi175.stdout:9/811: fdatasync d6/d1b/d42/d5b/d72/d7d/dcc/d78/fe1 0 2024-04-20T10:55:09.876 INFO:tasks.workunit.client.1.smithi175.stdout:8/890: dread d7/d13/f22 [0,4194304] 0 2024-04-20T10:55:09.877 INFO:tasks.workunit.client.1.smithi175.stdout:0/830: symlink df/d19/de0/dfb/df4/l113 0 2024-04-20T10:55:09.879 INFO:tasks.workunit.client.1.smithi175.stdout:2/842: creat d1/d7/d63/d36/d7d/d84/d8b/da7/f12b x:0 0 0 2024-04-20T10:55:09.882 INFO:tasks.workunit.client.1.smithi175.stdout:9/812: link d6/d58/d90/daa/dbd/de9/leb d6/d1b/d42/d5b/d72/d7d/dae/l100 0 2024-04-20T10:55:09.883 INFO:tasks.workunit.client.1.smithi175.stdout:8/891: chown d7/d13/d1d/d92/c67 4244101 1 2024-04-20T10:55:09.884 INFO:tasks.workunit.client.1.smithi175.stdout:8/892: creat d7/d13/d1d/d24/d38/d80/f11a x:0 0 0 2024-04-20T10:55:09.887 INFO:tasks.workunit.client.1.smithi175.stdout:3/699: write d7/d19/d33/d7e/d86/d7d/dcb/d79/f81 [640066,28032] 0 2024-04-20T10:55:09.888 INFO:tasks.workunit.client.1.smithi175.stdout:6/939: sync 2024-04-20T10:55:09.890 INFO:tasks.workunit.client.1.smithi175.stdout:6/940: mknod d1/dc0/d29/c12e 0 2024-04-20T10:55:09.891 INFO:tasks.workunit.client.1.smithi175.stdout:6/941: symlink d1/d37/l12f 0 2024-04-20T10:55:09.891 INFO:tasks.workunit.client.1.smithi175.stdout:6/942: write d1/d37/fba [884895,126698] 0 2024-04-20T10:55:09.892 INFO:tasks.workunit.client.1.smithi175.stdout:1/992: dwrite d0/d8/d13/d2e/d35/f63 [4194304,4194304] 0 2024-04-20T10:55:09.893 INFO:tasks.workunit.client.1.smithi175.stdout:8/893: dread d7/d13/d1d/d24/d38/fb9 [0,4194304] 0 2024-04-20T10:55:09.894 INFO:tasks.workunit.client.1.smithi175.stdout:2/843: dread d1/d7/d63/d36/d7d/f8e [0,4194304] 0 2024-04-20T10:55:09.894 INFO:tasks.workunit.client.1.smithi175.stdout:6/943: rename d1/dc0/d49/f10c to d1/d5/d12/d7f/de3/f130 0 2024-04-20T10:55:09.894 INFO:tasks.workunit.client.1.smithi175.stdout:6/944: dread - d1/d37/d83/db8/d60/d6b/d119/f127 zero size 2024-04-20T10:55:09.906 INFO:tasks.workunit.client.1.smithi175.stdout:1/993: dread d0/d8/d13/d2e/d35/d8a/fb0 [0,4194304] 0 2024-04-20T10:55:09.907 INFO:tasks.workunit.client.1.smithi175.stdout:1/994: truncate d0/d8/d13/d2e/d35/f7c 2794425 0 2024-04-20T10:55:09.907 INFO:tasks.workunit.client.1.smithi175.stdout:1/995: dread - d0/d8/d13/d7b/f14e zero size 2024-04-20T10:55:09.918 INFO:tasks.workunit.client.1.smithi175.stdout:1/996: dread d0/d57/fc3 [0,4194304] 0 2024-04-20T10:55:09.919 INFO:tasks.workunit.client.1.smithi175.stdout:1/997: getdents d0/d57/db7/df5/d10a 0 2024-04-20T10:55:09.923 INFO:tasks.workunit.client.1.smithi175.stdout:1/998: dread d0/d51/da8/fb3 [0,4194304] 0 2024-04-20T10:55:09.923 INFO:tasks.workunit.client.1.smithi175.stdout:1/999: write d0/d8/d13/d2e/d35/f37 [1173364,98493] 0 2024-04-20T10:55:09.925 INFO:tasks.workunit.client.1.smithi175.stdout:8/894: dwrite d7/d13/f6e [4194304,4194304] 0 2024-04-20T10:55:09.925 INFO:tasks.workunit.client.1.smithi175.stdout:3/700: dwrite d7/d19/d33/f3b [0,4194304] 0 2024-04-20T10:55:09.927 INFO:tasks.workunit.client.1.smithi175.stdout:8/895: mkdir d7/d13/d1d/d24/d26/dcb/d113/d11b 0 2024-04-20T10:55:09.927 INFO:tasks.workunit.client.1.smithi175.stdout:6/945: dwrite d1/d37/d83/db8/d60/d68/d7e/f128 [0,4194304] 0 2024-04-20T10:55:09.927 INFO:tasks.workunit.client.1.smithi175.stdout:9/813: dwrite d6/d33/d63/fba [0,4194304] 0 2024-04-20T10:55:09.929 INFO:tasks.workunit.client.1.smithi175.stdout:3/701: unlink d7/d19/fca 0 2024-04-20T10:55:09.930 INFO:tasks.workunit.client.1.smithi175.stdout:2/844: dwrite d1/d7/d63/d4b/f77 [0,4194304] 0 2024-04-20T10:55:09.930 INFO:tasks.workunit.client.1.smithi175.stdout:2/845: chown d1/d7/d63/dee/f70 83911283 1 2024-04-20T10:55:09.932 INFO:tasks.workunit.client.1.smithi175.stdout:9/814: creat d6/d58/d90/f101 x:0 0 0 2024-04-20T10:55:09.935 INFO:tasks.workunit.client.1.smithi175.stdout:3/702: mkdir d7/d19/d33/ddd 0 2024-04-20T10:55:09.937 INFO:tasks.workunit.client.1.smithi175.stdout:9/815: rename d6/c6e to d6/d58/c102 0 2024-04-20T10:55:09.937 INFO:tasks.workunit.client.1.smithi175.stdout:9/816: fdatasync d6/d1b/d2f/f64 0 2024-04-20T10:55:09.937 INFO:tasks.workunit.client.1.smithi175.stdout:9/817: chown d6/d58/d90/daa/dbd/fee 22242035 1 2024-04-20T10:55:09.937 INFO:tasks.workunit.client.1.smithi175.stdout:9/818: chown d6 1246859456 1 2024-04-20T10:55:09.939 INFO:tasks.workunit.client.1.smithi175.stdout:9/819: mknod d6/d58/d90/c103 0 2024-04-20T10:55:09.940 INFO:tasks.workunit.client.1.smithi175.stdout:3/703: mknod d7/d19/cde 0 2024-04-20T10:55:09.942 INFO:tasks.workunit.client.1.smithi175.stdout:3/704: getdents d7/d19/d33/d7e/d86/d7d/dcb 0 2024-04-20T10:55:09.951 INFO:tasks.workunit.client.1.smithi175.stdout:9/820: dread d6/d10/f1e [4194304,4194304] 0 2024-04-20T10:55:09.952 INFO:tasks.workunit.client.1.smithi175.stdout:9/821: mknod d6/d1b/d42/d5b/d72/d9e/c104 0 2024-04-20T10:55:09.952 INFO:tasks.workunit.client.1.smithi175.stdout:9/822: chown d6/d1b/d2f/c8a 59797 1 2024-04-20T10:55:09.952 INFO:tasks.workunit.client.1.smithi175.stdout:9/823: truncate d6/d58/fd4 4738054 0 2024-04-20T10:55:09.953 INFO:tasks.workunit.client.1.smithi175.stdout:9/824: getdents d6/d33/d63 0 2024-04-20T10:55:09.954 INFO:tasks.workunit.client.1.smithi175.stdout:3/705: dread d7/d21/d16/d22/f66 [0,4194304] 0 2024-04-20T10:55:09.956 INFO:tasks.workunit.client.1.smithi175.stdout:6/946: dwrite d1/d37/d83/db8/db9/f10e [0,4194304] 0 2024-04-20T10:55:09.957 INFO:tasks.workunit.client.1.smithi175.stdout:2/846: dwrite d1/d48/d21/db6/ffd [4194304,4194304] 0 2024-04-20T10:55:09.957 INFO:tasks.workunit.client.1.smithi175.stdout:2/847: fdatasync d1/d48/fd3 0 2024-04-20T10:55:09.959 INFO:tasks.workunit.client.1.smithi175.stdout:8/896: dwrite d7/d13/d1d/d24/d39/d85/fcf [0,4194304] 0 2024-04-20T10:55:09.965 INFO:tasks.workunit.client.1.smithi175.stdout:9/825: dread d6/d33/d63/dff/d81/fa4 [0,4194304] 0 2024-04-20T10:55:09.966 INFO:tasks.workunit.client.1.smithi175.stdout:3/706: write d7/d10/d8c/f8e [1199589,31387] 0 2024-04-20T10:55:09.969 INFO:tasks.workunit.client.1.smithi175.stdout:9/826: rmdir d6/d1b/d42/d5b/d72/d7d/dae/dbf 39 2024-04-20T10:55:09.969 INFO:tasks.workunit.client.1.smithi175.stdout:8/897: write d7/d13/d1d/d92/fa8 [3665586,40392] 0 2024-04-20T10:55:09.969 INFO:tasks.workunit.client.1.smithi175.stdout:8/898: fsync d7/d13/d1d/d24/f9c 0 2024-04-20T10:55:09.969 INFO:tasks.workunit.client.1.smithi175.stdout:3/707: getdents d7/d21/d16/d49/d54 0 2024-04-20T10:55:09.969 INFO:tasks.workunit.client.1.smithi175.stdout:3/708: dread - d7/d21/d16/d22/d2c/fa7 zero size 2024-04-20T10:55:09.970 INFO:tasks.workunit.client.1.smithi175.stdout:9/827: mkdir d6/dcb/d105 0 2024-04-20T10:55:09.970 INFO:tasks.workunit.client.1.smithi175.stdout:2/848: truncate d1/d7/d63/d4b/f77 2176623 0 2024-04-20T10:55:09.971 INFO:tasks.workunit.client.1.smithi175.stdout:8/899: symlink d7/d13/d1d/d24/d38/db6/d10a/l11c 0 2024-04-20T10:55:09.972 INFO:tasks.workunit.client.1.smithi175.stdout:9/828: link d6/d1b/d42/d51/d9f/fda d6/d58/d90/daa/dbd/dec/f106 0 2024-04-20T10:55:09.972 INFO:tasks.workunit.client.1.smithi175.stdout:9/829: chown d6/d58/d90/daa/dbd/de9 842 1 2024-04-20T10:55:09.973 INFO:tasks.workunit.client.1.smithi175.stdout:2/849: symlink d1/d48/d21/d76/da8/l12c 0 2024-04-20T10:55:09.974 INFO:tasks.workunit.client.1.smithi175.stdout:2/850: creat d1/d7/d63/d36/d7d/d84/d8b/da7/f12d x:0 0 0 2024-04-20T10:55:09.974 INFO:tasks.workunit.client.1.smithi175.stdout:9/830: symlink d6/d1b/l107 0 2024-04-20T10:55:09.974 INFO:tasks.workunit.client.1.smithi175.stdout:9/831: chown d6/d1b/d42/d51/de6 48342 1 2024-04-20T10:55:09.975 INFO:tasks.workunit.client.1.smithi175.stdout:2/851: rename d1/d48/f31 to d1/d7/d63/d4b/d8a/dd9/d108/ded/f12e 0 2024-04-20T10:55:09.975 INFO:tasks.workunit.client.1.smithi175.stdout:2/852: write d1/d48/f27 [4774206,2907] 0 2024-04-20T10:55:09.977 INFO:tasks.workunit.client.1.smithi175.stdout:9/832: unlink d6/d58/d90/daa/dbd/de9/leb 0 2024-04-20T10:55:09.977 INFO:tasks.workunit.client.1.smithi175.stdout:9/833: dread - d6/d1b/d42/d5b/d72/ff0 zero size 2024-04-20T10:55:09.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/709: dread d7/d10/d8c/f8e [0,4194304] 0 2024-04-20T10:55:09.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/710: fdatasync d7/d10/d8c/fb0 0 2024-04-20T10:55:09.978 INFO:tasks.workunit.client.1.smithi175.stdout:3/711: fsync d7/d21/d16/d22/d2c/d1f/d48/f53 0 2024-04-20T10:55:09.980 INFO:tasks.workunit.client.1.smithi175.stdout:3/712: creat d7/d19/d33/fdf x:0 0 0 2024-04-20T10:55:09.983 INFO:tasks.workunit.client.1.smithi175.stdout:9/834: dread d6/d33/d63/fba [0,4194304] 0 2024-04-20T10:55:09.983 INFO:tasks.workunit.client.1.smithi175.stdout:9/835: chown d6/d58/d90/daa/dbd 94535713 1 2024-04-20T10:55:09.984 INFO:tasks.workunit.client.1.smithi175.stdout:2/853: write d1/d7/d63/d4b/d8a/dd9/d108/de0/fe7 [4074835,68318] 0 2024-04-20T10:55:09.984 INFO:tasks.workunit.client.1.smithi175.stdout:9/836: creat d6/d33/d63/f108 x:0 0 0 2024-04-20T10:55:09.985 INFO:tasks.workunit.client.1.smithi175.stdout:9/837: fsync d6/d58/d90/f101 0 2024-04-20T10:55:09.986 INFO:tasks.workunit.client.1.smithi175.stdout:2/854: dread d1/d7/d63/d36/d7d/d84/d8b/fdd [0,4194304] 0 2024-04-20T10:55:09.988 INFO:tasks.workunit.client.1.smithi175.stdout:2/855: rename d1/d7/d63/d36/d7d/d84/d8b/l10f to d1/d48/d21/d9c/df8/l12f 0 2024-04-20T10:55:09.989 INFO:tasks.workunit.client.1.smithi175.stdout:6/947: dwrite d1/d5/f6 [0,4194304] 0 2024-04-20T10:55:09.989 INFO:tasks.workunit.client.1.smithi175.stdout:6/948: write d1/d37/f6f [856317,20359] 0 2024-04-20T10:55:09.990 INFO:tasks.workunit.client.1.smithi175.stdout:2/856: readlink d1/l4c 0 2024-04-20T10:55:09.990 INFO:tasks.workunit.client.1.smithi175.stdout:2/857: fdatasync d1/f10e 0 2024-04-20T10:55:09.999 INFO:tasks.workunit.client.1.smithi175.stdout:2/858: dread d1/f81 [0,4194304] 0 2024-04-20T10:55:10.000 INFO:tasks.workunit.client.1.smithi175.stdout:2/859: symlink d1/d7/d63/d36/l130 0 2024-04-20T10:55:10.001 INFO:tasks.workunit.client.1.smithi175.stdout:2/860: mkdir d1/d7/d63/d36/d7d/d84/d8b/d131 0 2024-04-20T10:55:10.001 INFO:tasks.workunit.client.1.smithi175.stdout:2/861: write d1/d48/f109 [530997,44285] 0 2024-04-20T10:55:10.001 INFO:tasks.workunit.client.1.smithi175.stdout:2/862: link d1/d48/d21/lcd d1/d48/l132 0 2024-04-20T10:55:10.002 INFO:tasks.workunit.client.1.smithi175.stdout:2/863: creat d1/d7/d63/d4b/d8a/f133 x:0 0 0 2024-04-20T10:55:10.012 INFO:tasks.workunit.client.1.smithi175.stdout:8/900: dwrite d7/f18 [4194304,4194304] 0 2024-04-20T10:55:10.012 INFO:tasks.workunit.client.1.smithi175.stdout:6/949: dwrite d1/f16 [0,4194304] 0 2024-04-20T10:55:10.012 INFO:tasks.workunit.client.1.smithi175.stdout:6/950: readlink d1/d37/d83/db8/d60/ded/dc1/lcf 0 2024-04-20T10:55:10.013 INFO:tasks.workunit.client.1.smithi175.stdout:6/951: fdatasync d1/dc0/f111 0 2024-04-20T10:55:10.014 INFO:tasks.workunit.client.1.smithi175.stdout:2/864: dread d1/d7/d63/f71 [0,4194304] 0 2024-04-20T10:55:10.014 INFO:tasks.workunit.client.1.smithi175.stdout:3/713: dwrite d7/d21/d16/d22/f66 [0,4194304] 0 2024-04-20T10:55:10.014 INFO:tasks.workunit.client.1.smithi175.stdout:3/714: fdatasync d7/d19/d33/d7e/d86/d7d/dcb/d50/f9b 0 2024-04-20T10:55:10.014 INFO:tasks.workunit.client.1.smithi175.stdout:6/952: symlink d1/d5/l131 0 2024-04-20T10:55:10.014 INFO:tasks.workunit.client.1.smithi175.stdout:2/865: mknod d1/d6a/c134 0 2024-04-20T10:55:10.015 INFO:tasks.workunit.client.1.smithi175.stdout:2/866: write d1/d7/d63/dee/f39 [2452279,13931] 0 2024-04-20T10:55:10.015 INFO:tasks.workunit.client.1.smithi175.stdout:6/953: truncate d1/d5/d12/d7f/fd3 4383317 0 2024-04-20T10:55:10.015 INFO:tasks.workunit.client.1.smithi175.stdout:2/867: symlink d1/d7/d63/d36/d7d/d80/l135 0 2024-04-20T10:55:10.017 INFO:tasks.workunit.client.1.smithi175.stdout:6/954: mknod d1/d37/d83/db8/d60/d6b/d10d/c132 0 2024-04-20T10:55:10.017 INFO:tasks.workunit.client.1.smithi175.stdout:6/955: fdatasync d1/d37/d83/db8/d60/d68/f11e 0 2024-04-20T10:55:10.018 INFO:tasks.workunit.client.1.smithi175.stdout:2/868: truncate d1/d7/d63/d36/d7d/d84/d8b/fdd 1386341 0 2024-04-20T10:55:10.018 INFO:tasks.workunit.client.1.smithi175.stdout:2/869: chown d1/d6a/d74/dc7/fe4 22641 1 2024-04-20T10:55:10.019 INFO:tasks.workunit.client.1.smithi175.stdout:2/870: truncate d1/d7/f22 501956 0 2024-04-20T10:55:10.019 INFO:tasks.workunit.client.1.smithi175.stdout:2/871: chown d1/d7/d63/dee/f46 640523 1 2024-04-20T10:55:10.019 INFO:tasks.workunit.client.1.smithi175.stdout:2/872: write d1/d48/d102/de1/f11b [1136083,121502] 0 2024-04-20T10:55:10.026 INFO:tasks.workunit.client.1.smithi175.stdout:9/838: getdents d6/d58/d90/daa/dbd/dec 0 2024-04-20T10:55:10.027 INFO:tasks.workunit.client.1.smithi175.stdout:2/873: dread d1/f10e [0,4194304] 0 2024-04-20T10:55:10.028 INFO:tasks.workunit.client.1.smithi175.stdout:9/839: rename d6/d58/f61 to d6/d1b/d42/d5b/d72/d7d/dcc/d78/f109 0 2024-04-20T10:55:10.029 INFO:tasks.workunit.client.1.smithi175.stdout:6/956: dread d1/d5/d12/f31 [0,4194304] 0 2024-04-20T10:55:10.032 INFO:tasks.workunit.client.1.smithi175.stdout:6/957: rename d1/d37/d83/db8/d60/d6b/c10a to d1/d5/d12/c133 0 2024-04-20T10:55:10.034 INFO:tasks.workunit.client.1.smithi175.stdout:6/958: mknod d1/d5/d12/d73/c134 0 2024-04-20T10:55:10.035 INFO:tasks.workunit.client.1.smithi175.stdout:6/959: dread - d1/d37/dfd/f107 zero size 2024-04-20T10:55:10.037 INFO:tasks.workunit.client.1.smithi175.stdout:3/715: dwrite d7/f14 [4194304,4194304] 0 2024-04-20T10:55:10.038 INFO:tasks.workunit.client.1.smithi175.stdout:3/716: fdatasync d7/d21/fa 0 2024-04-20T10:55:10.039 INFO:tasks.workunit.client.1.smithi175.stdout:3/717: symlink d7/d19/d33/d7e/le0 0 2024-04-20T10:55:10.039 INFO:tasks.workunit.client.1.smithi175.stdout:3/718: fdatasync d7/d21/d16/d49/f7c 0 2024-04-20T10:55:10.039 INFO:tasks.workunit.client.1.smithi175.stdout:3/719: write d7/d19/d33/fdf [937560,91867] 0 2024-04-20T10:55:10.045 INFO:tasks.workunit.client.1.smithi175.stdout:8/901: dwrite d7/f84 [0,4194304] 0 2024-04-20T10:55:10.045 INFO:tasks.workunit.client.1.smithi175.stdout:2/874: dwrite d1/f57 [0,4194304] 0 2024-04-20T10:55:10.046 INFO:tasks.workunit.client.1.smithi175.stdout:8/902: truncate d7/d13/d1d/d24/d39/f7a 2823908 0 2024-04-20T10:55:10.047 INFO:tasks.workunit.client.1.smithi175.stdout:2/875: creat d1/d7/d63/d4b/d8a/f136 x:0 0 0 2024-04-20T10:55:10.047 INFO:tasks.workunit.client.1.smithi175.stdout:2/876: stat d1/d6a/c134 0 2024-04-20T10:55:10.047 INFO:tasks.workunit.client.1.smithi175.stdout:2/877: chown d1/d48/d21/d76/c126 41225594 1 2024-04-20T10:55:10.048 INFO:tasks.workunit.client.1.smithi175.stdout:2/878: symlink d1/d6a/l137 0 2024-04-20T10:55:10.048 INFO:tasks.workunit.client.1.smithi175.stdout:2/879: truncate d1/d48/d21/d76/f11d 548017 0 2024-04-20T10:55:10.048 INFO:tasks.workunit.client.1.smithi175.stdout:8/903: symlink d7/d13/d1d/d92/l11d 0 2024-04-20T10:55:10.050 INFO:tasks.workunit.client.1.smithi175.stdout:8/904: creat d7/d13/d1d/d24/d38/d73/db5/dcc/f11e x:0 0 0 2024-04-20T10:55:10.050 INFO:tasks.workunit.client.1.smithi175.stdout:8/905: chown d7/d13/d1d/d24/d38/d80/fee 0 1 2024-04-20T10:55:10.050 INFO:tasks.workunit.client.1.smithi175.stdout:9/840: write d6/f39 [758486,102207] 0 2024-04-20T10:55:10.053 INFO:tasks.workunit.client.1.smithi175.stdout:3/720: write d7/d19/d33/d7e/d86/d7d/dcb/f80 [756,22425] 0 2024-04-20T10:55:10.062 INFO:tasks.workunit.client.1.smithi175.stdout:6/960: dwrite d1/d37/d83/f104 [0,4194304] 0 2024-04-20T10:55:10.062 INFO:tasks.workunit.client.1.smithi175.stdout:3/721: rename d7/d21/d16/d85 to d7/d21/d16/d49/de1 0 2024-04-20T10:55:10.062 INFO:tasks.workunit.client.1.smithi175.stdout:3/722: chown d7/d19/da2 5385276 1 2024-04-20T10:55:10.064 INFO:tasks.workunit.client.1.smithi175.stdout:6/961: creat d1/f135 x:0 0 0 2024-04-20T10:55:10.065 INFO:tasks.workunit.client.1.smithi175.stdout:3/723: link d7/d21/d16/d49/f63 d7/d10/d8c/fe2 0 2024-04-20T10:55:10.067 INFO:tasks.workunit.client.1.smithi175.stdout:9/841: dwrite d6/d1b/d42/d5b/d72/d7d/dcc/d78/fe1 [0,4194304] 0 2024-04-20T10:55:10.067 INFO:tasks.workunit.client.1.smithi175.stdout:6/962: symlink d1/d37/d83/db8/d60/ded/dc1/dfc/l136 0 2024-04-20T10:55:10.067 INFO:tasks.workunit.client.1.smithi175.stdout:6/963: chown d1/d37/d83/db8/d60/fac 2611538 1 2024-04-20T10:55:10.069 INFO:tasks.workunit.client.1.smithi175.stdout:9/842: creat d6/d1b/d42/d51/de6/f10a x:0 0 0 2024-04-20T10:55:10.069 INFO:tasks.workunit.client.1.smithi175.stdout:9/843: getdents d6/d1b/d42/dd5 0 2024-04-20T10:55:10.069 INFO:tasks.workunit.client.1.smithi175.stdout:9/844: write d6/d1b/d42/d5b/d72/d7d/dcc/d78/fd1 [124993,129298] 0 2024-04-20T10:55:10.069 INFO:tasks.workunit.client.1.smithi175.stdout:9/845: fdatasync f3 0 2024-04-20T10:55:10.069 INFO:tasks.workunit.client.1.smithi175.stdout:6/964: symlink d1/d37/d83/db8/d60/d68/d10b/l137 0 2024-04-20T10:55:10.069 INFO:tasks.workunit.client.1.smithi175.stdout:9/846: creat d6/d1b/d42/d5b/d72/f10b x:0 0 0 2024-04-20T10:55:10.071 INFO:tasks.workunit.client.1.smithi175.stdout:6/965: unlink d1/d37/d83/db8/d60/d68/d7e/f8f 0 2024-04-20T10:55:10.072 INFO:tasks.workunit.client.1.smithi175.stdout:9/847: symlink d6/d58/d90/daa/dbd/dec/l10c 0 2024-04-20T10:55:10.074 INFO:tasks.workunit.client.1.smithi175.stdout:9/848: write d6/d1b/d42/d5b/d72/d7d/f80 [28006,20828] 0 2024-04-20T10:55:10.074 INFO:tasks.workunit.client.1.smithi175.stdout:3/724: read d7/d21/d16/d22/d2c/d1f/f5b [7046969,110714] 0 2024-04-20T10:55:10.075 INFO:tasks.workunit.client.1.smithi175.stdout:9/849: getdents d6/d1b/d26/d8c/dc6 0 2024-04-20T10:55:10.075 INFO:tasks.workunit.client.1.smithi175.stdout:6/966: dread d1/d37/d83/db8/d60/d6b/da8/fe7 [0,4194304] 0 2024-04-20T10:55:10.089 INFO:tasks.workunit.client.1.smithi175.stdout:3/725: write d7/d21/d16/d22/d2c/d64/fa3 [2992439,12749] 0 2024-04-20T10:55:10.089 INFO:tasks.workunit.client.1.smithi175.stdout:3/726: chown d7/d21 1823 1 2024-04-20T10:55:10.099 INFO:tasks.workunit.client.1.smithi175.stdout:6/967: dwrite d1/d5/d12/f56 [0,4194304] 0 2024-04-20T10:55:10.101 INFO:tasks.workunit.client.1.smithi175.stdout:6/968: mknod d1/d5/d12/d73/c138 0 2024-04-20T10:55:10.102 INFO:tasks.workunit.client.1.smithi175.stdout:6/969: rename d1/d37/l51 to d1/d37/d83/db8/d60/ded/dc1/dfc/l139 0 2024-04-20T10:55:10.104 INFO:tasks.workunit.client.1.smithi175.stdout:6/970: rename d1/dc0/d63/d7c/fde to d1/d37/d83/db8/d60/d68/f13a 0 2024-04-20T10:55:10.104 INFO:tasks.workunit.client.1.smithi175.stdout:6/971: symlink d1/d37/d83/db8/d60/d6b/da8/l13b 0 2024-04-20T10:55:10.104 INFO:tasks.workunit.client.1.smithi175.stdout:6/972: write d1/d37/f115 [1013695,28064] 0 2024-04-20T10:55:10.105 INFO:tasks.workunit.client.1.smithi175.stdout:6/973: getdents d1/d5/d12/deb 0 2024-04-20T10:55:10.105 INFO:tasks.workunit.client.1.smithi175.stdout:6/974: creat d1/d37/d83/db8/d60/ded/dc1/dfc/f13c x:0 0 0 2024-04-20T10:55:10.105 INFO:tasks.workunit.client.1.smithi175.stdout:6/975: chown d1/d37/d83/db8/f58 0 1 2024-04-20T10:55:10.113 INFO:tasks.workunit.client.1.smithi175.stdout:9/850: dwrite d6/d1b/d42/d5b/f9c [0,4194304] 0 2024-04-20T10:55:10.113 INFO:tasks.workunit.client.1.smithi175.stdout:9/851: readlink d6/l18 0 2024-04-20T10:55:10.113 INFO:tasks.workunit.client.1.smithi175.stdout:9/852: write d6/d1b/d42/f50 [428481,26827] 0 2024-04-20T10:55:10.115 INFO:tasks.workunit.client.1.smithi175.stdout:2/880: dwrite d1/d7/f22 [0,4194304] 0 2024-04-20T10:55:10.115 INFO:tasks.workunit.client.1.smithi175.stdout:9/853: link d6/d1b/d42/d51/dca/fea d6/d1b/d42/dd5/f10d 0 2024-04-20T10:55:10.116 INFO:tasks.workunit.client.1.smithi175.stdout:3/727: dwrite d7/d21/d16/d22/d2c/d1f/f5b [8388608,4194304] 0 2024-04-20T10:55:10.116 INFO:tasks.workunit.client.1.smithi175.stdout:3/728: truncate d7/d21/d16/d22/d2c/d64/dbd/fd3 598306 0 2024-04-20T10:55:10.118 INFO:tasks.workunit.client.1.smithi175.stdout:2/881: creat d1/d7/d63/d36/d7d/d84/d8b/d101/f138 x:0 0 0 2024-04-20T10:55:10.120 INFO:tasks.workunit.client.1.smithi175.stdout:2/882: unlink d1/d7/d63/d36/d7d/d84/d8b/d99/lcf 0 2024-04-20T10:55:10.120 INFO:tasks.workunit.client.1.smithi175.stdout:3/729: dread d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/fab [0,4194304] 0 2024-04-20T10:55:10.131 INFO:tasks.workunit.client.1.smithi175.stdout:2/883: dread d1/d7/d63/dee/f8c [0,4194304] 0 2024-04-20T10:55:10.139 INFO:tasks.workunit.client.1.smithi175.stdout:2/884: dread d1/f6 [0,4194304] 0 2024-04-20T10:55:10.139 INFO:tasks.workunit.client.1.smithi175.stdout:3/730: dwrite d7/d21/d16/d22/d2c/f92 [0,4194304] 0 2024-04-20T10:55:10.143 INFO:tasks.workunit.client.1.smithi175.stdout:6/976: dwrite d1/d37/d83/db8/d60/d6b/f11b [0,4194304] 0 2024-04-20T10:55:10.143 INFO:tasks.workunit.client.1.smithi175.stdout:9/854: dwrite d6/d58/f68 [0,4194304] 0 2024-04-20T10:55:10.144 INFO:tasks.workunit.client.1.smithi175.stdout:6/977: dread d1/dc0/d49/f69 [0,4194304] 0 2024-04-20T10:55:10.148 INFO:tasks.workunit.client.1.smithi175.stdout:3/731: dread d7/d19/d33/d7e/d86/d7d/dcb/f6c [0,4194304] 0 2024-04-20T10:55:10.149 INFO:tasks.workunit.client.1.smithi175.stdout:2/885: write d1/f40 [692371,130190] 0 2024-04-20T10:55:10.149 INFO:tasks.workunit.client.1.smithi175.stdout:2/886: read - d1/d7/d63/dee/f10b zero size 2024-04-20T10:55:10.151 INFO:tasks.workunit.client.1.smithi175.stdout:6/978: creat d1/d5/d12/d73/d7a/dee/f13d x:0 0 0 2024-04-20T10:55:10.158 INFO:tasks.workunit.client.1.smithi175.stdout:6/979: dread d1/d37/d83/db8/d60/d6b/f78 [4194304,4194304] 0 2024-04-20T10:55:10.159 INFO:tasks.workunit.client.1.smithi175.stdout:6/980: creat d1/d5/d12/d73/d7a/f13e x:0 0 0 2024-04-20T10:55:10.161 INFO:tasks.workunit.client.1.smithi175.stdout:9/855: rename d6/d1b/d26/l34 to d6/d58/l10e 0 2024-04-20T10:55:10.162 INFO:tasks.workunit.client.1.smithi175.stdout:6/981: creat d1/d37/dfd/f13f x:0 0 0 2024-04-20T10:55:10.163 INFO:tasks.workunit.client.1.smithi175.stdout:6/982: mkdir d1/dc0/d63/d140 0 2024-04-20T10:55:10.164 INFO:tasks.workunit.client.1.smithi175.stdout:3/732: dwrite d7/d19/f97 [4194304,4194304] 0 2024-04-20T10:55:10.166 INFO:tasks.workunit.client.1.smithi175.stdout:2/887: dread d1/d48/d102/f7f [0,4194304] 0 2024-04-20T10:55:10.166 INFO:tasks.workunit.client.1.smithi175.stdout:2/888: stat d1/fad 0 2024-04-20T10:55:10.166 INFO:tasks.workunit.client.1.smithi175.stdout:9/856: mkdir d6/d58/d10f 0 2024-04-20T10:55:10.167 INFO:tasks.workunit.client.1.smithi175.stdout:2/889: creat d1/d6a/d74/dc7/f139 x:0 0 0 2024-04-20T10:55:10.168 INFO:tasks.workunit.client.1.smithi175.stdout:9/857: symlink d6/dcb/dce/df6/l110 0 2024-04-20T10:55:10.168 INFO:tasks.workunit.client.1.smithi175.stdout:2/890: write d1/d7/d63/dee/fdf [238318,97339] 0 2024-04-20T10:55:10.168 INFO:tasks.workunit.client.1.smithi175.stdout:2/891: stat d1/d48/fd3 0 2024-04-20T10:55:10.171 INFO:tasks.workunit.client.1.smithi175.stdout:3/733: link d7/d21/d16/l4c d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/le3 0 2024-04-20T10:55:10.171 INFO:tasks.workunit.client.1.smithi175.stdout:6/983: dread d1/d37/d83/db8/f4f [0,4194304] 0 2024-04-20T10:55:10.171 INFO:tasks.workunit.client.1.smithi175.stdout:6/984: chown d1/dc0/d29/f67 8746 1 2024-04-20T10:55:10.171 INFO:tasks.workunit.client.1.smithi175.stdout:6/985: truncate d1/d37/d83/db8/d60/ded/fa1 4567217 0 2024-04-20T10:55:10.171 INFO:tasks.workunit.client.1.smithi175.stdout:9/858: symlink d6/d33/d63/dff/d81/dd0/l111 0 2024-04-20T10:55:10.172 INFO:tasks.workunit.client.1.smithi175.stdout:9/859: chown d6/f4c 41 1 2024-04-20T10:55:10.173 INFO:tasks.workunit.client.1.smithi175.stdout:3/734: creat d7/d19/d33/d7e/d86/d7d/dcb/fe4 x:0 0 0 2024-04-20T10:55:10.174 INFO:tasks.workunit.client.1.smithi175.stdout:0/831: sync 2024-04-20T10:55:10.175 INFO:tasks.workunit.client.1.smithi175.stdout:9/860: truncate d6/d33/d63/f73 4129141 0 2024-04-20T10:55:10.175 INFO:tasks.workunit.client.1.smithi175.stdout:9/861: write d6/dcb/dce/ff2 [797872,12903] 0 2024-04-20T10:55:10.176 INFO:tasks.workunit.client.1.smithi175.stdout:0/832: creat df/d1a/d28/f114 x:0 0 0 2024-04-20T10:55:10.180 INFO:tasks.workunit.client.1.smithi175.stdout:6/986: dread d1/dc0/f99 [4194304,4194304] 0 2024-04-20T10:55:10.181 INFO:tasks.workunit.client.1.smithi175.stdout:3/735: dread d7/d21/d16/d22/d2c/d64/fa3 [0,4194304] 0 2024-04-20T10:55:10.182 INFO:tasks.workunit.client.1.smithi175.stdout:3/736: fsync d7/d19/d33/d7e/d86/f6f 0 2024-04-20T10:55:10.182 INFO:tasks.workunit.client.1.smithi175.stdout:3/737: chown d7/d19/da2 4 1 2024-04-20T10:55:10.183 INFO:tasks.workunit.client.1.smithi175.stdout:9/862: link d6/d1b/d42/d51/d9f/fda d6/d33/d63/dff/f112 0 2024-04-20T10:55:10.185 INFO:tasks.workunit.client.1.smithi175.stdout:9/863: rename d6/d10/l2d to d6/d1b/d42/d5b/d72/df8/dfd/l113 0 2024-04-20T10:55:10.186 INFO:tasks.workunit.client.1.smithi175.stdout:6/987: mkdir d1/dc0/d49/d141 0 2024-04-20T10:55:10.191 INFO:tasks.workunit.client.1.smithi175.stdout:2/892: dwrite d1/d7/d63/d36/d7d/d84/d8b/da7/f12d [0,4194304] 0 2024-04-20T10:55:10.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/738: dread d7/d21/f11 [0,4194304] 0 2024-04-20T10:55:10.191 INFO:tasks.workunit.client.1.smithi175.stdout:2/893: stat d1/d7/d63/d36/c78 0 2024-04-20T10:55:10.193 INFO:tasks.workunit.client.1.smithi175.stdout:9/864: rename d6/d1b/d42/d5b/d72/d7d/f80 to d6/d1b/d42/d51/de6/f114 0 2024-04-20T10:55:10.195 INFO:tasks.workunit.client.1.smithi175.stdout:0/833: dwrite df/d19/f51 [0,4194304] 0 2024-04-20T10:55:10.196 INFO:tasks.workunit.client.1.smithi175.stdout:0/834: write df/d1a/d22/d6a/d72/d48/d4e/f61 [3043741,111938] 0 2024-04-20T10:55:10.196 INFO:tasks.workunit.client.1.smithi175.stdout:0/835: truncate df/d17/dc0/dfc/d4f/dcd/fd9 5139505 0 2024-04-20T10:55:10.196 INFO:tasks.workunit.client.1.smithi175.stdout:0/836: truncate df/d19/de0/fe1 864939 0 2024-04-20T10:55:10.196 INFO:tasks.workunit.client.1.smithi175.stdout:0/837: write df/d1a/d22/fd7 [518145,32841] 0 2024-04-20T10:55:10.198 INFO:tasks.workunit.client.1.smithi175.stdout:0/838: creat df/d17/dc0/dfc/d4f/f115 x:0 0 0 2024-04-20T10:55:10.200 INFO:tasks.workunit.client.1.smithi175.stdout:6/988: dread d1/d37/d83/db8/d60/d6b/f11b [0,4194304] 0 2024-04-20T10:55:10.200 INFO:tasks.workunit.client.1.smithi175.stdout:6/989: fdatasync d1/dc0/d29/f4b 0 2024-04-20T10:55:10.200 INFO:tasks.workunit.client.1.smithi175.stdout:2/894: link d1/d7/d63/d36/d7d/d80/fbd d1/d7/f13a 0 2024-04-20T10:55:10.202 INFO:tasks.workunit.client.1.smithi175.stdout:0/839: unlink df/d1a/d22/d24/c7d 0 2024-04-20T10:55:10.202 INFO:tasks.workunit.client.1.smithi175.stdout:0/840: dread - df/d17/dc0/f10f zero size 2024-04-20T10:55:10.202 INFO:tasks.workunit.client.1.smithi175.stdout:0/841: truncate df/d1a/d22/d6a/d72/fe5 1014780 0 2024-04-20T10:55:10.202 INFO:tasks.workunit.client.1.smithi175.stdout:0/842: dread - df/d17/dc0/dfc/d4f/fe8 zero size 2024-04-20T10:55:10.202 INFO:tasks.workunit.client.1.smithi175.stdout:0/843: write df/d17/dc0/f10f [42327,25697] 0 2024-04-20T10:55:10.209 INFO:tasks.workunit.client.1.smithi175.stdout:8/906: sync 2024-04-20T10:55:10.214 INFO:tasks.workunit.client.1.smithi175.stdout:9/865: write d6/d1b/d42/d51/d9f/fde [3918957,121864] 0 2024-04-20T10:55:10.216 INFO:tasks.workunit.client.1.smithi175.stdout:8/907: link d7/d13/d1d/d24/d38/caf d7/d13/d1d/d24/d26/c11f 0 2024-04-20T10:55:10.221 INFO:tasks.workunit.client.1.smithi175.stdout:3/739: read d7/d19/d33/f3b [3828519,101951] 0 2024-04-20T10:55:10.222 INFO:tasks.workunit.client.1.smithi175.stdout:8/908: dread d7/f19 [0,4194304] 0 2024-04-20T10:55:10.225 INFO:tasks.workunit.client.1.smithi175.stdout:0/844: dwrite df/d17/dc0/dfc/f8b [0,4194304] 0 2024-04-20T10:55:10.226 INFO:tasks.workunit.client.1.smithi175.stdout:9/866: getdents d6/d1b/d42/d5b/d72/df8 0 2024-04-20T10:55:10.226 INFO:tasks.workunit.client.1.smithi175.stdout:3/740: dread d7/d19/d33/d7e/d86/d7d/dcb/f80 [0,4194304] 0 2024-04-20T10:55:10.227 INFO:tasks.workunit.client.1.smithi175.stdout:0/845: mknod df/d17/dc0/c116 0 2024-04-20T10:55:10.228 INFO:tasks.workunit.client.1.smithi175.stdout:9/867: creat d6/d58/d90/daa/dbd/f115 x:0 0 0 2024-04-20T10:55:10.229 INFO:tasks.workunit.client.1.smithi175.stdout:9/868: dread d6/d1b/d42/d51/de6/f114 [0,4194304] 0 2024-04-20T10:55:10.229 INFO:tasks.workunit.client.1.smithi175.stdout:9/869: truncate d6/d58/d90/daa/dbd/fee 1091329 0 2024-04-20T10:55:10.230 INFO:tasks.workunit.client.1.smithi175.stdout:3/741: mknod d7/d21/d16/ce5 0 2024-04-20T10:55:10.232 INFO:tasks.workunit.client.1.smithi175.stdout:9/870: mkdir d6/d1b/d26/d8c/d116 0 2024-04-20T10:55:10.233 INFO:tasks.workunit.client.1.smithi175.stdout:2/895: dwrite d1/d7/d63/d36/f95 [0,4194304] 0 2024-04-20T10:55:10.233 INFO:tasks.workunit.client.1.smithi175.stdout:2/896: chown d1/d7/d63/dee/f8c 147 1 2024-04-20T10:55:10.237 INFO:tasks.workunit.client.1.smithi175.stdout:9/871: creat d6/d1b/d26/d8c/f117 x:0 0 0 2024-04-20T10:55:10.237 INFO:tasks.workunit.client.1.smithi175.stdout:9/872: write d6/f4c [1729628,19440] 0 2024-04-20T10:55:10.253 INFO:tasks.workunit.client.1.smithi175.stdout:0/846: dread df/d1a/f27 [0,4194304] 0 2024-04-20T10:55:10.254 INFO:tasks.workunit.client.1.smithi175.stdout:0/847: getdents df/d2e/d107 0 2024-04-20T10:55:10.254 INFO:tasks.workunit.client.1.smithi175.stdout:3/742: dwrite d7/d10/f42 [0,4194304] 0 2024-04-20T10:55:10.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/743: chown d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fd9 1110672 1 2024-04-20T10:55:10.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/744: chown d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/cb4 982 1 2024-04-20T10:55:10.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/745: write d7/d21/d16/d22/d2c/f3c [2194840,90788] 0 2024-04-20T10:55:10.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/746: chown d7/d21/d16/d22/d2c/d1f/d48 24064 1 2024-04-20T10:55:10.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/747: dread d7/d21/d16/d22/d2c/d1f/d48/f53 [0,4194304] 0 2024-04-20T10:55:10.255 INFO:tasks.workunit.client.1.smithi175.stdout:3/748: truncate d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/f8a 17797 0 2024-04-20T10:55:10.266 INFO:tasks.workunit.client.1.smithi175.stdout:6/990: dwrite d1/dc0/f32 [0,4194304] 0 2024-04-20T10:55:10.267 INFO:tasks.workunit.client.1.smithi175.stdout:9/873: dwrite d6/f4c [0,4194304] 0 2024-04-20T10:55:10.268 INFO:tasks.workunit.client.1.smithi175.stdout:9/874: chown d6/d33/de7/cf4 92 1 2024-04-20T10:55:10.269 INFO:tasks.workunit.client.1.smithi175.stdout:0/848: link df/d1a/d22/fd7 df/f117 0 2024-04-20T10:55:10.274 INFO:tasks.workunit.client.1.smithi175.stdout:3/749: dwrite d7/d21/d16/d22/d2c/d1f/d48/f61 [0,4194304] 0 2024-04-20T10:55:10.275 INFO:tasks.workunit.client.1.smithi175.stdout:3/750: fsync d7/d21/d16/d22/d2c/fa7 0 2024-04-20T10:55:10.276 INFO:tasks.workunit.client.1.smithi175.stdout:9/875: creat d6/d1b/d26/d8c/dc6/f118 x:0 0 0 2024-04-20T10:55:10.277 INFO:tasks.workunit.client.1.smithi175.stdout:6/991: dread d1/dc0/d63/f77 [0,4194304] 0 2024-04-20T10:55:10.279 INFO:tasks.workunit.client.1.smithi175.stdout:6/992: truncate d1/d37/f85 813424 0 2024-04-20T10:55:10.279 INFO:tasks.workunit.client.1.smithi175.stdout:0/849: dread df/fac [0,4194304] 0 2024-04-20T10:55:10.280 INFO:tasks.workunit.client.1.smithi175.stdout:3/751: mknod d7/d19/d33/d7e/d86/d7d/dcb/d50/ce6 0 2024-04-20T10:55:10.280 INFO:tasks.workunit.client.1.smithi175.stdout:3/752: write d7/d21/d16/d22/d2c/d1f/d48/f53 [646539,63314] 0 2024-04-20T10:55:10.284 INFO:tasks.workunit.client.1.smithi175.stdout:9/876: dread d6/d1b/d2f/f45 [0,4194304] 0 2024-04-20T10:55:10.285 INFO:tasks.workunit.client.1.smithi175.stdout:9/877: creat d6/d1b/d26/d8c/d116/f119 x:0 0 0 2024-04-20T10:55:10.285 INFO:tasks.workunit.client.1.smithi175.stdout:9/878: truncate d6/d1b/d42/d5b/d72/d9e/fbe 173320 0 2024-04-20T10:55:10.285 INFO:tasks.workunit.client.1.smithi175.stdout:9/879: write d6/d58/d90/daa/fb7 [829261,95516] 0 2024-04-20T10:55:10.285 INFO:tasks.workunit.client.1.smithi175.stdout:9/880: readlink d6/d58/d90/daa/dbd/dec/l10c 0 2024-04-20T10:55:10.293 INFO:tasks.workunit.client.1.smithi175.stdout:0/850: link df/d1a/d22/d24/fbd df/d1a/d22/d6a/d72/f118 0 2024-04-20T10:55:10.294 INFO:tasks.workunit.client.1.smithi175.stdout:0/851: stat df/d19/fa5 0 2024-04-20T10:55:10.297 INFO:tasks.workunit.client.1.smithi175.stdout:3/753: dwrite d7/d21/d16/d22/d2c/d1f/f8f [4194304,4194304] 0 2024-04-20T10:55:10.303 INFO:tasks.workunit.client.1.smithi175.stdout:6/993: dwrite d1/dc0/d49/fa6 [4194304,4194304] 0 2024-04-20T10:55:10.303 INFO:tasks.workunit.client.1.smithi175.stdout:3/754: mknod d7/d19/d33/d7e/d89/ce7 0 2024-04-20T10:55:10.306 INFO:tasks.workunit.client.1.smithi175.stdout:9/881: dwrite d6/d58/d90/f101 [0,4194304] 0 2024-04-20T10:55:10.306 INFO:tasks.workunit.client.1.smithi175.stdout:9/882: fdatasync d6/d58/d90/daa/dbd/dec/f106 0 2024-04-20T10:55:10.306 INFO:tasks.workunit.client.1.smithi175.stdout:9/883: chown d6/d33/cf7 919 1 2024-04-20T10:55:10.312 INFO:tasks.workunit.client.1.smithi175.stdout:6/994: link d1/d5/d12/d7f/ld1 d1/d5/l142 0 2024-04-20T10:55:10.312 INFO:tasks.workunit.client.1.smithi175.stdout:6/995: write d1/d5/d12/f35 [986064,89336] 0 2024-04-20T10:55:10.314 INFO:tasks.workunit.client.1.smithi175.stdout:6/996: read d1/d37/fdc [515473,101694] 0 2024-04-20T10:55:10.320 INFO:tasks.workunit.client.1.smithi175.stdout:9/884: dread d6/d1b/d42/d51/f9a [0,4194304] 0 2024-04-20T10:55:10.321 INFO:tasks.workunit.client.1.smithi175.stdout:6/997: creat d1/d37/d83/db8/d60/f143 x:0 0 0 2024-04-20T10:55:10.323 INFO:tasks.workunit.client.1.smithi175.stdout:9/885: creat d6/d1b/d42/d5b/d72/d7d/dae/f11a x:0 0 0 2024-04-20T10:55:10.324 INFO:tasks.workunit.client.1.smithi175.stdout:3/755: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/fbc [4194304,4194304] 0 2024-04-20T10:55:10.326 INFO:tasks.workunit.client.1.smithi175.stdout:6/998: link d1/dc0/la3 d1/d37/d83/db8/d60/d6b/d10d/l144 0 2024-04-20T10:55:10.326 INFO:tasks.workunit.client.1.smithi175.stdout:6/999: fdatasync d1/d37/f48 0 2024-04-20T10:55:10.328 INFO:tasks.workunit.client.1.smithi175.stdout:2/897: dwrite d1/f33 [0,4194304] 0 2024-04-20T10:55:10.335 INFO:tasks.workunit.client.1.smithi175.stdout:9/886: write d6/d33/f5c [3987358,43868] 0 2024-04-20T10:55:10.347 INFO:tasks.workunit.client.1.smithi175.stdout:9/887: write d6/d1b/d42/d51/fcd [7498519,44893] 0 2024-04-20T10:55:10.348 INFO:tasks.workunit.client.1.smithi175.stdout:9/888: read d6/d33/d63/dff/fe2 [2932423,26991] 0 2024-04-20T10:55:10.348 INFO:tasks.workunit.client.1.smithi175.stdout:3/756: dwrite d7/d19/d33/f9f [0,4194304] 0 2024-04-20T10:55:10.349 INFO:tasks.workunit.client.1.smithi175.stdout:2/898: dwrite d1/d6a/d74/dc7/f10a [0,4194304] 0 2024-04-20T10:55:10.349 INFO:tasks.workunit.client.1.smithi175.stdout:2/899: readlink d1/d48/d102/l87 0 2024-04-20T10:55:10.349 INFO:tasks.workunit.client.1.smithi175.stdout:2/900: write d1/d7/d63/d4b/d8a/f136 [603506,93207] 0 2024-04-20T10:55:10.351 INFO:tasks.workunit.client.1.smithi175.stdout:3/757: dread d7/d10/f42 [4194304,4194304] 0 2024-04-20T10:55:10.368 INFO:tasks.workunit.client.1.smithi175.stdout:2/901: dwrite d1/d7/d63/d4b/d8a/dd9/ff3 [0,4194304] 0 2024-04-20T10:55:10.368 INFO:tasks.workunit.client.1.smithi175.stdout:2/902: chown d1/f33 18024 1 2024-04-20T10:55:10.375 INFO:tasks.workunit.client.1.smithi175.stdout:2/903: dread d1/d48/f3b [0,4194304] 0 2024-04-20T10:55:10.376 INFO:tasks.workunit.client.1.smithi175.stdout:2/904: chown d1/d7/f34 424 1 2024-04-20T10:55:10.376 INFO:tasks.workunit.client.1.smithi175.stdout:2/905: readlink d1/d48/d102/l87 0 2024-04-20T10:55:10.376 INFO:tasks.workunit.client.1.smithi175.stdout:3/758: rename d7/d10/f31 to d7/d19/fe8 0 2024-04-20T10:55:10.383 INFO:tasks.workunit.client.1.smithi175.stdout:3/759: write d7/d10/f4a [3194465,53337] 0 2024-04-20T10:55:10.385 INFO:tasks.workunit.client.1.smithi175.stdout:2/906: creat d1/d48/d21/d9c/f13b x:0 0 0 2024-04-20T10:55:10.385 INFO:tasks.workunit.client.1.smithi175.stdout:2/907: fdatasync d1/f33 0 2024-04-20T10:55:10.402 INFO:tasks.workunit.client.1.smithi175.stdout:3/760: dwrite d7/d19/f6b [0,4194304] 0 2024-04-20T10:55:10.470 INFO:tasks.workunit.client.1.smithi175.stdout:2/908: creat d1/d48/f13c x:0 0 0 2024-04-20T10:55:10.472 INFO:tasks.workunit.client.1.smithi175.stdout:8/909: sync 2024-04-20T10:55:10.473 INFO:tasks.workunit.client.1.smithi175.stdout:0/852: sync 2024-04-20T10:55:10.473 INFO:tasks.workunit.client.1.smithi175.stdout:0/853: write df/d1a/d22/d24/f106 [574750,31465] 0 2024-04-20T10:55:10.473 INFO:tasks.workunit.client.1.smithi175.stdout:2/909: creat d1/d7/d63/d4b/d8a/f13d x:0 0 0 2024-04-20T10:55:10.474 INFO:tasks.workunit.client.1.smithi175.stdout:0/854: link df/f11 df/d1a/d3f/f119 0 2024-04-20T10:55:10.476 INFO:tasks.workunit.client.1.smithi175.stdout:8/910: rename d7/l58 to d7/d13/d1d/d24/d39/d6f/l120 0 2024-04-20T10:55:10.478 INFO:tasks.workunit.client.1.smithi175.stdout:2/910: dread d1/d48/d21/d9c/fec [0,4194304] 0 2024-04-20T10:55:10.480 INFO:tasks.workunit.client.1.smithi175.stdout:8/911: rename d7/d13/d1d/d24/d26/cf8 to d7/d13/d1d/d24/d38/d73/db5/ddb/d10d/c121 0 2024-04-20T10:55:10.481 INFO:tasks.workunit.client.1.smithi175.stdout:2/911: creat d1/d7/d63/d4b/d8a/dd9/d108/de0/f13e x:0 0 0 2024-04-20T10:55:10.482 INFO:tasks.workunit.client.1.smithi175.stdout:8/912: mkdir d7/d13/d1d/d24/d38/d73/d10b/d122 0 2024-04-20T10:55:10.482 INFO:tasks.workunit.client.1.smithi175.stdout:8/913: readlink d7/d13/l53 0 2024-04-20T10:55:10.507 INFO:tasks.workunit.client.1.smithi175.stdout:0/855: dwrite df/d1a/d28/fce [0,4194304] 0 2024-04-20T10:55:10.507 INFO:tasks.workunit.client.1.smithi175.stdout:8/914: dwrite d7/d13/d1d/d24/d39/f3b [0,4194304] 0 2024-04-20T10:55:10.510 INFO:tasks.workunit.client.1.smithi175.stdout:8/915: mkdir d7/d13/d1d/d92/d6c/d123 0 2024-04-20T10:55:10.511 INFO:tasks.workunit.client.1.smithi175.stdout:2/912: link d1/d48/d102/df6/l116 d1/d7/l13f 0 2024-04-20T10:55:10.511 INFO:tasks.workunit.client.1.smithi175.stdout:2/913: dread - d1/d7/d63/dee/f10b zero size 2024-04-20T10:55:10.511 INFO:tasks.workunit.client.1.smithi175.stdout:8/916: mkdir d7/d13/da3/d124 0 2024-04-20T10:55:10.513 INFO:tasks.workunit.client.1.smithi175.stdout:8/917: rename d7/d13/d1d/d24/d38/d80/f11a to d7/d13/d1d/d24/d26/f125 0 2024-04-20T10:55:10.518 INFO:tasks.workunit.client.1.smithi175.stdout:0/856: dread df/d1a/d22/d6a/d72/f95 [0,4194304] 0 2024-04-20T10:55:10.523 INFO:tasks.workunit.client.1.smithi175.stdout:9/889: sync 2024-04-20T10:55:10.523 INFO:tasks.workunit.client.1.smithi175.stdout:9/890: stat d6/d33/de7/lf3 0 2024-04-20T10:55:10.525 INFO:tasks.workunit.client.1.smithi175.stdout:2/914: link d1/d48/f1d d1/d48/d21/d76/f140 0 2024-04-20T10:55:10.525 INFO:tasks.workunit.client.1.smithi175.stdout:2/915: truncate d1/d48/d21/f111 1125615 0 2024-04-20T10:55:10.526 INFO:tasks.workunit.client.1.smithi175.stdout:9/891: getdents d6/d1b/d42/d5b/d72 0 2024-04-20T10:55:10.530 INFO:tasks.workunit.client.1.smithi175.stdout:8/918: dwrite d7/d13/d1d/d24/f5d [0,4194304] 0 2024-04-20T10:55:10.531 INFO:tasks.workunit.client.1.smithi175.stdout:8/919: read - d7/d13/d1d/f10e zero size 2024-04-20T10:55:10.531 INFO:tasks.workunit.client.1.smithi175.stdout:8/920: chown d7/d13/d1d/d24/d39/d85/f103 51343 1 2024-04-20T10:55:10.531 INFO:tasks.workunit.client.1.smithi175.stdout:8/921: read - d7/d13/d1d/fc4 zero size 2024-04-20T10:55:10.532 INFO:tasks.workunit.client.1.smithi175.stdout:2/916: unlink d1/d7/l105 0 2024-04-20T10:55:10.538 INFO:tasks.workunit.client.1.smithi175.stdout:3/761: sync 2024-04-20T10:55:10.543 INFO:tasks.workunit.client.1.smithi175.stdout:9/892: dwrite d6/d1b/d42/d51/de6/f10a [0,4194304] 0 2024-04-20T10:55:10.545 INFO:tasks.workunit.client.1.smithi175.stdout:9/893: mknod d6/d58/d90/daa/dbd/dec/c11b 0 2024-04-20T10:55:10.545 INFO:tasks.workunit.client.1.smithi175.stdout:9/894: write d6/d33/f5c [760300,103273] 0 2024-04-20T10:55:10.545 INFO:tasks.workunit.client.1.smithi175.stdout:9/895: write d6/d1b/d42/d5b/d72/dc5/ff5 [521139,31130] 0 2024-04-20T10:55:10.545 INFO:tasks.workunit.client.1.smithi175.stdout:3/762: read d7/d10/d8c/fe2 [1699226,64358] 0 2024-04-20T10:55:10.546 INFO:tasks.workunit.client.1.smithi175.stdout:9/896: dread d6/d10/f77 [0,4194304] 0 2024-04-20T10:55:10.547 INFO:tasks.workunit.client.1.smithi175.stdout:2/917: rename d1/d48/f3b to d1/d7/f141 0 2024-04-20T10:55:10.548 INFO:tasks.workunit.client.1.smithi175.stdout:9/897: dread d6/d33/d63/dff/d81/f97 [0,4194304] 0 2024-04-20T10:55:10.548 INFO:tasks.workunit.client.1.smithi175.stdout:9/898: chown d6/d33/d63/dff/l7b 114 1 2024-04-20T10:55:10.548 INFO:tasks.workunit.client.1.smithi175.stdout:9/899: dread - d6/d1b/d42/d5b/d72/d9e/fe0 zero size 2024-04-20T10:55:10.548 INFO:tasks.workunit.client.1.smithi175.stdout:3/763: creat d7/d21/d16/d49/da8/fe9 x:0 0 0 2024-04-20T10:55:10.549 INFO:tasks.workunit.client.1.smithi175.stdout:0/857: dread df/d1a/d3f/d5e/f93 [0,4194304] 0 2024-04-20T10:55:10.549 INFO:tasks.workunit.client.1.smithi175.stdout:0/858: truncate df/d19/de0/dfb/dfe/f10e 646027 0 2024-04-20T10:55:10.549 INFO:tasks.workunit.client.1.smithi175.stdout:0/859: truncate df/d19/de0/dfb/dfe/f10e 1098475 0 2024-04-20T10:55:10.550 INFO:tasks.workunit.client.1.smithi175.stdout:9/900: truncate d6/d1b/d2f/f64 1004866 0 2024-04-20T10:55:10.552 INFO:tasks.workunit.client.1.smithi175.stdout:3/764: dread d7/d21/d16/d49/f63 [0,4194304] 0 2024-04-20T10:55:10.553 INFO:tasks.workunit.client.1.smithi175.stdout:9/901: mknod d6/d1b/d42/d5b/d72/dc5/c11c 0 2024-04-20T10:55:10.553 INFO:tasks.workunit.client.1.smithi175.stdout:2/918: dread d1/d48/d102/f7f [0,4194304] 0 2024-04-20T10:55:10.554 INFO:tasks.workunit.client.1.smithi175.stdout:0/860: rename df/d1a/d3f/d5e/fa4 to df/d1a/d22/f11a 0 2024-04-20T10:55:10.555 INFO:tasks.workunit.client.1.smithi175.stdout:3/765: mkdir d7/d10/d8c/dea 0 2024-04-20T10:55:10.556 INFO:tasks.workunit.client.1.smithi175.stdout:2/919: creat d1/d7/d63/dee/f142 x:0 0 0 2024-04-20T10:55:10.557 INFO:tasks.workunit.client.1.smithi175.stdout:0/861: creat df/d1a/d22/f11b x:0 0 0 2024-04-20T10:55:10.558 INFO:tasks.workunit.client.1.smithi175.stdout:0/862: stat df/d1a/d22/f79 0 2024-04-20T10:55:10.558 INFO:tasks.workunit.client.1.smithi175.stdout:0/863: readlink df/d1a/d22/d6a/d72/lcb 0 2024-04-20T10:55:10.559 INFO:tasks.workunit.client.1.smithi175.stdout:3/766: getdents d7/d19 0 2024-04-20T10:55:10.560 INFO:tasks.workunit.client.1.smithi175.stdout:2/920: creat d1/d6a/f143 x:0 0 0 2024-04-20T10:55:10.560 INFO:tasks.workunit.client.1.smithi175.stdout:0/864: creat df/d17/dc0/dfc/d4f/f11c x:0 0 0 2024-04-20T10:55:10.561 INFO:tasks.workunit.client.1.smithi175.stdout:3/767: mknod d7/d19/d33/d7e/d86/d7d/dcb/d79/ceb 0 2024-04-20T10:55:10.562 INFO:tasks.workunit.client.1.smithi175.stdout:2/921: rename d1/d7/d63/dee/fef to d1/d7/d63/d4b/d8a/dd9/d108/de0/f144 0 2024-04-20T10:55:10.563 INFO:tasks.workunit.client.1.smithi175.stdout:3/768: truncate d7/d21/d16/d49/f7c 3904919 0 2024-04-20T10:55:10.564 INFO:tasks.workunit.client.1.smithi175.stdout:2/922: mkdir d1/d7/d63/d36/d7d/d84/d8b/d145 0 2024-04-20T10:55:10.565 INFO:tasks.workunit.client.1.smithi175.stdout:0/865: write df/f11 [1948357,100630] 0 2024-04-20T10:55:10.565 INFO:tasks.workunit.client.1.smithi175.stdout:0/866: stat df/d1a/d28/f114 0 2024-04-20T10:55:10.565 INFO:tasks.workunit.client.1.smithi175.stdout:3/769: creat d7/d21/d16/d22/d2c/fec x:0 0 0 2024-04-20T10:55:10.566 INFO:tasks.workunit.client.1.smithi175.stdout:2/923: creat d1/d7/d63/d36/d7d/d80/d124/f146 x:0 0 0 2024-04-20T10:55:10.567 INFO:tasks.workunit.client.1.smithi175.stdout:0/867: creat df/d1a/d28/dde/f11d x:0 0 0 2024-04-20T10:55:10.568 INFO:tasks.workunit.client.1.smithi175.stdout:3/770: getdents d7/d19/da2 0 2024-04-20T10:55:10.568 INFO:tasks.workunit.client.1.smithi175.stdout:3/771: write d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/f73 [2018695,37555] 0 2024-04-20T10:55:10.568 INFO:tasks.workunit.client.1.smithi175.stdout:3/772: write d7/d10/f4a [1504114,69467] 0 2024-04-20T10:55:10.568 INFO:tasks.workunit.client.1.smithi175.stdout:2/924: getdents d1/d7/d63/d36 0 2024-04-20T10:55:10.569 INFO:tasks.workunit.client.1.smithi175.stdout:0/868: creat df/d1a/da1/f11e x:0 0 0 2024-04-20T10:55:10.570 INFO:tasks.workunit.client.1.smithi175.stdout:3/773: creat d7/d21/d16/d49/db5/fed x:0 0 0 2024-04-20T10:55:10.571 INFO:tasks.workunit.client.1.smithi175.stdout:3/774: stat d7/d21/fd 0 2024-04-20T10:55:10.571 INFO:tasks.workunit.client.1.smithi175.stdout:2/925: rmdir d1/d7/d63 39 2024-04-20T10:55:10.573 INFO:tasks.workunit.client.1.smithi175.stdout:2/926: unlink d1/d48/d21/d76/cf5 0 2024-04-20T10:55:10.573 INFO:tasks.workunit.client.1.smithi175.stdout:2/927: stat d1/d7/d63/d4b/l7e 0 2024-04-20T10:55:10.574 INFO:tasks.workunit.client.1.smithi175.stdout:0/869: symlink df/d1a/d28/l11f 0 2024-04-20T10:55:10.576 INFO:tasks.workunit.client.1.smithi175.stdout:3/775: link d7/d21/d16/c36 d7/d10/cee 0 2024-04-20T10:55:10.576 INFO:tasks.workunit.client.1.smithi175.stdout:3/776: write d7/d10/fc9 [98893,58404] 0 2024-04-20T10:55:10.577 INFO:tasks.workunit.client.1.smithi175.stdout:2/928: link d1/d48/f109 d1/d48/d102/de1/f147 0 2024-04-20T10:55:10.578 INFO:tasks.workunit.client.1.smithi175.stdout:3/777: getdents d7/d19/d33 0 2024-04-20T10:55:10.579 INFO:tasks.workunit.client.1.smithi175.stdout:0/870: mkdir df/d2e/d120 0 2024-04-20T10:55:10.579 INFO:tasks.workunit.client.1.smithi175.stdout:0/871: stat df/d17/dc0/dfc/d4f/f115 0 2024-04-20T10:55:10.579 INFO:tasks.workunit.client.1.smithi175.stdout:0/872: fsync df/d1a/d28/f73 0 2024-04-20T10:55:10.579 INFO:tasks.workunit.client.1.smithi175.stdout:0/873: fdatasync df/d1a/d22/d55/fb3 0 2024-04-20T10:55:10.580 INFO:tasks.workunit.client.1.smithi175.stdout:3/778: truncate d7/d21/d16/d22/faa 725539 0 2024-04-20T10:55:10.581 INFO:tasks.workunit.client.1.smithi175.stdout:0/874: mkdir df/d17/d71/d121 0 2024-04-20T10:55:10.583 INFO:tasks.workunit.client.1.smithi175.stdout:0/875: creat df/d17/dc0/dfc/f122 x:0 0 0 2024-04-20T10:55:10.583 INFO:tasks.workunit.client.1.smithi175.stdout:0/876: fdatasync df/d1a/d22/d6a/d72/f95 0 2024-04-20T10:55:10.584 INFO:tasks.workunit.client.1.smithi175.stdout:3/779: symlink d7/d21/d16/d49/lef 0 2024-04-20T10:55:10.584 INFO:tasks.workunit.client.1.smithi175.stdout:3/780: stat d7/d19/d33/d7e/d86/d7d/dcb/d79/ceb 0 2024-04-20T10:55:10.585 INFO:tasks.workunit.client.1.smithi175.stdout:2/929: read d1/f3 [6959409,5129] 0 2024-04-20T10:55:10.588 INFO:tasks.workunit.client.1.smithi175.stdout:0/877: symlink df/d1a/d22/d6a/l123 0 2024-04-20T10:55:10.610 INFO:tasks.workunit.client.1.smithi175.stdout:3/781: dwrite d7/d21/d16/d22/d2c/f92 [0,4194304] 0 2024-04-20T10:55:10.610 INFO:tasks.workunit.client.1.smithi175.stdout:3/782: stat d7/d10/d8c/fe2 0 2024-04-20T10:55:10.610 INFO:tasks.workunit.client.1.smithi175.stdout:0/878: symlink df/d19/de0/dea/l124 0 2024-04-20T10:55:10.610 INFO:tasks.workunit.client.1.smithi175.stdout:0/879: chown df/d17/f62 198544 1 2024-04-20T10:55:10.612 INFO:tasks.workunit.client.1.smithi175.stdout:3/783: mknod d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/cf0 0 2024-04-20T10:55:10.612 INFO:tasks.workunit.client.1.smithi175.stdout:3/784: rename d7 to d7/d19/d33/df1 22 2024-04-20T10:55:10.612 INFO:tasks.workunit.client.1.smithi175.stdout:2/930: dwrite d1/d7/f13a [0,4194304] 0 2024-04-20T10:55:10.614 INFO:tasks.workunit.client.1.smithi175.stdout:3/785: creat d7/d21/d16/d22/d2c/d1f/ff2 x:0 0 0 2024-04-20T10:55:10.614 INFO:tasks.workunit.client.1.smithi175.stdout:3/786: write d7/d21/d16/d22/d2c/d91/fa1 [1560232,63231] 0 2024-04-20T10:55:10.614 INFO:tasks.workunit.client.1.smithi175.stdout:3/787: fsync d7/d21/d16/d22/d2c/d64/f98 0 2024-04-20T10:55:10.614 INFO:tasks.workunit.client.1.smithi175.stdout:3/788: readlink d7/d21/d16/d49/lef 0 2024-04-20T10:55:10.614 INFO:tasks.workunit.client.1.smithi175.stdout:2/931: getdents d1/d7/d63/d4b/d8a/dd9/d108/ded 0 2024-04-20T10:55:10.616 INFO:tasks.workunit.client.1.smithi175.stdout:3/789: creat d7/d21/d16/d22/d2c/d64/ff3 x:0 0 0 2024-04-20T10:55:10.617 INFO:tasks.workunit.client.1.smithi175.stdout:2/932: creat d1/d7/d63/f148 x:0 0 0 2024-04-20T10:55:10.627 INFO:tasks.workunit.client.1.smithi175.stdout:9/902: dread d6/d1b/d42/d5b/d72/d7d/dcc/d78/f109 [0,4194304] 0 2024-04-20T10:55:10.627 INFO:tasks.workunit.client.1.smithi175.stdout:9/903: stat d6/dcb/d105 0 2024-04-20T10:55:10.627 INFO:tasks.workunit.client.1.smithi175.stdout:9/904: write d6/d33/d63/dff/fe2 [4846640,113051] 0 2024-04-20T10:55:10.629 INFO:tasks.workunit.client.1.smithi175.stdout:9/905: truncate d6/d1b/d42/dd5/f10d 252775 0 2024-04-20T10:55:10.629 INFO:tasks.workunit.client.1.smithi175.stdout:9/906: fdatasync d6/d33/d63/dff/d81/f97 0 2024-04-20T10:55:10.629 INFO:tasks.workunit.client.1.smithi175.stdout:9/907: read d6/d33/d63/dff/fe2 [1858161,74951] 0 2024-04-20T10:55:10.630 INFO:tasks.workunit.client.1.smithi175.stdout:3/790: rmdir d7/d21/d16/d49/db5 39 2024-04-20T10:55:10.630 INFO:tasks.workunit.client.1.smithi175.stdout:3/791: fdatasync d7/d21/fd 0 2024-04-20T10:55:10.636 INFO:tasks.workunit.client.1.smithi175.stdout:2/933: dwrite d1/d7/d63/d4b/d8a/f13d [0,4194304] 0 2024-04-20T10:55:10.637 INFO:tasks.workunit.client.1.smithi175.stdout:2/934: readlink d1/d48/d102/ld0 0 2024-04-20T10:55:10.638 INFO:tasks.workunit.client.1.smithi175.stdout:9/908: unlink d6/d1b/d42/d5b/d72/d7d/dcc/d78/fa0 0 2024-04-20T10:55:10.638 INFO:tasks.workunit.client.1.smithi175.stdout:9/909: chown d6/d58/d90/daa/lb2 19109 1 2024-04-20T10:55:10.639 INFO:tasks.workunit.client.1.smithi175.stdout:2/935: truncate d1/d48/d102/fb4 105270 0 2024-04-20T10:55:10.640 INFO:tasks.workunit.client.1.smithi175.stdout:9/910: mknod d6/d1b/d42/d5b/d72/df8/c11d 0 2024-04-20T10:55:10.641 INFO:tasks.workunit.client.1.smithi175.stdout:2/936: mknod d1/d7/d63/d36/d7d/d84/d8b/d101/c149 0 2024-04-20T10:55:10.641 INFO:tasks.workunit.client.1.smithi175.stdout:2/937: chown d1/d6a/d74/ca9 463 1 2024-04-20T10:55:10.642 INFO:tasks.workunit.client.1.smithi175.stdout:9/911: truncate d6/d33/d63/f73 406218 0 2024-04-20T10:55:10.644 INFO:tasks.workunit.client.1.smithi175.stdout:3/792: dwrite d7/d19/f6b [0,4194304] 0 2024-04-20T10:55:10.644 INFO:tasks.workunit.client.1.smithi175.stdout:3/793: stat d7/d21/d16/d22/d2c/d64/dbd/fd3 0 2024-04-20T10:55:10.645 INFO:tasks.workunit.client.1.smithi175.stdout:3/794: write d7/d21/d16/d49/f63 [3064829,41075] 0 2024-04-20T10:55:10.645 INFO:tasks.workunit.client.1.smithi175.stdout:3/795: write d7/d10/f4a [3575305,74057] 0 2024-04-20T10:55:10.645 INFO:tasks.workunit.client.1.smithi175.stdout:3/796: truncate d7/d21/d16/d22/d2c/fec 331167 0 2024-04-20T10:55:10.645 INFO:tasks.workunit.client.1.smithi175.stdout:3/797: write d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/fab [1581036,54842] 0 2024-04-20T10:55:10.652 INFO:tasks.workunit.client.1.smithi175.stdout:3/798: dread d7/f12 [0,4194304] 0 2024-04-20T10:55:10.652 INFO:tasks.workunit.client.1.smithi175.stdout:3/799: chown d7/d21/d16/d22/d2c/d64/dbd/fd3 0 1 2024-04-20T10:55:10.653 INFO:tasks.workunit.client.1.smithi175.stdout:9/912: creat d6/d1b/d42/d5b/d72/df8/dfd/f11e x:0 0 0 2024-04-20T10:55:10.653 INFO:tasks.workunit.client.1.smithi175.stdout:9/913: fsync d6/d58/d90/f93 0 2024-04-20T10:55:10.653 INFO:tasks.workunit.client.1.smithi175.stdout:9/914: read - d6/d1b/d42/d51/d9f/fda zero size 2024-04-20T10:55:10.654 INFO:tasks.workunit.client.1.smithi175.stdout:9/915: truncate d6/d1b/f47 1790632 0 2024-04-20T10:55:10.654 INFO:tasks.workunit.client.1.smithi175.stdout:9/916: read - d6/d1b/d2f/f70 zero size 2024-04-20T10:55:10.655 INFO:tasks.workunit.client.1.smithi175.stdout:3/800: rename d7/d21/d16/d22/d2c/d1f/l6e to d7/lf4 0 2024-04-20T10:55:10.661 INFO:tasks.workunit.client.1.smithi175.stdout:9/917: write d6/d1b/d42/d5b/d72/d7d/dcc/f9d [2217595,60571] 0 2024-04-20T10:55:10.661 INFO:tasks.workunit.client.1.smithi175.stdout:9/918: write d6/d58/d90/daa/dbd/f115 [642552,40943] 0 2024-04-20T10:55:10.662 INFO:tasks.workunit.client.1.smithi175.stdout:3/801: mknod d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc7/cf5 0 2024-04-20T10:55:10.662 INFO:tasks.workunit.client.1.smithi175.stdout:9/919: write d6/dcb/dce/ff2 [367167,28378] 0 2024-04-20T10:55:10.663 INFO:tasks.workunit.client.1.smithi175.stdout:2/938: dwrite d1/d48/d102/fb4 [0,4194304] 0 2024-04-20T10:55:10.663 INFO:tasks.workunit.client.1.smithi175.stdout:2/939: write d1/d7/d63/f148 [374185,75028] 0 2024-04-20T10:55:10.663 INFO:tasks.workunit.client.1.smithi175.stdout:2/940: dread - d1/ff0 zero size 2024-04-20T10:55:10.664 INFO:tasks.workunit.client.1.smithi175.stdout:9/920: rename d6/d1b/d2f/f6b to d6/d58/d90/daa/f11f 0 2024-04-20T10:55:10.667 INFO:tasks.workunit.client.1.smithi175.stdout:2/941: truncate d1/d7/d63/f3e 4512416 0 2024-04-20T10:55:10.671 INFO:tasks.workunit.client.1.smithi175.stdout:3/802: truncate d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/fbc 3290623 0 2024-04-20T10:55:10.671 INFO:tasks.workunit.client.1.smithi175.stdout:9/921: creat d6/d33/d63/f120 x:0 0 0 2024-04-20T10:55:10.673 INFO:tasks.workunit.client.1.smithi175.stdout:9/922: mkdir d6/dcb/d105/d121 0 2024-04-20T10:55:10.675 INFO:tasks.workunit.client.1.smithi175.stdout:3/803: rename d7/d21/d16/d49/da0 to d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/df6 0 2024-04-20T10:55:10.677 INFO:tasks.workunit.client.1.smithi175.stdout:9/923: unlink d6/d1b/d42/d5b/d72/d7d/dcc/f9d 0 2024-04-20T10:55:10.685 INFO:tasks.workunit.client.1.smithi175.stdout:0/880: dwrite df/d17/dc0/dfc/d4f/f6c [4194304,4194304] 0 2024-04-20T10:55:10.685 INFO:tasks.workunit.client.1.smithi175.stdout:0/881: write df/d1a/d22/f11b [25204,76805] 0 2024-04-20T10:55:10.686 INFO:tasks.workunit.client.1.smithi175.stdout:9/924: read d6/d1b/d42/d5b/d72/d7d/dcc/d78/fe1 [529226,69989] 0 2024-04-20T10:55:10.686 INFO:tasks.workunit.client.1.smithi175.stdout:3/804: mknod d7/d19/d33/d7e/cf7 0 2024-04-20T10:55:10.694 INFO:tasks.workunit.client.1.smithi175.stdout:9/925: rename d6/d1b/d42 to d6/d1b/d26/d8c/dc6/d122 0 2024-04-20T10:55:10.695 INFO:tasks.workunit.client.1.smithi175.stdout:9/926: chown d6/d1b/d26/d8c/dc6/d122/d5b/d72/d7d/dcc 2831837 1 2024-04-20T10:55:10.698 INFO:tasks.workunit.client.1.smithi175.stdout:0/882: write df/f81 [428679,5733] 0 2024-04-20T10:55:10.701 INFO:tasks.workunit.client.1.smithi175.stdout:8/922: sync 2024-04-20T10:55:10.702 INFO:tasks.workunit.client.1.smithi175.stdout:0/883: creat df/d19/de0/f125 x:0 0 0 2024-04-20T10:55:10.703 INFO:tasks.workunit.client.1.smithi175.stdout:8/923: link d7/d13/d1d/d24/d39/d85/l8a d7/d13/d1d/d24/d38/db6/l126 0 2024-04-20T10:55:10.703 INFO:tasks.workunit.client.1.smithi175.stdout:8/924: chown d7/d13/d1d/d24/d39/d6f/db7/dce 8512607 1 2024-04-20T10:55:10.708 INFO:tasks.workunit.client.1.smithi175.stdout:3/805: dwrite d7/d21/d16/d22/d2c/d91/fb7 [0,4194304] 0 2024-04-20T10:55:10.710 INFO:tasks.workunit.client.1.smithi175.stdout:0/884: mknod df/d19/c126 0 2024-04-20T10:55:10.712 INFO:tasks.workunit.client.1.smithi175.stdout:3/806: rename d7/d21/d16/d22/d2c to d7/d21/d16/d22/df8 0 2024-04-20T10:55:10.712 INFO:tasks.workunit.client.1.smithi175.stdout:3/807: read d7/d21/d16/d22/df8/d64/fa3 [1041235,97203] 0 2024-04-20T10:55:10.712 INFO:tasks.workunit.client.1.smithi175.stdout:3/808: chown d7/d21/fd 36 1 2024-04-20T10:55:10.712 INFO:tasks.workunit.client.1.smithi175.stdout:3/809: chown d7/f12 982013 1 2024-04-20T10:55:10.714 INFO:tasks.workunit.client.1.smithi175.stdout:3/810: chown d7/d21/c57 692 1 2024-04-20T10:55:10.716 INFO:tasks.workunit.client.1.smithi175.stdout:0/885: symlink df/d1a/d22/d6a/d72/d48/l127 0 2024-04-20T10:55:10.716 INFO:tasks.workunit.client.1.smithi175.stdout:0/886: write df/d1a/d22/d55/fb3 [2582862,67509] 0 2024-04-20T10:55:10.716 INFO:tasks.workunit.client.1.smithi175.stdout:0/887: fdatasync df/d1a/f27 0 2024-04-20T10:55:10.716 INFO:tasks.workunit.client.1.smithi175.stdout:3/811: symlink d7/d21/d16/d49/d54/lf9 0 2024-04-20T10:55:10.722 INFO:tasks.workunit.client.1.smithi175.stdout:8/925: dwrite d7/d13/d1d/d92/d6c/f97 [0,4194304] 0 2024-04-20T10:55:10.722 INFO:tasks.workunit.client.1.smithi175.stdout:8/926: write d7/d13/d1d/d24/d38/d73/db5/dcc/fdc [4476408,118469] 0 2024-04-20T10:55:10.723 INFO:tasks.workunit.client.1.smithi175.stdout:8/927: mknod d7/c127 0 2024-04-20T10:55:10.724 INFO:tasks.workunit.client.1.smithi175.stdout:0/888: rename df/d1a/d22/c4a to df/d17/dc0/dfc/c128 0 2024-04-20T10:55:10.733 INFO:tasks.workunit.client.1.smithi175.stdout:3/812: dwrite d7/d21/fa [0,4194304] 0 2024-04-20T10:55:10.734 INFO:tasks.workunit.client.1.smithi175.stdout:8/928: truncate d7/d13/d1d/d24/d39/d85/fcf 1520965 0 2024-04-20T10:55:10.734 INFO:tasks.workunit.client.1.smithi175.stdout:8/929: truncate d7/d13/d1d/d24/f9c 1339990 0 2024-04-20T10:55:10.734 INFO:tasks.workunit.client.1.smithi175.stdout:8/930: read d7/d13/d1d/d24/d39/f48 [272682,16975] 0 2024-04-20T10:55:10.735 INFO:tasks.workunit.client.1.smithi175.stdout:3/813: truncate d7/d21/d16/d22/df8/d1f/f8f 6992474 0 2024-04-20T10:55:10.735 INFO:tasks.workunit.client.1.smithi175.stdout:3/814: stat d7/d21/d16/d49/da8 0 2024-04-20T10:55:10.736 INFO:tasks.workunit.client.1.smithi175.stdout:3/815: mkdir d7/d21/d16/d49/dc5/ddc/dfa 0 2024-04-20T10:55:10.736 INFO:tasks.workunit.client.1.smithi175.stdout:3/816: write d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/f8a [468412,9395] 0 2024-04-20T10:55:10.742 INFO:tasks.workunit.client.1.smithi175.stdout:3/817: dread d7/d10/d8c/f8e [0,4194304] 0 2024-04-20T10:55:10.744 INFO:tasks.workunit.client.1.smithi175.stdout:8/931: rename d7/d13/c70 to d7/d13/d1d/d56/c128 0 2024-04-20T10:55:10.744 INFO:tasks.workunit.client.1.smithi175.stdout:0/889: dwrite df/d1a/d22/d6a/d72/d48/d4e/f69 [0,4194304] 0 2024-04-20T10:55:10.745 INFO:tasks.workunit.client.1.smithi175.stdout:3/818: symlink d7/d21/d16/d49/d54/lfb 0 2024-04-20T10:55:10.745 INFO:tasks.workunit.client.1.smithi175.stdout:3/819: stat d7/d19/d33/d7e/d86/d7d/dcb/d50/fc4 0 2024-04-20T10:55:10.746 INFO:tasks.workunit.client.1.smithi175.stdout:8/932: getdents d7/d13/d1d/d24 0 2024-04-20T10:55:10.749 INFO:tasks.workunit.client.1.smithi175.stdout:0/890: creat df/d17/dc0/dfc/f129 x:0 0 0 2024-04-20T10:55:10.749 INFO:tasks.workunit.client.1.smithi175.stdout:0/891: chown df/d1a/da1 1 1 2024-04-20T10:55:10.749 INFO:tasks.workunit.client.1.smithi175.stdout:0/892: fsync df/d17/dc0/f10f 0 2024-04-20T10:55:10.749 INFO:tasks.workunit.client.1.smithi175.stdout:0/893: stat df/d17/ffd 0 2024-04-20T10:55:10.751 INFO:tasks.workunit.client.1.smithi175.stdout:8/933: creat d7/d13/d1d/d24/f129 x:0 0 0 2024-04-20T10:55:10.760 INFO:tasks.workunit.client.1.smithi175.stdout:2/942: dwrite d1/d48/d21/db6/ffd [4194304,4194304] 0 2024-04-20T10:55:10.760 INFO:tasks.workunit.client.1.smithi175.stdout:2/943: write d1/d7/d63/dee/f10b [632295,27635] 0 2024-04-20T10:55:10.762 INFO:tasks.workunit.client.1.smithi175.stdout:8/934: unlink d7/d13/d1d/d24/d39/d6f/db7/dce/le8 0 2024-04-20T10:55:10.763 INFO:tasks.workunit.client.1.smithi175.stdout:2/944: symlink d1/d7/d63/d4b/d8a/dd9/d108/l14a 0 2024-04-20T10:55:10.764 INFO:tasks.workunit.client.1.smithi175.stdout:0/894: dread df/f3a [0,4194304] 0 2024-04-20T10:55:10.764 INFO:tasks.workunit.client.1.smithi175.stdout:8/935: mknod d7/d13/d1d/d92/d6c/d110/c12a 0 2024-04-20T10:55:10.765 INFO:tasks.workunit.client.1.smithi175.stdout:2/945: rmdir d1/d6a/d74 39 2024-04-20T10:55:10.765 INFO:tasks.workunit.client.1.smithi175.stdout:2/946: truncate d1/d48/d21/d76/da8/f127 52748 0 2024-04-20T10:55:10.769 INFO:tasks.workunit.client.1.smithi175.stdout:8/936: mknod d7/d13/d1d/d24/d38/d73/d10b/d122/c12b 0 2024-04-20T10:55:10.770 INFO:tasks.workunit.client.1.smithi175.stdout:2/947: symlink d1/d7/d63/d4b/d8a/dd9/d108/l14b 0 2024-04-20T10:55:10.770 INFO:tasks.workunit.client.1.smithi175.stdout:8/937: mknod d7/d13/d1d/d24/d38/d73/db5/ddb/d10d/c12c 0 2024-04-20T10:55:10.771 INFO:tasks.workunit.client.1.smithi175.stdout:2/948: mknod d1/d48/d102/df6/c14c 0 2024-04-20T10:55:10.781 INFO:tasks.workunit.client.1.smithi175.stdout:0/895: dwrite df/d19/f8a [0,4194304] 0 2024-04-20T10:55:10.782 INFO:tasks.workunit.client.1.smithi175.stdout:8/938: mknod d7/d13/d1d/d24/d26/dcb/d113/d11b/c12d 0 2024-04-20T10:55:10.788 INFO:tasks.workunit.client.1.smithi175.stdout:0/896: dread df/d17/f52 [0,4194304] 0 2024-04-20T10:55:10.788 INFO:tasks.workunit.client.1.smithi175.stdout:0/897: dread - df/d17/dc0/dfc/d4f/fe8 zero size 2024-04-20T10:55:10.803 INFO:tasks.workunit.client.1.smithi175.stdout:0/898: dwrite df/d1a/d22/d24/f106 [0,4194304] 0 2024-04-20T10:55:10.804 INFO:tasks.workunit.client.1.smithi175.stdout:8/939: creat d7/d13/d1d/d24/d26/dcb/f12e x:0 0 0 2024-04-20T10:55:10.804 INFO:tasks.workunit.client.1.smithi175.stdout:8/940: readlink d7/d13/d1d/d24/d38/l45 0 2024-04-20T10:55:10.804 INFO:tasks.workunit.client.1.smithi175.stdout:8/941: write d7/d13/d1d/ff2 [277755,39497] 0 2024-04-20T10:55:10.806 INFO:tasks.workunit.client.1.smithi175.stdout:0/899: rename df/d17/dc0/dfc/d4f/l82 to df/d17/d71/l12a 0 2024-04-20T10:55:10.821 INFO:tasks.workunit.client.1.smithi175.stdout:8/942: dwrite d7/d13/d1d/d24/d63/f7f [0,4194304] 0 2024-04-20T10:55:10.822 INFO:tasks.workunit.client.1.smithi175.stdout:0/900: creat df/d1a/d3f/d5e/f12b x:0 0 0 2024-04-20T10:55:10.823 INFO:tasks.workunit.client.1.smithi175.stdout:8/943: mknod d7/d13/d1d/d24/d38/d73/db5/ddb/d10d/c12f 0 2024-04-20T10:55:10.824 INFO:tasks.workunit.client.1.smithi175.stdout:8/944: creat d7/d13/d1d/d24/d38/d73/d10b/d122/f130 x:0 0 0 2024-04-20T10:55:10.825 INFO:tasks.workunit.client.1.smithi175.stdout:0/901: symlink df/d1a/d22/d24/l12c 0 2024-04-20T10:55:10.825 INFO:tasks.workunit.client.1.smithi175.stdout:0/902: chown df/d17/dc0/c116 54290395 1 2024-04-20T10:55:10.826 INFO:tasks.workunit.client.1.smithi175.stdout:8/945: rename d7/fd to d7/d13/da3/f131 0 2024-04-20T10:55:10.827 INFO:tasks.workunit.client.1.smithi175.stdout:0/903: symlink df/d19/de0/dfb/l12d 0 2024-04-20T10:55:10.827 INFO:tasks.workunit.client.1.smithi175.stdout:8/946: mkdir d7/d13/d1d/d24/d38/d73/d132 0 2024-04-20T10:55:10.828 INFO:tasks.workunit.client.1.smithi175.stdout:8/947: chown d7/d13/d1d/d24/d38/d73/cd1 97368 1 2024-04-20T10:55:10.834 INFO:tasks.workunit.client.1.smithi175.stdout:8/948: write d7/d13/f6e [2867175,11090] 0 2024-04-20T10:55:10.847 INFO:tasks.workunit.client.1.smithi175.stdout:2/949: dwrite d1/d7/d63/d4b/d8a/f133 [0,4194304] 0 2024-04-20T10:55:10.848 INFO:tasks.workunit.client.1.smithi175.stdout:0/904: creat df/d1a/d3f/f12e x:0 0 0 2024-04-20T10:55:10.850 INFO:tasks.workunit.client.1.smithi175.stdout:2/950: rename d1/d7/d63/d36/d7d/d80/d124 to d1/d6a/d74/dc7/d14d 0 2024-04-20T10:55:10.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/949: dread d7/d13/f12 [0,4194304] 0 2024-04-20T10:55:10.924 INFO:tasks.workunit.client.1.smithi175.stdout:8/950: write d7/d13/d1d/d24/d39/d6f/db7/dce/dfc/f115 [284649,102316] 0 2024-04-20T10:55:10.940 INFO:tasks.workunit.client.1.smithi175.stdout:8/951: dwrite d7/fc3 [0,4194304] 0 2024-04-20T10:55:10.941 INFO:tasks.workunit.client.1.smithi175.stdout:0/905: creat df/d17/d71/d121/f12f x:0 0 0 2024-04-20T10:55:10.942 INFO:tasks.workunit.client.1.smithi175.stdout:8/952: mknod d7/d13/d1d/d24/d63/dd9/c133 0 2024-04-20T10:55:10.951 INFO:tasks.workunit.client.1.smithi175.stdout:8/953: dread d7/d13/d1d/d24/d26/f7b [0,4194304] 0 2024-04-20T10:55:10.953 INFO:tasks.workunit.client.1.smithi175.stdout:8/954: dread d7/d13/d1d/d24/d38/fbe [0,4194304] 0 2024-04-20T10:55:10.953 INFO:tasks.workunit.client.1.smithi175.stdout:0/906: rmdir df/d1a/d3f 39 2024-04-20T10:55:10.953 INFO:tasks.workunit.client.1.smithi175.stdout:0/907: write df/d17/dc0/dfc/f129 [510636,32117] 0 2024-04-20T10:55:10.955 INFO:tasks.workunit.client.1.smithi175.stdout:0/908: rename df/d19/f31 to df/d17/dc0/f130 0 2024-04-20T10:55:10.955 INFO:tasks.workunit.client.1.smithi175.stdout:0/909: write df/f38 [1429242,103670] 0 2024-04-20T10:55:10.955 INFO:tasks.workunit.client.1.smithi175.stdout:0/910: dread - df/d1a/d22/d24/fbd zero size 2024-04-20T10:55:10.955 INFO:tasks.workunit.client.1.smithi175.stdout:0/911: dread - df/d1a/d22/d6a/d72/f118 zero size 2024-04-20T10:55:10.955 INFO:tasks.workunit.client.1.smithi175.stdout:0/912: write df/d19/de0/f125 [15092,119165] 0 2024-04-20T10:55:10.956 INFO:tasks.workunit.client.1.smithi175.stdout:0/913: dread - df/d2e/fb8 zero size 2024-04-20T10:55:10.956 INFO:tasks.workunit.client.1.smithi175.stdout:8/955: symlink d7/d13/d1d/d56/l134 0 2024-04-20T10:55:10.963 INFO:tasks.workunit.client.1.smithi175.stdout:0/914: dread df/d1a/d28/f73 [0,4194304] 0 2024-04-20T10:55:10.963 INFO:tasks.workunit.client.1.smithi175.stdout:0/915: read - df/d1a/d98/fbe zero size 2024-04-20T10:55:10.963 INFO:tasks.workunit.client.1.smithi175.stdout:0/916: truncate df/d19/de0/feb 252662 0 2024-04-20T10:55:10.963 INFO:tasks.workunit.client.1.smithi175.stdout:0/917: dread - df/d17/d71/d121/f12f zero size 2024-04-20T10:55:10.964 INFO:tasks.workunit.client.1.smithi175.stdout:8/956: rmdir d7/d13/d1d/d24/d38/d73/d10b/d122 39 2024-04-20T10:55:10.964 INFO:tasks.workunit.client.1.smithi175.stdout:0/918: truncate df/d17/dc0/f130 2287804 0 2024-04-20T10:55:11.036 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:11.098 INFO:tasks.workunit.client.1.smithi175.stdout:0/919: rename df/d1a/d28/dde to df/d1a/d22/d6a/d72/d131 0 2024-04-20T10:55:11.098 INFO:tasks.workunit.client.1.smithi175.stdout:0/920: mknod df/d1a/d3f/c132 0 2024-04-20T10:55:11.100 INFO:tasks.workunit.client.1.smithi175.stdout:0/921: mkdir df/d1a/d22/d24/d133 0 2024-04-20T10:55:11.100 INFO:tasks.workunit.client.1.smithi175.stdout:0/922: stat df/d17/dc0/dfc/d4f/fe8 0 2024-04-20T10:55:11.100 INFO:tasks.workunit.client.1.smithi175.stdout:0/923: chown df/d19/de0/dfb/lf7 86563 1 2024-04-20T10:55:11.100 INFO:tasks.workunit.client.1.smithi175.stdout:0/924: readlink df/d1a/l4c 0 2024-04-20T10:55:11.100 INFO:tasks.workunit.client.1.smithi175.stdout:0/925: getdents df/d19/de0/dea 0 2024-04-20T10:55:11.101 INFO:tasks.workunit.client.1.smithi175.stdout:0/926: creat df/d1a/d28/d104/d10c/f134 x:0 0 0 2024-04-20T10:55:11.101 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:55:11.102 INFO:tasks.workunit.client.1.smithi175.stdout:0/927: mknod df/d17/d71/d121/c135 0 2024-04-20T10:55:11.103 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:55:11.105 INFO:tasks.workunit.client.1.smithi175.stdout:0/928: dread df/d19/f7a [0,4194304] 0 2024-04-20T10:55:11.105 INFO:tasks.workunit.client.1.smithi175.stdout:0/929: fsync df/d19/f3b 0 2024-04-20T10:55:11.105 INFO:tasks.workunit.client.1.smithi175.stdout:0/930: stat df/d17/fa3 0 2024-04-20T10:55:11.107 INFO:tasks.workunit.client.1.smithi175.stdout:0/931: mknod df/d1a/d22/d24/d133/c136 0 2024-04-20T10:55:11.107 INFO:tasks.workunit.client.1.smithi175.stdout:0/932: write df/d1a/d3f/fd1 [2270655,16940] 0 2024-04-20T10:55:11.107 INFO:tasks.workunit.client.1.smithi175.stdout:0/933: dread - df/d17/dc0/dfc/d4f/f115 zero size 2024-04-20T10:55:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.135+0000 7fb37bc7a640 1 Processor -- start 2024-04-20T10:55:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb37bc7a640 1 -- start start 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb37bc7a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb3740ab730 0x7fb3741568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb37bc7a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3740c9ee0 0x7fb374156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb37bc7a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb37415a720 con 0x7fb374153ef0 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb37bc7a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb37415ac80 con 0x7fb3740ab730 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb37bc7a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb37415a9a0 con 0x7fb3740c9ee0 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb379215640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb3740ab730 0x7fb3741568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb379215640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb3740ab730 0x7fb3741568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35620/0 (socket says 172.21.15.90:35620) 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.136+0000 7fb379215640 1 -- 172.21.15.90:0/4269095305 learned_addr learned my addr 172.21.15.90:0/4269095305 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.137+0000 7fb379215640 1 -- 172.21.15.90:0/4269095305 >> v2:172.21.15.175:3300/0 conn(0x7fb3740c9ee0 msgr2=0x7fb374156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:11.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.137+0000 7fb379215640 1 --2- 172.21.15.90:0/4269095305 >> v2:172.21.15.175:3300/0 conn(0x7fb3740c9ee0 0x7fb374156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.137+0000 7fb379215640 1 -- 172.21.15.90:0/4269095305 >> v1:172.21.15.175:6789/0 conn(0x7fb374153ef0 legacy=0x7fb3740c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.137+0000 7fb379215640 1 -- 172.21.15.90:0/4269095305 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740c6a90 con 0x7fb3740ab730 2024-04-20T10:55:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.137+0000 7fb379215640 1 --2- 172.21.15.90:0/4269095305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3740ab730 0x7fb3741568c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb3741578b0 tx=0x7fb36402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6b727a6ea3ea379 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.137+0000 7fb378a14640 1 -- 172.21.15.90:0/4269095305 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364038070 con 0x7fb3740ab730 2024-04-20T10:55:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb378a14640 1 -- 172.21.15.90:0/4269095305 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36402f050 con 0x7fb3740ab730 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb378a14640 1 -- 172.21.15.90:0/4269095305 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364031970 con 0x7fb3740ab730 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 -- 172.21.15.90:0/4269095305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3740ab730 msgr2=0x7fb3741568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/4269095305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3740ab730 0x7fb3741568c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb3741578b0 tx=0x7fb36402b7f0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 -- 172.21.15.90:0/4269095305 shutdown_connections 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/4269095305 >> v2:172.21.15.175:3300/0 conn(0x7fb3740c9ee0 0x7fb374156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/4269095305 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3740ab730 0x7fb3741568c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 -- 172.21.15.90:0/4269095305 >> 172.21.15.90:0/4269095305 conn(0x7fb3740cbfe0 msgr2=0x7fb3740cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 -- 172.21.15.90:0/4269095305 shutdown_connections 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.138+0000 7fb37bc7a640 1 -- 172.21.15.90:0/4269095305 wait complete. 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.139+0000 7fb37bc7a640 1 Processor -- start 2024-04-20T10:55:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.139+0000 7fb37bc7a640 1 -- start start 2024-04-20T10:55:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37bc7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3740ab730 0x7fb3740c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37bc7a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3740c9ee0 0x7fb3741ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37bc7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb374153ef0 0x7fb3741efd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37bc7a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740c9280 con 0x7fb374153ef0 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37bc7a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740c9100 con 0x7fb3740ab730 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37bc7a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb3740bf800 con 0x7fb3740c9ee0 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb374153ef0 0x7fb3741efd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb374153ef0 0x7fb3741efd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35636/0 (socket says 172.21.15.90:35636) 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 -- 172.21.15.90:0/223703589 learned_addr learned my addr 172.21.15.90:0/223703589 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb379215640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3740c9ee0 0x7fb3741ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb379a16640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3740ab730 0x7fb3740c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 -- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3740c9ee0 msgr2=0x7fb3741ef7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3740c9ee0 0x7fb3741ef7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 -- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3740ab730 msgr2=0x7fb3740c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3740ab730 0x7fb3740c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.140+0000 7fb37a217640 1 -- 172.21.15.90:0/223703589 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb374150df0 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.141+0000 7fb37a217640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb374153ef0 0x7fb3741efd10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00b970 tx=0x7fb36c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.141+0000 7fb36a7fc640 1 -- 172.21.15.90:0/223703589 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c019070 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.141+0000 7fb36a7fc640 1 -- 172.21.15.90:0/223703589 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36c00cb60 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.141+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3740b1a40 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.141+0000 7fb36a7fc640 1 -- 172.21.15.90:0/223703589 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36c014440 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.141+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3740c5980 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.142+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb374076150 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.142+0000 7fb36a7fc640 1 -- 172.21.15.90:0/223703589 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb36c01c070 con 0x7fb374153ef0 2024-04-20T10:55:11.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.143+0000 7fb36a7fc640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb35806c8f0 0x7fb35806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.143+0000 7fb36a7fc640 1 -- 172.21.15.90:0/223703589 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7fb36c08bd40 con 0x7fb374153ef0 2024-04-20T10:55:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.143+0000 7fb379a16640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb35806c8f0 0x7fb35806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.143+0000 7fb379a16640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb35806c8f0 0x7fb35806edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb370006fd0 tx=0x7fb370008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:11.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.147+0000 7fb36a7fc640 1 -- 172.21.15.90:0/223703589 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb36c059cb0 con 0x7fb374153ef0 2024-04-20T10:55:11.226 INFO:tasks.workunit.client.1.smithi175.stdout:2/951: dread d1/d7/d63/d36/d7d/f8e [0,4194304] 0 2024-04-20T10:55:11.242 INFO:tasks.workunit.client.1.smithi175.stdout:2/952: dwrite d1/d7/d63/d4b/d8a/f133 [4194304,4194304] 0 2024-04-20T10:55:11.275 INFO:tasks.workunit.client.1.smithi175.stdout:8/957: write d7/fc3 [4458182,77874] 0 2024-04-20T10:55:11.276 INFO:tasks.workunit.client.1.smithi175.stdout:8/958: creat d7/d13/d1d/d24/d39/d85/f135 x:0 0 0 2024-04-20T10:55:11.276 INFO:tasks.workunit.client.1.smithi175.stdout:8/959: fdatasync d7/d13/d1d/d24/d39/f48 0 2024-04-20T10:55:11.277 INFO:tasks.workunit.client.1.smithi175.stdout:8/960: stat d7/d13/d1d/d24/d26/dcb/ded/l108 0 2024-04-20T10:55:11.282 INFO:tasks.workunit.client.1.smithi175.stdout:0/934: dread df/d17/dc0/dfc/d4f/f9c [0,4194304] 0 2024-04-20T10:55:11.283 INFO:tasks.workunit.client.1.smithi175.stdout:0/935: mkdir df/d19/de0/d137 0 2024-04-20T10:55:11.283 INFO:tasks.workunit.client.1.smithi175.stdout:0/936: stat df/d2e 0 2024-04-20T10:55:11.285 INFO:tasks.workunit.client.1.smithi175.stdout:0/937: unlink df/d17/dc0/f10f 0 2024-04-20T10:55:11.285 INFO:tasks.workunit.client.1.smithi175.stdout:0/938: chown df/d1a/f27 233020801 1 2024-04-20T10:55:11.285 INFO:tasks.workunit.client.1.smithi175.stdout:0/939: dread - df/d17/d71/d121/f12f zero size 2024-04-20T10:55:11.290 INFO:tasks.workunit.client.1.smithi175.stdout:3/820: sync 2024-04-20T10:55:11.290 INFO:tasks.workunit.client.1.smithi175.stdout:9/927: sync 2024-04-20T10:55:11.305 INFO:tasks.workunit.client.1.smithi175.stdout:0/940: dwrite f1 [0,4194304] 0 2024-04-20T10:55:11.306 INFO:tasks.workunit.client.1.smithi175.stdout:0/941: link df/d1a/d22/d24/fbd df/d17/d71/d121/f138 0 2024-04-20T10:55:11.307 INFO:tasks.workunit.client.1.smithi175.stdout:0/942: symlink df/d1a/d22/d55/da2/l139 0 2024-04-20T10:55:11.308 INFO:tasks.workunit.client.1.smithi175.stdout:0/943: mkdir df/d1a/d3f/d13a 0 2024-04-20T10:55:11.332 INFO:tasks.workunit.client.1.smithi175.stdout:2/953: creat d1/d48/d21/d76/f14e x:0 0 0 2024-04-20T10:55:11.332 INFO:tasks.workunit.client.1.smithi175.stdout:2/954: getdents d1/d7/d63/dee/dc6 0 2024-04-20T10:55:11.332 INFO:tasks.workunit.client.1.smithi175.stdout:2/955: stat d1/d7/d63/d36/d7d/d84/d8b/d101/f138 0 2024-04-20T10:55:11.332 INFO:tasks.workunit.client.1.smithi175.stdout:2/956: chown d1/d7/d63/d36/d7d/d80/l135 12805 1 2024-04-20T10:55:11.333 INFO:tasks.workunit.client.1.smithi175.stdout:2/957: mknod d1/d48/d102/de1/c14f 0 2024-04-20T10:55:11.333 INFO:tasks.workunit.client.1.smithi175.stdout:2/958: fdatasync d1/d7/d63/d36/fb0 0 2024-04-20T10:55:11.333 INFO:tasks.workunit.client.1.smithi175.stdout:2/959: chown d1/d48/d102/de1/f11b 1307389 1 2024-04-20T10:55:11.333 INFO:tasks.workunit.client.1.smithi175.stdout:2/960: creat d1/d48/d21/d9c/f150 x:0 0 0 2024-04-20T10:55:11.334 INFO:tasks.workunit.client.1.smithi175.stdout:2/961: creat d1/d6a/d74/dc7/f151 x:0 0 0 2024-04-20T10:55:11.336 INFO:tasks.workunit.client.1.smithi175.stdout:2/962: rename d1/d7/d63/d36/d7d/fbb to d1/d6a/d74/dc7/d14d/f152 0 2024-04-20T10:55:11.338 INFO:tasks.workunit.client.1.smithi175.stdout:2/963: rename d1/d48/d21/d76/da8/fbc to d1/d48/d21/d9c/f153 0 2024-04-20T10:55:11.354 INFO:tasks.workunit.client.1.smithi175.stdout:2/964: dwrite d1/d6a/d74/dc7/fdb [0,4194304] 0 2024-04-20T10:55:11.365 INFO:tasks.workunit.client.1.smithi175.stdout:2/965: dread d1/d7/d63/d4b/d8a/dd9/ff3 [0,4194304] 0 2024-04-20T10:55:11.365 INFO:tasks.workunit.client.1.smithi175.stdout:2/966: fdatasync d1/d48/d21/d9c/fec 0 2024-04-20T10:55:11.365 INFO:tasks.workunit.client.1.smithi175.stdout:2/967: fdatasync d1/d6a/d74/dc7/d14d/f146 0 2024-04-20T10:55:11.366 INFO:tasks.workunit.client.1.smithi175.stdout:2/968: dread d1/d48/f109 [0,4194304] 0 2024-04-20T10:55:11.394 INFO:tasks.workunit.client.1.smithi175.stdout:2/969: dwrite d1/d7/d63/d4b/d8a/dd9/d108/de0/fe7 [0,4194304] 0 2024-04-20T10:55:11.394 INFO:tasks.workunit.client.1.smithi175.stdout:2/970: chown d1/d48/d21/d9c/df8/l12f 0 1 2024-04-20T10:55:11.394 INFO:tasks.workunit.client.1.smithi175.stdout:2/971: chown d1/d48/d102/fa4 27808084 1 2024-04-20T10:55:11.395 INFO:tasks.workunit.client.1.smithi175.stdout:2/972: unlink d1/d48/d21/db6/ffd 0 2024-04-20T10:55:11.404 INFO:tasks.workunit.client.1.smithi175.stdout:9/928: mknod d6/d1b/d26/d8c/dc6/d122/d5b/d72/d7d/c123 0 2024-04-20T10:55:11.410 INFO:tasks.workunit.client.1.smithi175.stdout:2/973: dwrite d1/d48/d21/d76/f11d [0,4194304] 0 2024-04-20T10:55:11.411 INFO:tasks.workunit.client.1.smithi175.stdout:0/944: creat df/d1a/f13b x:0 0 0 2024-04-20T10:55:11.414 INFO:tasks.workunit.client.1.smithi175.stdout:2/974: rename d1/d48/d21/d9c/df8/l12f to d1/d48/d102/l154 0 2024-04-20T10:55:11.414 INFO:tasks.workunit.client.1.smithi175.stdout:2/975: read d1/d7/d63/d36/d7d/d80/ff1 [536881,81233] 0 2024-04-20T10:55:11.414 INFO:tasks.workunit.client.1.smithi175.stdout:0/945: rmdir df/d1a 39 2024-04-20T10:55:11.414 INFO:tasks.workunit.client.1.smithi175.stdout:0/946: fdatasync df/d1a/d3f/d5e/f93 0 2024-04-20T10:55:11.414 INFO:tasks.workunit.client.1.smithi175.stdout:0/947: dread - df/d1a/d3f/d5e/f12b zero size 2024-04-20T10:55:11.416 INFO:tasks.workunit.client.1.smithi175.stdout:2/976: rename d1/d48/d102/df6/c14c to d1/d48/d21/d9c/df8/c155 0 2024-04-20T10:55:11.416 INFO:tasks.workunit.client.1.smithi175.stdout:2/977: chown d1/d7/d63/d36/ce6 1559 1 2024-04-20T10:55:11.416 INFO:tasks.workunit.client.1.smithi175.stdout:0/948: rmdir df/d17/dc0/dfc 39 2024-04-20T10:55:11.416 INFO:tasks.workunit.client.1.smithi175.stdout:0/949: chown df 791 1 2024-04-20T10:55:11.417 INFO:tasks.workunit.client.1.smithi175.stdout:9/929: dwrite d6/d58/f68 [4194304,4194304] 0 2024-04-20T10:55:11.418 INFO:tasks.workunit.client.1.smithi175.stdout:9/930: chown d6/d1b/c67 168600 1 2024-04-20T10:55:11.418 INFO:tasks.workunit.client.1.smithi175.stdout:9/931: fdatasync d6/d1b/f24 0 2024-04-20T10:55:11.418 INFO:tasks.workunit.client.1.smithi175.stdout:2/978: mkdir d1/d7/d63/d156 0 2024-04-20T10:55:11.419 INFO:tasks.workunit.client.1.smithi175.stdout:0/950: dread df/d1a/d22/d6a/d72/d48/d4e/fae [0,4194304] 0 2024-04-20T10:55:11.421 INFO:tasks.workunit.client.1.smithi175.stdout:2/979: symlink d1/d7/d63/dee/l157 0 2024-04-20T10:55:11.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.436+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb3741517f0 con 0x7fb374153ef0 2024-04-20T10:55:11.436 INFO:tasks.workunit.client.1.smithi175.stdout:0/951: dwrite df/d17/dc0/dfc/d4f/fc1 [0,4194304] 0 2024-04-20T10:55:11.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.436+0000 7fb36a7fc640 1 -- 172.21.15.90:0/223703589 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7fb36c0595b0 con 0x7fb374153ef0 2024-04-20T10:55:11.437 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:11.437 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:11.437 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:11.438 INFO:tasks.workunit.client.1.smithi175.stdout:0/952: symlink df/d1a/d22/d24/d133/l13c 0 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb35806c8f0 msgr2=0x7fb35806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb35806c8f0 0x7fb35806edb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb370006fd0 tx=0x7fb370008040 comp rx=0 tx=0).stop 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb374153ef0 msgr2=0x7fb3741efd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb374153ef0 0x7fb3741efd10 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb36c00b970 tx=0x7fb36c00be30 comp rx=0 tx=0).stop 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 shutdown_connections 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb35806c8f0 0x7fb35806edb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb374153ef0 0x7fb3741efd10 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3740c9ee0 0x7fb3741ef7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 --2- 172.21.15.90:0/223703589 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3740ab730 0x7fb3740c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.438+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 >> 172.21.15.90:0/223703589 conn(0x7fb3740cbfe0 msgr2=0x7fb374157150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.439+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 shutdown_connections 2024-04-20T10:55:11.439 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.439+0000 7fb37bc7a640 1 -- 172.21.15.90:0/223703589 wait complete. 2024-04-20T10:55:11.449 INFO:tasks.mds_thrash.fs.[a]:kill mds.c (rank=0) 2024-04-20T10:55:11.450 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-20T10:55:11.450 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:55:11.451 INFO:tasks.workunit.client.1.smithi175.stdout:0/953: dwrite df/d1a/d28/d104/d10c/f134 [0,4194304] 0 2024-04-20T10:55:11.451 INFO:tasks.workunit.client.1.smithi175.stdout:0/954: readlink df/d17/lc8 0 2024-04-20T10:55:11.453 INFO:tasks.workunit.client.1.smithi175.stdout:0/955: rename df/fcf to df/d2e/d107/f13d 0 2024-04-20T10:55:11.453 INFO:tasks.workunit.client.1.smithi175.stdout:0/956: readlink df/d19/de0/dea/l100 0 2024-04-20T10:55:11.464 INFO:tasks.ceph.mds.c:Stopped 2024-04-20T10:55:11.465 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:11.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.603+0000 7ff817026640 1 Processor -- start 2024-04-20T10:55:11.603 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.603+0000 7ff817026640 1 -- start start 2024-04-20T10:55:11.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff817026640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff810154000 0x7ff8100abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff817026640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8100c4370 con 0x7ff810157710 2024-04-20T10:55:11.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff817026640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff810156c30 con 0x7ff810073810 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff817026640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff8101569e0 con 0x7ff810154000 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff8155c3640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff810154000 0x7ff8100abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff80ffff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff810157710 0x7ff8100ad0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:60066/0 (socket says 172.21.15.90:60066) 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff80ffff640 1 -- 172.21.15.90:0/3743675957 learned_addr learned my addr 172.21.15.90:0/3743675957 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff8155c3640 1 -- 172.21.15.90:0/3743675957 >> v1:172.21.15.175:6789/0 conn(0x7ff810073810 legacy=0x7ff8100c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff8155c3640 1 -- 172.21.15.90:0/3743675957 >> v1:172.21.15.90:6789/0 conn(0x7ff810157710 legacy=0x7ff8100ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff8155c3640 1 -- 172.21.15.90:0/3743675957 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff810156f10 con 0x7ff810154000 2024-04-20T10:55:11.605 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.604+0000 7ff80f7fe640 1 -- 172.21.15.90:0/3743675957 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2904315700 0 0) 0x7ff8100c4370 con 0x7ff810157710 2024-04-20T10:55:11.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff8155c3640 1 --2- 172.21.15.90:0/3743675957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff8100abbb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff808009d90 tx=0x7ff80802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4131df955e01c86 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff80f7fe640 1 -- 172.21.15.90:0/3743675957 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808039070 con 0x7ff810154000 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff80f7fe640 1 -- 172.21.15.90:0/3743675957 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80802cc60 con 0x7ff810154000 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff80f7fe640 1 -- 172.21.15.90:0/3743675957 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808034660 con 0x7ff810154000 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff817026640 1 -- 172.21.15.90:0/3743675957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 msgr2=0x7ff8100abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff817026640 1 --2- 172.21.15.90:0/3743675957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff8100abbb0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ff808009d90 tx=0x7ff80802beb0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff817026640 1 -- 172.21.15.90:0/3743675957 shutdown_connections 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff817026640 1 --2- 172.21.15.90:0/3743675957 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff8100abbb0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff817026640 1 -- 172.21.15.90:0/3743675957 >> 172.21.15.90:0/3743675957 conn(0x7ff8100c8080 msgr2=0x7ff8100c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff817026640 1 -- 172.21.15.90:0/3743675957 shutdown_connections 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.605+0000 7ff817026640 1 -- 172.21.15.90:0/3743675957 wait complete. 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.606+0000 7ff817026640 1 Processor -- start 2024-04-20T10:55:11.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff817026640 1 -- start start 2024-04-20T10:55:11.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff817026640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff810073810 0x7ff81014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff817026640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff810144260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff817026640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff810157710 0x7ff8101447a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff817026640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff8100ad7d0 con 0x7ff810154000 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff817026640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff810157280 con 0x7ff810073810 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff817026640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff8100ad950 con 0x7ff810157710 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff80ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff810144260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff80ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff810144260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35656/0 (socket says 172.21.15.90:35656) 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff80ffff640 1 -- 172.21.15.90:0/1418118898 learned_addr learned my addr 172.21.15.90:0/1418118898 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.607+0000 7ff814dc2640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff810073810 0x7ff81014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff8155c3640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff810157710 0x7ff8101447a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80ffff640 1 -- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff810157710 msgr2=0x7ff8101447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80ffff640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff810157710 0x7ff8101447a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80ffff640 1 -- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff810073810 msgr2=0x7ff81014f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80ffff640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff810073810 0x7ff81014f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80ffff640 1 -- 172.21.15.90:0/1418118898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81014d9e0 con 0x7ff810154000 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80ffff640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff810144260 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00c390 tx=0x7ff7fc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:11.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80d7fa640 1 -- 172.21.15.90:0/1418118898 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc0074e0 con 0x7ff810154000 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80d7fa640 1 -- 172.21.15.90:0/1418118898 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7fc0047e0 con 0x7ff810154000 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff810154910 con 0x7ff810154000 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff80d7fa640 1 -- 172.21.15.90:0/1418118898 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7fc004bd0 con 0x7ff810154000 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.608+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81014fdb0 con 0x7ff810154000 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.609+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff810076150 con 0x7ff810154000 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.609+0000 7ff80d7fa640 1 -- 172.21.15.90:0/1418118898 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff7fc011070 con 0x7ff810154000 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.610+0000 7ff80d7fa640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff7f406c8f0 0x7ff7f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:11.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.610+0000 7ff80d7fa640 1 -- 172.21.15.90:0/1418118898 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7ff7fc08bac0 con 0x7ff810154000 2024-04-20T10:55:11.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.610+0000 7ff814dc2640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff7f406c8f0 0x7ff7f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:11.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.610+0000 7ff814dc2640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff7f406c8f0 0x7ff7f406edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff804000f60 tx=0x7ff804009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:11.614 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.614+0000 7ff80d7fa640 1 -- 172.21.15.90:0/1418118898 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff7fc0593e0 con 0x7ff810154000 2024-04-20T10:55:11.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.832+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff81014d730 con 0x7ff810154000 2024-04-20T10:55:11.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.832+0000 7ff80d7fa640 1 -- 172.21.15.90:0/1418118898 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7ff7fc05d6e0 con 0x7ff810154000 2024-04-20T10:55:11.833 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:11.833 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:11.833 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.834+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff7f406c8f0 msgr2=0x7ff7f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.834+0000 7ff817026640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff7f406c8f0 0x7ff7f406edb0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff804000f60 tx=0x7ff804009040 comp rx=0 tx=0).stop 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.834+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 msgr2=0x7ff810144260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.834+0000 7ff817026640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff810144260 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc00c390 tx=0x7ff7fc00c850 comp rx=0 tx=0).stop 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 shutdown_connections 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff7f406c8f0 0x7ff7f406edb0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff810157710 0x7ff8101447a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff810154000 0x7ff810144260 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.835 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 --2- 172.21.15.90:0/1418118898 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff810073810 0x7ff81014f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:11.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 >> 172.21.15.90:0/1418118898 conn(0x7ff8100c8080 msgr2=0x7ff8100ab3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:11.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 shutdown_connections 2024-04-20T10:55:11.836 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:11.835+0000 7ff817026640 1 -- 172.21.15.90:0/1418118898 wait complete. 2024-04-20T10:55:11.846 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:3/821: sync 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:9/932: sync 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:8/961: sync 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:0/957: sync 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:9/933: readlink d6/dcb/dce/df6/lf9 0 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:2/980: sync 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:8/962: truncate d7/d13/d1d/d24/d26/dcb/d113/f117 172116 0 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:8/963: readlink d7/d13/d1d/d24/d38/db6/l126 0 2024-04-20T10:55:12.177 INFO:tasks.workunit.client.1.smithi175.stdout:0/958: write df/d1a/d22/fd7 [1361894,60269] 0 2024-04-20T10:55:12.178 INFO:tasks.workunit.client.1.smithi175.stdout:3/822: creat d7/d21/d16/d49/dc5/ffc x:0 0 0 2024-04-20T10:55:12.178 INFO:tasks.workunit.client.1.smithi175.stdout:3/823: getdents d7/d19 0 2024-04-20T10:55:12.179 INFO:tasks.workunit.client.1.smithi175.stdout:3/824: getdents d7/d21 0 2024-04-20T10:55:12.181 INFO:tasks.workunit.client.1.smithi175.stdout:3/825: creat d7/d19/da2/ffd x:0 0 0 2024-04-20T10:55:12.181 INFO:tasks.workunit.client.1.smithi175.stdout:3/826: readlink d7/d19/d33/d7e/d86/d7d/dcb/d50/la4 0 2024-04-20T10:55:12.182 INFO:tasks.workunit.client.1.smithi175.stdout:3/827: truncate d7/d21/d16/d22/f66 3083901 0 2024-04-20T10:55:12.190 INFO:tasks.workunit.client.1.smithi175.stdout:3/828: dread d7/d21/d16/d22/df8/f3c [4194304,4194304] 0 2024-04-20T10:55:12.190 INFO:tasks.workunit.client.1.smithi175.stdout:3/829: chown d7/d19/c1d 25182 1 2024-04-20T10:55:12.191 INFO:tasks.workunit.client.1.smithi175.stdout:2/981: write d1/d48/f27 [1106584,64491] 0 2024-04-20T10:55:12.193 INFO:tasks.workunit.client.1.smithi175.stdout:2/982: truncate d1/d7/f22 651879 0 2024-04-20T10:55:12.195 INFO:tasks.workunit.client.1.smithi175.stdout:9/934: dread d6/d58/f68 [0,4194304] 0 2024-04-20T10:55:12.195 INFO:tasks.workunit.client.1.smithi175.stdout:9/935: chown d6/f4c 3535954 1 2024-04-20T10:55:12.198 INFO:tasks.workunit.client.1.smithi175.stdout:8/964: dwrite d7/d13/d1d/d24/d38/fbe [0,4194304] 0 2024-04-20T10:55:12.202 INFO:tasks.workunit.client.1.smithi175.stdout:8/965: truncate d7/d13/d1d/d24/f5d 3536424 0 2024-04-20T10:55:12.205 INFO:tasks.workunit.client.1.smithi175.stdout:9/936: dread d6/d1b/d26/d8c/dc6/d122/d5b/f9c [0,4194304] 0 2024-04-20T10:55:12.215 INFO:tasks.workunit.client.1.smithi175.stdout:2/983: dwrite d1/d7/d63/d36/d7d/d84/d8b/d101/f73 [0,4194304] 0 2024-04-20T10:55:12.216 INFO:tasks.workunit.client.1.smithi175.stdout:3/830: dwrite d7/d21/d16/d22/f52 [0,4194304] 0 2024-04-20T10:55:12.216 INFO:tasks.workunit.client.1.smithi175.stdout:9/937: dread d6/d1b/d2f/f45 [0,4194304] 0 2024-04-20T10:55:12.218 INFO:tasks.workunit.client.1.smithi175.stdout:2/984: dread d1/d7/d63/dee/f10b [0,4194304] 0 2024-04-20T10:55:12.218 INFO:tasks.workunit.client.1.smithi175.stdout:9/938: dread d6/d1b/f47 [0,4194304] 0 2024-04-20T10:55:12.219 INFO:tasks.workunit.client.1.smithi175.stdout:3/831: mkdir d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/df6/dfe 0 2024-04-20T10:55:12.219 INFO:tasks.workunit.client.1.smithi175.stdout:2/985: truncate d1/f33 498290 0 2024-04-20T10:55:12.220 INFO:tasks.workunit.client.1.smithi175.stdout:8/966: write d7/d13/d1d/d24/d39/d6f/f61 [455226,54045] 0 2024-04-20T10:55:12.220 INFO:tasks.workunit.client.1.smithi175.stdout:9/939: creat d6/d58/d90/daa/dbd/f124 x:0 0 0 2024-04-20T10:55:12.221 INFO:tasks.workunit.client.1.smithi175.stdout:3/832: creat d7/d19/d33/ddd/fff x:0 0 0 2024-04-20T10:55:12.222 INFO:tasks.workunit.client.1.smithi175.stdout:2/986: symlink d1/d48/d21/d9c/df8/l158 0 2024-04-20T10:55:12.224 INFO:tasks.workunit.client.1.smithi175.stdout:8/967: creat d7/d13/d1d/d24/d38/d73/db5/f136 x:0 0 0 2024-04-20T10:55:12.224 INFO:tasks.workunit.client.1.smithi175.stdout:8/968: write d7/d13/d1d/d24/d38/d73/fa6 [4319713,101703] 0 2024-04-20T10:55:12.226 INFO:tasks.workunit.client.1.smithi175.stdout:3/833: truncate d7/d10/d8c/fb0 412681 0 2024-04-20T10:55:12.226 INFO:tasks.workunit.client.1.smithi175.stdout:9/940: dread d6/d33/f5c [0,4194304] 0 2024-04-20T10:55:12.227 INFO:tasks.workunit.client.1.smithi175.stdout:2/987: mkdir d1/d6a/d120/d159 0 2024-04-20T10:55:12.227 INFO:tasks.workunit.client.1.smithi175.stdout:2/988: chown d1/d7/d63/d36/d7d/d84/d8b/d101/f73 34270569 1 2024-04-20T10:55:12.227 INFO:tasks.workunit.client.1.smithi175.stdout:2/989: write d1/d7/d63/dee/f142 [800443,73282] 0 2024-04-20T10:55:12.227 INFO:tasks.workunit.client.1.smithi175.stdout:2/990: readlink d1/d48/l35 0 2024-04-20T10:55:12.227 INFO:tasks.workunit.client.1.smithi175.stdout:3/834: creat d7/d21/d16/d22/df8/d1f/d48/f100 x:0 0 0 2024-04-20T10:55:12.228 INFO:tasks.workunit.client.1.smithi175.stdout:9/941: getdents d6/d1b/d26/d8c/dc6/d122/d51 0 2024-04-20T10:55:12.228 INFO:tasks.workunit.client.1.smithi175.stdout:9/942: chown d6/d1b/d26/d8c/dc6/d122/d51/dca/ded 18 1 2024-04-20T10:55:12.229 INFO:tasks.workunit.client.1.smithi175.stdout:2/991: creat d1/d6a/d74/dc7/d14d/f15a x:0 0 0 2024-04-20T10:55:12.230 INFO:tasks.workunit.client.1.smithi175.stdout:3/835: rename d7/d19/c1d to d7/d19/d33/d7e/d86/db9/c101 0 2024-04-20T10:55:12.235 INFO:tasks.workunit.client.1.smithi175.stdout:8/969: write d7/d13/d1d/f100 [3262112,72883] 0 2024-04-20T10:55:12.235 INFO:tasks.workunit.client.1.smithi175.stdout:8/970: write d7/d13/d1d/f1e [1938227,104484] 0 2024-04-20T10:55:12.235 INFO:tasks.workunit.client.1.smithi175.stdout:9/943: dread d6/f39 [0,4194304] 0 2024-04-20T10:55:12.236 INFO:tasks.workunit.client.1.smithi175.stdout:8/971: dread d7/d13/d1d/d24/d39/d6f/db7/dce/dfc/f115 [0,4194304] 0 2024-04-20T10:55:12.236 INFO:tasks.workunit.client.1.smithi175.stdout:8/972: write d7/d13/da3/f131 [3066820,17367] 0 2024-04-20T10:55:12.255 INFO:tasks.workunit.client.1.smithi175.stdout:9/944: dwrite d6/d1b/d2f/f38 [0,4194304] 0 2024-04-20T10:55:12.261 INFO:tasks.workunit.client.1.smithi175.stdout:9/945: read d6/d1b/d2f/f38 [4399294,51961] 0 2024-04-20T10:55:12.278 INFO:tasks.workunit.client.1.smithi175.stdout:9/946: dwrite d6/d1b/f24 [4194304,4194304] 0 2024-04-20T10:55:12.484 INFO:tasks.workunit.client.1.smithi175.stdout:3/836: mkdir d7/d19/d33/d7e/da5/d102 0 2024-04-20T10:55:12.484 INFO:tasks.workunit.client.1.smithi175.stdout:2/992: mkdir d1/d7/d63/d4b/d8a/dd9/d108/d15b 0 2024-04-20T10:55:12.485 INFO:tasks.workunit.client.1.smithi175.stdout:8/973: creat d7/d13/d1d/d24/d39/d85/f137 x:0 0 0 2024-04-20T10:55:12.485 INFO:tasks.workunit.client.1.smithi175.stdout:8/974: truncate d7/d13/d1d/d24/d38/f57 1187297 0 2024-04-20T10:55:12.487 INFO:tasks.workunit.client.1.smithi175.stdout:9/947: creat d6/d33/de7/f125 x:0 0 0 2024-04-20T10:55:12.488 INFO:tasks.workunit.client.1.smithi175.stdout:3/837: dread d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/fab [0,4194304] 0 2024-04-20T10:55:12.488 INFO:tasks.workunit.client.1.smithi175.stdout:3/838: write d7/d10/f4a [307210,19290] 0 2024-04-20T10:55:12.490 INFO:tasks.workunit.client.1.smithi175.stdout:2/993: mknod d1/d7/d63/d36/d7d/d84/d8b/d145/c15c 0 2024-04-20T10:55:12.490 INFO:tasks.workunit.client.1.smithi175.stdout:2/994: stat d1/d48/d21/d9c/df8/l158 0 2024-04-20T10:55:12.490 INFO:tasks.workunit.client.1.smithi175.stdout:8/975: creat d7/d13/d1d/d24/d26/f138 x:0 0 0 2024-04-20T10:55:12.491 INFO:tasks.workunit.client.1.smithi175.stdout:2/995: unlink d1/d48/d21/d76/c83 0 2024-04-20T10:55:12.493 INFO:tasks.workunit.client.1.smithi175.stdout:8/976: unlink d7/d13/d1d/d92/lb1 0 2024-04-20T10:55:12.495 INFO:tasks.workunit.client.1.smithi175.stdout:2/996: rmdir d1/d7/d63/d156 0 2024-04-20T10:55:12.495 INFO:tasks.workunit.client.1.smithi175.stdout:3/839: dread d7/d21/d16/d22/f66 [0,4194304] 0 2024-04-20T10:55:12.496 INFO:tasks.workunit.client.1.smithi175.stdout:8/977: truncate d7/d13/d1d/d92/d6c/fd8 343122 0 2024-04-20T10:55:12.497 INFO:tasks.workunit.client.1.smithi175.stdout:3/840: creat d7/d10/d8c/f103 x:0 0 0 2024-04-20T10:55:12.500 INFO:tasks.workunit.client.1.smithi175.stdout:8/978: unlink d7/d13/d1d/d24/d26/f51 0 2024-04-20T10:55:12.501 INFO:tasks.workunit.client.1.smithi175.stdout:3/841: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/f104 x:0 0 0 2024-04-20T10:55:12.506 INFO:tasks.workunit.client.1.smithi175.stdout:9/948: dwrite d6/d1b/f24 [0,4194304] 0 2024-04-20T10:55:12.507 INFO:tasks.workunit.client.1.smithi175.stdout:0/959: sync 2024-04-20T10:55:12.507 INFO:tasks.workunit.client.1.smithi175.stdout:0/960: write df/d1a/d22/f11b [451838,10117] 0 2024-04-20T10:55:12.508 INFO:tasks.workunit.client.1.smithi175.stdout:9/949: symlink d6/d58/d90/daa/l126 0 2024-04-20T10:55:12.509 INFO:tasks.workunit.client.1.smithi175.stdout:9/950: mknod d6/d33/d63/dff/d81/dd0/c127 0 2024-04-20T10:55:12.510 INFO:tasks.workunit.client.1.smithi175.stdout:0/961: mkdir df/d1a/d22/d6a/d72/d48/d13e 0 2024-04-20T10:55:12.512 INFO:tasks.workunit.client.1.smithi175.stdout:9/951: mknod d6/c128 0 2024-04-20T10:55:12.514 INFO:tasks.workunit.client.1.smithi175.stdout:9/952: creat d6/d1b/d26/d8c/dc6/d122/d5b/d72/d9e/f129 x:0 0 0 2024-04-20T10:55:12.515 INFO:tasks.workunit.client.1.smithi175.stdout:0/962: dread df/d19/f3b [0,4194304] 0 2024-04-20T10:55:12.516 INFO:tasks.workunit.client.1.smithi175.stdout:9/953: mknod d6/d1b/d26/d8c/dc6/d122/d5b/c12a 0 2024-04-20T10:55:12.516 INFO:tasks.workunit.client.1.smithi175.stdout:9/954: fsync d6/f4c 0 2024-04-20T10:55:12.519 INFO:tasks.workunit.client.1.smithi175.stdout:0/963: dread df/d1a/d3f/fd1 [0,4194304] 0 2024-04-20T10:55:12.520 INFO:tasks.workunit.client.1.smithi175.stdout:2/997: dwrite d1/d7/d63/d36/d7d/f8e [0,4194304] 0 2024-04-20T10:55:12.520 INFO:tasks.workunit.client.1.smithi175.stdout:2/998: write d1/d48/d102/de1/f11b [1863414,79797] 0 2024-04-20T10:55:12.521 INFO:tasks.workunit.client.1.smithi175.stdout:2/999: fsync d1/ffb 0 2024-04-20T10:55:12.521 INFO:tasks.workunit.client.1.smithi175.stdout:0/964: creat df/d1a/d28/d104/d10c/f13f x:0 0 0 2024-04-20T10:55:12.521 INFO:tasks.workunit.client.1.smithi175.stdout:0/965: chown df/d19/l50 516846940 1 2024-04-20T10:55:12.522 INFO:tasks.workunit.client.1.smithi175.stdout:3/842: dwrite d7/d10/f42 [0,4194304] 0 2024-04-20T10:55:12.522 INFO:tasks.workunit.client.1.smithi175.stdout:0/966: mkdir df/d17/dc0/dfc/d4f/dcd/d140 0 2024-04-20T10:55:12.522 INFO:tasks.workunit.client.1.smithi175.stdout:8/979: dwrite d7/d13/d1d/d24/d38/f89 [0,4194304] 0 2024-04-20T10:55:12.523 INFO:tasks.workunit.client.1.smithi175.stdout:8/980: dread - d7/d13/d1d/d24/d39/d6f/db7/dbc/fef zero size 2024-04-20T10:55:12.525 INFO:tasks.workunit.client.1.smithi175.stdout:9/955: read d6/d1b/d26/d8c/dc6/d122/d51/de6/f10a [1188373,81202] 0 2024-04-20T10:55:12.526 INFO:tasks.workunit.client.1.smithi175.stdout:9/956: write d6/dcb/dce/ff2 [1705796,49849] 0 2024-04-20T10:55:12.532 INFO:tasks.workunit.client.1.smithi175.stdout:8/981: write d7/d13/d1d/f47 [2118662,29922] 0 2024-04-20T10:55:12.544 INFO:tasks.workunit.client.1.smithi175.stdout:3/843: dwrite d7/d21/d16/d49/d54/fcf [0,4194304] 0 2024-04-20T10:55:12.548 INFO:tasks.workunit.client.1.smithi175.stdout:3/844: read d7/d21/d16/d22/f66 [2130630,116263] 0 2024-04-20T10:55:12.783 INFO:tasks.workunit.client.1.smithi175.stdout:8/982: mknod d7/d13/d1d/d24/d38/d80/c139 0 2024-04-20T10:55:12.783 INFO:tasks.workunit.client.1.smithi175.stdout:8/983: dread - d7/d13/d1d/d24/d39/d6f/f8b zero size 2024-04-20T10:55:12.784 INFO:tasks.workunit.client.1.smithi175.stdout:8/984: write d7/d13/d1d/d24/d26/dcb/d113/f117 [253396,32666] 0 2024-04-20T10:55:12.784 INFO:tasks.workunit.client.1.smithi175.stdout:8/985: read - d7/d13/d1d/d24/d39/d6f/f8b zero size 2024-04-20T10:55:12.784 INFO:tasks.workunit.client.1.smithi175.stdout:8/986: chown d7/d13/d1d/d24/d38/db6/d10a 22926714 1 2024-04-20T10:55:12.786 INFO:tasks.workunit.client.1.smithi175.stdout:3/845: rename d7/d21/d16/d22/df8/d1f/d48 to d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/d105 0 2024-04-20T10:55:12.787 INFO:tasks.workunit.client.1.smithi175.stdout:0/967: mknod df/d1a/d22/d6a/d72/d48/d4e/c141 0 2024-04-20T10:55:12.788 INFO:tasks.workunit.client.1.smithi175.stdout:9/957: symlink d6/d1b/d2f/l12b 0 2024-04-20T10:55:12.788 INFO:tasks.workunit.client.1.smithi175.stdout:9/958: chown d6/d1b 27526753 1 2024-04-20T10:55:12.790 INFO:tasks.workunit.client.1.smithi175.stdout:8/987: rmdir d7/d13/d1d/d24/d39/d6f/db7 39 2024-04-20T10:55:12.792 INFO:tasks.workunit.client.1.smithi175.stdout:3/846: unlink d7/d19/d33/d7e/cf7 0 2024-04-20T10:55:12.796 INFO:tasks.workunit.client.1.smithi175.stdout:0/968: symlink df/d1a/d22/d6a/d72/d48/d4e/l142 0 2024-04-20T10:55:12.799 INFO:tasks.workunit.client.1.smithi175.stdout:8/988: link d7/d13/d1d/d24/l65 d7/d13/d1d/d24/d38/d80/l13a 0 2024-04-20T10:55:12.799 INFO:tasks.workunit.client.1.smithi175.stdout:8/989: fsync d7/d13/d1d/d24/d38/d73/d10b/d122/f130 0 2024-04-20T10:55:12.799 INFO:tasks.workunit.client.1.smithi175.stdout:8/990: truncate d7/d13/d1d/ff2 1174418 0 2024-04-20T10:55:12.802 INFO:tasks.workunit.client.1.smithi175.stdout:0/969: creat df/d19/de0/dfb/f143 x:0 0 0 2024-04-20T10:55:12.804 INFO:tasks.workunit.client.1.smithi175.stdout:0/970: fsync df/d1a/d22/f11b 0 2024-04-20T10:55:12.806 INFO:tasks.workunit.client.1.smithi175.stdout:3/847: write d7/d21/d16/d49/de1/fbb [94436,68125] 0 2024-04-20T10:55:12.808 INFO:tasks.workunit.client.1.smithi175.stdout:9/959: dwrite d6/d58/fd4 [0,4194304] 0 2024-04-20T10:55:12.820 INFO:tasks.workunit.client.1.smithi175.stdout:9/960: symlink d6/l12c 0 2024-04-20T10:55:12.837 INFO:tasks.workunit.client.1.smithi175.stdout:3/848: dwrite d7/d10/d8c/f8e [0,4194304] 0 2024-04-20T10:55:12.838 INFO:tasks.workunit.client.1.smithi175.stdout:3/849: dread d7/f51 [0,4194304] 0 2024-04-20T10:55:12.840 INFO:tasks.workunit.client.1.smithi175.stdout:9/961: mknod d6/d1b/d26/d8c/dc6/c12d 0 2024-04-20T10:55:12.840 INFO:tasks.workunit.client.1.smithi175.stdout:9/962: stat d6/d58/d90/daa/dbd/f115 0 2024-04-20T10:55:12.840 INFO:tasks.workunit.client.1.smithi175.stdout:9/963: fdatasync d6/d1b/d26/d8c/f117 0 2024-04-20T10:55:12.840 INFO:tasks.workunit.client.1.smithi175.stdout:8/991: dwrite d7/f19 [0,4194304] 0 2024-04-20T10:55:12.840 INFO:tasks.workunit.client.1.smithi175.stdout:8/992: write d7/d13/d1d/d24/d39/d85/f135 [324557,115974] 0 2024-04-20T10:55:12.860 INFO:tasks.workunit.client.1.smithi175.stdout:9/964: dwrite d6/d58/f68 [0,4194304] 0 2024-04-20T10:55:13.092 INFO:tasks.workunit.client.1.smithi175.stdout:3/850: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/f106 x:0 0 0 2024-04-20T10:55:13.093 INFO:tasks.workunit.client.1.smithi175.stdout:8/993: truncate d7/d13/d1d/d24/d39/d6f/fa7 46761 0 2024-04-20T10:55:13.094 INFO:tasks.workunit.client.1.smithi175.stdout:9/965: link d6/d1b/d2f/l66 d6/d1b/d26/d8c/dc6/d122/d51/dca/l12e 0 2024-04-20T10:55:13.094 INFO:tasks.workunit.client.1.smithi175.stdout:9/966: chown d6/d33/d63/dff/lb4 19 1 2024-04-20T10:55:13.095 INFO:tasks.workunit.client.1.smithi175.stdout:3/851: getdents d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0 0 2024-04-20T10:55:13.099 INFO:tasks.workunit.client.1.smithi175.stdout:3/852: unlink d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/d105/f78 0 2024-04-20T10:55:13.100 INFO:tasks.workunit.client.1.smithi175.stdout:8/994: symlink d7/d13/d1d/d24/dfd/l13b 0 2024-04-20T10:55:13.100 INFO:tasks.workunit.client.1.smithi175.stdout:9/967: write d6/d1b/d26/d8c/dc6/d122/d5b/d72/d9e/fbe [610757,52050] 0 2024-04-20T10:55:13.101 INFO:tasks.workunit.client.1.smithi175.stdout:0/971: sync 2024-04-20T10:55:13.111 INFO:tasks.workunit.client.1.smithi175.stdout:0/972: dread df/d17/dc0/dfc/d4f/f57 [0,4194304] 0 2024-04-20T10:55:13.119 INFO:tasks.workunit.client.1.smithi175.stdout:8/995: dwrite d7/d13/d1d/d24/d38/d73/fc8 [0,4194304] 0 2024-04-20T10:55:13.120 INFO:tasks.workunit.client.1.smithi175.stdout:9/968: dwrite d6/d1b/f7a [0,4194304] 0 2024-04-20T10:55:13.120 INFO:tasks.workunit.client.1.smithi175.stdout:0/973: dread df/d19/fa5 [0,4194304] 0 2024-04-20T10:55:13.121 INFO:tasks.workunit.client.1.smithi175.stdout:8/996: creat d7/d13/d1d/d24/d38/d73/db5/f13c x:0 0 0 2024-04-20T10:55:13.123 INFO:tasks.workunit.client.1.smithi175.stdout:8/997: dread d7/d13/f22 [4194304,4194304] 0 2024-04-20T10:55:13.123 INFO:tasks.workunit.client.1.smithi175.stdout:8/998: readlink d7/d13/d1d/d24/d63/ld2 0 2024-04-20T10:55:13.125 INFO:tasks.workunit.client.1.smithi175.stdout:9/969: dread d6/d58/d90/daa/dbd/f115 [0,4194304] 0 2024-04-20T10:55:13.126 INFO:tasks.workunit.client.1.smithi175.stdout:9/970: mknod d6/dcb/d105/c12f 0 2024-04-20T10:55:13.127 INFO:tasks.workunit.client.1.smithi175.stdout:9/971: rename d6/c3f to d6/d1b/c130 0 2024-04-20T10:55:13.131 INFO:tasks.workunit.client.1.smithi175.stdout:0/974: dread df/d17/f20 [0,4194304] 0 2024-04-20T10:55:13.134 INFO:tasks.workunit.client.1.smithi175.stdout:0/975: rename df/d17/dc0/dfc/l83 to df/d1a/d22/d24/l144 0 2024-04-20T10:55:13.139 INFO:tasks.workunit.client.1.smithi175.stdout:0/976: write df/d1a/d22/d6a/d72/f94 [1996524,86564] 0 2024-04-20T10:55:13.139 INFO:tasks.workunit.client.1.smithi175.stdout:0/977: dread - df/d17/dc0/dfc/f36 zero size 2024-04-20T10:55:13.140 INFO:tasks.workunit.client.1.smithi175.stdout:0/978: symlink df/d19/de0/dfb/l145 0 2024-04-20T10:55:13.142 INFO:tasks.workunit.client.1.smithi175.stdout:0/979: link df/d1a/d3f/f88 df/d1a/d22/d6a/f146 0 2024-04-20T10:55:13.142 INFO:tasks.workunit.client.1.smithi175.stdout:0/980: fsync df/d17/dc0/fc5 0 2024-04-20T10:55:13.142 INFO:tasks.workunit.client.1.smithi175.stdout:0/981: fsync df/d17/dc0/dfc/f8b 0 2024-04-20T10:55:13.213 INFO:tasks.workunit.client.1.smithi175.stdout:0/982: dwrite df/d1a/d22/d24/fc2 [0,4194304] 0 2024-04-20T10:55:13.218 INFO:tasks.workunit.client.1.smithi175.stdout:0/983: dread fe [0,4194304] 0 2024-04-20T10:55:13.219 INFO:tasks.workunit.client.1.smithi175.stdout:0/984: dread - df/d1a/f13b zero size 2024-04-20T10:55:13.219 INFO:tasks.workunit.client.1.smithi175.stdout:0/985: link df/d1a/d22/d55/da2/lb5 df/d17/l147 0 2024-04-20T10:55:13.553 INFO:tasks.workunit.client.1.smithi175.stdout:0/986: dwrite df/d19/fc6 [0,4194304] 0 2024-04-20T10:55:13.557 INFO:tasks.workunit.client.1.smithi175.stdout:3/853: sync 2024-04-20T10:55:13.557 INFO:tasks.workunit.client.1.smithi175.stdout:9/972: sync 2024-04-20T10:55:13.557 INFO:tasks.workunit.client.1.smithi175.stdout:9/973: readlink d6/d1b/l107 0 2024-04-20T10:55:13.558 INFO:tasks.workunit.client.1.smithi175.stdout:9/974: read d6/d1b/d2f/f41 [1312162,119544] 0 2024-04-20T10:55:13.559 INFO:tasks.workunit.client.1.smithi175.stdout:9/975: dread d6/d1b/d26/d8c/dc6/d122/d5b/d72/d9e/fbe [0,4194304] 0 2024-04-20T10:55:13.572 INFO:tasks.workunit.client.1.smithi175.stdout:9/976: read d6/d1b/d26/d8c/dc6/d122/d5b/d72/d7d/dcc/d78/f8e [3528967,3868] 0 2024-04-20T10:55:13.574 INFO:tasks.workunit.client.1.smithi175.stdout:3/854: dwrite d7/d21/d16/f7a [0,4194304] 0 2024-04-20T10:55:13.576 INFO:tasks.workunit.client.1.smithi175.stdout:0/987: truncate df/d1a/d22/f11b 58112 0 2024-04-20T10:55:13.589 INFO:tasks.workunit.client.1.smithi175.stdout:9/977: dwrite d6/d1b/d26/d8c/dc6/d122/d5b/d72/d9e/fbe [0,4194304] 0 2024-04-20T10:55:13.589 INFO:tasks.workunit.client.1.smithi175.stdout:9/978: write d6/d1b/d26/d8c/dc6/d122/d51/fcd [8530826,6344] 0 2024-04-20T10:55:13.589 INFO:tasks.workunit.client.1.smithi175.stdout:9/979: chown d6/d33/c84 69694442 1 2024-04-20T10:55:13.590 INFO:tasks.workunit.client.1.smithi175.stdout:0/988: unlink df/d1a/d22/d6a/d72/d48/c87 0 2024-04-20T10:55:13.592 INFO:tasks.workunit.client.1.smithi175.stdout:9/980: mkdir d6/d33/d63/dff/d81/d131 0 2024-04-20T10:55:13.592 INFO:tasks.workunit.client.1.smithi175.stdout:3/855: dwrite d7/d21/d16/d22/df8/d91/fb7 [4194304,4194304] 0 2024-04-20T10:55:13.593 INFO:tasks.workunit.client.1.smithi175.stdout:0/989: mkdir df/d17/dc0/dfc/dfa/d148 0 2024-04-20T10:55:13.594 INFO:tasks.workunit.client.1.smithi175.stdout:9/981: link d6/d58/d90/fa3 d6/d1b/d26/d8c/dc6/d122/d51/dca/f132 0 2024-04-20T10:55:13.597 INFO:tasks.workunit.client.1.smithi175.stdout:3/856: creat d7/d10/f107 x:0 0 0 2024-04-20T10:55:13.597 INFO:tasks.workunit.client.1.smithi175.stdout:3/857: write d7/d21/d16/d22/df8/fec [1147788,32565] 0 2024-04-20T10:55:13.597 INFO:tasks.workunit.client.1.smithi175.stdout:3/858: readlink d7/d21/d16/d22/df8/d1f/l9e 0 2024-04-20T10:55:13.600 INFO:tasks.workunit.client.1.smithi175.stdout:8/999: write d7/d13/d1d/d24/f2b [6420541,120934] 0 2024-04-20T10:55:13.607 INFO:tasks.workunit.client.1.smithi175.stdout:3/859: mknod d7/d19/d33/d7e/d86/db9/c108 0 2024-04-20T10:55:13.608 INFO:tasks.workunit.client.1.smithi175.stdout:0/990: dwrite df/d17/dc0/dfc/d4f/f115 [0,4194304] 0 2024-04-20T10:55:13.609 INFO:tasks.workunit.client.1.smithi175.stdout:0/991: rmdir df/d17/d71 39 2024-04-20T10:55:13.610 INFO:tasks.workunit.client.1.smithi175.stdout:0/992: symlink df/d2e/d107/l149 0 2024-04-20T10:55:13.611 INFO:tasks.workunit.client.1.smithi175.stdout:0/993: fdatasync df/d17/f8d 0 2024-04-20T10:55:13.611 INFO:tasks.workunit.client.1.smithi175.stdout:3/860: dread d7/d21/d16/d49/f63 [0,4194304] 0 2024-04-20T10:55:13.611 INFO:tasks.workunit.client.1.smithi175.stdout:3/861: truncate d7/d19/d33/d7e/d89/fd6 995205 0 2024-04-20T10:55:13.611 INFO:tasks.workunit.client.1.smithi175.stdout:0/994: creat df/d1a/d3f/f14a x:0 0 0 2024-04-20T10:55:13.613 INFO:tasks.workunit.client.1.smithi175.stdout:0/995: truncate df/d1a/d22/f79 433574 0 2024-04-20T10:55:13.615 INFO:tasks.workunit.client.1.smithi175.stdout:3/862: link d7/d21/d16/d49/cd2 d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/d105/c109 0 2024-04-20T10:55:13.618 INFO:tasks.workunit.client.1.smithi175.stdout:0/996: rename df/d1a/d28 to df/d19/d14b 0 2024-04-20T10:55:13.620 INFO:tasks.workunit.client.1.smithi175.stdout:3/863: rename d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/f104 to d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/f10a 0 2024-04-20T10:55:13.621 INFO:tasks.workunit.client.1.smithi175.stdout:3/864: stat d7/d21/d16/l32 0 2024-04-20T10:55:13.622 INFO:tasks.workunit.client.1.smithi175.stdout:3/865: mkdir d7/d21/d16/d22/df8/d1f/d10b 0 2024-04-20T10:55:13.623 INFO:tasks.workunit.client.1.smithi175.stdout:3/866: creat d7/d21/d16/d22/df8/d1f/d10b/f10c x:0 0 0 2024-04-20T10:55:13.623 INFO:tasks.workunit.client.1.smithi175.stdout:3/867: write d7/d10/d8c/fcc [389053,45191] 0 2024-04-20T10:55:13.625 INFO:tasks.workunit.client.1.smithi175.stdout:3/868: rename d7/d19/d33/d7e/d86/d7d/dcb/d50/ce6 to d7/d10/c10d 0 2024-04-20T10:55:13.625 INFO:tasks.workunit.client.1.smithi175.stdout:3/869: write d7/d21/d16/d22/df8/d1f/ff2 [749203,75672] 0 2024-04-20T10:55:13.627 INFO:tasks.workunit.client.1.smithi175.stdout:3/870: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/f10e x:0 0 0 2024-04-20T10:55:13.628 INFO:tasks.workunit.client.1.smithi175.stdout:3/871: creat d7/d21/d16/d49/de1/f10f x:0 0 0 2024-04-20T10:55:13.628 INFO:tasks.workunit.client.1.smithi175.stdout:3/872: stat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/lae 0 2024-04-20T10:55:13.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/873: mkdir d7/d21/d16/d22/d110 0 2024-04-20T10:55:13.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/874: dread - d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/d105/f100 zero size 2024-04-20T10:55:13.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/875: fdatasync d7/d21/d16/d22/f52 0 2024-04-20T10:55:13.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/876: read d7/d21/d16/d22/f66 [2744435,86572] 0 2024-04-20T10:55:13.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/877: write d7/d21/fb1 [627678,58043] 0 2024-04-20T10:55:13.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/878: dread - d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/f10a zero size 2024-04-20T10:55:13.631 INFO:tasks.workunit.client.1.smithi175.stdout:3/879: fsync d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/f73 0 2024-04-20T10:55:13.634 INFO:tasks.workunit.client.1.smithi175.stdout:0/997: dwrite df/d19/de0/dfb/dfe/f10e [0,4194304] 0 2024-04-20T10:55:13.642 INFO:tasks.workunit.client.1.smithi175.stdout:0/998: write df/d17/dc0/dfc/d4f/dcd/fd9 [1280573,64316] 0 2024-04-20T10:55:13.643 INFO:tasks.workunit.client.1.smithi175.stdout:0/999: truncate df/d19/f34 1912625 0 2024-04-20T10:55:13.646 INFO:tasks.workunit.client.1.smithi175.stdout:3/880: dwrite d7/d19/d33/ddd/fff [0,4194304] 0 2024-04-20T10:55:13.647 INFO:tasks.workunit.client.1.smithi175.stdout:3/881: creat d7/d19/d33/d7e/d86/d7d/f111 x:0 0 0 2024-04-20T10:55:13.648 INFO:tasks.workunit.client.1.smithi175.stdout:3/882: mkdir d7/d21/d16/d49/dc5/ddc/d112 0 2024-04-20T10:55:13.653 INFO:tasks.workunit.client.1.smithi175.stdout:3/883: dread d7/fd5 [4194304,4194304] 0 2024-04-20T10:55:13.670 INFO:tasks.workunit.client.1.smithi175.stdout:3/884: dwrite d7/d21/d16/d22/df8/fec [0,4194304] 0 2024-04-20T10:55:13.672 INFO:tasks.workunit.client.1.smithi175.stdout:3/885: mkdir d7/d21/d16/d49/dc5/ddc/dfa/d113 0 2024-04-20T10:55:13.688 INFO:tasks.workunit.client.1.smithi175.stdout:3/886: dwrite d7/d21/fb [0,4194304] 0 2024-04-20T10:55:13.688 INFO:tasks.workunit.client.1.smithi175.stdout:3/887: getdents d7/d21/d16/d49/dc5/ddc/dfa/d113 0 2024-04-20T10:55:13.847 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:13.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.944+0000 7f4aa3a32640 1 Processor -- start 2024-04-20T10:55:13.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.944+0000 7f4aa3a32640 1 -- start start 2024-04-20T10:55:13.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa3a32640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a9c154000 0x7f4a9c0abbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:13.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa3a32640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9c0c4370 con 0x7f4a9c157710 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa3a32640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a9c156c30 con 0x7f4a9c073810 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa3a32640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4a9c1569e0 con 0x7f4a9c154000 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa1fcf640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4a9c154000 0x7f4a9c0abbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa0fcd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4a9c157710 0x7f4a9c0ad0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:60080/0 (socket says 172.21.15.90:60080) 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa0fcd640 1 -- 172.21.15.90:0/4128700665 learned_addr learned my addr 172.21.15.90:0/4128700665 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa1fcf640 1 -- 172.21.15.90:0/4128700665 >> v1:172.21.15.175:6789/0 conn(0x7f4a9c073810 legacy=0x7f4a9c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa1fcf640 1 -- 172.21.15.90:0/4128700665 >> v1:172.21.15.90:6789/0 conn(0x7f4a9c157710 legacy=0x7f4a9c0ad0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4aa1fcf640 1 -- 172.21.15.90:0/4128700665 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c156f10 con 0x7f4a9c154000 2024-04-20T10:55:13.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.945+0000 7f4a93fff640 1 -- 172.21.15.90:0/4128700665 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1943952348 0 0) 0x7f4a9c0c4370 con 0x7f4a9c157710 2024-04-20T10:55:13.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.946+0000 7f4aa1fcf640 1 --2- 172.21.15.90:0/4128700665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c154000 0x7f4a9c0abbb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009d90 tx=0x7f4a9402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c4667e97387471f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:13.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.946+0000 7f4a93fff640 1 -- 172.21.15.90:0/4128700665 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94039070 con 0x7f4a9c154000 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.946+0000 7f4a93fff640 1 -- 172.21.15.90:0/4128700665 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9402cc60 con 0x7f4a9c154000 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.946+0000 7f4a93fff640 1 -- 172.21.15.90:0/4128700665 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94034660 con 0x7f4a9c154000 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.947+0000 7f4aa3a32640 1 -- 172.21.15.90:0/4128700665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c154000 msgr2=0x7f4a9c0abbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.947+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/4128700665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c154000 0x7f4a9c0abbb0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009d90 tx=0x7f4a9402beb0 comp rx=0 tx=0).stop 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.947+0000 7f4aa3a32640 1 -- 172.21.15.90:0/4128700665 shutdown_connections 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.947+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/4128700665 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c154000 0x7f4a9c0abbb0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.947+0000 7f4aa3a32640 1 -- 172.21.15.90:0/4128700665 >> 172.21.15.90:0/4128700665 conn(0x7f4a9c0c8080 msgr2=0x7f4a9c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.947+0000 7f4aa3a32640 1 -- 172.21.15.90:0/4128700665 shutdown_connections 2024-04-20T10:55:13.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.947+0000 7f4aa3a32640 1 -- 172.21.15.90:0/4128700665 wait complete. 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.948+0000 7f4aa3a32640 1 Processor -- start 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.948+0000 7f4aa3a32640 1 -- start start 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa3a32640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a9c073810 0x7f4a9c155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa3a32640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a9c154000 0x7f4a9c148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa3a32640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c157710 0x7f4a9c148670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa3a32640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c0ad7d0 con 0x7f4a9c157710 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa3a32640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4a9c157280 con 0x7f4a9c073810 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa3a32640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4a9c0ad950 con 0x7f4a9c154000 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c157710 0x7f4a9c148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c157710 0x7f4a9c148670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35676/0 (socket says 172.21.15.90:35676) 2024-04-20T10:55:13.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 -- 172.21.15.90:0/2055908465 learned_addr learned my addr 172.21.15.90:0/2055908465 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa17ce640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a9c073810 0x7f4a9c155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa0fcd640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a9c154000 0x7f4a9c148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 -- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a9c154000 msgr2=0x7f4a9c148130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a9c154000 0x7f4a9c148130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 -- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a9c073810 msgr2=0x7f4a9c155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a9c073810 0x7f4a9c155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 -- 172.21.15.90:0/2055908465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a9c1f07d0 con 0x7f4a9c157710 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa0fcd640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a9c154000 0x7f4a9c148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa1fcf640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c157710 0x7f4a9c148670 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009d90 tx=0x7f4a94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4a91ffb640 1 -- 172.21.15.90:0/2055908465 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94044030 con 0x7f4a9c157710 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4a91ffb640 1 -- 172.21.15.90:0/2055908465 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a9402ca60 con 0x7f4a9c157710 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a9c1edb10 con 0x7f4a9c157710 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.949+0000 7f4a91ffb640 1 -- 172.21.15.90:0/2055908465 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94039040 con 0x7f4a9c157710 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.950+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a9c148bb0 con 0x7f4a9c157710 2024-04-20T10:55:13.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.951+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a9c076150 con 0x7f4a9c157710 2024-04-20T10:55:13.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.951+0000 7f4a91ffb640 1 -- 172.21.15.90:0/2055908465 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a94047070 con 0x7f4a9c157710 2024-04-20T10:55:13.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.952+0000 7f4a91ffb640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a8006c920 0x7f4a8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:13.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.952+0000 7f4a91ffb640 1 -- 172.21.15.90:0/2055908465 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f4a940ae180 con 0x7f4a9c157710 2024-04-20T10:55:13.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.952+0000 7f4aa17ce640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a8006c920 0x7f4a8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:13.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.952+0000 7f4aa17ce640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a8006c920 0x7f4a8006ede0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4a98000f60 tx=0x7f4a98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:13.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:13.956+0000 7f4a91ffb640 1 -- 172.21.15.90:0/2055908465 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4a9407c1b0 con 0x7f4a9c157710 2024-04-20T10:55:13.976 INFO:tasks.workunit.client.1.smithi175.stdout:3/888: write d7/d21/d16/d22/df8/d1f/f5b [11388507,83283] 0 2024-04-20T10:55:14.134 INFO:tasks.workunit.client.1.smithi175.stdout:9/982: sync 2024-04-20T10:55:14.135 INFO:tasks.workunit.client.1.smithi175.stdout:9/983: creat d6/f133 x:0 0 0 2024-04-20T10:55:14.151 INFO:tasks.workunit.client.1.smithi175.stdout:9/984: dwrite d6/d33/f99 [0,4194304] 0 2024-04-20T10:55:14.153 INFO:tasks.workunit.client.1.smithi175.stdout:9/985: mknod d6/d1b/d2f/c134 0 2024-04-20T10:55:14.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.167+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4a9c0abff0 con 0x7f4a9c157710 2024-04-20T10:55:14.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.167+0000 7f4a91ffb640 1 -- 172.21.15.90:0/2055908465 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7f4a9407bab0 con 0x7f4a9c157710 2024-04-20T10:55:14.168 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:14.168 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:14.168 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a8006c920 msgr2=0x7f4a8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a8006c920 0x7f4a8006ede0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4a98000f60 tx=0x7f4a98009040 comp rx=0 tx=0).stop 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c157710 msgr2=0x7f4a9c148670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c157710 0x7f4a9c148670 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4a94009d90 tx=0x7f4a94004a40 comp rx=0 tx=0).stop 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 shutdown_connections 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4a8006c920 0x7f4a8006ede0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4a9c157710 0x7f4a9c148670 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4a9c154000 0x7f4a9c148130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:14.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 --2- 172.21.15.90:0/2055908465 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4a9c073810 0x7f4a9c155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:14.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 >> 172.21.15.90:0/2055908465 conn(0x7f4a9c0c8080 msgr2=0x7f4a9c152780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:14.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 shutdown_connections 2024-04-20T10:55:14.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:14.169+0000 7f4aa3a32640 1 -- 172.21.15.90:0/2055908465 wait complete. 2024-04-20T10:55:14.171 INFO:tasks.workunit.client.1.smithi175.stdout:9/986: dwrite d6/d33/d63/f108 [0,4194304] 0 2024-04-20T10:55:14.172 INFO:tasks.workunit.client.1.smithi175.stdout:9/987: creat d6/d58/f135 x:0 0 0 2024-04-20T10:55:14.173 INFO:tasks.workunit.client.1.smithi175.stdout:9/988: rmdir d6/dcb/dce 39 2024-04-20T10:55:14.175 INFO:tasks.workunit.client.1.smithi175.stdout:3/889: sync 2024-04-20T10:55:14.176 INFO:tasks.workunit.client.1.smithi175.stdout:3/890: symlink d7/d21/d16/d22/df8/d64/l114 0 2024-04-20T10:55:14.177 INFO:tasks.workunit.client.1.smithi175.stdout:3/891: write d7/d21/f11 [1109155,123649] 0 2024-04-20T10:55:14.182 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:14.187 INFO:tasks.workunit.client.1.smithi175.stdout:3/892: read d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/fbc [362968,129555] 0 2024-04-20T10:55:14.188 INFO:tasks.workunit.client.1.smithi175.stdout:3/893: getdents d7/d21/d16/d49/dc5/ddc/dfa 0 2024-04-20T10:55:14.189 INFO:tasks.workunit.client.1.smithi175.stdout:3/894: unlink d7/d19/f97 0 2024-04-20T10:55:14.190 INFO:tasks.workunit.client.1.smithi175.stdout:3/895: symlink d7/d21/d16/d49/db5/l115 0 2024-04-20T10:55:14.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/896: dread - d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fd9 zero size 2024-04-20T10:55:14.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/897: stat d7/d21/fb1 0 2024-04-20T10:55:14.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/898: dread - d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fd9 zero size 2024-04-20T10:55:14.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/899: fsync d7/d21/d16/d22/df8/d1f/d10b/f10c 0 2024-04-20T10:55:14.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/900: write d7/d10/d8c/fb0 [250338,41706] 0 2024-04-20T10:55:14.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/901: mknod d7/d21/d16/d49/dc5/ddc/dfa/d113/c116 0 2024-04-20T10:55:14.191 INFO:tasks.workunit.client.1.smithi175.stdout:3/902: fsync d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/fbc 0 2024-04-20T10:55:14.197 INFO:tasks.workunit.client.1.smithi175.stdout:9/989: dwrite d6/d1b/d26/d8c/dc6/d122/d51/fcd [4194304,4194304] 0 2024-04-20T10:55:14.199 INFO:tasks.workunit.client.1.smithi175.stdout:9/990: dread d6/f3c [0,4194304] 0 2024-04-20T10:55:14.199 INFO:tasks.workunit.client.1.smithi175.stdout:9/991: chown d6/d58 15602 1 2024-04-20T10:55:14.207 INFO:tasks.workunit.client.1.smithi175.stdout:3/903: dwrite d7/d21/d16/d22/df8/d1f/ff2 [0,4194304] 0 2024-04-20T10:55:14.208 INFO:tasks.workunit.client.1.smithi175.stdout:3/904: mkdir d7/d19/d33/d7e/d117 0 2024-04-20T10:55:14.208 INFO:tasks.workunit.client.1.smithi175.stdout:9/992: dread d6/d1b/f7a [0,4194304] 0 2024-04-20T10:55:14.209 INFO:tasks.workunit.client.1.smithi175.stdout:9/993: truncate d6/d58/f68 2472560 0 2024-04-20T10:55:14.209 INFO:tasks.workunit.client.1.smithi175.stdout:9/994: write d6/d1b/d26/d8c/dc6/d122/dd5/f10d [463491,111738] 0 2024-04-20T10:55:14.209 INFO:tasks.workunit.client.1.smithi175.stdout:9/995: fsync d6/d33/f99 0 2024-04-20T10:55:14.210 INFO:tasks.workunit.client.1.smithi175.stdout:3/905: rename d7/d19/d33/d7e/d86/d7d/dcb/c5e to d7/d21/d16/c118 0 2024-04-20T10:55:14.210 INFO:tasks.workunit.client.1.smithi175.stdout:3/906: stat d7/d19 0 2024-04-20T10:55:14.216 INFO:tasks.workunit.client.1.smithi175.stdout:3/907: write d7/d21/d16/d22/df8/d91/f2b [1411407,106192] 0 2024-04-20T10:55:14.225 INFO:tasks.workunit.client.1.smithi175.stdout:9/996: dwrite d6/d1b/d26/d8c/dc6/f118 [0,4194304] 0 2024-04-20T10:55:14.225 INFO:tasks.workunit.client.1.smithi175.stdout:9/997: dread - d6/d58/d90/daa/f11f zero size 2024-04-20T10:55:14.235 INFO:tasks.workunit.client.1.smithi175.stdout:3/908: dwrite d7/d19/d33/d7e/d89/fd6 [0,4194304] 0 2024-04-20T10:55:14.235 INFO:tasks.workunit.client.1.smithi175.stdout:3/909: write d7/f51 [387044,31158] 0 2024-04-20T10:55:14.256 INFO:tasks.workunit.client.1.smithi175.stdout:3/910: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/f73 [0,4194304] 0 2024-04-20T10:55:14.274 INFO:tasks.workunit.client.1.smithi175.stdout:3/911: dwrite d7/d21/f11 [0,4194304] 0 2024-04-20T10:55:14.288 INFO:tasks.workunit.client.1.smithi175.stdout:3/912: dwrite d7/d21/d16/f7a [0,4194304] 0 2024-04-20T10:55:14.288 INFO:tasks.workunit.client.1.smithi175.stdout:3/913: chown d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/fbc 17519 1 2024-04-20T10:55:14.303 INFO:tasks.workunit.client.1.smithi175.stdout:3/914: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d50/fc2 [0,4194304] 0 2024-04-20T10:55:14.306 INFO:tasks.workunit.client.1.smithi175.stdout:3/915: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/f119 x:0 0 0 2024-04-20T10:55:14.306 INFO:tasks.workunit.client.1.smithi175.stdout:3/916: symlink d7/d19/d33/l11a 0 2024-04-20T10:55:14.307 INFO:tasks.workunit.client.1.smithi175.stdout:3/917: getdents d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2 0 2024-04-20T10:55:14.309 INFO:tasks.workunit.client.1.smithi175.stdout:9/998: sync 2024-04-20T10:55:14.310 INFO:tasks.workunit.client.1.smithi175.stdout:3/918: dread d7/d19/d33/d7e/d86/d7d/dcb/f6c [0,4194304] 0 2024-04-20T10:55:14.310 INFO:tasks.workunit.client.1.smithi175.stdout:9/999: rename d6/fe to d6/d1b/f136 0 2024-04-20T10:55:14.311 INFO:tasks.workunit.client.1.smithi175.stdout:3/919: mkdir d7/d21/d16/d49/dc5/ddc/dfa/d113/d11b 0 2024-04-20T10:55:14.311 INFO:tasks.workunit.client.1.smithi175.stdout:3/920: dread - d7/d19/da2/ffd zero size 2024-04-20T10:55:14.311 INFO:tasks.workunit.client.1.smithi175.stdout:3/921: mknod d7/d21/d16/d22/c11c 0 2024-04-20T10:55:14.329 INFO:tasks.workunit.client.1.smithi175.stdout:3/922: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/d105/f9c [0,4194304] 0 2024-04-20T10:55:14.329 INFO:tasks.workunit.client.1.smithi175.stdout:3/923: write d7/d19/d33/d7e/d86/d7d/dcb/d79/f81 [848078,106079] 0 2024-04-20T10:55:14.329 INFO:tasks.workunit.client.1.smithi175.stdout:3/924: truncate d7/d21/d16/d22/df8/fa7 629500 0 2024-04-20T10:55:14.329 INFO:tasks.workunit.client.1.smithi175.stdout:3/925: mknod d7/d21/d16/d49/dc5/ddc/dfa/d113/d11b/c11d 0 2024-04-20T10:55:14.330 INFO:tasks.workunit.client.1.smithi175.stdout:3/926: truncate d7/d19/da2/ffd 449885 0 2024-04-20T10:55:14.330 INFO:tasks.workunit.client.1.smithi175.stdout:3/927: rename d7/d21/d16/d22/c88 to d7/d21/d16/d49/dc5/ddc/dfa/c11e 0 2024-04-20T10:55:14.331 INFO:tasks.workunit.client.1.smithi175.stdout:3/928: mknod d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/c11f 0 2024-04-20T10:55:14.338 INFO:tasks.workunit.client.1.smithi175.stdout:3/929: dread d7/d21/d16/d49/f7c [0,4194304] 0 2024-04-20T10:55:14.339 INFO:tasks.workunit.client.1.smithi175.stdout:3/930: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/df6/dfe/f120 x:0 0 0 2024-04-20T10:55:14.891 INFO:tasks.workunit.client.1.smithi175.stdout:3/931: dread d7/d21/d16/d22/df8/fa7 [0,4194304] 0 2024-04-20T10:55:14.891 INFO:tasks.workunit.client.1.smithi175.stdout:3/932: write d7/d10/d8c/fcc [262880,87975] 0 2024-04-20T10:55:14.901 INFO:tasks.workunit.client.1.smithi175.stdout:3/933: write d7/d21/f11 [2783421,46126] 0 2024-04-20T10:55:14.902 INFO:tasks.workunit.client.1.smithi175.stdout:3/934: creat d7/d21/f121 x:0 0 0 2024-04-20T10:55:14.902 INFO:tasks.workunit.client.1.smithi175.stdout:3/935: chown d7/d10/f9a 4926045 1 2024-04-20T10:55:14.902 INFO:tasks.workunit.client.1.smithi175.stdout:3/936: getdents d7/d21/d16/d49/dc5/ddc/dfa/d113 0 2024-04-20T10:55:14.903 INFO:tasks.workunit.client.1.smithi175.stdout:3/937: read d7/d21/d16/d22/df8/d1f/f5b [8448487,121530] 0 2024-04-20T10:55:14.903 INFO:tasks.workunit.client.1.smithi175.stdout:3/938: creat d7/d19/d33/d7e/d117/f122 x:0 0 0 2024-04-20T10:55:14.904 INFO:tasks.workunit.client.1.smithi175.stdout:3/939: creat d7/d10/f123 x:0 0 0 2024-04-20T10:55:14.904 INFO:tasks.workunit.client.1.smithi175.stdout:3/940: dread - d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fd7 zero size 2024-04-20T10:55:14.909 INFO:tasks.workunit.client.1.smithi175.stdout:3/941: write d7/d21/d16/d22/df8/f34 [841768,53963] 0 2024-04-20T10:55:14.909 INFO:tasks.workunit.client.1.smithi175.stdout:3/942: read - d7/d21/d16/d22/df8/d1f/d10b/f10c zero size 2024-04-20T10:55:14.925 INFO:tasks.workunit.client.1.smithi175.stdout:3/943: dwrite d7/d21/d16/d22/df8/d91/fb7 [8388608,4194304] 0 2024-04-20T10:55:14.926 INFO:tasks.workunit.client.1.smithi175.stdout:3/944: mknod d7/d19/d33/d7e/d89/c124 0 2024-04-20T10:55:14.927 INFO:tasks.workunit.client.1.smithi175.stdout:3/945: mknod d7/c125 0 2024-04-20T10:55:14.927 INFO:tasks.workunit.client.1.smithi175.stdout:3/946: rmdir d7/d21/d16/d22 39 2024-04-20T10:55:14.927 INFO:tasks.workunit.client.1.smithi175.stdout:3/947: fsync d7/d21/d16/d22/df8/d1f/f8f 0 2024-04-20T10:55:14.928 INFO:tasks.workunit.client.1.smithi175.stdout:3/948: mknod d7/d21/d16/d49/c126 0 2024-04-20T10:55:14.928 INFO:tasks.workunit.client.1.smithi175.stdout:3/949: readlink d7/d19/da2/laf 0 2024-04-20T10:55:14.929 INFO:tasks.workunit.client.1.smithi175.stdout:3/950: creat d7/d21/d16/d49/d54/f127 x:0 0 0 2024-04-20T10:55:14.929 INFO:tasks.workunit.client.1.smithi175.stdout:3/951: chown d7/d21/d16/d22 144 1 2024-04-20T10:55:14.945 INFO:tasks.workunit.client.1.smithi175.stdout:3/952: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fdb [0,4194304] 0 2024-04-20T10:55:14.945 INFO:tasks.workunit.client.1.smithi175.stdout:3/953: truncate d7/d19/d33/d7e/d86/d7d/dcb/d79/f81 1184105 0 2024-04-20T10:55:14.961 INFO:tasks.workunit.client.1.smithi175.stdout:3/954: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/f10e [0,4194304] 0 2024-04-20T10:55:14.961 INFO:tasks.workunit.client.1.smithi175.stdout:3/955: chown d7/d19/d33/d7e/le0 14475765 1 2024-04-20T10:55:14.961 INFO:tasks.workunit.client.1.smithi175.stdout:3/956: write d7/d19/d33/d7e/d86/d7d/dcb/d79/f81 [385819,43755] 0 2024-04-20T10:55:14.961 INFO:tasks.workunit.client.1.smithi175.stdout:3/957: chown d7/d21/fd 305 1 2024-04-20T10:55:14.968 INFO:tasks.workunit.client.1.smithi175.stdout:3/958: dread d7/f12 [0,4194304] 0 2024-04-20T10:55:14.969 INFO:tasks.workunit.client.1.smithi175.stdout:3/959: mkdir d7/d19/d33/d128 0 2024-04-20T10:55:14.984 INFO:tasks.workunit.client.1.smithi175.stdout:3/960: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d50/fc2 [0,4194304] 0 2024-04-20T10:55:14.984 INFO:tasks.workunit.client.1.smithi175.stdout:3/961: fdatasync d7/d21/d16/d22/df8/fec 0 2024-04-20T10:55:15.001 INFO:tasks.workunit.client.1.smithi175.stdout:3/962: dwrite d7/d21/fd [0,4194304] 0 2024-04-20T10:55:15.001 INFO:tasks.workunit.client.1.smithi175.stdout:3/963: fdatasync d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fc6 0 2024-04-20T10:55:15.001 INFO:tasks.workunit.client.1.smithi175.stdout:3/964: write d7/d10/d8c/f103 [652252,85178] 0 2024-04-20T10:55:15.001 INFO:tasks.workunit.client.1.smithi175.stdout:3/965: chown d7/d21/d16/d49/f7c 239311118 1 2024-04-20T10:55:15.002 INFO:tasks.workunit.client.1.smithi175.stdout:3/966: mknod d7/d19/d33/d7e/d117/c129 0 2024-04-20T10:55:15.002 INFO:tasks.workunit.client.1.smithi175.stdout:3/967: chown d7/d21/d16/d49/d54/fcf 946 1 2024-04-20T10:55:15.002 INFO:tasks.workunit.client.1.smithi175.stdout:3/968: creat d7/d21/d16/d22/df8/d1f/d10b/f12a x:0 0 0 2024-04-20T10:55:15.003 INFO:tasks.workunit.client.1.smithi175.stdout:3/969: write d7/d10/d8c/fcc [698912,121197] 0 2024-04-20T10:55:15.003 INFO:tasks.workunit.client.1.smithi175.stdout:3/970: chown d7/d10/d8c/fe2 102409169 1 2024-04-20T10:55:15.003 INFO:tasks.workunit.client.1.smithi175.stdout:3/971: rmdir d7/d19/d33/d7e/d86/d7d 39 2024-04-20T10:55:15.004 INFO:tasks.workunit.client.1.smithi175.stdout:3/972: link d7/d19/d33/d7e/d86/d7d/dcb/d50/fc2 d7/d21/d16/d22/df8/d64/dbd/dce/f12b 0 2024-04-20T10:55:15.345 INFO:tasks.workunit.client.1.smithi175.stdout:3/973: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dc0/fdb [4194304,4194304] 0 2024-04-20T10:55:15.345 INFO:tasks.workunit.client.1.smithi175.stdout:3/974: getdents d7/d19/d33/d128 0 2024-04-20T10:55:15.346 INFO:tasks.workunit.client.1.smithi175.stdout:3/975: fsync d7/f14 0 2024-04-20T10:55:15.346 INFO:tasks.workunit.client.1.smithi175.stdout:3/976: readlink d7/l1e 0 2024-04-20T10:55:15.347 INFO:tasks.workunit.client.1.smithi175.stdout:3/977: symlink d7/d21/d16/d22/d110/l12c 0 2024-04-20T10:55:15.365 INFO:tasks.workunit.client.1.smithi175.stdout:3/978: dwrite d7/d19/d33/ddd/fff [4194304,4194304] 0 2024-04-20T10:55:15.366 INFO:tasks.workunit.client.1.smithi175.stdout:3/979: mkdir d7/d19/d33/d7e/d117/d12d 0 2024-04-20T10:55:15.383 INFO:tasks.workunit.client.1.smithi175.stdout:3/980: dwrite d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/fbc [0,4194304] 0 2024-04-20T10:55:15.383 INFO:tasks.workunit.client.1.smithi175.stdout:3/981: readlink d7/d19/l24 0 2024-04-20T10:55:15.383 INFO:tasks.workunit.client.1.smithi175.stdout:3/982: getdents d7/d19/d33/ddd 0 2024-04-20T10:55:15.384 INFO:tasks.workunit.client.1.smithi175.stdout:3/983: chown d7/d21/d16/d49/dc5/ddc 1790290 1 2024-04-20T10:55:15.384 INFO:tasks.workunit.client.1.smithi175.stdout:3/984: write d7/d19/d33/d7e/d117/f122 [832798,124839] 0 2024-04-20T10:55:15.384 INFO:tasks.workunit.client.1.smithi175.stdout:3/985: chown d7/d19/d33/d7e/d86 2 1 2024-04-20T10:55:15.384 INFO:tasks.workunit.client.1.smithi175.stdout:3/986: write d7/d10/f4a [2342362,94081] 0 2024-04-20T10:55:15.384 INFO:tasks.workunit.client.1.smithi175.stdout:3/987: creat d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/df6/dfe/f12e x:0 0 0 2024-04-20T10:55:15.385 INFO:tasks.workunit.client.1.smithi175.stdout:3/988: mknod d7/d19/d33/d7e/da5/c12f 0 2024-04-20T10:55:15.385 INFO:tasks.workunit.client.1.smithi175.stdout:3/989: chown d7/d21/d16/d22/df8/fec 27775 1 2024-04-20T10:55:15.385 INFO:tasks.workunit.client.1.smithi175.stdout:3/990: chown d7/d19/d33/d7e/d86/d7d/dcb/d79/d99/dac/dad/db2/cbe 524825587 1 2024-04-20T10:55:15.409 INFO:tasks.workunit.client.1.smithi175.stdout:3/991: dwrite d7/d21/d16/d49/da8/fe9 [0,4194304] 0 2024-04-20T10:55:15.409 INFO:tasks.workunit.client.1.smithi175.stdout:3/992: readlink d7/d21/d16/d22/d110/l12c 0 2024-04-20T10:55:15.410 INFO:tasks.workunit.client.1.smithi175.stdout:3/993: symlink d7/d19/d33/d7e/da5/d102/l130 0 2024-04-20T10:55:15.592 INFO:tasks.workunit.client.1.smithi175.stdout:3/994: sync 2024-04-20T10:55:15.612 INFO:tasks.workunit.client.1.smithi175.stdout:3/995: dwrite d7/d21/d16/d22/df8/f92 [4194304,4194304] 0 2024-04-20T10:55:15.613 INFO:tasks.workunit.client.1.smithi175.stdout:3/996: truncate d7/d21/fd 1997935 0 2024-04-20T10:55:15.628 INFO:tasks.workunit.client.1.smithi175.stdout:3/997: dwrite d7/d21/f76 [0,4194304] 0 2024-04-20T10:55:15.637 INFO:tasks.workunit.client.1.smithi175.stdout:3/998: dread d7/d21/d16/d22/f52 [0,4194304] 0 2024-04-20T10:55:15.638 INFO:tasks.workunit.client.1.smithi175.stdout:3/999: creat d7/d19/d33/d128/f131 x:0 0 0 2024-04-20T10:55:15.640 INFO:tasks.workunit.client.1.smithi175.stderr:+ rm -rf -- ./tmp.8xc6qsUUr2 2024-04-20T10:55:16.184 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.308+0000 7ff015f2c640 1 Processor -- start 2024-04-20T10:55:16.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.308+0000 7ff015f2c640 1 -- start start 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff015f2c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff010153ef0 0x7ff0100c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff015f2c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0100c9ee0 0x7ff010156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff015f2c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff01015a720 con 0x7ff0100ab730 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff015f2c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff01015ac80 con 0x7ff0100c9ee0 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff015f2c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff01015a9a0 con 0x7ff010153ef0 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff00ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0100c9ee0 0x7ff010156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff00ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff0100c9ee0 0x7ff010156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55232/0 (socket says 172.21.15.90:55232) 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff00ffff640 1 -- 172.21.15.90:0/1908659747 learned_addr learned my addr 172.21.15.90:0/1908659747 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.309+0000 7ff00f7fe640 1 --2- 172.21.15.90:0/1908659747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff010153ef0 0x7ff0100c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.310+0000 7ff00ffff640 1 -- 172.21.15.90:0/1908659747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff010153ef0 msgr2=0x7ff0100c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:16.310 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.310+0000 7ff00ffff640 1 --2- 172.21.15.90:0/1908659747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff010153ef0 0x7ff0100c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.310+0000 7ff00ffff640 1 -- 172.21.15.90:0/1908659747 >> v1:172.21.15.175:6789/0 conn(0x7ff0100ab730 legacy=0x7ff0101568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.310+0000 7ff00ffff640 1 -- 172.21.15.90:0/1908659747 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0100c6a90 con 0x7ff0100c9ee0 2024-04-20T10:55:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.311+0000 7ff00ffff640 1 --2- 172.21.15.90:0/1908659747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff010156fd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff008009e50 tx=0x7ff00802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7df2811b82c7f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.311+0000 7ff00e7fc640 1 -- 172.21.15.90:0/1908659747 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00802c9e0 con 0x7ff0100c9ee0 2024-04-20T10:55:16.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.311+0000 7ff00e7fc640 1 -- 172.21.15.90:0/1908659747 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00802cb80 con 0x7ff0100c9ee0 2024-04-20T10:55:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.311+0000 7ff00e7fc640 1 -- 172.21.15.90:0/1908659747 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0080343f0 con 0x7ff0100c9ee0 2024-04-20T10:55:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 -- 172.21.15.90:0/1908659747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 msgr2=0x7ff010156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1908659747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff010156fd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff008009e50 tx=0x7ff00802be40 comp rx=0 tx=0).stop 2024-04-20T10:55:16.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 -- 172.21.15.90:0/1908659747 shutdown_connections 2024-04-20T10:55:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1908659747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff010156fd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1908659747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff010153ef0 0x7ff0100c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 -- 172.21.15.90:0/1908659747 >> 172.21.15.90:0/1908659747 conn(0x7ff0100cbfe0 msgr2=0x7ff0100cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 -- 172.21.15.90:0/1908659747 shutdown_connections 2024-04-20T10:55:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.312+0000 7ff015f2c640 1 -- 172.21.15.90:0/1908659747 wait complete. 2024-04-20T10:55:16.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.313+0000 7ff015f2c640 1 Processor -- start 2024-04-20T10:55:16.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.314+0000 7ff015f2c640 1 -- start start 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff015f2c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ab730 0x7ff010159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff015f2c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff0101ed4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff015f2c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff010153ef0 0x7ff0101eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff015f2c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff0100bf800 con 0x7ff0100c9ee0 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff015f2c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff010157510 con 0x7ff010153ef0 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff015f2c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff010155610 con 0x7ff0100ab730 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff0101ed4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ab730 0x7ff010159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:16.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00effd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff0101ed4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55238/0 (socket says 172.21.15.90:55238) 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ab730 0x7ff010159230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:57642/0 (socket says 172.21.15.90:57642) 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00effd640 1 -- 172.21.15.90:0/1152280423 learned_addr learned my addr 172.21.15.90:0/1152280423 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00ffff640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff010153ef0 0x7ff0101eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 -- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff010153ef0 msgr2=0x7ff0101eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff010153ef0 0x7ff0101eda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 -- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 msgr2=0x7ff0101ed4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff0101ed4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 -- 172.21.15.90:0/1152280423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0101edf70 con 0x7ff0100ab730 2024-04-20T10:55:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.315+0000 7ff00f7fe640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ab730 0x7ff010159230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff00000e850 tx=0x7ff00000ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.316+0000 7feff7fff640 1 -- 172.21.15.90:0/1152280423 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff000017070 con 0x7ff0100ab730 2024-04-20T10:55:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.316+0000 7feff7fff640 1 -- 172.21.15.90:0/1152280423 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff00000c940 con 0x7ff0100ab730 2024-04-20T10:55:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.316+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff010155860 con 0x7ff0100ab730 2024-04-20T10:55:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.316+0000 7feff7fff640 1 -- 172.21.15.90:0/1152280423 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff00000cd10 con 0x7ff0100ab730 2024-04-20T10:55:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.316+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff010155e20 con 0x7ff0100ab730 2024-04-20T10:55:16.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.317+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff010076150 con 0x7ff0100ab730 2024-04-20T10:55:16.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.318+0000 7feff7fff640 1 -- 172.21.15.90:0/1152280423 <== mon.2 v2:172.21.15.175:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff00001a070 con 0x7ff0100ab730 2024-04-20T10:55:16.318 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.318+0000 7feff7fff640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feffc06c8f0 0x7feffc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.319+0000 7ff00effd640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feffc06c8f0 0x7feffc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.319+0000 7feff7fff640 1 -- 172.21.15.90:0/1152280423 <== mon.2 v2:172.21.15.175:3301/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7ff00008bfb0 con 0x7ff0100ab730 2024-04-20T10:55:16.319 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.319+0000 7ff00effd640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feffc06c8f0 0x7feffc06edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff0101544e0 tx=0x7ff004009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:16.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.323+0000 7feff7fff640 1 -- 172.21.15.90:0/1152280423 <== mon.2 v2:172.21.15.175:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff000059830 con 0x7ff0100ab730 2024-04-20T10:55:16.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.541+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff01006d070 con 0x7ff0100ab730 2024-04-20T10:55:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.542+0000 7feff7fff640 1 -- 172.21.15.90:0/1152280423 <== mon.2 v2:172.21.15.175:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7ff00005db30 con 0x7ff0100ab730 2024-04-20T10:55:16.542 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:16.542 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:16.542 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feffc06c8f0 msgr2=0x7feffc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feffc06c8f0 0x7feffc06edb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff0101544e0 tx=0x7ff004009040 comp rx=0 tx=0).stop 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ab730 msgr2=0x7ff010159230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ab730 0x7ff010159230 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff00000e850 tx=0x7ff00000ed10 comp rx=0 tx=0).stop 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 shutdown_connections 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7feffc06c8f0 0x7feffc06edb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff010153ef0 0x7ff0101eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff0100c9ee0 0x7ff0101ed4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 --2- 172.21.15.90:0/1152280423 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff0100ab730 0x7ff010159230 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 >> 172.21.15.90:0/1152280423 conn(0x7ff0100cbfe0 msgr2=0x7ff0101568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:16.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 shutdown_connections 2024-04-20T10:55:16.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:16.544+0000 7ff015f2c640 1 -- 172.21.15.90:0/1152280423 wait complete. 2024-04-20T10:55:16.556 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:18.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:18.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.665+0000 7fb489c55640 1 Processor -- start 2024-04-20T10:55:18.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.665+0000 7fb489c55640 1 -- start start 2024-04-20T10:55:18.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb489c55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb484157a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb489c55640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb4840aebe0 0x7fb484157f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb489c55640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4840ac440 con 0x7fb48414ae60 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb489c55640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb4840af1a0 con 0x7fb4840aebe0 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb489c55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb4840ac700 con 0x7fb4840c3b00 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb483fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb4840aebe0 0x7fb484157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb483fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb4840aebe0 0x7fb484157f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55250/0 (socket says 172.21.15.90:55250) 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb483fff640 1 -- 172.21.15.90:0/3210423431 learned_addr learned my addr 172.21.15.90:0/3210423431 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb482ffd640 1 --2- 172.21.15.90:0/3210423431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb484157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb483fff640 1 -- 172.21.15.90:0/3210423431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 msgr2=0x7fb484157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb483fff640 1 --2- 172.21.15.90:0/3210423431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb484157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb483fff640 1 -- 172.21.15.90:0/3210423431 >> v1:172.21.15.175:6789/0 conn(0x7fb48414ae60 legacy=0x7fb4840ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:18.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.666+0000 7fb483fff640 1 -- 172.21.15.90:0/3210423431 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4840ac9e0 con 0x7fb4840aebe0 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.667+0000 7fb483fff640 1 --2- 172.21.15.90:0/3210423431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb484157f50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009e50 tx=0x7fb47c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705488943a54f23f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.667+0000 7fb4827fc640 1 -- 172.21.15.90:0/3210423431 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c02ca70 con 0x7fb4840aebe0 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.667+0000 7fb4827fc640 1 -- 172.21.15.90:0/3210423431 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb47c02cc10 con 0x7fb4840aebe0 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.667+0000 7fb4827fc640 1 -- 172.21.15.90:0/3210423431 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0343f0 con 0x7fb4840aebe0 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 -- 172.21.15.90:0/3210423431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 msgr2=0x7fb484157f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 --2- 172.21.15.90:0/3210423431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb484157f50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fb47c009e50 tx=0x7fb47c02bed0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 -- 172.21.15.90:0/3210423431 shutdown_connections 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 --2- 172.21.15.90:0/3210423431 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb484157f50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 --2- 172.21.15.90:0/3210423431 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb484157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 -- 172.21.15.90:0/3210423431 >> 172.21.15.90:0/3210423431 conn(0x7fb4840c9100 msgr2=0x7fb4840c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 -- 172.21.15.90:0/3210423431 shutdown_connections 2024-04-20T10:55:18.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.668+0000 7fb489c55640 1 -- 172.21.15.90:0/3210423431 wait complete. 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.669+0000 7fb489c55640 1 Processor -- start 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.669+0000 7fb489c55640 1 -- start start 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb489c55640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb4840c0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb489c55640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb4840beda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb489c55640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb48414ae60 0x7fb4840bf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb489c55640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb48414b3c0 con 0x7fb4840aebe0 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb489c55640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb48414b240 con 0x7fb48414ae60 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb489c55640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb4840ae860 con 0x7fb4840c3b00 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb4840c0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb4840c0d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55254/0 (socket says 172.21.15.90:55254) 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 -- 172.21.15.90:0/3498592725 learned_addr learned my addr 172.21.15.90:0/3498592725 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb482ffd640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb4840beda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:18.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb483fff640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb48414ae60 0x7fb4840bf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 -- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 msgr2=0x7fb4840beda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb4840beda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 -- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb48414ae60 msgr2=0x7fb4840bf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb48414ae60 0x7fb4840bf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.670+0000 7fb4837fe640 1 -- 172.21.15.90:0/3498592725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb48414ca80 con 0x7fb4840aebe0 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.671+0000 7fb4837fe640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb4840c0d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb47400c430 tx=0x7fb47400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.671+0000 7fb46bfff640 1 -- 172.21.15.90:0/3498592725 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4740052d0 con 0x7fb4840aebe0 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.671+0000 7fb46bfff640 1 -- 172.21.15.90:0/3498592725 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb474005490 con 0x7fb4840aebe0 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.671+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb48414b6e0 con 0x7fb4840aebe0 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.671+0000 7fb46bfff640 1 -- 172.21.15.90:0/3498592725 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb474007260 con 0x7fb4840aebe0 2024-04-20T10:55:18.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.671+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4840be5a0 con 0x7fb4840aebe0 2024-04-20T10:55:18.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.672+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb484076150 con 0x7fb4840aebe0 2024-04-20T10:55:18.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.672+0000 7fb46bfff640 1 -- 172.21.15.90:0/3498592725 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb474007400 con 0x7fb4840aebe0 2024-04-20T10:55:18.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.673+0000 7fb46bfff640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb47006c8f0 0x7fb47006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:18.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.673+0000 7fb482ffd640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb47006c8f0 0x7fb47006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:18.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.673+0000 7fb46bfff640 1 -- 172.21.15.90:0/3498592725 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7fb47408b530 con 0x7fb4840aebe0 2024-04-20T10:55:18.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.673+0000 7fb482ffd640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb47006c8f0 0x7fb47006edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb478006fd0 tx=0x7fb478008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:18.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.677+0000 7fb46bfff640 1 -- 172.21.15.90:0/3498592725 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb4740594a0 con 0x7fb4840aebe0 2024-04-20T10:55:18.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.895+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb484068cc0 con 0x7fb4840aebe0 2024-04-20T10:55:18.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.896+0000 7fb46bfff640 1 -- 172.21.15.90:0/3498592725 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7fb474058da0 con 0x7fb4840aebe0 2024-04-20T10:55:18.896 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:18.896 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:18.896 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb47006c8f0 msgr2=0x7fb47006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb47006c8f0 0x7fb47006edb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb478006fd0 tx=0x7fb478008040 comp rx=0 tx=0).stop 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 msgr2=0x7fb4840c0d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb4840c0d80 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fb47400c430 tx=0x7fb47400c8f0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 shutdown_connections 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb47006c8f0 0x7fb47006edb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb48414ae60 0x7fb4840bf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb4840c3b00 0x7fb4840beda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 --2- 172.21.15.90:0/3498592725 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4840aebe0 0x7fb4840c0d80 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 >> 172.21.15.90:0/3498592725 conn(0x7fb4840c9100 msgr2=0x7fb4841486d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 shutdown_connections 2024-04-20T10:55:18.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:18.898+0000 7fb489c55640 1 -- 172.21.15.90:0/3498592725 wait complete. 2024-04-20T10:55:18.910 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:20.912 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:21.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.019+0000 7f19ceeeb640 1 Processor -- start 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.019+0000 7f19ceeeb640 1 -- start start 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19ceeeb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f19c8073030 0x7f19c80c6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19ceeeb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c806feb0 con 0x7f19c8155170 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19ceeeb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19c8073530 con 0x7f19c814e810 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19ceeeb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f19c814ebf0 con 0x7f19c8073030 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19cd488640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f19c8155170 0x7f19c80c65b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:33994/0 (socket says 172.21.15.90:33994) 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19cd488640 1 -- 172.21.15.90:0/3647199185 learned_addr learned my addr 172.21.15.90:0/3647199185 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c7fff640 1 --2- 172.21.15.90:0/3647199185 >> v2:172.21.15.175:3300/0 conn(0x7f19c8073030 0x7f19c80c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c77fe640 1 -- 172.21.15.90:0/3647199185 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684495161 0 0) 0x7f19c806feb0 con 0x7f19c8155170 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c77fe640 1 -- 172.21.15.90:0/3647199185 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19b8003520 con 0x7f19c8155170 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c77fe640 1 -- 172.21.15.90:0/3647199185 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1858067192 0 0) 0x7f19c8073530 con 0x7f19c814e810 2024-04-20T10:55:21.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c77fe640 1 -- 172.21.15.90:0/3647199185 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19c806feb0 con 0x7f19c814e810 2024-04-20T10:55:21.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c7fff640 1 -- 172.21.15.90:0/3647199185 >> v1:172.21.15.175:6789/0 conn(0x7f19c814e810 legacy=0x7f19c8154610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:21.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c7fff640 1 -- 172.21.15.90:0/3647199185 >> v1:172.21.15.90:6789/0 conn(0x7f19c8155170 legacy=0x7f19c80c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:21.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.020+0000 7f19c7fff640 1 -- 172.21.15.90:0/3647199185 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c8070170 con 0x7f19c8073030 2024-04-20T10:55:21.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.021+0000 7f19c7fff640 1 --2- 172.21.15.90:0/3647199185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 0x7f19c80c6070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097a0 tx=0x7f19b402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f92e1a4d1ecd14a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:21.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.021+0000 7f19c77fe640 1 -- 172.21.15.90:0/3647199185 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4034070 con 0x7f19c8073030 2024-04-20T10:55:21.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.021+0000 7f19c77fe640 1 -- 172.21.15.90:0/3647199185 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b4030610 con 0x7f19c8073030 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.021+0000 7f19c77fe640 1 -- 172.21.15.90:0/3647199185 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b40309e0 con 0x7f19c8073030 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.022+0000 7f19ceeeb640 1 -- 172.21.15.90:0/3647199185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 msgr2=0x7f19c80c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.022+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/3647199185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 0x7f19c80c6070 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f19b40097a0 tx=0x7f19b402b960 comp rx=0 tx=0).stop 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.022+0000 7f19ceeeb640 1 -- 172.21.15.90:0/3647199185 shutdown_connections 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.022+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/3647199185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 0x7f19c80c6070 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.022+0000 7f19ceeeb640 1 -- 172.21.15.90:0/3647199185 >> 172.21.15.90:0/3647199185 conn(0x7f19c80676c0 msgr2=0x7f19c8067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.022+0000 7f19ceeeb640 1 -- 172.21.15.90:0/3647199185 shutdown_connections 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.022+0000 7f19ceeeb640 1 -- 172.21.15.90:0/3647199185 wait complete. 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.023+0000 7f19ceeeb640 1 Processor -- start 2024-04-20T10:55:21.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.023+0000 7f19ceeeb640 1 -- start start 2024-04-20T10:55:21.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19ceeeb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 0x7f19c80ca050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19ceeeb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19c814e810 0x7f19c8150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19ceeeb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19c8155170 0x7f19c8151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19ceeeb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f19c80c6cc0 con 0x7f19c814e810 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19ceeeb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f19c8070730 con 0x7f19c8073030 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19ceeeb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f19c806f650 con 0x7f19c8155170 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19c814e810 0x7f19c8150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19c814e810 0x7f19c8150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55270/0 (socket says 172.21.15.90:55270) 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 -- 172.21.15.90:0/2200250825 learned_addr learned my addr 172.21.15.90:0/2200250825 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19ccc87640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 0x7f19c80ca050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19cd488640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19c8155170 0x7f19c8151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 -- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19c8155170 msgr2=0x7f19c8151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:21.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19c8155170 0x7f19c8151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 -- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 msgr2=0x7f19c80ca050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 0x7f19c80ca050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 -- 172.21.15.90:0/2200250825 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19c80c8210 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.024+0000 7f19c7fff640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19c814e810 0x7f19c8150bd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f19b402bf70 tx=0x7f19b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.025+0000 7f19c57fa640 1 -- 172.21.15.90:0/2200250825 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4034040 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.025+0000 7f19c57fa640 1 -- 172.21.15.90:0/2200250825 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19b403aaa0 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.025+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19c80c84f0 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.025+0000 7f19c57fa640 1 -- 172.21.15.90:0/2200250825 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19b4006e10 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.025+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19c814f260 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.026+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19c80758b0 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.026+0000 7f19c57fa640 1 -- 172.21.15.90:0/2200250825 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19b4037070 con 0x7f19c814e810 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.027+0000 7f19c57fa640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f19ac06c8f0 0x7f19ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:21.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.027+0000 7f19ccc87640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f19ac06c8f0 0x7f19ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:21.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.027+0000 7f19c57fa640 1 -- 172.21.15.90:0/2200250825 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f19b40adcb0 con 0x7f19c814e810 2024-04-20T10:55:21.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.027+0000 7f19ccc87640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f19ac06c8f0 0x7f19ac06edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19bc007fd0 tx=0x7f19bc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:21.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.031+0000 7f19c57fa640 1 -- 172.21.15.90:0/2200250825 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f19c80758b0 con 0x7f19c814e810 2024-04-20T10:55:21.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.242+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19c8076150 con 0x7f19c814e810 2024-04-20T10:55:21.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.243+0000 7f19c57fa640 1 -- 172.21.15.90:0/2200250825 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7f19b403f070 con 0x7f19c814e810 2024-04-20T10:55:21.243 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:21.244 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:21.244 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f19ac06c8f0 msgr2=0x7f19ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f19ac06c8f0 0x7f19ac06edb0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19bc007fd0 tx=0x7f19bc009040 comp rx=0 tx=0).stop 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19c814e810 msgr2=0x7f19c8150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19c814e810 0x7f19c8150bd0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f19b402bf70 tx=0x7f19b40046c0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 shutdown_connections 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f19ac06c8f0 0x7f19ac06edb0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f19c8155170 0x7f19c8151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f19c814e810 0x7f19c8150bd0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 --2- 172.21.15.90:0/2200250825 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f19c8073030 0x7f19c80ca050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 >> 172.21.15.90:0/2200250825 conn(0x7f19c80676c0 msgr2=0x7f19c8143740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:21.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 shutdown_connections 2024-04-20T10:55:21.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:21.246+0000 7f19ceeeb640 1 -- 172.21.15.90:0/2200250825 wait complete. 2024-04-20T10:55:21.262 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:23.263 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:23.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.372+0000 7ff3cabce640 1 Processor -- start 2024-04-20T10:55:23.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.372+0000 7ff3cabce640 1 -- start start 2024-04-20T10:55:23.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3cabce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c4073810 0x7ff3c4154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:23.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3cabce640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff3c4157710 0x7ff3c40c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:23.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3cabce640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3c40c40d0 con 0x7ff3c40ad0c0 2024-04-20T10:55:23.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3cabce640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff3c41569e0 con 0x7ff3c4157710 2024-04-20T10:55:23.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3cabce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c4157280 con 0x7ff3c4073810 2024-04-20T10:55:23.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3c916b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff3c40ad0c0 0x7ff3c40abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:34010/0 (socket says 172.21.15.90:34010) 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3c916b640 1 -- 172.21.15.90:0/838564074 learned_addr learned my addr 172.21.15.90:0/838564074 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3c896a640 1 --2- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c4073810 0x7ff3c4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3c3fff640 1 --2- 172.21.15.90:0/838564074 >> v2:172.21.15.175:3300/0 conn(0x7ff3c4157710 0x7ff3c40c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3c37fe640 1 -- 172.21.15.90:0/838564074 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 155809937 0 0) 0x7ff3c40c40d0 con 0x7ff3c40ad0c0 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.373+0000 7ff3c37fe640 1 -- 172.21.15.90:0/838564074 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3ac003520 con 0x7ff3c40ad0c0 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.374+0000 7ff3c3fff640 1 -- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c4073810 msgr2=0x7ff3c4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.374+0000 7ff3c3fff640 1 --2- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c4073810 0x7ff3c4154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.374+0000 7ff3c37fe640 1 -- 172.21.15.90:0/838564074 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 145084626 0 0) 0x7ff3ac003520 con 0x7ff3c40ad0c0 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.374+0000 7ff3c3fff640 1 -- 172.21.15.90:0/838564074 >> v1:172.21.15.90:6789/0 conn(0x7ff3c40ad0c0 legacy=0x7ff3c40abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.374+0000 7ff3c3fff640 1 -- 172.21.15.90:0/838564074 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c40c4370 con 0x7ff3c4157710 2024-04-20T10:55:23.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.374+0000 7ff3c896a640 1 --2- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c4073810 0x7ff3c4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.374+0000 7ff3c3fff640 1 --2- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 0x7ff3c40c3b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80097a0 tx=0x7ff3b802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92236b68de3628cc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3c37fe640 1 -- 172.21.15.90:0/838564074 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b8037070 con 0x7ff3c4157710 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3c37fe640 1 -- 172.21.15.90:0/838564074 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b8030510 con 0x7ff3c4157710 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3c37fe640 1 -- 172.21.15.90:0/838564074 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0019f0 con 0x7ff3c4157710 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 -- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 msgr2=0x7ff3c40c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 --2- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 0x7ff3c40c3b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3b80097a0 tx=0x7ff3b802b710 comp rx=0 tx=0).stop 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 -- 172.21.15.90:0/838564074 shutdown_connections 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 --2- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 0x7ff3c40c3b90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 --2- 172.21.15.90:0/838564074 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c4073810 0x7ff3c4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 -- 172.21.15.90:0/838564074 >> 172.21.15.90:0/838564074 conn(0x7ff3c40c8080 msgr2=0x7ff3c40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 -- 172.21.15.90:0/838564074 shutdown_connections 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.375+0000 7ff3cabce640 1 -- 172.21.15.90:0/838564074 wait complete. 2024-04-20T10:55:23.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.376+0000 7ff3cabce640 1 Processor -- start 2024-04-20T10:55:23.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.376+0000 7ff3cabce640 1 -- start start 2024-04-20T10:55:23.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3cabce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3c4073810 0x7ff3c414b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3cabce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c40ad0c0 0x7ff3c41eb210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3cabce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 0x7ff3c41e0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3cabce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4073bf0 con 0x7ff3c4073810 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3cabce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff3c4156f10 con 0x7ff3c4157710 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3cabce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff3c40ac2c0 con 0x7ff3c40ad0c0 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3c896a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3c4073810 0x7ff3c414b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3c896a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3c4073810 0x7ff3c414b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55284/0 (socket says 172.21.15.90:55284) 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3c896a640 1 -- 172.21.15.90:0/1631865231 learned_addr learned my addr 172.21.15.90:0/1631865231 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3c916b640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 0x7ff3c41e0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.377+0000 7ff3c3fff640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c40ad0c0 0x7ff3c41eb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c896a640 1 -- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c40ad0c0 msgr2=0x7ff3c41eb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c896a640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c40ad0c0 0x7ff3c41eb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c896a640 1 -- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 msgr2=0x7ff3c41e0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c896a640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 0x7ff3c41e0a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c896a640 1 -- 172.21.15.90:0/1631865231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3c41e0300 con 0x7ff3c4073810 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c896a640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3c4073810 0x7ff3c414b3f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e990 tx=0x7ff3b400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c17fa640 1 -- 172.21.15.90:0/1631865231 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b4017070 con 0x7ff3c4073810 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c17fa640 1 -- 172.21.15.90:0/1631865231 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3b400c9e0 con 0x7ff3c4073810 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3c41dcb80 con 0x7ff3c4073810 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3c17fa640 1 -- 172.21.15.90:0/1631865231 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3b400cdb0 con 0x7ff3c4073810 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.378+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3c414b080 con 0x7ff3c4073810 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.379+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3c4076150 con 0x7ff3c4073810 2024-04-20T10:55:23.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.380+0000 7ff3c17fa640 1 -- 172.21.15.90:0/1631865231 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff3b401a070 con 0x7ff3c4073810 2024-04-20T10:55:23.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.380+0000 7ff3c17fa640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff3b006c8f0 0x7ff3b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:23.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.380+0000 7ff3c17fa640 1 -- 172.21.15.90:0/1631865231 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7ff3b408c1b0 con 0x7ff3c4073810 2024-04-20T10:55:23.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.380+0000 7ff3c3fff640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff3b006c8f0 0x7ff3b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:23.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.380+0000 7ff3c3fff640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff3b006c8f0 0x7ff3b006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8034000 tx=0x7ff3b8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:23.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.384+0000 7ff3c17fa640 1 -- 172.21.15.90:0/1631865231 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff3b4059ad0 con 0x7ff3c4073810 2024-04-20T10:55:23.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.609+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3c40c8c40 con 0x7ff3c4073810 2024-04-20T10:55:23.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.609+0000 7ff3c17fa640 1 -- 172.21.15.90:0/1631865231 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7ff3b405ddd0 con 0x7ff3c4073810 2024-04-20T10:55:23.610 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:23.610 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:23.610 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff3b006c8f0 msgr2=0x7ff3b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff3b006c8f0 0x7ff3b006edb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff3b8034000 tx=0x7ff3b8008030 comp rx=0 tx=0).stop 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3c4073810 msgr2=0x7ff3c414b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3c4073810 0x7ff3c414b3f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff3b400e990 tx=0x7ff3b400ee50 comp rx=0 tx=0).stop 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 shutdown_connections 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff3b006c8f0 0x7ff3b006edb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff3c4157710 0x7ff3c41e0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff3c40ad0c0 0x7ff3c41eb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 --2- 172.21.15.90:0/1631865231 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff3c4073810 0x7ff3c414b3f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:23.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 >> 172.21.15.90:0/1631865231 conn(0x7ff3c40c8080 msgr2=0x7ff3c4153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:23.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.611+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 shutdown_connections 2024-04-20T10:55:23.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:23.612+0000 7ff3cabce640 1 -- 172.21.15.90:0/1631865231 wait complete. 2024-04-20T10:55:23.623 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:25.624 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:25.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.735+0000 7f7e63ca8640 1 Processor -- start 2024-04-20T10:55:25.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.735+0000 7f7e63ca8640 1 -- start start 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e63ca8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7e5c0c27a0 0x7f7e5c153970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e63ca8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 0x7f7e5c153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e63ca8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5c0c54c0 con 0x7f7e5c156810 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e63ca8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7e5c071bb0 con 0x7f7e5c0c27a0 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e63ca8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5c071720 con 0x7f7e5c0aea30 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e62245640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f7e5c156810 0x7f7e5c156ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50914/0 (socket says 172.21.15.90:50914) 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e62245640 1 -- 172.21.15.90:0/4209992853 learned_addr learned my addr 172.21.15.90:0/4209992853 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813140214 0 0) 0x7f7e5c0c54c0 con 0x7f7e5c156810 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e48003520 con 0x7f7e5c156810 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e61a44640 1 --2- 172.21.15.90:0/4209992853 >> v2:172.21.15.175:3300/0 conn(0x7f7e5c0c27a0 0x7f7e5c153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e61243640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 0x7f7e5c153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.736+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 609602558 0 0) 0x7f7e48003520 con 0x7f7e5c156810 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 msgr2=0x7f7e5c153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 0x7f7e5c153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 >> v2:172.21.15.175:3300/0 conn(0x7f7e5c0c27a0 msgr2=0x7f7e5c153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 --2- 172.21.15.90:0/4209992853 >> v2:172.21.15.175:3300/0 conn(0x7f7e5c0c27a0 0x7f7e5c153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c15ab70 con 0x7f7e5c156810 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f7e540019f0 con 0x7f7e5c156810 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 >> v1:172.21.15.90:6789/0 conn(0x7f7e5c156810 legacy=0x7f7e5c156ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 0x7f7e480039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e48003f30 0x7f7e48004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48004d40 0x7f7e480051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c071bb0 con 0x7f7e48003f30 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c071720 con 0x7f7e48004d40 2024-04-20T10:55:25.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7e4800ba10 con 0x7f7e5c0aea30 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e61243640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e48003f30 0x7f7e48004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e61a44640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 0x7f7e480039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e62245640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48004d40 0x7f7e480051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e61243640 1 -- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 msgr2=0x7f7e480039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e61243640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c0aea30 0x7f7e480039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e61243640 1 -- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48004d40 msgr2=0x7f7e480051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e61243640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48004d40 0x7f7e480051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e61243640 1 -- 172.21.15.90:0/4209992853 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e48003520 con 0x7f7e48003f30 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.737+0000 7f7e62245640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48004d40 0x7f7e480051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.738+0000 7f7e61243640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e48003f30 0x7f7e48004800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009af0 tx=0x7f7e48005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f543325fc8377d77 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.738+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c039070 con 0x7f7e48003f30 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.738+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e4c02c6b0 con 0x7f7e48003f30 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.738+0000 7f7e60a42640 1 -- 172.21.15.90:0/4209992853 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e4c009690 con 0x7f7e48003f30 2024-04-20T10:55:25.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.738+0000 7f7e63ca8640 1 -- 172.21.15.90:0/4209992853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e48003f30 msgr2=0x7f7e48004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:25.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.738+0000 7f7e63ca8640 1 --2- 172.21.15.90:0/4209992853 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e48003f30 0x7f7e48004800 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f7e4c009af0 tx=0x7f7e48005830 comp rx=0 tx=0).stop 2024-04-20T10:55:25.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.739+0000 7f7e62245640 1 -- 172.21.15.90:0/4209992853 reap_dead start 2024-04-20T10:55:25.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.739+0000 7f7e63ca8640 1 -- 172.21.15.90:0/4209992853 shutdown_connections 2024-04-20T10:55:25.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.739+0000 7f7e63ca8640 1 -- 172.21.15.90:0/4209992853 >> 172.21.15.90:0/4209992853 conn(0x7f7e5c0c9100 msgr2=0x7f7e5c0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:25.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.739+0000 7f7e63ca8640 1 -- 172.21.15.90:0/4209992853 shutdown_connections 2024-04-20T10:55:25.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.739+0000 7f7e63ca8640 1 -- 172.21.15.90:0/4209992853 wait complete. 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 Processor -- start 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 -- start start 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48003f30 0x7f7e5c1f03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c151ea0 0x7f7e5c14e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e5c154fa0 0x7f7e5c1ecb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c15a910 con 0x7f7e5c154fa0 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5c15a790 con 0x7f7e48003f30 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.740+0000 7f7e63ca8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7e5c0c2b80 con 0x7f7e5c151ea0 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e5c154fa0 0x7f7e5c1ecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e5c154fa0 0x7f7e5c1ecb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33586/0 (socket says 172.21.15.90:33586) 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 -- 172.21.15.90:0/3856391711 learned_addr learned my addr 172.21.15.90:0/3856391711 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e61a44640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48003f30 0x7f7e5c1f03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e61243640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c151ea0 0x7f7e5c14e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 -- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c151ea0 msgr2=0x7f7e5c14e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c151ea0 0x7f7e5c14e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 -- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48003f30 msgr2=0x7f7e5c1f03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48003f30 0x7f7e5c1f03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 -- 172.21.15.90:0/3856391711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5c154db0 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e62245640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e5c154fa0 0x7f7e5c1ecb80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c06f320 tx=0x7f7e5400e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e527fc640 1 -- 172.21.15.90:0/3856391711 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e5400eb30 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e527fc640 1 -- 172.21.15.90:0/3856391711 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e5400ecd0 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e527fc640 1 -- 172.21.15.90:0/3856391711 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e540146c0 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5c1f0930 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.741+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e5c158780 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.742+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e5c076150 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.743+0000 7f7e527fc640 1 -- 172.21.15.90:0/3856391711 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e5401b060 con 0x7f7e5c154fa0 2024-04-20T10:55:25.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.743+0000 7f7e527fc640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7e4006c8f0 0x7f7e4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:25.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.743+0000 7f7e527fc640 1 -- 172.21.15.90:0/3856391711 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7f7e5408b650 con 0x7f7e5c154fa0 2024-04-20T10:55:25.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.743+0000 7f7e61a44640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7e4006c8f0 0x7f7e4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:25.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.744+0000 7f7e61a44640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7e4006c8f0 0x7f7e4006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009c40 tx=0x7f7e58009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:25.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.748+0000 7f7e527fc640 1 -- 172.21.15.90:0/3856391711 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7e540595c0 con 0x7f7e5c154fa0 2024-04-20T10:55:25.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.962+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e5c072db0 con 0x7f7e5c154fa0 2024-04-20T10:55:25.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.962+0000 7f7e527fc640 1 -- 172.21.15.90:0/3856391711 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7f7e54058ec0 con 0x7f7e5c154fa0 2024-04-20T10:55:25.963 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:25.963 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:25.963 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7e4006c8f0 msgr2=0x7f7e4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7e4006c8f0 0x7f7e4006edb0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009c40 tx=0x7f7e58009190 comp rx=0 tx=0).stop 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e5c154fa0 msgr2=0x7f7e5c1ecb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e5c154fa0 0x7f7e5c1ecb80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f7e5c06f320 tx=0x7f7e5400e530 comp rx=0 tx=0).stop 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 shutdown_connections 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7e4006c8f0 0x7f7e4006edb0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7e5c154fa0 0x7f7e5c1ecb80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7e5c151ea0 0x7f7e5c14e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 --2- 172.21.15.90:0/3856391711 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7e48003f30 0x7f7e5c1f03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 >> 172.21.15.90:0/3856391711 conn(0x7f7e5c0c9100 msgr2=0x7f7e5c0ad6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 shutdown_connections 2024-04-20T10:55:25.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:25.964+0000 7f7e63ca8640 1 -- 172.21.15.90:0/3856391711 wait complete. 2024-04-20T10:55:25.976 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:27.976 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:28.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.076+0000 7fbe40b96640 1 Processor -- start 2024-04-20T10:55:28.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.076+0000 7fbe40b96640 1 -- start start 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe40b96640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbe3c0ab730 0x7fbe3c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe40b96640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe3c0c9ee0 0x7fbe3c156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe40b96640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c15a720 con 0x7fbe3c153ef0 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe40b96640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fbe3c15ac80 con 0x7fbe3c0c9ee0 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe40b96640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbe3c15a9a0 con 0x7fbe3c0ab730 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe3ad9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe3c0c9ee0 0x7fbe3c156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe3ad9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fbe3c0c9ee0 0x7fbe3c156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33596/0 (socket says 172.21.15.90:33596) 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe3ad9d640 1 -- 172.21.15.90:0/4091264763 learned_addr learned my addr 172.21.15.90:0/4091264763 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.077+0000 7fbe39d9b640 1 --2- 172.21.15.90:0/4091264763 >> v2:172.21.15.175:3300/0 conn(0x7fbe3c0ab730 0x7fbe3c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:28.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.078+0000 7fbe3ad9d640 1 -- 172.21.15.90:0/4091264763 >> v2:172.21.15.175:3300/0 conn(0x7fbe3c0ab730 msgr2=0x7fbe3c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:28.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.078+0000 7fbe3ad9d640 1 --2- 172.21.15.90:0/4091264763 >> v2:172.21.15.175:3300/0 conn(0x7fbe3c0ab730 0x7fbe3c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.078+0000 7fbe3ad9d640 1 -- 172.21.15.90:0/4091264763 >> v1:172.21.15.175:6789/0 conn(0x7fbe3c153ef0 legacy=0x7fbe3c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:28.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.078+0000 7fbe3ad9d640 1 -- 172.21.15.90:0/4091264763 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c0c6a90 con 0x7fbe3c0c9ee0 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.078+0000 7fbe3ad9d640 1 --2- 172.21.15.90:0/4091264763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0c9ee0 0x7fbe3c156e00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0b2190 tx=0x7fbe3402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b31a8ccd5bbca0cf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.078+0000 7fbe3959a640 1 -- 172.21.15.90:0/4091264763 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe3402e070 con 0x7fbe3c0c9ee0 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.078+0000 7fbe3959a640 1 -- 172.21.15.90:0/4091264763 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe34037070 con 0x7fbe3c0c9ee0 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe3959a640 1 -- 172.21.15.90:0/4091264763 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe34031a00 con 0x7fbe3c0c9ee0 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 -- 172.21.15.90:0/4091264763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0c9ee0 msgr2=0x7fbe3c156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 --2- 172.21.15.90:0/4091264763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0c9ee0 0x7fbe3c156e00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0b2190 tx=0x7fbe3402b880 comp rx=0 tx=0).stop 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 -- 172.21.15.90:0/4091264763 shutdown_connections 2024-04-20T10:55:28.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 --2- 172.21.15.90:0/4091264763 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0c9ee0 0x7fbe3c156e00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 --2- 172.21.15.90:0/4091264763 >> v2:172.21.15.175:3300/0 conn(0x7fbe3c0ab730 0x7fbe3c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 -- 172.21.15.90:0/4091264763 >> 172.21.15.90:0/4091264763 conn(0x7fbe3c0cbfe0 msgr2=0x7fbe3c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 -- 172.21.15.90:0/4091264763 shutdown_connections 2024-04-20T10:55:28.082 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.079+0000 7fbe40b96640 1 -- 172.21.15.90:0/4091264763 wait complete. 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.080+0000 7fbe40b96640 1 Processor -- start 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.080+0000 7fbe40b96640 1 -- start start 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe40b96640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0ab730 0x7fbe3c1ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe40b96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe3c0c9ee0 0x7fbe3c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe40b96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe3c153ef0 0x7fbe3c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe40b96640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c0c9280 con 0x7fbe3c0ab730 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe40b96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbe3c0c9100 con 0x7fbe3c0c9ee0 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe40b96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbe3c0bf800 con 0x7fbe3c153ef0 2024-04-20T10:55:28.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe3a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0ab730 0x7fbe3c1ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe3a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0ab730 0x7fbe3c1ec330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33604/0 (socket says 172.21.15.90:33604) 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe3a59c640 1 -- 172.21.15.90:0/258004518 learned_addr learned my addr 172.21.15.90:0/258004518 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe39d9b640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe3c0c9ee0 0x7fbe3c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.081+0000 7fbe3ad9d640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe3c153ef0 0x7fbe3c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe3a59c640 1 -- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe3c153ef0 msgr2=0x7fbe3c1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe3a59c640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe3c153ef0 0x7fbe3c1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe3a59c640 1 -- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe3c0c9ee0 msgr2=0x7fbe3c150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe3a59c640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe3c0c9ee0 0x7fbe3c150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe3a59c640 1 -- 172.21.15.90:0/258004518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c151800 con 0x7fbe3c0ab730 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe3a59c640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0ab730 0x7fbe3c1ec330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00c730 tx=0x7fbe2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe2affd640 1 -- 172.21.15.90:0/258004518 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c016020 con 0x7fbe3c0ab730 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe2affd640 1 -- 172.21.15.90:0/258004518 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe2c006d50 con 0x7fbe3c0ab730 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe2affd640 1 -- 172.21.15.90:0/258004518 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2c003bb0 con 0x7fbe3c0ab730 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3c0c4100 con 0x7fbe3c0ab730 2024-04-20T10:55:28.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.082+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe3c1ece50 con 0x7fbe3c0ab730 2024-04-20T10:55:28.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.083+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe3c0c6630 con 0x7fbe3c0ab730 2024-04-20T10:55:28.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.083+0000 7fbe2affd640 1 -- 172.21.15.90:0/258004518 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbe2c00a850 con 0x7fbe3c0ab730 2024-04-20T10:55:28.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.084+0000 7fbe2affd640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe1c06c8f0 0x7fbe1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:28.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.084+0000 7fbe2affd640 1 -- 172.21.15.90:0/258004518 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 7067+0+0 (secure 0 0 0) 0x7fbe2c08bba0 con 0x7fbe3c0ab730 2024-04-20T10:55:28.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.084+0000 7fbe39d9b640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe1c06c8f0 0x7fbe1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:28.087 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.084+0000 7fbe39d9b640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe1c06c8f0 0x7fbe1c06edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c15a1e0 tx=0x7fbe30009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:28.089 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.088+0000 7fbe2affd640 1 -- 172.21.15.90:0/258004518 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbe3c0c6630 con 0x7fbe3c0ab730 2024-04-20T10:55:28.299 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.298+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe3c076150 con 0x7fbe3c0ab730 2024-04-20T10:55:28.300 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.299+0000 7fbe2affd640 1 -- 172.21.15.90:0/258004518 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) ==== 94+0+6527 (secure 0 0 0) 0x7fbe2c020020 con 0x7fbe3c0ab730 2024-04-20T10:55:28.300 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:28.301 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5562,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:53:39.341370+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":30,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5271":{"gid":5271,"name":"c","rank":0,"incarnation":21,"state":"up:active","state_seq":15,"addr":"172.21.15.90:6837/1538296646","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1538296646},{"type":"v1","addr":"172.21.15.90:6837","nonce":1538296646}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5271,"qdb_cluster":[5271]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:28.301 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 38 2024-04-20T10:55:28.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe1c06c8f0 msgr2=0x7fbe1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:28.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe1c06c8f0 0x7fbe1c06edb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c15a1e0 tx=0x7fbe30009190 comp rx=0 tx=0).stop 2024-04-20T10:55:28.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0ab730 msgr2=0x7fbe3c1ec330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0ab730 0x7fbe3c1ec330 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00c730 tx=0x7fbe2c00cbf0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 shutdown_connections 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe1c06c8f0 0x7fbe1c06edb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbe3c153ef0 0x7fbe3c1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbe3c0c9ee0 0x7fbe3c150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 --2- 172.21.15.90:0/258004518 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbe3c0ab730 0x7fbe3c1ec330 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 >> 172.21.15.90:0/258004518 conn(0x7fbe3c0cbfe0 msgr2=0x7fbe3c0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 shutdown_connections 2024-04-20T10:55:28.303 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:28.301+0000 7fbe40b96640 1 -- 172.21.15.90:0/258004518 wait complete. 2024-04-20T10:55:28.314 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:55:30.314 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:30.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.444+0000 7feac037e640 1 Processor -- start 2024-04-20T10:55:30.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.445+0000 7feac037e640 1 -- start start 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.445+0000 7feac037e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7feab8157190 0x7feab806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.445+0000 7feac037e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab80adce0 con 0x7feab8153ee0 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.445+0000 7feac037e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feab80adfc0 con 0x7feab80ab710 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.445+0000 7feac037e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7feab80ae2a0 con 0x7feab8157190 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.446+0000 7feabe11a640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7feab8153ee0 0x7feab80c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50928/0 (socket says 172.21.15.90:50928) 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.446+0000 7feabe11a640 1 -- 172.21.15.90:0/1290404728 learned_addr learned my addr 172.21.15.90:0/1290404728 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.446+0000 7feabe91b640 1 --2- 172.21.15.90:0/1290404728 >> v2:172.21.15.90:3300/0 conn(0x7feab8157190 0x7feab806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.446+0000 7feabe91b640 1 -- 172.21.15.90:0/1290404728 >> v1:172.21.15.175:6789/0 conn(0x7feab80ab710 legacy=0x7feab806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.446+0000 7feabe91b640 1 -- 172.21.15.90:0/1290404728 >> v1:172.21.15.90:6789/0 conn(0x7feab8153ee0 legacy=0x7feab80c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.446+0000 7feabe91b640 1 -- 172.21.15.90:0/1290404728 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab806d120 con 0x7feab8157190 2024-04-20T10:55:30.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.446+0000 7feabd118640 1 -- 172.21.15.90:0/1290404728 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2458965174 0 0) 0x7feab80adce0 con 0x7feab8153ee0 2024-04-20T10:55:30.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.447+0000 7feabe91b640 1 --2- 172.21.15.90:0/1290404728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab8157190 0x7feab806cbe0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feab0009d90 tx=0x7feab002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba9ee49340f3e3f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:30.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.447+0000 7feabd118640 1 -- 172.21.15.90:0/1290404728 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0039070 con 0x7feab8157190 2024-04-20T10:55:30.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.447+0000 7feabd118640 1 -- 172.21.15.90:0/1290404728 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab002cbd0 con 0x7feab8157190 2024-04-20T10:55:30.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.447+0000 7feabd118640 1 -- 172.21.15.90:0/1290404728 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0034440 con 0x7feab8157190 2024-04-20T10:55:30.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.448+0000 7feac037e640 1 -- 172.21.15.90:0/1290404728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab8157190 msgr2=0x7feab806cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.448+0000 7feac037e640 1 --2- 172.21.15.90:0/1290404728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab8157190 0x7feab806cbe0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feab0009d90 tx=0x7feab002be20 comp rx=0 tx=0).stop 2024-04-20T10:55:30.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.448+0000 7feac037e640 1 -- 172.21.15.90:0/1290404728 shutdown_connections 2024-04-20T10:55:30.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.448+0000 7feac037e640 1 --2- 172.21.15.90:0/1290404728 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab8157190 0x7feab806cbe0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.448+0000 7feac037e640 1 -- 172.21.15.90:0/1290404728 >> 172.21.15.90:0/1290404728 conn(0x7feab80cc060 msgr2=0x7feab80cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:30.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.448+0000 7feac037e640 1 -- 172.21.15.90:0/1290404728 shutdown_connections 2024-04-20T10:55:30.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.448+0000 7feac037e640 1 -- 172.21.15.90:0/1290404728 wait complete. 2024-04-20T10:55:30.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.449+0000 7feac037e640 1 Processor -- start 2024-04-20T10:55:30.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.449+0000 7feac037e640 1 -- start start 2024-04-20T10:55:30.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.450+0000 7feac037e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab80ab710 0x7feab81577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feac037e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab8153ee0 0x7feab80c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feac037e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab8157190 0x7feab80c0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feac037e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7feab80bf950 con 0x7feab80ab710 2024-04-20T10:55:30.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feac037e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7feab80bf7d0 con 0x7feab8157190 2024-04-20T10:55:30.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feac037e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7feab80caf70 con 0x7feab8153ee0 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab80ab710 0x7feab81577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab80ab710 0x7feab81577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33624/0 (socket says 172.21.15.90:33624) 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 -- 172.21.15.90:0/1468792281 learned_addr learned my addr 172.21.15.90:0/1468792281 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe91b640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab8157190 0x7feab80c0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabd919640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab8153ee0 0x7feab80c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 -- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab8153ee0 msgr2=0x7feab80c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab8153ee0 0x7feab80c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 -- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab8157190 msgr2=0x7feab80c0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab8157190 0x7feab80c0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 -- 172.21.15.90:0/1468792281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab8159bb0 con 0x7feab80ab710 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feabe11a640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab80ab710 0x7feab81577c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7feab400c4a0 tx=0x7feab400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feaaeffd640 1 -- 172.21.15.90:0/1468792281 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4018070 con 0x7feab80ab710 2024-04-20T10:55:30.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feaaeffd640 1 -- 172.21.15.90:0/1468792281 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feab40074e0 con 0x7feab80ab710 2024-04-20T10:55:30.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feab81e3720 con 0x7feab80ab710 2024-04-20T10:55:30.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.451+0000 7feaaeffd640 1 -- 172.21.15.90:0/1468792281 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab4004a20 con 0x7feab80ab710 2024-04-20T10:55:30.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.452+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feab80bfc00 con 0x7feab80ab710 2024-04-20T10:55:30.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.453+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab8076150 con 0x7feab80ab710 2024-04-20T10:55:30.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.453+0000 7feaaeffd640 1 -- 172.21.15.90:0/1468792281 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feab401b070 con 0x7feab80ab710 2024-04-20T10:55:30.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.454+0000 7feaaeffd640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fea9c06c8f0 0x7fea9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.454+0000 7feabd919640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fea9c06c8f0 0x7fea9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.454+0000 7feaaeffd640 1 -- 172.21.15.90:0/1468792281 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7feab408b280 con 0x7feab80ab710 2024-04-20T10:55:30.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.454+0000 7feabd919640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fea9c06c8f0 0x7fea9c06edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feab8156250 tx=0x7feaa8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:30.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.458+0000 7feaaeffd640 1 -- 172.21.15.90:0/1468792281 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7feab4058b40 con 0x7feab80ab710 2024-04-20T10:55:30.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.702+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7feab806d910 con 0x7feab80ab710 2024-04-20T10:55:30.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.703+0000 7feaaeffd640 1 -- 172.21.15.90:0/1468792281 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5694 (secure 0 0 0) 0x7feab405ce40 con 0x7feab80ab710 2024-04-20T10:55:30.704 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:30.704 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:30.341964+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:30.704 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 39 2024-04-20T10:55:30.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fea9c06c8f0 msgr2=0x7fea9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fea9c06c8f0 0x7fea9c06edb0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7feab8156250 tx=0x7feaa8009040 comp rx=0 tx=0).stop 2024-04-20T10:55:30.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab80ab710 msgr2=0x7feab81577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.706 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab80ab710 0x7feab81577c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7feab400c4a0 tx=0x7feab400c960 comp rx=0 tx=0).stop 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 shutdown_connections 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fea9c06c8f0 0x7fea9c06edb0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7feab8157190 0x7feab80c0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7feab8153ee0 0x7feab80c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 --2- 172.21.15.90:0/1468792281 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7feab80ab710 0x7feab81577c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 >> 172.21.15.90:0/1468792281 conn(0x7feab80cc060 msgr2=0x7feab8155660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 shutdown_connections 2024-04-20T10:55:30.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.705+0000 7feac037e640 1 -- 172.21.15.90:0/1468792281 wait complete. 2024-04-20T10:55:30.717 INFO:tasks.mds_thrash.fs.[a]:mds.c down, removed from mdsmap 2024-04-20T10:55:30.717 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-20T10:55:30.717 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:30.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.815+0000 7fe755d23640 1 Processor -- start 2024-04-20T10:55:30.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.815+0000 7fe755d23640 1 -- start start 2024-04-20T10:55:30.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe755d23640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe7500ab730 0x7fe7501568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe755d23640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe7500c9ee0 0x7fe750156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe755d23640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe75015a720 con 0x7fe750153ef0 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe755d23640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fe75015ac80 con 0x7fe7500c9ee0 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe755d23640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe75015a9a0 con 0x7fe7500ab730 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fe7500c9ee0 0x7fe750156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74f7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe750153ef0 0x7fe7500c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50934/0 (socket says 172.21.15.90:50934) 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74f7fe640 1 -- 172.21.15.90:0/2432885975 learned_addr learned my addr 172.21.15.90:0/2432885975 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74effd640 1 --2- 172.21.15.90:0/2432885975 >> v2:172.21.15.175:3300/0 conn(0x7fe7500ab730 0x7fe7501568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74ffff640 1 -- 172.21.15.90:0/2432885975 >> v2:172.21.15.175:3300/0 conn(0x7fe7500ab730 msgr2=0x7fe7501568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74ffff640 1 --2- 172.21.15.90:0/2432885975 >> v2:172.21.15.175:3300/0 conn(0x7fe7500ab730 0x7fe7501568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74ffff640 1 -- 172.21.15.90:0/2432885975 >> v1:172.21.15.90:6789/0 conn(0x7fe750153ef0 legacy=0x7fe7500c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.818 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74e7fc640 1 -- 172.21.15.90:0/2432885975 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482890393 0 0) 0x7fe740001110 con 0x7fe750153ef0 2024-04-20T10:55:30.819 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.816+0000 7fe74ffff640 1 -- 172.21.15.90:0/2432885975 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7500c6a90 con 0x7fe7500c9ee0 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.817+0000 7fe74ffff640 1 --2- 172.21.15.90:0/2432885975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500c9ee0 0x7fe750156e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe7500b2190 tx=0x7fe74802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717ac32f1f5f353b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe74e7fc640 1 -- 172.21.15.90:0/2432885975 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748039070 con 0x7fe7500c9ee0 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe74e7fc640 1 -- 172.21.15.90:0/2432885975 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe74802cb60 con 0x7fe7500c9ee0 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe74e7fc640 1 -- 172.21.15.90:0/2432885975 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe748034440 con 0x7fe7500c9ee0 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 -- 172.21.15.90:0/2432885975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500c9ee0 msgr2=0x7fe750156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 --2- 172.21.15.90:0/2432885975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500c9ee0 0x7fe750156e00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe7500b2190 tx=0x7fe74802bdb0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 -- 172.21.15.90:0/2432885975 shutdown_connections 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 --2- 172.21.15.90:0/2432885975 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500c9ee0 0x7fe750156e00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 --2- 172.21.15.90:0/2432885975 >> v2:172.21.15.175:3300/0 conn(0x7fe7500ab730 0x7fe7501568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 -- 172.21.15.90:0/2432885975 >> 172.21.15.90:0/2432885975 conn(0x7fe7500cbfe0 msgr2=0x7fe7500cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 -- 172.21.15.90:0/2432885975 shutdown_connections 2024-04-20T10:55:30.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.818+0000 7fe755d23640 1 -- 172.21.15.90:0/2432885975 wait complete. 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.819+0000 7fe755d23640 1 Processor -- start 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe755d23640 1 -- start start 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe755d23640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500ab730 0x7fe7501ed0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe755d23640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7500c9ee0 0x7fe7501594c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe755d23640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe750153ef0 0x7fe7501efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe755d23640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe7500c9280 con 0x7fe7500ab730 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe755d23640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe7500c9100 con 0x7fe7500c9ee0 2024-04-20T10:55:30.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe755d23640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe7500bf800 con 0x7fe750153ef0 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe74f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500ab730 0x7fe7501ed0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe74f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500ab730 0x7fe7501ed0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33636/0 (socket says 172.21.15.90:33636) 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe74f7fe640 1 -- 172.21.15.90:0/2107178109 learned_addr learned my addr 172.21.15.90:0/2107178109 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe74effd640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7500c9ee0 0x7fe7501594c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.820+0000 7fe74ffff640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe750153ef0 0x7fe7501efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe74f7fe640 1 -- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe750153ef0 msgr2=0x7fe7501efa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe74f7fe640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe750153ef0 0x7fe7501efa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe74f7fe640 1 -- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7500c9ee0 msgr2=0x7fe7501594c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe74f7fe640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7500c9ee0 0x7fe7501594c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe74f7fe640 1 -- 172.21.15.90:0/2107178109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7501e9900 con 0x7fe7500ab730 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe74f7fe640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500ab730 0x7fe7501ed0d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c460 tx=0x7fe74000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe737fff640 1 -- 172.21.15.90:0/2107178109 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740018070 con 0x7fe7500ab730 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe737fff640 1 -- 172.21.15.90:0/2107178109 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe740007500 con 0x7fe7500ab730 2024-04-20T10:55:30.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7501ef270 con 0x7fe7500ab730 2024-04-20T10:55:30.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe737fff640 1 -- 172.21.15.90:0/2107178109 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe740004a20 con 0x7fe7500ab730 2024-04-20T10:55:30.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.821+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7501ecb60 con 0x7fe7500ab730 2024-04-20T10:55:30.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.822+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe750076150 con 0x7fe7500ab730 2024-04-20T10:55:30.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.823+0000 7fe737fff640 1 -- 172.21.15.90:0/2107178109 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe74001b070 con 0x7fe7500ab730 2024-04-20T10:55:30.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.823+0000 7fe737fff640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe73c06c920 0x7fe73c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:30.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.824+0000 7fe737fff640 1 -- 172.21.15.90:0/2107178109 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fe74008b200 con 0x7fe7500ab730 2024-04-20T10:55:30.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.824+0000 7fe74effd640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe73c06c920 0x7fe73c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:30.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.824+0000 7fe74effd640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe73c06c920 0x7fe73c06ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe75015a6a0 tx=0x7fe744009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:30.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:30.828+0000 7fe737fff640 1 -- 172.21.15.90:0/2107178109 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe75015a720 con 0x7fe7500ab730 2024-04-20T10:55:31.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.053+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe75006d070 con 0x7fe7500ab730 2024-04-20T10:55:31.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.054+0000 7fe737fff640 1 -- 172.21.15.90:0/2107178109 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5694 (secure 0 0 0) 0x7fe740058ac0 con 0x7fe7500ab730 2024-04-20T10:55:31.055 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:31.055 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:30.341964+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:31.055 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 39 2024-04-20T10:55:31.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe73c06c920 msgr2=0x7fe73c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:31.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe73c06c920 0x7fe73c06ede0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe75015a6a0 tx=0x7fe744009190 comp rx=0 tx=0).stop 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500ab730 msgr2=0x7fe7501ed0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500ab730 0x7fe7501ed0d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fe74000c460 tx=0x7fe74000c920 comp rx=0 tx=0).stop 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 shutdown_connections 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe73c06c920 0x7fe73c06ede0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe750153ef0 0x7fe7501efa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe7500c9ee0 0x7fe7501594c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 --2- 172.21.15.90:0/2107178109 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe7500ab730 0x7fe7501ed0d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 >> 172.21.15.90:0/2107178109 conn(0x7fe7500cbfe0 msgr2=0x7fe7500cc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 shutdown_connections 2024-04-20T10:55:31.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:31.056+0000 7fe755d23640 1 -- 172.21.15.90:0/2107178109 wait complete. 2024-04-20T10:55:31.069 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 39, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 39, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5562": { "addr": "172.21.15.90:6835/732131803", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6834", "nonce": 732131803, "type": "v2" }, { "addr": "172.21.15.90:6835", "nonce": 732131803, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5562, "incarnation": 39, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:55:30.341964+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5562 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 37, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5239": { "addr": "172.21.15.175:6833/133567489", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6832", "nonce": 133567489, "type": "v2" }, { "addr": "172.21.15.175:6833", "nonce": 133567489, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5239, "incarnation": 33, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 12 } }, "last_failure": 0, "last_failure_osd_epoch": 32, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:54:55.558247+0000", "qdb_cluster": [ 5239 ], "qdb_leader": 5239, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5239 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:55:33.070 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.170+0000 7fa787af2640 1 Processor -- start 2024-04-20T10:55:33.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.170+0000 7fa787af2640 1 -- start start 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa787af2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa780153cc0 0x7fa780157110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa787af2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa7800c5520 0x7fa7800c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa787af2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa780071570 con 0x7fa7800c2a70 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa787af2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa7801540a0 con 0x7fa780153cc0 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa787af2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa7800c4010 con 0x7fa7800c5520 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa78588e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa780153cc0 0x7fa780157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa78608f640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa7800c2a70 0x7fa7800c44a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50940/0 (socket says 172.21.15.90:50940) 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa78608f640 1 -- 172.21.15.90:0/3444218533 learned_addr learned my addr 172.21.15.90:0/3444218533 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.171+0000 7fa78508d640 1 --2- 172.21.15.90:0/3444218533 >> v2:172.21.15.175:3300/0 conn(0x7fa7800c5520 0x7fa7800c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78588e640 1 -- 172.21.15.90:0/3444218533 >> v2:172.21.15.175:3300/0 conn(0x7fa7800c5520 msgr2=0x7fa7800c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78588e640 1 --2- 172.21.15.90:0/3444218533 >> v2:172.21.15.175:3300/0 conn(0x7fa7800c5520 0x7fa7800c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78588e640 1 -- 172.21.15.90:0/3444218533 >> v1:172.21.15.90:6789/0 conn(0x7fa7800c2a70 legacy=0x7fa7800c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:33.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78588e640 1 -- 172.21.15.90:0/3444218533 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780071850 con 0x7fa780153cc0 2024-04-20T10:55:33.174 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78488c640 1 -- 172.21.15.90:0/3444218533 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448842372 0 0) 0x7fa780071570 con 0x7fa7800c2a70 2024-04-20T10:55:33.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78588e640 1 --2- 172.21.15.90:0/3444218533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa780153cc0 0x7fa780157110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa7800c3030 tx=0x7fa77c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92483826bd9e91de server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:33.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78488c640 1 -- 172.21.15.90:0/3444218533 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c039070 con 0x7fa780153cc0 2024-04-20T10:55:33.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78488c640 1 -- 172.21.15.90:0/3444218533 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77c02cc80 con 0x7fa780153cc0 2024-04-20T10:55:33.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.172+0000 7fa78488c640 1 -- 172.21.15.90:0/3444218533 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77c034660 con 0x7fa780153cc0 2024-04-20T10:55:33.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 -- 172.21.15.90:0/3444218533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa780153cc0 msgr2=0x7fa780157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 --2- 172.21.15.90:0/3444218533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa780153cc0 0x7fa780157110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fa7800c3030 tx=0x7fa77c02bed0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 -- 172.21.15.90:0/3444218533 shutdown_connections 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 --2- 172.21.15.90:0/3444218533 >> v2:172.21.15.175:3300/0 conn(0x7fa7800c5520 0x7fa7800c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 --2- 172.21.15.90:0/3444218533 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa780153cc0 0x7fa780157110 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 -- 172.21.15.90:0/3444218533 >> 172.21.15.90:0/3444218533 conn(0x7fa7800c9100 msgr2=0x7fa7800c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 -- 172.21.15.90:0/3444218533 shutdown_connections 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.173+0000 7fa787af2640 1 -- 172.21.15.90:0/3444218533 wait complete. 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.174+0000 7fa787af2640 1 Processor -- start 2024-04-20T10:55:33.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.174+0000 7fa787af2640 1 -- start start 2024-04-20T10:55:33.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa787af2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7800c2a70 0x7fa78006b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:33.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa787af2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7800c5520 0x7fa7801ef8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:33.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa787af2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa780153cc0 0x7fa78006d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:33.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa787af2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800c4bb0 con 0x7fa7800c5520 2024-04-20T10:55:33.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa787af2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa78006f560 con 0x7fa7800c2a70 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa787af2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa7800c4d30 con 0x7fa780153cc0 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7800c5520 0x7fa7801ef8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7800c5520 0x7fa7801ef8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33652/0 (socket says 172.21.15.90:33652) 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 -- 172.21.15.90:0/676776022 learned_addr learned my addr 172.21.15.90:0/676776022 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78588e640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7800c2a70 0x7fa78006b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78608f640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa780153cc0 0x7fa78006d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 -- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa780153cc0 msgr2=0x7fa78006d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa780153cc0 0x7fa78006d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 -- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7800c2a70 msgr2=0x7fa78006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7800c2a70 0x7fa78006b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 -- 172.21.15.90:0/676776022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa780154990 con 0x7fa7800c5520 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78608f640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa780153cc0 0x7fa78006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.175+0000 7fa78508d640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7800c5520 0x7fa7801ef8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa77000e9b0 tx=0x7fa77000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.176+0000 7fa7767fc640 1 -- 172.21.15.90:0/676776022 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa770017070 con 0x7fa7800c5520 2024-04-20T10:55:33.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.176+0000 7fa7767fc640 1 -- 172.21.15.90:0/676776022 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa77000c9a0 con 0x7fa7800c5520 2024-04-20T10:55:33.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.176+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa780154c70 con 0x7fa7800c5520 2024-04-20T10:55:33.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.176+0000 7fa7767fc640 1 -- 172.21.15.90:0/676776022 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77000cd90 con 0x7fa7800c5520 2024-04-20T10:55:33.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.176+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78006d2b0 con 0x7fa7800c5520 2024-04-20T10:55:33.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.177+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa780076150 con 0x7fa7800c5520 2024-04-20T10:55:33.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.177+0000 7fa7767fc640 1 -- 172.21.15.90:0/676776022 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa77001a070 con 0x7fa7800c5520 2024-04-20T10:55:33.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.178+0000 7fa7767fc640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa76406c8f0 0x7fa76406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:33.180 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.178+0000 7fa78588e640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa76406c8f0 0x7fa76406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:33.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.178+0000 7fa7767fc640 1 -- 172.21.15.90:0/676776022 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fa77008c3c0 con 0x7fa7800c5520 2024-04-20T10:55:33.181 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.178+0000 7fa78588e640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa76406c8f0 0x7fa76406edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa77c036000 tx=0x7fa77c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:33.183 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.183+0000 7fa7767fc640 1 -- 172.21.15.90:0/676776022 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa770059c80 con 0x7fa7800c5520 2024-04-20T10:55:33.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.401+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7801512c0 con 0x7fa7800c5520 2024-04-20T10:55:33.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.402+0000 7fa7767fc640 1 -- 172.21.15.90:0/676776022 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5698 (secure 0 0 0) 0x7fa77005df80 con 0x7fa7800c5520 2024-04-20T10:55:33.403 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:33.403 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:32.801488+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:reconnect","state_seq":10,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:33.404 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 40 2024-04-20T10:55:33.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa76406c8f0 msgr2=0x7fa76406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:33.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa76406c8f0 0x7fa76406edb0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa77c036000 tx=0x7fa77c030000 comp rx=0 tx=0).stop 2024-04-20T10:55:33.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7800c5520 msgr2=0x7fa7801ef8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:33.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7800c5520 0x7fa7801ef8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa77000e9b0 tx=0x7fa77000ee70 comp rx=0 tx=0).stop 2024-04-20T10:55:33.405 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 shutdown_connections 2024-04-20T10:55:33.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa76406c8f0 0x7fa76406edb0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa780153cc0 0x7fa78006d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7800c5520 0x7fa7801ef8f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 --2- 172.21.15.90:0/676776022 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa7800c2a70 0x7fa78006b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:33.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 >> 172.21.15.90:0/676776022 conn(0x7fa7800c9100 msgr2=0x7fa780152870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:33.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 shutdown_connections 2024-04-20T10:55:33.406 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:33.404+0000 7fa787af2640 1 -- 172.21.15.90:0/676776022 wait complete. 2024-04-20T10:55:33.416 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-20T10:55:35.417 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:35.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.551+0000 7ff9d1915640 1 Processor -- start 2024-04-20T10:55:35.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.551+0000 7ff9d1915640 1 -- start start 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.551+0000 7ff9d1915640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc153ef0 0x7ff9cc0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.551+0000 7ff9d1915640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff9cc0ab730 0x7ff9cc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.551+0000 7ff9d1915640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9cc15a720 con 0x7ff9cc0c9ee0 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.551+0000 7ff9d1915640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff9cc15ac80 con 0x7ff9cc0ab730 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.551+0000 7ff9d1915640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc15a9a0 con 0x7ff9cc153ef0 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9ca7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff9cc0ab730 0x7ff9cc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9cb7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff9cc0c9ee0 0x7ff9cc156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:32816/0 (socket says 172.21.15.90:32816) 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9cb7fe640 1 -- 172.21.15.90:0/2731747565 learned_addr learned my addr 172.21.15.90:0/2731747565 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9caffd640 1 --2- 172.21.15.90:0/2731747565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc153ef0 0x7ff9cc0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9ca7fc640 1 -- 172.21.15.90:0/2731747565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc153ef0 msgr2=0x7ff9cc0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:35.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9ca7fc640 1 --2- 172.21.15.90:0/2731747565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc153ef0 0x7ff9cc0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9ca7fc640 1 -- 172.21.15.90:0/2731747565 >> v1:172.21.15.90:6789/0 conn(0x7ff9cc0c9ee0 legacy=0x7ff9cc156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9c9ffb640 1 -- 172.21.15.90:0/2731747565 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695760603 0 0) 0x7ff9c4001490 con 0x7ff9cc0c9ee0 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9ca7fc640 1 -- 172.21.15.90:0/2731747565 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc0c6a90 con 0x7ff9cc0ab730 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.552+0000 7ff9caffd640 1 --2- 172.21.15.90:0/2731747565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc153ef0 0x7ff9cc0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9ca7fc640 1 --2- 172.21.15.90:0/2731747565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc0ab730 0x7ff9cc1568c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00097a0 tx=0x7ff9c002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802c36eeace63b75 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9c9ffb640 1 -- 172.21.15.90:0/2731747565 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0038070 con 0x7ff9cc0ab730 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9c9ffb640 1 -- 172.21.15.90:0/2731747565 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c0031700 con 0x7ff9cc0ab730 2024-04-20T10:55:35.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9c9ffb640 1 -- 172.21.15.90:0/2731747565 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0031ad0 con 0x7ff9cc0ab730 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9d1915640 1 -- 172.21.15.90:0/2731747565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc0ab730 msgr2=0x7ff9cc1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9d1915640 1 --2- 172.21.15.90:0/2731747565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc0ab730 0x7ff9cc1568c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff9c00097a0 tx=0x7ff9c002b7a0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9d1915640 1 -- 172.21.15.90:0/2731747565 shutdown_connections 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9d1915640 1 --2- 172.21.15.90:0/2731747565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc0ab730 0x7ff9cc1568c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9d1915640 1 --2- 172.21.15.90:0/2731747565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc153ef0 0x7ff9cc0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.553+0000 7ff9d1915640 1 -- 172.21.15.90:0/2731747565 >> 172.21.15.90:0/2731747565 conn(0x7ff9cc0cbfe0 msgr2=0x7ff9cc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.554+0000 7ff9d1915640 1 -- 172.21.15.90:0/2731747565 shutdown_connections 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.554+0000 7ff9d1915640 1 -- 172.21.15.90:0/2731747565 wait complete. 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 Processor -- start 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 -- start start 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc0ab730 0x7ff9cc158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:35.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9cc0c9ee0 0x7ff9cc1ed870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc153ef0 0x7ff9cc1eddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc0bf800 con 0x7ff9cc153ef0 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff9cc157510 con 0x7ff9cc0c9ee0 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9d1915640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff9cc0b1d70 con 0x7ff9cc0ab730 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.555+0000 7ff9cb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc153ef0 0x7ff9cc1eddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc153ef0 0x7ff9cc1eddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32930/0 (socket says 172.21.15.90:32930) 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 -- 172.21.15.90:0/1493926926 learned_addr learned my addr 172.21.15.90:0/1493926926 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9caffd640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc0ab730 0x7ff9cc158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9ca7fc640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9cc0c9ee0 0x7ff9cc1ed870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 -- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc0ab730 msgr2=0x7ff9cc158df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc0ab730 0x7ff9cc158df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 -- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9cc0c9ee0 msgr2=0x7ff9cc1ed870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9cc0c9ee0 0x7ff9cc1ed870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 -- 172.21.15.90:0/1493926926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9cc1f0740 con 0x7ff9cc153ef0 2024-04-20T10:55:35.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9cb7fe640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc153ef0 0x7ff9cc1eddb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400cb20 tx=0x7ff9c40021c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:35.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9b3fff640 1 -- 172.21.15.90:0/1493926926 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c400ac00 con 0x7ff9cc153ef0 2024-04-20T10:55:35.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9b3fff640 1 -- 172.21.15.90:0/1493926926 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9c400adc0 con 0x7ff9cc153ef0 2024-04-20T10:55:35.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9b3fff640 1 -- 172.21.15.90:0/1493926926 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c4012640 con 0x7ff9cc153ef0 2024-04-20T10:55:35.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9cc1ec710 con 0x7ff9cc153ef0 2024-04-20T10:55:35.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.556+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9cc1eccd0 con 0x7ff9cc153ef0 2024-04-20T10:55:35.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.558+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9cc076150 con 0x7ff9cc153ef0 2024-04-20T10:55:35.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.558+0000 7ff9b3fff640 1 -- 172.21.15.90:0/1493926926 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff9c40127e0 con 0x7ff9cc153ef0 2024-04-20T10:55:35.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.558+0000 7ff9b3fff640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff9b806c8f0 0x7ff9b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:35.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.559+0000 7ff9b3fff640 1 -- 172.21.15.90:0/1493926926 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7ff9c408c4f0 con 0x7ff9cc153ef0 2024-04-20T10:55:35.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.559+0000 7ff9caffd640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff9b806c8f0 0x7ff9b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:35.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.559+0000 7ff9caffd640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff9b806c8f0 0x7ff9b806edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc006fd0 tx=0x7ff9bc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:35.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.567+0000 7ff9b3fff640 1 -- 172.21.15.90:0/1493926926 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff9cc15a720 con 0x7ff9cc153ef0 2024-04-20T10:55:35.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.896+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9cc1ecea0 con 0x7ff9cc153ef0 2024-04-20T10:55:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.897+0000 7ff9b3fff640 1 -- 172.21.15.90:0/1493926926 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5702 (secure 0 0 0) 0x7ff9c4059db0 con 0x7ff9cc153ef0 2024-04-20T10:55:35.897 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:35.897 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:35.897 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 43 2024-04-20T10:55:35.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff9b806c8f0 msgr2=0x7ff9b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:35.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff9b806c8f0 0x7ff9b806edb0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc006fd0 tx=0x7ff9bc008040 comp rx=0 tx=0).stop 2024-04-20T10:55:35.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc153ef0 msgr2=0x7ff9cc1eddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:35.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc153ef0 0x7ff9cc1eddb0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff9c400cb20 tx=0x7ff9c40021c0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 shutdown_connections 2024-04-20T10:55:35.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff9b806c8f0 0x7ff9b806edb0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff9cc153ef0 0x7ff9cc1eddb0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff9cc0c9ee0 0x7ff9cc1ed870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 --2- 172.21.15.90:0/1493926926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff9cc0ab730 0x7ff9cc158df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:35.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 >> 172.21.15.90:0/1493926926 conn(0x7ff9cc0cbfe0 msgr2=0x7ff9cc0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:35.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 shutdown_connections 2024-04-20T10:55:35.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:35.899+0000 7ff9d1915640 1 -- 172.21.15.90:0/1493926926 wait complete. 2024-04-20T10:55:35.914 INFO:tasks.mds_thrash.fs.[a]:mds.a has gained rank=0, replacing gid=5271 2024-04-20T10:55:35.914 INFO:tasks.mds_thrash.fs.[a]:waiting for 5 secs before reviving mds.c 2024-04-20T10:55:37.573 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-04-20T10:55:37.572+0000 7f34a1ba7640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:55:40.915 INFO:tasks.mds_thrash.fs.[a]:reviving mds.c 2024-04-20T10:55:40.915 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-20T10:55:40.915 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-20T10:55:40.918 INFO:tasks.ceph.mds.c:Started 2024-04-20T10:55:40.918 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:40.989 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-04-20T10:55:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.015+0000 7f9ecfc6d640 1 Processor -- start 2024-04-20T10:55:41.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.015+0000 7f9ecfc6d640 1 -- start start 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ecfc6d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9ec8151b10 0x7f9ec8154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ecfc6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8157a70 0x7f9ec80725f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ecfc6d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ec8072b30 0x7f9ec80aba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ecfc6d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec8157ed0 con 0x7f9ec8072b30 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ecfc6d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9ec8151ef0 con 0x7f9ec8151b10 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ecfc6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec8073ba0 con 0x7f9ec8157a70 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ece20a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ec8072b30 0x7f9ec80aba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ece20a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9ec8072b30 0x7f9ec80aba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32946/0 (socket says 172.21.15.90:32946) 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.016+0000 7f9ece20a640 1 -- 172.21.15.90:0/1488054856 learned_addr learned my addr 172.21.15.90:0/1488054856 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ecda09640 1 --2- 172.21.15.90:0/1488054856 >> v2:172.21.15.175:3300/0 conn(0x7f9ec8151b10 0x7f9ec8154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:41.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ecd208640 1 --2- 172.21.15.90:0/1488054856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8157a70 0x7f9ec80725f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:41.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ece20a640 1 -- 172.21.15.90:0/1488054856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8157a70 msgr2=0x7f9ec80725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:41.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ece20a640 1 --2- 172.21.15.90:0/1488054856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8157a70 0x7f9ec80725f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ece20a640 1 -- 172.21.15.90:0/1488054856 >> v2:172.21.15.175:3300/0 conn(0x7f9ec8151b10 msgr2=0x7f9ec8154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:41.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ece20a640 1 --2- 172.21.15.90:0/1488054856 >> v2:172.21.15.175:3300/0 conn(0x7f9ec8151b10 0x7f9ec8154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ece20a640 1 -- 172.21.15.90:0/1488054856 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec81589a0 con 0x7f9ec8072b30 2024-04-20T10:55:41.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ecd208640 1 --2- 172.21.15.90:0/1488054856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8157a70 0x7f9ec80725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:55:41.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.017+0000 7f9ece20a640 1 --2- 172.21.15.90:0/1488054856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8072b30 0x7f9ec80aba60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80cb100 tx=0x7f9ec002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c636adb246b3a742 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:41.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecca07640 1 -- 172.21.15.90:0/1488054856 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0035020 con 0x7f9ec8072b30 2024-04-20T10:55:41.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecca07640 1 -- 172.21.15.90:0/1488054856 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec0031870 con 0x7f9ec8072b30 2024-04-20T10:55:41.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecca07640 1 -- 172.21.15.90:0/1488054856 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0031c40 con 0x7f9ec8072b30 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/1488054856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8072b30 msgr2=0x7f9ec80aba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/1488054856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8072b30 0x7f9ec80aba60 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80cb100 tx=0x7f9ec002b910 comp rx=0 tx=0).stop 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/1488054856 shutdown_connections 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/1488054856 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8072b30 0x7f9ec80aba60 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/1488054856 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8157a70 0x7f9ec80725f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/1488054856 >> v2:172.21.15.175:3300/0 conn(0x7f9ec8151b10 0x7f9ec8154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/1488054856 >> 172.21.15.90:0/1488054856 conn(0x7f9ec80ca0a0 msgr2=0x7f9ec80ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/1488054856 shutdown_connections 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.018+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/1488054856 wait complete. 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.019+0000 7f9ecfc6d640 1 Processor -- start 2024-04-20T10:55:41.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.019+0000 7f9ecfc6d640 1 -- start start 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecfc6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec8072b30 0x7f9ec80c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecfc6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8151b10 0x7f9ec8150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecfc6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8157a70 0x7f9ec81506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecfc6d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81586c0 con 0x7f9ec8157a70 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecfc6d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9ec81583e0 con 0x7f9ec8072b30 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecfc6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9ec80ab540 con 0x7f9ec8151b10 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8157a70 0x7f9ec81506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8157a70 0x7f9ec81506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32960/0 (socket says 172.21.15.90:32960) 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 -- 172.21.15.90:0/2770558761 learned_addr learned my addr 172.21.15.90:0/2770558761 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecd208640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8151b10 0x7f9ec8150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:41.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ecda09640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec8072b30 0x7f9ec80c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 -- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8151b10 msgr2=0x7f9ec8150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8151b10 0x7f9ec8150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 -- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec8072b30 msgr2=0x7f9ec80c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec8072b30 0x7f9ec80c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.020+0000 7f9ece20a640 1 -- 172.21.15.90:0/2770558761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec814dd50 con 0x7f9ec8157a70 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.021+0000 7f9ece20a640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8157a70 0x7f9ec81506b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9ec002b950 tx=0x7f9ec00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.021+0000 7f9ebe7fc640 1 -- 172.21.15.90:0/2770558761 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0040070 con 0x7f9ec8157a70 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.021+0000 7f9ebe7fc640 1 -- 172.21.15.90:0/2770558761 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ec0030c50 con 0x7f9ec8157a70 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.021+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec806df30 con 0x7f9ec8157a70 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.021+0000 7f9ebe7fc640 1 -- 172.21.15.90:0/2770558761 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec0035040 con 0x7f9ec8157a70 2024-04-20T10:55:41.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.021+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ec814f970 con 0x7f9ec8157a70 2024-04-20T10:55:41.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.022+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ec8076150 con 0x7f9ec8157a70 2024-04-20T10:55:41.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.022+0000 7f9ebe7fc640 1 -- 172.21.15.90:0/2770558761 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9ec0038020 con 0x7f9ec8157a70 2024-04-20T10:55:41.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.022+0000 7f9ebe7fc640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eac06c8f0 0x7f9eac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:41.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.023+0000 7f9ebe7fc640 1 -- 172.21.15.90:0/2770558761 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f9ec00addb0 con 0x7f9ec8157a70 2024-04-20T10:55:41.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.023+0000 7f9ecda09640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eac06c8f0 0x7f9eac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:41.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.023+0000 7f9ecda09640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eac06c8f0 0x7f9eac06edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80c40e0 tx=0x7f9ec4009830 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:41.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.027+0000 7f9ebe7fc640 1 -- 172.21.15.90:0/2770558761 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9ec007b670 con 0x7f9ec8157a70 2024-04-20T10:55:41.181 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:55:41.184 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:55:41.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.265+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ec8073910 con 0x7f9ec8157a70 2024-04-20T10:55:41.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.265+0000 7f9ebe7fc640 1 -- 172.21.15.90:0/2770558761 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) ==== 94+0+5702 (secure 0 0 0) 0x7f9ec007f970 con 0x7f9ec8157a70 2024-04-20T10:55:41.266 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:41.266 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":43,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:41.266 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 43 2024-04-20T10:55:41.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eac06c8f0 msgr2=0x7f9eac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:41.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eac06c8f0 0x7f9eac06edb0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f9ec80c40e0 tx=0x7f9ec4009830 comp rx=0 tx=0).stop 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8157a70 msgr2=0x7f9ec81506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8157a70 0x7f9ec81506b0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9ec002b950 tx=0x7f9ec00046c0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 shutdown_connections 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9eac06c8f0 0x7f9eac06edb0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9ec8157a70 0x7f9ec81506b0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9ec8151b10 0x7f9ec8150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 --2- 172.21.15.90:0/2770558761 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9ec8072b30 0x7f9ec80c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 >> 172.21.15.90:0/2770558761 conn(0x7f9ec80ca0a0 msgr2=0x7f9ec80c5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 shutdown_connections 2024-04-20T10:55:41.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:41.268+0000 7f9ecfc6d640 1 -- 172.21.15.90:0/2770558761 wait complete. 2024-04-20T10:55:41.279 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-20T10:55:43.279 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:43.386 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.386+0000 7fe8643b6640 1 Processor -- start 2024-04-20T10:55:43.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.386+0000 7fe8643b6640 1 -- start start 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.387+0000 7fe8643b6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe85c153e80 0x7fe85c06f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.387+0000 7fe8643b6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c0aee70 0x7fe85c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.387+0000 7fe8643b6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe85c15a4c0 con 0x7fe85c06dc00 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.387+0000 7fe8643b6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe85c0ae920 con 0x7fe85c153e80 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.387+0000 7fe8643b6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c06e9e0 con 0x7fe85c0aee70 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862953640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c0aee70 0x7fe85c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862152640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe85c153e80 0x7fe85c06f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe861951640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fe85c06dc00 0x7fe85c159db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:53552/0 (socket says 172.21.15.90:53552) 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862953640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c0aee70 0x7fe85c06b930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:33556/0 (socket says 172.21.15.90:33556) 2024-04-20T10:55:43.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862152640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe85c153e80 0x7fe85c06f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:47256/0 (socket says 172.21.15.90:47256) 2024-04-20T10:55:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe861951640 1 -- 172.21.15.90:0/529433604 learned_addr learned my addr 172.21.15.90:0/529433604 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862953640 1 -- 172.21.15.90:0/529433604 >> v2:172.21.15.175:3300/0 conn(0x7fe85c153e80 msgr2=0x7fe85c06f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862953640 1 --2- 172.21.15.90:0/529433604 >> v2:172.21.15.175:3300/0 conn(0x7fe85c153e80 0x7fe85c06f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862953640 1 -- 172.21.15.90:0/529433604 >> v1:172.21.15.175:6789/0 conn(0x7fe85c06dc00 legacy=0x7fe85c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862953640 1 -- 172.21.15.90:0/529433604 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c073ad0 con 0x7fe85c0aee70 2024-04-20T10:55:43.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.388+0000 7fe862152640 1 --2- 172.21.15.90:0/529433604 >> v2:172.21.15.175:3300/0 conn(0x7fe85c153e80 0x7fe85c06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:55:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.389+0000 7fe862953640 1 --2- 172.21.15.90:0/529433604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c0aee70 0x7fe85c06b930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe854009d90 tx=0x7fe85402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a197c9a5e212ad48 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.389+0000 7fe861150640 1 -- 172.21.15.90:0/529433604 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854039070 con 0x7fe85c0aee70 2024-04-20T10:55:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.389+0000 7fe861150640 1 -- 172.21.15.90:0/529433604 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85402cbc0 con 0x7fe85c0aee70 2024-04-20T10:55:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.389+0000 7fe861150640 1 -- 172.21.15.90:0/529433604 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854034440 con 0x7fe85c0aee70 2024-04-20T10:55:43.390 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.389+0000 7fe8643b6640 1 -- 172.21.15.90:0/529433604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c0aee70 msgr2=0x7fe85c06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.389+0000 7fe8643b6640 1 --2- 172.21.15.90:0/529433604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c0aee70 0x7fe85c06b930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe854009d90 tx=0x7fe85402be10 comp rx=0 tx=0).stop 2024-04-20T10:55:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.390+0000 7fe8643b6640 1 -- 172.21.15.90:0/529433604 shutdown_connections 2024-04-20T10:55:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.390+0000 7fe8643b6640 1 --2- 172.21.15.90:0/529433604 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c0aee70 0x7fe85c06b930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.390+0000 7fe8643b6640 1 --2- 172.21.15.90:0/529433604 >> v2:172.21.15.175:3300/0 conn(0x7fe85c153e80 0x7fe85c06f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.390+0000 7fe8643b6640 1 -- 172.21.15.90:0/529433604 >> 172.21.15.90:0/529433604 conn(0x7fe85c0c9000 msgr2=0x7fe85c0c93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.390+0000 7fe8643b6640 1 -- 172.21.15.90:0/529433604 shutdown_connections 2024-04-20T10:55:43.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.390+0000 7fe8643b6640 1 -- 172.21.15.90:0/529433604 wait complete. 2024-04-20T10:55:43.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.391+0000 7fe8643b6640 1 Processor -- start 2024-04-20T10:55:43.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.391+0000 7fe8643b6640 1 -- start start 2024-04-20T10:55:43.393 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.391+0000 7fe8643b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe85c06dc00 0x7fe85c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.391+0000 7fe8643b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe85c0aee70 0x7fe85c1efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.391+0000 7fe8643b6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c153e80 0x7fe85c14bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe8643b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0c3fd0 con 0x7fe85c0aee70 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe8643b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe85c0aeb70 con 0x7fe85c06dc00 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe8643b6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe85c0c42b0 con 0x7fe85c153e80 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe861951640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe85c0aee70 0x7fe85c1efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862152640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe85c06dc00 0x7fe85c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe861951640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe85c0aee70 0x7fe85c1efb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32962/0 (socket says 172.21.15.90:32962) 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862953640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c153e80 0x7fe85c14bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe861951640 1 -- 172.21.15.90:0/3574447173 learned_addr learned my addr 172.21.15.90:0/3574447173 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862152640 1 -- 172.21.15.90:0/3574447173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c153e80 msgr2=0x7fe85c14bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:43.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862152640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c153e80 0x7fe85c14bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862152640 1 -- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe85c0aee70 msgr2=0x7fe85c1efb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862152640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe85c0aee70 0x7fe85c1efb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862152640 1 -- 172.21.15.90:0/3574447173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe85c14c960 con 0x7fe85c06dc00 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe861951640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe85c0aee70 0x7fe85c1efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe862152640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe85c06dc00 0x7fe85c14cc40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe85800e870 tx=0x7fe85800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe852ffd640 1 -- 172.21.15.90:0/3574447173 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe858017070 con 0x7fe85c06dc00 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe852ffd640 1 -- 172.21.15.90:0/3574447173 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe85800c940 con 0x7fe85c06dc00 2024-04-20T10:55:43.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe85c0ab5d0 con 0x7fe85c06dc00 2024-04-20T10:55:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.392+0000 7fe852ffd640 1 -- 172.21.15.90:0/3574447173 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85800cd10 con 0x7fe85c06dc00 2024-04-20T10:55:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.393+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe85c155010 con 0x7fe85c06dc00 2024-04-20T10:55:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.393+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe85c1536a0 con 0x7fe85c06dc00 2024-04-20T10:55:43.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.394+0000 7fe852ffd640 1 -- 172.21.15.90:0/3574447173 <== mon.1 v2:172.21.15.175:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe85801a070 con 0x7fe85c06dc00 2024-04-20T10:55:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.395+0000 7fe852ffd640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe84006c8f0 0x7fe84006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.395+0000 7fe861951640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe84006c8f0 0x7fe84006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.395+0000 7fe852ffd640 1 -- 172.21.15.90:0/3574447173 <== mon.1 v2:172.21.15.175:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fe85808c190 con 0x7fe85c06dc00 2024-04-20T10:55:43.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.395+0000 7fe861951640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe84006c8f0 0x7fe84006edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe85c1ed460 tx=0x7fe84c007ee0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:43.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.399+0000 7fe852ffd640 1 -- 172.21.15.90:0/3574447173 <== mon.1 v2:172.21.15.175:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe85c1536a0 con 0x7fe85c06dc00 2024-04-20T10:55:43.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.668+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe85c076150 con 0x7fe85c06dc00 2024-04-20T10:55:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.669+0000 7fe852ffd640 1 -- 172.21.15.90:0/3574447173 <== mon.1 v2:172.21.15.175:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7fe858059a50 con 0x7fe85c06dc00 2024-04-20T10:55:43.669 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:43.669 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:43.669 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:55:43.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe84006c8f0 msgr2=0x7fe84006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:43.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe84006c8f0 0x7fe84006edb0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe85c1ed460 tx=0x7fe84c007ee0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe85c06dc00 msgr2=0x7fe85c14cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe85c06dc00 0x7fe85c14cc40 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe85800e870 tx=0x7fe85800ed30 comp rx=0 tx=0).stop 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 shutdown_connections 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe84006c8f0 0x7fe84006edb0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe85c153e80 0x7fe85c14bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe85c0aee70 0x7fe85c1efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 --2- 172.21.15.90:0/3574447173 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe85c06dc00 0x7fe85c14cc40 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 >> 172.21.15.90:0/3574447173 conn(0x7fe85c0c9000 msgr2=0x7fe85c074f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 shutdown_connections 2024-04-20T10:55:43.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:43.671+0000 7fe8643b6640 1 -- 172.21.15.90:0/3574447173 wait complete. 2024-04-20T10:55:43.682 INFO:tasks.mds_thrash.fs.[a]:mds.c reported in up:standby state 2024-04-20T10:55:43.682 INFO:tasks.mds_thrash.fs.[a]:waiting for 45 secs before thrashing 2024-04-20T10:55:47.597 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:47.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.693+0000 7f367d575640 1 Processor -- start 2024-04-20T10:55:47.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.693+0000 7f367d575640 1 -- start start 2024-04-20T10:55:47.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f367d575640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3678153ef0 0x7f36780c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:47.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f367d575640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36780ab730 0x7f36781568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:47.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f367d575640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f367815a720 con 0x7f36780c9ee0 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f367d575640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f367815ac80 con 0x7f3678153ef0 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f367d575640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f367815a9a0 con 0x7f36780ab730 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f3676ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3678153ef0 0x7f36780c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f3676ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f3678153ef0 0x7f36780c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36984/0 (socket says 172.21.15.90:36984) 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f3676ffd640 1 -- 172.21.15.90:0/3836496724 learned_addr learned my addr 172.21.15.90:0/3836496724 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f36767fc640 1 --2- 172.21.15.90:0/3836496724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36780ab730 0x7f36781568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f3676ffd640 1 -- 172.21.15.90:0/3836496724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36780ab730 msgr2=0x7f36781568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f3676ffd640 1 --2- 172.21.15.90:0/3836496724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36780ab730 0x7f36781568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f3676ffd640 1 -- 172.21.15.90:0/3836496724 >> v1:172.21.15.175:6789/0 conn(0x7f36780c9ee0 legacy=0x7f3678156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.694+0000 7f3676ffd640 1 -- 172.21.15.90:0/3836496724 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36780c6a90 con 0x7f3678153ef0 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.695+0000 7f3676ffd640 1 --2- 172.21.15.90:0/3836496724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3678153ef0 0x7f36780c89f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f36780aec60 tx=0x7f366802bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f28d217e584fd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:47.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.695+0000 7f3675ffb640 1 -- 172.21.15.90:0/3836496724 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366802c910 con 0x7f3678153ef0 2024-04-20T10:55:47.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.695+0000 7f3675ffb640 1 -- 172.21.15.90:0/3836496724 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366802cab0 con 0x7f3678153ef0 2024-04-20T10:55:47.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.695+0000 7f3675ffb640 1 -- 172.21.15.90:0/3836496724 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36680343f0 con 0x7f3678153ef0 2024-04-20T10:55:47.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 -- 172.21.15.90:0/3836496724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3678153ef0 msgr2=0x7f36780c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:47.699 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 --2- 172.21.15.90:0/3836496724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3678153ef0 0x7f36780c89f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f36780aec60 tx=0x7f366802bd70 comp rx=0 tx=0).stop 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 -- 172.21.15.90:0/3836496724 shutdown_connections 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 --2- 172.21.15.90:0/3836496724 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f36780ab730 0x7f36781568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 --2- 172.21.15.90:0/3836496724 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f3678153ef0 0x7f36780c89f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 -- 172.21.15.90:0/3836496724 >> 172.21.15.90:0/3836496724 conn(0x7f36780cbfe0 msgr2=0x7f36780cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 -- 172.21.15.90:0/3836496724 shutdown_connections 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.696+0000 7f367d575640 1 -- 172.21.15.90:0/3836496724 wait complete. 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.697+0000 7f367d575640 1 Processor -- start 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.697+0000 7f367d575640 1 -- start start 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f367d575640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36780ab730 0x7f36781ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f367d575640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36780c9ee0 0x7f36780c5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f367d575640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3678153ef0 0x7f36780c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f367d575640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f36780bf800 con 0x7f36780c9ee0 2024-04-20T10:55:47.700 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f367d575640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f3678157510 con 0x7f36780ab730 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f367d575640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f36781532e0 con 0x7f3678153ef0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36780c9ee0 0x7f36780c5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36780c9ee0 0x7f36780c5ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:36994/0 (socket says 172.21.15.90:36994) 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 -- 172.21.15.90:0/3260453872 learned_addr learned my addr 172.21.15.90:0/3260453872 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f3676ffd640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36780ab730 0x7f36781ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36777fe640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3678153ef0 0x7f36780c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 -- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3678153ef0 msgr2=0x7f36780c1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3678153ef0 0x7f36780c1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 -- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36780ab730 msgr2=0x7f36781ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36780ab730 0x7f36781ed9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 -- 172.21.15.90:0/3260453872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36780c3150 con 0x7f36780c9ee0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f36767fc640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36780c9ee0 0x7f36780c5ae0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f366c00d5c0 tx=0x7f366c00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f365f7fe640 1 -- 172.21.15.90:0/3260453872 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0125f0 con 0x7f36780c9ee0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f365f7fe640 1 -- 172.21.15.90:0/3260453872 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f366c019070 con 0x7f36780c9ee0 2024-04-20T10:55:47.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36781f0600 con 0x7f36780c9ee0 2024-04-20T10:55:47.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.698+0000 7f365f7fe640 1 -- 172.21.15.90:0/3260453872 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f366c0129d0 con 0x7f36780c9ee0 2024-04-20T10:55:47.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.699+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36780c55c0 con 0x7f36780c9ee0 2024-04-20T10:55:47.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.700+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36780ca450 con 0x7f36780c9ee0 2024-04-20T10:55:47.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.700+0000 7f365f7fe640 1 -- 172.21.15.90:0/3260453872 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f366c012b70 con 0x7f36780c9ee0 2024-04-20T10:55:47.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.700+0000 7f365f7fe640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f366406c8f0 0x7f366406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:47.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.701+0000 7f3676ffd640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f366406c8f0 0x7f366406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:47.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.701+0000 7f365f7fe640 1 -- 172.21.15.90:0/3260453872 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f366c08c4a0 con 0x7f36780c9ee0 2024-04-20T10:55:47.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.701+0000 7f3676ffd640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f366406c8f0 0x7f366406edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3668035000 tx=0x7f3668030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:47.705 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.705+0000 7f365f7fe640 1 -- 172.21.15.90:0/3260453872 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f366c05a320 con 0x7f36780c9ee0 2024-04-20T10:55:47.934 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.934+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3678076150 con 0x7f36780c9ee0 2024-04-20T10:55:47.935 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.935+0000 7f365f7fe640 1 -- 172.21.15.90:0/3260453872 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7f366c059c20 con 0x7f36780c9ee0 2024-04-20T10:55:47.935 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:47.935 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:47.936 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:55:47.937 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f366406c8f0 msgr2=0x7f366406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f366406c8f0 0x7f366406edb0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f3668035000 tx=0x7f3668030000 comp rx=0 tx=0).stop 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36780c9ee0 msgr2=0x7f36780c5ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36780c9ee0 0x7f36780c5ae0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f366c00d5c0 tx=0x7f366c00da80 comp rx=0 tx=0).stop 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 shutdown_connections 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f366406c8f0 0x7f366406edb0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3678153ef0 0x7f36780c1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f36780c9ee0 0x7f36780c5ae0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 --2- 172.21.15.90:0/3260453872 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f36780ab730 0x7f36781ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 >> 172.21.15.90:0/3260453872 conn(0x7f36780cbfe0 msgr2=0x7f36781568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 shutdown_connections 2024-04-20T10:55:47.938 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:47.937+0000 7f367d575640 1 -- 172.21.15.90:0/3260453872 wait complete. 2024-04-20T10:55:47.948 INFO:tasks.mds_thrash.fs.[b]:kill mds.b (rank=0) 2024-04-20T10:55:47.949 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-20T10:55:47.949 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:55:47.962 INFO:tasks.ceph.mds.b:Stopped 2024-04-20T10:55:47.963 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:48.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.059+0000 7fb6b280f640 1 Processor -- start 2024-04-20T10:55:48.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.059+0000 7fb6b280f640 1 -- start start 2024-04-20T10:55:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.059+0000 7fb6b280f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb6ac154040 0x7fb6ac0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6b280f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 0x7fb6ac073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6b280f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6ac0af590 con 0x7fb6ac159e00 2024-04-20T10:55:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6b280f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb6ac0acb20 con 0x7fb6ac154040 2024-04-20T10:55:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6b280f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ac0acd70 con 0x7fb6ac0730e0 2024-04-20T10:55:48.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6b0dac640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb6ac159e00 0x7fb6ac15a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:40672/0 (socket says 172.21.15.90:40672) 2024-04-20T10:55:48.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6b0dac640 1 -- 172.21.15.90:0/1804308447 learned_addr learned my addr 172.21.15.90:0/1804308447 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1804308447 >> v2:172.21.15.175:3300/0 conn(0x7fb6ac154040 0x7fb6ac0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2299662615 0 0) 0x7fb6ac0af590 con 0x7fb6ac159e00 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 0x7fb6ac073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb694003520 con 0x7fb6ac159e00 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2065454748 0 0) 0x7fb694003520 con 0x7fb6ac159e00 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 msgr2=0x7fb6ac073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 0x7fb6ac073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 >> v2:172.21.15.175:3300/0 conn(0x7fb6ac154040 msgr2=0x7fb6ac0c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/1804308447 >> v2:172.21.15.175:3300/0 conn(0x7fb6ac154040 0x7fb6ac0c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac0c6400 con 0x7fb6ac159e00 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fb6a40019f0 con 0x7fb6ac159e00 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 >> v1:172.21.15.90:6789/0 conn(0x7fb6ac159e00 legacy=0x7fb6ac15a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:48.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 0x7fb6940039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694003f30 0x7fb694004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb694004d40 0x7fb6940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac0acb20 con 0x7fb694004d40 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac0acd70 con 0x7fb694003f30 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb69400baa0 con 0x7fb6ac0730e0 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 0x7fb6940039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694003f30 0x7fb694004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.060+0000 7fb6b0dac640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb694004d40 0x7fb6940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.061+0000 7fb6abfff640 1 -- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694003f30 msgr2=0x7fb694004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.061+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb694003f30 0x7fb694004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.061+0000 7fb6abfff640 1 -- 172.21.15.90:0/1804308447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb694004d40 msgr2=0x7fb6940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.061+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb694004d40 0x7fb6940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.061+0000 7fb6abfff640 1 -- 172.21.15.90:0/1804308447 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb694003520 con 0x7fb6ac0730e0 2024-04-20T10:55:48.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.061+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 0x7fb6940039b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009ac0 tx=0x7fb694005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21230b4a02e8c6ae server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c039070 con 0x7fb6ac0730e0 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c02c710 con 0x7fb6ac0730e0 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6aaffd640 1 -- 172.21.15.90:0/1804308447 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c009690 con 0x7fb6ac0730e0 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6b280f640 1 -- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 msgr2=0x7fb6940039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6b280f640 1 --2- 172.21.15.90:0/1804308447 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac0730e0 0x7fb6940039b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009ac0 tx=0x7fb694005830 comp rx=0 tx=0).stop 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6b0dac640 1 -- 172.21.15.90:0/1804308447 reap_dead start 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6b280f640 1 -- 172.21.15.90:0/1804308447 shutdown_connections 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6b280f640 1 -- 172.21.15.90:0/1804308447 >> 172.21.15.90:0/1804308447 conn(0x7fb6ac0676c0 msgr2=0x7fb6ac067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6b280f640 1 -- 172.21.15.90:0/1804308447 shutdown_connections 2024-04-20T10:55:48.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.062+0000 7fb6b280f640 1 -- 172.21.15.90:0/1804308447 wait complete. 2024-04-20T10:55:48.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.063+0000 7fb6b280f640 1 Processor -- start 2024-04-20T10:55:48.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b280f640 1 -- start start 2024-04-20T10:55:48.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b280f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0730e0 0x7fb6ac149800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b280f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac0c8060 0x7fb6ac14bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b280f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac149e00 0x7fb6ac1515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b280f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac0af020 con 0x7fb6ac0730e0 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b280f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6ac0aeea0 con 0x7fb6ac0c8060 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b280f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6ac070520 con 0x7fb6ac149e00 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0730e0 0x7fb6ac149800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6abfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0730e0 0x7fb6ac149800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37004/0 (socket says 172.21.15.90:37004) 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6abfff640 1 -- 172.21.15.90:0/1983081735 learned_addr learned my addr 172.21.15.90:0/1983081735 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac0c8060 0x7fb6ac14bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.064+0000 7fb6b0dac640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac149e00 0x7fb6ac1515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6abfff640 1 -- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac149e00 msgr2=0x7fb6ac1515d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac149e00 0x7fb6ac1515d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6abfff640 1 -- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac0c8060 msgr2=0x7fb6ac14bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac0c8060 0x7fb6ac14bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6abfff640 1 -- 172.21.15.90:0/1983081735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6ac1ec450 con 0x7fb6ac0730e0 2024-04-20T10:55:48.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6abfff640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0730e0 0x7fb6ac149800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009be0 tx=0x7fb69c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6a8ff9640 1 -- 172.21.15.90:0/1983081735 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c039050 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6a8ff9640 1 -- 172.21.15.90:0/1983081735 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb69c045070 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6a8ff9640 1 -- 172.21.15.90:0/1983081735 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb69c003a50 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6ac1ec710 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.065+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6ac1eccd0 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.066+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6ac076150 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.066+0000 7fb6a8ff9640 1 -- 172.21.15.90:0/1983081735 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb69c003bf0 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.067+0000 7fb6a8ff9640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.067+0000 7fb6a8ff9640 1 -- 172.21.15.90:0/1983081735 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fb69c0adbb0 con 0x7fb6ac0730e0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.067+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.067+0000 7fb6ab7fe640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac1f0a80 tx=0x7fb6a0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:48.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.071+0000 7fb6a8ff9640 1 -- 172.21.15.90:0/1983081735 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb69c04e020 con 0x7fb6ac0730e0 2024-04-20T10:55:48.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.280+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6ac0cb080 con 0x7fb6ac0730e0 2024-04-20T10:55:48.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.280+0000 7fb6a8ff9640 1 -- 172.21.15.90:0/1983081735 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7fb69c07b3e0 con 0x7fb6ac0730e0 2024-04-20T10:55:48.281 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:48.281 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:48.281 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 msgr2=0x7fb69806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac1f0a80 tx=0x7fb6a0009190 comp rx=0 tx=0).stop 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0730e0 msgr2=0x7fb6ac149800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0730e0 0x7fb6ac149800 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb69c009be0 tx=0x7fb69c004730 comp rx=0 tx=0).stop 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 shutdown_connections 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb69806c8f0 0x7fb69806edb0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6ac149e00 0x7fb6ac1515d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6ac0c8060 0x7fb6ac14bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 --2- 172.21.15.90:0/1983081735 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6ac0730e0 0x7fb6ac149800 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 >> 172.21.15.90:0/1983081735 conn(0x7fb6ac0676c0 msgr2=0x7fb6ac067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 shutdown_connections 2024-04-20T10:55:48.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:48.282+0000 7fb6b280f640 1 -- 172.21.15.90:0/1983081735 wait complete. 2024-04-20T10:55:48.293 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:55:50.294 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:50.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.392+0000 7ffa69611640 1 Processor -- start 2024-04-20T10:55:50.392 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.392+0000 7ffa69611640 1 -- start start 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa69611640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffa640ad720 0x7ffa64155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa69611640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640705c0 0x7ffa640c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa69611640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa6406d450 con 0x7ffa6406e210 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa69611640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ffa6406dd80 con 0x7ffa640ad720 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa69611640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffa6406d730 con 0x7ffa640705c0 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa62ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffa640ad720 0x7ffa64155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa627fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ffa6406e210 0x7ffa64073430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:40682/0 (socket says 172.21.15.90:40682) 2024-04-20T10:55:50.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa62ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ffa640ad720 0x7ffa64155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37018/0 (socket says 172.21.15.90:37018) 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa627fc640 1 -- 172.21.15.90:0/1225224295 learned_addr learned my addr 172.21.15.90:0/1225224295 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa637fe640 1 --2- 172.21.15.90:0/1225224295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640705c0 0x7ffa640c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa62ffd640 1 -- 172.21.15.90:0/1225224295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640705c0 msgr2=0x7ffa640c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa62ffd640 1 --2- 172.21.15.90:0/1225224295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640705c0 0x7ffa640c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa62ffd640 1 -- 172.21.15.90:0/1225224295 >> v1:172.21.15.90:6789/0 conn(0x7ffa6406e210 legacy=0x7ffa64073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa62ffd640 1 -- 172.21.15.90:0/1225224295 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa6406da10 con 0x7ffa640ad720 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.393+0000 7ffa61ffb640 1 -- 172.21.15.90:0/1225224295 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093306487 0 0) 0x7ffa6406d450 con 0x7ffa6406e210 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.394+0000 7ffa62ffd640 1 --2- 172.21.15.90:0/1225224295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa640ad720 0x7ffa64155010 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa540097a0 tx=0x7ffa5402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1084a0c8a49d660d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.394+0000 7ffa61ffb640 1 -- 172.21.15.90:0/1225224295 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa540315a0 con 0x7ffa640ad720 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.394+0000 7ffa61ffb640 1 -- 172.21.15.90:0/1225224295 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa54037070 con 0x7ffa640ad720 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.394+0000 7ffa61ffb640 1 -- 172.21.15.90:0/1225224295 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54031960 con 0x7ffa640ad720 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 -- 172.21.15.90:0/1225224295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa640ad720 msgr2=0x7ffa64155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:50.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 --2- 172.21.15.90:0/1225224295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa640ad720 0x7ffa64155010 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ffa540097a0 tx=0x7ffa5402b840 comp rx=0 tx=0).stop 2024-04-20T10:55:50.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 -- 172.21.15.90:0/1225224295 shutdown_connections 2024-04-20T10:55:50.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 --2- 172.21.15.90:0/1225224295 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640705c0 0x7ffa640c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 --2- 172.21.15.90:0/1225224295 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa640ad720 0x7ffa64155010 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 -- 172.21.15.90:0/1225224295 >> 172.21.15.90:0/1225224295 conn(0x7ffa640c8080 msgr2=0x7ffa640c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:50.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 -- 172.21.15.90:0/1225224295 shutdown_connections 2024-04-20T10:55:50.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.395+0000 7ffa69611640 1 -- 172.21.15.90:0/1225224295 wait complete. 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.396+0000 7ffa69611640 1 Processor -- start 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.396+0000 7ffa69611640 1 -- start start 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa6406e210 0x7ffa640c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa640705c0 0x7ffa641e0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640ad720 0x7ffa641ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64073b40 con 0x7ffa6406e210 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64070b30 con 0x7ffa640705c0 2024-04-20T10:55:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ffa64149850 con 0x7ffa640ad720 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa6406e210 0x7ffa640c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa6406e210 0x7ffa640c14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37034/0 (socket says 172.21.15.90:37034) 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 -- 172.21.15.90:0/1349917289 learned_addr learned my addr 172.21.15.90:0/1349917289 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa627fc640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa640705c0 0x7ffa641e0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa637fe640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640ad720 0x7ffa641ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 -- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640ad720 msgr2=0x7ffa641ebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640ad720 0x7ffa641ebbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 -- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa640705c0 msgr2=0x7ffa641e0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa640705c0 0x7ffa641e0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 -- 172.21.15.90:0/1349917289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa641efe20 con 0x7ffa6406e210 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa627fc640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa640705c0 0x7ffa641e0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa62ffd640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa6406e210 0x7ffa640c14b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa54034040 tx=0x7ffa540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa4b7fe640 1 -- 172.21.15.90:0/1349917289 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54032840 con 0x7ffa6406e210 2024-04-20T10:55:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa4b7fe640 1 -- 172.21.15.90:0/1349917289 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa54032a00 con 0x7ffa6406e210 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa640ac660 con 0x7ffa6406e210 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa4b7fe640 1 -- 172.21.15.90:0/1349917289 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54032df0 con 0x7ffa6406e210 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.397+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa64154290 con 0x7ffa6406e210 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.398+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa64076150 con 0x7ffa6406e210 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.399+0000 7ffa4b7fe640 1 -- 172.21.15.90:0/1349917289 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffa5404e430 con 0x7ffa6406e210 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.399+0000 7ffa4b7fe640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffa5006c8f0 0x7ffa5006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.399+0000 7ffa4b7fe640 1 -- 172.21.15.90:0/1349917289 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7ffa5402f030 con 0x7ffa6406e210 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.399+0000 7ffa627fc640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffa5006c8f0 0x7ffa5006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:50.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.400+0000 7ffa627fc640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffa5006c8f0 0x7ffa5006edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffa64073830 tx=0x7ffa58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:50.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.403+0000 7ffa4b7fe640 1 -- 172.21.15.90:0/1349917289 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ffa54040070 con 0x7ffa6406e210 2024-04-20T10:55:50.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.620+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ffa64073580 con 0x7ffa6406e210 2024-04-20T10:55:50.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.621+0000 7ffa4b7fe640 1 -- 172.21.15.90:0/1349917289 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7ffa5407bff0 con 0x7ffa6406e210 2024-04-20T10:55:50.621 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:50.622 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:50.622 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:55:50.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffa5006c8f0 msgr2=0x7ffa5006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:50.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffa5006c8f0 0x7ffa5006edb0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ffa64073830 tx=0x7ffa58009040 comp rx=0 tx=0).stop 2024-04-20T10:55:50.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa6406e210 msgr2=0x7ffa640c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:50.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa6406e210 0x7ffa640c14b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ffa54034040 tx=0x7ffa540046c0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 shutdown_connections 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ffa5006c8f0 0x7ffa5006edb0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ffa640ad720 0x7ffa641ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ffa640705c0 0x7ffa641e0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 --2- 172.21.15.90:0/1349917289 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ffa6406e210 0x7ffa640c14b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 >> 172.21.15.90:0/1349917289 conn(0x7ffa640c8080 msgr2=0x7ffa640721f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 shutdown_connections 2024-04-20T10:55:50.624 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:50.623+0000 7ffa69611640 1 -- 172.21.15.90:0/1349917289 wait complete. 2024-04-20T10:55:50.634 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:55:52.635 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:52.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.732+0000 7f7865bef640 1 Processor -- start 2024-04-20T10:55:52.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.732+0000 7f7865bef640 1 -- start start 2024-04-20T10:55:52.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f7865bef640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78600701c0 0x7f7860073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:52.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f7865bef640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f786015ab30 0x7f7860156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:52.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f7865bef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 0x7f7860156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:52.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f7865bef640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f78600ab630 con 0x7f78600701c0 2024-04-20T10:55:52.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f7865bef640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7860159e00 con 0x7f786015ab30 2024-04-20T10:55:52.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f7865bef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78600c6870 con 0x7f7860073640 2024-04-20T10:55:52.734 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78600701c0 0x7f7860073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78600701c0 0x7f7860073100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37040/0 (socket says 172.21.15.90:37040) 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 -- 172.21.15.90:0/3872311414 learned_addr learned my addr 172.21.15.90:0/3872311414 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 -- 172.21.15.90:0/3872311414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 msgr2=0x7f7860156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 --2- 172.21.15.90:0/3872311414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 0x7f7860156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 -- 172.21.15.90:0/3872311414 >> v2:172.21.15.175:3300/0 conn(0x7f786015ab30 msgr2=0x7f7860156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 --2- 172.21.15.90:0/3872311414 >> v2:172.21.15.175:3300/0 conn(0x7f786015ab30 0x7f7860156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.733+0000 7f785f7fe640 1 -- 172.21.15.90:0/3872311414 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786015a050 con 0x7f78600701c0 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.734+0000 7f785f7fe640 1 --2- 172.21.15.90:0/3872311414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860073100 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f78600c46d0 tx=0x7f785002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52867db9ad379f5e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.734+0000 7f785e7fc640 1 -- 172.21.15.90:0/3872311414 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850035020 con 0x7f78600701c0 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.734+0000 7f785e7fc640 1 -- 172.21.15.90:0/3872311414 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7850031870 con 0x7f78600701c0 2024-04-20T10:55:52.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.734+0000 7f785e7fc640 1 -- 172.21.15.90:0/3872311414 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850031c40 con 0x7f78600701c0 2024-04-20T10:55:52.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.734+0000 7f7865bef640 1 -- 172.21.15.90:0/3872311414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 msgr2=0x7f7860073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:52.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.734+0000 7f7865bef640 1 --2- 172.21.15.90:0/3872311414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860073100 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f78600c46d0 tx=0x7f785002b910 comp rx=0 tx=0).stop 2024-04-20T10:55:52.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.735+0000 7f7865bef640 1 -- 172.21.15.90:0/3872311414 shutdown_connections 2024-04-20T10:55:52.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.735+0000 7f7865bef640 1 --2- 172.21.15.90:0/3872311414 >> v2:172.21.15.175:3300/0 conn(0x7f786015ab30 0x7f7860156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.735+0000 7f7865bef640 1 --2- 172.21.15.90:0/3872311414 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 0x7f7860156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.735+0000 7f7865bef640 1 --2- 172.21.15.90:0/3872311414 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860073100 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.735+0000 7f7865bef640 1 -- 172.21.15.90:0/3872311414 >> 172.21.15.90:0/3872311414 conn(0x7f78600676c0 msgr2=0x7f7860067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.735+0000 7f7865bef640 1 -- 172.21.15.90:0/3872311414 shutdown_connections 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.735+0000 7f7865bef640 1 -- 172.21.15.90:0/3872311414 wait complete. 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 Processor -- start 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 -- start start 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860155940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 0x7f786006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786015ab30 0x7f786014ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78600705a0 con 0x7f78600701c0 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f786015a610 con 0x7f786015ab30 2024-04-20T10:55:52.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.736+0000 7f7865bef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78600c6470 con 0x7f7860073640 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860155940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860155940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37056/0 (socket says 172.21.15.90:37056) 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 -- 172.21.15.90:0/1224349419 learned_addr learned my addr 172.21.15.90:0/1224349419 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785effd640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 0x7f786006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785ffff640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786015ab30 0x7f786014ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 -- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 msgr2=0x7f786006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 0x7f786006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 -- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786015ab30 msgr2=0x7f786014ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786015ab30 0x7f786014ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 -- 172.21.15.90:0/1224349419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786014fd90 con 0x7f78600701c0 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f785f7fe640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860155940 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7850000c00 tx=0x7f78500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f7847fff640 1 -- 172.21.15.90:0/1224349419 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785003ad60 con 0x7f78600701c0 2024-04-20T10:55:52.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f7847fff640 1 -- 172.21.15.90:0/1224349419 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78500443f0 con 0x7f78600701c0 2024-04-20T10:55:52.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78600c9850 con 0x7f78600701c0 2024-04-20T10:55:52.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f7847fff640 1 -- 172.21.15.90:0/1224349419 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78500447e0 con 0x7f78600701c0 2024-04-20T10:55:52.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.737+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78601593d0 con 0x7f78600701c0 2024-04-20T10:55:52.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.738+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7860076150 con 0x7f78600701c0 2024-04-20T10:55:52.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.739+0000 7f7847fff640 1 -- 172.21.15.90:0/1224349419 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f785004b060 con 0x7f78600701c0 2024-04-20T10:55:52.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.739+0000 7f7847fff640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f784c06c8f0 0x7f784c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:52.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.739+0000 7f7847fff640 1 -- 172.21.15.90:0/1224349419 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f78500ae360 con 0x7f78600701c0 2024-04-20T10:55:52.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.739+0000 7f785effd640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f784c06c8f0 0x7f784c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:52.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.739+0000 7f785effd640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f784c06c8f0 0x7f784c06edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f78600c9120 tx=0x7f7854008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:52.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.743+0000 7f7847fff640 1 -- 172.21.15.90:0/1224349419 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f785003f070 con 0x7f78600701c0 2024-04-20T10:55:52.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.957+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78600c9a20 con 0x7f78600701c0 2024-04-20T10:55:52.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.957+0000 7f7847fff640 1 -- 172.21.15.90:0/1224349419 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7f785002f320 con 0x7f78600701c0 2024-04-20T10:55:52.958 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:52.958 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:52.958 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:55:52.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f784c06c8f0 msgr2=0x7f784c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f784c06c8f0 0x7f784c06edb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f78600c9120 tx=0x7f7854008040 comp rx=0 tx=0).stop 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 msgr2=0x7f7860155940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860155940 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f7850000c00 tx=0x7f78500046c0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 shutdown_connections 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f784c06c8f0 0x7f784c06edb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f786015ab30 0x7f786014ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7860073640 0x7f786006d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 --2- 172.21.15.90:0/1224349419 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78600701c0 0x7f7860155940 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 >> 172.21.15.90:0/1224349419 conn(0x7f78600676c0 msgr2=0x7f78601534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:52.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 shutdown_connections 2024-04-20T10:55:52.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:52.959+0000 7f7865bef640 1 -- 172.21.15.90:0/1224349419 wait complete. 2024-04-20T10:55:52.970 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:55:54.971 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:55.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.067+0000 7fb2cf831640 1 Processor -- start 2024-04-20T10:55:55.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.067+0000 7fb2cf831640 1 -- start start 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2cf831640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2c80c4bb0 0x7fb2c8159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2cf831640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c80af590 con 0x7fb2c8154040 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2cf831640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c80acd70 con 0x7fb2c815a340 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2cf831640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c80acb20 con 0x7fb2c80c4bb0 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2ccdcc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2c80c4bb0 0x7fb2c8159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2ccdcc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb2c80c4bb0 0x7fb2c8159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37062/0 (socket says 172.21.15.90:37062) 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2cd5cd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb2c8154040 0x7fb2c80730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:40688/0 (socket says 172.21.15.90:40688) 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.068+0000 7fb2ccdcc640 1 -- 172.21.15.90:0/2231357563 learned_addr learned my addr 172.21.15.90:0/2231357563 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:55.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.069+0000 7fb2ccdcc640 1 -- 172.21.15.90:0/2231357563 >> v1:172.21.15.175:6789/0 conn(0x7fb2c815a340 legacy=0x7fb2c81611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.069+0000 7fb2ccdcc640 1 -- 172.21.15.90:0/2231357563 >> v1:172.21.15.90:6789/0 conn(0x7fb2c8154040 legacy=0x7fb2c80730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.069+0000 7fb2ccdcc640 1 -- 172.21.15.90:0/2231357563 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c80c6400 con 0x7fb2c80c4bb0 2024-04-20T10:55:55.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.069+0000 7fb2bffff640 1 -- 172.21.15.90:0/2231357563 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398954299 0 0) 0x7fb2c80af590 con 0x7fb2c8154040 2024-04-20T10:55:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.069+0000 7fb2ccdcc640 1 --2- 172.21.15.90:0/2231357563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c8159e00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009870 tx=0x7fb2b802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cc49443e8bf9e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2bffff640 1 -- 172.21.15.90:0/2231357563 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b802e070 con 0x7fb2c80c4bb0 2024-04-20T10:55:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2bffff640 1 -- 172.21.15.90:0/2231357563 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b8037070 con 0x7fb2c80c4bb0 2024-04-20T10:55:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2bffff640 1 -- 172.21.15.90:0/2231357563 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8031a00 con 0x7fb2c80c4bb0 2024-04-20T10:55:55.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2cf831640 1 -- 172.21.15.90:0/2231357563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c80c4bb0 msgr2=0x7fb2c8159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2231357563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c8159e00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8009870 tx=0x7fb2b802b880 comp rx=0 tx=0).stop 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2cf831640 1 -- 172.21.15.90:0/2231357563 shutdown_connections 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2231357563 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c8159e00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2cf831640 1 -- 172.21.15.90:0/2231357563 >> 172.21.15.90:0/2231357563 conn(0x7fb2c80676c0 msgr2=0x7fb2c8067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2cf831640 1 -- 172.21.15.90:0/2231357563 shutdown_connections 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.070+0000 7fb2cf831640 1 -- 172.21.15.90:0/2231357563 wait complete. 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.071+0000 7fb2cf831640 1 Processor -- start 2024-04-20T10:55:55.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.071+0000 7fb2cf831640 1 -- start start 2024-04-20T10:55:55.074 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cf831640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c806f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cf831640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2c8154040 0x7fb2c81ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cf831640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c815a340 0x7fb2c81efe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cf831640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c80737f0 con 0x7fb2c815a340 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cf831640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c815a7b0 con 0x7fb2c80c4bb0 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cf831640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c8073970 con 0x7fb2c8154040 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c815a340 0x7fb2c81efe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c815a340 0x7fb2c81efe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:37066/0 (socket says 172.21.15.90:37066) 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 -- 172.21.15.90:0/2268007273 learned_addr learned my addr 172.21.15.90:0/2268007273 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2ccdcc640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2c8154040 0x7fb2c81ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cd5cd640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c806f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 -- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2c8154040 msgr2=0x7fb2c81ef910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:55.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2c8154040 0x7fb2c81ef910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 -- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2c80c4bb0 msgr2=0x7fb2c806f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c806f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cddce640 1 -- 172.21.15.90:0/2268007273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c81f0570 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2ccdcc640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2c8154040 0x7fb2c81ef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.072+0000 7fb2cd5cd640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c806f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.073+0000 7fb2cddce640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c815a340 0x7fb2c81efe50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000b970 tx=0x7fb2c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.073+0000 7fb2bdffb640 1 -- 172.21.15.90:0/2268007273 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0019070 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.073+0000 7fb2bdffb640 1 -- 172.21.15.90:0/2268007273 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c000cb40 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.073+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c80c95f0 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.073+0000 7fb2bdffb640 1 -- 172.21.15.90:0/2268007273 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c0014440 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.073+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c8151c20 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.074+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c80adcc0 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.074+0000 7fb2bdffb640 1 -- 172.21.15.90:0/2268007273 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2c001c070 con 0x7fb2c815a340 2024-04-20T10:55:55.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.075+0000 7fb2bdffb640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2ac06c8f0 0x7fb2ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:55.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.075+0000 7fb2bdffb640 1 -- 172.21.15.90:0/2268007273 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fb2c008bca0 con 0x7fb2c815a340 2024-04-20T10:55:55.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.075+0000 7fb2cd5cd640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2ac06c8f0 0x7fb2ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:55.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.075+0000 7fb2cd5cd640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2ac06c8f0 0x7fb2ac06edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4000f60 tx=0x7fb2c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:55.079 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.079+0000 7fb2bdffb640 1 -- 172.21.15.90:0/2268007273 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb2c80adcc0 con 0x7fb2c815a340 2024-04-20T10:55:55.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.321+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb2c8076150 con 0x7fb2c815a340 2024-04-20T10:55:55.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.322+0000 7fb2bdffb640 1 -- 172.21.15.90:0/2268007273 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7fb2c0059bb0 con 0x7fb2c815a340 2024-04-20T10:55:55.322 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:55.322 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:55.322 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:55:55.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2ac06c8f0 msgr2=0x7fb2ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:55.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2ac06c8f0 0x7fb2ac06edb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb2c4000f60 tx=0x7fb2c4009040 comp rx=0 tx=0).stop 2024-04-20T10:55:55.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c815a340 msgr2=0x7fb2c81efe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:55.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c815a340 0x7fb2c81efe50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb2c000b970 tx=0x7fb2c000be30 comp rx=0 tx=0).stop 2024-04-20T10:55:55.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 shutdown_connections 2024-04-20T10:55:55.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb2ac06c8f0 0x7fb2ac06edb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:55.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb2c815a340 0x7fb2c81efe50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:55.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb2c8154040 0x7fb2c81ef910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:55.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 --2- 172.21.15.90:0/2268007273 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb2c80c4bb0 0x7fb2c806f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:55.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 >> 172.21.15.90:0/2268007273 conn(0x7fb2c80676c0 msgr2=0x7fb2c80730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:55.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 shutdown_connections 2024-04-20T10:55:55.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:55.324+0000 7fb2cf831640 1 -- 172.21.15.90:0/2268007273 wait complete. 2024-04-20T10:55:55.335 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:55:57.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:57.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.462+0000 7fd89427a640 1 Processor -- start 2024-04-20T10:55:57.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.463+0000 7fd89427a640 1 -- start start 2024-04-20T10:55:57.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.464+0000 7fd89427a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd88c0ad720 0x7fd88c155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:57.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.464+0000 7fd89427a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd88c06e210 0x7fd88c073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:57.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.464+0000 7fd89427a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd88c06d450 con 0x7fd88c0705c0 2024-04-20T10:55:57.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.464+0000 7fd89427a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd88c06dd80 con 0x7fd88c0ad720 2024-04-20T10:55:57.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.464+0000 7fd89427a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd88c06d730 con 0x7fd88c06e210 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.464+0000 7fd892817640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd88c0705c0 0x7fd88c0c3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49404/0 (socket says 172.21.15.90:49404) 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.464+0000 7fd892817640 1 -- 172.21.15.90:0/1397238071 learned_addr learned my addr 172.21.15.90:0/1397238071 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.465+0000 7fd891815640 1 --2- 172.21.15.90:0/1397238071 >> v2:172.21.15.175:3300/0 conn(0x7fd88c06e210 0x7fd88c073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.465+0000 7fd892016640 1 --2- 172.21.15.90:0/1397238071 >> v2:172.21.15.90:3300/0 conn(0x7fd88c0ad720 0x7fd88c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.465+0000 7fd892016640 1 -- 172.21.15.90:0/1397238071 >> v2:172.21.15.175:3300/0 conn(0x7fd88c06e210 msgr2=0x7fd88c073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.465+0000 7fd892016640 1 --2- 172.21.15.90:0/1397238071 >> v2:172.21.15.175:3300/0 conn(0x7fd88c06e210 0x7fd88c073430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.465+0000 7fd892016640 1 -- 172.21.15.90:0/1397238071 >> v1:172.21.15.90:6789/0 conn(0x7fd88c0705c0 legacy=0x7fd88c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:57.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.465+0000 7fd892016640 1 -- 172.21.15.90:0/1397238071 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c06da10 con 0x7fd88c0ad720 2024-04-20T10:55:57.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.466+0000 7fd892016640 1 --2- 172.21.15.90:0/1397238071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c0ad720 0x7fd88c155010 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0688d0 tx=0x7fd88802b680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba675db4c70e628 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:57.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.467+0000 7fd891014640 1 -- 172.21.15.90:0/1397238071 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888037070 con 0x7fd88c0ad720 2024-04-20T10:55:57.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.467+0000 7fd891014640 1 -- 172.21.15.90:0/1397238071 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888030710 con 0x7fd88c0ad720 2024-04-20T10:55:57.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.467+0000 7fd891014640 1 -- 172.21.15.90:0/1397238071 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888030ae0 con 0x7fd88c0ad720 2024-04-20T10:55:57.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.468+0000 7fd89427a640 1 -- 172.21.15.90:0/1397238071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c0ad720 msgr2=0x7fd88c155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:57.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.468+0000 7fd89427a640 1 --2- 172.21.15.90:0/1397238071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c0ad720 0x7fd88c155010 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0688d0 tx=0x7fd88802b680 comp rx=0 tx=0).stop 2024-04-20T10:55:57.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.469+0000 7fd89427a640 1 -- 172.21.15.90:0/1397238071 shutdown_connections 2024-04-20T10:55:57.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.469+0000 7fd89427a640 1 --2- 172.21.15.90:0/1397238071 >> v2:172.21.15.175:3300/0 conn(0x7fd88c06e210 0x7fd88c073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.469+0000 7fd89427a640 1 --2- 172.21.15.90:0/1397238071 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c0ad720 0x7fd88c155010 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.469+0000 7fd89427a640 1 -- 172.21.15.90:0/1397238071 >> 172.21.15.90:0/1397238071 conn(0x7fd88c0c8080 msgr2=0x7fd88c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:57.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.469+0000 7fd89427a640 1 -- 172.21.15.90:0/1397238071 shutdown_connections 2024-04-20T10:55:57.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.469+0000 7fd89427a640 1 -- 172.21.15.90:0/1397238071 wait complete. 2024-04-20T10:55:57.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.471+0000 7fd89427a640 1 Processor -- start 2024-04-20T10:55:57.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.471+0000 7fd89427a640 1 -- start start 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd89427a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c06e210 0x7fd88c0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd89427a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88c0705c0 0x7fd88c1e0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd89427a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd88c0ad720 0x7fd88c1529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd89427a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c0c3dc0 con 0x7fd88c06e210 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd89427a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd88c0c3c40 con 0x7fd88c0705c0 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd89427a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd88c070b30 con 0x7fd88c0ad720 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c06e210 0x7fd88c0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:57.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c06e210 0x7fd88c0c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60934/0 (socket says 172.21.15.90:60934) 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 -- 172.21.15.90:0/665528959 learned_addr learned my addr 172.21.15.90:0/665528959 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892817640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd88c0ad720 0x7fd88c1529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd891815640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88c0705c0 0x7fd88c1e0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 -- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd88c0ad720 msgr2=0x7fd88c1529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd88c0ad720 0x7fd88c1529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 -- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88c0705c0 msgr2=0x7fd88c1e0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88c0705c0 0x7fd88c1e0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 -- 172.21.15.90:0/665528959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88c14d460 con 0x7fd88c06e210 2024-04-20T10:55:57.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.472+0000 7fd892016640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c06e210 0x7fd88c0c0a60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd888009890 tx=0x7fd8880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:57.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.473+0000 7fd882ffd640 1 -- 172.21.15.90:0/665528959 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd888037040 con 0x7fd88c06e210 2024-04-20T10:55:57.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.473+0000 7fd882ffd640 1 -- 172.21.15.90:0/665528959 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd888041070 con 0x7fd88c06e210 2024-04-20T10:55:57.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.473+0000 7fd882ffd640 1 -- 172.21.15.90:0/665528959 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88803dab0 con 0x7fd88c06e210 2024-04-20T10:55:57.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.473+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88c1daa00 con 0x7fd88c06e210 2024-04-20T10:55:57.474 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.473+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd88c1dafc0 con 0x7fd88c06e210 2024-04-20T10:55:57.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.474+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd88c076150 con 0x7fd88c06e210 2024-04-20T10:55:57.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.475+0000 7fd882ffd640 1 -- 172.21.15.90:0/665528959 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd88803dc50 con 0x7fd88c06e210 2024-04-20T10:55:57.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.475+0000 7fd882ffd640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd87006c8f0 0x7fd87006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:57.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.475+0000 7fd882ffd640 1 -- 172.21.15.90:0/665528959 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7fd8880b1660 con 0x7fd88c06e210 2024-04-20T10:55:57.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.475+0000 7fd891815640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd87006c8f0 0x7fd87006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:57.476 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.476+0000 7fd891815640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd87006c8f0 0x7fd87006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0c58f0 tx=0x7fd87c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:57.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.479+0000 7fd882ffd640 1 -- 172.21.15.90:0/665528959 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd88807ef20 con 0x7fd88c06e210 2024-04-20T10:55:57.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.693+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd88c068dc0 con 0x7fd88c06e210 2024-04-20T10:55:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.693+0000 7fd882ffd640 1 -- 172.21.15.90:0/665528959 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7fd888083220 con 0x7fd88c06e210 2024-04-20T10:55:57.694 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:55:57.694 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:55:57.694 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:55:57.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.695+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd87006c8f0 msgr2=0x7fd87006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:57.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.695+0000 7fd89427a640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd87006c8f0 0x7fd87006edb0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0c58f0 tx=0x7fd87c009190 comp rx=0 tx=0).stop 2024-04-20T10:55:57.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.695+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c06e210 msgr2=0x7fd88c0c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:57.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.695+0000 7fd89427a640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c06e210 0x7fd88c0c0a60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd888009890 tx=0x7fd8880046c0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 shutdown_connections 2024-04-20T10:55:57.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd87006c8f0 0x7fd87006edb0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd88c0ad720 0x7fd88c1529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd88c0705c0 0x7fd88c1e0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 --2- 172.21.15.90:0/665528959 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd88c06e210 0x7fd88c0c0a60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:57.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 >> 172.21.15.90:0/665528959 conn(0x7fd88c0c8080 msgr2=0x7fd88c0c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:57.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 shutdown_connections 2024-04-20T10:55:57.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:57.696+0000 7fd89427a640 1 -- 172.21.15.90:0/665528959 wait complete. 2024-04-20T10:55:57.707 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:55:59.708 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:55:59.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.804+0000 7fabb7a7a640 1 Processor -- start 2024-04-20T10:55:59.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.804+0000 7fabb7a7a640 1 -- start start 2024-04-20T10:55:59.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb7a7a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fabb01519e0 0x7fabb00c2d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:59.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb7a7a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fabb00708d0 0x7fabb006d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:59.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb7a7a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabb0154550 con 0x7fabb00c32b0 2024-04-20T10:55:59.806 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb7a7a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fabb0155160 con 0x7fabb00708d0 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb7a7a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fabb0154830 con 0x7fabb01519e0 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb5015640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fabb00708d0 0x7fabb006d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb5015640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fabb00708d0 0x7fabb006d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60940/0 (socket says 172.21.15.90:60940) 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb5015640 1 -- 172.21.15.90:0/986014028 learned_addr learned my addr 172.21.15.90:0/986014028 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb5015640 1 -- 172.21.15.90:0/986014028 >> v2:172.21.15.175:3300/0 conn(0x7fabb01519e0 msgr2=0x7fabb00c2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb5015640 1 --2- 172.21.15.90:0/986014028 >> v2:172.21.15.175:3300/0 conn(0x7fabb01519e0 0x7fabb00c2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb5015640 1 -- 172.21.15.90:0/986014028 >> v1:172.21.15.175:6789/0 conn(0x7fabb00c32b0 legacy=0x7fabb006dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.805+0000 7fabb5015640 1 -- 172.21.15.90:0/986014028 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb0154b10 con 0x7fabb00708d0 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.806+0000 7fabb5015640 1 --2- 172.21.15.90:0/986014028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00708d0 0x7fabb006d6f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fabb00ad910 tx=0x7faba002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d805b5735d83fbf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.806+0000 7fabb4814640 1 -- 172.21.15.90:0/986014028 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0035020 con 0x7fabb00708d0 2024-04-20T10:55:59.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.806+0000 7fabb4814640 1 -- 172.21.15.90:0/986014028 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba0031870 con 0x7fabb00708d0 2024-04-20T10:55:59.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.806+0000 7fabb4814640 1 -- 172.21.15.90:0/986014028 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba0031c40 con 0x7fabb00708d0 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 -- 172.21.15.90:0/986014028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00708d0 msgr2=0x7fabb006d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/986014028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00708d0 0x7fabb006d6f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fabb00ad910 tx=0x7faba002b910 comp rx=0 tx=0).stop 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 -- 172.21.15.90:0/986014028 shutdown_connections 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/986014028 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00708d0 0x7fabb006d6f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/986014028 >> v2:172.21.15.175:3300/0 conn(0x7fabb01519e0 0x7fabb00c2d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 -- 172.21.15.90:0/986014028 >> 172.21.15.90:0/986014028 conn(0x7fabb006bb10 msgr2=0x7fabb006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 -- 172.21.15.90:0/986014028 shutdown_connections 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.807+0000 7fabb7a7a640 1 -- 172.21.15.90:0/986014028 wait complete. 2024-04-20T10:55:59.814 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.808+0000 7fabb7a7a640 1 Processor -- start 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.808+0000 7fabb7a7a640 1 -- start start 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb00708d0 0x7fabb01ea860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00c32b0 0x7fabb014e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabb01519e0 0x7fabb01e1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fabb0151dc0 con 0x7fabb00c32b0 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fabb006e340 con 0x7fabb00708d0 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fabb00c5ab0 con 0x7fabb01519e0 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00c32b0 0x7fabb014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00c32b0 0x7fabb014e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60944/0 (socket says 172.21.15.90:60944) 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 -- 172.21.15.90:0/3778946938 learned_addr learned my addr 172.21.15.90:0/3778946938 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:55:59.815 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5816640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb00708d0 0x7fabb01ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb6017640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabb01519e0 0x7fabb01e1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 -- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabb01519e0 msgr2=0x7fabb01e1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabb01519e0 0x7fabb01e1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 -- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb00708d0 msgr2=0x7fabb01ea860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb00708d0 0x7fabb01ea860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 -- 172.21.15.90:0/3778946938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabb00c6230 con 0x7fabb00c32b0 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb5015640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00c32b0 0x7fabb014e710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faba002b950 tx=0x7faba00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7faba67fc640 1 -- 172.21.15.90:0/3778946938 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba003ad60 con 0x7fabb00c32b0 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7faba67fc640 1 -- 172.21.15.90:0/3778946938 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faba00443f0 con 0x7fabb00c32b0 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7faba67fc640 1 -- 172.21.15.90:0/3778946938 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faba00447e0 con 0x7fabb00c32b0 2024-04-20T10:55:59.816 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabb0156c20 con 0x7fabb00c32b0 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.809+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabb01571e0 con 0x7fabb00c32b0 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.810+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabb0076150 con 0x7fabb00c32b0 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.811+0000 7faba67fc640 1 -- 172.21.15.90:0/3778946938 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faba0038020 con 0x7fabb00c32b0 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.811+0000 7faba67fc640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fab9406c920 0x7fab9406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.811+0000 7faba67fc640 1 -- 172.21.15.90:0/3778946938 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7faba00ae2b0 con 0x7fabb00c32b0 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.811+0000 7fabb5816640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fab9406c920 0x7fab9406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.812+0000 7fabb5816640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fab9406c920 0x7fab9406ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fabac0098e0 tx=0x7fabac009060 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:55:59.817 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:55:59.816+0000 7faba67fc640 1 -- 172.21.15.90:0/3778946938 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faba003f070 con 0x7fabb00c32b0 2024-04-20T10:56:00.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.029+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabb006eea0 con 0x7fabb00c32b0 2024-04-20T10:56:00.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.030+0000 7faba67fc640 1 -- 172.21.15.90:0/3778946938 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7faba007bc00 con 0x7fabb00c32b0 2024-04-20T10:56:00.030 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:00.030 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:56:00.031 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:56:00.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fab9406c920 msgr2=0x7fab9406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:00.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fab9406c920 0x7fab9406ede0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fabac0098e0 tx=0x7fabac009060 comp rx=0 tx=0).stop 2024-04-20T10:56:00.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00c32b0 msgr2=0x7fabb014e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:00.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00c32b0 0x7fabb014e710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7faba002b950 tx=0x7faba00046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 shutdown_connections 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fab9406c920 0x7fab9406ede0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fabb01519e0 0x7fabb01e1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fabb00c32b0 0x7fabb014e710 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 --2- 172.21.15.90:0/3778946938 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fabb00708d0 0x7fabb01ea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 >> 172.21.15.90:0/3778946938 conn(0x7fabb006bb10 msgr2=0x7fabb006bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 shutdown_connections 2024-04-20T10:56:00.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:00.032+0000 7fabb7a7a640 1 -- 172.21.15.90:0/3778946938 wait complete. 2024-04-20T10:56:00.046 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:56:00.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T10:56:00.090 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-20T10:56:02.047 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:02.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.143+0000 7f95a1715640 1 Processor -- start 2024-04-20T10:56:02.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.143+0000 7f95a1715640 1 -- start start 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f95a1715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c073810 0x7f959c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f95a1715640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f959c0ad0c0 0x7f959c0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f95a1715640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f959c0c4370 con 0x7f959c157710 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f95a1715640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f959c1569e0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f95a1715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f959c157280 con 0x7f959c073810 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f959b7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f959c0ad0c0 0x7f959c0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f959a7fc640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f959c157710 0x7f959c0c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:37938/0 (socket says 172.21.15.90:37938) 2024-04-20T10:56:02.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.144+0000 7f959a7fc640 1 -- 172.21.15.90:0/2842930200 learned_addr learned my addr 172.21.15.90:0/2842930200 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:02.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.145+0000 7f959affd640 1 --2- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c073810 0x7f959c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:02.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.145+0000 7f959b7fe640 1 -- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c073810 msgr2=0x7f959c154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:02.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.145+0000 7f959b7fe640 1 --2- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c073810 0x7f959c154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.145+0000 7f959b7fe640 1 -- 172.21.15.90:0/2842930200 >> v1:172.21.15.175:6789/0 conn(0x7f959c157710 legacy=0x7f959c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:02.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.145+0000 7f959b7fe640 1 -- 172.21.15.90:0/2842930200 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c156c30 con 0x7f959c0ad0c0 2024-04-20T10:56:02.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f959b7fe640 1 --2- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c0ad0c0 0x7f959c0ad540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95940097a0 tx=0x7f959402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbcb4def51ab327 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:02.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f9599ffb640 1 -- 172.21.15.90:0/2842930200 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95940315a0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f9599ffb640 1 -- 172.21.15.90:0/2842930200 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9594037070 con 0x7f959c0ad0c0 2024-04-20T10:56:02.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f9599ffb640 1 -- 172.21.15.90:0/2842930200 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9594031960 con 0x7f959c0ad0c0 2024-04-20T10:56:02.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 -- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c0ad0c0 msgr2=0x7f959c0ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:02.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 --2- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c0ad0c0 0x7f959c0ad540 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f95940097a0 tx=0x7f959402b840 comp rx=0 tx=0).stop 2024-04-20T10:56:02.147 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 -- 172.21.15.90:0/2842930200 shutdown_connections 2024-04-20T10:56:02.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 --2- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c0ad0c0 0x7f959c0ad540 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 --2- 172.21.15.90:0/2842930200 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c073810 0x7f959c154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 -- 172.21.15.90:0/2842930200 >> 172.21.15.90:0/2842930200 conn(0x7f959c0c8080 msgr2=0x7f959c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:02.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 -- 172.21.15.90:0/2842930200 shutdown_connections 2024-04-20T10:56:02.148 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.146+0000 7f95a1715640 1 -- 172.21.15.90:0/2842930200 wait complete. 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 Processor -- start 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 -- start start 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c073810 0x7f959c1dec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f959c0ad0c0 0x7f959c14f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c157710 0x7f959c1e11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f959c0abbb0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f959c073bf0 con 0x7f959c073810 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f95a1715640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f959c0abd30 con 0x7f959c157710 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f959a7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f959c0ad0c0 0x7f959c14f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:02.151 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f959a7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f959c0ad0c0 0x7f959c14f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60948/0 (socket says 172.21.15.90:60948) 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.148+0000 7f959a7fc640 1 -- 172.21.15.90:0/510627824 learned_addr learned my addr 172.21.15.90:0/510627824 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959affd640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c073810 0x7f959c1dec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959b7fe640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c157710 0x7f959c1e11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959a7fc640 1 -- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c157710 msgr2=0x7f959c1e11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959a7fc640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c157710 0x7f959c1e11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959a7fc640 1 -- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c073810 msgr2=0x7f959c1dec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959a7fc640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c073810 0x7f959c1dec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959a7fc640 1 -- 172.21.15.90:0/510627824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959c0c6c00 con 0x7f959c0ad0c0 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959b7fe640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c157710 0x7f959c1e11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f959a7fc640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f959c0ad0c0 0x7f959c14f2e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f959000c3f0 tx=0x7f959000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f95837fe640 1 -- 172.21.15.90:0/510627824 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9590017070 con 0x7f959c0ad0c0 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f95837fe640 1 -- 172.21.15.90:0/510627824 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9590005ce0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959c1e06e0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.152 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f95837fe640 1 -- 172.21.15.90:0/510627824 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95900072f0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.149+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f959c14f820 con 0x7f959c0ad0c0 2024-04-20T10:56:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.150+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f959c1e04d0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.151+0000 7f95837fe640 1 -- 172.21.15.90:0/510627824 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f959001a070 con 0x7f959c0ad0c0 2024-04-20T10:56:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.151+0000 7f95837fe640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f958806c8f0 0x7f958806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.151+0000 7f95837fe640 1 -- 172.21.15.90:0/510627824 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7f959008b3f0 con 0x7f959c0ad0c0 2024-04-20T10:56:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.151+0000 7f959affd640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f958806c8f0 0x7f958806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:02.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.151+0000 7f959affd640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f958806c8f0 0x7f958806edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f958c0074a0 tx=0x7f958c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:02.155 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.155+0000 7f95837fe640 1 -- 172.21.15.90:0/510627824 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9590059300 con 0x7f959c0ad0c0 2024-04-20T10:56:02.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.370+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f959c076150 con 0x7f959c0ad0c0 2024-04-20T10:56:02.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.371+0000 7f95837fe640 1 -- 172.21.15.90:0/510627824 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7f9590058c00 con 0x7f959c0ad0c0 2024-04-20T10:56:02.371 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:02.371 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:56:02.372 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:56:02.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f958806c8f0 msgr2=0x7f958806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f958806c8f0 0x7f958806edb0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f958c0074a0 tx=0x7f958c00b040 comp rx=0 tx=0).stop 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f959c0ad0c0 msgr2=0x7f959c14f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f959c0ad0c0 0x7f959c14f2e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f959000c3f0 tx=0x7f959000c8b0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 shutdown_connections 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f958806c8f0 0x7f958806edb0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f959c157710 0x7f959c1e11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f959c0ad0c0 0x7f959c14f2e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 --2- 172.21.15.90:0/510627824 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f959c073810 0x7f959c1dec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 >> 172.21.15.90:0/510627824 conn(0x7f959c0c8080 msgr2=0x7f959c1561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 shutdown_connections 2024-04-20T10:56:02.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:02.373+0000 7f95a1715640 1 -- 172.21.15.90:0/510627824 wait complete. 2024-04-20T10:56:02.384 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:56:04.385 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:04.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.495+0000 7ff5243e6640 1 Processor -- start 2024-04-20T10:56:04.496 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.495+0000 7ff5243e6640 1 -- start start 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff5243e6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff51c0ad720 0x7ff51c155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff5243e6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff51c06e210 0x7ff51c073430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff5243e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 0x7ff51c0c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff5243e6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff51c06dd80 con 0x7ff51c0ad720 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff5243e6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff51c06d450 con 0x7ff51c06e210 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff5243e6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff51c06d730 con 0x7ff51c0705c0 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff522182640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff51c0ad720 0x7ff51c155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:04.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff522182640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff51c0ad720 0x7ff51c155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60956/0 (socket says 172.21.15.90:60956) 2024-04-20T10:56:04.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.496+0000 7ff522182640 1 -- 172.21.15.90:0/2048047751 learned_addr learned my addr 172.21.15.90:0/2048047751 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:04.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.497+0000 7ff522182640 1 -- 172.21.15.90:0/2048047751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 msgr2=0x7ff51c0c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:04.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.497+0000 7ff522182640 1 --2- 172.21.15.90:0/2048047751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 0x7ff51c0c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.497+0000 7ff521981640 1 --2- 172.21.15.90:0/2048047751 >> v2:172.21.15.175:3300/0 conn(0x7ff51c06e210 0x7ff51c073430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:04.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.497+0000 7ff522182640 1 -- 172.21.15.90:0/2048047751 >> v2:172.21.15.175:3300/0 conn(0x7ff51c06e210 msgr2=0x7ff51c073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:04.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.497+0000 7ff522182640 1 --2- 172.21.15.90:0/2048047751 >> v2:172.21.15.175:3300/0 conn(0x7ff51c06e210 0x7ff51c073430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.497+0000 7ff522182640 1 -- 172.21.15.90:0/2048047751 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c06da10 con 0x7ff51c0ad720 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.497+0000 7ff522182640 1 --2- 172.21.15.90:0/2048047751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c155010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0688d0 tx=0x7ff51402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9236393f02fa2abb server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff521180640 1 -- 172.21.15.90:0/2048047751 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51402c9e0 con 0x7ff51c0ad720 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff521180640 1 -- 172.21.15.90:0/2048047751 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff51402cb80 con 0x7ff51c0ad720 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff521180640 1 -- 172.21.15.90:0/2048047751 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5140343f0 con 0x7ff51c0ad720 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 -- 172.21.15.90:0/2048047751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 msgr2=0x7ff51c155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 --2- 172.21.15.90:0/2048047751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c155010 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0688d0 tx=0x7ff51402be40 comp rx=0 tx=0).stop 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 -- 172.21.15.90:0/2048047751 shutdown_connections 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 --2- 172.21.15.90:0/2048047751 >> v2:172.21.15.175:3300/0 conn(0x7ff51c06e210 0x7ff51c073430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.502 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 --2- 172.21.15.90:0/2048047751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 0x7ff51c0c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 --2- 172.21.15.90:0/2048047751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c155010 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 -- 172.21.15.90:0/2048047751 >> 172.21.15.90:0/2048047751 conn(0x7ff51c0c8080 msgr2=0x7ff51c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 -- 172.21.15.90:0/2048047751 shutdown_connections 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.498+0000 7ff5243e6640 1 -- 172.21.15.90:0/2048047751 wait complete. 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.499+0000 7ff5243e6640 1 Processor -- start 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff5243e6640 1 -- start start 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff5243e6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff51c06e210 0x7ff51c0c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff5243e6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 0x7ff51c141210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff5243e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff5243e6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c070cb0 con 0x7ff51c0ad720 2024-04-20T10:56:04.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff5243e6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff51c070b30 con 0x7ff51c06e210 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff5243e6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff51c0adb00 con 0x7ff51c0705c0 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff522983640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff522983640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c141750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:60972/0 (socket says 172.21.15.90:60972) 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff522983640 1 -- 172.21.15.90:0/3121388199 learned_addr learned my addr 172.21.15.90:0/3121388199 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.500+0000 7ff522182640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff51c06e210 0x7ff51c0c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff521981640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 0x7ff51c141210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff522983640 1 -- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 msgr2=0x7ff51c141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff522983640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 0x7ff51c141210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff522983640 1 -- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff51c06e210 msgr2=0x7ff51c0c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff522983640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff51c06e210 0x7ff51c0c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff522983640 1 -- 172.21.15.90:0/3121388199 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c0c3ff0 con 0x7ff51c0ad720 2024-04-20T10:56:04.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff522983640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c141750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00b450 tx=0x7ff50c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:04.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff51affd640 1 -- 172.21.15.90:0/3121388199 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c015020 con 0x7ff51c0ad720 2024-04-20T10:56:04.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff51affd640 1 -- 172.21.15.90:0/3121388199 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff50c011890 con 0x7ff51c0ad720 2024-04-20T10:56:04.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c1ebdb0 con 0x7ff51c0ad720 2024-04-20T10:56:04.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff51affd640 1 -- 172.21.15.90:0/3121388199 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff50c011c60 con 0x7ff51c0ad720 2024-04-20T10:56:04.505 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.501+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff51c1ec370 con 0x7ff51c0ad720 2024-04-20T10:56:04.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.502+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff51c076150 con 0x7ff51c0ad720 2024-04-20T10:56:04.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.502+0000 7ff51affd640 1 -- 172.21.15.90:0/3121388199 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff50c018020 con 0x7ff51c0ad720 2024-04-20T10:56:04.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.503+0000 7ff51affd640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff50806c8f0 0x7ff50806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:04.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.503+0000 7ff51affd640 1 -- 172.21.15.90:0/3121388199 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 7153+0+0 (secure 0 0 0) 0x7ff50c08c270 con 0x7ff51c0ad720 2024-04-20T10:56:04.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.503+0000 7ff522182640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff50806c8f0 0x7ff50806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:04.506 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.503+0000 7ff522182640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff50806c8f0 0x7ff50806edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff514035000 tx=0x7ff514030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:04.507 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.507+0000 7ff51affd640 1 -- 172.21.15.90:0/3121388199 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff50c01f020 con 0x7ff51c0ad720 2024-04-20T10:56:04.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.756+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff51c069c50 con 0x7ff51c0ad720 2024-04-20T10:56:04.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.757+0000 7ff51affd640 1 -- 172.21.15.90:0/3121388199 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+6524 (secure 0 0 0) 0x7ff50c00d040 con 0x7ff51c0ad720 2024-04-20T10:56:04.757 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:04.758 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:54:55.558247+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":32,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5239},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5239":{"gid":5239,"name":"b","rank":0,"incarnation":33,"state":"up:active","state_seq":12,"addr":"172.21.15.175:6833/133567489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":133567489},{"type":"v1","addr":"172.21.15.175:6833","nonce":133567489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5239,"qdb_cluster":[5239]},"id":2}]} 2024-04-20T10:56:04.758 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 44 2024-04-20T10:56:04.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff50806c8f0 msgr2=0x7ff50806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:04.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff50806c8f0 0x7ff50806edb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff514035000 tx=0x7ff514030000 comp rx=0 tx=0).stop 2024-04-20T10:56:04.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 msgr2=0x7ff51c141750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c141750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00b450 tx=0x7ff50c00b910 comp rx=0 tx=0).stop 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 shutdown_connections 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff50806c8f0 0x7ff50806edb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff51c0ad720 0x7ff51c141750 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff51c0705c0 0x7ff51c141210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 --2- 172.21.15.90:0/3121388199 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff51c06e210 0x7ff51c0c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 >> 172.21.15.90:0/3121388199 conn(0x7ff51c0c8080 msgr2=0x7ff51c0c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 shutdown_connections 2024-04-20T10:56:04.760 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:04.759+0000 7ff5243e6640 1 -- 172.21.15.90:0/3121388199 wait complete. 2024-04-20T10:56:04.770 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:56:06.771 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:06.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.871+0000 7f8f6c043640 1 Processor -- start 2024-04-20T10:56:06.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.871+0000 7f8f6c043640 1 -- start start 2024-04-20T10:56:06.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.871+0000 7f8f6c043640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8f64153ee0 0x7f8f64157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.871+0000 7f8f6c043640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f640adce0 con 0x7f8f6406c4d0 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.871+0000 7f8f6c043640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f640adfc0 con 0x7f8f640ab710 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.871+0000 7f8f6c043640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f8f640ae2a0 con 0x7f8f64153ee0 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f6a5e0640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8f6406c4d0 0x7f8f6406c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:45136/0 (socket says 172.21.15.90:45136) 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f6a5e0640 1 -- 172.21.15.90:0/4165304063 learned_addr learned my addr 172.21.15.90:0/4165304063 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2550774060 0 0) 0x7f8f640adce0 con 0x7f8f6406c4d0 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f50003520 con 0x7f8f6406c4d0 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f69ddf640 1 --2- 172.21.15.90:0/4165304063 >> v2:172.21.15.175:3300/0 conn(0x7f8f64153ee0 0x7f8f64157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 860293254 0 0) 0x7f8f50003520 con 0x7f8f6406c4d0 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 >> v2:172.21.15.175:3300/0 conn(0x7f8f64153ee0 msgr2=0x7f8f64157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:06.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 --2- 172.21.15.90:0/4165304063 >> v2:172.21.15.175:3300/0 conn(0x7f8f64153ee0 0x7f8f64157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 >> v1:172.21.15.175:6789/0 conn(0x7f8f640ab710 legacy=0x7f8f640c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f640c70f0 con 0x7f8f6406c4d0 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f8f5c0019f0 con 0x7f8f6406c4d0 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 >> v1:172.21.15.90:6789/0 conn(0x7f8f6406c4d0 legacy=0x7f8f6406c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f500039b0 0x7f8f50003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50004800 0x7f8f50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f500052e0 0x7f8f5000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f640ae2a0 con 0x7f8f50004800 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5000c1b0 con 0x7f8f500052e0 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5000c3b0 con 0x7f8f500039b0 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f695de640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50004800 0x7f8f50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.872+0000 7f8f6a5e0640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f500052e0 0x7f8f5000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f69ddf640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f500039b0 0x7f8f50003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f695de640 1 -- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f500039b0 msgr2=0x7f8f50003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f695de640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f500039b0 0x7f8f50003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f695de640 1 -- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f500052e0 msgr2=0x7f8f5000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f695de640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f500052e0 0x7f8f5000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f695de640 1 -- 172.21.15.90:0/4165304063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f50003520 con 0x7f8f50004800 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f6a5e0640 1 -- 172.21.15.90:0/4165304063 reap_dead start 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.873+0000 7f8f695de640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50004800 0x7f8f50004c80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001720 tx=0x7f8f50005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e1a9d17b22b508 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54001370 con 0x7f8f50004800 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f540052d0 con 0x7f8f50004800 2024-04-20T10:56:06.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f68ddd640 1 -- 172.21.15.90:0/4165304063 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54003830 con 0x7f8f50004800 2024-04-20T10:56:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f6c043640 1 -- 172.21.15.90:0/4165304063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50004800 msgr2=0x7f8f50004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f6c043640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50004800 0x7f8f50004c80 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f8f54001720 tx=0x7f8f50005830 comp rx=0 tx=0).stop 2024-04-20T10:56:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f6c043640 1 -- 172.21.15.90:0/4165304063 shutdown_connections 2024-04-20T10:56:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f6c043640 1 --2- 172.21.15.90:0/4165304063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f50004800 0x7f8f50004c80 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:06.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f6c043640 1 -- 172.21.15.90:0/4165304063 >> 172.21.15.90:0/4165304063 conn(0x7f8f640cc060 msgr2=0x7f8f640cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f6c043640 1 -- 172.21.15.90:0/4165304063 shutdown_connections 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.874+0000 7f8f6c043640 1 -- 172.21.15.90:0/4165304063 wait complete. 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.875+0000 7f8f6c043640 1 Processor -- start 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6c043640 1 -- start start 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6c043640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f50004800 0x7f8f64159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6c043640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f640bf030 0x7f8f640c0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6c043640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f640c54e0 0x7f8f640bf9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6c043640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8f64157310 con 0x7f8f640bf030 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6c043640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8f64157190 con 0x7f8f640c54e0 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6c043640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8f64157490 con 0x7f8f50004800 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f695de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f640bf030 0x7f8f640c0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f695de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f640bf030 0x7f8f640c0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59786/0 (socket says 172.21.15.90:59786) 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f695de640 1 -- 172.21.15.90:0/588751379 learned_addr learned my addr 172.21.15.90:0/588751379 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.876+0000 7f8f6a5e0640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f640c54e0 0x7f8f640bf9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f69ddf640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f50004800 0x7f8f64159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f695de640 1 -- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f50004800 msgr2=0x7f8f64159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f695de640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f50004800 0x7f8f64159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f695de640 1 -- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f640c54e0 msgr2=0x7f8f640bf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f695de640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f640c54e0 0x7f8f640bf9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f695de640 1 -- 172.21.15.90:0/588751379 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f640c21d0 con 0x7f8f640bf030 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f6a5e0640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f640c54e0 0x7f8f640bf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f695de640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f640bf030 0x7f8f640c0bb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8f54005040 tx=0x7f8f54001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f5a7fc640 1 -- 172.21.15.90:0/588751379 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54041020 con 0x7f8f640bf030 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f5a7fc640 1 -- 172.21.15.90:0/588751379 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f54005480 con 0x7f8f640bf030 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f64159910 con 0x7f8f640bf030 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f5a7fc640 1 -- 172.21.15.90:0/588751379 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f54007a30 con 0x7f8f640bf030 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.877+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f640c2c40 con 0x7f8f640bf030 2024-04-20T10:56:06.881 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.878+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f64076150 con 0x7f8f640bf030 2024-04-20T10:56:06.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.878+0000 7f8f5a7fc640 1 -- 172.21.15.90:0/588751379 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8f54044020 con 0x7f8f640bf030 2024-04-20T10:56:06.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.879+0000 7f8f5a7fc640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f4806c920 0x7f8f4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:06.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.879+0000 7f8f69ddf640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f4806c920 0x7f8f4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:06.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.879+0000 7f8f5a7fc640 1 -- 172.21.15.90:0/588751379 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f8f540adb80 con 0x7f8f640bf030 2024-04-20T10:56:06.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.880+0000 7f8f69ddf640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f4806c920 0x7f8f4806ede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f640ab2c0 tx=0x7f8f60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:06.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:06.887+0000 7f8f5a7fc640 1 -- 172.21.15.90:0/588751379 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8f5404b030 con 0x7f8f640bf030 2024-04-20T10:56:07.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.150+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8f6406d910 con 0x7f8f640bf030 2024-04-20T10:56:07.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.151+0000 7f8f5a7fc640 1 -- 172.21.15.90:0/588751379 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5691 (secure 0 0 0) 0x7f8f540303c0 con 0x7f8f640bf030 2024-04-20T10:56:07.151 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:07.151 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:05.346934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:56:07.151 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 45 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.152+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f4806c920 msgr2=0x7f8f4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f4806c920 0x7f8f4806ede0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8f640ab2c0 tx=0x7f8f60008040 comp rx=0 tx=0).stop 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f640bf030 msgr2=0x7f8f640c0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f640bf030 0x7f8f640c0bb0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f8f54005040 tx=0x7f8f54001120 comp rx=0 tx=0).stop 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 shutdown_connections 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f4806c920 0x7f8f4806ede0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8f640c54e0 0x7f8f640bf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8f640bf030 0x7f8f640c0bb0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 --2- 172.21.15.90:0/588751379 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8f50004800 0x7f8f64159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 >> 172.21.15.90:0/588751379 conn(0x7f8f640cc060 msgr2=0x7f8f640b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:07.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 shutdown_connections 2024-04-20T10:56:07.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.153+0000 7f8f6c043640 1 -- 172.21.15.90:0/588751379 wait complete. 2024-04-20T10:56:07.164 INFO:tasks.mds_thrash.fs.[b]:mds.b down, removed from mdsmap 2024-04-20T10:56:07.164 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-20T10:56:07.165 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:07.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.268+0000 7f70aef15640 1 Processor -- start 2024-04-20T10:56:07.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.268+0000 7f70aef15640 1 -- start start 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70aef15640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f70a8153ee0 0x7f70a8157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70aef15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f70a80ab710 0x7f70a80c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70aef15640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70a80adce0 con 0x7f70a80c6f20 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70aef15640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f70a80adfc0 con 0x7f70a8153ee0 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70aef15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f70a80ae2a0 con 0x7f70a80ab710 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70accb1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f70a8153ee0 0x7f70a8157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70accb1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f70a8153ee0 0x7f70a8157190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59792/0 (socket says 172.21.15.90:59792) 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70accb1640 1 -- 172.21.15.90:0/3435669323 learned_addr learned my addr 172.21.15.90:0/3435669323 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70a7fff640 1 --2- 172.21.15.90:0/3435669323 >> v2:172.21.15.175:3300/0 conn(0x7f70a80ab710 0x7f70a80c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70accb1640 1 -- 172.21.15.90:0/3435669323 >> v2:172.21.15.175:3300/0 conn(0x7f70a80ab710 msgr2=0x7f70a80c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:07.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70accb1640 1 --2- 172.21.15.90:0/3435669323 >> v2:172.21.15.175:3300/0 conn(0x7f70a80ab710 0x7f70a80c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70accb1640 1 -- 172.21.15.90:0/3435669323 >> v1:172.21.15.175:6789/0 conn(0x7f70a80c6f20 legacy=0x7f70a806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70accb1640 1 -- 172.21.15.90:0/3435669323 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a80bf7d0 con 0x7f70a8153ee0 2024-04-20T10:56:07.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.269+0000 7f70a7fff640 1 --2- 172.21.15.90:0/3435669323 >> v2:172.21.15.175:3300/0 conn(0x7f70a80ab710 0x7f70a80c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.270+0000 7f70accb1640 1 --2- 172.21.15.90:0/3435669323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a8157190 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f70a806d8e0 tx=0x7f709c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b75537559a117d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.270+0000 7f70a77fe640 1 -- 172.21.15.90:0/3435669323 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c02e070 con 0x7f70a8153ee0 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.270+0000 7f70a77fe640 1 -- 172.21.15.90:0/3435669323 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f709c037070 con 0x7f70a8153ee0 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.270+0000 7f70a77fe640 1 -- 172.21.15.90:0/3435669323 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f709c031a00 con 0x7f70a8153ee0 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 -- 172.21.15.90:0/3435669323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 msgr2=0x7f70a8157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 --2- 172.21.15.90:0/3435669323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a8157190 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f70a806d8e0 tx=0x7f709c02b880 comp rx=0 tx=0).stop 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 -- 172.21.15.90:0/3435669323 shutdown_connections 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 --2- 172.21.15.90:0/3435669323 >> v2:172.21.15.175:3300/0 conn(0x7f70a80ab710 0x7f70a80c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 --2- 172.21.15.90:0/3435669323 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a8157190 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 -- 172.21.15.90:0/3435669323 >> 172.21.15.90:0/3435669323 conn(0x7f70a80cc060 msgr2=0x7f70a80cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:07.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 -- 172.21.15.90:0/3435669323 shutdown_connections 2024-04-20T10:56:07.273 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.271+0000 7f70aef15640 1 -- 172.21.15.90:0/3435669323 wait complete. 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.272+0000 7f70aef15640 1 Processor -- start 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.272+0000 7f70aef15640 1 -- start start 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70aef15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70a80ab710 0x7f70a81ef490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70aef15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80c6f20 0x7f70a80aa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70aef15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a80aa5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70aef15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f70a806cff0 con 0x7f70a8153ee0 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70aef15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f70a806ce70 con 0x7f70a80c6f20 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70aef15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f70a806d170 con 0x7f70a80ab710 2024-04-20T10:56:07.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70ad4b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a80aa5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70ad4b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a80aa5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59798/0 (socket says 172.21.15.90:59798) 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.273+0000 7f70ad4b2640 1 -- 172.21.15.90:0/2539468513 learned_addr learned my addr 172.21.15.90:0/2539468513 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70a7fff640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80c6f20 0x7f70a80aa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70accb1640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70a80ab710 0x7f70a81ef490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70ad4b2640 1 -- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70a80ab710 msgr2=0x7f70a81ef490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70ad4b2640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70a80ab710 0x7f70a81ef490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70ad4b2640 1 -- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80c6f20 msgr2=0x7f70a80aa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70ad4b2640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80c6f20 0x7f70a80aa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70ad4b2640 1 -- 172.21.15.90:0/2539468513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70a80aae30 con 0x7f70a8153ee0 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70a7fff640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80c6f20 0x7f70a80aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70ad4b2640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a80aa5f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c6b0 tx=0x7f70a000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70a57fa640 1 -- 172.21.15.90:0/2539468513 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0003b70 con 0x7f70a8153ee0 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70a57fa640 1 -- 172.21.15.90:0/2539468513 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70a0003d30 con 0x7f70a8153ee0 2024-04-20T10:56:07.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70a815a4c0 con 0x7f70a8153ee0 2024-04-20T10:56:07.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70a57fa640 1 -- 172.21.15.90:0/2539468513 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70a0005310 con 0x7f70a8153ee0 2024-04-20T10:56:07.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.274+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70a81f0220 con 0x7f70a8153ee0 2024-04-20T10:56:07.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.275+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70a8076150 con 0x7f70a8153ee0 2024-04-20T10:56:07.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.276+0000 7f70a57fa640 1 -- 172.21.15.90:0/2539468513 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f70a00054b0 con 0x7f70a8153ee0 2024-04-20T10:56:07.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.276+0000 7f70a57fa640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708c06c920 0x7f708c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:07.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.277+0000 7f70a57fa640 1 -- 172.21.15.90:0/2539468513 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f70a008bf90 con 0x7f70a8153ee0 2024-04-20T10:56:07.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.277+0000 7f70accb1640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708c06c920 0x7f708c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:07.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.277+0000 7f70accb1640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708c06c920 0x7f708c06ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f709c036000 tx=0x7f709c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:07.285 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.285+0000 7f70a57fa640 1 -- 172.21.15.90:0/2539468513 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f70a0059dc0 con 0x7f70a8153ee0 2024-04-20T10:56:07.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.553+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70a806d910 con 0x7f70a8153ee0 2024-04-20T10:56:07.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.554+0000 7f70a57fa640 1 -- 172.21.15.90:0/2539468513 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) ==== 94+0+5691 (secure 0 0 0) 0x7f70a00596c0 con 0x7f70a8153ee0 2024-04-20T10:56:07.554 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:07.554 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":45,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:05.346934+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:56:07.555 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 45 2024-04-20T10:56:07.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708c06c920 msgr2=0x7f708c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708c06c920 0x7f708c06ede0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f709c036000 tx=0x7f709c03d040 comp rx=0 tx=0).stop 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 msgr2=0x7f70a80aa5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a80aa5f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c6b0 tx=0x7f70a000cb70 comp rx=0 tx=0).stop 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 shutdown_connections 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708c06c920 0x7f708c06ede0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f70a8153ee0 0x7f70a80aa5f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f70a80c6f20 0x7f70a80aa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 --2- 172.21.15.90:0/2539468513 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f70a80ab710 0x7f70a81ef490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 >> 172.21.15.90:0/2539468513 conn(0x7f70a80cc060 msgr2=0x7f70a80cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 shutdown_connections 2024-04-20T10:56:07.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:07.556+0000 7f70aef15640 1 -- 172.21.15.90:0/2539468513 wait complete. 2024-04-20T10:56:07.568 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 45, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 43, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5562": { "addr": "172.21.15.90:6835/732131803", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6834", "nonce": 732131803, "type": "v2" }, { "addr": "172.21.15.90:6835", "nonce": 732131803, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5562, "incarnation": 39, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 13 } }, "last_failure": 0, "last_failure_osd_epoch": 33, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:55:35.859861+0000", "qdb_cluster": [ 5562 ], "qdb_leader": 5562, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5562 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 45, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5679": { "addr": "172.21.15.90:6837/597803483", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6836", "nonce": 597803483, "type": "v2" }, { "addr": "172.21.15.90:6837", "nonce": 597803483, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5679, "incarnation": 45, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:56:05.346934+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5679 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:56:09.569 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:09.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.668+0000 7f9f2df6d640 1 Processor -- start 2024-04-20T10:56:09.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.668+0000 7f9f2df6d640 1 -- start start 2024-04-20T10:56:09.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f2df6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280adad0 0x7f9f280ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f2df6d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9f280ad3a0 0x7f9f280adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f2df6d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f281551e0 con 0x7f9f280c3b00 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f2df6d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9f280aeb80 con 0x7f9f280ad3a0 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f2df6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9f280aedd0 con 0x7f9f280adad0 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f26ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9f280ad3a0 0x7f9f280adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f26ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9f280ad3a0 0x7f9f280adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59810/0 (socket says 172.21.15.90:59810) 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f26ffd640 1 -- 172.21.15.90:0/2916236387 learned_addr learned my addr 172.21.15.90:0/2916236387 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f277fe640 1 --2- 172.21.15.90:0/2916236387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280adad0 0x7f9f280ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f26ffd640 1 -- 172.21.15.90:0/2916236387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280adad0 msgr2=0x7f9f280ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f26ffd640 1 --2- 172.21.15.90:0/2916236387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280adad0 0x7f9f280ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f26ffd640 1 -- 172.21.15.90:0/2916236387 >> v1:172.21.15.175:6789/0 conn(0x7f9f280c3b00 legacy=0x7f9f281517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f26ffd640 1 -- 172.21.15.90:0/2916236387 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f280af0b0 con 0x7f9f280ad3a0 2024-04-20T10:56:09.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.669+0000 7f9f277fe640 1 --2- 172.21.15.90:0/2916236387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280adad0 0x7f9f280ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.670+0000 7f9f26ffd640 1 --2- 172.21.15.90:0/2916236387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280ad3a0 0x7f9f280adeb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009870 tx=0x7f9f1c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c668450eb5873ab server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.670+0000 7f9f267fc640 1 -- 172.21.15.90:0/2916236387 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c0317c0 con 0x7f9f280ad3a0 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.670+0000 7f9f267fc640 1 -- 172.21.15.90:0/2916236387 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c037070 con 0x7f9f280ad3a0 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.670+0000 7f9f267fc640 1 -- 172.21.15.90:0/2916236387 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c031b80 con 0x7f9f280ad3a0 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 -- 172.21.15.90:0/2916236387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280ad3a0 msgr2=0x7f9f280adeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/2916236387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280ad3a0 0x7f9f280adeb0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c009870 tx=0x7f9f1c02b860 comp rx=0 tx=0).stop 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 -- 172.21.15.90:0/2916236387 shutdown_connections 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/2916236387 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280ad3a0 0x7f9f280adeb0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/2916236387 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280adad0 0x7f9f280ac7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 -- 172.21.15.90:0/2916236387 >> 172.21.15.90:0/2916236387 conn(0x7f9f280c9100 msgr2=0x7f9f280c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:09.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 -- 172.21.15.90:0/2916236387 shutdown_connections 2024-04-20T10:56:09.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.671+0000 7f9f2df6d640 1 -- 172.21.15.90:0/2916236387 wait complete. 2024-04-20T10:56:09.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.672+0000 7f9f2df6d640 1 Processor -- start 2024-04-20T10:56:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.672+0000 7f9f2df6d640 1 -- start start 2024-04-20T10:56:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f2df6d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280ad3a0 0x7f9f280c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f2df6d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280adad0 0x7f9f281edd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f2df6d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f280c3b00 0x7f9f281474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f2df6d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280ae570 con 0x7f9f280adad0 2024-04-20T10:56:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f2df6d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9f280ae3f0 con 0x7f9f280c3b00 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f2df6d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9f28151eb0 con 0x7f9f280ad3a0 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280adad0 0x7f9f281edd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280adad0 0x7f9f281edd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59824/0 (socket says 172.21.15.90:59824) 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 -- 172.21.15.90:0/3283929078 learned_addr learned my addr 172.21.15.90:0/3283929078 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f277fe640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280ad3a0 0x7f9f280c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f27fff640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f280c3b00 0x7f9f281474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 -- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280ad3a0 msgr2=0x7f9f280c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280ad3a0 0x7f9f280c2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 -- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f280c3b00 msgr2=0x7f9f281474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f280c3b00 0x7f9f281474d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f26ffd640 1 -- 172.21.15.90:0/3283929078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f280c0f90 con 0x7f9f280adad0 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f277fe640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280ad3a0 0x7f9f280c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.673+0000 7f9f27fff640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f280c3b00 0x7f9f281474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:56:09.676 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.674+0000 7f9f26ffd640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280adad0 0x7f9f281edd50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000c00 tx=0x7f9f1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.674+0000 7f9f0ffff640 1 -- 172.21.15.90:0/3283929078 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c032860 con 0x7f9f280adad0 2024-04-20T10:56:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.674+0000 7f9f0ffff640 1 -- 172.21.15.90:0/3283929078 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f1c032a00 con 0x7f9f280adad0 2024-04-20T10:56:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.674+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f281ea8e0 con 0x7f9f280adad0 2024-04-20T10:56:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.674+0000 7f9f0ffff640 1 -- 172.21.15.90:0/3283929078 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f1c032df0 con 0x7f9f280adad0 2024-04-20T10:56:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.674+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f28157c30 con 0x7f9f280adad0 2024-04-20T10:56:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.675+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f28076150 con 0x7f9f280adad0 2024-04-20T10:56:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.675+0000 7f9f0ffff640 1 -- 172.21.15.90:0/3283929078 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9f1c04c060 con 0x7f9f280adad0 2024-04-20T10:56:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.676+0000 7f9f0ffff640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9f1406c8f0 0x7f9f1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.676+0000 7f9f0ffff640 1 -- 172.21.15.90:0/3283929078 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f9f1c0ae000 con 0x7f9f280adad0 2024-04-20T10:56:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.676+0000 7f9f277fe640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9f1406c8f0 0x7f9f1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.676+0000 7f9f277fe640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9f1406c8f0 0x7f9f1406edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9f2806c860 tx=0x7f9f18008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:09.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.680+0000 7f9f0ffff640 1 -- 172.21.15.90:0/3283929078 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9f280c0f90 con 0x7f9f280adad0 2024-04-20T10:56:09.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.894+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f28154370 con 0x7f9f280adad0 2024-04-20T10:56:09.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.894+0000 7f9f0ffff640 1 -- 172.21.15.90:0/3283929078 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+5694 (secure 0 0 0) 0x7f9f1c040070 con 0x7f9f280adad0 2024-04-20T10:56:09.895 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:09.895 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":46,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:08.795345+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:reconnect","state_seq":8,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:56:09.895 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 46 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.896+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9f1406c8f0 msgr2=0x7f9f1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.896+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9f1406c8f0 0x7f9f1406edb0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f9f2806c860 tx=0x7f9f18008040 comp rx=0 tx=0).stop 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.896+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280adad0 msgr2=0x7f9f281edd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.896+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280adad0 0x7f9f281edd50 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c000c00 tx=0x7f9f1c0046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 shutdown_connections 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9f1406c8f0 0x7f9f1406edb0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9f280c3b00 0x7f9f281474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9f280adad0 0x7f9f281edd50 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 --2- 172.21.15.90:0/3283929078 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9f280ad3a0 0x7f9f280c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 >> 172.21.15.90:0/3283929078 conn(0x7f9f280c9100 msgr2=0x7f9f281504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:09.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 shutdown_connections 2024-04-20T10:56:09.898 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:09.897+0000 7f9f2df6d640 1 -- 172.21.15.90:0/3283929078 wait complete. 2024-04-20T10:56:09.909 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:56:11.231 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:56:11.234 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:56:11.910 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:12.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.017+0000 7f8605cd3640 1 Processor -- start 2024-04-20T10:56:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.017+0000 7f8605cd3640 1 -- start start 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f8605cd3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8600073810 0x7f8600154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f8605cd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8600157710 0x7f86000c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f8605cd3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86000c40d0 con 0x7f86000ad0c0 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f8605cd3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f86001569e0 con 0x7f8600073810 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f8605cd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8600157280 con 0x7f8600157710 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f85feffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8600157710 0x7f86000c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f85ff7fe640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f8600073810 0x7f8600154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f85feffd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8600157710 0x7f86000c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:40278/0 (socket says 172.21.15.90:40278) 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f85feffd640 1 -- 172.21.15.90:0/624511550 learned_addr learned my addr 172.21.15.90:0/624511550 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.018+0000 7f85fffff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f86000ad0c0 0x7f86000abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:38016/0 (socket says 172.21.15.90:38016) 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.019+0000 7f85ff7fe640 1 -- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8600157710 msgr2=0x7f86000c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.019+0000 7f85ff7fe640 1 --2- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8600157710 0x7f86000c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.019+0000 7f85ff7fe640 1 -- 172.21.15.90:0/624511550 >> v1:172.21.15.175:6789/0 conn(0x7f86000ad0c0 legacy=0x7f86000abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.019+0000 7f85ff7fe640 1 -- 172.21.15.90:0/624511550 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86000c4370 con 0x7f8600073810 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.019+0000 7f85fe7fc640 1 -- 172.21.15.90:0/624511550 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4139797220 0 0) 0x7f86000c40d0 con 0x7f86000ad0c0 2024-04-20T10:56:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.019+0000 7f85feffd640 1 --2- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8600157710 0x7f86000c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:56:12.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f85ff7fe640 1 --2- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 0x7f8600154000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f85f00097a0 tx=0x7f85f002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7436ccc9a2d757f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f85fe7fc640 1 -- 172.21.15.90:0/624511550 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0031780 con 0x7f8600073810 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f85fe7fc640 1 -- 172.21.15.90:0/624511550 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f0037070 con 0x7f8600073810 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f85fe7fc640 1 -- 172.21.15.90:0/624511550 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f0031b40 con 0x7f8600073810 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 -- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 msgr2=0x7f8600154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 --2- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 0x7f8600154000 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f85f00097a0 tx=0x7f85f002b820 comp rx=0 tx=0).stop 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 -- 172.21.15.90:0/624511550 shutdown_connections 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 --2- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8600157710 0x7f86000c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 --2- 172.21.15.90:0/624511550 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 0x7f8600154000 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 -- 172.21.15.90:0/624511550 >> 172.21.15.90:0/624511550 conn(0x7f86000c8080 msgr2=0x7f86000c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 -- 172.21.15.90:0/624511550 shutdown_connections 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.020+0000 7f8605cd3640 1 -- 172.21.15.90:0/624511550 wait complete. 2024-04-20T10:56:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.021+0000 7f8605cd3640 1 Processor -- start 2024-04-20T10:56:12.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f8605cd3640 1 -- start start 2024-04-20T10:56:12.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f8605cd3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 0x7f86000c17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f8605cd3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86000ad0c0 0x7f86001ef550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f8605cd3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8600157710 0x7f86001efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f8605cd3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8600073bf0 con 0x7f8600157710 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f8605cd3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8600156f10 con 0x7f8600073810 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f8605cd3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f86000ac2c0 con 0x7f86000ad0c0 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f85fffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8600157710 0x7f86001efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.022+0000 7f85fffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8600157710 0x7f86001efa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59828/0 (socket says 172.21.15.90:59828) 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85fffff640 1 -- 172.21.15.90:0/2950202503 learned_addr learned my addr 172.21.15.90:0/2950202503 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85ff7fe640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 0x7f86000c17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85feffd640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86000ad0c0 0x7f86001ef550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85fffff640 1 -- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86000ad0c0 msgr2=0x7f86001ef550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85fffff640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86000ad0c0 0x7f86001ef550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85fffff640 1 -- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 msgr2=0x7f86000c17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85fffff640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 0x7f86000c17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85fffff640 1 -- 172.21.15.90:0/2950202503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86000c7020 con 0x7f8600157710 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85fffff640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8600157710 0x7f86001efa90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f85f800c7b0 tx=0x7f85f800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85e7fff640 1 -- 172.21.15.90:0/2950202503 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f8018070 con 0x7f8600157710 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85e7fff640 1 -- 172.21.15.90:0/2950202503 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85f800a640 con 0x7f8600157710 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f860014e440 con 0x7f8600157710 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f85e7fff640 1 -- 172.21.15.90:0/2950202503 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85f800aa30 con 0x7f8600157710 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.023+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f860014d900 con 0x7f8600157710 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.024+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8600076150 con 0x7f8600157710 2024-04-20T10:56:12.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.025+0000 7f85e7fff640 1 -- 172.21.15.90:0/2950202503 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85f800abd0 con 0x7f8600157710 2024-04-20T10:56:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.025+0000 7f85e7fff640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85ec06c8f0 0x7f85ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.025+0000 7f85e7fff640 1 -- 172.21.15.90:0/2950202503 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f85f808b6e0 con 0x7f8600157710 2024-04-20T10:56:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.025+0000 7f85ff7fe640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85ec06c8f0 0x7f85ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:12.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.026+0000 7f85ff7fe640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85ec06c8f0 0x7f85ec06edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85f0036000 tx=0x7f85f0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:12.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.029+0000 7f85e7fff640 1 -- 172.21.15.90:0/2950202503 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f85f8058ed0 con 0x7f8600157710 2024-04-20T10:56:12.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.242+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8600073140 con 0x7f8600157710 2024-04-20T10:56:12.243 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.242+0000 7f85e7fff640 1 -- 172.21.15.90:0/2950202503 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5698 (secure 0 0 0) 0x7f85f805d1d0 con 0x7f8600157710 2024-04-20T10:56:12.243 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:12.243 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":48,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:10.494327+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:clientreplay","state_seq":10,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:56:12.243 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 48 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85ec06c8f0 msgr2=0x7f85ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85ec06c8f0 0x7f85ec06edb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f85f0036000 tx=0x7f85f0008030 comp rx=0 tx=0).stop 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8600157710 msgr2=0x7f86001efa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8600157710 0x7f86001efa90 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f85f800c7b0 tx=0x7f85f800cc70 comp rx=0 tx=0).stop 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 shutdown_connections 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f85ec06c8f0 0x7f85ec06edb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8600157710 0x7f86001efa90 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f86000ad0c0 0x7f86001ef550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 --2- 172.21.15.90:0/2950202503 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8600073810 0x7f86000c17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:12.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.244+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 >> 172.21.15.90:0/2950202503 conn(0x7f86000c8080 msgr2=0x7f8600154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:12.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.245+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 shutdown_connections 2024-04-20T10:56:12.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:12.245+0000 7f8605cd3640 1 -- 172.21.15.90:0/2950202503 wait complete. 2024-04-20T10:56:12.256 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:56:14.257 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:14.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.367+0000 7f04964fd640 1 Processor -- start 2024-04-20T10:56:14.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.367+0000 7f04964fd640 1 -- start start 2024-04-20T10:56:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f04964fd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0490157710 0x7f0490154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f04964fd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04900c4370 con 0x7f04900ad0c0 2024-04-20T10:56:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f04964fd640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0490156c30 con 0x7f0490073810 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f04964fd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f04901569e0 con 0x7f0490157710 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f0494a9a640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f04900ad0c0 0x7f04900abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:45146/0 (socket says 172.21.15.90:45146) 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f0494a9a640 1 -- 172.21.15.90:0/643698407 learned_addr learned my addr 172.21.15.90:0/643698407 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f048f7fe640 1 --2- 172.21.15.90:0/643698407 >> v2:172.21.15.175:3300/0 conn(0x7f0490157710 0x7f0490154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2202215139 0 0) 0x7f04900c4370 con 0x7f04900ad0c0 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.368+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0478003520 con 0x7f04900ad0c0 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2785620630 0 0) 0x7f0478003520 con 0x7f04900ad0c0 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 >> v2:172.21.15.175:3300/0 conn(0x7f0490157710 msgr2=0x7f0490154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 --2- 172.21.15.90:0/643698407 >> v2:172.21.15.175:3300/0 conn(0x7f0490157710 0x7f0490154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 >> v1:172.21.15.175:6789/0 conn(0x7f0490073810 legacy=0x7f04900c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:14.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0490156f10 con 0x7f04900ad0c0 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f04880019f0 con 0x7f04900ad0c0 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 >> v1:172.21.15.90:6789/0 conn(0x7f04900ad0c0 legacy=0x7f04900abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478003a00 0x7f0478003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478004800 0x7f0478004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0478005210 0x7f047800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04901569e0 con 0x7f0478005210 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f047800c160 con 0x7f0478004800 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f047800c360 con 0x7f0478003a00 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f0494a9a640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0478005210 0x7f047800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048f7fe640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478004800 0x7f0478004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f048ffff640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478003a00 0x7f0478003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.373 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f0494a9a640 1 -- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478003a00 msgr2=0x7f0478003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f0494a9a640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478003a00 0x7f0478003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f0494a9a640 1 -- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478004800 msgr2=0x7f0478004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f0494a9a640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0478004800 0x7f0478004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.369+0000 7f0494a9a640 1 -- 172.21.15.90:0/643698407 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0478003520 con 0x7f0478005210 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.370+0000 7f0494a9a640 1 -- 172.21.15.90:0/643698407 reap_dead start 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.370+0000 7f0494a9a640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0478005210 0x7f047800b9c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f048800a760 tx=0x7f0478005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9c58fce2bb5bd79 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.370+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048800a3b0 con 0x7f0478005210 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.370+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488034630 con 0x7f0478005210 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.370+0000 7f048effd640 1 -- 172.21.15.90:0/643698407 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488034a20 con 0x7f0478005210 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.371+0000 7f04964fd640 1 -- 172.21.15.90:0/643698407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0478005210 msgr2=0x7f047800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.371+0000 7f04964fd640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0478005210 0x7f047800b9c0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f048800a760 tx=0x7f0478005830 comp rx=0 tx=0).stop 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.371+0000 7f04964fd640 1 -- 172.21.15.90:0/643698407 shutdown_connections 2024-04-20T10:56:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.371+0000 7f04964fd640 1 --2- 172.21.15.90:0/643698407 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0478005210 0x7f047800b9c0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.371+0000 7f04964fd640 1 -- 172.21.15.90:0/643698407 >> 172.21.15.90:0/643698407 conn(0x7f04900c8080 msgr2=0x7f04900c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.371+0000 7f04964fd640 1 -- 172.21.15.90:0/643698407 shutdown_connections 2024-04-20T10:56:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.371+0000 7f04964fd640 1 -- 172.21.15.90:0/643698407 wait complete. 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.372+0000 7f04964fd640 1 Processor -- start 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.372+0000 7f04964fd640 1 -- start start 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f04964fd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478005210 0x7f04900ac180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f04964fd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f049014bde0 0x7f04901de150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f04964fd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04901dfed0 0x7f04901de690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f04964fd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0490154000 con 0x7f04901dfed0 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f04964fd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0490157280 con 0x7f049014bde0 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f04964fd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0490154180 con 0x7f0478005210 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04901dfed0 0x7f04901de690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.378 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04901dfed0 0x7f04901de690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:59852/0 (socket says 172.21.15.90:59852) 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 -- 172.21.15.90:0/1420799698 learned_addr learned my addr 172.21.15.90:0/1420799698 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f048f7fe640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f049014bde0 0x7f04901de150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f048ffff640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478005210 0x7f04900ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 -- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478005210 msgr2=0x7f04900ac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478005210 0x7f04900ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 -- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f049014bde0 msgr2=0x7f04901de150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f049014bde0 0x7f04901de150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 -- 172.21.15.90:0/1420799698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049014bb90 con 0x7f04901dfed0 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f048f7fe640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f049014bde0 0x7f04901de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f0494a9a640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04901dfed0 0x7f04901de690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f048800a880 tx=0x7f04900c4650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f048cff9640 1 -- 172.21.15.90:0/1420799698 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488043070 con 0x7f04901dfed0 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f048cff9640 1 -- 172.21.15.90:0/1420799698 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488004b60 con 0x7f04901dfed0 2024-04-20T10:56:14.379 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.373+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049014b8b0 con 0x7f04901dfed0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.374+0000 7f048cff9640 1 -- 172.21.15.90:0/1420799698 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0488039040 con 0x7f04901dfed0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.374+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04901e13a0 con 0x7f04901dfed0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.375+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0490076150 con 0x7f04901dfed0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.375+0000 7f048cff9640 1 -- 172.21.15.90:0/1420799698 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0488046070 con 0x7f04901dfed0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.376+0000 7f048cff9640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f047c06c920 0x7f047c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.376+0000 7f048cff9640 1 -- 172.21.15.90:0/1420799698 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f04880ad420 con 0x7f04901dfed0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.376+0000 7f048ffff640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f047c06c920 0x7f047c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.376+0000 7f048ffff640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f047c06c920 0x7f047c06ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0480000c00 tx=0x7f0480009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.380+0000 7f048cff9640 1 -- 172.21.15.90:0/1420799698 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f048807b250 con 0x7f04901dfed0 2024-04-20T10:56:14.604 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-20T10:56:14.604 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-04-20T10:56:14.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.623+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04900c8c40 con 0x7f04901dfed0 2024-04-20T10:56:14.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.623+0000 7f048cff9640 1 -- 172.21.15.90:0/1420799698 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5699 (secure 0 0 0) 0x7f048807ab50 con 0x7f04901dfed0 2024-04-20T10:56:14.624 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:14.624 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:14.624 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 49 2024-04-20T10:56:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f047c06c920 msgr2=0x7f047c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f047c06c920 0x7f047c06ede0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0480000c00 tx=0x7f0480009040 comp rx=0 tx=0).stop 2024-04-20T10:56:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04901dfed0 msgr2=0x7f04901de690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04901dfed0 0x7f04901de690 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f048800a880 tx=0x7f04900c4650 comp rx=0 tx=0).stop 2024-04-20T10:56:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 shutdown_connections 2024-04-20T10:56:14.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f047c06c920 0x7f047c06ede0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04901dfed0 0x7f04901de690 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f049014bde0 0x7f04901de150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 --2- 172.21.15.90:0/1420799698 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0478005210 0x7f04900ac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.625+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 >> 172.21.15.90:0/1420799698 conn(0x7f04900c8080 msgr2=0x7f049014c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.626+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 shutdown_connections 2024-04-20T10:56:14.627 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:14.626+0000 7f04964fd640 1 -- 172.21.15.90:0/1420799698 wait complete. 2024-04-20T10:56:14.637 INFO:tasks.mds_thrash.fs.[b]:mds.c has gained rank=0, replacing gid=5239 2024-04-20T10:56:14.637 INFO:tasks.mds_thrash.fs.[b]:waiting for 9 secs before reviving mds.b 2024-04-20T10:56:16.883 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-04-20T10:56:16.883+0000 7f3dcbc08640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:56:23.638 INFO:tasks.mds_thrash.fs.[b]:reviving mds.b 2024-04-20T10:56:23.638 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-20T10:56:23.638 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-20T10:56:23.641 INFO:tasks.ceph.mds.b:Started 2024-04-20T10:56:23.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:23.712 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-20T10:56:23.738 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.738+0000 7f906097e640 1 Processor -- start 2024-04-20T10:56:23.739 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.738+0000 7f906097e640 1 -- start start 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f906097e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f905c073810 0x7f905c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f906097e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c0c4370 con 0x7f905c0ad0c0 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f906097e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f905c156c30 con 0x7f905c157710 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f906097e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f905c1569e0 con 0x7f905c073810 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f905a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f905c073810 0x7f905c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f905a59c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f905c073810 0x7f905c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33580/0 (socket says 172.21.15.90:33580) 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f905ad9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f905c0ad0c0 0x7f905c0abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:35604/0 (socket says 172.21.15.90:35604) 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.739+0000 7f905a59c640 1 -- 172.21.15.90:0/3333405001 learned_addr learned my addr 172.21.15.90:0/3333405001 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.740+0000 7f905a59c640 1 -- 172.21.15.90:0/3333405001 >> v1:172.21.15.175:6789/0 conn(0x7f905c157710 legacy=0x7f905c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:23.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.740+0000 7f905a59c640 1 -- 172.21.15.90:0/3333405001 >> v1:172.21.15.90:6789/0 conn(0x7f905c0ad0c0 legacy=0x7f905c0abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:23.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.740+0000 7f905a59c640 1 -- 172.21.15.90:0/3333405001 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c156f10 con 0x7f905c073810 2024-04-20T10:56:23.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.740+0000 7f905959a640 1 -- 172.21.15.90:0/3333405001 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1800503270 0 0) 0x7f905c0c4370 con 0x7f905c0ad0c0 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.740+0000 7f905a59c640 1 --2- 172.21.15.90:0/3333405001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c154000 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f904c009e50 tx=0x7f904c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586d2f126ea77426 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.740+0000 7f905959a640 1 -- 172.21.15.90:0/3333405001 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c02cb20 con 0x7f905c073810 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f905959a640 1 -- 172.21.15.90:0/3333405001 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c02ccc0 con 0x7f905c073810 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f905959a640 1 -- 172.21.15.90:0/3333405001 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c034610 con 0x7f905c073810 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f906097e640 1 -- 172.21.15.90:0/3333405001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 msgr2=0x7f905c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f906097e640 1 --2- 172.21.15.90:0/3333405001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c154000 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f904c009e50 tx=0x7f904c02bf80 comp rx=0 tx=0).stop 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f906097e640 1 -- 172.21.15.90:0/3333405001 shutdown_connections 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f906097e640 1 --2- 172.21.15.90:0/3333405001 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c154000 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:23.742 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f906097e640 1 -- 172.21.15.90:0/3333405001 >> 172.21.15.90:0/3333405001 conn(0x7f905c0c8080 msgr2=0x7f905c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:23.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f906097e640 1 -- 172.21.15.90:0/3333405001 shutdown_connections 2024-04-20T10:56:23.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.741+0000 7f906097e640 1 -- 172.21.15.90:0/3333405001 wait complete. 2024-04-20T10:56:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.742+0000 7f906097e640 1 Processor -- start 2024-04-20T10:56:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f906097e640 1 -- start start 2024-04-20T10:56:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f906097e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c1477e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f906097e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f905c0ad0c0 0x7f905c152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f906097e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f905c157710 0x7f905c0c0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:23.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f906097e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f905c0ac2c0 con 0x7f905c073810 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f906097e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f905c157280 con 0x7f905c157710 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f906097e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f905c0ac440 con 0x7f905c0ad0c0 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c1477e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905a59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c1477e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:33592/0 (socket says 172.21.15.90:33592) 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905a59c640 1 -- 172.21.15.90:0/1642221063 learned_addr learned my addr 172.21.15.90:0/1642221063 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905ad9d640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f905c157710 0x7f905c0c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f9059d9b640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f905c0ad0c0 0x7f905c152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905a59c640 1 -- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f905c0ad0c0 msgr2=0x7f905c152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905a59c640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f905c0ad0c0 0x7f905c152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905a59c640 1 -- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f905c157710 msgr2=0x7f905c0c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.743+0000 7f905a59c640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f905c157710 0x7f905c0c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f905a59c640 1 -- 172.21.15.90:0/1642221063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f905c14abb0 con 0x7f905c073810 2024-04-20T10:56:23.746 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f9059d9b640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f905c0ad0c0 0x7f905c152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f905a59c640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c1477e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f904c009e50 tx=0x7f904c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f904affd640 1 -- 172.21.15.90:0/1642221063 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c043030 con 0x7f905c073810 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f904affd640 1 -- 172.21.15.90:0/1642221063 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f904c03e450 con 0x7f905c073810 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f904affd640 1 -- 172.21.15.90:0/1642221063 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f904c03e660 con 0x7f905c073810 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f905c0be6d0 con 0x7f905c073810 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.744+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f905c0bf060 con 0x7f905c073810 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.745+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f905c0bf2a0 con 0x7f905c073810 2024-04-20T10:56:23.747 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.745+0000 7f904affd640 1 -- 172.21.15.90:0/1642221063 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f904c046070 con 0x7f905c073810 2024-04-20T10:56:23.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.745+0000 7f904affd640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f903c06c920 0x7f903c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:23.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.746+0000 7f904affd640 1 -- 172.21.15.90:0/1642221063 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f904c0ae5a0 con 0x7f905c073810 2024-04-20T10:56:23.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.746+0000 7f9059d9b640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f903c06c920 0x7f903c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:23.748 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.746+0000 7f9059d9b640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f903c06c920 0x7f903c06ede0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f905c14a930 tx=0x7f9050009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:23.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.750+0000 7f904affd640 1 -- 172.21.15.90:0/1642221063 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f905c0bf2a0 con 0x7f905c073810 2024-04-20T10:56:23.961 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.961+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f905c076150 con 0x7f905c073810 2024-04-20T10:56:23.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.962+0000 7f904affd640 1 -- 172.21.15.90:0/1642221063 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+5699 (secure 0 0 0) 0x7f904c04d070 con 0x7f905c073810 2024-04-20T10:56:23.962 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:23.962 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:23.963 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 49 2024-04-20T10:56:23.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f903c06c920 msgr2=0x7f903c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:23.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f903c06c920 0x7f903c06ede0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f905c14a930 tx=0x7f9050009040 comp rx=0 tx=0).stop 2024-04-20T10:56:23.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 msgr2=0x7f905c1477e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:23.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c1477e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f904c009e50 tx=0x7f904c004a40 comp rx=0 tx=0).stop 2024-04-20T10:56:23.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 shutdown_connections 2024-04-20T10:56:23.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f903c06c920 0x7f903c06ede0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:23.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f905c157710 0x7f905c0c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:23.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f905c0ad0c0 0x7f905c152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:23.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 --2- 172.21.15.90:0/1642221063 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f905c073810 0x7f905c1477e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:23.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 >> 172.21.15.90:0/1642221063 conn(0x7f905c0c8080 msgr2=0x7f905c0ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:23.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 shutdown_connections 2024-04-20T10:56:23.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:23.964+0000 7f906097e640 1 -- 172.21.15.90:0/1642221063 wait complete. 2024-04-20T10:56:23.975 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-04-20T10:56:25.975 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:26.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.091+0000 7fd599a9a640 1 Processor -- start 2024-04-20T10:56:26.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.091+0000 7fd599a9a640 1 -- start start 2024-04-20T10:56:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd599a9a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd59406e210 0x7fd594155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd599a9a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5940705c0 0x7fd5940c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd599a9a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd59406d450 con 0x7fd5940ad720 2024-04-20T10:56:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd599a9a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd59406dd80 con 0x7fd5940705c0 2024-04-20T10:56:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd599a9a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd59406d730 con 0x7fd59406e210 2024-04-20T10:56:26.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd593fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5940705c0 0x7fd5940c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd5937fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd5940ad720 0x7fd594073430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55636/0 (socket says 172.21.15.90:55636) 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd593fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd5940705c0 0x7fd5940c3530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39444/0 (socket says 172.21.15.90:39444) 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd5937fe640 1 -- 172.21.15.90:0/990808991 learned_addr learned my addr 172.21.15.90:0/990808991 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd593fff640 1 -- 172.21.15.90:0/990808991 >> v2:172.21.15.175:3300/0 conn(0x7fd59406e210 msgr2=0x7fd594155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd58bfff640 1 --2- 172.21.15.90:0/990808991 >> v2:172.21.15.175:3300/0 conn(0x7fd59406e210 0x7fd594155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd593fff640 1 --2- 172.21.15.90:0/990808991 >> v2:172.21.15.175:3300/0 conn(0x7fd59406e210 0x7fd594155010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd592ffd640 1 -- 172.21.15.90:0/990808991 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002118749 0 0) 0x7fd59406d450 con 0x7fd5940ad720 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd593fff640 1 -- 172.21.15.90:0/990808991 >> v1:172.21.15.90:6789/0 conn(0x7fd5940ad720 legacy=0x7fd594073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.092+0000 7fd593fff640 1 -- 172.21.15.90:0/990808991 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59406da10 con 0x7fd5940705c0 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.093+0000 7fd593fff640 1 --2- 172.21.15.90:0/990808991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5940705c0 0x7fd5940c3530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd5940688d0 tx=0x7fd58c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a751d2d94017f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:26.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.093+0000 7fd592ffd640 1 -- 172.21.15.90:0/990808991 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c039070 con 0x7fd5940705c0 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.093+0000 7fd592ffd640 1 -- 172.21.15.90:0/990808991 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd58c02cbf0 con 0x7fd5940705c0 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.093+0000 7fd592ffd640 1 -- 172.21.15.90:0/990808991 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c034440 con 0x7fd5940705c0 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 -- 172.21.15.90:0/990808991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5940705c0 msgr2=0x7fd5940c3530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 --2- 172.21.15.90:0/990808991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5940705c0 0x7fd5940c3530 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fd5940688d0 tx=0x7fd58c02be40 comp rx=0 tx=0).stop 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 -- 172.21.15.90:0/990808991 shutdown_connections 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 --2- 172.21.15.90:0/990808991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5940705c0 0x7fd5940c3530 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 --2- 172.21.15.90:0/990808991 >> v2:172.21.15.175:3300/0 conn(0x7fd59406e210 0x7fd594155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 -- 172.21.15.90:0/990808991 >> 172.21.15.90:0/990808991 conn(0x7fd5940c8080 msgr2=0x7fd5940c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 -- 172.21.15.90:0/990808991 shutdown_connections 2024-04-20T10:56:26.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.094+0000 7fd599a9a640 1 -- 172.21.15.90:0/990808991 wait complete. 2024-04-20T10:56:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.095+0000 7fd599a9a640 1 Processor -- start 2024-04-20T10:56:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.095+0000 7fd599a9a640 1 -- start start 2024-04-20T10:56:26.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd59406e210 0x7fd59414ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5940705c0 0x7fd5940c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5940ad720 0x7fd5941ebb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd594073b40 con 0x7fd59406e210 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd594070b30 con 0x7fd5940ad720 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd59414c3f0 con 0x7fd5940705c0 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd59406e210 0x7fd59414ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd59406e210 0x7fd59414ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39446/0 (socket says 172.21.15.90:39446) 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 -- 172.21.15.90:0/2410948669 learned_addr learned my addr 172.21.15.90:0/2410948669 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd593fff640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5940ad720 0x7fd5941ebb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd58bfff640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5940705c0 0x7fd5940c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 -- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5940705c0 msgr2=0x7fd5940c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:26.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5940705c0 0x7fd5940c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 -- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5940ad720 msgr2=0x7fd5941ebb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5940ad720 0x7fd5941ebb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 -- 172.21.15.90:0/2410948669 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd59414cbd0 con 0x7fd59406e210 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd593fff640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5940ad720 0x7fd5941ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd58bfff640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5940705c0 0x7fd5940c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd5937fe640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd59406e210 0x7fd59414ba90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c430 tx=0x7fd58400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd590ff9640 1 -- 172.21.15.90:0/2410948669 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5840074e0 con 0x7fd59406e210 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd590ff9640 1 -- 172.21.15.90:0/2410948669 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5840047e0 con 0x7fd59406e210 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5940c7a80 con 0x7fd59406e210 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd590ff9640 1 -- 172.21.15.90:0/2410948669 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd584004bd0 con 0x7fd59406e210 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.096+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5941e2fd0 con 0x7fd59406e210 2024-04-20T10:56:26.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.097+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd59414d2b0 con 0x7fd59406e210 2024-04-20T10:56:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.098+0000 7fd590ff9640 1 -- 172.21.15.90:0/2410948669 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd584011070 con 0x7fd59406e210 2024-04-20T10:56:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.098+0000 7fd590ff9640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd57406c8f0 0x7fd57406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.098+0000 7fd590ff9640 1 -- 172.21.15.90:0/2410948669 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7fd58408bcd0 con 0x7fd59406e210 2024-04-20T10:56:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.098+0000 7fd58bfff640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd57406c8f0 0x7fd57406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.099+0000 7fd58bfff640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd57406c8f0 0x7fd57406edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5940734b0 tx=0x7fd57c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:26.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.103+0000 7fd590ff9640 1 -- 172.21.15.90:0/2410948669 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd59414d2b0 con 0x7fd59406e210 2024-04-20T10:56:26.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.328+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd594076150 con 0x7fd59406e210 2024-04-20T10:56:26.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.329+0000 7fd590ff9640 1 -- 172.21.15.90:0/2410948669 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7fd58400e280 con 0x7fd59406e210 2024-04-20T10:56:26.329 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:26.329 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:26.329 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:26.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd57406c8f0 msgr2=0x7fd57406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:26.332 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd57406c8f0 0x7fd57406edb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd5940734b0 tx=0x7fd57c008040 comp rx=0 tx=0).stop 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd59406e210 msgr2=0x7fd59414ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd59406e210 0x7fd59414ba90 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fd58400c430 tx=0x7fd58400c8f0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 shutdown_connections 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd57406c8f0 0x7fd57406edb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5940ad720 0x7fd5941ebb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5940705c0 0x7fd5940c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 --2- 172.21.15.90:0/2410948669 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd59406e210 0x7fd59414ba90 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 >> 172.21.15.90:0/2410948669 conn(0x7fd5940c8080 msgr2=0x7fd594153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 shutdown_connections 2024-04-20T10:56:26.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:26.332+0000 7fd599a9a640 1 -- 172.21.15.90:0/2410948669 wait complete. 2024-04-20T10:56:26.347 INFO:tasks.mds_thrash.fs.[b]:mds.b reported in up:standby state 2024-04-20T10:56:26.347 INFO:tasks.mds_thrash.fs.[b]:waiting for 67 secs before thrashing 2024-04-20T10:56:28.684 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:28.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.781+0000 7f9e49014640 1 Processor -- start 2024-04-20T10:56:28.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.781+0000 7f9e49014640 1 -- start start 2024-04-20T10:56:28.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.781+0000 7f9e49014640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e44154040 0x7f9e440c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:28.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.781+0000 7f9e49014640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e4415a510 0x7f9e44073520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.781+0000 7f9e49014640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e440af590 con 0x7f9e440730e0 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.781+0000 7f9e49014640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9e440acb20 con 0x7f9e44154040 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.781+0000 7f9e49014640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e440acd70 con 0x7f9e4415a510 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e42d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9e44154040 0x7f9e440c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e4259c640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f9e440730e0 0x7f9e44159e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34548/0 (socket says 172.21.15.90:34548) 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e4259c640 1 -- 172.21.15.90:0/2055798204 learned_addr learned my addr 172.21.15.90:0/2055798204 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e4359e640 1 --2- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e4415a510 0x7f9e44073520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e41d9b640 1 -- 172.21.15.90:0/2055798204 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176148999 0 0) 0x7f9e440af590 con 0x7f9e440730e0 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e41d9b640 1 -- 172.21.15.90:0/2055798204 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e2c003520 con 0x7f9e440730e0 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e42d9d640 1 -- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e4415a510 msgr2=0x7f9e44073520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e42d9d640 1 --2- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e4415a510 0x7f9e44073520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:28.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e42d9d640 1 -- 172.21.15.90:0/2055798204 >> v1:172.21.15.175:6789/0 conn(0x7f9e440730e0 legacy=0x7f9e44159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:28.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.782+0000 7f9e42d9d640 1 -- 172.21.15.90:0/2055798204 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e440c6400 con 0x7f9e44154040 2024-04-20T10:56:28.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.783+0000 7f9e42d9d640 1 --2- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e44154040 0x7f9e440c4bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e380097a0 tx=0x7f9e3802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b9058b2351d02dbd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:28.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.783+0000 7f9e41d9b640 1 -- 172.21.15.90:0/2055798204 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38038070 con 0x7f9e44154040 2024-04-20T10:56:28.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.783+0000 7f9e41d9b640 1 -- 172.21.15.90:0/2055798204 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e38031700 con 0x7f9e44154040 2024-04-20T10:56:28.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.783+0000 7f9e41d9b640 1 -- 172.21.15.90:0/2055798204 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38031ab0 con 0x7f9e44154040 2024-04-20T10:56:28.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 -- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e44154040 msgr2=0x7f9e440c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:28.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 --2- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e44154040 0x7f9e440c4bb0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f9e380097a0 tx=0x7f9e3802b7a0 comp rx=0 tx=0).stop 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 -- 172.21.15.90:0/2055798204 shutdown_connections 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 --2- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e4415a510 0x7f9e44073520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 --2- 172.21.15.90:0/2055798204 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e44154040 0x7f9e440c4bb0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 -- 172.21.15.90:0/2055798204 >> 172.21.15.90:0/2055798204 conn(0x7f9e440676c0 msgr2=0x7f9e44067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 -- 172.21.15.90:0/2055798204 shutdown_connections 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.784+0000 7f9e49014640 1 -- 172.21.15.90:0/2055798204 wait complete. 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.785+0000 7f9e49014640 1 Processor -- start 2024-04-20T10:56:28.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.785+0000 7f9e49014640 1 -- start start 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e49014640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e440730e0 0x7f9e4414cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e49014640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e44154040 0x7f9e4414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e49014640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4415a510 0x7f9e4406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e49014640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9e440af020 con 0x7f9e440730e0 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e49014640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9e440aeea0 con 0x7f9e4415a510 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e49014640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9e44070520 con 0x7f9e44154040 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e440730e0 0x7f9e4414cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e440730e0 0x7f9e4414cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39454/0 (socket says 172.21.15.90:39454) 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 -- 172.21.15.90:0/3771936095 learned_addr learned my addr 172.21.15.90:0/3771936095 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e4359e640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4415a510 0x7f9e4406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:28.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e4259c640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e44154040 0x7f9e4414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 -- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e44154040 msgr2=0x7f9e4414d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e44154040 0x7f9e4414d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 -- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4415a510 msgr2=0x7f9e4406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4415a510 0x7f9e4406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 -- 172.21.15.90:0/3771936095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e44159350 con 0x7f9e440730e0 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e42d9d640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e440730e0 0x7f9e4414cb10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9e380098c0 tx=0x7f9e380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.786+0000 7f9e2b7fe640 1 -- 172.21.15.90:0/3771936095 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38041030 con 0x7f9e440730e0 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.787+0000 7f9e2b7fe640 1 -- 172.21.15.90:0/3771936095 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e38039040 con 0x7f9e440730e0 2024-04-20T10:56:28.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.787+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e441ec670 con 0x7f9e440730e0 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.787+0000 7f9e2b7fe640 1 -- 172.21.15.90:0/3771936095 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e38038070 con 0x7f9e440730e0 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.787+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e441595f0 con 0x7f9e440730e0 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.787+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e44076150 con 0x7f9e440730e0 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.788+0000 7f9e2b7fe640 1 -- 172.21.15.90:0/3771936095 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9e38044070 con 0x7f9e440730e0 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.788+0000 7f9e2b7fe640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e3006c8f0 0x7f9e3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.788+0000 7f9e2b7fe640 1 -- 172.21.15.90:0/3771936095 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f9e380ad3e0 con 0x7f9e440730e0 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.788+0000 7f9e4259c640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e3006c8f0 0x7f9e3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:28.791 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.789+0000 7f9e4259c640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e3006c8f0 0x7f9e3006edb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e4406e560 tx=0x7f9e34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:28.793 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:28.793+0000 7f9e2b7fe640 1 -- 172.21.15.90:0/3771936095 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9e38030070 con 0x7f9e440730e0 2024-04-20T10:56:29.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.022+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e44072ec0 con 0x7f9e440730e0 2024-04-20T10:56:29.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.022+0000 7f9e2b7fe640 1 -- 172.21.15.90:0/3771936095 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7f9e3807ac50 con 0x7f9e440730e0 2024-04-20T10:56:29.023 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:29.023 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:29.023 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:29.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e3006c8f0 msgr2=0x7f9e3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e3006c8f0 0x7f9e3006edb0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9e4406e560 tx=0x7f9e34009040 comp rx=0 tx=0).stop 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e440730e0 msgr2=0x7f9e4414cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e440730e0 0x7f9e4414cb10 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9e380098c0 tx=0x7f9e380046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 shutdown_connections 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9e3006c8f0 0x7f9e3006edb0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9e4415a510 0x7f9e4406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9e44154040 0x7f9e4414d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 --2- 172.21.15.90:0/3771936095 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9e440730e0 0x7f9e4414cb10 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 >> 172.21.15.90:0/3771936095 conn(0x7f9e440676c0 msgr2=0x7f9e44150220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 shutdown_connections 2024-04-20T10:56:29.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.024+0000 7f9e49014640 1 -- 172.21.15.90:0/3771936095 wait complete. 2024-04-20T10:56:29.035 INFO:tasks.mds_thrash.fs.[a]:kill mds.a (rank=0) 2024-04-20T10:56:29.035 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-20T10:56:29.036 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:56:29.050 INFO:tasks.ceph.mds.a:Stopped 2024-04-20T10:56:29.050 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:29.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.187+0000 7f4ae06c1640 1 Processor -- start 2024-04-20T10:56:29.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.187+0000 7f4ae06c1640 1 -- start start 2024-04-20T10:56:29.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.188+0000 7f4ae06c1640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ad8073810 0x7f4ad8154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:29.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.188+0000 7f4ae06c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad8157710 0x7f4ad80c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:29.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.188+0000 7f4ae06c1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ad80c40d0 con 0x7f4ad80ad0c0 2024-04-20T10:56:29.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.188+0000 7f4ae06c1640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4ad81569e0 con 0x7f4ad8073810 2024-04-20T10:56:29.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.188+0000 7f4ae06c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad8157280 con 0x7f4ad8157710 2024-04-20T10:56:29.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.188+0000 7f4ade45d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ad8073810 0x7f4ad8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4addc5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad8157710 0x7f4ad80c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4adec5e640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f4ad80ad0c0 0x7f4ad80abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34550/0 (socket says 172.21.15.90:34550) 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4adec5e640 1 -- 172.21.15.90:0/1548945251 learned_addr learned my addr 172.21.15.90:0/1548945251 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4ade45d640 1 -- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad8157710 msgr2=0x7f4ad80c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4ade45d640 1 --2- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad8157710 0x7f4ad80c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4ade45d640 1 -- 172.21.15.90:0/1548945251 >> v1:172.21.15.175:6789/0 conn(0x7f4ad80ad0c0 legacy=0x7f4ad80abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4ade45d640 1 -- 172.21.15.90:0/1548945251 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad80c4370 con 0x7f4ad8073810 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4add45b640 1 -- 172.21.15.90:0/1548945251 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721969567 0 0) 0x7f4ad80c40d0 con 0x7f4ad80ad0c0 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.189+0000 7f4addc5c640 1 --2- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad8157710 0x7f4ad80c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:56:29.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.190+0000 7f4ade45d640 1 --2- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8073810 0x7f4ad8154000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40097a0 tx=0x7f4ad402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d0cffe32cb4d8b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.190+0000 7f4add45b640 1 -- 172.21.15.90:0/1548945251 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40315a0 con 0x7f4ad8073810 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.190+0000 7f4add45b640 1 -- 172.21.15.90:0/1548945251 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad4037070 con 0x7f4ad8073810 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.190+0000 7f4add45b640 1 -- 172.21.15.90:0/1548945251 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4031960 con 0x7f4ad8073810 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.190+0000 7f4ae06c1640 1 -- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8073810 msgr2=0x7f4ad8154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.190+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8073810 0x7f4ad8154000 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40097a0 tx=0x7f4ad402b840 comp rx=0 tx=0).stop 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.191+0000 7f4ae06c1640 1 -- 172.21.15.90:0/1548945251 shutdown_connections 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.191+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad8157710 0x7f4ad80c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.191+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/1548945251 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8073810 0x7f4ad8154000 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.191+0000 7f4ae06c1640 1 -- 172.21.15.90:0/1548945251 >> 172.21.15.90:0/1548945251 conn(0x7f4ad80c8080 msgr2=0x7f4ad80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:29.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.191+0000 7f4ae06c1640 1 -- 172.21.15.90:0/1548945251 shutdown_connections 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.191+0000 7f4ae06c1640 1 -- 172.21.15.90:0/1548945251 wait complete. 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 Processor -- start 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 -- start start 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad8073810 0x7f4ad80c3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad80ad0c0 0x7f4ad814e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8157710 0x7f4ad814eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad8073bf0 con 0x7f4ad8073810 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad8156f10 con 0x7f4ad8157710 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ae06c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ad80ac2c0 con 0x7f4ad80ad0c0 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.192+0000 7f4ade45d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad8073810 0x7f4ad80c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:29.199 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad8073810 0x7f4ad80c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39460/0 (socket says 172.21.15.90:39460) 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 -- 172.21.15.90:0/284891772 learned_addr learned my addr 172.21.15.90:0/284891772 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4addc5c640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad80ad0c0 0x7f4ad814e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4adec5e640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8157710 0x7f4ad814eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 -- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad80ad0c0 msgr2=0x7f4ad814e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad80ad0c0 0x7f4ad814e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 -- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8157710 msgr2=0x7f4ad814eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8157710 0x7f4ad814eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 -- 172.21.15.90:0/284891772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad81e06c0 con 0x7f4ad8073810 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ade45d640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad8073810 0x7f4ad80c3910 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4034040 tx=0x7f4ad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:29.200 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4aceffd640 1 -- 172.21.15.90:0/284891772 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4004230 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4aceffd640 1 -- 172.21.15.90:0/284891772 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad40043f0 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4aceffd640 1 -- 172.21.15.90:0/284891772 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4003850 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad814f840 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.193+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad814f560 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.194+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad8076150 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.195+0000 7f4aceffd640 1 -- 172.21.15.90:0/284891772 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ad40039f0 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.195+0000 7f4aceffd640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4abc06c8f0 0x7f4abc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.195+0000 7f4aceffd640 1 -- 172.21.15.90:0/284891772 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f4ad402f030 con 0x7f4ad8073810 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.195+0000 7f4addc5c640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4abc06c8f0 0x7f4abc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:29.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.195+0000 7f4addc5c640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4abc06c8f0 0x7f4abc06edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009560 tx=0x7f4ac8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:29.202 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.199+0000 7f4aceffd640 1 -- 172.21.15.90:0/284891772 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4ad4041070 con 0x7f4ad8073810 2024-04-20T10:56:29.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.421+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ad8155200 con 0x7f4ad8073810 2024-04-20T10:56:29.422 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.422+0000 7f4aceffd640 1 -- 172.21.15.90:0/284891772 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7f4ad407b870 con 0x7f4ad8073810 2024-04-20T10:56:29.422 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:29.422 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:29.422 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:29.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4abc06c8f0 msgr2=0x7f4abc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4abc06c8f0 0x7f4abc06edb0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ac8009560 tx=0x7f4ac8009190 comp rx=0 tx=0).stop 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad8073810 msgr2=0x7f4ad80c3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad8073810 0x7f4ad80c3910 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4034040 tx=0x7f4ad40046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 shutdown_connections 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4abc06c8f0 0x7f4abc06edb0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ad8157710 0x7f4ad814eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ad80ad0c0 0x7f4ad814e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 --2- 172.21.15.90:0/284891772 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ad8073810 0x7f4ad80c3910 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 >> 172.21.15.90:0/284891772 conn(0x7f4ad80c8080 msgr2=0x7f4ad80ac5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 shutdown_connections 2024-04-20T10:56:29.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:29.424+0000 7f4ae06c1640 1 -- 172.21.15.90:0/284891772 wait complete. 2024-04-20T10:56:29.436 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:56:31.437 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:31.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.552+0000 7f7629375640 1 Processor -- start 2024-04-20T10:56:31.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.552+0000 7f7629375640 1 -- start start 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f7629375640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f76240c6e70 0x7f7624156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f7629375640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f7624150460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f7629375640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76240c9410 con 0x7f76240c8c90 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f7629375640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f762406c580 con 0x7f76240c6e70 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f7629375640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f76240c9c30 con 0x7f762406d120 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f761bfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f76240c8c90 0x7f762406ca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:55652/0 (socket says 172.21.15.90:55652) 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f761bfff640 1 -- 172.21.15.90:0/1560313620 learned_addr learned my addr 172.21.15.90:0/1560313620 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:31.554 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f7622ffd640 1 --2- 172.21.15.90:0/1560313620 >> v2:172.21.15.175:3300/0 conn(0x7f76240c6e70 0x7f7624156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f76237fe640 1 --2- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f7624150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f76227fc640 1 -- 172.21.15.90:0/1560313620 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2186555958 0 0) 0x7f76240c9410 con 0x7f76240c8c90 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.553+0000 7f76227fc640 1 -- 172.21.15.90:0/1560313620 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7610003520 con 0x7f76240c8c90 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.554+0000 7f7622ffd640 1 -- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 msgr2=0x7f7624150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.554+0000 7f7622ffd640 1 --2- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f7624150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.554+0000 7f7622ffd640 1 -- 172.21.15.90:0/1560313620 >> v1:172.21.15.90:6789/0 conn(0x7f76240c8c90 legacy=0x7f762406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.554+0000 7f7622ffd640 1 -- 172.21.15.90:0/1560313620 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76240c96b0 con 0x7f76240c6e70 2024-04-20T10:56:31.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.554+0000 7f76237fe640 1 --2- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f7624150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:56:31.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.554+0000 7f7622ffd640 1 --2- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f7624156a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76140097a0 tx=0x7f761402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25ded729faafebf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:31.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f76227fc640 1 -- 172.21.15.90:0/1560313620 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76140315a0 con 0x7f76240c6e70 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f76227fc640 1 -- 172.21.15.90:0/1560313620 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7614037070 con 0x7f76240c6e70 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f76227fc640 1 -- 172.21.15.90:0/1560313620 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7614031960 con 0x7f76240c6e70 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 -- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 msgr2=0x7f7624156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 --2- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f7624156a50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76140097a0 tx=0x7f761402b840 comp rx=0 tx=0).stop 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 -- 172.21.15.90:0/1560313620 shutdown_connections 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 --2- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f7624150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 --2- 172.21.15.90:0/1560313620 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f7624156a50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 -- 172.21.15.90:0/1560313620 >> 172.21.15.90:0/1560313620 conn(0x7f76240addb0 msgr2=0x7f76240ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 -- 172.21.15.90:0/1560313620 shutdown_connections 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.555+0000 7f7629375640 1 -- 172.21.15.90:0/1560313620 wait complete. 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.556+0000 7f7629375640 1 Processor -- start 2024-04-20T10:56:31.557 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f7629375640 1 -- start start 2024-04-20T10:56:31.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f7629375640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f762415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:31.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f7629375640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f76241489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:31.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f7629375640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76240c8c90 0x7f7624148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:31.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f7629375640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76240ca3a0 con 0x7f76240c8c90 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f7629375640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f76240c90a0 con 0x7f76240c6e70 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f7629375640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f76240ca520 con 0x7f762406d120 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f76237fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76240c8c90 0x7f7624148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f76237fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76240c8c90 0x7f7624148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39474/0 (socket says 172.21.15.90:39474) 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.557+0000 7f76237fe640 1 -- 172.21.15.90:0/1739017919 learned_addr learned my addr 172.21.15.90:0/1739017919 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f761bfff640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f76241489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f76237fe640 1 -- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 msgr2=0x7f762415a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f76237fe640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f762415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f76237fe640 1 -- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 msgr2=0x7f76241489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f76237fe640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f76241489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f76237fe640 1 -- 172.21.15.90:0/1739017919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76241ed460 con 0x7f76240c8c90 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f761bfff640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f76241489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:31.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f76237fe640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76240c8c90 0x7f7624148ee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e10 tx=0x7f761c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:31.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f761b7fe640 1 -- 172.21.15.90:0/1739017919 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c018020 con 0x7f76240c8c90 2024-04-20T10:56:31.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f761b7fe640 1 -- 172.21.15.90:0/1739017919 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f761c014480 con 0x7f76240c8c90 2024-04-20T10:56:31.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f761b7fe640 1 -- 172.21.15.90:0/1739017919 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f761c014850 con 0x7f76240c8c90 2024-04-20T10:56:31.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7624158000 con 0x7f76240c8c90 2024-04-20T10:56:31.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.558+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f762415ab80 con 0x7f76240c8c90 2024-04-20T10:56:31.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.559+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7624157b60 con 0x7f76240c8c90 2024-04-20T10:56:31.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.560+0000 7f761b7fe640 1 -- 172.21.15.90:0/1739017919 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f761c005d10 con 0x7f76240c8c90 2024-04-20T10:56:31.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.560+0000 7f761b7fe640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f760406c8f0 0x7f760406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:31.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.560+0000 7f761b7fe640 1 -- 172.21.15.90:0/1739017919 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f761c08ce10 con 0x7f76240c8c90 2024-04-20T10:56:31.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.560+0000 7f7622ffd640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f760406c8f0 0x7f760406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:31.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.561+0000 7f7622ffd640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f760406c8f0 0x7f760406edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7614036000 tx=0x7f7614030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:31.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.564+0000 7f761b7fe640 1 -- 172.21.15.90:0/1739017919 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f761c022030 con 0x7f76240c8c90 2024-04-20T10:56:31.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.785+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7624076150 con 0x7f76240c8c90 2024-04-20T10:56:31.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.785+0000 7f761b7fe640 1 -- 172.21.15.90:0/1739017919 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7f761c010040 con 0x7f76240c8c90 2024-04-20T10:56:31.785 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:31.786 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:31.786 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:31.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f760406c8f0 msgr2=0x7f760406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f760406c8f0 0x7f760406edb0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7614036000 tx=0x7f7614030000 comp rx=0 tx=0).stop 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76240c8c90 msgr2=0x7f7624148ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76240c8c90 0x7f7624148ee0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f761c009e10 tx=0x7f761c00c490 comp rx=0 tx=0).stop 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 shutdown_connections 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f760406c8f0 0x7f760406edb0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f76240c8c90 0x7f7624148ee0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76240c6e70 0x7f76241489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 --2- 172.21.15.90:0/1739017919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f762406d120 0x7f762415a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 >> 172.21.15.90:0/1739017919 conn(0x7f76240addb0 msgr2=0x7f76240cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 shutdown_connections 2024-04-20T10:56:31.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:31.787+0000 7f7629375640 1 -- 172.21.15.90:0/1739017919 wait complete. 2024-04-20T10:56:31.799 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:56:33.800 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:33.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.911+0000 7f8a54681640 1 Processor -- start 2024-04-20T10:56:33.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.911+0000 7f8a54681640 1 -- start start 2024-04-20T10:56:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a54681640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a4c153ef0 0x7f8a4c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a54681640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0ab730 0x7f8a4c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a54681640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a4c15a720 con 0x7f8a4c0c9ee0 2024-04-20T10:56:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a54681640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8a4c15ac80 con 0x7f8a4c153ef0 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a54681640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c15a9a0 con 0x7f8a4c0ab730 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a5241d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a4c153ef0 0x7f8a4c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a5241d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8a4c153ef0 0x7f8a4c0c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39476/0 (socket says 172.21.15.90:39476) 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a5241d640 1 -- 172.21.15.90:0/2079653747 learned_addr learned my addr 172.21.15.90:0/2079653747 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a51c1c640 1 --2- 172.21.15.90:0/2079653747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0ab730 0x7f8a4c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a5241d640 1 -- 172.21.15.90:0/2079653747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0ab730 msgr2=0x7f8a4c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a5241d640 1 --2- 172.21.15.90:0/2079653747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0ab730 0x7f8a4c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a5241d640 1 -- 172.21.15.90:0/2079653747 >> v1:172.21.15.175:6789/0 conn(0x7f8a4c0c9ee0 legacy=0x7f8a4c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.912+0000 7f8a5241d640 1 -- 172.21.15.90:0/2079653747 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c0c6a90 con 0x7f8a4c153ef0 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.913+0000 7f8a5241d640 1 --2- 172.21.15.90:0/2079653747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c89f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009870 tx=0x7f8a4802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c74966282b20de server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.913+0000 7f8a5141b640 1 -- 172.21.15.90:0/2079653747 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480317c0 con 0x7f8a4c153ef0 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.913+0000 7f8a5141b640 1 -- 172.21.15.90:0/2079653747 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a48037070 con 0x7f8a4c153ef0 2024-04-20T10:56:33.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.913+0000 7f8a5141b640 1 -- 172.21.15.90:0/2079653747 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48031b80 con 0x7f8a4c153ef0 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 -- 172.21.15.90:0/2079653747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c153ef0 msgr2=0x7f8a4c0c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 --2- 172.21.15.90:0/2079653747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c89f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8a48009870 tx=0x7f8a4802b860 comp rx=0 tx=0).stop 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 -- 172.21.15.90:0/2079653747 shutdown_connections 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 --2- 172.21.15.90:0/2079653747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0ab730 0x7f8a4c1568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 --2- 172.21.15.90:0/2079653747 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c89f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 -- 172.21.15.90:0/2079653747 >> 172.21.15.90:0/2079653747 conn(0x7f8a4c0cbfe0 msgr2=0x7f8a4c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 -- 172.21.15.90:0/2079653747 shutdown_connections 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.914+0000 7f8a54681640 1 -- 172.21.15.90:0/2079653747 wait complete. 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.915+0000 7f8a54681640 1 Processor -- start 2024-04-20T10:56:33.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.915+0000 7f8a54681640 1 -- start start 2024-04-20T10:56:33.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a54681640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c0ab730 0x7f8a4c1efa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:33.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a54681640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0c9ee0 0x7f8a4c1eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:33.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a54681640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:33.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a54681640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c0bf800 con 0x7f8a4c0ab730 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a54681640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8a4c157510 con 0x7f8a4c153ef0 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a54681640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4c1f0950 con 0x7f8a4c0c9ee0 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a5241d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c0ab730 0x7f8a4c1efa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a5241d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c0ab730 0x7f8a4c1efa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39482/0 (socket says 172.21.15.90:39482) 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a5241d640 1 -- 172.21.15.90:0/505483152 learned_addr learned my addr 172.21.15.90:0/505483152 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a52c1e640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a51c1c640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0c9ee0 0x7f8a4c1eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a5241d640 1 -- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0c9ee0 msgr2=0x7f8a4c1eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a5241d640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0c9ee0 0x7f8a4c1eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a5241d640 1 -- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c153ef0 msgr2=0x7f8a4c0c1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.916+0000 7f8a5241d640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a5241d640 1 -- 172.21.15.90:0/505483152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a4c1531a0 con 0x7f8a4c0ab730 2024-04-20T10:56:33.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a52c1e640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:56:33.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a5241d640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c0ab730 0x7f8a4c1efa50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8a48000c00 tx=0x7f8a480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:33.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a42ffd640 1 -- 172.21.15.90:0/505483152 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48032650 con 0x7f8a4c0ab730 2024-04-20T10:56:33.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a42ffd640 1 -- 172.21.15.90:0/505483152 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a480327f0 con 0x7f8a4c0ab730 2024-04-20T10:56:33.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a42ffd640 1 -- 172.21.15.90:0/505483152 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a48032be0 con 0x7f8a4c0ab730 2024-04-20T10:56:33.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a4c0b1990 con 0x7f8a4c0ab730 2024-04-20T10:56:33.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.917+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a4c1514a0 con 0x7f8a4c0ab730 2024-04-20T10:56:33.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.918+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a4c076150 con 0x7f8a4c0ab730 2024-04-20T10:56:33.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.919+0000 7f8a42ffd640 1 -- 172.21.15.90:0/505483152 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8a4804c060 con 0x7f8a4c0ab730 2024-04-20T10:56:33.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.919+0000 7f8a42ffd640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a3006c8f0 0x7f8a3006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:33.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.919+0000 7f8a42ffd640 1 -- 172.21.15.90:0/505483152 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f8a480adc30 con 0x7f8a4c0ab730 2024-04-20T10:56:33.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.919+0000 7f8a51c1c640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a3006c8f0 0x7f8a3006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:33.921 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.920+0000 7f8a51c1c640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a3006c8f0 0x7f8a3006edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0cb770 tx=0x7f8a3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:33.923 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:33.924+0000 7f8a42ffd640 1 -- 172.21.15.90:0/505483152 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8a48040070 con 0x7f8a4c0ab730 2024-04-20T10:56:34.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.149+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8a4c0c95c0 con 0x7f8a4c0ab730 2024-04-20T10:56:34.150 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.150+0000 7f8a42ffd640 1 -- 172.21.15.90:0/505483152 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7f8a4807ba60 con 0x7f8a4c0ab730 2024-04-20T10:56:34.151 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:34.151 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:34.151 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a3006c8f0 msgr2=0x7f8a3006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a3006c8f0 0x7f8a3006edb0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c0cb770 tx=0x7f8a3c008040 comp rx=0 tx=0).stop 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c0ab730 msgr2=0x7f8a4c1efa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c0ab730 0x7f8a4c1efa50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8a48000c00 tx=0x7f8a480046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 shutdown_connections 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8a3006c8f0 0x7f8a3006edb0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8a4c153ef0 0x7f8a4c0c1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8a4c0c9ee0 0x7f8a4c1eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 --2- 172.21.15.90:0/505483152 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8a4c0ab730 0x7f8a4c1efa50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 >> 172.21.15.90:0/505483152 conn(0x7f8a4c0cbfe0 msgr2=0x7f8a4c1568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:34.153 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 shutdown_connections 2024-04-20T10:56:34.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:34.152+0000 7f8a54681640 1 -- 172.21.15.90:0/505483152 wait complete. 2024-04-20T10:56:34.163 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:56:36.164 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:36.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.261+0000 7fa22c05b640 1 Processor -- start 2024-04-20T10:56:36.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.262+0000 7fa22c05b640 1 -- start start 2024-04-20T10:56:36.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.262+0000 7fa22c05b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa224153ef0 0x7fa2240c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:36.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.262+0000 7fa22c05b640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2240c9ee0 0x7fa224156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.262+0000 7fa22c05b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa22415a720 con 0x7fa2240ab730 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.262+0000 7fa22c05b640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa22415ac80 con 0x7fa2240c9ee0 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.262+0000 7fa22c05b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa22415a9a0 con 0x7fa224153ef0 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa22a5f8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa2240c9ee0 0x7fa224156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa229df7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa224153ef0 0x7fa2240c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa2295f6640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fa2240ab730 0x7fa2241568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:47290/0 (socket says 172.21.15.90:47290) 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa2295f6640 1 -- 172.21.15.90:0/2783644093 learned_addr learned my addr 172.21.15.90:0/2783644093 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa22a5f8640 1 -- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa224153ef0 msgr2=0x7fa2240c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa22a5f8640 1 --2- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa224153ef0 0x7fa2240c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa22a5f8640 1 -- 172.21.15.90:0/2783644093 >> v1:172.21.15.175:6789/0 conn(0x7fa2240ab730 legacy=0x7fa2241568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa22a5f8640 1 -- 172.21.15.90:0/2783644093 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240c6a90 con 0x7fa2240c9ee0 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa228df5640 1 -- 172.21.15.90:0/2783644093 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333586227 0 0) 0x7fa218001110 con 0x7fa2240ab730 2024-04-20T10:56:36.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.263+0000 7fa229df7640 1 --2- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa224153ef0 0x7fa2240c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.264+0000 7fa22a5f8640 1 --2- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2240c9ee0 0x7fa224156fd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa214009d90 tx=0x7fa21402bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cacd00358669ca3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.264+0000 7fa228df5640 1 -- 172.21.15.90:0/2783644093 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214039070 con 0x7fa2240c9ee0 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.264+0000 7fa228df5640 1 -- 172.21.15.90:0/2783644093 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa21402cb30 con 0x7fa2240c9ee0 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.264+0000 7fa228df5640 1 -- 172.21.15.90:0/2783644093 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa214034440 con 0x7fa2240c9ee0 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 -- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2240c9ee0 msgr2=0x7fa224156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 --2- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2240c9ee0 0x7fa224156fd0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fa214009d90 tx=0x7fa21402bd80 comp rx=0 tx=0).stop 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 -- 172.21.15.90:0/2783644093 shutdown_connections 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 --2- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa2240c9ee0 0x7fa224156fd0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.267 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 --2- 172.21.15.90:0/2783644093 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa224153ef0 0x7fa2240c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 -- 172.21.15.90:0/2783644093 >> 172.21.15.90:0/2783644093 conn(0x7fa2240cbfe0 msgr2=0x7fa2240cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:36.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 -- 172.21.15.90:0/2783644093 shutdown_connections 2024-04-20T10:56:36.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.265+0000 7fa22c05b640 1 -- 172.21.15.90:0/2783644093 wait complete. 2024-04-20T10:56:36.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 Processor -- start 2024-04-20T10:56:36.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 -- start start 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240ab730 0x7fa224150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2240c9ee0 0x7fa224151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa224153ef0 0x7fa2241efe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa2240bf800 con 0x7fa2240c9ee0 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa224157510 con 0x7fa224153ef0 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.266+0000 7fa22c05b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa2241516d0 con 0x7fa2240ab730 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2240c9ee0 0x7fa224151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2240c9ee0 0x7fa224151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53632/0 (socket says 172.21.15.90:53632) 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa22a5f8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa224153ef0 0x7fa2241efe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa229df7640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240ab730 0x7fa224150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:36.270 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 -- 172.21.15.90:0/454220326 learned_addr learned my addr 172.21.15.90:0/454220326 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 -- 172.21.15.90:0/454220326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240ab730 msgr2=0x7fa224150c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240ab730 0x7fa224150c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 -- 172.21.15.90:0/454220326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa224153ef0 msgr2=0x7fa2241efe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa224153ef0 0x7fa2241efe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 -- 172.21.15.90:0/454220326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2240b0840 con 0x7fa2240c9ee0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa22a5f8640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa224153ef0 0x7fa2241efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2295f6640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2240c9ee0 0x7fa224151190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c3e0 tx=0x7fa21800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2227fc640 1 -- 172.21.15.90:0/454220326 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218017070 con 0x7fa2240c9ee0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2227fc640 1 -- 172.21.15.90:0/454220326 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa218005ce0 con 0x7fa2240c9ee0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2240b0b20 con 0x7fa2240c9ee0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa2227fc640 1 -- 172.21.15.90:0/454220326 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa218007310 con 0x7fa2240c9ee0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.267+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2240b10e0 con 0x7fa2240c9ee0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.268+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa224076150 con 0x7fa2240c9ee0 2024-04-20T10:56:36.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.269+0000 7fa2227fc640 1 -- 172.21.15.90:0/454220326 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa21801a070 con 0x7fa2240c9ee0 2024-04-20T10:56:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.269+0000 7fa2227fc640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa21006c8f0 0x7fa21006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.269+0000 7fa2227fc640 1 -- 172.21.15.90:0/454220326 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7fa21808b370 con 0x7fa2240c9ee0 2024-04-20T10:56:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.269+0000 7fa229df7640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa21006c8f0 0x7fa21006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:36.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.270+0000 7fa229df7640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa21006c8f0 0x7fa21006edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa2241ea470 tx=0x7fa21c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:36.274 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.273+0000 7fa2227fc640 1 -- 172.21.15.90:0/454220326 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa22415a720 con 0x7fa2240c9ee0 2024-04-20T10:56:36.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.499+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa224152680 con 0x7fa2240c9ee0 2024-04-20T10:56:36.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.499+0000 7fa2227fc640 1 -- 172.21.15.90:0/454220326 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7fa218058be0 con 0x7fa2240c9ee0 2024-04-20T10:56:36.500 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:36.501 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:36.501 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.501+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa21006c8f0 msgr2=0x7fa21006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.501+0000 7fa22c05b640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa21006c8f0 0x7fa21006edb0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa2241ea470 tx=0x7fa21c009190 comp rx=0 tx=0).stop 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.501+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2240c9ee0 msgr2=0x7fa224151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.501+0000 7fa22c05b640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2240c9ee0 0x7fa224151190 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c3e0 tx=0x7fa21800c8a0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.501+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 shutdown_connections 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.502+0000 7fa22c05b640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa21006c8f0 0x7fa21006edb0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.502+0000 7fa22c05b640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa224153ef0 0x7fa2241efe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.502+0000 7fa22c05b640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa2240c9ee0 0x7fa224151190 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.502+0000 7fa22c05b640 1 --2- 172.21.15.90:0/454220326 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa2240ab730 0x7fa224150c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:36.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.502+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 >> 172.21.15.90:0/454220326 conn(0x7fa2240cbfe0 msgr2=0x7fa2240ad150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:36.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.502+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 shutdown_connections 2024-04-20T10:56:36.504 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:36.502+0000 7fa22c05b640 1 -- 172.21.15.90:0/454220326 wait complete. 2024-04-20T10:56:36.514 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:56:38.515 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.628+0000 7f31f67ce640 1 Processor -- start 2024-04-20T10:56:38.632 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.628+0000 7f31f67ce640 1 -- start start 2024-04-20T10:56:38.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31f67ce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31f00c27a0 0x7f31f01570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:38.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31f67ce640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f31f00ad640 0x7f31f0153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:38.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31f67ce640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31f00adab0 con 0x7f31f00c54d0 2024-04-20T10:56:38.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31f67ce640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f31f0071690 con 0x7f31f00c27a0 2024-04-20T10:56:38.635 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31f67ce640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f31f0071970 con 0x7f31f00ad640 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31effff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31f00c27a0 0x7f31f01570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31effff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31f00c27a0 0x7f31f01570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53638/0 (socket says 172.21.15.90:53638) 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.629+0000 7f31effff640 1 -- 172.21.15.90:0/3044843710 learned_addr learned my addr 172.21.15.90:0/3044843710 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.630+0000 7f31effff640 1 -- 172.21.15.90:0/3044843710 >> v2:172.21.15.175:3300/0 conn(0x7f31f00ad640 msgr2=0x7f31f0153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.630+0000 7f31f4d6b640 1 --2- 172.21.15.90:0/3044843710 >> v2:172.21.15.175:3300/0 conn(0x7f31f00ad640 0x7f31f0153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.630+0000 7f31effff640 1 --2- 172.21.15.90:0/3044843710 >> v2:172.21.15.175:3300/0 conn(0x7f31f00ad640 0x7f31f0153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.630+0000 7f31effff640 1 -- 172.21.15.90:0/3044843710 >> v1:172.21.15.175:6789/0 conn(0x7f31f00c54d0 legacy=0x7f31f015a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.630+0000 7f31effff640 1 -- 172.21.15.90:0/3044843710 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f0159ce0 con 0x7f31f00c27a0 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.630+0000 7f31effff640 1 --2- 172.21.15.90:0/3044843710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f01570d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f31f00acaa0 tx=0x7f31e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11fffad1b158092c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31eeffd640 1 -- 172.21.15.90:0/3044843710 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0035020 con 0x7f31f00c27a0 2024-04-20T10:56:38.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31eeffd640 1 -- 172.21.15.90:0/3044843710 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e0031870 con 0x7f31f00c27a0 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31eeffd640 1 -- 172.21.15.90:0/3044843710 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e0031c40 con 0x7f31f00c27a0 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 -- 172.21.15.90:0/3044843710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 msgr2=0x7f31f01570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 --2- 172.21.15.90:0/3044843710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f01570d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f31f00acaa0 tx=0x7f31e002b910 comp rx=0 tx=0).stop 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 -- 172.21.15.90:0/3044843710 shutdown_connections 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 --2- 172.21.15.90:0/3044843710 >> v2:172.21.15.175:3300/0 conn(0x7f31f00ad640 0x7f31f0153730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 --2- 172.21.15.90:0/3044843710 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f01570d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 -- 172.21.15.90:0/3044843710 >> 172.21.15.90:0/3044843710 conn(0x7f31f00c9100 msgr2=0x7f31f00c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 -- 172.21.15.90:0/3044843710 shutdown_connections 2024-04-20T10:56:38.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.631+0000 7f31f67ce640 1 -- 172.21.15.90:0/3044843710 wait complete. 2024-04-20T10:56:38.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.632+0000 7f31f67ce640 1 Processor -- start 2024-04-20T10:56:38.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31f67ce640 1 -- start start 2024-04-20T10:56:38.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31f67ce640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31f00ad640 0x7f31f014f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:38.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31f67ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f014b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:38.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31f67ce640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31f00c54d0 0x7f31f00c73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:38.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31f67ce640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31f00c2b80 con 0x7f31f00c27a0 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31f67ce640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31f006f510 con 0x7f31f00c54d0 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31f67ce640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f31f00c2d00 con 0x7f31f00ad640 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31ef7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f014b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31ef7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f014b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53640/0 (socket says 172.21.15.90:53640) 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.633+0000 7f31ef7fe640 1 -- 172.21.15.90:0/2708523098 learned_addr learned my addr 172.21.15.90:0/2708523098 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31f4d6b640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31f00c54d0 0x7f31f00c73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ef7fe640 1 -- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31f00ad640 msgr2=0x7f31f014f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:38.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31effff640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31f00ad640 0x7f31f014f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ef7fe640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31f00ad640 0x7f31f014f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ef7fe640 1 -- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31f00c54d0 msgr2=0x7f31f00c73c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ef7fe640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31f00c54d0 0x7f31f00c73c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ef7fe640 1 -- 172.21.15.90:0/2708523098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31f0071cd0 con 0x7f31f00c27a0 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31f4d6b640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31f00c54d0 0x7f31f00c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ef7fe640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f014b740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f31e400b420 tx=0x7f31e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ecff9640 1 -- 172.21.15.90:0/2708523098 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011830 con 0x7f31f00c27a0 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ecff9640 1 -- 172.21.15.90:0/2708523098 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31e4016070 con 0x7f31f00c27a0 2024-04-20T10:56:38.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31f0071f40 con 0x7f31f00c27a0 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31ecff9640 1 -- 172.21.15.90:0/2708523098 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31e4011c10 con 0x7f31f00c27a0 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.634+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31f0072500 con 0x7f31f00c27a0 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.635+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31f014fd10 con 0x7f31f00c27a0 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.636+0000 7f31ecff9640 1 -- 172.21.15.90:0/2708523098 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f31e401b460 con 0x7f31f00c27a0 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.636+0000 7f31ecff9640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31dc06c920 0x7f31dc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.636+0000 7f31ecff9640 1 -- 172.21.15.90:0/2708523098 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f31e408bbd0 con 0x7f31f00c27a0 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.636+0000 7f31effff640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31dc06c920 0x7f31dc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:38.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.637+0000 7f31effff640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31dc06c920 0x7f31dc06ede0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f31e0036000 tx=0x7f31e0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:38.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.641+0000 7f31ecff9640 1 -- 172.21.15.90:0/2708523098 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f31e4020020 con 0x7f31f00c27a0 2024-04-20T10:56:38.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.851+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31f01572b0 con 0x7f31f00c27a0 2024-04-20T10:56:38.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.851+0000 7f31ecff9640 1 -- 172.21.15.90:0/2708523098 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7f31e4059a00 con 0x7f31f00c27a0 2024-04-20T10:56:38.853 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:38.853 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:38.854 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:38.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31dc06c920 msgr2=0x7f31dc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:38.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31dc06c920 0x7f31dc06ede0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f31e0036000 tx=0x7f31e0008030 comp rx=0 tx=0).stop 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 msgr2=0x7f31f014b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f014b740 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f31e400b420 tx=0x7f31e400b8e0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 shutdown_connections 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31dc06c920 0x7f31dc06ede0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31f00c54d0 0x7f31f00c73c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31f00c27a0 0x7f31f014b740 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 --2- 172.21.15.90:0/2708523098 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31f00ad640 0x7f31f014f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 >> 172.21.15.90:0/2708523098 conn(0x7f31f00c9100 msgr2=0x7f31f00c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 shutdown_connections 2024-04-20T10:56:38.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:38.854+0000 7f31f67ce640 1 -- 172.21.15.90:0/2708523098 wait complete. 2024-04-20T10:56:38.866 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:56:40.867 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:40.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.962+0000 7efd6705c640 1 Processor -- start 2024-04-20T10:56:40.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.962+0000 7efd6705c640 1 -- start start 2024-04-20T10:56:40.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd6705c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efd60153ef0 0x7efd600c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd6705c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600c9ee0 0x7efd60156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd6705c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd6015a720 con 0x7efd600ab730 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd6705c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7efd6015ac80 con 0x7efd60153ef0 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd6705c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd6015a9a0 con 0x7efd600c9ee0 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd64df8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efd60153ef0 0x7efd600c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd64df8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efd60153ef0 0x7efd600c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53646/0 (socket says 172.21.15.90:53646) 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.963+0000 7efd64df8640 1 -- 172.21.15.90:0/1041394687 learned_addr learned my addr 172.21.15.90:0/1041394687 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd64df8640 1 -- 172.21.15.90:0/1041394687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600c9ee0 msgr2=0x7efd60156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd655f9640 1 --2- 172.21.15.90:0/1041394687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600c9ee0 0x7efd60156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd64df8640 1 --2- 172.21.15.90:0/1041394687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600c9ee0 0x7efd60156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd64df8640 1 -- 172.21.15.90:0/1041394687 >> v1:172.21.15.175:6789/0 conn(0x7efd600ab730 legacy=0x7efd601568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd64df8640 1 -- 172.21.15.90:0/1041394687 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd600c6a90 con 0x7efd60153ef0 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd655f9640 1 --2- 172.21.15.90:0/1041394687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600c9ee0 0x7efd60156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:40.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd64df8640 1 --2- 172.21.15.90:0/1041394687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60153ef0 0x7efd600c89f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efd600aec60 tx=0x7efd5002b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86a349c9f9f8080a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd5f7fe640 1 -- 172.21.15.90:0/1041394687 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50038070 con 0x7efd60153ef0 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd5f7fe640 1 -- 172.21.15.90:0/1041394687 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd50031520 con 0x7efd60153ef0 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.964+0000 7efd5f7fe640 1 -- 172.21.15.90:0/1041394687 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd500318f0 con 0x7efd60153ef0 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 -- 172.21.15.90:0/1041394687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60153ef0 msgr2=0x7efd600c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 --2- 172.21.15.90:0/1041394687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60153ef0 0x7efd600c89f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efd600aec60 tx=0x7efd5002b7c0 comp rx=0 tx=0).stop 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 -- 172.21.15.90:0/1041394687 shutdown_connections 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 --2- 172.21.15.90:0/1041394687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd600c9ee0 0x7efd60156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 --2- 172.21.15.90:0/1041394687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd60153ef0 0x7efd600c89f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 -- 172.21.15.90:0/1041394687 >> 172.21.15.90:0/1041394687 conn(0x7efd600cbfe0 msgr2=0x7efd600cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 -- 172.21.15.90:0/1041394687 shutdown_connections 2024-04-20T10:56:40.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.965+0000 7efd6705c640 1 -- 172.21.15.90:0/1041394687 wait complete. 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.966+0000 7efd6705c640 1 Processor -- start 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.966+0000 7efd6705c640 1 -- start start 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd6705c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd600ab730 0x7efd601e05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd6705c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600c9ee0 0x7efd600c54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd6705c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd60153ef0 0x7efd601eff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd6705c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efd600bf800 con 0x7efd600ab730 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd6705c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efd60157510 con 0x7efd600c9ee0 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd6705c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efd601dfdb0 con 0x7efd60153ef0 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd600ab730 0x7efd601e05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:40.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd600ab730 0x7efd601e05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53654/0 (socket says 172.21.15.90:53654) 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 -- 172.21.15.90:0/3155080514 learned_addr learned my addr 172.21.15.90:0/3155080514 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 -- 172.21.15.90:0/3155080514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd60153ef0 msgr2=0x7efd601eff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd60153ef0 0x7efd601eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 -- 172.21.15.90:0/3155080514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600c9ee0 msgr2=0x7efd600c54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600c9ee0 0x7efd600c54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 -- 172.21.15.90:0/3155080514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd601e0000 con 0x7efd600ab730 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.967+0000 7efd64df8640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd600ab730 0x7efd601e05c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd5002b800 tx=0x7efd500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.968+0000 7efd5d7fa640 1 -- 172.21.15.90:0/3155080514 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50042070 con 0x7efd600ab730 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.968+0000 7efd5d7fa640 1 -- 172.21.15.90:0/3155080514 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd5003d890 con 0x7efd600ab730 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.968+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd601e02e0 con 0x7efd600ab730 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.968+0000 7efd5d7fa640 1 -- 172.21.15.90:0/3155080514 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd50038040 con 0x7efd600ab730 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.968+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd601528d0 con 0x7efd600ab730 2024-04-20T10:56:40.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.969+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd600c7a50 con 0x7efd600ab730 2024-04-20T10:56:40.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.969+0000 7efd5d7fa640 1 -- 172.21.15.90:0/3155080514 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efd50045070 con 0x7efd600ab730 2024-04-20T10:56:40.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.969+0000 7efd5d7fa640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4c06c8f0 0x7efd4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:40.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.970+0000 7efd5d7fa640 1 -- 172.21.15.90:0/3155080514 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7efd500adbc0 con 0x7efd600ab730 2024-04-20T10:56:40.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.970+0000 7efd5ffff640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4c06c8f0 0x7efd4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:40.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.970+0000 7efd5ffff640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4c06c8f0 0x7efd4c06edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd54006fd0 tx=0x7efd54006bc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:40.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:40.974+0000 7efd5d7fa640 1 -- 172.21.15.90:0/3155080514 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7efd600c7a50 con 0x7efd600ab730 2024-04-20T10:56:41.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.191+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efd60076150 con 0x7efd600ab730 2024-04-20T10:56:41.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.191+0000 7efd5d7fa640 1 -- 172.21.15.90:0/3155080514 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7efd6015a720 con 0x7efd600ab730 2024-04-20T10:56:41.193 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:41.193 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:41.193 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.193+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4c06c8f0 msgr2=0x7efd4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.193+0000 7efd6705c640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4c06c8f0 0x7efd4c06edb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7efd54006fd0 tx=0x7efd54006bc0 comp rx=0 tx=0).stop 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.193+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd600ab730 msgr2=0x7efd601e05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.193+0000 7efd6705c640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd600ab730 0x7efd601e05c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7efd5002b800 tx=0x7efd500046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 shutdown_connections 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7efd4c06c8f0 0x7efd4c06edb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efd60153ef0 0x7efd601eff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:41.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efd600c9ee0 0x7efd600c54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 --2- 172.21.15.90:0/3155080514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efd600ab730 0x7efd601e05c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 >> 172.21.15.90:0/3155080514 conn(0x7efd600cbfe0 msgr2=0x7efd600cad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 shutdown_connections 2024-04-20T10:56:41.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:41.194+0000 7efd6705c640 1 -- 172.21.15.90:0/3155080514 wait complete. 2024-04-20T10:56:41.206 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:56:41.578 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:56:41.581 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:56:43.206 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:43.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.327+0000 7f767f0df640 1 Processor -- start 2024-04-20T10:56:43.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.327+0000 7f767f0df640 1 -- start start 2024-04-20T10:56:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767f0df640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7678073810 0x7f7678154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767f0df640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76780c4370 con 0x7f7678157710 2024-04-20T10:56:43.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767f0df640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7678156c30 con 0x7f76780ad0c0 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767f0df640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f76781569e0 con 0x7f7678073810 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767ce7b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7678073810 0x7f7678154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767ce7b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7678073810 0x7f7678154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53662/0 (socket says 172.21.15.90:53662) 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767ce7b640 1 -- 172.21.15.90:0/1295953412 learned_addr learned my addr 172.21.15.90:0/1295953412 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f7677fff640 1 --1- 172.21.15.90:0/1295953412 >> v1:172.21.15.90:6789/0 conn(0x7f7678157710 0x7f76780c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51216/0 (socket says 172.21.15.90:51216) 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767ce7b640 1 -- 172.21.15.90:0/1295953412 >> v1:172.21.15.175:6789/0 conn(0x7f76780ad0c0 legacy=0x7f76780abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767ce7b640 1 -- 172.21.15.90:0/1295953412 >> v1:172.21.15.90:6789/0 conn(0x7f7678157710 legacy=0x7f76780c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.328+0000 7f767ce7b640 1 -- 172.21.15.90:0/1295953412 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7678156f10 con 0x7f7678073810 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.329+0000 7f767ce7b640 1 --2- 172.21.15.90:0/1295953412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f7678154000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7670009e50 tx=0x7f767002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fb6e0623fb89fe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.329+0000 7f76777fe640 1 -- 172.21.15.90:0/1295953412 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767002ca80 con 0x7f7678073810 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.329+0000 7f76777fe640 1 -- 172.21.15.90:0/1295953412 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767002cc20 con 0x7f7678073810 2024-04-20T10:56:43.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.329+0000 7f76777fe640 1 -- 172.21.15.90:0/1295953412 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76700343f0 con 0x7f7678073810 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.330+0000 7f767f0df640 1 -- 172.21.15.90:0/1295953412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 msgr2=0x7f7678154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.330+0000 7f767f0df640 1 --2- 172.21.15.90:0/1295953412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f7678154000 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f7670009e50 tx=0x7f767002bee0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.330+0000 7f767f0df640 1 -- 172.21.15.90:0/1295953412 shutdown_connections 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.330+0000 7f767f0df640 1 --2- 172.21.15.90:0/1295953412 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f7678154000 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.330+0000 7f767f0df640 1 -- 172.21.15.90:0/1295953412 >> 172.21.15.90:0/1295953412 conn(0x7f76780c8080 msgr2=0x7f76780c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.330+0000 7f767f0df640 1 -- 172.21.15.90:0/1295953412 shutdown_connections 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.330+0000 7f767f0df640 1 -- 172.21.15.90:0/1295953412 wait complete. 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.331+0000 7f767f0df640 1 Processor -- start 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.331+0000 7f767f0df640 1 -- start start 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767f0df640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f76781ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:43.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767f0df640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76780ad0c0 0x7f76780c2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767f0df640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7678157710 0x7f76781eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767f0df640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f76780ac2c0 con 0x7f7678073810 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767f0df640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7678157280 con 0x7f76780ad0c0 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767f0df640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f76780ac440 con 0x7f7678157710 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f76781ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f76781ed7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53674/0 (socket says 172.21.15.90:53674) 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 -- 172.21.15.90:0/193129239 learned_addr learned my addr 172.21.15.90:0/193129239 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 -- 172.21.15.90:0/193129239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7678157710 msgr2=0x7f76781eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7678157710 0x7f76781eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 -- 172.21.15.90:0/193129239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76780ad0c0 msgr2=0x7f76780c2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76780ad0c0 0x7f76780c2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 -- 172.21.15.90:0/193129239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76780bd2a0 con 0x7f7678073810 2024-04-20T10:56:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.332+0000 7f767ce7b640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f76781ed7b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7670009e50 tx=0x7f7670004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.333+0000 7f76757fa640 1 -- 172.21.15.90:0/193129239 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670043020 con 0x7f7678073810 2024-04-20T10:56:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.333+0000 7f76757fa640 1 -- 172.21.15.90:0/193129239 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f767003e450 con 0x7f7678073810 2024-04-20T10:56:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.333+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76780bd580 con 0x7f7678073810 2024-04-20T10:56:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.333+0000 7f76757fa640 1 -- 172.21.15.90:0/193129239 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767003e840 con 0x7f7678073810 2024-04-20T10:56:43.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.333+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76781ea5f0 con 0x7f7678073810 2024-04-20T10:56:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.334+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7678076150 con 0x7f7678073810 2024-04-20T10:56:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.334+0000 7f76757fa640 1 -- 172.21.15.90:0/193129239 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7670046020 con 0x7f7678073810 2024-04-20T10:56:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.334+0000 7f76757fa640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f766406c8f0 0x7f766406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.335+0000 7f76757fa640 1 -- 172.21.15.90:0/193129239 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 7239+0+0 (secure 0 0 0) 0x7f76700aea30 con 0x7f7678073810 2024-04-20T10:56:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.335+0000 7f7677fff640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f766406c8f0 0x7f766406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:43.336 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.335+0000 7f7677fff640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f766406c8f0 0x7f766406edb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f60 tx=0x7f766c007a00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:43.339 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.339+0000 7f76757fa640 1 -- 172.21.15.90:0/193129239 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f767004d030 con 0x7f7678073810 2024-04-20T10:56:43.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.552+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76780c8c40 con 0x7f7678073810 2024-04-20T10:56:43.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.553+0000 7f76757fa640 1 -- 172.21.15.90:0/193129239 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+6527 (secure 0 0 0) 0x7f767007c8f0 con 0x7f7678073810 2024-04-20T10:56:43.553 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:43.553 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5497,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":50}],"filesystems":[{"mdsmap":{"epoch":43,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:55:35.859861+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":33,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5562},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5562":{"gid":5562,"name":"a","rank":0,"incarnation":39,"state":"up:active","state_seq":13,"addr":"172.21.15.90:6835/732131803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":732131803},{"type":"v1","addr":"172.21.15.90:6835","nonce":732131803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5562,"qdb_cluster":[5562]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:43.553 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 50 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.554+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f766406c8f0 msgr2=0x7f766406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.554+0000 7f767f0df640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f766406c8f0 0x7f766406edb0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f766c000f60 tx=0x7f766c007a00 comp rx=0 tx=0).stop 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.554+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 msgr2=0x7f76781ed7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.554+0000 7f767f0df640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f76781ed7b0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f7670009e50 tx=0x7f7670004a40 comp rx=0 tx=0).stop 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 shutdown_connections 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f766406c8f0 0x7f766406edb0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7678157710 0x7f76781eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f76780ad0c0 0x7f76780c2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 --2- 172.21.15.90:0/193129239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7678073810 0x7f76781ed7b0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:43.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 >> 172.21.15.90:0/193129239 conn(0x7f76780c8080 msgr2=0x7f76780c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:43.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 shutdown_connections 2024-04-20T10:56:43.556 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:43.555+0000 7f767f0df640 1 -- 172.21.15.90:0/193129239 wait complete. 2024-04-20T10:56:43.568 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:56:45.569 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:45.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.664+0000 7fac4d104640 1 Processor -- start 2024-04-20T10:56:45.665 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.664+0000 7fac4d104640 1 -- start start 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac4d104640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac4806deb0 0x7fac48152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac4d104640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac480c2b20 con 0x7fac480c3d40 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac4d104640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac48153250 con 0x7fac48150550 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac4d104640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fac480ab0e0 con 0x7fac4806deb0 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac4659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fac480c3d40 0x7fac4814fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:60164/0 (socket says 172.21.15.90:60164) 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac4659c640 1 -- 172.21.15.90:0/745263424 learned_addr learned my addr 172.21.15.90:0/745263424 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac46d9d640 1 --2- 172.21.15.90:0/745263424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac4806deb0 0x7fac48152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.665+0000 7fac45d9b640 1 -- 172.21.15.90:0/745263424 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 867832222 0 0) 0x7fac480c2b20 con 0x7fac480c3d40 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.666+0000 7fac45d9b640 1 -- 172.21.15.90:0/745263424 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac30005730 con 0x7fac480c3d40 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.666+0000 7fac45d9b640 1 -- 172.21.15.90:0/745263424 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19667587 0 0) 0x7fac48153250 con 0x7fac48150550 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.666+0000 7fac45d9b640 1 -- 172.21.15.90:0/745263424 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac480c2b20 con 0x7fac48150550 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.666+0000 7fac46d9d640 1 -- 172.21.15.90:0/745263424 >> v1:172.21.15.175:6789/0 conn(0x7fac48150550 legacy=0x7fac480c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:45.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.666+0000 7fac46d9d640 1 -- 172.21.15.90:0/745263424 >> v1:172.21.15.90:6789/0 conn(0x7fac480c3d40 legacy=0x7fac4814fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.666+0000 7fac46d9d640 1 -- 172.21.15.90:0/745263424 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac48153530 con 0x7fac4806deb0 2024-04-20T10:56:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.666+0000 7fac46d9d640 1 --2- 172.21.15.90:0/745263424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac4806deb0 0x7fac48152b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac380097d0 tx=0x7fac3802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5666a3ebff8e8571 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac45d9b640 1 -- 172.21.15.90:0/745263424 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38035020 con 0x7fac4806deb0 2024-04-20T10:56:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac45d9b640 1 -- 172.21.15.90:0/745263424 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac38031800 con 0x7fac4806deb0 2024-04-20T10:56:45.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac45d9b640 1 -- 172.21.15.90:0/745263424 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38031bb0 con 0x7fac4806deb0 2024-04-20T10:56:45.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac4d104640 1 -- 172.21.15.90:0/745263424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac4806deb0 msgr2=0x7fac48152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:45.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac4d104640 1 --2- 172.21.15.90:0/745263424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac4806deb0 0x7fac48152b90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac380097d0 tx=0x7fac3802b8a0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac4d104640 1 -- 172.21.15.90:0/745263424 shutdown_connections 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac4d104640 1 --2- 172.21.15.90:0/745263424 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac4806deb0 0x7fac48152b90 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac4d104640 1 -- 172.21.15.90:0/745263424 >> 172.21.15.90:0/745263424 conn(0x7fac480c8080 msgr2=0x7fac480c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac4d104640 1 -- 172.21.15.90:0/745263424 shutdown_connections 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.667+0000 7fac4d104640 1 -- 172.21.15.90:0/745263424 wait complete. 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 Processor -- start 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 -- start start 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4806deb0 0x7fac4814f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac480c3d40 0x7fac4814ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac48150550 0x7fac481dd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fac48153af0 con 0x7fac4806deb0 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fac480c4880 con 0x7fac48150550 2024-04-20T10:56:45.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4d104640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fac4806e290 con 0x7fac480c3d40 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac46d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4806deb0 0x7fac4814f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac46d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4806deb0 0x7fac4814f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44276/0 (socket says 172.21.15.90:44276) 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac46d9d640 1 -- 172.21.15.90:0/3841471303 learned_addr learned my addr 172.21.15.90:0/3841471303 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4759e640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac48150550 0x7fac481dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.669+0000 7fac4659c640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac480c3d40 0x7fac4814ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac46d9d640 1 -- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac480c3d40 msgr2=0x7fac4814ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac46d9d640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac480c3d40 0x7fac4814ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac46d9d640 1 -- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac48150550 msgr2=0x7fac481dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac46d9d640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac48150550 0x7fac481dd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac46d9d640 1 -- 172.21.15.90:0/3841471303 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac481ecd60 con 0x7fac4806deb0 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac46d9d640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4806deb0 0x7fac4814f430 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fac38034040 tx=0x7fac380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac2f7fe640 1 -- 172.21.15.90:0/3841471303 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38035040 con 0x7fac4806deb0 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac2f7fe640 1 -- 172.21.15.90:0/3841471303 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac38039cf0 con 0x7fac4806deb0 2024-04-20T10:56:45.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac481ed040 con 0x7fac4806deb0 2024-04-20T10:56:45.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac2f7fe640 1 -- 172.21.15.90:0/3841471303 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac38039ea0 con 0x7fac4806deb0 2024-04-20T10:56:45.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.670+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481dd950 con 0x7fac4806deb0 2024-04-20T10:56:45.673 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.671+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac48076150 con 0x7fac4806deb0 2024-04-20T10:56:45.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.672+0000 7fac2f7fe640 1 -- 172.21.15.90:0/3841471303 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac38038020 con 0x7fac4806deb0 2024-04-20T10:56:45.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.672+0000 7fac2f7fe640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac3406c8f0 0x7fac3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:45.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.672+0000 7fac2f7fe640 1 -- 172.21.15.90:0/3841471303 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7fac380ae100 con 0x7fac4806deb0 2024-04-20T10:56:45.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.672+0000 7fac4659c640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac3406c8f0 0x7fac3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:45.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.672+0000 7fac4659c640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac3406c8f0 0x7fac3406edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac48151d40 tx=0x7fac3c007d70 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:45.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.677+0000 7fac2f7fe640 1 -- 172.21.15.90:0/3841471303 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fac3807b890 con 0x7fac4806deb0 2024-04-20T10:56:45.939 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.939+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac48074380 con 0x7fac4806deb0 2024-04-20T10:56:45.940 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.940+0000 7fac2f7fe640 1 -- 172.21.15.90:0/3841471303 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5697 (secure 0 0 0) 0x7fac3807fb90 con 0x7fac4806deb0 2024-04-20T10:56:45.940 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:45.940 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:45.352953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:45.940 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-04-20T10:56:45.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac3406c8f0 msgr2=0x7fac3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:45.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac3406c8f0 0x7fac3406edb0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fac48151d40 tx=0x7fac3c007d70 comp rx=0 tx=0).stop 2024-04-20T10:56:45.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4806deb0 msgr2=0x7fac4814f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:45.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4806deb0 0x7fac4814f430 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fac38034040 tx=0x7fac380046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 shutdown_connections 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fac3406c8f0 0x7fac3406edb0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fac48150550 0x7fac481dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fac480c3d40 0x7fac4814ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 --2- 172.21.15.90:0/3841471303 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fac4806deb0 0x7fac4814f430 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 >> 172.21.15.90:0/3841471303 conn(0x7fac480c8080 msgr2=0x7fac480c2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 shutdown_connections 2024-04-20T10:56:45.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:45.942+0000 7fac4d104640 1 -- 172.21.15.90:0/3841471303 wait complete. 2024-04-20T10:56:45.954 INFO:tasks.mds_thrash.fs.[a]:mds.a down, removed from mdsmap 2024-04-20T10:56:45.954 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-20T10:56:45.954 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:46.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.061+0000 7fc81ed9f640 1 Processor -- start 2024-04-20T10:56:46.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.061+0000 7fc81ed9f640 1 -- start start 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.061+0000 7fc81ed9f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 0x7fc8180ae6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.061+0000 7fc81ed9f640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fc8180aec20 0x7fc8180c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81ed9f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc818071320 con 0x7fc8180c8160 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81ed9f640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fc818156950 con 0x7fc8180aec20 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81ed9f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc818156c30 con 0x7fc818153d90 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81e59e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fc8180c8160 0x7fc8180c37f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:60180/0 (socket says 172.21.15.90:60180) 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81e59e640 1 -- 172.21.15.90:0/2066903713 learned_addr learned my addr 172.21.15.90:0/2066903713 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 0x7fc8180ae6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81d59c640 1 --2- 172.21.15.90:0/2066903713 >> v2:172.21.15.175:3300/0 conn(0x7fc8180aec20 0x7fc8180c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113039385 0 0) 0x7fc818071320 con 0x7fc8180c8160 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc804003520 con 0x7fc8180c8160 2024-04-20T10:56:46.065 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3374638207 0 0) 0x7fc804003520 con 0x7fc8180c8160 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 msgr2=0x7fc8180ae6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 0x7fc8180ae6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 >> v2:172.21.15.175:3300/0 conn(0x7fc8180aec20 msgr2=0x7fc8180c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 --2- 172.21.15.90:0/2066903713 >> v2:172.21.15.175:3300/0 conn(0x7fc8180aec20 0x7fc8180c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc818156f10 con 0x7fc8180c8160 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fc8100019f0 con 0x7fc8180c8160 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 >> v1:172.21.15.90:6789/0 conn(0x7fc8180c8160 legacy=0x7fc8180c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8040039b0 0x7fc804003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 0x7fc804004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804004d40 0x7fc8040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc818156950 con 0x7fc8040039b0 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc818156c30 con 0x7fc804004d40 2024-04-20T10:56:46.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8040039b0 0x7fc804003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc80400b9c0 con 0x7fc818153d90 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.062+0000 7fc81e59e640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804004d40 0x7fc8040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81d59c640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 0x7fc804004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81dd9d640 1 -- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 msgr2=0x7fc804004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 0x7fc804004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81dd9d640 1 -- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804004d40 msgr2=0x7fc8040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc804004d40 0x7fc8040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81dd9d640 1 -- 172.21.15.90:0/2066903713 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc804003520 con 0x7fc8040039b0 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81d59c640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc818153d90 0x7fc804004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.063+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8040039b0 0x7fc804003dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc814009ac0 tx=0x7fc804005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=120dce7e48a8c03d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814039070 con 0x7fc8040039b0 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc81402c6b0 con 0x7fc8040039b0 2024-04-20T10:56:46.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81cd9b640 1 -- 172.21.15.90:0/2066903713 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc814009690 con 0x7fc8040039b0 2024-04-20T10:56:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81ed9f640 1 -- 172.21.15.90:0/2066903713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8040039b0 msgr2=0x7fc804003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81ed9f640 1 --2- 172.21.15.90:0/2066903713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc8040039b0 0x7fc804003dd0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fc814009ac0 tx=0x7fc804005830 comp rx=0 tx=0).stop 2024-04-20T10:56:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81e59e640 1 -- 172.21.15.90:0/2066903713 reap_dead start 2024-04-20T10:56:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81ed9f640 1 -- 172.21.15.90:0/2066903713 shutdown_connections 2024-04-20T10:56:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81ed9f640 1 -- 172.21.15.90:0/2066903713 >> 172.21.15.90:0/2066903713 conn(0x7fc8180c5810 msgr2=0x7fc8180c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81ed9f640 1 -- 172.21.15.90:0/2066903713 shutdown_connections 2024-04-20T10:56:46.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.064+0000 7fc81ed9f640 1 -- 172.21.15.90:0/2066903713 wait complete. 2024-04-20T10:56:46.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.065+0000 7fc81ed9f640 1 Processor -- start 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.065+0000 7fc81ed9f640 1 -- start start 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81ed9f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8040039b0 0x7fc8181585d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81ed9f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc818152ed0 0x7fc818159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81ed9f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8181efe70 0x7fc8181e3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81ed9f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc8180ae6e0 con 0x7fc818152ed0 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81ed9f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc818154170 con 0x7fc8040039b0 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81ed9f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc8180ae860 con 0x7fc8181efe70 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc818152ed0 0x7fc818159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc818152ed0 0x7fc818159310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44298/0 (socket says 172.21.15.90:44298) 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 -- 172.21.15.90:0/1494255517 learned_addr learned my addr 172.21.15.90:0/1494255517 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81e59e640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8181efe70 0x7fc8181e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8040039b0 0x7fc8181585d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 -- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8181efe70 msgr2=0x7fc8181e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8181efe70 0x7fc8181e3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 -- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8040039b0 msgr2=0x7fc8181585d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8040039b0 0x7fc8181585d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 -- 172.21.15.90:0/1494255517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8181ef6b0 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.066+0000 7fc81d59c640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc818152ed0 0x7fc818159310 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc808011690 tx=0x7fc808011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.067+0000 7fc80e7fc640 1 -- 172.21.15.90:0/1494255517 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80800f8f0 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.067+0000 7fc80e7fc640 1 -- 172.21.15.90:0/1494255517 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc80800fa90 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.067+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc81815a430 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.067+0000 7fc80e7fc640 1 -- 172.21.15.90:0/1494255517 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80800fe80 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.067+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc81815a9f0 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.068+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc818076070 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.068+0000 7fc80e7fc640 1 -- 172.21.15.90:0/1494255517 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc808015460 con 0x7fc818152ed0 2024-04-20T10:56:46.072 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.069+0000 7fc80e7fc640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc7fc06c920 0x7fc7fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:46.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.069+0000 7fc80e7fc640 1 -- 172.21.15.90:0/1494255517 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7fc80808c960 con 0x7fc818152ed0 2024-04-20T10:56:46.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.069+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc7fc06c920 0x7fc7fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:46.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.069+0000 7fc81dd9d640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc7fc06c920 0x7fc7fc06ede0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc814036000 tx=0x7fc814030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:46.073 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.073+0000 7fc80e7fc640 1 -- 172.21.15.90:0/1494255517 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc808019030 con 0x7fc818152ed0 2024-04-20T10:56:46.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.283+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8180c4860 con 0x7fc818152ed0 2024-04-20T10:56:46.284 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.284+0000 7fc80e7fc640 1 -- 172.21.15.90:0/1494255517 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5697 (secure 0 0 0) 0x7fc80805a740 con 0x7fc818152ed0 2024-04-20T10:56:46.284 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:46.284 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:45.352953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:46.284 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-04-20T10:56:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc7fc06c920 msgr2=0x7fc7fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc7fc06c920 0x7fc7fc06ede0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc814036000 tx=0x7fc814030000 comp rx=0 tx=0).stop 2024-04-20T10:56:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc818152ed0 msgr2=0x7fc818159310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc818152ed0 0x7fc818159310 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fc808011690 tx=0x7fc808011a90 comp rx=0 tx=0).stop 2024-04-20T10:56:46.286 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 shutdown_connections 2024-04-20T10:56:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc7fc06c920 0x7fc7fc06ede0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc8181efe70 0x7fc8181e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc818152ed0 0x7fc818159310 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 --2- 172.21.15.90:0/1494255517 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc8040039b0 0x7fc8181585d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 >> 172.21.15.90:0/1494255517 conn(0x7fc8180c5810 msgr2=0x7fc8180715b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 shutdown_connections 2024-04-20T10:56:46.287 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:46.286+0000 7fc81ed9f640 1 -- 172.21.15.90:0/1494255517 wait complete. 2024-04-20T10:56:46.297 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 51, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 51, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5497": { "addr": "172.21.15.175:6833/3798454731", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6832", "nonce": 3798454731, "type": "v2" }, { "addr": "172.21.15.175:6833", "nonce": 3798454731, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5497, "incarnation": 51, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:56:45.352953+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5497 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 49, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5679": { "addr": "172.21.15.90:6837/597803483", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6836", "nonce": 597803483, "type": "v2" }, { "addr": "172.21.15.90:6837", "nonce": 597803483, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5679, "incarnation": 45, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 34, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:56:12.376110+0000", "qdb_cluster": [ 5679 ], "qdb_leader": 5679, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5679 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:56:48.298 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:48.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.412+0000 7f6bd0515640 1 Processor -- start 2024-04-20T10:56:48.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.412+0000 7f6bd0515640 1 -- start start 2024-04-20T10:56:48.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bd0515640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6bc8151b10 0x7f6bc8154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:48.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bd0515640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc8073ba0 con 0x7f6bc80aba60 2024-04-20T10:56:48.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bd0515640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bc81589a0 con 0x7f6bc8157a70 2024-04-20T10:56:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bd0515640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6bc8151ef0 con 0x7f6bc8151b10 2024-04-20T10:56:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bce2b1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6bc8151b10 0x7f6bc8154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bce2b1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6bc8151b10 0x7f6bc8154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44312/0 (socket says 172.21.15.90:44312) 2024-04-20T10:56:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bce2b1640 1 -- 172.21.15.90:0/516492340 learned_addr learned my addr 172.21.15.90:0/516492340 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bce2b1640 1 -- 172.21.15.90:0/516492340 >> v1:172.21.15.175:6789/0 conn(0x7f6bc8157a70 legacy=0x7f6bc80725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bce2b1640 1 -- 172.21.15.90:0/516492340 >> v1:172.21.15.90:6789/0 conn(0x7f6bc80aba60 legacy=0x7f6bc80abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:48.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.413+0000 7f6bce2b1640 1 -- 172.21.15.90:0/516492340 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc8158100 con 0x7f6bc8151b10 2024-04-20T10:56:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.414+0000 7f6bce2b1640 1 --2- 172.21.15.90:0/516492340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8151b10 0x7f6bc8154480 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098a0 tx=0x7f6bc402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e0e517864110b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.414+0000 7f6bcd2af640 1 -- 172.21.15.90:0/516492340 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4034070 con 0x7f6bc8151b10 2024-04-20T10:56:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.414+0000 7f6bcd2af640 1 -- 172.21.15.90:0/516492340 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc4030840 con 0x7f6bc8151b10 2024-04-20T10:56:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.414+0000 7f6bcd2af640 1 -- 172.21.15.90:0/516492340 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc4030c10 con 0x7f6bc8151b10 2024-04-20T10:56:48.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.415+0000 7f6bd0515640 1 -- 172.21.15.90:0/516492340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8151b10 msgr2=0x7f6bc8154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.415+0000 7f6bd0515640 1 --2- 172.21.15.90:0/516492340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8151b10 0x7f6bc8154480 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f6bc40098a0 tx=0x7f6bc402b980 comp rx=0 tx=0).stop 2024-04-20T10:56:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.415+0000 7f6bd0515640 1 -- 172.21.15.90:0/516492340 shutdown_connections 2024-04-20T10:56:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.415+0000 7f6bd0515640 1 --2- 172.21.15.90:0/516492340 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8151b10 0x7f6bc8154480 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.415+0000 7f6bd0515640 1 -- 172.21.15.90:0/516492340 >> 172.21.15.90:0/516492340 conn(0x7f6bc80ca0a0 msgr2=0x7f6bc80ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.415+0000 7f6bd0515640 1 -- 172.21.15.90:0/516492340 shutdown_connections 2024-04-20T10:56:48.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.415+0000 7f6bd0515640 1 -- 172.21.15.90:0/516492340 wait complete. 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.416+0000 7f6bd0515640 1 Processor -- start 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.416+0000 7f6bd0515640 1 -- start start 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bd0515640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc80aba60 0x7f6bc80c3740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bd0515640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bc8151b10 0x7f6bc814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bd0515640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8157a70 0x7f6bc814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bd0515640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc80ab540 con 0x7f6bc8157a70 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bd0515640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc81586c0 con 0x7f6bc80aba60 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bd0515640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc8072d00 con 0x7f6bc8151b10 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8157a70 0x7f6bc814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8157a70 0x7f6bc814d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44316/0 (socket says 172.21.15.90:44316) 2024-04-20T10:56:48.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 -- 172.21.15.90:0/1715140333 learned_addr learned my addr 172.21.15.90:0/1715140333 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bce2b1640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc80aba60 0x7f6bc80c3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bcdab0640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bc8151b10 0x7f6bc814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 -- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bc8151b10 msgr2=0x7f6bc814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bc8151b10 0x7f6bc814cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 -- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc80aba60 msgr2=0x7f6bc80c3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc80aba60 0x7f6bc80c3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.417+0000 7f6bceab2640 1 -- 172.21.15.90:0/1715140333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc814ee50 con 0x7f6bc8157a70 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.418+0000 7f6bceab2640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8157a70 0x7f6bc814d040 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c7d0 tx=0x7f6bc000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.418+0000 7f6bbeffd640 1 -- 172.21.15.90:0/1715140333 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc0003b70 con 0x7f6bc8157a70 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.418+0000 7f6bbeffd640 1 -- 172.21.15.90:0/1715140333 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bc0003d30 con 0x7f6bc8157a70 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.418+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc81ef920 con 0x7f6bc8157a70 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.418+0000 7f6bbeffd640 1 -- 172.21.15.90:0/1715140333 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc000aa30 con 0x7f6bc8157a70 2024-04-20T10:56:48.419 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.418+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc81efee0 con 0x7f6bc8157a70 2024-04-20T10:56:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.419+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc8076150 con 0x7f6bc8157a70 2024-04-20T10:56:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.419+0000 7f6bbeffd640 1 -- 172.21.15.90:0/1715140333 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6bc000abd0 con 0x7f6bc8157a70 2024-04-20T10:56:48.420 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.420+0000 7f6bbeffd640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6bac06c8f0 0x7f6bac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.420+0000 7f6bbeffd640 1 -- 172.21.15.90:0/1715140333 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f6bc008be70 con 0x7f6bc8157a70 2024-04-20T10:56:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.420+0000 7f6bce2b1640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6bac06c8f0 0x7f6bac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:48.421 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.420+0000 7f6bce2b1640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6bac06c8f0 0x7f6bac06edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4036000 tx=0x7f6bc4008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:48.424 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.424+0000 7f6bbeffd640 1 -- 172.21.15.90:0/1715140333 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6bc0059690 con 0x7f6bc8157a70 2024-04-20T10:56:48.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.642+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bc80c89e0 con 0x7f6bc8157a70 2024-04-20T10:56:48.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.643+0000 7f6bbeffd640 1 -- 172.21.15.90:0/1715140333 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) ==== 94+0+5697 (secure 0 0 0) 0x7f6bc005d990 con 0x7f6bc8157a70 2024-04-20T10:56:48.643 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:48.644 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":51,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:45.352953+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:48.644 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 51 2024-04-20T10:56:48.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6bac06c8f0 msgr2=0x7f6bac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6bac06c8f0 0x7f6bac06edb0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4036000 tx=0x7f6bc4008030 comp rx=0 tx=0).stop 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8157a70 msgr2=0x7f6bc814d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8157a70 0x7f6bc814d040 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000c7d0 tx=0x7f6bc000cc90 comp rx=0 tx=0).stop 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 shutdown_connections 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6bac06c8f0 0x7f6bac06edb0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6bc8157a70 0x7f6bc814d040 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6bc8151b10 0x7f6bc814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 --2- 172.21.15.90:0/1715140333 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6bc80aba60 0x7f6bc80c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:48.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 >> 172.21.15.90:0/1715140333 conn(0x7f6bc80ca0a0 msgr2=0x7f6bc8154a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:48.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 shutdown_connections 2024-04-20T10:56:48.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:48.645+0000 7f6bd0515640 1 -- 172.21.15.90:0/1715140333 wait complete. 2024-04-20T10:56:48.656 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-20T10:56:50.657 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:50.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.755+0000 7fd5cf84a640 1 Processor -- start 2024-04-20T10:56:50.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.755+0000 7fd5cf84a640 1 -- start start 2024-04-20T10:56:50.755 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cf84a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd5c80c3740 0x7fd5c80c52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:50.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cf84a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c806ff00 con 0x7fd5c8072f90 2024-04-20T10:56:50.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cf84a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5c80701e0 con 0x7fd5c80ab4a0 2024-04-20T10:56:50.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cf84a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd5c8072b00 con 0x7fd5c80c3740 2024-04-20T10:56:50.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cdde7640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd5c8072f90 0x7fd5c8153b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:60200/0 (socket says 172.21.15.90:60200) 2024-04-20T10:56:50.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cdde7640 1 -- 172.21.15.90:0/336719188 learned_addr learned my addr 172.21.15.90:0/336719188 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:50.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cd5e6640 1 --2- 172.21.15.90:0/336719188 >> v2:172.21.15.175:3300/0 conn(0x7fd5c80c3740 0x7fd5c80c52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:50.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5bffff640 1 -- 172.21.15.90:0/336719188 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181950884 0 0) 0x7fd5c806ff00 con 0x7fd5c8072f90 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5bffff640 1 -- 172.21.15.90:0/336719188 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5b4003520 con 0x7fd5c8072f90 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5bffff640 1 -- 172.21.15.90:0/336719188 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4118107443 0 0) 0x7fd5c80701e0 con 0x7fd5c80ab4a0 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5bffff640 1 -- 172.21.15.90:0/336719188 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c806ff00 con 0x7fd5c80ab4a0 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cd5e6640 1 -- 172.21.15.90:0/336719188 >> v1:172.21.15.175:6789/0 conn(0x7fd5c80ab4a0 legacy=0x7fd5c8157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cd5e6640 1 -- 172.21.15.90:0/336719188 >> v1:172.21.15.90:6789/0 conn(0x7fd5c8072f90 legacy=0x7fd5c8153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.756+0000 7fd5cd5e6640 1 -- 172.21.15.90:0/336719188 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c80704c0 con 0x7fd5c80c3740 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.757+0000 7fd5cd5e6640 1 --2- 172.21.15.90:0/336719188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80c3740 0x7fd5c80c52b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40097a0 tx=0x7fd5c402b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66a9b678056fd83d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.757+0000 7fd5bffff640 1 -- 172.21.15.90:0/336719188 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c40315a0 con 0x7fd5c80c3740 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.757+0000 7fd5bffff640 1 -- 172.21.15.90:0/336719188 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c4037070 con 0x7fd5c80c3740 2024-04-20T10:56:50.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.757+0000 7fd5bffff640 1 -- 172.21.15.90:0/336719188 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4031960 con 0x7fd5c80c3740 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.758+0000 7fd5cf84a640 1 -- 172.21.15.90:0/336719188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80c3740 msgr2=0x7fd5c80c52b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.758+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/336719188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80c3740 0x7fd5c80c52b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd5c40097a0 tx=0x7fd5c402b840 comp rx=0 tx=0).stop 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.758+0000 7fd5cf84a640 1 -- 172.21.15.90:0/336719188 shutdown_connections 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.758+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/336719188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80c3740 0x7fd5c80c52b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.758+0000 7fd5cf84a640 1 -- 172.21.15.90:0/336719188 >> 172.21.15.90:0/336719188 conn(0x7fd5c80ca0a0 msgr2=0x7fd5c80ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.758+0000 7fd5cf84a640 1 -- 172.21.15.90:0/336719188 shutdown_connections 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.758+0000 7fd5cf84a640 1 -- 172.21.15.90:0/336719188 wait complete. 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.759+0000 7fd5cf84a640 1 Processor -- start 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.759+0000 7fd5cf84a640 1 -- start start 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cf84a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c8072f90 0x7fd5c81ef900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cf84a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80ab4a0 0x7fd5c8145ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:50.761 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cf84a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5c80c3740 0x7fd5c8145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cf84a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c80735c0 con 0x7fd5c8072f90 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cf84a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c8073440 con 0x7fd5c80ab4a0 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cf84a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd5c8154290 con 0x7fd5c80c3740 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c8072f90 0x7fd5c81ef900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c8072f90 0x7fd5c81ef900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44332/0 (socket says 172.21.15.90:44332) 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 -- 172.21.15.90:0/3731343176 learned_addr learned my addr 172.21.15.90:0/3731343176 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5ccde5640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80ab4a0 0x7fd5c8145ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 -- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5c80c3740 msgr2=0x7fd5c8145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5c80c3740 0x7fd5c8145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 -- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80ab4a0 msgr2=0x7fd5c8145ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80ab4a0 0x7fd5c8145ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 -- 172.21.15.90:0/3731343176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c814c290 con 0x7fd5c8072f90 2024-04-20T10:56:50.762 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5ccde5640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80ab4a0 0x7fd5c8145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:56:50.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cd5e6640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c8072f90 0x7fd5c81ef900 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4034040 tx=0x7fd5c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:50.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5bdffb640 1 -- 172.21.15.90:0/3731343176 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4032630 con 0x7fd5c8072f90 2024-04-20T10:56:50.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5bdffb640 1 -- 172.21.15.90:0/3731343176 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c40327f0 con 0x7fd5c8072f90 2024-04-20T10:56:50.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c80b01b0 con 0x7fd5c8072f90 2024-04-20T10:56:50.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.760+0000 7fd5bdffb640 1 -- 172.21.15.90:0/3731343176 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5c4032be0 con 0x7fd5c8072f90 2024-04-20T10:56:50.763 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.761+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c814c530 con 0x7fd5c8072f90 2024-04-20T10:56:50.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.761+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c8068c20 con 0x7fd5c8072f90 2024-04-20T10:56:50.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.762+0000 7fd5bdffb640 1 -- 172.21.15.90:0/3731343176 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd5c404e430 con 0x7fd5c8072f90 2024-04-20T10:56:50.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.762+0000 7fd5bdffb640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd5ac06c920 0x7fd5ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:50.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.762+0000 7fd5ccde5640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd5ac06c920 0x7fd5ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:50.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.762+0000 7fd5bdffb640 1 -- 172.21.15.90:0/3731343176 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7fd5c402f030 con 0x7fd5c8072f90 2024-04-20T10:56:50.764 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.763+0000 7fd5ccde5640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd5ac06c920 0x7fd5ac06ede0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd5c814cd20 tx=0x7fd5b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:50.767 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.767+0000 7fd5bdffb640 1 -- 172.21.15.90:0/3731343176 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd5c8068c20 con 0x7fd5c8072f90 2024-04-20T10:56:50.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.978+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd5c80c3b20 con 0x7fd5c8072f90 2024-04-20T10:56:50.979 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:50.979 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":53,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:49.490779+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:50.979 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 53 2024-04-20T10:56:50.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.978+0000 7fd5bdffb640 1 -- 172.21.15.90:0/3731343176 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+5697 (secure 0 0 0) 0x7fd5c80c3b20 con 0x7fd5c8072f90 2024-04-20T10:56:50.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd5ac06c920 msgr2=0x7fd5ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:50.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd5ac06c920 0x7fd5ac06ede0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd5c814cd20 tx=0x7fd5b8009040 comp rx=0 tx=0).stop 2024-04-20T10:56:50.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c8072f90 msgr2=0x7fd5c81ef900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:50.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c8072f90 0x7fd5c81ef900 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4034040 tx=0x7fd5c40046c0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 shutdown_connections 2024-04-20T10:56:50.987 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd5ac06c920 0x7fd5ac06ede0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd5c80c3740 0x7fd5c8145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd5c80ab4a0 0x7fd5c8145ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 --2- 172.21.15.90:0/3731343176 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd5c8072f90 0x7fd5c81ef900 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:50.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 >> 172.21.15.90:0/3731343176 conn(0x7fd5c80ca0a0 msgr2=0x7fd5c8152210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:50.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 shutdown_connections 2024-04-20T10:56:50.988 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:50.981+0000 7fd5cf84a640 1 -- 172.21.15.90:0/3731343176 wait complete. 2024-04-20T10:56:50.998 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-20T10:56:52.999 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:56:53.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.109+0000 7f2d5aeeb640 1 Processor -- start 2024-04-20T10:56:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.109+0000 7f2d5aeeb640 1 -- start start 2024-04-20T10:56:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d5aeeb640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2d5406ef90 0x7f2d540c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d5aeeb640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d540c2880 con 0x7f2d540c7bf0 2024-04-20T10:56:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d5aeeb640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d540c33e0 con 0x7f2d540c23f0 2024-04-20T10:56:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d5aeeb640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2d540c4480 con 0x7f2d5406ef90 2024-04-20T10:56:53.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d58c87640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2d540c7bf0 0x7f2d540c1ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:60204/0 (socket says 172.21.15.90:60204) 2024-04-20T10:56:53.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d58c87640 1 -- 172.21.15.90:0/3105122360 learned_addr learned my addr 172.21.15.90:0/3105122360 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:56:53.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156441087 0 0) 0x7f2d540c2880 con 0x7f2d540c7bf0 2024-04-20T10:56:53.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d44003520 con 0x7f2d540c7bf0 2024-04-20T10:56:53.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d53fff640 1 --2- 172.21.15.90:0/3105122360 >> v2:172.21.15.175:3300/0 conn(0x7f2d5406ef90 0x7f2d540c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:53.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3370092121 0 0) 0x7f2d44003520 con 0x7f2d540c7bf0 2024-04-20T10:56:53.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 >> v2:172.21.15.175:3300/0 conn(0x7f2d5406ef90 msgr2=0x7f2d540c7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 --2- 172.21.15.90:0/3105122360 >> v2:172.21.15.175:3300/0 conn(0x7f2d5406ef90 0x7f2d540c7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 >> v1:172.21.15.175:6789/0 conn(0x7f2d540c23f0 legacy=0x7f2d54160f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d540c36c0 con 0x7f2d540c7bf0 2024-04-20T10:56:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f2d48001670 con 0x7f2d540c7bf0 2024-04-20T10:56:53.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 >> v1:172.21.15.90:6789/0 conn(0x7f2d540c7bf0 legacy=0x7f2d540c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d440039b0 0x7f2d44003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d44004800 0x7f2d44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d4400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540c4480 con 0x7f2d440052e0 2024-04-20T10:56:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d4400c1b0 con 0x7f2d440039b0 2024-04-20T10:56:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.110+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2d4400c3b0 con 0x7f2d44004800 2024-04-20T10:56:53.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d59488640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d4400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d58c87640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d440039b0 0x7f2d44003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d53fff640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d44004800 0x7f2d44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d59488640 1 -- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d44004800 msgr2=0x7f2d44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d59488640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d44004800 0x7f2d44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d59488640 1 -- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d440039b0 msgr2=0x7f2d44003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d59488640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d440039b0 0x7f2d44003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.111+0000 7f2d59488640 1 -- 172.21.15.90:0/3105122360 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d44003520 con 0x7f2d440052e0 2024-04-20T10:56:53.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d59488640 1 -- 172.21.15.90:0/3105122360 reap_dead start 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d59488640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d4400b9c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c001e20 tx=0x7f2d44005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f81819ce8c2ff1cf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c001a70 con 0x7f2d440052e0 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4c003b70 con 0x7f2d440052e0 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d537fe640 1 -- 172.21.15.90:0/3105122360 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4c0050d0 con 0x7f2d440052e0 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3105122360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 msgr2=0x7f2d4400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d4400b9c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c001e20 tx=0x7f2d44005830 comp rx=0 tx=0).stop 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3105122360 shutdown_connections 2024-04-20T10:56:53.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3105122360 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d4400b9c0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3105122360 >> 172.21.15.90:0/3105122360 conn(0x7f2d540aa660 msgr2=0x7f2d540aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3105122360 shutdown_connections 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.112+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3105122360 wait complete. 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.114+0000 7f2d5aeeb640 1 Processor -- start 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.114+0000 7f2d5aeeb640 1 -- start start 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.114+0000 7f2d5aeeb640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d541508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.114+0000 7f2d5aeeb640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5414fe30 0x7f2d54151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.114+0000 7f2d5aeeb640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d541510c0 0x7f2d54151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d5aeeb640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540c3c80 con 0x7f2d440052e0 2024-04-20T10:56:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d5aeeb640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d540c3ff0 con 0x7f2d5414fe30 2024-04-20T10:56:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d5aeeb640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2d541563f0 con 0x7f2d541510c0 2024-04-20T10:56:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d541508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d541508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44354/0 (socket says 172.21.15.90:44354) 2024-04-20T10:56:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 -- 172.21.15.90:0/3708164681 learned_addr learned my addr 172.21.15.90:0/3708164681 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:56:53.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d53fff640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5414fe30 0x7f2d54151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 -- 172.21.15.90:0/3708164681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d541510c0 msgr2=0x7f2d54151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d541510c0 0x7f2d54151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 -- 172.21.15.90:0/3708164681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5414fe30 msgr2=0x7f2d54151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5414fe30 0x7f2d54151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 -- 172.21.15.90:0/3708164681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d54152090 con 0x7f2d440052e0 2024-04-20T10:56:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d58c87640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d541508c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2d480072c0 tx=0x7f2d48007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:53.129 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d517fa640 1 -- 172.21.15.90:0/3708164681 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d48001640 con 0x7f2d440052e0 2024-04-20T10:56:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d517fa640 1 -- 172.21.15.90:0/3708164681 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d48018070 con 0x7f2d440052e0 2024-04-20T10:56:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5415a740 con 0x7f2d440052e0 2024-04-20T10:56:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d517fa640 1 -- 172.21.15.90:0/3708164681 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d4800fba0 con 0x7f2d440052e0 2024-04-20T10:56:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.115+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d54070c40 con 0x7f2d440052e0 2024-04-20T10:56:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.116+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d54076150 con 0x7f2d440052e0 2024-04-20T10:56:53.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.117+0000 7f2d517fa640 1 -- 172.21.15.90:0/3708164681 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d4800fd40 con 0x7f2d440052e0 2024-04-20T10:56:53.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.117+0000 7f2d517fa640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3806c8f0 0x7f2d3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:56:53.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.117+0000 7f2d517fa640 1 -- 172.21.15.90:0/3708164681 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f2d4808c100 con 0x7f2d440052e0 2024-04-20T10:56:53.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.117+0000 7f2d53fff640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3806c8f0 0x7f2d3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:56:53.131 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.118+0000 7f2d53fff640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3806c8f0 0x7f2d3806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d54150230 tx=0x7f2d40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:56:53.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.122+0000 7f2d517fa640 1 -- 172.21.15.90:0/3708164681 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2d48059f70 con 0x7f2d440052e0 2024-04-20T10:56:53.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.349+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d540c5b20 con 0x7f2d440052e0 2024-04-20T10:56:53.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.349+0000 7f2d517fa640 1 -- 172.21.15.90:0/3708164681 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) ==== 94+0+5705 (secure 0 0 0) 0x7f2d48059870 con 0x7f2d440052e0 2024-04-20T10:56:53.350 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:56:53.350 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":55,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:56:53.350 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 55 2024-04-20T10:56:53.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3806c8f0 msgr2=0x7f2d3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:53.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3806c8f0 0x7f2d3806edb0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2d54150230 tx=0x7f2d40008040 comp rx=0 tx=0).stop 2024-04-20T10:56:53.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 msgr2=0x7f2d541508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:56:53.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d541508c0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2d480072c0 tx=0x7f2d48007780 comp rx=0 tx=0).stop 2024-04-20T10:56:53.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 shutdown_connections 2024-04-20T10:56:53.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3806c8f0 0x7f2d3806edb0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d541510c0 0x7f2d54151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d5414fe30 0x7f2d54151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.351+0000 7f2d5aeeb640 1 --2- 172.21.15.90:0/3708164681 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d440052e0 0x7f2d541508c0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:56:53.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.352+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 >> 172.21.15.90:0/3708164681 conn(0x7f2d540aa660 msgr2=0x7f2d54153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:56:53.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.352+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 shutdown_connections 2024-04-20T10:56:53.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:56:53.352+0000 7f2d5aeeb640 1 -- 172.21.15.90:0/3708164681 wait complete. 2024-04-20T10:56:53.364 INFO:tasks.mds_thrash.fs.[a]:mds.b has gained rank=0, replacing gid=5562 2024-04-20T10:56:53.364 INFO:tasks.mds_thrash.fs.[a]:waiting for 8 secs before reviving mds.a 2024-04-20T10:56:54.416 INFO:tasks.ceph.mds.b.smithi175.stderr:2024-04-20T10:56:54.415+0000 7fa1665a2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:57:01.365 INFO:tasks.mds_thrash.fs.[a]:reviving mds.a 2024-04-20T10:57:01.365 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-20T10:57:01.365 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-20T10:57:01.368 INFO:tasks.ceph.mds.a:Started 2024-04-20T10:57:01.368 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:01.440 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-20T10:57:01.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.467+0000 7f2d55bb2640 1 Processor -- start 2024-04-20T10:57:01.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.468+0000 7f2d55bb2640 1 -- start start 2024-04-20T10:57:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.468+0000 7f2d55bb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.468+0000 7f2d55bb2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d50071fa0 con 0x7f2d5006ca40 2024-04-20T10:57:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.468+0000 7f2d55bb2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d50153500 con 0x7f2d50150c00 2024-04-20T10:57:01.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.468+0000 7f2d55bb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2d500c4210 con 0x7f2d5006f330 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.468+0000 7f2d4effd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2d5006ca40 0x7f2d5006d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:44244/0 (socket says 172.21.15.90:44244) 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.468+0000 7f2d4effd640 1 -- 172.21.15.90:0/320619763 learned_addr learned my addr 172.21.15.90:0/320619763 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4ffff640 1 --2- 172.21.15.90:0/320619763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105530068 0 0) 0x7f2d50071fa0 con 0x7f2d5006ca40 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d38003520 con 0x7f2d5006ca40 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159039654 0 0) 0x7f2d50153500 con 0x7f2d50150c00 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d50071fa0 con 0x7f2d50150c00 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4ffff640 1 -- 172.21.15.90:0/320619763 >> v1:172.21.15.175:6789/0 conn(0x7f2d50150c00 legacy=0x7f2d500c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2627150526 0 0) 0x7f2d38003520 con 0x7f2d5006ca40 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4ffff640 1 -- 172.21.15.90:0/320619763 >> v1:172.21.15.90:6789/0 conn(0x7f2d5006ca40 legacy=0x7f2d5006d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:01.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.469+0000 7f2d4ffff640 1 -- 172.21.15.90:0/320619763 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5006ced0 con 0x7f2d5006f330 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d4ffff640 1 --2- 172.21.15.90:0/320619763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50153fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d500c4390 tx=0x7f2d4802bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b86c5864c3f976 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d48039070 con 0x7f2d5006f330 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d4802c910 con 0x7f2d5006f330 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d4e7fc640 1 -- 172.21.15.90:0/320619763 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d44001670 con 0x7f2d5006f330 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d55bb2640 1 -- 172.21.15.90:0/320619763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 msgr2=0x7f2d50153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/320619763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50153fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2d500c4390 tx=0x7f2d4802bde0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d55bb2640 1 -- 172.21.15.90:0/320619763 shutdown_connections 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/320619763 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50153fa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d55bb2640 1 -- 172.21.15.90:0/320619763 >> 172.21.15.90:0/320619763 conn(0x7f2d500c9100 msgr2=0x7f2d500c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d55bb2640 1 -- 172.21.15.90:0/320619763 shutdown_connections 2024-04-20T10:57:01.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.470+0000 7f2d55bb2640 1 -- 172.21.15.90:0/320619763 wait complete. 2024-04-20T10:57:01.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.471+0000 7f2d55bb2640 1 Processor -- start 2024-04-20T10:57:01.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d55bb2640 1 -- start start 2024-04-20T10:57:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d55bb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50147960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d55bb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50150c00 0x7f2d5014c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d55bb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d5014a450 0x7f2d5014cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d55bb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2d5006d1b0 con 0x7f2d5014a450 2024-04-20T10:57:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d55bb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2d50153a80 con 0x7f2d50150c00 2024-04-20T10:57:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d55bb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2d5006db60 con 0x7f2d5006f330 2024-04-20T10:57:01.478 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d4ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d5014a450 0x7f2d5014cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d4ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d5014a450 0x7f2d5014cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57376/0 (socket says 172.21.15.90:57376) 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.472+0000 7f2d4ffff640 1 -- 172.21.15.90:0/1003476899 learned_addr learned my addr 172.21.15.90:0/1003476899 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4effd640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50150c00 0x7f2d5014c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4f7fe640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50147960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4ffff640 1 -- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 msgr2=0x7f2d50147960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4ffff640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50147960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4ffff640 1 -- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50150c00 msgr2=0x7f2d5014c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4ffff640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50150c00 0x7f2d5014c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4ffff640 1 -- 172.21.15.90:0/1003476899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d501eb070 con 0x7f2d5014a450 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d4ffff640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d5014a450 0x7f2d5014cf20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2d48037040 tx=0x7f2d48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d37fff640 1 -- 172.21.15.90:0/1003476899 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d48039050 con 0x7f2d5014a450 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d37fff640 1 -- 172.21.15.90:0/1003476899 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d48045070 con 0x7f2d5014a450 2024-04-20T10:57:01.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d50148310 con 0x7f2d5014a450 2024-04-20T10:57:01.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d37fff640 1 -- 172.21.15.90:0/1003476899 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d48009450 con 0x7f2d5014a450 2024-04-20T10:57:01.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.473+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d501485b0 con 0x7f2d5014a450 2024-04-20T10:57:01.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.474+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d50076150 con 0x7f2d5014a450 2024-04-20T10:57:01.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.475+0000 7f2d37fff640 1 -- 172.21.15.90:0/1003476899 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d48040690 con 0x7f2d5014a450 2024-04-20T10:57:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.475+0000 7f2d37fff640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3c06c8f0 0x7f2d3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.475+0000 7f2d37fff640 1 -- 172.21.15.90:0/1003476899 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f2d480ae6f0 con 0x7f2d5014a450 2024-04-20T10:57:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.475+0000 7f2d4f7fe640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3c06c8f0 0x7f2d3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.475+0000 7f2d4f7fe640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3c06c8f0 0x7f2d3c06edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d400011e0 tx=0x7f2d40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:01.481 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.479+0000 7f2d37fff640 1 -- 172.21.15.90:0/1003476899 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2d4804f020 con 0x7f2d5014a450 2024-04-20T10:57:01.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.703+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d50072170 con 0x7f2d5014a450 2024-04-20T10:57:01.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.704+0000 7f2d37fff640 1 -- 172.21.15.90:0/1003476899 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7f2d4807bfd0 con 0x7f2d5014a450 2024-04-20T10:57:01.705 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:01.705 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:01.705 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3c06c8f0 msgr2=0x7f2d3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3c06c8f0 0x7f2d3c06edb0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2d400011e0 tx=0x7f2d40009040 comp rx=0 tx=0).stop 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d5014a450 msgr2=0x7f2d5014cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d5014a450 0x7f2d5014cf20 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f2d48037040 tx=0x7f2d48004a40 comp rx=0 tx=0).stop 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 shutdown_connections 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2d3c06c8f0 0x7f2d3c06edb0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2d5014a450 0x7f2d5014cf20 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2d50150c00 0x7f2d5014c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.707 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 --2- 172.21.15.90:0/1003476899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2d5006f330 0x7f2d50147960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:01.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 >> 172.21.15.90:0/1003476899 conn(0x7f2d500c9100 msgr2=0x7f2d500c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:01.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 shutdown_connections 2024-04-20T10:57:01.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:01.706+0000 7f2d55bb2640 1 -- 172.21.15.90:0/1003476899 wait complete. 2024-04-20T10:57:01.718 INFO:tasks.mds_thrash.fs.[a]:mds.a reported in up:standby state 2024-04-20T10:57:01.718 INFO:tasks.mds_thrash.fs.[a]:waiting for 112 secs before thrashing 2024-04-20T10:57:11.632 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:57:11.635 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:57:33.348 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:33.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.446+0000 7f948d65c640 1 Processor -- start 2024-04-20T10:57:33.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.446+0000 7f948d65c640 1 -- start start 2024-04-20T10:57:33.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f948d65c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94881576a0 0x7f948815a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f948d65c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9488154430 con 0x7f94880ca030 2024-04-20T10:57:33.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f948d65c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94880c9b00 con 0x7f9488154050 2024-04-20T10:57:33.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f948d65c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9488156ab0 con 0x7f94881576a0 2024-04-20T10:57:33.454 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f94867fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f94880ca030 0x7f9488156f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54298/0 (socket says 172.21.15.90:54298) 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f94867fc640 1 -- 172.21.15.90:0/2849407009 learned_addr learned my addr 172.21.15.90:0/2849407009 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 634303782 0 0) 0x7f9488154430 con 0x7f94880ca030 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9470003520 con 0x7f94880ca030 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3061776258 0 0) 0x7f9470003520 con 0x7f94880ca030 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 >> v2:172.21.15.175:3300/0 conn(0x7f94881576a0 msgr2=0x7f948815a920 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 --2- 172.21.15.90:0/2849407009 >> v2:172.21.15.175:3300/0 conn(0x7f94881576a0 0x7f948815a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 >> v1:172.21.15.175:6789/0 conn(0x7f9488154050 legacy=0x7f94880c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94880c8be0 con 0x7f94880ca030 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f947c001670 con 0x7f94880ca030 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 >> v1:172.21.15.90:6789/0 conn(0x7f94880ca030 legacy=0x7f9488156f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039b0 0x7f9470003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9470004800 0x7f9470004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700053c0 0x7f947000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9488156ab0 con 0x7f94700053c0 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f947000c280 con 0x7f9470004800 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f947000c480 con 0x7f94700039b0 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f94877fe640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700053c0 0x7f947000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f9486ffd640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039b0 0x7f9470003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.447+0000 7f94867fc640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9470004800 0x7f9470004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94877fe640 1 -- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039b0 msgr2=0x7f9470003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94877fe640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700039b0 0x7f9470003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94877fe640 1 -- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9470004800 msgr2=0x7f9470004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94877fe640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9470004800 0x7f9470004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94877fe640 1 -- 172.21.15.90:0/2849407009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9470003520 con 0x7f94700053c0 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94867fc640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9470004800 0x7f9470004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94877fe640 1 -- 172.21.15.90:0/2849407009 reap_dead start 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f94877fe640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700053c0 0x7f947000b9c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9480009e30 tx=0x7f9470005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29594d6ea6709b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.448+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480039070 con 0x7f94700053c0 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948002cd70 con 0x7f94700053c0 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f9485ffb640 1 -- 172.21.15.90:0/2849407009 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9480009a30 con 0x7f94700053c0 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f948d65c640 1 -- 172.21.15.90:0/2849407009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700053c0 msgr2=0x7f947000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f948d65c640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700053c0 0x7f947000b9c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9480009e30 tx=0x7f9470005830 comp rx=0 tx=0).stop 2024-04-20T10:57:33.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f948d65c640 1 -- 172.21.15.90:0/2849407009 shutdown_connections 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f948d65c640 1 --2- 172.21.15.90:0/2849407009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94700053c0 0x7f947000b9c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f948d65c640 1 -- 172.21.15.90:0/2849407009 >> 172.21.15.90:0/2849407009 conn(0x7f94880ade20 msgr2=0x7f94880ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f948d65c640 1 -- 172.21.15.90:0/2849407009 shutdown_connections 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.449+0000 7f948d65c640 1 -- 172.21.15.90:0/2849407009 wait complete. 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.450+0000 7f948d65c640 1 Processor -- start 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.450+0000 7f948d65c640 1 -- start start 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f948d65c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700053c0 0x7f948814ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f948d65c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94880aefa0 0x7f9488159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f948d65c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815a300 0x7f94881490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f948d65c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94880c9480 con 0x7f94880aefa0 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f948d65c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94880c91a0 con 0x7f948815a300 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f948d65c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f94880cac30 con 0x7f94700053c0 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94880aefa0 0x7f9488159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94880aefa0 0x7f9488159dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48458/0 (socket says 172.21.15.90:48458) 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 -- 172.21.15.90:0/3267947066 learned_addr learned my addr 172.21.15.90:0/3267947066 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94877fe640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815a300 0x7f94881490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 -- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700053c0 msgr2=0x7f948814ef00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700053c0 0x7f948814ef00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 -- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815a300 msgr2=0x7f94881490e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815a300 0x7f94881490e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94867fc640 1 -- 172.21.15.90:0/3267947066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f948814dc20 con 0x7f94880aefa0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.451+0000 7f94877fe640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815a300 0x7f94881490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.452+0000 7f94867fc640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94880aefa0 0x7f9488159dc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f947c00e820 tx=0x7f947c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.452+0000 7f946f7fe640 1 -- 172.21.15.90:0/3267947066 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c00c870 con 0x7f94880aefa0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.452+0000 7f946f7fe640 1 -- 172.21.15.90:0/3267947066 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f947c018070 con 0x7f94880aefa0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.452+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f948814e420 con 0x7f94880aefa0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.452+0000 7f946f7fe640 1 -- 172.21.15.90:0/3267947066 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947c00cc10 con 0x7f94880aefa0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.452+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f948814f870 con 0x7f94880aefa0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.453+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9488076150 con 0x7f94880aefa0 2024-04-20T10:57:33.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.453+0000 7f946f7fe640 1 -- 172.21.15.90:0/3267947066 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f947c01d460 con 0x7f94880aefa0 2024-04-20T10:57:33.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.454+0000 7f946f7fe640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f947406c8f0 0x7f947406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.454+0000 7f946f7fe640 1 -- 172.21.15.90:0/3267947066 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f947c08bef0 con 0x7f94880aefa0 2024-04-20T10:57:33.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.454+0000 7f9486ffd640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f947406c8f0 0x7f947406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.454+0000 7f9486ffd640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f947406c8f0 0x7f947406edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9478007fd0 tx=0x7f9478009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:33.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.459+0000 7f946f7fe640 1 -- 172.21.15.90:0/3267947066 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f947c059d60 con 0x7f94880aefa0 2024-04-20T10:57:33.680 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.680+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94880c63a0 con 0x7f94880aefa0 2024-04-20T10:57:33.681 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.681+0000 7f946f7fe640 1 -- 172.21.15.90:0/3267947066 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7f947c059660 con 0x7f94880aefa0 2024-04-20T10:57:33.681 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:33.681 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:33.682 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:33.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f947406c8f0 msgr2=0x7f947406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f947406c8f0 0x7f947406edb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f9478007fd0 tx=0x7f9478009040 comp rx=0 tx=0).stop 2024-04-20T10:57:33.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94880aefa0 msgr2=0x7f9488159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.683 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94880aefa0 0x7f9488159dc0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f947c00e820 tx=0x7f947c00ece0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 shutdown_connections 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f947406c8f0 0x7f947406edb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f948815a300 0x7f94881490e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94880aefa0 0x7f9488159dc0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 --2- 172.21.15.90:0/3267947066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94700053c0 0x7f948814ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 >> 172.21.15.90:0/3267947066 conn(0x7f94880ade20 msgr2=0x7f94880c69b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 shutdown_connections 2024-04-20T10:57:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.683+0000 7f948d65c640 1 -- 172.21.15.90:0/3267947066 wait complete. 2024-04-20T10:57:33.694 INFO:tasks.mds_thrash.fs.[b]:kill mds.c (rank=0) 2024-04-20T10:57:33.694 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-20T10:57:33.694 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:57:33.706 INFO:tasks.ceph.mds.c:Stopped 2024-04-20T10:57:33.706 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:33.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.842+0000 7f1ae07f4640 1 Processor -- start 2024-04-20T10:57:33.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.842+0000 7f1ae07f4640 1 -- start start 2024-04-20T10:57:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1ae07f4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f1ad8157710 0x7f1ad8154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1ae07f4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad80c4370 con 0x7f1ad8073810 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1ae07f4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ad8156c30 con 0x7f1ad80ad0c0 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1ae07f4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f1ad81569e0 con 0x7f1ad8157710 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1ade590640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f1ad8073810 0x7f1ad80c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54310/0 (socket says 172.21.15.90:54310) 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1ade590640 1 -- 172.21.15.90:0/3592532682 learned_addr learned my addr 172.21.15.90:0/3592532682 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1addd8f640 1 --2- 172.21.15.90:0/3592532682 >> v2:172.21.15.175:3300/0 conn(0x7f1ad8157710 0x7f1ad8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760951641 0 0) 0x7f1ad80c4370 con 0x7f1ad8073810 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ac4003520 con 0x7f1ad8073810 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 430749173 0 0) 0x7f1ac4003520 con 0x7f1ad8073810 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 >> v2:172.21.15.175:3300/0 conn(0x7f1ad8157710 msgr2=0x7f1ad8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 --2- 172.21.15.90:0/3592532682 >> v2:172.21.15.175:3300/0 conn(0x7f1ad8157710 0x7f1ad8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 >> v1:172.21.15.175:6789/0 conn(0x7f1ad80ad0c0 legacy=0x7f1ad80abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad8156f10 con 0x7f1ad8073810 2024-04-20T10:57:33.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f1ac8001670 con 0x7f1ad8073810 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 >> v1:172.21.15.90:6789/0 conn(0x7f1ad8073810 legacy=0x7f1ad80c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac40039b0 0x7f1ac4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ac4004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac4005120 0x7f1ac400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad81569e0 con 0x7f1ac40043b0 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ac400c060 con 0x7f1ac4005120 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.843+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ac400c260 con 0x7f1ac40039b0 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1addd8f640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ac4004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1aded91640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac4005120 0x7f1ac400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1ade590640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac40039b0 0x7f1ac4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1addd8f640 1 -- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac40039b0 msgr2=0x7f1ac4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1addd8f640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac40039b0 0x7f1ac4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.847 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1addd8f640 1 -- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac4005120 msgr2=0x7f1ac400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1addd8f640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac4005120 0x7f1ac400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1addd8f640 1 -- 172.21.15.90:0/3592532682 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ac4003520 con 0x7f1ac40043b0 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1ade590640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ac40039b0 0x7f1ac4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1aded91640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ac4005120 0x7f1ac400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.844+0000 7f1aded91640 1 -- 172.21.15.90:0/3592532682 reap_dead start 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1addd8f640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ac4004880 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8070110 tx=0x7f1ac4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdacccd8e0c9a530 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4039070 con 0x7f1ac40043b0 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ad402c660 con 0x7f1ac40043b0 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1add58e640 1 -- 172.21.15.90:0/3592532682 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ad4009690 con 0x7f1ac40043b0 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1ae07f4640 1 -- 172.21.15.90:0/3592532682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 msgr2=0x7f1ac4004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ac4004880 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f1ad8070110 tx=0x7f1ac4005830 comp rx=0 tx=0).stop 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1ae07f4640 1 -- 172.21.15.90:0/3592532682 shutdown_connections 2024-04-20T10:57:33.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/3592532682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ac4004880 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1ae07f4640 1 -- 172.21.15.90:0/3592532682 >> 172.21.15.90:0/3592532682 conn(0x7f1ad80c8080 msgr2=0x7f1ad80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1ae07f4640 1 -- 172.21.15.90:0/3592532682 shutdown_connections 2024-04-20T10:57:33.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.845+0000 7f1ae07f4640 1 -- 172.21.15.90:0/3592532682 wait complete. 2024-04-20T10:57:33.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.846+0000 7f1ae07f4640 1 Processor -- start 2024-04-20T10:57:33.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.846+0000 7f1ae07f4640 1 -- start start 2024-04-20T10:57:33.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ae07f4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ad814b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ae07f4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad80c6bb0 0x7f1ad8072700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ae07f4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad81e8020 0x7f1ad81ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ae07f4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8154000 con 0x7f1ac40043b0 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ae07f4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1ad8157280 con 0x7f1ad80c6bb0 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ae07f4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f1ad8154180 con 0x7f1ad81e8020 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ad814b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ad814b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:48466/0 (socket says 172.21.15.90:48466) 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 -- 172.21.15.90:0/2655442033 learned_addr learned my addr 172.21.15.90:0/2655442033 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1addd8f640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad80c6bb0 0x7f1ad8072700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1aded91640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad81e8020 0x7f1ad81ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 -- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad81e8020 msgr2=0x7f1ad81ebc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad81e8020 0x7f1ad81ebc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 -- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad80c6bb0 msgr2=0x7f1ad8072700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:33.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad80c6bb0 0x7f1ad8072700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1ade590640 1 -- 172.21.15.90:0/2655442033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ad81eb730 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.847+0000 7f1addd8f640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad80c6bb0 0x7f1ad8072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.848+0000 7f1ade590640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ad814b6b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800e7b0 tx=0x7f1ac800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.848+0000 7f1aceffd640 1 -- 172.21.15.90:0/2655442033 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800c870 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.848+0000 7f1aceffd640 1 -- 172.21.15.90:0/2655442033 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ac8018070 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.848+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ad814b3d0 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.848+0000 7f1aceffd640 1 -- 172.21.15.90:0/2655442033 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ac800cc10 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.848+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ad80c5f90 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.849+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ad81eb900 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.849+0000 7f1aceffd640 1 -- 172.21.15.90:0/2655442033 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1ac801d460 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.849+0000 7f1aceffd640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1abc06c8f0 0x7f1abc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.850+0000 7f1addd8f640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1abc06c8f0 0x7f1abc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.850+0000 7f1aceffd640 1 -- 172.21.15.90:0/2655442033 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f1ac808bfb0 con 0x7f1ac40043b0 2024-04-20T10:57:33.853 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.850+0000 7f1addd8f640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1abc06c8f0 0x7f1abc06edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4036000 tx=0x7f1ad4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:33.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:33.854+0000 7f1aceffd640 1 -- 172.21.15.90:0/2655442033 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1ac8059e20 con 0x7f1ac40043b0 2024-04-20T10:57:34.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.067+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ad8076150 con 0x7f1ac40043b0 2024-04-20T10:57:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.067+0000 7f1aceffd640 1 -- 172.21.15.90:0/2655442033 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7f1ac8059720 con 0x7f1ac40043b0 2024-04-20T10:57:34.068 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:34.068 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:34.068 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.069+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1abc06c8f0 msgr2=0x7f1abc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.069+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1abc06c8f0 0x7f1abc06edb0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1ad4036000 tx=0x7f1ad4030000 comp rx=0 tx=0).stop 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.069+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 msgr2=0x7f1ad814b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.069+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ad814b6b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f1ac800e7b0 tx=0x7f1ac800ec70 comp rx=0 tx=0).stop 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 shutdown_connections 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f1abc06c8f0 0x7f1abc06edb0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f1ad81e8020 0x7f1ad81ebc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:34.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f1ad80c6bb0 0x7f1ad8072700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:34.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 --2- 172.21.15.90:0/2655442033 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1ac40043b0 0x7f1ad814b6b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:34.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 >> 172.21.15.90:0/2655442033 conn(0x7f1ad80c8080 msgr2=0x7f1ad806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:34.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 shutdown_connections 2024-04-20T10:57:34.071 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:34.070+0000 7f1ae07f4640 1 -- 172.21.15.90:0/2655442033 wait complete. 2024-04-20T10:57:34.081 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:57:36.082 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.189+0000 7fe4bf2c1640 1 Processor -- start 2024-04-20T10:57:36.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.189+0000 7fe4bf2c1640 1 -- start start 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4bf2c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b8155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4bf2c1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b806d450 con 0x7fe4b80705c0 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4bf2c1640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4b806d730 con 0x7fe4b80ad720 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4bf2c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b806dd80 con 0x7fe4b806e210 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4bd85e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe4b80705c0 0x7fe4b80c3530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:34138/0 (socket says 172.21.15.90:34138) 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4bd85e640 1 -- 172.21.15.90:0/1922217258 learned_addr learned my addr 172.21.15.90:0/1922217258 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4bc85c640 1 --2- 172.21.15.90:0/1922217258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b8155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4affff640 1 -- 172.21.15.90:0/1922217258 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2273535034 0 0) 0x7fe4b806d450 con 0x7fe4b80705c0 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.190+0000 7fe4affff640 1 -- 172.21.15.90:0/1922217258 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a4003520 con 0x7fe4b80705c0 2024-04-20T10:57:36.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.191+0000 7fe4affff640 1 -- 172.21.15.90:0/1922217258 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 769448055 0 0) 0x7fe4b806d730 con 0x7fe4b80ad720 2024-04-20T10:57:36.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.191+0000 7fe4bc85c640 1 -- 172.21.15.90:0/1922217258 >> v1:172.21.15.175:6789/0 conn(0x7fe4b80ad720 legacy=0x7fe4b8073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:36.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.191+0000 7fe4bc85c640 1 -- 172.21.15.90:0/1922217258 >> v1:172.21.15.90:6789/0 conn(0x7fe4b80705c0 legacy=0x7fe4b80c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:36.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.191+0000 7fe4bc85c640 1 -- 172.21.15.90:0/1922217258 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b806da10 con 0x7fe4b806e210 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.191+0000 7fe4bc85c640 1 --2- 172.21.15.90:0/1922217258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b8155010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097d0 tx=0x7fe4a802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e7d8e9f907dd8b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4affff640 1 -- 172.21.15.90:0/1922217258 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8035020 con 0x7fe4b806e210 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4affff640 1 -- 172.21.15.90:0/1922217258 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8031800 con 0x7fe4b806e210 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4affff640 1 -- 172.21.15.90:0/1922217258 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8031bd0 con 0x7fe4b806e210 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/1922217258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 msgr2=0x7fe4b8155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/1922217258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b8155010 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097d0 tx=0x7fe4a802b8a0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/1922217258 shutdown_connections 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/1922217258 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b8155010 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/1922217258 >> 172.21.15.90:0/1922217258 conn(0x7fe4b80c8080 msgr2=0x7fe4b80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:36.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/1922217258 shutdown_connections 2024-04-20T10:57:36.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.192+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/1922217258 wait complete. 2024-04-20T10:57:36.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.193+0000 7fe4bf2c1640 1 Processor -- start 2024-04-20T10:57:36.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.193+0000 7fe4bf2c1640 1 -- start start 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bf2c1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b814c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bf2c1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4b80705c0 0x7fe4b81ed0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bf2c1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4b80ad720 0x7fe4b81ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bf2c1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b8073b40 con 0x7fe4b80705c0 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bf2c1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe4b80c3c40 con 0x7fe4b80ad720 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bf2c1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b80c0a10 con 0x7fe4b806e210 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bc85c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4b80705c0 0x7fe4b81ed0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bc85c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4b80705c0 0x7fe4b81ed0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32808/0 (socket says 172.21.15.90:32808) 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bc85c640 1 -- 172.21.15.90:0/2776969836 learned_addr learned my addr 172.21.15.90:0/2776969836 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bd05d640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b814c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bd85e640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4b80ad720 0x7fe4b81ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bc85c640 1 -- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 msgr2=0x7fe4b814c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:36.196 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bc85c640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b814c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.194+0000 7fe4bc85c640 1 -- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4b80ad720 msgr2=0x7fe4b81ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4bc85c640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4b80ad720 0x7fe4b81ed600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4bc85c640 1 -- 172.21.15.90:0/2776969836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b81edb40 con 0x7fe4b80705c0 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4bc85c640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4b80705c0 0x7fe4b81ed0c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097d0 tx=0x7fe4a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4adffb640 1 -- 172.21.15.90:0/2776969836 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8040070 con 0x7fe4b80705c0 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4adffb640 1 -- 172.21.15.90:0/2776969836 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4a8039c70 con 0x7fe4b80705c0 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4b8155030 con 0x7fe4b80705c0 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4adffb640 1 -- 172.21.15.90:0/2776969836 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4a8035040 con 0x7fe4b80705c0 2024-04-20T10:57:36.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.195+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4b80c0f60 con 0x7fe4b80705c0 2024-04-20T10:57:36.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.196+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4b8076150 con 0x7fe4b80705c0 2024-04-20T10:57:36.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.197+0000 7fe4adffb640 1 -- 172.21.15.90:0/2776969836 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe4a8038020 con 0x7fe4b80705c0 2024-04-20T10:57:36.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.197+0000 7fe4adffb640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe49c06c8f0 0x7fe49c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:36.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.197+0000 7fe4adffb640 1 -- 172.21.15.90:0/2776969836 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7fe4a80adb50 con 0x7fe4b80705c0 2024-04-20T10:57:36.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.197+0000 7fe4bd05d640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe49c06c8f0 0x7fe49c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:36.198 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.197+0000 7fe4bd05d640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe49c06c8f0 0x7fe49c06edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4000f60 tx=0x7fe4b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:36.201 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.202+0000 7fe4adffb640 1 -- 172.21.15.90:0/2776969836 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe4a8039e20 con 0x7fe4b80705c0 2024-04-20T10:57:36.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.433+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4b80c7d20 con 0x7fe4b80705c0 2024-04-20T10:57:36.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.433+0000 7fe4adffb640 1 -- 172.21.15.90:0/2776969836 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7fe4a807b2f0 con 0x7fe4b80705c0 2024-04-20T10:57:36.434 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:36.434 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:36.434 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:36.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.435+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe49c06c8f0 msgr2=0x7fe49c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:36.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.435+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe49c06c8f0 0x7fe49c06edb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe4b4000f60 tx=0x7fe4b4009040 comp rx=0 tx=0).stop 2024-04-20T10:57:36.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4b80705c0 msgr2=0x7fe4b81ed0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:36.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4b80705c0 0x7fe4b81ed0c0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe4a80097d0 tx=0x7fe4a80046c0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 shutdown_connections 2024-04-20T10:57:36.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe49c06c8f0 0x7fe49c06edb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe4b80ad720 0x7fe4b81ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe4b80705c0 0x7fe4b81ed0c0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 --2- 172.21.15.90:0/2776969836 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe4b806e210 0x7fe4b814c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:36.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 >> 172.21.15.90:0/2776969836 conn(0x7fe4b80c8080 msgr2=0x7fe4b814ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:36.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 shutdown_connections 2024-04-20T10:57:36.437 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:36.436+0000 7fe4bf2c1640 1 -- 172.21.15.90:0/2776969836 wait complete. 2024-04-20T10:57:36.447 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:57:38.447 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.560+0000 7f34045ef640 1 Processor -- start 2024-04-20T10:57:38.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.560+0000 7f34045ef640 1 -- start start 2024-04-20T10:57:38.562 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f34045ef640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f33fc0ab730 0x7f33fc1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f34045ef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f34045ef640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33fc15a720 con 0x7f33fc153ef0 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f34045ef640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f33fc15ac80 con 0x7f33fc0ab730 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f34045ef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc15a9a0 con 0x7f33fc0c9ee0 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f3401b8a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f33fc0ab730 0x7f33fc1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f3401b8a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f33fc0ab730 0x7f33fc1568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32816/0 (socket says 172.21.15.90:32816) 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.561+0000 7f3401b8a640 1 -- 172.21.15.90:0/1056509158 learned_addr learned my addr 172.21.15.90:0/1056509158 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.562+0000 7f3402b8c640 1 --2- 172.21.15.90:0/1056509158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.562+0000 7f3401b8a640 1 -- 172.21.15.90:0/1056509158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 msgr2=0x7f33fc156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.562+0000 7f3401b8a640 1 --2- 172.21.15.90:0/1056509158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.562+0000 7f3401b8a640 1 -- 172.21.15.90:0/1056509158 >> v1:172.21.15.175:6789/0 conn(0x7f33fc153ef0 legacy=0x7f33fc0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:38.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.562+0000 7f3401b8a640 1 -- 172.21.15.90:0/1056509158 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc0c6a90 con 0x7f33fc0ab730 2024-04-20T10:57:38.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.562+0000 7f3402b8c640 1 --2- 172.21.15.90:0/1056509158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:38.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.562+0000 7f3401b8a640 1 --2- 172.21.15.90:0/1056509158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc0ab730 0x7f33fc1568c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009870 tx=0x7f33f002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fe1bef81c05f7d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:38.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f3401389640 1 -- 172.21.15.90:0/1056509158 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f00317c0 con 0x7f33fc0ab730 2024-04-20T10:57:38.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f3401389640 1 -- 172.21.15.90:0/1056509158 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f0037070 con 0x7f33fc0ab730 2024-04-20T10:57:38.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f3401389640 1 -- 172.21.15.90:0/1056509158 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f0031b80 con 0x7f33fc0ab730 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 -- 172.21.15.90:0/1056509158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc0ab730 msgr2=0x7f33fc1568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 --2- 172.21.15.90:0/1056509158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc0ab730 0x7f33fc1568c0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f33f0009870 tx=0x7f33f002b860 comp rx=0 tx=0).stop 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 -- 172.21.15.90:0/1056509158 shutdown_connections 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 --2- 172.21.15.90:0/1056509158 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 --2- 172.21.15.90:0/1056509158 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc0ab730 0x7f33fc1568c0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 -- 172.21.15.90:0/1056509158 >> 172.21.15.90:0/1056509158 conn(0x7f33fc0cbfe0 msgr2=0x7f33fc0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 -- 172.21.15.90:0/1056509158 shutdown_connections 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.563+0000 7f34045ef640 1 -- 172.21.15.90:0/1056509158 wait complete. 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.564+0000 7f34045ef640 1 Processor -- start 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.564+0000 7f34045ef640 1 -- start start 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f34045ef640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33fc0ab730 0x7f33fc1efbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f34045ef640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc0b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:38.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f34045ef640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc153ef0 0x7f33fc1509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f34045ef640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc0c9280 con 0x7f33fc153ef0 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f34045ef640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f33fc0c9100 con 0x7f33fc0ab730 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f34045ef640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f33fc0bf800 con 0x7f33fc0c9ee0 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc153ef0 0x7f33fc1509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc153ef0 0x7f33fc1509a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32832/0 (socket says 172.21.15.90:32832) 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 -- 172.21.15.90:0/4149250595 learned_addr learned my addr 172.21.15.90:0/4149250595 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 -- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 msgr2=0x7f33fc0b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc0b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 -- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33fc0ab730 msgr2=0x7f33fc1efbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f340238b640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33fc0ab730 0x7f33fc1efbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33fc0ab730 0x7f33fc1efbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f3402b8c640 1 -- 172.21.15.90:0/4149250595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33fc1515d0 con 0x7f33fc153ef0 2024-04-20T10:57:38.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.565+0000 7f340238b640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33fc0ab730 0x7f33fc1efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:57:38.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.566+0000 7f3402b8c640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc153ef0 0x7f33fc1509a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00d7d0 tx=0x7f33ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:38.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.566+0000 7f33faffd640 1 -- 172.21.15.90:0/4149250595 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec004030 con 0x7f33fc153ef0 2024-04-20T10:57:38.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.566+0000 7f33faffd640 1 -- 172.21.15.90:0/4149250595 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33ec0041d0 con 0x7f33fc153ef0 2024-04-20T10:57:38.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.566+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33fc0b0a90 con 0x7f33fc153ef0 2024-04-20T10:57:38.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.566+0000 7f33faffd640 1 -- 172.21.15.90:0/4149250595 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33ec0096a0 con 0x7f33fc153ef0 2024-04-20T10:57:38.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.566+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33fc0b0d30 con 0x7f33fc153ef0 2024-04-20T10:57:38.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.567+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33fc076150 con 0x7f33fc153ef0 2024-04-20T10:57:38.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.567+0000 7f33faffd640 1 -- 172.21.15.90:0/4149250595 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33ec009840 con 0x7f33fc153ef0 2024-04-20T10:57:38.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.567+0000 7f33faffd640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e806c920 0x7f33e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:38.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.567+0000 7f33faffd640 1 -- 172.21.15.90:0/4149250595 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f33ec08c410 con 0x7f33fc153ef0 2024-04-20T10:57:38.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.568+0000 7f340238b640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e806c920 0x7f33e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:38.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.568+0000 7f340238b640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e806c920 0x7f33e806ede0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f33fc15a3e0 tx=0x7f33f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:38.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.572+0000 7f33faffd640 1 -- 172.21.15.90:0/4149250595 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f33ec05a280 con 0x7f33fc153ef0 2024-04-20T10:57:38.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.784+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33fc06d070 con 0x7f33fc153ef0 2024-04-20T10:57:38.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.785+0000 7f33faffd640 1 -- 172.21.15.90:0/4149250595 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7f33ec059b80 con 0x7f33fc153ef0 2024-04-20T10:57:38.785 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:38.785 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:38.785 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:38.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e806c920 msgr2=0x7f33e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:38.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e806c920 0x7f33e806ede0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f33fc15a3e0 tx=0x7f33f4009040 comp rx=0 tx=0).stop 2024-04-20T10:57:38.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc153ef0 msgr2=0x7f33fc1509a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:38.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc153ef0 0x7f33fc1509a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f33ec00d7d0 tx=0x7f33ec00dc90 comp rx=0 tx=0).stop 2024-04-20T10:57:38.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 shutdown_connections 2024-04-20T10:57:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f33e806c920 0x7f33e806ede0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f33fc153ef0 0x7f33fc1509a0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f33fc0c9ee0 0x7f33fc0b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 --2- 172.21.15.90:0/4149250595 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f33fc0ab730 0x7f33fc1efbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 >> 172.21.15.90:0/4149250595 conn(0x7f33fc0cbfe0 msgr2=0x7f33fc0ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 shutdown_connections 2024-04-20T10:57:38.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:38.787+0000 7f34045ef640 1 -- 172.21.15.90:0/4149250595 wait complete. 2024-04-20T10:57:38.798 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:57:40.799 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:40.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.907+0000 7f5084811640 1 Processor -- start 2024-04-20T10:57:40.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.907+0000 7f5084811640 1 -- start start 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.907+0000 7f5084811640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f5080156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.907+0000 7f5084811640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508015a720 con 0x7f50800ab730 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.907+0000 7f5084811640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f508015ac80 con 0x7f5080153ef0 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.907+0000 7f5084811640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f508015a9a0 con 0x7f50800c9ee0 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f5077fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f50800ab730 0x7f50801568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:34140/0 (socket says 172.21.15.90:34140) 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f5077fff640 1 -- 172.21.15.90:0/1000457988 learned_addr learned my addr 172.21.15.90:0/1000457988 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507ed9d640 1 --2- 172.21.15.90:0/1000457988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f5080156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325551397 0 0) 0x7f5068001110 con 0x7f50800ab730 2024-04-20T10:57:40.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f506c003520 con 0x7f50800ab730 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362772840 0 0) 0x7f508015ac80 con 0x7f5080153ef0 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5068001110 con 0x7f5080153ef0 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507ed9d640 1 -- 172.21.15.90:0/1000457988 >> v1:172.21.15.175:6789/0 conn(0x7f5080153ef0 legacy=0x7f50800c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507ed9d640 1 -- 172.21.15.90:0/1000457988 >> v1:172.21.15.90:6789/0 conn(0x7f50800ab730 legacy=0x7f50801568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4115016278 0 0) 0x7f506c003520 con 0x7f50800ab730 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.908+0000 7f507ed9d640 1 -- 172.21.15.90:0/1000457988 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50800c6a90 con 0x7f50800c9ee0 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.909+0000 7f507ed9d640 1 --2- 172.21.15.90:0/1000457988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f5080156fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5078009dc0 tx=0x7f507802bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df855c275ab84faf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.909+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078039070 con 0x7f50800c9ee0 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.909+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f507802c7f0 con 0x7f50800c9ee0 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.909+0000 7f507dd9b640 1 -- 172.21.15.90:0/1000457988 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068001860 con 0x7f50800c9ee0 2024-04-20T10:57:40.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.909+0000 7f5084811640 1 -- 172.21.15.90:0/1000457988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 msgr2=0x7f5080156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:40.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.909+0000 7f5084811640 1 --2- 172.21.15.90:0/1000457988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f5080156fd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5078009dc0 tx=0x7f507802bcc0 comp rx=0 tx=0).stop 2024-04-20T10:57:40.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.910+0000 7f5084811640 1 -- 172.21.15.90:0/1000457988 shutdown_connections 2024-04-20T10:57:40.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.910+0000 7f5084811640 1 --2- 172.21.15.90:0/1000457988 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f5080156fd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:40.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.910+0000 7f5084811640 1 -- 172.21.15.90:0/1000457988 >> 172.21.15.90:0/1000457988 conn(0x7f50800cbfe0 msgr2=0x7f50800cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:40.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.910+0000 7f5084811640 1 -- 172.21.15.90:0/1000457988 shutdown_connections 2024-04-20T10:57:40.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.910+0000 7f5084811640 1 -- 172.21.15.90:0/1000457988 wait complete. 2024-04-20T10:57:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 Processor -- start 2024-04-20T10:57:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 -- start start 2024-04-20T10:57:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50800ab730 0x7f50800c3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f50801e9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:40.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5080153ef0 0x7f50801e95b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f50800c9100 con 0x7f5080153ef0 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5080157510 con 0x7f50800ab730 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.911+0000 7f5084811640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f50800c9280 con 0x7f50800c9ee0 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5080153ef0 0x7f50801e95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5080153ef0 0x7f50801e95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32836/0 (socket says 172.21.15.90:32836) 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 -- 172.21.15.90:0/1834217426 learned_addr learned my addr 172.21.15.90:0/1834217426 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f5077fff640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f50801e9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507e59c640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50800ab730 0x7f50800c3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 -- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 msgr2=0x7f50801e9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f50801e9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:40.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 -- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50800ab730 msgr2=0x7f50800c3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50800ab730 0x7f50800c3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 -- 172.21.15.90:0/1834217426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50801e9af0 con 0x7f5080153ef0 2024-04-20T10:57:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f507ed9d640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5080153ef0 0x7f50801e95b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5078009ee0 tx=0x7f5078004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f5076ffd640 1 -- 172.21.15.90:0/1834217426 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078039040 con 0x7f5080153ef0 2024-04-20T10:57:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f5076ffd640 1 -- 172.21.15.90:0/1834217426 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5078034c40 con 0x7f5080153ef0 2024-04-20T10:57:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f5076ffd640 1 -- 172.21.15.90:0/1834217426 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078003bd0 con 0x7f5080153ef0 2024-04-20T10:57:40.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50801efff0 con 0x7f5080153ef0 2024-04-20T10:57:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.912+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50801f0290 con 0x7f5080153ef0 2024-04-20T10:57:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.913+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f508015a400 con 0x7f5080153ef0 2024-04-20T10:57:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.914+0000 7f5076ffd640 1 -- 172.21.15.90:0/1834217426 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5078004030 con 0x7f5080153ef0 2024-04-20T10:57:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.914+0000 7f5076ffd640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f506006c8f0 0x7f506006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.914+0000 7f5076ffd640 1 -- 172.21.15.90:0/1834217426 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f50780aeb70 con 0x7f5080153ef0 2024-04-20T10:57:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.914+0000 7f507e59c640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f506006c8f0 0x7f506006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:40.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.915+0000 7f507e59c640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f506006c8f0 0x7f506006edb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f50700011e0 tx=0x7f5070009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:40.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:40.919+0000 7f5076ffd640 1 -- 172.21.15.90:0/1834217426 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f508015a400 con 0x7f5080153ef0 2024-04-20T10:57:41.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.135+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5080076150 con 0x7f5080153ef0 2024-04-20T10:57:41.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.136+0000 7f5076ffd640 1 -- 172.21.15.90:0/1834217426 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7f507802ce20 con 0x7f5080153ef0 2024-04-20T10:57:41.136 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:41.136 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:41.136 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f506006c8f0 msgr2=0x7f506006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f506006c8f0 0x7f506006edb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f50700011e0 tx=0x7f5070009040 comp rx=0 tx=0).stop 2024-04-20T10:57:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5080153ef0 msgr2=0x7f50801e95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5080153ef0 0x7f50801e95b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5078009ee0 tx=0x7f5078004a40 comp rx=0 tx=0).stop 2024-04-20T10:57:41.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 shutdown_connections 2024-04-20T10:57:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f506006c8f0 0x7f506006edb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5080153ef0 0x7f50801e95b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f50800c9ee0 0x7f50801e9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 --2- 172.21.15.90:0/1834217426 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f50800ab730 0x7f50800c3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 >> 172.21.15.90:0/1834217426 conn(0x7f50800cbfe0 msgr2=0x7f5080152900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 shutdown_connections 2024-04-20T10:57:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:41.138+0000 7f5084811640 1 -- 172.21.15.90:0/1834217426 wait complete. 2024-04-20T10:57:41.149 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:57:41.685 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:57:41.688 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:57:43.150 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:43.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.256+0000 7f981c66d640 1 Processor -- start 2024-04-20T10:57:43.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.256+0000 7f981c66d640 1 -- start start 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981c66d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f9814154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981c66d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f98140ad0c0 0x7f98140ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981c66d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98140c4370 con 0x7f9814073810 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981c66d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f98141569e0 con 0x7f98140ad0c0 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981c66d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9814157280 con 0x7f9814157710 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981ac0a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f98140ad0c0 0x7f98140ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981ac0a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f98140ad0c0 0x7f98140ad540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32848/0 (socket says 172.21.15.90:32848) 2024-04-20T10:57:43.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f981ac0a640 1 -- 172.21.15.90:0/3843289686 learned_addr learned my addr 172.21.15.90:0/3843289686 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:43.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.257+0000 7f9819c08640 1 --2- 172.21.15.90:0/3843289686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f9814154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:43.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.258+0000 7f981ac0a640 1 -- 172.21.15.90:0/3843289686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 msgr2=0x7f9814154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:43.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.258+0000 7f981ac0a640 1 --2- 172.21.15.90:0/3843289686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f9814154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.258+0000 7f981ac0a640 1 -- 172.21.15.90:0/3843289686 >> v1:172.21.15.175:6789/0 conn(0x7f9814073810 legacy=0x7f98140c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:43.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.258+0000 7f981ac0a640 1 -- 172.21.15.90:0/3843289686 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9814156c30 con 0x7f98140ad0c0 2024-04-20T10:57:43.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.258+0000 7f981ac0a640 1 --2- 172.21.15.90:0/3843289686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98140ad540 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f980c009e50 tx=0x7f980c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360932efd3ba441a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:43.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f9819407640 1 -- 172.21.15.90:0/3843289686 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c02ca70 con 0x7f98140ad0c0 2024-04-20T10:57:43.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f9819407640 1 -- 172.21.15.90:0/3843289686 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c02cc10 con 0x7f98140ad0c0 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f9819407640 1 -- 172.21.15.90:0/3843289686 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c0343f0 con 0x7f98140ad0c0 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 -- 172.21.15.90:0/3843289686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 msgr2=0x7f98140ad540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 --2- 172.21.15.90:0/3843289686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98140ad540 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f980c009e50 tx=0x7f980c02bed0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 -- 172.21.15.90:0/3843289686 shutdown_connections 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 --2- 172.21.15.90:0/3843289686 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98140ad540 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 --2- 172.21.15.90:0/3843289686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f9814154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 -- 172.21.15.90:0/3843289686 >> 172.21.15.90:0/3843289686 conn(0x7f98140c8080 msgr2=0x7f98140c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 -- 172.21.15.90:0/3843289686 shutdown_connections 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.259+0000 7f981c66d640 1 -- 172.21.15.90:0/3843289686 wait complete. 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.260+0000 7f981c66d640 1 Processor -- start 2024-04-20T10:57:43.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981c66d640 1 -- start start 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981c66d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9814073810 0x7f98141eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981c66d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98141e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981c66d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f98141dff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981c66d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f98140abbb0 con 0x7f98140ad0c0 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981c66d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9814073bf0 con 0x7f9814073810 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981c66d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f98140abd30 con 0x7f9814157710 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f9819c08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98141e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f9819c08640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98141e6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:32860/0 (socket says 172.21.15.90:32860) 2024-04-20T10:57:43.264 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f9819c08640 1 -- 172.21.15.90:0/2602883580 learned_addr learned my addr 172.21.15.90:0/2602883580 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981ac0a640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f98141dff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.261+0000 7f981a409640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9814073810 0x7f98141eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f9819c08640 1 -- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 msgr2=0x7f98141dff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f9819c08640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f98141dff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f9819c08640 1 -- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9814073810 msgr2=0x7f98141eda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f9819c08640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9814073810 0x7f98141eda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f9819c08640 1 -- 172.21.15.90:0/2602883580 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98140c2a80 con 0x7f98140ad0c0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f9819c08640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98141e6f30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f980400e8a0 tx=0x7f980400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f980affd640 1 -- 172.21.15.90:0/2602883580 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9804017070 con 0x7f98140ad0c0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f980affd640 1 -- 172.21.15.90:0/2602883580 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980400ee90 con 0x7f98140ad0c0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f980affd640 1 -- 172.21.15.90:0/2602883580 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980400cb40 con 0x7f98140ad0c0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98141edf40 con 0x7f98140ad0c0 2024-04-20T10:57:43.265 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.262+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98140c3000 con 0x7f98140ad0c0 2024-04-20T10:57:43.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.263+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9814076150 con 0x7f98140ad0c0 2024-04-20T10:57:43.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.263+0000 7f980affd640 1 -- 172.21.15.90:0/2602883580 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f980401a070 con 0x7f98140ad0c0 2024-04-20T10:57:43.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.264+0000 7f980affd640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97f806c8f0 0x7f97f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:43.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.264+0000 7f981a409640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97f806c8f0 0x7f97f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:43.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.264+0000 7f980affd640 1 -- 172.21.15.90:0/2602883580 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f980408bef0 con 0x7f98140ad0c0 2024-04-20T10:57:43.266 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.264+0000 7f981a409640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97f806c8f0 0x7f97f806edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98140be0d0 tx=0x7f9810009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:43.268 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.268+0000 7f980affd640 1 -- 172.21.15.90:0/2602883580 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9804059710 con 0x7f98140ad0c0 2024-04-20T10:57:43.485 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.485+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9814069c50 con 0x7f98140ad0c0 2024-04-20T10:57:43.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.486+0000 7f980affd640 1 -- 172.21.15.90:0/2602883580 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7f980405da10 con 0x7f98140ad0c0 2024-04-20T10:57:43.486 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:43.486 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:43.487 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:43.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97f806c8f0 msgr2=0x7f97f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:43.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97f806c8f0 0x7f97f806edb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98140be0d0 tx=0x7f9810009040 comp rx=0 tx=0).stop 2024-04-20T10:57:43.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 msgr2=0x7f98141e6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:43.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98141e6f30 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f980400e8a0 tx=0x7f980400ed60 comp rx=0 tx=0).stop 2024-04-20T10:57:43.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 shutdown_connections 2024-04-20T10:57:43.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97f806c8f0 0x7f97f806edb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9814157710 0x7f98141dff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f98140ad0c0 0x7f98141e6f30 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 --2- 172.21.15.90:0/2602883580 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9814073810 0x7f98141eda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:43.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 >> 172.21.15.90:0/2602883580 conn(0x7f98140c8080 msgr2=0x7f98140ac170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:43.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 shutdown_connections 2024-04-20T10:57:43.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:43.488+0000 7f981c66d640 1 -- 172.21.15.90:0/2602883580 wait complete. 2024-04-20T10:57:43.499 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:57:45.500 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:45.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.610+0000 7fd673fb2640 1 Processor -- start 2024-04-20T10:57:45.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.610+0000 7fd673fb2640 1 -- start start 2024-04-20T10:57:45.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd673fb2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd66c15ab30 0x7fd66c156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:45.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd673fb2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd66c0c4bb0 0x7fd66c156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:45.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd673fb2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd66c0c6870 con 0x7fd66c0701c0 2024-04-20T10:57:45.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd673fb2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd66c0ab630 con 0x7fd66c15ab30 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd673fb2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd66c159e00 con 0x7fd66c0c4bb0 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd67154d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd66c15ab30 0x7fd66c156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd671d4e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd66c0701c0 0x7fd66c073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53942/0 (socket says 172.21.15.90:53942) 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd671d4e640 1 -- 172.21.15.90:0/1986496578 learned_addr learned my addr 172.21.15.90:0/1986496578 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd67254f640 1 --2- 172.21.15.90:0/1986496578 >> v2:172.21.15.175:3300/0 conn(0x7fd66c0c4bb0 0x7fd66c156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd67154d640 1 -- 172.21.15.90:0/1986496578 >> v2:172.21.15.175:3300/0 conn(0x7fd66c0c4bb0 msgr2=0x7fd66c156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd67154d640 1 --2- 172.21.15.90:0/1986496578 >> v2:172.21.15.175:3300/0 conn(0x7fd66c0c4bb0 0x7fd66c156d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd67154d640 1 -- 172.21.15.90:0/1986496578 >> v1:172.21.15.90:6789/0 conn(0x7fd66c0701c0 legacy=0x7fd66c073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd67154d640 1 -- 172.21.15.90:0/1986496578 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c15a050 con 0x7fd66c15ab30 2024-04-20T10:57:45.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.611+0000 7fd670d4c640 1 -- 172.21.15.90:0/1986496578 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617637472 0 0) 0x7fd66c0c6870 con 0x7fd66c0701c0 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.612+0000 7fd67154d640 1 --2- 172.21.15.90:0/1986496578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c15ab30 0x7fd66c156810 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd66c072470 tx=0x7fd65c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e36713bf7aea6f40 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.612+0000 7fd670d4c640 1 -- 172.21.15.90:0/1986496578 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c035020 con 0x7fd66c15ab30 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.612+0000 7fd670d4c640 1 -- 172.21.15.90:0/1986496578 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65c031830 con 0x7fd66c15ab30 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.612+0000 7fd670d4c640 1 -- 172.21.15.90:0/1986496578 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c031c00 con 0x7fd66c15ab30 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 -- 172.21.15.90:0/1986496578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c15ab30 msgr2=0x7fd66c156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 --2- 172.21.15.90:0/1986496578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c15ab30 0x7fd66c156810 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fd66c072470 tx=0x7fd65c02b8d0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 -- 172.21.15.90:0/1986496578 shutdown_connections 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 --2- 172.21.15.90:0/1986496578 >> v2:172.21.15.175:3300/0 conn(0x7fd66c0c4bb0 0x7fd66c156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 --2- 172.21.15.90:0/1986496578 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c15ab30 0x7fd66c156810 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 -- 172.21.15.90:0/1986496578 >> 172.21.15.90:0/1986496578 conn(0x7fd66c0676c0 msgr2=0x7fd66c067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:45.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 -- 172.21.15.90:0/1986496578 shutdown_connections 2024-04-20T10:57:45.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.613+0000 7fd673fb2640 1 -- 172.21.15.90:0/1986496578 wait complete. 2024-04-20T10:57:45.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.614+0000 7fd673fb2640 1 Processor -- start 2024-04-20T10:57:45.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.614+0000 7fd673fb2640 1 -- start start 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c0701c0 0x7fd66c158b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd66c0c4bb0 0x7fd66c150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd66c15ab30 0x7fd66c151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c0705a0 con 0x7fd66c0701c0 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd66c15a610 con 0x7fd66c15ab30 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd66c073810 con 0x7fd66c0c4bb0 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c0701c0 0x7fd66c158b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:45.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c0701c0 0x7fd66c158b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41616/0 (socket says 172.21.15.90:41616) 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 -- 172.21.15.90:0/602468909 learned_addr learned my addr 172.21.15.90:0/602468909 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd67154d640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd66c0c4bb0 0x7fd66c150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd67254f640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd66c15ab30 0x7fd66c151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 -- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd66c0c4bb0 msgr2=0x7fd66c150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd66c0c4bb0 0x7fd66c150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 -- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd66c15ab30 msgr2=0x7fd66c151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd66c15ab30 0x7fd66c151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 -- 172.21.15.90:0/602468909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd66c1f06c0 con 0x7fd66c0701c0 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd67154d640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd66c0c4bb0 0x7fd66c150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd671d4e640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c0701c0 0x7fd66c158b00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c460 tx=0x7fd66800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd6627fc640 1 -- 172.21.15.90:0/602468909 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668018070 con 0x7fd66c0701c0 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd6627fc640 1 -- 172.21.15.90:0/602468909 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd668007500 con 0x7fd66c0701c0 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd66c1f09a0 con 0x7fd66c0701c0 2024-04-20T10:57:45.619 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd6627fc640 1 -- 172.21.15.90:0/602468909 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd668004a20 con 0x7fd66c0701c0 2024-04-20T10:57:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.615+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66c159040 con 0x7fd66c0701c0 2024-04-20T10:57:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.616+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd66c159730 con 0x7fd66c0701c0 2024-04-20T10:57:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.617+0000 7fd6627fc640 1 -- 172.21.15.90:0/602468909 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd66801b070 con 0x7fd66c0701c0 2024-04-20T10:57:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.617+0000 7fd6627fc640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd65006c920 0x7fd65006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:45.620 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.618+0000 7fd67154d640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd65006c920 0x7fd65006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:45.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.618+0000 7fd6627fc640 1 -- 172.21.15.90:0/602468909 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7fd66808b380 con 0x7fd66c0701c0 2024-04-20T10:57:45.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.618+0000 7fd67154d640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd65006c920 0x7fd65006ede0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd65c036000 tx=0x7fd65c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:45.623 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.622+0000 7fd6627fc640 1 -- 172.21.15.90:0/602468909 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd66c159730 con 0x7fd66c0701c0 2024-04-20T10:57:45.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.853+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd66c076150 con 0x7fd66c0701c0 2024-04-20T10:57:45.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.853+0000 7fd6627fc640 1 -- 172.21.15.90:0/602468909 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7fd6680591f0 con 0x7fd66c0701c0 2024-04-20T10:57:45.855 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:45.855 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:45.855 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.855+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd65006c920 msgr2=0x7fd65006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.855+0000 7fd673fb2640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd65006c920 0x7fd65006ede0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fd65c036000 tx=0x7fd65c008030 comp rx=0 tx=0).stop 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c0701c0 msgr2=0x7fd66c158b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c0701c0 0x7fd66c158b00 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fd66800c460 tx=0x7fd66800c920 comp rx=0 tx=0).stop 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 shutdown_connections 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd65006c920 0x7fd65006ede0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd66c15ab30 0x7fd66c151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd66c0c4bb0 0x7fd66c150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 --2- 172.21.15.90:0/602468909 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd66c0701c0 0x7fd66c158b00 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:45.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 >> 172.21.15.90:0/602468909 conn(0x7fd66c0676c0 msgr2=0x7fd66c067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:45.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 shutdown_connections 2024-04-20T10:57:45.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:45.856+0000 7fd673fb2640 1 -- 172.21.15.90:0/602468909 wait complete. 2024-04-20T10:57:45.868 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:57:47.870 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:47.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.966+0000 7f30ffdf4640 1 Processor -- start 2024-04-20T10:57:47.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30ffdf4640 1 -- start start 2024-04-20T10:57:47.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30ffdf4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f30f80ab730 0x7f30f81568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30ffdf4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 0x7f30f8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.971 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30ffdf4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f815a720 con 0x7f30f8153ef0 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30ffdf4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f30f815ac80 con 0x7f30f80ab730 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30ffdf4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f30f815a9a0 con 0x7f30f80c9ee0 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30fdb90640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f30f8153ef0 0x7f30f80c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53948/0 (socket says 172.21.15.90:53948) 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.967+0000 7f30fdb90640 1 -- 172.21.15.90:0/1089377478 learned_addr learned my addr 172.21.15.90:0/1089377478 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232373570 0 0) 0x7f30f0001490 con 0x7f30f8153ef0 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30e4003520 con 0x7f30f8153ef0 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 0x7f30f8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fd38f640 1 --2- 172.21.15.90:0/1089377478 >> v2:172.21.15.175:3300/0 conn(0x7f30f80ab730 0x7f30f81568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2724679914 0 0) 0x7f30e4003520 con 0x7f30f8153ef0 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 msgr2=0x7f30f8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 0x7f30f8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 >> v2:172.21.15.175:3300/0 conn(0x7f30f80ab730 msgr2=0x7f30f81568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 --2- 172.21.15.90:0/1089377478 >> v2:172.21.15.175:3300/0 conn(0x7f30f80ab730 0x7f30f81568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:47.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80c6a90 con 0x7f30f8153ef0 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f30f0001be0 con 0x7f30f8153ef0 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 0x7f30f8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fd38f640 1 --2- 172.21.15.90:0/1089377478 >> v2:172.21.15.175:3300/0 conn(0x7f30f80ab730 0x7f30f81568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 >> v1:172.21.15.90:6789/0 conn(0x7f30f8153ef0 legacy=0x7f30f80c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 0x7f30e40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e4003fa0 0x7f30e4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30e40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30f815ac80 con 0x7f30e4004d40 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30f815a9a0 con 0x7f30e4003fa0 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f30e400bbd0 con 0x7f30f80c9ee0 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30e40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fdb90640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 0x7f30e40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:47.973 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fd38f640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e4003fa0 0x7f30e4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 -- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 msgr2=0x7f30e40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80c9ee0 0x7f30e40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 -- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e4003fa0 msgr2=0x7f30e4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30e4003fa0 0x7f30e4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.968+0000 7f30fe391640 1 -- 172.21.15.90:0/1089377478 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e4003520 con 0x7f30e4004d40 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.969+0000 7f30fe391640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30e40051c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f30f40098a0 tx=0x7f30e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f6e1174a8c0af2f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.969+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f400f040 con 0x7f30e4004d40 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.969+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f4004230 con 0x7f30e4004d40 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.969+0000 7f30fcb8e640 1 -- 172.21.15.90:0/1089377478 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f4003610 con 0x7f30e4004d40 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.970+0000 7f30ffdf4640 1 -- 172.21.15.90:0/1089377478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 msgr2=0x7f30e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.970+0000 7f30ffdf4640 1 --2- 172.21.15.90:0/1089377478 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30e40051c0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f30f40098a0 tx=0x7f30e4005830 comp rx=0 tx=0).stop 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.970+0000 7f30fe391640 1 -- 172.21.15.90:0/1089377478 reap_dead start 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.970+0000 7f30ffdf4640 1 -- 172.21.15.90:0/1089377478 shutdown_connections 2024-04-20T10:57:47.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.970+0000 7f30ffdf4640 1 -- 172.21.15.90:0/1089377478 >> 172.21.15.90:0/1089377478 conn(0x7f30f80cbfe0 msgr2=0x7f30f80cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:47.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.970+0000 7f30ffdf4640 1 -- 172.21.15.90:0/1089377478 shutdown_connections 2024-04-20T10:57:47.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.970+0000 7f30ffdf4640 1 -- 172.21.15.90:0/1089377478 wait complete. 2024-04-20T10:57:47.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.971+0000 7f30ffdf4640 1 Processor -- start 2024-04-20T10:57:47.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.971+0000 7f30ffdf4640 1 -- start start 2024-04-20T10:57:47.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30f80c2780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80aec10 0x7f30f81ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f8150f50 0x7f30f81efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80c9280 con 0x7f30e4004d40 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80c9100 con 0x7f30f8150f50 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80bf800 con 0x7f30f80aec10 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30f80c2780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30f80c2780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41630/0 (socket says 172.21.15.90:41630) 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 -- 172.21.15.90:0/3126209688 learned_addr learned my addr 172.21.15.90:0/3126209688 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 -- 172.21.15.90:0/3126209688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80aec10 msgr2=0x7f30f81ef5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80aec10 0x7f30f81ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 -- 172.21.15.90:0/3126209688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f8150f50 msgr2=0x7f30f81efb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f8150f50 0x7f30f81efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 -- 172.21.15.90:0/3126209688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80c58e0 con 0x7f30e4004d40 2024-04-20T10:57:47.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30fdb90640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30f80c2780 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001630 tx=0x7f30f0007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ee7fc640 1 -- 172.21.15.90:0/3126209688 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f0017020 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ee7fc640 1 -- 172.21.15.90:0/3126209688 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f00133f0 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f80af630 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ee7fc640 1 -- 172.21.15.90:0/3126209688 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f000ae60 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.972+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f80c5b80 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.973+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f80c3a70 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.974+0000 7f30ee7fc640 1 -- 172.21.15.90:0/3126209688 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f30f001a020 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.974+0000 7f30ee7fc640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30dc06c8f0 0x7f30dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.974+0000 7f30ee7fc640 1 -- 172.21.15.90:0/3126209688 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f30f008cb60 con 0x7f30e4004d40 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.974+0000 7f30fd38f640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30dc06c8f0 0x7f30dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:47.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.975+0000 7f30fd38f640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30dc06c8f0 0x7f30dc06edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f30f81574f0 tx=0x7f30e8009540 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:47.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:47.979+0000 7f30ee7fc640 1 -- 172.21.15.90:0/3126209688 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f30f0021020 con 0x7f30e4004d40 2024-04-20T10:57:48.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.189+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f30f8076150 con 0x7f30e4004d40 2024-04-20T10:57:48.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.189+0000 7f30ee7fc640 1 -- 172.21.15.90:0/3126209688 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 56 v56) ==== 94+0+6530 (secure 0 0 0) 0x7f30f815a720 con 0x7f30e4004d40 2024-04-20T10:57:48.191 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:48.191 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":56,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5868,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:56:12.376110+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":34,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"c","rank":0,"incarnation":45,"state":"up:active","state_seq":11,"addr":"172.21.15.90:6837/597803483","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":597803483},{"type":"v1","addr":"172.21.15.90:6837","nonce":597803483}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5679,"qdb_cluster":[5679]},"id":2}]} 2024-04-20T10:57:48.191 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 56 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30dc06c8f0 msgr2=0x7f30dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30dc06c8f0 0x7f30dc06edb0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f30f81574f0 tx=0x7f30e8009540 comp rx=0 tx=0).stop 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 msgr2=0x7f30f80c2780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30f80c2780 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f30f0001630 tx=0x7f30f0007430 comp rx=0 tx=0).stop 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 shutdown_connections 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f30dc06c8f0 0x7f30dc06edb0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f30f8150f50 0x7f30f81efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f30f80aec10 0x7f30f81ef5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:48.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 --2- 172.21.15.90:0/3126209688 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f30e4004d40 0x7f30f80c2780 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.191+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 >> 172.21.15.90:0/3126209688 conn(0x7f30f80cbfe0 msgr2=0x7f30f80c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.192+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 shutdown_connections 2024-04-20T10:57:48.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:48.192+0000 7f30ffdf4640 1 -- 172.21.15.90:0/3126209688 wait complete. 2024-04-20T10:57:48.204 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is laggy/crashed, in failed state, or mds.c is removed from mdsmap 2024-04-20T10:57:50.204 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:50.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.316+0000 7f3212efd640 1 Processor -- start 2024-04-20T10:57:50.317 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.316+0000 7f3212efd640 1 -- start start 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f3212efd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 0x7f320c1568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f3212efd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c15a720 con 0x7f320c0c9ee0 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f3212efd640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f320c15ac80 con 0x7f320c153ef0 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f3212efd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f320c15a9a0 con 0x7f320c0ab730 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f321149a640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f320c0c9ee0 0x7f320c156e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53952/0 (socket says 172.21.15.90:53952) 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f321149a640 1 -- 172.21.15.90:0/50240283 learned_addr learned my addr 172.21.15.90:0/50240283 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320bfff640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 0x7f320c1568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 964775108 0 0) 0x7f3204001490 con 0x7f320c0c9ee0 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31fc003520 con 0x7f320c0c9ee0 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 804939805 0 0) 0x7f320c15ac80 con 0x7f320c153ef0 2024-04-20T10:57:50.321 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3204001490 con 0x7f320c153ef0 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1074396825 0 0) 0x7f31fc003520 con 0x7f320c0c9ee0 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 msgr2=0x7f320c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 0x7f320c1568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 >> v1:172.21.15.175:6789/0 conn(0x7f320c153ef0 legacy=0x7f320c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c0c6a90 con 0x7f320c0c9ee0 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f3204001be0 con 0x7f320c0c9ee0 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 >> v1:172.21.15.90:6789/0 conn(0x7f320c0c9ee0 legacy=0x7f320c156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f31fc003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31fc004800 0x7f31fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 0x7f31fc005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f320c15a9a0 con 0x7f31fc003b70 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f31fc00bb80 con 0x7f31fc004800 2024-04-20T10:57:50.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f31fc00bd80 con 0x7f320c0ab730 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.317+0000 7f3210c99640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f31fc003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f320bfff640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31fc004800 0x7f31fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f321149a640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 0x7f31fc005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f3210c99640 1 -- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 msgr2=0x7f31fc005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f3210c99640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0ab730 0x7f31fc005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f3210c99640 1 -- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31fc004800 msgr2=0x7f31fc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f3210c99640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31fc004800 0x7f31fc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f3210c99640 1 -- 172.21.15.90:0/50240283 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31fc003520 con 0x7f31fc003b70 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.318+0000 7f3210c99640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f31fc003f70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f32000018d0 tx=0x7f31fc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35b6ff91abae509a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200037070 con 0x7f31fc003b70 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32000052d0 con 0x7f31fc003b70 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f320b7fe640 1 -- 172.21.15.90:0/50240283 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32000014f0 con 0x7f31fc003b70 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f3212efd640 1 -- 172.21.15.90:0/50240283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 msgr2=0x7f31fc003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f3212efd640 1 --2- 172.21.15.90:0/50240283 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f31fc003f70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f32000018d0 tx=0x7f31fc005830 comp rx=0 tx=0).stop 2024-04-20T10:57:50.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f321149a640 1 -- 172.21.15.90:0/50240283 reap_dead start 2024-04-20T10:57:50.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f3212efd640 1 -- 172.21.15.90:0/50240283 shutdown_connections 2024-04-20T10:57:50.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f3212efd640 1 -- 172.21.15.90:0/50240283 >> 172.21.15.90:0/50240283 conn(0x7f320c0cbfe0 msgr2=0x7f320c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:50.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f3212efd640 1 -- 172.21.15.90:0/50240283 shutdown_connections 2024-04-20T10:57:50.324 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.319+0000 7f3212efd640 1 -- 172.21.15.90:0/50240283 wait complete. 2024-04-20T10:57:50.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 Processor -- start 2024-04-20T10:57:50.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 -- start start 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f320c0c2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f320c1e0fd0 0x7f320c0af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0c52d0 0x7f320c0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f320c0c9100 con 0x7f31fc003b70 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f320c157510 con 0x7f320c1e0fd0 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.321+0000 7f3212efd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f320c0c9280 con 0x7f320c0c52d0 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f320c0c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f320c0c2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41648/0 (socket says 172.21.15.90:41648) 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 -- 172.21.15.90:0/1535839715 learned_addr learned my addr 172.21.15.90:0/1535839715 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f321149a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0c52d0 0x7f320c0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f320bfff640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f320c1e0fd0 0x7f320c0af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 -- 172.21.15.90:0/1535839715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0c52d0 msgr2=0x7f320c0c5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0c52d0 0x7f320c0c5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 -- 172.21.15.90:0/1535839715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f320c1e0fd0 msgr2=0x7f320c0af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f320c1e0fd0 0x7f320c0af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 -- 172.21.15.90:0/1535839715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f320c0c2540 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3210c99640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f320c0c2000 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3200035040 tx=0x7f32000012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f32097fa640 1 -- 172.21.15.90:0/1535839715 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200037070 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f32097fa640 1 -- 172.21.15.90:0/1535839715 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3200038040 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f320c159520 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f32097fa640 1 -- 172.21.15.90:0/1535839715 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32000014f0 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.322+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f320c0c4510 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.323+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f320c0695c0 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.324+0000 7f32097fa640 1 -- 172.21.15.90:0/1535839715 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f32000052d0 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.324+0000 7f32097fa640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31f006c8f0 0x7f31f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.324+0000 7f32097fa640 1 -- 172.21.15.90:0/1535839715 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 7325+0+0 (secure 0 0 0) 0x7f32000ad4d0 con 0x7f31fc003b70 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.324+0000 7f320bfff640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31f006c8f0 0x7f31f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.325+0000 7f320bfff640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31f006c8f0 0x7f31f006edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f320c0b2090 tx=0x7f31f8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:50.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.329+0000 7f32097fa640 1 -- 172.21.15.90:0/1535839715 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f320c0695c0 con 0x7f31fc003b70 2024-04-20T10:57:50.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.567+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f320c06d070 con 0x7f31fc003b70 2024-04-20T10:57:50.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.568+0000 7f32097fa640 1 -- 172.21.15.90:0/1535839715 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5700 (secure 0 0 0) 0x7f320c0c2540 con 0x7f31fc003b70 2024-04-20T10:57:50.569 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:50.569 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:50.361691+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:57:50.569 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 57 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31f006c8f0 msgr2=0x7f31f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31f006c8f0 0x7f31f006edb0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f320c0b2090 tx=0x7f31f8009190 comp rx=0 tx=0).stop 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 msgr2=0x7f320c0c2000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f320c0c2000 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3200035040 tx=0x7f32000012d0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 shutdown_connections 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f31f006c8f0 0x7f31f006edb0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f320c0c52d0 0x7f320c0c5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f320c1e0fd0 0x7f320c0af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 --2- 172.21.15.90:0/1535839715 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31fc003b70 0x7f320c0c2000 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 >> 172.21.15.90:0/1535839715 conn(0x7f320c0cbfe0 msgr2=0x7f320c0c89f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 shutdown_connections 2024-04-20T10:57:50.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.570+0000 7f3212efd640 1 -- 172.21.15.90:0/1535839715 wait complete. 2024-04-20T10:57:50.583 INFO:tasks.mds_thrash.fs.[b]:mds.c down, removed from mdsmap 2024-04-20T10:57:50.583 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-20T10:57:50.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:50.685 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.684+0000 7f17c6960640 1 Processor -- start 2024-04-20T10:57:50.686 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.684+0000 7f17c6960640 1 -- start start 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17c6960640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17c0153ef0 0x7f17c00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17c6960640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c00ab730 0x7f17c01568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17c6960640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f17c00c9ee0 0x7f17c0156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17c6960640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f17c015a720 con 0x7f17c0153ef0 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17c6960640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f17c015ac80 con 0x7f17c00c9ee0 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17c6960640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17c015a9a0 con 0x7f17c00ab730 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17bffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17c0153ef0 0x7f17c00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17bffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f17c0153ef0 0x7f17c00c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41662/0 (socket says 172.21.15.90:41662) 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17bffff640 1 -- 172.21.15.90:0/2668925155 learned_addr learned my addr 172.21.15.90:0/2668925155 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17c4efd640 1 --2- 172.21.15.90:0/2668925155 >> v2:172.21.15.175:3300/0 conn(0x7f17c00c9ee0 0x7f17c0156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.685+0000 7f17bf7fe640 1 --2- 172.21.15.90:0/2668925155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c00ab730 0x7f17c01568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.686+0000 7f17bffff640 1 -- 172.21.15.90:0/2668925155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c00ab730 msgr2=0x7f17c01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.686+0000 7f17bffff640 1 --2- 172.21.15.90:0/2668925155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c00ab730 0x7f17c01568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.686+0000 7f17bffff640 1 -- 172.21.15.90:0/2668925155 >> v2:172.21.15.175:3300/0 conn(0x7f17c00c9ee0 msgr2=0x7f17c0156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.686+0000 7f17bffff640 1 --2- 172.21.15.90:0/2668925155 >> v2:172.21.15.175:3300/0 conn(0x7f17c00c9ee0 0x7f17c0156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.686+0000 7f17bffff640 1 -- 172.21.15.90:0/2668925155 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c00c6a90 con 0x7f17c0153ef0 2024-04-20T10:57:50.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.686+0000 7f17bffff640 1 --2- 172.21.15.90:0/2668925155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c0153ef0 0x7f17c00c89f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f17c00c9b40 tx=0x7f17b002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5012333c75a3dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:50.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17beffd640 1 -- 172.21.15.90:0/2668925155 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0038070 con 0x7f17c0153ef0 2024-04-20T10:57:50.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17beffd640 1 -- 172.21.15.90:0/2668925155 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b002f050 con 0x7f17c0153ef0 2024-04-20T10:57:50.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17beffd640 1 -- 172.21.15.90:0/2668925155 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0031970 con 0x7f17c0153ef0 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 -- 172.21.15.90:0/2668925155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c0153ef0 msgr2=0x7f17c00c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 --2- 172.21.15.90:0/2668925155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c0153ef0 0x7f17c00c89f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f17c00c9b40 tx=0x7f17b002b7f0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 -- 172.21.15.90:0/2668925155 shutdown_connections 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 --2- 172.21.15.90:0/2668925155 >> v2:172.21.15.175:3300/0 conn(0x7f17c00c9ee0 0x7f17c0156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 --2- 172.21.15.90:0/2668925155 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c00ab730 0x7f17c01568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 --2- 172.21.15.90:0/2668925155 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c0153ef0 0x7f17c00c89f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 -- 172.21.15.90:0/2668925155 >> 172.21.15.90:0/2668925155 conn(0x7f17c00cbfe0 msgr2=0x7f17c00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 -- 172.21.15.90:0/2668925155 shutdown_connections 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.687+0000 7f17c6960640 1 -- 172.21.15.90:0/2668925155 wait complete. 2024-04-20T10:57:50.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.688+0000 7f17c6960640 1 Processor -- start 2024-04-20T10:57:50.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c6960640 1 -- start start 2024-04-20T10:57:50.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c6960640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c00ab730 0x7f17c01510f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c6960640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00c9ee0 0x7f17c01ef7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c6960640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0153ef0 0x7f17c01efcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c6960640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f17c00bf800 con 0x7f17c00c9ee0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c6960640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f17c0157340 con 0x7f17c00ab730 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c6960640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f17c00c10a0 con 0x7f17c0153ef0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17bf7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00c9ee0 0x7f17c01ef7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17bf7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00c9ee0 0x7f17c01ef7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41666/0 (socket says 172.21.15.90:41666) 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17bf7fe640 1 -- 172.21.15.90:0/1339301936 learned_addr learned my addr 172.21.15.90:0/1339301936 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17c4efd640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0153ef0 0x7f17c01efcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.689+0000 7f17bffff640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c00ab730 0x7f17c01510f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bf7fe640 1 -- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0153ef0 msgr2=0x7f17c01efcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bf7fe640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0153ef0 0x7f17c01efcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bf7fe640 1 -- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c00ab730 msgr2=0x7f17c01510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bf7fe640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c00ab730 0x7f17c01510f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bf7fe640 1 -- 172.21.15.90:0/1339301936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17c00c5d00 con 0x7f17c00c9ee0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bf7fe640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00c9ee0 0x7f17c01ef7b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f17b400e860 tx=0x7f17b400ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bcff9640 1 -- 172.21.15.90:0/1339301936 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b4017070 con 0x7f17c00c9ee0 2024-04-20T10:57:50.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bcff9640 1 -- 172.21.15.90:0/1339301936 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b400c940 con 0x7f17c00c9ee0 2024-04-20T10:57:50.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17c00c07e0 con 0x7f17c00c9ee0 2024-04-20T10:57:50.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17bcff9640 1 -- 172.21.15.90:0/1339301936 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b400cd10 con 0x7f17c00c9ee0 2024-04-20T10:57:50.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.690+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17c00c0a50 con 0x7f17c00c9ee0 2024-04-20T10:57:50.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.691+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17c0076150 con 0x7f17c00c9ee0 2024-04-20T10:57:50.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.692+0000 7f17bcff9640 1 -- 172.21.15.90:0/1339301936 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17b401a070 con 0x7f17c00c9ee0 2024-04-20T10:57:50.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.692+0000 7f17bcff9640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f17ac06c8f0 0x7f17ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:50.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.692+0000 7f17bffff640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f17ac06c8f0 0x7f17ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:50.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.692+0000 7f17bcff9640 1 -- 172.21.15.90:0/1339301936 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f17b408c1c0 con 0x7f17c00c9ee0 2024-04-20T10:57:50.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.693+0000 7f17bffff640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f17ac06c8f0 0x7f17ac06edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f17b0035000 tx=0x7f17b0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:50.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.697+0000 7f17bcff9640 1 -- 172.21.15.90:0/1339301936 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f17b4059900 con 0x7f17c00c9ee0 2024-04-20T10:57:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.960+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17c006d070 con 0x7f17c00c9ee0 2024-04-20T10:57:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.961+0000 7f17bcff9640 1 -- 172.21.15.90:0/1339301936 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5700 (secure 0 0 0) 0x7f17b405dc00 con 0x7f17c00c9ee0 2024-04-20T10:57:50.963 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:50.963 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:50.361691+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:57:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 57 2024-04-20T10:57:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f17ac06c8f0 msgr2=0x7f17ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f17ac06c8f0 0x7f17ac06edb0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f17b0035000 tx=0x7f17b0008030 comp rx=0 tx=0).stop 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00c9ee0 msgr2=0x7f17c01ef7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00c9ee0 0x7f17c01ef7b0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f17b400e860 tx=0x7f17b400ed20 comp rx=0 tx=0).stop 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 shutdown_connections 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f17ac06c8f0 0x7f17ac06edb0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f17c0153ef0 0x7f17c01efcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f17c00c9ee0 0x7f17c01ef7b0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 --2- 172.21.15.90:0/1339301936 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f17c00ab730 0x7f17c01510f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 >> 172.21.15.90:0/1339301936 conn(0x7f17c00cbfe0 msgr2=0x7f17c01568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 shutdown_connections 2024-04-20T10:57:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:50.963+0000 7f17c6960640 1 -- 172.21.15.90:0/1339301936 wait complete. 2024-04-20T10:57:50.976 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 57, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 55, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5497": { "addr": "172.21.15.175:6833/3798454731", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6832", "nonce": 3798454731, "type": "v2" }, { "addr": "172.21.15.175:6833", "nonce": 3798454731, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5497, "incarnation": 51, "join_fscid": -1, "name": "b", "rank": 0, "state": "up:active", "state_seq": 11 } }, "last_failure": 0, "last_failure_osd_epoch": 35, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:56:52.500542+0000", "qdb_cluster": [ 5497 ], "qdb_leader": 5497, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5497 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 57, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5868": { "addr": "172.21.15.90:6835/3994531378", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6834", "nonce": 3994531378, "type": "v2" }, { "addr": "172.21.15.90:6835", "nonce": 3994531378, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5868, "incarnation": 57, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 36, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:57:50.361691+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5868 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:57:52.977 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:53.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.075+0000 7f94f3e31640 1 Processor -- start 2024-04-20T10:57:53.076 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.076+0000 7f94f3e31640 1 -- start start 2024-04-20T10:57:53.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.076+0000 7f94f3e31640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f94ec153ef0 0x7f94ec0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:53.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.076+0000 7f94f3e31640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94ec0c9ee0 0x7f94ec156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:53.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.076+0000 7f94f3e31640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94ec15a720 con 0x7f94ec0ab730 2024-04-20T10:57:53.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.076+0000 7f94f3e31640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f94ec15ac80 con 0x7f94ec0c9ee0 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.076+0000 7f94f3e31640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f94ec15a9a0 con 0x7f94ec153ef0 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f23ce640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f94ec0c9ee0 0x7f94ec156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f13cc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f94ec0ab730 0x7f94ec1568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:53968/0 (socket says 172.21.15.90:53968) 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f13cc640 1 -- 172.21.15.90:0/254664121 learned_addr learned my addr 172.21.15.90:0/254664121 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f1bcd640 1 --2- 172.21.15.90:0/254664121 >> v2:172.21.15.175:3300/0 conn(0x7f94ec153ef0 0x7f94ec0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f0bcb640 1 -- 172.21.15.90:0/254664121 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 16852343 0 0) 0x7f94dc001110 con 0x7f94ec0ab730 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f0bcb640 1 -- 172.21.15.90:0/254664121 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94d8003520 con 0x7f94ec0ab730 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f23ce640 1 -- 172.21.15.90:0/254664121 >> v2:172.21.15.175:3300/0 conn(0x7f94ec153ef0 msgr2=0x7f94ec0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f23ce640 1 --2- 172.21.15.90:0/254664121 >> v2:172.21.15.175:3300/0 conn(0x7f94ec153ef0 0x7f94ec0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f23ce640 1 -- 172.21.15.90:0/254664121 >> v1:172.21.15.90:6789/0 conn(0x7f94ec0ab730 legacy=0x7f94ec1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:53.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.077+0000 7f94f23ce640 1 -- 172.21.15.90:0/254664121 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec0c6a90 con 0x7f94ec0c9ee0 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.078+0000 7f94f23ce640 1 --2- 172.21.15.90:0/254664121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0c9ee0 0x7f94ec156fd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0aec60 tx=0x7f94e402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08fc04f38f959d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.078+0000 7f94f0bcb640 1 -- 172.21.15.90:0/254664121 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4039070 con 0x7f94ec0c9ee0 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.078+0000 7f94f0bcb640 1 -- 172.21.15.90:0/254664121 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e402cb60 con 0x7f94ec0c9ee0 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.078+0000 7f94f0bcb640 1 -- 172.21.15.90:0/254664121 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e4034440 con 0x7f94ec0c9ee0 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 -- 172.21.15.90:0/254664121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0c9ee0 msgr2=0x7f94ec156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 --2- 172.21.15.90:0/254664121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0c9ee0 0x7f94ec156fd0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0aec60 tx=0x7f94e402bdb0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 -- 172.21.15.90:0/254664121 shutdown_connections 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 --2- 172.21.15.90:0/254664121 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0c9ee0 0x7f94ec156fd0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 --2- 172.21.15.90:0/254664121 >> v2:172.21.15.175:3300/0 conn(0x7f94ec153ef0 0x7f94ec0c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 -- 172.21.15.90:0/254664121 >> 172.21.15.90:0/254664121 conn(0x7f94ec0cbfe0 msgr2=0x7f94ec0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:53.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 -- 172.21.15.90:0/254664121 shutdown_connections 2024-04-20T10:57:53.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.079+0000 7f94f3e31640 1 -- 172.21.15.90:0/254664121 wait complete. 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.080+0000 7f94f3e31640 1 Processor -- start 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.080+0000 7f94f3e31640 1 -- start start 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f3e31640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0ab730 0x7f94ec1ecef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f3e31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ec0c9ee0 0x7f94ec0c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f3e31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec153ef0 0x7f94ec150e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f3e31640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec0bf800 con 0x7f94ec0ab730 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f3e31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f94ec157510 con 0x7f94ec153ef0 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f3e31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f94ec0bf630 con 0x7f94ec0c9ee0 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f1bcd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0ab730 0x7f94ec1ecef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f1bcd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0ab730 0x7f94ec1ecef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41690/0 (socket says 172.21.15.90:41690) 2024-04-20T10:57:53.083 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.081+0000 7f94f1bcd640 1 -- 172.21.15.90:0/3626046085 learned_addr learned my addr 172.21.15.90:0/3626046085 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f13cc640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ec0c9ee0 0x7f94ec0c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f23ce640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec153ef0 0x7f94ec150e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f1bcd640 1 -- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ec0c9ee0 msgr2=0x7f94ec0c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f1bcd640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ec0c9ee0 0x7f94ec0c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f1bcd640 1 -- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec153ef0 msgr2=0x7f94ec150e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f1bcd640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec153ef0 0x7f94ec150e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f1bcd640 1 -- 172.21.15.90:0/3626046085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94ec1eda80 con 0x7f94ec0ab730 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f1bcd640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0ab730 0x7f94ec1ecef0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f94e800e870 tx=0x7f94e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94e27fc640 1 -- 172.21.15.90:0/3626046085 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e8017070 con 0x7f94ec0ab730 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94e27fc640 1 -- 172.21.15.90:0/3626046085 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94e800c940 con 0x7f94ec0ab730 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94e27fc640 1 -- 172.21.15.90:0/3626046085 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94e800cd30 con 0x7f94ec0ab730 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94ec1dff50 con 0x7f94ec0ab730 2024-04-20T10:57:53.084 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.082+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94ec0c5360 con 0x7f94ec0ab730 2024-04-20T10:57:53.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.083+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94ec076150 con 0x7f94ec0ab730 2024-04-20T10:57:53.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.084+0000 7f94e27fc640 1 -- 172.21.15.90:0/3626046085 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f94e801a070 con 0x7f94ec0ab730 2024-04-20T10:57:53.085 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.084+0000 7f94e27fc640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94d006c8f0 0x7f94d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:53.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.084+0000 7f94e27fc640 1 -- 172.21.15.90:0/3626046085 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f94e808c370 con 0x7f94ec0ab730 2024-04-20T10:57:53.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.084+0000 7f94f13cc640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94d006c8f0 0x7f94d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:53.086 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.085+0000 7f94f13cc640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94d006c8f0 0x7f94d006edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007fd0 tx=0x7f94dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:53.088 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.088+0000 7f94e27fc640 1 -- 172.21.15.90:0/3626046085 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f94e805a180 con 0x7f94ec0ab730 2024-04-20T10:57:53.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.312+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f94ec0cb7c0 con 0x7f94ec0ab730 2024-04-20T10:57:53.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.312+0000 7f94e27fc640 1 -- 172.21.15.90:0/3626046085 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) ==== 94+0+5700 (secure 0 0 0) 0x7f94e8059a80 con 0x7f94ec0ab730 2024-04-20T10:57:53.313 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:53.313 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:50.361691+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:57:53.313 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 57 2024-04-20T10:57:53.314 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94d006c8f0 msgr2=0x7f94d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94d006c8f0 0x7f94d006edb0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f94dc007fd0 tx=0x7f94dc009040 comp rx=0 tx=0).stop 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0ab730 msgr2=0x7f94ec1ecef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0ab730 0x7f94ec1ecef0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f94e800e870 tx=0x7f94e800ed30 comp rx=0 tx=0).stop 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 shutdown_connections 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f94d006c8f0 0x7f94d006edb0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f94ec153ef0 0x7f94ec150e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f94ec0c9ee0 0x7f94ec0c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 --2- 172.21.15.90:0/3626046085 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f94ec0ab730 0x7f94ec1ecef0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 >> 172.21.15.90:0/3626046085 conn(0x7f94ec0cbfe0 msgr2=0x7f94ec159750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 shutdown_connections 2024-04-20T10:57:53.315 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:53.314+0000 7f94f3e31640 1 -- 172.21.15.90:0/3626046085 wait complete. 2024-04-20T10:57:53.325 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:57:55.326 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:55.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.426+0000 7fa05b46d640 1 Processor -- start 2024-04-20T10:57:55.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.426+0000 7fa05b46d640 1 -- start start 2024-04-20T10:57:55.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa05b46d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa054157710 0x7fa054154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:55.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa05b46d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa0540ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:55.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa05b46d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0540c4370 con 0x7fa054073810 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa05b46d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa0541569e0 con 0x7fa054157710 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa05b46d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa054157280 con 0x7fa0540ad0c0 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa058a08640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa054157710 0x7fa054154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa058a08640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa054157710 0x7fa054154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41770/0 (socket says 172.21.15.90:41770) 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa058a08640 1 -- 172.21.15.90:0/3726121012 learned_addr learned my addr 172.21.15.90:0/3726121012 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa059a0a640 1 --2- 172.21.15.90:0/3726121012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa0540ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa058a08640 1 -- 172.21.15.90:0/3726121012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 msgr2=0x7fa0540ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa058a08640 1 --2- 172.21.15.90:0/3726121012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa0540ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa058a08640 1 -- 172.21.15.90:0/3726121012 >> v1:172.21.15.175:6789/0 conn(0x7fa054073810 legacy=0x7fa0540c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa058a08640 1 -- 172.21.15.90:0/3726121012 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa054156c30 con 0x7fa054157710 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.427+0000 7fa059a0a640 1 --2- 172.21.15.90:0/3726121012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa0540ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.428+0000 7fa058a08640 1 --2- 172.21.15.90:0/3726121012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa054154000 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa04400bb10 tx=0x7fa04402e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89e1224d8fa3ebe0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:55.429 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.428+0000 7fa04bfff640 1 -- 172.21.15.90:0/3726121012 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04403b070 con 0x7fa054157710 2024-04-20T10:57:55.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.428+0000 7fa04bfff640 1 -- 172.21.15.90:0/3726121012 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04402ede0 con 0x7fa054157710 2024-04-20T10:57:55.430 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.428+0000 7fa04bfff640 1 -- 172.21.15.90:0/3726121012 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044036660 con 0x7fa054157710 2024-04-20T10:57:55.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 -- 172.21.15.90:0/3726121012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 msgr2=0x7fa054154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:55.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 --2- 172.21.15.90:0/3726121012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa054154000 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa04400bb10 tx=0x7fa04402e030 comp rx=0 tx=0).stop 2024-04-20T10:57:55.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 -- 172.21.15.90:0/3726121012 shutdown_connections 2024-04-20T10:57:55.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 --2- 172.21.15.90:0/3726121012 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa0540ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 --2- 172.21.15.90:0/3726121012 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa054154000 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 -- 172.21.15.90:0/3726121012 >> 172.21.15.90:0/3726121012 conn(0x7fa0540c8080 msgr2=0x7fa0540c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 -- 172.21.15.90:0/3726121012 shutdown_connections 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.429+0000 7fa05b46d640 1 -- 172.21.15.90:0/3726121012 wait complete. 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.430+0000 7fa05b46d640 1 Processor -- start 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.430+0000 7fa05b46d640 1 -- start start 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa05b46d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa054073810 0x7fa054071e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa05b46d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa054072b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa05b46d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa0541e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa05b46d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa0540abbb0 con 0x7fa054157710 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa05b46d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa054073bf0 con 0x7fa054073810 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa05b46d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa0540abd30 con 0x7fa0540ad0c0 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa0541e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa0541e85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41774/0 (socket says 172.21.15.90:41774) 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 -- 172.21.15.90:0/1166357013 learned_addr learned my addr 172.21.15.90:0/1166357013 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059209640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa054073810 0x7fa054071e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:55.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa058a08640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa054072b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 -- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 msgr2=0x7fa054072b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa054072b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 -- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa054073810 msgr2=0x7fa054071e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa054073810 0x7fa054071e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 -- 172.21.15.90:0/1166357013 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa054073200 con 0x7fa054157710 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa059a0a640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa0541e85a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00c820 tx=0x7fa04c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa049ffb640 1 -- 172.21.15.90:0/1166357013 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c015070 con 0x7fa054157710 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa049ffb640 1 -- 172.21.15.90:0/1166357013 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa04c007a30 con 0x7fa054157710 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa054071370 con 0x7fa054157710 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.431+0000 7fa049ffb640 1 -- 172.21.15.90:0/1166357013 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04c007e20 con 0x7fa054157710 2024-04-20T10:57:55.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.432+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa054071930 con 0x7fa054157710 2024-04-20T10:57:55.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.433+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa054076150 con 0x7fa054157710 2024-04-20T10:57:55.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.433+0000 7fa049ffb640 1 -- 172.21.15.90:0/1166357013 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa04c018070 con 0x7fa054157710 2024-04-20T10:57:55.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.433+0000 7fa049ffb640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa03806c920 0x7fa03806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:55.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.434+0000 7fa049ffb640 1 -- 172.21.15.90:0/1166357013 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7fa04c08bfb0 con 0x7fa054157710 2024-04-20T10:57:55.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.434+0000 7fa059209640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa03806c920 0x7fa03806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:55.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.434+0000 7fa059209640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa03806c920 0x7fa03806ede0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa05406e010 tx=0x7fa050003d90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:55.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.438+0000 7fa049ffb640 1 -- 172.21.15.90:0/1166357013 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa04c059770 con 0x7fa054157710 2024-04-20T10:57:55.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.658+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa0540c8c40 con 0x7fa054157710 2024-04-20T10:57:55.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.659+0000 7fa049ffb640 1 -- 172.21.15.90:0/1166357013 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) ==== 94+0+5701 (secure 0 0 0) 0x7fa04c05da70 con 0x7fa054157710 2024-04-20T10:57:55.659 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:55.659 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":59,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":59,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:54.618766+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:rejoin","state_seq":16,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:57:55.659 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 59 2024-04-20T10:57:55.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa03806c920 msgr2=0x7fa03806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:55.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa03806c920 0x7fa03806ede0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fa05406e010 tx=0x7fa050003d90 comp rx=0 tx=0).stop 2024-04-20T10:57:55.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 msgr2=0x7fa0541e85a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:55.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa0541e85a0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00c820 tx=0x7fa04c00cce0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 shutdown_connections 2024-04-20T10:57:55.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa03806c920 0x7fa03806ede0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa054157710 0x7fa0541e85a0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa0540ad0c0 0x7fa054072b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 --2- 172.21.15.90:0/1166357013 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa054073810 0x7fa054071e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:55.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 >> 172.21.15.90:0/1166357013 conn(0x7fa0540c8080 msgr2=0x7fa0540ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:55.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 shutdown_connections 2024-04-20T10:57:55.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:55.661+0000 7fa05b46d640 1 -- 172.21.15.90:0/1166357013 wait complete. 2024-04-20T10:57:55.672 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:57:57.673 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:57:57.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.772+0000 7f2c19c43640 1 Processor -- start 2024-04-20T10:57:57.772 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.772+0000 7f2c19c43640 1 -- start start 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c19c43640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f2c14151b40 0x7f2c140ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c19c43640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2c140ae720 0x7f2c140c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c19c43640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c140adee0 0x7f2c14157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c19c43640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2c140c86d0 con 0x7f2c140ae720 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c19c43640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f2c14067a10 con 0x7f2c14151b40 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c19c43640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2c14067cf0 con 0x7f2c140adee0 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2c140ae720 0x7f2c140c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:57.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2c140ae720 0x7f2c140c3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41778/0 (socket says 172.21.15.90:41778) 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 -- 172.21.15.90:0/3283064270 learned_addr learned my addr 172.21.15.90:0/3283064270 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c137fe640 1 --2- 172.21.15.90:0/3283064270 >> v2:172.21.15.175:3300/0 conn(0x7f2c14151b40 0x7f2c140ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c13fff640 1 --2- 172.21.15.90:0/3283064270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c140adee0 0x7f2c14157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 -- 172.21.15.90:0/3283064270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c140adee0 msgr2=0x7f2c14157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 --2- 172.21.15.90:0/3283064270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c140adee0 0x7f2c14157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 -- 172.21.15.90:0/3283064270 >> v2:172.21.15.175:3300/0 conn(0x7f2c14151b40 msgr2=0x7f2c140ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 --2- 172.21.15.90:0/3283064270 >> v2:172.21.15.175:3300/0 conn(0x7f2c14151b40 0x7f2c140ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.773+0000 7f2c12ffd640 1 -- 172.21.15.90:0/3283064270 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c14158430 con 0x7f2c140ae720 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.774+0000 7f2c12ffd640 1 --2- 172.21.15.90:0/3283064270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140ae720 0x7f2c140c3910 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2c14075920 tx=0x7f2c0802fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c18d0b031f6b0ef server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.774+0000 7f2c127fc640 1 -- 172.21.15.90:0/3283064270 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0803d070 con 0x7f2c140ae720 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.774+0000 7f2c127fc640 1 -- 172.21.15.90:0/3283064270 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c080309b0 con 0x7f2c140ae720 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.774+0000 7f2c127fc640 1 -- 172.21.15.90:0/3283064270 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c08030d80 con 0x7f2c140ae720 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.774+0000 7f2c19c43640 1 -- 172.21.15.90:0/3283064270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140ae720 msgr2=0x7f2c140c3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:57.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.774+0000 7f2c19c43640 1 --2- 172.21.15.90:0/3283064270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140ae720 0x7f2c140c3910 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f2c14075920 tx=0x7f2c0802fc00 comp rx=0 tx=0).stop 2024-04-20T10:57:57.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.775+0000 7f2c19c43640 1 -- 172.21.15.90:0/3283064270 shutdown_connections 2024-04-20T10:57:57.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.775+0000 7f2c19c43640 1 --2- 172.21.15.90:0/3283064270 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c140adee0 0x7f2c14157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:57.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.775+0000 7f2c19c43640 1 --2- 172.21.15.90:0/3283064270 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140ae720 0x7f2c140c3910 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:57.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.775+0000 7f2c19c43640 1 --2- 172.21.15.90:0/3283064270 >> v2:172.21.15.175:3300/0 conn(0x7f2c14151b40 0x7f2c140ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:57.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.775+0000 7f2c19c43640 1 -- 172.21.15.90:0/3283064270 >> 172.21.15.90:0/3283064270 conn(0x7f2c140aa660 msgr2=0x7f2c140aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:57.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.775+0000 7f2c19c43640 1 -- 172.21.15.90:0/3283064270 shutdown_connections 2024-04-20T10:57:57.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.775+0000 7f2c19c43640 1 -- 172.21.15.90:0/3283064270 wait complete. 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.776+0000 7f2c19c43640 1 Processor -- start 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.776+0000 7f2c19c43640 1 -- start start 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140adee0 0x7f2c14150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c140ae720 0x7f2c14148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c14151b40 0x7f2c14149080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140ae370 con 0x7f2c140adee0 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2c140c3e50 con 0x7f2c140ae720 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2c140ae4f0 con 0x7f2c14151b40 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140adee0 0x7f2c14150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140adee0 0x7f2c14150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:41792/0 (socket says 172.21.15.90:41792) 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 -- 172.21.15.90:0/2167113615 learned_addr learned my addr 172.21.15.90:0/2167113615 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c12ffd640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c140ae720 0x7f2c14148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:57.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c13fff640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c14151b40 0x7f2c14149080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 -- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c14151b40 msgr2=0x7f2c14149080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c14151b40 0x7f2c14149080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 -- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c140ae720 msgr2=0x7f2c14148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c140ae720 0x7f2c14148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 -- 172.21.15.90:0/2167113615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c141522a0 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c137fe640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140adee0 0x7f2c14150870 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400d830 tx=0x7f2c0400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2bfbfff640 1 -- 172.21.15.90:0/2167113615 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400b6c0 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2bfbfff640 1 -- 172.21.15.90:0/2167113615 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c04019070 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c14152580 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2bfbfff640 1 -- 172.21.15.90:0/2167113615 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400ba80 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.777+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c141528f0 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.778+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c14076150 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.779+0000 7f2bfbfff640 1 -- 172.21.15.90:0/2167113615 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2c0401e460 con 0x7f2c140adee0 2024-04-20T10:57:57.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.779+0000 7f2bfbfff640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2c0006c8f0 0x7f2c0006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:57:57.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.779+0000 7f2c12ffd640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2c0006c8f0 0x7f2c0006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:57:57.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.779+0000 7f2bfbfff640 1 -- 172.21.15.90:0/2167113615 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f2c0408c710 con 0x7f2c140adee0 2024-04-20T10:57:57.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.780+0000 7f2c12ffd640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2c0006c8f0 0x7f2c0006edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2c0803a000 tx=0x7f2c08034000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:57:57.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:57.784+0000 7f2bfbfff640 1 -- 172.21.15.90:0/2167113615 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2c04059e40 con 0x7f2c140adee0 2024-04-20T10:57:58.030 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.030+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c140c2a20 con 0x7f2c140adee0 2024-04-20T10:57:58.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.031+0000 7f2bfbfff640 1 -- 172.21.15.90:0/2167113615 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5708 (secure 0 0 0) 0x7f2c0405e140 con 0x7f2c140adee0 2024-04-20T10:57:58.031 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:57:58.032 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:57:58.032 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 61 2024-04-20T10:57:58.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2c0006c8f0 msgr2=0x7f2c0006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:58.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2c0006c8f0 0x7f2c0006edb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f2c0803a000 tx=0x7f2c08034000 comp rx=0 tx=0).stop 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140adee0 msgr2=0x7f2c14150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140adee0 0x7f2c14150870 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400d830 tx=0x7f2c0400dcf0 comp rx=0 tx=0).stop 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 shutdown_connections 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f2c0006c8f0 0x7f2c0006edb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2c14151b40 0x7f2c14149080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2c140ae720 0x7f2c14148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 --2- 172.21.15.90:0/2167113615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2c140adee0 0x7f2c14150870 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 >> 172.21.15.90:0/2167113615 conn(0x7f2c140aa660 msgr2=0x7f2c140ab6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 shutdown_connections 2024-04-20T10:57:58.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:57:58.034+0000 7f2c19c43640 1 -- 172.21.15.90:0/2167113615 wait complete. 2024-04-20T10:57:58.045 INFO:tasks.mds_thrash.fs.[b]:mds.a has gained rank=0, replacing gid=5679 2024-04-20T10:57:58.045 INFO:tasks.mds_thrash.fs.[b]:waiting for 8 secs before reviving mds.c 2024-04-20T10:58:01.527 INFO:tasks.ceph.mds.a.smithi090.stderr:2024-04-20T10:58:01.527+0000 7faa8ece4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:58:06.046 INFO:tasks.mds_thrash.fs.[b]:reviving mds.c 2024-04-20T10:58:06.046 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-20T10:58:06.047 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-20T10:58:06.049 INFO:tasks.ceph.mds.c:Started 2024-04-20T10:58:06.049 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:58:06.133 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-04-20T10:58:06.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.168+0000 7f96f3fe6640 1 Processor -- start 2024-04-20T10:58:06.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.169+0000 7f96f3fe6640 1 -- start start 2024-04-20T10:58:06.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.169+0000 7f96f3fe6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f96ec150b50 0x7f96ec06d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:06.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.169+0000 7f96f3fe6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f96ec06db60 0x7f96ec0c43e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:06.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.169+0000 7f96f3fe6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96ec067cd0 con 0x7f96ec0c31d0 2024-04-20T10:58:06.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.169+0000 7f96f3fe6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f96ec157a40 con 0x7f96ec06db60 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.169+0000 7f96f3fe6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f96ec0a7f80 con 0x7f96ec150b50 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1581640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f96ec06db60 0x7f96ec0c43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1581640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f96ec06db60 0x7f96ec0c43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55134/0 (socket says 172.21.15.90:55134) 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1581640 1 -- 172.21.15.90:0/4052273088 learned_addr learned my addr 172.21.15.90:0/4052273088 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f2583640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f96ec0c31d0 0x7f96ec0c4920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52322/0 (socket says 172.21.15.90:52322) 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1d82640 1 --2- 172.21.15.90:0/4052273088 >> v2:172.21.15.175:3300/0 conn(0x7f96ec150b50 0x7f96ec06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1581640 1 -- 172.21.15.90:0/4052273088 >> v2:172.21.15.175:3300/0 conn(0x7f96ec150b50 msgr2=0x7f96ec06d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1581640 1 --2- 172.21.15.90:0/4052273088 >> v2:172.21.15.175:3300/0 conn(0x7f96ec150b50 0x7f96ec06d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1581640 1 -- 172.21.15.90:0/4052273088 >> v1:172.21.15.90:6789/0 conn(0x7f96ec0c31d0 legacy=0x7f96ec0c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f0d80640 1 -- 172.21.15.90:0/4052273088 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2771190169 0 0) 0x7f96ec067cd0 con 0x7f96ec0c31d0 2024-04-20T10:58:06.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.170+0000 7f96f1581640 1 -- 172.21.15.90:0/4052273088 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec1574c0 con 0x7f96ec06db60 2024-04-20T10:58:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.171+0000 7f96f1581640 1 --2- 172.21.15.90:0/4052273088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec06db60 0x7f96ec0c43e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0ab110 tx=0x7f96dc02db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c44fc4cd923764 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:06.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.171+0000 7f96f0d80640 1 -- 172.21.15.90:0/4052273088 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc02f8e0 con 0x7f96ec06db60 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.171+0000 7f96f0d80640 1 -- 172.21.15.90:0/4052273088 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96dc02fa80 con 0x7f96ec06db60 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.171+0000 7f96f0d80640 1 -- 172.21.15.90:0/4052273088 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc02fe50 con 0x7f96ec06db60 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 -- 172.21.15.90:0/4052273088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec06db60 msgr2=0x7f96ec0c43e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/4052273088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec06db60 0x7f96ec0c43e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f96ec0ab110 tx=0x7f96dc02db20 comp rx=0 tx=0).stop 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 -- 172.21.15.90:0/4052273088 shutdown_connections 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/4052273088 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec06db60 0x7f96ec0c43e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/4052273088 >> v2:172.21.15.175:3300/0 conn(0x7f96ec150b50 0x7f96ec06d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 -- 172.21.15.90:0/4052273088 >> 172.21.15.90:0/4052273088 conn(0x7f96ec0aa580 msgr2=0x7f96ec0aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 -- 172.21.15.90:0/4052273088 shutdown_connections 2024-04-20T10:58:06.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.172+0000 7f96f3fe6640 1 -- 172.21.15.90:0/4052273088 wait complete. 2024-04-20T10:58:06.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.173+0000 7f96f3fe6640 1 Processor -- start 2024-04-20T10:58:06.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.173+0000 7f96f3fe6640 1 -- start start 2024-04-20T10:58:06.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f3fe6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ec06db60 0x7f96ec072b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f3fe6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec0c31d0 0x7f96ec0c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f3fe6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ec150b50 0x7f96ec14bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f3fe6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec157760 con 0x7f96ec0c31d0 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f3fe6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f96ec0c5030 con 0x7f96ec150b50 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f3fe6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f96ec0c3ec0 con 0x7f96ec06db60 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec0c31d0 0x7f96ec0c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec0c31d0 0x7f96ec0c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55138/0 (socket says 172.21.15.90:55138) 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 -- 172.21.15.90:0/2080575991 learned_addr learned my addr 172.21.15.90:0/2080575991 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1d82640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ec06db60 0x7f96ec072b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f2583640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ec150b50 0x7f96ec14bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:06.176 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 -- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ec06db60 msgr2=0x7f96ec072b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ec06db60 0x7f96ec072b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 -- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ec150b50 msgr2=0x7f96ec14bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ec150b50 0x7f96ec14bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.174+0000 7f96f1581640 1 -- 172.21.15.90:0/2080575991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96ec073070 con 0x7f96ec0c31d0 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.175+0000 7f96f1581640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec0c31d0 0x7f96ec0c1e70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f96dc000c00 tx=0x7f96dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.175+0000 7f96e27fc640 1 -- 172.21.15.90:0/2080575991 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc046020 con 0x7f96ec0c31d0 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.175+0000 7f96e27fc640 1 -- 172.21.15.90:0/2080575991 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f96dc037ca0 con 0x7f96ec0c31d0 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.175+0000 7f96e27fc640 1 -- 172.21.15.90:0/2080575991 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0426b0 con 0x7f96ec0c31d0 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.175+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96ec1510d0 con 0x7f96ec0c31d0 2024-04-20T10:58:06.177 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.175+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96ec151690 con 0x7f96ec0c31d0 2024-04-20T10:58:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.176+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96ec076150 con 0x7f96ec0c31d0 2024-04-20T10:58:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.177+0000 7f96e27fc640 1 -- 172.21.15.90:0/2080575991 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f96dc049020 con 0x7f96ec0c31d0 2024-04-20T10:58:06.178 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.177+0000 7f96e27fc640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f96d006c8f0 0x7f96d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.177+0000 7f96e27fc640 1 -- 172.21.15.90:0/2080575991 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f96dc0aed30 con 0x7f96ec0c31d0 2024-04-20T10:58:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.177+0000 7f96f1d82640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f96d006c8f0 0x7f96d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:06.179 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.178+0000 7f96f1d82640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f96d006c8f0 0x7f96d006edb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009ad0 tx=0x7f96e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:06.182 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.182+0000 7f96e27fc640 1 -- 172.21.15.90:0/2080575991 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f96dc07cb40 con 0x7f96ec0c31d0 2024-04-20T10:58:06.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.414+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96ec067ab0 con 0x7f96ec0c31d0 2024-04-20T10:58:06.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.416+0000 7f96e27fc640 1 -- 172.21.15.90:0/2080575991 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5708 (secure 0 0 0) 0x7f96dc07c440 con 0x7f96ec0c31d0 2024-04-20T10:58:06.418 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:58:06.418 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:58:06.418 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 61 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f96d006c8f0 msgr2=0x7f96d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f96d006c8f0 0x7f96d006edb0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f96e8009ad0 tx=0x7f96e8008040 comp rx=0 tx=0).stop 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec0c31d0 msgr2=0x7f96ec0c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec0c31d0 0x7f96ec0c1e70 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f96dc000c00 tx=0x7f96dc0046c0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 shutdown_connections 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f96d006c8f0 0x7f96d006edb0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f96ec150b50 0x7f96ec14bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.425 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f96ec0c31d0 0x7f96ec0c1e70 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 --2- 172.21.15.90:0/2080575991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f96ec06db60 0x7f96ec072b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:06.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 >> 172.21.15.90:0/2080575991 conn(0x7f96ec0aa580 msgr2=0x7f96ec0aa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:06.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 shutdown_connections 2024-04-20T10:58:06.426 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:06.420+0000 7f96f3fe6640 1 -- 172.21.15.90:0/2080575991 wait complete. 2024-04-20T10:58:06.432 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.c is in active, standby or standby-replay 2024-04-20T10:58:08.433 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:58:08.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.565+0000 7f4ff5cfd640 1 Processor -- start 2024-04-20T10:58:08.565 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.565+0000 7f4ff5cfd640 1 -- start start 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4ff5cfd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ff01542d0 0x7f4ff00679b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4ff5cfd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4ff5cfd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ff00a8050 con 0x7f4ff00c7e00 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4ff5cfd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4ff00c5130 con 0x7f4ff01542d0 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4ff5cfd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff00c3350 con 0x7f4ff006d5d0 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4feffff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4ff00c7e00 0x7f4ff00c3b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:52328/0 (socket says 172.21.15.90:52328) 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4feffff640 1 -- 172.21.15.90:0/3329451404 learned_addr learned my addr 172.21.15.90:0/3329451404 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4feeffd640 1 --2- 172.21.15.90:0/3329451404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4fef7fe640 1 --2- 172.21.15.90:0/3329451404 >> v2:172.21.15.175:3300/0 conn(0x7f4ff01542d0 0x7f4ff00679b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4fee7fc640 1 -- 172.21.15.90:0/3329451404 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207566398 0 0) 0x7f4ff00a8050 con 0x7f4ff00c7e00 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4fee7fc640 1 -- 172.21.15.90:0/3329451404 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fd8003520 con 0x7f4ff00c7e00 2024-04-20T10:58:08.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4feeffd640 1 -- 172.21.15.90:0/3329451404 >> v2:172.21.15.175:3300/0 conn(0x7f4ff01542d0 msgr2=0x7f4ff00679b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:58:08.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4feeffd640 1 --2- 172.21.15.90:0/3329451404 >> v2:172.21.15.175:3300/0 conn(0x7f4ff01542d0 0x7f4ff00679b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.566+0000 7f4feeffd640 1 -- 172.21.15.90:0/3329451404 >> v1:172.21.15.90:6789/0 conn(0x7f4ff00c7e00 legacy=0x7f4ff00c3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:08.568 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.567+0000 7f4feeffd640 1 -- 172.21.15.90:0/3329451404 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff00c3630 con 0x7f4ff006d5d0 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.567+0000 7f4feeffd640 1 --2- 172.21.15.90:0/3329451404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00c78c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40097a0 tx=0x7f4fe402b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a473dac3d271fce3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.567+0000 7f4fee7fc640 1 -- 172.21.15.90:0/3329451404 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4038070 con 0x7f4ff006d5d0 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.567+0000 7f4fee7fc640 1 -- 172.21.15.90:0/3329451404 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe4031700 con 0x7f4ff006d5d0 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4fee7fc640 1 -- 172.21.15.90:0/3329451404 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4031ab0 con 0x7f4ff006d5d0 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3329451404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 msgr2=0x7f4ff00c78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3329451404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00c78c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40097a0 tx=0x7f4fe402b7a0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3329451404 shutdown_connections 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3329451404 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00c78c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3329451404 >> v2:172.21.15.175:3300/0 conn(0x7f4ff01542d0 0x7f4ff00679b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.569 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3329451404 >> 172.21.15.90:0/3329451404 conn(0x7f4ff00aa660 msgr2=0x7f4ff00aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:08.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3329451404 shutdown_connections 2024-04-20T10:58:08.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.568+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3329451404 wait complete. 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.569+0000 7f4ff5cfd640 1 Processor -- start 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4ff5cfd640 1 -- start start 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4ff5cfd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00ad630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4ff5cfd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ff00c7e00 0x7f4ff014c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4ff5cfd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ff01542d0 0x7f4ff014cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4ff5cfd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff00c4ed0 con 0x7f4ff00c7e00 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4ff5cfd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ff00c4d50 con 0x7f4ff01542d0 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4ff5cfd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ff00c4260 con 0x7f4ff006d5d0 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ff00c7e00 0x7f4ff014c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4feeffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ff00c7e00 0x7f4ff014c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:55152/0 (socket says 172.21.15.90:55152) 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4feeffd640 1 -- 172.21.15.90:0/3356277479 learned_addr learned my addr 172.21.15.90:0/3356277479 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.570+0000 7f4fef7fe640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00ad630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:08.572 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4feffff640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ff01542d0 0x7f4ff014cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4feeffd640 1 -- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 msgr2=0x7f4ff00ad630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4feeffd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00ad630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4feeffd640 1 -- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ff01542d0 msgr2=0x7f4ff014cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4feeffd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ff01542d0 0x7f4ff014cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4feeffd640 1 -- 172.21.15.90:0/3356277479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ff01ecfb0 con 0x7f4ff00c7e00 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4feeffd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ff00c7e00 0x7f4ff014c650 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000c00 tx=0x7f4fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4fd7fff640 1 -- 172.21.15.90:0/3356277479 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4043070 con 0x7f4ff00c7e00 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4fd7fff640 1 -- 172.21.15.90:0/3356277479 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fe403f870 con 0x7f4ff00c7e00 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ff0156b00 con 0x7f4ff00c7e00 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4fd7fff640 1 -- 172.21.15.90:0/3356277479 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fe4038040 con 0x7f4ff00c7e00 2024-04-20T10:58:08.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.571+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ff01570c0 con 0x7f4ff00c7e00 2024-04-20T10:58:08.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.572+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ff0076150 con 0x7f4ff00c7e00 2024-04-20T10:58:08.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.573+0000 7f4fd7fff640 1 -- 172.21.15.90:0/3356277479 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4fe4046070 con 0x7f4ff00c7e00 2024-04-20T10:58:08.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.573+0000 7f4fd7fff640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4fdc06c8f0 0x7f4fdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:08.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.573+0000 7f4fef7fe640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4fdc06c8f0 0x7f4fdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:08.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.573+0000 7f4fd7fff640 1 -- 172.21.15.90:0/3356277479 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f4fe40adca0 con 0x7f4ff00c7e00 2024-04-20T10:58:08.575 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.574+0000 7f4fef7fe640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4fdc06c8f0 0x7f4fdc06edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009aa0 tx=0x7f4fe0009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:08.578 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.578+0000 7f4fd7fff640 1 -- 172.21.15.90:0/3356277479 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4fe4030070 con 0x7f4ff00c7e00 2024-04-20T10:58:08.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.825+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ff0067790 con 0x7f4ff00c7e00 2024-04-20T10:58:08.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.826+0000 7f4fd7fff640 1 -- 172.21.15.90:0/3356277479 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f4fe407b460 con 0x7f4ff00c7e00 2024-04-20T10:58:08.826 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:58:08.826 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:58:08.826 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:58:08.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4fdc06c8f0 msgr2=0x7f4fdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:08.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4fdc06c8f0 0x7f4fdc06edb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0009aa0 tx=0x7f4fe0009190 comp rx=0 tx=0).stop 2024-04-20T10:58:08.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ff00c7e00 msgr2=0x7f4ff014c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:08.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ff00c7e00 0x7f4ff014c650 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4fe4000c00 tx=0x7f4fe40046c0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 shutdown_connections 2024-04-20T10:58:08.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4fdc06c8f0 0x7f4fdc06edb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ff01542d0 0x7f4ff014cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ff00c7e00 0x7f4ff014c650 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 --2- 172.21.15.90:0/3356277479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ff006d5d0 0x7f4ff00ad630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:08.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 >> 172.21.15.90:0/3356277479 conn(0x7f4ff00aa660 msgr2=0x7f4ff00ae690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:08.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 shutdown_connections 2024-04-20T10:58:08.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:08.828+0000 7f4ff5cfd640 1 -- 172.21.15.90:0/3356277479 wait complete. 2024-04-20T10:58:08.839 INFO:tasks.mds_thrash.fs.[b]:mds.c reported in up:standby state 2024-04-20T10:58:08.839 INFO:tasks.mds_thrash.fs.[b]:waiting for 58 secs before thrashing 2024-04-20T10:58:11.822 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:58:11.825 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:58:42.141 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:58:42.145 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:58:53.719 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:58:53.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.819+0000 7f5a7fbca640 1 Processor -- start 2024-04-20T10:58:53.820 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.820+0000 7f5a7fbca640 1 -- start start 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.820+0000 7f5a7fbca640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5a78157710 0x7f5a78154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.820+0000 7f5a7fbca640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a780ad0c0 0x7f5a780ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.820+0000 7f5a7fbca640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a780c4370 con 0x7f5a78073810 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.820+0000 7f5a7fbca640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5a781569e0 con 0x7f5a78157710 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.820+0000 7f5a7fbca640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5a78157280 con 0x7f5a780ad0c0 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.820+0000 7f5a7d966640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5a78073810 0x7f5a780c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50022/0 (socket says 172.21.15.90:50022) 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7d966640 1 -- 172.21.15.90:0/3360675747 learned_addr learned my addr 172.21.15.90:0/3360675747 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:58:53.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7e167640 1 --2- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a780ad0c0 0x7f5a780ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7d165640 1 --2- 172.21.15.90:0/3360675747 >> v2:172.21.15.175:3300/0 conn(0x7f5a78157710 0x7f5a78154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7c964640 1 -- 172.21.15.90:0/3360675747 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290840514 0 0) 0x7f5a780c4370 con 0x7f5a78073810 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7c964640 1 -- 172.21.15.90:0/3360675747 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a64003520 con 0x7f5a78073810 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7d165640 1 -- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a780ad0c0 msgr2=0x7f5a780ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7d165640 1 --2- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a780ad0c0 0x7f5a780ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7d165640 1 -- 172.21.15.90:0/3360675747 >> v1:172.21.15.90:6789/0 conn(0x7f5a78073810 legacy=0x7f5a780c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7c964640 1 -- 172.21.15.90:0/3360675747 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 985474779 0 0) 0x7f5a64003520 con 0x7f5a78073810 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7d165640 1 -- 172.21.15.90:0/3360675747 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a78156c30 con 0x7f5a78157710 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.821+0000 7f5a7e167640 1 --2- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a780ad0c0 0x7f5a780ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.822+0000 7f5a7d165640 1 --2- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a78157710 0x7f5a78154000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a740097a0 tx=0x7f5a7402b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=957ba2b7fa039610 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.822+0000 7f5a7c964640 1 -- 172.21.15.90:0/3360675747 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a74037070 con 0x7f5a78157710 2024-04-20T10:58:53.825 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.822+0000 7f5a7c964640 1 -- 172.21.15.90:0/3360675747 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a74030510 con 0x7f5a78157710 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.822+0000 7f5a7c964640 1 -- 172.21.15.90:0/3360675747 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a68001670 con 0x7f5a78157710 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.822+0000 7f5a7fbca640 1 -- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a78157710 msgr2=0x7f5a78154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.822+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a78157710 0x7f5a78154000 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f5a740097a0 tx=0x7f5a7402b710 comp rx=0 tx=0).stop 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.823+0000 7f5a7fbca640 1 -- 172.21.15.90:0/3360675747 shutdown_connections 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.823+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a780ad0c0 0x7f5a780ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.823+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/3360675747 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a78157710 0x7f5a78154000 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.823+0000 7f5a7fbca640 1 -- 172.21.15.90:0/3360675747 >> 172.21.15.90:0/3360675747 conn(0x7f5a780c8080 msgr2=0x7f5a780c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.823+0000 7f5a7fbca640 1 -- 172.21.15.90:0/3360675747 shutdown_connections 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.823+0000 7f5a7fbca640 1 -- 172.21.15.90:0/3360675747 wait complete. 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 Processor -- start 2024-04-20T10:58:53.826 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 -- start start 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a78073810 0x7f5a780722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a780ad0c0 0x7f5a7814f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a78157710 0x7f5a780c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5a780abbb0 con 0x7f5a78157710 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5a78073bf0 con 0x7f5a780ad0c0 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.824+0000 7f5a7fbca640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5a780abd30 con 0x7f5a78073810 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a78157710 0x7f5a780c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a78157710 0x7f5a780c14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35800/0 (socket says 172.21.15.90:35800) 2024-04-20T10:58:53.831 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 -- 172.21.15.90:0/2777362998 learned_addr learned my addr 172.21.15.90:0/2777362998 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7d966640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a78073810 0x7f5a780722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7d165640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a780ad0c0 0x7f5a7814f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 -- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a78073810 msgr2=0x7f5a780722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a78073810 0x7f5a780722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 -- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a780ad0c0 msgr2=0x7f5a7814f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a780ad0c0 0x7f5a7814f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 -- 172.21.15.90:0/2777362998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a781e0920 con 0x7f5a78157710 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7d165640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a780ad0c0 0x7f5a7814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7e167640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a78157710 0x7f5a780c14b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000efc0 tx=0x7f5a70009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a6e7fc640 1 -- 172.21.15.90:0/2777362998 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70018030 con 0x7f5a78157710 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a6e7fc640 1 -- 172.21.15.90:0/2777362998 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a7000cde0 con 0x7f5a78157710 2024-04-20T10:58:53.832 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a6e7fc640 1 -- 172.21.15.90:0/2777362998 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a70003bb0 con 0x7f5a78157710 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a781ec3c0 con 0x7f5a78157710 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.825+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a7814f830 con 0x7f5a78157710 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.826+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a78076150 con 0x7f5a78157710 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.827+0000 7f5a6e7fc640 1 -- 172.21.15.90:0/2777362998 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a70005d10 con 0x7f5a78157710 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.827+0000 7f5a6e7fc640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5a5c06c8f0 0x7f5a5c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.827+0000 7f5a6e7fc640 1 -- 172.21.15.90:0/2777362998 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f5a7008cc70 con 0x7f5a78157710 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.827+0000 7f5a7d966640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5a5c06c8f0 0x7f5a5c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:53.833 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.827+0000 7f5a7d966640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5a5c06c8f0 0x7f5a5c06edb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5a68007a00 tx=0x7f5a68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:53.834 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:53.831+0000 7f5a6e7fc640 1 -- 172.21.15.90:0/2777362998 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5a70022070 con 0x7f5a78157710 2024-04-20T10:58:54.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.040+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5a780c8c40 con 0x7f5a78157710 2024-04-20T10:58:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.040+0000 7f5a6e7fc640 1 -- 172.21.15.90:0/2777362998 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f5a781e0920 con 0x7f5a78157710 2024-04-20T10:58:54.042 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:58:54.042 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:58:54.042 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5a5c06c8f0 msgr2=0x7f5a5c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5a5c06c8f0 0x7f5a5c06edb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5a68007a00 tx=0x7f5a68009040 comp rx=0 tx=0).stop 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a78157710 msgr2=0x7f5a780c14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a78157710 0x7f5a780c14b0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5a7000efc0 tx=0x7f5a70009f90 comp rx=0 tx=0).stop 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 shutdown_connections 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5a5c06c8f0 0x7f5a5c06edb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5a78157710 0x7f5a780c14b0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5a780ad0c0 0x7f5a7814f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 --2- 172.21.15.90:0/2777362998 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5a78073810 0x7f5a780722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.042+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 >> 172.21.15.90:0/2777362998 conn(0x7f5a780c8080 msgr2=0x7f5a78153270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:54.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.043+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 shutdown_connections 2024-04-20T10:58:54.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.043+0000 7f5a7fbca640 1 -- 172.21.15.90:0/2777362998 wait complete. 2024-04-20T10:58:54.054 INFO:tasks.mds_thrash.fs.[a]:kill mds.b (rank=0) 2024-04-20T10:58:54.055 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-20T10:58:54.055 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:58:54.066 INFO:tasks.ceph.mds.b:Stopped 2024-04-20T10:58:54.067 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:58:54.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.162+0000 7fdfb2869640 1 Processor -- start 2024-04-20T10:58:54.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.162+0000 7fdfb2869640 1 -- start start 2024-04-20T10:58:54.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfb2869640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac1570f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:54.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfb2869640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdfac0c5480 0x7fdfac0ad5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:54.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfb2869640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfac0714f0 con 0x7fdfac15a590 2024-04-20T10:58:54.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfb2869640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fdfac06f640 con 0x7fdfac0c5480 2024-04-20T10:58:54.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfb2869640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdfac071a70 con 0x7fdfac0c27a0 2024-04-20T10:58:54.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfab7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdfac0c5480 0x7fdfac0ad5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfb0e06640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fdfac15a590 0x7fdfac1537a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50032/0 (socket says 172.21.15.90:50032) 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfb0e06640 1 -- 172.21.15.90:0/2552382927 learned_addr learned my addr 172.21.15.90:0/2552382927 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfabfff640 1 --2- 172.21.15.90:0/2552382927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac1570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfab7fe640 1 -- 172.21.15.90:0/2552382927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 msgr2=0x7fdfac1570f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfab7fe640 1 --2- 172.21.15.90:0/2552382927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac1570f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfab7fe640 1 -- 172.21.15.90:0/2552382927 >> v1:172.21.15.90:6789/0 conn(0x7fdfac15a590 legacy=0x7fdfac1537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfab7fe640 1 -- 172.21.15.90:0/2552382927 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac071790 con 0x7fdfac0c5480 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.163+0000 7fdfaaffd640 1 -- 172.21.15.90:0/2552382927 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1683514979 0 0) 0x7fdfac0714f0 con 0x7fdfac15a590 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.164+0000 7fdfab7fe640 1 --2- 172.21.15.90:0/2552382927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac0ad5d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097a0 tx=0x7fdfa002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484ea61125b804ae server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.164+0000 7fdfaaffd640 1 -- 172.21.15.90:0/2552382927 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa00315a0 con 0x7fdfac0c5480 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.164+0000 7fdfaaffd640 1 -- 172.21.15.90:0/2552382927 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa0037070 con 0x7fdfac0c5480 2024-04-20T10:58:54.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.164+0000 7fdfaaffd640 1 -- 172.21.15.90:0/2552382927 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0031960 con 0x7fdfac0c5480 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 -- 172.21.15.90:0/2552382927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 msgr2=0x7fdfac0ad5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 --2- 172.21.15.90:0/2552382927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac0ad5d0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00097a0 tx=0x7fdfa002b840 comp rx=0 tx=0).stop 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 -- 172.21.15.90:0/2552382927 shutdown_connections 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 --2- 172.21.15.90:0/2552382927 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac0ad5d0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 --2- 172.21.15.90:0/2552382927 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac1570f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 -- 172.21.15.90:0/2552382927 >> 172.21.15.90:0/2552382927 conn(0x7fdfac0c9100 msgr2=0x7fdfac0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 -- 172.21.15.90:0/2552382927 shutdown_connections 2024-04-20T10:58:54.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.165+0000 7fdfb2869640 1 -- 172.21.15.90:0/2552382927 wait complete. 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.166+0000 7fdfb2869640 1 Processor -- start 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.166+0000 7fdfb2869640 1 -- start start 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfb2869640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac14e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfb2869640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfb2869640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfac15a590 0x7fdfac071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfb2869640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac15a070 con 0x7fdfac0c5480 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfb2869640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdfac0adb10 con 0x7fdfac15a590 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfb2869640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdfac15aa20 con 0x7fdfac0c27a0 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:35816/0 (socket says 172.21.15.90:35816) 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 -- 172.21.15.90:0/3027364254 learned_addr learned my addr 172.21.15.90:0/3027364254 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:54.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfb0e06640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfac15a590 0x7fdfac071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfabfff640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac14e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 -- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 msgr2=0x7fdfac14e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac14e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 -- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfac15a590 msgr2=0x7fdfac071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfac15a590 0x7fdfac071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 -- 172.21.15.90:0/3027364254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfac158bb0 con 0x7fdfac0c5480 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.167+0000 7fdfab7fe640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac149740 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00098c0 tx=0x7fdfa00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.168+0000 7fdfa8ff9640 1 -- 172.21.15.90:0/3027364254 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0032840 con 0x7fdfac0c5480 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.168+0000 7fdfa8ff9640 1 -- 172.21.15.90:0/3027364254 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa0032a00 con 0x7fdfac0c5480 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.168+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfac143ca0 con 0x7fdfac0c5480 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.168+0000 7fdfa8ff9640 1 -- 172.21.15.90:0/3027364254 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0032df0 con 0x7fdfac0c5480 2024-04-20T10:58:54.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.168+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfac149c80 con 0x7fdfac0c5480 2024-04-20T10:58:54.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.169+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfac076150 con 0x7fdfac0c5480 2024-04-20T10:58:54.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.169+0000 7fdfa8ff9640 1 -- 172.21.15.90:0/3027364254 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdfa004e430 con 0x7fdfac0c5480 2024-04-20T10:58:54.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.169+0000 7fdfa8ff9640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdf9806c8f0 0x7fdf9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:54.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.169+0000 7fdfa8ff9640 1 -- 172.21.15.90:0/3027364254 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7fdfa002f030 con 0x7fdfac0c5480 2024-04-20T10:58:54.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.170+0000 7fdfabfff640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdf9806c8f0 0x7fdf9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:54.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.170+0000 7fdfabfff640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdf9806c8f0 0x7fdf9806edb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0079a0 tx=0x7fdf9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:54.175 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.174+0000 7fdfa8ff9640 1 -- 172.21.15.90:0/3027364254 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fdfa0040070 con 0x7fdfac0c5480 2024-04-20T10:58:54.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.383+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdfac0c5260 con 0x7fdfac0c5480 2024-04-20T10:58:54.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.384+0000 7fdfa8ff9640 1 -- 172.21.15.90:0/3027364254 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7fdfa007b7a0 con 0x7fdfac0c5480 2024-04-20T10:58:54.385 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:58:54.386 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:58:54.386 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:58:54.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdf9806c8f0 msgr2=0x7fdf9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdf9806c8f0 0x7fdf9806edb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c0079a0 tx=0x7fdf9c008040 comp rx=0 tx=0).stop 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 msgr2=0x7fdfac149740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac149740 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00098c0 tx=0x7fdfa00046c0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 shutdown_connections 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdf9806c8f0 0x7fdf9806edb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdfac15a590 0x7fdfac071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdfac0c5480 0x7fdfac149740 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 --2- 172.21.15.90:0/3027364254 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdfac0c27a0 0x7fdfac14e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 >> 172.21.15.90:0/3027364254 conn(0x7fdfac0c9100 msgr2=0x7fdfac1e2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 shutdown_connections 2024-04-20T10:58:54.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:54.386+0000 7fdfb2869640 1 -- 172.21.15.90:0/3027364254 wait complete. 2024-04-20T10:58:54.399 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:58:56.400 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:58:56.508 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.507+0000 7f08865b2640 1 Processor -- start 2024-04-20T10:58:56.509 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.507+0000 7f08865b2640 1 -- start start 2024-04-20T10:58:56.510 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.508+0000 7f08865b2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08800701c0 0x7f0880073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.508+0000 7f08865b2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08800c6870 con 0x7f0880156f20 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.508+0000 7f08865b2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f088015a050 con 0x7f088015ab30 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.508+0000 7f08865b2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f08800ab630 con 0x7f08800701c0 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.508+0000 7f087ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f08800701c0 0x7f0880073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.508+0000 7f0884b4f640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0880156f20 0x7f0880153630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48592/0 (socket says 172.21.15.90:48592) 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.508+0000 7f0884b4f640 1 -- 172.21.15.90:0/1654531859 learned_addr learned my addr 172.21.15.90:0/1654531859 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087ffff640 1 -- 172.21.15.90:0/1654531859 >> v1:172.21.15.175:6789/0 conn(0x7f088015ab30 legacy=0x7f0880156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087ffff640 1 -- 172.21.15.90:0/1654531859 >> v1:172.21.15.90:6789/0 conn(0x7f0880156f20 legacy=0x7f0880153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:56.511 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087ffff640 1 -- 172.21.15.90:0/1654531859 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088015a330 con 0x7f08800701c0 2024-04-20T10:58:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087effd640 1 -- 172.21.15.90:0/1654531859 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1846717393 0 0) 0x7f08800c6870 con 0x7f0880156f20 2024-04-20T10:58:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087ffff640 1 --2- 172.21.15.90:0/1654531859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800701c0 0x7f0880073100 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f08680097a0 tx=0x7f086802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b838a3e0401ba4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087effd640 1 -- 172.21.15.90:0/1654531859 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08680315a0 con 0x7f08800701c0 2024-04-20T10:58:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087effd640 1 -- 172.21.15.90:0/1654531859 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0868037070 con 0x7f08800701c0 2024-04-20T10:58:56.512 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.509+0000 7f087effd640 1 -- 172.21.15.90:0/1654531859 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0868031960 con 0x7f08800701c0 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.510+0000 7f08865b2640 1 -- 172.21.15.90:0/1654531859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800701c0 msgr2=0x7f0880073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.510+0000 7f08865b2640 1 --2- 172.21.15.90:0/1654531859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800701c0 0x7f0880073100 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f08680097a0 tx=0x7f086802b840 comp rx=0 tx=0).stop 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.510+0000 7f08865b2640 1 -- 172.21.15.90:0/1654531859 shutdown_connections 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.510+0000 7f08865b2640 1 --2- 172.21.15.90:0/1654531859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f08800701c0 0x7f0880073100 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.510+0000 7f08865b2640 1 -- 172.21.15.90:0/1654531859 >> 172.21.15.90:0/1654531859 conn(0x7f08800676c0 msgr2=0x7f0880067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.510+0000 7f08865b2640 1 -- 172.21.15.90:0/1654531859 shutdown_connections 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.510+0000 7f08865b2640 1 -- 172.21.15.90:0/1654531859 wait complete. 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.511+0000 7f08865b2640 1 Processor -- start 2024-04-20T10:58:56.515 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.511+0000 7f08865b2640 1 -- start start 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f08865b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800701c0 0x7f08801efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f08865b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f088015ab30 0x7f088006d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f08865b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f088014cc20 0x7f088006da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f08865b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f08800705a0 con 0x7f088014cc20 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f08865b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0880159e00 con 0x7f08800701c0 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f08865b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f08800c6470 con 0x7f088015ab30 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f088014cc20 0x7f088006da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f088014cc20 0x7f088006da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58708/0 (socket says 172.21.15.90:58708) 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 -- 172.21.15.90:0/3963372341 learned_addr learned my addr 172.21.15.90:0/3963372341 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f087f7fe640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f088015ab30 0x7f088006d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f087ffff640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800701c0 0x7f08801efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 -- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f088015ab30 msgr2=0x7f088006d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:56.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f088015ab30 0x7f088006d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 -- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800701c0 msgr2=0x7f08801efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800701c0 0x7f08801efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.512+0000 7f0884b4f640 1 -- 172.21.15.90:0/3963372341 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08801f0470 con 0x7f088014cc20 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.513+0000 7f0884b4f640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f088014cc20 0x7f088006da00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f087800c780 tx=0x7f087800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.513+0000 7f087cff9640 1 -- 172.21.15.90:0/3963372341 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0878018070 con 0x7f088014cc20 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.513+0000 7f087cff9640 1 -- 172.21.15.90:0/3963372341 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f087800a640 con 0x7f088014cc20 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.513+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08801f0750 con 0x7f088014cc20 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.513+0000 7f087cff9640 1 -- 172.21.15.90:0/3963372341 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087800aa70 con 0x7f088014cc20 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.513+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08801f0170 con 0x7f088014cc20 2024-04-20T10:58:56.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.514+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0880076150 con 0x7f088014cc20 2024-04-20T10:58:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.514+0000 7f087cff9640 1 -- 172.21.15.90:0/3963372341 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f087801b070 con 0x7f088014cc20 2024-04-20T10:58:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.515+0000 7f087cff9640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.515+0000 7f087cff9640 1 -- 172.21.15.90:0/3963372341 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f087808b750 con 0x7f088014cc20 2024-04-20T10:58:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.515+0000 7f087ffff640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:56.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.515+0000 7f087ffff640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0868036000 tx=0x7f0868008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:56.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.522+0000 7f087cff9640 1 -- 172.21.15.90:0/3963372341 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0878059560 con 0x7f088014cc20 2024-04-20T10:58:56.740 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.739+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0880072ee0 con 0x7f088014cc20 2024-04-20T10:58:56.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.739+0000 7f087cff9640 1 -- 172.21.15.90:0/3963372341 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f0878058e60 con 0x7f088014cc20 2024-04-20T10:58:56.741 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:58:56.741 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:58:56.741 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 msgr2=0x7f086006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0868036000 tx=0x7f0868008030 comp rx=0 tx=0).stop 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f088014cc20 msgr2=0x7f088006da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f088014cc20 0x7f088006da00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f087800c780 tx=0x7f087800cc40 comp rx=0 tx=0).stop 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 shutdown_connections 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f086006c8f0 0x7f086006edb0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f088014cc20 0x7f088006da00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f088015ab30 0x7f088006d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.741+0000 7f08865b2640 1 --2- 172.21.15.90:0/3963372341 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f08800701c0 0x7f08801efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.742+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 >> 172.21.15.90:0/3963372341 conn(0x7f08800676c0 msgr2=0x7f0880067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:56.743 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.742+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 shutdown_connections 2024-04-20T10:58:56.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:56.742+0000 7f08865b2640 1 -- 172.21.15.90:0/3963372341 wait complete. 2024-04-20T10:58:56.754 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:58:58.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:58:58.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.866+0000 7fbeb308c640 1 Processor -- start 2024-04-20T10:58:58.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.866+0000 7fbeb308c640 1 -- start start 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeb308c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac157710 0x7fbeac154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeb308c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbeac0ad0c0 0x7fbeac0ad540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeb308c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeac0c4370 con 0x7fbeac073810 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeb308c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbeac1569e0 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeb308c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac157280 con 0x7fbeac157710 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeabfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac157710 0x7fbeac154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeabfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac157710 0x7fbeac154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:38068/0 (socket says 172.21.15.90:38068) 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeabfff640 1 -- 172.21.15.90:0/2788073846 learned_addr learned my addr 172.21.15.90:0/2788073846 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.867+0000 7fbeb1629640 1 --2- 172.21.15.90:0/2788073846 >> v2:172.21.15.175:3300/0 conn(0x7fbeac0ad0c0 0x7fbeac0ad540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.868+0000 7fbeabfff640 1 -- 172.21.15.90:0/2788073846 >> v2:172.21.15.175:3300/0 conn(0x7fbeac0ad0c0 msgr2=0x7fbeac0ad540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:58:58.869 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.868+0000 7fbeabfff640 1 --2- 172.21.15.90:0/2788073846 >> v2:172.21.15.175:3300/0 conn(0x7fbeac0ad0c0 0x7fbeac0ad540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:58.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.868+0000 7fbeabfff640 1 -- 172.21.15.90:0/2788073846 >> v1:172.21.15.175:6789/0 conn(0x7fbeac073810 legacy=0x7fbeac0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:58.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.868+0000 7fbeab7fe640 1 -- 172.21.15.90:0/2788073846 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195543277 0 0) 0x7fbeac0c4370 con 0x7fbeac073810 2024-04-20T10:58:58.870 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.868+0000 7fbeabfff640 1 -- 172.21.15.90:0/2788073846 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac156c30 con 0x7fbeac157710 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeabfff640 1 --2- 172.21.15.90:0/2788073846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac157710 0x7fbeac154000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009870 tx=0x7fbea002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0b7ff5c1cde96a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeab7fe640 1 -- 172.21.15.90:0/2788073846 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0035020 con 0x7fbeac157710 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeab7fe640 1 -- 172.21.15.90:0/2788073846 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea0031640 con 0x7fbeac157710 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeab7fe640 1 -- 172.21.15.90:0/2788073846 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea002d040 con 0x7fbeac157710 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 -- 172.21.15.90:0/2788073846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac157710 msgr2=0x7fbeac154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 --2- 172.21.15.90:0/2788073846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac157710 0x7fbeac154000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009870 tx=0x7fbea002b8f0 comp rx=0 tx=0).stop 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 -- 172.21.15.90:0/2788073846 shutdown_connections 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 --2- 172.21.15.90:0/2788073846 >> v2:172.21.15.175:3300/0 conn(0x7fbeac0ad0c0 0x7fbeac0ad540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:58.871 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 --2- 172.21.15.90:0/2788073846 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac157710 0x7fbeac154000 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:58.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 -- 172.21.15.90:0/2788073846 >> 172.21.15.90:0/2788073846 conn(0x7fbeac0c8080 msgr2=0x7fbeac0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:58.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 -- 172.21.15.90:0/2788073846 shutdown_connections 2024-04-20T10:58:58.872 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.869+0000 7fbeb308c640 1 -- 172.21.15.90:0/2788073846 wait complete. 2024-04-20T10:58:58.873 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 Processor -- start 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 -- start start 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac073810 0x7fbeac0bd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbeac0ad0c0 0x7fbeac0bd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbeac157710 0x7fbeac14e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac0abbb0 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac073bf0 con 0x7fbeac157710 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.871+0000 7fbeb308c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac0abd30 con 0x7fbeac073810 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbeac0ad0c0 0x7fbeac0bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbeac0ad0c0 0x7fbeac0bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58718/0 (socket says 172.21.15.90:58718) 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 -- 172.21.15.90:0/1170862881 learned_addr learned my addr 172.21.15.90:0/1170862881 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeb0e28640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac073810 0x7fbeac0bd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeb1629640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbeac157710 0x7fbeac14e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:58.874 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 -- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac073810 msgr2=0x7fbeac0bd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac073810 0x7fbeac0bd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 -- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbeac157710 msgr2=0x7fbeac14e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbeac157710 0x7fbeac14e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 -- 172.21.15.90:0/1170862881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac1ea8c0 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeabfff640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbeac0ad0c0 0x7fbeac0bd850 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbea0000c00 tx=0x7fbea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbea97fa640 1 -- 172.21.15.90:0/1170862881 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0040070 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbea97fa640 1 -- 172.21.15.90:0/1170862881 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea00399f0 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbea97fa640 1 -- 172.21.15.90:0/1170862881 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea0035040 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac1eab60 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.875 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.872+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac0beae0 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.874+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeac076150 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.874+0000 7fbea97fa640 1 -- 172.21.15.90:0/1170862881 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbea004b060 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.874+0000 7fbea97fa640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe9806c8f0 0x7fbe9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:58:58.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.875+0000 7fbeb0e28640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe9806c8f0 0x7fbe9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:58:58.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.875+0000 7fbea97fa640 1 -- 172.21.15.90:0/1170862881 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7fbea00ad820 con 0x7fbeac0ad0c0 2024-04-20T10:58:58.876 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.875+0000 7fbeb0e28640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe9806c8f0 0x7fbe9806edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c000f60 tx=0x7fbe9c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:58:58.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:58.879+0000 7fbea97fa640 1 -- 172.21.15.90:0/1170862881 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbea007afe0 con 0x7fbeac0ad0c0 2024-04-20T10:58:59.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.104+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbeac0c8c40 con 0x7fbeac0ad0c0 2024-04-20T10:58:59.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.104+0000 7fbea97fa640 1 -- 172.21.15.90:0/1170862881 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7fbea007f2e0 con 0x7fbeac0ad0c0 2024-04-20T10:58:59.106 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:58:59.106 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:58:59.106 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:58:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe9806c8f0 msgr2=0x7fbe9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe9806c8f0 0x7fbe9806edb0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c000f60 tx=0x7fbe9c009040 comp rx=0 tx=0).stop 2024-04-20T10:58:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbeac0ad0c0 msgr2=0x7fbeac0bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:58:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbeac0ad0c0 0x7fbeac0bd850 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fbea0000c00 tx=0x7fbea00046c0 comp rx=0 tx=0).stop 2024-04-20T10:58:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 shutdown_connections 2024-04-20T10:58:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbe9806c8f0 0x7fbe9806edb0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:59.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbeac157710 0x7fbeac14e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:59.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbeac0ad0c0 0x7fbeac0bd850 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:59.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 --2- 172.21.15.90:0/1170862881 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbeac073810 0x7fbeac0bd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:58:59.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 >> 172.21.15.90:0/1170862881 conn(0x7fbeac0c8080 msgr2=0x7fbeac153250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:58:59.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 shutdown_connections 2024-04-20T10:58:59.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:58:59.107+0000 7fbeb308c640 1 -- 172.21.15.90:0/1170862881 wait complete. 2024-04-20T10:58:59.118 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:59:01.119 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:01.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.222+0000 7f9b37c43640 1 Processor -- start 2024-04-20T10:59:01.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.222+0000 7f9b37c43640 1 -- start start 2024-04-20T10:59:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b37c43640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30067b60 0x7f9b301548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b37c43640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b300c8320 0x7f9b30154de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b37c43640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b300c38c0 con 0x7f9b30154160 2024-04-20T10:59:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b37c43640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9b300c7a40 con 0x7f9b300c8320 2024-04-20T10:59:01.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b37c43640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9b300c34c0 con 0x7f9b30067b60 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b361e0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b300c8320 0x7f9b30154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b361e0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9b300c8320 0x7f9b30154de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58730/0 (socket says 172.21.15.90:58730) 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b361e0640 1 -- 172.21.15.90:0/2238318075 learned_addr learned my addr 172.21.15.90:0/2238318075 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b351de640 1 --2- 172.21.15.90:0/2238318075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30067b60 0x7f9b301548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b361e0640 1 -- 172.21.15.90:0/2238318075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30067b60 msgr2=0x7f9b301548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b361e0640 1 --2- 172.21.15.90:0/2238318075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30067b60 0x7f9b301548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b361e0640 1 -- 172.21.15.90:0/2238318075 >> v1:172.21.15.175:6789/0 conn(0x7f9b30154160 legacy=0x7f9b3006b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b361e0640 1 -- 172.21.15.90:0/2238318075 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3006c040 con 0x7f9b300c8320 2024-04-20T10:59:01.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.223+0000 7f9b351de640 1 --2- 172.21.15.90:0/2238318075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30067b60 0x7f9b301548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:01.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.224+0000 7f9b361e0640 1 --2- 172.21.15.90:0/2238318075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b300c8320 0x7f9b30154de0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009e50 tx=0x7f9b2802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a893f7c47291a4d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:01.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.224+0000 7f9b349dd640 1 -- 172.21.15.90:0/2238318075 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2802cb00 con 0x7f9b300c8320 2024-04-20T10:59:01.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.224+0000 7f9b349dd640 1 -- 172.21.15.90:0/2238318075 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b2802cca0 con 0x7f9b300c8320 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.224+0000 7f9b349dd640 1 -- 172.21.15.90:0/2238318075 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28034610 con 0x7f9b300c8320 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 -- 172.21.15.90:0/2238318075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b300c8320 msgr2=0x7f9b30154de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 --2- 172.21.15.90:0/2238318075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b300c8320 0x7f9b30154de0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f9b28009e50 tx=0x7f9b2802bf60 comp rx=0 tx=0).stop 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 -- 172.21.15.90:0/2238318075 shutdown_connections 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 --2- 172.21.15.90:0/2238318075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b300c8320 0x7f9b30154de0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 --2- 172.21.15.90:0/2238318075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30067b60 0x7f9b301548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 -- 172.21.15.90:0/2238318075 >> 172.21.15.90:0/2238318075 conn(0x7f9b300aa580 msgr2=0x7f9b300aa990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 -- 172.21.15.90:0/2238318075 shutdown_connections 2024-04-20T10:59:01.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.225+0000 7f9b37c43640 1 -- 172.21.15.90:0/2238318075 wait complete. 2024-04-20T10:59:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.226+0000 7f9b37c43640 1 Processor -- start 2024-04-20T10:59:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.226+0000 7f9b37c43640 1 -- start start 2024-04-20T10:59:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b300c8320 0x7f9b30150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b30154160 0x7f9b301ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30152950 0x7f9b30152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9b301554a0 con 0x7f9b30154160 2024-04-20T10:59:01.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30155320 con 0x7f9b300c8320 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3015ee90 con 0x7f9b30152950 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b30154160 0x7f9b301ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b30154160 0x7f9b301ea8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58746/0 (socket says 172.21.15.90:58746) 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 -- 172.21.15.90:0/3558094879 learned_addr learned my addr 172.21.15.90:0/3558094879 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b361e0640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30152950 0x7f9b30152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b359df640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b300c8320 0x7f9b30150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 -- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30152950 msgr2=0x7f9b30152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30152950 0x7f9b30152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 -- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b300c8320 msgr2=0x7f9b30150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b300c8320 0x7f9b30150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 -- 172.21.15.90:0/3558094879 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b301514c0 con 0x7f9b30154160 2024-04-20T10:59:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b351de640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b30154160 0x7f9b301ea8e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000d800 tx=0x7f9b2000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b267fc640 1 -- 172.21.15.90:0/3558094879 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b20004030 con 0x7f9b30154160 2024-04-20T10:59:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b267fc640 1 -- 172.21.15.90:0/3558094879 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b200041d0 con 0x7f9b30154160 2024-04-20T10:59:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b30150540 con 0x7f9b30154160 2024-04-20T10:59:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b267fc640 1 -- 172.21.15.90:0/3558094879 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000b6c0 con 0x7f9b30154160 2024-04-20T10:59:01.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.227+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b30158770 con 0x7f9b30154160 2024-04-20T10:59:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.229+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b30158970 con 0x7f9b30154160 2024-04-20T10:59:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.229+0000 7f9b267fc640 1 -- 172.21.15.90:0/3558094879 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9b2000b860 con 0x7f9b30154160 2024-04-20T10:59:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.229+0000 7f9b267fc640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b1406c8f0 0x7f9b1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.229+0000 7f9b267fc640 1 -- 172.21.15.90:0/3558094879 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f9b2008c270 con 0x7f9b30154160 2024-04-20T10:59:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.229+0000 7f9b359df640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b1406c8f0 0x7f9b1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:01.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.230+0000 7f9b359df640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b1406c8f0 0x7f9b1406edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0016e0 tx=0x7f9b2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:01.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.234+0000 7f9b267fc640 1 -- 172.21.15.90:0/3558094879 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9b30158970 con 0x7f9b30154160 2024-04-20T10:59:01.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.493+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b30076150 con 0x7f9b30154160 2024-04-20T10:59:01.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.493+0000 7f9b267fc640 1 -- 172.21.15.90:0/3558094879 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f9b20059a30 con 0x7f9b30154160 2024-04-20T10:59:01.495 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:01.495 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:01.495 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b1406c8f0 msgr2=0x7f9b1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b1406c8f0 0x7f9b1406edb0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c0016e0 tx=0x7f9b2c009040 comp rx=0 tx=0).stop 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b30154160 msgr2=0x7f9b301ea8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b30154160 0x7f9b301ea8e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000d800 tx=0x7f9b2000dcc0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 shutdown_connections 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9b1406c8f0 0x7f9b1406edb0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9b30152950 0x7f9b30152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9b30154160 0x7f9b301ea8e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 --2- 172.21.15.90:0/3558094879 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9b300c8320 0x7f9b30150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:01.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.497+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 >> 172.21.15.90:0/3558094879 conn(0x7f9b300aa580 msgr2=0x7f9b300c6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:01.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.498+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 shutdown_connections 2024-04-20T10:59:01.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:01.498+0000 7f9b37c43640 1 -- 172.21.15.90:0/3558094879 wait complete. 2024-04-20T10:59:01.510 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:59:03.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:03.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.626+0000 7f574bfbd640 1 Processor -- start 2024-04-20T10:59:03.626 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.626+0000 7f574bfbd640 1 -- start start 2024-04-20T10:59:03.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574bfbd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f57440701c0 0x7f5744073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:03.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574bfbd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5744156f20 0x7f5744153630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:03.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574bfbd640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f57440c6870 con 0x7f574415ab30 2024-04-20T10:59:03.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574bfbd640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f57440ab630 con 0x7f5744156f20 2024-04-20T10:59:03.629 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574bfbd640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5744159e00 con 0x7f57440701c0 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574a55a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5744156f20 0x7f5744153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f5749558640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f574415ab30 0x7f5744156810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48596/0 (socket says 172.21.15.90:48596) 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f5749558640 1 -- 172.21.15.90:0/287994378 learned_addr learned my addr 172.21.15.90:0/287994378 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f5749d59640 1 --2- 172.21.15.90:0/287994378 >> v2:172.21.15.175:3300/0 conn(0x7f57440701c0 0x7f5744073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574a55a640 1 -- 172.21.15.90:0/287994378 >> v2:172.21.15.175:3300/0 conn(0x7f57440701c0 msgr2=0x7f5744073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574a55a640 1 --2- 172.21.15.90:0/287994378 >> v2:172.21.15.175:3300/0 conn(0x7f57440701c0 0x7f5744073100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574a55a640 1 -- 172.21.15.90:0/287994378 >> v1:172.21.15.90:6789/0 conn(0x7f574415ab30 legacy=0x7f5744156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.627+0000 7f574a55a640 1 -- 172.21.15.90:0/287994378 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f574415a050 con 0x7f5744156f20 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.628+0000 7f574a55a640 1 --2- 172.21.15.90:0/287994378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5744156f20 0x7f5744153630 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f57440c55f0 tx=0x7f573c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206439802665c386 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:03.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.628+0000 7f5748d57640 1 -- 172.21.15.90:0/287994378 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c039070 con 0x7f5744156f20 2024-04-20T10:59:03.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.628+0000 7f5748d57640 1 -- 172.21.15.90:0/287994378 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f573c02cbf0 con 0x7f5744156f20 2024-04-20T10:59:03.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.628+0000 7f5748d57640 1 -- 172.21.15.90:0/287994378 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f573c034440 con 0x7f5744156f20 2024-04-20T10:59:03.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 -- 172.21.15.90:0/287994378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5744156f20 msgr2=0x7f5744153630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:03.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 --2- 172.21.15.90:0/287994378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5744156f20 0x7f5744153630 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f57440c55f0 tx=0x7f573c02be40 comp rx=0 tx=0).stop 2024-04-20T10:59:03.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 -- 172.21.15.90:0/287994378 shutdown_connections 2024-04-20T10:59:03.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 --2- 172.21.15.90:0/287994378 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5744156f20 0x7f5744153630 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 --2- 172.21.15.90:0/287994378 >> v2:172.21.15.175:3300/0 conn(0x7f57440701c0 0x7f5744073100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 -- 172.21.15.90:0/287994378 >> 172.21.15.90:0/287994378 conn(0x7f57440676c0 msgr2=0x7f5744067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:03.636 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 -- 172.21.15.90:0/287994378 shutdown_connections 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.629+0000 7f574bfbd640 1 -- 172.21.15.90:0/287994378 wait complete. 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 Processor -- start 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 -- start start 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57440701c0 0x7f574406eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f574415ab30 0x7f574414fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f574406d960 0x7f574414ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f57440705a0 con 0x7f574415ab30 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f574415a610 con 0x7f57440701c0 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.630+0000 7f574bfbd640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f57440c6470 con 0x7f574406d960 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f574415ab30 0x7f574414fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:03.637 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f574415ab30 0x7f574414fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:58776/0 (socket says 172.21.15.90:58776) 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 -- 172.21.15.90:0/2197826835 learned_addr learned my addr 172.21.15.90:0/2197826835 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f574a55a640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f574406d960 0x7f574414ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749d59640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57440701c0 0x7f574406eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 -- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f574406d960 msgr2=0x7f574414ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f574406d960 0x7f574414ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 -- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57440701c0 msgr2=0x7f574406eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57440701c0 0x7f574406eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 -- 172.21.15.90:0/2197826835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5744158ae0 con 0x7f574415ab30 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f574a55a640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f574406d960 0x7f574414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749d59640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57440701c0 0x7f574406eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f5749558640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f574415ab30 0x7f574414fd90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f573400c470 tx=0x7f573400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:03.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f573a7fc640 1 -- 172.21.15.90:0/2197826835 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5734017070 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f573a7fc640 1 -- 172.21.15.90:0/2197826835 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5734005ce0 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f574414fab0 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f573a7fc640 1 -- 172.21.15.90:0/2197826835 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57340072d0 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.631+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5744157750 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.632+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5744076150 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.633+0000 7f573a7fc640 1 -- 172.21.15.90:0/2197826835 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f573401a070 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.633+0000 7f573a7fc640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f572806c8f0 0x7f572806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.633+0000 7f573a7fc640 1 -- 172.21.15.90:0/2197826835 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f573408b3a0 con 0x7f574415ab30 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.633+0000 7f5749d59640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f572806c8f0 0x7f572806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:03.639 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.634+0000 7f5749d59640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f572806c8f0 0x7f572806edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5740006fd0 tx=0x7f5740008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:03.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.638+0000 7f573a7fc640 1 -- 172.21.15.90:0/2197826835 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5734058ad0 con 0x7f574415ab30 2024-04-20T10:59:03.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.912+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5744072ee0 con 0x7f574415ab30 2024-04-20T10:59:03.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.913+0000 7f573a7fc640 1 -- 172.21.15.90:0/2197826835 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f573405cdd0 con 0x7f574415ab30 2024-04-20T10:59:03.913 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:03.913 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:03.913 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.915+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f572806c8f0 msgr2=0x7f572806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.915+0000 7f574bfbd640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f572806c8f0 0x7f572806edb0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f5740006fd0 tx=0x7f5740008040 comp rx=0 tx=0).stop 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.915+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f574415ab30 msgr2=0x7f574414fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.915+0000 7f574bfbd640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f574415ab30 0x7f574414fd90 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f573400c470 tx=0x7f573400c930 comp rx=0 tx=0).stop 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.915+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 shutdown_connections 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.915+0000 7f574bfbd640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f572806c8f0 0x7f572806edb0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.916+0000 7f574bfbd640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f574406d960 0x7f574414ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.916+0000 7f574bfbd640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f574415ab30 0x7f574414fd90 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.916+0000 7f574bfbd640 1 --2- 172.21.15.90:0/2197826835 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f57440701c0 0x7f574406eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:03.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.916+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 >> 172.21.15.90:0/2197826835 conn(0x7f57440676c0 msgr2=0x7f57440ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:03.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.916+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 shutdown_connections 2024-04-20T10:59:03.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:03.916+0000 7f574bfbd640 1 -- 172.21.15.90:0/2197826835 wait complete. 2024-04-20T10:59:03.927 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:59:05.928 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:06.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.035+0000 7f66f6b2c640 1 Processor -- start 2024-04-20T10:59:06.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.035+0000 7f66f6b2c640 1 -- start start 2024-04-20T10:59:06.037 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f6b2c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f66f0153ef0 0x7f66f00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f6b2c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66f00c9ee0 0x7f66f0156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f6b2c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66f015a720 con 0x7f66f00ab730 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f6b2c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f66f015ac80 con 0x7f66f00c9ee0 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f6b2c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f66f015a9a0 con 0x7f66f0153ef0 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f50c9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66f00c9ee0 0x7f66f0156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f50c9640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f66f00c9ee0 0x7f66f0156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43992/0 (socket says 172.21.15.90:43992) 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.036+0000 7f66f50c9640 1 -- 172.21.15.90:0/2335310984 learned_addr learned my addr 172.21.15.90:0/2335310984 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.037+0000 7f66f48c8640 1 --2- 172.21.15.90:0/2335310984 >> v2:172.21.15.175:3300/0 conn(0x7f66f0153ef0 0x7f66f00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.037+0000 7f66f50c9640 1 -- 172.21.15.90:0/2335310984 >> v2:172.21.15.175:3300/0 conn(0x7f66f0153ef0 msgr2=0x7f66f00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.037+0000 7f66f50c9640 1 --2- 172.21.15.90:0/2335310984 >> v2:172.21.15.175:3300/0 conn(0x7f66f0153ef0 0x7f66f00c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.037+0000 7f66f50c9640 1 -- 172.21.15.90:0/2335310984 >> v1:172.21.15.175:6789/0 conn(0x7f66f00ab730 legacy=0x7f66f01568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.037+0000 7f66f50c9640 1 -- 172.21.15.90:0/2335310984 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f00c6a90 con 0x7f66f00c9ee0 2024-04-20T10:59:06.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.037+0000 7f66f50c9640 1 --2- 172.21.15.90:0/2335310984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00c9ee0 0x7f66f0156fd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f66f00aec60 tx=0x7f66e802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=509596dbd77188da server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:06.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66ef7fe640 1 -- 172.21.15.90:0/2335310984 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e802c9f0 con 0x7f66f00c9ee0 2024-04-20T10:59:06.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66ef7fe640 1 -- 172.21.15.90:0/2335310984 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e802cb90 con 0x7f66f00c9ee0 2024-04-20T10:59:06.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66ef7fe640 1 -- 172.21.15.90:0/2335310984 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e80343f0 con 0x7f66f00c9ee0 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2335310984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00c9ee0 msgr2=0x7f66f0156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2335310984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00c9ee0 0x7f66f0156fd0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f66f00aec60 tx=0x7f66e802be50 comp rx=0 tx=0).stop 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2335310984 shutdown_connections 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2335310984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00c9ee0 0x7f66f0156fd0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2335310984 >> v2:172.21.15.175:3300/0 conn(0x7f66f0153ef0 0x7f66f00c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2335310984 >> 172.21.15.90:0/2335310984 conn(0x7f66f00cbfe0 msgr2=0x7f66f00cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2335310984 shutdown_connections 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.038+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2335310984 wait complete. 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.039+0000 7f66f6b2c640 1 Processor -- start 2024-04-20T10:59:06.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.039+0000 7f66f6b2c640 1 -- start start 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f6b2c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00ab730 0x7f66f0150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f6b2c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66f00c9ee0 0x7f66f01ef660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f6b2c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66f0153ef0 0x7f66f01efba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f6b2c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f66f00bf800 con 0x7f66f00ab730 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f6b2c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f66f0157510 con 0x7f66f00c9ee0 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f6b2c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f66f01f05a0 con 0x7f66f0153ef0 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f48c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00ab730 0x7f66f0150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f48c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00ab730 0x7f66f0150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:43998/0 (socket says 172.21.15.90:43998) 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.040+0000 7f66f48c8640 1 -- 172.21.15.90:0/2532444890 learned_addr learned my addr 172.21.15.90:0/2532444890 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66effff640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66f00c9ee0 0x7f66f01ef660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f50c9640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66f0153ef0 0x7f66f01efba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f48c8640 1 -- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66f0153ef0 msgr2=0x7f66f01efba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f48c8640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66f0153ef0 0x7f66f01efba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f48c8640 1 -- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66f00c9ee0 msgr2=0x7f66f01ef660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f48c8640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66f00c9ee0 0x7f66f01ef660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f48c8640 1 -- 172.21.15.90:0/2532444890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f01ef420 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66effff640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66f00c9ee0 0x7f66f01ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f48c8640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00ab730 0x7f66f0150770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d5d0 tx=0x7f66e000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66ed7fa640 1 -- 172.21.15.90:0/2532444890 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e00125f0 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66ed7fa640 1 -- 172.21.15.90:0/2532444890 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66e0019070 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66ed7fa640 1 -- 172.21.15.90:0/2532444890 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66e00129f0 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66f01f02c0 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.041+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66f01e3bb0 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.042+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66f0076150 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.042+0000 7f66ed7fa640 1 -- 172.21.15.90:0/2532444890 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66e0012b90 con 0x7f66f00ab730 2024-04-20T10:59:06.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.043+0000 7f66ed7fa640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66dc06c8f0 0x7f66dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.043+0000 7f66ed7fa640 1 -- 172.21.15.90:0/2532444890 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f66e008c5c0 con 0x7f66f00ab730 2024-04-20T10:59:06.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.043+0000 7f66effff640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66dc06c8f0 0x7f66dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.045 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.043+0000 7f66effff640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66dc06c8f0 0x7f66dc06edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66f00cc6b0 tx=0x7f66e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:06.047 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.047+0000 7f66ed7fa640 1 -- 172.21.15.90:0/2532444890 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f66e005a3d0 con 0x7f66f00ab730 2024-04-20T10:59:06.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.321+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66f00b1f20 con 0x7f66f00ab730 2024-04-20T10:59:06.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.322+0000 7f66ed7fa640 1 -- 172.21.15.90:0/2532444890 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f66e0059cd0 con 0x7f66f00ab730 2024-04-20T10:59:06.322 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:06.323 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:06.323 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66dc06c8f0 msgr2=0x7f66dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66dc06c8f0 0x7f66dc06edb0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f66f00cc6b0 tx=0x7f66e4009040 comp rx=0 tx=0).stop 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00ab730 msgr2=0x7f66f0150770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00ab730 0x7f66f0150770 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f66e000d5d0 tx=0x7f66e000da90 comp rx=0 tx=0).stop 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 shutdown_connections 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f66dc06c8f0 0x7f66dc06edb0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f66f0153ef0 0x7f66f01efba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f66f00c9ee0 0x7f66f01ef660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 --2- 172.21.15.90:0/2532444890 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f66f00ab730 0x7f66f0150770 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 >> 172.21.15.90:0/2532444890 conn(0x7f66f00cbfe0 msgr2=0x7f66f00acf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 shutdown_connections 2024-04-20T10:59:06.325 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.324+0000 7f66f6b2c640 1 -- 172.21.15.90:0/2532444890 wait complete. 2024-04-20T10:59:06.335 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:59:06.840 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:06.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.937+0000 7fbca24e0640 1 Processor -- start 2024-04-20T10:59:06.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.938+0000 7fbca24e0640 1 -- start start 2024-04-20T10:59:06.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.938+0000 7fbca24e0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbc9c153ef0 0x7fbc9c0c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.938+0000 7fbca24e0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc9c15a720 con 0x7fbc9c0c9ee0 2024-04-20T10:59:06.942 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.938+0000 7fbca24e0640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc9c15ac80 con 0x7fbc9c0ab730 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.938+0000 7fbca24e0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbc9c15a9a0 con 0x7fbc9c153ef0 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.938+0000 7fbca0a7d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbc9c0c9ee0 0x7fbc9c156fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51274/0 (socket says 172.21.15.90:51274) 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.938+0000 7fbca0a7d640 1 -- 172.21.15.90:0/2241792308 learned_addr learned my addr 172.21.15.90:0/2241792308 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786029588 0 0) 0x7fbc94001490 con 0x7fbc9c0c9ee0 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc84003520 con 0x7fbc9c0c9ee0 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9bfff640 1 --2- 172.21.15.90:0/2241792308 >> v2:172.21.15.175:3300/0 conn(0x7fbc9c153ef0 0x7fbc9c0c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1420572156 0 0) 0x7fbc84003520 con 0x7fbc9c0c9ee0 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 >> v2:172.21.15.175:3300/0 conn(0x7fbc9c153ef0 msgr2=0x7fbc9c0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 --2- 172.21.15.90:0/2241792308 >> v2:172.21.15.175:3300/0 conn(0x7fbc9c153ef0 0x7fbc9c0c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 >> v1:172.21.15.175:6789/0 conn(0x7fbc9c0ab730 legacy=0x7fbc9c1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9c0c6a90 con 0x7fbc9c0c9ee0 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fbc94001bc0 con 0x7fbc9c0c9ee0 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 >> v1:172.21.15.90:6789/0 conn(0x7fbc9c0c9ee0 legacy=0x7fbc9c156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.943 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840039b0 0x7fbc84003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc84004800 0x7fbc84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc840052e0 0x7fbc8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c15a9a0 con 0x7fbc840052e0 2024-04-20T10:59:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc8400c230 con 0x7fbc840039b0 2024-04-20T10:59:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbc8400c430 con 0x7fbc84004800 2024-04-20T10:59:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbca0a7d640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc840052e0 0x7fbc8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.944 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9bfff640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840039b0 0x7fbc84003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbc9b7fe640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc84004800 0x7fbc84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbca0a7d640 1 -- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc84004800 msgr2=0x7fbc84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbca0a7d640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc84004800 0x7fbc84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbca0a7d640 1 -- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840039b0 msgr2=0x7fbc84003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbca0a7d640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840039b0 0x7fbc84003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.939+0000 7fbca0a7d640 1 -- 172.21.15.90:0/2241792308 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc84003520 con 0x7fbc840052e0 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.940+0000 7fbca0a7d640 1 -- 172.21.15.90:0/2241792308 reap_dead start 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.940+0000 7fbca0a7d640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc840052e0 0x7fbc8400b9c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400aa00 tx=0x7fbc84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeb49551e89ee019 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.940+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400a650 con 0x7fbc840052e0 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.940+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc94030070 con 0x7fbc840052e0 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.940+0000 7fbc9affd640 1 -- 172.21.15.90:0/2241792308 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc94034850 con 0x7fbc840052e0 2024-04-20T10:59:06.945 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.941+0000 7fbca24e0640 1 -- 172.21.15.90:0/2241792308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc840052e0 msgr2=0x7fbc8400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.941+0000 7fbca24e0640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc840052e0 0x7fbc8400b9c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400aa00 tx=0x7fbc84005830 comp rx=0 tx=0).stop 2024-04-20T10:59:06.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.941+0000 7fbca24e0640 1 -- 172.21.15.90:0/2241792308 shutdown_connections 2024-04-20T10:59:06.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.941+0000 7fbca24e0640 1 --2- 172.21.15.90:0/2241792308 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc840052e0 0x7fbc8400b9c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.941+0000 7fbca24e0640 1 -- 172.21.15.90:0/2241792308 >> 172.21.15.90:0/2241792308 conn(0x7fbc9c0cbfe0 msgr2=0x7fbc9c0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:06.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.941+0000 7fbca24e0640 1 -- 172.21.15.90:0/2241792308 shutdown_connections 2024-04-20T10:59:06.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.941+0000 7fbca24e0640 1 -- 172.21.15.90:0/2241792308 wait complete. 2024-04-20T10:59:06.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.942+0000 7fbca24e0640 1 Processor -- start 2024-04-20T10:59:06.947 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.942+0000 7fbca24e0640 1 -- start start 2024-04-20T10:59:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca24e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840052e0 0x7fbc9c1ef710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca24e0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc9c1594e0 0x7fbc9c14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca24e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc9c151060 0x7fbc9c1504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca24e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c0bf800 con 0x7fbc9c151060 2024-04-20T10:59:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca24e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c0c89f0 con 0x7fbc840052e0 2024-04-20T10:59:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca24e0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9c0c5d10 con 0x7fbc9c1594e0 2024-04-20T10:59:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc9c151060 0x7fbc9c1504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc9c151060 0x7fbc9c1504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44010/0 (socket says 172.21.15.90:44010) 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 -- 172.21.15.90:0/3077633480 learned_addr learned my addr 172.21.15.90:0/3077633480 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbc9b7fe640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc9c1594e0 0x7fbc9c14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbc9bfff640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840052e0 0x7fbc9c1ef710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 -- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc9c1594e0 msgr2=0x7fbc9c14ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc9c1594e0 0x7fbc9c14ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 -- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840052e0 msgr2=0x7fbc9c1ef710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840052e0 0x7fbc9c1ef710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 -- 172.21.15.90:0/3077633480 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9c150e10 con 0x7fbc9c151060 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbc9b7fe640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc9c1594e0 0x7fbc9c14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbca0a7d640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc9c151060 0x7fbc9c1504b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400a130 tx=0x7fbc9c156750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.943+0000 7fbc98ff9640 1 -- 172.21.15.90:0/3077633480 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9400a650 con 0x7fbc9c151060 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.944+0000 7fbc98ff9640 1 -- 172.21.15.90:0/3077633480 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc94044070 con 0x7fbc9c151060 2024-04-20T10:59:06.951 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.944+0000 7fbc98ff9640 1 -- 172.21.15.90:0/3077633480 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc9403f470 con 0x7fbc9c151060 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.944+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9c150b30 con 0x7fbc9c151060 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.944+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9c1f0230 con 0x7fbc9c151060 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.945+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc9c076150 con 0x7fbc9c151060 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.945+0000 7fbc98ff9640 1 -- 172.21.15.90:0/3077633480 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbc9403d040 con 0x7fbc9c151060 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.945+0000 7fbc98ff9640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbc8806c920 0x7fbc8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.946+0000 7fbc9bfff640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbc8806c920 0x7fbc8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.946+0000 7fbc98ff9640 1 -- 172.21.15.90:0/3077633480 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7fbc940ae020 con 0x7fbc9c151060 2024-04-20T10:59:06.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.946+0000 7fbc9bfff640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbc8806c920 0x7fbc8806ede0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbc90006fd0 tx=0x7fbc90008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:06.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:06.950+0000 7fbc98ff9640 1 -- 172.21.15.90:0/3077633480 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbc9c15a720 con 0x7fbc9c151060 2024-04-20T10:59:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.160+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc9c0cbc40 con 0x7fbc9c151060 2024-04-20T10:59:07.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.160+0000 7fbc98ff9640 1 -- 172.21.15.90:0/3077633480 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7fbc9407bda0 con 0x7fbc9c151060 2024-04-20T10:59:07.160 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:07.161 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:07.161 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:59:07.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbc8806c920 msgr2=0x7fbc8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbc8806c920 0x7fbc8806ede0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fbc90006fd0 tx=0x7fbc90008040 comp rx=0 tx=0).stop 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc9c151060 msgr2=0x7fbc9c1504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc9c151060 0x7fbc9c1504b0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fbc9400a130 tx=0x7fbc9c156750 comp rx=0 tx=0).stop 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 shutdown_connections 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbc8806c920 0x7fbc8806ede0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbc9c151060 0x7fbc9c1504b0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbc9c1594e0 0x7fbc9c14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 --2- 172.21.15.90:0/3077633480 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbc840052e0 0x7fbc9c1ef710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 >> 172.21.15.90:0/3077633480 conn(0x7fbc9c0cbfe0 msgr2=0x7fbc9c1567c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 shutdown_connections 2024-04-20T10:59:07.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.162+0000 7fbca24e0640 1 -- 172.21.15.90:0/3077633480 wait complete. 2024-04-20T10:59:07.173 INFO:tasks.mds_thrash.fs.[b]:kill mds.a (rank=0) 2024-04-20T10:59:07.174 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-20T10:59:07.174 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T10:59:07.184 INFO:tasks.ceph.mds.a:Stopped 2024-04-20T10:59:07.185 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.322+0000 7fa5cfe70640 1 Processor -- start 2024-04-20T10:59:07.322 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.322+0000 7fa5cfe70640 1 -- start start 2024-04-20T10:59:07.326 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5cfe70640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 0x7fa5c80ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5cfe70640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c81551e0 con 0x7fa5c80c3b00 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5cfe70640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c80aedd0 con 0x7fa5c80adad0 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5cfe70640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c80ae5c0 con 0x7fa5c80ad3a0 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ce40d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa5c80c3b00 0x7fa5c81517a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51284/0 (socket says 172.21.15.90:51284) 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ce40d640 1 -- 172.21.15.90:0/3937462483 learned_addr learned my addr 172.21.15.90:0/3937462483 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5cd40b640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 0x7fa5c80ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552587176 0 0) 0x7fa5c81551e0 con 0x7fa5c80c3b00 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5b4003520 con 0x7fa5c80c3b00 2024-04-20T10:59:07.327 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756873472 0 0) 0x7fa5c80aedd0 con 0x7fa5c80adad0 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5c81551e0 con 0x7fa5c80adad0 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1624153270 0 0) 0x7fa5b4003520 con 0x7fa5c80c3b00 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 msgr2=0x7fa5c80ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 0x7fa5c80ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 >> v1:172.21.15.175:6789/0 conn(0x7fa5c80adad0 legacy=0x7fa5c80adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c80af0b0 con 0x7fa5c80c3b00 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fa5c0001970 con 0x7fa5c80c3b00 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 >> v1:172.21.15.90:6789/0 conn(0x7fa5c80c3b00 legacy=0x7fa5c81517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.323+0000 7fa5ccc0a640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b4003b70 0x7fa5b4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5ccc0a640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5ccc0a640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 0x7fa5b4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.328 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b400bb50 con 0x7fa5b4004800 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5b400bcd0 con 0x7fa5b4003b70 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5b400bea0 con 0x7fa5c80ad3a0 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cd40b640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cdc0c640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b4003b70 0x7fa5b4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5ce40d640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 0x7fa5b4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cd40b640 1 -- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 msgr2=0x7fa5b4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cd40b640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c80ad3a0 0x7fa5b4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cd40b640 1 -- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b4003b70 msgr2=0x7fa5b4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cd40b640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b4003b70 0x7fa5b4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cd40b640 1 -- 172.21.15.90:0/3937462483 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5b4003520 con 0x7fa5b4004800 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.324+0000 7fa5cdc0c640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5b4003b70 0x7fa5b4003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5cd40b640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5b4004c80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009af0 tx=0x7fa5b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05ab761461256b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8039070 con 0x7fa5b4004800 2024-04-20T10:59:07.329 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5b802c6b0 con 0x7fa5b4004800 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5ccc0a640 1 -- 172.21.15.90:0/3937462483 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b8009690 con 0x7fa5b4004800 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5cfe70640 1 -- 172.21.15.90:0/3937462483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 msgr2=0x7fa5b4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5cfe70640 1 --2- 172.21.15.90:0/3937462483 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5b4004c80 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8009af0 tx=0x7fa5b4005830 comp rx=0 tx=0).stop 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5ce40d640 1 -- 172.21.15.90:0/3937462483 reap_dead start 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5cfe70640 1 -- 172.21.15.90:0/3937462483 shutdown_connections 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5cfe70640 1 -- 172.21.15.90:0/3937462483 >> 172.21.15.90:0/3937462483 conn(0x7fa5c80c9100 msgr2=0x7fa5c80c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5cfe70640 1 -- 172.21.15.90:0/3937462483 shutdown_connections 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.325+0000 7fa5cfe70640 1 -- 172.21.15.90:0/3937462483 wait complete. 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.326+0000 7fa5cfe70640 1 Processor -- start 2024-04-20T10:59:07.330 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cfe70640 1 -- start start 2024-04-20T10:59:07.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cfe70640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5c81457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cfe70640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c81efe80 0x7fa5c8147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cfe70640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c81ebf00 0x7fa5c81ec3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cfe70640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c8151eb0 con 0x7fa5b4004800 2024-04-20T10:59:07.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cfe70640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c80aeb80 con 0x7fa5c81ebf00 2024-04-20T10:59:07.333 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cfe70640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c8152030 con 0x7fa5c81efe80 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5c81457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5c81457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44030/0 (socket says 172.21.15.90:44030) 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 -- 172.21.15.90:0/2213640484 learned_addr learned my addr 172.21.15.90:0/2213640484 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 -- 172.21.15.90:0/2213640484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c81efe80 msgr2=0x7fa5c8147180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c81efe80 0x7fa5c8147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 -- 172.21.15.90:0/2213640484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c81ebf00 msgr2=0x7fa5c81ec3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c81ebf00 0x7fa5c81ec3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.327+0000 7fa5cdc0c640 1 -- 172.21.15.90:0/2213640484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c81f0300 con 0x7fa5b4004800 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.328+0000 7fa5cdc0c640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5c81457d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400e780 tx=0x7fa5c400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.328+0000 7fa5be7fc640 1 -- 172.21.15.90:0/2213640484 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c40050d0 con 0x7fa5b4004800 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.328+0000 7fa5be7fc640 1 -- 172.21.15.90:0/2213640484 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5c4005270 con 0x7fa5b4004800 2024-04-20T10:59:07.334 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.328+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c806e7f0 con 0x7fa5b4004800 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.328+0000 7fa5be7fc640 1 -- 172.21.15.90:0/2213640484 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4005420 con 0x7fa5b4004800 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.328+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c806d580 con 0x7fa5b4004800 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.329+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c81504d0 con 0x7fa5b4004800 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.329+0000 7fa5be7fc640 1 -- 172.21.15.90:0/2213640484 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa5c401a020 con 0x7fa5b4004800 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.330+0000 7fa5be7fc640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa5ac06c920 0x7fa5ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.330+0000 7fa5cd40b640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa5ac06c920 0x7fa5ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.330+0000 7fa5be7fc640 1 -- 172.21.15.90:0/2213640484 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7fa5c408b8e0 con 0x7fa5b4004800 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.330+0000 7fa5cd40b640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa5ac06c920 0x7fa5ac06ede0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8036000 tx=0x7fa5b802e000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:07.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.334+0000 7fa5be7fc640 1 -- 172.21.15.90:0/2213640484 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa5c81504d0 con 0x7fa5b4004800 2024-04-20T10:59:07.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.546+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5c814fb30 con 0x7fa5b4004800 2024-04-20T10:59:07.547 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.546+0000 7fa5be7fc640 1 -- 172.21.15.90:0/2213640484 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7fa5c814fb30 con 0x7fa5b4004800 2024-04-20T10:59:07.548 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:07.548 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:07.549 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa5ac06c920 msgr2=0x7fa5ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa5ac06c920 0x7fa5ac06ede0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa5b8036000 tx=0x7fa5b802e000 comp rx=0 tx=0).stop 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 msgr2=0x7fa5c81457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5c81457d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400e780 tx=0x7fa5c400ec40 comp rx=0 tx=0).stop 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 shutdown_connections 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa5ac06c920 0x7fa5ac06ede0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa5c81ebf00 0x7fa5c81ec3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.550 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5c81efe80 0x7fa5c8147180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 --2- 172.21.15.90:0/2213640484 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5b4004800 0x7fa5c81457d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:07.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.548+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 >> 172.21.15.90:0/2213640484 conn(0x7fa5c80c9100 msgr2=0x7fa5c80ac8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:07.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.549+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 shutdown_connections 2024-04-20T10:59:07.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:07.549+0000 7fa5cfe70640 1 -- 172.21.15.90:0/2213640484 wait complete. 2024-04-20T10:59:07.560 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:59:08.336 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:08.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f133ea3a640 1 Processor -- start 2024-04-20T10:59:08.443 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f133ea3a640 1 -- start start 2024-04-20T10:59:08.445 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f133ea3a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1338153ef0 0x7f13380c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f133ea3a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f13380c9ee0 0x7f1338156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f133ea3a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f133815a720 con 0x7f13380ab730 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f133ea3a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f133815ac80 con 0x7f1338153ef0 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f133ea3a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f133815a9a0 con 0x7f13380c9ee0 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.443+0000 7f1337fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1338153ef0 0x7f13380c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.444+0000 7f1337fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f1338153ef0 0x7f13380c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44034/0 (socket says 172.21.15.90:44034) 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.444+0000 7f1337fff640 1 -- 172.21.15.90:0/3826318794 learned_addr learned my addr 172.21.15.90:0/3826318794 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.444+0000 7f1337fff640 1 -- 172.21.15.90:0/3826318794 >> v2:172.21.15.175:3300/0 conn(0x7f13380c9ee0 msgr2=0x7f1338156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.444+0000 7f1337fff640 1 --2- 172.21.15.90:0/3826318794 >> v2:172.21.15.175:3300/0 conn(0x7f13380c9ee0 0x7f1338156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.444+0000 7f1337fff640 1 -- 172.21.15.90:0/3826318794 >> v1:172.21.15.90:6789/0 conn(0x7f13380ab730 legacy=0x7f13381568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:08.446 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.444+0000 7f1337fff640 1 -- 172.21.15.90:0/3826318794 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13380c6a90 con 0x7f1338153ef0 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f1337fff640 1 --2- 172.21.15.90:0/3826318794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13380c89f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f13381578b0 tx=0x7f132802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18d712cc3cca6fbf server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f1336ffd640 1 -- 172.21.15.90:0/3826318794 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f132802e070 con 0x7f1338153ef0 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f1336ffd640 1 -- 172.21.15.90:0/3826318794 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1328037070 con 0x7f1338153ef0 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f1336ffd640 1 -- 172.21.15.90:0/3826318794 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1328031a00 con 0x7f1338153ef0 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 -- 172.21.15.90:0/3826318794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 msgr2=0x7f13380c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 --2- 172.21.15.90:0/3826318794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13380c89f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f13381578b0 tx=0x7f132802b880 comp rx=0 tx=0).stop 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 -- 172.21.15.90:0/3826318794 shutdown_connections 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 --2- 172.21.15.90:0/3826318794 >> v2:172.21.15.175:3300/0 conn(0x7f13380c9ee0 0x7f1338156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 --2- 172.21.15.90:0/3826318794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13380c89f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 -- 172.21.15.90:0/3826318794 >> 172.21.15.90:0/3826318794 conn(0x7f13380cbfe0 msgr2=0x7f13380cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:08.447 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 -- 172.21.15.90:0/3826318794 shutdown_connections 2024-04-20T10:59:08.448 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.445+0000 7f133ea3a640 1 -- 172.21.15.90:0/3826318794 wait complete. 2024-04-20T10:59:08.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.446+0000 7f133ea3a640 1 Processor -- start 2024-04-20T10:59:08.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133ea3a640 1 -- start start 2024-04-20T10:59:08.449 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133ea3a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13380ab730 0x7f13380c1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133ea3a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13380c9ee0 0x7f13380c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133ea3a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13381ec830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133ea3a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f13380bf800 con 0x7f1338153ef0 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133ea3a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1338157510 con 0x7f13380ab730 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133ea3a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f13380c16f0 con 0x7f13380c9ee0 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133cfd7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13381ec830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133cfd7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13381ec830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44044/0 (socket says 172.21.15.90:44044) 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.447+0000 7f133cfd7640 1 -- 172.21.15.90:0/250049555 learned_addr learned my addr 172.21.15.90:0/250049555 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f1337fff640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13380ab730 0x7f13380c1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f13377fe640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13380c9ee0 0x7f13380c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:08.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f133cfd7640 1 -- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13380c9ee0 msgr2=0x7f13380c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:08.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f133cfd7640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13380c9ee0 0x7f13380c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f133cfd7640 1 -- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13380ab730 msgr2=0x7f13380c1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:08.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f133cfd7640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13380ab730 0x7f13380c1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f133cfd7640 1 -- 172.21.15.90:0/250049555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13380c2410 con 0x7f1338153ef0 2024-04-20T10:59:08.451 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.448+0000 7f133cfd7640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13381ec830 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f133000b9a0 tx=0x7f133000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:08.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.450+0000 7f1334ff9640 1 -- 172.21.15.90:0/250049555 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330019070 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.450+0000 7f1334ff9640 1 -- 172.21.15.90:0/250049555 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f133000cbc0 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.450+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13381ed2b0 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.450+0000 7f1334ff9640 1 -- 172.21.15.90:0/250049555 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1330014440 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.450+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13380c41e0 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.451+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1338076150 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.451+0000 7f1334ff9640 1 -- 172.21.15.90:0/250049555 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f133001c070 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.452+0000 7f1334ff9640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f132406c920 0x7f132406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.452+0000 7f1334ff9640 1 -- 172.21.15.90:0/250049555 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f133008be70 con 0x7f1338153ef0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.452+0000 7f1337fff640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f132406c920 0x7f132406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:08.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.452+0000 7f1337fff640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f132406c920 0x7f132406ede0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1328036000 tx=0x7f132803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:08.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.456+0000 7f1334ff9640 1 -- 172.21.15.90:0/250049555 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f13300595a0 con 0x7f1338153ef0 2024-04-20T10:59:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.666+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f13380c2e70 con 0x7f1338153ef0 2024-04-20T10:59:08.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.666+0000 7f1334ff9640 1 -- 172.21.15.90:0/250049555 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f133005d8a0 con 0x7f1338153ef0 2024-04-20T10:59:08.667 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:08.667 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:08.667 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f132406c920 msgr2=0x7f132406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f132406c920 0x7f132406ede0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1328036000 tx=0x7f132803d040 comp rx=0 tx=0).stop 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 msgr2=0x7f13381ec830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13381ec830 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f133000b9a0 tx=0x7f133000be60 comp rx=0 tx=0).stop 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 shutdown_connections 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f132406c920 0x7f132406ede0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f1338153ef0 0x7f13381ec830 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f13380c9ee0 0x7f13380c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 --2- 172.21.15.90:0/250049555 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f13380ab730 0x7f13380c1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 >> 172.21.15.90:0/250049555 conn(0x7f13380cbfe0 msgr2=0x7f13380ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 shutdown_connections 2024-04-20T10:59:08.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:08.668+0000 7f133ea3a640 1 -- 172.21.15.90:0/250049555 wait complete. 2024-04-20T10:59:08.679 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is laggy/crashed, in failed state, or mds.b is removed from mdsmap 2024-04-20T10:59:09.561 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.670+0000 7f253a893640 1 Processor -- start 2024-04-20T10:59:09.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.670+0000 7f253a893640 1 -- start start 2024-04-20T10:59:09.671 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f253a893640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25340c4bb0 0x7f2534159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f253a893640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f253415a340 0x7f25341611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f253a893640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25340af590 con 0x7f2534154040 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f253a893640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f25340acb20 con 0x7f25340c4bb0 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f253a893640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f25340acd70 con 0x7f253415a340 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f25337fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25340c4bb0 0x7f2534159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f25337fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f25340c4bb0 0x7f2534159e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44056/0 (socket says 172.21.15.90:44056) 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f25337fe640 1 -- 172.21.15.90:0/1132454619 learned_addr learned my addr 172.21.15.90:0/1132454619 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f2538e30640 1 --2- 172.21.15.90:0/1132454619 >> v2:172.21.15.175:3300/0 conn(0x7f253415a340 0x7f25341611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f25337fe640 1 -- 172.21.15.90:0/1132454619 >> v2:172.21.15.175:3300/0 conn(0x7f253415a340 msgr2=0x7f25341611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f25337fe640 1 --2- 172.21.15.90:0/1132454619 >> v2:172.21.15.175:3300/0 conn(0x7f253415a340 0x7f25341611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f25337fe640 1 -- 172.21.15.90:0/1132454619 >> v1:172.21.15.175:6789/0 conn(0x7f2534154040 legacy=0x7f25340730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:09.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.671+0000 7f25337fe640 1 -- 172.21.15.90:0/1132454619 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25340c6400 con 0x7f25340c4bb0 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.672+0000 7f25337fe640 1 --2- 172.21.15.90:0/1132454619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25340c4bb0 0x7f2534159e00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f253406c3d0 tx=0x7f252402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40598c9d6cd844fc server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.672+0000 7f2532ffd640 1 -- 172.21.15.90:0/1132454619 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252402e070 con 0x7f25340c4bb0 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.672+0000 7f2532ffd640 1 -- 172.21.15.90:0/1132454619 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2524037070 con 0x7f25340c4bb0 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.672+0000 7f2532ffd640 1 -- 172.21.15.90:0/1132454619 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2524031a00 con 0x7f25340c4bb0 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 -- 172.21.15.90:0/1132454619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25340c4bb0 msgr2=0x7f2534159e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 --2- 172.21.15.90:0/1132454619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25340c4bb0 0x7f2534159e00 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f253406c3d0 tx=0x7f252402b880 comp rx=0 tx=0).stop 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 -- 172.21.15.90:0/1132454619 shutdown_connections 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 --2- 172.21.15.90:0/1132454619 >> v2:172.21.15.175:3300/0 conn(0x7f253415a340 0x7f25341611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.674 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 --2- 172.21.15.90:0/1132454619 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f25340c4bb0 0x7f2534159e00 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 -- 172.21.15.90:0/1132454619 >> 172.21.15.90:0/1132454619 conn(0x7f25340676c0 msgr2=0x7f2534067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 -- 172.21.15.90:0/1132454619 shutdown_connections 2024-04-20T10:59:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.673+0000 7f253a893640 1 -- 172.21.15.90:0/1132454619 wait complete. 2024-04-20T10:59:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.674+0000 7f253a893640 1 Processor -- start 2024-04-20T10:59:09.675 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.674+0000 7f253a893640 1 -- start start 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f253a893640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340c4bb0 0x7f25341ec080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f253a893640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534154040 0x7f25340c9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f253a893640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f253415a340 0x7f25341f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f253a893640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f25340737f0 con 0x7f253415a340 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f253a893640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f253415a7b0 con 0x7f2534154040 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f253a893640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2534073970 con 0x7f25340c4bb0 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f253415a340 0x7f25341f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f253415a340 0x7f25341f0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44060/0 (socket says 172.21.15.90:44060) 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 -- 172.21.15.90:0/3757104157 learned_addr learned my addr 172.21.15.90:0/3757104157 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f25337fe640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534154040 0x7f25340c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2533fff640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340c4bb0 0x7f25341ec080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:09.677 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 -- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340c4bb0 msgr2=0x7f25341ec080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340c4bb0 0x7f25341ec080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 -- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534154040 msgr2=0x7f25340c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534154040 0x7f25340c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 -- 172.21.15.90:0/3757104157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253414a210 con 0x7f253415a340 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2533fff640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340c4bb0 0x7f25341ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f25337fe640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534154040 0x7f25340c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2538e30640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f253415a340 0x7f25341f0010 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f252c00efc0 tx=0x7f252c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.675+0000 7f2530ff9640 1 -- 172.21.15.90:0/3757104157 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c018020 con 0x7f253415a340 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.676+0000 7f2530ff9640 1 -- 172.21.15.90:0/3757104157 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252c014480 con 0x7f253415a340 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.676+0000 7f2530ff9640 1 -- 172.21.15.90:0/3757104157 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c014870 con 0x7f253415a340 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.676+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253414a4f0 con 0x7f253415a340 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.676+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25341ec5c0 con 0x7f253415a340 2024-04-20T10:59:09.678 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.676+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2534076150 con 0x7f253415a340 2024-04-20T10:59:09.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.677+0000 7f2530ff9640 1 -- 172.21.15.90:0/3757104157 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f252c005d10 con 0x7f253415a340 2024-04-20T10:59:09.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.677+0000 7f2530ff9640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f252006c8f0 0x7f252006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:09.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.677+0000 7f2530ff9640 1 -- 172.21.15.90:0/3757104157 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 7411+0+0 (secure 0 0 0) 0x7f252c08cc40 con 0x7f253415a340 2024-04-20T10:59:09.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.677+0000 7f2533fff640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f252006c8f0 0x7f252006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:09.679 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.678+0000 7f2533fff640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f252006c8f0 0x7f252006edb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2528001700 tx=0x7f2528009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:09.682 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.682+0000 7f2530ff9640 1 -- 172.21.15.90:0/3757104157 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f252c022070 con 0x7f253415a340 2024-04-20T10:59:09.895 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.895+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25340ad3d0 con 0x7f253415a340 2024-04-20T10:59:09.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.896+0000 7f2530ff9640 1 -- 172.21.15.90:0/3757104157 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) ==== 94+0+6533 (secure 0 0 0) 0x7f252c010040 con 0x7f253415a340 2024-04-20T10:59:09.896 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:09.897 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5964,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":55,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:56:52.500542+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":35,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5497},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5497":{"gid":5497,"name":"b","rank":0,"incarnation":51,"state":"up:active","state_seq":11,"addr":"172.21.15.175:6833/3798454731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":3798454731},{"type":"v1","addr":"172.21.15.175:6833","nonce":3798454731}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5497,"qdb_cluster":[5497]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:09.897 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 62 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f252006c8f0 msgr2=0x7f252006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f252006c8f0 0x7f252006edb0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2528001700 tx=0x7f2528009040 comp rx=0 tx=0).stop 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f253415a340 msgr2=0x7f25341f0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f253415a340 0x7f25341f0010 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f252c00efc0 tx=0x7f252c00c490 comp rx=0 tx=0).stop 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 shutdown_connections 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f252006c8f0 0x7f252006edb0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f253415a340 0x7f25341f0010 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2534154040 0x7f25340c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 --2- 172.21.15.90:0/3757104157 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f25340c4bb0 0x7f25341ec080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:09.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 >> 172.21.15.90:0/3757104157 conn(0x7f25340676c0 msgr2=0x7f25340abff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:09.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 shutdown_connections 2024-04-20T10:59:09.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:09.898+0000 7f253a893640 1 -- 172.21.15.90:0/3757104157 wait complete. 2024-04-20T10:59:09.910 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:59:10.681 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:10.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.778+0000 7f6fe8c4e640 1 Processor -- start 2024-04-20T10:59:10.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.778+0000 7f6fe8c4e640 1 -- start start 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.779+0000 7f6fe8c4e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.779+0000 7f6fe8c4e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6fe40c9ee0 0x7f6fe4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.779+0000 7f6fe8c4e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fe415a720 con 0x7f6fe40ab730 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.779+0000 7f6fe8c4e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f6fe415ac80 con 0x7f6fe40c9ee0 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.779+0000 7f6fe8c4e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe415a9a0 con 0x7f6fe4153ef0 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.779+0000 7f6fe259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe2d9d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6fe40c9ee0 0x7f6fe4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:10.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe259c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe40c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:60250/0 (socket says 172.21.15.90:60250) 2024-04-20T10:59:10.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe259c640 1 -- 172.21.15.90:0/3478957070 learned_addr learned my addr 172.21.15.90:0/3478957070 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:10.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe1d9b640 1 --1- 172.21.15.90:0/3478957070 >> v1:172.21.15.175:6789/0 conn(0x7f6fe40ab730 0x7f6fe41568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:46918/0 (socket says 172.21.15.90:46918) 2024-04-20T10:59:10.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe2d9d640 1 -- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 msgr2=0x7f6fe40c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:10.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe2d9d640 1 --2- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe40c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:10.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe2d9d640 1 -- 172.21.15.90:0/3478957070 >> v1:172.21.15.175:6789/0 conn(0x7f6fe40ab730 legacy=0x7f6fe41568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:10.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe2d9d640 1 -- 172.21.15.90:0/3478957070 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe40c6a90 con 0x7f6fe40c9ee0 2024-04-20T10:59:10.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.780+0000 7f6fe259c640 1 --2- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe40c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe2d9d640 1 --2- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe4156fd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009d90 tx=0x7f6fdc02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bccaad37c93c8908 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe159a640 1 -- 172.21.15.90:0/3478957070 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc039070 con 0x7f6fe40c9ee0 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe159a640 1 -- 172.21.15.90:0/3478957070 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fdc02cb30 con 0x7f6fe40c9ee0 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe159a640 1 -- 172.21.15.90:0/3478957070 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc034440 con 0x7f6fe40c9ee0 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 msgr2=0x7f6fe4156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe4156fd0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009d90 tx=0x7f6fdc02bd80 comp rx=0 tx=0).stop 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3478957070 shutdown_connections 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe4156fd0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3478957070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe40c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3478957070 >> 172.21.15.90:0/3478957070 conn(0x7f6fe40cbfe0 msgr2=0x7f6fe40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3478957070 shutdown_connections 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.781+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3478957070 wait complete. 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 Processor -- start 2024-04-20T10:59:10.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 -- start start 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fe40ab730 0x7f6fe41efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe41f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe4155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe40bf800 con 0x7f6fe40ab730 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6fe4157510 con 0x7f6fe40c9ee0 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.783+0000 7f6fe8c4e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6fe41f0870 con 0x7f6fe4153ef0 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fe40ab730 0x7f6fe41efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fe40ab730 0x7f6fe41efdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44076/0 (socket says 172.21.15.90:44076) 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 -- 172.21.15.90:0/3004318892 learned_addr learned my addr 172.21.15.90:0/3004318892 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe2d9d640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe4155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe1d9b640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe41f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:10.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 -- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 msgr2=0x7f6fe4155790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe4155790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 -- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 msgr2=0x7f6fe41f0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe41f0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 -- 172.21.15.90:0/3004318892 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fe41eda80 con 0x7f6fe40ab730 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe2d9d640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe4155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe1d9b640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe41f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe259c640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fe40ab730 0x7f6fe41efdf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e9e0 tx=0x7f6fd400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fd2ffd640 1 -- 172.21.15.90:0/3004318892 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd4017070 con 0x7f6fe40ab730 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fd2ffd640 1 -- 172.21.15.90:0/3004318892 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fd400c9d0 con 0x7f6fe40ab730 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fe41546f0 con 0x7f6fe40ab730 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fd2ffd640 1 -- 172.21.15.90:0/3004318892 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd400cd80 con 0x7f6fe40ab730 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.784+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fe4154cb0 con 0x7f6fe40ab730 2024-04-20T10:59:10.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.786+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fe4152f50 con 0x7f6fe40ab730 2024-04-20T10:59:10.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.787+0000 7f6fd2ffd640 1 -- 172.21.15.90:0/3004318892 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6fd401a070 con 0x7f6fe40ab730 2024-04-20T10:59:10.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.787+0000 7f6fd2ffd640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6fc406c920 0x7f6fc406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:10.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.787+0000 7f6fd2ffd640 1 -- 172.21.15.90:0/3004318892 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7f6fd408bfd0 con 0x7f6fe40ab730 2024-04-20T10:59:10.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.787+0000 7f6fe1d9b640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6fc406c920 0x7f6fc406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:10.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.787+0000 7f6fe1d9b640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6fc406c920 0x7f6fc406ede0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4157270 tx=0x7f6fd8007e20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:10.795 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:10.795+0000 7f6fd2ffd640 1 -- 172.21.15.90:0/3004318892 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6fe4152f50 con 0x7f6fe40ab730 2024-04-20T10:59:11.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.015+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6fe40695c0 con 0x7f6fe40ab730 2024-04-20T10:59:11.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.016+0000 7f6fd2ffd640 1 -- 172.21.15.90:0/3004318892 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5697 (secure 0 0 0) 0x7f6fe40695c0 con 0x7f6fe40ab730 2024-04-20T10:59:11.017 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:11.017 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:10.374777+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:11.017 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 63 2024-04-20T10:59:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6fc406c920 msgr2=0x7f6fc406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6fc406c920 0x7f6fc406ede0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4157270 tx=0x7f6fd8007e20 comp rx=0 tx=0).stop 2024-04-20T10:59:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fe40ab730 msgr2=0x7f6fe41efdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fe40ab730 0x7f6fe41efdf0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f6fd400e9e0 tx=0x7f6fd400eea0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 shutdown_connections 2024-04-20T10:59:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6fc406c920 0x7f6fc406ede0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6fe4153ef0 0x7f6fe4155790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6fe40c9ee0 0x7f6fe41f0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 --2- 172.21.15.90:0/3004318892 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6fe40ab730 0x7f6fe41efdf0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 >> 172.21.15.90:0/3004318892 conn(0x7f6fe40cbfe0 msgr2=0x7f6fe40abeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 shutdown_connections 2024-04-20T10:59:11.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.018+0000 7f6fe8c4e640 1 -- 172.21.15.90:0/3004318892 wait complete. 2024-04-20T10:59:11.033 INFO:tasks.mds_thrash.fs.[a]:mds.b down, removed from mdsmap 2024-04-20T10:59:11.033 INFO:tasks.mds_thrash.fs.[a]:waiting for mds cluster to stabilize... 2024-04-20T10:59:11.033 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.131+0000 7fd20699d640 1 Processor -- start 2024-04-20T10:59:11.132 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.131+0000 7fd20699d640 1 -- start start 2024-04-20T10:59:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20699d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd20006be60 0x7fd200157100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:11.133 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20699d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd20006d390 0x7fd200157a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20699d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd20006c2f0 con 0x7fd200153ee0 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20699d640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fd2001542c0 con 0x7fd20006d390 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20699d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd20006c5d0 con 0x7fd20006be60 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20619c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd20006d390 0x7fd200157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20619c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fd20006d390 0x7fd200157a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44080/0 (socket says 172.21.15.90:44080) 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.132+0000 7fd20619c640 1 -- 172.21.15.90:0/2185747161 learned_addr learned my addr 172.21.15.90:0/2185747161 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.133+0000 7fd20519a640 1 --2- 172.21.15.90:0/2185747161 >> v2:172.21.15.175:3300/0 conn(0x7fd20006be60 0x7fd200157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.133+0000 7fd20619c640 1 -- 172.21.15.90:0/2185747161 >> v2:172.21.15.175:3300/0 conn(0x7fd20006be60 msgr2=0x7fd200157100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.133+0000 7fd20619c640 1 --2- 172.21.15.90:0/2185747161 >> v2:172.21.15.175:3300/0 conn(0x7fd20006be60 0x7fd200157100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.133+0000 7fd20619c640 1 -- 172.21.15.90:0/2185747161 >> v1:172.21.15.90:6789/0 conn(0x7fd200153ee0 legacy=0x7fd2000c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.134 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.133+0000 7fd20619c640 1 -- 172.21.15.90:0/2185747161 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20006c8b0 con 0x7fd20006d390 2024-04-20T10:59:11.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.133+0000 7fd20519a640 1 --2- 172.21.15.90:0/2185747161 >> v2:172.21.15.175:3300/0 conn(0x7fd20006be60 0x7fd200157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.134+0000 7fd20619c640 1 --2- 172.21.15.90:0/2185747161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd200157a60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd2000c2d60 tx=0x7fd1f802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdd7dabad57d7a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.134+0000 7fd204999640 1 -- 172.21.15.90:0/2185747161 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f802ca80 con 0x7fd20006d390 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.134+0000 7fd204999640 1 -- 172.21.15.90:0/2185747161 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1f802cc20 con 0x7fd20006d390 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.134+0000 7fd204999640 1 -- 172.21.15.90:0/2185747161 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1f80343f0 con 0x7fd20006d390 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 -- 172.21.15.90:0/2185747161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 msgr2=0x7fd200157a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 --2- 172.21.15.90:0/2185747161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd200157a60 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd2000c2d60 tx=0x7fd1f802bee0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 -- 172.21.15.90:0/2185747161 shutdown_connections 2024-04-20T10:59:11.138 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 --2- 172.21.15.90:0/2185747161 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd200157a60 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 --2- 172.21.15.90:0/2185747161 >> v2:172.21.15.175:3300/0 conn(0x7fd20006be60 0x7fd200157100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 -- 172.21.15.90:0/2185747161 >> 172.21.15.90:0/2185747161 conn(0x7fd2000cbe30 msgr2=0x7fd2000cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 -- 172.21.15.90:0/2185747161 shutdown_connections 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.135+0000 7fd20699d640 1 -- 172.21.15.90:0/2185747161 wait complete. 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 Processor -- start 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 -- start start 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd2000c5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd200153ee0 0x7fd2001efd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2000c17a0 0x7fd2001f0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000c6ec0 con 0x7fd20006d390 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd2000ccb40 con 0x7fd2000c17a0 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20699d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd2000c7040 con 0x7fd200153ee0 2024-04-20T10:59:11.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.136+0000 7fd20599b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd2000c5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd2000c5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44092/0 (socket says 172.21.15.90:44092) 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 -- 172.21.15.90:0/2723505217 learned_addr learned my addr 172.21.15.90:0/2723505217 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20619c640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2000c17a0 0x7fd2001f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20519a640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd200153ee0 0x7fd2001efd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 -- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd200153ee0 msgr2=0x7fd2001efd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd200153ee0 0x7fd2001efd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 -- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2000c17a0 msgr2=0x7fd2001f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2000c17a0 0x7fd2001f0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 -- 172.21.15.90:0/2723505217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2000c0880 con 0x7fd20006d390 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20599b640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd2000c5340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c400 tx=0x7fd1fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd1f67fc640 1 -- 172.21.15.90:0/2723505217 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0052d0 con 0x7fd20006d390 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd1f67fc640 1 -- 172.21.15.90:0/2723505217 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc005490 con 0x7fd20006d390 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd1f67fc640 1 -- 172.21.15.90:0/2723505217 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc007260 con 0x7fd20006d390 2024-04-20T10:59:11.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2000ad080 con 0x7fd20006d390 2024-04-20T10:59:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.137+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2000c0e00 con 0x7fd20006d390 2024-04-20T10:59:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.138+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd200076070 con 0x7fd20006d390 2024-04-20T10:59:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.139+0000 7fd1f67fc640 1 -- 172.21.15.90:0/2723505217 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd1fc007400 con 0x7fd20006d390 2024-04-20T10:59:11.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.139+0000 7fd1f67fc640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd1e406c8f0 0x7fd1e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.139+0000 7fd1f67fc640 1 -- 172.21.15.90:0/2723505217 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7fd1fc08b750 con 0x7fd20006d390 2024-04-20T10:59:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.139+0000 7fd20519a640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd1e406c8f0 0x7fd1e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:11.142 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.139+0000 7fd20519a640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd1e406c8f0 0x7fd1e406edb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd2001e9fd0 tx=0x7fd1f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:11.143 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.143+0000 7fd1f67fc640 1 -- 172.21.15.90:0/2723505217 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd1fc059510 con 0x7fd20006d390 2024-04-20T10:59:11.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.365+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2000ad790 con 0x7fd20006d390 2024-04-20T10:59:11.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.366+0000 7fd1f67fc640 1 -- 172.21.15.90:0/2723505217 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5697 (secure 0 0 0) 0x7fd1fc058e10 con 0x7fd20006d390 2024-04-20T10:59:11.366 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:11.366 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:10.374777+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:11.370 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 63 2024-04-20T10:59:11.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd1e406c8f0 msgr2=0x7fd1e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd1e406c8f0 0x7fd1e406edb0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd2001e9fd0 tx=0x7fd1f0008040 comp rx=0 tx=0).stop 2024-04-20T10:59:11.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 msgr2=0x7fd2000c5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd2000c5340 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc00c400 tx=0x7fd1fc00c8c0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 shutdown_connections 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd1e406c8f0 0x7fd1e406edb0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd2000c17a0 0x7fd2001f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd200153ee0 0x7fd2001efd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 --2- 172.21.15.90:0/2723505217 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd20006d390 0x7fd2000c5340 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 >> 172.21.15.90:0/2723505217 conn(0x7fd2000cbe30 msgr2=0x7fd200156470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 shutdown_connections 2024-04-20T10:59:11.372 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:11.368+0000 7fd20699d640 1 -- 172.21.15.90:0/2723505217 wait complete. 2024-04-20T10:59:11.379 INFO:tasks.mds_thrash.fs.[a]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 63, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 63, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5964": { "addr": "172.21.15.90:6837/1253561572", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6836", "nonce": 1253561572, "type": "v2" }, { "addr": "172.21.15.90:6837", "nonce": 1253561572, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5964, "incarnation": 63, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:59:10.374777+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5964 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 61, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_5868": { "addr": "172.21.15.90:6835/3994531378", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6834", "nonce": 3994531378, "type": "v2" }, { "addr": "172.21.15.90:6835", "nonce": 3994531378, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5868, "incarnation": 57, "join_fscid": -1, "name": "a", "rank": 0, "state": "up:active", "state_seq": 18 } }, "last_failure": 0, "last_failure_osd_epoch": 36, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:57:57.628923+0000", "qdb_cluster": [ 5868 ], "qdb_leader": 5868, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5868 } } } ], "standbys": [ { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "epoch": 19, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 0, "join_fscid": -1, "name": "d", "rank": -1, "state": "up:standby", "state_seq": 1 } ] } 2024-04-20T10:59:11.911 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:12.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.010+0000 7f4b68843640 1 Processor -- start 2024-04-20T10:59:12.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.010+0000 7f4b68843640 1 -- start start 2024-04-20T10:59:12.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b68843640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4b64153ef0 0x7f4b640c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:12.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b68843640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b641568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:12.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b68843640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4b640c9ee0 0x7f4b64156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:12.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b68843640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6415a720 con 0x7f4b640c9ee0 2024-04-20T10:59:12.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b68843640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4b6415ac80 con 0x7f4b64153ef0 2024-04-20T10:59:12.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b68843640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b6415a9a0 con 0x7f4b640ab730 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4b640c9ee0 0x7f4b64156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4b640c9ee0 0x7f4b64156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44096/0 (socket says 172.21.15.90:44096) 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 -- 172.21.15.90:0/1244707570 learned_addr learned my addr 172.21.15.90:0/1244707570 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b61d9b640 1 --2- 172.21.15.90:0/1244707570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b641568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b6259c640 1 --2- 172.21.15.90:0/1244707570 >> v2:172.21.15.175:3300/0 conn(0x7f4b64153ef0 0x7f4b640c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 -- 172.21.15.90:0/1244707570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 msgr2=0x7f4b641568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 --2- 172.21.15.90:0/1244707570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b641568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 -- 172.21.15.90:0/1244707570 >> v2:172.21.15.175:3300/0 conn(0x7f4b64153ef0 msgr2=0x7f4b640c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 --2- 172.21.15.90:0/1244707570 >> v2:172.21.15.175:3300/0 conn(0x7f4b64153ef0 0x7f4b640c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b62d9d640 1 -- 172.21.15.90:0/1244707570 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b640c6a90 con 0x7f4b640c9ee0 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b6259c640 1 --2- 172.21.15.90:0/1244707570 >> v2:172.21.15.175:3300/0 conn(0x7f4b64153ef0 0x7f4b640c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.011+0000 7f4b61d9b640 1 --2- 172.21.15.90:0/1244707570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b641568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.012+0000 7f4b62d9d640 1 --2- 172.21.15.90:0/1244707570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b640c9ee0 0x7f4b64156e00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4b640aec60 tx=0x7f4b5c02bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e5f97c5324e5d96 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:12.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.012+0000 7f4b6159a640 1 -- 172.21.15.90:0/1244707570 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c02c950 con 0x7f4b640c9ee0 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.012+0000 7f4b6159a640 1 -- 172.21.15.90:0/1244707570 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5c02caf0 con 0x7f4b640c9ee0 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.012+0000 7f4b6159a640 1 -- 172.21.15.90:0/1244707570 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0343f0 con 0x7f4b640c9ee0 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 -- 172.21.15.90:0/1244707570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b640c9ee0 msgr2=0x7f4b64156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 --2- 172.21.15.90:0/1244707570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b640c9ee0 0x7f4b64156e00 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f4b640aec60 tx=0x7f4b5c02bdb0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 -- 172.21.15.90:0/1244707570 shutdown_connections 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 --2- 172.21.15.90:0/1244707570 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b640c9ee0 0x7f4b64156e00 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 --2- 172.21.15.90:0/1244707570 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b641568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 --2- 172.21.15.90:0/1244707570 >> v2:172.21.15.175:3300/0 conn(0x7f4b64153ef0 0x7f4b640c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 -- 172.21.15.90:0/1244707570 >> 172.21.15.90:0/1244707570 conn(0x7f4b640cbfe0 msgr2=0x7f4b640cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 -- 172.21.15.90:0/1244707570 shutdown_connections 2024-04-20T10:59:12.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.013+0000 7f4b68843640 1 -- 172.21.15.90:0/1244707570 wait complete. 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.014+0000 7f4b68843640 1 Processor -- start 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.014+0000 7f4b68843640 1 -- start start 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b68843640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b640c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b68843640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b640c9ee0 0x7f4b640c4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b68843640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b64153ef0 0x7f4b641ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b68843640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b640bf800 con 0x7f4b64153ef0 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b68843640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b64157340 con 0x7f4b640c9ee0 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b68843640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b640c3560 con 0x7f4b640ab730 2024-04-20T10:59:12.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b64153ef0 0x7f4b641ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b64153ef0 0x7f4b641ee9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44102/0 (socket says 172.21.15.90:44102) 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 -- 172.21.15.90:0/4154983458 learned_addr learned my addr 172.21.15.90:0/4154983458 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b6259c640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b640c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b61d9b640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b640c9ee0 0x7f4b640c4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 -- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 msgr2=0x7f4b640c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b640c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 -- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b640c9ee0 msgr2=0x7f4b640c4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b640c9ee0 0x7f4b640c4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b62d9d640 1 -- 172.21.15.90:0/4154983458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b640c27d0 con 0x7f4b64153ef0 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.015+0000 7f4b61d9b640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b640c9ee0 0x7f4b640c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.016+0000 7f4b62d9d640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b64153ef0 0x7f4b641ee9a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c036040 tx=0x7f4b5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.016+0000 7f4b52ffd640 1 -- 172.21.15.90:0/4154983458 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c043020 con 0x7f4b64153ef0 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.016+0000 7f4b52ffd640 1 -- 172.21.15.90:0/4154983458 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b5c03e450 con 0x7f4b64153ef0 2024-04-20T10:59:12.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.016+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b641ec9c0 con 0x7f4b64153ef0 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.016+0000 7f4b52ffd640 1 -- 172.21.15.90:0/4154983458 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c03e840 con 0x7f4b64153ef0 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.016+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b640c6150 con 0x7f4b64153ef0 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.017+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b64076150 con 0x7f4b64153ef0 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.017+0000 7f4b52ffd640 1 -- 172.21.15.90:0/4154983458 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b5c046020 con 0x7f4b64153ef0 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.018+0000 7f4b52ffd640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b4406c8f0 0x7f4b4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.018+0000 7f4b52ffd640 1 -- 172.21.15.90:0/4154983458 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7f4b5c0aef40 con 0x7f4b64153ef0 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.018+0000 7f4b6259c640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b4406c8f0 0x7f4b4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:12.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.018+0000 7f4b6259c640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b4406c8f0 0x7f4b4406edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4b640ad8d0 tx=0x7f4b54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:12.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.022+0000 7f4b52ffd640 1 -- 172.21.15.90:0/4154983458 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4b5c04d020 con 0x7f4b64153ef0 2024-04-20T10:59:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.259+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b640c23d0 con 0x7f4b64153ef0 2024-04-20T10:59:12.259 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.259+0000 7f4b52ffd640 1 -- 172.21.15.90:0/4154983458 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5697 (secure 0 0 0) 0x7f4b5c07cc70 con 0x7f4b64153ef0 2024-04-20T10:59:12.260 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:12.260 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:10.374777+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:12.260 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 63 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b4406c8f0 msgr2=0x7f4b4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b4406c8f0 0x7f4b4406edb0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4b640ad8d0 tx=0x7f4b54008040 comp rx=0 tx=0).stop 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b64153ef0 msgr2=0x7f4b641ee9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b64153ef0 0x7f4b641ee9a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c036040 tx=0x7f4b5c004a40 comp rx=0 tx=0).stop 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 shutdown_connections 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b4406c8f0 0x7f4b4406edb0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b64153ef0 0x7f4b641ee9a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b640c9ee0 0x7f4b640c4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 --2- 172.21.15.90:0/4154983458 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b640ab730 0x7f4b640c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:12.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 >> 172.21.15.90:0/4154983458 conn(0x7f4b640cbfe0 msgr2=0x7f4b640acd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:12.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 shutdown_connections 2024-04-20T10:59:12.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:12.261+0000 7f4b68843640 1 -- 172.21.15.90:0/4154983458 wait complete. 2024-04-20T10:59:12.273 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:59:12.502 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:59:12.504 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:59:13.381 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:13.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.479+0000 7f358bb8f640 1 Processor -- start 2024-04-20T10:59:13.480 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.480+0000 7f358bb8f640 1 -- start start 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.480+0000 7f358bb8f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f35840ab730 0x7f35841568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.480+0000 7f358bb8f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c9ee0 0x7f3584156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.480+0000 7f358bb8f640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f358415a720 con 0x7f3584153ef0 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.480+0000 7f358bb8f640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f358415ac80 con 0x7f35840ab730 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.480+0000 7f358bb8f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f358415a9a0 con 0x7f35840c9ee0 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.480+0000 7f358912a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f35840ab730 0x7f35841568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.481+0000 7f358912a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f35840ab730 0x7f35841568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44112/0 (socket says 172.21.15.90:44112) 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.481+0000 7f358912a640 1 -- 172.21.15.90:0/494795367 learned_addr learned my addr 172.21.15.90:0/494795367 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.481+0000 7f358a12c640 1 --2- 172.21.15.90:0/494795367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c9ee0 0x7f3584156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.481+0000 7f358912a640 1 -- 172.21.15.90:0/494795367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c9ee0 msgr2=0x7f3584156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.481+0000 7f358912a640 1 --2- 172.21.15.90:0/494795367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c9ee0 0x7f3584156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.482 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.481+0000 7f358912a640 1 -- 172.21.15.90:0/494795367 >> v1:172.21.15.90:6789/0 conn(0x7f3584153ef0 legacy=0x7f35840c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:13.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.481+0000 7f358912a640 1 -- 172.21.15.90:0/494795367 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35840c6a90 con 0x7f35840ab730 2024-04-20T10:59:13.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358912a640 1 --2- 172.21.15.90:0/494795367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840ab730 0x7f35841568c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3574009870 tx=0x7f357402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21968e55c093b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:13.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f3588929640 1 -- 172.21.15.90:0/494795367 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35740317c0 con 0x7f35840ab730 2024-04-20T10:59:13.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f3588929640 1 -- 172.21.15.90:0/494795367 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574037070 con 0x7f35840ab730 2024-04-20T10:59:13.483 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f3588929640 1 -- 172.21.15.90:0/494795367 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574031b80 con 0x7f35840ab730 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 -- 172.21.15.90:0/494795367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840ab730 msgr2=0x7f35841568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 --2- 172.21.15.90:0/494795367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840ab730 0x7f35841568c0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3574009870 tx=0x7f357402b860 comp rx=0 tx=0).stop 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 -- 172.21.15.90:0/494795367 shutdown_connections 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 --2- 172.21.15.90:0/494795367 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840c9ee0 0x7f3584156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 --2- 172.21.15.90:0/494795367 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840ab730 0x7f35841568c0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 -- 172.21.15.90:0/494795367 >> 172.21.15.90:0/494795367 conn(0x7f35840cbfe0 msgr2=0x7f35840cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 -- 172.21.15.90:0/494795367 shutdown_connections 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.482+0000 7f358bb8f640 1 -- 172.21.15.90:0/494795367 wait complete. 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.483+0000 7f358bb8f640 1 Processor -- start 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358bb8f640 1 -- start start 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358bb8f640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840ab730 0x7f35841ec330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358bb8f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840c9ee0 0x7f3584155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:13.486 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358bb8f640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584153ef0 0x7f3584150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358bb8f640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f35840c9280 con 0x7f35840c9ee0 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358bb8f640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f35840c9100 con 0x7f3584153ef0 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358bb8f640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f35840bf800 con 0x7f35840ab730 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358912a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840c9ee0 0x7f3584155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358912a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840c9ee0 0x7f3584155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44128/0 (socket says 172.21.15.90:44128) 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.484+0000 7f358912a640 1 -- 172.21.15.90:0/4181235256 learned_addr learned my addr 172.21.15.90:0/4181235256 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358992b640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840ab730 0x7f35841ec330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358912a640 1 -- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840ab730 msgr2=0x7f35841ec330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358a12c640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584153ef0 0x7f3584150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358912a640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840ab730 0x7f35841ec330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358912a640 1 -- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584153ef0 msgr2=0x7f3584150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358912a640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584153ef0 0x7f3584150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358912a640 1 -- 172.21.15.90:0/4181235256 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35841ec950 con 0x7f35840c9ee0 2024-04-20T10:59:13.487 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358992b640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840ab730 0x7f35841ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358a12c640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584153ef0 0x7f3584150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358912a640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840c9ee0 0x7f3584155cb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3574000c00 tx=0x7f35740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f357a7fc640 1 -- 172.21.15.90:0/4181235256 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574032860 con 0x7f35840c9ee0 2024-04-20T10:59:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f357a7fc640 1 -- 172.21.15.90:0/4181235256 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3574032a20 con 0x7f35840c9ee0 2024-04-20T10:59:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35841ecc30 con 0x7f35840c9ee0 2024-04-20T10:59:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f357a7fc640 1 -- 172.21.15.90:0/4181235256 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574032e10 con 0x7f35840c9ee0 2024-04-20T10:59:13.488 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.485+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35841ed1f0 con 0x7f35840c9ee0 2024-04-20T10:59:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.486+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3584076150 con 0x7f35840c9ee0 2024-04-20T10:59:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.487+0000 7f357a7fc640 1 -- 172.21.15.90:0/4181235256 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f357404c060 con 0x7f35840c9ee0 2024-04-20T10:59:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.487+0000 7f357a7fc640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356806c8f0 0x7f356806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.487+0000 7f357a7fc640 1 -- 172.21.15.90:0/4181235256 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7f35740ada30 con 0x7f35840c9ee0 2024-04-20T10:59:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.487+0000 7f358992b640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356806c8f0 0x7f356806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:13.489 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.488+0000 7f358992b640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356806c8f0 0x7f356806edb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3580000f60 tx=0x7f3580009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:13.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.491+0000 7f357a7fc640 1 -- 172.21.15.90:0/4181235256 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f3574040070 con 0x7f35840c9ee0 2024-04-20T10:59:13.732 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.732+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f35840cbbb0 con 0x7f35840c9ee0 2024-04-20T10:59:13.733 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.733+0000 7f357a7fc640 1 -- 172.21.15.90:0/4181235256 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5697 (secure 0 0 0) 0x7f3574031e90 con 0x7f35840c9ee0 2024-04-20T10:59:13.733 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:13.733 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:10.374777+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:13.733 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 63 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356806c8f0 msgr2=0x7f356806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356806c8f0 0x7f356806edb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f3580000f60 tx=0x7f3580009040 comp rx=0 tx=0).stop 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840c9ee0 msgr2=0x7f3584155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840c9ee0 0x7f3584155cb0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3574000c00 tx=0x7f35740046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 shutdown_connections 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f356806c8f0 0x7f356806edb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3584153ef0 0x7f3584150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f35840c9ee0 0x7f3584155cb0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.735 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 --2- 172.21.15.90:0/4181235256 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f35840ab730 0x7f35841ec330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:13.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 >> 172.21.15.90:0/4181235256 conn(0x7f35840cbfe0 msgr2=0x7f35840ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:13.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 shutdown_connections 2024-04-20T10:59:13.736 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:13.735+0000 7f358bb8f640 1 -- 172.21.15.90:0/4181235256 wait complete. 2024-04-20T10:59:13.746 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-20T10:59:14.273 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.371+0000 7fa7b2e99640 1 Processor -- start 2024-04-20T10:59:14.371 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.371+0000 7fa7b2e99640 1 -- start start 2024-04-20T10:59:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7b2e99640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 0x7fa7ac156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7b2e99640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac15a720 con 0x7fa7ac153ef0 2024-04-20T10:59:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7b2e99640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7ac15ac80 con 0x7fa7ac0ab730 2024-04-20T10:59:14.374 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7b2e99640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa7ac15a9a0 con 0x7fa7ac0c9ee0 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7b0c35640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa7ac153ef0 0x7fa7ac0c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:51302/0 (socket says 172.21.15.90:51302) 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7b0c35640 1 -- 172.21.15.90:0/863024734 learned_addr learned my addr 172.21.15.90:0/863024734 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886255364 0 0) 0x7fa7a0001110 con 0x7fa7ac153ef0 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa79c003520 con 0x7fa7ac153ef0 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7b1436640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 0x7fa7ac156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3124093337 0 0) 0x7fa79c003520 con 0x7fa7ac153ef0 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 msgr2=0x7fa7ac156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7ab7fe640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 0x7fa7ac156fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 >> v1:172.21.15.175:6789/0 conn(0x7fa7ac0ab730 legacy=0x7fa7ac1568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.372+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac0c6a90 con 0x7fa7ac153ef0 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fa7a0001860 con 0x7fa7ac153ef0 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 >> v1:172.21.15.90:6789/0 conn(0x7fa7ac153ef0 legacy=0x7fa7ac0c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:14.375 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0039e0 0x7fa79c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 0x7fa79c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c004d40 0x7fa79c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac15a9a0 con 0x7fa79c0039e0 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c00bb80 con 0x7fa79c004d40 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c00bd80 con 0x7fa7ac0c9ee0 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0039e0 0x7fa79c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7abfff640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 0x7fa79c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b1436640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c004d40 0x7fa79c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b0c35640 1 -- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 msgr2=0x7fa79c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 0x7fa79c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b0c35640 1 -- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c004d40 msgr2=0x7fa79c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c004d40 0x7fa79c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b0c35640 1 -- 172.21.15.90:0/863024734 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c003520 con 0x7fa79c0039e0 2024-04-20T10:59:14.376 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7abfff640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac0c9ee0 0x7fa79c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:14.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.373+0000 7fa7b1436640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c004d40 0x7fa79c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:14.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.374+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0039e0 0x7fa79c003e00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000c490 tx=0x7fa79c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d244c537f8d2a2e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:14.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.374+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a000c0e0 con 0x7fa79c0039e0 2024-04-20T10:59:14.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.374+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a0030070 con 0x7fa79c0039e0 2024-04-20T10:59:14.377 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.374+0000 7fa7ab7fe640 1 -- 172.21.15.90:0/863024734 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a00058d0 con 0x7fa79c0039e0 2024-04-20T10:59:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.375+0000 7fa7b2e99640 1 -- 172.21.15.90:0/863024734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0039e0 msgr2=0x7fa79c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.375+0000 7fa7b2e99640 1 --2- 172.21.15.90:0/863024734 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa79c0039e0 0x7fa79c003e00 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa7a000c490 tx=0x7fa79c005830 comp rx=0 tx=0).stop 2024-04-20T10:59:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.375+0000 7fa7b1436640 1 -- 172.21.15.90:0/863024734 reap_dead start 2024-04-20T10:59:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.375+0000 7fa7b2e99640 1 -- 172.21.15.90:0/863024734 shutdown_connections 2024-04-20T10:59:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.375+0000 7fa7b2e99640 1 -- 172.21.15.90:0/863024734 >> 172.21.15.90:0/863024734 conn(0x7fa7ac0cbfe0 msgr2=0x7fa7ac0cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.375+0000 7fa7b2e99640 1 -- 172.21.15.90:0/863024734 shutdown_connections 2024-04-20T10:59:14.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.375+0000 7fa7b2e99640 1 -- 172.21.15.90:0/863024734 wait complete. 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.376+0000 7fa7b2e99640 1 Processor -- start 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.376+0000 7fa7b2e99640 1 -- start start 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b2e99640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c0039e0 0x7fa7ac1ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b2e99640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac1e2990 0x7fa7ac0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b2e99640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7ac0ad1c0 0x7fa7ac1eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b2e99640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac0c9280 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b2e99640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa7ac0c9100 con 0x7fa79c0039e0 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b2e99640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa7ac0bf800 con 0x7fa7ac1e2990 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7ac0ad1c0 0x7fa7ac1eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7ac0ad1c0 0x7fa7ac1eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:44142/0 (socket says 172.21.15.90:44142) 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 -- 172.21.15.90:0/1471331678 learned_addr learned my addr 172.21.15.90:0/1471331678 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7abfff640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac1e2990 0x7fa7ac0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c0039e0 0x7fa7ac1ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 -- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac1e2990 msgr2=0x7fa7ac0acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac1e2990 0x7fa7ac0acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 -- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c0039e0 msgr2=0x7fa7ac1ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c0039e0 0x7fa7ac1ed8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b1436640 1 -- 172.21.15.90:0/1471331678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7ac0ae390 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.377+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c0039e0 0x7fa7ac1ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.378+0000 7fa7b1436640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7ac0ad1c0 0x7fa7ac1eeee0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac08e540 tx=0x7fa7a4010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.378+0000 7fa7a97fa640 1 -- 172.21.15.90:0/1471331678 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a401a030 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.378+0000 7fa7a97fa640 1 -- 172.21.15.90:0/1471331678 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7a4010d80 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.378+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7ac0ae670 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.378+0000 7fa7a97fa640 1 -- 172.21.15.90:0/1471331678 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4003bd0 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.378+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7ac154460 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.379+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7ac068d40 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.379+0000 7fa7a97fa640 1 -- 172.21.15.90:0/1471331678 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa7a401d070 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.380+0000 7fa7a97fa640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa79006c8f0 0x7fa79006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:14.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.380+0000 7fa7a97fa640 1 -- 172.21.15.90:0/1471331678 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7fa7a408cc00 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.380+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa79006c8f0 0x7fa79006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:14.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.380+0000 7fa7b0c35640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa79006c8f0 0x7fa79006edb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0034000 tx=0x7fa7a0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:14.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.384+0000 7fa7a97fa640 1 -- 172.21.15.90:0/1471331678 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa7ac068d40 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.604+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7ac0ac550 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.604 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.604+0000 7fa7a97fa640 1 -- 172.21.15.90:0/1471331678 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+5697 (secure 0 0 0) 0x7fa7a4093080 con 0x7fa7ac0ad1c0 2024-04-20T10:59:14.605 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:14.605 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:10.374777+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:14.605 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 63 2024-04-20T10:59:14.606 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa79006c8f0 msgr2=0x7fa79006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa79006c8f0 0x7fa79006edb0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa7a0034000 tx=0x7fa7a0009030 comp rx=0 tx=0).stop 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7ac0ad1c0 msgr2=0x7fa7ac1eeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7ac0ad1c0 0x7fa7ac1eeee0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac08e540 tx=0x7fa7a4010590 comp rx=0 tx=0).stop 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 shutdown_connections 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa79006c8f0 0x7fa79006edb0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa7ac0ad1c0 0x7fa7ac1eeee0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa7ac1e2990 0x7fa7ac0acc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 --2- 172.21.15.90:0/1471331678 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa79c0039e0 0x7fa7ac1ed8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 >> 172.21.15.90:0/1471331678 conn(0x7fa7ac0cbfe0 msgr2=0x7fa7ac155c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 shutdown_connections 2024-04-20T10:59:14.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:14.606+0000 7fa7b2e99640 1 -- 172.21.15.90:0/1471331678 wait complete. 2024-04-20T10:59:14.617 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:59:15.747 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:15.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.845+0000 7f7ce25db640 1 Processor -- start 2024-04-20T10:59:15.848 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.845+0000 7f7ce25db640 1 -- start start 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7ce25db640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7cdc06ef90 0x7f7cdc0c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7ce25db640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7cdc0c23f0 0x7f7cdc157170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7ce25db640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cdc0c2880 con 0x7f7cdc0c7bf0 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7ce25db640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f7cdc0c4480 con 0x7f7cdc06ef90 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7ce25db640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7cdc1576b0 con 0x7f7cdc0c23f0 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7cdb7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7cdc06ef90 0x7f7cdc0c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7cdb7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7cdc06ef90 0x7f7cdc0c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34670/0 (socket says 172.21.15.90:34670) 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7cdb7fe640 1 -- 172.21.15.90:0/1323677337 learned_addr learned my addr 172.21.15.90:0/1323677337 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7ce0b78640 1 --2- 172.21.15.90:0/1323677337 >> v2:172.21.15.175:3300/0 conn(0x7f7cdc0c23f0 0x7f7cdc157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:15.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7cdb7fe640 1 -- 172.21.15.90:0/1323677337 >> v2:172.21.15.175:3300/0 conn(0x7f7cdc0c23f0 msgr2=0x7f7cdc157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7cdb7fe640 1 --2- 172.21.15.90:0/1323677337 >> v2:172.21.15.175:3300/0 conn(0x7f7cdc0c23f0 0x7f7cdc157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7cdb7fe640 1 -- 172.21.15.90:0/1323677337 >> v1:172.21.15.175:6789/0 conn(0x7f7cdc0c7bf0 legacy=0x7f7cdc0c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.846+0000 7f7cdb7fe640 1 -- 172.21.15.90:0/1323677337 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc0c33e0 con 0x7f7cdc06ef90 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.847+0000 7f7cdb7fe640 1 --2- 172.21.15.90:0/1323677337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc0c7fd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc15ad00 tx=0x7f7cd002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=835ba38e5d314354 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.847+0000 7f7cdaffd640 1 -- 172.21.15.90:0/1323677337 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd002e070 con 0x7f7cdc06ef90 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.847+0000 7f7cdaffd640 1 -- 172.21.15.90:0/1323677337 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd0037070 con 0x7f7cdc06ef90 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.847+0000 7f7cdaffd640 1 -- 172.21.15.90:0/1323677337 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0031a00 con 0x7f7cdc06ef90 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 -- 172.21.15.90:0/1323677337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 msgr2=0x7f7cdc0c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 --2- 172.21.15.90:0/1323677337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc0c7fd0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7cdc15ad00 tx=0x7f7cd002b880 comp rx=0 tx=0).stop 2024-04-20T10:59:15.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 -- 172.21.15.90:0/1323677337 shutdown_connections 2024-04-20T10:59:15.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 --2- 172.21.15.90:0/1323677337 >> v2:172.21.15.175:3300/0 conn(0x7f7cdc0c23f0 0x7f7cdc157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:15.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 --2- 172.21.15.90:0/1323677337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc0c7fd0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:15.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 -- 172.21.15.90:0/1323677337 >> 172.21.15.90:0/1323677337 conn(0x7f7cdc0aa660 msgr2=0x7f7cdc0aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:15.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 -- 172.21.15.90:0/1323677337 shutdown_connections 2024-04-20T10:59:15.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.848+0000 7f7ce25db640 1 -- 172.21.15.90:0/1323677337 wait complete. 2024-04-20T10:59:15.854 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.849+0000 7f7ce25db640 1 Processor -- start 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.849+0000 7f7ce25db640 1 -- start start 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce25db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc1455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce25db640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc0c23f0 0x7f7cdc14db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce25db640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cdc0c7bf0 0x7f7cdc14a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce25db640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0c39a0 con 0x7f7cdc06ef90 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce25db640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7cdc0c3ff0 con 0x7f7cdc0c23f0 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce25db640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7cdc0c3c80 con 0x7f7cdc0c7bf0 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc1455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc1455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34680/0 (socket says 172.21.15.90:34680) 2024-04-20T10:59:15.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 -- 172.21.15.90:0/2421661631 learned_addr learned my addr 172.21.15.90:0/2421661631 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce0b78640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cdc0c7bf0 0x7f7cdc14a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdb7fe640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc0c23f0 0x7f7cdc14db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 -- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cdc0c7bf0 msgr2=0x7f7cdc14a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cdc0c7bf0 0x7f7cdc14a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 -- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc0c23f0 msgr2=0x7f7cdc14db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc0c23f0 0x7f7cdc14db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 -- 172.21.15.90:0/2421661631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cdc1eccd0 con 0x7f7cdc06ef90 2024-04-20T10:59:15.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce0b78640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cdc0c7bf0 0x7f7cdc14a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cdbfff640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc1455e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c400 tx=0x7f7ccc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cd8ff9640 1 -- 172.21.15.90:0/2421661631 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc0052d0 con 0x7f7cdc06ef90 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cd8ff9640 1 -- 172.21.15.90:0/2421661631 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ccc005490 con 0x7f7cdc06ef90 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cdc1ecfb0 con 0x7f7cdc06ef90 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.850+0000 7f7cd8ff9640 1 -- 172.21.15.90:0/2421661631 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ccc007260 con 0x7f7cdc06ef90 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.851+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cdc149ac0 con 0x7f7cdc06ef90 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.851+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cdc0a80d0 con 0x7f7cdc06ef90 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.852+0000 7f7cd8ff9640 1 -- 172.21.15.90:0/2421661631 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ccc007400 con 0x7f7cdc06ef90 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.852+0000 7f7cd8ff9640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7cc806c8f0 0x7f7cc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:15.857 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.853+0000 7f7cdb7fe640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7cc806c8f0 0x7f7cc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:15.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.853+0000 7f7cd8ff9640 1 -- 172.21.15.90:0/2421661631 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7f7ccc08b750 con 0x7f7cdc06ef90 2024-04-20T10:59:15.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.853+0000 7f7cdb7fe640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7cc806c8f0 0x7f7cc806edb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0036000 tx=0x7f7cd003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:15.858 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:15.857+0000 7f7cd8ff9640 1 -- 172.21.15.90:0/2421661631 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7ccc059510 con 0x7f7cdc06ef90 2024-04-20T10:59:16.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.071+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cdc076150 con 0x7f7cdc06ef90 2024-04-20T10:59:16.075 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.071+0000 7f7cd8ff9640 1 -- 172.21.15.90:0/2421661631 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) ==== 94+0+5701 (secure 0 0 0) 0x7f7ccc058e10 con 0x7f7cdc06ef90 2024-04-20T10:59:16.075 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:16.076 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":64,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:15.351426+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 64 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7cc806c8f0 msgr2=0x7f7cc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7cc806c8f0 0x7f7cc806edb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0036000 tx=0x7f7cd003d040 comp rx=0 tx=0).stop 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 msgr2=0x7f7cdc1455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc1455e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f7ccc00c400 tx=0x7f7ccc00c8c0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 shutdown_connections 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7cc806c8f0 0x7f7cc806edb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7cdc0c7bf0 0x7f7cdc14a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7cdc0c23f0 0x7f7cdc14db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.077 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 --2- 172.21.15.90:0/2421661631 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7cdc06ef90 0x7f7cdc1455e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 >> 172.21.15.90:0/2421661631 conn(0x7f7cdc0aa660 msgr2=0x7f7cdc154320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:16.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 shutdown_connections 2024-04-20T10:59:16.078 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.073+0000 7f7ce25db640 1 -- 172.21.15.90:0/2421661631 wait complete. 2024-04-20T10:59:16.084 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-20T10:59:16.618 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.716+0000 7f0475693640 1 Processor -- start 2024-04-20T10:59:16.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.716+0000 7f0475693640 1 -- start start 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f0475693640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f04700c9ee0 0x7f0470156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f0475693640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047015a720 con 0x7f0470153ef0 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f0475693640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f047015ac80 con 0x7f04700ab730 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f0475693640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f047015a9a0 con 0x7f04700c9ee0 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f046f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f04700c9ee0 0x7f0470156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f046f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f04700c9ee0 0x7f0470156fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34682/0 (socket says 172.21.15.90:34682) 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f046f7fe640 1 -- 172.21.15.90:0/81974969 learned_addr learned my addr 172.21.15.90:0/81974969 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f046f7fe640 1 -- 172.21.15.90:0/81974969 >> v1:172.21.15.175:6789/0 conn(0x7f04700ab730 legacy=0x7f04701568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f046f7fe640 1 -- 172.21.15.90:0/81974969 >> v1:172.21.15.90:6789/0 conn(0x7f0470153ef0 legacy=0x7f04700c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.717+0000 7f046f7fe640 1 -- 172.21.15.90:0/81974969 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04700c6a90 con 0x7f04700c9ee0 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f046f7fe640 1 --2- 172.21.15.90:0/81974969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f0470156fd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0468009e50 tx=0x7f046802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32799ba6d2058e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f046e7fc640 1 -- 172.21.15.90:0/81974969 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046802c9f0 con 0x7f04700c9ee0 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f046e7fc640 1 -- 172.21.15.90:0/81974969 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f046802cb90 con 0x7f04700c9ee0 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f046e7fc640 1 -- 172.21.15.90:0/81974969 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04680343f0 con 0x7f04700c9ee0 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f0475693640 1 -- 172.21.15.90:0/81974969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 msgr2=0x7f0470156fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f0475693640 1 --2- 172.21.15.90:0/81974969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f0470156fd0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0468009e50 tx=0x7f046802be50 comp rx=0 tx=0).stop 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f0475693640 1 -- 172.21.15.90:0/81974969 shutdown_connections 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f0475693640 1 --2- 172.21.15.90:0/81974969 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f0470156fd0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f0475693640 1 -- 172.21.15.90:0/81974969 >> 172.21.15.90:0/81974969 conn(0x7f04700cbfe0 msgr2=0x7f04700cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f0475693640 1 -- 172.21.15.90:0/81974969 shutdown_connections 2024-04-20T10:59:16.720 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.718+0000 7f0475693640 1 -- 172.21.15.90:0/81974969 wait complete. 2024-04-20T10:59:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.719+0000 7f0475693640 1 Processor -- start 2024-04-20T10:59:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0475693640 1 -- start start 2024-04-20T10:59:16.723 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0475693640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04700ab730 0x7f0470155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0475693640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f04701586e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0475693640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0470153ef0 0x7f0470158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0475693640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f04700c9100 con 0x7f04700c9ee0 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0475693640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0470157510 con 0x7f0470153ef0 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0475693640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f04700c9280 con 0x7f04700ab730 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0467fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f04701586e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0467fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f04701586e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34690/0 (socket says 172.21.15.90:34690) 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f0467fff640 1 -- 172.21.15.90:0/86551479 learned_addr learned my addr 172.21.15.90:0/86551479 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:16.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f046f7fe640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0470153ef0 0x7f0470158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.720+0000 7f046effd640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04700ab730 0x7f0470155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0467fff640 1 -- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04700ab730 msgr2=0x7f0470155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0467fff640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04700ab730 0x7f0470155ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0467fff640 1 -- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0470153ef0 msgr2=0x7f0470158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0467fff640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0470153ef0 0x7f0470158c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0467fff640 1 -- 172.21.15.90:0/86551479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04701ec550 con 0x7f04700c9ee0 2024-04-20T10:59:16.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f046effd640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04700ab730 0x7f0470155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f046f7fe640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0470153ef0 0x7f0470158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0467fff640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f04701586e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f045800b3c0 tx=0x7f045800b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f04677fe640 1 -- 172.21.15.90:0/86551479 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458011830 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f04677fe640 1 -- 172.21.15.90:0/86551479 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0458016070 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f04677fe640 1 -- 172.21.15.90:0/86551479 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0458011c50 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04700aee30 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.721+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04701ecaf0 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.722+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0470076150 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.722+0000 7f04677fe640 1 -- 172.21.15.90:0/86551479 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f045801b460 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.723+0000 7f04677fe640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f045006c8f0 0x7f045006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.723+0000 7f04677fe640 1 -- 172.21.15.90:0/86551479 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7f045808bc80 con 0x7f04700c9ee0 2024-04-20T10:59:16.726 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.723+0000 7f046effd640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f045006c8f0 0x7f045006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:16.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.723+0000 7f046effd640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f045006c8f0 0x7f045006edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f04700cbac0 tx=0x7f0460009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:16.727 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.727+0000 7f04677fe640 1 -- 172.21.15.90:0/86551479 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0458020020 con 0x7f04700c9ee0 2024-04-20T10:59:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.946+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0470152810 con 0x7f04700c9ee0 2024-04-20T10:59:16.946 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.946+0000 7f04677fe640 1 -- 172.21.15.90:0/86551479 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) ==== 94+0+5698 (secure 0 0 0) 0x7f0458059a40 con 0x7f04700c9ee0 2024-04-20T10:59:16.947 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:16.947 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":65,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:15.483309+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:16.947 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 65 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f045006c8f0 msgr2=0x7f045006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f045006c8f0 0x7f045006edb0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f04700cbac0 tx=0x7f0460009040 comp rx=0 tx=0).stop 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 msgr2=0x7f04701586e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f04701586e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f045800b3c0 tx=0x7f045800b880 comp rx=0 tx=0).stop 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 shutdown_connections 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f045006c8f0 0x7f045006edb0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0470153ef0 0x7f0470158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f04700c9ee0 0x7f04701586e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 --2- 172.21.15.90:0/86551479 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f04700ab730 0x7f0470155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 >> 172.21.15.90:0/86551479 conn(0x7f04700cbfe0 msgr2=0x7f0470152a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 shutdown_connections 2024-04-20T10:59:16.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:16.948+0000 7f0475693640 1 -- 172.21.15.90:0/86551479 wait complete. 2024-04-20T10:59:16.959 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:59:18.085 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:18.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.186+0000 7f0000681640 1 Processor -- start 2024-04-20T10:59:18.186 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.186+0000 7f0000681640 1 -- start start 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7f0000681640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8073810 0x7efff8154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7f0000681640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efff8157710 0x7efff80c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7f0000681640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efff80c40d0 con 0x7efff80ad0c0 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7f0000681640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7efff81569e0 con 0x7efff8157710 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7f0000681640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efff8157280 con 0x7efff8073810 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffdc1c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efff8157710 0x7efff80c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffdc1c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7efff8157710 0x7efff80c3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34702/0 (socket says 172.21.15.90:34702) 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffdc1c640 1 -- 172.21.15.90:0/249564914 learned_addr learned my addr 172.21.15.90:0/249564914 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffec1e640 1 --1- 172.21.15.90:0/249564914 >> v1:172.21.15.90:6789/0 conn(0x7efff80ad0c0 0x7efff80abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:49998/0 (socket says 172.21.15.90:49998) 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffe41d640 1 --2- 172.21.15.90:0/249564914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8073810 0x7efff8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffdc1c640 1 -- 172.21.15.90:0/249564914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8073810 msgr2=0x7efff8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffdc1c640 1 --2- 172.21.15.90:0/249564914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8073810 0x7efff8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.188 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffdc1c640 1 -- 172.21.15.90:0/249564914 >> v1:172.21.15.90:6789/0 conn(0x7efff80ad0c0 legacy=0x7efff80abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:18.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.187+0000 7efffdc1c640 1 -- 172.21.15.90:0/249564914 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff80c4370 con 0x7efff8157710 2024-04-20T10:59:18.189 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.188+0000 7efffdc1c640 1 --2- 172.21.15.90:0/249564914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8157710 0x7efff80c3b90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7effe8009870 tx=0x7effe802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a168bce740f38287 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.188+0000 7efffd41b640 1 -- 172.21.15.90:0/249564914 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe8035020 con 0x7efff8157710 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.188+0000 7efffd41b640 1 -- 172.21.15.90:0/249564914 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7effe8031640 con 0x7efff8157710 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.188+0000 7efffd41b640 1 -- 172.21.15.90:0/249564914 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effe802d040 con 0x7efff8157710 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 -- 172.21.15.90:0/249564914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8157710 msgr2=0x7efff80c3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 --2- 172.21.15.90:0/249564914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8157710 0x7efff80c3b90 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7effe8009870 tx=0x7effe802b8f0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 -- 172.21.15.90:0/249564914 shutdown_connections 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 --2- 172.21.15.90:0/249564914 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8157710 0x7efff80c3b90 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 --2- 172.21.15.90:0/249564914 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8073810 0x7efff8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.190 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 -- 172.21.15.90:0/249564914 >> 172.21.15.90:0/249564914 conn(0x7efff80c8080 msgr2=0x7efff80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:18.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 -- 172.21.15.90:0/249564914 shutdown_connections 2024-04-20T10:59:18.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.189+0000 7f0000681640 1 -- 172.21.15.90:0/249564914 wait complete. 2024-04-20T10:59:18.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 Processor -- start 2024-04-20T10:59:18.191 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 -- start start 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8073810 0x7efff8152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff80ad0c0 0x7efff8071120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8157710 0x7efff814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7efff8073bf0 con 0x7efff8073810 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7efff8156f10 con 0x7efff80ad0c0 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7f0000681640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7efff80ac2c0 con 0x7efff8157710 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.190+0000 7efffe41d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8073810 0x7efff8152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8073810 0x7efff8152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34712/0 (socket says 172.21.15.90:34712) 2024-04-20T10:59:18.193 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 -- 172.21.15.90:0/3689191859 learned_addr learned my addr 172.21.15.90:0/3689191859 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffec1e640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8157710 0x7efff814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffdc1c640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff80ad0c0 0x7efff8071120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 -- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8157710 msgr2=0x7efff814d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8157710 0x7efff814d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 -- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff80ad0c0 msgr2=0x7efff8071120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff80ad0c0 0x7efff8071120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 -- 172.21.15.90:0/3689191859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efff81dca50 con 0x7efff8073810 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7efffe41d640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8073810 0x7efff8152520 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7efff400d830 tx=0x7efff400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7effeeffd640 1 -- 172.21.15.90:0/3689191859 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff400b6c0 con 0x7efff8073810 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7effeeffd640 1 -- 172.21.15.90:0/3689191859 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efff4019070 con 0x7efff8073810 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efff814e640 con 0x7efff8073810 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7effeeffd640 1 -- 172.21.15.90:0/3689191859 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efff400ba80 con 0x7efff8073810 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.191+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efff814dd00 con 0x7efff8073810 2024-04-20T10:59:18.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.192+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efff814daf0 con 0x7efff8073810 2024-04-20T10:59:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.192+0000 7effeeffd640 1 -- 172.21.15.90:0/3689191859 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efff401e460 con 0x7efff8073810 2024-04-20T10:59:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.193+0000 7effeeffd640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7effdc06c8f0 0x7effdc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.193+0000 7effeeffd640 1 -- 172.21.15.90:0/3689191859 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7efff408c930 con 0x7efff8073810 2024-04-20T10:59:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.193+0000 7efffdc1c640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7effdc06c8f0 0x7effdc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:18.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.193+0000 7efffdc1c640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7effdc06c8f0 0x7effdc06edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7effe8036000 tx=0x7effe803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:18.197 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.197+0000 7effeeffd640 1 -- 172.21.15.90:0/3689191859 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7efff405a660 con 0x7efff8073810 2024-04-20T10:59:18.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.408+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efff80c8c40 con 0x7efff8073810 2024-04-20T10:59:18.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.409+0000 7effeeffd640 1 -- 172.21.15.90:0/3689191859 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) ==== 94+0+5704 (secure 0 0 0) 0x7efff4059f60 con 0x7efff8073810 2024-04-20T10:59:18.409 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:18.409 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:16.513212+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:clientreplay","state_seq":21,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:18.410 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 66 2024-04-20T10:59:18.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7effdc06c8f0 msgr2=0x7effdc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:18.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7effdc06c8f0 0x7effdc06edb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7effe8036000 tx=0x7effe803c040 comp rx=0 tx=0).stop 2024-04-20T10:59:18.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8073810 msgr2=0x7efff8152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8073810 0x7efff8152520 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7efff400d830 tx=0x7efff400dcf0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 shutdown_connections 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7effdc06c8f0 0x7effdc06edb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7efff8157710 0x7efff814d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7efff80ad0c0 0x7efff8071120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 --2- 172.21.15.90:0/3689191859 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7efff8073810 0x7efff8152520 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 >> 172.21.15.90:0/3689191859 conn(0x7efff80c8080 msgr2=0x7efff80c5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 shutdown_connections 2024-04-20T10:59:18.412 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:18.411+0000 7f0000681640 1 -- 172.21.15.90:0/3689191859 wait complete. 2024-04-20T10:59:18.422 INFO:tasks.mds_thrash.fs.[a]:no change 2024-04-20T10:59:18.675 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-20T10:59:18.675 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-20T10:59:18.938 DEBUG:teuthology.parallel:result is None 2024-04-20T10:59:18.960 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:19.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.057+0000 7f4b4b3b2640 1 Processor -- start 2024-04-20T10:59:19.058 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.057+0000 7f4b4b3b2640 1 -- start start 2024-04-20T10:59:19.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4b3b2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4b44157710 0x7f4b44154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:19.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4b3b2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4b440ad0c0 0x7f4b440ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:19.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4b3b2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b440c4370 con 0x7f4b44073810 2024-04-20T10:59:19.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4b3b2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f4b441569e0 con 0x7f4b44157710 2024-04-20T10:59:19.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4b3b2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4b44157280 con 0x7f4b440ad0c0 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4894d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4b44157710 0x7f4b44154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4894d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f4b44157710 0x7f4b44154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34728/0 (socket says 172.21.15.90:34728) 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4894d640 1 -- 172.21.15.90:0/1179718408 learned_addr learned my addr 172.21.15.90:0/1179718408 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4994f640 1 --2- 172.21.15.90:0/1179718408 >> v2:172.21.15.175:3300/0 conn(0x7f4b440ad0c0 0x7f4b440ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4894d640 1 -- 172.21.15.90:0/1179718408 >> v2:172.21.15.175:3300/0 conn(0x7f4b440ad0c0 msgr2=0x7f4b440ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4894d640 1 --2- 172.21.15.90:0/1179718408 >> v2:172.21.15.175:3300/0 conn(0x7f4b440ad0c0 0x7f4b440ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4894d640 1 -- 172.21.15.90:0/1179718408 >> v1:172.21.15.175:6789/0 conn(0x7f4b44073810 legacy=0x7f4b440c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.058+0000 7f4b4894d640 1 -- 172.21.15.90:0/1179718408 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b44156c30 con 0x7f4b44157710 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.059+0000 7f4b4894d640 1 --2- 172.21.15.90:0/1179718408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b44157710 0x7f4b44154000 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4b44070a90 tx=0x7f4b3402db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9f4cab66480b7c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.059+0000 7f4b3bfff640 1 -- 172.21.15.90:0/1179718408 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3402f8e0 con 0x7f4b44157710 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.059+0000 7f4b3bfff640 1 -- 172.21.15.90:0/1179718408 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b3402fa80 con 0x7f4b44157710 2024-04-20T10:59:19.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.059+0000 7f4b3bfff640 1 -- 172.21.15.90:0/1179718408 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b3402fe50 con 0x7f4b44157710 2024-04-20T10:59:19.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/1179718408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b44157710 msgr2=0x7f4b44154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:19.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/1179718408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b44157710 0x7f4b44154000 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4b44070a90 tx=0x7f4b3402db20 comp rx=0 tx=0).stop 2024-04-20T10:59:19.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/1179718408 shutdown_connections 2024-04-20T10:59:19.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/1179718408 >> v2:172.21.15.175:3300/0 conn(0x7f4b440ad0c0 0x7f4b440ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/1179718408 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b44157710 0x7f4b44154000 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/1179718408 >> 172.21.15.90:0/1179718408 conn(0x7f4b440c8080 msgr2=0x7f4b440c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:19.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/1179718408 shutdown_connections 2024-04-20T10:59:19.063 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.060+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/1179718408 wait complete. 2024-04-20T10:59:19.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.061+0000 7f4b4b3b2640 1 Processor -- start 2024-04-20T10:59:19.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.061+0000 7f4b4b3b2640 1 -- start start 2024-04-20T10:59:19.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4b3b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b44073810 0x7f4b441ed1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:19.066 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4b3b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b440ad0c0 0x7f4b440c29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4b3b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b44157710 0x7f4b4414b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4b3b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4b440abbb0 con 0x7f4b440ad0c0 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4b3b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4b44073bf0 con 0x7f4b44157710 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4b3b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4b440abd30 con 0x7f4b44073810 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b440ad0c0 0x7f4b440c29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b440ad0c0 0x7f4b440c29e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34744/0 (socket says 172.21.15.90:34744) 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 -- 172.21.15.90:0/2716654906 learned_addr learned my addr 172.21.15.90:0/2716654906 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:19.067 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4994f640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b44157710 0x7f4b4414b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4914e640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b44073810 0x7f4b441ed1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 -- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b44073810 msgr2=0x7f4b441ed1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b44073810 0x7f4b441ed1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 -- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b44157710 msgr2=0x7f4b4414b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b44157710 0x7f4b4414b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.062+0000 7f4b4894d640 1 -- 172.21.15.90:0/2716654906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b4409cfe0 con 0x7f4b440ad0c0 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.063+0000 7f4b4894d640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b440ad0c0 0x7f4b440c29e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4b3402db60 tx=0x7f4b340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.063+0000 7f4b39ffb640 1 -- 172.21.15.90:0/2716654906 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b34046020 con 0x7f4b440ad0c0 2024-04-20T10:59:19.068 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.063+0000 7f4b39ffb640 1 -- 172.21.15.90:0/2716654906 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b34037cd0 con 0x7f4b440ad0c0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.063+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b440aa830 con 0x7f4b440ad0c0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.063+0000 7f4b39ffb640 1 -- 172.21.15.90:0/2716654906 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b340426b0 con 0x7f4b440ad0c0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.063+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b440aadf0 con 0x7f4b440ad0c0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.064+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b44076150 con 0x7f4b440ad0c0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.064+0000 7f4b39ffb640 1 -- 172.21.15.90:0/2716654906 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4b34049020 con 0x7f4b440ad0c0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.065+0000 7f4b39ffb640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b2806c8f0 0x7f4b2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.065+0000 7f4b39ffb640 1 -- 172.21.15.90:0/2716654906 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 7497+0+0 (secure 0 0 0) 0x7f4b340aecf0 con 0x7f4b440ad0c0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.065+0000 7f4b4914e640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b2806c8f0 0x7f4b2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:19.069 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.065+0000 7f4b4914e640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b2806c8f0 0x7f4b2806edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b40001780 tx=0x7f4b40009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:19.070 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.069+0000 7f4b39ffb640 1 -- 172.21.15.90:0/2716654906 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4b3407c460 con 0x7f4b440ad0c0 2024-04-20T10:59:19.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.279+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4b440c2420 con 0x7f4b440ad0c0 2024-04-20T10:59:19.280 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.279+0000 7f4b39ffb640 1 -- 172.21.15.90:0/2716654906 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) ==== 94+0+5705 (secure 0 0 0) 0x7f4b34080760 con 0x7f4b440ad0c0 2024-04-20T10:59:19.280 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:19.280 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":67,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4769,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":61,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:57:57.628923+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":36,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5868":{"gid":5868,"name":"a","rank":0,"incarnation":57,"state":"up:active","state_seq":18,"addr":"172.21.15.90:6835/3994531378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":3994531378},{"type":"v1","addr":"172.21.15.90:6835","nonce":3994531378}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5868,"qdb_cluster":[5868]},"id":2}]} 2024-04-20T10:59:19.281 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 67 2024-04-20T10:59:19.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b2806c8f0 msgr2=0x7f4b2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:19.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b2806c8f0 0x7f4b2806edb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4b40001780 tx=0x7f4b40009040 comp rx=0 tx=0).stop 2024-04-20T10:59:19.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b440ad0c0 msgr2=0x7f4b440c29e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:19.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b440ad0c0 0x7f4b440c29e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f4b3402db60 tx=0x7f4b340046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.282 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 shutdown_connections 2024-04-20T10:59:19.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4b2806c8f0 0x7f4b2806edb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4b44157710 0x7f4b4414b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4b440ad0c0 0x7f4b440c29e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 --2- 172.21.15.90:0/2716654906 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4b44073810 0x7f4b441ed1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:19.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 >> 172.21.15.90:0/2716654906 conn(0x7f4b440c8080 msgr2=0x7f4b44156230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:19.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 shutdown_connections 2024-04-20T10:59:19.283 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:19.281+0000 7f4b4b3b2640 1 -- 172.21.15.90:0/2716654906 wait complete. 2024-04-20T10:59:19.293 INFO:tasks.mds_thrash.fs.[b]:waiting till mds map indicates mds.a is laggy/crashed, in failed state, or mds.a is removed from mdsmap 2024-04-20T10:59:20.423 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:20.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.530+0000 7f4ac96ba640 1 Processor -- start 2024-04-20T10:59:20.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.530+0000 7f4ac96ba640 1 -- start start 2024-04-20T10:59:20.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac96ba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac4153df0 0x7f4ac406cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:20.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac96ba640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f4ac415a810 0x7f4ac40c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:20.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac96ba640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ac40c6e60 con 0x7f4ac40c6a00 2024-04-20T10:59:20.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac96ba640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f4ac40ca690 con 0x7f4ac415a810 2024-04-20T10:59:20.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac96ba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac406c7b0 con 0x7f4ac4153df0 2024-04-20T10:59:20.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac27fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f4ac40c6a00 0x7f4ac40c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:50010/0 (socket says 172.21.15.90:50010) 2024-04-20T10:59:20.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac27fc640 1 -- 172.21.15.90:0/4118731181 learned_addr learned my addr 172.21.15.90:0/4118731181 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac2ffd640 1 --2- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac4153df0 0x7f4ac406cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac37fe640 1 --2- 172.21.15.90:0/4118731181 >> v2:172.21.15.175:3300/0 conn(0x7f4ac415a810 0x7f4ac40c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac1ffb640 1 -- 172.21.15.90:0/4118731181 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100737822 0 0) 0x7f4ac40c6e60 con 0x7f4ac40c6a00 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac1ffb640 1 -- 172.21.15.90:0/4118731181 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aac003520 con 0x7f4ac40c6a00 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac37fe640 1 -- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac4153df0 msgr2=0x7f4ac406cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac37fe640 1 --2- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac4153df0 0x7f4ac406cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac1ffb640 1 -- 172.21.15.90:0/4118731181 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2023215389 0 0) 0x7f4aac003520 con 0x7f4ac40c6a00 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac37fe640 1 -- 172.21.15.90:0/4118731181 >> v1:172.21.15.90:6789/0 conn(0x7f4ac40c6a00 legacy=0x7f4ac40c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac37fe640 1 -- 172.21.15.90:0/4118731181 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac40c7100 con 0x7f4ac415a810 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.531+0000 7f4ac2ffd640 1 --2- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac4153df0 0x7f4ac406cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:20.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.532+0000 7f4ac37fe640 1 --2- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415a810 0x7f4ac40c8a90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097d0 tx=0x7f4ab402b650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a085fe5f77e8d64e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.532+0000 7f4ac1ffb640 1 -- 172.21.15.90:0/4118731181 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4037070 con 0x7f4ac415a810 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.532+0000 7f4ac1ffb640 1 -- 172.21.15.90:0/4118731181 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab402be50 con 0x7f4ac415a810 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.532+0000 7f4ac1ffb640 1 -- 172.21.15.90:0/4118731181 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8001670 con 0x7f4ac415a810 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 -- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415a810 msgr2=0x7f4ac40c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415a810 0x7f4ac40c8a90 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4ab40097d0 tx=0x7f4ab402b650 comp rx=0 tx=0).stop 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 -- 172.21.15.90:0/4118731181 shutdown_connections 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac415a810 0x7f4ac40c8a90 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/4118731181 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac4153df0 0x7f4ac406cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 -- 172.21.15.90:0/4118731181 >> 172.21.15.90:0/4118731181 conn(0x7f4ac40adbd0 msgr2=0x7f4ac40adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 -- 172.21.15.90:0/4118731181 shutdown_connections 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.533+0000 7f4ac96ba640 1 -- 172.21.15.90:0/4118731181 wait complete. 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.534+0000 7f4ac96ba640 1 Processor -- start 2024-04-20T10:59:20.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.534+0000 7f4ac96ba640 1 -- start start 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac96ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40c6a00 0x7f4ac40aba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac96ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ac4153df0 0x7f4ac41587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac96ba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac415a810 0x7f4ac40c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac96ba640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac415aca0 con 0x7f4ac4153df0 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac96ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac406c440 con 0x7f4ac40c6a00 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac96ba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f4ac41541d0 con 0x7f4ac415a810 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ac4153df0 0x7f4ac41587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:20.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac27fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ac4153df0 0x7f4ac41587c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34750/0 (socket says 172.21.15.90:34750) 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac27fc640 1 -- 172.21.15.90:0/1594670188 learned_addr learned my addr 172.21.15.90:0/1594670188 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac27fc640 1 -- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac415a810 msgr2=0x7f4ac40c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.535+0000 7f4ac37fe640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac415a810 0x7f4ac40c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac2ffd640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40c6a00 0x7f4ac40aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac27fc640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac415a810 0x7f4ac40c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac27fc640 1 -- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40c6a00 msgr2=0x7f4ac40aba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac27fc640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40c6a00 0x7f4ac40aba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac27fc640 1 -- 172.21.15.90:0/1594670188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac4159760 con 0x7f4ac4153df0 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac37fe640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac415a810 0x7f4ac40c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac2ffd640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40c6a00 0x7f4ac40aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac27fc640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ac4153df0 0x7f4ac41587c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c750 tx=0x7f4ab800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4aab7fe640 1 -- 172.21.15.90:0/1594670188 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab8005ad0 con 0x7f4ac4153df0 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4aab7fe640 1 -- 172.21.15.90:0/1594670188 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ab8005c90 con 0x7f4ac4153df0 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac4159a20 con 0x7f4ac4153df0 2024-04-20T10:59:20.539 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4aab7fe640 1 -- 172.21.15.90:0/1594670188 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab80072b0 con 0x7f4ac4153df0 2024-04-20T10:59:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.536+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac4157fc0 con 0x7f4ac4153df0 2024-04-20T10:59:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.537+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac4076150 con 0x7f4ac4153df0 2024-04-20T10:59:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.537+0000 7f4aab7fe640 1 -- 172.21.15.90:0/1594670188 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ab8007450 con 0x7f4ac4153df0 2024-04-20T10:59:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.538+0000 7f4aab7fe640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4ab006c8f0 0x7f4ab006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.538+0000 7f4ac2ffd640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4ab006c8f0 0x7f4ab006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.538+0000 7f4aab7fe640 1 -- 172.21.15.90:0/1594670188 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f4ab808c0e0 con 0x7f4ac4153df0 2024-04-20T10:59:20.540 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.538+0000 7f4ac2ffd640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4ab006c8f0 0x7f4ab006edb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0074d0 tx=0x7f4abc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:20.542 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.542+0000 7f4aab7fe640 1 -- 172.21.15.90:0/1594670188 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f4ab8010300 con 0x7f4ac4153df0 2024-04-20T10:59:20.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.768+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ac406cce0 con 0x7f4ac4153df0 2024-04-20T10:59:20.771 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.769+0000 7f4aab7fe640 1 -- 172.21.15.90:0/1594670188 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+4873 (secure 0 0 0) 0x7f4ab8059dc0 con 0x7f4ac4153df0 2024-04-20T10:59:20.772 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:20.772 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:20.376459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 68 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4ab006c8f0 msgr2=0x7f4ab006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4ab006c8f0 0x7f4ab006edb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0074d0 tx=0x7f4abc00b040 comp rx=0 tx=0).stop 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ac4153df0 msgr2=0x7f4ac41587c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ac4153df0 0x7f4ac41587c0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f4ab800c750 tx=0x7f4ab800cc10 comp rx=0 tx=0).stop 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 shutdown_connections 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f4ab006c8f0 0x7f4ab006edb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f4ac415a810 0x7f4ac40c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f4ac4153df0 0x7f4ac41587c0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.773 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 --2- 172.21.15.90:0/1594670188 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f4ac40c6a00 0x7f4ac40aba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:20.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 >> 172.21.15.90:0/1594670188 conn(0x7f4ac40adbd0 msgr2=0x7f4ac40c8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:20.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 shutdown_connections 2024-04-20T10:59:20.774 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:20.771+0000 7f4ac96ba640 1 -- 172.21.15.90:0/1594670188 wait complete. 2024-04-20T10:59:20.783 INFO:tasks.mds_thrash.fs.[a]:mds.c has gained rank=0, replacing gid=5497 2024-04-20T10:59:20.783 INFO:tasks.mds_thrash.fs.[a]:waiting for 7 secs before reviving mds.b 2024-04-20T10:59:21.294 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:21.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.406+0000 7fb93a2c8640 1 Processor -- start 2024-04-20T10:59:21.407 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.406+0000 7fb93a2c8640 1 -- start start 2024-04-20T10:59:21.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb93a2c8640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9340ab730 0x7fb9341568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb93a2c8640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb9340c9ee0 0x7fb934156e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb93a2c8640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb93415a720 con 0x7fb934153ef0 2024-04-20T10:59:21.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb93a2c8640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb93415ac80 con 0x7fb9340ab730 2024-04-20T10:59:21.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb93a2c8640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb93415a9a0 con 0x7fb9340c9ee0 2024-04-20T10:59:21.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb9337fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9340ab730 0x7fb9341568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb9337fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb9340ab730 0x7fb9341568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34762/0 (socket says 172.21.15.90:34762) 2024-04-20T10:59:21.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.407+0000 7fb9337fe640 1 -- 172.21.15.90:0/2903823980 learned_addr learned my addr 172.21.15.90:0/2903823980 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:21.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.408+0000 7fb938865640 1 --2- 172.21.15.90:0/2903823980 >> v2:172.21.15.175:3300/0 conn(0x7fb9340c9ee0 0x7fb934156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.408+0000 7fb9337fe640 1 -- 172.21.15.90:0/2903823980 >> v2:172.21.15.175:3300/0 conn(0x7fb9340c9ee0 msgr2=0x7fb934156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:21.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.408+0000 7fb9337fe640 1 --2- 172.21.15.90:0/2903823980 >> v2:172.21.15.175:3300/0 conn(0x7fb9340c9ee0 0x7fb934156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.408+0000 7fb9337fe640 1 -- 172.21.15.90:0/2903823980 >> v1:172.21.15.90:6789/0 conn(0x7fb934153ef0 legacy=0x7fb9340c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.408+0000 7fb9337fe640 1 -- 172.21.15.90:0/2903823980 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9340c6a90 con 0x7fb9340ab730 2024-04-20T10:59:21.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.408+0000 7fb9337fe640 1 --2- 172.21.15.90:0/2903823980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340ab730 0x7fb9341568c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb9341578b0 tx=0x7fb92802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d6b9b6c91b0a52 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:21.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb932ffd640 1 -- 172.21.15.90:0/2903823980 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb92802e070 con 0x7fb9340ab730 2024-04-20T10:59:21.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb932ffd640 1 -- 172.21.15.90:0/2903823980 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb928037070 con 0x7fb9340ab730 2024-04-20T10:59:21.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb932ffd640 1 -- 172.21.15.90:0/2903823980 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928031a00 con 0x7fb9340ab730 2024-04-20T10:59:21.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 -- 172.21.15.90:0/2903823980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340ab730 msgr2=0x7fb9341568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/2903823980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340ab730 0x7fb9341568c0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb9341578b0 tx=0x7fb92802b880 comp rx=0 tx=0).stop 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 -- 172.21.15.90:0/2903823980 shutdown_connections 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/2903823980 >> v2:172.21.15.175:3300/0 conn(0x7fb9340c9ee0 0x7fb934156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/2903823980 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340ab730 0x7fb9341568c0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 -- 172.21.15.90:0/2903823980 >> 172.21.15.90:0/2903823980 conn(0x7fb9340cbfe0 msgr2=0x7fb9340cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 -- 172.21.15.90:0/2903823980 shutdown_connections 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.409+0000 7fb93a2c8640 1 -- 172.21.15.90:0/2903823980 wait complete. 2024-04-20T10:59:21.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.410+0000 7fb93a2c8640 1 Processor -- start 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb93a2c8640 1 -- start start 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb93a2c8640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9340ab730 0x7fb9341f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb93a2c8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340c9ee0 0x7fb9340b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb93a2c8640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb934153ef0 0x7fb9341ef780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb93a2c8640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340c9280 con 0x7fb9340c9ee0 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb93a2c8640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb9340c9100 con 0x7fb934153ef0 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb93a2c8640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb9340bf800 con 0x7fb9340ab730 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb9337fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340c9ee0 0x7fb9340b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb9337fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340c9ee0 0x7fb9340b18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34772/0 (socket says 172.21.15.90:34772) 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb9337fe640 1 -- 172.21.15.90:0/3160949453 learned_addr learned my addr 172.21.15.90:0/3160949453 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb938865640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb934153ef0 0x7fb9341ef780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.414 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.411+0000 7fb933fff640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9340ab730 0x7fb9341f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb9337fe640 1 -- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9340ab730 msgr2=0x7fb9341f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb9337fe640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9340ab730 0x7fb9341f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb9337fe640 1 -- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb934153ef0 msgr2=0x7fb9341ef780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb9337fe640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb934153ef0 0x7fb9341ef780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb9337fe640 1 -- 172.21.15.90:0/3160949453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb934150f80 con 0x7fb9340c9ee0 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb9337fe640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340c9ee0 0x7fb9340b18d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb92802b8c0 tx=0x7fb9280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb930ff9640 1 -- 172.21.15.90:0/3160949453 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928032670 con 0x7fb9340c9ee0 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb930ff9640 1 -- 172.21.15.90:0/3160949453 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb928032830 con 0x7fb9340c9ee0 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb934150aa0 con 0x7fb9340c9ee0 2024-04-20T10:59:21.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb930ff9640 1 -- 172.21.15.90:0/3160949453 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb928032c20 con 0x7fb9340c9ee0 2024-04-20T10:59:21.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.412+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9341533e0 con 0x7fb9340c9ee0 2024-04-20T10:59:21.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.413+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9340ab4d0 con 0x7fb9340c9ee0 2024-04-20T10:59:21.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.414+0000 7fb930ff9640 1 -- 172.21.15.90:0/3160949453 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb9280453f0 con 0x7fb9340c9ee0 2024-04-20T10:59:21.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.414+0000 7fb930ff9640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb92006c8f0 0x7fb92006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.414+0000 7fb930ff9640 1 -- 172.21.15.90:0/3160949453 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fb9280adf90 con 0x7fb9340c9ee0 2024-04-20T10:59:21.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.414+0000 7fb933fff640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb92006c8f0 0x7fb92006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.417 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.415+0000 7fb933fff640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb92006c8f0 0x7fb92006edb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb9240016e0 tx=0x7fb924009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:21.418 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.418+0000 7fb930ff9640 1 -- 172.21.15.90:0/3160949453 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb928040070 con 0x7fb9340c9ee0 2024-04-20T10:59:21.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.638+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9340c5c20 con 0x7fb9340c9ee0 2024-04-20T10:59:21.638 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.638+0000 7fb930ff9640 1 -- 172.21.15.90:0/3160949453 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+4873 (secure 0 0 0) 0x7fb92807b6b0 con 0x7fb9340c9ee0 2024-04-20T10:59:21.639 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:21.639 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:20.376459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:59:21.639 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 68 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb92006c8f0 msgr2=0x7fb92006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb92006c8f0 0x7fb92006edb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb9240016e0 tx=0x7fb924009040 comp rx=0 tx=0).stop 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340c9ee0 msgr2=0x7fb9340b18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340c9ee0 0x7fb9340b18d0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb92802b8c0 tx=0x7fb9280046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 shutdown_connections 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb92006c8f0 0x7fb92006edb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb934153ef0 0x7fb9341ef780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb9340c9ee0 0x7fb9340b18d0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 --2- 172.21.15.90:0/3160949453 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb9340ab730 0x7fb9341f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 >> 172.21.15.90:0/3160949453 conn(0x7fb9340cbfe0 msgr2=0x7fb9340ca3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 shutdown_connections 2024-04-20T10:59:21.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.640+0000 7fb93a2c8640 1 -- 172.21.15.90:0/3160949453 wait complete. 2024-04-20T10:59:21.652 INFO:tasks.mds_thrash.fs.[b]:mds.a down, removed from mdsmap 2024-04-20T10:59:21.652 INFO:tasks.mds_thrash.fs.[b]:waiting for mds cluster to stabilize... 2024-04-20T10:59:21.653 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.750+0000 7f5401d15640 1 Processor -- start 2024-04-20T10:59:21.750 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.750+0000 7f5401d15640 1 -- start start 2024-04-20T10:59:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.750+0000 7f5401d15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc0ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.750+0000 7f5401d15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53fc0ae720 0x7f53fc0c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.751 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.750+0000 7f5401d15640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53fc067a10 con 0x7f53fc0adee0 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.750+0000 7f5401d15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f53fc0c86d0 con 0x7f53fc0ae720 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.750+0000 7f5401d15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc067cf0 con 0x7f53fc151b40 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53fb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc0ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53faffd640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f53fc0ae720 0x7f53fc0c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53fbfff640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f53fc0adee0 0x7f53fc157980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:34016/0 (socket says 172.21.15.90:34016) 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53fbfff640 1 -- 172.21.15.90:0/1064146849 learned_addr learned my addr 172.21.15.90:0/1064146849 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53fb7fe640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc0ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:51206/0 (socket says 172.21.15.90:51206) 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53faffd640 1 -- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 msgr2=0x7f53fc0ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53faffd640 1 --2- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc0ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.752 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53faffd640 1 -- 172.21.15.90:0/1064146849 >> v1:172.21.15.175:6789/0 conn(0x7f53fc0adee0 legacy=0x7f53fc157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53faffd640 1 -- 172.21.15.90:0/1064146849 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc158430 con 0x7f53fc0ae720 2024-04-20T10:59:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53fa7fc640 1 -- 172.21.15.90:0/1064146849 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066092486 0 0) 0x7f53fc067a10 con 0x7f53fc0adee0 2024-04-20T10:59:21.753 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.751+0000 7f53fb7fe640 1 --2- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc0ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:21.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f53faffd640 1 --2- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0ae720 0x7f53fc0c3910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53f00097a0 tx=0x7f53f002b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c88c20cdad67655 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:21.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f53fa7fc640 1 -- 172.21.15.90:0/1064146849 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0038070 con 0x7f53fc0ae720 2024-04-20T10:59:21.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f53fa7fc640 1 -- 172.21.15.90:0/1064146849 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f0031700 con 0x7f53fc0ae720 2024-04-20T10:59:21.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f53fa7fc640 1 -- 172.21.15.90:0/1064146849 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0031ad0 con 0x7f53fc0ae720 2024-04-20T10:59:21.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 -- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0ae720 msgr2=0x7f53fc0c3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.756 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 --2- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0ae720 0x7f53fc0c3910 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f53f00097a0 tx=0x7f53f002b7a0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 -- 172.21.15.90:0/1064146849 shutdown_connections 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 --2- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0ae720 0x7f53fc0c3910 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 --2- 172.21.15.90:0/1064146849 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc0ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 -- 172.21.15.90:0/1064146849 >> 172.21.15.90:0/1064146849 conn(0x7f53fc0aa660 msgr2=0x7f53fc0aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 -- 172.21.15.90:0/1064146849 shutdown_connections 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.752+0000 7f5401d15640 1 -- 172.21.15.90:0/1064146849 wait complete. 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.753+0000 7f5401d15640 1 Processor -- start 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f5401d15640 1 -- start start 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f5401d15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0adee0 0x7f53fc14ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f5401d15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc0ae720 0x7f53fc14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f5401d15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc1ebe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.757 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f5401d15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc0ae390 con 0x7f53fc0ae720 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f5401d15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f53fc0c3e50 con 0x7f53fc0adee0 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f5401d15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f53fc158090 con 0x7f53fc151b40 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f53faffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc0ae720 0x7f53fc14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f53faffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc0ae720 0x7f53fc14f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34776/0 (socket says 172.21.15.90:34776) 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f53fbfff640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc1ebe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.754+0000 7f53faffd640 1 -- 172.21.15.90:0/4178721968 learned_addr learned my addr 172.21.15.90:0/4178721968 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53fb7fe640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0adee0 0x7f53fc14ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53faffd640 1 -- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 msgr2=0x7f53fc1ebe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53faffd640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc1ebe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53faffd640 1 -- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0adee0 msgr2=0x7f53fc14ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53faffd640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0adee0 0x7f53fc14ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53faffd640 1 -- 172.21.15.90:0/4178721968 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53fc1e05d0 con 0x7f53fc0ae720 2024-04-20T10:59:21.758 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53fbfff640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc1ebe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:21.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53faffd640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc0ae720 0x7f53fc14f010 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f53f0036040 tx=0x7f53f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:21.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53e3fff640 1 -- 172.21.15.90:0/4178721968 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f0038040 con 0x7f53fc0ae720 2024-04-20T10:59:21.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53e3fff640 1 -- 172.21.15.90:0/4178721968 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53f0004230 con 0x7f53fc0ae720 2024-04-20T10:59:21.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53fc14bdb0 con 0x7f53fc0ae720 2024-04-20T10:59:21.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f53e3fff640 1 -- 172.21.15.90:0/4178721968 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53f003e650 con 0x7f53fc0ae720 2024-04-20T10:59:21.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.755+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53fc1eb680 con 0x7f53fc0ae720 2024-04-20T10:59:21.759 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.756+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53fc076150 con 0x7f53fc0ae720 2024-04-20T10:59:21.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.757+0000 7f53e3fff640 1 -- 172.21.15.90:0/4178721968 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f53f00315c0 con 0x7f53fc0ae720 2024-04-20T10:59:21.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.757+0000 7f53e3fff640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f53e806c8f0 0x7f53e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:21.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.757+0000 7f53fb7fe640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f53e806c8f0 0x7f53e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:21.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.757+0000 7f53e3fff640 1 -- 172.21.15.90:0/4178721968 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f53f00add70 con 0x7f53fc0ae720 2024-04-20T10:59:21.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.757+0000 7f53fb7fe640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f53e806c8f0 0x7f53e806edb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009a30 tx=0x7f53ec008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:21.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.761+0000 7f53e3fff640 1 -- 172.21.15.90:0/4178721968 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f53f0043020 con 0x7f53fc0ae720 2024-04-20T10:59:21.845 INFO:tasks.ceph.mds.c.smithi090.stderr:2024-04-20T10:59:21.845+0000 7f3d20cfa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:59:21.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.979+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f53fc0c2a20 con 0x7f53fc0ae720 2024-04-20T10:59:21.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.979+0000 7f53e3fff640 1 -- 172.21.15.90:0/4178721968 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+4873 (secure 0 0 0) 0x7f53f0030070 con 0x7f53fc0ae720 2024-04-20T10:59:21.980 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:21.980 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:20.376459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:59:21.980 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 68 2024-04-20T10:59:21.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.981+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f53e806c8f0 msgr2=0x7f53e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.981+0000 7f5401d15640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f53e806c8f0 0x7f53e806edb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009a30 tx=0x7f53ec008040 comp rx=0 tx=0).stop 2024-04-20T10:59:21.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.981+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc0ae720 msgr2=0x7f53fc14f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:21.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.981+0000 7f5401d15640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc0ae720 0x7f53fc14f010 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f53f0036040 tx=0x7f53f00046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 shutdown_connections 2024-04-20T10:59:21.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f53e806c8f0 0x7f53e806edb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f53fc151b40 0x7f53fc1ebe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f53fc0ae720 0x7f53fc14f010 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 --2- 172.21.15.90:0/4178721968 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f53fc0adee0 0x7f53fc14ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:21.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 >> 172.21.15.90:0/4178721968 conn(0x7f53fc0aa660 msgr2=0x7f53fc0a93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:21.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 shutdown_connections 2024-04-20T10:59:21.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:21.982+0000 7f5401d15640 1 -- 172.21.15.90:0/4178721968 wait complete. 2024-04-20T10:59:21.994 INFO:tasks.mds_thrash.fs.[b]:mds map: { "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "default_fscid": 1, "epoch": 68, "feature_flags": { "enable_multiple": true, "ever_enabled_multiple": true }, "filesystems": [ { "id": 1, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:39.915256+0000", "damaged": [], "data_pools": [ 3 ], "enabled": true, "epoch": 67, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "a", "in": [ 0 ], "info": { "gid_5964": { "addr": "172.21.15.90:6837/1253561572", "addrs": { "addrvec": [ { "addr": "172.21.15.90:6836", "nonce": 1253561572, "type": "v2" }, { "addr": "172.21.15.90:6837", "nonce": 1253561572, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 5964, "incarnation": 63, "join_fscid": -1, "name": "c", "rank": 0, "state": "up:active", "state_seq": 22 } }, "last_failure": 0, "last_failure_osd_epoch": 37, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 2, "modified": "2024-04-20T10:59:18.505405+0000", "qdb_cluster": [ 5964 ], "qdb_leader": 5964, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 5964 } } }, { "id": 2, "mdsmap": { "bal_rank_mask": "-1", "balancer": "", "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "created": "2024-04-20T10:50:48.982985+0000", "damaged": [], "data_pools": [ 5 ], "enabled": true, "epoch": 68, "ever_allowed_features": 0, "explicitly_allowed_features": 0, "failed": [], "flags": 18, "flags_state": { "allow_multimds_snaps": true, "allow_snaps": true, "allow_standby_replay": false, "balance_automate": false, "joinable": true, "refuse_client_session": false, "refuse_standby_for_another_fs": false }, "fs_name": "b", "in": [ 0 ], "info": { "gid_4769": { "addr": "172.21.15.175:6835/3644701296", "addrs": { "addrvec": [ { "addr": "172.21.15.175:6834", "nonce": 3644701296, "type": "v2" }, { "addr": "172.21.15.175:6835", "nonce": 3644701296, "type": "v1" } ] }, "compat": { "compat": {}, "incompat": { "feature_1": "base v0.20", "feature_10": "snaprealm v2", "feature_11": "minor log segments", "feature_12": "quiesce subvolumes", "feature_2": "client writeable ranges", "feature_3": "default file layouts on dirs", "feature_4": "dir inode in separate object", "feature_5": "mds uses versioned encoding", "feature_6": "dirfrag is stored in omap", "feature_7": "mds uses inline data", "feature_8": "no anchor table", "feature_9": "file layout v2" }, "ro_compat": {} }, "export_targets": [], "features": 4540701547738038271, "flags": 0, "gid": 4769, "incarnation": 68, "join_fscid": -1, "name": "d", "rank": 0, "state": "up:replay", "state_seq": 1 } }, "last_failure": 0, "last_failure_osd_epoch": 38, "max_file_size": 1099511627776, "max_mds": 1, "max_xattr_size": 65536, "metadata_pool": 4, "modified": "2024-04-20T10:59:20.376459+0000", "qdb_cluster": [], "qdb_leader": 0, "required_client_features": {}, "root": 0, "session_autoclose": 300, "session_timeout": 300, "snap_rstat": true, "standby_count_wanted": 0, "stopped": [], "tableserver": 0, "up": { "mds_0": 4769 } } } ], "standbys": [] } 2024-04-20T10:59:23.994 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:24.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.107+0000 7f9c656a5640 1 Processor -- start 2024-04-20T10:59:24.107 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.107+0000 7f9c656a5640 1 -- start start 2024-04-20T10:59:24.108 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c656a5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c60153df0 0x7f9c6006cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c656a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c6015a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c656a5640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9c600c9f80 0x7f9c600c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c656a5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6015ad50 con 0x7f9c60153df0 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c656a5640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9c6006c7b0 con 0x7f9c600c9f80 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c656a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9c600c6e60 con 0x7f9c600c6a00 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c60153df0 0x7f9c6006cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9c60153df0 0x7f9c6006cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34788/0 (socket says 172.21.15.90:34788) 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 -- 172.21.15.90:0/95837547 learned_addr learned my addr 172.21.15.90:0/95837547 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5f7fe640 1 --2- 172.21.15.90:0/95837547 >> v2:172.21.15.175:3300/0 conn(0x7f9c600c9f80 0x7f9c600c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c57fff640 1 --2- 172.21.15.90:0/95837547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c6015a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 -- 172.21.15.90:0/95837547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 msgr2=0x7f9c6015a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:24.109 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 --2- 172.21.15.90:0/95837547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c6015a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 -- 172.21.15.90:0/95837547 >> v2:172.21.15.175:3300/0 conn(0x7f9c600c9f80 msgr2=0x7f9c600c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:24.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 --2- 172.21.15.90:0/95837547 >> v2:172.21.15.175:3300/0 conn(0x7f9c600c9f80 0x7f9c600c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.110 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.108+0000 7f9c5effd640 1 -- 172.21.15.90:0/95837547 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c600c7100 con 0x7f9c60153df0 2024-04-20T10:59:24.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.109+0000 7f9c5effd640 1 --2- 172.21.15.90:0/95837547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c60153df0 0x7f9c6006cc40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009870 tx=0x7f9c5002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ade960e2b2128e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:24.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.109+0000 7f9c5e7fc640 1 -- 172.21.15.90:0/95837547 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c50038070 con 0x7f9c60153df0 2024-04-20T10:59:24.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.109+0000 7f9c5e7fc640 1 -- 172.21.15.90:0/95837547 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c50031740 con 0x7f9c60153df0 2024-04-20T10:59:24.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.109+0000 7f9c5e7fc640 1 -- 172.21.15.90:0/95837547 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c5002f050 con 0x7f9c60153df0 2024-04-20T10:59:24.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 -- 172.21.15.90:0/95837547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c60153df0 msgr2=0x7f9c6006cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:24.111 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 --2- 172.21.15.90:0/95837547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c60153df0 0x7f9c6006cc40 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9c50009870 tx=0x7f9c5002b7e0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 -- 172.21.15.90:0/95837547 shutdown_connections 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 --2- 172.21.15.90:0/95837547 >> v2:172.21.15.175:3300/0 conn(0x7f9c600c9f80 0x7f9c600c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 --2- 172.21.15.90:0/95837547 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c6015a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 --2- 172.21.15.90:0/95837547 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c60153df0 0x7f9c6006cc40 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 -- 172.21.15.90:0/95837547 >> 172.21.15.90:0/95837547 conn(0x7f9c600adbd0 msgr2=0x7f9c600adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 -- 172.21.15.90:0/95837547 shutdown_connections 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.110+0000 7f9c656a5640 1 -- 172.21.15.90:0/95837547 wait complete. 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.111+0000 7f9c656a5640 1 Processor -- start 2024-04-20T10:59:24.112 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.111+0000 7f9c656a5640 1 -- start start 2024-04-20T10:59:24.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c656a5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c601eea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:24.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c656a5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c600c9f80 0x7f9c601eef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:24.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c656a5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c60153df0 0x7f9c60156bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:24.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c656a5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9c601541d0 con 0x7f9c600c9f80 2024-04-20T10:59:24.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c656a5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9c6006c440 con 0x7f9c60153df0 2024-04-20T10:59:24.114 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c656a5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9c600c73e0 con 0x7f9c600c6a00 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c600c9f80 0x7f9c601eef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c600c9f80 0x7f9c601eef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:34794/0 (socket says 172.21.15.90:34794) 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 -- 172.21.15.90:0/3916390239 learned_addr learned my addr 172.21.15.90:0/3916390239 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c5effd640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c601eea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c5f7fe640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c60153df0 0x7f9c60156bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 -- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 msgr2=0x7f9c601eea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c601eea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 -- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c60153df0 msgr2=0x7f9c60156bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c60153df0 0x7f9c60156bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 -- 172.21.15.90:0/3916390239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c601555b0 con 0x7f9c600c9f80 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.112+0000 7f9c57fff640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c600c9f80 0x7f9c601eef70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800e870 tx=0x7f9c4800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.113+0000 7f9c577fe640 1 -- 172.21.15.90:0/3916390239 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c48017070 con 0x7f9c600c9f80 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.113+0000 7f9c577fe640 1 -- 172.21.15.90:0/3916390239 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c4800ee60 con 0x7f9c600c9f80 2024-04-20T10:59:24.115 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.113+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c60155890 con 0x7f9c600c9f80 2024-04-20T10:59:24.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.113+0000 7f9c577fe640 1 -- 172.21.15.90:0/3916390239 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4800cb80 con 0x7f9c600c9f80 2024-04-20T10:59:24.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.113+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c60155e50 con 0x7f9c600c9f80 2024-04-20T10:59:24.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.114+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c60076150 con 0x7f9c600c9f80 2024-04-20T10:59:24.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.114+0000 7f9c577fe640 1 -- 172.21.15.90:0/3916390239 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9c4801a070 con 0x7f9c600c9f80 2024-04-20T10:59:24.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.115+0000 7f9c577fe640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c4006c8f0 0x7f9c4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:24.116 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.115+0000 7f9c5effd640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c4006c8f0 0x7f9c4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:24.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.115+0000 7f9c577fe640 1 -- 172.21.15.90:0/3916390239 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f9c4808c3f0 con 0x7f9c600c9f80 2024-04-20T10:59:24.117 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.115+0000 7f9c5effd640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c4006c8f0 0x7f9c4006edb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9c50035000 tx=0x7f9c50008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:24.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.119+0000 7f9c577fe640 1 -- 172.21.15.90:0/3916390239 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9c48059a80 con 0x7f9c600c9f80 2024-04-20T10:59:24.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.334+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c601ed570 con 0x7f9c600c9f80 2024-04-20T10:59:24.335 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.335+0000 7f9c577fe640 1 -- 172.21.15.90:0/3916390239 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+4873 (secure 0 0 0) 0x7f9c4805dd80 con 0x7f9c600c9f80 2024-04-20T10:59:24.335 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:24.335 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:20.376459+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:replay","state_seq":1,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:59:24.336 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 68 2024-04-20T10:59:24.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c4006c8f0 msgr2=0x7f9c4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:24.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c4006c8f0 0x7f9c4006edb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9c50035000 tx=0x7f9c50008030 comp rx=0 tx=0).stop 2024-04-20T10:59:24.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c600c9f80 msgr2=0x7f9c601eef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:24.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c600c9f80 0x7f9c601eef70 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9c4800e870 tx=0x7f9c4800ed30 comp rx=0 tx=0).stop 2024-04-20T10:59:24.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 shutdown_connections 2024-04-20T10:59:24.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9c4006c8f0 0x7f9c4006edb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9c60153df0 0x7f9c60156bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9c600c9f80 0x7f9c601eef70 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 --2- 172.21.15.90:0/3916390239 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9c600c6a00 0x7f9c601eea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:24.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 >> 172.21.15.90:0/3916390239 conn(0x7f9c600adbd0 msgr2=0x7f9c60152890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:24.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 shutdown_connections 2024-04-20T10:59:24.338 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:24.337+0000 7f9c656a5640 1 -- 172.21.15.90:0/3916390239 wait complete. 2024-04-20T10:59:24.348 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:59:26.349 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:26.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.460+0000 7f7db2fa4640 1 Processor -- start 2024-04-20T10:59:26.460 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.460+0000 7f7db2fa4640 1 -- start start 2024-04-20T10:59:26.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.460+0000 7f7db2fa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7dac073810 0x7f7dac154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.460+0000 7f7db2fa4640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7dac0ad0c0 0x7f7dac0ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.460+0000 7f7db2fa4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dac0c4370 con 0x7f7dac157710 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db2fa4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f7dac1569e0 con 0x7f7dac073810 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db2fa4640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7dac157280 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db0d40640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7dac073810 0x7f7dac154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db0d40640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f7dac073810 0x7f7dac154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53382/0 (socket says 172.21.15.90:53382) 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db0d40640 1 -- 172.21.15.90:0/616705331 learned_addr learned my addr 172.21.15.90:0/616705331 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db1541640 1 --2- 172.21.15.90:0/616705331 >> v2:172.21.15.175:3300/0 conn(0x7f7dac0ad0c0 0x7f7dac0ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db0d40640 1 -- 172.21.15.90:0/616705331 >> v2:172.21.15.175:3300/0 conn(0x7f7dac0ad0c0 msgr2=0x7f7dac0ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db0d40640 1 --2- 172.21.15.90:0/616705331 >> v2:172.21.15.175:3300/0 conn(0x7f7dac0ad0c0 0x7f7dac0ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db0d40640 1 -- 172.21.15.90:0/616705331 >> v1:172.21.15.175:6789/0 conn(0x7f7dac157710 legacy=0x7f7dac0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:26.462 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.461+0000 7f7db0d40640 1 -- 172.21.15.90:0/616705331 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac156c30 con 0x7f7dac073810 2024-04-20T10:59:26.463 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.462+0000 7f7db0d40640 1 --2- 172.21.15.90:0/616705331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac073810 0x7f7dac154000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0c42a0 tx=0x7f7da002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925321fe566f70b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.462+0000 7f7dab7fe640 1 -- 172.21.15.90:0/616705331 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0035020 con 0x7f7dac073810 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.462+0000 7f7dab7fe640 1 -- 172.21.15.90:0/616705331 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7da0031870 con 0x7f7dac073810 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.462+0000 7f7dab7fe640 1 -- 172.21.15.90:0/616705331 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7da0031c40 con 0x7f7dac073810 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.462+0000 7f7db2fa4640 1 -- 172.21.15.90:0/616705331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac073810 msgr2=0x7f7dac154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.462+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/616705331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac073810 0x7f7dac154000 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f7dac0c42a0 tx=0x7f7da002b910 comp rx=0 tx=0).stop 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.463+0000 7f7db2fa4640 1 -- 172.21.15.90:0/616705331 shutdown_connections 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.463+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/616705331 >> v2:172.21.15.175:3300/0 conn(0x7f7dac0ad0c0 0x7f7dac0ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.463+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/616705331 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac073810 0x7f7dac154000 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.463+0000 7f7db2fa4640 1 -- 172.21.15.90:0/616705331 >> 172.21.15.90:0/616705331 conn(0x7f7dac0c8080 msgr2=0x7f7dac0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:26.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.463+0000 7f7db2fa4640 1 -- 172.21.15.90:0/616705331 shutdown_connections 2024-04-20T10:59:26.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.463+0000 7f7db2fa4640 1 -- 172.21.15.90:0/616705331 wait complete. 2024-04-20T10:59:26.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.464+0000 7f7db2fa4640 1 Processor -- start 2024-04-20T10:59:26.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.464+0000 7f7db2fa4640 1 -- start start 2024-04-20T10:59:26.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db2fa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dac073810 0x7f7dac1df140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:26.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db2fa4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac0ad0c0 0x7f7dac1eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db2fa4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dac157710 0x7f7dac152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db2fa4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac0abbb0 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db2fa4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7dac073bf0 con 0x7f7dac073810 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db2fa4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7dac0abd30 con 0x7f7dac157710 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac0ad0c0 0x7f7dac1eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac0ad0c0 0x7f7dac1eac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53384/0 (socket says 172.21.15.90:53384) 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 -- 172.21.15.90:0/2223689428 learned_addr learned my addr 172.21.15.90:0/2223689428 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db0d40640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dac073810 0x7f7dac1df140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db1541640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dac157710 0x7f7dac152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 -- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dac157710 msgr2=0x7f7dac152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dac157710 0x7f7dac152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 -- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dac073810 msgr2=0x7f7dac1df140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dac073810 0x7f7dac1df140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 -- 172.21.15.90:0/2223689428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dac1de0c0 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7dabfff640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac0ad0c0 0x7f7dac1eac80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c3c0 tx=0x7f7d9800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7da97fa640 1 -- 172.21.15.90:0/2223689428 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d980052d0 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7da97fa640 1 -- 172.21.15.90:0/2223689428 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d98005490 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7da97fa640 1 -- 172.21.15.90:0/2223689428 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d98007260 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.465+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dac1de360 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.466+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dac1dcca0 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.467+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac076150 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.467+0000 7f7da97fa640 1 -- 172.21.15.90:0/2223689428 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7d98007400 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.467+0000 7f7da97fa640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7d9006c8f0 0x7f7d9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.467+0000 7f7da97fa640 1 -- 172.21.15.90:0/2223689428 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f7d9808b660 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.469 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.468+0000 7f7db0d40640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7d9006c8f0 0x7f7d9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:26.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.468+0000 7f7db0d40640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7d9006c8f0 0x7f7d9006edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7da0036000 tx=0x7f7da003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:26.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.472+0000 7f7da97fa640 1 -- 172.21.15.90:0/2223689428 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7d98058d80 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.687+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dac0c8c40 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.687+0000 7f7da97fa640 1 -- 172.21.15.90:0/2223689428 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+4878 (secure 0 0 0) 0x7f7d9805d080 con 0x7f7dac0ad0c0 2024-04-20T10:59:26.688 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:26.688 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":69,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":69,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:25.550069+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:reconnect","state_seq":100,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:59:26.688 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 69 2024-04-20T10:59:26.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7d9006c8f0 msgr2=0x7f7d9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:26.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7d9006c8f0 0x7f7d9006edb0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7da0036000 tx=0x7f7da003c040 comp rx=0 tx=0).stop 2024-04-20T10:59:26.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac0ad0c0 msgr2=0x7f7dac1eac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:26.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac0ad0c0 0x7f7dac1eac80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800c3c0 tx=0x7f7d9800c880 comp rx=0 tx=0).stop 2024-04-20T10:59:26.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 shutdown_connections 2024-04-20T10:59:26.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7d9006c8f0 0x7f7d9006edb0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7dac157710 0x7f7dac152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7dac0ad0c0 0x7f7dac1eac80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 --2- 172.21.15.90:0/2223689428 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7dac073810 0x7f7dac1df140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:26.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 >> 172.21.15.90:0/2223689428 conn(0x7f7dac0c8080 msgr2=0x7f7dac0c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:26.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 shutdown_connections 2024-04-20T10:59:26.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:26.690+0000 7f7db2fa4640 1 -- 172.21.15.90:0/2223689428 wait complete. 2024-04-20T10:59:26.701 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:59:27.784 INFO:tasks.mds_thrash.fs.[a]:reviving mds.b 2024-04-20T10:59:27.784 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-20T10:59:27.785 DEBUG:teuthology.orchestra.run.smithi175:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-20T10:59:27.787 INFO:tasks.ceph.mds.b:Started 2024-04-20T10:59:27.787 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:27.869 INFO:tasks.ceph.mds.b.smithi175.stdout:starting mds.b at 2024-04-20T10:59:27.900 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.900+0000 7fb49dd32640 1 Processor -- start 2024-04-20T10:59:27.901 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.900+0000 7fb49dd32640 1 -- start start 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb49dd32640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb4980c4bb0 0x7fb498159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb49dd32640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb49815a340 0x7fb4981611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb49dd32640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4980af590 con 0x7fb498154040 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb49dd32640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb4980acb20 con 0x7fb49815a340 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb49dd32640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb4980acd70 con 0x7fb4980c4bb0 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb497fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb49815a340 0x7fb4981611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb497fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb49815a340 0x7fb4981611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53396/0 (socket says 172.21.15.90:53396) 2024-04-20T10:59:27.902 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb497fff640 1 -- 172.21.15.90:0/1927904931 learned_addr learned my addr 172.21.15.90:0/1927904931 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:27.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.901+0000 7fb496ffd640 1 --2- 172.21.15.90:0/1927904931 >> v2:172.21.15.175:3300/0 conn(0x7fb4980c4bb0 0x7fb498159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:27.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.902+0000 7fb497fff640 1 -- 172.21.15.90:0/1927904931 >> v2:172.21.15.175:3300/0 conn(0x7fb4980c4bb0 msgr2=0x7fb498159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:27.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.902+0000 7fb497fff640 1 --2- 172.21.15.90:0/1927904931 >> v2:172.21.15.175:3300/0 conn(0x7fb4980c4bb0 0x7fb498159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:27.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.902+0000 7fb497fff640 1 -- 172.21.15.90:0/1927904931 >> v1:172.21.15.175:6789/0 conn(0x7fb498154040 legacy=0x7fb4980730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:27.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.902+0000 7fb497fff640 1 -- 172.21.15.90:0/1927904931 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4980c6400 con 0x7fb49815a340 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.902+0000 7fb497fff640 1 --2- 172.21.15.90:0/1927904931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815a340 0x7fb4981611e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb4980c4a80 tx=0x7fb49002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bd5b4e0c76b02b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.902+0000 7fb4967fc640 1 -- 172.21.15.90:0/1927904931 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49002c960 con 0x7fb49815a340 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb4967fc640 1 -- 172.21.15.90:0/1927904931 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb49002cb00 con 0x7fb49815a340 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb4967fc640 1 -- 172.21.15.90:0/1927904931 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4900343f0 con 0x7fb49815a340 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 -- 172.21.15.90:0/1927904931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815a340 msgr2=0x7fb4981611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 --2- 172.21.15.90:0/1927904931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815a340 0x7fb4981611e0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fb4980c4a80 tx=0x7fb49002bdc0 comp rx=0 tx=0).stop 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 -- 172.21.15.90:0/1927904931 shutdown_connections 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 --2- 172.21.15.90:0/1927904931 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb49815a340 0x7fb4981611e0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 --2- 172.21.15.90:0/1927904931 >> v2:172.21.15.175:3300/0 conn(0x7fb4980c4bb0 0x7fb498159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 -- 172.21.15.90:0/1927904931 >> 172.21.15.90:0/1927904931 conn(0x7fb4980676c0 msgr2=0x7fb498067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:27.904 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 -- 172.21.15.90:0/1927904931 shutdown_connections 2024-04-20T10:59:27.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.903+0000 7fb49dd32640 1 -- 172.21.15.90:0/1927904931 wait complete. 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.904+0000 7fb49dd32640 1 Processor -- start 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb49dd32640 1 -- start start 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb49dd32640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4980c4bb0 0x7fb4980c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb49dd32640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb498154040 0x7fb4981457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb49dd32640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49815a340 0x7fb498153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb49dd32640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb4980737f0 con 0x7fb4980c4bb0 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb49dd32640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb49815a7b0 con 0x7fb498154040 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb49dd32640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb498073970 con 0x7fb49815a340 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb4977fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4980c4bb0 0x7fb4980c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb4977fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4980c4bb0 0x7fb4980c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53402/0 (socket says 172.21.15.90:53402) 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.905+0000 7fb4977fe640 1 -- 172.21.15.90:0/2230027899 learned_addr learned my addr 172.21.15.90:0/2230027899 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:27.907 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb496ffd640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb498154040 0x7fb4981457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb497fff640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49815a340 0x7fb498153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb4977fe640 1 -- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49815a340 msgr2=0x7fb498153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb4977fe640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49815a340 0x7fb498153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb4977fe640 1 -- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb498154040 msgr2=0x7fb4981457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb4977fe640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb498154040 0x7fb4981457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb4977fe640 1 -- 172.21.15.90:0/2230027899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb498151b30 con 0x7fb4980c4bb0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb4977fe640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4980c4bb0 0x7fb4980c9a20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb48800c430 tx=0x7fb48800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb47ffff640 1 -- 172.21.15.90:0/2230027899 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb488011790 con 0x7fb4980c4bb0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb47ffff640 1 -- 172.21.15.90:0/2230027899 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb488017070 con 0x7fb4980c4bb0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb47ffff640 1 -- 172.21.15.90:0/2230027899 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb488011bb0 con 0x7fb4980c4bb0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb498151650 con 0x7fb4980c4bb0 2024-04-20T10:59:27.908 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.906+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4981f0660 con 0x7fb4980c4bb0 2024-04-20T10:59:27.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.907+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb498076150 con 0x7fb4980c4bb0 2024-04-20T10:59:27.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.908+0000 7fb47ffff640 1 -- 172.21.15.90:0/2230027899 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb48801c460 con 0x7fb4980c4bb0 2024-04-20T10:59:27.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.908+0000 7fb47ffff640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb48406c8f0 0x7fb48406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:27.909 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.908+0000 7fb47ffff640 1 -- 172.21.15.90:0/2230027899 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fb48808bff0 con 0x7fb4980c4bb0 2024-04-20T10:59:27.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.908+0000 7fb496ffd640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb48406c8f0 0x7fb48406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:27.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.908+0000 7fb496ffd640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb48406c8f0 0x7fb48406edb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb498069160 tx=0x7fb48c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:27.912 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:27.912+0000 7fb47ffff640 1 -- 172.21.15.90:0/2230027899 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb488059680 con 0x7fb4980c4bb0 2024-04-20T10:59:28.124 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.124+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4981463b0 con 0x7fb4980c4bb0 2024-04-20T10:59:28.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.125+0000 7fb47ffff640 1 -- 172.21.15.90:0/2230027899 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) ==== 94+0+4875 (secure 0 0 0) 0x7fb48805d980 con 0x7fb4980c4bb0 2024-04-20T10:59:28.125 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:28.125 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":70,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:26.546784+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:rejoin","state_seq":101,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:59:28.125 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 70 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb48406c8f0 msgr2=0x7fb48406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb48406c8f0 0x7fb48406edb0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb498069160 tx=0x7fb48c008040 comp rx=0 tx=0).stop 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4980c4bb0 msgr2=0x7fb4980c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4980c4bb0 0x7fb4980c9a20 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fb48800c430 tx=0x7fb48800c8f0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 shutdown_connections 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb48406c8f0 0x7fb48406edb0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb49815a340 0x7fb498153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb498154040 0x7fb4981457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 --2- 172.21.15.90:0/2230027899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb4980c4bb0 0x7fb4980c9a20 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.126+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 >> 172.21.15.90:0/2230027899 conn(0x7fb4980676c0 msgr2=0x7fb4980ac080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:28.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.127+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 shutdown_connections 2024-04-20T10:59:28.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.127+0000 7fb49dd32640 1 -- 172.21.15.90:0/2230027899 wait complete. 2024-04-20T10:59:28.138 INFO:tasks.mds_thrash.fs.[a]:waiting till mds map indicates mds.b is in active, standby or standby-replay 2024-04-20T10:59:28.703 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:28.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.800+0000 7f41ab796640 1 Processor -- start 2024-04-20T10:59:28.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.800+0000 7f41ab796640 1 -- start start 2024-04-20T10:59:28.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41ab796640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41a406f000 0x7f41a406e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:28.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41ab796640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a40c50b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:28.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41ab796640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41a4156e90 con 0x7f41a4153c90 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41ab796640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f41a40c4590 con 0x7f41a406f000 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41ab796640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41a40c3fd0 con 0x7f41a40ad4c0 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a9d33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a40c50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a8d31640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41a406f000 0x7f41a406e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a9532640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7f41a4153c90 0x7f41a4156780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:46040/0 (socket says 172.21.15.90:46040) 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a9532640 1 -- 172.21.15.90:0/4020889758 learned_addr learned my addr 172.21.15.90:0/4020889758 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a9d33640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a40c50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:48468/0 (socket says 172.21.15.90:48468) 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a8d31640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f41a406f000 0x7f41a406e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3300/0 says I am v2:172.21.15.90:41528/0 (socket says 172.21.15.90:41528) 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a8d31640 1 -- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 msgr2=0x7f41a40c50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a8d31640 1 --2- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a40c50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a8d31640 1 -- 172.21.15.90:0/4020889758 >> v1:172.21.15.175:6789/0 conn(0x7f41a4153c90 legacy=0x7f41a4156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a8d31640 1 -- 172.21.15.90:0/4020889758 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a40c42b0 con 0x7f41a406f000 2024-04-20T10:59:28.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f419bfff640 1 -- 172.21.15.90:0/4020889758 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685110841 0 0) 0x7f41a4156e90 con 0x7f41a4153c90 2024-04-20T10:59:28.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.801+0000 7f41a9d33640 1 --2- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a40c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.802+0000 7f41a8d31640 1 --2- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a406f000 0x7f41a406e8e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41940097a0 tx=0x7f419402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25ab916a2f01f094 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.802+0000 7f419bfff640 1 -- 172.21.15.90:0/4020889758 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194038070 con 0x7f41a406f000 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.802+0000 7f419bfff640 1 -- 172.21.15.90:0/4020889758 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4194031700 con 0x7f41a406f000 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.802+0000 7f419bfff640 1 -- 172.21.15.90:0/4020889758 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4194031ad0 con 0x7f41a406f000 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 -- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a406f000 msgr2=0x7f41a406e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 --2- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a406f000 0x7f41a406e8e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f41940097a0 tx=0x7f419402b7a0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 -- 172.21.15.90:0/4020889758 shutdown_connections 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 --2- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a40c50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 --2- 172.21.15.90:0/4020889758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a406f000 0x7f41a406e8e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.804 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 -- 172.21.15.90:0/4020889758 >> 172.21.15.90:0/4020889758 conn(0x7f41a406bb10 msgr2=0x7f41a406bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:28.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 -- 172.21.15.90:0/4020889758 shutdown_connections 2024-04-20T10:59:28.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.803+0000 7f41ab796640 1 -- 172.21.15.90:0/4020889758 wait complete. 2024-04-20T10:59:28.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.804+0000 7f41ab796640 1 Processor -- start 2024-04-20T10:59:28.805 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.804+0000 7f41ab796640 1 -- start start 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41ab796640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a406f000 0x7f41a41efc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41ab796640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a41ed100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41ab796640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4153c90 0x7f41a40c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41ab796640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f41a4154070 con 0x7f41a406f000 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41ab796640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f41a406e3c0 con 0x7f41a4153c90 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41ab796640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f41a41541f0 con 0x7f41a40ad4c0 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a406f000 0x7f41a41efc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a406f000 0x7f41a41efc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53404/0 (socket says 172.21.15.90:53404) 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 -- 172.21.15.90:0/3897815821 learned_addr learned my addr 172.21.15.90:0/3897815821 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a8d31640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a41ed100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9d33640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4153c90 0x7f41a40c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 -- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 msgr2=0x7f41a41ed100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:28.807 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a41ed100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 -- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4153c90 msgr2=0x7f41a40c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4153c90 0x7f41a40c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 -- 172.21.15.90:0/3897815821 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41a4073390 con 0x7f41a406f000 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41a9532640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a406f000 0x7f41a41efc10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c430 tx=0x7f41a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f4199ffb640 1 -- 172.21.15.90:0/3897815821 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a00074e0 con 0x7f41a406f000 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f4199ffb640 1 -- 172.21.15.90:0/3897815821 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41a00047e0 con 0x7f41a406f000 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41a4073670 con 0x7f41a406f000 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.805+0000 7f4199ffb640 1 -- 172.21.15.90:0/3897815821 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41a0004bd0 con 0x7f41a406f000 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.806+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41a41ed640 con 0x7f41a406f000 2024-04-20T10:59:28.808 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.807+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41a41ef200 con 0x7f41a406f000 2024-04-20T10:59:28.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.807+0000 7f4199ffb640 1 -- 172.21.15.90:0/3897815821 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41a0011070 con 0x7f41a406f000 2024-04-20T10:59:28.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.807+0000 7f4199ffb640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f418806c920 0x7f418806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:28.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.808+0000 7f4199ffb640 1 -- 172.21.15.90:0/3897815821 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f41a008bf20 con 0x7f41a406f000 2024-04-20T10:59:28.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.808+0000 7f41a8d31640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f418806c920 0x7f418806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:28.809 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.808+0000 7f41a8d31640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f418806c920 0x7f418806ede0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4194035000 tx=0x7f4194008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:28.812 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:28.812+0000 7f4199ffb640 1 -- 172.21.15.90:0/3897815821 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f41a0059c00 con 0x7f41a406f000 2024-04-20T10:59:29.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.021+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41a4076150 con 0x7f41a406f000 2024-04-20T10:59:29.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.022+0000 7f4199ffb640 1 -- 172.21.15.90:0/3897815821 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+5708 (secure 0 0 0) 0x7f41a0059500 con 0x7f41a406f000 2024-04-20T10:59:29.022 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:29.023 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":71,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":71,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:27.580702+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:clientreplay","state_seq":102,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-04-20T10:59:29.023 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 71 2024-04-20T10:59:29.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f418806c920 msgr2=0x7f418806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:29.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f418806c920 0x7f418806ede0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4194035000 tx=0x7f4194008030 comp rx=0 tx=0).stop 2024-04-20T10:59:29.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a406f000 msgr2=0x7f41a41efc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a406f000 0x7f41a41efc10 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f41a000c430 tx=0x7f41a000c8f0 comp rx=0 tx=0).stop 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 shutdown_connections 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f418806c920 0x7f418806ede0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f41a4153c90 0x7f41a40c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f41a40ad4c0 0x7f41a41ed100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 --2- 172.21.15.90:0/3897815821 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f41a406f000 0x7f41a41efc10 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 >> 172.21.15.90:0/3897815821 conn(0x7f41a406bb10 msgr2=0x7f41a40ac150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 shutdown_connections 2024-04-20T10:59:29.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:29.024+0000 7f41ab796640 1 -- 172.21.15.90:0/3897815821 wait complete. 2024-04-20T10:59:29.035 INFO:tasks.mds_thrash.fs.[b]:no change 2024-04-20T10:59:29.742 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-04-20T10:59:29.743 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-04-20T10:59:30.054 DEBUG:teuthology.parallel:result is None 2024-04-20T10:59:30.054 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-20T10:59:30.139 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:30.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.242+0000 7fa56008c640 1 Processor -- start 2024-04-20T10:59:30.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.242+0000 7fa56008c640 1 -- start start 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa56008c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fa558151b40 0x7fa5580ab960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa56008c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa558157980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa56008c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa558067a10 con 0x7fa5580ae720 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa56008c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fa5580c86d0 con 0x7fa558151b40 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa56008c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa558067cf0 con 0x7fa5580adee0 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa55d627640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fa5580ae720 0x7fa5580c3910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47704/0 (socket says 172.21.15.90:47704) 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa55d627640 1 -- 172.21.15.90:0/2472984375 learned_addr learned my addr 172.21.15.90:0/2472984375 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa55e629640 1 --2- 172.21.15.90:0/2472984375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa558157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:30.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa55de28640 1 --2- 172.21.15.90:0/2472984375 >> v2:172.21.15.175:3300/0 conn(0x7fa558151b40 0x7fa5580ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:30.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa55ce26640 1 -- 172.21.15.90:0/2472984375 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 785317058 0 0) 0x7fa558067a10 con 0x7fa5580ae720 2024-04-20T10:59:30.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.243+0000 7fa55ce26640 1 -- 172.21.15.90:0/2472984375 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa544003520 con 0x7fa5580ae720 2024-04-20T10:59:30.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.244+0000 7fa55e629640 1 -- 172.21.15.90:0/2472984375 >> v2:172.21.15.175:3300/0 conn(0x7fa558151b40 msgr2=0x7fa5580ab960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:30.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.244+0000 7fa55e629640 1 --2- 172.21.15.90:0/2472984375 >> v2:172.21.15.175:3300/0 conn(0x7fa558151b40 0x7fa5580ab960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.244+0000 7fa55e629640 1 -- 172.21.15.90:0/2472984375 >> v1:172.21.15.90:6789/0 conn(0x7fa5580ae720 legacy=0x7fa5580c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:30.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.244+0000 7fa55e629640 1 -- 172.21.15.90:0/2472984375 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa558158430 con 0x7fa5580adee0 2024-04-20T10:59:30.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.244+0000 7fa55de28640 1 --2- 172.21.15.90:0/2472984375 >> v2:172.21.15.175:3300/0 conn(0x7fa558151b40 0x7fa5580ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:30.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.244+0000 7fa55e629640 1 --2- 172.21.15.90:0/2472984375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa558157980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa550009d90 tx=0x7fa55002bd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bee1a448a44da917 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:30.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa55ce26640 1 -- 172.21.15.90:0/2472984375 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550039070 con 0x7fa5580adee0 2024-04-20T10:59:30.246 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa55ce26640 1 -- 172.21.15.90:0/2472984375 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa55002cb30 con 0x7fa5580adee0 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa55ce26640 1 -- 172.21.15.90:0/2472984375 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa550034440 con 0x7fa5580adee0 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 -- 172.21.15.90:0/2472984375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 msgr2=0x7fa558157980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 --2- 172.21.15.90:0/2472984375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa558157980 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa550009d90 tx=0x7fa55002bd80 comp rx=0 tx=0).stop 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 -- 172.21.15.90:0/2472984375 shutdown_connections 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 --2- 172.21.15.90:0/2472984375 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa558157980 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 --2- 172.21.15.90:0/2472984375 >> v2:172.21.15.175:3300/0 conn(0x7fa558151b40 0x7fa5580ab960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 -- 172.21.15.90:0/2472984375 >> 172.21.15.90:0/2472984375 conn(0x7fa5580aa660 msgr2=0x7fa5580aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 -- 172.21.15.90:0/2472984375 shutdown_connections 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.245+0000 7fa56008c640 1 -- 172.21.15.90:0/2472984375 wait complete. 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.246+0000 7fa56008c640 1 Processor -- start 2024-04-20T10:59:30.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.246+0000 7fa56008c640 1 -- start start 2024-04-20T10:59:30.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa56008c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa5581edf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:30.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa56008c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5580ae720 0x7fa5581ee490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:30.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa56008c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558151b40 0x7fa5580730d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:30.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa56008c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580ae4f0 con 0x7fa5580ae720 2024-04-20T10:59:30.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa56008c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa5580ae370 con 0x7fa558151b40 2024-04-20T10:59:30.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa56008c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa5580c82f0 con 0x7fa5580adee0 2024-04-20T10:59:30.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5580ae720 0x7fa5581ee490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5580ae720 0x7fa5581ee490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53422/0 (socket says 172.21.15.90:53422) 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 -- 172.21.15.90:0/260013113 learned_addr learned my addr 172.21.15.90:0/260013113 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55de28640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa5581edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55e629640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558151b40 0x7fa5580730d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 -- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 msgr2=0x7fa5581edf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa5581edf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 -- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558151b40 msgr2=0x7fa5580730d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558151b40 0x7fa5580730d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.247+0000 7fa55d627640 1 -- 172.21.15.90:0/260013113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa55814b270 con 0x7fa5580ae720 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.248+0000 7fa55d627640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5580ae720 0x7fa5581ee490 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c390 tx=0x7fa54800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.248+0000 7fa54e7fc640 1 -- 172.21.15.90:0/260013113 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa548017070 con 0x7fa5580ae720 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.248+0000 7fa54e7fc640 1 -- 172.21.15.90:0/260013113 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa548005ce0 con 0x7fa5580ae720 2024-04-20T10:59:30.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.248+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa558156330 con 0x7fa5580ae720 2024-04-20T10:59:30.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.248+0000 7fa54e7fc640 1 -- 172.21.15.90:0/260013113 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5480072f0 con 0x7fa5580ae720 2024-04-20T10:59:30.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.248+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5581568f0 con 0x7fa5580ae720 2024-04-20T10:59:30.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.249+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa558076150 con 0x7fa5580ae720 2024-04-20T10:59:30.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.249+0000 7fa54e7fc640 1 -- 172.21.15.90:0/260013113 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa54801a070 con 0x7fa5580ae720 2024-04-20T10:59:30.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.250+0000 7fa54e7fc640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:30.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.250+0000 7fa54e7fc640 1 -- 172.21.15.90:0/260013113 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fa54808b580 con 0x7fa5580ae720 2024-04-20T10:59:30.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.250+0000 7fa55de28640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:30.252 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.250+0000 7fa55de28640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa558157c40 tx=0x7fa554009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:30.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.254+0000 7fa54e7fc640 1 -- 172.21.15.90:0/260013113 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa548058ca0 con 0x7fa5580ae720 2024-04-20T10:59:30.339 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-20T10:59:30.339 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-04-20T10:59:30.368 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-04-20T10:59:30.369 DEBUG:teuthology.run_tasks:Unwinding manager mds_thrash 2024-04-20T10:59:30.669 INFO:tasks.mds_thrash:joining mds_thrasher 2024-04-20T10:59:30.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.484+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa558073f70 con 0x7fa5580ae720 2024-04-20T10:59:30.670 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.484+0000 7fa54e7fc640 1 -- 172.21.15.90:0/260013113 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5709 (secure 0 0 0) 0x7fa54805cfa0 con 0x7fa5580ae720 2024-04-20T10:59:30.670 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:30.670 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":72,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:29.552819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":103,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4769,"qdb_cluster":[4769]},"id":2}]} 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 72 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 msgr2=0x7fa53c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa558157c40 tx=0x7fa554009190 comp rx=0 tx=0).stop 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5580ae720 msgr2=0x7fa5581ee490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5580ae720 0x7fa5581ee490 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa54800c390 tx=0x7fa54800c850 comp rx=0 tx=0).stop 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 shutdown_connections 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa53c06c8f0 0x7fa53c06edb0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa558151b40 0x7fa5580730d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa5580ae720 0x7fa5581ee490 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 --2- 172.21.15.90:0/260013113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa5580adee0 0x7fa5581edf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 >> 172.21.15.90:0/260013113 conn(0x7fa5580aa660 msgr2=0x7fa5580a9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 shutdown_connections 2024-04-20T10:59:30.672 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:30.486+0000 7fa56008c640 1 -- 172.21.15.90:0/260013113 wait complete. 2024-04-20T10:59:30.673 INFO:tasks.mds_thrash.fs.[a]:mds.b reported in up:standby state 2024-04-20T10:59:30.673 INFO:tasks.mds_thrash.fs.[a]:waiting for 110 secs before thrashing 2024-04-20T10:59:30.928 INFO:tasks.ceph.mds.d.smithi175.stderr:2024-04-20T10:59:30.928+0000 7f8691dbd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T10:59:31.037 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:31.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.137+0000 7fb559152640 1 Processor -- start 2024-04-20T10:59:31.137 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.137+0000 7fb559152640 1 -- start start 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb559152640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5540c7fd0 0x7fb5540c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb559152640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5540c8460 con 0x7fb55406ef90 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb559152640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5540c33e0 con 0x7fb5540c7bf0 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb559152640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb5540c4480 con 0x7fb5540c7fd0 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb55359e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb5540c7fd0 0x7fb5540c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb55259c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb55406ef90 0x7fb55415ef80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:47708/0 (socket says 172.21.15.90:47708) 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb55259c640 1 -- 172.21.15.90:0/1436145509 learned_addr learned my addr 172.21.15.90:0/1436145509 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb55359e640 1 -- 172.21.15.90:0/1436145509 >> v1:172.21.15.175:6789/0 conn(0x7fb5540c7bf0 legacy=0x7fb5540c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb55359e640 1 -- 172.21.15.90:0/1436145509 >> v1:172.21.15.90:6789/0 conn(0x7fb55406ef90 legacy=0x7fb55415ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb551d9b640 1 -- 172.21.15.90:0/1436145509 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433431644 0 0) 0x7fb548001110 con 0x7fb55406ef90 2024-04-20T10:59:31.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.138+0000 7fb55359e640 1 -- 172.21.15.90:0/1436145509 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5540c36c0 con 0x7fb5540c7fd0 2024-04-20T10:59:31.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.139+0000 7fb55359e640 1 --2- 172.21.15.90:0/1436145509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5540c7fd0 0x7fb5540c23f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0097a0 tx=0x7fb54c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a764b03ae972524 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:31.140 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.139+0000 7fb551d9b640 1 -- 172.21.15.90:0/1436145509 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0315a0 con 0x7fb5540c7fd0 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.139+0000 7fb551d9b640 1 -- 172.21.15.90:0/1436145509 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c037070 con 0x7fb5540c7fd0 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.139+0000 7fb551d9b640 1 -- 172.21.15.90:0/1436145509 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54c031960 con 0x7fb5540c7fd0 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.140+0000 7fb559152640 1 -- 172.21.15.90:0/1436145509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5540c7fd0 msgr2=0x7fb5540c23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.140+0000 7fb559152640 1 --2- 172.21.15.90:0/1436145509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5540c7fd0 0x7fb5540c23f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fb54c0097a0 tx=0x7fb54c02b840 comp rx=0 tx=0).stop 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.140+0000 7fb559152640 1 -- 172.21.15.90:0/1436145509 shutdown_connections 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.140+0000 7fb559152640 1 --2- 172.21.15.90:0/1436145509 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb5540c7fd0 0x7fb5540c23f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.140+0000 7fb559152640 1 -- 172.21.15.90:0/1436145509 >> 172.21.15.90:0/1436145509 conn(0x7fb5540aa660 msgr2=0x7fb5540aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.140+0000 7fb559152640 1 -- 172.21.15.90:0/1436145509 shutdown_connections 2024-04-20T10:59:31.141 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.140+0000 7fb559152640 1 -- 172.21.15.90:0/1436145509 wait complete. 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.141+0000 7fb559152640 1 Processor -- start 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.141+0000 7fb559152640 1 -- start start 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb559152640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55406ef90 0x7fb55415a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb559152640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5540c7bf0 0x7fb55414d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb559152640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5540c7fd0 0x7fb5541eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb559152640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb5540c3ff0 con 0x7fb55406ef90 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb559152640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb5540c2930 con 0x7fb5540c7fd0 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb559152640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb5540c3c80 con 0x7fb5540c7bf0 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55406ef90 0x7fb55415a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55406ef90 0x7fb55415a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:53448/0 (socket says 172.21.15.90:53448) 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 -- 172.21.15.90:0/3484191185 learned_addr learned my addr 172.21.15.90:0/3484191185 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb55259c640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5540c7bf0 0x7fb55414d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb55359e640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5540c7fd0 0x7fb5541eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 -- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5540c7bf0 msgr2=0x7fb55414d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:31.144 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5540c7bf0 0x7fb55414d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 -- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5540c7fd0 msgr2=0x7fb5541eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5540c7fd0 0x7fb5541eda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.142+0000 7fb552d9d640 1 -- 172.21.15.90:0/3484191185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5541ed210 con 0x7fb55406ef90 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.143+0000 7fb552d9d640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55406ef90 0x7fb55415a640 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb54400c870 tx=0x7fb54400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.143+0000 7fb53b7fe640 1 -- 172.21.15.90:0/3484191185 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb544003b70 con 0x7fb55406ef90 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.143+0000 7fb53b7fe640 1 -- 172.21.15.90:0/3484191185 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb544003d30 con 0x7fb55406ef90 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.143+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5541ed4b0 con 0x7fb55406ef90 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.143+0000 7fb53b7fe640 1 -- 172.21.15.90:0/3484191185 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54400aa30 con 0x7fb55406ef90 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.143+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55414cd90 con 0x7fb55406ef90 2024-04-20T10:59:31.145 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.144+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb554076150 con 0x7fb55406ef90 2024-04-20T10:59:31.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.144+0000 7fb53b7fe640 1 -- 172.21.15.90:0/3484191185 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb54400abd0 con 0x7fb55406ef90 2024-04-20T10:59:31.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.145+0000 7fb53b7fe640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb54006c8f0 0x7fb54006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:31.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.145+0000 7fb53b7fe640 1 -- 172.21.15.90:0/3484191185 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fb54408bfc0 con 0x7fb55406ef90 2024-04-20T10:59:31.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.145+0000 7fb55259c640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb54006c8f0 0x7fb54006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:31.146 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.145+0000 7fb55259c640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb54006c8f0 0x7fb54006edb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb5541e3ec0 tx=0x7fb548007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:31.149 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.149+0000 7fb53b7fe640 1 -- 172.21.15.90:0/3484191185 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb5440596e0 con 0x7fb55406ef90 2024-04-20T10:59:31.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.360+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb55414f8c0 con 0x7fb55406ef90 2024-04-20T10:59:31.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.360+0000 7fb53b7fe640 1 -- 172.21.15.90:0/3484191185 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) ==== 94+0+5709 (secure 0 0 0) 0x7fb54405d9e0 con 0x7fb55406ef90 2024-04-20T10:59:31.361 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:31.361 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":72,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:29.552819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":103,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4769,"qdb_cluster":[4769]},"id":2}]} 2024-04-20T10:59:31.361 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 72 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb54006c8f0 msgr2=0x7fb54006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb54006c8f0 0x7fb54006edb0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb5541e3ec0 tx=0x7fb548007b50 comp rx=0 tx=0).stop 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55406ef90 msgr2=0x7fb55415a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55406ef90 0x7fb55415a640 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb54400c870 tx=0x7fb54400cd30 comp rx=0 tx=0).stop 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 shutdown_connections 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb54006c8f0 0x7fb54006edb0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb5540c7fd0 0x7fb5541eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb5540c7bf0 0x7fb55414d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:31.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 --2- 172.21.15.90:0/3484191185 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb55406ef90 0x7fb55415a640 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:31.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.362+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 >> 172.21.15.90:0/3484191185 conn(0x7fb5540aa660 msgr2=0x7fb55414eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:31.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.363+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 shutdown_connections 2024-04-20T10:59:31.364 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:31.363+0000 7fb559152640 1 -- 172.21.15.90:0/3484191185 wait complete. 2024-04-20T10:59:31.374 INFO:tasks.mds_thrash.fs.[b]:mds.d has gained rank=0, replacing gid=5868 2024-04-20T10:59:31.374 INFO:tasks.mds_thrash.fs.[b]:waiting for 9 secs before reviving mds.a 2024-04-20T10:59:40.375 INFO:tasks.mds_thrash.fs.[b]:reviving mds.a 2024-04-20T10:59:40.376 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-20T10:59:40.376 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-20T10:59:40.379 INFO:tasks.ceph.mds.a:Started 2024-04-20T10:59:40.379 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T10:59:40.464 INFO:tasks.ceph.mds.a.smithi090.stdout:starting mds.a at 2024-04-20T10:59:40.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.491+0000 7f375ae50640 1 Processor -- start 2024-04-20T10:59:40.491 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.491+0000 7f375ae50640 1 -- start start 2024-04-20T10:59:40.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.491+0000 7f375ae50640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3754153ef0 0x7f37540c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f375ae50640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375415a720 con 0x7f37540ab730 2024-04-20T10:59:40.492 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f375ae50640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375415ac80 con 0x7f37540c9ee0 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f375ae50640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f375415a9a0 con 0x7f3754153ef0 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f374bfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f37540ab730 0x7f37541568c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54356/0 (socket says 172.21.15.90:54356) 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f374bfff640 1 -- 172.21.15.90:0/2266164686 learned_addr learned my addr 172.21.15.90:0/2266164686 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f3758bec640 1 --2- 172.21.15.90:0/2266164686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3754153ef0 0x7f37540c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688254418 0 0) 0x7f3744001110 con 0x7f37540ab730 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f373c003520 con 0x7f37540ab730 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674291489 0 0) 0x7f375415ac80 con 0x7f37540c9ee0 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3744001110 con 0x7f37540c9ee0 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f3758bec640 1 -- 172.21.15.90:0/2266164686 >> v1:172.21.15.175:6789/0 conn(0x7f37540c9ee0 legacy=0x7f3754156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3905790296 0 0) 0x7f373c003520 con 0x7f37540ab730 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f3758bec640 1 -- 172.21.15.90:0/2266164686 >> v1:172.21.15.90:6789/0 conn(0x7f37540ab730 legacy=0x7f37541568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.493 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.492+0000 7f3758bec640 1 -- 172.21.15.90:0/2266164686 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37540c6a90 con 0x7f3754153ef0 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.493+0000 7f3758bec640 1 --2- 172.21.15.90:0/2266164686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3754153ef0 0x7f37540c89f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37500097d0 tx=0x7f375002b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a654068113a84d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.493+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3750037070 con 0x7f3754153ef0 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.493+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3750030510 con 0x7f3754153ef0 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.493+0000 7f374b7fe640 1 -- 172.21.15.90:0/2266164686 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744001860 con 0x7f3754153ef0 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.494+0000 7f375ae50640 1 -- 172.21.15.90:0/2266164686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3754153ef0 msgr2=0x7f37540c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.494+0000 7f375ae50640 1 --2- 172.21.15.90:0/2266164686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3754153ef0 0x7f37540c89f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f37500097d0 tx=0x7f375002b6e0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.494+0000 7f375ae50640 1 -- 172.21.15.90:0/2266164686 shutdown_connections 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.494+0000 7f375ae50640 1 --2- 172.21.15.90:0/2266164686 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f3754153ef0 0x7f37540c89f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.494+0000 7f375ae50640 1 -- 172.21.15.90:0/2266164686 >> 172.21.15.90:0/2266164686 conn(0x7f37540cbfe0 msgr2=0x7f37540cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.494+0000 7f375ae50640 1 -- 172.21.15.90:0/2266164686 shutdown_connections 2024-04-20T10:59:40.495 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.494+0000 7f375ae50640 1 -- 172.21.15.90:0/2266164686 wait complete. 2024-04-20T10:59:40.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.495+0000 7f375ae50640 1 Processor -- start 2024-04-20T10:59:40.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.495+0000 7f375ae50640 1 -- start start 2024-04-20T10:59:40.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f375ae50640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37540ab730 0x7f3754150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f375ae50640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37540c9ee0 0x7f37540c2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f375ae50640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3754153ef0 0x7f3754155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f375ae50640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f37540bf800 con 0x7f37540c9ee0 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f375ae50640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f37540c8f30 con 0x7f3754153ef0 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f375ae50640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f37540bfbb0 con 0x7f37540ab730 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37540c9ee0 0x7f37540c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37540c9ee0 0x7f37540c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39200/0 (socket says 172.21.15.90:39200) 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 -- 172.21.15.90:0/2959138991 learned_addr learned my addr 172.21.15.90:0/2959138991 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f37593ed640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3754153ef0 0x7f3754155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f3758bec640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37540ab730 0x7f3754150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.498 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 -- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37540ab730 msgr2=0x7f3754150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37540ab730 0x7f3754150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 -- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3754153ef0 msgr2=0x7f3754155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3754153ef0 0x7f3754155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f374bfff640 1 -- 172.21.15.90:0/2959138991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37541ef4d0 con 0x7f37540c9ee0 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.496+0000 7f37593ed640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3754153ef0 0x7f3754155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.497+0000 7f374bfff640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37540c9ee0 0x7f37540c2760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f374400cac0 tx=0x7f374400cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.497+0000 7f37497fa640 1 -- 172.21.15.90:0/2959138991 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744017070 con 0x7f37540c9ee0 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.497+0000 7f37497fa640 1 -- 172.21.15.90:0/2959138991 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3744005ce0 con 0x7f37540c9ee0 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.497+0000 7f37497fa640 1 -- 172.21.15.90:0/2959138991 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3744007270 con 0x7f37540c9ee0 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.497+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37541ef7b0 con 0x7f37540c9ee0 2024-04-20T10:59:40.499 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.497+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37541efd70 con 0x7f37540c9ee0 2024-04-20T10:59:40.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.498+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3754076150 con 0x7f37540c9ee0 2024-04-20T10:59:40.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.498+0000 7f37497fa640 1 -- 172.21.15.90:0/2959138991 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f374401a070 con 0x7f37540c9ee0 2024-04-20T10:59:40.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.499+0000 7f37497fa640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f374006c8f0 0x7f374006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.499+0000 7f37497fa640 1 -- 172.21.15.90:0/2959138991 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f374408b810 con 0x7f37540c9ee0 2024-04-20T10:59:40.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.499+0000 7f3758bec640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f374006c8f0 0x7f374006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.500 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.499+0000 7f3758bec640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f374006c8f0 0x7f374006edb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3750034000 tx=0x7f3750008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:40.503 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.503+0000 7f37497fa640 1 -- 172.21.15.90:0/2959138991 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f375415a720 con 0x7f37540c9ee0 2024-04-20T10:59:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.715+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37540bf5e0 con 0x7f37540c9ee0 2024-04-20T10:59:40.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.715+0000 7f37497fa640 1 -- 172.21.15.90:0/2959138991 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+6534 (secure 0 0 0) 0x7f3744058f30 con 0x7f37540c9ee0 2024-04-20T10:59:40.716 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:40.716 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":73,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2387787206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2387787206},{"type":"v1","addr":"172.21.15.90:6835","nonce":2387787206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:29.552819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":103,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4769,"qdb_cluster":[4769]},"id":2}]} 2024-04-20T10:59:40.716 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 73 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f374006c8f0 msgr2=0x7f374006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f374006c8f0 0x7f374006edb0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3750034000 tx=0x7f3750008030 comp rx=0 tx=0).stop 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37540c9ee0 msgr2=0x7f37540c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37540c9ee0 0x7f37540c2760 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f374400cac0 tx=0x7f374400cf80 comp rx=0 tx=0).stop 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 shutdown_connections 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f374006c8f0 0x7f374006edb0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f3754153ef0 0x7f3754155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.718 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f37540c9ee0 0x7f37540c2760 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 --2- 172.21.15.90:0/2959138991 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f37540ab730 0x7f3754150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 >> 172.21.15.90:0/2959138991 conn(0x7f37540cbfe0 msgr2=0x7f375406c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 shutdown_connections 2024-04-20T10:59:40.719 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.717+0000 7f375ae50640 1 -- 172.21.15.90:0/2959138991 wait complete. 2024-04-20T10:59:40.729 INFO:tasks.mds_thrash.fs.[b]:mds.a reported in up:standby state 2024-04-20T10:59:40.729 INFO:tasks.mds_thrash.fs.[b]:stat['max_mds'] = 0 2024-04-20T10:59:40.729 INFO:tasks.mds_thrash.fs.[b]:stat['deactivate'] = 0 2024-04-20T10:59:40.729 INFO:tasks.mds_thrash.fs.[b]:stat['kill'] = 6 2024-04-20T10:59:40.729 INFO:tasks.mds_thrash:done joining 2024-04-20T10:59:40.730 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-20T10:59:40.739 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-20T10:59:40.739 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:59:40.740 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T10:59:40.756 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T10:59:40.756 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T10:59:40.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:59:40.948 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.948+0000 7f6b313b6640 1 Processor -- start 2024-04-20T10:59:40.949 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.948+0000 7f6b313b6640 1 -- start start 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b313b6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6b2c0c4600 0x7f6b2c0ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b313b6640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2c0acaa0 con 0x7f6b2c0ac2b0 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b313b6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b2c15a750 con 0x7f6b2c153d60 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b313b6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2c0acdf0 con 0x7f6b2c0c4600 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b2b7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6b2c0c4600 0x7f6b2c0ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b2a7fc640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6b2c0ac2b0 0x7f6b2c0c35e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54368/0 (socket says 172.21.15.90:54368) 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b2a7fc640 1 -- 172.21.15.90:0/706913635 learned_addr learned my addr 172.21.15.90:0/706913635 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b2b7fe640 1 -- 172.21.15.90:0/706913635 >> v1:172.21.15.175:6789/0 conn(0x7f6b2c153d60 legacy=0x7f6b2c0c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.949+0000 7f6b2b7fe640 1 -- 172.21.15.90:0/706913635 >> v1:172.21.15.90:6789/0 conn(0x7f6b2c0ac2b0 legacy=0x7f6b2c0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.950 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.950+0000 7f6b2b7fe640 1 -- 172.21.15.90:0/706913635 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c15aa30 con 0x7f6b2c0c4600 2024-04-20T10:59:40.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.950+0000 7f6b2b7fe640 1 --2- 172.21.15.90:0/706913635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c0c4600 0x7f6b2c0ab4a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0acf70 tx=0x7f6b2402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42c48aea5fe730b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:40.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.950+0000 7f6b29ffb640 1 -- 172.21.15.90:0/706913635 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24038070 con 0x7f6b2c0c4600 2024-04-20T10:59:40.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.950+0000 7f6b29ffb640 1 -- 172.21.15.90:0/706913635 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b24031700 con 0x7f6b2c0c4600 2024-04-20T10:59:40.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.950+0000 7f6b29ffb640 1 -- 172.21.15.90:0/706913635 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24031ad0 con 0x7f6b2c0c4600 2024-04-20T10:59:40.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.951+0000 7f6b313b6640 1 -- 172.21.15.90:0/706913635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c0c4600 msgr2=0x7f6b2c0ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.951+0000 7f6b313b6640 1 --2- 172.21.15.90:0/706913635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c0c4600 0x7f6b2c0ab4a0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0acf70 tx=0x7f6b2402b7a0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.952 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.951+0000 7f6b313b6640 1 -- 172.21.15.90:0/706913635 shutdown_connections 2024-04-20T10:59:40.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.951+0000 7f6b313b6640 1 --2- 172.21.15.90:0/706913635 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c0c4600 0x7f6b2c0ab4a0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.951+0000 7f6b313b6640 1 -- 172.21.15.90:0/706913635 >> 172.21.15.90:0/706913635 conn(0x7f6b2c067de0 msgr2=0x7f6b2c0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:40.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.951+0000 7f6b313b6640 1 -- 172.21.15.90:0/706913635 shutdown_connections 2024-04-20T10:59:40.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.951+0000 7f6b313b6640 1 -- 172.21.15.90:0/706913635 wait complete. 2024-04-20T10:59:40.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.952+0000 7f6b313b6640 1 Processor -- start 2024-04-20T10:59:40.953 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.952+0000 7f6b313b6640 1 -- start start 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b313b6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b2c0ac2b0 0x7f6b2c1ed130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b313b6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2c0c4600 0x7f6b2c158ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b313b6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c153d60 0x7f6b2c1ef230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b313b6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c0c3e70 con 0x7f6b2c153d60 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b313b6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2c0c3cf0 con 0x7f6b2c0ac2b0 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b313b6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6b2c070e20 con 0x7f6b2c0c4600 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c153d60 0x7f6b2c1ef230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c153d60 0x7f6b2c1ef230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39222/0 (socket says 172.21.15.90:39222) 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 -- 172.21.15.90:0/3064516029 learned_addr learned my addr 172.21.15.90:0/3064516029 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 -- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2c0c4600 msgr2=0x7f6b2c158ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2a7fc640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2c0c4600 0x7f6b2c158ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2affd640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b2c0ac2b0 0x7f6b2c1ed130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2c0c4600 0x7f6b2c158ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 -- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b2c0ac2b0 msgr2=0x7f6b2c1ed130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b2c0ac2b0 0x7f6b2c1ed130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 -- 172.21.15.90:0/3064516029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2c0ae130 con 0x7f6b2c153d60 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.953+0000 7f6b2b7fe640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c153d60 0x7f6b2c1ef230 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6b2402bdb0 tx=0x7f6b240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.954+0000 7f6b137fe640 1 -- 172.21.15.90:0/3064516029 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24043070 con 0x7f6b2c153d60 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.954+0000 7f6b137fe640 1 -- 172.21.15.90:0/3064516029 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b240339b0 con 0x7f6b2c153d60 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.954+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b2c1efe90 con 0x7f6b2c153d60 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.954+0000 7f6b137fe640 1 -- 172.21.15.90:0/3064516029 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b24038040 con 0x7f6b2c153d60 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.954+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2c1590e0 con 0x7f6b2c153d60 2024-04-20T10:59:40.956 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.955+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b2c076150 con 0x7f6b2c153d60 2024-04-20T10:59:40.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.955+0000 7f6b137fe640 1 -- 172.21.15.90:0/3064516029 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6b24046070 con 0x7f6b2c153d60 2024-04-20T10:59:40.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.955+0000 7f6b137fe640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6b1806c8f0 0x7f6b1806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:40.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.955+0000 7f6b137fe640 1 -- 172.21.15.90:0/3064516029 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f6b240ae030 con 0x7f6b2c153d60 2024-04-20T10:59:40.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.956+0000 7f6b2affd640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6b1806c8f0 0x7f6b1806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:40.957 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.956+0000 7f6b2affd640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6b1806c8f0 0x7f6b1806edb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c1504d0 tx=0x7f6b1c0072f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:40.960 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:40.960+0000 7f6b137fe640 1 -- 172.21.15.90:0/3064516029 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6b24030070 con 0x7f6b2c153d60 2024-04-20T10:59:41.135 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.135+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b2c075ab0 con 0x7f6b2c153d60 2024-04-20T10:59:41.136 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.136+0000 7f6b137fe640 1 -- 172.21.15.90:0/3064516029 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+22023 (secure 0 0 0) 0x7f6b2407bec0 con 0x7f6b2c153d60 2024-04-20T10:59:41.137 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:41.137 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:59:20.376229+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6834/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6833/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.175:6833/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.90:6835/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6834/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6837/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.90:6837/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.90:6835/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.175:6835/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6836/1538296646":"2024-04-21T10:55:30.341595+0000","172.21.15.90:6836/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.175:6832/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6836/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.175:6832/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.175:6833/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6834/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.175:6832/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.90:6834/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.90:6834/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.90:6837/1538296646":"2024-04-21T10:55:30.341595+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6b1806c8f0 msgr2=0x7f6b1806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6b1806c8f0 0x7f6b1806edb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c1504d0 tx=0x7f6b1c0072f0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c153d60 msgr2=0x7f6b2c1ef230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c153d60 0x7f6b2c1ef230 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f6b2402bdb0 tx=0x7f6b240046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 shutdown_connections 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6b1806c8f0 0x7f6b1806edb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6b2c153d60 0x7f6b2c1ef230 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6b2c0c4600 0x7f6b2c158ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 --2- 172.21.15.90:0/3064516029 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6b2c0ac2b0 0x7f6b2c1ed130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 >> 172.21.15.90:0/3064516029 conn(0x7f6b2c067de0 msgr2=0x7f6b2c0ab840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 shutdown_connections 2024-04-20T10:59:41.139 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.138+0000 7f6b313b6640 1 -- 172.21.15.90:0/3064516029 wait complete. 2024-04-20T10:59:41.150 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:59:41.150 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:59:41.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.251+0000 7fd3228b2640 1 Processor -- start 2024-04-20T10:59:41.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.251+0000 7fd3228b2640 1 -- start start 2024-04-20T10:59:41.254 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd3228b2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fd31c0c4bb0 0x7fd31c159e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd3228b2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c0af590 con 0x7fd31c154040 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd3228b2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd31c0acd70 con 0x7fd31c15a340 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd3228b2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fd31c0acb20 con 0x7fd31c0c4bb0 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31bfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fd31c154040 0x7fd31c0730e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54382/0 (socket says 172.21.15.90:54382) 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31bfff640 1 -- 172.21.15.90:0/4007117031 learned_addr learned my addr 172.21.15.90:0/4007117031 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31b7fe640 1 --2- 172.21.15.90:0/4007117031 >> v2:172.21.15.175:3300/0 conn(0x7fd31c0c4bb0 0x7fd31c159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2873979243 0 0) 0x7fd31c0af590 con 0x7fd31c154040 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd304003520 con 0x7fd31c154040 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 807749898 0 0) 0x7fd304003520 con 0x7fd31c154040 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 >> v2:172.21.15.175:3300/0 conn(0x7fd31c0c4bb0 msgr2=0x7fd31c159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 --2- 172.21.15.90:0/4007117031 >> v2:172.21.15.175:3300/0 conn(0x7fd31c0c4bb0 0x7fd31c159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 >> v1:172.21.15.175:6789/0 conn(0x7fd31c15a340 legacy=0x7fd31c1611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.255 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c0c6400 con 0x7fd31c154040 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fd30c001670 con 0x7fd31c154040 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 >> v1:172.21.15.90:6789/0 conn(0x7fd31c154040 legacy=0x7fd31c0730e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd304004800 0x7fd304004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3040052e0 0x7fd30400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c0acb20 con 0x7fd3040052e0 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd30400c1b0 con 0x7fd3040039b0 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd30400c3b0 con 0x7fd304004800 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd320e4f640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3040052e0 0x7fd30400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.252+0000 7fd31bfff640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd31b7fe640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd304004800 0x7fd304004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd320e4f640 1 -- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd304004800 msgr2=0x7fd304004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:41.256 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd320e4f640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd304004800 0x7fd304004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd320e4f640 1 -- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3040039b0 msgr2=0x7fd304003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd320e4f640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd3040039b0 0x7fd304003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd320e4f640 1 -- 172.21.15.90:0/4007117031 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd304003520 con 0x7fd3040052e0 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd320e4f640 1 -- 172.21.15.90:0/4007117031 reap_dead start 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.253+0000 7fd320e4f640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3040052e0 0x7fd30400b9c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd314001e20 tx=0x7fd304005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d029ea359fd4b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314001a70 con 0x7fd3040052e0 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd314003b70 con 0x7fd3040052e0 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd31affd640 1 -- 172.21.15.90:0/4007117031 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3140050d0 con 0x7fd3040052e0 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd3228b2640 1 -- 172.21.15.90:0/4007117031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3040052e0 msgr2=0x7fd30400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd3228b2640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3040052e0 0x7fd30400b9c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fd314001e20 tx=0x7fd304005830 comp rx=0 tx=0).stop 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd3228b2640 1 -- 172.21.15.90:0/4007117031 shutdown_connections 2024-04-20T10:59:41.257 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd3228b2640 1 --2- 172.21.15.90:0/4007117031 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd3040052e0 0x7fd30400b9c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd3228b2640 1 -- 172.21.15.90:0/4007117031 >> 172.21.15.90:0/4007117031 conn(0x7fd31c0676c0 msgr2=0x7fd31c067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:41.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd3228b2640 1 -- 172.21.15.90:0/4007117031 shutdown_connections 2024-04-20T10:59:41.258 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.254+0000 7fd3228b2640 1 -- 172.21.15.90:0/4007117031 wait complete. 2024-04-20T10:59:41.260 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.255+0000 7fd3228b2640 1 Processor -- start 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.255+0000 7fd3228b2640 1 -- start start 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd3228b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3040052e0 0x7fd31c14c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd3228b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c1ec190 0x7fd31c157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd3228b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd31c156f60 0x7fd31c158370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd3228b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c0aeea0 con 0x7fd31c156f60 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd3228b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fd31c15a7b0 con 0x7fd31c1ec190 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd3228b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fd31c0af020 con 0x7fd3040052e0 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd31c156f60 0x7fd31c158370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd31c156f60 0x7fd31c158370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39250/0 (socket says 172.21.15.90:39250) 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 -- 172.21.15.90:0/2608539987 learned_addr learned my addr 172.21.15.90:0/2608539987 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd31bfff640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3040052e0 0x7fd31c14c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd31b7fe640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c1ec190 0x7fd31c157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.261 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 -- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3040052e0 msgr2=0x7fd31c14c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3040052e0 0x7fd31c14c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 -- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c1ec190 msgr2=0x7fd31c157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c1ec190 0x7fd31c157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.256+0000 7fd320e4f640 1 -- 172.21.15.90:0/2608539987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd31c1ec670 con 0x7fd31c156f60 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd31bfff640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3040052e0 0x7fd31c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd31b7fe640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c1ec190 0x7fd31c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd320e4f640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd31c156f60 0x7fd31c158370 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd314001f10 tx=0x7fd3140014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd318ff9640 1 -- 172.21.15.90:0/2608539987 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314042470 con 0x7fd31c156f60 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd318ff9640 1 -- 172.21.15.90:0/2608539987 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd314042630 con 0x7fd31c156f60 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd31c1ec950 con 0x7fd31c156f60 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd318ff9640 1 -- 172.21.15.90:0/2608539987 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd314042a20 con 0x7fd31c156f60 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.257+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd31c1ecf10 con 0x7fd31c156f60 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.258+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd31c076150 con 0x7fd31c156f60 2024-04-20T10:59:41.262 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.258+0000 7fd318ff9640 1 -- 172.21.15.90:0/2608539987 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd314042bc0 con 0x7fd31c156f60 2024-04-20T10:59:41.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.259+0000 7fd318ff9640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd30806c8f0 0x7fd30806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.259+0000 7fd31bfff640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd30806c8f0 0x7fd30806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.259+0000 7fd318ff9640 1 -- 172.21.15.90:0/2608539987 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fd3140ae520 con 0x7fd31c156f60 2024-04-20T10:59:41.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.259+0000 7fd31bfff640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd30806c8f0 0x7fd30806edb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0010e0 tx=0x7fd30c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.263 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.263+0000 7fd318ff9640 1 -- 172.21.15.90:0/2608539987 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fd314033030 con 0x7fd31c156f60 2024-04-20T10:59:41.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.437+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd31c157800 con 0x7fd31c156f60 2024-04-20T10:59:41.438 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.438+0000 7fd318ff9640 1 -- 172.21.15.90:0/2608539987 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7fd3140373d0 con 0x7fd31c156f60 2024-04-20T10:59:41.438 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:59:41.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.439+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd30806c8f0 msgr2=0x7fd30806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd30806c8f0 0x7fd30806edb0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd30c0010e0 tx=0x7fd30c009040 comp rx=0 tx=0).stop 2024-04-20T10:59:41.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd31c156f60 msgr2=0x7fd31c158370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd31c156f60 0x7fd31c158370 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fd314001f10 tx=0x7fd3140014a0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.440 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 shutdown_connections 2024-04-20T10:59:41.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fd30806c8f0 0x7fd30806edb0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fd31c156f60 0x7fd31c158370 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fd31c1ec190 0x7fd31c157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 --2- 172.21.15.90:0/2608539987 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fd3040052e0 0x7fd31c14c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 >> 172.21.15.90:0/2608539987 conn(0x7fd31c0676c0 msgr2=0x7fd31c151020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:41.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 shutdown_connections 2024-04-20T10:59:41.441 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.440+0000 7fd3228b2640 1 -- 172.21.15.90:0/2608539987 wait complete. 2024-04-20T10:59:41.451 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:59:41.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.551+0000 7f93c8e6a640 1 Processor -- start 2024-04-20T10:59:41.551 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.551+0000 7f93c8e6a640 1 -- start start 2024-04-20T10:59:41.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c8e6a640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f93c4157710 0x7f93c4154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.552 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c8e6a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40ad0c0 0x7f93c40ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c8e6a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93c40c4370 con 0x7f93c4073810 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c8e6a640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f93c41569e0 con 0x7f93c4157710 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c8e6a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f93c4157280 con 0x7f93c40ad0c0 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c259c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f93c4073810 0x7f93c40c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54392/0 (socket says 172.21.15.90:54392) 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c259c640 1 -- 172.21.15.90:0/2916816162 learned_addr learned my addr 172.21.15.90:0/2916816162 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93bbfff640 1 --2- 172.21.15.90:0/2916816162 >> v2:172.21.15.175:3300/0 conn(0x7f93c4157710 0x7f93c4154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c2d9d640 1 --2- 172.21.15.90:0/2916816162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40ad0c0 0x7f93c40ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c1d9b640 1 -- 172.21.15.90:0/2916816162 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946162942 0 0) 0x7f93c40c4370 con 0x7f93c4073810 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c1d9b640 1 -- 172.21.15.90:0/2916816162 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93b0003520 con 0x7f93c4073810 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c2d9d640 1 -- 172.21.15.90:0/2916816162 >> v2:172.21.15.175:3300/0 conn(0x7f93c4157710 msgr2=0x7f93c4154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c2d9d640 1 --2- 172.21.15.90:0/2916816162 >> v2:172.21.15.175:3300/0 conn(0x7f93c4157710 0x7f93c4154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c2d9d640 1 -- 172.21.15.90:0/2916816162 >> v1:172.21.15.90:6789/0 conn(0x7f93c4073810 legacy=0x7f93c40c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.552+0000 7f93c2d9d640 1 -- 172.21.15.90:0/2916816162 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c4156c30 con 0x7f93c40ad0c0 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.553+0000 7f93c2d9d640 1 --2- 172.21.15.90:0/2916816162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40ad0c0 0x7f93c40ad570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=382161234e5bfba3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.553+0000 7f93c1d9b640 1 -- 172.21.15.90:0/2916816162 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc039070 con 0x7f93c40ad0c0 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.553+0000 7f93c1d9b640 1 -- 172.21.15.90:0/2916816162 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc02cbc0 con 0x7f93c40ad0c0 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.553+0000 7f93c1d9b640 1 -- 172.21.15.90:0/2916816162 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc034440 con 0x7f93c40ad0c0 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2916816162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40ad0c0 msgr2=0x7f93c40ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2916816162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40ad0c0 0x7f93c40ad570 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc02be10 comp rx=0 tx=0).stop 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2916816162 shutdown_connections 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2916816162 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c40ad0c0 0x7f93c40ad570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2916816162 >> v2:172.21.15.175:3300/0 conn(0x7f93c4157710 0x7f93c4154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2916816162 >> 172.21.15.90:0/2916816162 conn(0x7f93c40c8080 msgr2=0x7f93c40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2916816162 shutdown_connections 2024-04-20T10:59:41.555 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.554+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2916816162 wait complete. 2024-04-20T10:59:41.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.555+0000 7f93c8e6a640 1 Processor -- start 2024-04-20T10:59:41.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.555+0000 7f93c8e6a640 1 -- start start 2024-04-20T10:59:41.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c8e6a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c4073810 0x7f93c4146180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.558 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c8e6a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40ad0c0 0x7f93c41466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c8e6a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93c4157710 0x7f93c41ec490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c8e6a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f93c40abbb0 con 0x7f93c4157710 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c8e6a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f93c4073bf0 con 0x7f93c40ad0c0 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c8e6a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f93c40abd30 con 0x7f93c4073810 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93c4157710 0x7f93c41ec490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93c4157710 0x7f93c41ec490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39256/0 (socket says 172.21.15.90:39256) 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 -- 172.21.15.90:0/2777159627 learned_addr learned my addr 172.21.15.90:0/2777159627 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c259c640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c4073810 0x7f93c4146180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93bbfff640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40ad0c0 0x7f93c41466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 -- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c4073810 msgr2=0x7f93c4146180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c4073810 0x7f93c4146180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 -- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40ad0c0 msgr2=0x7f93c41466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40ad0c0 0x7f93c41466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.559 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 -- 172.21.15.90:0/2777159627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93c4156130 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93c2d9d640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93c4157710 0x7f93c41ec490 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.556+0000 7f93baffd640 1 -- 172.21.15.90:0/2777159627 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc009450 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.557+0000 7f93baffd640 1 -- 172.21.15.90:0/2777159627 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93bc03b610 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.557+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93c41537c0 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.557+0000 7f93baffd640 1 -- 172.21.15.90:0/2777159627 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93bc03b9e0 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.557+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93c41471c0 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.558+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c4076150 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.558+0000 7f93baffd640 1 -- 172.21.15.90:0/2777159627 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93bc03bb80 con 0x7f93c4157710 2024-04-20T10:59:41.560 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.558+0000 7f93baffd640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f93a406c920 0x7f93a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.559+0000 7f93c259c640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f93a406c920 0x7f93a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.559+0000 7f93baffd640 1 -- 172.21.15.90:0/2777159627 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f93bc0b0c30 con 0x7f93c4157710 2024-04-20T10:59:41.561 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.559+0000 7f93c259c640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f93a406c920 0x7f93a406ede0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005880 tx=0x7f93b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.563 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.563+0000 7f93baffd640 1 -- 172.21.15.90:0/2777159627 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f93bc07e410 con 0x7f93c4157710 2024-04-20T10:59:41.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.741+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f93c40c8c40 con 0x7f93c4157710 2024-04-20T10:59:41.741 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.741+0000 7f93baffd640 1 -- 172.21.15.90:0/2777159627 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v38) ==== 99+0+11 (secure 0 0 0) 0x7f93bc082710 con 0x7f93c4157710 2024-04-20T10:59:41.741 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:59:41.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f93a406c920 msgr2=0x7f93a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f93a406c920 0x7f93a406ede0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93b4005880 tx=0x7f93b4009040 comp rx=0 tx=0).stop 2024-04-20T10:59:41.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93c4157710 msgr2=0x7f93c41ec490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93c4157710 0x7f93c41ec490 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f93bc009d90 tx=0x7f93bc004a40 comp rx=0 tx=0).stop 2024-04-20T10:59:41.744 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 shutdown_connections 2024-04-20T10:59:41.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f93a406c920 0x7f93a406ede0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f93c4157710 0x7f93c41ec490 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f93c40ad0c0 0x7f93c41466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 --2- 172.21.15.90:0/2777159627 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f93c4073810 0x7f93c4146180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 >> 172.21.15.90:0/2777159627 conn(0x7f93c40c8080 msgr2=0x7f93c40c3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:41.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 shutdown_connections 2024-04-20T10:59:41.745 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.743+0000 7f93c8e6a640 1 -- 172.21.15.90:0/2777159627 wait complete. 2024-04-20T10:59:41.755 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:59:41.855 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.855+0000 7fbdac0b3640 1 Processor -- start 2024-04-20T10:59:41.856 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.855+0000 7fbdac0b3640 1 -- start start 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbdac0b3640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fbda4154040 0x7fbda40c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbdac0b3640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda40af590 con 0x7fbda40730e0 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbdac0b3640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda40acd70 con 0x7fbda415a510 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbdac0b3640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fbda40acb20 con 0x7fbda4154040 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbda964e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbda40730e0 0x7fbda4159e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54398/0 (socket says 172.21.15.90:54398) 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbda964e640 1 -- 172.21.15.90:0/2390524113 learned_addr learned my addr 172.21.15.90:0/2390524113 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953678543 0 0) 0x7fbda40af590 con 0x7fbda40730e0 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd90003520 con 0x7fbda40730e0 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.856+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/2390524113 >> v2:172.21.15.175:3300/0 conn(0x7fbda4154040 0x7fbda40c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.860 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2859651799 0 0) 0x7fbd90003520 con 0x7fbda40730e0 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 >> v2:172.21.15.175:3300/0 conn(0x7fbda4154040 msgr2=0x7fbda40c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 --2- 172.21.15.90:0/2390524113 >> v2:172.21.15.175:3300/0 conn(0x7fbda4154040 0x7fbda40c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 >> v1:172.21.15.175:6789/0 conn(0x7fbda415a510 legacy=0x7fbda41611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda40c6400 con 0x7fbda40730e0 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fbd94001670 con 0x7fbda40730e0 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 >> v1:172.21.15.90:6789/0 conn(0x7fbda40730e0 legacy=0x7fbda4159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbd90003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd90004800 0x7fbd90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd900052e0 0x7fbd9000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40acb20 con 0x7fbd900039b0 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbd9000c1b0 con 0x7fbd900052e0 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbd9000c3b0 con 0x7fbd90004800 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbd90003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.861 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbdaa650640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd900052e0 0x7fbd9000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda964e640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd90004800 0x7fbd90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda9e4f640 1 -- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd90004800 msgr2=0x7fbd90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbd90004800 0x7fbd90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda9e4f640 1 -- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd900052e0 msgr2=0x7fbd9000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbd900052e0 0x7fbd9000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbda9e4f640 1 -- 172.21.15.90:0/2390524113 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd90003520 con 0x7fbd900039b0 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.857+0000 7fbdaa650640 1 -- 172.21.15.90:0/2390524113 reap_dead start 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbd90003dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009f90 tx=0x7fbd90005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf05689efc2f662 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0039070 con 0x7fbd900039b0 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda002cbd0 con 0x7fbd900039b0 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbda8e4d640 1 -- 172.21.15.90:0/2390524113 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0009c10 con 0x7fbd900039b0 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbdac0b3640 1 -- 172.21.15.90:0/2390524113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 msgr2=0x7fbd90003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbd90003dd0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbda0009f90 tx=0x7fbd90005830 comp rx=0 tx=0).stop 2024-04-20T10:59:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbdac0b3640 1 -- 172.21.15.90:0/2390524113 shutdown_connections 2024-04-20T10:59:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/2390524113 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbd90003dd0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbdac0b3640 1 -- 172.21.15.90:0/2390524113 >> 172.21.15.90:0/2390524113 conn(0x7fbda40676c0 msgr2=0x7fbda4067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbdac0b3640 1 -- 172.21.15.90:0/2390524113 shutdown_connections 2024-04-20T10:59:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.858+0000 7fbdac0b3640 1 -- 172.21.15.90:0/2390524113 wait complete. 2024-04-20T10:59:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 Processor -- start 2024-04-20T10:59:41.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 -- start start 2024-04-20T10:59:41.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbda41e9680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbda406e4d0 0x7fbda414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbda406e950 0x7fbda4157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40af020 con 0x7fbd900039b0 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40aeea0 con 0x7fbda406e4d0 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdac0b3640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbda4070520 con 0x7fbda406e950 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbda9e4f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbda41e9680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbda9e4f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbda41e9680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39282/0 (socket says 172.21.15.90:39282) 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbda9e4f640 1 -- 172.21.15.90:0/3330955771 learned_addr learned my addr 172.21.15.90:0/3330955771 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.860+0000 7fbdaa650640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbda406e950 0x7fbda4157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda964e640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbda406e4d0 0x7fbda414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda9e4f640 1 -- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbda406e950 msgr2=0x7fbda4157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbda406e950 0x7fbda4157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda9e4f640 1 -- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbda406e4d0 msgr2=0x7fbda414b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbda406e4d0 0x7fbda414b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda9e4f640 1 -- 172.21.15.90:0/3330955771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda41e9e00 con 0x7fbd900039b0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda964e640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbda406e4d0 0x7fbda414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbda9e4f640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbda41e9680 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbda002c640 tx=0x7fbda0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbd9a7fc640 1 -- 172.21.15.90:0/3330955771 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0042020 con 0x7fbd900039b0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbd9a7fc640 1 -- 172.21.15.90:0/3330955771 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbda003a040 con 0x7fbd900039b0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda41ec360 con 0x7fbd900039b0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbd9a7fc640 1 -- 172.21.15.90:0/3330955771 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbda0039070 con 0x7fbd900039b0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.861+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda41ec920 con 0x7fbd900039b0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.862+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda4076150 con 0x7fbd900039b0 2024-04-20T10:59:41.867 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.862+0000 7fbd9a7fc640 1 -- 172.21.15.90:0/3330955771 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbda0005d10 con 0x7fbd900039b0 2024-04-20T10:59:41.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.863+0000 7fbd9a7fc640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbd8806c8f0 0x7fbd8806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:41.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.863+0000 7fbd9a7fc640 1 -- 172.21.15.90:0/3330955771 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fbda00ae3d0 con 0x7fbd900039b0 2024-04-20T10:59:41.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.863+0000 7fbda964e640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbd8806c8f0 0x7fbd8806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:41.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.863+0000 7fbda964e640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbd8806c8f0 0x7fbd8806edb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbd94001eb0 tx=0x7fbd94001da0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:41.868 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:41.867+0000 7fbd9a7fc640 1 -- 172.21.15.90:0/3330955771 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fbda004c070 con 0x7fbd900039b0 2024-04-20T10:59:42.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.040+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7fbda4072ec0 con 0x7fbd900039b0 2024-04-20T10:59:42.041 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.040+0000 7fbd9a7fc640 1 -- 172.21.15.90:0/3330955771 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v38) ==== 95+0+11 (secure 0 0 0) 0x7fbda41e9e00 con 0x7fbd900039b0 2024-04-20T10:59:42.041 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.042+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbd8806c8f0 msgr2=0x7fbd8806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.042+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbd8806c8f0 0x7fbd8806edb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbd94001eb0 tx=0x7fbd94001da0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.042+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 msgr2=0x7fbda41e9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.042+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbda41e9680 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbda002c640 tx=0x7fbda0009750 comp rx=0 tx=0).stop 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 shutdown_connections 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbd8806c8f0 0x7fbd8806edb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbda406e950 0x7fbda4157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.043 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbda406e4d0 0x7fbda414b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 --2- 172.21.15.90:0/3330955771 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbd900039b0 0x7fbda41e9680 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 >> 172.21.15.90:0/3330955771 conn(0x7fbda40676c0 msgr2=0x7fbda4067aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:42.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 shutdown_connections 2024-04-20T10:59:42.044 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.043+0000 7fbdac0b3640 1 -- 172.21.15.90:0/3330955771 wait complete. 2024-04-20T10:59:42.054 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:59:42.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.154+0000 7f8fbf431640 1 Processor -- start 2024-04-20T10:59:42.154 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.154+0000 7f8fbf431640 1 -- start start 2024-04-20T10:59:42.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.154+0000 7f8fbf431640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8fb80c54d0 0x7f8fb81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbf431640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb80adab0 con 0x7f8fb80c27a0 2024-04-20T10:59:42.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbf431640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fb8071690 con 0x7f8fb80ad640 2024-04-20T10:59:42.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbf431640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f8fb8071970 con 0x7f8fb80c54d0 2024-04-20T10:59:42.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbc9cc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f8fb80c54d0 0x7f8fb81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.164 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbd1cd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f8fb80c27a0 0x7f8fb815a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54412/0 (socket says 172.21.15.90:54412) 2024-04-20T10:59:42.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbd1cd640 1 -- 172.21.15.90:0/600093138 learned_addr learned my addr 172.21.15.90:0/600093138 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:42.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbc9cc640 1 --2- 172.21.15.90:0/600093138 >> v2:172.21.15.90:3300/0 conn(0x7f8fb80c54d0 0x7f8fb81570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39286/0 (socket says 172.21.15.90:39286) 2024-04-20T10:59:42.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbc9cc640 1 -- 172.21.15.90:0/600093138 >> v1:172.21.15.175:6789/0 conn(0x7f8fb80ad640 legacy=0x7f8fb8153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:42.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbc9cc640 1 -- 172.21.15.90:0/600093138 >> v1:172.21.15.90:6789/0 conn(0x7f8fb80c27a0 legacy=0x7f8fb815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.155+0000 7f8fbc9cc640 1 -- 172.21.15.90:0/600093138 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb8159ce0 con 0x7f8fb80c54d0 2024-04-20T10:59:42.165 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbc9cc640 1 --2- 172.21.15.90:0/600093138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb81570d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80097a0 tx=0x7f8fa802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=131f6d739c181327 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8faffff640 1 -- 172.21.15.90:0/600093138 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8035020 con 0x7f8fb80c54d0 2024-04-20T10:59:42.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8faffff640 1 -- 172.21.15.90:0/600093138 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fa8031830 con 0x7f8fb80c54d0 2024-04-20T10:59:42.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8faffff640 1 -- 172.21.15.90:0/600093138 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fa8031c00 con 0x7f8fb80c54d0 2024-04-20T10:59:42.166 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbf431640 1 -- 172.21.15.90:0/600093138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 msgr2=0x7f8fb81570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbf431640 1 --2- 172.21.15.90:0/600093138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb81570d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80097a0 tx=0x7f8fa802b8d0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbf431640 1 -- 172.21.15.90:0/600093138 shutdown_connections 2024-04-20T10:59:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbf431640 1 --2- 172.21.15.90:0/600093138 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb81570d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbf431640 1 -- 172.21.15.90:0/600093138 >> 172.21.15.90:0/600093138 conn(0x7f8fb80c9100 msgr2=0x7f8fb80c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbf431640 1 -- 172.21.15.90:0/600093138 shutdown_connections 2024-04-20T10:59:42.167 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.156+0000 7f8fbf431640 1 -- 172.21.15.90:0/600093138 wait complete. 2024-04-20T10:59:42.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.157+0000 7f8fbf431640 1 Processor -- start 2024-04-20T10:59:42.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbf431640 1 -- start start 2024-04-20T10:59:42.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbf431640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb80ad640 0x7f8fb8157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbf431640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb80c27a0 0x7f8fb81ece30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbf431640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb8072ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.168 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbf431640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb80c2b80 con 0x7f8fb80c54d0 2024-04-20T10:59:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbf431640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f8fb806f510 con 0x7f8fb80c27a0 2024-04-20T10:59:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbf431640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f8fb80c2d00 con 0x7f8fb80ad640 2024-04-20T10:59:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbd9ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb8072ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbd9ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb8072ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39294/0 (socket says 172.21.15.90:39294) 2024-04-20T10:59:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbd9ce640 1 -- 172.21.15.90:0/2857766154 learned_addr learned my addr 172.21.15.90:0/2857766154 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:42.169 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.158+0000 7f8fbd1cd640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb80ad640 0x7f8fb8157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbc9cc640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb80c27a0 0x7f8fb81ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbd9ce640 1 -- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb80ad640 msgr2=0x7f8fb8157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbd9ce640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb80ad640 0x7f8fb8157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbd9ce640 1 -- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb80c27a0 msgr2=0x7f8fb81ece30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbd9ce640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb80c27a0 0x7f8fb81ece30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.170 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbd9ce640 1 -- 172.21.15.90:0/2857766154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fb8155f90 con 0x7f8fb80c54d0 2024-04-20T10:59:42.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbc9cc640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb80c27a0 0x7f8fb81ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:42.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbd9ce640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb8072ef0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000b970 tx=0x7f8fb000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fadffb640 1 -- 172.21.15.90:0/2857766154 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0019070 con 0x7f8fb80c54d0 2024-04-20T10:59:42.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fadffb640 1 -- 172.21.15.90:0/2857766154 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fb000cb40 con 0x7f8fb80c54d0 2024-04-20T10:59:42.171 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fb81559d0 con 0x7f8fb80c54d0 2024-04-20T10:59:42.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fadffb640 1 -- 172.21.15.90:0/2857766154 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fb0014440 con 0x7f8fb80c54d0 2024-04-20T10:59:42.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.159+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fb8154560 con 0x7f8fb80c54d0 2024-04-20T10:59:42.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.160+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fb80c34c0 con 0x7f8fb80c54d0 2024-04-20T10:59:42.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.160+0000 7f8fadffb640 1 -- 172.21.15.90:0/2857766154 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8fb001c070 con 0x7f8fb80c54d0 2024-04-20T10:59:42.172 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.161+0000 7f8fadffb640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f9c06c8f0 0x7f8f9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.161+0000 7f8fadffb640 1 -- 172.21.15.90:0/2857766154 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f8fb008be00 con 0x7f8fb80c54d0 2024-04-20T10:59:42.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.161+0000 7f8fbd1cd640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f9c06c8f0 0x7f8f9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.161+0000 7f8fbd1cd640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f9c06c8f0 0x7f8f9c06edb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80c4660 tx=0x7f8fb4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.173 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.165+0000 7f8fadffb640 1 -- 172.21.15.90:0/2857766154 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8fb80c34c0 con 0x7f8fb80c54d0 2024-04-20T10:59:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.337+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f8fb8076150 con 0x7f8fb80c54d0 2024-04-20T10:59:42.337 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.337+0000 7f8fadffb640 1 -- 172.21.15.90:0/2857766154 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v38) ==== 99+0+11 (secure 0 0 0) 0x7f8fb0059b70 con 0x7f8fb80c54d0 2024-04-20T10:59:42.338 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f9c06c8f0 msgr2=0x7f8f9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f9c06c8f0 0x7f8f9c06edb0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8fb80c4660 tx=0x7f8fb4009040 comp rx=0 tx=0).stop 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 msgr2=0x7f8fb8072ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb8072ef0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f8fb000b970 tx=0x7f8fb000be30 comp rx=0 tx=0).stop 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 shutdown_connections 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f8f9c06c8f0 0x7f8f9c06edb0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f8fb80c54d0 0x7f8fb8072ef0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f8fb80c27a0 0x7f8fb81ece30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 --2- 172.21.15.90:0/2857766154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f8fb80ad640 0x7f8fb8157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 >> 172.21.15.90:0/2857766154 conn(0x7f8fb80c9100 msgr2=0x7f8fb8151a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:42.340 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 shutdown_connections 2024-04-20T10:59:42.341 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.339+0000 7f8fbf431640 1 -- 172.21.15.90:0/2857766154 wait complete. 2024-04-20T10:59:42.350 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:59:42.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f36c11640 1 Processor -- start 2024-04-20T10:59:42.450 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f36c11640 1 -- start start 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f36c11640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0f3006ff90 0x7f0f30158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f36c11640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f300c6040 0x7f0f300c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f36c11640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f300704c0 con 0x7f0f30151b40 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f36c11640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f0f30073800 con 0x7f0f300c6040 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f36c11640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0f300731b0 con 0x7f0f3006ff90 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.450+0000 7f0f351ae640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f300c6040 0x7f0f300c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f349ad640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0f30151b40 0x7f0f30157c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54418/0 (socket says 172.21.15.90:54418) 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f351ae640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f0f300c6040 0x7f0f300c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39298/0 (socket says 172.21.15.90:39298) 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f349ad640 1 -- 172.21.15.90:0/2516286298 learned_addr learned my addr 172.21.15.90:0/2516286298 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f2ffff640 1 --2- 172.21.15.90:0/2516286298 >> v2:172.21.15.175:3300/0 conn(0x7f0f3006ff90 0x7f0f30158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f351ae640 1 -- 172.21.15.90:0/2516286298 >> v2:172.21.15.175:3300/0 conn(0x7f0f3006ff90 msgr2=0x7f0f30158810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:42.452 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f351ae640 1 --2- 172.21.15.90:0/2516286298 >> v2:172.21.15.175:3300/0 conn(0x7f0f3006ff90 0x7f0f30158810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f351ae640 1 -- 172.21.15.90:0/2516286298 >> v1:172.21.15.90:6789/0 conn(0x7f0f30151b40 legacy=0x7f0f30157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f351ae640 1 -- 172.21.15.90:0/2516286298 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f30073490 con 0x7f0f300c6040 2024-04-20T10:59:42.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.451+0000 7f0f2f7fe640 1 -- 172.21.15.90:0/2516286298 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073373644 0 0) 0x7f0f300704c0 con 0x7f0f30151b40 2024-04-20T10:59:42.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f351ae640 1 --2- 172.21.15.90:0/2516286298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300c64a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0f300c56f0 tx=0x7f0f2802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed53619c4510d0aa server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f2f7fe640 1 -- 172.21.15.90:0/2516286298 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28039070 con 0x7f0f300c6040 2024-04-20T10:59:42.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f2f7fe640 1 -- 172.21.15.90:0/2516286298 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2802cb60 con 0x7f0f300c6040 2024-04-20T10:59:42.453 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f2f7fe640 1 -- 172.21.15.90:0/2516286298 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28034440 con 0x7f0f300c6040 2024-04-20T10:59:42.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 -- 172.21.15.90:0/2516286298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 msgr2=0x7f0f300c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.455 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 --2- 172.21.15.90:0/2516286298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300c64a0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0f300c56f0 tx=0x7f0f2802bdb0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 -- 172.21.15.90:0/2516286298 shutdown_connections 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 --2- 172.21.15.90:0/2516286298 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300c64a0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 --2- 172.21.15.90:0/2516286298 >> v2:172.21.15.175:3300/0 conn(0x7f0f3006ff90 0x7f0f30158810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 -- 172.21.15.90:0/2516286298 >> 172.21.15.90:0/2516286298 conn(0x7f0f300676c0 msgr2=0x7f0f30067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 -- 172.21.15.90:0/2516286298 shutdown_connections 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.452+0000 7f0f36c11640 1 -- 172.21.15.90:0/2516286298 wait complete. 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.453+0000 7f0f36c11640 1 Processor -- start 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.453+0000 7f0f36c11640 1 -- start start 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f36c11640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3006ff90 0x7f0f300c9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f36c11640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f36c11640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f30151b40 0x7f0f301ea9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f36c11640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0f301520a0 con 0x7f0f300c6040 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f36c11640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0f30151f20 con 0x7f0f3006ff90 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f36c11640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0f3006f600 con 0x7f0f30151b40 2024-04-20T10:59:42.456 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f2ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f2ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39304/0 (socket says 172.21.15.90:39304) 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f2ffff640 1 -- 172.21.15.90:0/3438459687 learned_addr learned my addr 172.21.15.90:0/3438459687 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f351ae640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f30151b40 0x7f0f301ea9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f2ffff640 1 -- 172.21.15.90:0/3438459687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f30151b40 msgr2=0x7f0f301ea9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f2ffff640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f30151b40 0x7f0f301ea9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f2ffff640 1 -- 172.21.15.90:0/3438459687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3006ff90 msgr2=0x7f0f300c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.454+0000 7f0f2ffff640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3006ff90 0x7f0f300c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.455+0000 7f0f2ffff640 1 -- 172.21.15.90:0/3438459687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f301ea230 con 0x7f0f300c6040 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.455+0000 7f0f2ffff640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300aeed0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d600 tx=0x7f0f2400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.455+0000 7f0f2d7fa640 1 -- 172.21.15.90:0/3438459687 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24004240 con 0x7f0f300c6040 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.455+0000 7f0f2d7fa640 1 -- 172.21.15.90:0/3438459687 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f240043e0 con 0x7f0f300c6040 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.455+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f301ee220 con 0x7f0f300c6040 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.455+0000 7f0f2d7fa640 1 -- 172.21.15.90:0/3438459687 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f24003830 con 0x7f0f300c6040 2024-04-20T10:59:42.457 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.455+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f30154a40 con 0x7f0f300c6040 2024-04-20T10:59:42.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.456+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f30076150 con 0x7f0f300c6040 2024-04-20T10:59:42.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.456+0000 7f0f2d7fa640 1 -- 172.21.15.90:0/3438459687 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f240039d0 con 0x7f0f300c6040 2024-04-20T10:59:42.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.457+0000 7f0f2d7fa640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0f1c06c920 0x7f0f1c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.457+0000 7f0f2d7fa640 1 -- 172.21.15.90:0/3438459687 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f0f2408c490 con 0x7f0f300c6040 2024-04-20T10:59:42.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.457+0000 7f0f349ad640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0f1c06c920 0x7f0f1c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.459 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.457+0000 7f0f349ad640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0f1c06c920 0x7f0f1c06ede0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0f20007fd0 tx=0x7f0f20007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.461 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.461+0000 7f0f2d7fa640 1 -- 172.21.15.90:0/3438459687 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0f2401c360 con 0x7f0f300c6040 2024-04-20T10:59:42.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:59:42.558 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T10:59:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.641+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f0f3006f230 con 0x7f0f300c6040 2024-04-20T10:59:42.642 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.642+0000 7f0f2d7fa640 1 -- 172.21.15.90:0/3438459687 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v38) ==== 95+0+11 (secure 0 0 0) 0x7f0f2405a200 con 0x7f0f300c6040 2024-04-20T10:59:42.642 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:59:42.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0f1c06c920 msgr2=0x7f0f1c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0f1c06c920 0x7f0f1c06ede0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f0f20007fd0 tx=0x7f0f20007960 comp rx=0 tx=0).stop 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 msgr2=0x7f0f300aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300aeed0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400d600 tx=0x7f0f2400dac0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 shutdown_connections 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0f1c06c920 0x7f0f1c06ede0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0f30151b40 0x7f0f301ea9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0f300c6040 0x7f0f300aeed0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 --2- 172.21.15.90:0/3438459687 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0f3006ff90 0x7f0f300c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 >> 172.21.15.90:0/3438459687 conn(0x7f0f300676c0 msgr2=0x7f0f30155a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 shutdown_connections 2024-04-20T10:59:42.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.644+0000 7f0f36c11640 1 -- 172.21.15.90:0/3438459687 wait complete. 2024-04-20T10:59:42.655 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T10:59:42.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.751+0000 7ff5b7d15640 1 Processor -- start 2024-04-20T10:59:42.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b7d15640 1 -- start start 2024-04-20T10:59:42.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b7d15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 0x7ff5b01671b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b7d15640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff5b01676f0 0x7ff5b0167b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b7d15640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b00ac250 con 0x7ff5b00c4130 2024-04-20T10:59:42.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b7d15640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b00ae150 con 0x7ff5b01676f0 2024-04-20T10:59:42.821 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b7d15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b006d480 con 0x7ff5b006e020 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b5ab1640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff5b00c4130 0x7ff5b006d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54426/0 (socket says 172.21.15.90:54426) 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.752+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/3514217372 learned_addr learned my addr 172.21.15.90:0/3514217372 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.753+0000 7ff5b52b0640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 0x7ff5b01671b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.753+0000 7ff5b62b2640 1 --2- 172.21.15.90:0/3514217372 >> v2:172.21.15.175:3300/0 conn(0x7ff5b01676f0 0x7ff5b0167b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.753+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488357778 0 0) 0x7ff5b00ac250 con 0x7ff5b00c4130 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff59c003500 con 0x7ff5b00c4130 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1365005744 0 0) 0x7ff59c003500 con 0x7ff5b00c4130 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 msgr2=0x7ff5b01671b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 0x7ff5b01671b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 >> v2:172.21.15.175:3300/0 conn(0x7ff5b01676f0 msgr2=0x7ff5b0167b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 --2- 172.21.15.90:0/3514217372 >> v2:172.21.15.175:3300/0 conn(0x7ff5b01676f0 0x7ff5b0167b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b00ac530 con 0x7ff5b00c4130 2024-04-20T10:59:42.822 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7ff5a0001670 con 0x7ff5b00c4130 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 >> v1:172.21.15.90:6789/0 conn(0x7ff5b00c4130 legacy=0x7ff5b006d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff59c004fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 0x7ff59c0037e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff59c003e00 0x7ff59c00b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b00ae150 con 0x7ff59c004b70 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b006d480 con 0x7ff59c003e00 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff59c00bbc0 con 0x7ff5b006e020 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b5ab1640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff59c004fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b52b0640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 0x7ff59c0037e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b62b2640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff59c003e00 0x7ff59c00b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 msgr2=0x7ff59c0037e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b5ab1640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b006e020 0x7ff59c0037e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff59c003e00 msgr2=0x7ff59c00b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:42.823 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b5ab1640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff59c003e00 0x7ff59c00b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.819+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/3514217372 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff59c003500 con 0x7ff59c004b70 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.820+0000 7ff5b5ab1640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff59c004fb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c160 tx=0x7ff59c004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c17bd1784cc4a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.820+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0007c80 con 0x7ff59c004b70 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.820+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a0030070 con 0x7ff59c004b70 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.820+0000 7ff5b4aaf640 1 -- 172.21.15.90:0/3514217372 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0005d30 con 0x7ff59c004b70 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.821+0000 7ff5b7d15640 1 -- 172.21.15.90:0/3514217372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 msgr2=0x7ff59c004fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.821+0000 7ff5b7d15640 1 --2- 172.21.15.90:0/3514217372 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff59c004fb0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7ff5a000c160 tx=0x7ff59c004800 comp rx=0 tx=0).stop 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.821+0000 7ff5b62b2640 1 -- 172.21.15.90:0/3514217372 reap_dead start 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.821+0000 7ff5b7d15640 1 -- 172.21.15.90:0/3514217372 shutdown_connections 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.821+0000 7ff5b7d15640 1 -- 172.21.15.90:0/3514217372 >> 172.21.15.90:0/3514217372 conn(0x7ff5b00c8080 msgr2=0x7ff5b00c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.821+0000 7ff5b7d15640 1 -- 172.21.15.90:0/3514217372 shutdown_connections 2024-04-20T10:59:42.824 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.821+0000 7ff5b7d15640 1 -- 172.21.15.90:0/3514217372 wait complete. 2024-04-20T10:59:42.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.822+0000 7ff5b7d15640 1 Processor -- start 2024-04-20T10:59:42.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.822+0000 7ff5b7d15640 1 -- start start 2024-04-20T10:59:42.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.822+0000 7ff5b7d15640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff5b00bd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b7d15640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b01612b0 0x7ff5b01667f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b7d15640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b01617e0 0x7ff5b01ee360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.827 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b7d15640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b0070510 con 0x7ff59c004b70 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b7d15640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b00c3050 con 0x7ff5b01612b0 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b7d15640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff5b00adde0 con 0x7ff5b01617e0 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff5b00bd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff5b00bd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39314/0 (socket says 172.21.15.90:39314) 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/184369611 learned_addr learned my addr 172.21.15.90:0/184369611 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b52b0640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b01612b0 0x7ff5b01667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b62b2640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b01617e0 0x7ff5b01ee360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b01617e0 msgr2=0x7ff5b01ee360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b01617e0 0x7ff5b01ee360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b01612b0 msgr2=0x7ff5b01667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b01612b0 0x7ff5b01667f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 -- 172.21.15.90:0/184369611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b01f0400 con 0x7ff59c004b70 2024-04-20T10:59:42.828 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b5ab1640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff5b00bd8f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0000fb0 tx=0x7ff5b00c2e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5a67fc640 1 -- 172.21.15.90:0/184369611 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0045070 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5a67fc640 1 -- 172.21.15.90:0/184369611 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a0004bf0 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b01ed3c0 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5a67fc640 1 -- 172.21.15.90:0/184369611 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0007070 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.823+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b00bd3d0 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.824+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b01ed1d0 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.825+0000 7ff5a67fc640 1 -- 172.21.15.90:0/184369611 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5a0007210 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.825+0000 7ff5a67fc640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff59406c8f0 0x7ff59406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.825+0000 7ff5b52b0640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff59406c8f0 0x7ff59406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.825+0000 7ff5a67fc640 1 -- 172.21.15.90:0/184369611 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7ff5a00ad190 con 0x7ff59c004b70 2024-04-20T10:59:42.829 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.826+0000 7ff5b52b0640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff59406c8f0 0x7ff59406edb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00aaec0 tx=0x7ff5ac00a040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:42.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:42.830+0000 7ff5a67fc640 1 -- 172.21.15.90:0/184369611 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff5a007a9c0 con 0x7ff59c004b70 2024-04-20T10:59:43.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.017+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff5b0076150 con 0x7ff59c004b70 2024-04-20T10:59:43.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.018+0000 7ff5a67fc640 1 -- 172.21.15.90:0/184369611 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 22 entries v38) ==== 81+0+1344 (secure 0 0 0) 0x7ff5a007ecc0 con 0x7ff59c004b70 2024-04-20T10:59:43.018 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/3994531378 2024-04-21T10:59:20.376156+0000 2024-04-20T10:59:43.018 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6833/3798454731 2024-04-21T10:59:10.374554+0000 2024-04-20T10:59:43.018 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/732131803 2024-04-21T10:56:45.352698+0000 2024-04-20T10:59:43.018 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6833/133567489 2024-04-21T10:56:05.346704+0000 2024-04-20T10:59:43.018 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/3994531378 2024-04-21T10:59:20.376156+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6834/2994051895 2024-04-21T10:52:40.317797+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6837/597803483 2024-04-21T10:57:50.361461+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6837/3822230008 2024-04-21T10:52:41.327372+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/1834995897 2024-04-21T10:53:35.325514+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6835/2994051895 2024-04-21T10:52:40.317797+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6836/1538296646 2024-04-21T10:55:30.341595+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6836/3822230008 2024-04-21T10:52:41.327372+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6832/1855171726 2024-04-21T10:54:15.330938+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6836/597803483 2024-04-21T10:57:50.361461+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6832/133567489 2024-04-21T10:56:05.346704+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6833/1855171726 2024-04-21T10:54:15.330938+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/4126797977 2024-04-21T10:54:50.335879+0000 2024-04-20T10:59:43.019 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6832/3798454731 2024-04-21T10:59:10.374554+0000 2024-04-20T10:59:43.020 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/4126797977 2024-04-21T10:54:50.335879+0000 2024-04-20T10:59:43.020 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/732131803 2024-04-21T10:56:45.352698+0000 2024-04-20T10:59:43.020 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/1834995897 2024-04-21T10:53:35.325514+0000 2024-04-20T10:59:43.020 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6837/1538296646 2024-04-21T10:55:30.341595+0000 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:listed 22 entries 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff59406c8f0 msgr2=0x7ff59406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff59406c8f0 0x7ff59406edb0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff5b00aaec0 tx=0x7ff5ac00a040 comp rx=0 tx=0).stop 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 msgr2=0x7ff5b00bd8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff5b00bd8f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0000fb0 tx=0x7ff5b00c2e10 comp rx=0 tx=0).stop 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 shutdown_connections 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff59406c8f0 0x7ff59406edb0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff5b01617e0 0x7ff5b01ee360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff5b01612b0 0x7ff5b01667f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 --2- 172.21.15.90:0/184369611 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff59c004b70 0x7ff5b00bd8f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 >> 172.21.15.90:0/184369611 conn(0x7ff5b00c8080 msgr2=0x7ff5b00c4b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 shutdown_connections 2024-04-20T10:59:43.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.020+0000 7ff5b7d15640 1 -- 172.21.15.90:0/184369611 wait complete. 2024-04-20T10:59:43.031 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-20T10:59:43.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:43.031 DEBUG:teuthology.orchestra.run.smithi090:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-20T10:59:43.097 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T10:59:43.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:43.098 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-20T10:59:43.224 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:59:43.224 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T10:59:43.243 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T10:59:43.243 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T10:59:43.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:59:43.399 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.399+0000 7fb892043640 1 Processor -- start 2024-04-20T10:59:43.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.399+0000 7fb892043640 1 -- start start 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb892043640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 0x7fb88c0acc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb892043640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c0c44f0 con 0x7fb88c0c34d0 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb892043640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb88c0c4bd0 con 0x7fb88c0c38b0 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb892043640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c0c3d60 con 0x7fb88c0ab4a0 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88b7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb88c0c34d0 0x7fb88c0ac570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54428/0 (socket says 172.21.15.90:54428) 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88b7fe640 1 -- 172.21.15.90:0/2527271512 learned_addr learned my addr 172.21.15.90:0/2527271512 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88affd640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 0x7fb88c0acc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 406615184 0 0) 0x7fb88c0c44f0 con 0x7fb88c0c34d0 2024-04-20T10:59:43.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb874003520 con 0x7fb88c0c34d0 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1061900587 0 0) 0x7fb874003520 con 0x7fb88c0c34d0 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 msgr2=0x7fb88c0acc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 0x7fb88c0acc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 >> v1:172.21.15.175:6789/0 conn(0x7fb88c0c38b0 legacy=0x7fb88c161010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c0c4eb0 con 0x7fb88c0c34d0 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.400+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fb87c001670 con 0x7fb88c0c34d0 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 >> v1:172.21.15.90:6789/0 conn(0x7fb88c0c34d0 legacy=0x7fb88c0ac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88a7fc640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8740039e0 0x7fb874003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88a7fc640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 0x7fb874004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88a7fc640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c0c3d60 con 0x7fb8740039e0 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb87400baf0 con 0x7fb874004d40 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb87400bcf0 con 0x7fb88c0ab4a0 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88b7fe640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8740039e0 0x7fb874003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88affd640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 0x7fb874004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88bfff640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88b7fe640 1 -- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 msgr2=0x7fb874004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88b7fe640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c0ab4a0 0x7fb874004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88b7fe640 1 -- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb874004d40 msgr2=0x7fb8740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88b7fe640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88b7fe640 1 -- 172.21.15.90:0/2527271512 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb874003520 con 0x7fb8740039e0 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.401+0000 7fb88bfff640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb874004d40 0x7fb8740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb88b7fe640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8740039e0 0x7fb874003e00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c290 tx=0x7fb874005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77daf990b3031a1a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c007d30 con 0x7fb8740039e0 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb87c030070 con 0x7fb8740039e0 2024-04-20T10:59:43.404 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb88a7fc640 1 -- 172.21.15.90:0/2527271512 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb87c005d30 con 0x7fb8740039e0 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb892043640 1 -- 172.21.15.90:0/2527271512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8740039e0 msgr2=0x7fb874003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb892043640 1 --2- 172.21.15.90:0/2527271512 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb8740039e0 0x7fb874003e00 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb87c00c290 tx=0x7fb874005830 comp rx=0 tx=0).stop 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb88bfff640 1 -- 172.21.15.90:0/2527271512 reap_dead start 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb892043640 1 -- 172.21.15.90:0/2527271512 shutdown_connections 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.402+0000 7fb892043640 1 -- 172.21.15.90:0/2527271512 >> 172.21.15.90:0/2527271512 conn(0x7fb88c0ca0a0 msgr2=0x7fb88c0ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.403+0000 7fb892043640 1 -- 172.21.15.90:0/2527271512 shutdown_connections 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.403+0000 7fb892043640 1 -- 172.21.15.90:0/2527271512 wait complete. 2024-04-20T10:59:43.408 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 Processor -- start 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 -- start start 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8740039e0 0x7fb88c1ed020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88c1e1df0 0x7fb88c1e2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c1467a0 0x7fb88c146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c0c57e0 con 0x7fb88c1e1df0 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb88c0c5470 con 0x7fb8740039e0 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb892043640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb88c0acc80 con 0x7fb88c1467a0 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb88affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88c1e1df0 0x7fb88c1e2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb88affd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88c1e1df0 0x7fb88c1e2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39336/0 (socket says 172.21.15.90:39336) 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.404+0000 7fb88affd640 1 -- 172.21.15.90:0/3934775926 learned_addr learned my addr 172.21.15.90:0/3934775926 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88b7fe640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8740039e0 0x7fb88c1ed020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88bfff640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c1467a0 0x7fb88c146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88affd640 1 -- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c1467a0 msgr2=0x7fb88c146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.409 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88affd640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c1467a0 0x7fb88c146c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88affd640 1 -- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8740039e0 msgr2=0x7fb88c1ed020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88affd640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8740039e0 0x7fb88c1ed020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88affd640 1 -- 172.21.15.90:0/3934775926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb88c1513d0 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb88affd640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88c1e1df0 0x7fb88c1e2270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb8800119a0 tx=0x7fb880011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb873fff640 1 -- 172.21.15.90:0/3934775926 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb88000fa90 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb873fff640 1 -- 172.21.15.90:0/3934775926 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb88000fc30 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb88c1516b0 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb873fff640 1 -- 172.21.15.90:0/3934775926 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb880014440 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.405+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb88c152430 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.406+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb88c076150 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.407+0000 7fb873fff640 1 -- 172.21.15.90:0/3934775926 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb880012040 con 0x7fb88c1e1df0 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.407+0000 7fb873fff640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb87806c920 0x7fb87806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.410 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.407+0000 7fb873fff640 1 -- 172.21.15.90:0/3934775926 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fb88008c7b0 con 0x7fb88c1e1df0 2024-04-20T10:59:43.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.407+0000 7fb88b7fe640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb87806c920 0x7fb87806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.407+0000 7fb88b7fe640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb87806c920 0x7fb87806ede0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb87c034000 tx=0x7fb87c007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:43.411 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.411+0000 7fb873fff640 1 -- 172.21.15.90:0/3934775926 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb880019030 con 0x7fb88c1e1df0 2024-04-20T10:59:43.588 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.588+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb88c0c41b0 con 0x7fb88c1e1df0 2024-04-20T10:59:43.590 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.590+0000 7fb873fff640 1 -- 172.21.15.90:0/3934775926 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+22023 (secure 0 0 0) 0x7fb88005a520 con 0x7fb88c1e1df0 2024-04-20T10:59:43.591 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:43.591 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:59:20.376229+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6834/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6833/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.175:6833/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.90:6835/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6834/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6837/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.90:6837/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.90:6835/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.175:6835/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6836/1538296646":"2024-04-21T10:55:30.341595+0000","172.21.15.90:6836/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.175:6832/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6836/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.175:6832/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.175:6833/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6834/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.175:6832/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.90:6834/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.90:6834/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.90:6837/1538296646":"2024-04-21T10:55:30.341595+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb87806c920 msgr2=0x7fb87806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb87806c920 0x7fb87806ede0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb87c034000 tx=0x7fb87c007000 comp rx=0 tx=0).stop 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88c1e1df0 msgr2=0x7fb88c1e2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88c1e1df0 0x7fb88c1e2270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb8800119a0 tx=0x7fb880011e60 comp rx=0 tx=0).stop 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 shutdown_connections 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb87806c920 0x7fb87806ede0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb88c1467a0 0x7fb88c146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb88c1e1df0 0x7fb88c1e2270 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 --2- 172.21.15.90:0/3934775926 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb8740039e0 0x7fb88c1ed020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 >> 172.21.15.90:0/3934775926 conn(0x7fb88c0ca0a0 msgr2=0x7fb88c14f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:43.593 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 shutdown_connections 2024-04-20T10:59:43.594 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.592+0000 7fb892043640 1 -- 172.21.15.90:0/3934775926 wait complete. 2024-04-20T10:59:43.604 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-20T10:50:27.678230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'a_metadata', 'create_time': '2024-04-20T10:50:37.606387+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'a_data', 'create_time': '2024-04-20T10:50:38.877596+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'a'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'b_metadata', 'create_time': '2024-04-20T10:50:46.703661+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'b_data', 'create_time': '2024-04-20T10:50:47.935403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'b'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-20T10:59:43.605 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-20T10:59:43.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.704+0000 7f62cc332640 1 Processor -- start 2024-04-20T10:59:43.704 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.704+0000 7f62cc332640 1 -- start start 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.704+0000 7f62cc332640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 0x7f62c40ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.704+0000 7f62cc332640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c41551e0 con 0x7f62c40c3b00 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.704+0000 7f62cc332640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c40aedd0 con 0x7f62c40ad3a0 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.704+0000 7f62cc332640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f62c40ae5c0 con 0x7f62c40adad0 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62ca8cf640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f62c40c3b00 0x7f62c41517a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54440/0 (socket says 172.21.15.90:54440) 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62ca8cf640 1 -- 172.21.15.90:0/2502373857 learned_addr learned my addr 172.21.15.90:0/2502373857 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62ca0ce640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 0x7f62c40ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 21362601 0 0) 0x7f62c41551e0 con 0x7f62c40c3b00 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b0003520 con 0x7f62c40c3b00 2024-04-20T10:59:43.708 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3911165516 0 0) 0x7f62b0003520 con 0x7f62c40c3b00 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 msgr2=0x7f62c40ac7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 0x7f62c40ac7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 >> v1:172.21.15.175:6789/0 conn(0x7f62c40ad3a0 legacy=0x7f62c40adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c40af0b0 con 0x7f62c40c3b00 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f62bc0019f0 con 0x7f62c40c3b00 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 >> v1:172.21.15.90:6789/0 conn(0x7f62c40c3b00 legacy=0x7f62c41517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 0x7f62b00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62b0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62b0004d40 0x7f62b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62b000baa0 con 0x7f62b0003f20 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62b000bc50 con 0x7f62b0004d40 2024-04-20T10:59:43.709 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f62b000be50 con 0x7f62c40adad0 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62c98cd640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62b0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62ca0ce640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 0x7f62b00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.705+0000 7f62ca8cf640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62b0004d40 0x7f62b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c98cd640 1 -- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 msgr2=0x7f62b00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c98cd640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c40adad0 0x7f62b00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c98cd640 1 -- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62b0004d40 msgr2=0x7f62b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c98cd640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62b0004d40 0x7f62b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c98cd640 1 -- 172.21.15.90:0/2502373857 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62b0003520 con 0x7f62b0003f20 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c98cd640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62b0004800 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f62c0001860 tx=0x7f62b0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a800f9ab1033dd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0038070 con 0x7f62b0003f20 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62c0033410 con 0x7f62b0003f20 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.706+0000 7f62c90cc640 1 -- 172.21.15.90:0/2502373857 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c0001430 con 0x7f62b0003f20 2024-04-20T10:59:43.710 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.707+0000 7f62cc332640 1 -- 172.21.15.90:0/2502373857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 msgr2=0x7f62b0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.707+0000 7f62cc332640 1 --2- 172.21.15.90:0/2502373857 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62b0004800 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f62c0001860 tx=0x7f62b0005830 comp rx=0 tx=0).stop 2024-04-20T10:59:43.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.707+0000 7f62ca8cf640 1 -- 172.21.15.90:0/2502373857 reap_dead start 2024-04-20T10:59:43.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.707+0000 7f62cc332640 1 -- 172.21.15.90:0/2502373857 shutdown_connections 2024-04-20T10:59:43.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.707+0000 7f62cc332640 1 -- 172.21.15.90:0/2502373857 >> 172.21.15.90:0/2502373857 conn(0x7f62c40c9100 msgr2=0x7f62c40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:43.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.707+0000 7f62cc332640 1 -- 172.21.15.90:0/2502373857 shutdown_connections 2024-04-20T10:59:43.711 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.707+0000 7f62cc332640 1 -- 172.21.15.90:0/2502373857 wait complete. 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.708+0000 7f62cc332640 1 Processor -- start 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.708+0000 7f62cc332640 1 -- start start 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62cc332640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62c414b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62cc332640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c41504f0 0x7f62c414e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62cc332640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62c4145900 0x7f62c4145d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62cc332640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f62c4151eb0 con 0x7f62b0003f20 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62cc332640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f62c40aeb80 con 0x7f62c4145900 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62cc332640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f62c4152030 con 0x7f62c41504f0 2024-04-20T10:59:43.714 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62c414b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62c414b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39352/0 (socket says 172.21.15.90:39352) 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 -- 172.21.15.90:0/438295058 learned_addr learned my addr 172.21.15.90:0/438295058 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62c98cd640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c41504f0 0x7f62c414e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca8cf640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62c4145900 0x7f62c4145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 -- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c41504f0 msgr2=0x7f62c414e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c41504f0 0x7f62c414e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 -- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62c4145900 msgr2=0x7f62c4145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62c4145900 0x7f62c4145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 -- 172.21.15.90:0/438295058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c41557e0 con 0x7f62b0003f20 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62c98cd640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c41504f0 0x7f62c414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca8cf640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62c4145900 0x7f62c4145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.709+0000 7f62ca0ce640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62c414b380 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f62b80119d0 tx=0x7f62b8011e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.710+0000 7f62b6ffd640 1 -- 172.21.15.90:0/438295058 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b800fb50 con 0x7f62b0003f20 2024-04-20T10:59:43.715 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.710+0000 7f62b6ffd640 1 -- 172.21.15.90:0/438295058 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62b800fcf0 con 0x7f62b0003f20 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.710+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62c414bec0 con 0x7f62b0003f20 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.710+0000 7f62b6ffd640 1 -- 172.21.15.90:0/438295058 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62b800fea0 con 0x7f62b0003f20 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.710+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62c414c480 con 0x7f62b0003f20 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.711+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62c414c6c0 con 0x7f62b0003f20 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.711+0000 7f62b6ffd640 1 -- 172.21.15.90:0/438295058 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62b8012040 con 0x7f62b0003f20 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.711+0000 7f62b6ffd640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f62a806c920 0x7f62a806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.711+0000 7f62b6ffd640 1 -- 172.21.15.90:0/438295058 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f62b808c990 con 0x7f62b0003f20 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.711+0000 7f62c98cd640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f62a806c920 0x7f62a806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:43.716 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.712+0000 7f62c98cd640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f62a806c920 0x7f62a806ede0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f62c0035000 tx=0x7f62c0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:43.717 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.716+0000 7f62b6ffd640 1 -- 172.21.15.90:0/438295058 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f62c414c6c0 con 0x7f62b0003f20 2024-04-20T10:59:43.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.893+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f62c4076150 con 0x7f62b0003f20 2024-04-20T10:59:43.894 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.893+0000 7f62b6ffd640 1 -- 172.21.15.90:0/438295058 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) ==== 93+0+10 (secure 0 0 0) 0x7f62b8019030 con 0x7f62b0003f20 2024-04-20T10:59:43.894 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 1 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f62a806c920 msgr2=0x7f62a806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f62a806c920 0x7f62a806ede0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f62c0035000 tx=0x7f62c0009030 comp rx=0 tx=0).stop 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 msgr2=0x7f62c414b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62c414b380 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f62b80119d0 tx=0x7f62b8011e90 comp rx=0 tx=0).stop 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 shutdown_connections 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f62a806c920 0x7f62a806ede0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f62c4145900 0x7f62c4145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.896 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f62c41504f0 0x7f62c414e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 --2- 172.21.15.90:0/438295058 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f62b0003f20 0x7f62c414b380 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:43.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 >> 172.21.15.90:0/438295058 conn(0x7f62c40c9100 msgr2=0x7f62c41515e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:43.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 shutdown_connections 2024-04-20T10:59:43.897 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:43.895+0000 7f62cc332640 1 -- 172.21.15.90:0/438295058 wait complete. 2024-04-20T10:59:43.907 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_metadata pg_num 2024-04-20T10:59:44.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.006+0000 7f6549a48640 1 Processor -- start 2024-04-20T10:59:44.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.006+0000 7f6549a48640 1 -- start start 2024-04-20T10:59:44.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6549a48640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6544153c50 0x7f654415a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6549a48640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f65440c5520 0x7f65440c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6549a48640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65440c2a70 0x7f65440c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6549a48640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6544071650 con 0x7f6544153c50 2024-04-20T10:59:44.008 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6549a48640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f65440718f0 con 0x7f65440c5520 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6549a48640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f65440c3ca0 con 0x7f65440c2a70 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6542ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6544153c50 0x7f654415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6542ffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6544153c50 0x7f654415a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39362/0 (socket says 172.21.15.90:39362) 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f6542ffd640 1 -- 172.21.15.90:0/2272952337 learned_addr learned my addr 172.21.15.90:0/2272952337 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f65427fc640 1 --2- 172.21.15.90:0/2272952337 >> v2:172.21.15.175:3300/0 conn(0x7f65440c5520 0x7f65440c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.007+0000 7f65437fe640 1 --2- 172.21.15.90:0/2272952337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65440c2a70 0x7f65440c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.008+0000 7f6542ffd640 1 -- 172.21.15.90:0/2272952337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65440c2a70 msgr2=0x7f65440c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.008+0000 7f6542ffd640 1 --2- 172.21.15.90:0/2272952337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65440c2a70 0x7f65440c44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.008+0000 7f6542ffd640 1 -- 172.21.15.90:0/2272952337 >> v2:172.21.15.175:3300/0 conn(0x7f65440c5520 msgr2=0x7f65440c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.008+0000 7f6542ffd640 1 --2- 172.21.15.90:0/2272952337 >> v2:172.21.15.175:3300/0 conn(0x7f65440c5520 0x7f65440c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.008+0000 7f6542ffd640 1 -- 172.21.15.90:0/2272952337 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65440c3f80 con 0x7f6544153c50 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.008+0000 7f65437fe640 1 --2- 172.21.15.90:0/2272952337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65440c2a70 0x7f65440c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:44.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.008+0000 7f6542ffd640 1 --2- 172.21.15.90:0/2272952337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6544153c50 0x7f654415a710 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f654406f1e0 tx=0x7f653402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727787d4411141f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6541ffb640 1 -- 172.21.15.90:0/2272952337 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653402ca70 con 0x7f6544153c50 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6541ffb640 1 -- 172.21.15.90:0/2272952337 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653402cc10 con 0x7f6544153c50 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6541ffb640 1 -- 172.21.15.90:0/2272952337 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65340343f0 con 0x7f6544153c50 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 -- 172.21.15.90:0/2272952337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6544153c50 msgr2=0x7f654415a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 --2- 172.21.15.90:0/2272952337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6544153c50 0x7f654415a710 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f654406f1e0 tx=0x7f653402bed0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 -- 172.21.15.90:0/2272952337 shutdown_connections 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 --2- 172.21.15.90:0/2272952337 >> v2:172.21.15.175:3300/0 conn(0x7f65440c5520 0x7f65440c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 --2- 172.21.15.90:0/2272952337 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65440c2a70 0x7f65440c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 --2- 172.21.15.90:0/2272952337 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6544153c50 0x7f654415a710 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 -- 172.21.15.90:0/2272952337 >> 172.21.15.90:0/2272952337 conn(0x7f65440c9100 msgr2=0x7f65440c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 -- 172.21.15.90:0/2272952337 shutdown_connections 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.009+0000 7f6549a48640 1 -- 172.21.15.90:0/2272952337 wait complete. 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.010+0000 7f6549a48640 1 Processor -- start 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.010+0000 7f6549a48640 1 -- start start 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6549a48640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65440c2a70 0x7f65441f03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6549a48640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65440c5520 0x7f654414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6549a48640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6544153c50 0x7f65441eca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6549a48640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65440c4b60 con 0x7f65440c5520 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6549a48640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65440c49e0 con 0x7f65440c2a70 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6549a48640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f65440c4ce0 con 0x7f6544153c50 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65440c5520 0x7f654414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65440c5520 0x7f654414e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39378/0 (socket says 172.21.15.90:39378) 2024-04-20T10:59:44.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 -- 172.21.15.90:0/54441911 learned_addr learned my addr 172.21.15.90:0/54441911 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 -- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6544153c50 msgr2=0x7f65441eca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65437fe640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6544153c50 0x7f65441eca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6542ffd640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65440c2a70 0x7f65441f03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6544153c50 0x7f65441eca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 -- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65440c2a70 msgr2=0x7f65441f03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65440c2a70 0x7f65441f03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65427fc640 1 -- 172.21.15.90:0/54441911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f654406e710 con 0x7f65440c5520 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f65437fe640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6544153c50 0x7f65441eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.011+0000 7f6542ffd640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65440c2a70 0x7f65441f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.012+0000 7f65427fc640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65440c5520 0x7f654414e590 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f653800e9e0 tx=0x7f653800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.012+0000 7f652bfff640 1 -- 172.21.15.90:0/54441911 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538017070 con 0x7f65440c5520 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.012+0000 7f652bfff640 1 -- 172.21.15.90:0/54441911 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f653800c9d0 con 0x7f65440c5520 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.012+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f654406ce40 con 0x7f65440c5520 2024-04-20T10:59:44.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.012+0000 7f652bfff640 1 -- 172.21.15.90:0/54441911 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653800cdc0 con 0x7f65440c5520 2024-04-20T10:59:44.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.012+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f654406e150 con 0x7f65440c5520 2024-04-20T10:59:44.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.013+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6544076150 con 0x7f65440c5520 2024-04-20T10:59:44.016 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.013+0000 7f652bfff640 1 -- 172.21.15.90:0/54441911 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f653801a070 con 0x7f65440c5520 2024-04-20T10:59:44.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.014+0000 7f652bfff640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f653006c8f0 0x7f653006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.014+0000 7f652bfff640 1 -- 172.21.15.90:0/54441911 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f653808c210 con 0x7f65440c5520 2024-04-20T10:59:44.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.014+0000 7f6542ffd640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f653006c8f0 0x7f653006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.014+0000 7f6542ffd640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f653006c8f0 0x7f653006edb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6534035000 tx=0x7f6534030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.018+0000 7f652bfff640 1 -- 172.21.15.90:0/54441911 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6538059f80 con 0x7f65440c5520 2024-04-20T10:59:44.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.191+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"} v 0) -- 0x7f65440c5300 con 0x7f65440c5520 2024-04-20T10:59:44.192 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.192+0000 7f652bfff640 1 -- 172.21.15.90:0/54441911 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_metadata", "var": "pg_num"}]=0 v38) ==== 99+0+11 (secure 0 0 0) 0x7f6538059880 con 0x7f65440c5520 2024-04-20T10:59:44.192 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:59:44.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.193+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f653006c8f0 msgr2=0x7f653006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.193+0000 7f6549a48640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f653006c8f0 0x7f653006edb0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f6534035000 tx=0x7f6534030000 comp rx=0 tx=0).stop 2024-04-20T10:59:44.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.193+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65440c5520 msgr2=0x7f654414e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.193+0000 7f6549a48640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65440c5520 0x7f654414e590 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f653800e9e0 tx=0x7f653800eea0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 shutdown_connections 2024-04-20T10:59:44.194 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f653006c8f0 0x7f653006edb0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6544153c50 0x7f65441eca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f65440c5520 0x7f654414e590 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 --2- 172.21.15.90:0/54441911 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65440c2a70 0x7f65441f03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 >> 172.21.15.90:0/54441911 conn(0x7f65440c9100 msgr2=0x7f65440c86c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:44.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 shutdown_connections 2024-04-20T10:59:44.195 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.194+0000 7f6549a48640 1 -- 172.21.15.90:0/54441911 wait complete. 2024-04-20T10:59:44.205 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get a_data pg_num 2024-04-20T10:59:44.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.304+0000 7f1128a31640 1 Processor -- start 2024-04-20T10:59:44.304 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.304+0000 7f1128a31640 1 -- start start 2024-04-20T10:59:44.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f1128a31640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f11240ad720 0x7f1124155010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f1128a31640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f11240705c0 0x7f11240c3530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.305 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f1128a31640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f112406d450 con 0x7f112406e210 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f1128a31640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f112406dd80 con 0x7f11240ad720 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f1128a31640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f112406d730 con 0x7f11240705c0 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f112259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f11240ad720 0x7f1124155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f1121d9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f112406e210 0x7f1124073430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54448/0 (socket says 172.21.15.90:54448) 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f1121d9b640 1 -- 172.21.15.90:0/3727220545 learned_addr learned my addr 172.21.15.90:0/3727220545 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f112259c640 1 -- 172.21.15.90:0/3727220545 >> v2:172.21.15.175:3300/0 conn(0x7f11240705c0 msgr2=0x7f11240c3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f112259c640 1 --2- 172.21.15.90:0/3727220545 >> v2:172.21.15.175:3300/0 conn(0x7f11240705c0 0x7f11240c3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f112259c640 1 -- 172.21.15.90:0/3727220545 >> v1:172.21.15.90:6789/0 conn(0x7f112406e210 legacy=0x7f1124073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f112259c640 1 -- 172.21.15.90:0/3727220545 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f112406da10 con 0x7f11240ad720 2024-04-20T10:59:44.306 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.305+0000 7f112159a640 1 -- 172.21.15.90:0/3727220545 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590972121 0 0) 0x7f112406d450 con 0x7f112406e210 2024-04-20T10:59:44.307 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.306+0000 7f112259c640 1 --2- 172.21.15.90:0/3727220545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11240ad720 0x7f1124155010 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f112406dcf0 tx=0x7f111402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81a23d6d7e571aab server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.306+0000 7f112159a640 1 -- 172.21.15.90:0/3727220545 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11140315a0 con 0x7f11240ad720 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.306+0000 7f112159a640 1 -- 172.21.15.90:0/3727220545 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1114037070 con 0x7f11240ad720 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.306+0000 7f112159a640 1 -- 172.21.15.90:0/3727220545 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114031960 con 0x7f11240ad720 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 -- 172.21.15.90:0/3727220545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11240ad720 msgr2=0x7f1124155010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 --2- 172.21.15.90:0/3727220545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11240ad720 0x7f1124155010 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f112406dcf0 tx=0x7f111402b840 comp rx=0 tx=0).stop 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 -- 172.21.15.90:0/3727220545 shutdown_connections 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 --2- 172.21.15.90:0/3727220545 >> v2:172.21.15.175:3300/0 conn(0x7f11240705c0 0x7f11240c3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 --2- 172.21.15.90:0/3727220545 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f11240ad720 0x7f1124155010 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 -- 172.21.15.90:0/3727220545 >> 172.21.15.90:0/3727220545 conn(0x7f11240c8080 msgr2=0x7f11240c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 -- 172.21.15.90:0/3727220545 shutdown_connections 2024-04-20T10:59:44.308 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.307+0000 7f1128a31640 1 -- 172.21.15.90:0/3727220545 wait complete. 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.308+0000 7f1128a31640 1 Processor -- start 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.308+0000 7f1128a31640 1 -- start start 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1128a31640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f112406e210 0x7f11241ed0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1128a31640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240705c0 0x7f11241ed620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1128a31640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11240ad720 0x7f11241eb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1128a31640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f1124073b40 con 0x7f112406e210 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1128a31640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f1124070b30 con 0x7f11240705c0 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1128a31640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f11240c42f0 con 0x7f11240ad720 2024-04-20T10:59:44.311 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f112406e210 0x7f11241ed0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f112406e210 0x7f11241ed0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39398/0 (socket says 172.21.15.90:39398) 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 -- 172.21.15.90:0/1625560314 learned_addr learned my addr 172.21.15.90:0/1625560314 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1121d9b640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240705c0 0x7f11241ed620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1122d9d640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11240ad720 0x7f11241eb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 -- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11240ad720 msgr2=0x7f11241eb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11240ad720 0x7f11241eb3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 -- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240705c0 msgr2=0x7f11241ed620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240705c0 0x7f11241ed620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 -- 172.21.15.90:0/1625560314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11241edd10 con 0x7f112406e210 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f112259c640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f112406e210 0x7f11241ed0e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1114034040 tx=0x7f11140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1112ffd640 1 -- 172.21.15.90:0/1625560314 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114004230 con 0x7f112406e210 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1112ffd640 1 -- 172.21.15.90:0/1625560314 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f11140043d0 con 0x7f112406e210 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1112ffd640 1 -- 172.21.15.90:0/1625560314 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1114032880 con 0x7f112406e210 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.309+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11241da710 con 0x7f112406e210 2024-04-20T10:59:44.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.310+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11241eaea0 con 0x7f112406e210 2024-04-20T10:59:44.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.311+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1124076150 con 0x7f112406e210 2024-04-20T10:59:44.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.311+0000 7f1112ffd640 1 -- 172.21.15.90:0/1625560314 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1114032a20 con 0x7f112406e210 2024-04-20T10:59:44.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.311+0000 7f1112ffd640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f110406c920 0x7f110406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.312+0000 7f1121d9b640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f110406c920 0x7f110406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.312+0000 7f1112ffd640 1 -- 172.21.15.90:0/1625560314 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f111402f030 con 0x7f112406e210 2024-04-20T10:59:44.313 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.312+0000 7f1121d9b640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f110406c920 0x7f110406ede0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f11241de8a0 tx=0x7f1118007b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.316 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.316+0000 7f1112ffd640 1 -- 172.21.15.90:0/1625560314 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f1114041070 con 0x7f112406e210 2024-04-20T10:59:44.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.494+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"} v 0) -- 0x7f11241dac30 con 0x7f112406e210 2024-04-20T10:59:44.494 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.494+0000 7f1112ffd640 1 -- 172.21.15.90:0/1625560314 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "a_data", "var": "pg_num"}]=0 v38) ==== 95+0+11 (secure 0 0 0) 0x7f111407c0a0 con 0x7f112406e210 2024-04-20T10:59:44.494 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f110406c920 msgr2=0x7f110406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f110406c920 0x7f110406ede0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f11241de8a0 tx=0x7f1118007b90 comp rx=0 tx=0).stop 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f112406e210 msgr2=0x7f11241ed0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f112406e210 0x7f11241ed0e0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1114034040 tx=0x7f11140046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 shutdown_connections 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f110406c920 0x7f110406ede0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f11240ad720 0x7f11241eb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f11240705c0 0x7f11241ed620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 --2- 172.21.15.90:0/1625560314 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f112406e210 0x7f11241ed0e0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 >> 172.21.15.90:0/1625560314 conn(0x7f11240c8080 msgr2=0x7f11240c3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 shutdown_connections 2024-04-20T10:59:44.497 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.496+0000 7f1128a31640 1 -- 172.21.15.90:0/1625560314 wait complete. 2024-04-20T10:59:44.507 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_metadata pg_num 2024-04-20T10:59:44.608 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.608+0000 7f986f32c640 1 Processor -- start 2024-04-20T10:59:44.609 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.608+0000 7f986f32c640 1 -- start start 2024-04-20T10:59:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f986f32c640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f986806ca40 0x7f9868153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f986f32c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9868071fa0 con 0x7f986806f330 2024-04-20T10:59:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f986f32c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9868153500 con 0x7f9868150c00 2024-04-20T10:59:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f986f32c640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f98680c4210 con 0x7f986806ca40 2024-04-20T10:59:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f986d8c9640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f986806f330 0x7f986806d450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54452/0 (socket says 172.21.15.90:54452) 2024-04-20T10:59:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f986d8c9640 1 -- 172.21.15.90:0/251046457 learned_addr learned my addr 172.21.15.90:0/251046457 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:44.610 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f986c8c7640 1 --2- 172.21.15.90:0/251046457 >> v2:172.21.15.175:3300/0 conn(0x7f986806ca40 0x7f9868153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f985ffff640 1 -- 172.21.15.90:0/251046457 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998638281 0 0) 0x7f9868071fa0 con 0x7f986806f330 2024-04-20T10:59:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f985ffff640 1 -- 172.21.15.90:0/251046457 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9854003520 con 0x7f986806f330 2024-04-20T10:59:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f985ffff640 1 -- 172.21.15.90:0/251046457 <== mon.1 v1:172.21.15.175:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445900470 0 0) 0x7f9868153500 con 0x7f9868150c00 2024-04-20T10:59:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.609+0000 7f985ffff640 1 -- 172.21.15.90:0/251046457 --> v1:172.21.15.175:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9868071fa0 con 0x7f9868150c00 2024-04-20T10:59:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.610+0000 7f986c8c7640 1 -- 172.21.15.90:0/251046457 >> v1:172.21.15.175:6789/0 conn(0x7f9868150c00 legacy=0x7f98680c3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.610+0000 7f986c8c7640 1 -- 172.21.15.90:0/251046457 >> v1:172.21.15.90:6789/0 conn(0x7f986806f330 legacy=0x7f986806d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.611 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.610+0000 7f986c8c7640 1 -- 172.21.15.90:0/251046457 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986806ced0 con 0x7f986806ca40 2024-04-20T10:59:44.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.610+0000 7f986c8c7640 1 --2- 172.21.15.90:0/251046457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f986806ca40 0x7f9868153fa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98680c4390 tx=0x7f985802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e863940421a582c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f985ffff640 1 -- 172.21.15.90:0/251046457 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858034070 con 0x7f986806ca40 2024-04-20T10:59:44.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f985ffff640 1 -- 172.21.15.90:0/251046457 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9858030610 con 0x7f986806ca40 2024-04-20T10:59:44.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f985ffff640 1 -- 172.21.15.90:0/251046457 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98580309c0 con 0x7f986806ca40 2024-04-20T10:59:44.612 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f986f32c640 1 -- 172.21.15.90:0/251046457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f986806ca40 msgr2=0x7f9868153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f986f32c640 1 --2- 172.21.15.90:0/251046457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f986806ca40 0x7f9868153fa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f98680c4390 tx=0x7f985802b960 comp rx=0 tx=0).stop 2024-04-20T10:59:44.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f986f32c640 1 -- 172.21.15.90:0/251046457 shutdown_connections 2024-04-20T10:59:44.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f986f32c640 1 --2- 172.21.15.90:0/251046457 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f986806ca40 0x7f9868153fa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f986f32c640 1 -- 172.21.15.90:0/251046457 >> 172.21.15.90:0/251046457 conn(0x7f98680c9100 msgr2=0x7f98680c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:44.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f986f32c640 1 -- 172.21.15.90:0/251046457 shutdown_connections 2024-04-20T10:59:44.613 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.611+0000 7f986f32c640 1 -- 172.21.15.90:0/251046457 wait complete. 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.613+0000 7f986f32c640 1 Processor -- start 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.613+0000 7f986f32c640 1 -- start start 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.613+0000 7f986f32c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f986806f330 0x7f9868146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.613+0000 7f986f32c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9868150c00 0x7f98681ecd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986f32c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98681559c0 0x7f986814bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986f32c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f986806d1b0 con 0x7f9868150c00 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986f32c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9868153a80 con 0x7f98681559c0 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986f32c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f986806db60 con 0x7f986806f330 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9868150c00 0x7f98681ecd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.615 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9868150c00 0x7f98681ecd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39406/0 (socket says 172.21.15.90:39406) 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 -- 172.21.15.90:0/487390009 learned_addr learned my addr 172.21.15.90:0/487390009 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986d0c8640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f986806f330 0x7f9868146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986d8c9640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98681559c0 0x7f986814bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 -- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f986806f330 msgr2=0x7f9868146730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f986806f330 0x7f9868146730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 -- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98681559c0 msgr2=0x7f986814bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98681559c0 0x7f986814bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 -- 172.21.15.90:0/487390009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98681ec300 con 0x7f9868150c00 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986c8c7640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9868150c00 0x7f98681ecd80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f985802b9a0 tx=0x7f98580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f985dffb640 1 -- 172.21.15.90:0/487390009 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858048070 con 0x7f9868150c00 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f985dffb640 1 -- 172.21.15.90:0/487390009 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98580044c0 con 0x7f9868150c00 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9868146f70 con 0x7f9868150c00 2024-04-20T10:59:44.616 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.614+0000 7f985dffb640 1 -- 172.21.15.90:0/487390009 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9858034050 con 0x7f9868150c00 2024-04-20T10:59:44.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.615+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98681ec860 con 0x7f9868150c00 2024-04-20T10:59:44.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.615+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9868076150 con 0x7f9868150c00 2024-04-20T10:59:44.617 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.616+0000 7f985dffb640 1 -- 172.21.15.90:0/487390009 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f985804b070 con 0x7f9868150c00 2024-04-20T10:59:44.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.616+0000 7f985dffb640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f984c06c8f0 0x7f984c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:44.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.616+0000 7f985dffb640 1 -- 172.21.15.90:0/487390009 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f98580ade40 con 0x7f9868150c00 2024-04-20T10:59:44.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.616+0000 7f986d0c8640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f984c06c8f0 0x7f984c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:44.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.617+0000 7f986d0c8640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f984c06c8f0 0x7f984c06edb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f98640011e0 tx=0x7f9864009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:44.621 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.621+0000 7f985dffb640 1 -- 172.21.15.90:0/487390009 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f98681ec300 con 0x7f9868150c00 2024-04-20T10:59:44.797 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.797+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"} v 0) -- 0x7f9868072170 con 0x7f9868150c00 2024-04-20T10:59:44.798 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.797+0000 7f985dffb640 1 -- 172.21.15.90:0/487390009 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_metadata", "var": "pg_num"}]=0 v38) ==== 99+0+11 (secure 0 0 0) 0x7f985807b680 con 0x7f9868150c00 2024-04-20T10:59:44.798 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 32 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f984c06c8f0 msgr2=0x7f984c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f984c06c8f0 0x7f984c06edb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f98640011e0 tx=0x7f9864009040 comp rx=0 tx=0).stop 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9868150c00 msgr2=0x7f98681ecd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9868150c00 0x7f98681ecd80 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f985802b9a0 tx=0x7f98580046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 shutdown_connections 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f984c06c8f0 0x7f984c06edb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f98681559c0 0x7f986814bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9868150c00 0x7f98681ecd80 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.799+0000 7f986f32c640 1 --2- 172.21.15.90:0/487390009 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f986806f330 0x7f9868146730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.800+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 >> 172.21.15.90:0/487390009 conn(0x7f98680c9100 msgr2=0x7f986814fe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.800+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 shutdown_connections 2024-04-20T10:59:44.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.800+0000 7f986f32c640 1 -- 172.21.15.90:0/487390009 wait complete. 2024-04-20T10:59:44.811 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get b_data pg_num 2024-04-20T10:59:44.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.911+0000 7f59c8a88640 1 Processor -- start 2024-04-20T10:59:45.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.911+0000 7f59c8a88640 1 -- start start 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c8a88640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f59c406deb0 0x7f59c4152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c8a88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c40c3d40 0x7f59c414fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c8a88640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f59c4150380 0x7f59c40c3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c8a88640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f59c40ab0e0 con 0x7f59c4150380 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c8a88640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f59c40c2b20 con 0x7f59c406deb0 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c8a88640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59c4150800 con 0x7f59c40c3d40 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f59c4150380 0x7f59c40c3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f59c4150380 0x7f59c40c3000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39414/0 (socket says 172.21.15.90:39414) 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 -- 172.21.15.90:0/1421089510 learned_addr learned my addr 172.21.15.90:0/1421089510 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c259c640 1 --2- 172.21.15.90:0/1421089510 >> v2:172.21.15.175:3300/0 conn(0x7f59c406deb0 0x7f59c4152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.520 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c1d9b640 1 --2- 172.21.15.90:0/1421089510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c40c3d40 0x7f59c414fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 -- 172.21.15.90:0/1421089510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c40c3d40 msgr2=0x7f59c414fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 --2- 172.21.15.90:0/1421089510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c40c3d40 0x7f59c414fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 -- 172.21.15.90:0/1421089510 >> v2:172.21.15.175:3300/0 conn(0x7f59c406deb0 msgr2=0x7f59c4152b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 --2- 172.21.15.90:0/1421089510 >> v2:172.21.15.175:3300/0 conn(0x7f59c406deb0 0x7f59c4152b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c2d9d640 1 -- 172.21.15.90:0/1421089510 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c4153250 con 0x7f59c4150380 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c1d9b640 1 --2- 172.21.15.90:0/1421089510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c40c3d40 0x7f59c414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.912+0000 7f59c259c640 1 --2- 172.21.15.90:0/1421089510 >> v2:172.21.15.175:3300/0 conn(0x7f59c406deb0 0x7f59c4152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.913+0000 7f59c2d9d640 1 --2- 172.21.15.90:0/1421089510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c4150380 0x7f59c40c3000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f59c40702f0 tx=0x7f59bc02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68bffd8a063e9b95 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.913+0000 7f59c159a640 1 -- 172.21.15.90:0/1421089510 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc02c9e0 con 0x7f59c4150380 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.913+0000 7f59c159a640 1 -- 172.21.15.90:0/1421089510 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59bc02cb80 con 0x7f59c4150380 2024-04-20T10:59:45.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.913+0000 7f59c159a640 1 -- 172.21.15.90:0/1421089510 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59bc0343f0 con 0x7f59c4150380 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 -- 172.21.15.90:0/1421089510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c4150380 msgr2=0x7f59c40c3000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 --2- 172.21.15.90:0/1421089510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c4150380 0x7f59c40c3000 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f59c40702f0 tx=0x7f59bc02be40 comp rx=0 tx=0).stop 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 -- 172.21.15.90:0/1421089510 shutdown_connections 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 --2- 172.21.15.90:0/1421089510 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c4150380 0x7f59c40c3000 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 --2- 172.21.15.90:0/1421089510 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c40c3d40 0x7f59c414fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 --2- 172.21.15.90:0/1421089510 >> v2:172.21.15.175:3300/0 conn(0x7f59c406deb0 0x7f59c4152b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 -- 172.21.15.90:0/1421089510 >> 172.21.15.90:0/1421089510 conn(0x7f59c40c8080 msgr2=0x7f59c40c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 -- 172.21.15.90:0/1421089510 shutdown_connections 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.914+0000 7f59c8a88640 1 -- 172.21.15.90:0/1421089510 wait complete. 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.915+0000 7f59c8a88640 1 Processor -- start 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.915+0000 7f59c8a88640 1 -- start start 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c8a88640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c406deb0 0x7f59c40c3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c8a88640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40c3d40 0x7f59c4147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c8a88640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c4150380 0x7f59c4147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c8a88640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59c40c4880 con 0x7f59c40c3d40 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c8a88640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59c4153810 con 0x7f59c406deb0 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c8a88640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59c4153af0 con 0x7f59c4150380 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40c3d40 0x7f59c4147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40c3d40 0x7f59c4147320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:39428/0 (socket says 172.21.15.90:39428) 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 -- 172.21.15.90:0/3731149899 learned_addr learned my addr 172.21.15.90:0/3731149899 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c2d9d640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c4150380 0x7f59c4147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c259c640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c406deb0 0x7f59c40c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 -- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c4150380 msgr2=0x7f59c4147860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c4150380 0x7f59c4147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 -- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c406deb0 msgr2=0x7f59c40c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c406deb0 0x7f59c40c3170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 -- 172.21.15.90:0/3731149899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c4151c90 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.916+0000 7f59c1d9b640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40c3d40 0x7f59c4147320 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c820 tx=0x7f59b800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.917+0000 7f59b2ffd640 1 -- 172.21.15.90:0/3731149899 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8015070 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.917+0000 7f59b2ffd640 1 -- 172.21.15.90:0/3731149899 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b8007a30 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.917+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c4151f70 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.917+0000 7f59b2ffd640 1 -- 172.21.15.90:0/3731149899 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b8007e20 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.917+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c40c36b0 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.918+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c4076150 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.918+0000 7f59b2ffd640 1 -- 172.21.15.90:0/3731149899 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f59b8018070 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.918+0000 7f59b2ffd640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59a406c920 0x7f59a406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.919+0000 7f59c259c640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59a406c920 0x7f59a406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.919+0000 7f59b2ffd640 1 -- 172.21.15.90:0/3731149899 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f59b808bca0 con 0x7f59c40c3d40 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.919+0000 7f59c259c640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59a406c920 0x7f59a406ede0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b840 tx=0x7f59b4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:45.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:44.923+0000 7f59b2ffd640 1 -- 172.21.15.90:0/3731149899 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f59b8059a10 con 0x7f59c40c3d40 2024-04-20T10:59:45.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.100+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"} v 0) -- 0x7f59c40abf90 con 0x7f59c40c3d40 2024-04-20T10:59:45.525 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.100+0000 7f59b2ffd640 1 -- 172.21.15.90:0/3731149899 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "b_data", "var": "pg_num"}]=0 v38) ==== 95+0+11 (secure 0 0 0) 0x7f59b8059310 con 0x7f59c40c3d40 2024-04-20T10:59:45.525 INFO:teuthology.orchestra.run.smithi090.stdout:pg_num: 64 2024-04-20T10:59:45.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59a406c920 msgr2=0x7f59a406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59a406c920 0x7f59a406ede0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f59b400b840 tx=0x7f59b4008040 comp rx=0 tx=0).stop 2024-04-20T10:59:45.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40c3d40 msgr2=0x7f59c4147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40c3d40 0x7f59c4147320 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f59b800c820 tx=0x7f59b800cce0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 shutdown_connections 2024-04-20T10:59:45.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f59a406c920 0x7f59a406ede0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.527 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59c4150380 0x7f59c4147860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59c40c3d40 0x7f59c4147320 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 --2- 172.21.15.90:0/3731149899 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59c406deb0 0x7f59c40c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 >> 172.21.15.90:0/3731149899 conn(0x7f59c40c8080 msgr2=0x7f59c406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:45.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 shutdown_connections 2024-04-20T10:59:45.528 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.102+0000 7f59c8a88640 1 -- 172.21.15.90:0/3731149899 wait complete. 2024-04-20T10:59:45.529 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-20T10:59:45.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.644+0000 7f6cac85c640 1 Processor -- start 2024-04-20T10:59:45.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.644+0000 7f6cac85c640 1 -- start start 2024-04-20T10:59:45.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.644+0000 7f6cac85c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ca8153d60 0x7f6ca80ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.644+0000 7f6cac85c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca80c4600 0x7f6ca80c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.644+0000 7f6cac85c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ca80acaa0 con 0x7f6ca80ac2b0 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.644+0000 7f6cac85c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6ca80acdf0 con 0x7f6ca8153d60 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.644+0000 7f6cac85c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca815a750 con 0x7f6ca80c4600 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ca8153d60 0x7f6ca80ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6ca8153d60 0x7f6ca80ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51912/0 (socket says 172.21.15.90:51912) 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca659c640 1 -- 172.21.15.90:0/108278154 learned_addr learned my addr 172.21.15.90:0/108278154 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca6d9d640 1 --2- 172.21.15.90:0/108278154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca80c4600 0x7f6ca80c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca659c640 1 -- 172.21.15.90:0/108278154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca80c4600 msgr2=0x7f6ca80c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca659c640 1 --2- 172.21.15.90:0/108278154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca80c4600 0x7f6ca80c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca659c640 1 -- 172.21.15.90:0/108278154 >> v1:172.21.15.175:6789/0 conn(0x7f6ca80ac2b0 legacy=0x7f6ca80c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.645+0000 7f6ca659c640 1 -- 172.21.15.90:0/108278154 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca815aa30 con 0x7f6ca8153d60 2024-04-20T10:59:45.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6ca659c640 1 --2- 172.21.15.90:0/108278154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca8153d60 0x7f6ca80ab4a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195426b46221e94f server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:45.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6ca5d9b640 1 -- 172.21.15.90:0/108278154 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c980317c0 con 0x7f6ca8153d60 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6ca5d9b640 1 -- 172.21.15.90:0/108278154 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c98037070 con 0x7f6ca8153d60 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6ca5d9b640 1 -- 172.21.15.90:0/108278154 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98031b80 con 0x7f6ca8153d60 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6cac85c640 1 -- 172.21.15.90:0/108278154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca8153d60 msgr2=0x7f6ca80ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6cac85c640 1 --2- 172.21.15.90:0/108278154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca8153d60 0x7f6ca80ab4a0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009870 tx=0x7f6c9802b860 comp rx=0 tx=0).stop 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6cac85c640 1 -- 172.21.15.90:0/108278154 shutdown_connections 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6cac85c640 1 --2- 172.21.15.90:0/108278154 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca80c4600 0x7f6ca80c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6cac85c640 1 --2- 172.21.15.90:0/108278154 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca8153d60 0x7f6ca80ab4a0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.646+0000 7f6cac85c640 1 -- 172.21.15.90:0/108278154 >> 172.21.15.90:0/108278154 conn(0x7f6ca8067de0 msgr2=0x7f6ca80ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.647+0000 7f6cac85c640 1 -- 172.21.15.90:0/108278154 shutdown_connections 2024-04-20T10:59:45.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.647+0000 7f6cac85c640 1 -- 172.21.15.90:0/108278154 wait complete. 2024-04-20T10:59:45.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.648+0000 7f6cac85c640 1 Processor -- start 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.648+0000 7f6cac85c640 1 -- start start 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.648+0000 7f6cac85c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ca80ac2b0 0x7f6ca8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.648+0000 7f6cac85c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca80c4600 0x7f6ca80aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6cac85c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca8153d60 0x7f6ca81eda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6cac85c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8070fa0 con 0x7f6ca80c4600 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6cac85c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8070e20 con 0x7f6ca80ac2b0 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6cac85c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca80c3b20 con 0x7f6ca8153d60 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca80c4600 0x7f6ca80aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca80c4600 0x7f6ca80aed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51920/0 (socket says 172.21.15.90:51920) 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 -- 172.21.15.90:0/3520596565 learned_addr learned my addr 172.21.15.90:0/3520596565 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6ca6d9d640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca8153d60 0x7f6ca81eda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6ca659c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ca80ac2b0 0x7f6ca8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 -- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca8153d60 msgr2=0x7f6ca81eda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca8153d60 0x7f6ca81eda50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 -- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ca80ac2b0 msgr2=0x7f6ca8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ca80ac2b0 0x7f6ca8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 -- 172.21.15.90:0/3520596565 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca8158e30 con 0x7f6ca80c4600 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6ca659c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ca80ac2b0 0x7f6ca8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9ffff640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca80c4600 0x7f6ca80aed40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000c430 tx=0x7f6c9000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9effd640 1 -- 172.21.15.90:0/3520596565 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90017070 con 0x7f6ca80c4600 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9effd640 1 -- 172.21.15.90:0/3520596565 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c900052d0 con 0x7f6ca80c4600 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca8159c10 con 0x7f6ca80c4600 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6c9effd640 1 -- 172.21.15.90:0/3520596565 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c90003830 con 0x7f6ca80c4600 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.649+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca81f03b0 con 0x7f6ca80c4600 2024-04-20T10:59:45.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.651+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca8076150 con 0x7f6ca80c4600 2024-04-20T10:59:45.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.651+0000 7f6c9effd640 1 -- 172.21.15.90:0/3520596565 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6c9001a070 con 0x7f6ca80c4600 2024-04-20T10:59:45.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.652+0000 7f6c9effd640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6c8806c920 0x7f6c8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:45.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.652+0000 7f6c9effd640 1 -- 172.21.15.90:0/3520596565 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f6c9008b590 con 0x7f6ca80c4600 2024-04-20T10:59:45.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.652+0000 7f6ca659c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6c8806c920 0x7f6c8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:45.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.652+0000 7f6ca659c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6c8806c920 0x7f6c8806ede0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c98036000 tx=0x7f6c9803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:45.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.657+0000 7f6c9effd640 1 -- 172.21.15.90:0/3520596565 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6ca8158e30 con 0x7f6ca80c4600 2024-04-20T10:59:45.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.846+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6ca80caa80 con 0x7f6ca80c4600 2024-04-20T10:59:45.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.846+0000 7f6c9effd640 1 -- 172.21.15.90:0/3520596565 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 22 entries v38) ==== 81+0+1344 (secure 0 0 0) 0x7f6c90058c20 con 0x7f6ca80c4600 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/3994531378 2024-04-21T10:59:20.376156+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6833/3798454731 2024-04-21T10:59:10.374554+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/732131803 2024-04-21T10:56:45.352698+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6833/133567489 2024-04-21T10:56:05.346704+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/3994531378 2024-04-21T10:59:20.376156+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6834/2994051895 2024-04-21T10:52:40.317797+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6837/597803483 2024-04-21T10:57:50.361461+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6837/3822230008 2024-04-21T10:52:41.327372+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/1834995897 2024-04-21T10:53:35.325514+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6835/2994051895 2024-04-21T10:52:40.317797+0000 2024-04-20T10:59:45.847 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6836/1538296646 2024-04-21T10:55:30.341595+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6836/3822230008 2024-04-21T10:52:41.327372+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6832/1855171726 2024-04-21T10:54:15.330938+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6836/597803483 2024-04-21T10:57:50.361461+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6832/133567489 2024-04-21T10:56:05.346704+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6833/1855171726 2024-04-21T10:54:15.330938+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/4126797977 2024-04-21T10:54:50.335879+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.175:6832/3798454731 2024-04-21T10:59:10.374554+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6835/4126797977 2024-04-21T10:54:50.335879+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/732131803 2024-04-21T10:56:45.352698+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6834/1834995897 2024-04-21T10:53:35.325514+0000 2024-04-20T10:59:45.848 INFO:teuthology.orchestra.run.smithi090.stdout:172.21.15.90:6837/1538296646 2024-04-21T10:55:30.341595+0000 2024-04-20T10:59:45.849 INFO:teuthology.orchestra.run.smithi090.stderr:listed 22 entries 2024-04-20T10:59:45.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6c8806c920 msgr2=0x7f6c8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6c8806c920 0x7f6c8806ede0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6c98036000 tx=0x7f6c9803d040 comp rx=0 tx=0).stop 2024-04-20T10:59:45.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca80c4600 msgr2=0x7f6ca80aed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca80c4600 0x7f6ca80aed40 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f6c9000c430 tx=0x7f6c9000c8f0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 shutdown_connections 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6c8806c920 0x7f6c8806ede0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6ca8153d60 0x7f6ca81eda50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6ca80c4600 0x7f6ca80aed40 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 --2- 172.21.15.90:0/3520596565 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6ca80ac2b0 0x7f6ca8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 >> 172.21.15.90:0/3520596565 conn(0x7f6ca8067de0 msgr2=0x7f6ca80ab4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 shutdown_connections 2024-04-20T10:59:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:45.848+0000 7f6cac85c640 1 -- 172.21.15.90:0/3520596565 wait complete. 2024-04-20T10:59:45.860 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-04-20T10:59:45.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:45.860 DEBUG:teuthology.orchestra.run.smithi175:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-04-20T10:59:45.893 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T10:59:45.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:45.894 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-20T10:59:45.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:45.959 DEBUG:teuthology.orchestra.run.smithi090:> ip netns list 2024-04-20T10:59:45.975 INFO:teuthology.orchestra.run.smithi090.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-20T10:59:45.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:45.975 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-20T10:59:46.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:46.039 DEBUG:teuthology.orchestra.run.smithi090:> sudo ip link delete ceph-brx 2024-04-20T10:59:46.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:46.130 DEBUG:teuthology.orchestra.run.smithi175:> ip netns list 2024-04-20T10:59:46.148 INFO:teuthology.orchestra.run.smithi175.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-20T10:59:46.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:46.148 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-20T10:59:46.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T10:59:46.217 DEBUG:teuthology.orchestra.run.smithi175:> sudo ip link delete ceph-brx 2024-04-20T10:59:46.315 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-20T10:59:46.324 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-20T10:59:46.325 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:59:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.425+0000 7f2408e5c640 1 Processor -- start 2024-04-20T10:59:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.425+0000 7f2408e5c640 1 -- start start 2024-04-20T10:59:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f2408e5c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f240406deb0 0x7f2404152b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f2408e5c640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24040c2b20 con 0x7f2404150550 2024-04-20T10:59:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f2408e5c640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2404153250 con 0x7f24040c3d40 2024-04-20T10:59:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f2408e5c640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f24040ab0e0 con 0x7f240406deb0 2024-04-20T10:59:46.427 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f240259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f240406deb0 0x7f2404152b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f240259c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f240406deb0 0x7f2404152b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51936/0 (socket says 172.21.15.90:51936) 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f240259c640 1 -- 172.21.15.90:0/662067276 learned_addr learned my addr 172.21.15.90:0/662067276 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f2402d9d640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f2404150550 0x7f24040c3000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48352/0 (socket says 172.21.15.90:48352) 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f240259c640 1 -- 172.21.15.90:0/662067276 >> v1:172.21.15.175:6789/0 conn(0x7f24040c3d40 legacy=0x7f240414fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f240259c640 1 -- 172.21.15.90:0/662067276 >> v1:172.21.15.90:6789/0 conn(0x7f2404150550 legacy=0x7f24040c3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f240259c640 1 -- 172.21.15.90:0/662067276 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2404153530 con 0x7f240406deb0 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.426+0000 7f2401d9b640 1 -- 172.21.15.90:0/662067276 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823727220 0 0) 0x7f24040c2b20 con 0x7f2404150550 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f240259c640 1 --2- 172.21.15.90:0/662067276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240406deb0 0x7f2404152b90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f23f40098a0 tx=0x7f23f402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f327ed1db7e805b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f2401d9b640 1 -- 172.21.15.90:0/662067276 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f4035020 con 0x7f240406deb0 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f2401d9b640 1 -- 172.21.15.90:0/662067276 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23f4031640 con 0x7f240406deb0 2024-04-20T10:59:46.428 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f2401d9b640 1 -- 172.21.15.90:0/662067276 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f402d040 con 0x7f240406deb0 2024-04-20T10:59:46.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f2408e5c640 1 -- 172.21.15.90:0/662067276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240406deb0 msgr2=0x7f2404152b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.431 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f2408e5c640 1 --2- 172.21.15.90:0/662067276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240406deb0 0x7f2404152b90 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f23f40098a0 tx=0x7f23f402b8f0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f2408e5c640 1 -- 172.21.15.90:0/662067276 shutdown_connections 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.427+0000 7f2408e5c640 1 --2- 172.21.15.90:0/662067276 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f240406deb0 0x7f2404152b90 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.428+0000 7f2408e5c640 1 -- 172.21.15.90:0/662067276 >> 172.21.15.90:0/662067276 conn(0x7f24040c8080 msgr2=0x7f24040c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.428+0000 7f2408e5c640 1 -- 172.21.15.90:0/662067276 shutdown_connections 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.428+0000 7f2408e5c640 1 -- 172.21.15.90:0/662067276 wait complete. 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 Processor -- start 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 -- start start 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f240406deb0 0x7f24041ea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24040c3d40 0x7f24040c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2404150550 0x7f2404142690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2404153af0 con 0x7f2404150550 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f24040c4880 con 0x7f240406deb0 2024-04-20T10:59:46.432 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.429+0000 7f2408e5c640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f240406e290 con 0x7f24040c3d40 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2404150550 0x7f2404142690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2404150550 0x7f2404142690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51948/0 (socket says 172.21.15.90:51948) 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 -- 172.21.15.90:0/3379921948 learned_addr learned my addr 172.21.15.90:0/3379921948 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f240259c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f240406deb0 0x7f24041ea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f23fbfff640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24040c3d40 0x7f24040c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 -- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24040c3d40 msgr2=0x7f24040c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24040c3d40 0x7f24040c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 -- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f240406deb0 msgr2=0x7f24041ea820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f240406deb0 0x7f24041ea820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 -- 172.21.15.90:0/3379921948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24041e0680 con 0x7f2404150550 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f23fbfff640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24040c3d40 0x7f24040c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2402d9d640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2404150550 0x7f2404142690 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00cb30 tx=0x7f23fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f23faffd640 1 -- 172.21.15.90:0/3379921948 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00aca0 con 0x7f2404150550 2024-04-20T10:59:46.433 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f23faffd640 1 -- 172.21.15.90:0/3379921948 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23fc012400 con 0x7f2404150550 2024-04-20T10:59:46.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24041e0960 con 0x7f2404150550 2024-04-20T10:59:46.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f23faffd640 1 -- 172.21.15.90:0/3379921948 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00ae60 con 0x7f2404150550 2024-04-20T10:59:46.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.430+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24041e0f20 con 0x7f2404150550 2024-04-20T10:59:46.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.431+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2404076150 con 0x7f2404150550 2024-04-20T10:59:46.434 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.432+0000 7f23faffd640 1 -- 172.21.15.90:0/3379921948 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f23fc0127f0 con 0x7f2404150550 2024-04-20T10:59:46.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.432+0000 7f23faffd640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f23e406c8f0 0x7f23e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.432+0000 7f23faffd640 1 -- 172.21.15.90:0/3379921948 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f23fc08c940 con 0x7f2404150550 2024-04-20T10:59:46.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.432+0000 7f240259c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f23e406c8f0 0x7f23e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.435 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.433+0000 7f240259c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f23e406c8f0 0x7f23e406edb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23f4036000 tx=0x7f23f403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:46.436 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.436+0000 7f23faffd640 1 -- 172.21.15.90:0/3379921948 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f23fc05a620 con 0x7f2404150550 2024-04-20T10:59:46.607 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.606+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24041e12a0 con 0x7f23e406c8f0 2024-04-20T10:59:46.618 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.618+0000 7f23faffd640 1 -- 172.21.15.90:0/3379921948 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494337 (secure 0 0 0) 0x7f23f40c1b20 con 0x7f23e406c8f0 2024-04-20T10:59:46.624 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:46.628 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.621+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f23e406c8f0 msgr2=0x7f23e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.621+0000 7f2408e5c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f23e406c8f0 0x7f23e406edb0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f23f4036000 tx=0x7f23f403c040 comp rx=0 tx=0).stop 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.621+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2404150550 msgr2=0x7f2404142690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.621+0000 7f2408e5c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2404150550 0x7f2404142690 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00cb30 tx=0x7f23fc00a060 comp rx=0 tx=0).stop 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 shutdown_connections 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f23e406c8f0 0x7f23e406edb0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2404150550 0x7f2404142690 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.630 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f24040c3d40 0x7f24040c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 --2- 172.21.15.90:0/3379921948 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f240406deb0 0x7f24041ea820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 >> 172.21.15.90:0/3379921948 conn(0x7f24040c8080 msgr2=0x7f2404072ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:46.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 shutdown_connections 2024-04-20T10:59:46.631 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.622+0000 7f2408e5c640 1 -- 172.21.15.90:0/3379921948 wait complete. 2024-04-20T10:59:46.633 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-04-20T10:59:45.805828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":301439747,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":12158,"num_read_kb":7850279,"num_write":64813,"num_write_kb":8966793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71615,"ondisk_log_size":71615,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1099600,"kb_used_data":592208,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":753875120,"statfs":{"total":773094113280,"available":771968122880,"internally_reserved":0,"allocated":606420992,"data_stored":604476094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":519491120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55310,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":12,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003210"},"pg_stats":[{"pgid":"5.18","version":"38'433","reported_seq":545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.647268+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:59:28.647268+0000","last_peered":"2024-04-20T10:59:28.647268+0000","last_clean":"2024-04-20T10:59:28.647268+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:59:28.647268+0000","last_undegraded":"2024-04-20T10:59:28.647268+0000","last_fullsized":"2024-04-20T10:59:28.647268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":22795,"num_write":399,"num_write_kb":54919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"38'85","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387326+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:59:20.387326+0000","last_peered":"2024-04-20T10:59:20.387326+0000","last_clean":"2024-04-20T10:59:20.387326+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:59:20.387326+0000","last_undegraded":"2024-04-20T10:59:20.387326+0000","last_fullsized":"2024-04-20T10:59:20.387326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":13987,"num_write":27,"num_write_kb":4118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"38'408","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403809+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:59:23.403809+0000","last_peered":"2024-04-20T10:59:23.403809+0000","last_clean":"2024-04-20T10:59:23.403809+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:59:23.403809+0000","last_undegraded":"2024-04-20T10:59:23.403809+0000","last_fullsized":"2024-04-20T10:59:23.403809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":85574,"num_write":384,"num_write_kb":89655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"38'168","reported_seq":213,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.596572+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:59:22.596572+0000","last_peered":"2024-04-20T10:59:22.596572+0000","last_clean":"2024-04-20T10:59:22.596572+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:59:22.596572+0000","last_undegraded":"2024-04-20T10:59:22.596572+0000","last_fullsized":"2024-04-20T10:59:22.596572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"38'459","reported_seq":574,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.407768+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:59:30.407768+0000","last_peered":"2024-04-20T10:59:30.407768+0000","last_clean":"2024-04-20T10:59:30.407768+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:59:30.407768+0000","last_undegraded":"2024-04-20T10:59:30.407768+0000","last_fullsized":"2024-04-20T10:59:30.407768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":79973,"num_write":429,"num_write_kb":121385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"36'193","reported_seq":248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.396105+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:59:20.396105+0000","last_peered":"2024-04-20T10:59:20.396105+0000","last_clean":"2024-04-20T10:59:20.396105+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:59:20.396105+0000","last_undegraded":"2024-04-20T10:59:20.396105+0000","last_fullsized":"2024-04-20T10:59:20.396105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":130,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"37'359","reported_seq":476,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386804+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:59:20.386804+0000","last_peered":"2024-04-20T10:59:20.386804+0000","last_clean":"2024-04-20T10:59:20.386804+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:59:20.386804+0000","last_undegraded":"2024-04-20T10:59:20.386804+0000","last_fullsized":"2024-04-20T10:59:20.386804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":24250,"num_write":339,"num_write_kb":58188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"38'922","reported_seq":973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.570742+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:59:21.570742+0000","last_peered":"2024-04-20T10:59:21.570742+0000","last_clean":"2024-04-20T10:59:21.570742+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:59:21.570742+0000","last_undegraded":"2024-04-20T10:59:21.570742+0000","last_fullsized":"2024-04-20T10:59:21.570742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":852,"num_write_kb":8691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"38'405","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.639984+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:59:28.639984+0000","last_peered":"2024-04-20T10:59:28.639984+0000","last_clean":"2024-04-20T10:59:28.639984+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:59:28.639984+0000","last_undegraded":"2024-04-20T10:59:28.639984+0000","last_fullsized":"2024-04-20T10:59:28.639984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":43507,"num_write":372,"num_write_kb":54374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"37'371","reported_seq":440,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392875+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:59:20.392875+0000","last_peered":"2024-04-20T10:59:20.392875+0000","last_clean":"2024-04-20T10:59:20.392875+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:59:20.392875+0000","last_undegraded":"2024-04-20T10:59:20.392875+0000","last_fullsized":"2024-04-20T10:59:20.392875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":45077,"num_write":302,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'401","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393379+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:59:20.393379+0000","last_peered":"2024-04-20T10:59:20.393379+0000","last_clean":"2024-04-20T10:59:20.393379+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:59:20.393379+0000","last_undegraded":"2024-04-20T10:59:20.393379+0000","last_fullsized":"2024-04-20T10:59:20.393379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":103995,"num_write":369,"num_write_kb":100717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'159","reported_seq":208,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386804+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:59:20.386804+0000","last_peered":"2024-04-20T10:59:20.386804+0000","last_clean":"2024-04-20T10:59:20.386804+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:59:20.386804+0000","last_undegraded":"2024-04-20T10:59:20.386804+0000","last_fullsized":"2024-04-20T10:59:20.386804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":20490,"num_write":105,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"38'368","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641669+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:59:28.641669+0000","last_peered":"2024-04-20T10:59:28.641669+0000","last_clean":"2024-04-20T10:59:28.641669+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:59:28.641669+0000","last_undegraded":"2024-04-20T10:59:28.641669+0000","last_fullsized":"2024-04-20T10:59:28.641669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":53969,"num_write":336,"num_write_kb":42442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"38'67","reported_seq":129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391409+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:59:20.391409+0000","last_peered":"2024-04-20T10:59:20.391409+0000","last_clean":"2024-04-20T10:59:20.391409+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:59:20.391409+0000","last_undegraded":"2024-04-20T10:59:20.391409+0000","last_fullsized":"2024-04-20T10:59:20.391409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":8317,"num_write":19,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'375","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395496+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:59:20.395496+0000","last_peered":"2024-04-20T10:59:20.395496+0000","last_clean":"2024-04-20T10:59:20.395496+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:59:20.395496+0000","last_undegraded":"2024-04-20T10:59:20.395496+0000","last_fullsized":"2024-04-20T10:59:20.395496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":27688,"num_write":341,"num_write_kb":72358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'659","reported_seq":712,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.264947+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:59:22.264947+0000","last_peered":"2024-04-20T10:59:22.264947+0000","last_clean":"2024-04-20T10:59:22.264947+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:59:22.264947+0000","last_undegraded":"2024-04-20T10:59:22.264947+0000","last_fullsized":"2024-04-20T10:59:22.264947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36433,"num_write":605,"num_write_kb":12615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"38'446","reported_seq":569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.406503+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:59:30.406503+0000","last_peered":"2024-04-20T10:59:30.406503+0000","last_clean":"2024-04-20T10:59:30.406503+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:59:30.406503+0000","last_undegraded":"2024-04-20T10:59:30.406503+0000","last_fullsized":"2024-04-20T10:59:30.406503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":68359,"num_write":412,"num_write_kb":83650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"38'451","reported_seq":601,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408229+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:59:23.408229+0000","last_peered":"2024-04-20T10:59:23.408229+0000","last_clean":"2024-04-20T10:59:23.408229+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:59:23.408229+0000","last_undegraded":"2024-04-20T10:59:23.408229+0000","last_fullsized":"2024-04-20T10:59:23.408229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":83011,"num_write":424,"num_write_kb":112568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"37'185","reported_seq":251,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391349+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:59:20.391349+0000","last_peered":"2024-04-20T10:59:20.391349+0000","last_clean":"2024-04-20T10:59:20.391349+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:59:20.391349+0000","last_undegraded":"2024-04-20T10:59:20.391349+0000","last_fullsized":"2024-04-20T10:59:20.391349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32778,"num_write":122,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'533","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387601+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:59:20.387601+0000","last_peered":"2024-04-20T10:59:20.387601+0000","last_clean":"2024-04-20T10:59:20.387601+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:59:20.387601+0000","last_undegraded":"2024-04-20T10:59:20.387601+0000","last_fullsized":"2024-04-20T10:59:20.387601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16463,"num_write":485,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'400","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380771+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:59:20.380771+0000","last_peered":"2024-04-20T10:59:20.380771+0000","last_clean":"2024-04-20T10:59:20.380771+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:59:20.380771+0000","last_undegraded":"2024-04-20T10:59:20.380771+0000","last_fullsized":"2024-04-20T10:59:20.380771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":15248,"num_write":372,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"36'439","reported_seq":580,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389917+0000","last_change":"2024-04-20T10:51:20.874303+0000","last_active":"2024-04-20T10:59:20.389917+0000","last_peered":"2024-04-20T10:59:20.389917+0000","last_clean":"2024-04-20T10:59:20.389917+0000","last_became_active":"2024-04-20T10:51:20.873593+0000","last_became_peered":"2024-04-20T10:51:20.873593+0000","last_unstale":"2024-04-20T10:59:20.389917+0000","last_undegraded":"2024-04-20T10:59:20.389917+0000","last_fullsized":"2024-04-20T10:59:20.389917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:03.363095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":68460,"num_write":408,"num_write_kb":88214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"36'471","reported_seq":525,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391983+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:59:20.391983+0000","last_peered":"2024-04-20T10:59:20.391983+0000","last_clean":"2024-04-20T10:59:20.391983+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:59:20.391983+0000","last_undegraded":"2024-04-20T10:59:20.391983+0000","last_fullsized":"2024-04-20T10:59:20.391983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":415,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'54","reported_seq":97,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612670+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:59:28.612670+0000","last_peered":"2024-04-20T10:59:28.612670+0000","last_clean":"2024-04-20T10:59:28.612670+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:59:28.612670+0000","last_undegraded":"2024-04-20T10:59:28.612670+0000","last_fullsized":"2024-04-20T10:59:28.612670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"38'386","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648828+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:59:28.648828+0000","last_peered":"2024-04-20T10:59:28.648828+0000","last_clean":"2024-04-20T10:59:28.648828+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:59:28.648828+0000","last_undegraded":"2024-04-20T10:59:28.648828+0000","last_fullsized":"2024-04-20T10:59:28.648828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":51447,"num_write":355,"num_write_kb":79846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'408","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391303+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:59:20.391303+0000","last_peered":"2024-04-20T10:59:20.391303+0000","last_clean":"2024-04-20T10:59:20.391303+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:59:20.391303+0000","last_undegraded":"2024-04-20T10:59:20.391303+0000","last_fullsized":"2024-04-20T10:59:20.391303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":28672,"num_write":368,"num_write_kb":66779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'260","reported_seq":313,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392032+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:59:20.392032+0000","last_peered":"2024-04-20T10:59:20.392032+0000","last_clean":"2024-04-20T10:59:20.392032+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:59:20.392032+0000","last_undegraded":"2024-04-20T10:59:20.392032+0000","last_fullsized":"2024-04-20T10:59:20.392032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":207,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"38'292","reported_seq":344,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644447+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:59:28.644447+0000","last_peered":"2024-04-20T10:59:28.644447+0000","last_clean":"2024-04-20T10:59:28.644447+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:59:28.644447+0000","last_undegraded":"2024-04-20T10:59:28.644447+0000","last_fullsized":"2024-04-20T10:59:28.644447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":243,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"38'417","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401200+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:59:30.401200+0000","last_peered":"2024-04-20T10:59:30.401200+0000","last_clean":"2024-04-20T10:59:30.401200+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:59:30.401200+0000","last_undegraded":"2024-04-20T10:59:30.401200+0000","last_fullsized":"2024-04-20T10:59:30.401200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":59672,"num_write":383,"num_write_kb":87983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"38'464","reported_seq":618,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399563+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:59:23.399563+0000","last_peered":"2024-04-20T10:59:23.399563+0000","last_clean":"2024-04-20T10:59:23.399563+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:59:23.399563+0000","last_undegraded":"2024-04-20T10:59:23.399563+0000","last_fullsized":"2024-04-20T10:59:23.399563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":46635,"num_write":434,"num_write_kb":47131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'429","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391034+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:59:20.391034+0000","last_peered":"2024-04-20T10:59:20.391034+0000","last_clean":"2024-04-20T10:59:20.391034+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:59:20.391034+0000","last_undegraded":"2024-04-20T10:59:20.391034+0000","last_fullsized":"2024-04-20T10:59:20.391034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":373,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'505","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.682919+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:59:21.682919+0000","last_peered":"2024-04-20T10:59:21.682919+0000","last_clean":"2024-04-20T10:59:21.682919+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:59:21.682919+0000","last_undegraded":"2024-04-20T10:59:21.682919+0000","last_fullsized":"2024-04-20T10:59:21.682919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":12324,"num_write":451,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"38'428","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389966+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:59:20.389966+0000","last_peered":"2024-04-20T10:59:20.389966+0000","last_clean":"2024-04-20T10:59:20.389966+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:59:20.389966+0000","last_undegraded":"2024-04-20T10:59:20.389966+0000","last_fullsized":"2024-04-20T10:59:20.389966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70222,"num_write":390,"num_write_kb":75460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"38'430","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408714+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:59:23.408714+0000","last_peered":"2024-04-20T10:59:23.408714+0000","last_clean":"2024-04-20T10:59:23.408714+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:59:23.408714+0000","last_undegraded":"2024-04-20T10:59:23.408714+0000","last_fullsized":"2024-04-20T10:59:23.408714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":26226,"num_write":396,"num_write_kb":42836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"38'177","reported_seq":238,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.142667+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:59:31.142667+0000","last_peered":"2024-04-20T10:59:31.142667+0000","last_clean":"2024-04-20T10:59:31.142667+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:59:31.142667+0000","last_undegraded":"2024-04-20T10:59:31.142667+0000","last_fullsized":"2024-04-20T10:59:31.142667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2765447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":2215,"num_write":121,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"38'354","reported_seq":681,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.399438+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:59:36.399438+0000","last_peered":"2024-04-20T10:59:36.399438+0000","last_clean":"2024-04-20T10:59:36.399438+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:59:36.399438+0000","last_undegraded":"2024-04-20T10:59:36.399438+0000","last_fullsized":"2024-04-20T10:59:36.399438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465101,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":1621,"num_write":296,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'403","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635967+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:59:28.635967+0000","last_peered":"2024-04-20T10:59:28.635967+0000","last_clean":"2024-04-20T10:59:28.635967+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:59:28.635967+0000","last_undegraded":"2024-04-20T10:59:28.635967+0000","last_fullsized":"2024-04-20T10:59:28.635967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":84919,"num_write":363,"num_write_kb":88226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"38'351","reported_seq":485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.747469+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:59:21.747469+0000","last_peered":"2024-04-20T10:59:21.747469+0000","last_clean":"2024-04-20T10:59:21.747469+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:59:21.747469+0000","last_undegraded":"2024-04-20T10:59:21.747469+0000","last_fullsized":"2024-04-20T10:59:21.747469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":41830,"num_write":332,"num_write_kb":50578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"38'367","reported_seq":429,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.382070+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:59:31.382070+0000","last_peered":"2024-04-20T10:59:31.382070+0000","last_clean":"2024-04-20T10:59:31.382070+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:59:31.382070+0000","last_undegraded":"2024-04-20T10:59:31.382070+0000","last_fullsized":"2024-04-20T10:59:31.382070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":432,"num_write":705,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"38'199","reported_seq":256,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:25.551371+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:59:25.551371+0000","last_peered":"2024-04-20T10:59:25.551371+0000","last_clean":"2024-04-20T10:59:25.551371+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:59:25.551371+0000","last_undegraded":"2024-04-20T10:59:25.551371+0000","last_fullsized":"2024-04-20T10:59:25.551371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":41717,"num_write":141,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"38'382","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.634547+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:59:28.634547+0000","last_peered":"2024-04-20T10:59:28.634547+0000","last_clean":"2024-04-20T10:59:28.634547+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:59:28.634547+0000","last_undegraded":"2024-04-20T10:59:28.634547+0000","last_fullsized":"2024-04-20T10:59:28.634547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36954,"num_write":352,"num_write_kb":63166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"38'440","reported_seq":587,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391402+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:59:20.391402+0000","last_peered":"2024-04-20T10:59:20.391402+0000","last_clean":"2024-04-20T10:59:20.391402+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:59:20.391402+0000","last_undegraded":"2024-04-20T10:59:20.391402+0000","last_fullsized":"2024-04-20T10:59:20.391402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":92391,"num_write":411,"num_write_kb":121276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'116","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393763+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:59:20.393763+0000","last_peered":"2024-04-20T10:59:20.393763+0000","last_clean":"2024-04-20T10:59:20.393763+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:59:20.393763+0000","last_undegraded":"2024-04-20T10:59:20.393763+0000","last_fullsized":"2024-04-20T10:59:20.393763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":47,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"38'72","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621376+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:59:28.621376+0000","last_peered":"2024-04-20T10:59:28.621376+0000","last_clean":"2024-04-20T10:59:28.621376+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:59:28.621376+0000","last_undegraded":"2024-04-20T10:59:28.621376+0000","last_fullsized":"2024-04-20T10:59:28.621376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"38'388","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.638445+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:59:28.638445+0000","last_peered":"2024-04-20T10:59:28.638445+0000","last_clean":"2024-04-20T10:59:28.638445+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:59:28.638445+0000","last_undegraded":"2024-04-20T10:59:28.638445+0000","last_fullsized":"2024-04-20T10:59:28.638445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":31459,"num_write":347,"num_write_kb":38414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"38'421","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406112+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:59:23.406112+0000","last_peered":"2024-04-20T10:59:23.406112+0000","last_clean":"2024-04-20T10:59:23.406112+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:59:23.406112+0000","last_undegraded":"2024-04-20T10:59:23.406112+0000","last_fullsized":"2024-04-20T10:59:23.406112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":53960,"num_write":380,"num_write_kb":46448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"37'59","reported_seq":111,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391821+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:59:20.391821+0000","last_peered":"2024-04-20T10:59:20.391821+0000","last_clean":"2024-04-20T10:59:20.391821+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:59:20.391821+0000","last_undegraded":"2024-04-20T10:59:20.391821+0000","last_fullsized":"2024-04-20T10:59:20.391821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'621","reported_seq":677,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.626958+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:59:20.626958+0000","last_peered":"2024-04-20T10:59:20.626958+0000","last_clean":"2024-04-20T10:59:20.626958+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:59:20.626958+0000","last_undegraded":"2024-04-20T10:59:20.626958+0000","last_fullsized":"2024-04-20T10:59:20.626958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":37014,"num_write":557,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"38'440","reported_seq":575,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405359+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:59:30.405359+0000","last_peered":"2024-04-20T10:59:30.405359+0000","last_clean":"2024-04-20T10:59:30.405359+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:59:30.405359+0000","last_undegraded":"2024-04-20T10:59:30.405359+0000","last_fullsized":"2024-04-20T10:59:30.405359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":72557,"num_write":399,"num_write_kb":79896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"37'409","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388343+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:59:20.388343+0000","last_peered":"2024-04-20T10:59:20.388343+0000","last_clean":"2024-04-20T10:59:20.388343+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:59:20.388343+0000","last_undegraded":"2024-04-20T10:59:20.388343+0000","last_fullsized":"2024-04-20T10:59:20.388343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69573,"num_write":375,"num_write_kb":88218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'601","reported_seq":659,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394008+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:59:20.394008+0000","last_peered":"2024-04-20T10:59:20.394008+0000","last_clean":"2024-04-20T10:59:20.394008+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:59:20.394008+0000","last_undegraded":"2024-04-20T10:59:20.394008+0000","last_fullsized":"2024-04-20T10:59:20.394008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":551,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"38'74","reported_seq":119,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390879+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:59:20.390879+0000","last_peered":"2024-04-20T10:59:20.390879+0000","last_clean":"2024-04-20T10:59:20.390879+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:59:20.390879+0000","last_undegraded":"2024-04-20T10:59:20.390879+0000","last_fullsized":"2024-04-20T10:59:20.390879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"38'423","reported_seq":553,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410970+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:59:30.410970+0000","last_peered":"2024-04-20T10:59:30.410970+0000","last_clean":"2024-04-20T10:59:30.410970+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:59:30.410970+0000","last_undegraded":"2024-04-20T10:59:30.410970+0000","last_fullsized":"2024-04-20T10:59:30.410970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56610,"num_write":400,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'384","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389823+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:59:20.389823+0000","last_peered":"2024-04-20T10:59:20.389823+0000","last_clean":"2024-04-20T10:59:20.389823+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:59:20.389823+0000","last_undegraded":"2024-04-20T10:59:20.389823+0000","last_fullsized":"2024-04-20T10:59:20.389823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":325,"num_write":350,"num_write_kb":17356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"38'354","reported_seq":699,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:34.398923+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:59:34.398923+0000","last_peered":"2024-04-20T10:59:34.398923+0000","last_clean":"2024-04-20T10:59:34.398923+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:59:34.398923+0000","last_undegraded":"2024-04-20T10:59:34.398923+0000","last_fullsized":"2024-04-20T10:59:34.398923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":293,"num_read_kb":1639,"num_write":299,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"38'135","reported_seq":190,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.401719+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:59:36.401719+0000","last_peered":"2024-04-20T10:59:36.401719+0000","last_clean":"2024-04-20T10:59:36.401719+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:59:36.401719+0000","last_undegraded":"2024-04-20T10:59:36.401719+0000","last_fullsized":"2024-04-20T10:59:36.401719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":994,"num_write":82,"num_write_kb":1558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'363","reported_seq":473,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405073+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:59:30.405073+0000","last_peered":"2024-04-20T10:59:30.405073+0000","last_clean":"2024-04-20T10:59:30.405073+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:59:30.405073+0000","last_undegraded":"2024-04-20T10:59:30.405073+0000","last_fullsized":"2024-04-20T10:59:30.405073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56669,"num_write":337,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"38'414","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386329+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:59:20.386329+0000","last_peered":"2024-04-20T10:59:20.386329+0000","last_clean":"2024-04-20T10:59:20.386329+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:59:20.386329+0000","last_undegraded":"2024-04-20T10:59:20.386329+0000","last_fullsized":"2024-04-20T10:59:20.386329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":100333,"num_write":376,"num_write_kb":104385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"37'123","reported_seq":184,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390747+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:59:20.390747+0000","last_peered":"2024-04-20T10:59:20.390747+0000","last_clean":"2024-04-20T10:59:20.390747+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:59:20.390747+0000","last_undegraded":"2024-04-20T10:59:20.390747+0000","last_fullsized":"2024-04-20T10:59:20.390747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":57,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"38'366","reported_seq":421,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.838351+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:59:31.838351+0000","last_peered":"2024-04-20T10:59:31.838351+0000","last_clean":"2024-04-20T10:59:31.838351+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:59:31.838351+0000","last_undegraded":"2024-04-20T10:59:31.838351+0000","last_fullsized":"2024-04-20T10:59:31.838351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":373,"num_write":704,"num_write_kb":1825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"38'374","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645982+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:59:28.645982+0000","last_peered":"2024-04-20T10:59:28.645982+0000","last_clean":"2024-04-20T10:59:28.645982+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:59:28.645982+0000","last_undegraded":"2024-04-20T10:59:28.645982+0000","last_fullsized":"2024-04-20T10:59:28.645982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23979,"num_write":342,"num_write_kb":50629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"38'375","reported_seq":496,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394982+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:59:20.394982+0000","last_peered":"2024-04-20T10:59:20.394982+0000","last_clean":"2024-04-20T10:59:20.394982+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:59:20.394982+0000","last_undegraded":"2024-04-20T10:59:20.394982+0000","last_fullsized":"2024-04-20T10:59:20.394982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32768,"num_write":345,"num_write_kb":58807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"38'72","reported_seq":124,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392162+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:59:20.392162+0000","last_peered":"2024-04-20T10:59:20.392162+0000","last_clean":"2024-04-20T10:59:20.392162+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:59:20.392162+0000","last_undegraded":"2024-04-20T10:59:20.392162+0000","last_fullsized":"2024-04-20T10:59:20.392162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391430+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:59:20.391430+0000","last_peered":"2024-04-20T10:59:20.391430+0000","last_clean":"2024-04-20T10:59:20.391430+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:59:20.391430+0000","last_undegraded":"2024-04-20T10:59:20.391430+0000","last_fullsized":"2024-04-20T10:59:20.391430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"38'102","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:25.550993+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:59:25.550993+0000","last_peered":"2024-04-20T10:59:25.550993+0000","last_clean":"2024-04-20T10:59:25.550993+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:59:25.550993+0000","last_undegraded":"2024-04-20T10:59:25.550993+0000","last_fullsized":"2024-04-20T10:59:25.550993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"38'445","reported_seq":578,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380835+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:59:20.380835+0000","last_peered":"2024-04-20T10:59:20.380835+0000","last_clean":"2024-04-20T10:59:20.380835+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:59:20.380835+0000","last_undegraded":"2024-04-20T10:59:20.380835+0000","last_fullsized":"2024-04-20T10:59:20.380835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":88903,"num_write":409,"num_write_kb":92640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'412","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392902+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:59:20.392902+0000","last_peered":"2024-04-20T10:59:20.392902+0000","last_clean":"2024-04-20T10:59:20.392902+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:59:20.392902+0000","last_undegraded":"2024-04-20T10:59:20.392902+0000","last_fullsized":"2024-04-20T10:59:20.392902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53899,"num_write":383,"num_write_kb":39701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"37'57","reported_seq":109,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381980+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:59:20.381980+0000","last_peered":"2024-04-20T10:59:20.381980+0000","last_clean":"2024-04-20T10:59:20.381980+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:59:20.381980+0000","last_undegraded":"2024-04-20T10:59:20.381980+0000","last_fullsized":"2024-04-20T10:59:20.381980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'249","reported_seq":297,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.168615+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:59:22.168615+0000","last_peered":"2024-04-20T10:59:22.168615+0000","last_clean":"2024-04-20T10:59:22.168615+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:59:22.168615+0000","last_undegraded":"2024-04-20T10:59:22.168615+0000","last_fullsized":"2024-04-20T10:59:22.168615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":11663,"num_write":185,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"38'444","reported_seq":573,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.409848+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:59:30.409848+0000","last_peered":"2024-04-20T10:59:30.409848+0000","last_clean":"2024-04-20T10:59:30.409848+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:59:30.409848+0000","last_undegraded":"2024-04-20T10:59:30.409848+0000","last_fullsized":"2024-04-20T10:59:30.409848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":74093,"num_write":415,"num_write_kb":112646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"38'451","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409601+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:59:23.409601+0000","last_peered":"2024-04-20T10:59:23.409601+0000","last_clean":"2024-04-20T10:59:23.409601+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:59:23.409601+0000","last_undegraded":"2024-04-20T10:59:23.409601+0000","last_fullsized":"2024-04-20T10:59:23.409601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":13128,"num_write":408,"num_write_kb":42612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'466","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395060+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:59:20.395060+0000","last_peered":"2024-04-20T10:59:20.395060+0000","last_clean":"2024-04-20T10:59:20.395060+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:59:20.395060+0000","last_undegraded":"2024-04-20T10:59:20.395060+0000","last_fullsized":"2024-04-20T10:59:20.395060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12293,"num_write":417,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"38'254","reported_seq":311,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.379543+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:59:22.379543+0000","last_peered":"2024-04-20T10:59:22.379543+0000","last_clean":"2024-04-20T10:59:22.379543+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:59:22.379543+0000","last_undegraded":"2024-04-20T10:59:22.379543+0000","last_fullsized":"2024-04-20T10:59:22.379543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":192,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"38'448","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405455+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:59:30.405455+0000","last_peered":"2024-04-20T10:59:30.405455+0000","last_clean":"2024-04-20T10:59:30.405455+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:59:30.405455+0000","last_undegraded":"2024-04-20T10:59:30.405455+0000","last_fullsized":"2024-04-20T10:59:30.405455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28672,"num_write":415,"num_write_kb":38311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"38'377","reported_seq":509,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403988+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:59:23.403988+0000","last_peered":"2024-04-20T10:59:23.403988+0000","last_clean":"2024-04-20T10:59:23.403988+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:59:23.403988+0000","last_undegraded":"2024-04-20T10:59:23.403988+0000","last_fullsized":"2024-04-20T10:59:23.403988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":24736,"num_write":347,"num_write_kb":38102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'415","reported_seq":477,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382204+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:59:20.382204+0000","last_peered":"2024-04-20T10:59:20.382204+0000","last_clean":"2024-04-20T10:59:20.382204+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:59:20.382204+0000","last_undegraded":"2024-04-20T10:59:20.382204+0000","last_fullsized":"2024-04-20T10:59:20.382204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":12309,"num_write":370,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"38'499","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645869+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:59:28.645869+0000","last_peered":"2024-04-20T10:59:28.645869+0000","last_clean":"2024-04-20T10:59:28.645869+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:59:28.645869+0000","last_undegraded":"2024-04-20T10:59:28.645869+0000","last_fullsized":"2024-04-20T10:59:28.645869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":443,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"38'402","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.638499+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:59:28.638499+0000","last_peered":"2024-04-20T10:59:28.638499+0000","last_clean":"2024-04-20T10:59:28.638499+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:59:28.638499+0000","last_undegraded":"2024-04-20T10:59:28.638499+0000","last_fullsized":"2024-04-20T10:59:28.638499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56962,"num_write":365,"num_write_kb":46837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"38'375","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410908+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:59:23.410908+0000","last_peered":"2024-04-20T10:59:23.410908+0000","last_clean":"2024-04-20T10:59:23.410908+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:59:23.410908+0000","last_undegraded":"2024-04-20T10:59:23.410908+0000","last_fullsized":"2024-04-20T10:59:23.410908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":12893,"num_write":338,"num_write_kb":54469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"38'678","reported_seq":737,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404745+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:59:23.404745+0000","last_peered":"2024-04-20T10:59:23.404745+0000","last_clean":"2024-04-20T10:59:23.404745+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:59:23.404745+0000","last_undegraded":"2024-04-20T10:59:23.404745+0000","last_fullsized":"2024-04-20T10:59:23.404745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":626,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'248","reported_seq":294,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.699927+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:59:23.699927+0000","last_peered":"2024-04-20T10:59:23.699927+0000","last_clean":"2024-04-20T10:59:23.699927+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:59:23.699927+0000","last_undegraded":"2024-04-20T10:59:23.699927+0000","last_fullsized":"2024-04-20T10:59:23.699927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":197,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"38'396","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.614014+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:59:28.614014+0000","last_peered":"2024-04-20T10:59:28.614014+0000","last_clean":"2024-04-20T10:59:28.614014+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:59:28.614014+0000","last_undegraded":"2024-04-20T10:59:28.614014+0000","last_fullsized":"2024-04-20T10:59:28.614014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27222,"num_write":365,"num_write_kb":63558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"38'485","reported_seq":639,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404048+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:59:23.404048+0000","last_peered":"2024-04-20T10:59:23.404048+0000","last_clean":"2024-04-20T10:59:23.404048+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:59:23.404048+0000","last_undegraded":"2024-04-20T10:59:23.404048+0000","last_fullsized":"2024-04-20T10:59:23.404048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":79269,"num_write":451,"num_write_kb":100665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"38'417","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409150+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:59:23.409150+0000","last_peered":"2024-04-20T10:59:23.409150+0000","last_clean":"2024-04-20T10:59:23.409150+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:59:23.409150+0000","last_undegraded":"2024-04-20T10:59:23.409150+0000","last_fullsized":"2024-04-20T10:59:23.409150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":8276,"num_write":372,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"38'124","reported_seq":172,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.613412+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:59:28.613412+0000","last_peered":"2024-04-20T10:59:28.613412+0000","last_clean":"2024-04-20T10:59:28.613412+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:59:28.613412+0000","last_undegraded":"2024-04-20T10:59:28.613412+0000","last_fullsized":"2024-04-20T10:59:28.613412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12306,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"38'439","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621872+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:59:28.621872+0000","last_peered":"2024-04-20T10:59:28.621872+0000","last_clean":"2024-04-20T10:59:28.621872+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:59:28.621872+0000","last_undegraded":"2024-04-20T10:59:28.621872+0000","last_fullsized":"2024-04-20T10:59:28.621872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":73928,"num_write":402,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"38'444","reported_seq":609,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381611+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:59:20.381611+0000","last_peered":"2024-04-20T10:59:20.381611+0000","last_clean":"2024-04-20T10:59:20.381611+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:59:20.381611+0000","last_undegraded":"2024-04-20T10:59:20.381611+0000","last_fullsized":"2024-04-20T10:59:20.381611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":47645,"num_write":412,"num_write_kb":63928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'71","reported_seq":122,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382049+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:59:20.382049+0000","last_peered":"2024-04-20T10:59:20.382049+0000","last_clean":"2024-04-20T10:59:20.382049+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:59:20.382049+0000","last_undegraded":"2024-04-20T10:59:20.382049+0000","last_fullsized":"2024-04-20T10:59:20.382049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"38'64","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.599721+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:59:28.599721+0000","last_peered":"2024-04-20T10:59:28.599721+0000","last_clean":"2024-04-20T10:59:28.599721+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:59:28.599721+0000","last_undegraded":"2024-04-20T10:59:28.599721+0000","last_fullsized":"2024-04-20T10:59:28.599721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"38'417","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405132+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:59:30.405132+0000","last_peered":"2024-04-20T10:59:30.405132+0000","last_clean":"2024-04-20T10:59:30.405132+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:59:30.405132+0000","last_undegraded":"2024-04-20T10:59:30.405132+0000","last_fullsized":"2024-04-20T10:59:30.405132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":100636,"num_write":369,"num_write_kb":112428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"38'400","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391000+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:59:20.391000+0000","last_peered":"2024-04-20T10:59:20.391000+0000","last_clean":"2024-04-20T10:59:20.391000+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:59:20.391000+0000","last_undegraded":"2024-04-20T10:59:20.391000+0000","last_fullsized":"2024-04-20T10:59:20.391000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":45758,"num_write":374,"num_write_kb":77972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"38'70","reported_seq":121,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410476+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:59:23.410476+0000","last_peered":"2024-04-20T10:59:23.410476+0000","last_clean":"2024-04-20T10:59:23.410476+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:59:23.410476+0000","last_undegraded":"2024-04-20T10:59:23.410476+0000","last_fullsized":"2024-04-20T10:59:23.410476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"38'515","reported_seq":589,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.607025+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:59:28.607025+0000","last_peered":"2024-04-20T10:59:28.607025+0000","last_clean":"2024-04-20T10:59:28.607025+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:59:28.607025+0000","last_undegraded":"2024-04-20T10:59:28.607025+0000","last_fullsized":"2024-04-20T10:59:28.607025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":32813,"num_write":465,"num_write_kb":12552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"38'400","reported_seq":517,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641744+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:59:28.641744+0000","last_peered":"2024-04-20T10:59:28.641744+0000","last_clean":"2024-04-20T10:59:28.641744+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:59:28.641744+0000","last_undegraded":"2024-04-20T10:59:28.641744+0000","last_fullsized":"2024-04-20T10:59:28.641744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":57869,"num_write":367,"num_write_kb":80191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"38'424","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407502+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:59:23.407502+0000","last_peered":"2024-04-20T10:59:23.407502+0000","last_clean":"2024-04-20T10:59:23.407502+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:59:23.407502+0000","last_undegraded":"2024-04-20T10:59:23.407502+0000","last_fullsized":"2024-04-20T10:59:23.407502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62334,"num_write":402,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'166","reported_seq":233,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388592+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:59:20.388592+0000","last_peered":"2024-04-20T10:59:20.388592+0000","last_clean":"2024-04-20T10:59:20.388592+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:59:20.388592+0000","last_undegraded":"2024-04-20T10:59:20.388592+0000","last_fullsized":"2024-04-20T10:59:20.388592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":24616,"num_write":112,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"38'322","reported_seq":381,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.414032+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:59:30.414032+0000","last_peered":"2024-04-20T10:59:30.414032+0000","last_clean":"2024-04-20T10:59:30.414032+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:59:30.414032+0000","last_undegraded":"2024-04-20T10:59:30.414032+0000","last_fullsized":"2024-04-20T10:59:30.414032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":278,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"38'376","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633687+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:59:28.633687+0000","last_peered":"2024-04-20T10:59:28.633687+0000","last_clean":"2024-04-20T10:59:28.633687+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:59:28.633687+0000","last_undegraded":"2024-04-20T10:59:28.633687+0000","last_fullsized":"2024-04-20T10:59:28.633687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":25860,"num_write":345,"num_write_kb":47542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"38'388","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402878+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:59:23.402878+0000","last_peered":"2024-04-20T10:59:23.402878+0000","last_clean":"2024-04-20T10:59:23.402878+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:59:23.402878+0000","last_undegraded":"2024-04-20T10:59:23.402878+0000","last_fullsized":"2024-04-20T10:59:23.402878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":29836,"num_write":343,"num_write_kb":67451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"38'576","reported_seq":656,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383078+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:59:20.383078+0000","last_peered":"2024-04-20T10:59:20.383078+0000","last_clean":"2024-04-20T10:59:20.383078+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:59:20.383078+0000","last_undegraded":"2024-04-20T10:59:20.383078+0000","last_fullsized":"2024-04-20T10:59:20.383078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35988,"num_write":517,"num_write_kb":12589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"38'65","reported_seq":108,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412464+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:59:30.412464+0000","last_peered":"2024-04-20T10:59:30.412464+0000","last_clean":"2024-04-20T10:59:30.412464+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:59:30.412464+0000","last_undegraded":"2024-04-20T10:59:30.412464+0000","last_fullsized":"2024-04-20T10:59:30.412464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"38'406","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410400+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:59:30.410400+0000","last_peered":"2024-04-20T10:59:30.410400+0000","last_clean":"2024-04-20T10:59:30.410400+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:59:30.410400+0000","last_undegraded":"2024-04-20T10:59:30.410400+0000","last_fullsized":"2024-04-20T10:59:30.410400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":74646,"num_write":381,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'380","reported_seq":517,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387972+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:59:20.387972+0000","last_peered":"2024-04-20T10:59:20.387972+0000","last_clean":"2024-04-20T10:59:20.387972+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:59:20.387972+0000","last_undegraded":"2024-04-20T10:59:20.387972+0000","last_fullsized":"2024-04-20T10:59:20.387972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61041,"num_write":349,"num_write_kb":58639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"38'332","reported_seq":396,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:24.130660+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:59:24.130660+0000","last_peered":"2024-04-20T10:59:24.130660+0000","last_clean":"2024-04-20T10:59:24.130660+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:59:24.130660+0000","last_undegraded":"2024-04-20T10:59:24.130660+0000","last_fullsized":"2024-04-20T10:59:24.130660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":4122,"num_write":282,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'149","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.899565+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:59:20.899565+0000","last_peered":"2024-04-20T10:59:20.899565+0000","last_clean":"2024-04-20T10:59:20.899565+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:59:20.899565+0000","last_undegraded":"2024-04-20T10:59:20.899565+0000","last_fullsized":"2024-04-20T10:59:20.899565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":45111,"num_write":81,"num_write_kb":8263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"38'468","reported_seq":597,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405389+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:59:30.405389+0000","last_peered":"2024-04-20T10:59:30.405389+0000","last_clean":"2024-04-20T10:59:30.405389+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:59:30.405389+0000","last_undegraded":"2024-04-20T10:59:30.405389+0000","last_fullsized":"2024-04-20T10:59:30.405389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":50494,"num_write":431,"num_write_kb":38868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"37'379","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386809+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:59:20.386809+0000","last_peered":"2024-04-20T10:59:20.386809+0000","last_clean":"2024-04-20T10:59:20.386809+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:59:20.386809+0000","last_undegraded":"2024-04-20T10:59:20.386809+0000","last_fullsized":"2024-04-20T10:59:20.386809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":58132,"num_write":347,"num_write_kb":59251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"37'174","reported_seq":226,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393492+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:59:20.393492+0000","last_peered":"2024-04-20T10:59:20.393492+0000","last_clean":"2024-04-20T10:59:20.393492+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:59:20.393492+0000","last_undegraded":"2024-04-20T10:59:20.393492+0000","last_fullsized":"2024-04-20T10:59:20.393492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":116,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"38'452","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.584992+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:59:28.584992+0000","last_peered":"2024-04-20T10:59:28.584992+0000","last_clean":"2024-04-20T10:59:28.584992+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:59:28.584992+0000","last_undegraded":"2024-04-20T10:59:28.584992+0000","last_fullsized":"2024-04-20T10:59:28.584992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":8291,"num_write":401,"num_write_kb":8399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'436","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641887+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:59:28.641887+0000","last_peered":"2024-04-20T10:59:28.641887+0000","last_clean":"2024-04-20T10:59:28.641887+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:59:28.641887+0000","last_undegraded":"2024-04-20T10:59:28.641887+0000","last_fullsized":"2024-04-20T10:59:28.641887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":65641,"num_write":399,"num_write_kb":55375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"38'413","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392717+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:59:20.392717+0000","last_peered":"2024-04-20T10:59:20.392717+0000","last_clean":"2024-04-20T10:59:20.392717+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:59:20.392717+0000","last_undegraded":"2024-04-20T10:59:20.392717+0000","last_fullsized":"2024-04-20T10:59:20.392717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":35937,"num_write":378,"num_write_kb":46521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"37'65","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383939+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:59:20.383939+0000","last_peered":"2024-04-20T10:59:20.383939+0000","last_clean":"2024-04-20T10:59:20.383939+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:59:20.383939+0000","last_undegraded":"2024-04-20T10:59:20.383939+0000","last_fullsized":"2024-04-20T10:59:20.383939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'63","reported_seq":106,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392568+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:59:20.392568+0000","last_peered":"2024-04-20T10:59:20.392568+0000","last_clean":"2024-04-20T10:59:20.392568+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:59:20.392568+0000","last_undegraded":"2024-04-20T10:59:20.392568+0000","last_fullsized":"2024-04-20T10:59:20.392568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"38'364","reported_seq":462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636298+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:59:28.636298+0000","last_peered":"2024-04-20T10:59:28.636298+0000","last_clean":"2024-04-20T10:59:28.636298+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:59:28.636298+0000","last_undegraded":"2024-04-20T10:59:28.636298+0000","last_fullsized":"2024-04-20T10:59:28.636298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25276,"num_write":334,"num_write_kb":46079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'73","reported_seq":123,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387292+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:59:20.387292+0000","last_peered":"2024-04-20T10:59:20.387292+0000","last_clean":"2024-04-20T10:59:20.387292+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:59:20.387292+0000","last_undegraded":"2024-04-20T10:59:20.387292+0000","last_fullsized":"2024-04-20T10:59:20.387292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":32,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"38'418","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402123+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:59:23.402123+0000","last_peered":"2024-04-20T10:59:23.402123+0000","last_clean":"2024-04-20T10:59:23.402123+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:59:23.402123+0000","last_undegraded":"2024-04-20T10:59:23.402123+0000","last_fullsized":"2024-04-20T10:59:23.402123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":61851,"num_write":392,"num_write_kb":55373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"38'892","reported_seq":950,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392749+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:59:20.392749+0000","last_peered":"2024-04-20T10:59:20.392749+0000","last_clean":"2024-04-20T10:59:20.392749+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:59:20.392749+0000","last_undegraded":"2024-04-20T10:59:20.392749+0000","last_fullsized":"2024-04-20T10:59:20.392749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":834,"num_write_kb":8709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'413","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405817+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:59:30.405817+0000","last_peered":"2024-04-20T10:59:30.405817+0000","last_clean":"2024-04-20T10:59:30.405817+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:59:30.405817+0000","last_undegraded":"2024-04-20T10:59:30.405817+0000","last_fullsized":"2024-04-20T10:59:30.405817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49569,"num_write":377,"num_write_kb":64815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"38'54","reported_seq":115,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.556737+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:59:28.556737+0000","last_peered":"2024-04-20T10:59:28.556737+0000","last_clean":"2024-04-20T10:59:28.556737+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:59:28.556737+0000","last_undegraded":"2024-04-20T10:59:28.556737+0000","last_fullsized":"2024-04-20T10:59:28.556737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":8,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"38'435","reported_seq":554,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391278+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:59:20.391278+0000","last_peered":"2024-04-20T10:59:20.391278+0000","last_clean":"2024-04-20T10:59:20.391278+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:59:20.391278+0000","last_undegraded":"2024-04-20T10:59:20.391278+0000","last_fullsized":"2024-04-20T10:59:20.391278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26261,"num_write":400,"num_write_kb":42830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"38'220","reported_seq":272,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393663+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:59:20.393663+0000","last_peered":"2024-04-20T10:59:20.393663+0000","last_clean":"2024-04-20T10:59:20.393663+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:59:20.393663+0000","last_undegraded":"2024-04-20T10:59:20.393663+0000","last_fullsized":"2024-04-20T10:59:20.393663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":166,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"38'369","reported_seq":465,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.643876+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:59:28.643876+0000","last_peered":"2024-04-20T10:59:28.643876+0000","last_clean":"2024-04-20T10:59:28.643876+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:59:28.643876+0000","last_undegraded":"2024-04-20T10:59:28.643876+0000","last_fullsized":"2024-04-20T10:59:28.643876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31197,"num_write":338,"num_write_kb":64191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"36'448","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382658+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:59:20.382658+0000","last_peered":"2024-04-20T10:59:20.382658+0000","last_clean":"2024-04-20T10:59:20.382658+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:59:20.382658+0000","last_undegraded":"2024-04-20T10:59:20.382658+0000","last_fullsized":"2024-04-20T10:59:20.382658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":384,"num_write_kb":12501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'379","reported_seq":515,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388144+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:59:20.388144+0000","last_peered":"2024-04-20T10:59:20.388144+0000","last_clean":"2024-04-20T10:59:20.388144+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:59:20.388144+0000","last_undegraded":"2024-04-20T10:59:20.388144+0000","last_fullsized":"2024-04-20T10:59:20.388144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52177,"num_write":354,"num_write_kb":79739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"38'581","reported_seq":637,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.623970+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:59:28.623970+0000","last_peered":"2024-04-20T10:59:28.623970+0000","last_clean":"2024-04-20T10:59:28.623970+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:59:28.623970+0000","last_undegraded":"2024-04-20T10:59:28.623970+0000","last_fullsized":"2024-04-20T10:59:28.623970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":12318,"num_write":526,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"38'403","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636902+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:59:28.636902+0000","last_peered":"2024-04-20T10:59:28.636902+0000","last_clean":"2024-04-20T10:59:28.636902+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:59:28.636902+0000","last_undegraded":"2024-04-20T10:59:28.636902+0000","last_fullsized":"2024-04-20T10:59:28.636902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":104331,"num_write":376,"num_write_kb":109020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"36'181","reported_seq":237,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392436+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:59:20.392436+0000","last_peered":"2024-04-20T10:59:20.392436+0000","last_clean":"2024-04-20T10:59:20.392436+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:59:20.392436+0000","last_undegraded":"2024-04-20T10:59:20.392436+0000","last_fullsized":"2024-04-20T10:59:20.392436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":124,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'410","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386887+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:59:20.386887+0000","last_peered":"2024-04-20T10:59:20.386887+0000","last_clean":"2024-04-20T10:59:20.386887+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:59:20.386887+0000","last_undegraded":"2024-04-20T10:59:20.386887+0000","last_fullsized":"2024-04-20T10:59:20.386887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56637,"num_write":377,"num_write_kb":62852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"38'546","reported_seq":612,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.627865+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:59:28.627865+0000","last_peered":"2024-04-20T10:59:28.627865+0000","last_clean":"2024-04-20T10:59:28.627865+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:59:28.627865+0000","last_undegraded":"2024-04-20T10:59:28.627865+0000","last_fullsized":"2024-04-20T10:59:28.627865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":57371,"num_write":468,"num_write_kb":12517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"38'472","reported_seq":608,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401711+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:59:30.401711+0000","last_peered":"2024-04-20T10:59:30.401711+0000","last_clean":"2024-04-20T10:59:30.401711+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:59:30.401711+0000","last_undegraded":"2024-04-20T10:59:30.401711+0000","last_fullsized":"2024-04-20T10:59:30.401711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":77683,"num_write":435,"num_write_kb":89005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"38'421","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381481+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:59:20.381481+0000","last_peered":"2024-04-20T10:59:20.381481+0000","last_clean":"2024-04-20T10:59:20.381481+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:59:20.381481+0000","last_undegraded":"2024-04-20T10:59:20.381481+0000","last_fullsized":"2024-04-20T10:59:20.381481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":50143,"num_write":396,"num_write_kb":67741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"38'423","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.406726+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:59:30.406726+0000","last_peered":"2024-04-20T10:59:30.406726+0000","last_clean":"2024-04-20T10:59:30.406726+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:59:30.406726+0000","last_undegraded":"2024-04-20T10:59:30.406726+0000","last_fullsized":"2024-04-20T10:59:30.406726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66334,"num_write":397,"num_write_kb":71356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"38'448","reported_seq":602,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380185+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:59:20.380185+0000","last_peered":"2024-04-20T10:59:20.380185+0000","last_clean":"2024-04-20T10:59:20.380185+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:59:20.380185+0000","last_undegraded":"2024-04-20T10:59:20.380185+0000","last_fullsized":"2024-04-20T10:59:20.380185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":105081,"num_write":414,"num_write_kb":80164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"38'397","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410925+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:59:30.410925+0000","last_peered":"2024-04-20T10:59:30.410925+0000","last_clean":"2024-04-20T10:59:30.410925+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:59:30.410925+0000","last_undegraded":"2024-04-20T10:59:30.410925+0000","last_fullsized":"2024-04-20T10:59:30.410925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":91923,"num_write":367,"num_write_kb":80227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"38'487","reported_seq":649,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395042+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:59:20.395042+0000","last_peered":"2024-04-20T10:59:20.395042+0000","last_clean":"2024-04-20T10:59:20.395042+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:59:20.395042+0000","last_undegraded":"2024-04-20T10:59:20.395042+0000","last_fullsized":"2024-04-20T10:59:20.395042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":66889,"num_write":452,"num_write_kb":101085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"38'390","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645512+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:59:28.645512+0000","last_peered":"2024-04-20T10:59:28.645512+0000","last_clean":"2024-04-20T10:59:28.645512+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:59:28.645512+0000","last_undegraded":"2024-04-20T10:59:28.645512+0000","last_fullsized":"2024-04-20T10:59:28.645512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":23315,"num_write":364,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"38'411","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401301+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:59:23.401301+0000","last_peered":"2024-04-20T10:59:23.401301+0000","last_clean":"2024-04-20T10:59:23.401301+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:59:23.401301+0000","last_undegraded":"2024-04-20T10:59:23.401301+0000","last_fullsized":"2024-04-20T10:59:23.401301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":34858,"num_write":375,"num_write_kb":71279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"38'438","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648687+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:59:28.648687+0000","last_peered":"2024-04-20T10:59:28.648687+0000","last_clean":"2024-04-20T10:59:28.648687+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:59:28.648687+0000","last_undegraded":"2024-04-20T10:59:28.648687+0000","last_fullsized":"2024-04-20T10:59:28.648687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":12465,"num_write":398,"num_write_kb":25863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"38'367","reported_seq":490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410600+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:59:23.410600+0000","last_peered":"2024-04-20T10:59:23.410600+0000","last_clean":"2024-04-20T10:59:23.410600+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:59:23.410600+0000","last_undegraded":"2024-04-20T10:59:23.410600+0000","last_fullsized":"2024-04-20T10:59:23.410600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40934,"num_write":339,"num_write_kb":54699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"38'400","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.400228+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:59:30.400228+0000","last_peered":"2024-04-20T10:59:30.400228+0000","last_clean":"2024-04-20T10:59:30.400228+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:59:30.400228+0000","last_undegraded":"2024-04-20T10:59:30.400228+0000","last_fullsized":"2024-04-20T10:59:30.400228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":17066,"num_write":365,"num_write_kb":46558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"37'404","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394135+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:59:20.394135+0000","last_peered":"2024-04-20T10:59:20.394135+0000","last_clean":"2024-04-20T10:59:20.394135+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:59:20.394135+0000","last_undegraded":"2024-04-20T10:59:20.394135+0000","last_fullsized":"2024-04-20T10:59:20.394135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64800,"num_write":371,"num_write_kb":91764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"38'402","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649072+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:59:28.649072+0000","last_peered":"2024-04-20T10:59:28.649072+0000","last_clean":"2024-04-20T10:59:28.649072+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:59:28.649072+0000","last_undegraded":"2024-04-20T10:59:28.649072+0000","last_fullsized":"2024-04-20T10:59:28.649072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1607,"num_write":370,"num_write_kb":5819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"38'433","reported_seq":570,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.735059+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:59:21.735059+0000","last_peered":"2024-04-20T10:59:21.735059+0000","last_clean":"2024-04-20T10:59:21.735059+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:59:21.735059+0000","last_undegraded":"2024-04-20T10:59:21.735059+0000","last_fullsized":"2024-04-20T10:59:21.735059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":4096,"num_write":399,"num_write_kb":30569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"38'439","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648218+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:59:28.648218+0000","last_peered":"2024-04-20T10:59:28.648218+0000","last_clean":"2024-04-20T10:59:28.648218+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:59:28.648218+0000","last_undegraded":"2024-04-20T10:59:28.648218+0000","last_fullsized":"2024-04-20T10:59:28.648218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":70131,"num_write":400,"num_write_kb":59168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"38'431","reported_seq":582,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.398797+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:59:23.398797+0000","last_peered":"2024-04-20T10:59:23.398797+0000","last_clean":"2024-04-20T10:59:23.398797+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:59:23.398797+0000","last_undegraded":"2024-04-20T10:59:23.398797+0000","last_fullsized":"2024-04-20T10:59:23.398797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":77347,"num_write":407,"num_write_kb":71895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"38'408","reported_seq":520,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411133+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:59:30.411133+0000","last_peered":"2024-04-20T10:59:30.411133+0000","last_clean":"2024-04-20T10:59:30.411133+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:59:30.411133+0000","last_undegraded":"2024-04-20T10:59:30.411133+0000","last_fullsized":"2024-04-20T10:59:30.411133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":43744,"num_write":370,"num_write_kb":63188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"38'456","reported_seq":613,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410206+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:59:23.410206+0000","last_peered":"2024-04-20T10:59:23.410206+0000","last_clean":"2024-04-20T10:59:23.410206+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:59:23.410206+0000","last_undegraded":"2024-04-20T10:59:23.410206+0000","last_fullsized":"2024-04-20T10:59:23.410206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63871,"num_write":428,"num_write_kb":100114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"38'419","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401609+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:59:30.401609+0000","last_peered":"2024-04-20T10:59:30.401609+0000","last_clean":"2024-04-20T10:59:30.401609+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:59:30.401609+0000","last_undegraded":"2024-04-20T10:59:30.401609+0000","last_fullsized":"2024-04-20T10:59:30.401609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":38962,"num_write":387,"num_write_kb":79793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"38'398","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401652+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:59:23.401652+0000","last_peered":"2024-04-20T10:59:23.401652+0000","last_clean":"2024-04-20T10:59:23.401652+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:59:23.401652+0000","last_undegraded":"2024-04-20T10:59:23.401652+0000","last_fullsized":"2024-04-20T10:59:23.401652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":27738,"num_write":360,"num_write_kb":54944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"38'458","reported_seq":577,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380662+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:59:20.380662+0000","last_peered":"2024-04-20T10:59:20.380662+0000","last_clean":"2024-04-20T10:59:20.380662+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:59:20.380662+0000","last_undegraded":"2024-04-20T10:59:20.380662+0000","last_fullsized":"2024-04-20T10:59:20.380662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":59920,"num_write":425,"num_write_kb":71046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"37'439","reported_seq":599,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392443+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:59:20.392443+0000","last_peered":"2024-04-20T10:59:20.392443+0000","last_clean":"2024-04-20T10:59:20.392443+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:59:20.392443+0000","last_undegraded":"2024-04-20T10:59:20.392443+0000","last_fullsized":"2024-04-20T10:59:20.392443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":95905,"num_write":408,"num_write_kb":92283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"38'434","reported_seq":561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.630311+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:59:28.630311+0000","last_peered":"2024-04-20T10:59:28.630311+0000","last_clean":"2024-04-20T10:59:28.630311+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:59:28.630311+0000","last_undegraded":"2024-04-20T10:59:28.630311+0000","last_fullsized":"2024-04-20T10:59:28.630311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66507,"num_write":387,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"38'427","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410629+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:59:23.410629+0000","last_peered":"2024-04-20T10:59:23.410629+0000","last_clean":"2024-04-20T10:59:23.410629+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:59:23.410629+0000","last_undegraded":"2024-04-20T10:59:23.410629+0000","last_fullsized":"2024-04-20T10:59:23.410629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":76500,"num_write":396,"num_write_kb":108707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"38'451","reported_seq":611,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644728+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:59:28.644728+0000","last_peered":"2024-04-20T10:59:28.644728+0000","last_clean":"2024-04-20T10:59:28.644728+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:59:28.644728+0000","last_undegraded":"2024-04-20T10:59:28.644728+0000","last_fullsized":"2024-04-20T10:59:28.644728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":149375,"num_write":423,"num_write_kb":104932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"36'447","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382311+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:59:20.382311+0000","last_peered":"2024-04-20T10:59:20.382311+0000","last_clean":"2024-04-20T10:59:20.382311+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:59:20.382311+0000","last_undegraded":"2024-04-20T10:59:20.382311+0000","last_fullsized":"2024-04-20T10:59:20.382311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":47044,"num_write":422,"num_write_kb":50901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"38'415","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644572+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:59:28.644572+0000","last_peered":"2024-04-20T10:59:28.644572+0000","last_clean":"2024-04-20T10:59:28.644572+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:59:28.644572+0000","last_undegraded":"2024-04-20T10:59:28.644572+0000","last_fullsized":"2024-04-20T10:59:28.644572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":91214,"num_write":375,"num_write_kb":63780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"37'461","reported_seq":625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393370+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:59:20.393370+0000","last_peered":"2024-04-20T10:59:20.393370+0000","last_clean":"2024-04-20T10:59:20.393370+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:59:20.393370+0000","last_undegraded":"2024-04-20T10:59:20.393370+0000","last_fullsized":"2024-04-20T10:59:20.393370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":88844,"num_write":432,"num_write_kb":122405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"38'475","reported_seq":632,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411714+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:59:30.411714+0000","last_peered":"2024-04-20T10:59:30.411714+0000","last_clean":"2024-04-20T10:59:30.411714+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:59:30.411714+0000","last_undegraded":"2024-04-20T10:59:30.411714+0000","last_fullsized":"2024-04-20T10:59:30.411714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":92351,"num_write":448,"num_write_kb":96949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"38'395","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408704+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:59:23.408704+0000","last_peered":"2024-04-20T10:59:23.408704+0000","last_clean":"2024-04-20T10:59:23.408704+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:59:23.408704+0000","last_undegraded":"2024-04-20T10:59:23.408704+0000","last_fullsized":"2024-04-20T10:59:23.408704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":19688,"num_write":355,"num_write_kb":13664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"38'415","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612674+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:59:28.612674+0000","last_peered":"2024-04-20T10:59:28.612674+0000","last_clean":"2024-04-20T10:59:28.612674+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:59:28.612674+0000","last_undegraded":"2024-04-20T10:59:28.612674+0000","last_fullsized":"2024-04-20T10:59:28.612674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":48111,"num_write":381,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"38'397","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399907+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:59:23.399907+0000","last_peered":"2024-04-20T10:59:23.399907+0000","last_clean":"2024-04-20T10:59:23.399907+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:59:23.399907+0000","last_undegraded":"2024-04-20T10:59:23.399907+0000","last_fullsized":"2024-04-20T10:59:23.399907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":17103,"num_write":369,"num_write_kb":54677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"38'400","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635768+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:59:28.635768+0000","last_peered":"2024-04-20T10:59:28.635768+0000","last_clean":"2024-04-20T10:59:28.635768+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:59:28.635768+0000","last_undegraded":"2024-04-20T10:59:28.635768+0000","last_fullsized":"2024-04-20T10:59:28.635768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":100212,"num_write":371,"num_write_kb":79700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"38'442","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399450+0000","last_change":"2024-04-20T10:51:20.873976+0000","last_active":"2024-04-20T10:59:23.399450+0000","last_peered":"2024-04-20T10:59:23.399450+0000","last_clean":"2024-04-20T10:59:23.399450+0000","last_became_active":"2024-04-20T10:51:20.873636+0000","last_became_peered":"2024-04-20T10:51:20.873636+0000","last_unstale":"2024-04-20T10:59:23.399450+0000","last_undegraded":"2024-04-20T10:59:23.399450+0000","last_fullsized":"2024-04-20T10:59:23.399450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:25:44.190342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42670,"num_write":410,"num_write_kb":59228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"38'412","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:29.333860+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:59:29.333860+0000","last_peered":"2024-04-20T10:59:29.333860+0000","last_clean":"2024-04-20T10:59:29.333860+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:59:29.333860+0000","last_undegraded":"2024-04-20T10:59:29.333860+0000","last_fullsized":"2024-04-20T10:59:29.333860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":47914,"num_write":385,"num_write_kb":47165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"38'402","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391617+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:59:20.391617+0000","last_peered":"2024-04-20T10:59:20.391617+0000","last_clean":"2024-04-20T10:59:20.391617+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:59:20.391617+0000","last_undegraded":"2024-04-20T10:59:20.391617+0000","last_fullsized":"2024-04-20T10:59:20.391617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":39185,"num_write":369,"num_write_kb":42800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"38'382","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.399818+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:59:30.399818+0000","last_peered":"2024-04-20T10:59:30.399818+0000","last_clean":"2024-04-20T10:59:30.399818+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:59:30.399818+0000","last_undegraded":"2024-04-20T10:59:30.399818+0000","last_fullsized":"2024-04-20T10:59:30.399818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":54933,"num_write":350,"num_write_kb":63813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"37'409","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386301+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:59:20.386301+0000","last_peered":"2024-04-20T10:59:20.386301+0000","last_clean":"2024-04-20T10:59:20.386301+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:59:20.386301+0000","last_undegraded":"2024-04-20T10:59:20.386301+0000","last_fullsized":"2024-04-20T10:59:20.386301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":25358,"num_write":380,"num_write_kb":59236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"38'401","reported_seq":510,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649095+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:59:28.649095+0000","last_peered":"2024-04-20T10:59:28.649095+0000","last_clean":"2024-04-20T10:59:28.649095+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:59:28.649095+0000","last_undegraded":"2024-04-20T10:59:28.649095+0000","last_fullsized":"2024-04-20T10:59:28.649095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":46490,"num_write":386,"num_write_kb":55187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"38'404","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391974+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:59:20.391974+0000","last_peered":"2024-04-20T10:59:20.391974+0000","last_clean":"2024-04-20T10:59:20.391974+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:59:20.391974+0000","last_undegraded":"2024-04-20T10:59:20.391974+0000","last_fullsized":"2024-04-20T10:59:20.391974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":60998,"num_write":371,"num_write_kb":104269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"38'390","reported_seq":492,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635398+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:59:28.635398+0000","last_peered":"2024-04-20T10:59:28.635398+0000","last_clean":"2024-04-20T10:59:28.635398+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:59:28.635398+0000","last_undegraded":"2024-04-20T10:59:28.635398+0000","last_fullsized":"2024-04-20T10:59:28.635398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":9157,"num_write":355,"num_write_kb":25794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"38'351","reported_seq":480,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399206+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:59:23.399206+0000","last_peered":"2024-04-20T10:59:23.399206+0000","last_clean":"2024-04-20T10:59:23.399206+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:59:23.399206+0000","last_undegraded":"2024-04-20T10:59:23.399206+0000","last_fullsized":"2024-04-20T10:59:23.399206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":63467,"num_write":328,"num_write_kb":42600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"38'381","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646486+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:59:28.646486+0000","last_peered":"2024-04-20T10:59:28.646486+0000","last_clean":"2024-04-20T10:59:28.646486+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:59:28.646486+0000","last_undegraded":"2024-04-20T10:59:28.646486+0000","last_fullsized":"2024-04-20T10:59:28.646486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":28672,"num_write":342,"num_write_kb":50404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"38'364","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383016+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:59:20.383016+0000","last_peered":"2024-04-20T10:59:20.383016+0000","last_clean":"2024-04-20T10:59:20.383016+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:59:20.383016+0000","last_undegraded":"2024-04-20T10:59:20.383016+0000","last_fullsized":"2024-04-20T10:59:20.383016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":12730,"num_write":348,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"38'424","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.402605+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:59:30.402605+0000","last_peered":"2024-04-20T10:59:30.402605+0000","last_clean":"2024-04-20T10:59:30.402605+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:59:30.402605+0000","last_undegraded":"2024-04-20T10:59:30.402605+0000","last_fullsized":"2024-04-20T10:59:30.402605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":7385,"num_write":393,"num_write_kb":42181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"38'399","reported_seq":540,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382905+0000","last_change":"2024-04-20T10:51:20.769699+0000","last_active":"2024-04-20T10:59:20.382905+0000","last_peered":"2024-04-20T10:59:20.382905+0000","last_clean":"2024-04-20T10:59:20.382905+0000","last_became_active":"2024-04-20T10:51:20.769384+0000","last_became_peered":"2024-04-20T10:51:20.769384+0000","last_unstale":"2024-04-20T10:59:20.382905+0000","last_undegraded":"2024-04-20T10:59:20.382905+0000","last_fullsized":"2024-04-20T10:59:20.382905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:57:56.261004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71394,"num_write":379,"num_write_kb":96385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"38'436","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391041+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:59:20.391041+0000","last_peered":"2024-04-20T10:59:20.391041+0000","last_clean":"2024-04-20T10:59:20.391041+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:59:20.391041+0000","last_undegraded":"2024-04-20T10:59:20.391041+0000","last_fullsized":"2024-04-20T10:59:20.391041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":70925,"num_write":402,"num_write_kb":100628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"38'423","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380992+0000","last_change":"2024-04-20T10:51:20.841991+0000","last_active":"2024-04-20T10:59:20.380992+0000","last_peered":"2024-04-20T10:59:20.380992+0000","last_clean":"2024-04-20T10:59:20.380992+0000","last_became_active":"2024-04-20T10:51:20.841719+0000","last_became_peered":"2024-04-20T10:51:20.841719+0000","last_unstale":"2024-04-20T10:59:20.380992+0000","last_undegraded":"2024-04-20T10:59:20.380992+0000","last_fullsized":"2024-04-20T10:59:20.380992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:09:17.891373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":49916,"num_write":398,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"38'473","reported_seq":605,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633509+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:59:28.633509+0000","last_peered":"2024-04-20T10:59:28.633509+0000","last_clean":"2024-04-20T10:59:28.633509+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:59:28.633509+0000","last_undegraded":"2024-04-20T10:59:28.633509+0000","last_fullsized":"2024-04-20T10:59:28.633509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":134201,"num_write":442,"num_write_kb":141769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"38'414","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406887+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:59:23.406887+0000","last_peered":"2024-04-20T10:59:23.406887+0000","last_clean":"2024-04-20T10:59:23.406887+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:59:23.406887+0000","last_undegraded":"2024-04-20T10:59:23.406887+0000","last_fullsized":"2024-04-20T10:59:23.406887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":129245,"num_write":382,"num_write_kb":126738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"38'443","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633493+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:59:28.633493+0000","last_peered":"2024-04-20T10:59:28.633493+0000","last_clean":"2024-04-20T10:59:28.633493+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:59:28.633493+0000","last_undegraded":"2024-04-20T10:59:28.633493+0000","last_fullsized":"2024-04-20T10:59:28.633493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":98132,"num_write":412,"num_write_kb":88980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"38'431","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390443+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:59:20.390443+0000","last_peered":"2024-04-20T10:59:20.390443+0000","last_clean":"2024-04-20T10:59:20.390443+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:59:20.390443+0000","last_undegraded":"2024-04-20T10:59:20.390443+0000","last_fullsized":"2024-04-20T10:59:20.390443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":82367,"num_write":405,"num_write_kb":88791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"38'369","reported_seq":469,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.408544+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:59:30.408544+0000","last_peered":"2024-04-20T10:59:30.408544+0000","last_clean":"2024-04-20T10:59:30.408544+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:59:30.408544+0000","last_undegraded":"2024-04-20T10:59:30.408544+0000","last_fullsized":"2024-04-20T10:59:30.408544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":17428,"num_write":337,"num_write_kb":30562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"38'375","reported_seq":483,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399602+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:59:23.399602+0000","last_peered":"2024-04-20T10:59:23.399602+0000","last_clean":"2024-04-20T10:59:23.399602+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:59:23.399602+0000","last_undegraded":"2024-04-20T10:59:23.399602+0000","last_fullsized":"2024-04-20T10:59:23.399602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":12288,"num_write":347,"num_write_kb":45028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"38'368","reported_seq":470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645244+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:59:28.645244+0000","last_peered":"2024-04-20T10:59:28.645244+0000","last_clean":"2024-04-20T10:59:28.645244+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:59:28.645244+0000","last_undegraded":"2024-04-20T10:59:28.645244+0000","last_fullsized":"2024-04-20T10:59:28.645244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":42400,"num_write":337,"num_write_kb":50456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"38'435","reported_seq":585,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390827+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:59:20.390827+0000","last_peered":"2024-04-20T10:59:20.390827+0000","last_clean":"2024-04-20T10:59:20.390827+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:59:20.390827+0000","last_undegraded":"2024-04-20T10:59:20.390827+0000","last_fullsized":"2024-04-20T10:59:20.390827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":60266,"num_write":401,"num_write_kb":64358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"38'402","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401638+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:59:30.401638+0000","last_peered":"2024-04-20T10:59:30.401638+0000","last_clean":"2024-04-20T10:59:30.401638+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:59:30.401638+0000","last_undegraded":"2024-04-20T10:59:30.401638+0000","last_fullsized":"2024-04-20T10:59:30.401638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58110,"num_write":372,"num_write_kb":67566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"38'410","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402471+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:59:23.402471+0000","last_peered":"2024-04-20T10:59:23.402471+0000","last_clean":"2024-04-20T10:59:23.402471+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:59:23.402471+0000","last_undegraded":"2024-04-20T10:59:23.402471+0000","last_fullsized":"2024-04-20T10:59:23.402471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":40406,"num_write":376,"num_write_kb":72310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"38'423","reported_seq":540,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646095+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:59:28.646095+0000","last_peered":"2024-04-20T10:59:28.646095+0000","last_clean":"2024-04-20T10:59:28.646095+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:59:28.646095+0000","last_undegraded":"2024-04-20T10:59:28.646095+0000","last_fullsized":"2024-04-20T10:59:28.646095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48634,"num_write":394,"num_write_kb":56270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"37'391","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386768+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:59:20.386768+0000","last_peered":"2024-04-20T10:59:20.386768+0000","last_clean":"2024-04-20T10:59:20.386768+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:59:20.386768+0000","last_undegraded":"2024-04-20T10:59:20.386768+0000","last_fullsized":"2024-04-20T10:59:20.386768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":67210,"num_write":369,"num_write_kb":63933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"38'365","reported_seq":475,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405357+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:59:30.405357+0000","last_peered":"2024-04-20T10:59:30.405357+0000","last_clean":"2024-04-20T10:59:30.405357+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:59:30.405357+0000","last_undegraded":"2024-04-20T10:59:30.405357+0000","last_fullsized":"2024-04-20T10:59:30.405357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":38197,"num_write":324,"num_write_kb":43133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'436","reported_seq":574,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390287+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:59:20.390287+0000","last_peered":"2024-04-20T10:59:20.390287+0000","last_clean":"2024-04-20T10:59:20.390287+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:59:20.390287+0000","last_undegraded":"2024-04-20T10:59:20.390287+0000","last_fullsized":"2024-04-20T10:59:20.390287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":82231,"num_write":413,"num_write_kb":104966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"38'435","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648841+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:59:28.648841+0000","last_peered":"2024-04-20T10:59:28.648841+0000","last_clean":"2024-04-20T10:59:28.648841+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:59:28.648841+0000","last_undegraded":"2024-04-20T10:59:28.648841+0000","last_fullsized":"2024-04-20T10:59:28.648841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78016,"num_write":409,"num_write_kb":101239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"37'379","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392424+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:59:20.392424+0000","last_peered":"2024-04-20T10:59:20.392424+0000","last_clean":"2024-04-20T10:59:20.392424+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:59:20.392424+0000","last_undegraded":"2024-04-20T10:59:20.392424+0000","last_fullsized":"2024-04-20T10:59:20.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":25535,"num_write":356,"num_write_kb":38136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4810,"num_read_kb":3595152,"num_write":24379,"num_write_kb":4256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26481,"ondisk_log_size":26481,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":149799644,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":809,"num_read_kb":507129,"num_write":8083,"num_write_kb":153175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299663360,"data_stored":299599288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9473,"ondisk_log_size":9473,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5724,"num_read_kb":3353332,"num_write":24442,"num_write_kb":4400565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26386,"ondisk_log_size":26386,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151049735,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":699,"num_read_kb":394566,"num_write":7750,"num_write_kb":153909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302161920,"data_stored":302099470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9158,"ondisk_log_size":9158,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126660,"kb_used_data":77436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94245180,"statfs":{"total":96636764160,"available":96507064320,"internally_reserved":0,"allocated":79294464,"data_stored":79053534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130184,"kb_used_data":80960,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94241656,"statfs":{"total":96636764160,"available":96503455744,"internally_reserved":0,"allocated":82903040,"data_stored":82658086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123880,"kb_used_data":52512,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94247960,"statfs":{"total":96636764160,"available":96509911040,"internally_reserved":0,"allocated":53772288,"data_stored":53529519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177172,"kb_used_data":96076,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94194668,"statfs":{"total":96636764160,"available":96455340032,"internally_reserved":0,"allocated":98381824,"data_stored":98133898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185380,"kb_used_data":104284,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94186460,"statfs":{"total":96636764160,"available":96446935040,"internally_reserved":0,"allocated":106786816,"data_stored":106540719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71508,"kb_used_data":26444,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94300332,"statfs":{"total":96636764160,"available":96563539968,"internally_reserved":0,"allocated":27078656,"data_stored":26847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189528,"kb_used_data":108432,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94182312,"statfs":{"total":96636764160,"available":96442687488,"internally_reserved":0,"allocated":111034368,"data_stored":110784766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95288,"kb_used_data":46064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94276552,"statfs":{"total":96636764160,"available":96539189248,"internally_reserved":0,"allocated":47169536,"data_stored":46927925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14065664,"data_stored":14065090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35045376,"data_stored":35037282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48914432,"data_stored":48903463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57298944,"data_stored":57291981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":68657152,"data_stored":68641991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51796853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23982080,"data_stored":23969726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:59:46.641 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:59:46.775 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.771+0000 7ff15aa63640 1 Processor -- start 2024-04-20T10:59:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.771+0000 7ff15aa63640 1 -- start start 2024-04-20T10:59:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.771+0000 7ff15aa63640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff154157710 0x7ff154154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.771+0000 7ff15aa63640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1540c4370 con 0x7ff1540ad0c0 2024-04-20T10:59:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.771+0000 7ff15aa63640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff154156c30 con 0x7ff154073810 2024-04-20T10:59:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.771+0000 7ff15aa63640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff1541569e0 con 0x7ff154157710 2024-04-20T10:59:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.772+0000 7ff1537fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff154157710 0x7ff154154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.772+0000 7ff159000640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7ff1540ad0c0 0x7ff1540abbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48364/0 (socket says 172.21.15.90:48364) 2024-04-20T10:59:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.772+0000 7ff159000640 1 -- 172.21.15.90:0/2118288144 learned_addr learned my addr 172.21.15.90:0/2118288144 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.772+0000 7ff1537fe640 1 -- 172.21.15.90:0/2118288144 >> v1:172.21.15.175:6789/0 conn(0x7ff154073810 legacy=0x7ff1540c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.772+0000 7ff1537fe640 1 -- 172.21.15.90:0/2118288144 >> v1:172.21.15.90:6789/0 conn(0x7ff1540ad0c0 legacy=0x7ff1540abbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.772+0000 7ff152ffd640 1 -- 172.21.15.90:0/2118288144 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485312291 0 0) 0x7ff1540c4370 con 0x7ff1540ad0c0 2024-04-20T10:59:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.772+0000 7ff1537fe640 1 -- 172.21.15.90:0/2118288144 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff154156f10 con 0x7ff154157710 2024-04-20T10:59:46.777 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.773+0000 7ff1537fe640 1 --2- 172.21.15.90:0/2118288144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154157710 0x7ff154154000 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff1480097a0 tx=0x7ff14802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d31ce8c8d184bc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.773+0000 7ff152ffd640 1 -- 172.21.15.90:0/2118288144 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1480315a0 con 0x7ff154157710 2024-04-20T10:59:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.773+0000 7ff152ffd640 1 -- 172.21.15.90:0/2118288144 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff148037070 con 0x7ff154157710 2024-04-20T10:59:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.773+0000 7ff152ffd640 1 -- 172.21.15.90:0/2118288144 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148031960 con 0x7ff154157710 2024-04-20T10:59:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.773+0000 7ff15aa63640 1 -- 172.21.15.90:0/2118288144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154157710 msgr2=0x7ff154154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.773+0000 7ff15aa63640 1 --2- 172.21.15.90:0/2118288144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154157710 0x7ff154154000 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7ff1480097a0 tx=0x7ff14802b840 comp rx=0 tx=0).stop 2024-04-20T10:59:46.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.773+0000 7ff15aa63640 1 -- 172.21.15.90:0/2118288144 shutdown_connections 2024-04-20T10:59:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.774+0000 7ff15aa63640 1 --2- 172.21.15.90:0/2118288144 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154157710 0x7ff154154000 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.774+0000 7ff15aa63640 1 -- 172.21.15.90:0/2118288144 >> 172.21.15.90:0/2118288144 conn(0x7ff1540c8080 msgr2=0x7ff1540c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.774+0000 7ff15aa63640 1 -- 172.21.15.90:0/2118288144 shutdown_connections 2024-04-20T10:59:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.774+0000 7ff15aa63640 1 -- 172.21.15.90:0/2118288144 wait complete. 2024-04-20T10:59:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.775+0000 7ff15aa63640 1 Processor -- start 2024-04-20T10:59:46.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.775+0000 7ff15aa63640 1 -- start start 2024-04-20T10:59:46.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154073810 0x7ff154071d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1540ad0c0 0x7ff1541487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff154157710 0x7ff1541e10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff1540ac2c0 con 0x7ff154073810 2024-04-20T10:59:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff154157280 con 0x7ff154157710 2024-04-20T10:59:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff1540ac440 con 0x7ff1540ad0c0 2024-04-20T10:59:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154073810 0x7ff154071d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154073810 0x7ff154071d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51978/0 (socket says 172.21.15.90:51978) 2024-04-20T10:59:46.783 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 -- 172.21.15.90:0/4231754905 learned_addr learned my addr 172.21.15.90:0/4231754905 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff1537fe640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1540ad0c0 0x7ff1541487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff159000640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff154157710 0x7ff1541e10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 -- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1540ad0c0 msgr2=0x7ff1541487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1540ad0c0 0x7ff1541487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 -- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff154157710 msgr2=0x7ff1541e10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff154157710 0x7ff1541e10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 -- 172.21.15.90:0/4231754905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1540c7cb0 con 0x7ff154073810 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff153fff640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154073810 0x7ff154071d20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff14400c430 tx=0x7ff14400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff150ff9640 1 -- 172.21.15.90:0/4231754905 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144011790 con 0x7ff154073810 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff150ff9640 1 -- 172.21.15.90:0/4231754905 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff144017070 con 0x7ff154073810 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1540c79d0 con 0x7ff154073810 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff150ff9640 1 -- 172.21.15.90:0/4231754905 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff144011b70 con 0x7ff154073810 2024-04-20T10:59:46.784 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.776+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1541f03d0 con 0x7ff154073810 2024-04-20T10:59:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.777+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff154076150 con 0x7ff154073810 2024-04-20T10:59:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.778+0000 7ff150ff9640 1 -- 172.21.15.90:0/4231754905 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff144011d10 con 0x7ff154073810 2024-04-20T10:59:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.778+0000 7ff150ff9640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff14006c8f0 0x7ff14006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.778+0000 7ff1537fe640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff14006c8f0 0x7ff14006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.778+0000 7ff150ff9640 1 -- 172.21.15.90:0/4231754905 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7ff14408c060 con 0x7ff154073810 2024-04-20T10:59:46.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.779+0000 7ff1537fe640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff14006c8f0 0x7ff14006edb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff148036000 tx=0x7ff14803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:46.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.783+0000 7ff150ff9640 1 -- 172.21.15.90:0/4231754905 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff144059dd0 con 0x7ff154073810 2024-04-20T10:59:46.955 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.955+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff154071ae0 con 0x7ff14006c8f0 2024-04-20T10:59:46.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.966+0000 7ff150ff9640 1 -- 172.21.15.90:0/4231754905 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494337 (secure 0 0 0) 0x7ff154071ae0 con 0x7ff14006c8f0 2024-04-20T10:59:46.972 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:46.975 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff14006c8f0 msgr2=0x7ff14006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff14006c8f0 0x7ff14006edb0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff148036000 tx=0x7ff14803d040 comp rx=0 tx=0).stop 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154073810 msgr2=0x7ff154071d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154073810 0x7ff154071d20 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7ff14400c430 tx=0x7ff14400c8f0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 shutdown_connections 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff14006c8f0 0x7ff14006edb0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff154157710 0x7ff1541e10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff1540ad0c0 0x7ff1541487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 --2- 172.21.15.90:0/4231754905 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff154073810 0x7ff154071d20 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 >> 172.21.15.90:0/4231754905 conn(0x7ff1540c8080 msgr2=0x7ff1540c2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 shutdown_connections 2024-04-20T10:59:46.977 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:46.970+0000 7ff15aa63640 1 -- 172.21.15.90:0/4231754905 wait complete. 2024-04-20T10:59:46.981 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-04-20T10:59:45.805828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":301439747,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":12158,"num_read_kb":7850279,"num_write":64813,"num_write_kb":8966793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71615,"ondisk_log_size":71615,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1099600,"kb_used_data":592208,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":753875120,"statfs":{"total":773094113280,"available":771968122880,"internally_reserved":0,"allocated":606420992,"data_stored":604476094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":519491120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55310,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":12,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003210"},"pg_stats":[{"pgid":"5.18","version":"38'433","reported_seq":545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.647268+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:59:28.647268+0000","last_peered":"2024-04-20T10:59:28.647268+0000","last_clean":"2024-04-20T10:59:28.647268+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:59:28.647268+0000","last_undegraded":"2024-04-20T10:59:28.647268+0000","last_fullsized":"2024-04-20T10:59:28.647268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":22795,"num_write":399,"num_write_kb":54919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"38'85","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387326+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:59:20.387326+0000","last_peered":"2024-04-20T10:59:20.387326+0000","last_clean":"2024-04-20T10:59:20.387326+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:59:20.387326+0000","last_undegraded":"2024-04-20T10:59:20.387326+0000","last_fullsized":"2024-04-20T10:59:20.387326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":13987,"num_write":27,"num_write_kb":4118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"38'408","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403809+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:59:23.403809+0000","last_peered":"2024-04-20T10:59:23.403809+0000","last_clean":"2024-04-20T10:59:23.403809+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:59:23.403809+0000","last_undegraded":"2024-04-20T10:59:23.403809+0000","last_fullsized":"2024-04-20T10:59:23.403809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":85574,"num_write":384,"num_write_kb":89655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"38'168","reported_seq":213,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.596572+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:59:22.596572+0000","last_peered":"2024-04-20T10:59:22.596572+0000","last_clean":"2024-04-20T10:59:22.596572+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:59:22.596572+0000","last_undegraded":"2024-04-20T10:59:22.596572+0000","last_fullsized":"2024-04-20T10:59:22.596572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"38'459","reported_seq":574,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.407768+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:59:30.407768+0000","last_peered":"2024-04-20T10:59:30.407768+0000","last_clean":"2024-04-20T10:59:30.407768+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:59:30.407768+0000","last_undegraded":"2024-04-20T10:59:30.407768+0000","last_fullsized":"2024-04-20T10:59:30.407768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":79973,"num_write":429,"num_write_kb":121385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"36'193","reported_seq":248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.396105+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:59:20.396105+0000","last_peered":"2024-04-20T10:59:20.396105+0000","last_clean":"2024-04-20T10:59:20.396105+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:59:20.396105+0000","last_undegraded":"2024-04-20T10:59:20.396105+0000","last_fullsized":"2024-04-20T10:59:20.396105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":130,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"37'359","reported_seq":476,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386804+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:59:20.386804+0000","last_peered":"2024-04-20T10:59:20.386804+0000","last_clean":"2024-04-20T10:59:20.386804+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:59:20.386804+0000","last_undegraded":"2024-04-20T10:59:20.386804+0000","last_fullsized":"2024-04-20T10:59:20.386804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":24250,"num_write":339,"num_write_kb":58188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"38'922","reported_seq":973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.570742+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:59:21.570742+0000","last_peered":"2024-04-20T10:59:21.570742+0000","last_clean":"2024-04-20T10:59:21.570742+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:59:21.570742+0000","last_undegraded":"2024-04-20T10:59:21.570742+0000","last_fullsized":"2024-04-20T10:59:21.570742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":852,"num_write_kb":8691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"38'405","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.639984+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:59:28.639984+0000","last_peered":"2024-04-20T10:59:28.639984+0000","last_clean":"2024-04-20T10:59:28.639984+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:59:28.639984+0000","last_undegraded":"2024-04-20T10:59:28.639984+0000","last_fullsized":"2024-04-20T10:59:28.639984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":43507,"num_write":372,"num_write_kb":54374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"37'371","reported_seq":440,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392875+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:59:20.392875+0000","last_peered":"2024-04-20T10:59:20.392875+0000","last_clean":"2024-04-20T10:59:20.392875+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:59:20.392875+0000","last_undegraded":"2024-04-20T10:59:20.392875+0000","last_fullsized":"2024-04-20T10:59:20.392875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":45077,"num_write":302,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'401","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393379+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:59:20.393379+0000","last_peered":"2024-04-20T10:59:20.393379+0000","last_clean":"2024-04-20T10:59:20.393379+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:59:20.393379+0000","last_undegraded":"2024-04-20T10:59:20.393379+0000","last_fullsized":"2024-04-20T10:59:20.393379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":103995,"num_write":369,"num_write_kb":100717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'159","reported_seq":208,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386804+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:59:20.386804+0000","last_peered":"2024-04-20T10:59:20.386804+0000","last_clean":"2024-04-20T10:59:20.386804+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:59:20.386804+0000","last_undegraded":"2024-04-20T10:59:20.386804+0000","last_fullsized":"2024-04-20T10:59:20.386804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":20490,"num_write":105,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"38'368","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641669+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:59:28.641669+0000","last_peered":"2024-04-20T10:59:28.641669+0000","last_clean":"2024-04-20T10:59:28.641669+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:59:28.641669+0000","last_undegraded":"2024-04-20T10:59:28.641669+0000","last_fullsized":"2024-04-20T10:59:28.641669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":53969,"num_write":336,"num_write_kb":42442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"38'67","reported_seq":129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391409+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:59:20.391409+0000","last_peered":"2024-04-20T10:59:20.391409+0000","last_clean":"2024-04-20T10:59:20.391409+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:59:20.391409+0000","last_undegraded":"2024-04-20T10:59:20.391409+0000","last_fullsized":"2024-04-20T10:59:20.391409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":8317,"num_write":19,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'375","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395496+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:59:20.395496+0000","last_peered":"2024-04-20T10:59:20.395496+0000","last_clean":"2024-04-20T10:59:20.395496+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:59:20.395496+0000","last_undegraded":"2024-04-20T10:59:20.395496+0000","last_fullsized":"2024-04-20T10:59:20.395496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":27688,"num_write":341,"num_write_kb":72358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'659","reported_seq":712,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.264947+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:59:22.264947+0000","last_peered":"2024-04-20T10:59:22.264947+0000","last_clean":"2024-04-20T10:59:22.264947+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:59:22.264947+0000","last_undegraded":"2024-04-20T10:59:22.264947+0000","last_fullsized":"2024-04-20T10:59:22.264947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36433,"num_write":605,"num_write_kb":12615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"38'446","reported_seq":569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.406503+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:59:30.406503+0000","last_peered":"2024-04-20T10:59:30.406503+0000","last_clean":"2024-04-20T10:59:30.406503+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:59:30.406503+0000","last_undegraded":"2024-04-20T10:59:30.406503+0000","last_fullsized":"2024-04-20T10:59:30.406503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":68359,"num_write":412,"num_write_kb":83650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"38'451","reported_seq":601,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408229+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:59:23.408229+0000","last_peered":"2024-04-20T10:59:23.408229+0000","last_clean":"2024-04-20T10:59:23.408229+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:59:23.408229+0000","last_undegraded":"2024-04-20T10:59:23.408229+0000","last_fullsized":"2024-04-20T10:59:23.408229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":83011,"num_write":424,"num_write_kb":112568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"37'185","reported_seq":251,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391349+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:59:20.391349+0000","last_peered":"2024-04-20T10:59:20.391349+0000","last_clean":"2024-04-20T10:59:20.391349+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:59:20.391349+0000","last_undegraded":"2024-04-20T10:59:20.391349+0000","last_fullsized":"2024-04-20T10:59:20.391349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32778,"num_write":122,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'533","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387601+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:59:20.387601+0000","last_peered":"2024-04-20T10:59:20.387601+0000","last_clean":"2024-04-20T10:59:20.387601+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:59:20.387601+0000","last_undegraded":"2024-04-20T10:59:20.387601+0000","last_fullsized":"2024-04-20T10:59:20.387601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16463,"num_write":485,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'400","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380771+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:59:20.380771+0000","last_peered":"2024-04-20T10:59:20.380771+0000","last_clean":"2024-04-20T10:59:20.380771+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:59:20.380771+0000","last_undegraded":"2024-04-20T10:59:20.380771+0000","last_fullsized":"2024-04-20T10:59:20.380771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":15248,"num_write":372,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"36'439","reported_seq":580,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389917+0000","last_change":"2024-04-20T10:51:20.874303+0000","last_active":"2024-04-20T10:59:20.389917+0000","last_peered":"2024-04-20T10:59:20.389917+0000","last_clean":"2024-04-20T10:59:20.389917+0000","last_became_active":"2024-04-20T10:51:20.873593+0000","last_became_peered":"2024-04-20T10:51:20.873593+0000","last_unstale":"2024-04-20T10:59:20.389917+0000","last_undegraded":"2024-04-20T10:59:20.389917+0000","last_fullsized":"2024-04-20T10:59:20.389917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:03.363095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":68460,"num_write":408,"num_write_kb":88214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"36'471","reported_seq":525,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391983+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:59:20.391983+0000","last_peered":"2024-04-20T10:59:20.391983+0000","last_clean":"2024-04-20T10:59:20.391983+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:59:20.391983+0000","last_undegraded":"2024-04-20T10:59:20.391983+0000","last_fullsized":"2024-04-20T10:59:20.391983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":415,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'54","reported_seq":97,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612670+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:59:28.612670+0000","last_peered":"2024-04-20T10:59:28.612670+0000","last_clean":"2024-04-20T10:59:28.612670+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:59:28.612670+0000","last_undegraded":"2024-04-20T10:59:28.612670+0000","last_fullsized":"2024-04-20T10:59:28.612670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"38'386","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648828+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:59:28.648828+0000","last_peered":"2024-04-20T10:59:28.648828+0000","last_clean":"2024-04-20T10:59:28.648828+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:59:28.648828+0000","last_undegraded":"2024-04-20T10:59:28.648828+0000","last_fullsized":"2024-04-20T10:59:28.648828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":51447,"num_write":355,"num_write_kb":79846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'408","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391303+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:59:20.391303+0000","last_peered":"2024-04-20T10:59:20.391303+0000","last_clean":"2024-04-20T10:59:20.391303+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:59:20.391303+0000","last_undegraded":"2024-04-20T10:59:20.391303+0000","last_fullsized":"2024-04-20T10:59:20.391303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":28672,"num_write":368,"num_write_kb":66779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'260","reported_seq":313,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392032+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:59:20.392032+0000","last_peered":"2024-04-20T10:59:20.392032+0000","last_clean":"2024-04-20T10:59:20.392032+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:59:20.392032+0000","last_undegraded":"2024-04-20T10:59:20.392032+0000","last_fullsized":"2024-04-20T10:59:20.392032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":207,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"38'292","reported_seq":344,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644447+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:59:28.644447+0000","last_peered":"2024-04-20T10:59:28.644447+0000","last_clean":"2024-04-20T10:59:28.644447+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:59:28.644447+0000","last_undegraded":"2024-04-20T10:59:28.644447+0000","last_fullsized":"2024-04-20T10:59:28.644447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":243,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"38'417","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401200+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:59:30.401200+0000","last_peered":"2024-04-20T10:59:30.401200+0000","last_clean":"2024-04-20T10:59:30.401200+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:59:30.401200+0000","last_undegraded":"2024-04-20T10:59:30.401200+0000","last_fullsized":"2024-04-20T10:59:30.401200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":59672,"num_write":383,"num_write_kb":87983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"38'464","reported_seq":618,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399563+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:59:23.399563+0000","last_peered":"2024-04-20T10:59:23.399563+0000","last_clean":"2024-04-20T10:59:23.399563+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:59:23.399563+0000","last_undegraded":"2024-04-20T10:59:23.399563+0000","last_fullsized":"2024-04-20T10:59:23.399563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":46635,"num_write":434,"num_write_kb":47131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'429","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391034+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:59:20.391034+0000","last_peered":"2024-04-20T10:59:20.391034+0000","last_clean":"2024-04-20T10:59:20.391034+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:59:20.391034+0000","last_undegraded":"2024-04-20T10:59:20.391034+0000","last_fullsized":"2024-04-20T10:59:20.391034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":373,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'505","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.682919+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:59:21.682919+0000","last_peered":"2024-04-20T10:59:21.682919+0000","last_clean":"2024-04-20T10:59:21.682919+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:59:21.682919+0000","last_undegraded":"2024-04-20T10:59:21.682919+0000","last_fullsized":"2024-04-20T10:59:21.682919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":12324,"num_write":451,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"38'428","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389966+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:59:20.389966+0000","last_peered":"2024-04-20T10:59:20.389966+0000","last_clean":"2024-04-20T10:59:20.389966+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:59:20.389966+0000","last_undegraded":"2024-04-20T10:59:20.389966+0000","last_fullsized":"2024-04-20T10:59:20.389966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70222,"num_write":390,"num_write_kb":75460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"38'430","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408714+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:59:23.408714+0000","last_peered":"2024-04-20T10:59:23.408714+0000","last_clean":"2024-04-20T10:59:23.408714+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:59:23.408714+0000","last_undegraded":"2024-04-20T10:59:23.408714+0000","last_fullsized":"2024-04-20T10:59:23.408714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":26226,"num_write":396,"num_write_kb":42836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"38'177","reported_seq":238,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.142667+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:59:31.142667+0000","last_peered":"2024-04-20T10:59:31.142667+0000","last_clean":"2024-04-20T10:59:31.142667+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:59:31.142667+0000","last_undegraded":"2024-04-20T10:59:31.142667+0000","last_fullsized":"2024-04-20T10:59:31.142667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2765447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":2215,"num_write":121,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"38'354","reported_seq":681,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.399438+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:59:36.399438+0000","last_peered":"2024-04-20T10:59:36.399438+0000","last_clean":"2024-04-20T10:59:36.399438+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:59:36.399438+0000","last_undegraded":"2024-04-20T10:59:36.399438+0000","last_fullsized":"2024-04-20T10:59:36.399438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465101,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":1621,"num_write":296,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'403","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635967+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:59:28.635967+0000","last_peered":"2024-04-20T10:59:28.635967+0000","last_clean":"2024-04-20T10:59:28.635967+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:59:28.635967+0000","last_undegraded":"2024-04-20T10:59:28.635967+0000","last_fullsized":"2024-04-20T10:59:28.635967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":84919,"num_write":363,"num_write_kb":88226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"38'351","reported_seq":485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.747469+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:59:21.747469+0000","last_peered":"2024-04-20T10:59:21.747469+0000","last_clean":"2024-04-20T10:59:21.747469+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:59:21.747469+0000","last_undegraded":"2024-04-20T10:59:21.747469+0000","last_fullsized":"2024-04-20T10:59:21.747469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":41830,"num_write":332,"num_write_kb":50578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"38'367","reported_seq":429,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.382070+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:59:31.382070+0000","last_peered":"2024-04-20T10:59:31.382070+0000","last_clean":"2024-04-20T10:59:31.382070+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:59:31.382070+0000","last_undegraded":"2024-04-20T10:59:31.382070+0000","last_fullsized":"2024-04-20T10:59:31.382070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":432,"num_write":705,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"38'199","reported_seq":256,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:25.551371+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:59:25.551371+0000","last_peered":"2024-04-20T10:59:25.551371+0000","last_clean":"2024-04-20T10:59:25.551371+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:59:25.551371+0000","last_undegraded":"2024-04-20T10:59:25.551371+0000","last_fullsized":"2024-04-20T10:59:25.551371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":41717,"num_write":141,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"38'382","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.634547+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:59:28.634547+0000","last_peered":"2024-04-20T10:59:28.634547+0000","last_clean":"2024-04-20T10:59:28.634547+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:59:28.634547+0000","last_undegraded":"2024-04-20T10:59:28.634547+0000","last_fullsized":"2024-04-20T10:59:28.634547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36954,"num_write":352,"num_write_kb":63166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"38'440","reported_seq":587,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391402+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:59:20.391402+0000","last_peered":"2024-04-20T10:59:20.391402+0000","last_clean":"2024-04-20T10:59:20.391402+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:59:20.391402+0000","last_undegraded":"2024-04-20T10:59:20.391402+0000","last_fullsized":"2024-04-20T10:59:20.391402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":92391,"num_write":411,"num_write_kb":121276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'116","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393763+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:59:20.393763+0000","last_peered":"2024-04-20T10:59:20.393763+0000","last_clean":"2024-04-20T10:59:20.393763+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:59:20.393763+0000","last_undegraded":"2024-04-20T10:59:20.393763+0000","last_fullsized":"2024-04-20T10:59:20.393763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":47,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"38'72","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621376+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:59:28.621376+0000","last_peered":"2024-04-20T10:59:28.621376+0000","last_clean":"2024-04-20T10:59:28.621376+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:59:28.621376+0000","last_undegraded":"2024-04-20T10:59:28.621376+0000","last_fullsized":"2024-04-20T10:59:28.621376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"38'388","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.638445+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:59:28.638445+0000","last_peered":"2024-04-20T10:59:28.638445+0000","last_clean":"2024-04-20T10:59:28.638445+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:59:28.638445+0000","last_undegraded":"2024-04-20T10:59:28.638445+0000","last_fullsized":"2024-04-20T10:59:28.638445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":31459,"num_write":347,"num_write_kb":38414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"38'421","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406112+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:59:23.406112+0000","last_peered":"2024-04-20T10:59:23.406112+0000","last_clean":"2024-04-20T10:59:23.406112+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:59:23.406112+0000","last_undegraded":"2024-04-20T10:59:23.406112+0000","last_fullsized":"2024-04-20T10:59:23.406112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":53960,"num_write":380,"num_write_kb":46448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"37'59","reported_seq":111,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391821+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:59:20.391821+0000","last_peered":"2024-04-20T10:59:20.391821+0000","last_clean":"2024-04-20T10:59:20.391821+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:59:20.391821+0000","last_undegraded":"2024-04-20T10:59:20.391821+0000","last_fullsized":"2024-04-20T10:59:20.391821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'621","reported_seq":677,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.626958+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:59:20.626958+0000","last_peered":"2024-04-20T10:59:20.626958+0000","last_clean":"2024-04-20T10:59:20.626958+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:59:20.626958+0000","last_undegraded":"2024-04-20T10:59:20.626958+0000","last_fullsized":"2024-04-20T10:59:20.626958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":37014,"num_write":557,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"38'440","reported_seq":575,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405359+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:59:30.405359+0000","last_peered":"2024-04-20T10:59:30.405359+0000","last_clean":"2024-04-20T10:59:30.405359+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:59:30.405359+0000","last_undegraded":"2024-04-20T10:59:30.405359+0000","last_fullsized":"2024-04-20T10:59:30.405359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":72557,"num_write":399,"num_write_kb":79896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"37'409","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388343+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:59:20.388343+0000","last_peered":"2024-04-20T10:59:20.388343+0000","last_clean":"2024-04-20T10:59:20.388343+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:59:20.388343+0000","last_undegraded":"2024-04-20T10:59:20.388343+0000","last_fullsized":"2024-04-20T10:59:20.388343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69573,"num_write":375,"num_write_kb":88218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'601","reported_seq":659,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394008+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:59:20.394008+0000","last_peered":"2024-04-20T10:59:20.394008+0000","last_clean":"2024-04-20T10:59:20.394008+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:59:20.394008+0000","last_undegraded":"2024-04-20T10:59:20.394008+0000","last_fullsized":"2024-04-20T10:59:20.394008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":551,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"38'74","reported_seq":119,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390879+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:59:20.390879+0000","last_peered":"2024-04-20T10:59:20.390879+0000","last_clean":"2024-04-20T10:59:20.390879+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:59:20.390879+0000","last_undegraded":"2024-04-20T10:59:20.390879+0000","last_fullsized":"2024-04-20T10:59:20.390879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"38'423","reported_seq":553,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410970+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:59:30.410970+0000","last_peered":"2024-04-20T10:59:30.410970+0000","last_clean":"2024-04-20T10:59:30.410970+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:59:30.410970+0000","last_undegraded":"2024-04-20T10:59:30.410970+0000","last_fullsized":"2024-04-20T10:59:30.410970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56610,"num_write":400,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'384","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389823+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:59:20.389823+0000","last_peered":"2024-04-20T10:59:20.389823+0000","last_clean":"2024-04-20T10:59:20.389823+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:59:20.389823+0000","last_undegraded":"2024-04-20T10:59:20.389823+0000","last_fullsized":"2024-04-20T10:59:20.389823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":325,"num_write":350,"num_write_kb":17356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"38'354","reported_seq":699,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:34.398923+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:59:34.398923+0000","last_peered":"2024-04-20T10:59:34.398923+0000","last_clean":"2024-04-20T10:59:34.398923+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:59:34.398923+0000","last_undegraded":"2024-04-20T10:59:34.398923+0000","last_fullsized":"2024-04-20T10:59:34.398923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":293,"num_read_kb":1639,"num_write":299,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"38'135","reported_seq":190,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.401719+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:59:36.401719+0000","last_peered":"2024-04-20T10:59:36.401719+0000","last_clean":"2024-04-20T10:59:36.401719+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:59:36.401719+0000","last_undegraded":"2024-04-20T10:59:36.401719+0000","last_fullsized":"2024-04-20T10:59:36.401719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":994,"num_write":82,"num_write_kb":1558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'363","reported_seq":473,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405073+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:59:30.405073+0000","last_peered":"2024-04-20T10:59:30.405073+0000","last_clean":"2024-04-20T10:59:30.405073+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:59:30.405073+0000","last_undegraded":"2024-04-20T10:59:30.405073+0000","last_fullsized":"2024-04-20T10:59:30.405073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56669,"num_write":337,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"38'414","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386329+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:59:20.386329+0000","last_peered":"2024-04-20T10:59:20.386329+0000","last_clean":"2024-04-20T10:59:20.386329+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:59:20.386329+0000","last_undegraded":"2024-04-20T10:59:20.386329+0000","last_fullsized":"2024-04-20T10:59:20.386329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":100333,"num_write":376,"num_write_kb":104385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"37'123","reported_seq":184,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390747+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:59:20.390747+0000","last_peered":"2024-04-20T10:59:20.390747+0000","last_clean":"2024-04-20T10:59:20.390747+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:59:20.390747+0000","last_undegraded":"2024-04-20T10:59:20.390747+0000","last_fullsized":"2024-04-20T10:59:20.390747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":57,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"38'366","reported_seq":421,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.838351+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:59:31.838351+0000","last_peered":"2024-04-20T10:59:31.838351+0000","last_clean":"2024-04-20T10:59:31.838351+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:59:31.838351+0000","last_undegraded":"2024-04-20T10:59:31.838351+0000","last_fullsized":"2024-04-20T10:59:31.838351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":373,"num_write":704,"num_write_kb":1825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"38'374","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645982+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:59:28.645982+0000","last_peered":"2024-04-20T10:59:28.645982+0000","last_clean":"2024-04-20T10:59:28.645982+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:59:28.645982+0000","last_undegraded":"2024-04-20T10:59:28.645982+0000","last_fullsized":"2024-04-20T10:59:28.645982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23979,"num_write":342,"num_write_kb":50629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"38'375","reported_seq":496,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394982+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:59:20.394982+0000","last_peered":"2024-04-20T10:59:20.394982+0000","last_clean":"2024-04-20T10:59:20.394982+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:59:20.394982+0000","last_undegraded":"2024-04-20T10:59:20.394982+0000","last_fullsized":"2024-04-20T10:59:20.394982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32768,"num_write":345,"num_write_kb":58807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"38'72","reported_seq":124,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392162+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:59:20.392162+0000","last_peered":"2024-04-20T10:59:20.392162+0000","last_clean":"2024-04-20T10:59:20.392162+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:59:20.392162+0000","last_undegraded":"2024-04-20T10:59:20.392162+0000","last_fullsized":"2024-04-20T10:59:20.392162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391430+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:59:20.391430+0000","last_peered":"2024-04-20T10:59:20.391430+0000","last_clean":"2024-04-20T10:59:20.391430+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:59:20.391430+0000","last_undegraded":"2024-04-20T10:59:20.391430+0000","last_fullsized":"2024-04-20T10:59:20.391430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"38'102","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:25.550993+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:59:25.550993+0000","last_peered":"2024-04-20T10:59:25.550993+0000","last_clean":"2024-04-20T10:59:25.550993+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:59:25.550993+0000","last_undegraded":"2024-04-20T10:59:25.550993+0000","last_fullsized":"2024-04-20T10:59:25.550993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"38'445","reported_seq":578,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380835+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:59:20.380835+0000","last_peered":"2024-04-20T10:59:20.380835+0000","last_clean":"2024-04-20T10:59:20.380835+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:59:20.380835+0000","last_undegraded":"2024-04-20T10:59:20.380835+0000","last_fullsized":"2024-04-20T10:59:20.380835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":88903,"num_write":409,"num_write_kb":92640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'412","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392902+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:59:20.392902+0000","last_peered":"2024-04-20T10:59:20.392902+0000","last_clean":"2024-04-20T10:59:20.392902+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:59:20.392902+0000","last_undegraded":"2024-04-20T10:59:20.392902+0000","last_fullsized":"2024-04-20T10:59:20.392902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53899,"num_write":383,"num_write_kb":39701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"37'57","reported_seq":109,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381980+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:59:20.381980+0000","last_peered":"2024-04-20T10:59:20.381980+0000","last_clean":"2024-04-20T10:59:20.381980+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:59:20.381980+0000","last_undegraded":"2024-04-20T10:59:20.381980+0000","last_fullsized":"2024-04-20T10:59:20.381980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'249","reported_seq":297,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.168615+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:59:22.168615+0000","last_peered":"2024-04-20T10:59:22.168615+0000","last_clean":"2024-04-20T10:59:22.168615+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:59:22.168615+0000","last_undegraded":"2024-04-20T10:59:22.168615+0000","last_fullsized":"2024-04-20T10:59:22.168615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":11663,"num_write":185,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"38'444","reported_seq":573,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.409848+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:59:30.409848+0000","last_peered":"2024-04-20T10:59:30.409848+0000","last_clean":"2024-04-20T10:59:30.409848+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:59:30.409848+0000","last_undegraded":"2024-04-20T10:59:30.409848+0000","last_fullsized":"2024-04-20T10:59:30.409848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":74093,"num_write":415,"num_write_kb":112646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"38'451","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409601+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:59:23.409601+0000","last_peered":"2024-04-20T10:59:23.409601+0000","last_clean":"2024-04-20T10:59:23.409601+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:59:23.409601+0000","last_undegraded":"2024-04-20T10:59:23.409601+0000","last_fullsized":"2024-04-20T10:59:23.409601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":13128,"num_write":408,"num_write_kb":42612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'466","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395060+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:59:20.395060+0000","last_peered":"2024-04-20T10:59:20.395060+0000","last_clean":"2024-04-20T10:59:20.395060+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:59:20.395060+0000","last_undegraded":"2024-04-20T10:59:20.395060+0000","last_fullsized":"2024-04-20T10:59:20.395060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12293,"num_write":417,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"38'254","reported_seq":311,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.379543+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:59:22.379543+0000","last_peered":"2024-04-20T10:59:22.379543+0000","last_clean":"2024-04-20T10:59:22.379543+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:59:22.379543+0000","last_undegraded":"2024-04-20T10:59:22.379543+0000","last_fullsized":"2024-04-20T10:59:22.379543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":192,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"38'448","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405455+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:59:30.405455+0000","last_peered":"2024-04-20T10:59:30.405455+0000","last_clean":"2024-04-20T10:59:30.405455+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:59:30.405455+0000","last_undegraded":"2024-04-20T10:59:30.405455+0000","last_fullsized":"2024-04-20T10:59:30.405455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28672,"num_write":415,"num_write_kb":38311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"38'377","reported_seq":509,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403988+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:59:23.403988+0000","last_peered":"2024-04-20T10:59:23.403988+0000","last_clean":"2024-04-20T10:59:23.403988+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:59:23.403988+0000","last_undegraded":"2024-04-20T10:59:23.403988+0000","last_fullsized":"2024-04-20T10:59:23.403988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":24736,"num_write":347,"num_write_kb":38102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'415","reported_seq":477,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382204+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:59:20.382204+0000","last_peered":"2024-04-20T10:59:20.382204+0000","last_clean":"2024-04-20T10:59:20.382204+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:59:20.382204+0000","last_undegraded":"2024-04-20T10:59:20.382204+0000","last_fullsized":"2024-04-20T10:59:20.382204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":12309,"num_write":370,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"38'499","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645869+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:59:28.645869+0000","last_peered":"2024-04-20T10:59:28.645869+0000","last_clean":"2024-04-20T10:59:28.645869+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:59:28.645869+0000","last_undegraded":"2024-04-20T10:59:28.645869+0000","last_fullsized":"2024-04-20T10:59:28.645869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":443,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"38'402","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.638499+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:59:28.638499+0000","last_peered":"2024-04-20T10:59:28.638499+0000","last_clean":"2024-04-20T10:59:28.638499+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:59:28.638499+0000","last_undegraded":"2024-04-20T10:59:28.638499+0000","last_fullsized":"2024-04-20T10:59:28.638499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56962,"num_write":365,"num_write_kb":46837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"38'375","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410908+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:59:23.410908+0000","last_peered":"2024-04-20T10:59:23.410908+0000","last_clean":"2024-04-20T10:59:23.410908+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:59:23.410908+0000","last_undegraded":"2024-04-20T10:59:23.410908+0000","last_fullsized":"2024-04-20T10:59:23.410908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":12893,"num_write":338,"num_write_kb":54469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"38'678","reported_seq":737,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404745+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:59:23.404745+0000","last_peered":"2024-04-20T10:59:23.404745+0000","last_clean":"2024-04-20T10:59:23.404745+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:59:23.404745+0000","last_undegraded":"2024-04-20T10:59:23.404745+0000","last_fullsized":"2024-04-20T10:59:23.404745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":626,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'248","reported_seq":294,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.699927+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:59:23.699927+0000","last_peered":"2024-04-20T10:59:23.699927+0000","last_clean":"2024-04-20T10:59:23.699927+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:59:23.699927+0000","last_undegraded":"2024-04-20T10:59:23.699927+0000","last_fullsized":"2024-04-20T10:59:23.699927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":197,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"38'396","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.614014+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:59:28.614014+0000","last_peered":"2024-04-20T10:59:28.614014+0000","last_clean":"2024-04-20T10:59:28.614014+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:59:28.614014+0000","last_undegraded":"2024-04-20T10:59:28.614014+0000","last_fullsized":"2024-04-20T10:59:28.614014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27222,"num_write":365,"num_write_kb":63558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"38'485","reported_seq":639,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404048+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:59:23.404048+0000","last_peered":"2024-04-20T10:59:23.404048+0000","last_clean":"2024-04-20T10:59:23.404048+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:59:23.404048+0000","last_undegraded":"2024-04-20T10:59:23.404048+0000","last_fullsized":"2024-04-20T10:59:23.404048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":79269,"num_write":451,"num_write_kb":100665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"38'417","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409150+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:59:23.409150+0000","last_peered":"2024-04-20T10:59:23.409150+0000","last_clean":"2024-04-20T10:59:23.409150+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:59:23.409150+0000","last_undegraded":"2024-04-20T10:59:23.409150+0000","last_fullsized":"2024-04-20T10:59:23.409150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":8276,"num_write":372,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"38'124","reported_seq":172,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.613412+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:59:28.613412+0000","last_peered":"2024-04-20T10:59:28.613412+0000","last_clean":"2024-04-20T10:59:28.613412+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:59:28.613412+0000","last_undegraded":"2024-04-20T10:59:28.613412+0000","last_fullsized":"2024-04-20T10:59:28.613412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12306,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"38'439","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621872+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:59:28.621872+0000","last_peered":"2024-04-20T10:59:28.621872+0000","last_clean":"2024-04-20T10:59:28.621872+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:59:28.621872+0000","last_undegraded":"2024-04-20T10:59:28.621872+0000","last_fullsized":"2024-04-20T10:59:28.621872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":73928,"num_write":402,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"38'444","reported_seq":609,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381611+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:59:20.381611+0000","last_peered":"2024-04-20T10:59:20.381611+0000","last_clean":"2024-04-20T10:59:20.381611+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:59:20.381611+0000","last_undegraded":"2024-04-20T10:59:20.381611+0000","last_fullsized":"2024-04-20T10:59:20.381611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":47645,"num_write":412,"num_write_kb":63928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'71","reported_seq":122,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382049+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:59:20.382049+0000","last_peered":"2024-04-20T10:59:20.382049+0000","last_clean":"2024-04-20T10:59:20.382049+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:59:20.382049+0000","last_undegraded":"2024-04-20T10:59:20.382049+0000","last_fullsized":"2024-04-20T10:59:20.382049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"38'64","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.599721+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:59:28.599721+0000","last_peered":"2024-04-20T10:59:28.599721+0000","last_clean":"2024-04-20T10:59:28.599721+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:59:28.599721+0000","last_undegraded":"2024-04-20T10:59:28.599721+0000","last_fullsized":"2024-04-20T10:59:28.599721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"38'417","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405132+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:59:30.405132+0000","last_peered":"2024-04-20T10:59:30.405132+0000","last_clean":"2024-04-20T10:59:30.405132+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:59:30.405132+0000","last_undegraded":"2024-04-20T10:59:30.405132+0000","last_fullsized":"2024-04-20T10:59:30.405132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":100636,"num_write":369,"num_write_kb":112428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"38'400","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391000+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:59:20.391000+0000","last_peered":"2024-04-20T10:59:20.391000+0000","last_clean":"2024-04-20T10:59:20.391000+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:59:20.391000+0000","last_undegraded":"2024-04-20T10:59:20.391000+0000","last_fullsized":"2024-04-20T10:59:20.391000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":45758,"num_write":374,"num_write_kb":77972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"38'70","reported_seq":121,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410476+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:59:23.410476+0000","last_peered":"2024-04-20T10:59:23.410476+0000","last_clean":"2024-04-20T10:59:23.410476+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:59:23.410476+0000","last_undegraded":"2024-04-20T10:59:23.410476+0000","last_fullsized":"2024-04-20T10:59:23.410476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"38'515","reported_seq":589,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.607025+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:59:28.607025+0000","last_peered":"2024-04-20T10:59:28.607025+0000","last_clean":"2024-04-20T10:59:28.607025+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:59:28.607025+0000","last_undegraded":"2024-04-20T10:59:28.607025+0000","last_fullsized":"2024-04-20T10:59:28.607025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":32813,"num_write":465,"num_write_kb":12552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"38'400","reported_seq":517,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641744+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:59:28.641744+0000","last_peered":"2024-04-20T10:59:28.641744+0000","last_clean":"2024-04-20T10:59:28.641744+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:59:28.641744+0000","last_undegraded":"2024-04-20T10:59:28.641744+0000","last_fullsized":"2024-04-20T10:59:28.641744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":57869,"num_write":367,"num_write_kb":80191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"38'424","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407502+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:59:23.407502+0000","last_peered":"2024-04-20T10:59:23.407502+0000","last_clean":"2024-04-20T10:59:23.407502+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:59:23.407502+0000","last_undegraded":"2024-04-20T10:59:23.407502+0000","last_fullsized":"2024-04-20T10:59:23.407502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62334,"num_write":402,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'166","reported_seq":233,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388592+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:59:20.388592+0000","last_peered":"2024-04-20T10:59:20.388592+0000","last_clean":"2024-04-20T10:59:20.388592+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:59:20.388592+0000","last_undegraded":"2024-04-20T10:59:20.388592+0000","last_fullsized":"2024-04-20T10:59:20.388592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":24616,"num_write":112,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"38'322","reported_seq":381,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.414032+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:59:30.414032+0000","last_peered":"2024-04-20T10:59:30.414032+0000","last_clean":"2024-04-20T10:59:30.414032+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:59:30.414032+0000","last_undegraded":"2024-04-20T10:59:30.414032+0000","last_fullsized":"2024-04-20T10:59:30.414032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":278,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"38'376","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633687+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:59:28.633687+0000","last_peered":"2024-04-20T10:59:28.633687+0000","last_clean":"2024-04-20T10:59:28.633687+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:59:28.633687+0000","last_undegraded":"2024-04-20T10:59:28.633687+0000","last_fullsized":"2024-04-20T10:59:28.633687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":25860,"num_write":345,"num_write_kb":47542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"38'388","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402878+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:59:23.402878+0000","last_peered":"2024-04-20T10:59:23.402878+0000","last_clean":"2024-04-20T10:59:23.402878+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:59:23.402878+0000","last_undegraded":"2024-04-20T10:59:23.402878+0000","last_fullsized":"2024-04-20T10:59:23.402878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":29836,"num_write":343,"num_write_kb":67451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"38'576","reported_seq":656,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383078+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:59:20.383078+0000","last_peered":"2024-04-20T10:59:20.383078+0000","last_clean":"2024-04-20T10:59:20.383078+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:59:20.383078+0000","last_undegraded":"2024-04-20T10:59:20.383078+0000","last_fullsized":"2024-04-20T10:59:20.383078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35988,"num_write":517,"num_write_kb":12589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"38'65","reported_seq":108,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412464+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:59:30.412464+0000","last_peered":"2024-04-20T10:59:30.412464+0000","last_clean":"2024-04-20T10:59:30.412464+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:59:30.412464+0000","last_undegraded":"2024-04-20T10:59:30.412464+0000","last_fullsized":"2024-04-20T10:59:30.412464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"38'406","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410400+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:59:30.410400+0000","last_peered":"2024-04-20T10:59:30.410400+0000","last_clean":"2024-04-20T10:59:30.410400+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:59:30.410400+0000","last_undegraded":"2024-04-20T10:59:30.410400+0000","last_fullsized":"2024-04-20T10:59:30.410400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":74646,"num_write":381,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'380","reported_seq":517,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387972+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:59:20.387972+0000","last_peered":"2024-04-20T10:59:20.387972+0000","last_clean":"2024-04-20T10:59:20.387972+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:59:20.387972+0000","last_undegraded":"2024-04-20T10:59:20.387972+0000","last_fullsized":"2024-04-20T10:59:20.387972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61041,"num_write":349,"num_write_kb":58639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"38'332","reported_seq":396,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:24.130660+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:59:24.130660+0000","last_peered":"2024-04-20T10:59:24.130660+0000","last_clean":"2024-04-20T10:59:24.130660+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:59:24.130660+0000","last_undegraded":"2024-04-20T10:59:24.130660+0000","last_fullsized":"2024-04-20T10:59:24.130660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":4122,"num_write":282,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'149","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.899565+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:59:20.899565+0000","last_peered":"2024-04-20T10:59:20.899565+0000","last_clean":"2024-04-20T10:59:20.899565+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:59:20.899565+0000","last_undegraded":"2024-04-20T10:59:20.899565+0000","last_fullsized":"2024-04-20T10:59:20.899565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":45111,"num_write":81,"num_write_kb":8263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"38'468","reported_seq":597,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405389+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:59:30.405389+0000","last_peered":"2024-04-20T10:59:30.405389+0000","last_clean":"2024-04-20T10:59:30.405389+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:59:30.405389+0000","last_undegraded":"2024-04-20T10:59:30.405389+0000","last_fullsized":"2024-04-20T10:59:30.405389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":50494,"num_write":431,"num_write_kb":38868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"37'379","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386809+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:59:20.386809+0000","last_peered":"2024-04-20T10:59:20.386809+0000","last_clean":"2024-04-20T10:59:20.386809+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:59:20.386809+0000","last_undegraded":"2024-04-20T10:59:20.386809+0000","last_fullsized":"2024-04-20T10:59:20.386809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":58132,"num_write":347,"num_write_kb":59251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"37'174","reported_seq":226,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393492+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:59:20.393492+0000","last_peered":"2024-04-20T10:59:20.393492+0000","last_clean":"2024-04-20T10:59:20.393492+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:59:20.393492+0000","last_undegraded":"2024-04-20T10:59:20.393492+0000","last_fullsized":"2024-04-20T10:59:20.393492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":116,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"38'452","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.584992+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:59:28.584992+0000","last_peered":"2024-04-20T10:59:28.584992+0000","last_clean":"2024-04-20T10:59:28.584992+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:59:28.584992+0000","last_undegraded":"2024-04-20T10:59:28.584992+0000","last_fullsized":"2024-04-20T10:59:28.584992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":8291,"num_write":401,"num_write_kb":8399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'436","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641887+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:59:28.641887+0000","last_peered":"2024-04-20T10:59:28.641887+0000","last_clean":"2024-04-20T10:59:28.641887+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:59:28.641887+0000","last_undegraded":"2024-04-20T10:59:28.641887+0000","last_fullsized":"2024-04-20T10:59:28.641887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":65641,"num_write":399,"num_write_kb":55375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"38'413","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392717+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:59:20.392717+0000","last_peered":"2024-04-20T10:59:20.392717+0000","last_clean":"2024-04-20T10:59:20.392717+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:59:20.392717+0000","last_undegraded":"2024-04-20T10:59:20.392717+0000","last_fullsized":"2024-04-20T10:59:20.392717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":35937,"num_write":378,"num_write_kb":46521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"37'65","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383939+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:59:20.383939+0000","last_peered":"2024-04-20T10:59:20.383939+0000","last_clean":"2024-04-20T10:59:20.383939+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:59:20.383939+0000","last_undegraded":"2024-04-20T10:59:20.383939+0000","last_fullsized":"2024-04-20T10:59:20.383939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'63","reported_seq":106,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392568+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:59:20.392568+0000","last_peered":"2024-04-20T10:59:20.392568+0000","last_clean":"2024-04-20T10:59:20.392568+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:59:20.392568+0000","last_undegraded":"2024-04-20T10:59:20.392568+0000","last_fullsized":"2024-04-20T10:59:20.392568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"38'364","reported_seq":462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636298+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:59:28.636298+0000","last_peered":"2024-04-20T10:59:28.636298+0000","last_clean":"2024-04-20T10:59:28.636298+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:59:28.636298+0000","last_undegraded":"2024-04-20T10:59:28.636298+0000","last_fullsized":"2024-04-20T10:59:28.636298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25276,"num_write":334,"num_write_kb":46079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'73","reported_seq":123,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387292+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:59:20.387292+0000","last_peered":"2024-04-20T10:59:20.387292+0000","last_clean":"2024-04-20T10:59:20.387292+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:59:20.387292+0000","last_undegraded":"2024-04-20T10:59:20.387292+0000","last_fullsized":"2024-04-20T10:59:20.387292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":32,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"38'418","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402123+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:59:23.402123+0000","last_peered":"2024-04-20T10:59:23.402123+0000","last_clean":"2024-04-20T10:59:23.402123+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:59:23.402123+0000","last_undegraded":"2024-04-20T10:59:23.402123+0000","last_fullsized":"2024-04-20T10:59:23.402123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":61851,"num_write":392,"num_write_kb":55373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"38'892","reported_seq":950,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392749+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:59:20.392749+0000","last_peered":"2024-04-20T10:59:20.392749+0000","last_clean":"2024-04-20T10:59:20.392749+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:59:20.392749+0000","last_undegraded":"2024-04-20T10:59:20.392749+0000","last_fullsized":"2024-04-20T10:59:20.392749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":834,"num_write_kb":8709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'413","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405817+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:59:30.405817+0000","last_peered":"2024-04-20T10:59:30.405817+0000","last_clean":"2024-04-20T10:59:30.405817+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:59:30.405817+0000","last_undegraded":"2024-04-20T10:59:30.405817+0000","last_fullsized":"2024-04-20T10:59:30.405817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49569,"num_write":377,"num_write_kb":64815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"38'54","reported_seq":115,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.556737+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:59:28.556737+0000","last_peered":"2024-04-20T10:59:28.556737+0000","last_clean":"2024-04-20T10:59:28.556737+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:59:28.556737+0000","last_undegraded":"2024-04-20T10:59:28.556737+0000","last_fullsized":"2024-04-20T10:59:28.556737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":8,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"38'435","reported_seq":554,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391278+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:59:20.391278+0000","last_peered":"2024-04-20T10:59:20.391278+0000","last_clean":"2024-04-20T10:59:20.391278+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:59:20.391278+0000","last_undegraded":"2024-04-20T10:59:20.391278+0000","last_fullsized":"2024-04-20T10:59:20.391278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26261,"num_write":400,"num_write_kb":42830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"38'220","reported_seq":272,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393663+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:59:20.393663+0000","last_peered":"2024-04-20T10:59:20.393663+0000","last_clean":"2024-04-20T10:59:20.393663+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:59:20.393663+0000","last_undegraded":"2024-04-20T10:59:20.393663+0000","last_fullsized":"2024-04-20T10:59:20.393663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":166,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"38'369","reported_seq":465,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.643876+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:59:28.643876+0000","last_peered":"2024-04-20T10:59:28.643876+0000","last_clean":"2024-04-20T10:59:28.643876+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:59:28.643876+0000","last_undegraded":"2024-04-20T10:59:28.643876+0000","last_fullsized":"2024-04-20T10:59:28.643876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31197,"num_write":338,"num_write_kb":64191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"36'448","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382658+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:59:20.382658+0000","last_peered":"2024-04-20T10:59:20.382658+0000","last_clean":"2024-04-20T10:59:20.382658+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:59:20.382658+0000","last_undegraded":"2024-04-20T10:59:20.382658+0000","last_fullsized":"2024-04-20T10:59:20.382658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":384,"num_write_kb":12501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'379","reported_seq":515,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388144+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:59:20.388144+0000","last_peered":"2024-04-20T10:59:20.388144+0000","last_clean":"2024-04-20T10:59:20.388144+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:59:20.388144+0000","last_undegraded":"2024-04-20T10:59:20.388144+0000","last_fullsized":"2024-04-20T10:59:20.388144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52177,"num_write":354,"num_write_kb":79739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"38'581","reported_seq":637,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.623970+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:59:28.623970+0000","last_peered":"2024-04-20T10:59:28.623970+0000","last_clean":"2024-04-20T10:59:28.623970+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:59:28.623970+0000","last_undegraded":"2024-04-20T10:59:28.623970+0000","last_fullsized":"2024-04-20T10:59:28.623970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":12318,"num_write":526,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"38'403","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636902+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:59:28.636902+0000","last_peered":"2024-04-20T10:59:28.636902+0000","last_clean":"2024-04-20T10:59:28.636902+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:59:28.636902+0000","last_undegraded":"2024-04-20T10:59:28.636902+0000","last_fullsized":"2024-04-20T10:59:28.636902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":104331,"num_write":376,"num_write_kb":109020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"36'181","reported_seq":237,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392436+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:59:20.392436+0000","last_peered":"2024-04-20T10:59:20.392436+0000","last_clean":"2024-04-20T10:59:20.392436+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:59:20.392436+0000","last_undegraded":"2024-04-20T10:59:20.392436+0000","last_fullsized":"2024-04-20T10:59:20.392436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":124,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'410","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386887+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:59:20.386887+0000","last_peered":"2024-04-20T10:59:20.386887+0000","last_clean":"2024-04-20T10:59:20.386887+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:59:20.386887+0000","last_undegraded":"2024-04-20T10:59:20.386887+0000","last_fullsized":"2024-04-20T10:59:20.386887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56637,"num_write":377,"num_write_kb":62852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"38'546","reported_seq":612,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.627865+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:59:28.627865+0000","last_peered":"2024-04-20T10:59:28.627865+0000","last_clean":"2024-04-20T10:59:28.627865+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:59:28.627865+0000","last_undegraded":"2024-04-20T10:59:28.627865+0000","last_fullsized":"2024-04-20T10:59:28.627865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":57371,"num_write":468,"num_write_kb":12517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"38'472","reported_seq":608,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401711+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:59:30.401711+0000","last_peered":"2024-04-20T10:59:30.401711+0000","last_clean":"2024-04-20T10:59:30.401711+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:59:30.401711+0000","last_undegraded":"2024-04-20T10:59:30.401711+0000","last_fullsized":"2024-04-20T10:59:30.401711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":77683,"num_write":435,"num_write_kb":89005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"38'421","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381481+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:59:20.381481+0000","last_peered":"2024-04-20T10:59:20.381481+0000","last_clean":"2024-04-20T10:59:20.381481+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:59:20.381481+0000","last_undegraded":"2024-04-20T10:59:20.381481+0000","last_fullsized":"2024-04-20T10:59:20.381481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":50143,"num_write":396,"num_write_kb":67741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"38'423","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.406726+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:59:30.406726+0000","last_peered":"2024-04-20T10:59:30.406726+0000","last_clean":"2024-04-20T10:59:30.406726+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:59:30.406726+0000","last_undegraded":"2024-04-20T10:59:30.406726+0000","last_fullsized":"2024-04-20T10:59:30.406726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66334,"num_write":397,"num_write_kb":71356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"38'448","reported_seq":602,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380185+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:59:20.380185+0000","last_peered":"2024-04-20T10:59:20.380185+0000","last_clean":"2024-04-20T10:59:20.380185+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:59:20.380185+0000","last_undegraded":"2024-04-20T10:59:20.380185+0000","last_fullsized":"2024-04-20T10:59:20.380185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":105081,"num_write":414,"num_write_kb":80164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"38'397","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410925+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:59:30.410925+0000","last_peered":"2024-04-20T10:59:30.410925+0000","last_clean":"2024-04-20T10:59:30.410925+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:59:30.410925+0000","last_undegraded":"2024-04-20T10:59:30.410925+0000","last_fullsized":"2024-04-20T10:59:30.410925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":91923,"num_write":367,"num_write_kb":80227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"38'487","reported_seq":649,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395042+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:59:20.395042+0000","last_peered":"2024-04-20T10:59:20.395042+0000","last_clean":"2024-04-20T10:59:20.395042+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:59:20.395042+0000","last_undegraded":"2024-04-20T10:59:20.395042+0000","last_fullsized":"2024-04-20T10:59:20.395042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":66889,"num_write":452,"num_write_kb":101085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"38'390","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645512+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:59:28.645512+0000","last_peered":"2024-04-20T10:59:28.645512+0000","last_clean":"2024-04-20T10:59:28.645512+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:59:28.645512+0000","last_undegraded":"2024-04-20T10:59:28.645512+0000","last_fullsized":"2024-04-20T10:59:28.645512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":23315,"num_write":364,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"38'411","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401301+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:59:23.401301+0000","last_peered":"2024-04-20T10:59:23.401301+0000","last_clean":"2024-04-20T10:59:23.401301+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:59:23.401301+0000","last_undegraded":"2024-04-20T10:59:23.401301+0000","last_fullsized":"2024-04-20T10:59:23.401301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":34858,"num_write":375,"num_write_kb":71279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"38'438","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648687+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:59:28.648687+0000","last_peered":"2024-04-20T10:59:28.648687+0000","last_clean":"2024-04-20T10:59:28.648687+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:59:28.648687+0000","last_undegraded":"2024-04-20T10:59:28.648687+0000","last_fullsized":"2024-04-20T10:59:28.648687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":12465,"num_write":398,"num_write_kb":25863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"38'367","reported_seq":490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410600+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:59:23.410600+0000","last_peered":"2024-04-20T10:59:23.410600+0000","last_clean":"2024-04-20T10:59:23.410600+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:59:23.410600+0000","last_undegraded":"2024-04-20T10:59:23.410600+0000","last_fullsized":"2024-04-20T10:59:23.410600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40934,"num_write":339,"num_write_kb":54699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"38'400","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.400228+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:59:30.400228+0000","last_peered":"2024-04-20T10:59:30.400228+0000","last_clean":"2024-04-20T10:59:30.400228+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:59:30.400228+0000","last_undegraded":"2024-04-20T10:59:30.400228+0000","last_fullsized":"2024-04-20T10:59:30.400228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":17066,"num_write":365,"num_write_kb":46558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"37'404","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394135+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:59:20.394135+0000","last_peered":"2024-04-20T10:59:20.394135+0000","last_clean":"2024-04-20T10:59:20.394135+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:59:20.394135+0000","last_undegraded":"2024-04-20T10:59:20.394135+0000","last_fullsized":"2024-04-20T10:59:20.394135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64800,"num_write":371,"num_write_kb":91764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"38'402","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649072+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:59:28.649072+0000","last_peered":"2024-04-20T10:59:28.649072+0000","last_clean":"2024-04-20T10:59:28.649072+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:59:28.649072+0000","last_undegraded":"2024-04-20T10:59:28.649072+0000","last_fullsized":"2024-04-20T10:59:28.649072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1607,"num_write":370,"num_write_kb":5819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"38'433","reported_seq":570,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.735059+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:59:21.735059+0000","last_peered":"2024-04-20T10:59:21.735059+0000","last_clean":"2024-04-20T10:59:21.735059+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:59:21.735059+0000","last_undegraded":"2024-04-20T10:59:21.735059+0000","last_fullsized":"2024-04-20T10:59:21.735059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":4096,"num_write":399,"num_write_kb":30569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"38'439","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648218+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:59:28.648218+0000","last_peered":"2024-04-20T10:59:28.648218+0000","last_clean":"2024-04-20T10:59:28.648218+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:59:28.648218+0000","last_undegraded":"2024-04-20T10:59:28.648218+0000","last_fullsized":"2024-04-20T10:59:28.648218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":70131,"num_write":400,"num_write_kb":59168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"38'431","reported_seq":582,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.398797+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:59:23.398797+0000","last_peered":"2024-04-20T10:59:23.398797+0000","last_clean":"2024-04-20T10:59:23.398797+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:59:23.398797+0000","last_undegraded":"2024-04-20T10:59:23.398797+0000","last_fullsized":"2024-04-20T10:59:23.398797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":77347,"num_write":407,"num_write_kb":71895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"38'408","reported_seq":520,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411133+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:59:30.411133+0000","last_peered":"2024-04-20T10:59:30.411133+0000","last_clean":"2024-04-20T10:59:30.411133+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:59:30.411133+0000","last_undegraded":"2024-04-20T10:59:30.411133+0000","last_fullsized":"2024-04-20T10:59:30.411133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":43744,"num_write":370,"num_write_kb":63188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"38'456","reported_seq":613,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410206+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:59:23.410206+0000","last_peered":"2024-04-20T10:59:23.410206+0000","last_clean":"2024-04-20T10:59:23.410206+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:59:23.410206+0000","last_undegraded":"2024-04-20T10:59:23.410206+0000","last_fullsized":"2024-04-20T10:59:23.410206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63871,"num_write":428,"num_write_kb":100114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"38'419","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401609+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:59:30.401609+0000","last_peered":"2024-04-20T10:59:30.401609+0000","last_clean":"2024-04-20T10:59:30.401609+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:59:30.401609+0000","last_undegraded":"2024-04-20T10:59:30.401609+0000","last_fullsized":"2024-04-20T10:59:30.401609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":38962,"num_write":387,"num_write_kb":79793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"38'398","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401652+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:59:23.401652+0000","last_peered":"2024-04-20T10:59:23.401652+0000","last_clean":"2024-04-20T10:59:23.401652+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:59:23.401652+0000","last_undegraded":"2024-04-20T10:59:23.401652+0000","last_fullsized":"2024-04-20T10:59:23.401652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":27738,"num_write":360,"num_write_kb":54944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"38'458","reported_seq":577,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380662+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:59:20.380662+0000","last_peered":"2024-04-20T10:59:20.380662+0000","last_clean":"2024-04-20T10:59:20.380662+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:59:20.380662+0000","last_undegraded":"2024-04-20T10:59:20.380662+0000","last_fullsized":"2024-04-20T10:59:20.380662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":59920,"num_write":425,"num_write_kb":71046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"37'439","reported_seq":599,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392443+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:59:20.392443+0000","last_peered":"2024-04-20T10:59:20.392443+0000","last_clean":"2024-04-20T10:59:20.392443+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:59:20.392443+0000","last_undegraded":"2024-04-20T10:59:20.392443+0000","last_fullsized":"2024-04-20T10:59:20.392443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":95905,"num_write":408,"num_write_kb":92283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"38'434","reported_seq":561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.630311+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:59:28.630311+0000","last_peered":"2024-04-20T10:59:28.630311+0000","last_clean":"2024-04-20T10:59:28.630311+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:59:28.630311+0000","last_undegraded":"2024-04-20T10:59:28.630311+0000","last_fullsized":"2024-04-20T10:59:28.630311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66507,"num_write":387,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"38'427","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410629+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:59:23.410629+0000","last_peered":"2024-04-20T10:59:23.410629+0000","last_clean":"2024-04-20T10:59:23.410629+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:59:23.410629+0000","last_undegraded":"2024-04-20T10:59:23.410629+0000","last_fullsized":"2024-04-20T10:59:23.410629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":76500,"num_write":396,"num_write_kb":108707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"38'451","reported_seq":611,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644728+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:59:28.644728+0000","last_peered":"2024-04-20T10:59:28.644728+0000","last_clean":"2024-04-20T10:59:28.644728+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:59:28.644728+0000","last_undegraded":"2024-04-20T10:59:28.644728+0000","last_fullsized":"2024-04-20T10:59:28.644728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":149375,"num_write":423,"num_write_kb":104932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"36'447","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382311+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:59:20.382311+0000","last_peered":"2024-04-20T10:59:20.382311+0000","last_clean":"2024-04-20T10:59:20.382311+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:59:20.382311+0000","last_undegraded":"2024-04-20T10:59:20.382311+0000","last_fullsized":"2024-04-20T10:59:20.382311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":47044,"num_write":422,"num_write_kb":50901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"38'415","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644572+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:59:28.644572+0000","last_peered":"2024-04-20T10:59:28.644572+0000","last_clean":"2024-04-20T10:59:28.644572+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:59:28.644572+0000","last_undegraded":"2024-04-20T10:59:28.644572+0000","last_fullsized":"2024-04-20T10:59:28.644572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":91214,"num_write":375,"num_write_kb":63780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"37'461","reported_seq":625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393370+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:59:20.393370+0000","last_peered":"2024-04-20T10:59:20.393370+0000","last_clean":"2024-04-20T10:59:20.393370+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:59:20.393370+0000","last_undegraded":"2024-04-20T10:59:20.393370+0000","last_fullsized":"2024-04-20T10:59:20.393370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":88844,"num_write":432,"num_write_kb":122405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"38'475","reported_seq":632,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411714+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:59:30.411714+0000","last_peered":"2024-04-20T10:59:30.411714+0000","last_clean":"2024-04-20T10:59:30.411714+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:59:30.411714+0000","last_undegraded":"2024-04-20T10:59:30.411714+0000","last_fullsized":"2024-04-20T10:59:30.411714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":92351,"num_write":448,"num_write_kb":96949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"38'395","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408704+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:59:23.408704+0000","last_peered":"2024-04-20T10:59:23.408704+0000","last_clean":"2024-04-20T10:59:23.408704+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:59:23.408704+0000","last_undegraded":"2024-04-20T10:59:23.408704+0000","last_fullsized":"2024-04-20T10:59:23.408704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":19688,"num_write":355,"num_write_kb":13664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"38'415","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612674+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:59:28.612674+0000","last_peered":"2024-04-20T10:59:28.612674+0000","last_clean":"2024-04-20T10:59:28.612674+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:59:28.612674+0000","last_undegraded":"2024-04-20T10:59:28.612674+0000","last_fullsized":"2024-04-20T10:59:28.612674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":48111,"num_write":381,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"38'397","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399907+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:59:23.399907+0000","last_peered":"2024-04-20T10:59:23.399907+0000","last_clean":"2024-04-20T10:59:23.399907+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:59:23.399907+0000","last_undegraded":"2024-04-20T10:59:23.399907+0000","last_fullsized":"2024-04-20T10:59:23.399907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":17103,"num_write":369,"num_write_kb":54677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"38'400","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635768+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:59:28.635768+0000","last_peered":"2024-04-20T10:59:28.635768+0000","last_clean":"2024-04-20T10:59:28.635768+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:59:28.635768+0000","last_undegraded":"2024-04-20T10:59:28.635768+0000","last_fullsized":"2024-04-20T10:59:28.635768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":100212,"num_write":371,"num_write_kb":79700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"38'442","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399450+0000","last_change":"2024-04-20T10:51:20.873976+0000","last_active":"2024-04-20T10:59:23.399450+0000","last_peered":"2024-04-20T10:59:23.399450+0000","last_clean":"2024-04-20T10:59:23.399450+0000","last_became_active":"2024-04-20T10:51:20.873636+0000","last_became_peered":"2024-04-20T10:51:20.873636+0000","last_unstale":"2024-04-20T10:59:23.399450+0000","last_undegraded":"2024-04-20T10:59:23.399450+0000","last_fullsized":"2024-04-20T10:59:23.399450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:25:44.190342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42670,"num_write":410,"num_write_kb":59228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"38'412","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:29.333860+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:59:29.333860+0000","last_peered":"2024-04-20T10:59:29.333860+0000","last_clean":"2024-04-20T10:59:29.333860+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:59:29.333860+0000","last_undegraded":"2024-04-20T10:59:29.333860+0000","last_fullsized":"2024-04-20T10:59:29.333860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":47914,"num_write":385,"num_write_kb":47165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"38'402","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391617+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:59:20.391617+0000","last_peered":"2024-04-20T10:59:20.391617+0000","last_clean":"2024-04-20T10:59:20.391617+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:59:20.391617+0000","last_undegraded":"2024-04-20T10:59:20.391617+0000","last_fullsized":"2024-04-20T10:59:20.391617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":39185,"num_write":369,"num_write_kb":42800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"38'382","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.399818+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:59:30.399818+0000","last_peered":"2024-04-20T10:59:30.399818+0000","last_clean":"2024-04-20T10:59:30.399818+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:59:30.399818+0000","last_undegraded":"2024-04-20T10:59:30.399818+0000","last_fullsized":"2024-04-20T10:59:30.399818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":54933,"num_write":350,"num_write_kb":63813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"37'409","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386301+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:59:20.386301+0000","last_peered":"2024-04-20T10:59:20.386301+0000","last_clean":"2024-04-20T10:59:20.386301+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:59:20.386301+0000","last_undegraded":"2024-04-20T10:59:20.386301+0000","last_fullsized":"2024-04-20T10:59:20.386301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":25358,"num_write":380,"num_write_kb":59236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"38'401","reported_seq":510,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649095+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:59:28.649095+0000","last_peered":"2024-04-20T10:59:28.649095+0000","last_clean":"2024-04-20T10:59:28.649095+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:59:28.649095+0000","last_undegraded":"2024-04-20T10:59:28.649095+0000","last_fullsized":"2024-04-20T10:59:28.649095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":46490,"num_write":386,"num_write_kb":55187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"38'404","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391974+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:59:20.391974+0000","last_peered":"2024-04-20T10:59:20.391974+0000","last_clean":"2024-04-20T10:59:20.391974+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:59:20.391974+0000","last_undegraded":"2024-04-20T10:59:20.391974+0000","last_fullsized":"2024-04-20T10:59:20.391974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":60998,"num_write":371,"num_write_kb":104269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"38'390","reported_seq":492,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635398+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:59:28.635398+0000","last_peered":"2024-04-20T10:59:28.635398+0000","last_clean":"2024-04-20T10:59:28.635398+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:59:28.635398+0000","last_undegraded":"2024-04-20T10:59:28.635398+0000","last_fullsized":"2024-04-20T10:59:28.635398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":9157,"num_write":355,"num_write_kb":25794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"38'351","reported_seq":480,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399206+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:59:23.399206+0000","last_peered":"2024-04-20T10:59:23.399206+0000","last_clean":"2024-04-20T10:59:23.399206+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:59:23.399206+0000","last_undegraded":"2024-04-20T10:59:23.399206+0000","last_fullsized":"2024-04-20T10:59:23.399206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":63467,"num_write":328,"num_write_kb":42600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"38'381","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646486+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:59:28.646486+0000","last_peered":"2024-04-20T10:59:28.646486+0000","last_clean":"2024-04-20T10:59:28.646486+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:59:28.646486+0000","last_undegraded":"2024-04-20T10:59:28.646486+0000","last_fullsized":"2024-04-20T10:59:28.646486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":28672,"num_write":342,"num_write_kb":50404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"38'364","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383016+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:59:20.383016+0000","last_peered":"2024-04-20T10:59:20.383016+0000","last_clean":"2024-04-20T10:59:20.383016+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:59:20.383016+0000","last_undegraded":"2024-04-20T10:59:20.383016+0000","last_fullsized":"2024-04-20T10:59:20.383016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":12730,"num_write":348,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"38'424","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.402605+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:59:30.402605+0000","last_peered":"2024-04-20T10:59:30.402605+0000","last_clean":"2024-04-20T10:59:30.402605+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:59:30.402605+0000","last_undegraded":"2024-04-20T10:59:30.402605+0000","last_fullsized":"2024-04-20T10:59:30.402605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":7385,"num_write":393,"num_write_kb":42181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"38'399","reported_seq":540,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382905+0000","last_change":"2024-04-20T10:51:20.769699+0000","last_active":"2024-04-20T10:59:20.382905+0000","last_peered":"2024-04-20T10:59:20.382905+0000","last_clean":"2024-04-20T10:59:20.382905+0000","last_became_active":"2024-04-20T10:51:20.769384+0000","last_became_peered":"2024-04-20T10:51:20.769384+0000","last_unstale":"2024-04-20T10:59:20.382905+0000","last_undegraded":"2024-04-20T10:59:20.382905+0000","last_fullsized":"2024-04-20T10:59:20.382905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:57:56.261004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71394,"num_write":379,"num_write_kb":96385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"38'436","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391041+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:59:20.391041+0000","last_peered":"2024-04-20T10:59:20.391041+0000","last_clean":"2024-04-20T10:59:20.391041+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:59:20.391041+0000","last_undegraded":"2024-04-20T10:59:20.391041+0000","last_fullsized":"2024-04-20T10:59:20.391041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":70925,"num_write":402,"num_write_kb":100628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"38'423","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380992+0000","last_change":"2024-04-20T10:51:20.841991+0000","last_active":"2024-04-20T10:59:20.380992+0000","last_peered":"2024-04-20T10:59:20.380992+0000","last_clean":"2024-04-20T10:59:20.380992+0000","last_became_active":"2024-04-20T10:51:20.841719+0000","last_became_peered":"2024-04-20T10:51:20.841719+0000","last_unstale":"2024-04-20T10:59:20.380992+0000","last_undegraded":"2024-04-20T10:59:20.380992+0000","last_fullsized":"2024-04-20T10:59:20.380992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:09:17.891373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":49916,"num_write":398,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"38'473","reported_seq":605,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633509+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:59:28.633509+0000","last_peered":"2024-04-20T10:59:28.633509+0000","last_clean":"2024-04-20T10:59:28.633509+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:59:28.633509+0000","last_undegraded":"2024-04-20T10:59:28.633509+0000","last_fullsized":"2024-04-20T10:59:28.633509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":134201,"num_write":442,"num_write_kb":141769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"38'414","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406887+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:59:23.406887+0000","last_peered":"2024-04-20T10:59:23.406887+0000","last_clean":"2024-04-20T10:59:23.406887+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:59:23.406887+0000","last_undegraded":"2024-04-20T10:59:23.406887+0000","last_fullsized":"2024-04-20T10:59:23.406887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":129245,"num_write":382,"num_write_kb":126738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"38'443","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633493+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:59:28.633493+0000","last_peered":"2024-04-20T10:59:28.633493+0000","last_clean":"2024-04-20T10:59:28.633493+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:59:28.633493+0000","last_undegraded":"2024-04-20T10:59:28.633493+0000","last_fullsized":"2024-04-20T10:59:28.633493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":98132,"num_write":412,"num_write_kb":88980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"38'431","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390443+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:59:20.390443+0000","last_peered":"2024-04-20T10:59:20.390443+0000","last_clean":"2024-04-20T10:59:20.390443+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:59:20.390443+0000","last_undegraded":"2024-04-20T10:59:20.390443+0000","last_fullsized":"2024-04-20T10:59:20.390443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":82367,"num_write":405,"num_write_kb":88791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"38'369","reported_seq":469,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.408544+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:59:30.408544+0000","last_peered":"2024-04-20T10:59:30.408544+0000","last_clean":"2024-04-20T10:59:30.408544+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:59:30.408544+0000","last_undegraded":"2024-04-20T10:59:30.408544+0000","last_fullsized":"2024-04-20T10:59:30.408544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":17428,"num_write":337,"num_write_kb":30562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"38'375","reported_seq":483,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399602+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:59:23.399602+0000","last_peered":"2024-04-20T10:59:23.399602+0000","last_clean":"2024-04-20T10:59:23.399602+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:59:23.399602+0000","last_undegraded":"2024-04-20T10:59:23.399602+0000","last_fullsized":"2024-04-20T10:59:23.399602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":12288,"num_write":347,"num_write_kb":45028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"38'368","reported_seq":470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645244+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:59:28.645244+0000","last_peered":"2024-04-20T10:59:28.645244+0000","last_clean":"2024-04-20T10:59:28.645244+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:59:28.645244+0000","last_undegraded":"2024-04-20T10:59:28.645244+0000","last_fullsized":"2024-04-20T10:59:28.645244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":42400,"num_write":337,"num_write_kb":50456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"38'435","reported_seq":585,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390827+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:59:20.390827+0000","last_peered":"2024-04-20T10:59:20.390827+0000","last_clean":"2024-04-20T10:59:20.390827+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:59:20.390827+0000","last_undegraded":"2024-04-20T10:59:20.390827+0000","last_fullsized":"2024-04-20T10:59:20.390827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":60266,"num_write":401,"num_write_kb":64358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"38'402","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401638+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:59:30.401638+0000","last_peered":"2024-04-20T10:59:30.401638+0000","last_clean":"2024-04-20T10:59:30.401638+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:59:30.401638+0000","last_undegraded":"2024-04-20T10:59:30.401638+0000","last_fullsized":"2024-04-20T10:59:30.401638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58110,"num_write":372,"num_write_kb":67566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"38'410","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402471+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:59:23.402471+0000","last_peered":"2024-04-20T10:59:23.402471+0000","last_clean":"2024-04-20T10:59:23.402471+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:59:23.402471+0000","last_undegraded":"2024-04-20T10:59:23.402471+0000","last_fullsized":"2024-04-20T10:59:23.402471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":40406,"num_write":376,"num_write_kb":72310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"38'423","reported_seq":540,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646095+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:59:28.646095+0000","last_peered":"2024-04-20T10:59:28.646095+0000","last_clean":"2024-04-20T10:59:28.646095+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:59:28.646095+0000","last_undegraded":"2024-04-20T10:59:28.646095+0000","last_fullsized":"2024-04-20T10:59:28.646095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48634,"num_write":394,"num_write_kb":56270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"37'391","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386768+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:59:20.386768+0000","last_peered":"2024-04-20T10:59:20.386768+0000","last_clean":"2024-04-20T10:59:20.386768+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:59:20.386768+0000","last_undegraded":"2024-04-20T10:59:20.386768+0000","last_fullsized":"2024-04-20T10:59:20.386768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":67210,"num_write":369,"num_write_kb":63933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"38'365","reported_seq":475,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405357+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:59:30.405357+0000","last_peered":"2024-04-20T10:59:30.405357+0000","last_clean":"2024-04-20T10:59:30.405357+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:59:30.405357+0000","last_undegraded":"2024-04-20T10:59:30.405357+0000","last_fullsized":"2024-04-20T10:59:30.405357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":38197,"num_write":324,"num_write_kb":43133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'436","reported_seq":574,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390287+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:59:20.390287+0000","last_peered":"2024-04-20T10:59:20.390287+0000","last_clean":"2024-04-20T10:59:20.390287+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:59:20.390287+0000","last_undegraded":"2024-04-20T10:59:20.390287+0000","last_fullsized":"2024-04-20T10:59:20.390287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":82231,"num_write":413,"num_write_kb":104966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"38'435","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648841+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:59:28.648841+0000","last_peered":"2024-04-20T10:59:28.648841+0000","last_clean":"2024-04-20T10:59:28.648841+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:59:28.648841+0000","last_undegraded":"2024-04-20T10:59:28.648841+0000","last_fullsized":"2024-04-20T10:59:28.648841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78016,"num_write":409,"num_write_kb":101239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"37'379","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392424+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:59:20.392424+0000","last_peered":"2024-04-20T10:59:20.392424+0000","last_clean":"2024-04-20T10:59:20.392424+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:59:20.392424+0000","last_undegraded":"2024-04-20T10:59:20.392424+0000","last_fullsized":"2024-04-20T10:59:20.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":25535,"num_write":356,"num_write_kb":38136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4810,"num_read_kb":3595152,"num_write":24379,"num_write_kb":4256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26481,"ondisk_log_size":26481,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":149799644,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":809,"num_read_kb":507129,"num_write":8083,"num_write_kb":153175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299663360,"data_stored":299599288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9473,"ondisk_log_size":9473,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5724,"num_read_kb":3353332,"num_write":24442,"num_write_kb":4400565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26386,"ondisk_log_size":26386,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151049735,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":699,"num_read_kb":394566,"num_write":7750,"num_write_kb":153909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302161920,"data_stored":302099470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9158,"ondisk_log_size":9158,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126660,"kb_used_data":77436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94245180,"statfs":{"total":96636764160,"available":96507064320,"internally_reserved":0,"allocated":79294464,"data_stored":79053534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130184,"kb_used_data":80960,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94241656,"statfs":{"total":96636764160,"available":96503455744,"internally_reserved":0,"allocated":82903040,"data_stored":82658086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123880,"kb_used_data":52512,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94247960,"statfs":{"total":96636764160,"available":96509911040,"internally_reserved":0,"allocated":53772288,"data_stored":53529519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177172,"kb_used_data":96076,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94194668,"statfs":{"total":96636764160,"available":96455340032,"internally_reserved":0,"allocated":98381824,"data_stored":98133898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185380,"kb_used_data":104284,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94186460,"statfs":{"total":96636764160,"available":96446935040,"internally_reserved":0,"allocated":106786816,"data_stored":106540719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71508,"kb_used_data":26444,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94300332,"statfs":{"total":96636764160,"available":96563539968,"internally_reserved":0,"allocated":27078656,"data_stored":26847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189528,"kb_used_data":108432,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94182312,"statfs":{"total":96636764160,"available":96442687488,"internally_reserved":0,"allocated":111034368,"data_stored":110784766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95288,"kb_used_data":46064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94276552,"statfs":{"total":96636764160,"available":96539189248,"internally_reserved":0,"allocated":47169536,"data_stored":46927925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14065664,"data_stored":14065090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35045376,"data_stored":35037282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48914432,"data_stored":48903463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57298944,"data_stored":57291981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":68657152,"data_stored":68641991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51796853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23982080,"data_stored":23969726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:59:46.989 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-20T10:59:46.990 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:59:47.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.118+0000 7f64aff0e640 1 Processor -- start 2024-04-20T10:59:47.118 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.118+0000 7f64aff0e640 1 -- start start 2024-04-20T10:59:47.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64aff0e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f64a8157710 0x7f64a8154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64aff0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a80ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64aff0e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64a80c4370 con 0x7f64a8073810 2024-04-20T10:59:47.119 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64aff0e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f64a81569e0 con 0x7f64a8157710 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64aff0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f64a8157280 con 0x7f64a80ad0c0 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ae4ab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a80ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ae4ab640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a80ad570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.175:3301/0 says I am v2:172.21.15.90:33996/0 (socket says 172.21.15.90:33996) 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ae4ab640 1 -- 172.21.15.90:0/1390077509 learned_addr learned my addr 172.21.15.90:0/1390077509 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ad4a9640 1 --2- 172.21.15.90:0/1390077509 >> v2:172.21.15.175:3300/0 conn(0x7f64a8157710 0x7f64a8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ae4ab640 1 -- 172.21.15.90:0/1390077509 >> v2:172.21.15.175:3300/0 conn(0x7f64a8157710 msgr2=0x7f64a8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ae4ab640 1 --2- 172.21.15.90:0/1390077509 >> v2:172.21.15.175:3300/0 conn(0x7f64a8157710 0x7f64a8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ae4ab640 1 -- 172.21.15.90:0/1390077509 >> v1:172.21.15.175:6789/0 conn(0x7f64a8073810 legacy=0x7f64a80c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.120 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.119+0000 7f64ae4ab640 1 -- 172.21.15.90:0/1390077509 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a8156c30 con 0x7f64a80ad0c0 2024-04-20T10:59:47.121 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.120+0000 7f64ae4ab640 1 --2- 172.21.15.90:0/1390077509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a80ad570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009e50 tx=0x7f64a002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3184175de8249143 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.120+0000 7f64acca8640 1 -- 172.21.15.90:0/1390077509 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a002ca70 con 0x7f64a80ad0c0 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.120+0000 7f64acca8640 1 -- 172.21.15.90:0/1390077509 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a002cc10 con 0x7f64a80ad0c0 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.120+0000 7f64acca8640 1 -- 172.21.15.90:0/1390077509 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a00343f0 con 0x7f64a80ad0c0 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 -- 172.21.15.90:0/1390077509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 msgr2=0x7f64a80ad570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 --2- 172.21.15.90:0/1390077509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a80ad570 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009e50 tx=0x7f64a002bed0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 -- 172.21.15.90:0/1390077509 shutdown_connections 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 --2- 172.21.15.90:0/1390077509 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a80ad570 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 --2- 172.21.15.90:0/1390077509 >> v2:172.21.15.175:3300/0 conn(0x7f64a8157710 0x7f64a8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.122 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 -- 172.21.15.90:0/1390077509 >> 172.21.15.90:0/1390077509 conn(0x7f64a80c8080 msgr2=0x7f64a80c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:47.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 -- 172.21.15.90:0/1390077509 shutdown_connections 2024-04-20T10:59:47.123 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.121+0000 7f64aff0e640 1 -- 172.21.15.90:0/1390077509 wait complete. 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.122+0000 7f64aff0e640 1 Processor -- start 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.122+0000 7f64aff0e640 1 -- start start 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64aff0e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8073810 0x7f64a81ec420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64aff0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a814cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64aff0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a8157710 0x7f64a814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64aff0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f64a80abbb0 con 0x7f64a8157710 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64aff0e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f64a8073bf0 con 0x7f64a8073810 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64aff0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f64a80abd30 con 0x7f64a80ad0c0 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a8157710 0x7f64a814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.125 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a8157710 0x7f64a814d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:51984/0 (socket says 172.21.15.90:51984) 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 -- 172.21.15.90:0/3763155122 learned_addr learned my addr 172.21.15.90:0/3763155122 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64adcaa640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8073810 0x7f64a81ec420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ad4a9640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a814cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 -- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 msgr2=0x7f64a814cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a814cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 -- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8073810 msgr2=0x7f64a81ec420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8073810 0x7f64a81ec420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 -- 172.21.15.90:0/3763155122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64a814d820 con 0x7f64a8157710 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f64ae4ab640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a8157710 0x7f64a814d2e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009f70 tx=0x7f64a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.123+0000 7f649e7fc640 1 -- 172.21.15.90:0/3763155122 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0043020 con 0x7f64a8157710 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.124+0000 7f649e7fc640 1 -- 172.21.15.90:0/3763155122 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64a003e450 con 0x7f64a8157710 2024-04-20T10:59:47.126 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.124+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64a81ecea0 con 0x7f64a8157710 2024-04-20T10:59:47.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.124+0000 7f649e7fc640 1 -- 172.21.15.90:0/3763155122 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a0009510 con 0x7f64a8157710 2024-04-20T10:59:47.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.124+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64a81dceb0 con 0x7f64a8157710 2024-04-20T10:59:47.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.124+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64a8076150 con 0x7f64a8157710 2024-04-20T10:59:47.127 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.125+0000 7f649e7fc640 1 -- 172.21.15.90:0/3763155122 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f64a0046020 con 0x7f64a8157710 2024-04-20T10:59:47.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.125+0000 7f649e7fc640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f648c06c920 0x7f648c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.125+0000 7f649e7fc640 1 -- 172.21.15.90:0/3763155122 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f64a00ae900 con 0x7f64a8157710 2024-04-20T10:59:47.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.125+0000 7f64adcaa640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f648c06c920 0x7f648c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.128 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.126+0000 7f64adcaa640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f648c06c920 0x7f648c06ede0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64a4001640 tx=0x7f64a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:47.130 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.130+0000 7f649e7fc640 1 -- 172.21.15.90:0/3763155122 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f64a004d030 con 0x7f64a8157710 2024-04-20T10:59:47.302 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.301+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f64a80c8c40 con 0x7f648c06c920 2024-04-20T10:59:47.312 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.312+0000 7f649e7fc640 1 -- 172.21.15.90:0/3763155122 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494337 (secure 0 0 0) 0x7f64a80c8c40 con 0x7f648c06c920 2024-04-20T10:59:47.318 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:47.321 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f648c06c920 msgr2=0x7f648c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f648c06c920 0x7f648c06ede0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f64a4001640 tx=0x7f64a4009040 comp rx=0 tx=0).stop 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a8157710 msgr2=0x7f64a814d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a8157710 0x7f64a814d2e0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009f70 tx=0x7f64a0004a40 comp rx=0 tx=0).stop 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 shutdown_connections 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f648c06c920 0x7f648c06ede0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f64a8157710 0x7f64a814d2e0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f64a80ad0c0 0x7f64a814cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 --2- 172.21.15.90:0/3763155122 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f64a8073810 0x7f64a81ec420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.316+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 >> 172.21.15.90:0/3763155122 conn(0x7f64a80c8080 msgr2=0x7f64a806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.317+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 shutdown_connections 2024-04-20T10:59:47.323 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.317+0000 7f64aff0e640 1 -- 172.21.15.90:0/3763155122 wait complete. 2024-04-20T10:59:47.328 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2024-04-20T10:59:45.805828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":301439747,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":12158,"num_read_kb":7850279,"num_write":64813,"num_write_kb":8966793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71615,"ondisk_log_size":71615,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1099600,"kb_used_data":592208,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":753875120,"statfs":{"total":773094113280,"available":771968122880,"internally_reserved":0,"allocated":606420992,"data_stored":604476094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":519491120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55310,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":12,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003210"},"pg_stats":[{"pgid":"5.18","version":"38'433","reported_seq":545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.647268+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:59:28.647268+0000","last_peered":"2024-04-20T10:59:28.647268+0000","last_clean":"2024-04-20T10:59:28.647268+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:59:28.647268+0000","last_undegraded":"2024-04-20T10:59:28.647268+0000","last_fullsized":"2024-04-20T10:59:28.647268+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:20.601002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":22795,"num_write":399,"num_write_kb":54919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"38'85","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387326+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:59:20.387326+0000","last_peered":"2024-04-20T10:59:20.387326+0000","last_clean":"2024-04-20T10:59:20.387326+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:59:20.387326+0000","last_undegraded":"2024-04-20T10:59:20.387326+0000","last_fullsized":"2024-04-20T10:59:20.387326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":13987,"num_write":27,"num_write_kb":4118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"38'408","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403809+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:59:23.403809+0000","last_peered":"2024-04-20T10:59:23.403809+0000","last_clean":"2024-04-20T10:59:23.403809+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:59:23.403809+0000","last_undegraded":"2024-04-20T10:59:23.403809+0000","last_fullsized":"2024-04-20T10:59:23.403809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:16:52.958643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":85574,"num_write":384,"num_write_kb":89655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"38'168","reported_seq":213,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.596572+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:59:22.596572+0000","last_peered":"2024-04-20T10:59:22.596572+0000","last_clean":"2024-04-20T10:59:22.596572+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:59:22.596572+0000","last_undegraded":"2024-04-20T10:59:22.596572+0000","last_fullsized":"2024-04-20T10:59:22.596572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:24:16.228178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"38'459","reported_seq":574,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.407768+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:59:30.407768+0000","last_peered":"2024-04-20T10:59:30.407768+0000","last_clean":"2024-04-20T10:59:30.407768+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:59:30.407768+0000","last_undegraded":"2024-04-20T10:59:30.407768+0000","last_fullsized":"2024-04-20T10:59:30.407768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:32:28.897162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":79973,"num_write":429,"num_write_kb":121385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"36'193","reported_seq":248,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.396105+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:59:20.396105+0000","last_peered":"2024-04-20T10:59:20.396105+0000","last_clean":"2024-04-20T10:59:20.396105+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:59:20.396105+0000","last_undegraded":"2024-04-20T10:59:20.396105+0000","last_fullsized":"2024-04-20T10:59:20.396105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:54:19.523895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":130,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"37'359","reported_seq":476,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386804+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:59:20.386804+0000","last_peered":"2024-04-20T10:59:20.386804+0000","last_clean":"2024-04-20T10:59:20.386804+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:59:20.386804+0000","last_undegraded":"2024-04-20T10:59:20.386804+0000","last_fullsized":"2024-04-20T10:59:20.386804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":24250,"num_write":339,"num_write_kb":58188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"38'922","reported_seq":973,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.570742+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:59:21.570742+0000","last_peered":"2024-04-20T10:59:21.570742+0000","last_clean":"2024-04-20T10:59:21.570742+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:59:21.570742+0000","last_undegraded":"2024-04-20T10:59:21.570742+0000","last_fullsized":"2024-04-20T10:59:21.570742+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:27.001286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":852,"num_write_kb":8691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"38'405","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.639984+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:59:28.639984+0000","last_peered":"2024-04-20T10:59:28.639984+0000","last_clean":"2024-04-20T10:59:28.639984+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:59:28.639984+0000","last_undegraded":"2024-04-20T10:59:28.639984+0000","last_fullsized":"2024-04-20T10:59:28.639984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":43507,"num_write":372,"num_write_kb":54374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"37'371","reported_seq":440,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392875+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:59:20.392875+0000","last_peered":"2024-04-20T10:59:20.392875+0000","last_clean":"2024-04-20T10:59:20.392875+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:59:20.392875+0000","last_undegraded":"2024-04-20T10:59:20.392875+0000","last_fullsized":"2024-04-20T10:59:20.392875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":45077,"num_write":302,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'401","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393379+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:59:20.393379+0000","last_peered":"2024-04-20T10:59:20.393379+0000","last_clean":"2024-04-20T10:59:20.393379+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:59:20.393379+0000","last_undegraded":"2024-04-20T10:59:20.393379+0000","last_fullsized":"2024-04-20T10:59:20.393379+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:07.575891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":103995,"num_write":369,"num_write_kb":100717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'159","reported_seq":208,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386804+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:59:20.386804+0000","last_peered":"2024-04-20T10:59:20.386804+0000","last_clean":"2024-04-20T10:59:20.386804+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:59:20.386804+0000","last_undegraded":"2024-04-20T10:59:20.386804+0000","last_fullsized":"2024-04-20T10:59:20.386804+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:13.909880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":20490,"num_write":105,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"38'368","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641669+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:59:28.641669+0000","last_peered":"2024-04-20T10:59:28.641669+0000","last_clean":"2024-04-20T10:59:28.641669+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:59:28.641669+0000","last_undegraded":"2024-04-20T10:59:28.641669+0000","last_fullsized":"2024-04-20T10:59:28.641669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:44:28.575563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":53969,"num_write":336,"num_write_kb":42442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"38'67","reported_seq":129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391409+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:59:20.391409+0000","last_peered":"2024-04-20T10:59:20.391409+0000","last_clean":"2024-04-20T10:59:20.391409+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:59:20.391409+0000","last_undegraded":"2024-04-20T10:59:20.391409+0000","last_fullsized":"2024-04-20T10:59:20.391409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":8317,"num_write":19,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'375","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395496+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:59:20.395496+0000","last_peered":"2024-04-20T10:59:20.395496+0000","last_clean":"2024-04-20T10:59:20.395496+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:59:20.395496+0000","last_undegraded":"2024-04-20T10:59:20.395496+0000","last_fullsized":"2024-04-20T10:59:20.395496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:10:08.043881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":27688,"num_write":341,"num_write_kb":72358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"36'659","reported_seq":712,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.264947+0000","last_change":"2024-04-20T10:50:48.640642+0000","last_active":"2024-04-20T10:59:22.264947+0000","last_peered":"2024-04-20T10:59:22.264947+0000","last_clean":"2024-04-20T10:59:22.264947+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:59:22.264947+0000","last_undegraded":"2024-04-20T10:59:22.264947+0000","last_fullsized":"2024-04-20T10:59:22.264947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":659,"log_dups_size":0,"ondisk_log_size":659,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:32.507224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36433,"num_write":605,"num_write_kb":12615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"38'446","reported_seq":569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.406503+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:59:30.406503+0000","last_peered":"2024-04-20T10:59:30.406503+0000","last_clean":"2024-04-20T10:59:30.406503+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:59:30.406503+0000","last_undegraded":"2024-04-20T10:59:30.406503+0000","last_fullsized":"2024-04-20T10:59:30.406503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:06.618063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":68359,"num_write":412,"num_write_kb":83650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"38'451","reported_seq":601,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408229+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:59:23.408229+0000","last_peered":"2024-04-20T10:59:23.408229+0000","last_clean":"2024-04-20T10:59:23.408229+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:59:23.408229+0000","last_undegraded":"2024-04-20T10:59:23.408229+0000","last_fullsized":"2024-04-20T10:59:23.408229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:10.263905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":83011,"num_write":424,"num_write_kb":112568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"37'185","reported_seq":251,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391349+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:59:20.391349+0000","last_peered":"2024-04-20T10:59:20.391349+0000","last_clean":"2024-04-20T10:59:20.391349+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:59:20.391349+0000","last_undegraded":"2024-04-20T10:59:20.391349+0000","last_fullsized":"2024-04-20T10:59:20.391349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32778,"num_write":122,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'533","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387601+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:59:20.387601+0000","last_peered":"2024-04-20T10:59:20.387601+0000","last_clean":"2024-04-20T10:59:20.387601+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:59:20.387601+0000","last_undegraded":"2024-04-20T10:59:20.387601+0000","last_fullsized":"2024-04-20T10:59:20.387601+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:03.561396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16463,"num_write":485,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'400","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380771+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:59:20.380771+0000","last_peered":"2024-04-20T10:59:20.380771+0000","last_clean":"2024-04-20T10:59:20.380771+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:59:20.380771+0000","last_undegraded":"2024-04-20T10:59:20.380771+0000","last_fullsized":"2024-04-20T10:59:20.380771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:52.424365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":15248,"num_write":372,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"36'439","reported_seq":580,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389917+0000","last_change":"2024-04-20T10:51:20.874303+0000","last_active":"2024-04-20T10:59:20.389917+0000","last_peered":"2024-04-20T10:59:20.389917+0000","last_clean":"2024-04-20T10:59:20.389917+0000","last_became_active":"2024-04-20T10:51:20.873593+0000","last_became_peered":"2024-04-20T10:51:20.873593+0000","last_unstale":"2024-04-20T10:59:20.389917+0000","last_undegraded":"2024-04-20T10:59:20.389917+0000","last_fullsized":"2024-04-20T10:59:20.389917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:03.363095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":68460,"num_write":408,"num_write_kb":88214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"36'471","reported_seq":525,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391983+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:59:20.391983+0000","last_peered":"2024-04-20T10:59:20.391983+0000","last_clean":"2024-04-20T10:59:20.391983+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:59:20.391983+0000","last_undegraded":"2024-04-20T10:59:20.391983+0000","last_fullsized":"2024-04-20T10:59:20.391983+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:15.983806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":415,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'54","reported_seq":97,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612670+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:59:28.612670+0000","last_peered":"2024-04-20T10:59:28.612670+0000","last_clean":"2024-04-20T10:59:28.612670+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:59:28.612670+0000","last_undegraded":"2024-04-20T10:59:28.612670+0000","last_fullsized":"2024-04-20T10:59:28.612670+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:53.496236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"38'386","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648828+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:59:28.648828+0000","last_peered":"2024-04-20T10:59:28.648828+0000","last_clean":"2024-04-20T10:59:28.648828+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:59:28.648828+0000","last_undegraded":"2024-04-20T10:59:28.648828+0000","last_fullsized":"2024-04-20T10:59:28.648828+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:51:26.377612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":51447,"num_write":355,"num_write_kb":79846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'408","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391303+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:59:20.391303+0000","last_peered":"2024-04-20T10:59:20.391303+0000","last_clean":"2024-04-20T10:59:20.391303+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:59:20.391303+0000","last_undegraded":"2024-04-20T10:59:20.391303+0000","last_fullsized":"2024-04-20T10:59:20.391303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:39:55.373842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":28672,"num_write":368,"num_write_kb":66779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'260","reported_seq":313,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392032+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:59:20.392032+0000","last_peered":"2024-04-20T10:59:20.392032+0000","last_clean":"2024-04-20T10:59:20.392032+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:59:20.392032+0000","last_undegraded":"2024-04-20T10:59:20.392032+0000","last_fullsized":"2024-04-20T10:59:20.392032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":207,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"38'292","reported_seq":344,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644447+0000","last_change":"2024-04-20T10:50:48.644225+0000","last_active":"2024-04-20T10:59:28.644447+0000","last_peered":"2024-04-20T10:59:28.644447+0000","last_clean":"2024-04-20T10:59:28.644447+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:59:28.644447+0000","last_undegraded":"2024-04-20T10:59:28.644447+0000","last_fullsized":"2024-04-20T10:59:28.644447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":292,"log_dups_size":0,"ondisk_log_size":292,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:05:24.371824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":243,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"38'417","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401200+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:59:30.401200+0000","last_peered":"2024-04-20T10:59:30.401200+0000","last_clean":"2024-04-20T10:59:30.401200+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:59:30.401200+0000","last_undegraded":"2024-04-20T10:59:30.401200+0000","last_fullsized":"2024-04-20T10:59:30.401200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:27.614938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":59672,"num_write":383,"num_write_kb":87983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"38'464","reported_seq":618,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399563+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:59:23.399563+0000","last_peered":"2024-04-20T10:59:23.399563+0000","last_clean":"2024-04-20T10:59:23.399563+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:59:23.399563+0000","last_undegraded":"2024-04-20T10:59:23.399563+0000","last_fullsized":"2024-04-20T10:59:23.399563+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:36:59.256414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":46635,"num_write":434,"num_write_kb":47131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'429","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391034+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:59:20.391034+0000","last_peered":"2024-04-20T10:59:20.391034+0000","last_clean":"2024-04-20T10:59:20.391034+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:59:20.391034+0000","last_undegraded":"2024-04-20T10:59:20.391034+0000","last_fullsized":"2024-04-20T10:59:20.391034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":373,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'505","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.682919+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:59:21.682919+0000","last_peered":"2024-04-20T10:59:21.682919+0000","last_clean":"2024-04-20T10:59:21.682919+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:59:21.682919+0000","last_undegraded":"2024-04-20T10:59:21.682919+0000","last_fullsized":"2024-04-20T10:59:21.682919+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:28.157136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":12324,"num_write":451,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"38'428","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389966+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:59:20.389966+0000","last_peered":"2024-04-20T10:59:20.389966+0000","last_clean":"2024-04-20T10:59:20.389966+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:59:20.389966+0000","last_undegraded":"2024-04-20T10:59:20.389966+0000","last_fullsized":"2024-04-20T10:59:20.389966+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:54.773653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70222,"num_write":390,"num_write_kb":75460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"38'430","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408714+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:59:23.408714+0000","last_peered":"2024-04-20T10:59:23.408714+0000","last_clean":"2024-04-20T10:59:23.408714+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:59:23.408714+0000","last_undegraded":"2024-04-20T10:59:23.408714+0000","last_fullsized":"2024-04-20T10:59:23.408714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":26226,"num_write":396,"num_write_kb":42836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"38'177","reported_seq":238,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.142667+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:59:31.142667+0000","last_peered":"2024-04-20T10:59:31.142667+0000","last_clean":"2024-04-20T10:59:31.142667+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:59:31.142667+0000","last_undegraded":"2024-04-20T10:59:31.142667+0000","last_fullsized":"2024-04-20T10:59:31.142667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":177,"log_dups_size":0,"ondisk_log_size":177,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T10:58:32.083875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2765447,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":2215,"num_write":121,"num_write_kb":2773,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"38'354","reported_seq":681,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.399438+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:59:36.399438+0000","last_peered":"2024-04-20T10:59:36.399438+0000","last_clean":"2024-04-20T10:59:36.399438+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:59:36.399438+0000","last_undegraded":"2024-04-20T10:59:36.399438+0000","last_fullsized":"2024-04-20T10:59:36.399438+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:57:53.393820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465101,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":1621,"num_write":296,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'403","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635967+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:59:28.635967+0000","last_peered":"2024-04-20T10:59:28.635967+0000","last_clean":"2024-04-20T10:59:28.635967+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:59:28.635967+0000","last_undegraded":"2024-04-20T10:59:28.635967+0000","last_fullsized":"2024-04-20T10:59:28.635967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:19:21.545538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":84919,"num_write":363,"num_write_kb":88226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"38'351","reported_seq":485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.747469+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:59:21.747469+0000","last_peered":"2024-04-20T10:59:21.747469+0000","last_clean":"2024-04-20T10:59:21.747469+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:59:21.747469+0000","last_undegraded":"2024-04-20T10:59:21.747469+0000","last_fullsized":"2024-04-20T10:59:21.747469+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:20.047804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":41830,"num_write":332,"num_write_kb":50578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"38'367","reported_seq":429,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.382070+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:59:31.382070+0000","last_peered":"2024-04-20T10:59:31.382070+0000","last_clean":"2024-04-20T10:59:31.382070+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:59:31.382070+0000","last_undegraded":"2024-04-20T10:59:31.382070+0000","last_fullsized":"2024-04-20T10:59:31.382070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:33.835480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":432,"num_write":705,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"38'199","reported_seq":256,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:25.551371+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:59:25.551371+0000","last_peered":"2024-04-20T10:59:25.551371+0000","last_clean":"2024-04-20T10:59:25.551371+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:59:25.551371+0000","last_undegraded":"2024-04-20T10:59:25.551371+0000","last_fullsized":"2024-04-20T10:59:25.551371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:59.426105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":41717,"num_write":141,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"38'382","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.634547+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:59:28.634547+0000","last_peered":"2024-04-20T10:59:28.634547+0000","last_clean":"2024-04-20T10:59:28.634547+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:59:28.634547+0000","last_undegraded":"2024-04-20T10:59:28.634547+0000","last_fullsized":"2024-04-20T10:59:28.634547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:38.475494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36954,"num_write":352,"num_write_kb":63166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"38'440","reported_seq":587,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391402+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:59:20.391402+0000","last_peered":"2024-04-20T10:59:20.391402+0000","last_clean":"2024-04-20T10:59:20.391402+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:59:20.391402+0000","last_undegraded":"2024-04-20T10:59:20.391402+0000","last_fullsized":"2024-04-20T10:59:20.391402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:40:20.185467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":92391,"num_write":411,"num_write_kb":121276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'116","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393763+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:59:20.393763+0000","last_peered":"2024-04-20T10:59:20.393763+0000","last_clean":"2024-04-20T10:59:20.393763+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:59:20.393763+0000","last_undegraded":"2024-04-20T10:59:20.393763+0000","last_fullsized":"2024-04-20T10:59:20.393763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":47,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"38'72","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621376+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:59:28.621376+0000","last_peered":"2024-04-20T10:59:28.621376+0000","last_clean":"2024-04-20T10:59:28.621376+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:59:28.621376+0000","last_undegraded":"2024-04-20T10:59:28.621376+0000","last_fullsized":"2024-04-20T10:59:28.621376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"38'388","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.638445+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:59:28.638445+0000","last_peered":"2024-04-20T10:59:28.638445+0000","last_clean":"2024-04-20T10:59:28.638445+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:59:28.638445+0000","last_undegraded":"2024-04-20T10:59:28.638445+0000","last_fullsized":"2024-04-20T10:59:28.638445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":31459,"num_write":347,"num_write_kb":38414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"38'421","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406112+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:59:23.406112+0000","last_peered":"2024-04-20T10:59:23.406112+0000","last_clean":"2024-04-20T10:59:23.406112+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:59:23.406112+0000","last_undegraded":"2024-04-20T10:59:23.406112+0000","last_fullsized":"2024-04-20T10:59:23.406112+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:43:49.332809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":53960,"num_write":380,"num_write_kb":46448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"37'59","reported_seq":111,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391821+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:59:20.391821+0000","last_peered":"2024-04-20T10:59:20.391821+0000","last_clean":"2024-04-20T10:59:20.391821+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:59:20.391821+0000","last_undegraded":"2024-04-20T10:59:20.391821+0000","last_fullsized":"2024-04-20T10:59:20.391821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:52:43.113716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'621","reported_seq":677,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.626958+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:59:20.626958+0000","last_peered":"2024-04-20T10:59:20.626958+0000","last_clean":"2024-04-20T10:59:20.626958+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:59:20.626958+0000","last_undegraded":"2024-04-20T10:59:20.626958+0000","last_fullsized":"2024-04-20T10:59:20.626958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:01:31.782378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":37014,"num_write":557,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"38'440","reported_seq":575,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405359+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:59:30.405359+0000","last_peered":"2024-04-20T10:59:30.405359+0000","last_clean":"2024-04-20T10:59:30.405359+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:59:30.405359+0000","last_undegraded":"2024-04-20T10:59:30.405359+0000","last_fullsized":"2024-04-20T10:59:30.405359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":72557,"num_write":399,"num_write_kb":79896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"37'409","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388343+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:59:20.388343+0000","last_peered":"2024-04-20T10:59:20.388343+0000","last_clean":"2024-04-20T10:59:20.388343+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:59:20.388343+0000","last_undegraded":"2024-04-20T10:59:20.388343+0000","last_fullsized":"2024-04-20T10:59:20.388343+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:46:03.443255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69573,"num_write":375,"num_write_kb":88218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'601","reported_seq":659,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394008+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:59:20.394008+0000","last_peered":"2024-04-20T10:59:20.394008+0000","last_clean":"2024-04-20T10:59:20.394008+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:59:20.394008+0000","last_undegraded":"2024-04-20T10:59:20.394008+0000","last_fullsized":"2024-04-20T10:59:20.394008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:46:03.797351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":551,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"38'74","reported_seq":119,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390879+0000","last_change":"2024-04-20T10:50:48.642284+0000","last_active":"2024-04-20T10:59:20.390879+0000","last_peered":"2024-04-20T10:59:20.390879+0000","last_clean":"2024-04-20T10:59:20.390879+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:59:20.390879+0000","last_undegraded":"2024-04-20T10:59:20.390879+0000","last_fullsized":"2024-04-20T10:59:20.390879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:33.763030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"38'423","reported_seq":553,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410970+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:59:30.410970+0000","last_peered":"2024-04-20T10:59:30.410970+0000","last_clean":"2024-04-20T10:59:30.410970+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:59:30.410970+0000","last_undegraded":"2024-04-20T10:59:30.410970+0000","last_fullsized":"2024-04-20T10:59:30.410970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:30.236048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56610,"num_write":400,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'384","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.389823+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:59:20.389823+0000","last_peered":"2024-04-20T10:59:20.389823+0000","last_clean":"2024-04-20T10:59:20.389823+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:59:20.389823+0000","last_undegraded":"2024-04-20T10:59:20.389823+0000","last_fullsized":"2024-04-20T10:59:20.389823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:44:45.500378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":325,"num_write":350,"num_write_kb":17356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"38'354","reported_seq":699,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:34.398923+0000","last_change":"2024-04-20T10:50:39.574215+0000","last_active":"2024-04-20T10:59:34.398923+0000","last_peered":"2024-04-20T10:59:34.398923+0000","last_clean":"2024-04-20T10:59:34.398923+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:59:34.398923+0000","last_undegraded":"2024-04-20T10:59:34.398923+0000","last_fullsized":"2024-04-20T10:59:34.398923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:41:47.428078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":293,"num_read_kb":1639,"num_write":299,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"38'135","reported_seq":190,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.401719+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:59:36.401719+0000","last_peered":"2024-04-20T10:59:36.401719+0000","last_clean":"2024-04-20T10:59:36.401719+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:59:36.401719+0000","last_undegraded":"2024-04-20T10:59:36.401719+0000","last_fullsized":"2024-04-20T10:59:36.401719+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:37:21.623298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":994,"num_write":82,"num_write_kb":1558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'363","reported_seq":473,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405073+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:59:30.405073+0000","last_peered":"2024-04-20T10:59:30.405073+0000","last_clean":"2024-04-20T10:59:30.405073+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:59:30.405073+0000","last_undegraded":"2024-04-20T10:59:30.405073+0000","last_fullsized":"2024-04-20T10:59:30.405073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:12.558799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56669,"num_write":337,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"38'414","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386329+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:59:20.386329+0000","last_peered":"2024-04-20T10:59:20.386329+0000","last_clean":"2024-04-20T10:59:20.386329+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:59:20.386329+0000","last_undegraded":"2024-04-20T10:59:20.386329+0000","last_fullsized":"2024-04-20T10:59:20.386329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":100333,"num_write":376,"num_write_kb":104385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"37'123","reported_seq":184,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390747+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:59:20.390747+0000","last_peered":"2024-04-20T10:59:20.390747+0000","last_clean":"2024-04-20T10:59:20.390747+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:59:20.390747+0000","last_undegraded":"2024-04-20T10:59:20.390747+0000","last_fullsized":"2024-04-20T10:59:20.390747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":57,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"38'366","reported_seq":421,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.838351+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:59:31.838351+0000","last_peered":"2024-04-20T10:59:31.838351+0000","last_clean":"2024-04-20T10:59:31.838351+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:59:31.838351+0000","last_undegraded":"2024-04-20T10:59:31.838351+0000","last_fullsized":"2024-04-20T10:59:31.838351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":373,"num_write":704,"num_write_kb":1825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"38'374","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645982+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:59:28.645982+0000","last_peered":"2024-04-20T10:59:28.645982+0000","last_clean":"2024-04-20T10:59:28.645982+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:59:28.645982+0000","last_undegraded":"2024-04-20T10:59:28.645982+0000","last_fullsized":"2024-04-20T10:59:28.645982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23979,"num_write":342,"num_write_kb":50629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"38'375","reported_seq":496,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394982+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:59:20.394982+0000","last_peered":"2024-04-20T10:59:20.394982+0000","last_clean":"2024-04-20T10:59:20.394982+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:59:20.394982+0000","last_undegraded":"2024-04-20T10:59:20.394982+0000","last_fullsized":"2024-04-20T10:59:20.394982+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:22:44.467358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32768,"num_write":345,"num_write_kb":58807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"38'72","reported_seq":124,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392162+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:59:20.392162+0000","last_peered":"2024-04-20T10:59:20.392162+0000","last_clean":"2024-04-20T10:59:20.392162+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:59:20.392162+0000","last_undegraded":"2024-04-20T10:59:20.392162+0000","last_fullsized":"2024-04-20T10:59:20.392162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:21:53.793791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391430+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:59:20.391430+0000","last_peered":"2024-04-20T10:59:20.391430+0000","last_clean":"2024-04-20T10:59:20.391430+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:59:20.391430+0000","last_undegraded":"2024-04-20T10:59:20.391430+0000","last_fullsized":"2024-04-20T10:59:20.391430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"38'102","reported_seq":148,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:25.550993+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:59:25.550993+0000","last_peered":"2024-04-20T10:59:25.550993+0000","last_clean":"2024-04-20T10:59:25.550993+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:59:25.550993+0000","last_undegraded":"2024-04-20T10:59:25.550993+0000","last_fullsized":"2024-04-20T10:59:25.550993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.585607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"38'445","reported_seq":578,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380835+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:59:20.380835+0000","last_peered":"2024-04-20T10:59:20.380835+0000","last_clean":"2024-04-20T10:59:20.380835+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:59:20.380835+0000","last_undegraded":"2024-04-20T10:59:20.380835+0000","last_fullsized":"2024-04-20T10:59:20.380835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:28:38.183812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":88903,"num_write":409,"num_write_kb":92640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'412","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392902+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:59:20.392902+0000","last_peered":"2024-04-20T10:59:20.392902+0000","last_clean":"2024-04-20T10:59:20.392902+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:59:20.392902+0000","last_undegraded":"2024-04-20T10:59:20.392902+0000","last_fullsized":"2024-04-20T10:59:20.392902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53899,"num_write":383,"num_write_kb":39701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"37'57","reported_seq":109,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381980+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:59:20.381980+0000","last_peered":"2024-04-20T10:59:20.381980+0000","last_clean":"2024-04-20T10:59:20.381980+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:59:20.381980+0000","last_undegraded":"2024-04-20T10:59:20.381980+0000","last_fullsized":"2024-04-20T10:59:20.381980+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:55.732668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'249","reported_seq":297,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.168615+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:59:22.168615+0000","last_peered":"2024-04-20T10:59:22.168615+0000","last_clean":"2024-04-20T10:59:22.168615+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:59:22.168615+0000","last_undegraded":"2024-04-20T10:59:22.168615+0000","last_fullsized":"2024-04-20T10:59:22.168615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:10:00.466550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":11663,"num_write":185,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"38'444","reported_seq":573,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.409848+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:59:30.409848+0000","last_peered":"2024-04-20T10:59:30.409848+0000","last_clean":"2024-04-20T10:59:30.409848+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:59:30.409848+0000","last_undegraded":"2024-04-20T10:59:30.409848+0000","last_fullsized":"2024-04-20T10:59:30.409848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:11:36.485211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":74093,"num_write":415,"num_write_kb":112646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"38'451","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409601+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:59:23.409601+0000","last_peered":"2024-04-20T10:59:23.409601+0000","last_clean":"2024-04-20T10:59:23.409601+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:59:23.409601+0000","last_undegraded":"2024-04-20T10:59:23.409601+0000","last_fullsized":"2024-04-20T10:59:23.409601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:05:15.893229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":13128,"num_write":408,"num_write_kb":42612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'466","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395060+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:59:20.395060+0000","last_peered":"2024-04-20T10:59:20.395060+0000","last_clean":"2024-04-20T10:59:20.395060+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:59:20.395060+0000","last_undegraded":"2024-04-20T10:59:20.395060+0000","last_fullsized":"2024-04-20T10:59:20.395060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:37:35.563993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12293,"num_write":417,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"38'254","reported_seq":311,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.379543+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:59:22.379543+0000","last_peered":"2024-04-20T10:59:22.379543+0000","last_clean":"2024-04-20T10:59:22.379543+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:59:22.379543+0000","last_undegraded":"2024-04-20T10:59:22.379543+0000","last_fullsized":"2024-04-20T10:59:22.379543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":192,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"38'448","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405455+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:59:30.405455+0000","last_peered":"2024-04-20T10:59:30.405455+0000","last_clean":"2024-04-20T10:59:30.405455+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:59:30.405455+0000","last_undegraded":"2024-04-20T10:59:30.405455+0000","last_fullsized":"2024-04-20T10:59:30.405455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28672,"num_write":415,"num_write_kb":38311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"38'377","reported_seq":509,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403988+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:59:23.403988+0000","last_peered":"2024-04-20T10:59:23.403988+0000","last_clean":"2024-04-20T10:59:23.403988+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:59:23.403988+0000","last_undegraded":"2024-04-20T10:59:23.403988+0000","last_fullsized":"2024-04-20T10:59:23.403988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":24736,"num_write":347,"num_write_kb":38102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'415","reported_seq":477,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382204+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:59:20.382204+0000","last_peered":"2024-04-20T10:59:20.382204+0000","last_clean":"2024-04-20T10:59:20.382204+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:59:20.382204+0000","last_undegraded":"2024-04-20T10:59:20.382204+0000","last_fullsized":"2024-04-20T10:59:20.382204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:07:12.579769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":12309,"num_write":370,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"38'499","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645869+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:59:28.645869+0000","last_peered":"2024-04-20T10:59:28.645869+0000","last_clean":"2024-04-20T10:59:28.645869+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:59:28.645869+0000","last_undegraded":"2024-04-20T10:59:28.645869+0000","last_fullsized":"2024-04-20T10:59:28.645869+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:45:18.758560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":443,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"38'402","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.638499+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:59:28.638499+0000","last_peered":"2024-04-20T10:59:28.638499+0000","last_clean":"2024-04-20T10:59:28.638499+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:59:28.638499+0000","last_undegraded":"2024-04-20T10:59:28.638499+0000","last_fullsized":"2024-04-20T10:59:28.638499+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:34:04.025006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56962,"num_write":365,"num_write_kb":46837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"38'375","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410908+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:59:23.410908+0000","last_peered":"2024-04-20T10:59:23.410908+0000","last_clean":"2024-04-20T10:59:23.410908+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:59:23.410908+0000","last_undegraded":"2024-04-20T10:59:23.410908+0000","last_fullsized":"2024-04-20T10:59:23.410908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":12893,"num_write":338,"num_write_kb":54469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"38'678","reported_seq":737,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404745+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:59:23.404745+0000","last_peered":"2024-04-20T10:59:23.404745+0000","last_clean":"2024-04-20T10:59:23.404745+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:59:23.404745+0000","last_undegraded":"2024-04-20T10:59:23.404745+0000","last_fullsized":"2024-04-20T10:59:23.404745+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:20:19.176281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":626,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'248","reported_seq":294,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.699927+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:59:23.699927+0000","last_peered":"2024-04-20T10:59:23.699927+0000","last_clean":"2024-04-20T10:59:23.699927+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:59:23.699927+0000","last_undegraded":"2024-04-20T10:59:23.699927+0000","last_fullsized":"2024-04-20T10:59:23.699927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:34:55.732989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":197,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"38'396","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.614014+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:59:28.614014+0000","last_peered":"2024-04-20T10:59:28.614014+0000","last_clean":"2024-04-20T10:59:28.614014+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:59:28.614014+0000","last_undegraded":"2024-04-20T10:59:28.614014+0000","last_fullsized":"2024-04-20T10:59:28.614014+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:54.538820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27222,"num_write":365,"num_write_kb":63558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"38'485","reported_seq":639,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404048+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:59:23.404048+0000","last_peered":"2024-04-20T10:59:23.404048+0000","last_clean":"2024-04-20T10:59:23.404048+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:59:23.404048+0000","last_undegraded":"2024-04-20T10:59:23.404048+0000","last_fullsized":"2024-04-20T10:59:23.404048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":79269,"num_write":451,"num_write_kb":100665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"38'417","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409150+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:59:23.409150+0000","last_peered":"2024-04-20T10:59:23.409150+0000","last_clean":"2024-04-20T10:59:23.409150+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:59:23.409150+0000","last_undegraded":"2024-04-20T10:59:23.409150+0000","last_fullsized":"2024-04-20T10:59:23.409150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:04.871825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":8276,"num_write":372,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"38'124","reported_seq":172,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.613412+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:59:28.613412+0000","last_peered":"2024-04-20T10:59:28.613412+0000","last_clean":"2024-04-20T10:59:28.613412+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:59:28.613412+0000","last_undegraded":"2024-04-20T10:59:28.613412+0000","last_fullsized":"2024-04-20T10:59:28.613412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12306,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"38'439","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621872+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:59:28.621872+0000","last_peered":"2024-04-20T10:59:28.621872+0000","last_clean":"2024-04-20T10:59:28.621872+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:59:28.621872+0000","last_undegraded":"2024-04-20T10:59:28.621872+0000","last_fullsized":"2024-04-20T10:59:28.621872+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:04:32.118160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":73928,"num_write":402,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"38'444","reported_seq":609,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381611+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:59:20.381611+0000","last_peered":"2024-04-20T10:59:20.381611+0000","last_clean":"2024-04-20T10:59:20.381611+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:59:20.381611+0000","last_undegraded":"2024-04-20T10:59:20.381611+0000","last_fullsized":"2024-04-20T10:59:20.381611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:00:05.979576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":47645,"num_write":412,"num_write_kb":63928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'71","reported_seq":122,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382049+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:59:20.382049+0000","last_peered":"2024-04-20T10:59:20.382049+0000","last_clean":"2024-04-20T10:59:20.382049+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:59:20.382049+0000","last_undegraded":"2024-04-20T10:59:20.382049+0000","last_fullsized":"2024-04-20T10:59:20.382049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:19:03.569865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"38'64","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.599721+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:59:28.599721+0000","last_peered":"2024-04-20T10:59:28.599721+0000","last_clean":"2024-04-20T10:59:28.599721+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:59:28.599721+0000","last_undegraded":"2024-04-20T10:59:28.599721+0000","last_fullsized":"2024-04-20T10:59:28.599721+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:34:37.091672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"38'417","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405132+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:59:30.405132+0000","last_peered":"2024-04-20T10:59:30.405132+0000","last_clean":"2024-04-20T10:59:30.405132+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:59:30.405132+0000","last_undegraded":"2024-04-20T10:59:30.405132+0000","last_fullsized":"2024-04-20T10:59:30.405132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:10:16.879749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":100636,"num_write":369,"num_write_kb":112428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"38'400","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391000+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:59:20.391000+0000","last_peered":"2024-04-20T10:59:20.391000+0000","last_clean":"2024-04-20T10:59:20.391000+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:59:20.391000+0000","last_undegraded":"2024-04-20T10:59:20.391000+0000","last_fullsized":"2024-04-20T10:59:20.391000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":45758,"num_write":374,"num_write_kb":77972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"38'70","reported_seq":121,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410476+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:59:23.410476+0000","last_peered":"2024-04-20T10:59:23.410476+0000","last_clean":"2024-04-20T10:59:23.410476+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:59:23.410476+0000","last_undegraded":"2024-04-20T10:59:23.410476+0000","last_fullsized":"2024-04-20T10:59:23.410476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:35.058810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"38'515","reported_seq":589,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.607025+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:59:28.607025+0000","last_peered":"2024-04-20T10:59:28.607025+0000","last_clean":"2024-04-20T10:59:28.607025+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:59:28.607025+0000","last_undegraded":"2024-04-20T10:59:28.607025+0000","last_fullsized":"2024-04-20T10:59:28.607025+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:08:01.532137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":32813,"num_write":465,"num_write_kb":12552,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"38'400","reported_seq":517,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641744+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:59:28.641744+0000","last_peered":"2024-04-20T10:59:28.641744+0000","last_clean":"2024-04-20T10:59:28.641744+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:59:28.641744+0000","last_undegraded":"2024-04-20T10:59:28.641744+0000","last_fullsized":"2024-04-20T10:59:28.641744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:42:07.143047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":57869,"num_write":367,"num_write_kb":80191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"38'424","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407502+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:59:23.407502+0000","last_peered":"2024-04-20T10:59:23.407502+0000","last_clean":"2024-04-20T10:59:23.407502+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:59:23.407502+0000","last_undegraded":"2024-04-20T10:59:23.407502+0000","last_fullsized":"2024-04-20T10:59:23.407502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62334,"num_write":402,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'166","reported_seq":233,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388592+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:59:20.388592+0000","last_peered":"2024-04-20T10:59:20.388592+0000","last_clean":"2024-04-20T10:59:20.388592+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:59:20.388592+0000","last_undegraded":"2024-04-20T10:59:20.388592+0000","last_fullsized":"2024-04-20T10:59:20.388592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":24616,"num_write":112,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"38'322","reported_seq":381,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.414032+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:59:30.414032+0000","last_peered":"2024-04-20T10:59:30.414032+0000","last_clean":"2024-04-20T10:59:30.414032+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:59:30.414032+0000","last_undegraded":"2024-04-20T10:59:30.414032+0000","last_fullsized":"2024-04-20T10:59:30.414032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:58.738620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":278,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"38'376","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633687+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:59:28.633687+0000","last_peered":"2024-04-20T10:59:28.633687+0000","last_clean":"2024-04-20T10:59:28.633687+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:59:28.633687+0000","last_undegraded":"2024-04-20T10:59:28.633687+0000","last_fullsized":"2024-04-20T10:59:28.633687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:08:25.137746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":25860,"num_write":345,"num_write_kb":47542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"38'388","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402878+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:59:23.402878+0000","last_peered":"2024-04-20T10:59:23.402878+0000","last_clean":"2024-04-20T10:59:23.402878+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:59:23.402878+0000","last_undegraded":"2024-04-20T10:59:23.402878+0000","last_fullsized":"2024-04-20T10:59:23.402878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":29836,"num_write":343,"num_write_kb":67451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"38'576","reported_seq":656,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383078+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:59:20.383078+0000","last_peered":"2024-04-20T10:59:20.383078+0000","last_clean":"2024-04-20T10:59:20.383078+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:59:20.383078+0000","last_undegraded":"2024-04-20T10:59:20.383078+0000","last_fullsized":"2024-04-20T10:59:20.383078+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:46:30.333228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35988,"num_write":517,"num_write_kb":12589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"38'65","reported_seq":108,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412464+0000","last_change":"2024-04-20T10:50:48.642004+0000","last_active":"2024-04-20T10:59:30.412464+0000","last_peered":"2024-04-20T10:59:30.412464+0000","last_clean":"2024-04-20T10:59:30.412464+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:59:30.412464+0000","last_undegraded":"2024-04-20T10:59:30.412464+0000","last_fullsized":"2024-04-20T10:59:30.412464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:16:08.127873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"38'406","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410400+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:59:30.410400+0000","last_peered":"2024-04-20T10:59:30.410400+0000","last_clean":"2024-04-20T10:59:30.410400+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:59:30.410400+0000","last_undegraded":"2024-04-20T10:59:30.410400+0000","last_fullsized":"2024-04-20T10:59:30.410400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:02.832174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":74646,"num_write":381,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'380","reported_seq":517,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387972+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:59:20.387972+0000","last_peered":"2024-04-20T10:59:20.387972+0000","last_clean":"2024-04-20T10:59:20.387972+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:59:20.387972+0000","last_undegraded":"2024-04-20T10:59:20.387972+0000","last_fullsized":"2024-04-20T10:59:20.387972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:34:48.724871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61041,"num_write":349,"num_write_kb":58639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"38'332","reported_seq":396,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:24.130660+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:59:24.130660+0000","last_peered":"2024-04-20T10:59:24.130660+0000","last_clean":"2024-04-20T10:59:24.130660+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:59:24.130660+0000","last_undegraded":"2024-04-20T10:59:24.130660+0000","last_fullsized":"2024-04-20T10:59:24.130660+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:29:19.882558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":4122,"num_write":282,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'149","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.899565+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:59:20.899565+0000","last_peered":"2024-04-20T10:59:20.899565+0000","last_clean":"2024-04-20T10:59:20.899565+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:59:20.899565+0000","last_undegraded":"2024-04-20T10:59:20.899565+0000","last_fullsized":"2024-04-20T10:59:20.899565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:53:00.154334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":45111,"num_write":81,"num_write_kb":8263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"38'468","reported_seq":597,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405389+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:59:30.405389+0000","last_peered":"2024-04-20T10:59:30.405389+0000","last_clean":"2024-04-20T10:59:30.405389+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:59:30.405389+0000","last_undegraded":"2024-04-20T10:59:30.405389+0000","last_fullsized":"2024-04-20T10:59:30.405389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:50:14.445660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":50494,"num_write":431,"num_write_kb":38868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"37'379","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386809+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:59:20.386809+0000","last_peered":"2024-04-20T10:59:20.386809+0000","last_clean":"2024-04-20T10:59:20.386809+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:59:20.386809+0000","last_undegraded":"2024-04-20T10:59:20.386809+0000","last_fullsized":"2024-04-20T10:59:20.386809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":58132,"num_write":347,"num_write_kb":59251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"37'174","reported_seq":226,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393492+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:59:20.393492+0000","last_peered":"2024-04-20T10:59:20.393492+0000","last_clean":"2024-04-20T10:59:20.393492+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:59:20.393492+0000","last_undegraded":"2024-04-20T10:59:20.393492+0000","last_fullsized":"2024-04-20T10:59:20.393492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:02:56.074284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":116,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"38'452","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.584992+0000","last_change":"2024-04-20T10:50:48.641344+0000","last_active":"2024-04-20T10:59:28.584992+0000","last_peered":"2024-04-20T10:59:28.584992+0000","last_clean":"2024-04-20T10:59:28.584992+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:59:28.584992+0000","last_undegraded":"2024-04-20T10:59:28.584992+0000","last_fullsized":"2024-04-20T10:59:28.584992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:25.600050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":8291,"num_write":401,"num_write_kb":8399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'436","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641887+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:59:28.641887+0000","last_peered":"2024-04-20T10:59:28.641887+0000","last_clean":"2024-04-20T10:59:28.641887+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:59:28.641887+0000","last_undegraded":"2024-04-20T10:59:28.641887+0000","last_fullsized":"2024-04-20T10:59:28.641887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":65641,"num_write":399,"num_write_kb":55375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"38'413","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392717+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:59:20.392717+0000","last_peered":"2024-04-20T10:59:20.392717+0000","last_clean":"2024-04-20T10:59:20.392717+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:59:20.392717+0000","last_undegraded":"2024-04-20T10:59:20.392717+0000","last_fullsized":"2024-04-20T10:59:20.392717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:54:26.671693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":35937,"num_write":378,"num_write_kb":46521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"37'65","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383939+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:59:20.383939+0000","last_peered":"2024-04-20T10:59:20.383939+0000","last_clean":"2024-04-20T10:59:20.383939+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:59:20.383939+0000","last_undegraded":"2024-04-20T10:59:20.383939+0000","last_fullsized":"2024-04-20T10:59:20.383939+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:03.665669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'63","reported_seq":106,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392568+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:59:20.392568+0000","last_peered":"2024-04-20T10:59:20.392568+0000","last_clean":"2024-04-20T10:59:20.392568+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:59:20.392568+0000","last_undegraded":"2024-04-20T10:59:20.392568+0000","last_fullsized":"2024-04-20T10:59:20.392568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:30.961757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"38'364","reported_seq":462,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636298+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:59:28.636298+0000","last_peered":"2024-04-20T10:59:28.636298+0000","last_clean":"2024-04-20T10:59:28.636298+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:59:28.636298+0000","last_undegraded":"2024-04-20T10:59:28.636298+0000","last_fullsized":"2024-04-20T10:59:28.636298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:11:45.766201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25276,"num_write":334,"num_write_kb":46079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'73","reported_seq":123,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387292+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:59:20.387292+0000","last_peered":"2024-04-20T10:59:20.387292+0000","last_clean":"2024-04-20T10:59:20.387292+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:59:20.387292+0000","last_undegraded":"2024-04-20T10:59:20.387292+0000","last_fullsized":"2024-04-20T10:59:20.387292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":32,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"38'418","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402123+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:59:23.402123+0000","last_peered":"2024-04-20T10:59:23.402123+0000","last_clean":"2024-04-20T10:59:23.402123+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:59:23.402123+0000","last_undegraded":"2024-04-20T10:59:23.402123+0000","last_fullsized":"2024-04-20T10:59:23.402123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:22.080551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":61851,"num_write":392,"num_write_kb":55373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"38'892","reported_seq":950,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392749+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:59:20.392749+0000","last_peered":"2024-04-20T10:59:20.392749+0000","last_clean":"2024-04-20T10:59:20.392749+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:59:20.392749+0000","last_undegraded":"2024-04-20T10:59:20.392749+0000","last_fullsized":"2024-04-20T10:59:20.392749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:40.008752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":834,"num_write_kb":8709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'413","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405817+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:59:30.405817+0000","last_peered":"2024-04-20T10:59:30.405817+0000","last_clean":"2024-04-20T10:59:30.405817+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:59:30.405817+0000","last_undegraded":"2024-04-20T10:59:30.405817+0000","last_fullsized":"2024-04-20T10:59:30.405817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49569,"num_write":377,"num_write_kb":64815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"38'54","reported_seq":115,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.556737+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:59:28.556737+0000","last_peered":"2024-04-20T10:59:28.556737+0000","last_clean":"2024-04-20T10:59:28.556737+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:59:28.556737+0000","last_undegraded":"2024-04-20T10:59:28.556737+0000","last_fullsized":"2024-04-20T10:59:28.556737+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:45:31.602717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":8,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"38'435","reported_seq":554,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391278+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:59:20.391278+0000","last_peered":"2024-04-20T10:59:20.391278+0000","last_clean":"2024-04-20T10:59:20.391278+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:59:20.391278+0000","last_undegraded":"2024-04-20T10:59:20.391278+0000","last_fullsized":"2024-04-20T10:59:20.391278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:21.160220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26261,"num_write":400,"num_write_kb":42830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"38'220","reported_seq":272,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393663+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:59:20.393663+0000","last_peered":"2024-04-20T10:59:20.393663+0000","last_clean":"2024-04-20T10:59:20.393663+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:59:20.393663+0000","last_undegraded":"2024-04-20T10:59:20.393663+0000","last_fullsized":"2024-04-20T10:59:20.393663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:48:07.381045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":166,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"38'369","reported_seq":465,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.643876+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:59:28.643876+0000","last_peered":"2024-04-20T10:59:28.643876+0000","last_clean":"2024-04-20T10:59:28.643876+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:59:28.643876+0000","last_undegraded":"2024-04-20T10:59:28.643876+0000","last_fullsized":"2024-04-20T10:59:28.643876+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:32.527030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31197,"num_write":338,"num_write_kb":64191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"36'448","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382658+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:59:20.382658+0000","last_peered":"2024-04-20T10:59:20.382658+0000","last_clean":"2024-04-20T10:59:20.382658+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:59:20.382658+0000","last_undegraded":"2024-04-20T10:59:20.382658+0000","last_fullsized":"2024-04-20T10:59:20.382658+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:01.087719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":384,"num_write_kb":12501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'379","reported_seq":515,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388144+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:59:20.388144+0000","last_peered":"2024-04-20T10:59:20.388144+0000","last_clean":"2024-04-20T10:59:20.388144+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:59:20.388144+0000","last_undegraded":"2024-04-20T10:59:20.388144+0000","last_fullsized":"2024-04-20T10:59:20.388144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52177,"num_write":354,"num_write_kb":79739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"38'581","reported_seq":637,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.623970+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:59:28.623970+0000","last_peered":"2024-04-20T10:59:28.623970+0000","last_clean":"2024-04-20T10:59:28.623970+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:59:28.623970+0000","last_undegraded":"2024-04-20T10:59:28.623970+0000","last_fullsized":"2024-04-20T10:59:28.623970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:02:00.098143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":12318,"num_write":526,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"38'403","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636902+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:59:28.636902+0000","last_peered":"2024-04-20T10:59:28.636902+0000","last_clean":"2024-04-20T10:59:28.636902+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:59:28.636902+0000","last_undegraded":"2024-04-20T10:59:28.636902+0000","last_fullsized":"2024-04-20T10:59:28.636902+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:48:22.137982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":104331,"num_write":376,"num_write_kb":109020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"36'181","reported_seq":237,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392436+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:59:20.392436+0000","last_peered":"2024-04-20T10:59:20.392436+0000","last_clean":"2024-04-20T10:59:20.392436+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:59:20.392436+0000","last_undegraded":"2024-04-20T10:59:20.392436+0000","last_fullsized":"2024-04-20T10:59:20.392436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:42:08.737627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":124,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'410","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386887+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:59:20.386887+0000","last_peered":"2024-04-20T10:59:20.386887+0000","last_clean":"2024-04-20T10:59:20.386887+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:59:20.386887+0000","last_undegraded":"2024-04-20T10:59:20.386887+0000","last_fullsized":"2024-04-20T10:59:20.386887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:38:35.233324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56637,"num_write":377,"num_write_kb":62852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"38'546","reported_seq":612,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.627865+0000","last_change":"2024-04-20T10:50:48.642075+0000","last_active":"2024-04-20T10:59:28.627865+0000","last_peered":"2024-04-20T10:59:28.627865+0000","last_clean":"2024-04-20T10:59:28.627865+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:59:28.627865+0000","last_undegraded":"2024-04-20T10:59:28.627865+0000","last_fullsized":"2024-04-20T10:59:28.627865+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":546,"log_dups_size":0,"ondisk_log_size":546,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:37:08.040493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":57371,"num_write":468,"num_write_kb":12517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"38'472","reported_seq":608,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401711+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:59:30.401711+0000","last_peered":"2024-04-20T10:59:30.401711+0000","last_clean":"2024-04-20T10:59:30.401711+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:59:30.401711+0000","last_undegraded":"2024-04-20T10:59:30.401711+0000","last_fullsized":"2024-04-20T10:59:30.401711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:36.095962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":77683,"num_write":435,"num_write_kb":89005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"38'421","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.381481+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:59:20.381481+0000","last_peered":"2024-04-20T10:59:20.381481+0000","last_clean":"2024-04-20T10:59:20.381481+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:59:20.381481+0000","last_undegraded":"2024-04-20T10:59:20.381481+0000","last_fullsized":"2024-04-20T10:59:20.381481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:57:40.627804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":50143,"num_write":396,"num_write_kb":67741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"38'423","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.406726+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:59:30.406726+0000","last_peered":"2024-04-20T10:59:30.406726+0000","last_clean":"2024-04-20T10:59:30.406726+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:59:30.406726+0000","last_undegraded":"2024-04-20T10:59:30.406726+0000","last_fullsized":"2024-04-20T10:59:30.406726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:55:33.099168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66334,"num_write":397,"num_write_kb":71356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"38'448","reported_seq":602,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380185+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:59:20.380185+0000","last_peered":"2024-04-20T10:59:20.380185+0000","last_clean":"2024-04-20T10:59:20.380185+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:59:20.380185+0000","last_undegraded":"2024-04-20T10:59:20.380185+0000","last_fullsized":"2024-04-20T10:59:20.380185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:41:59.010280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":105081,"num_write":414,"num_write_kb":80164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"38'397","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410925+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:59:30.410925+0000","last_peered":"2024-04-20T10:59:30.410925+0000","last_clean":"2024-04-20T10:59:30.410925+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:59:30.410925+0000","last_undegraded":"2024-04-20T10:59:30.410925+0000","last_fullsized":"2024-04-20T10:59:30.410925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:24:45.466418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":91923,"num_write":367,"num_write_kb":80227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"38'487","reported_seq":649,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.395042+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:59:20.395042+0000","last_peered":"2024-04-20T10:59:20.395042+0000","last_clean":"2024-04-20T10:59:20.395042+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:59:20.395042+0000","last_undegraded":"2024-04-20T10:59:20.395042+0000","last_fullsized":"2024-04-20T10:59:20.395042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:28.520100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":66889,"num_write":452,"num_write_kb":101085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"38'390","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645512+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:59:28.645512+0000","last_peered":"2024-04-20T10:59:28.645512+0000","last_clean":"2024-04-20T10:59:28.645512+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:59:28.645512+0000","last_undegraded":"2024-04-20T10:59:28.645512+0000","last_fullsized":"2024-04-20T10:59:28.645512+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:49:24.514517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":23315,"num_write":364,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"38'411","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401301+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:59:23.401301+0000","last_peered":"2024-04-20T10:59:23.401301+0000","last_clean":"2024-04-20T10:59:23.401301+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:59:23.401301+0000","last_undegraded":"2024-04-20T10:59:23.401301+0000","last_fullsized":"2024-04-20T10:59:23.401301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":34858,"num_write":375,"num_write_kb":71279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"38'438","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648687+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:59:28.648687+0000","last_peered":"2024-04-20T10:59:28.648687+0000","last_clean":"2024-04-20T10:59:28.648687+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:59:28.648687+0000","last_undegraded":"2024-04-20T10:59:28.648687+0000","last_fullsized":"2024-04-20T10:59:28.648687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":12465,"num_write":398,"num_write_kb":25863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"38'367","reported_seq":490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410600+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:59:23.410600+0000","last_peered":"2024-04-20T10:59:23.410600+0000","last_clean":"2024-04-20T10:59:23.410600+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:59:23.410600+0000","last_undegraded":"2024-04-20T10:59:23.410600+0000","last_fullsized":"2024-04-20T10:59:23.410600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:33:35.966437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40934,"num_write":339,"num_write_kb":54699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"38'400","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.400228+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:59:30.400228+0000","last_peered":"2024-04-20T10:59:30.400228+0000","last_clean":"2024-04-20T10:59:30.400228+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:59:30.400228+0000","last_undegraded":"2024-04-20T10:59:30.400228+0000","last_fullsized":"2024-04-20T10:59:30.400228+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:00:45.823279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":17066,"num_write":365,"num_write_kb":46558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"37'404","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394135+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:59:20.394135+0000","last_peered":"2024-04-20T10:59:20.394135+0000","last_clean":"2024-04-20T10:59:20.394135+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:59:20.394135+0000","last_undegraded":"2024-04-20T10:59:20.394135+0000","last_fullsized":"2024-04-20T10:59:20.394135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:31.935998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64800,"num_write":371,"num_write_kb":91764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"38'402","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649072+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:59:28.649072+0000","last_peered":"2024-04-20T10:59:28.649072+0000","last_clean":"2024-04-20T10:59:28.649072+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:59:28.649072+0000","last_undegraded":"2024-04-20T10:59:28.649072+0000","last_fullsized":"2024-04-20T10:59:28.649072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1607,"num_write":370,"num_write_kb":5819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"38'433","reported_seq":570,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.735059+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:59:21.735059+0000","last_peered":"2024-04-20T10:59:21.735059+0000","last_clean":"2024-04-20T10:59:21.735059+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:59:21.735059+0000","last_undegraded":"2024-04-20T10:59:21.735059+0000","last_fullsized":"2024-04-20T10:59:21.735059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:27.563912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":4096,"num_write":399,"num_write_kb":30569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"38'439","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648218+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:59:28.648218+0000","last_peered":"2024-04-20T10:59:28.648218+0000","last_clean":"2024-04-20T10:59:28.648218+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:59:28.648218+0000","last_undegraded":"2024-04-20T10:59:28.648218+0000","last_fullsized":"2024-04-20T10:59:28.648218+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:13:04.656192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":70131,"num_write":400,"num_write_kb":59168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"38'431","reported_seq":582,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.398797+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:59:23.398797+0000","last_peered":"2024-04-20T10:59:23.398797+0000","last_clean":"2024-04-20T10:59:23.398797+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:59:23.398797+0000","last_undegraded":"2024-04-20T10:59:23.398797+0000","last_fullsized":"2024-04-20T10:59:23.398797+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:46:47.004965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":77347,"num_write":407,"num_write_kb":71895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"38'408","reported_seq":520,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411133+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:59:30.411133+0000","last_peered":"2024-04-20T10:59:30.411133+0000","last_clean":"2024-04-20T10:59:30.411133+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:59:30.411133+0000","last_undegraded":"2024-04-20T10:59:30.411133+0000","last_fullsized":"2024-04-20T10:59:30.411133+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:13:19.890412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":43744,"num_write":370,"num_write_kb":63188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"38'456","reported_seq":613,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410206+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:59:23.410206+0000","last_peered":"2024-04-20T10:59:23.410206+0000","last_clean":"2024-04-20T10:59:23.410206+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:59:23.410206+0000","last_undegraded":"2024-04-20T10:59:23.410206+0000","last_fullsized":"2024-04-20T10:59:23.410206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:23:17.938463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63871,"num_write":428,"num_write_kb":100114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"38'419","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401609+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:59:30.401609+0000","last_peered":"2024-04-20T10:59:30.401609+0000","last_clean":"2024-04-20T10:59:30.401609+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:59:30.401609+0000","last_undegraded":"2024-04-20T10:59:30.401609+0000","last_fullsized":"2024-04-20T10:59:30.401609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":38962,"num_write":387,"num_write_kb":79793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"38'398","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401652+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:59:23.401652+0000","last_peered":"2024-04-20T10:59:23.401652+0000","last_clean":"2024-04-20T10:59:23.401652+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:59:23.401652+0000","last_undegraded":"2024-04-20T10:59:23.401652+0000","last_fullsized":"2024-04-20T10:59:23.401652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:22:42.177291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":27738,"num_write":360,"num_write_kb":54944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"38'458","reported_seq":577,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380662+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:59:20.380662+0000","last_peered":"2024-04-20T10:59:20.380662+0000","last_clean":"2024-04-20T10:59:20.380662+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:59:20.380662+0000","last_undegraded":"2024-04-20T10:59:20.380662+0000","last_fullsized":"2024-04-20T10:59:20.380662+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:28:09.768611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":59920,"num_write":425,"num_write_kb":71046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"37'439","reported_seq":599,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392443+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:59:20.392443+0000","last_peered":"2024-04-20T10:59:20.392443+0000","last_clean":"2024-04-20T10:59:20.392443+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:59:20.392443+0000","last_undegraded":"2024-04-20T10:59:20.392443+0000","last_fullsized":"2024-04-20T10:59:20.392443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:32.394600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":95905,"num_write":408,"num_write_kb":92283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"38'434","reported_seq":561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.630311+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:59:28.630311+0000","last_peered":"2024-04-20T10:59:28.630311+0000","last_clean":"2024-04-20T10:59:28.630311+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:59:28.630311+0000","last_undegraded":"2024-04-20T10:59:28.630311+0000","last_fullsized":"2024-04-20T10:59:28.630311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:14.736493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66507,"num_write":387,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"38'427","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410629+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:59:23.410629+0000","last_peered":"2024-04-20T10:59:23.410629+0000","last_clean":"2024-04-20T10:59:23.410629+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:59:23.410629+0000","last_undegraded":"2024-04-20T10:59:23.410629+0000","last_fullsized":"2024-04-20T10:59:23.410629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":76500,"num_write":396,"num_write_kb":108707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"38'451","reported_seq":611,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644728+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:59:28.644728+0000","last_peered":"2024-04-20T10:59:28.644728+0000","last_clean":"2024-04-20T10:59:28.644728+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:59:28.644728+0000","last_undegraded":"2024-04-20T10:59:28.644728+0000","last_fullsized":"2024-04-20T10:59:28.644728+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:18.313924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":149375,"num_write":423,"num_write_kb":104932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"36'447","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382311+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:59:20.382311+0000","last_peered":"2024-04-20T10:59:20.382311+0000","last_clean":"2024-04-20T10:59:20.382311+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:59:20.382311+0000","last_undegraded":"2024-04-20T10:59:20.382311+0000","last_fullsized":"2024-04-20T10:59:20.382311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:38:15.116632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":47044,"num_write":422,"num_write_kb":50901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"38'415","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.644572+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:59:28.644572+0000","last_peered":"2024-04-20T10:59:28.644572+0000","last_clean":"2024-04-20T10:59:28.644572+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:59:28.644572+0000","last_undegraded":"2024-04-20T10:59:28.644572+0000","last_fullsized":"2024-04-20T10:59:28.644572+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:13:52.821094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":91214,"num_write":375,"num_write_kb":63780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"37'461","reported_seq":625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393370+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:59:20.393370+0000","last_peered":"2024-04-20T10:59:20.393370+0000","last_clean":"2024-04-20T10:59:20.393370+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:59:20.393370+0000","last_undegraded":"2024-04-20T10:59:20.393370+0000","last_fullsized":"2024-04-20T10:59:20.393370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":88844,"num_write":432,"num_write_kb":122405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"38'475","reported_seq":632,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411714+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:59:30.411714+0000","last_peered":"2024-04-20T10:59:30.411714+0000","last_clean":"2024-04-20T10:59:30.411714+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:59:30.411714+0000","last_undegraded":"2024-04-20T10:59:30.411714+0000","last_fullsized":"2024-04-20T10:59:30.411714+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:43:54.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":92351,"num_write":448,"num_write_kb":96949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"38'395","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408704+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:59:23.408704+0000","last_peered":"2024-04-20T10:59:23.408704+0000","last_clean":"2024-04-20T10:59:23.408704+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:59:23.408704+0000","last_undegraded":"2024-04-20T10:59:23.408704+0000","last_fullsized":"2024-04-20T10:59:23.408704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:41:34.092848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":19688,"num_write":355,"num_write_kb":13664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"38'415","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612674+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:59:28.612674+0000","last_peered":"2024-04-20T10:59:28.612674+0000","last_clean":"2024-04-20T10:59:28.612674+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:59:28.612674+0000","last_undegraded":"2024-04-20T10:59:28.612674+0000","last_fullsized":"2024-04-20T10:59:28.612674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":48111,"num_write":381,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"38'397","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399907+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:59:23.399907+0000","last_peered":"2024-04-20T10:59:23.399907+0000","last_clean":"2024-04-20T10:59:23.399907+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:59:23.399907+0000","last_undegraded":"2024-04-20T10:59:23.399907+0000","last_fullsized":"2024-04-20T10:59:23.399907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:20.927885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":17103,"num_write":369,"num_write_kb":54677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"38'400","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635768+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:59:28.635768+0000","last_peered":"2024-04-20T10:59:28.635768+0000","last_clean":"2024-04-20T10:59:28.635768+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:59:28.635768+0000","last_undegraded":"2024-04-20T10:59:28.635768+0000","last_fullsized":"2024-04-20T10:59:28.635768+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:55:10.285574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":100212,"num_write":371,"num_write_kb":79700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"38'442","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399450+0000","last_change":"2024-04-20T10:51:20.873976+0000","last_active":"2024-04-20T10:59:23.399450+0000","last_peered":"2024-04-20T10:59:23.399450+0000","last_clean":"2024-04-20T10:59:23.399450+0000","last_became_active":"2024-04-20T10:51:20.873636+0000","last_became_peered":"2024-04-20T10:51:20.873636+0000","last_unstale":"2024-04-20T10:59:23.399450+0000","last_undegraded":"2024-04-20T10:59:23.399450+0000","last_fullsized":"2024-04-20T10:59:23.399450+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:25:44.190342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42670,"num_write":410,"num_write_kb":59228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"38'412","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:29.333860+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:59:29.333860+0000","last_peered":"2024-04-20T10:59:29.333860+0000","last_clean":"2024-04-20T10:59:29.333860+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:59:29.333860+0000","last_undegraded":"2024-04-20T10:59:29.333860+0000","last_fullsized":"2024-04-20T10:59:29.333860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:23:23.953878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":47914,"num_write":385,"num_write_kb":47165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"38'402","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391617+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:59:20.391617+0000","last_peered":"2024-04-20T10:59:20.391617+0000","last_clean":"2024-04-20T10:59:20.391617+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:59:20.391617+0000","last_undegraded":"2024-04-20T10:59:20.391617+0000","last_fullsized":"2024-04-20T10:59:20.391617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:05.896345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":39185,"num_write":369,"num_write_kb":42800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"38'382","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.399818+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:59:30.399818+0000","last_peered":"2024-04-20T10:59:30.399818+0000","last_clean":"2024-04-20T10:59:30.399818+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:59:30.399818+0000","last_undegraded":"2024-04-20T10:59:30.399818+0000","last_fullsized":"2024-04-20T10:59:30.399818+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:29:05.790739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":54933,"num_write":350,"num_write_kb":63813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"37'409","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386301+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:59:20.386301+0000","last_peered":"2024-04-20T10:59:20.386301+0000","last_clean":"2024-04-20T10:59:20.386301+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:59:20.386301+0000","last_undegraded":"2024-04-20T10:59:20.386301+0000","last_fullsized":"2024-04-20T10:59:20.386301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":25358,"num_write":380,"num_write_kb":59236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"38'401","reported_seq":510,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649095+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:59:28.649095+0000","last_peered":"2024-04-20T10:59:28.649095+0000","last_clean":"2024-04-20T10:59:28.649095+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:59:28.649095+0000","last_undegraded":"2024-04-20T10:59:28.649095+0000","last_fullsized":"2024-04-20T10:59:28.649095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":46490,"num_write":386,"num_write_kb":55187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"38'404","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391974+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:59:20.391974+0000","last_peered":"2024-04-20T10:59:20.391974+0000","last_clean":"2024-04-20T10:59:20.391974+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:59:20.391974+0000","last_undegraded":"2024-04-20T10:59:20.391974+0000","last_fullsized":"2024-04-20T10:59:20.391974+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:24:54.874843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":60998,"num_write":371,"num_write_kb":104269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"38'390","reported_seq":492,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.635398+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:59:28.635398+0000","last_peered":"2024-04-20T10:59:28.635398+0000","last_clean":"2024-04-20T10:59:28.635398+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:59:28.635398+0000","last_undegraded":"2024-04-20T10:59:28.635398+0000","last_fullsized":"2024-04-20T10:59:28.635398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:17:28.270301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":9157,"num_write":355,"num_write_kb":25794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"38'351","reported_seq":480,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399206+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:59:23.399206+0000","last_peered":"2024-04-20T10:59:23.399206+0000","last_clean":"2024-04-20T10:59:23.399206+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:59:23.399206+0000","last_undegraded":"2024-04-20T10:59:23.399206+0000","last_fullsized":"2024-04-20T10:59:23.399206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:19:59.025454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":63467,"num_write":328,"num_write_kb":42600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"38'381","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646486+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:59:28.646486+0000","last_peered":"2024-04-20T10:59:28.646486+0000","last_clean":"2024-04-20T10:59:28.646486+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:59:28.646486+0000","last_undegraded":"2024-04-20T10:59:28.646486+0000","last_fullsized":"2024-04-20T10:59:28.646486+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:29:09.016239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":28672,"num_write":342,"num_write_kb":50404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"38'364","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383016+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:59:20.383016+0000","last_peered":"2024-04-20T10:59:20.383016+0000","last_clean":"2024-04-20T10:59:20.383016+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:59:20.383016+0000","last_undegraded":"2024-04-20T10:59:20.383016+0000","last_fullsized":"2024-04-20T10:59:20.383016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:05:43.257283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":12730,"num_write":348,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"38'424","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.402605+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:59:30.402605+0000","last_peered":"2024-04-20T10:59:30.402605+0000","last_clean":"2024-04-20T10:59:30.402605+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:59:30.402605+0000","last_undegraded":"2024-04-20T10:59:30.402605+0000","last_fullsized":"2024-04-20T10:59:30.402605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":7385,"num_write":393,"num_write_kb":42181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"38'399","reported_seq":540,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382905+0000","last_change":"2024-04-20T10:51:20.769699+0000","last_active":"2024-04-20T10:59:20.382905+0000","last_peered":"2024-04-20T10:59:20.382905+0000","last_clean":"2024-04-20T10:59:20.382905+0000","last_became_active":"2024-04-20T10:51:20.769384+0000","last_became_peered":"2024-04-20T10:51:20.769384+0000","last_unstale":"2024-04-20T10:59:20.382905+0000","last_undegraded":"2024-04-20T10:59:20.382905+0000","last_fullsized":"2024-04-20T10:59:20.382905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:57:56.261004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71394,"num_write":379,"num_write_kb":96385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"38'436","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391041+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:59:20.391041+0000","last_peered":"2024-04-20T10:59:20.391041+0000","last_clean":"2024-04-20T10:59:20.391041+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:59:20.391041+0000","last_undegraded":"2024-04-20T10:59:20.391041+0000","last_fullsized":"2024-04-20T10:59:20.391041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:05:13.550357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":70925,"num_write":402,"num_write_kb":100628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"38'423","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.380992+0000","last_change":"2024-04-20T10:51:20.841991+0000","last_active":"2024-04-20T10:59:20.380992+0000","last_peered":"2024-04-20T10:59:20.380992+0000","last_clean":"2024-04-20T10:59:20.380992+0000","last_became_active":"2024-04-20T10:51:20.841719+0000","last_became_peered":"2024-04-20T10:51:20.841719+0000","last_unstale":"2024-04-20T10:59:20.380992+0000","last_undegraded":"2024-04-20T10:59:20.380992+0000","last_fullsized":"2024-04-20T10:59:20.380992+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:09:17.891373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":49916,"num_write":398,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"38'473","reported_seq":605,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633509+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:59:28.633509+0000","last_peered":"2024-04-20T10:59:28.633509+0000","last_clean":"2024-04-20T10:59:28.633509+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:59:28.633509+0000","last_undegraded":"2024-04-20T10:59:28.633509+0000","last_fullsized":"2024-04-20T10:59:28.633509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:26:19.727546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":134201,"num_write":442,"num_write_kb":141769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"38'414","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406887+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:59:23.406887+0000","last_peered":"2024-04-20T10:59:23.406887+0000","last_clean":"2024-04-20T10:59:23.406887+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:59:23.406887+0000","last_undegraded":"2024-04-20T10:59:23.406887+0000","last_fullsized":"2024-04-20T10:59:23.406887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:19:57.492030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":129245,"num_write":382,"num_write_kb":126738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"38'443","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.633493+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:59:28.633493+0000","last_peered":"2024-04-20T10:59:28.633493+0000","last_clean":"2024-04-20T10:59:28.633493+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:59:28.633493+0000","last_undegraded":"2024-04-20T10:59:28.633493+0000","last_fullsized":"2024-04-20T10:59:28.633493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:15.876144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":98132,"num_write":412,"num_write_kb":88980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"38'431","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390443+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:59:20.390443+0000","last_peered":"2024-04-20T10:59:20.390443+0000","last_clean":"2024-04-20T10:59:20.390443+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:59:20.390443+0000","last_undegraded":"2024-04-20T10:59:20.390443+0000","last_fullsized":"2024-04-20T10:59:20.390443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":82367,"num_write":405,"num_write_kb":88791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"38'369","reported_seq":469,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.408544+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:59:30.408544+0000","last_peered":"2024-04-20T10:59:30.408544+0000","last_clean":"2024-04-20T10:59:30.408544+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:59:30.408544+0000","last_undegraded":"2024-04-20T10:59:30.408544+0000","last_fullsized":"2024-04-20T10:59:30.408544+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:59:21.718707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":17428,"num_write":337,"num_write_kb":30562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"38'375","reported_seq":483,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399602+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:59:23.399602+0000","last_peered":"2024-04-20T10:59:23.399602+0000","last_clean":"2024-04-20T10:59:23.399602+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:59:23.399602+0000","last_undegraded":"2024-04-20T10:59:23.399602+0000","last_fullsized":"2024-04-20T10:59:23.399602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:14:43.648847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":12288,"num_write":347,"num_write_kb":45028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"38'368","reported_seq":470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645244+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:59:28.645244+0000","last_peered":"2024-04-20T10:59:28.645244+0000","last_clean":"2024-04-20T10:59:28.645244+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:59:28.645244+0000","last_undegraded":"2024-04-20T10:59:28.645244+0000","last_fullsized":"2024-04-20T10:59:28.645244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:13:13.368928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":42400,"num_write":337,"num_write_kb":50456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"38'435","reported_seq":585,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390827+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:59:20.390827+0000","last_peered":"2024-04-20T10:59:20.390827+0000","last_clean":"2024-04-20T10:59:20.390827+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:59:20.390827+0000","last_undegraded":"2024-04-20T10:59:20.390827+0000","last_fullsized":"2024-04-20T10:59:20.390827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":60266,"num_write":401,"num_write_kb":64358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"38'402","reported_seq":519,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401638+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:59:30.401638+0000","last_peered":"2024-04-20T10:59:30.401638+0000","last_clean":"2024-04-20T10:59:30.401638+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:59:30.401638+0000","last_undegraded":"2024-04-20T10:59:30.401638+0000","last_fullsized":"2024-04-20T10:59:30.401638+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:43.474051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58110,"num_write":372,"num_write_kb":67566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"38'410","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402471+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:59:23.402471+0000","last_peered":"2024-04-20T10:59:23.402471+0000","last_clean":"2024-04-20T10:59:23.402471+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:59:23.402471+0000","last_undegraded":"2024-04-20T10:59:23.402471+0000","last_fullsized":"2024-04-20T10:59:23.402471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:46:46.752966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":40406,"num_write":376,"num_write_kb":72310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"38'423","reported_seq":540,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646095+0000","last_change":"2024-04-20T10:50:49.640857+0000","last_active":"2024-04-20T10:59:28.646095+0000","last_peered":"2024-04-20T10:59:28.646095+0000","last_clean":"2024-04-20T10:59:28.646095+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:59:28.646095+0000","last_undegraded":"2024-04-20T10:59:28.646095+0000","last_fullsized":"2024-04-20T10:59:28.646095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:50:11.455419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48634,"num_write":394,"num_write_kb":56270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"37'391","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386768+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:59:20.386768+0000","last_peered":"2024-04-20T10:59:20.386768+0000","last_clean":"2024-04-20T10:59:20.386768+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:59:20.386768+0000","last_undegraded":"2024-04-20T10:59:20.386768+0000","last_fullsized":"2024-04-20T10:59:20.386768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":67210,"num_write":369,"num_write_kb":63933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"38'365","reported_seq":475,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405357+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:59:30.405357+0000","last_peered":"2024-04-20T10:59:30.405357+0000","last_clean":"2024-04-20T10:59:30.405357+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:59:30.405357+0000","last_undegraded":"2024-04-20T10:59:30.405357+0000","last_fullsized":"2024-04-20T10:59:30.405357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":38197,"num_write":324,"num_write_kb":43133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'436","reported_seq":574,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390287+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:59:20.390287+0000","last_peered":"2024-04-20T10:59:20.390287+0000","last_clean":"2024-04-20T10:59:20.390287+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:59:20.390287+0000","last_undegraded":"2024-04-20T10:59:20.390287+0000","last_fullsized":"2024-04-20T10:59:20.390287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:22:12.552155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":82231,"num_write":413,"num_write_kb":104966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"38'435","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648841+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:59:28.648841+0000","last_peered":"2024-04-20T10:59:28.648841+0000","last_clean":"2024-04-20T10:59:28.648841+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:59:28.648841+0000","last_undegraded":"2024-04-20T10:59:28.648841+0000","last_fullsized":"2024-04-20T10:59:28.648841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78016,"num_write":409,"num_write_kb":101239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"37'379","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392424+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:59:20.392424+0000","last_peered":"2024-04-20T10:59:20.392424+0000","last_clean":"2024-04-20T10:59:20.392424+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:59:20.392424+0000","last_undegraded":"2024-04-20T10:59:20.392424+0000","last_fullsized":"2024-04-20T10:59:20.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":25535,"num_write":356,"num_write_kb":38136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4810,"num_read_kb":3595152,"num_write":24379,"num_write_kb":4256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26481,"ondisk_log_size":26481,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":149799644,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":809,"num_read_kb":507129,"num_write":8083,"num_write_kb":153175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299663360,"data_stored":299599288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9473,"ondisk_log_size":9473,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5724,"num_read_kb":3353332,"num_write":24442,"num_write_kb":4400565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26386,"ondisk_log_size":26386,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151049735,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":699,"num_read_kb":394566,"num_write":7750,"num_write_kb":153909,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302161920,"data_stored":302099470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9158,"ondisk_log_size":9158,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574962,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126660,"kb_used_data":77436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94245180,"statfs":{"total":96636764160,"available":96507064320,"internally_reserved":0,"allocated":79294464,"data_stored":79053534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130184,"kb_used_data":80960,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94241656,"statfs":{"total":96636764160,"available":96503455744,"internally_reserved":0,"allocated":82903040,"data_stored":82658086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123880,"kb_used_data":52512,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94247960,"statfs":{"total":96636764160,"available":96509911040,"internally_reserved":0,"allocated":53772288,"data_stored":53529519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574963,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177172,"kb_used_data":96076,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94194668,"statfs":{"total":96636764160,"available":96455340032,"internally_reserved":0,"allocated":98381824,"data_stored":98133898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574963,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185380,"kb_used_data":104284,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94186460,"statfs":{"total":96636764160,"available":96446935040,"internally_reserved":0,"allocated":106786816,"data_stored":106540719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574963,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71508,"kb_used_data":26444,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94300332,"statfs":{"total":96636764160,"available":96563539968,"internally_reserved":0,"allocated":27078656,"data_stored":26847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189528,"kb_used_data":108432,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94182312,"statfs":{"total":96636764160,"available":96442687488,"internally_reserved":0,"allocated":111034368,"data_stored":110784766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574963,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95288,"kb_used_data":46064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94276552,"statfs":{"total":96636764160,"available":96539189248,"internally_reserved":0,"allocated":47169536,"data_stored":46927925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14065664,"data_stored":14065090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35045376,"data_stored":35037282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48914432,"data_stored":48903463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57298944,"data_stored":57291981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":68657152,"data_stored":68641991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51796853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23982080,"data_stored":23969726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:59:47.335 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T10:59:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.464+0000 7f70a2c9a640 1 Processor -- start 2024-04-20T10:59:47.464 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.464+0000 7f70a2c9a640 1 -- start start 2024-04-20T10:59:47.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.464+0000 7f70a2c9a640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f709c151b40 0x7f709c158810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a2c9a640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0704c0 con 0x7f709c0c6040 2024-04-20T10:59:47.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a2c9a640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0731b0 con 0x7f709c06ff90 2024-04-20T10:59:47.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a2c9a640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f709c073800 con 0x7f709c151b40 2024-04-20T10:59:47.465 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a0a36640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f709c151b40 0x7f709c158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a1237640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f709c0c6040 0x7f709c0c64a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48376/0 (socket says 172.21.15.90:48376) 2024-04-20T10:59:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a1237640 1 -- 172.21.15.90:0/3388213460 learned_addr learned my addr 172.21.15.90:0/3388213460 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a0a36640 1 -- 172.21.15.90:0/3388213460 >> v1:172.21.15.175:6789/0 conn(0x7f709c06ff90 legacy=0x7f709c157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a0a36640 1 -- 172.21.15.90:0/3388213460 >> v1:172.21.15.90:6789/0 conn(0x7f709c0c6040 legacy=0x7f709c0c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.466 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.465+0000 7f70a0a36640 1 -- 172.21.15.90:0/3388213460 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c073490 con 0x7f709c151b40 2024-04-20T10:59:47.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.466+0000 7f70a0a36640 1 --2- 172.21.15.90:0/3388213460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c151b40 0x7f709c158810 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f709c073980 tx=0x7f709002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e473e269565faed server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:47.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.466+0000 7f709b7fe640 1 -- 172.21.15.90:0/3388213460 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090038070 con 0x7f709c151b40 2024-04-20T10:59:47.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.466+0000 7f709b7fe640 1 -- 172.21.15.90:0/3388213460 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7090031700 con 0x7f709c151b40 2024-04-20T10:59:47.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.466+0000 7f709b7fe640 1 -- 172.21.15.90:0/3388213460 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090031ad0 con 0x7f709c151b40 2024-04-20T10:59:47.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.467+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3388213460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c151b40 msgr2=0x7f709c158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.467+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3388213460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c151b40 0x7f709c158810 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f709c073980 tx=0x7f709002b7a0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.467 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.467+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3388213460 shutdown_connections 2024-04-20T10:59:47.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.467+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3388213460 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c151b40 0x7f709c158810 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.467+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3388213460 >> 172.21.15.90:0/3388213460 conn(0x7f709c0676c0 msgr2=0x7f709c067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:47.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.467+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3388213460 shutdown_connections 2024-04-20T10:59:47.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.467+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3388213460 wait complete. 2024-04-20T10:59:47.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 Processor -- start 2024-04-20T10:59:47.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 -- start start 2024-04-20T10:59:47.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c06ff90 0x7f709c0c3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f709c0c6040 0x7f709c1f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f709c151b40 0x7f709c14cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.470 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0c6d30 con 0x7f709c06ff90 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f709c0c6bb0 con 0x7f709c0c6040 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.468+0000 7f70a2c9a640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f709c151f20 con 0x7f709c151b40 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c06ff90 0x7f709c0c3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c06ff90 0x7f709c0c3850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52016/0 (socket says 172.21.15.90:52016) 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 -- 172.21.15.90:0/3907585025 learned_addr learned my addr 172.21.15.90:0/3907585025 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a1237640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f709c151b40 0x7f709c14cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f709bfff640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f709c0c6040 0x7f709c1f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 -- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f709c151b40 msgr2=0x7f709c14cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f709c151b40 0x7f709c14cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 -- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f709c0c6040 msgr2=0x7f709c1f0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f709c0c6040 0x7f709c1f0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 -- 172.21.15.90:0/3907585025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c14b810 con 0x7f709c06ff90 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f709bfff640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f709c0c6040 0x7f709c1f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:47.471 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a0a36640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c06ff90 0x7f709c0c3850 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7090009890 tx=0x7f70900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:47.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70997fa640 1 -- 172.21.15.90:0/3907585025 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090043070 con 0x7f709c06ff90 2024-04-20T10:59:47.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70997fa640 1 -- 172.21.15.90:0/3907585025 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7090033a30 con 0x7f709c06ff90 2024-04-20T10:59:47.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c1f0370 con 0x7f709c06ff90 2024-04-20T10:59:47.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70997fa640 1 -- 172.21.15.90:0/3907585025 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7090038040 con 0x7f709c06ff90 2024-04-20T10:59:47.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.469+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c06e260 con 0x7f709c06ff90 2024-04-20T10:59:47.472 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.470+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f709c06fd50 con 0x7f709c06ff90 2024-04-20T10:59:47.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.471+0000 7f70997fa640 1 -- 172.21.15.90:0/3907585025 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7090046070 con 0x7f709c06ff90 2024-04-20T10:59:47.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.471+0000 7f70997fa640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708006c920 0x7f708006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:47.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.471+0000 7f70997fa640 1 -- 172.21.15.90:0/3907585025 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f70900adf80 con 0x7f709c06ff90 2024-04-20T10:59:47.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.471+0000 7f709bfff640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708006c920 0x7f708006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:47.473 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.472+0000 7f709bfff640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708006c920 0x7f708006ede0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7088006fd0 tx=0x7f7088008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:47.475 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.475+0000 7f70997fa640 1 -- 172.21.15.90:0/3907585025 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f709c06fd50 con 0x7f709c06ff90 2024-04-20T10:59:47.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.652+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f709c06edf0 con 0x7f709c06ff90 2024-04-20T10:59:47.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.653+0000 7f70997fa640 1 -- 172.21.15.90:0/3907585025 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+22023 (secure 0 0 0) 0x7f709c06edf0 con 0x7f709c06ff90 2024-04-20T10:59:47.654 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:47.654 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:59:20.376229+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6834/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6833/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.175:6833/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.90:6835/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6834/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6837/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.90:6837/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.90:6835/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.175:6835/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6836/1538296646":"2024-04-21T10:55:30.341595+0000","172.21.15.90:6836/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.175:6832/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6836/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.175:6832/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.175:6833/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6834/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.175:6832/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.90:6834/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.90:6834/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.90:6837/1538296646":"2024-04-21T10:55:30.341595+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708006c920 msgr2=0x7f708006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708006c920 0x7f708006ede0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f7088006fd0 tx=0x7f7088008040 comp rx=0 tx=0).stop 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c06ff90 msgr2=0x7f709c0c3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c06ff90 0x7f709c0c3850 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f7090009890 tx=0x7f70900046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 shutdown_connections 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f708006c920 0x7f708006ede0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f709c151b40 0x7f709c14cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f709c0c6040 0x7f709c1f0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 --2- 172.21.15.90:0/3907585025 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f709c06ff90 0x7f709c0c3850 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 >> 172.21.15.90:0/3907585025 conn(0x7f709c0676c0 msgr2=0x7f709c14fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 shutdown_connections 2024-04-20T10:59:47.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:47.655+0000 7f70a2c9a640 1 -- 172.21.15.90:0/3907585025 wait complete. 2024-04-20T10:59:48.667 INFO:tasks.ceph:Scrubbing osd.0 2024-04-20T10:59:48.668 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:48.778 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.778+0000 7f6587477640 1 Processor -- start 2024-04-20T10:59:48.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.778+0000 7f6587477640 1 -- start start 2024-04-20T10:59:48.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6587477640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f6580153fe0 0x7f65800c3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6587477640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65800c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6587477640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65800c2ee0 con 0x7f65800c3f30 2024-04-20T10:59:48.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6587477640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f65800c2c90 con 0x7f6580153fe0 2024-04-20T10:59:48.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6587477640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f65800c31c0 con 0x7f65800c25d0 2024-04-20T10:59:48.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6585a14640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f65800c3f30 0x7f6580156a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48388/0 (socket says 172.21.15.90:48388) 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6585a14640 1 -- 172.21.15.90:0/1865438070 learned_addr learned my addr 172.21.15.90:0/1865438070 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6584a12640 1 --2- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65800c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6585213640 1 --2- 172.21.15.90:0/1865438070 >> v2:172.21.15.175:3300/0 conn(0x7f6580153fe0 0x7f65800c3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.779+0000 7f6577fff640 1 -- 172.21.15.90:0/1865438070 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933837664 0 0) 0x7f65800c2ee0 con 0x7f65800c3f30 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.780+0000 7f6577fff640 1 -- 172.21.15.90:0/1865438070 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f656c003520 con 0x7f65800c3f30 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.780+0000 7f6577fff640 1 -- 172.21.15.90:0/1865438070 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2906503810 0 0) 0x7f656c003520 con 0x7f65800c3f30 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.780+0000 7f6585213640 1 -- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 msgr2=0x7f65800c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.780+0000 7f6585213640 1 --2- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65800c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.780+0000 7f6585213640 1 -- 172.21.15.90:0/1865438070 >> v1:172.21.15.90:6789/0 conn(0x7f65800c3f30 legacy=0x7f6580156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.780+0000 7f6585213640 1 -- 172.21.15.90:0/1865438070 --> v2:172.21.15.175:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65800c17f0 con 0x7f6580153fe0 2024-04-20T10:59:48.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.780+0000 7f6584a12640 1 --2- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65800c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:48.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6585213640 1 --2- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6580153fe0 0x7f65800c3390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f657c0097a0 tx=0x7f657c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=654dfd0eb10b41d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:48.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6577fff640 1 -- 172.21.15.90:0/1865438070 <== mon.1 v2:172.21.15.175:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f657c037070 con 0x7f6580153fe0 2024-04-20T10:59:48.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6577fff640 1 -- 172.21.15.90:0/1865438070 <== mon.1 v2:172.21.15.175:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f657c030510 con 0x7f6580153fe0 2024-04-20T10:59:48.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6577fff640 1 -- 172.21.15.90:0/1865438070 <== mon.1 v2:172.21.15.175:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780019f0 con 0x7f6580153fe0 2024-04-20T10:59:48.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6587477640 1 -- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6580153fe0 msgr2=0x7f65800c3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6587477640 1 --2- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6580153fe0 0x7f65800c3390 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f657c0097a0 tx=0x7f657c02b710 comp rx=0 tx=0).stop 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6587477640 1 -- 172.21.15.90:0/1865438070 shutdown_connections 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6587477640 1 --2- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65800c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6587477640 1 --2- 172.21.15.90:0/1865438070 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6580153fe0 0x7f65800c3390 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.781+0000 7f6587477640 1 -- 172.21.15.90:0/1865438070 >> 172.21.15.90:0/1865438070 conn(0x7f658006b930 msgr2=0x7f658006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.782+0000 7f6587477640 1 -- 172.21.15.90:0/1865438070 shutdown_connections 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.782+0000 7f6587477640 1 -- 172.21.15.90:0/1865438070 wait complete. 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 Processor -- start 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 -- start start 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65801ec9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65800c3f30 0x7f6580155950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6580153fe0 0x7f65801e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f65801571a0 con 0x7f6580153fe0 2024-04-20T10:59:48.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f65800c1b60 con 0x7f65800c3f30 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6587477640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6580157320 con 0x7f65800c25d0 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6585a14640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6580153fe0 0x7f65801e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6585a14640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6580153fe0 0x7f65801e8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52022/0 (socket says 172.21.15.90:52022) 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.783+0000 7f6585a14640 1 -- 172.21.15.90:0/2258839847 learned_addr learned my addr 172.21.15.90:0/2258839847 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6584a12640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65800c3f30 0x7f6580155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6585213640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65801ec9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6585a14640 1 -- 172.21.15.90:0/2258839847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 msgr2=0x7f65801ec9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6585a14640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f65800c25d0 0x7f65801ec9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6585a14640 1 -- 172.21.15.90:0/2258839847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65800c3f30 msgr2=0x7f6580155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6585a14640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f65800c3f30 0x7f6580155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6585a14640 1 -- 172.21.15.90:0/2258839847 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658014ff70 con 0x7f6580153fe0 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6585a14640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6580153fe0 0x7f65801e8e70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6578001890 tx=0x7f657800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:48.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6578012400 con 0x7f6580153fe0 2024-04-20T10:59:48.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65780125c0 con 0x7f6580153fe0 2024-04-20T10:59:48.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65780129b0 con 0x7f6580153fe0 2024-04-20T10:59:48.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6580150230 con 0x7f6580153fe0 2024-04-20T10:59:48.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.784+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65801507f0 con 0x7f6580153fe0 2024-04-20T10:59:48.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.785+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f65800761f0 con 0x7f6580153fe0 2024-04-20T10:59:48.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6578012b50 con 0x7f6580153fe0 2024-04-20T10:59:48.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6575ffb640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f656406c8f0 0x7f656406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6585213640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f656406c8f0 0x7f656406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f657808c9b0 con 0x7f6580153fe0 2024-04-20T10:59:48.789 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6575ffb640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f6564077ad0 0x7f6564079f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 --> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f656407a620 con 0x7f6564077ad0 2024-04-20T10:59:48.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f65780912c0 con 0x7f6580153fe0 2024-04-20T10:59:48.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6584a12640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f6564077ad0 0x7f6564079f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.786+0000 7f6585213640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f656406c8f0 0x7f656406edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f657c034000 tx=0x7f657c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:48.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.787+0000 7f6584a12640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f6564077ad0 0x7f6564079f50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:48.790 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.787+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== osd.0 v2:172.21.15.90:6800/1699315385 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f656407a620 con 0x7f6564077ad0 2024-04-20T10:59:48.800 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.800+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 --> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f65800c5b90 con 0x7f6564077ad0 2024-04-20T10:59:48.801 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.800+0000 7f6575ffb640 1 -- 172.21.15.90:0/2258839847 <== osd.0 v2:172.21.15.90:6800/1699315385 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f65800c5b90 con 0x7f6564077ad0 2024-04-20T10:59:48.801 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:48.801 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:48.801 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:48.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f6564077ad0 msgr2=0x7f6564079f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6800/1699315385,v1:172.21.15.90:6801/1699315385] conn(0x7f6564077ad0 0x7f6564079f50 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f656406c8f0 msgr2=0x7f656406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f656406c8f0 0x7f656406edb0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f657c034000 tx=0x7f657c008030 comp rx=0 tx=0).stop 2024-04-20T10:59:48.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6580153fe0 msgr2=0x7f65801e8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.802 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 --2- 172.21.15.90:0/2258839847 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6580153fe0 0x7f65801e8e70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6578001890 tx=0x7f657800a430 comp rx=0 tx=0).stop 2024-04-20T10:59:48.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6585a14640 1 -- 172.21.15.90:0/2258839847 reap_dead start 2024-04-20T10:59:48.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 shutdown_connections 2024-04-20T10:59:48.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 >> 172.21.15.90:0/2258839847 conn(0x7f658006b930 msgr2=0x7f658006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:48.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 shutdown_connections 2024-04-20T10:59:48.803 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.801+0000 7f6587477640 1 -- 172.21.15.90:0/2258839847 wait complete. 2024-04-20T10:59:48.812 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa1537e640 1 Processor -- start 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa1537e640 1 -- start start 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa1537e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa100ab730 0x7faa101568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa1537e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1015a720 con 0x7faa10153ef0 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa1537e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa1015ac80 con 0x7faa100c9ee0 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa1537e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7faa1015a9a0 con 0x7faa100ab730 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa0e7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa100ab730 0x7faa101568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa0e7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7faa100ab730 0x7faa101568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52028/0 (socket says 172.21.15.90:52028) 2024-04-20T10:59:48.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa0effd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7faa10153ef0 0x7faa100c89f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48392/0 (socket says 172.21.15.90:48392) 2024-04-20T10:59:48.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.909+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3926077866 learned_addr learned my addr 172.21.15.90:0/3926077866 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:48.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.910+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3926077866 >> v1:172.21.15.175:6789/0 conn(0x7faa100c9ee0 legacy=0x7faa10156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:48.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.910+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3926077866 >> v1:172.21.15.90:6789/0 conn(0x7faa10153ef0 legacy=0x7faa100c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.910+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3926077866 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa100c6a90 con 0x7faa100ab730 2024-04-20T10:59:48.911 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.910+0000 7faa0dffb640 1 -- 172.21.15.90:0/3926077866 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908502262 0 0) 0x7faa08001490 con 0x7faa10153ef0 2024-04-20T10:59:48.914 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.910+0000 7faa0e7fc640 1 --2- 172.21.15.90:0/3926077866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100ab730 0x7faa101568c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faa04009870 tx=0x7faa0402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87b60ff164fe4d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa0dffb640 1 -- 172.21.15.90:0/3926077866 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0402e070 con 0x7faa100ab730 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa0dffb640 1 -- 172.21.15.90:0/3926077866 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa04037070 con 0x7faa100ab730 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa0dffb640 1 -- 172.21.15.90:0/3926077866 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04031a00 con 0x7faa100ab730 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa1537e640 1 -- 172.21.15.90:0/3926077866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100ab730 msgr2=0x7faa101568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa1537e640 1 --2- 172.21.15.90:0/3926077866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100ab730 0x7faa101568c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7faa04009870 tx=0x7faa0402b880 comp rx=0 tx=0).stop 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa1537e640 1 -- 172.21.15.90:0/3926077866 shutdown_connections 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa1537e640 1 --2- 172.21.15.90:0/3926077866 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100ab730 0x7faa101568c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa1537e640 1 -- 172.21.15.90:0/3926077866 >> 172.21.15.90:0/3926077866 conn(0x7faa100cbfe0 msgr2=0x7faa100cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa1537e640 1 -- 172.21.15.90:0/3926077866 shutdown_connections 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.911+0000 7faa1537e640 1 -- 172.21.15.90:0/3926077866 wait complete. 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.912+0000 7faa1537e640 1 Processor -- start 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.912+0000 7faa1537e640 1 -- start start 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa1537e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa100ab730 0x7faa101f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.915 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa1537e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100c9ee0 0x7faa100c1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.916 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa1537e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa10153ef0 0x7faa101509a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa1537e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7faa100c9100 con 0x7faa100c9ee0 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa1537e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7faa10157510 con 0x7faa100ab730 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa1537e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7faa100c9280 con 0x7faa10153ef0 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100c9ee0 0x7faa100c1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0e7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100c9ee0 0x7faa100c1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52038/0 (socket says 172.21.15.90:52038) 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3462777086 learned_addr learned my addr 172.21.15.90:0/3462777086 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3462777086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa10153ef0 msgr2=0x7faa101509a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0e7fc640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa10153ef0 0x7faa101509a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3462777086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa100ab730 msgr2=0x7faa101f05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:48.917 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0effd640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa100ab730 0x7faa101f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.913+0000 7faa0e7fc640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa100ab730 0x7faa101f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.914+0000 7faa0e7fc640 1 -- 172.21.15.90:0/3462777086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa101566d0 con 0x7faa100c9ee0 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.914+0000 7faa0e7fc640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100c9ee0 0x7faa100c1ef0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faa04009870 tx=0x7faa040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.914+0000 7fa9f77fe640 1 -- 172.21.15.90:0/3462777086 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04031ed0 con 0x7faa100c9ee0 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.914+0000 7fa9f77fe640 1 -- 172.21.15.90:0/3462777086 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa04004250 con 0x7faa100c9ee0 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.914+0000 7fa9f77fe640 1 -- 172.21.15.90:0/3462777086 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa04003610 con 0x7faa100c9ee0 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.914+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa101ec860 con 0x7faa100c9ee0 2024-04-20T10:59:48.918 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.914+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa101ece20 con 0x7faa100c9ee0 2024-04-20T10:59:48.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.915+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa100cb7d0 con 0x7faa100c9ee0 2024-04-20T10:59:48.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.915+0000 7fa9f77fe640 1 -- 172.21.15.90:0/3462777086 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa0404c060 con 0x7faa100c9ee0 2024-04-20T10:59:48.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.916+0000 7fa9f77fe640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9fc06c920 0x7fa9fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:48.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.916+0000 7faa0effd640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9fc06c920 0x7fa9fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:48.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.916+0000 7fa9f77fe640 1 -- 172.21.15.90:0/3462777086 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7faa040adc60 con 0x7faa100c9ee0 2024-04-20T10:59:48.919 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.916+0000 7faa0effd640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9fc06c920 0x7fa9fc06ede0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faa080012e0 tx=0x7faa08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:48.920 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:48.920+0000 7fa9f77fe640 1 -- 172.21.15.90:0/3462777086 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7faa100cb7d0 con 0x7faa100c9ee0 2024-04-20T10:59:49.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.097+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7faa101ed600 con 0x7fa9fc06c920 2024-04-20T10:59:49.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.097+0000 7fa9f77fe640 1 -- 172.21.15.90:0/3462777086 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faa101ed600 con 0x7fa9fc06c920 2024-04-20T10:59:49.097 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 0 to deep-scrub 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9fc06c920 msgr2=0x7fa9fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9fc06c920 0x7fa9fc06ede0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7faa080012e0 tx=0x7faa08009040 comp rx=0 tx=0).stop 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100c9ee0 msgr2=0x7faa100c1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100c9ee0 0x7faa100c1ef0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faa04009870 tx=0x7faa040046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 shutdown_connections 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa9fc06c920 0x7fa9fc06ede0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7faa10153ef0 0x7faa101509a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7faa100c9ee0 0x7faa100c1ef0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 --2- 172.21.15.90:0/3462777086 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7faa100ab730 0x7faa101f05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.099+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 >> 172.21.15.90:0/3462777086 conn(0x7faa100cbfe0 msgr2=0x7faa100cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.100+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 shutdown_connections 2024-04-20T10:59:49.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.100+0000 7faa1537e640 1 -- 172.21.15.90:0/3462777086 wait complete. 2024-04-20T10:59:49.111 INFO:tasks.ceph:Scrubbing osd.1 2024-04-20T10:59:49.111 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:49.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.211+0000 7f5b33d52640 1 Processor -- start 2024-04-20T10:59:49.211 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.211+0000 7f5b33d52640 1 -- start start 2024-04-20T10:59:49.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b33d52640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b2c0c6a00 0x7f5b2c1567a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b33d52640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5b2c06c140 0x7f5b2c161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b33d52640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b2c0c7240 con 0x7f5b2c0c6de0 2024-04-20T10:59:49.213 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b33d52640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2c0c99e0 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b33d52640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5b2c0caf90 con 0x7f5b2c06c140 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b31aee640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b2c0c6a00 0x7f5b2c1567a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b312ed640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5b2c0c6de0 0x7f5b2c06ba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48400/0 (socket says 172.21.15.90:48400) 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b31aee640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f5b2c0c6a00 0x7f5b2c1567a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52046/0 (socket says 172.21.15.90:52046) 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b312ed640 1 -- 172.21.15.90:0/2317351502 learned_addr learned my addr 172.21.15.90:0/2317351502 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b322ef640 1 --2- 172.21.15.90:0/2317351502 >> v2:172.21.15.175:3300/0 conn(0x7f5b2c06c140 0x7f5b2c161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b31aee640 1 -- 172.21.15.90:0/2317351502 >> v2:172.21.15.175:3300/0 conn(0x7f5b2c06c140 msgr2=0x7f5b2c161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b31aee640 1 --2- 172.21.15.90:0/2317351502 >> v2:172.21.15.175:3300/0 conn(0x7f5b2c06c140 0x7f5b2c161120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b31aee640 1 -- 172.21.15.90:0/2317351502 >> v1:172.21.15.90:6789/0 conn(0x7f5b2c0c6de0 legacy=0x7f5b2c06ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b31aee640 1 -- 172.21.15.90:0/2317351502 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c0cb270 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.212+0000 7f5b30aec640 1 -- 172.21.15.90:0/2317351502 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111250788 0 0) 0x7f5b2c0c7240 con 0x7f5b2c0c6de0 2024-04-20T10:59:49.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.213+0000 7f5b31aee640 1 --2- 172.21.15.90:0/2317351502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c1567a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06de80 tx=0x7f5b1c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e3062b1fc7dfe12 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.213+0000 7f5b30aec640 1 -- 172.21.15.90:0/2317351502 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c035020 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.213+0000 7f5b30aec640 1 -- 172.21.15.90:0/2317351502 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b1c031830 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.215 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.213+0000 7f5b30aec640 1 -- 172.21.15.90:0/2317351502 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c031c00 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 -- 172.21.15.90:0/2317351502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 msgr2=0x7f5b2c1567a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 --2- 172.21.15.90:0/2317351502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c1567a0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c06de80 tx=0x7f5b1c02b8d0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 -- 172.21.15.90:0/2317351502 shutdown_connections 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 --2- 172.21.15.90:0/2317351502 >> v2:172.21.15.175:3300/0 conn(0x7f5b2c06c140 0x7f5b2c161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 --2- 172.21.15.90:0/2317351502 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c1567a0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 -- 172.21.15.90:0/2317351502 >> 172.21.15.90:0/2317351502 conn(0x7f5b2c0c8b00 msgr2=0x7f5b2c0c8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 -- 172.21.15.90:0/2317351502 shutdown_connections 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.214+0000 7f5b33d52640 1 -- 172.21.15.90:0/2317351502 wait complete. 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.215+0000 7f5b33d52640 1 Processor -- start 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.215+0000 7f5b33d52640 1 -- start start 2024-04-20T10:59:49.220 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2c06c140 0x7f5b2c0b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c155c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2c0c6de0 0x7f5b2c1561b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c0cbb10 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5b2c0cb830 con 0x7f5b2c0c6de0 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5b2c0ca160 con 0x7f5b2c06c140 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c155c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c155c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52058/0 (socket says 172.21.15.90:52058) 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 -- 172.21.15.90:0/88128919 learned_addr learned my addr 172.21.15.90:0/88128919 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b322ef640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2c0c6de0 0x7f5b2c1561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b31aee640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2c06c140 0x7f5b2c0b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 -- 172.21.15.90:0/88128919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2c06c140 msgr2=0x7f5b2c0b0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2c06c140 0x7f5b2c0b0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 -- 172.21.15.90:0/88128919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2c0c6de0 msgr2=0x7f5b2c1561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5b2c0c6de0 0x7f5b2c1561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 -- 172.21.15.90:0/88128919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2c0b15d0 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b31aee640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5b2c06c140 0x7f5b2c0b0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b312ed640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c155c70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800c4d0 tx=0x7f5b2800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28018070 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b28007500 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2c1efaa0 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b28004a20 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.216+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b2c1f0580 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.217+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b2c1f0160 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.218+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5b2801b070 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.218+0000 7f5b227fc640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b1006c8f0 0x7f5b1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.218+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f5b2808bb40 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.218+0000 7f5b31aee640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b1006c8f0 0x7f5b1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.218+0000 7f5b227fc640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7f5b10077ac0 0x7f5b10079f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.218+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 --> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b28018e70 con 0x7f5b10077ac0 2024-04-20T10:59:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.218+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5b2808bfd0 con 0x7f5b2c0c6a00 2024-04-20T10:59:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.219+0000 7f5b322ef640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7f5b10077ac0 0x7f5b10079f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.219+0000 7f5b31aee640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b1006c8f0 0x7f5b1006edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c036000 tx=0x7f5b1c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.219+0000 7f5b322ef640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7f5b10077ac0 0x7f5b10079f40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.219+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== osd.1 v2:172.21.15.90:6824/1234006559 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b28018e70 con 0x7f5b10077ac0 2024-04-20T10:59:49.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.232+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 --> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5b2c068c20 con 0x7f5b10077ac0 2024-04-20T10:59:49.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.232+0000 7f5b227fc640 1 -- 172.21.15.90:0/88128919 <== osd.1 v2:172.21.15.90:6824/1234006559 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5b2c068c20 con 0x7f5b10077ac0 2024-04-20T10:59:49.233 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:49.233 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:49.233 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:49.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7f5b10077ac0 msgr2=0x7f5b10079f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6824/1234006559,v1:172.21.15.90:6825/1234006559] conn(0x7f5b10077ac0 0x7f5b10079f40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b1006c8f0 msgr2=0x7f5b1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5b1006c8f0 0x7f5b1006edb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c036000 tx=0x7f5b1c008030 comp rx=0 tx=0).stop 2024-04-20T10:59:49.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 msgr2=0x7f5b2c155c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 --2- 172.21.15.90:0/88128919 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5b2c0c6a00 0x7f5b2c155c70 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5b2800c4d0 tx=0x7f5b2800c990 comp rx=0 tx=0).stop 2024-04-20T10:59:49.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b322ef640 1 -- 172.21.15.90:0/88128919 reap_dead start 2024-04-20T10:59:49.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 shutdown_connections 2024-04-20T10:59:49.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 >> 172.21.15.90:0/88128919 conn(0x7f5b2c0c8b00 msgr2=0x7f5b2c155090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 shutdown_connections 2024-04-20T10:59:49.235 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.233+0000 7f5b33d52640 1 -- 172.21.15.90:0/88128919 wait complete. 2024-04-20T10:59:49.244 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-20T10:59:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.341+0000 7f8017ac1640 1 Processor -- start 2024-04-20T10:59:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.342+0000 7f8017ac1640 1 -- start start 2024-04-20T10:59:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.342+0000 7f8017ac1640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80100c7bf0 0x7f80100c7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.342+0000 7f8017ac1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010157170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.342+0000 7f8017ac1640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80100c2880 con 0x7f80100c1ce0 2024-04-20T10:59:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.342+0000 7f8017ac1640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f80100c4480 con 0x7f80100c7bf0 2024-04-20T10:59:49.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.342+0000 7f8017ac1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f80101576b0 con 0x7f801006ef90 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801585d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80100c7bf0 0x7f80100c7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801585d640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f80100c7bf0 0x7f80100c7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52074/0 (socket says 172.21.15.90:52074) 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801605e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f80100c1ce0 0x7f80100c2170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48406/0 (socket says 172.21.15.90:48406) 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801585d640 1 -- 172.21.15.90:0/1642034682 learned_addr learned my addr 172.21.15.90:0/1642034682 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801505c640 1 --2- 172.21.15.90:0/1642034682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010157170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801585d640 1 -- 172.21.15.90:0/1642034682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 msgr2=0x7f8010157170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801585d640 1 --2- 172.21.15.90:0/1642034682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010157170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801585d640 1 -- 172.21.15.90:0/1642034682 >> v1:172.21.15.90:6789/0 conn(0x7f80100c1ce0 legacy=0x7f80100c2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801585d640 1 -- 172.21.15.90:0/1642034682 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80100c33e0 con 0x7f80100c7bf0 2024-04-20T10:59:49.344 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.343+0000 7f801485b640 1 -- 172.21.15.90:0/1642034682 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764469773 0 0) 0x7f80100c2880 con 0x7f80100c1ce0 2024-04-20T10:59:49.345 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f801585d640 1 --2- 172.21.15.90:0/1642034682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f80100c7fd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f800c0098a0 tx=0x7f800c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e1745afdb63f7dd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f801485b640 1 -- 172.21.15.90:0/1642034682 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c0317c0 con 0x7f80100c7bf0 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f801485b640 1 -- 172.21.15.90:0/1642034682 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800c037070 con 0x7f80100c7bf0 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f801485b640 1 -- 172.21.15.90:0/1642034682 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800c031b80 con 0x7f80100c7bf0 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 -- 172.21.15.90:0/1642034682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 msgr2=0x7f80100c7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1642034682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f80100c7fd0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f800c0098a0 tx=0x7f800c02b860 comp rx=0 tx=0).stop 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 -- 172.21.15.90:0/1642034682 shutdown_connections 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1642034682 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010157170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1642034682 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f80100c7fd0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 -- 172.21.15.90:0/1642034682 >> 172.21.15.90:0/1642034682 conn(0x7f80100aa660 msgr2=0x7f80100aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 -- 172.21.15.90:0/1642034682 shutdown_connections 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.344+0000 7f8017ac1640 1 -- 172.21.15.90:0/1642034682 wait complete. 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.345+0000 7f8017ac1640 1 Processor -- start 2024-04-20T10:59:49.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.345+0000 7f8017ac1640 1 -- start start 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f8017ac1640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f8017ac1640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80100c1ce0 0x7f8010073050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f8017ac1640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f8010157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f8017ac1640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f80100c39a0 con 0x7f80100c7bf0 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f8017ac1640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f80100c3ff0 con 0x7f80100c1ce0 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f8017ac1640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f80100c3c80 con 0x7f801006ef90 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f8010157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f8010157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52078/0 (socket says 172.21.15.90:52078) 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 -- 172.21.15.90:0/1462893704 learned_addr learned my addr 172.21.15.90:0/1462893704 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801585d640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801505c640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80100c1ce0 0x7f8010073050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 -- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 msgr2=0x7f8010159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.349 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 -- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80100c1ce0 msgr2=0x7f8010073050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80100c1ce0 0x7f8010073050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801605e640 1 -- 172.21.15.90:0/1462893704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801015a680 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.346+0000 7f801585d640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.347+0000 7f801605e640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f8010157a10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f800800c7a0 tx=0x7f800800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.347+0000 7f80067fc640 1 -- 172.21.15.90:0/1462893704 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008018070 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.347+0000 7f80067fc640 1 -- 172.21.15.90:0/1462893704 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800800a5e0 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.347+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801015a960 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.347+0000 7f80067fc640 1 -- 172.21.15.90:0/1462893704 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f800800aa50 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.347+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80101ed050 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.348+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8010076150 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.348+0000 7f80067fc640 1 -- 172.21.15.90:0/1462893704 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f800801b070 con 0x7f80100c7bf0 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.349+0000 7f80067fc640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7ff406c8f0 0x7f7ff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.349+0000 7f80067fc640 1 -- 172.21.15.90:0/1462893704 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f800808b810 con 0x7f80100c7bf0 2024-04-20T10:59:49.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.349+0000 7f801585d640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7ff406c8f0 0x7f7ff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.349+0000 7f801585d640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7ff406c8f0 0x7f7ff406edb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f800c036000 tx=0x7f800c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.353+0000 7f80067fc640 1 -- 172.21.15.90:0/1462893704 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f8008059580 con 0x7f80100c7bf0 2024-04-20T10:59:49.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.529+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f80100c21f0 con 0x7f7ff406c8f0 2024-04-20T10:59:49.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.530+0000 7f80067fc640 1 -- 172.21.15.90:0/1462893704 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f80100c21f0 con 0x7f7ff406c8f0 2024-04-20T10:59:49.530 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 1 to deep-scrub 2024-04-20T10:59:49.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7ff406c8f0 msgr2=0x7f7ff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7ff406c8f0 0x7f7ff406edb0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f800c036000 tx=0x7f800c03d040 comp rx=0 tx=0).stop 2024-04-20T10:59:49.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 msgr2=0x7f8010157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f8010157a10 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f800800c7a0 tx=0x7f800800cc60 comp rx=0 tx=0).stop 2024-04-20T10:59:49.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 shutdown_connections 2024-04-20T10:59:49.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7ff406c8f0 0x7f7ff406edb0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f80100c7bf0 0x7f8010157a10 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f80100c1ce0 0x7f8010073050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 --2- 172.21.15.90:0/1462893704 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f801006ef90 0x7f8010159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 >> 172.21.15.90:0/1462893704 conn(0x7f80100aa660 msgr2=0x7f80101563f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 shutdown_connections 2024-04-20T10:59:49.533 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.532+0000 7f8017ac1640 1 -- 172.21.15.90:0/1462893704 wait complete. 2024-04-20T10:59:49.543 INFO:tasks.ceph:Scrubbing osd.2 2024-04-20T10:59:49.543 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:49.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.644+0000 7fe99b94b640 1 Processor -- start 2024-04-20T10:59:49.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.644+0000 7fe99b94b640 1 -- start start 2024-04-20T10:59:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.645+0000 7fe99b94b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 0x7fe994157240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.645+0000 7fe99b94b640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9940c6c10 con 0x7fe9940ae2e0 2024-04-20T10:59:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.645+0000 7fe99b94b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9940c6ef0 con 0x7fe9940ae740 2024-04-20T10:59:49.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.645+0000 7fe99b94b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe9941544a0 con 0x7fe9941540c0 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.645+0000 7fe998ee6640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe9940ae2e0 0x7fe99406c310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48420/0 (socket says 172.21.15.90:48420) 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.645+0000 7fe998ee6640 1 -- 172.21.15.90:0/153804822 learned_addr learned my addr 172.21.15.90:0/153804822 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295311260 0 0) 0x7fe9940c6c10 con 0x7fe9940ae2e0 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe9996e7640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 0x7fe994157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe97c003520 con 0x7fe9940ae2e0 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 937381692 0 0) 0x7fe97c003520 con 0x7fe9940ae2e0 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 msgr2=0x7fe994157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 0x7fe994157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 >> v1:172.21.15.175:6789/0 conn(0x7fe9940ae740 legacy=0x7fe99406ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9940aebb0 con 0x7fe9940ae2e0 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fe988001670 con 0x7fe9940ae2e0 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 >> v1:172.21.15.90:6789/0 conn(0x7fe9940ae2e0 legacy=0x7fe99406c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 0x7fe97c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c003f60 0x7fe97c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe97c004d40 0x7fe97c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c00bbd0 con 0x7fe97c004d40 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe97c00bd80 con 0x7fe97c003f60 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe97c00bf80 con 0x7fe9941540c0 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe999ee8640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe97c004d40 0x7fe97c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe9996e7640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 0x7fe97c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe998ee6640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c003f60 0x7fe97c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe999ee8640 1 -- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 msgr2=0x7fe97c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe999ee8640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941540c0 0x7fe97c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe999ee8640 1 -- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c003f60 msgr2=0x7fe97c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe999ee8640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe97c003f60 0x7fe97c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.646+0000 7fe999ee8640 1 -- 172.21.15.90:0/153804822 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe97c003520 con 0x7fe97c004d40 2024-04-20T10:59:49.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.647+0000 7fe999ee8640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe97c004d40 0x7fe97c0051c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe98c001750 tx=0x7fe97c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90038a5870d3a659 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.647+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c001370 con 0x7fe97c004d40 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.647+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98c0052d0 con 0x7fe97c004d40 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.647+0000 7fe993fff640 1 -- 172.21.15.90:0/153804822 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98c003830 con 0x7fe97c004d40 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.648+0000 7fe99b94b640 1 -- 172.21.15.90:0/153804822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe97c004d40 msgr2=0x7fe97c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.648+0000 7fe99b94b640 1 --2- 172.21.15.90:0/153804822 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe97c004d40 0x7fe97c0051c0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe98c001750 tx=0x7fe97c005830 comp rx=0 tx=0).stop 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.648+0000 7fe999ee8640 1 -- 172.21.15.90:0/153804822 reap_dead start 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.648+0000 7fe99b94b640 1 -- 172.21.15.90:0/153804822 shutdown_connections 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.648+0000 7fe99b94b640 1 -- 172.21.15.90:0/153804822 >> 172.21.15.90:0/153804822 conn(0x7fe9940cc0f0 msgr2=0x7fe9940cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.648+0000 7fe99b94b640 1 -- 172.21.15.90:0/153804822 shutdown_connections 2024-04-20T10:59:49.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.648+0000 7fe99b94b640 1 -- 172.21.15.90:0/153804822 wait complete. 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.649+0000 7fe99b94b640 1 Processor -- start 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.649+0000 7fe99b94b640 1 -- start start 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.649+0000 7fe99b94b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941561e0 0x7fe9941565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.649+0000 7fe99b94b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe994154630 0x7fe994145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe99b94b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99414e950 0x7fe99414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe99b94b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940ca2b0 con 0x7fe994154630 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe99b94b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe9940ca130 con 0x7fe99414e950 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe99b94b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe9940ca9a0 con 0x7fe9941561e0 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe994154630 0x7fe994145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe994154630 0x7fe994145b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52096/0 (socket says 172.21.15.90:52096) 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 -- 172.21.15.90:0/3326082382 learned_addr learned my addr 172.21.15.90:0/3326082382 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe9996e7640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941561e0 0x7fe9941565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe999ee8640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99414e950 0x7fe99414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 -- 172.21.15.90:0/3326082382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941561e0 msgr2=0x7fe9941565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe9941561e0 0x7fe9941565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 -- 172.21.15.90:0/3326082382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99414e950 msgr2=0x7fe99414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe99414e950 0x7fe99414ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 -- 172.21.15.90:0/3326082382 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe994154ac0 con 0x7fe994154630 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe998ee6640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe994154630 0x7fe994145b00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe988007290 tx=0x7fe988007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98800f8e0 con 0x7fe994154630 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe988018070 con 0x7fe994154630 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9941ef510 con 0x7fe994154630 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe98800fcc0 con 0x7fe994154630 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.650+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9941efad0 con 0x7fe994154630 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.651+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe9940761f0 con 0x7fe994154630 2024-04-20T10:59:49.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.652+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe98801d460 con 0x7fe994154630 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.652+0000 7fe991ffb640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe98006c8f0 0x7fe98006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.652+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fe98808c2a0 con 0x7fe994154630 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.652+0000 7fe9996e7640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe98006c8f0 0x7fe98006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.652+0000 7fe991ffb640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7fe980077a50 0x7fe980079ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.652+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 --> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe98007a5a0 con 0x7fe980077a50 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.653+0000 7fe999ee8640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7fe980077a50 0x7fe980079ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.653+0000 7fe9996e7640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe98006c8f0 0x7fe98006edb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe994069920 tx=0x7fe98400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.653+0000 7fe999ee8640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7fe980077a50 0x7fe980079ed0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.654+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== osd.2 v2:172.21.15.90:6816/460939980 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe98007a5a0 con 0x7fe980077a50 2024-04-20T10:59:49.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.654+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fe988093050 con 0x7fe994154630 2024-04-20T10:59:49.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 --> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe994151390 con 0x7fe980077a50 2024-04-20T10:59:49.667 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe991ffb640 1 -- 172.21.15.90:0/3326082382 <== osd.2 v2:172.21.15.90:6816/460939980 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe994151390 con 0x7fe980077a50 2024-04-20T10:59:49.667 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:49.668 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:49.668 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:49.668 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7fe980077a50 msgr2=0x7fe980079ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe99b94b640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6816/460939980,v1:172.21.15.90:6817/460939980] conn(0x7fe980077a50 0x7fe980079ed0 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe98006c8f0 msgr2=0x7fe98006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe99b94b640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe98006c8f0 0x7fe98006edb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe994069920 tx=0x7fe98400b040 comp rx=0 tx=0).stop 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe994154630 msgr2=0x7fe994145b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.667+0000 7fe99b94b640 1 --2- 172.21.15.90:0/3326082382 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe994154630 0x7fe994145b00 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fe988007290 tx=0x7fe988007750 comp rx=0 tx=0).stop 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.668+0000 7fe999ee8640 1 -- 172.21.15.90:0/3326082382 reap_dead start 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.668+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 shutdown_connections 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.668+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 >> 172.21.15.90:0/3326082382 conn(0x7fe9940cc0f0 msgr2=0x7fe9940c9390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.668+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 shutdown_connections 2024-04-20T10:59:49.669 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.668+0000 7fe99b94b640 1 -- 172.21.15.90:0/3326082382 wait complete. 2024-04-20T10:59:49.678 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-20T10:59:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.775+0000 7f5f42af2640 1 Processor -- start 2024-04-20T10:59:49.776 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.775+0000 7f5f42af2640 1 -- start start 2024-04-20T10:59:49.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.776+0000 7f5f42af2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 0x7f5f3c157a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.776+0000 7f5f42af2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f5f3c0aba60 0x7f5f3c0abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.776+0000 7f5f42af2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3c073ba0 con 0x7f5f3c151b10 2024-04-20T10:59:49.779 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.776+0000 7f5f42af2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f5f3c151ef0 con 0x7f5f3c0aba60 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.776+0000 7f5f42af2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f3c1589a0 con 0x7f5f3c154480 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.776+0000 7f5f4088e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5f3c151b10 0x7f5f3c0725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48422/0 (socket says 172.21.15.90:48422) 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.776+0000 7f5f4088e640 1 -- 172.21.15.90:0/158009812 learned_addr learned my addr 172.21.15.90:0/158009812 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002772537 0 0) 0x7f5f3c073ba0 con 0x7f5f3c151b10 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 0x7f5f3c157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f4108f640 1 --2- 172.21.15.90:0/158009812 >> v2:172.21.15.175:3300/0 conn(0x7f5f3c0aba60 0x7f5f3c0abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f24003520 con 0x7f5f3c151b10 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3191016306 0 0) 0x7f5f24003520 con 0x7f5f3c151b10 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 msgr2=0x7f5f3c157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 0x7f5f3c157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 >> v2:172.21.15.175:3300/0 conn(0x7f5f3c0aba60 msgr2=0x7f5f3c0abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 --2- 172.21.15.90:0/158009812 >> v2:172.21.15.175:3300/0 conn(0x7f5f3c0aba60 0x7f5f3c0abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.780 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c158100 con 0x7f5f3c151b10 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f5f2c001670 con 0x7f5f3c151b10 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 >> v1:172.21.15.90:6789/0 conn(0x7f5f3c151b10 legacy=0x7f5f3c0725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f240039b0 0x7f5f24003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f24004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 0x7f5f240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c151ef0 con 0x7f5f24004800 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c1589a0 con 0x7f5f240039b0 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2400b9f0 con 0x7f5f3c154480 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f24004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f4088e640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f240039b0 0x7f5f24003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f4108f640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 0x7f5f240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3bfff640 1 -- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 msgr2=0x7f5f240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c154480 0x7f5f240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.781 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3bfff640 1 -- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f240039b0 msgr2=0x7f5f24003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f240039b0 0x7f5f24003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.777+0000 7f5f3bfff640 1 -- 172.21.15.90:0/158009812 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f24003520 con 0x7f5f24004800 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.778+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f24004c80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009ac0 tx=0x7f5f24005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9ba302bd6b7f2b server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.778+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30039070 con 0x7f5f24004800 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.778+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f3002c6b0 con 0x7f5f24004800 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.778+0000 7f5f3b7fe640 1 -- 172.21.15.90:0/158009812 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f30009690 con 0x7f5f24004800 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.779+0000 7f5f42af2640 1 -- 172.21.15.90:0/158009812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 msgr2=0x7f5f24004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.779+0000 7f5f42af2640 1 --2- 172.21.15.90:0/158009812 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f24004c80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f5f30009ac0 tx=0x7f5f24005830 comp rx=0 tx=0).stop 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.779+0000 7f5f4108f640 1 -- 172.21.15.90:0/158009812 reap_dead start 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.779+0000 7f5f42af2640 1 -- 172.21.15.90:0/158009812 shutdown_connections 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.779+0000 7f5f42af2640 1 -- 172.21.15.90:0/158009812 >> 172.21.15.90:0/158009812 conn(0x7f5f3c0ca0a0 msgr2=0x7f5f3c0ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.779+0000 7f5f42af2640 1 -- 172.21.15.90:0/158009812 shutdown_connections 2024-04-20T10:59:49.782 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.779+0000 7f5f42af2640 1 -- 172.21.15.90:0/158009812 wait complete. 2024-04-20T10:59:49.785 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.780+0000 7f5f42af2640 1 Processor -- start 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.780+0000 7f5f42af2640 1 -- start start 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f3c144910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c0ae190 0x7f5f3c146480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f3c1469c0 0x7f5f3c1e9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c0ab540 con 0x7f5f24004800 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f5f3c1586c0 con 0x7f5f3c1469c0 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5f3c072d00 con 0x7f5f3c0ae190 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f3c144910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f3c144910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52106/0 (socket says 172.21.15.90:52106) 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 -- 172.21.15.90:0/2995795493 learned_addr learned my addr 172.21.15.90:0/2995795493 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c0ae190 0x7f5f3c146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4108f640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f3c1469c0 0x7f5f3c1e9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.786 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 -- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c0ae190 msgr2=0x7f5f3c146480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c0ae190 0x7f5f3c146480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 -- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f3c1469c0 msgr2=0x7f5f3c1e9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f3c1469c0 0x7f5f3c1e9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 -- 172.21.15.90:0/2995795493 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3c156320 con 0x7f5f24004800 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4108f640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f3c1469c0 0x7f5f3c1e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f4088e640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f3c144910 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00e6d0 tx=0x7f5f2c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f397fa640 1 -- 172.21.15.90:0/2995795493 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00c660 con 0x7f5f24004800 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f397fa640 1 -- 172.21.15.90:0/2995795493 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f2c018070 con 0x7f5f24004800 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f3c1565c0 con 0x7f5f24004800 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f397fa640 1 -- 172.21.15.90:0/2995795493 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f2c00ca40 con 0x7f5f24004800 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.781+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f3c157670 con 0x7f5f24004800 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.782+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f3c1578b0 con 0x7f5f24004800 2024-04-20T10:59:49.787 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.783+0000 7f5f397fa640 1 -- 172.21.15.90:0/2995795493 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f2c00cbe0 con 0x7f5f24004800 2024-04-20T10:59:49.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.783+0000 7f5f397fa640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f2806c8f0 0x7f5f2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:49.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.783+0000 7f5f397fa640 1 -- 172.21.15.90:0/2995795493 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f5f2c08bfc0 con 0x7f5f24004800 2024-04-20T10:59:49.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.783+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f2806c8f0 0x7f5f2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:49.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.784+0000 7f5f3bfff640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f2806c8f0 0x7f5f2806edb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5f30036000 tx=0x7f5f30030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:49.788 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.787+0000 7f5f397fa640 1 -- 172.21.15.90:0/2995795493 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5f3c1578b0 con 0x7f5f24004800 2024-04-20T10:59:49.966 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.966+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5f3c157180 con 0x7f5f2806c8f0 2024-04-20T10:59:49.967 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.966+0000 7f5f397fa640 1 -- 172.21.15.90:0/2995795493 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5f3c157180 con 0x7f5f2806c8f0 2024-04-20T10:59:49.967 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 2 to deep-scrub 2024-04-20T10:59:49.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f2806c8f0 msgr2=0x7f5f2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f2806c8f0 0x7f5f2806edb0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5f30036000 tx=0x7f5f30030000 comp rx=0 tx=0).stop 2024-04-20T10:59:49.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 msgr2=0x7f5f3c144910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:49.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f3c144910 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c00e6d0 tx=0x7f5f2c00eb90 comp rx=0 tx=0).stop 2024-04-20T10:59:49.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 shutdown_connections 2024-04-20T10:59:49.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f5f2806c8f0 0x7f5f2806edb0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5f3c1469c0 0x7f5f3c1e9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5f3c0ae190 0x7f5f3c146480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 --2- 172.21.15.90:0/2995795493 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f5f24004800 0x7f5f3c144910 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 >> 172.21.15.90:0/2995795493 conn(0x7f5f3c0ca0a0 msgr2=0x7f5f3c0c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 shutdown_connections 2024-04-20T10:59:49.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:49.969+0000 7f5f42af2640 1 -- 172.21.15.90:0/2995795493 wait complete. 2024-04-20T10:59:49.980 INFO:tasks.ceph:Scrubbing osd.3 2024-04-20T10:59:49.980 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:50.080 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.080+0000 7fdb4759e640 1 Processor -- start 2024-04-20T10:59:50.081 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.080+0000 7fdb4759e640 1 -- start start 2024-04-20T10:59:50.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb4759e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdb48153fb0 0x7fdb480c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb4759e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fdb4806ce70 0x7fdb480c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.091 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb4759e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb480c3070 con 0x7fdb48159e20 2024-04-20T10:59:50.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb4759e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4806c340 con 0x7fdb48153fb0 2024-04-20T10:59:50.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb4759e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4806c900 con 0x7fdb4806ce70 2024-04-20T10:59:50.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb45d9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdb48153fb0 0x7fdb480c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb4659c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fdb48159e20 0x7fdb481538a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48428/0 (socket says 172.21.15.90:48428) 2024-04-20T10:59:50.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb45d9b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fdb48153fb0 0x7fdb480c6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52118/0 (socket says 172.21.15.90:52118) 2024-04-20T10:59:50.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb4659c640 1 -- 172.21.15.90:0/2397849225 learned_addr learned my addr 172.21.15.90:0/2397849225 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:50.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb46d9d640 1 --2- 172.21.15.90:0/2397849225 >> v2:172.21.15.175:3300/0 conn(0x7fdb4806ce70 0x7fdb480c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb45d9b640 1 -- 172.21.15.90:0/2397849225 >> v2:172.21.15.175:3300/0 conn(0x7fdb4806ce70 msgr2=0x7fdb480c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb45d9b640 1 --2- 172.21.15.90:0/2397849225 >> v2:172.21.15.175:3300/0 conn(0x7fdb4806ce70 0x7fdb480c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb45d9b640 1 -- 172.21.15.90:0/2397849225 >> v1:172.21.15.90:6789/0 conn(0x7fdb48159e20 legacy=0x7fdb481538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb45d9b640 1 -- 172.21.15.90:0/2397849225 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4815a660 con 0x7fdb48153fb0 2024-04-20T10:59:50.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.081+0000 7fdb46d9d640 1 --2- 172.21.15.90:0/2397849225 >> v2:172.21.15.175:3300/0 conn(0x7fdb4806ce70 0x7fdb480c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:50.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.082+0000 7fdb45d9b640 1 --2- 172.21.15.90:0/2397849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48153fb0 0x7fdb480c6b30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdb4806c870 tx=0x7fdb3c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=668f65e4869912ff server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.082+0000 7fdb4559a640 1 -- 172.21.15.90:0/2397849225 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0315a0 con 0x7fdb48153fb0 2024-04-20T10:59:50.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.082+0000 7fdb4559a640 1 -- 172.21.15.90:0/2397849225 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb3c037070 con 0x7fdb48153fb0 2024-04-20T10:59:50.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.082+0000 7fdb4559a640 1 -- 172.21.15.90:0/2397849225 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c031960 con 0x7fdb48153fb0 2024-04-20T10:59:50.094 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 -- 172.21.15.90:0/2397849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48153fb0 msgr2=0x7fdb480c6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 --2- 172.21.15.90:0/2397849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48153fb0 0x7fdb480c6b30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fdb4806c870 tx=0x7fdb3c02b840 comp rx=0 tx=0).stop 2024-04-20T10:59:50.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 -- 172.21.15.90:0/2397849225 shutdown_connections 2024-04-20T10:59:50.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 --2- 172.21.15.90:0/2397849225 >> v2:172.21.15.175:3300/0 conn(0x7fdb4806ce70 0x7fdb480c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 --2- 172.21.15.90:0/2397849225 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48153fb0 0x7fdb480c6b30 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.095 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 -- 172.21.15.90:0/2397849225 >> 172.21.15.90:0/2397849225 conn(0x7fdb480ade20 msgr2=0x7fdb480ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 -- 172.21.15.90:0/2397849225 shutdown_connections 2024-04-20T10:59:50.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.083+0000 7fdb4759e640 1 -- 172.21.15.90:0/2397849225 wait complete. 2024-04-20T10:59:50.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.084+0000 7fdb4759e640 1 Processor -- start 2024-04-20T10:59:50.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.084+0000 7fdb4759e640 1 -- start start 2024-04-20T10:59:50.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb4759e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb4806ce70 0x7fdb4814b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb4759e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb48153fb0 0x7fdb4814bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb4759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48159e20 0x7fdb481ef7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb4759e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4815a200 con 0x7fdb48159e20 2024-04-20T10:59:50.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb4759e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4806c590 con 0x7fdb48153fb0 2024-04-20T10:59:50.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb4759e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fdb4815a380 con 0x7fdb4806ce70 2024-04-20T10:59:50.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb46d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48159e20 0x7fdb481ef7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb46d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48159e20 0x7fdb481ef7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52130/0 (socket says 172.21.15.90:52130) 2024-04-20T10:59:50.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb46d9d640 1 -- 172.21.15.90:0/4170409955 learned_addr learned my addr 172.21.15.90:0/4170409955 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:50.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb4659c640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb4806ce70 0x7fdb4814b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.085+0000 7fdb45d9b640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb48153fb0 0x7fdb4814bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb46d9d640 1 -- 172.21.15.90:0/4170409955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb4806ce70 msgr2=0x7fdb4814b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb46d9d640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fdb4806ce70 0x7fdb4814b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb46d9d640 1 -- 172.21.15.90:0/4170409955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb48153fb0 msgr2=0x7fdb4814bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb46d9d640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb48153fb0 0x7fdb4814bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb46d9d640 1 -- 172.21.15.90:0/4170409955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4814c330 con 0x7fdb48159e20 2024-04-20T10:59:50.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb45d9b640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fdb48153fb0 0x7fdb4814bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:50.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb46d9d640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48159e20 0x7fdb481ef7d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c7f0 tx=0x7fdb4000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40015070 con 0x7fdb48159e20 2024-04-20T10:59:50.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb40007820 con 0x7fdb48159e20 2024-04-20T10:59:50.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40007c10 con 0x7fdb48159e20 2024-04-20T10:59:50.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb480c6270 con 0x7fdb48159e20 2024-04-20T10:59:50.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.086+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb480b1bf0 con 0x7fdb48159e20 2024-04-20T10:59:50.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.087+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb48076070 con 0x7fdb48159e20 2024-04-20T10:59:50.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.087+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdb40018070 con 0x7fdb48159e20 2024-04-20T10:59:50.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb36ffd640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdb2806c8f0 0x7fdb2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fdb4008c3a0 con 0x7fdb48159e20 2024-04-20T10:59:50.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb4659c640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdb2806c8f0 0x7fdb2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb36ffd640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7fdb28077ac0 0x7fdb28079f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 --> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb4001de50 con 0x7fdb28077ac0 2024-04-20T10:59:50.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fdb40093050 con 0x7fdb48159e20 2024-04-20T10:59:50.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb45d9b640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7fdb28077ac0 0x7fdb28079f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.101 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb4659c640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdb2806c8f0 0x7fdb2806edb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdb380012e0 tx=0x7fdb38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.088+0000 7fdb45d9b640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7fdb28077ac0 0x7fdb28079f40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.089+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== osd.3 v2:172.21.15.90:6808/3826442785 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb4001de50 con 0x7fdb28077ac0 2024-04-20T10:59:50.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.102+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 --> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdb480c65e0 con 0x7fdb28077ac0 2024-04-20T10:59:50.103 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.102+0000 7fdb36ffd640 1 -- 172.21.15.90:0/4170409955 <== osd.3 v2:172.21.15.90:6808/3826442785 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdb480c65e0 con 0x7fdb28077ac0 2024-04-20T10:59:50.103 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:50.103 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:50.104 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:50.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7fdb28077ac0 msgr2=0x7fdb28079f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6808/3826442785,v1:172.21.15.90:6809/3826442785] conn(0x7fdb28077ac0 0x7fdb28079f40 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdb2806c8f0 msgr2=0x7fdb2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fdb2806c8f0 0x7fdb2806edb0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fdb380012e0 tx=0x7fdb38009040 comp rx=0 tx=0).stop 2024-04-20T10:59:50.105 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48159e20 msgr2=0x7fdb481ef7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 --2- 172.21.15.90:0/4170409955 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fdb48159e20 0x7fdb481ef7d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fdb4000c7f0 tx=0x7fdb4000ccb0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb46d9d640 1 -- 172.21.15.90:0/4170409955 reap_dead start 2024-04-20T10:59:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 shutdown_connections 2024-04-20T10:59:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 >> 172.21.15.90:0/4170409955 conn(0x7fdb480ade20 msgr2=0x7fdb481528d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 shutdown_connections 2024-04-20T10:59:50.106 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.103+0000 7fdb4759e640 1 -- 172.21.15.90:0/4170409955 wait complete. 2024-04-20T10:59:50.114 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-20T10:59:50.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.211+0000 7fb702ad2640 1 Processor -- start 2024-04-20T10:59:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.211+0000 7fb702ad2640 1 -- start start 2024-04-20T10:59:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb702ad2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb6fc15ab30 0x7fb6fc156810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb702ad2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb6fc0c4bb0 0x7fb6fc156d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb702ad2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6fc0c6870 con 0x7fb6fc0701c0 2024-04-20T10:59:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb702ad2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc0ab630 con 0x7fb6fc15ab30 2024-04-20T10:59:50.222 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb702ad2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc159e00 con 0x7fb6fc0c4bb0 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fbfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb6fc15ab30 0x7fb6fc156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fbfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fb6fc15ab30 0x7fb6fc156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52144/0 (socket says 172.21.15.90:52144) 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fbfff640 1 -- 172.21.15.90:0/3143472743 learned_addr learned my addr 172.21.15.90:0/3143472743 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb70086e640 1 --1- 172.21.15.90:0/3143472743 >> v1:172.21.15.90:6789/0 conn(0x7fb6fc0701c0 0x7fb6fc073100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48432/0 (socket says 172.21.15.90:48432) 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fbfff640 1 -- 172.21.15.90:0/3143472743 >> v2:172.21.15.175:3300/0 conn(0x7fb6fc0c4bb0 msgr2=0x7fb6fc156d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fbfff640 1 --2- 172.21.15.90:0/3143472743 >> v2:172.21.15.175:3300/0 conn(0x7fb6fc0c4bb0 0x7fb6fc156d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fbfff640 1 -- 172.21.15.90:0/3143472743 >> v1:172.21.15.90:6789/0 conn(0x7fb6fc0701c0 legacy=0x7fb6fc073100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fb7fe640 1 -- 172.21.15.90:0/3143472743 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 287009366 0 0) 0x7fb6fc0c6870 con 0x7fb6fc0701c0 2024-04-20T10:59:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.212+0000 7fb6fbfff640 1 -- 172.21.15.90:0/3143472743 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc15a050 con 0x7fb6fc15ab30 2024-04-20T10:59:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.213+0000 7fb6fbfff640 1 --2- 172.21.15.90:0/3143472743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc15ab30 0x7fb6fc156810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc072470 tx=0x7fb6f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346e98dfc03389d5 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.213+0000 7fb6fb7fe640 1 -- 172.21.15.90:0/3143472743 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0034070 con 0x7fb6fc15ab30 2024-04-20T10:59:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.213+0000 7fb6fb7fe640 1 -- 172.21.15.90:0/3143472743 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f0030860 con 0x7fb6fc15ab30 2024-04-20T10:59:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.213+0000 7fb6fb7fe640 1 -- 172.21.15.90:0/3143472743 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f0030c30 con 0x7fb6fc15ab30 2024-04-20T10:59:50.224 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 -- 172.21.15.90:0/3143472743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc15ab30 msgr2=0x7fb6fc156810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 --2- 172.21.15.90:0/3143472743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc15ab30 0x7fb6fc156810 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc072470 tx=0x7fb6f002b9a0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 -- 172.21.15.90:0/3143472743 shutdown_connections 2024-04-20T10:59:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 --2- 172.21.15.90:0/3143472743 >> v2:172.21.15.175:3300/0 conn(0x7fb6fc0c4bb0 0x7fb6fc156d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 --2- 172.21.15.90:0/3143472743 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc15ab30 0x7fb6fc156810 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 -- 172.21.15.90:0/3143472743 >> 172.21.15.90:0/3143472743 conn(0x7fb6fc0676c0 msgr2=0x7fb6fc067ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 -- 172.21.15.90:0/3143472743 shutdown_connections 2024-04-20T10:59:50.225 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.214+0000 7fb702ad2640 1 -- 172.21.15.90:0/3143472743 wait complete. 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.215+0000 7fb702ad2640 1 Processor -- start 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.215+0000 7fb702ad2640 1 -- start start 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb702ad2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc0701c0 0x7fb6fc156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb702ad2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6fc0c4bb0 0x7fb6fc1e0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb702ad2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6fc15ab30 0x7fb6fc1e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb702ad2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0705a0 con 0x7fb6fc0701c0 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb702ad2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc15a610 con 0x7fb6fc0c4bb0 2024-04-20T10:59:50.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb702ad2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc073810 con 0x7fb6fc15ab30 2024-04-20T10:59:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc0701c0 0x7fb6fc156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc0701c0 0x7fb6fc156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52160/0 (socket says 172.21.15.90:52160) 2024-04-20T10:59:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 -- 172.21.15.90:0/970104373 learned_addr learned my addr 172.21.15.90:0/970104373 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 -- 172.21.15.90:0/970104373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6fc15ab30 msgr2=0x7fb6fc1e1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6fc15ab30 0x7fb6fc1e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 -- 172.21.15.90:0/970104373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6fc0c4bb0 msgr2=0x7fb6fc1e0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.227 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6fc0c4bb0 0x7fb6fc1e0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 -- 172.21.15.90:0/970104373 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc158fe0 con 0x7fb6fc0701c0 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb70086e640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc0701c0 0x7fb6fc156670 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00c430 tx=0x7fb6ec00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.216+0000 7fb6f97fa640 1 -- 172.21.15.90:0/970104373 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0074e0 con 0x7fb6fc0701c0 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.217+0000 7fb6f97fa640 1 -- 172.21.15.90:0/970104373 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ec0047e0 con 0x7fb6fc0701c0 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.217+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc1e0600 con 0x7fb6fc0701c0 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.217+0000 7fb6f97fa640 1 -- 172.21.15.90:0/970104373 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec004bd0 con 0x7fb6fc0701c0 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.217+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc1ed190 con 0x7fb6fc0701c0 2024-04-20T10:59:50.228 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.218+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc1e08f0 con 0x7fb6fc0701c0 2024-04-20T10:59:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.218+0000 7fb6f97fa640 1 -- 172.21.15.90:0/970104373 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb6ec011070 con 0x7fb6fc0701c0 2024-04-20T10:59:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.218+0000 7fb6f97fa640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb6e806c920 0x7fb6e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.218+0000 7fb6fbfff640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb6e806c920 0x7fb6e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.218+0000 7fb6f97fa640 1 -- 172.21.15.90:0/970104373 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fb6ec08be10 con 0x7fb6fc0701c0 2024-04-20T10:59:50.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.219+0000 7fb6fbfff640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb6e806c920 0x7fb6e806ede0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0036000 tx=0x7fb6f003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.223+0000 7fb6f97fa640 1 -- 172.21.15.90:0/970104373 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb6ec00e280 con 0x7fb6fc0701c0 2024-04-20T10:59:50.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.398+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fb6fc076150 con 0x7fb6e806c920 2024-04-20T10:59:50.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.398+0000 7fb6f97fa640 1 -- 172.21.15.90:0/970104373 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb6fc076150 con 0x7fb6e806c920 2024-04-20T10:59:50.398 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 3 to deep-scrub 2024-04-20T10:59:50.400 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb6e806c920 msgr2=0x7fb6e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb6e806c920 0x7fb6e806ede0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0036000 tx=0x7fb6f003b040 comp rx=0 tx=0).stop 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc0701c0 msgr2=0x7fb6fc156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc0701c0 0x7fb6fc156670 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec00c430 tx=0x7fb6ec00c8f0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 shutdown_connections 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb6e806c920 0x7fb6e806ede0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb6fc15ab30 0x7fb6fc1e1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb6fc0c4bb0 0x7fb6fc1e0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 --2- 172.21.15.90:0/970104373 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb6fc0701c0 0x7fb6fc156670 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 >> 172.21.15.90:0/970104373 conn(0x7fb6fc0676c0 msgr2=0x7fb6fc0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 shutdown_connections 2024-04-20T10:59:50.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.400+0000 7fb702ad2640 1 -- 172.21.15.90:0/970104373 wait complete. 2024-04-20T10:59:50.411 INFO:tasks.ceph:Scrubbing osd.4 2024-04-20T10:59:50.412 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:50.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 Processor -- start 2024-04-20T10:59:50.513 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 -- start start 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae580726f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fae580c6710 0x7fae580ab6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fae580c45e0 0x7fae580abc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fae580c4b40 con 0x7fae580c45e0 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fae580c5100 con 0x7fae580c6710 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.513+0000 7fae5e5db640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fae58155050 con 0x7fae58151d40 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fae580c45e0 0x7fae580abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fae580c45e0 0x7fae580abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52164/0 (socket says 172.21.15.90:52164) 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 -- 172.21.15.90:0/2553950615 learned_addr learned my addr 172.21.15.90:0/2553950615 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:50.516 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae57fff640 1 --2- 172.21.15.90:0/2553950615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae580726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 -- 172.21.15.90:0/2553950615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 msgr2=0x7fae580726f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 --2- 172.21.15.90:0/2553950615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae580726f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 -- 172.21.15.90:0/2553950615 >> v2:172.21.15.175:3300/0 conn(0x7fae580c6710 msgr2=0x7fae580ab6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae577fe640 1 --2- 172.21.15.90:0/2553950615 >> v2:172.21.15.175:3300/0 conn(0x7fae580c6710 0x7fae580ab6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 --2- 172.21.15.90:0/2553950615 >> v2:172.21.15.175:3300/0 conn(0x7fae580c6710 0x7fae580ab6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae5cb78640 1 -- 172.21.15.90:0/2553950615 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae58155330 con 0x7fae580c45e0 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae57fff640 1 --2- 172.21.15.90:0/2553950615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae580726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.514+0000 7fae577fe640 1 --2- 172.21.15.90:0/2553950615 >> v2:172.21.15.175:3300/0 conn(0x7fae580c6710 0x7fae580ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5cb78640 1 --2- 172.21.15.90:0/2553950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c45e0 0x7fae580abc20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fae58073cf0 tx=0x7fae5002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893ef5de64064624 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae56ffd640 1 -- 172.21.15.90:0/2553950615 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae5002c9e0 con 0x7fae580c45e0 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae56ffd640 1 -- 172.21.15.90:0/2553950615 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae5002cb80 con 0x7fae580c45e0 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae56ffd640 1 -- 172.21.15.90:0/2553950615 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae500343f0 con 0x7fae580c45e0 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 -- 172.21.15.90:0/2553950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c45e0 msgr2=0x7fae580abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 --2- 172.21.15.90:0/2553950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c45e0 0x7fae580abc20 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fae58073cf0 tx=0x7fae5002be40 comp rx=0 tx=0).stop 2024-04-20T10:59:50.517 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 -- 172.21.15.90:0/2553950615 shutdown_connections 2024-04-20T10:59:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 --2- 172.21.15.90:0/2553950615 >> v2:172.21.15.175:3300/0 conn(0x7fae580c6710 0x7fae580ab6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 --2- 172.21.15.90:0/2553950615 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c45e0 0x7fae580abc20 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 --2- 172.21.15.90:0/2553950615 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae580726f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 -- 172.21.15.90:0/2553950615 >> 172.21.15.90:0/2553950615 conn(0x7fae580ca140 msgr2=0x7fae580ca520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 -- 172.21.15.90:0/2553950615 shutdown_connections 2024-04-20T10:59:50.518 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.515+0000 7fae5e5db640 1 -- 172.21.15.90:0/2553950615 wait complete. 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.516+0000 7fae5e5db640 1 Processor -- start 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae5e5db640 1 -- start start 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae5e5db640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae580c45e0 0x7fae5814e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae5e5db640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c6710 0x7fae580c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae5e5db640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae581523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae5e5db640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fae580ac2e0 con 0x7fae580c6710 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae5e5db640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fae580ac160 con 0x7fae580c45e0 2024-04-20T10:59:50.521 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae5e5db640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fae580ac910 con 0x7fae58151d40 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae577fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c6710 0x7fae580c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae577fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c6710 0x7fae580c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52166/0 (socket says 172.21.15.90:52166) 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.517+0000 7fae577fe640 1 -- 172.21.15.90:0/3782201973 learned_addr learned my addr 172.21.15.90:0/3782201973 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae5cb78640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae581523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae577fe640 1 -- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 msgr2=0x7fae581523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae57fff640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae580c45e0 0x7fae5814e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae577fe640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fae58151d40 0x7fae581523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae577fe640 1 -- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae580c45e0 msgr2=0x7fae5814e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae577fe640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae580c45e0 0x7fae5814e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae577fe640 1 -- 172.21.15.90:0/3782201973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae58154820 con 0x7fae580c6710 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae57fff640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fae580c45e0 0x7fae5814e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae577fe640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c6710 0x7fae580c8d80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c820 tx=0x7fae4c00cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.522 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c015070 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae4c007a30 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae58154b00 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c007e00 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.518+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae581eadd0 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.519+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae580761f0 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.519+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fae4c018070 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae54ff9640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fae4406c8f0 0x7fae4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fae4c08c150 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae57fff640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fae4406c8f0 0x7fae4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae54ff9640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fae44077ac0 0x7fae44079f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 --> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae4407a610 con 0x7fae44077ac0 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fae4c093050 con 0x7fae580c6710 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae57fff640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fae4406c8f0 0x7fae4406edb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fae48006fd0 tx=0x7fae48008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.523 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.520+0000 7fae5cb78640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fae44077ac0 0x7fae44079f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.521+0000 7fae5cb78640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fae44077ac0 0x7fae44079f40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.524 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.522+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== osd.4 v2:172.21.15.175:6800/1431656962 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae4407a610 con 0x7fae44077ac0 2024-04-20T10:59:50.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.535+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 --> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fae58154d90 con 0x7fae44077ac0 2024-04-20T10:59:50.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.535+0000 7fae54ff9640 1 -- 172.21.15.90:0/3782201973 <== osd.4 v2:172.21.15.175:6800/1431656962 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fae58154d90 con 0x7fae44077ac0 2024-04-20T10:59:50.535 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:50.536 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:50.536 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fae44077ac0 msgr2=0x7fae44079f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.175:6800/1431656962,v1:172.21.15.175:6801/1431656962] conn(0x7fae44077ac0 0x7fae44079f40 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fae4406c8f0 msgr2=0x7fae4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fae4406c8f0 0x7fae4406edb0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fae48006fd0 tx=0x7fae48008040 comp rx=0 tx=0).stop 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c6710 msgr2=0x7fae580c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 --2- 172.21.15.90:0/3782201973 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fae580c6710 0x7fae580c8d80 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fae4c00c820 tx=0x7fae4c00cce0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5cb78640 1 -- 172.21.15.90:0/3782201973 reap_dead start 2024-04-20T10:59:50.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 shutdown_connections 2024-04-20T10:59:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 >> 172.21.15.90:0/3782201973 conn(0x7fae580ca140 msgr2=0x7fae581502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 shutdown_connections 2024-04-20T10:59:50.538 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.536+0000 7fae5e5db640 1 -- 172.21.15.90:0/3782201973 wait complete. 2024-04-20T10:59:50.546 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-20T10:59:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.644+0000 7fcb79192640 1 Processor -- start 2024-04-20T10:59:50.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.644+0000 7fcb79192640 1 -- start start 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb79192640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb79192640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb740ad640 0x7fcb74153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb79192640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb740adaa0 con 0x7fcb740c54d0 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb79192640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fcb74071690 con 0x7fcb740ad640 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb79192640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcb74071970 con 0x7fcb740c27a0 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7359e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb740ad640 0x7fcb74153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7259c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fcb740c54d0 0x7fcb7415a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48444/0 (socket says 172.21.15.90:48444) 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7259c640 1 -- 172.21.15.90:0/720159013 learned_addr learned my addr 172.21.15.90:0/720159013 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7359e640 1 --2- 172.21.15.90:0/720159013 >> v2:172.21.15.90:3300/0 conn(0x7fcb740ad640 0x7fcb74153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52172/0 (socket says 172.21.15.90:52172) 2024-04-20T10:59:50.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb72d9d640 1 --2- 172.21.15.90:0/720159013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7359e640 1 -- 172.21.15.90:0/720159013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 msgr2=0x7fcb741570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7359e640 1 --2- 172.21.15.90:0/720159013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7359e640 1 -- 172.21.15.90:0/720159013 >> v1:172.21.15.90:6789/0 conn(0x7fcb740c54d0 legacy=0x7fcb7415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb7359e640 1 -- 172.21.15.90:0/720159013 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb74159ce0 con 0x7fcb740ad640 2024-04-20T10:59:50.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.645+0000 7fcb71d9b640 1 -- 172.21.15.90:0/720159013 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3439110789 0 0) 0x7fcb740adaa0 con 0x7fcb740c54d0 2024-04-20T10:59:50.647 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.646+0000 7fcb7359e640 1 --2- 172.21.15.90:0/720159013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740ad640 0x7fcb74153730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0097a0 tx=0x7fcb6c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3b6ff58f7941671 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.646+0000 7fcb71d9b640 1 -- 172.21.15.90:0/720159013 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c035020 con 0x7fcb740ad640 2024-04-20T10:59:50.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.646+0000 7fcb71d9b640 1 -- 172.21.15.90:0/720159013 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c031830 con 0x7fcb740ad640 2024-04-20T10:59:50.648 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.646+0000 7fcb71d9b640 1 -- 172.21.15.90:0/720159013 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c031c00 con 0x7fcb740ad640 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 -- 172.21.15.90:0/720159013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740ad640 msgr2=0x7fcb74153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 --2- 172.21.15.90:0/720159013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740ad640 0x7fcb74153730 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0097a0 tx=0x7fcb6c02b8d0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 -- 172.21.15.90:0/720159013 shutdown_connections 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 --2- 172.21.15.90:0/720159013 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740ad640 0x7fcb74153730 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 --2- 172.21.15.90:0/720159013 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 -- 172.21.15.90:0/720159013 >> 172.21.15.90:0/720159013 conn(0x7fcb740c9100 msgr2=0x7fcb740c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 -- 172.21.15.90:0/720159013 shutdown_connections 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.647+0000 7fcb79192640 1 -- 172.21.15.90:0/720159013 wait complete. 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.648+0000 7fcb79192640 1 Processor -- start 2024-04-20T10:59:50.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.648+0000 7fcb79192640 1 -- start start 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb79192640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb740ad640 0x7fcb74159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb79192640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741efa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb79192640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740c54d0 0x7fcb741583d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb79192640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb740c2b80 con 0x7fcb740c54d0 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb79192640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7406f510 con 0x7fcb740ad640 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb79192640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcb740c2d00 con 0x7fcb740c27a0 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740c54d0 0x7fcb741583d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740c54d0 0x7fcb741583d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52180/0 (socket says 172.21.15.90:52180) 2024-04-20T10:59:50.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 -- 172.21.15.90:0/3303498751 learned_addr learned my addr 172.21.15.90:0/3303498751 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7259c640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741efa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb72d9d640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb740ad640 0x7fcb74159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 -- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 msgr2=0x7fcb741efa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741efa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 -- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb740ad640 msgr2=0x7fcb74159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb740ad640 0x7fcb74159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 -- 172.21.15.90:0/3303498751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb74154cb0 con 0x7fcb740c54d0 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb72d9d640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb740ad640 0x7fcb74159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb7359e640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740c54d0 0x7fcb741583d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0098c0 tx=0x7fcb6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb5b7fe640 1 -- 172.21.15.90:0/3303498751 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c035070 con 0x7fcb740c54d0 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.649+0000 7fcb5b7fe640 1 -- 172.21.15.90:0/3303498751 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb6c004230 con 0x7fcb740c54d0 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.650+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb741563a0 con 0x7fcb740c54d0 2024-04-20T10:59:50.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.650+0000 7fcb5b7fe640 1 -- 172.21.15.90:0/3303498751 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c03a6f0 con 0x7fcb740c54d0 2024-04-20T10:59:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.650+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb74159850 con 0x7fcb740c54d0 2024-04-20T10:59:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.651+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb741568c0 con 0x7fcb740c54d0 2024-04-20T10:59:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.651+0000 7fcb5b7fe640 1 -- 172.21.15.90:0/3303498751 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb6c038020 con 0x7fcb740c54d0 2024-04-20T10:59:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.651+0000 7fcb5b7fe640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb6006c920 0x7fcb6006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.651+0000 7fcb5b7fe640 1 -- 172.21.15.90:0/3303498751 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fcb6c0adda0 con 0x7fcb740c54d0 2024-04-20T10:59:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.651+0000 7fcb72d9d640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb6006c920 0x7fcb6006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.654 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.652+0000 7fcb72d9d640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb6006c920 0x7fcb6006ede0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009b20 tx=0x7fcb640039d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.656+0000 7fcb5b7fe640 1 -- 172.21.15.90:0/3303498751 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fcb741568c0 con 0x7fcb740c54d0 2024-04-20T10:59:50.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.842+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fcb74076150 con 0x7fcb6006c920 2024-04-20T10:59:50.843 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.842+0000 7fcb5b7fe640 1 -- 172.21.15.90:0/3303498751 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb74076150 con 0x7fcb6006c920 2024-04-20T10:59:50.843 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 4 to deep-scrub 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb6006c920 msgr2=0x7fcb6006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb6006c920 0x7fcb6006ede0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fcb64009b20 tx=0x7fcb640039d0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740c54d0 msgr2=0x7fcb741583d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740c54d0 0x7fcb741583d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0098c0 tx=0x7fcb6c0046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 shutdown_connections 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb6006c920 0x7fcb6006ede0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb740c54d0 0x7fcb741583d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb740c27a0 0x7fcb741efa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 --2- 172.21.15.90:0/3303498751 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb740ad640 0x7fcb74159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 >> 172.21.15.90:0/3303498751 conn(0x7fcb740c9100 msgr2=0x7fcb740c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 shutdown_connections 2024-04-20T10:59:50.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.844+0000 7fcb79192640 1 -- 172.21.15.90:0/3303498751 wait complete. 2024-04-20T10:59:50.856 INFO:tasks.ceph:Scrubbing osd.5 2024-04-20T10:59:50.856 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:50.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.958+0000 7f58e697e640 1 Processor -- start 2024-04-20T10:59:50.958 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.958+0000 7f58e697e640 1 -- start start 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.958+0000 7f58e697e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 0x7f58e00c5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.958+0000 7f58e697e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f58e0156d90 0x7f58e0161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.958+0000 7f58e697e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e00c2f40 con 0x7f58e015a680 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58e697e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f58e0154130 con 0x7f58e0156d90 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58e697e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f58e00c3b90 con 0x7f58e0153d50 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58df7fe640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f58e015a680 0x7f58e0156680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48452/0 (socket says 172.21.15.90:48452) 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58df7fe640 1 -- 172.21.15.90:0/1010704041 learned_addr learned my addr 172.21.15.90:0/1010704041 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58dffff640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 0x7f58e00c5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.962 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1010704041 >> v2:172.21.15.175:3300/0 conn(0x7f58e0156d90 0x7f58e0161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504765693 0 0) 0x7f58e00c2f40 con 0x7f58e015a680 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c8003520 con 0x7f58e015a680 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3907774200 0 0) 0x7f58c8003520 con 0x7f58e015a680 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 msgr2=0x7f58e00c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 0x7f58e00c5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 >> v2:172.21.15.175:3300/0 conn(0x7f58e0156d90 msgr2=0x7f58e0161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 --2- 172.21.15.90:0/1010704041 >> v2:172.21.15.175:3300/0 conn(0x7f58e0156d90 0x7f58e0161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e00c31b0 con 0x7f58e015a680 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f58d4001670 con 0x7f58e015a680 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 >> v1:172.21.15.90:6789/0 conn(0x7f58e015a680 legacy=0x7f58e0156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 0x7f58c80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c8003f30 0x7f58c8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.963 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c8004d40 0x7f58c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58e00c3b90 con 0x7f58c8004d40 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58c800b9c0 con 0x7f58c8003f30 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f58c800bb90 con 0x7f58e0153d50 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c8004d40 0x7f58c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58dffff640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 0x7f58c80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.959+0000 7f58df7fe640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c8003f30 0x7f58c8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.960+0000 7f58e4f1b640 1 -- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 msgr2=0x7f58c80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.960+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e0153d50 0x7f58c80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.960+0000 7f58e4f1b640 1 -- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c8003f30 msgr2=0x7f58c8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.960+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58c8003f30 0x7f58c8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.960+0000 7f58e4f1b640 1 -- 172.21.15.90:0/1010704041 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58c8003520 con 0x7f58c8004d40 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.960+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c8004d40 0x7f58c80051c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009f90 tx=0x7f58c8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397f475d405037ce server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.960+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8039070 con 0x7f58c8004d40 2024-04-20T10:59:50.964 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d802cbd0 con 0x7f58c8004d40 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58deffd640 1 -- 172.21.15.90:0/1010704041 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d8009c10 con 0x7f58c8004d40 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58e697e640 1 -- 172.21.15.90:0/1010704041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c8004d40 msgr2=0x7f58c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58e697e640 1 --2- 172.21.15.90:0/1010704041 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58c8004d40 0x7f58c80051c0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f58d8009f90 tx=0x7f58c8005830 comp rx=0 tx=0).stop 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58e4f1b640 1 -- 172.21.15.90:0/1010704041 reap_dead start 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58e697e640 1 -- 172.21.15.90:0/1010704041 shutdown_connections 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58e697e640 1 -- 172.21.15.90:0/1010704041 >> 172.21.15.90:0/1010704041 conn(0x7f58e006ca40 msgr2=0x7f58e006ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58e697e640 1 -- 172.21.15.90:0/1010704041 shutdown_connections 2024-04-20T10:59:50.965 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.961+0000 7f58e697e640 1 -- 172.21.15.90:0/1010704041 wait complete. 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.962+0000 7f58e697e640 1 Processor -- start 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.962+0000 7f58e697e640 1 -- start start 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58e697e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e00c82f0 0x7f58e01ec1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58e697e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58e0157a20 0x7f58e01ec700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58e697e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e014da80 0x7f58e014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58e697e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f58e0073ab0 con 0x7f58e0157a20 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58e697e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f58e015ab10 con 0x7f58e014da80 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58e697e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f58e0073c30 con 0x7f58e00c82f0 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58e0157a20 0x7f58e01ec700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.968 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58e0157a20 0x7f58e01ec700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52202/0 (socket says 172.21.15.90:52202) 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 -- 172.21.15.90:0/1547815785 learned_addr learned my addr 172.21.15.90:0/1547815785 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58dffff640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e00c82f0 0x7f58e01ec1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 -- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e00c82f0 msgr2=0x7f58e01ec1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e014da80 0x7f58e014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f58e00c82f0 0x7f58e01ec1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 -- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e014da80 msgr2=0x7f58e014df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f58e014da80 0x7f58e014df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.963+0000 7f58df7fe640 1 -- 172.21.15.90:0/1547815785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e00ad960 con 0x7f58e0157a20 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.964+0000 7f58df7fe640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58e0157a20 0x7f58e01ec700 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f58d4007290 tx=0x7f58d4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.964+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d400f960 con 0x7f58e0157a20 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.964+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58d4018070 con 0x7f58e0157a20 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.964+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58e00ac1b0 con 0x7f58e0157a20 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.964+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58d400fd60 con 0x7f58e0157a20 2024-04-20T10:59:50.969 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.964+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58e01efe80 con 0x7f58e0157a20 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.965+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f58e00761f0 con 0x7f58e0157a20 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.965+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f58d401d460 con 0x7f58e0157a20 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58dcff9640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f58cc06c920 0x7f58cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f58d408ce40 con 0x7f58e0157a20 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58dffff640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f58cc06c920 0x7f58cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58dcff9640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7f58cc077b00 0x7f58cc079f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 --> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58d401ee50 con 0x7f58cc077b00 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f58d408d2d0 con 0x7f58e0157a20 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58dffff640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f58cc06c920 0x7f58cc06ede0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58d00099e0 tx=0x7f58d0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.966+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7f58cc077b00 0x7f58cc079f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.967+0000 7f58e4f1b640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7f58cc077b00 0x7f58cc079f80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:50.970 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.968+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== osd.5 v2:172.21.15.175:6824/1056337988 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f58d401ee50 con 0x7f58cc077b00 2024-04-20T10:59:50.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.981+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 --> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f58e00c2c80 con 0x7f58cc077b00 2024-04-20T10:59:50.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.981+0000 7f58dcff9640 1 -- 172.21.15.90:0/1547815785 <== osd.5 v2:172.21.15.175:6824/1056337988 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f58e00c2c80 con 0x7f58cc077b00 2024-04-20T10:59:50.982 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:50.982 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:50.982 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7f58cc077b00 msgr2=0x7f58cc079f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.175:6824/1056337988,v1:172.21.15.175:6825/1056337988] conn(0x7f58cc077b00 0x7f58cc079f80 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f58cc06c920 msgr2=0x7f58cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f58cc06c920 0x7f58cc06ede0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f58d00099e0 tx=0x7f58d0008040 comp rx=0 tx=0).stop 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58e0157a20 msgr2=0x7f58e01ec700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 --2- 172.21.15.90:0/1547815785 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f58e0157a20 0x7f58e01ec700 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f58d4007290 tx=0x7f58d4007750 comp rx=0 tx=0).stop 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e4f1b640 1 -- 172.21.15.90:0/1547815785 reap_dead start 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 shutdown_connections 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 >> 172.21.15.90:0/1547815785 conn(0x7f58e006ca40 msgr2=0x7f58e0151b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:50.983 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 shutdown_connections 2024-04-20T10:59:50.984 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:50.982+0000 7f58e697e640 1 -- 172.21.15.90:0/1547815785 wait complete. 2024-04-20T10:59:50.992 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-20T10:59:51.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.090+0000 7f45c9c77640 1 Processor -- start 2024-04-20T10:59:51.090 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.090+0000 7f45c9c77640 1 -- start start 2024-04-20T10:59:51.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c9c77640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45c4153c50 0x7f45c415a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c9c77640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40c5520 0x7f45c40c2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c9c77640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45c4071650 con 0x7f45c40c2a70 2024-04-20T10:59:51.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c9c77640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f45c40718f0 con 0x7f45c4153c50 2024-04-20T10:59:51.092 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c9c77640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f45c40c3ca0 con 0x7f45c40c5520 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c37fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45c4153c50 0x7f45c415a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c3fff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f45c40c2a70 0x7f45c40c44a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48458/0 (socket says 172.21.15.90:48458) 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c37fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f45c4153c50 0x7f45c415a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52204/0 (socket says 172.21.15.90:52204) 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c3fff640 1 -- 172.21.15.90:0/2319652300 learned_addr learned my addr 172.21.15.90:0/2319652300 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c2ffd640 1 --2- 172.21.15.90:0/2319652300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40c5520 0x7f45c40c2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c37fe640 1 -- 172.21.15.90:0/2319652300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40c5520 msgr2=0x7f45c40c2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c37fe640 1 --2- 172.21.15.90:0/2319652300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40c5520 0x7f45c40c2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c37fe640 1 -- 172.21.15.90:0/2319652300 >> v1:172.21.15.90:6789/0 conn(0x7f45c40c2a70 legacy=0x7f45c40c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c27fc640 1 -- 172.21.15.90:0/2319652300 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584149213 0 0) 0x7f45c4071650 con 0x7f45c40c2a70 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.091+0000 7f45c37fe640 1 -- 172.21.15.90:0/2319652300 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c40c3f80 con 0x7f45c4153c50 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.092+0000 7f45c37fe640 1 --2- 172.21.15.90:0/2319652300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c4153c50 0x7f45c415a710 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f45b40097a0 tx=0x7f45b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce4f9a825f1d3e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.092+0000 7f45c27fc640 1 -- 172.21.15.90:0/2319652300 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4035020 con 0x7f45c4153c50 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.092+0000 7f45c27fc640 1 -- 172.21.15.90:0/2319652300 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b4031830 con 0x7f45c4153c50 2024-04-20T10:59:51.093 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.092+0000 7f45c27fc640 1 -- 172.21.15.90:0/2319652300 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4031c00 con 0x7f45c4153c50 2024-04-20T10:59:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 -- 172.21.15.90:0/2319652300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c4153c50 msgr2=0x7f45c415a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2319652300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c4153c50 0x7f45c415a710 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f45b40097a0 tx=0x7f45b402b8d0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 -- 172.21.15.90:0/2319652300 shutdown_connections 2024-04-20T10:59:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2319652300 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c40c5520 0x7f45c40c2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2319652300 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c4153c50 0x7f45c415a710 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.096 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 -- 172.21.15.90:0/2319652300 >> 172.21.15.90:0/2319652300 conn(0x7f45c40c9100 msgr2=0x7f45c40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 -- 172.21.15.90:0/2319652300 shutdown_connections 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.093+0000 7f45c9c77640 1 -- 172.21.15.90:0/2319652300 wait complete. 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.094+0000 7f45c9c77640 1 Processor -- start 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.094+0000 7f45c9c77640 1 -- start start 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c9c77640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c40c2a70 0x7f45c4147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c9c77640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40c5520 0x7f45c406c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c9c77640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c4153c50 0x7f45c41418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c9c77640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f45c41541b0 con 0x7f45c40c2a70 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c9c77640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f45c4154030 con 0x7f45c40c5520 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c9c77640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f45c40ad640 con 0x7f45c4153c50 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c40c2a70 0x7f45c4147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c40c2a70 0x7f45c4147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52214/0 (socket says 172.21.15.90:52214) 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 -- 172.21.15.90:0/2074247275 learned_addr learned my addr 172.21.15.90:0/2074247275 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:51.097 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c3fff640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c4153c50 0x7f45c41418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c2ffd640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40c5520 0x7f45c406c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 -- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c4153c50 msgr2=0x7f45c41418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c4153c50 0x7f45c41418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 -- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40c5520 msgr2=0x7f45c406c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40c5520 0x7f45c406c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 -- 172.21.15.90:0/2074247275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45c415a6e0 con 0x7f45c40c2a70 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c3fff640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c4153c50 0x7f45c41418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c2ffd640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40c5520 0x7f45c406c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.095+0000 7f45c37fe640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c40c2a70 0x7f45c4147280 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f45b40098c0 tx=0x7f45b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.096+0000 7f45abfff640 1 -- 172.21.15.90:0/2074247275 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4040070 con 0x7f45c40c2a70 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.096+0000 7f45abfff640 1 -- 172.21.15.90:0/2074247275 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45b403e070 con 0x7f45c40c2a70 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.096+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45c4159960 con 0x7f45c40c2a70 2024-04-20T10:59:51.098 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.096+0000 7f45abfff640 1 -- 172.21.15.90:0/2074247275 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45b4035040 con 0x7f45c40c2a70 2024-04-20T10:59:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.096+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45c41477c0 con 0x7f45c40c2a70 2024-04-20T10:59:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.097+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45c4076150 con 0x7f45c40c2a70 2024-04-20T10:59:51.099 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.097+0000 7f45abfff640 1 -- 172.21.15.90:0/2074247275 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f45b4038020 con 0x7f45c40c2a70 2024-04-20T10:59:51.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.097+0000 7f45abfff640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f45b006c8f0 0x7f45b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.097+0000 7f45abfff640 1 -- 172.21.15.90:0/2074247275 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f45b40ad6b0 con 0x7f45c40c2a70 2024-04-20T10:59:51.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.098+0000 7f45c2ffd640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f45b006c8f0 0x7f45b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.100 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.098+0000 7f45c2ffd640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f45b006c8f0 0x7f45b006edb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45c40af600 tx=0x7f45b8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.102 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.102+0000 7f45abfff640 1 -- 172.21.15.90:0/2074247275 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f45b4031800 con 0x7f45c40c2a70 2024-04-20T10:59:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.275+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f45c40c5300 con 0x7f45b006c8f0 2024-04-20T10:59:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.276+0000 7f45abfff640 1 -- 172.21.15.90:0/2074247275 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f45c40c5300 con 0x7f45b006c8f0 2024-04-20T10:59:51.276 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 5 to deep-scrub 2024-04-20T10:59:51.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f45b006c8f0 msgr2=0x7f45b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f45b006c8f0 0x7f45b006edb0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f45c40af600 tx=0x7f45b8008040 comp rx=0 tx=0).stop 2024-04-20T10:59:51.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c40c2a70 msgr2=0x7f45c4147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c40c2a70 0x7f45c4147280 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f45b40098c0 tx=0x7f45b40046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 shutdown_connections 2024-04-20T10:59:51.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f45b006c8f0 0x7f45b006edb0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f45c4153c50 0x7f45c41418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f45c40c5520 0x7f45c406c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 --2- 172.21.15.90:0/2074247275 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f45c40c2a70 0x7f45c4147280 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 >> 172.21.15.90:0/2074247275 conn(0x7f45c40c9100 msgr2=0x7f45c40c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 shutdown_connections 2024-04-20T10:59:51.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.278+0000 7f45c9c77640 1 -- 172.21.15.90:0/2074247275 wait complete. 2024-04-20T10:59:51.289 INFO:tasks.ceph:Scrubbing osd.6 2024-04-20T10:59:51.289 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:51.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.390+0000 7fbf2d0ba640 1 Processor -- start 2024-04-20T10:59:51.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.390+0000 7fbf2d0ba640 1 -- start start 2024-04-20T10:59:51.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf2d0ba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf28151e40 0x7fbf28072660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.394 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf2d0ba640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf28158150 con 0x7fbf28157be0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf2d0ba640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf28158430 con 0x7fbf28072ba0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf2d0ba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbf28158710 con 0x7fbf28151e40 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf2759e640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fbf28157be0 0x7fbf2815ef70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48464/0 (socket says 172.21.15.90:48464) 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf2759e640 1 -- 172.21.15.90:0/1163549910 learned_addr learned my addr 172.21.15.90:0/1163549910 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf26d9d640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf28151e40 0x7fbf28072660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.391+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187518692 0 0) 0x7fbf28158150 con 0x7fbf28157be0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf10003520 con 0x7fbf28157be0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 618582564 0 0) 0x7fbf10003520 con 0x7fbf28157be0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf28151e40 msgr2=0x7fbf28072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf28151e40 0x7fbf28072660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 >> v1:172.21.15.175:6789/0 conn(0x7fbf28072ba0 legacy=0x7fbf28154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf281589f0 con 0x7fbf28157be0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fbf18001670 con 0x7fbf28157be0 2024-04-20T10:59:51.395 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 >> v1:172.21.15.90:6789/0 conn(0x7fbf28157be0 legacy=0x7fbf2815ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf100039e0 0x7fbf10003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf10004340 0x7fbf10004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100050c0 0x7fbf1000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf28158710 con 0x7fbf10004340 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1000bfe0 con 0x7fbf100050c0 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbf1000c1e0 con 0x7fbf100039e0 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf26d9d640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf28151e40 0x7fbf28072660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf2659c640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf10004340 0x7fbf10004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf2759e640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100050c0 0x7fbf1000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf26d9d640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf100039e0 0x7fbf10003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf2659c640 1 -- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf100039e0 msgr2=0x7fbf10003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf2659c640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf100039e0 0x7fbf10003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf2659c640 1 -- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100050c0 msgr2=0x7fbf1000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.396 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf2659c640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf100050c0 0x7fbf1000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf2659c640 1 -- 172.21.15.90:0/1163549910 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf10003520 con 0x7fbf10004340 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.392+0000 7fbf26d9d640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf100039e0 0x7fbf10003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.393+0000 7fbf2659c640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf10004340 0x7fbf10004820 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c001910 tx=0x7fbf10005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a96f722501b28ef server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.393+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c0014e0 con 0x7fbf10004340 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.393+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf1c037070 con 0x7fbf10004340 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.393+0000 7fbf25d9b640 1 -- 172.21.15.90:0/1163549910 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c032880 con 0x7fbf10004340 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.394+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/1163549910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf10004340 msgr2=0x7fbf10004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.394+0000 7fbf2d0ba640 1 --2- 172.21.15.90:0/1163549910 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf10004340 0x7fbf10004820 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c001910 tx=0x7fbf10005830 comp rx=0 tx=0).stop 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.394+0000 7fbf2759e640 1 -- 172.21.15.90:0/1163549910 reap_dead start 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.394+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/1163549910 shutdown_connections 2024-04-20T10:59:51.397 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.394+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/1163549910 >> 172.21.15.90:0/1163549910 conn(0x7fbf28067cf0 msgr2=0x7fbf280ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.394+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/1163549910 shutdown_connections 2024-04-20T10:59:51.398 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.394+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/1163549910 wait complete. 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.395+0000 7fbf2d0ba640 1 Processor -- start 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.395+0000 7fbf2d0ba640 1 -- start start 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf10004340 0x7fbf280c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf280c8890 0x7fbf280adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf281eb4d0 0x7fbf280ae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fbf280ac8b0 con 0x7fbf281eb4d0 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fbf281545f0 con 0x7fbf10004340 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fbf280aca30 con 0x7fbf280c8890 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf281eb4d0 0x7fbf280ae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf281eb4d0 0x7fbf280ae1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52232/0 (socket says 172.21.15.90:52232) 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 -- 172.21.15.90:0/647406366 learned_addr learned my addr 172.21.15.90:0/647406366 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:51.401 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2659c640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf280c8890 0x7fbf280adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf26d9d640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf10004340 0x7fbf280c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 -- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf280c8890 msgr2=0x7fbf280adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf280c8890 0x7fbf280adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 -- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf10004340 msgr2=0x7fbf280c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fbf10004340 0x7fbf280c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 -- 172.21.15.90:0/647406366 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf280ae730 con 0x7fbf281eb4d0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2659c640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fbf280c8890 0x7fbf280adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2759e640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf281eb4d0 0x7fbf280ae1f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbf28157fc0 tx=0x7fbf18007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800f700 con 0x7fbf281eb4d0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf18018070 con 0x7fbf281eb4d0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf280c5830 con 0x7fbf281eb4d0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1800fb00 con 0x7fbf281eb4d0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.396+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf280c5df0 con 0x7fbf281eb4d0 2024-04-20T10:59:51.402 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.397+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbf280761f0 con 0x7fbf281eb4d0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.398+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbf1800fca0 con 0x7fbf281eb4d0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.398+0000 7fbf0f7fe640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbf1406c920 0x7fbf1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.398+0000 7fbf26d9d640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbf1406c920 0x7fbf1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.398+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fbf1808c880 con 0x7fbf281eb4d0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.399+0000 7fbf0f7fe640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fbf14077b00 0x7fbf14079f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.399+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 --> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbf1801ee50 con 0x7fbf14077b00 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.399+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fbf1808cd10 con 0x7fbf281eb4d0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.399+0000 7fbf2659c640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fbf14077b00 0x7fbf14079f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.399+0000 7fbf26d9d640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbf1406c920 0x7fbf1406ede0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbf280cb150 tx=0x7fbf2000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.399+0000 7fbf2659c640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fbf14077b00 0x7fbf14079f80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.403 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.400+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== osd.6 v2:172.21.15.175:6816/3312370671 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbf1801ee50 con 0x7fbf14077b00 2024-04-20T10:59:51.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.413+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 --> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fbf280ac4b0 con 0x7fbf14077b00 2024-04-20T10:59:51.413 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.413+0000 7fbf0f7fe640 1 -- 172.21.15.90:0/647406366 <== osd.6 v2:172.21.15.175:6816/3312370671 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fbf280ac4b0 con 0x7fbf14077b00 2024-04-20T10:59:51.414 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:51.414 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:51.414 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:51.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fbf14077b00 msgr2=0x7fbf14079f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.175:6816/3312370671,v1:172.21.15.175:6817/3312370671] conn(0x7fbf14077b00 0x7fbf14079f80 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.415 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbf1406c920 msgr2=0x7fbf1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fbf1406c920 0x7fbf1406ede0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fbf280cb150 tx=0x7fbf2000b040 comp rx=0 tx=0).stop 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf281eb4d0 msgr2=0x7fbf280ae1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 --2- 172.21.15.90:0/647406366 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fbf281eb4d0 0x7fbf280ae1f0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fbf28157fc0 tx=0x7fbf18007430 comp rx=0 tx=0).stop 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2759e640 1 -- 172.21.15.90:0/647406366 reap_dead start 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 shutdown_connections 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 >> 172.21.15.90:0/647406366 conn(0x7fbf28067cf0 msgr2=0x7fbf281506b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 shutdown_connections 2024-04-20T10:59:51.416 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.414+0000 7fbf2d0ba640 1 -- 172.21.15.90:0/647406366 wait complete. 2024-04-20T10:59:51.426 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-20T10:59:51.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.525+0000 7f78e1f00640 1 Processor -- start 2024-04-20T10:59:51.526 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.525+0000 7f78e1f00640 1 -- start start 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78e1f00640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f78dc151b10 0x7f78dc0ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78e1f00640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78dc0c51d0 0x7f78dc157a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78e1f00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc0adc10 0x7f78dc157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78e1f00640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f78dc0c4d40 con 0x7f78dc0c51d0 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78e1f00640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f78dc151ef0 con 0x7f78dc151b10 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78e1f00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78dc158500 con 0x7f78dc0adc10 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78daffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78dc0c51d0 0x7f78dc157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78daffd640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f78dc0c51d0 0x7f78dc157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52244/0 (socket says 172.21.15.90:52244) 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.526+0000 7f78daffd640 1 -- 172.21.15.90:0/1874452179 learned_addr learned my addr 172.21.15.90:0/1874452179 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78dbfff640 1 --2- 172.21.15.90:0/1874452179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc0adc10 0x7f78dc157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.529 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78db7fe640 1 --2- 172.21.15.90:0/1874452179 >> v2:172.21.15.175:3300/0 conn(0x7f78dc151b10 0x7f78dc0ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78daffd640 1 -- 172.21.15.90:0/1874452179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc0adc10 msgr2=0x7f78dc157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78daffd640 1 --2- 172.21.15.90:0/1874452179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc0adc10 0x7f78dc157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78daffd640 1 -- 172.21.15.90:0/1874452179 >> v2:172.21.15.175:3300/0 conn(0x7f78dc151b10 msgr2=0x7f78dc0ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78daffd640 1 --2- 172.21.15.90:0/1874452179 >> v2:172.21.15.175:3300/0 conn(0x7f78dc151b10 0x7f78dc0ad6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78daffd640 1 -- 172.21.15.90:0/1874452179 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc1587c0 con 0x7f78dc0c51d0 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78db7fe640 1 --2- 172.21.15.90:0/1874452179 >> v2:172.21.15.175:3300/0 conn(0x7f78dc151b10 0x7f78dc0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.527+0000 7f78daffd640 1 --2- 172.21.15.90:0/1874452179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc157a80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0ca190 tx=0x7f78d002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf9f950cad7ea62 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78da7fc640 1 -- 172.21.15.90:0/1874452179 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0038070 con 0x7f78dc0c51d0 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78da7fc640 1 -- 172.21.15.90:0/1874452179 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d002f050 con 0x7f78dc0c51d0 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78da7fc640 1 -- 172.21.15.90:0/1874452179 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0031970 con 0x7f78dc0c51d0 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 -- 172.21.15.90:0/1874452179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 msgr2=0x7f78dc157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.530 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 --2- 172.21.15.90:0/1874452179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc157a80 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0ca190 tx=0x7f78d002b7f0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 -- 172.21.15.90:0/1874452179 shutdown_connections 2024-04-20T10:59:51.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 --2- 172.21.15.90:0/1874452179 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc0adc10 0x7f78dc157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 --2- 172.21.15.90:0/1874452179 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc157a80 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 --2- 172.21.15.90:0/1874452179 >> v2:172.21.15.175:3300/0 conn(0x7f78dc151b10 0x7f78dc0ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 -- 172.21.15.90:0/1874452179 >> 172.21.15.90:0/1874452179 conn(0x7f78dc0c9100 msgr2=0x7f78dc0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 -- 172.21.15.90:0/1874452179 shutdown_connections 2024-04-20T10:59:51.531 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.528+0000 7f78e1f00640 1 -- 172.21.15.90:0/1874452179 wait complete. 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.529+0000 7f78e1f00640 1 Processor -- start 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78e1f00640 1 -- start start 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78e1f00640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0adc10 0x7f78dc1ed780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78e1f00640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc14d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78e1f00640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc151b10 0x7f78dc14dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78e1f00640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc06b930 con 0x7f78dc0c51d0 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78e1f00640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f78dc0c49d0 con 0x7f78dc0adc10 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78e1f00640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f78dc06bab0 con 0x7f78dc151b10 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78daffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc14d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78daffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc14d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52254/0 (socket says 172.21.15.90:52254) 2024-04-20T10:59:51.534 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78daffd640 1 -- 172.21.15.90:0/2872646474 learned_addr learned my addr 172.21.15.90:0/2872646474 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78db7fe640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0adc10 0x7f78dc1ed780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.530+0000 7f78dbfff640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc151b10 0x7f78dc14dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78daffd640 1 -- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc151b10 msgr2=0x7f78dc14dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78daffd640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc151b10 0x7f78dc14dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78daffd640 1 -- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0adc10 msgr2=0x7f78dc1ed780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78daffd640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0adc10 0x7f78dc1ed780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78daffd640 1 -- 172.21.15.90:0/2872646474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78dc144ad0 con 0x7f78dc0c51d0 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78dbfff640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc151b10 0x7f78dc14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78daffd640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc14d9a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f78d0000c00 tx=0x7f78d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78c3fff640 1 -- 172.21.15.90:0/2872646474 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0042070 con 0x7f78dc0c51d0 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78c3fff640 1 -- 172.21.15.90:0/2872646474 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d003d680 con 0x7f78dc0c51d0 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78dc1ee200 con 0x7f78dc0c51d0 2024-04-20T10:59:51.535 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78c3fff640 1 -- 172.21.15.90:0/2872646474 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d0038040 con 0x7f78dc0c51d0 2024-04-20T10:59:51.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.531+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78dc152e50 con 0x7f78dc0c51d0 2024-04-20T10:59:51.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.532+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78dc076150 con 0x7f78dc0c51d0 2024-04-20T10:59:51.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.532+0000 7f78c3fff640 1 -- 172.21.15.90:0/2872646474 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78d0045070 con 0x7f78dc0c51d0 2024-04-20T10:59:51.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.533+0000 7f78c3fff640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c920 0x7f78c806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.533+0000 7f78c3fff640 1 -- 172.21.15.90:0/2872646474 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f78d00adcd0 con 0x7f78dc0c51d0 2024-04-20T10:59:51.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.533+0000 7f78db7fe640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c920 0x7f78c806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.536 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.533+0000 7f78db7fe640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c920 0x7f78c806ede0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0c8930 tx=0x7f78cc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.537 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.537+0000 7f78c3fff640 1 -- 172.21.15.90:0/2872646474 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f78d007b3f0 con 0x7f78dc0c51d0 2024-04-20T10:59:51.721 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.721+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f78dc144880 con 0x7f78c806c920 2024-04-20T10:59:51.722 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.721+0000 7f78c3fff640 1 -- 172.21.15.90:0/2872646474 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f78dc144880 con 0x7f78c806c920 2024-04-20T10:59:51.722 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 6 to deep-scrub 2024-04-20T10:59:51.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.723+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c920 msgr2=0x7f78c806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.723+0000 7f78e1f00640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c920 0x7f78c806ede0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f78dc0c8930 tx=0x7f78cc008040 comp rx=0 tx=0).stop 2024-04-20T10:59:51.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.723+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 msgr2=0x7f78dc14d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.723+0000 7f78e1f00640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc14d9a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f78d0000c00 tx=0x7f78d00046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 shutdown_connections 2024-04-20T10:59:51.724 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f78c806c920 0x7f78c806ede0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f78dc151b10 0x7f78dc14dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f78dc0c51d0 0x7f78dc14d9a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 --2- 172.21.15.90:0/2872646474 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f78dc0adc10 0x7f78dc1ed780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 >> 172.21.15.90:0/2872646474 conn(0x7f78dc0c9100 msgr2=0x7f78dc150610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 shutdown_connections 2024-04-20T10:59:51.725 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.724+0000 7f78e1f00640 1 -- 172.21.15.90:0/2872646474 wait complete. 2024-04-20T10:59:51.735 INFO:tasks.ceph:Scrubbing osd.7 2024-04-20T10:59:51.736 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-20T10:59:51.841 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.841+0000 7f6d65b96640 1 Processor -- start 2024-04-20T10:59:51.842 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.841+0000 7f6d65b96640 1 -- start start 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.841+0000 7f6d65b96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d60157be0 0x7f6d60154b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.841+0000 7f6d65b96640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d600c0fd0 0x7f6d601550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.841+0000 7f6d65b96640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d60158150 con 0x7f6d60151e40 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.841+0000 7f6d65b96640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6d60155600 con 0x7f6d600c0fd0 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.841+0000 7f6d65b96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60158430 con 0x7f6d60157be0 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d600c0fd0 0x7f6d601550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5ffff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6d600c0fd0 0x7f6d601550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52264/0 (socket says 172.21.15.90:52264) 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1929751643 learned_addr learned my addr 172.21.15.90:0/1929751643 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5effd640 1 --2- 172.21.15.90:0/1929751643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d60157be0 0x7f6d60154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1929751643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d60157be0 msgr2=0x7f6d60154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.844 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5ffff640 1 --2- 172.21.15.90:0/1929751643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d60157be0 0x7f6d60154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1929751643 >> v1:172.21.15.175:6789/0 conn(0x7f6d60151e40 legacy=0x7f6d60072660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.842+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1929751643 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d60158710 con 0x7f6d600c0fd0 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d5ffff640 1 --2- 172.21.15.90:0/1929751643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d600c0fd0 0x7f6d601550c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6d60155780 tx=0x7f6d5802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efa2a1037d864c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d5e7fc640 1 -- 172.21.15.90:0/1929751643 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d5802ca50 con 0x7f6d600c0fd0 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d5e7fc640 1 -- 172.21.15.90:0/1929751643 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5802cbf0 con 0x7f6d600c0fd0 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d5e7fc640 1 -- 172.21.15.90:0/1929751643 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d580343f0 con 0x7f6d600c0fd0 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 -- 172.21.15.90:0/1929751643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d600c0fd0 msgr2=0x7f6d601550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 --2- 172.21.15.90:0/1929751643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d600c0fd0 0x7f6d601550c0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6d60155780 tx=0x7f6d5802beb0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 -- 172.21.15.90:0/1929751643 shutdown_connections 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 --2- 172.21.15.90:0/1929751643 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d600c0fd0 0x7f6d601550c0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 --2- 172.21.15.90:0/1929751643 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d60157be0 0x7f6d60154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 -- 172.21.15.90:0/1929751643 >> 172.21.15.90:0/1929751643 conn(0x7f6d60067cf0 msgr2=0x7f6d600ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.845 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 -- 172.21.15.90:0/1929751643 shutdown_connections 2024-04-20T10:59:51.846 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.843+0000 7f6d65b96640 1 -- 172.21.15.90:0/1929751643 wait complete. 2024-04-20T10:59:51.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.844+0000 7f6d65b96640 1 Processor -- start 2024-04-20T10:59:51.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d65b96640 1 -- start start 2024-04-20T10:59:51.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d65b96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600c0fd0 0x7f6d600ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d65b96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60157be0 0x7f6d60150160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d65b96640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d60150bd0 0x7f6d600c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d65b96640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6d601545f0 con 0x7f6d60150bd0 2024-04-20T10:59:51.849 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d65b96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6d60155ae0 con 0x7f6d60157be0 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d65b96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6d60072d70 con 0x7f6d600c0fd0 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d60150bd0 0x7f6d600c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d5ffff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d60150bd0 0x7f6d600c6be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52278/0 (socket says 172.21.15.90:52278) 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.845+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1355770655 learned_addr learned my addr 172.21.15.90:0/1355770655 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5f7fe640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600c0fd0 0x7f6d600ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5effd640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60157be0 0x7f6d60150160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600c0fd0 msgr2=0x7f6d600ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5ffff640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6d600c0fd0 0x7f6d600ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60157be0 msgr2=0x7f6d60150160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5ffff640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6d60157be0 0x7f6d60150160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1355770655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601506a0 con 0x7f6d60150bd0 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d5ffff640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d60150bd0 0x7f6d600c6be0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009f40 tx=0x7f6d58004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.850 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58043020 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d5803e450 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d601508f0 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d58009510 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.846+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d601efe30 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.847+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d601f04f0 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6d58005d10 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d47fff640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4c06c8f0 0x7f6d4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d5f7fe640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4c06c8f0 0x7f6d4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f6d580aec30 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d47fff640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f6d4c077ac0 0x7f6d4c079f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 --> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d4c07a610 con 0x7f6d4c077ac0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f6d580b1330 con 0x7f6d60150bd0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d5f7fe640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4c06c8f0 0x7f6d4c06edb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6d601ed670 tx=0x7f6d50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.848+0000 7f6d5effd640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f6d4c077ac0 0x7f6d4c079f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.849+0000 7f6d5effd640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f6d4c077ac0 0x7f6d4c079f40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.850+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== osd.7 v2:172.21.15.175:6808/2312344703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d4c07a610 con 0x7f6d4c077ac0 2024-04-20T10:59:51.862 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.863+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 --> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6d600761f0 con 0x7f6d4c077ac0 2024-04-20T10:59:51.863 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.863+0000 7f6d47fff640 1 -- 172.21.15.90:0/1355770655 <== osd.7 v2:172.21.15.175:6808/2312344703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6d600761f0 con 0x7f6d4c077ac0 2024-04-20T10:59:51.863 INFO:teuthology.orchestra.run.smithi090.stdout:{ 2024-04-20T10:59:51.863 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-20T10:59:51.863 INFO:teuthology.orchestra.run.smithi090.stdout:} 2024-04-20T10:59:51.864 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.863+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f6d4c077ac0 msgr2=0x7f6d4c079f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.863+0000 7f6d65b96640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.175:6808/2312344703,v1:172.21.15.175:6809/2312344703] conn(0x7f6d4c077ac0 0x7f6d4c079f40 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4c06c8f0 msgr2=0x7f6d4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6d4c06c8f0 0x7f6d4c06edb0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f6d601ed670 tx=0x7f6d50009040 comp rx=0 tx=0).stop 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d60150bd0 msgr2=0x7f6d600c6be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 --2- 172.21.15.90:0/1355770655 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6d60150bd0 0x7f6d600c6be0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6d58009f40 tx=0x7f6d58004a40 comp rx=0 tx=0).stop 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d5ffff640 1 -- 172.21.15.90:0/1355770655 reap_dead start 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 shutdown_connections 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 >> 172.21.15.90:0/1355770655 conn(0x7f6d60067cf0 msgr2=0x7f6d60157020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.865 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 shutdown_connections 2024-04-20T10:59:51.866 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.864+0000 7f6d65b96640 1 -- 172.21.15.90:0/1355770655 wait complete. 2024-04-20T10:59:51.874 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-20T10:59:51.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.971+0000 7f3119f0e640 1 Processor -- start 2024-04-20T10:59:51.972 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.971+0000 7f3119f0e640 1 -- start start 2024-04-20T10:59:51.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f3119f0e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31140c27a0 0x7f31141570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.974 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f3119f0e640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31140adab0 con 0x7f31140c54d0 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f3119f0e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3114071690 con 0x7f31140ad640 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f3119f0e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f3114071970 con 0x7f31140c27a0 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f31137fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31140c27a0 0x7f31141570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f3112ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f31140c54d0 0x7f311415a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:48468/0 (socket says 172.21.15.90:48468) 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f31137fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f31140c27a0 0x7f31141570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52290/0 (socket says 172.21.15.90:52290) 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.972+0000 7f3112ffd640 1 -- 172.21.15.90:0/3974969614 learned_addr learned my addr 172.21.15.90:0/3974969614 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.973+0000 7f31137fe640 1 -- 172.21.15.90:0/3974969614 >> v1:172.21.15.175:6789/0 conn(0x7f31140ad640 legacy=0x7f3114153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.973+0000 7f31137fe640 1 -- 172.21.15.90:0/3974969614 >> v1:172.21.15.90:6789/0 conn(0x7f31140c54d0 legacy=0x7f311415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.973+0000 7f31137fe640 1 -- 172.21.15.90:0/3974969614 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3114159ce0 con 0x7f31140c27a0 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.973+0000 7f31127fc640 1 -- 172.21.15.90:0/3974969614 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3010198380 0 0) 0x7f31140adab0 con 0x7f31140c54d0 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.973+0000 7f31137fe640 1 --2- 172.21.15.90:0/3974969614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140c27a0 0x7f31141570d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f31040097a0 tx=0x7f310402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97e5db5e87e97c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.973+0000 7f31127fc640 1 -- 172.21.15.90:0/3974969614 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104035020 con 0x7f31140c27a0 2024-04-20T10:59:51.975 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f31127fc640 1 -- 172.21.15.90:0/3974969614 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3104031830 con 0x7f31140c27a0 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f31127fc640 1 -- 172.21.15.90:0/3974969614 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104031c00 con 0x7f31140c27a0 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f3119f0e640 1 -- 172.21.15.90:0/3974969614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140c27a0 msgr2=0x7f31141570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f3119f0e640 1 --2- 172.21.15.90:0/3974969614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140c27a0 0x7f31141570d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f31040097a0 tx=0x7f310402b8d0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f3119f0e640 1 -- 172.21.15.90:0/3974969614 shutdown_connections 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f3119f0e640 1 --2- 172.21.15.90:0/3974969614 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140c27a0 0x7f31141570d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f3119f0e640 1 -- 172.21.15.90:0/3974969614 >> 172.21.15.90:0/3974969614 conn(0x7f31140c9100 msgr2=0x7f31140c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f3119f0e640 1 -- 172.21.15.90:0/3974969614 shutdown_connections 2024-04-20T10:59:51.976 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.974+0000 7f3119f0e640 1 -- 172.21.15.90:0/3974969614 wait complete. 2024-04-20T10:59:51.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.975+0000 7f3119f0e640 1 Processor -- start 2024-04-20T10:59:51.978 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.975+0000 7f3119f0e640 1 -- start start 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3119f0e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140ad640 0x7f3114158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3119f0e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31140c27a0 0x7f3114149940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3119f0e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31140c54d0 0x7f3114149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3119f0e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f31140c2b80 con 0x7f31140ad640 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3119f0e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f311406f510 con 0x7f31140c27a0 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3119f0e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f31140c2d00 con 0x7f31140c54d0 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140ad640 0x7f3114158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140ad640 0x7f3114158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52294/0 (socket says 172.21.15.90:52294) 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 -- 172.21.15.90:0/1744297267 learned_addr learned my addr 172.21.15.90:0/1744297267 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3113fff640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31140c54d0 0x7f3114149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f3112ffd640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31140c27a0 0x7f3114149940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 -- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31140c54d0 msgr2=0x7f3114149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.979 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31140c54d0 0x7f3114149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 -- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31140c27a0 msgr2=0x7f3114149940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31140c27a0 0x7f3114149940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.976+0000 7f31137fe640 1 -- 172.21.15.90:0/1744297267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3114072a20 con 0x7f31140ad640 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.977+0000 7f31137fe640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140ad640 0x7f3114158410 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f31040097a0 tx=0x7f31040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.977+0000 7f30fbfff640 1 -- 172.21.15.90:0/1744297267 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f310403aa70 con 0x7f31140ad640 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.977+0000 7f30fbfff640 1 -- 172.21.15.90:0/1744297267 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f310403ac10 con 0x7f31140ad640 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.977+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3114072d00 con 0x7f31140ad640 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.977+0000 7f30fbfff640 1 -- 172.21.15.90:0/1744297267 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040443f0 con 0x7f31140ad640 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.977+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31140732c0 con 0x7f31140ad640 2024-04-20T10:59:51.980 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.978+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3114076150 con 0x7f31140ad640 2024-04-20T10:59:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.978+0000 7f30fbfff640 1 -- 172.21.15.90:0/1744297267 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f310404b060 con 0x7f31140ad640 2024-04-20T10:59:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.978+0000 7f30fbfff640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f310006c8f0 0x7f310006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.978+0000 7f30fbfff640 1 -- 172.21.15.90:0/1744297267 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f31040ae010 con 0x7f31140ad640 2024-04-20T10:59:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.979+0000 7f3112ffd640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f310006c8f0 0x7f310006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:51.981 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.979+0000 7f3112ffd640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f310006c8f0 0x7f310006edb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f311414a990 tx=0x7f3108007b50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:51.982 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:51.983+0000 7f30fbfff640 1 -- 172.21.15.90:0/1744297267 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f310403f070 con 0x7f31140ad640 2024-04-20T10:59:52.159 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.159+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f31140c52b0 con 0x7f310006c8f0 2024-04-20T10:59:52.160 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.159+0000 7f30fbfff640 1 -- 172.21.15.90:0/1744297267 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f31140c52b0 con 0x7f310006c8f0 2024-04-20T10:59:52.160 INFO:teuthology.orchestra.run.smithi090.stderr:instructed osd(s) 7 to deep-scrub 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f310006c8f0 msgr2=0x7f310006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f310006c8f0 0x7f310006edb0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f311414a990 tx=0x7f3108007b50 comp rx=0 tx=0).stop 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140ad640 msgr2=0x7f3114158410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140ad640 0x7f3114158410 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f31040097a0 tx=0x7f31040046c0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 shutdown_connections 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f310006c8f0 0x7f310006edb0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f31140c54d0 0x7f3114149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.162 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f31140c27a0 0x7f3114149940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 --2- 172.21.15.90:0/1744297267 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f31140ad640 0x7f3114158410 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.161+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 >> 172.21.15.90:0/1744297267 conn(0x7f31140c9100 msgr2=0x7f31141500f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:52.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.162+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 shutdown_connections 2024-04-20T10:59:52.163 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.162+0000 7f3119f0e640 1 -- 172.21.15.90:0/1744297267 wait complete. 2024-04-20T10:59:52.173 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T10:59:52.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.269+0000 7f2a22074640 1 Processor -- start 2024-04-20T10:59:52.269 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.269+0000 7f2a22074640 1 -- start start 2024-04-20T10:59:52.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a22074640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c06cc40 0x7f2a1c0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:52.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a22074640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2a1c15a810 0x7f2a1c0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:52.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a22074640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a1c0c7100 con 0x7f2a1c153df0 2024-04-20T10:59:52.271 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a22074640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f2a1c0ca690 con 0x7f2a1c15a810 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a22074640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c06c7b0 con 0x7f2a1c06cc40 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2a1c15a810 0x7f2a1c0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f2a1c15a810 0x7f2a1c0c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52304/0 (socket says 172.21.15.90:52304) 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3271927663 learned_addr learned my addr 172.21.15.90:0/3271927663 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1affd640 1 --2- 172.21.15.90:0/3271927663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c06cc40 0x7f2a1c0c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3271927663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c06cc40 msgr2=0x7f2a1c0c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1bfff640 1 --2- 172.21.15.90:0/3271927663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c06cc40 0x7f2a1c0c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3271927663 >> v1:172.21.15.175:6789/0 conn(0x7f2a1c153df0 legacy=0x7f2a1c0c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3271927663 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c06c160 con 0x7f2a1c15a810 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.270+0000 7f2a1affd640 1 --2- 172.21.15.90:0/3271927663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c06cc40 0x7f2a1c0c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.271+0000 7f2a1bfff640 1 --2- 172.21.15.90:0/3271927663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c0c8a90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009e80 tx=0x7f2a1402bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e935fc1b89a0b3cd server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.271+0000 7f2a1a7fc640 1 -- 172.21.15.90:0/3271927663 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1402c930 con 0x7f2a1c15a810 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.271+0000 7f2a1a7fc640 1 -- 172.21.15.90:0/3271927663 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1402cad0 con 0x7f2a1c15a810 2024-04-20T10:59:52.272 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.271+0000 7f2a1a7fc640 1 -- 172.21.15.90:0/3271927663 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a140343f0 con 0x7f2a1c15a810 2024-04-20T10:59:52.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 -- 172.21.15.90:0/3271927663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 msgr2=0x7f2a1c0c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:52.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 --2- 172.21.15.90:0/3271927663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c0c8a90 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009e80 tx=0x7f2a1402bd90 comp rx=0 tx=0).stop 2024-04-20T10:59:52.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 -- 172.21.15.90:0/3271927663 shutdown_connections 2024-04-20T10:59:52.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 --2- 172.21.15.90:0/3271927663 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c0c8a90 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.275 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 --2- 172.21.15.90:0/3271927663 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c06cc40 0x7f2a1c0c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 -- 172.21.15.90:0/3271927663 >> 172.21.15.90:0/3271927663 conn(0x7f2a1c0adbd0 msgr2=0x7f2a1c0adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 -- 172.21.15.90:0/3271927663 shutdown_connections 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.272+0000 7f2a22074640 1 -- 172.21.15.90:0/3271927663 wait complete. 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.273+0000 7f2a22074640 1 Processor -- start 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.273+0000 7f2a22074640 1 -- start start 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a1c06cc40 0x7f2a1c155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c153df0 0x7f2a1c0c39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c1541d0 con 0x7f2a1c15a810 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c15aca0 con 0x7f2a1c06cc40 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f2a1c0c73e0 con 0x7f2a1c153df0 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:52312/0 (socket says 172.21.15.90:52312) 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3625593542 learned_addr learned my addr 172.21.15.90:0/3625593542 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T10:59:52.276 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1b7fe640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a1c06cc40 0x7f2a1c155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1affd640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c153df0 0x7f2a1c0c39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c153df0 msgr2=0x7f2a1c0c39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c153df0 0x7f2a1c0c39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a1c06cc40 msgr2=0x7f2a1c155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a1c06cc40 0x7f2a1c155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 -- 172.21.15.90:0/3625593542 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c1548a0 con 0x7f2a1c15a810 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a1bfff640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c158ab0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2a14036040 tx=0x7f2a14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a13fff640 1 -- 172.21.15.90:0/3625593542 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14043020 con 0x7f2a1c15a810 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a13fff640 1 -- 172.21.15.90:0/3625593542 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1403e450 con 0x7f2a1c15a810 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1c154b80 con 0x7f2a1c15a810 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a13fff640 1 -- 172.21.15.90:0/3625593542 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1403e840 con 0x7f2a1c15a810 2024-04-20T10:59:52.277 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.274+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1c0c3f10 con 0x7f2a1c15a810 2024-04-20T10:59:52.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.276+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a1c076150 con 0x7f2a1c15a810 2024-04-20T10:59:52.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.276+0000 7f2a13fff640 1 -- 172.21.15.90:0/3625593542 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2a14046020 con 0x7f2a1c15a810 2024-04-20T10:59:52.278 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.276+0000 7f2a13fff640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f29fc06c920 0x7f29fc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T10:59:52.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.277+0000 7f2a1b7fe640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f29fc06c920 0x7f29fc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T10:59:52.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.277+0000 7f2a13fff640 1 -- 172.21.15.90:0/3625593542 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f2a140aea00 con 0x7f2a1c15a810 2024-04-20T10:59:52.279 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.277+0000 7f2a1b7fe640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f29fc06c920 0x7f29fc06ede0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2a04004f60 tx=0x7f2a04007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T10:59:52.281 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.281+0000 7f2a13fff640 1 -- 172.21.15.90:0/3625593542 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f2a1404d030 con 0x7f2a1c15a810 2024-04-20T10:59:52.458 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.457+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a1c154d50 con 0x7f29fc06c920 2024-04-20T10:59:52.468 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.468+0000 7f2a13fff640 1 -- 172.21.15.90:0/3625593542 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+489320 (secure 0 0 0) 0x7f2a1c154d50 con 0x7f29fc06c920 2024-04-20T10:59:52.473 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T10:59:52.477 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f29fc06c920 msgr2=0x7f29fc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f29fc06c920 0x7f29fc06ede0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2a04004f60 tx=0x7f2a04007e30 comp rx=0 tx=0).stop 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 msgr2=0x7f2a1c158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c158ab0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2a14036040 tx=0x7f2a14004a40 comp rx=0 tx=0).stop 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 shutdown_connections 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f29fc06c920 0x7f29fc06ede0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f2a1c15a810 0x7f2a1c158ab0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f2a1c153df0 0x7f2a1c0c39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 --2- 172.21.15.90:0/3625593542 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f2a1c06cc40 0x7f2a1c155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 >> 172.21.15.90:0/3625593542 conn(0x7f2a1c0adbd0 msgr2=0x7f2a1c152cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 shutdown_connections 2024-04-20T10:59:52.479 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T10:59:52.472+0000 7f2a22074640 1 -- 172.21.15.90:0/3625593542 wait complete. 2024-04-20T10:59:52.483 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2024-04-20T10:59:51.807374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":301440141,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":12158,"num_read_kb":7850279,"num_write":64820,"num_write_kb":8966796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71629,"ondisk_log_size":71629,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1099600,"kb_used_data":592208,"kb_used_omap":12,"kb_used_meta":507315,"kb_avail":753875120,"statfs":{"total":773094113280,"available":771968122880,"internally_reserved":0,"allocated":606420992,"data_stored":604476882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":519491120},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":993,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002937"},"pg_stats":[{"pgid":"5.18","version":"38'433","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401110+0000","last_change":"2024-04-20T10:50:49.639684+0000","last_active":"2024-04-20T10:59:30.401110+0000","last_peered":"2024-04-20T10:59:30.401110+0000","last_clean":"2024-04-20T10:59:30.401110+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T10:59:30.401110+0000","last_undegraded":"2024-04-20T10:59:30.401110+0000","last_fullsized":"2024-04-20T10:59:30.401110+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":22795,"num_write":399,"num_write_kb":54919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"38'85","reported_seq":152,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387326+0000","last_change":"2024-04-20T10:50:39.578129+0000","last_active":"2024-04-20T10:59:20.387326+0000","last_peered":"2024-04-20T10:59:20.387326+0000","last_clean":"2024-04-20T10:59:20.387326+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:59:20.387326+0000","last_undegraded":"2024-04-20T10:59:20.387326+0000","last_fullsized":"2024-04-20T10:59:20.387326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:32:11.915773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":13987,"num_write":27,"num_write_kb":4118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"38'408","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409658+0000","last_change":"2024-04-20T10:50:40.598547+0000","last_active":"2024-04-20T10:59:23.409658+0000","last_peered":"2024-04-20T10:59:23.409658+0000","last_clean":"2024-04-20T10:59:23.409658+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T10:59:23.409658+0000","last_undegraded":"2024-04-20T10:59:23.409658+0000","last_fullsized":"2024-04-20T10:59:23.409658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":85574,"num_write":384,"num_write_kb":89655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"38'168","reported_seq":214,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412574+0000","last_change":"2024-04-20T10:50:48.633589+0000","last_active":"2024-04-20T10:59:30.412574+0000","last_peered":"2024-04-20T10:59:30.412574+0000","last_clean":"2024-04-20T10:59:30.412574+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:59:30.412574+0000","last_undegraded":"2024-04-20T10:59:30.412574+0000","last_fullsized":"2024-04-20T10:59:30.412574+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"38'459","reported_seq":575,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.407883+0000","last_change":"2024-04-20T10:50:49.653789+0000","last_active":"2024-04-20T10:59:30.407883+0000","last_peered":"2024-04-20T10:59:30.407883+0000","last_clean":"2024-04-20T10:59:30.407883+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T10:59:30.407883+0000","last_undegraded":"2024-04-20T10:59:30.407883+0000","last_fullsized":"2024-04-20T10:59:30.407883+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":79973,"num_write":429,"num_write_kb":121385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"36'193","reported_seq":249,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.396130+0000","last_change":"2024-04-20T10:50:39.579550+0000","last_active":"2024-04-20T10:59:20.396130+0000","last_peered":"2024-04-20T10:59:20.396130+0000","last_clean":"2024-04-20T10:59:20.396130+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T10:59:20.396130+0000","last_undegraded":"2024-04-20T10:59:20.396130+0000","last_fullsized":"2024-04-20T10:59:20.396130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":193,"log_dups_size":0,"ondisk_log_size":193,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":130,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"37'359","reported_seq":476,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386804+0000","last_change":"2024-04-20T10:50:40.605141+0000","last_active":"2024-04-20T10:59:20.386804+0000","last_peered":"2024-04-20T10:59:20.386804+0000","last_clean":"2024-04-20T10:59:20.386804+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:59:20.386804+0000","last_undegraded":"2024-04-20T10:59:20.386804+0000","last_fullsized":"2024-04-20T10:59:20.386804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:43.432979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":24250,"num_write":339,"num_write_kb":58188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"38'922","reported_seq":974,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412799+0000","last_change":"2024-04-20T10:50:48.637677+0000","last_active":"2024-04-20T10:59:30.412799+0000","last_peered":"2024-04-20T10:59:30.412799+0000","last_clean":"2024-04-20T10:59:30.412799+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:59:30.412799+0000","last_undegraded":"2024-04-20T10:59:30.412799+0000","last_fullsized":"2024-04-20T10:59:30.412799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":922,"log_dups_size":0,"ondisk_log_size":922,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":852,"num_write_kb":8691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"38'405","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.639984+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:59:28.639984+0000","last_peered":"2024-04-20T10:59:28.639984+0000","last_clean":"2024-04-20T10:59:28.639984+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:59:28.639984+0000","last_undegraded":"2024-04-20T10:59:28.639984+0000","last_fullsized":"2024-04-20T10:59:28.639984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:09:25.388705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":43507,"num_write":372,"num_write_kb":54374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"37'371","reported_seq":440,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392875+0000","last_change":"2024-04-20T10:50:39.578654+0000","last_active":"2024-04-20T10:59:20.392875+0000","last_peered":"2024-04-20T10:59:20.392875+0000","last_clean":"2024-04-20T10:59:20.392875+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T10:59:20.392875+0000","last_undegraded":"2024-04-20T10:59:20.392875+0000","last_fullsized":"2024-04-20T10:59:20.392875+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:18.537483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":45077,"num_write":302,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'401","reported_seq":550,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393435+0000","last_change":"2024-04-20T10:50:40.598595+0000","last_active":"2024-04-20T10:59:20.393435+0000","last_peered":"2024-04-20T10:59:20.393435+0000","last_clean":"2024-04-20T10:59:20.393435+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T10:59:20.393435+0000","last_undegraded":"2024-04-20T10:59:20.393435+0000","last_fullsized":"2024-04-20T10:59:20.393435+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":103995,"num_write":369,"num_write_kb":100717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"36'159","reported_seq":209,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.596778+0000","last_change":"2024-04-20T10:50:48.641943+0000","last_active":"2024-04-20T10:59:20.596778+0000","last_peered":"2024-04-20T10:59:20.596778+0000","last_clean":"2024-04-20T10:59:20.596778+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:59:20.596778+0000","last_undegraded":"2024-04-20T10:59:20.596778+0000","last_fullsized":"2024-04-20T10:59:20.596778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":20490,"num_write":105,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"38'368","reported_seq":475,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401304+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:59:30.401304+0000","last_peered":"2024-04-20T10:59:30.401304+0000","last_clean":"2024-04-20T10:59:30.401304+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:59:30.401304+0000","last_undegraded":"2024-04-20T10:59:30.401304+0000","last_fullsized":"2024-04-20T10:59:30.401304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":53969,"num_write":336,"num_write_kb":42442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"38'67","reported_seq":129,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391409+0000","last_change":"2024-04-20T10:50:39.587182+0000","last_active":"2024-04-20T10:59:20.391409+0000","last_peered":"2024-04-20T10:59:20.391409+0000","last_clean":"2024-04-20T10:59:20.391409+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T10:59:20.391409+0000","last_undegraded":"2024-04-20T10:59:20.391409+0000","last_fullsized":"2024-04-20T10:59:20.391409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:58:29.716885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":8317,"num_write":19,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'375","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.400039+0000","last_change":"2024-04-20T10:50:40.597921+0000","last_active":"2024-04-20T10:59:23.400039+0000","last_peered":"2024-04-20T10:59:23.400039+0000","last_clean":"2024-04-20T10:59:23.400039+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T10:59:23.400039+0000","last_undegraded":"2024-04-20T10:59:23.400039+0000","last_fullsized":"2024-04-20T10:59:23.400039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":27688,"num_write":341,"num_write_kb":72358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"38'662","reported_seq":724,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.113400+0000","last_change":"2024-04-20T10:59:51.113432+0000","last_active":"2024-04-20T10:59:51.113400+0000","last_peered":"2024-04-20T10:59:51.113400+0000","last_clean":"2024-04-20T10:59:51.113400+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:59:51.113400+0000","last_undegraded":"2024-04-20T10:59:51.113400+0000","last_fullsized":"2024-04-20T10:59:51.113400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'662","last_scrub_stamp":"2024-04-20T10:59:51.113312+0000","last_deep_scrub":"38'662","last_deep_scrub_stamp":"2024-04-20T10:59:51.113312+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.113312+0000","objects_scrubbed":3,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:48:48.384673+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36433,"num_write":605,"num_write_kb":12615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"38'446","reported_seq":571,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.531536+0000","last_change":"2024-04-20T10:50:49.654800+0000","last_active":"2024-04-20T10:59:49.531536+0000","last_peered":"2024-04-20T10:59:49.531536+0000","last_clean":"2024-04-20T10:59:49.531536+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T10:59:49.531536+0000","last_undegraded":"2024-04-20T10:59:49.531536+0000","last_fullsized":"2024-04-20T10:59:49.531536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":68359,"num_write":412,"num_write_kb":83650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"38'451","reported_seq":602,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410121+0000","last_change":"2024-04-20T10:50:40.604006+0000","last_active":"2024-04-20T10:59:23.410121+0000","last_peered":"2024-04-20T10:59:23.410121+0000","last_clean":"2024-04-20T10:59:23.410121+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:59:23.410121+0000","last_undegraded":"2024-04-20T10:59:23.410121+0000","last_fullsized":"2024-04-20T10:59:23.410121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":83011,"num_write":424,"num_write_kb":112568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"37'185","reported_seq":251,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391349+0000","last_change":"2024-04-20T10:50:39.580195+0000","last_active":"2024-04-20T10:59:20.391349+0000","last_peered":"2024-04-20T10:59:20.391349+0000","last_clean":"2024-04-20T10:59:20.391349+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T10:59:20.391349+0000","last_undegraded":"2024-04-20T10:59:20.391349+0000","last_fullsized":"2024-04-20T10:59:20.391349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:37:11.925844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32778,"num_write":122,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"36'533","reported_seq":590,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.844433+0000","last_change":"2024-04-20T10:50:48.636966+0000","last_active":"2024-04-20T10:59:50.844433+0000","last_peered":"2024-04-20T10:59:50.844433+0000","last_clean":"2024-04-20T10:59:50.844433+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T10:59:50.844433+0000","last_undegraded":"2024-04-20T10:59:50.844433+0000","last_fullsized":"2024-04-20T10:59:50.844433+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":533,"log_dups_size":0,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16463,"num_write":485,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'400","reported_seq":496,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.968179+0000","last_change":"2024-04-20T10:50:49.643475+0000","last_active":"2024-04-20T10:59:49.968179+0000","last_peered":"2024-04-20T10:59:49.968179+0000","last_clean":"2024-04-20T10:59:49.968179+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T10:59:49.968179+0000","last_undegraded":"2024-04-20T10:59:49.968179+0000","last_fullsized":"2024-04-20T10:59:49.968179+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":15248,"num_write":372,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"36'439","reported_seq":581,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390816+0000","last_change":"2024-04-20T10:51:20.874303+0000","last_active":"2024-04-20T10:59:20.390816+0000","last_peered":"2024-04-20T10:59:20.390816+0000","last_clean":"2024-04-20T10:59:20.390816+0000","last_became_active":"2024-04-20T10:51:20.873593+0000","last_became_peered":"2024-04-20T10:51:20.873593+0000","last_unstale":"2024-04-20T10:59:20.390816+0000","last_undegraded":"2024-04-20T10:59:20.390816+0000","last_fullsized":"2024-04-20T10:59:20.390816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":68460,"num_write":408,"num_write_kb":88214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"36'471","reported_seq":526,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.731405+0000","last_change":"2024-04-20T10:50:39.581058+0000","last_active":"2024-04-20T10:59:21.731405+0000","last_peered":"2024-04-20T10:59:21.731405+0000","last_clean":"2024-04-20T10:59:21.731405+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T10:59:21.731405+0000","last_undegraded":"2024-04-20T10:59:21.731405+0000","last_fullsized":"2024-04-20T10:59:21.731405+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":415,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'54","reported_seq":99,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.844408+0000","last_change":"2024-04-20T10:50:48.641257+0000","last_active":"2024-04-20T10:59:50.844408+0000","last_peered":"2024-04-20T10:59:50.844408+0000","last_clean":"2024-04-20T10:59:50.844408+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:59:50.844408+0000","last_undegraded":"2024-04-20T10:59:50.844408+0000","last_fullsized":"2024-04-20T10:59:50.844408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"38'386","reported_seq":495,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.844534+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:59:50.844534+0000","last_peered":"2024-04-20T10:59:50.844534+0000","last_clean":"2024-04-20T10:59:50.844534+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:59:50.844534+0000","last_undegraded":"2024-04-20T10:59:50.844534+0000","last_fullsized":"2024-04-20T10:59:50.844534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":51447,"num_write":355,"num_write_kb":79846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'408","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.747399+0000","last_change":"2024-04-20T10:50:40.594159+0000","last_active":"2024-04-20T10:59:21.747399+0000","last_peered":"2024-04-20T10:59:21.747399+0000","last_clean":"2024-04-20T10:59:21.747399+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T10:59:21.747399+0000","last_undegraded":"2024-04-20T10:59:21.747399+0000","last_fullsized":"2024-04-20T10:59:21.747399+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":28672,"num_write":368,"num_write_kb":66779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"36'260","reported_seq":314,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.731379+0000","last_change":"2024-04-20T10:50:39.577845+0000","last_active":"2024-04-20T10:59:21.731379+0000","last_peered":"2024-04-20T10:59:21.731379+0000","last_clean":"2024-04-20T10:59:21.731379+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:59:21.731379+0000","last_undegraded":"2024-04-20T10:59:21.731379+0000","last_fullsized":"2024-04-20T10:59:21.731379+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":260,"log_dups_size":0,"ondisk_log_size":260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":207,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"38'294","reported_seq":356,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.579856+0000","last_change":"2024-04-20T10:59:51.579856+0000","last_active":"2024-04-20T10:59:51.579856+0000","last_peered":"2024-04-20T10:59:51.579856+0000","last_clean":"2024-04-20T10:59:51.579856+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:59:51.579856+0000","last_undegraded":"2024-04-20T10:59:51.579856+0000","last_fullsized":"2024-04-20T10:59:51.579856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'294","last_scrub_stamp":"2024-04-20T10:59:51.579708+0000","last_deep_scrub":"38'294","last_deep_scrub_stamp":"2024-04-20T10:59:51.579708+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.579708+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:58.562988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":243,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"38'417","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.277864+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:59:51.277864+0000","last_peered":"2024-04-20T10:59:51.277864+0000","last_clean":"2024-04-20T10:59:51.277864+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:59:51.277864+0000","last_undegraded":"2024-04-20T10:59:51.277864+0000","last_fullsized":"2024-04-20T10:59:51.277864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":59672,"num_write":383,"num_write_kb":87983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"38'464","reported_seq":619,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404798+0000","last_change":"2024-04-20T10:50:40.593061+0000","last_active":"2024-04-20T10:59:23.404798+0000","last_peered":"2024-04-20T10:59:23.404798+0000","last_clean":"2024-04-20T10:59:23.404798+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T10:59:23.404798+0000","last_undegraded":"2024-04-20T10:59:23.404798+0000","last_fullsized":"2024-04-20T10:59:23.404798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":46635,"num_write":434,"num_write_kb":47131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"36'429","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391034+0000","last_change":"2024-04-20T10:50:39.581761+0000","last_active":"2024-04-20T10:59:20.391034+0000","last_peered":"2024-04-20T10:59:20.391034+0000","last_clean":"2024-04-20T10:59:20.391034+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T10:59:20.391034+0000","last_undegraded":"2024-04-20T10:59:20.391034+0000","last_fullsized":"2024-04-20T10:59:20.391034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:36:13.057643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":373,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"36'505","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.844435+0000","last_change":"2024-04-20T10:50:48.639092+0000","last_active":"2024-04-20T10:59:50.844435+0000","last_peered":"2024-04-20T10:59:50.844435+0000","last_clean":"2024-04-20T10:59:50.844435+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:59:50.844435+0000","last_undegraded":"2024-04-20T10:59:50.844435+0000","last_fullsized":"2024-04-20T10:59:50.844435+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":12324,"num_write":451,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"38'428","reported_seq":553,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.642427+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:59:28.642427+0000","last_peered":"2024-04-20T10:59:28.642427+0000","last_clean":"2024-04-20T10:59:28.642427+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:59:28.642427+0000","last_undegraded":"2024-04-20T10:59:28.642427+0000","last_fullsized":"2024-04-20T10:59:28.642427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70222,"num_write":390,"num_write_kb":75460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"38'430","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408714+0000","last_change":"2024-04-20T10:50:40.594043+0000","last_active":"2024-04-20T10:59:23.408714+0000","last_peered":"2024-04-20T10:59:23.408714+0000","last_clean":"2024-04-20T10:59:23.408714+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:59:23.408714+0000","last_undegraded":"2024-04-20T10:59:23.408714+0000","last_fullsized":"2024-04-20T10:59:23.408714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:15.004354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":26226,"num_write":396,"num_write_kb":42836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"38'178","reported_seq":240,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:43.096652+0000","last_change":"2024-04-20T10:50:39.578052+0000","last_active":"2024-04-20T10:59:43.096652+0000","last_peered":"2024-04-20T10:59:43.096652+0000","last_clean":"2024-04-20T10:59:43.096652+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:59:43.096652+0000","last_undegraded":"2024-04-20T10:59:43.096652+0000","last_fullsized":"2024-04-20T10:59:43.096652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":178,"log_dups_size":0,"ondisk_log_size":178,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2765636,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":2215,"num_write":122,"num_write_kb":2774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"38'354","reported_seq":682,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.399802+0000","last_change":"2024-04-20T10:50:48.634717+0000","last_active":"2024-04-20T10:59:36.399802+0000","last_peered":"2024-04-20T10:59:36.399802+0000","last_clean":"2024-04-20T10:59:36.399802+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T10:59:36.399802+0000","last_undegraded":"2024-04-20T10:59:36.399802+0000","last_fullsized":"2024-04-20T10:59:36.399802+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465101,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":1621,"num_write":296,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'403","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405129+0000","last_change":"2024-04-20T10:50:49.642653+0000","last_active":"2024-04-20T10:59:30.405129+0000","last_peered":"2024-04-20T10:59:30.405129+0000","last_clean":"2024-04-20T10:59:30.405129+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T10:59:30.405129+0000","last_undegraded":"2024-04-20T10:59:30.405129+0000","last_fullsized":"2024-04-20T10:59:30.405129+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":84919,"num_write":363,"num_write_kb":88226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"38'351","reported_seq":486,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403564+0000","last_change":"2024-04-20T10:50:40.593576+0000","last_active":"2024-04-20T10:59:23.403564+0000","last_peered":"2024-04-20T10:59:23.403564+0000","last_clean":"2024-04-20T10:59:23.403564+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T10:59:23.403564+0000","last_undegraded":"2024-04-20T10:59:23.403564+0000","last_fullsized":"2024-04-20T10:59:23.403564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":41830,"num_write":332,"num_write_kb":50578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"38'368","reported_seq":431,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:43.383800+0000","last_change":"2024-04-20T10:50:39.586143+0000","last_active":"2024-04-20T10:59:43.383800+0000","last_peered":"2024-04-20T10:59:43.383800+0000","last_clean":"2024-04-20T10:59:43.383800+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T10:59:43.383800+0000","last_undegraded":"2024-04-20T10:59:43.383800+0000","last_fullsized":"2024-04-20T10:59:43.383800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":432,"num_write":707,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"38'199","reported_seq":257,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.630850+0000","last_change":"2024-04-20T10:50:48.645122+0000","last_active":"2024-04-20T10:59:28.630850+0000","last_peered":"2024-04-20T10:59:28.630850+0000","last_clean":"2024-04-20T10:59:28.630850+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:59:28.630850+0000","last_undegraded":"2024-04-20T10:59:28.630850+0000","last_fullsized":"2024-04-20T10:59:28.630850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":41717,"num_write":141,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"38'382","reported_seq":490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.400998+0000","last_change":"2024-04-20T10:50:49.644115+0000","last_active":"2024-04-20T10:59:30.400998+0000","last_peered":"2024-04-20T10:59:30.400998+0000","last_clean":"2024-04-20T10:59:30.400998+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T10:59:30.400998+0000","last_undegraded":"2024-04-20T10:59:30.400998+0000","last_fullsized":"2024-04-20T10:59:30.400998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36954,"num_write":352,"num_write_kb":63166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"38'440","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404060+0000","last_change":"2024-04-20T10:50:40.592670+0000","last_active":"2024-04-20T10:59:23.404060+0000","last_peered":"2024-04-20T10:59:23.404060+0000","last_clean":"2024-04-20T10:59:23.404060+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:59:23.404060+0000","last_undegraded":"2024-04-20T10:59:23.404060+0000","last_fullsized":"2024-04-20T10:59:23.404060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":92391,"num_write":411,"num_write_kb":121276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"37'116","reported_seq":169,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393763+0000","last_change":"2024-04-20T10:50:39.579885+0000","last_active":"2024-04-20T10:59:20.393763+0000","last_peered":"2024-04-20T10:59:20.393763+0000","last_clean":"2024-04-20T10:59:20.393763+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T10:59:20.393763+0000","last_undegraded":"2024-04-20T10:59:20.393763+0000","last_fullsized":"2024-04-20T10:59:20.393763+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":116,"log_dups_size":0,"ondisk_log_size":116,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:25.988621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":47,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"38'72","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621376+0000","last_change":"2024-04-20T10:50:48.640826+0000","last_active":"2024-04-20T10:59:28.621376+0000","last_peered":"2024-04-20T10:59:28.621376+0000","last_clean":"2024-04-20T10:59:28.621376+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T10:59:28.621376+0000","last_undegraded":"2024-04-20T10:59:28.621376+0000","last_fullsized":"2024-04-20T10:59:28.621376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:41.027377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"38'388","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.638445+0000","last_change":"2024-04-20T10:50:49.644637+0000","last_active":"2024-04-20T10:59:28.638445+0000","last_peered":"2024-04-20T10:59:28.638445+0000","last_clean":"2024-04-20T10:59:28.638445+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T10:59:28.638445+0000","last_undegraded":"2024-04-20T10:59:28.638445+0000","last_fullsized":"2024-04-20T10:59:28.638445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:27:36.671824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":31459,"num_write":347,"num_write_kb":38414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"38'421","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407060+0000","last_change":"2024-04-20T10:50:40.612823+0000","last_active":"2024-04-20T10:59:23.407060+0000","last_peered":"2024-04-20T10:59:23.407060+0000","last_clean":"2024-04-20T10:59:23.407060+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:59:23.407060+0000","last_undegraded":"2024-04-20T10:59:23.407060+0000","last_fullsized":"2024-04-20T10:59:23.407060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":53960,"num_write":380,"num_write_kb":46448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"37'59","reported_seq":112,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391886+0000","last_change":"2024-04-20T10:50:39.581411+0000","last_active":"2024-04-20T10:59:20.391886+0000","last_peered":"2024-04-20T10:59:20.391886+0000","last_clean":"2024-04-20T10:59:20.391886+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T10:59:20.391886+0000","last_undegraded":"2024-04-20T10:59:20.391886+0000","last_fullsized":"2024-04-20T10:59:20.391886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"36'621","reported_seq":678,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.450711+0000","last_change":"2024-04-20T10:50:48.644512+0000","last_active":"2024-04-20T10:59:21.450711+0000","last_peered":"2024-04-20T10:59:21.450711+0000","last_clean":"2024-04-20T10:59:21.450711+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:59:21.450711+0000","last_undegraded":"2024-04-20T10:59:21.450711+0000","last_fullsized":"2024-04-20T10:59:21.450711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":621,"log_dups_size":0,"ondisk_log_size":621,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":37014,"num_write":557,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"38'440","reported_seq":575,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405359+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:59:30.405359+0000","last_peered":"2024-04-20T10:59:30.405359+0000","last_clean":"2024-04-20T10:59:30.405359+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:59:30.405359+0000","last_undegraded":"2024-04-20T10:59:30.405359+0000","last_fullsized":"2024-04-20T10:59:30.405359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:01.758311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":72557,"num_write":399,"num_write_kb":79896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"37'409","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388403+0000","last_change":"2024-04-20T10:50:40.592316+0000","last_active":"2024-04-20T10:59:20.388403+0000","last_peered":"2024-04-20T10:59:20.388403+0000","last_clean":"2024-04-20T10:59:20.388403+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T10:59:20.388403+0000","last_undegraded":"2024-04-20T10:59:20.388403+0000","last_fullsized":"2024-04-20T10:59:20.388403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69573,"num_write":375,"num_write_kb":88218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'601","reported_seq":660,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.394074+0000","last_change":"2024-04-20T10:50:39.584613+0000","last_active":"2024-04-20T10:59:20.394074+0000","last_peered":"2024-04-20T10:59:20.394074+0000","last_clean":"2024-04-20T10:59:20.394074+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T10:59:20.394074+0000","last_undegraded":"2024-04-20T10:59:20.394074+0000","last_fullsized":"2024-04-20T10:59:20.394074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":601,"log_dups_size":0,"ondisk_log_size":601,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":551,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"38'74","reported_seq":128,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.614200+0000","last_change":"2024-04-20T10:59:49.614221+0000","last_active":"2024-04-20T10:59:49.614200+0000","last_peered":"2024-04-20T10:59:49.614200+0000","last_clean":"2024-04-20T10:59:49.614200+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:59:49.614200+0000","last_undegraded":"2024-04-20T10:59:49.614200+0000","last_fullsized":"2024-04-20T10:59:49.614200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-04-20T10:59:49.614120+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-04-20T10:59:49.614120+0000","last_clean_scrub_stamp":"2024-04-20T10:59:49.614120+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:03.239494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"38'423","reported_seq":554,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.739265+0000","last_change":"2024-04-20T10:50:49.650809+0000","last_active":"2024-04-20T10:59:31.739265+0000","last_peered":"2024-04-20T10:59:31.739265+0000","last_clean":"2024-04-20T10:59:31.739265+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T10:59:31.739265+0000","last_undegraded":"2024-04-20T10:59:31.739265+0000","last_fullsized":"2024-04-20T10:59:31.739265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56610,"num_write":400,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'384","reported_seq":503,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390203+0000","last_change":"2024-04-20T10:50:40.590050+0000","last_active":"2024-04-20T10:59:20.390203+0000","last_peered":"2024-04-20T10:59:20.390203+0000","last_clean":"2024-04-20T10:59:20.390203+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T10:59:20.390203+0000","last_undegraded":"2024-04-20T10:59:20.390203+0000","last_fullsized":"2024-04-20T10:59:20.390203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":325,"num_write":350,"num_write_kb":17356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"38'354","reported_seq":708,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.506502+0000","last_change":"2024-04-20T10:59:51.506525+0000","last_active":"2024-04-20T10:59:51.506502+0000","last_peered":"2024-04-20T10:59:51.506502+0000","last_clean":"2024-04-20T10:59:51.506502+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:59:51.506502+0000","last_undegraded":"2024-04-20T10:59:51.506502+0000","last_fullsized":"2024-04-20T10:59:51.506502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'354","last_scrub_stamp":"2024-04-20T10:59:51.506417+0000","last_deep_scrub":"38'354","last_deep_scrub_stamp":"2024-04-20T10:59:51.506417+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.506417+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:26:01.369153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":293,"num_read_kb":1639,"num_write":299,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"38'136","reported_seq":192,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:45.891958+0000","last_change":"2024-04-20T10:50:48.645641+0000","last_active":"2024-04-20T10:59:45.891958+0000","last_peered":"2024-04-20T10:59:45.891958+0000","last_clean":"2024-04-20T10:59:45.891958+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:59:45.891958+0000","last_undegraded":"2024-04-20T10:59:45.891958+0000","last_fullsized":"2024-04-20T10:59:45.891958+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532638,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":994,"num_write":83,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'363","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.798010+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:59:31.798010+0000","last_peered":"2024-04-20T10:59:31.798010+0000","last_clean":"2024-04-20T10:59:31.798010+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:59:31.798010+0000","last_undegraded":"2024-04-20T10:59:31.798010+0000","last_fullsized":"2024-04-20T10:59:31.798010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56669,"num_write":337,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"38'414","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386329+0000","last_change":"2024-04-20T10:50:40.600415+0000","last_active":"2024-04-20T10:59:20.386329+0000","last_peered":"2024-04-20T10:59:20.386329+0000","last_clean":"2024-04-20T10:59:20.386329+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:59:20.386329+0000","last_undegraded":"2024-04-20T10:59:20.386329+0000","last_fullsized":"2024-04-20T10:59:20.386329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:51:48.541893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":100333,"num_write":376,"num_write_kb":104385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"37'123","reported_seq":184,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390747+0000","last_change":"2024-04-20T10:50:39.581351+0000","last_active":"2024-04-20T10:59:20.390747+0000","last_peered":"2024-04-20T10:59:20.390747+0000","last_clean":"2024-04-20T10:59:20.390747+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T10:59:20.390747+0000","last_undegraded":"2024-04-20T10:59:20.390747+0000","last_fullsized":"2024-04-20T10:59:20.390747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:16:12.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":57,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"38'367","reported_seq":422,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.383602+0000","last_change":"2024-04-20T10:50:48.641271+0000","last_active":"2024-04-20T10:59:36.383602+0000","last_peered":"2024-04-20T10:59:36.383602+0000","last_clean":"2024-04-20T10:59:36.383602+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T10:59:36.383602+0000","last_undegraded":"2024-04-20T10:59:36.383602+0000","last_fullsized":"2024-04-20T10:59:36.383602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:20:48.010250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":373,"num_write":706,"num_write_kb":1825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"38'374","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645982+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:59:28.645982+0000","last_peered":"2024-04-20T10:59:28.645982+0000","last_clean":"2024-04-20T10:59:28.645982+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:59:28.645982+0000","last_undegraded":"2024-04-20T10:59:28.645982+0000","last_fullsized":"2024-04-20T10:59:28.645982+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:23:27.866710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23979,"num_write":342,"num_write_kb":50629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"38'375","reported_seq":497,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.397798+0000","last_change":"2024-04-20T10:50:40.605254+0000","last_active":"2024-04-20T10:59:23.397798+0000","last_peered":"2024-04-20T10:59:23.397798+0000","last_clean":"2024-04-20T10:59:23.397798+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:59:23.397798+0000","last_undegraded":"2024-04-20T10:59:23.397798+0000","last_fullsized":"2024-04-20T10:59:23.397798+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32768,"num_write":345,"num_write_kb":58807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"38'72","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403583+0000","last_change":"2024-04-20T10:50:39.586510+0000","last_active":"2024-04-20T10:59:23.403583+0000","last_peered":"2024-04-20T10:59:23.403583+0000","last_clean":"2024-04-20T10:59:23.403583+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T10:59:23.403583+0000","last_undegraded":"2024-04-20T10:59:23.403583+0000","last_fullsized":"2024-04-20T10:59:23.403583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":208,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391430+0000","last_change":"2024-04-20T10:50:29.615883+0000","last_active":"2024-04-20T10:59:20.391430+0000","last_peered":"2024-04-20T10:59:20.391430+0000","last_clean":"2024-04-20T10:59:20.391430+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T10:59:20.391430+0000","last_undegraded":"2024-04-20T10:59:20.391430+0000","last_fullsized":"2024-04-20T10:59:20.391430+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:28.509710+0000","last_clean_scrub_stamp":"2024-04-20T10:50:28.509710+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:31.779481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"38'102","reported_seq":149,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.630537+0000","last_change":"2024-04-20T10:50:48.641823+0000","last_active":"2024-04-20T10:59:28.630537+0000","last_peered":"2024-04-20T10:59:28.630537+0000","last_clean":"2024-04-20T10:59:28.630537+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T10:59:28.630537+0000","last_undegraded":"2024-04-20T10:59:28.630537+0000","last_fullsized":"2024-04-20T10:59:28.630537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"38'445","reported_seq":580,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.968163+0000","last_change":"2024-04-20T10:50:49.644457+0000","last_active":"2024-04-20T10:59:49.968163+0000","last_peered":"2024-04-20T10:59:49.968163+0000","last_clean":"2024-04-20T10:59:49.968163+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T10:59:49.968163+0000","last_undegraded":"2024-04-20T10:59:49.968163+0000","last_fullsized":"2024-04-20T10:59:49.968163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":88903,"num_write":409,"num_write_kb":92640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'412","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392902+0000","last_change":"2024-04-20T10:50:40.607201+0000","last_active":"2024-04-20T10:59:20.392902+0000","last_peered":"2024-04-20T10:59:20.392902+0000","last_clean":"2024-04-20T10:59:20.392902+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:59:20.392902+0000","last_undegraded":"2024-04-20T10:59:20.392902+0000","last_fullsized":"2024-04-20T10:59:20.392902+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:14:22.657636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53899,"num_write":383,"num_write_kb":39701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"37'57","reported_seq":110,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.740164+0000","last_change":"2024-04-20T10:50:39.587986+0000","last_active":"2024-04-20T10:59:41.740164+0000","last_peered":"2024-04-20T10:59:41.740164+0000","last_clean":"2024-04-20T10:59:41.740164+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:59:41.740164+0000","last_undegraded":"2024-04-20T10:59:41.740164+0000","last_fullsized":"2024-04-20T10:59:41.740164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"36'249","reported_seq":298,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.736160+0000","last_change":"2024-04-20T10:50:48.643092+0000","last_active":"2024-04-20T10:59:31.736160+0000","last_peered":"2024-04-20T10:59:31.736160+0000","last_clean":"2024-04-20T10:59:31.736160+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T10:59:31.736160+0000","last_undegraded":"2024-04-20T10:59:31.736160+0000","last_fullsized":"2024-04-20T10:59:31.736160+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":11663,"num_write":185,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"38'444","reported_seq":574,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.739246+0000","last_change":"2024-04-20T10:50:49.634835+0000","last_active":"2024-04-20T10:59:31.739246+0000","last_peered":"2024-04-20T10:59:31.739246+0000","last_clean":"2024-04-20T10:59:31.739246+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:59:31.739246+0000","last_undegraded":"2024-04-20T10:59:31.739246+0000","last_fullsized":"2024-04-20T10:59:31.739246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":74093,"num_write":415,"num_write_kb":112646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"38'451","reported_seq":584,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.799308+0000","last_change":"2024-04-20T10:50:40.612664+0000","last_active":"2024-04-20T10:59:41.799308+0000","last_peered":"2024-04-20T10:59:41.799308+0000","last_clean":"2024-04-20T10:59:41.799308+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:59:41.799308+0000","last_undegraded":"2024-04-20T10:59:41.799308+0000","last_fullsized":"2024-04-20T10:59:41.799308+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":13128,"num_write":408,"num_write_kb":42612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"36'466","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.733633+0000","last_change":"2024-04-20T10:50:39.581370+0000","last_active":"2024-04-20T10:59:41.733633+0000","last_peered":"2024-04-20T10:59:41.733633+0000","last_clean":"2024-04-20T10:59:41.733633+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T10:59:41.733633+0000","last_undegraded":"2024-04-20T10:59:41.733633+0000","last_fullsized":"2024-04-20T10:59:41.733633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":466,"log_dups_size":0,"ondisk_log_size":466,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12293,"num_write":417,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"38'254","reported_seq":311,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:22.379543+0000","last_change":"2024-04-20T10:50:48.640192+0000","last_active":"2024-04-20T10:59:22.379543+0000","last_peered":"2024-04-20T10:59:22.379543+0000","last_clean":"2024-04-20T10:59:22.379543+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:59:22.379543+0000","last_undegraded":"2024-04-20T10:59:22.379543+0000","last_fullsized":"2024-04-20T10:59:22.379543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:15:42.926680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":192,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"38'448","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405455+0000","last_change":"2024-04-20T10:50:49.641684+0000","last_active":"2024-04-20T10:59:30.405455+0000","last_peered":"2024-04-20T10:59:30.405455+0000","last_clean":"2024-04-20T10:59:30.405455+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T10:59:30.405455+0000","last_undegraded":"2024-04-20T10:59:30.405455+0000","last_fullsized":"2024-04-20T10:59:30.405455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:20:43.828285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28672,"num_write":415,"num_write_kb":38311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"38'377","reported_seq":509,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403988+0000","last_change":"2024-04-20T10:50:40.609072+0000","last_active":"2024-04-20T10:59:23.403988+0000","last_peered":"2024-04-20T10:59:23.403988+0000","last_clean":"2024-04-20T10:59:23.403988+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:59:23.403988+0000","last_undegraded":"2024-04-20T10:59:23.403988+0000","last_fullsized":"2024-04-20T10:59:23.403988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:14.268077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":24736,"num_write":347,"num_write_kb":38102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"36'415","reported_seq":478,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.740197+0000","last_change":"2024-04-20T10:50:39.574267+0000","last_active":"2024-04-20T10:59:41.740197+0000","last_peered":"2024-04-20T10:59:41.740197+0000","last_clean":"2024-04-20T10:59:41.740197+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:59:41.740197+0000","last_undegraded":"2024-04-20T10:59:41.740197+0000","last_fullsized":"2024-04-20T10:59:41.740197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":12309,"num_write":370,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"38'499","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.797944+0000","last_change":"2024-04-20T10:50:48.646066+0000","last_active":"2024-04-20T10:59:31.797944+0000","last_peered":"2024-04-20T10:59:31.797944+0000","last_clean":"2024-04-20T10:59:31.797944+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:59:31.797944+0000","last_undegraded":"2024-04-20T10:59:31.797944+0000","last_fullsized":"2024-04-20T10:59:31.797944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":499,"log_dups_size":0,"ondisk_log_size":499,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":443,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"38'402","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.739225+0000","last_change":"2024-04-20T10:50:49.644090+0000","last_active":"2024-04-20T10:59:31.739225+0000","last_peered":"2024-04-20T10:59:31.739225+0000","last_clean":"2024-04-20T10:59:31.739225+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T10:59:31.739225+0000","last_undegraded":"2024-04-20T10:59:31.739225+0000","last_fullsized":"2024-04-20T10:59:31.739225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56962,"num_write":365,"num_write_kb":46837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"38'375","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410908+0000","last_change":"2024-04-20T10:50:40.609236+0000","last_active":"2024-04-20T10:59:23.410908+0000","last_peered":"2024-04-20T10:59:23.410908+0000","last_clean":"2024-04-20T10:59:23.410908+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:59:23.410908+0000","last_undegraded":"2024-04-20T10:59:23.410908+0000","last_fullsized":"2024-04-20T10:59:23.410908+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:42:07.812700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":12893,"num_write":338,"num_write_kb":54469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"38'678","reported_seq":738,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.775001+0000","last_change":"2024-04-20T10:50:39.576183+0000","last_active":"2024-04-20T10:59:41.775001+0000","last_peered":"2024-04-20T10:59:41.775001+0000","last_clean":"2024-04-20T10:59:41.775001+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:59:41.775001+0000","last_undegraded":"2024-04-20T10:59:41.775001+0000","last_fullsized":"2024-04-20T10:59:41.775001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":626,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"36'248","reported_seq":295,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.773565+0000","last_change":"2024-04-20T10:50:48.638503+0000","last_active":"2024-04-20T10:59:31.773565+0000","last_peered":"2024-04-20T10:59:31.773565+0000","last_clean":"2024-04-20T10:59:31.773565+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:59:31.773565+0000","last_undegraded":"2024-04-20T10:59:31.773565+0000","last_fullsized":"2024-04-20T10:59:31.773565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":197,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"38'396","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621421+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:59:28.621421+0000","last_peered":"2024-04-20T10:59:28.621421+0000","last_clean":"2024-04-20T10:59:28.621421+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:59:28.621421+0000","last_undegraded":"2024-04-20T10:59:28.621421+0000","last_fullsized":"2024-04-20T10:59:28.621421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27222,"num_write":365,"num_write_kb":63558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"38'485","reported_seq":639,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404048+0000","last_change":"2024-04-20T10:50:40.606908+0000","last_active":"2024-04-20T10:59:23.404048+0000","last_peered":"2024-04-20T10:59:23.404048+0000","last_clean":"2024-04-20T10:59:23.404048+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:59:23.404048+0000","last_undegraded":"2024-04-20T10:59:23.404048+0000","last_fullsized":"2024-04-20T10:59:23.404048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:37:50.975962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":79269,"num_write":451,"num_write_kb":100665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"38'417","reported_seq":499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:34.400862+0000","last_change":"2024-04-20T10:50:39.577415+0000","last_active":"2024-04-20T10:59:34.400862+0000","last_peered":"2024-04-20T10:59:34.400862+0000","last_clean":"2024-04-20T10:59:34.400862+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:59:34.400862+0000","last_undegraded":"2024-04-20T10:59:34.400862+0000","last_fullsized":"2024-04-20T10:59:34.400862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":8276,"num_write":372,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"38'124","reported_seq":172,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.613412+0000","last_change":"2024-04-20T10:50:48.640245+0000","last_active":"2024-04-20T10:59:28.613412+0000","last_peered":"2024-04-20T10:59:28.613412+0000","last_clean":"2024-04-20T10:59:28.613412+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T10:59:28.613412+0000","last_undegraded":"2024-04-20T10:59:28.613412+0000","last_fullsized":"2024-04-20T10:59:28.613412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:52.620414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12306,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"38'439","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412181+0000","last_change":"2024-04-20T10:50:49.648875+0000","last_active":"2024-04-20T10:59:30.412181+0000","last_peered":"2024-04-20T10:59:30.412181+0000","last_clean":"2024-04-20T10:59:30.412181+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T10:59:30.412181+0000","last_undegraded":"2024-04-20T10:59:30.412181+0000","last_fullsized":"2024-04-20T10:59:30.412181+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":73928,"num_write":402,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"38'444","reported_seq":610,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407092+0000","last_change":"2024-04-20T10:50:40.593416+0000","last_active":"2024-04-20T10:59:23.407092+0000","last_peered":"2024-04-20T10:59:23.407092+0000","last_clean":"2024-04-20T10:59:23.407092+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T10:59:23.407092+0000","last_undegraded":"2024-04-20T10:59:23.407092+0000","last_fullsized":"2024-04-20T10:59:23.407092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":47645,"num_write":412,"num_write_kb":63928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'71","reported_seq":123,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382111+0000","last_change":"2024-04-20T10:50:39.581751+0000","last_active":"2024-04-20T10:59:20.382111+0000","last_peered":"2024-04-20T10:59:20.382111+0000","last_clean":"2024-04-20T10:59:20.382111+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:59:20.382111+0000","last_undegraded":"2024-04-20T10:59:20.382111+0000","last_fullsized":"2024-04-20T10:59:20.382111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"38'64","reported_seq":108,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612427+0000","last_change":"2024-04-20T10:50:48.644924+0000","last_active":"2024-04-20T10:59:28.612427+0000","last_peered":"2024-04-20T10:59:28.612427+0000","last_clean":"2024-04-20T10:59:28.612427+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:59:28.612427+0000","last_undegraded":"2024-04-20T10:59:28.612427+0000","last_fullsized":"2024-04-20T10:59:28.612427+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"38'417","reported_seq":543,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.408726+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:59:30.408726+0000","last_peered":"2024-04-20T10:59:30.408726+0000","last_clean":"2024-04-20T10:59:30.408726+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:59:30.408726+0000","last_undegraded":"2024-04-20T10:59:30.408726+0000","last_fullsized":"2024-04-20T10:59:30.408726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":100636,"num_write":369,"num_write_kb":112428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"38'400","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.391000+0000","last_change":"2024-04-20T10:50:40.608892+0000","last_active":"2024-04-20T10:59:20.391000+0000","last_peered":"2024-04-20T10:59:20.391000+0000","last_clean":"2024-04-20T10:59:20.391000+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:59:20.391000+0000","last_undegraded":"2024-04-20T10:59:20.391000+0000","last_fullsized":"2024-04-20T10:59:20.391000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:05:57.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":45758,"num_write":374,"num_write_kb":77972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"38'70","reported_seq":122,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410633+0000","last_change":"2024-04-20T10:50:39.586432+0000","last_active":"2024-04-20T10:59:23.410633+0000","last_peered":"2024-04-20T10:59:23.410633+0000","last_clean":"2024-04-20T10:59:23.410633+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T10:59:23.410633+0000","last_undegraded":"2024-04-20T10:59:23.410633+0000","last_fullsized":"2024-04-20T10:59:23.410633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"38'516","reported_seq":591,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:45.891684+0000","last_change":"2024-04-20T10:50:48.642717+0000","last_active":"2024-04-20T10:59:45.891684+0000","last_peered":"2024-04-20T10:59:45.891684+0000","last_clean":"2024-04-20T10:59:45.891684+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:59:45.891684+0000","last_undegraded":"2024-04-20T10:59:45.891684+0000","last_fullsized":"2024-04-20T10:59:45.891684+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":32813,"num_write":466,"num_write_kb":12553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"38'400","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646378+0000","last_change":"2024-04-20T10:50:49.647256+0000","last_active":"2024-04-20T10:59:28.646378+0000","last_peered":"2024-04-20T10:59:28.646378+0000","last_clean":"2024-04-20T10:59:28.646378+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T10:59:28.646378+0000","last_undegraded":"2024-04-20T10:59:28.646378+0000","last_fullsized":"2024-04-20T10:59:28.646378+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":57869,"num_write":367,"num_write_kb":80191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"38'424","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407502+0000","last_change":"2024-04-20T10:50:40.595988+0000","last_active":"2024-04-20T10:59:23.407502+0000","last_peered":"2024-04-20T10:59:23.407502+0000","last_clean":"2024-04-20T10:59:23.407502+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:59:23.407502+0000","last_undegraded":"2024-04-20T10:59:23.407502+0000","last_fullsized":"2024-04-20T10:59:23.407502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:52:22.715301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62334,"num_write":402,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"36'166","reported_seq":233,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388592+0000","last_change":"2024-04-20T10:50:39.575995+0000","last_active":"2024-04-20T10:59:20.388592+0000","last_peered":"2024-04-20T10:59:20.388592+0000","last_clean":"2024-04-20T10:59:20.388592+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:59:20.388592+0000","last_undegraded":"2024-04-20T10:59:20.388592+0000","last_fullsized":"2024-04-20T10:59:20.388592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":166,"log_dups_size":0,"ondisk_log_size":166,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:25.165429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":24616,"num_write":112,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"38'322","reported_seq":382,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.403369+0000","last_change":"2024-04-20T10:50:48.643752+0000","last_active":"2024-04-20T10:59:36.403369+0000","last_peered":"2024-04-20T10:59:36.403369+0000","last_clean":"2024-04-20T10:59:36.403369+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:59:36.403369+0000","last_undegraded":"2024-04-20T10:59:36.403369+0000","last_fullsized":"2024-04-20T10:59:36.403369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":322,"log_dups_size":0,"ondisk_log_size":322,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":278,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"38'376","reported_seq":490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.403150+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:59:30.403150+0000","last_peered":"2024-04-20T10:59:30.403150+0000","last_clean":"2024-04-20T10:59:30.403150+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:59:30.403150+0000","last_undegraded":"2024-04-20T10:59:30.403150+0000","last_fullsized":"2024-04-20T10:59:30.403150+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":25860,"num_write":345,"num_write_kb":47542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"38'388","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402878+0000","last_change":"2024-04-20T10:50:40.594444+0000","last_active":"2024-04-20T10:59:23.402878+0000","last_peered":"2024-04-20T10:59:23.402878+0000","last_clean":"2024-04-20T10:59:23.402878+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T10:59:23.402878+0000","last_undegraded":"2024-04-20T10:59:23.402878+0000","last_fullsized":"2024-04-20T10:59:23.402878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:52.274423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":29836,"num_write":343,"num_write_kb":67451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"38'576","reported_seq":657,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:36.140937+0000","last_change":"2024-04-20T10:50:39.583809+0000","last_active":"2024-04-20T10:59:36.140937+0000","last_peered":"2024-04-20T10:59:36.140937+0000","last_clean":"2024-04-20T10:59:36.140937+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:59:36.140937+0000","last_undegraded":"2024-04-20T10:59:36.140937+0000","last_fullsized":"2024-04-20T10:59:36.140937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":576,"log_dups_size":0,"ondisk_log_size":576,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35988,"num_write":517,"num_write_kb":12589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"38'65","reported_seq":117,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.575299+0000","last_change":"2024-04-20T10:59:50.575322+0000","last_active":"2024-04-20T10:59:50.575299+0000","last_peered":"2024-04-20T10:59:50.575299+0000","last_clean":"2024-04-20T10:59:50.575299+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:59:50.575299+0000","last_undegraded":"2024-04-20T10:59:50.575299+0000","last_fullsized":"2024-04-20T10:59:50.575299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'65","last_scrub_stamp":"2024-04-20T10:59:50.575224+0000","last_deep_scrub":"38'65","last_deep_scrub_stamp":"2024-04-20T10:59:50.575224+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.575224+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:52:41.164009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"38'406","reported_seq":520,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411136+0000","last_change":"2024-04-20T10:50:49.654798+0000","last_active":"2024-04-20T10:59:30.411136+0000","last_peered":"2024-04-20T10:59:30.411136+0000","last_clean":"2024-04-20T10:59:30.411136+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T10:59:30.411136+0000","last_undegraded":"2024-04-20T10:59:30.411136+0000","last_fullsized":"2024-04-20T10:59:30.411136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":74646,"num_write":381,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'380","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388341+0000","last_change":"2024-04-20T10:50:40.596095+0000","last_active":"2024-04-20T10:59:20.388341+0000","last_peered":"2024-04-20T10:59:20.388341+0000","last_clean":"2024-04-20T10:59:20.388341+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T10:59:20.388341+0000","last_undegraded":"2024-04-20T10:59:20.388341+0000","last_fullsized":"2024-04-20T10:59:20.388341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61041,"num_write":349,"num_write_kb":58639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"38'332","reported_seq":397,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:34.402801+0000","last_change":"2024-04-20T10:50:39.587319+0000","last_active":"2024-04-20T10:59:34.402801+0000","last_peered":"2024-04-20T10:59:34.402801+0000","last_clean":"2024-04-20T10:59:34.402801+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T10:59:34.402801+0000","last_undegraded":"2024-04-20T10:59:34.402801+0000","last_fullsized":"2024-04-20T10:59:34.402801+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":332,"log_dups_size":0,"ondisk_log_size":332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":4122,"num_write":282,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"36'149","reported_seq":219,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.555862+0000","last_change":"2024-04-20T10:50:48.642834+0000","last_active":"2024-04-20T10:59:28.555862+0000","last_peered":"2024-04-20T10:59:28.555862+0000","last_clean":"2024-04-20T10:59:28.555862+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:59:28.555862+0000","last_undegraded":"2024-04-20T10:59:28.555862+0000","last_fullsized":"2024-04-20T10:59:28.555862+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":45111,"num_write":81,"num_write_kb":8263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"38'468","reported_seq":598,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405900+0000","last_change":"2024-04-20T10:50:49.640699+0000","last_active":"2024-04-20T10:59:30.405900+0000","last_peered":"2024-04-20T10:59:30.405900+0000","last_clean":"2024-04-20T10:59:30.405900+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T10:59:30.405900+0000","last_undegraded":"2024-04-20T10:59:30.405900+0000","last_fullsized":"2024-04-20T10:59:30.405900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":50494,"num_write":431,"num_write_kb":38868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"37'379","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386809+0000","last_change":"2024-04-20T10:50:40.599552+0000","last_active":"2024-04-20T10:59:20.386809+0000","last_peered":"2024-04-20T10:59:20.386809+0000","last_clean":"2024-04-20T10:59:20.386809+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:59:20.386809+0000","last_undegraded":"2024-04-20T10:59:20.386809+0000","last_fullsized":"2024-04-20T10:59:20.386809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:39:26.637818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":58132,"num_write":347,"num_write_kb":59251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"37'174","reported_seq":227,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393565+0000","last_change":"2024-04-20T10:50:39.587015+0000","last_active":"2024-04-20T10:59:20.393565+0000","last_peered":"2024-04-20T10:59:20.393565+0000","last_clean":"2024-04-20T10:59:20.393565+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T10:59:20.393565+0000","last_undegraded":"2024-04-20T10:59:20.393565+0000","last_fullsized":"2024-04-20T10:59:20.393565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":174,"log_dups_size":0,"ondisk_log_size":174,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":116,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"38'452","reported_seq":535,"reported_epoch":38,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-20T10:59:51.746030+0000","last_change":"2024-04-20T10:59:51.745793+0000","last_active":"2024-04-20T10:59:51.746030+0000","last_peered":"2024-04-20T10:59:51.746030+0000","last_clean":"2024-04-20T10:59:51.746030+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:59:51.746030+0000","last_undegraded":"2024-04-20T10:59:51.746030+0000","last_fullsized":"2024-04-20T10:59:51.746030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":452,"log_dups_size":0,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":8291,"num_write":401,"num_write_kb":8399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'436","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.641887+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:59:28.641887+0000","last_peered":"2024-04-20T10:59:28.641887+0000","last_clean":"2024-04-20T10:59:28.641887+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:59:28.641887+0000","last_undegraded":"2024-04-20T10:59:28.641887+0000","last_fullsized":"2024-04-20T10:59:28.641887+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:30:33.301690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":65641,"num_write":399,"num_write_kb":55375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"38'413","reported_seq":550,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410530+0000","last_change":"2024-04-20T10:50:40.601895+0000","last_active":"2024-04-20T10:59:23.410530+0000","last_peered":"2024-04-20T10:59:23.410530+0000","last_clean":"2024-04-20T10:59:23.410530+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T10:59:23.410530+0000","last_undegraded":"2024-04-20T10:59:23.410530+0000","last_fullsized":"2024-04-20T10:59:23.410530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":35937,"num_write":378,"num_write_kb":46521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"37'65","reported_seq":117,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.383991+0000","last_change":"2024-04-20T10:50:39.585967+0000","last_active":"2024-04-20T10:59:20.383991+0000","last_peered":"2024-04-20T10:59:20.383991+0000","last_clean":"2024-04-20T10:59:20.383991+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T10:59:20.383991+0000","last_undegraded":"2024-04-20T10:59:20.383991+0000","last_fullsized":"2024-04-20T10:59:20.383991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'63","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392619+0000","last_change":"2024-04-20T10:50:48.644879+0000","last_active":"2024-04-20T10:59:20.392619+0000","last_peered":"2024-04-20T10:59:20.392619+0000","last_clean":"2024-04-20T10:59:20.392619+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:59:20.392619+0000","last_undegraded":"2024-04-20T10:59:20.392619+0000","last_fullsized":"2024-04-20T10:59:20.392619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"38'364","reported_seq":463,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649246+0000","last_change":"2024-04-20T10:50:49.640583+0000","last_active":"2024-04-20T10:59:28.649246+0000","last_peered":"2024-04-20T10:59:28.649246+0000","last_clean":"2024-04-20T10:59:28.649246+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T10:59:28.649246+0000","last_undegraded":"2024-04-20T10:59:28.649246+0000","last_fullsized":"2024-04-20T10:59:28.649246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25276,"num_write":334,"num_write_kb":46079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"36'73","reported_seq":123,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387292+0000","last_change":"2024-04-20T10:50:48.643821+0000","last_active":"2024-04-20T10:59:20.387292+0000","last_peered":"2024-04-20T10:59:20.387292+0000","last_clean":"2024-04-20T10:59:20.387292+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T10:59:20.387292+0000","last_undegraded":"2024-04-20T10:59:20.387292+0000","last_fullsized":"2024-04-20T10:59:20.387292+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:13.387839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":32,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"38'418","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.404588+0000","last_change":"2024-04-20T10:50:40.592455+0000","last_active":"2024-04-20T10:59:23.404588+0000","last_peered":"2024-04-20T10:59:23.404588+0000","last_clean":"2024-04-20T10:59:23.404588+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:59:23.404588+0000","last_undegraded":"2024-04-20T10:59:23.404588+0000","last_fullsized":"2024-04-20T10:59:23.404588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":61851,"num_write":392,"num_write_kb":55373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"38'892","reported_seq":951,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410710+0000","last_change":"2024-04-20T10:50:39.582960+0000","last_active":"2024-04-20T10:59:23.410710+0000","last_peered":"2024-04-20T10:59:23.410710+0000","last_clean":"2024-04-20T10:59:23.410710+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T10:59:23.410710+0000","last_undegraded":"2024-04-20T10:59:23.410710+0000","last_fullsized":"2024-04-20T10:59:23.410710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":892,"log_dups_size":0,"ondisk_log_size":892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":834,"num_write_kb":8709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'413","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405817+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:59:30.405817+0000","last_peered":"2024-04-20T10:59:30.405817+0000","last_clean":"2024-04-20T10:59:30.405817+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:59:30.405817+0000","last_undegraded":"2024-04-20T10:59:30.405817+0000","last_fullsized":"2024-04-20T10:59:30.405817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:46:09.918122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49569,"num_write":377,"num_write_kb":64815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"38'54","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410285+0000","last_change":"2024-04-20T10:50:48.637136+0000","last_active":"2024-04-20T10:59:30.410285+0000","last_peered":"2024-04-20T10:59:30.410285+0000","last_clean":"2024-04-20T10:59:30.410285+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:59:30.410285+0000","last_undegraded":"2024-04-20T10:59:30.410285+0000","last_fullsized":"2024-04-20T10:59:30.410285+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":8,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"38'435","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399922+0000","last_change":"2024-04-20T10:50:40.592181+0000","last_active":"2024-04-20T10:59:23.399922+0000","last_peered":"2024-04-20T10:59:23.399922+0000","last_clean":"2024-04-20T10:59:23.399922+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T10:59:23.399922+0000","last_undegraded":"2024-04-20T10:59:23.399922+0000","last_fullsized":"2024-04-20T10:59:23.399922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26261,"num_write":400,"num_write_kb":42830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"38'220","reported_seq":273,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410249+0000","last_change":"2024-04-20T10:50:39.580157+0000","last_active":"2024-04-20T10:59:23.410249+0000","last_peered":"2024-04-20T10:59:23.410249+0000","last_clean":"2024-04-20T10:59:23.410249+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T10:59:23.410249+0000","last_undegraded":"2024-04-20T10:59:23.410249+0000","last_fullsized":"2024-04-20T10:59:23.410249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":166,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"38'369","reported_seq":466,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.406506+0000","last_change":"2024-04-20T10:50:49.651593+0000","last_active":"2024-04-20T10:59:30.406506+0000","last_peered":"2024-04-20T10:59:30.406506+0000","last_clean":"2024-04-20T10:59:30.406506+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T10:59:30.406506+0000","last_undegraded":"2024-04-20T10:59:30.406506+0000","last_fullsized":"2024-04-20T10:59:30.406506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31197,"num_write":338,"num_write_kb":64191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"36'448","reported_seq":507,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.382718+0000","last_change":"2024-04-20T10:50:39.582161+0000","last_active":"2024-04-20T10:59:20.382718+0000","last_peered":"2024-04-20T10:59:20.382718+0000","last_clean":"2024-04-20T10:59:20.382718+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:59:20.382718+0000","last_undegraded":"2024-04-20T10:59:20.382718+0000","last_fullsized":"2024-04-20T10:59:20.382718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":384,"num_write_kb":12501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'379","reported_seq":515,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.388144+0000","last_change":"2024-04-20T10:50:40.601555+0000","last_active":"2024-04-20T10:59:20.388144+0000","last_peered":"2024-04-20T10:59:20.388144+0000","last_clean":"2024-04-20T10:59:20.388144+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:59:20.388144+0000","last_undegraded":"2024-04-20T10:59:20.388144+0000","last_fullsized":"2024-04-20T10:59:20.388144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:40:17.857241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52177,"num_write":354,"num_write_kb":79739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"38'581","reported_seq":638,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.404266+0000","last_change":"2024-04-20T10:50:48.641145+0000","last_active":"2024-04-20T10:59:30.404266+0000","last_peered":"2024-04-20T10:59:30.404266+0000","last_clean":"2024-04-20T10:59:30.404266+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:59:30.404266+0000","last_undegraded":"2024-04-20T10:59:30.404266+0000","last_fullsized":"2024-04-20T10:59:30.404266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:47.611814+0000","last_clean_scrub_stamp":"2024-04-20T10:50:47.611814+0000","objects_scrubbed":0,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":12318,"num_write":526,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"38'403","reported_seq":533,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648655+0000","last_change":"2024-04-20T10:50:49.642684+0000","last_active":"2024-04-20T10:59:28.648655+0000","last_peered":"2024-04-20T10:59:28.648655+0000","last_clean":"2024-04-20T10:59:28.648655+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T10:59:28.648655+0000","last_undegraded":"2024-04-20T10:59:28.648655+0000","last_fullsized":"2024-04-20T10:59:28.648655+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":104331,"num_write":376,"num_write_kb":109020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"36'181","reported_seq":238,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392487+0000","last_change":"2024-04-20T10:50:39.578954+0000","last_active":"2024-04-20T10:59:20.392487+0000","last_peered":"2024-04-20T10:59:20.392487+0000","last_clean":"2024-04-20T10:59:20.392487+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T10:59:20.392487+0000","last_undegraded":"2024-04-20T10:59:20.392487+0000","last_fullsized":"2024-04-20T10:59:20.392487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:38.554880+0000","last_clean_scrub_stamp":"2024-04-20T10:50:38.554880+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":124,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'410","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.387215+0000","last_change":"2024-04-20T10:50:40.584589+0000","last_active":"2024-04-20T10:59:20.387215+0000","last_peered":"2024-04-20T10:59:20.387215+0000","last_clean":"2024-04-20T10:59:20.387215+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:59:20.387215+0000","last_undegraded":"2024-04-20T10:59:20.387215+0000","last_fullsized":"2024-04-20T10:59:20.387215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56637,"num_write":377,"num_write_kb":62852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"38'550","reported_seq":625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.798374+0000","last_change":"2024-04-20T10:59:50.798403+0000","last_active":"2024-04-20T10:59:50.798374+0000","last_peered":"2024-04-20T10:59:50.798374+0000","last_clean":"2024-04-20T10:59:50.798374+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:59:50.798374+0000","last_undegraded":"2024-04-20T10:59:50.798374+0000","last_fullsized":"2024-04-20T10:59:50.798374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'550","last_scrub_stamp":"2024-04-20T10:59:50.798302+0000","last_deep_scrub":"38'550","last_deep_scrub_stamp":"2024-04-20T10:59:50.798302+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.798302+0000","objects_scrubbed":4,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:38:58.664176+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":57371,"num_write":468,"num_write_kb":12517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"38'472","reported_seq":609,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.748333+0000","last_change":"2024-04-20T10:50:49.646108+0000","last_active":"2024-04-20T10:59:31.748333+0000","last_peered":"2024-04-20T10:59:31.748333+0000","last_clean":"2024-04-20T10:59:31.748333+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T10:59:31.748333+0000","last_undegraded":"2024-04-20T10:59:31.748333+0000","last_fullsized":"2024-04-20T10:59:31.748333+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":77683,"num_write":435,"num_write_kb":89005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"38'421","reported_seq":568,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406944+0000","last_change":"2024-04-20T10:50:40.593003+0000","last_active":"2024-04-20T10:59:23.406944+0000","last_peered":"2024-04-20T10:59:23.406944+0000","last_clean":"2024-04-20T10:59:23.406944+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T10:59:23.406944+0000","last_undegraded":"2024-04-20T10:59:23.406944+0000","last_fullsized":"2024-04-20T10:59:23.406944+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":50143,"num_write":396,"num_write_kb":67741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"38'423","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.732586+0000","last_change":"2024-04-20T10:50:49.646003+0000","last_active":"2024-04-20T10:59:31.732586+0000","last_peered":"2024-04-20T10:59:31.732586+0000","last_clean":"2024-04-20T10:59:31.732586+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:59:31.732586+0000","last_undegraded":"2024-04-20T10:59:31.732586+0000","last_fullsized":"2024-04-20T10:59:31.732586+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66334,"num_write":397,"num_write_kb":71356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"38'448","reported_seq":603,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407212+0000","last_change":"2024-04-20T10:50:40.605379+0000","last_active":"2024-04-20T10:59:23.407212+0000","last_peered":"2024-04-20T10:59:23.407212+0000","last_clean":"2024-04-20T10:59:23.407212+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:59:23.407212+0000","last_undegraded":"2024-04-20T10:59:23.407212+0000","last_fullsized":"2024-04-20T10:59:23.407212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":105081,"num_write":414,"num_write_kb":80164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"38'397","reported_seq":522,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.797977+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:59:31.797977+0000","last_peered":"2024-04-20T10:59:31.797977+0000","last_clean":"2024-04-20T10:59:31.797977+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:59:31.797977+0000","last_undegraded":"2024-04-20T10:59:31.797977+0000","last_fullsized":"2024-04-20T10:59:31.797977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":91923,"num_write":367,"num_write_kb":80227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"38'487","reported_seq":650,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406723+0000","last_change":"2024-04-20T10:50:40.612598+0000","last_active":"2024-04-20T10:59:23.406723+0000","last_peered":"2024-04-20T10:59:23.406723+0000","last_clean":"2024-04-20T10:59:23.406723+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:59:23.406723+0000","last_undegraded":"2024-04-20T10:59:23.406723+0000","last_fullsized":"2024-04-20T10:59:23.406723+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":66889,"num_write":452,"num_write_kb":101085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"38'390","reported_seq":499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.732555+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:59:31.732555+0000","last_peered":"2024-04-20T10:59:31.732555+0000","last_clean":"2024-04-20T10:59:31.732555+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:59:31.732555+0000","last_undegraded":"2024-04-20T10:59:31.732555+0000","last_fullsized":"2024-04-20T10:59:31.732555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":23315,"num_write":364,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"38'411","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401301+0000","last_change":"2024-04-20T10:50:40.599513+0000","last_active":"2024-04-20T10:59:23.401301+0000","last_peered":"2024-04-20T10:59:23.401301+0000","last_clean":"2024-04-20T10:59:23.401301+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T10:59:23.401301+0000","last_undegraded":"2024-04-20T10:59:23.401301+0000","last_fullsized":"2024-04-20T10:59:23.401301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:28:36.781412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":34858,"num_write":375,"num_write_kb":71279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"38'438","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648687+0000","last_change":"2024-04-20T10:50:49.641803+0000","last_active":"2024-04-20T10:59:28.648687+0000","last_peered":"2024-04-20T10:59:28.648687+0000","last_clean":"2024-04-20T10:59:28.648687+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T10:59:28.648687+0000","last_undegraded":"2024-04-20T10:59:28.648687+0000","last_fullsized":"2024-04-20T10:59:28.648687+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:53:53.560697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":12465,"num_write":398,"num_write_kb":25863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"38'367","reported_seq":491,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410742+0000","last_change":"2024-04-20T10:50:40.603854+0000","last_active":"2024-04-20T10:59:23.410742+0000","last_peered":"2024-04-20T10:59:23.410742+0000","last_clean":"2024-04-20T10:59:23.410742+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:59:23.410742+0000","last_undegraded":"2024-04-20T10:59:23.410742+0000","last_fullsized":"2024-04-20T10:59:23.410742+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40934,"num_write":339,"num_write_kb":54699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"38'400","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.407824+0000","last_change":"2024-04-20T10:50:49.639661+0000","last_active":"2024-04-20T10:59:30.407824+0000","last_peered":"2024-04-20T10:59:30.407824+0000","last_clean":"2024-04-20T10:59:30.407824+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T10:59:30.407824+0000","last_undegraded":"2024-04-20T10:59:30.407824+0000","last_fullsized":"2024-04-20T10:59:30.407824+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":17066,"num_write":365,"num_write_kb":46558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"37'404","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:21.731426+0000","last_change":"2024-04-20T10:50:40.590337+0000","last_active":"2024-04-20T10:59:21.731426+0000","last_peered":"2024-04-20T10:59:21.731426+0000","last_clean":"2024-04-20T10:59:21.731426+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:59:21.731426+0000","last_undegraded":"2024-04-20T10:59:21.731426+0000","last_fullsized":"2024-04-20T10:59:21.731426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64800,"num_write":371,"num_write_kb":91764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"38'402","reported_seq":501,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649072+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:59:28.649072+0000","last_peered":"2024-04-20T10:59:28.649072+0000","last_clean":"2024-04-20T10:59:28.649072+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:59:28.649072+0000","last_undegraded":"2024-04-20T10:59:28.649072+0000","last_fullsized":"2024-04-20T10:59:28.649072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:27:14.105679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1607,"num_write":370,"num_write_kb":5819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"38'433","reported_seq":571,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399859+0000","last_change":"2024-04-20T10:50:40.594041+0000","last_active":"2024-04-20T10:59:23.399859+0000","last_peered":"2024-04-20T10:59:23.399859+0000","last_clean":"2024-04-20T10:59:23.399859+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T10:59:23.399859+0000","last_undegraded":"2024-04-20T10:59:23.399859+0000","last_fullsized":"2024-04-20T10:59:23.399859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":4096,"num_write":399,"num_write_kb":30569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"38'439","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410289+0000","last_change":"2024-04-20T10:50:49.637140+0000","last_active":"2024-04-20T10:59:30.410289+0000","last_peered":"2024-04-20T10:59:30.410289+0000","last_clean":"2024-04-20T10:59:30.410289+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T10:59:30.410289+0000","last_undegraded":"2024-04-20T10:59:30.410289+0000","last_fullsized":"2024-04-20T10:59:30.410289+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":70131,"num_write":400,"num_write_kb":59168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"38'431","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.401305+0000","last_change":"2024-04-20T10:50:40.603789+0000","last_active":"2024-04-20T10:59:23.401305+0000","last_peered":"2024-04-20T10:59:23.401305+0000","last_clean":"2024-04-20T10:59:23.401305+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T10:59:23.401305+0000","last_undegraded":"2024-04-20T10:59:23.401305+0000","last_fullsized":"2024-04-20T10:59:23.401305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":77347,"num_write":407,"num_write_kb":71895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"38'408","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411346+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:59:30.411346+0000","last_peered":"2024-04-20T10:59:30.411346+0000","last_clean":"2024-04-20T10:59:30.411346+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:59:30.411346+0000","last_undegraded":"2024-04-20T10:59:30.411346+0000","last_fullsized":"2024-04-20T10:59:30.411346+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":43744,"num_write":370,"num_write_kb":63188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"38'456","reported_seq":614,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410659+0000","last_change":"2024-04-20T10:50:40.597500+0000","last_active":"2024-04-20T10:59:23.410659+0000","last_peered":"2024-04-20T10:59:23.410659+0000","last_clean":"2024-04-20T10:59:23.410659+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T10:59:23.410659+0000","last_undegraded":"2024-04-20T10:59:23.410659+0000","last_fullsized":"2024-04-20T10:59:23.410659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63871,"num_write":428,"num_write_kb":100114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"38'419","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401609+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:59:30.401609+0000","last_peered":"2024-04-20T10:59:30.401609+0000","last_clean":"2024-04-20T10:59:30.401609+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:59:30.401609+0000","last_undegraded":"2024-04-20T10:59:30.401609+0000","last_fullsized":"2024-04-20T10:59:30.401609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:42.469507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":38962,"num_write":387,"num_write_kb":79793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"38'398","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.749197+0000","last_change":"2024-04-20T10:50:40.591617+0000","last_active":"2024-04-20T10:59:41.749197+0000","last_peered":"2024-04-20T10:59:41.749197+0000","last_clean":"2024-04-20T10:59:41.749197+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T10:59:41.749197+0000","last_undegraded":"2024-04-20T10:59:41.749197+0000","last_fullsized":"2024-04-20T10:59:41.749197+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":27738,"num_write":360,"num_write_kb":54944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"38'458","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.968171+0000","last_change":"2024-04-20T10:50:49.642314+0000","last_active":"2024-04-20T10:59:49.968171+0000","last_peered":"2024-04-20T10:59:49.968171+0000","last_clean":"2024-04-20T10:59:49.968171+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T10:59:49.968171+0000","last_undegraded":"2024-04-20T10:59:49.968171+0000","last_fullsized":"2024-04-20T10:59:49.968171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":59920,"num_write":425,"num_write_kb":71046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"37'439","reported_seq":600,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.799268+0000","last_change":"2024-04-20T10:50:40.602540+0000","last_active":"2024-04-20T10:59:41.799268+0000","last_peered":"2024-04-20T10:59:41.799268+0000","last_clean":"2024-04-20T10:59:41.799268+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:59:41.799268+0000","last_undegraded":"2024-04-20T10:59:41.799268+0000","last_fullsized":"2024-04-20T10:59:41.799268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":95905,"num_write":408,"num_write_kb":92283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"38'434","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.399990+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:59:50.399990+0000","last_peered":"2024-04-20T10:59:50.399990+0000","last_clean":"2024-04-20T10:59:50.399990+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:59:50.399990+0000","last_undegraded":"2024-04-20T10:59:50.399990+0000","last_fullsized":"2024-04-20T10:59:50.399990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66507,"num_write":387,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"38'427","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410629+0000","last_change":"2024-04-20T10:50:40.599243+0000","last_active":"2024-04-20T10:59:23.410629+0000","last_peered":"2024-04-20T10:59:23.410629+0000","last_clean":"2024-04-20T10:59:23.410629+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T10:59:23.410629+0000","last_undegraded":"2024-04-20T10:59:23.410629+0000","last_fullsized":"2024-04-20T10:59:23.410629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:59:13.505221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":76500,"num_write":396,"num_write_kb":108707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"38'451","reported_seq":613,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.844649+0000","last_change":"2024-04-20T10:50:49.642360+0000","last_active":"2024-04-20T10:59:50.844649+0000","last_peered":"2024-04-20T10:59:50.844649+0000","last_clean":"2024-04-20T10:59:50.844649+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T10:59:50.844649+0000","last_undegraded":"2024-04-20T10:59:50.844649+0000","last_fullsized":"2024-04-20T10:59:50.844649+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":149375,"num_write":423,"num_write_kb":104932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"36'447","reported_seq":584,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:41.737304+0000","last_change":"2024-04-20T10:50:40.605153+0000","last_active":"2024-04-20T10:59:41.737304+0000","last_peered":"2024-04-20T10:59:41.737304+0000","last_clean":"2024-04-20T10:59:41.737304+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:59:41.737304+0000","last_undegraded":"2024-04-20T10:59:41.737304+0000","last_fullsized":"2024-04-20T10:59:41.737304+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":47044,"num_write":422,"num_write_kb":50901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"38'415","reported_seq":538,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.844663+0000","last_change":"2024-04-20T10:50:49.645482+0000","last_active":"2024-04-20T10:59:50.844663+0000","last_peered":"2024-04-20T10:59:50.844663+0000","last_clean":"2024-04-20T10:59:50.844663+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T10:59:50.844663+0000","last_undegraded":"2024-04-20T10:59:50.844663+0000","last_fullsized":"2024-04-20T10:59:50.844663+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":91214,"num_write":375,"num_write_kb":63780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"37'461","reported_seq":625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.393370+0000","last_change":"2024-04-20T10:50:40.607436+0000","last_active":"2024-04-20T10:59:20.393370+0000","last_peered":"2024-04-20T10:59:20.393370+0000","last_clean":"2024-04-20T10:59:20.393370+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:59:20.393370+0000","last_undegraded":"2024-04-20T10:59:20.393370+0000","last_fullsized":"2024-04-20T10:59:20.393370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:20:16.073179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":88844,"num_write":432,"num_write_kb":122405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"38'475","reported_seq":633,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.797922+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:59:31.797922+0000","last_peered":"2024-04-20T10:59:31.797922+0000","last_clean":"2024-04-20T10:59:31.797922+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:59:31.797922+0000","last_undegraded":"2024-04-20T10:59:31.797922+0000","last_fullsized":"2024-04-20T10:59:31.797922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":92351,"num_write":448,"num_write_kb":96949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"38'395","reported_seq":533,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408849+0000","last_change":"2024-04-20T10:50:40.597430+0000","last_active":"2024-04-20T10:59:23.408849+0000","last_peered":"2024-04-20T10:59:23.408849+0000","last_clean":"2024-04-20T10:59:23.408849+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:59:23.408849+0000","last_undegraded":"2024-04-20T10:59:23.408849+0000","last_fullsized":"2024-04-20T10:59:23.408849+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":19688,"num_write":355,"num_write_kb":13664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"38'415","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.612674+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:59:28.612674+0000","last_peered":"2024-04-20T10:59:28.612674+0000","last_clean":"2024-04-20T10:59:28.612674+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:59:28.612674+0000","last_undegraded":"2024-04-20T10:59:28.612674+0000","last_fullsized":"2024-04-20T10:59:28.612674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:02:07.991240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":48111,"num_write":381,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"38'397","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.403276+0000","last_change":"2024-04-20T10:50:40.601720+0000","last_active":"2024-04-20T10:59:23.403276+0000","last_peered":"2024-04-20T10:59:23.403276+0000","last_clean":"2024-04-20T10:59:23.403276+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T10:59:23.403276+0000","last_undegraded":"2024-04-20T10:59:23.403276+0000","last_fullsized":"2024-04-20T10:59:23.403276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":17103,"num_write":369,"num_write_kb":54677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"38'400","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405305+0000","last_change":"2024-04-20T10:50:49.653302+0000","last_active":"2024-04-20T10:59:30.405305+0000","last_peered":"2024-04-20T10:59:30.405305+0000","last_clean":"2024-04-20T10:59:30.405305+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T10:59:30.405305+0000","last_undegraded":"2024-04-20T10:59:30.405305+0000","last_fullsized":"2024-04-20T10:59:30.405305+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":100212,"num_write":371,"num_write_kb":79700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"38'442","reported_seq":573,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.402748+0000","last_change":"2024-04-20T10:51:20.873976+0000","last_active":"2024-04-20T10:59:23.402748+0000","last_peered":"2024-04-20T10:59:23.402748+0000","last_clean":"2024-04-20T10:59:23.402748+0000","last_became_active":"2024-04-20T10:51:20.873636+0000","last_became_peered":"2024-04-20T10:51:20.873636+0000","last_unstale":"2024-04-20T10:59:23.402748+0000","last_undegraded":"2024-04-20T10:59:23.402748+0000","last_fullsized":"2024-04-20T10:59:23.402748+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42670,"num_write":410,"num_write_kb":59228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"38'412","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412265+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:59:30.412265+0000","last_peered":"2024-04-20T10:59:30.412265+0000","last_clean":"2024-04-20T10:59:30.412265+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:59:30.412265+0000","last_undegraded":"2024-04-20T10:59:30.412265+0000","last_fullsized":"2024-04-20T10:59:30.412265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":47914,"num_write":385,"num_write_kb":47165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"38'402","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.399632+0000","last_change":"2024-04-20T10:50:40.582435+0000","last_active":"2024-04-20T10:59:23.399632+0000","last_peered":"2024-04-20T10:59:23.399632+0000","last_clean":"2024-04-20T10:59:23.399632+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T10:59:23.399632+0000","last_undegraded":"2024-04-20T10:59:23.399632+0000","last_fullsized":"2024-04-20T10:59:23.399632+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":39185,"num_write":369,"num_write_kb":42800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"38'382","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.409030+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:59:30.409030+0000","last_peered":"2024-04-20T10:59:30.409030+0000","last_clean":"2024-04-20T10:59:30.409030+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:59:30.409030+0000","last_undegraded":"2024-04-20T10:59:30.409030+0000","last_fullsized":"2024-04-20T10:59:30.409030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":54933,"num_write":350,"num_write_kb":63813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"37'409","reported_seq":548,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386301+0000","last_change":"2024-04-20T10:50:40.595102+0000","last_active":"2024-04-20T10:59:20.386301+0000","last_peered":"2024-04-20T10:59:20.386301+0000","last_clean":"2024-04-20T10:59:20.386301+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:59:20.386301+0000","last_undegraded":"2024-04-20T10:59:20.386301+0000","last_fullsized":"2024-04-20T10:59:20.386301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:18:01.820117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":25358,"num_write":380,"num_write_kb":59236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"38'401","reported_seq":510,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649095+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:59:28.649095+0000","last_peered":"2024-04-20T10:59:28.649095+0000","last_clean":"2024-04-20T10:59:28.649095+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:59:28.649095+0000","last_undegraded":"2024-04-20T10:59:28.649095+0000","last_fullsized":"2024-04-20T10:59:28.649095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:35:35.532523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":46490,"num_write":386,"num_write_kb":55187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"38'404","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409480+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:59:23.409480+0000","last_peered":"2024-04-20T10:59:23.409480+0000","last_clean":"2024-04-20T10:59:23.409480+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:59:23.409480+0000","last_undegraded":"2024-04-20T10:59:23.409480+0000","last_fullsized":"2024-04-20T10:59:23.409480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":60998,"num_write":371,"num_write_kb":104269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"38'390","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.645398+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:59:28.645398+0000","last_peered":"2024-04-20T10:59:28.645398+0000","last_clean":"2024-04-20T10:59:28.645398+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:59:28.645398+0000","last_undegraded":"2024-04-20T10:59:28.645398+0000","last_fullsized":"2024-04-20T10:59:28.645398+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":9157,"num_write":355,"num_write_kb":25794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"38'351","reported_seq":481,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409558+0000","last_change":"2024-04-20T10:50:40.595864+0000","last_active":"2024-04-20T10:59:23.409558+0000","last_peered":"2024-04-20T10:59:23.409558+0000","last_clean":"2024-04-20T10:59:23.409558+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T10:59:23.409558+0000","last_undegraded":"2024-04-20T10:59:23.409558+0000","last_fullsized":"2024-04-20T10:59:23.409558+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":63467,"num_write":328,"num_write_kb":42600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"38'381","reported_seq":490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410464+0000","last_change":"2024-04-20T10:50:49.642245+0000","last_active":"2024-04-20T10:59:30.410464+0000","last_peered":"2024-04-20T10:59:30.410464+0000","last_clean":"2024-04-20T10:59:30.410464+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:59:30.410464+0000","last_undegraded":"2024-04-20T10:59:30.410464+0000","last_fullsized":"2024-04-20T10:59:30.410464+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":28672,"num_write":342,"num_write_kb":50404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"38'364","reported_seq":485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.408319+0000","last_change":"2024-04-20T10:50:40.604982+0000","last_active":"2024-04-20T10:59:23.408319+0000","last_peered":"2024-04-20T10:59:23.408319+0000","last_clean":"2024-04-20T10:59:23.408319+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:59:23.408319+0000","last_undegraded":"2024-04-20T10:59:23.408319+0000","last_fullsized":"2024-04-20T10:59:23.408319+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":12730,"num_write":348,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"38'424","reported_seq":532,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.402605+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:59:30.402605+0000","last_peered":"2024-04-20T10:59:30.402605+0000","last_clean":"2024-04-20T10:59:30.402605+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:59:30.402605+0000","last_undegraded":"2024-04-20T10:59:30.402605+0000","last_fullsized":"2024-04-20T10:59:30.402605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:10:16.154476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":7385,"num_write":393,"num_write_kb":42181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"38'399","reported_seq":541,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.397928+0000","last_change":"2024-04-20T10:51:20.769699+0000","last_active":"2024-04-20T10:59:23.397928+0000","last_peered":"2024-04-20T10:59:23.397928+0000","last_clean":"2024-04-20T10:59:23.397928+0000","last_became_active":"2024-04-20T10:51:20.769384+0000","last_became_peered":"2024-04-20T10:51:20.769384+0000","last_unstale":"2024-04-20T10:59:23.397928+0000","last_undegraded":"2024-04-20T10:59:23.397928+0000","last_fullsized":"2024-04-20T10:59:23.397928+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71394,"num_write":379,"num_write_kb":96385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"38'436","reported_seq":553,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401721+0000","last_change":"2024-04-20T10:50:49.646706+0000","last_active":"2024-04-20T10:59:30.401721+0000","last_peered":"2024-04-20T10:59:30.401721+0000","last_clean":"2024-04-20T10:59:30.401721+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T10:59:30.401721+0000","last_undegraded":"2024-04-20T10:59:30.401721+0000","last_fullsized":"2024-04-20T10:59:30.401721+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":70925,"num_write":402,"num_write_kb":100628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"38'423","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407161+0000","last_change":"2024-04-20T10:51:20.841991+0000","last_active":"2024-04-20T10:59:23.407161+0000","last_peered":"2024-04-20T10:59:23.407161+0000","last_clean":"2024-04-20T10:59:23.407161+0000","last_became_active":"2024-04-20T10:51:20.841719+0000","last_became_peered":"2024-04-20T10:51:20.841719+0000","last_unstale":"2024-04-20T10:59:23.407161+0000","last_undegraded":"2024-04-20T10:59:23.407161+0000","last_fullsized":"2024-04-20T10:59:23.407161+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":49916,"num_write":398,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"38'473","reported_seq":606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636981+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:59:28.636981+0000","last_peered":"2024-04-20T10:59:28.636981+0000","last_clean":"2024-04-20T10:59:28.636981+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:59:28.636981+0000","last_undegraded":"2024-04-20T10:59:28.636981+0000","last_fullsized":"2024-04-20T10:59:28.636981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":134201,"num_write":442,"num_write_kb":141769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"38'414","reported_seq":589,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410789+0000","last_change":"2024-04-20T10:50:40.605284+0000","last_active":"2024-04-20T10:59:23.410789+0000","last_peered":"2024-04-20T10:59:23.410789+0000","last_clean":"2024-04-20T10:59:23.410789+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:59:23.410789+0000","last_undegraded":"2024-04-20T10:59:23.410789+0000","last_fullsized":"2024-04-20T10:59:23.410789+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":129245,"num_write":382,"num_write_kb":126738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"38'443","reported_seq":568,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648759+0000","last_change":"2024-04-20T10:50:49.653099+0000","last_active":"2024-04-20T10:59:28.648759+0000","last_peered":"2024-04-20T10:59:28.648759+0000","last_clean":"2024-04-20T10:59:28.648759+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T10:59:28.648759+0000","last_undegraded":"2024-04-20T10:59:28.648759+0000","last_fullsized":"2024-04-20T10:59:28.648759+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":98132,"num_write":412,"num_write_kb":88980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"38'431","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390443+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:59:20.390443+0000","last_peered":"2024-04-20T10:59:20.390443+0000","last_clean":"2024-04-20T10:59:20.390443+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:59:20.390443+0000","last_undegraded":"2024-04-20T10:59:20.390443+0000","last_fullsized":"2024-04-20T10:59:20.390443+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:44:22.259180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":82367,"num_write":405,"num_write_kb":88791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"38'369","reported_seq":470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412127+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:59:30.412127+0000","last_peered":"2024-04-20T10:59:30.412127+0000","last_clean":"2024-04-20T10:59:30.412127+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:59:30.412127+0000","last_undegraded":"2024-04-20T10:59:30.412127+0000","last_fullsized":"2024-04-20T10:59:30.412127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":17428,"num_write":337,"num_write_kb":30562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"38'375","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.406655+0000","last_change":"2024-04-20T10:50:40.604367+0000","last_active":"2024-04-20T10:59:23.406655+0000","last_peered":"2024-04-20T10:59:23.406655+0000","last_clean":"2024-04-20T10:59:23.406655+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:59:23.406655+0000","last_undegraded":"2024-04-20T10:59:23.406655+0000","last_fullsized":"2024-04-20T10:59:23.406655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":12288,"num_write":347,"num_write_kb":45028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"38'368","reported_seq":471,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646963+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:59:28.646963+0000","last_peered":"2024-04-20T10:59:28.646963+0000","last_clean":"2024-04-20T10:59:28.646963+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:59:28.646963+0000","last_undegraded":"2024-04-20T10:59:28.646963+0000","last_fullsized":"2024-04-20T10:59:28.646963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":42400,"num_write":337,"num_write_kb":50456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"38'435","reported_seq":585,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390827+0000","last_change":"2024-04-20T10:50:40.593231+0000","last_active":"2024-04-20T10:59:20.390827+0000","last_peered":"2024-04-20T10:59:20.390827+0000","last_clean":"2024-04-20T10:59:20.390827+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T10:59:20.390827+0000","last_undegraded":"2024-04-20T10:59:20.390827+0000","last_fullsized":"2024-04-20T10:59:20.390827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:02:46.290808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":60266,"num_write":401,"num_write_kb":64358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"38'402","reported_seq":520,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410555+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:59:30.410555+0000","last_peered":"2024-04-20T10:59:30.410555+0000","last_clean":"2024-04-20T10:59:30.410555+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:59:30.410555+0000","last_undegraded":"2024-04-20T10:59:30.410555+0000","last_fullsized":"2024-04-20T10:59:30.410555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58110,"num_write":372,"num_write_kb":67566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"38'410","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.410539+0000","last_change":"2024-04-20T10:50:40.613054+0000","last_active":"2024-04-20T10:59:23.410539+0000","last_peered":"2024-04-20T10:59:23.410539+0000","last_clean":"2024-04-20T10:59:23.410539+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:59:23.410539+0000","last_undegraded":"2024-04-20T10:59:23.410539+0000","last_fullsized":"2024-04-20T10:59:23.410539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":40406,"num_write":376,"num_write_kb":72310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"38'423","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.499172+0000","last_change":"2024-04-20T10:59:50.499195+0000","last_active":"2024-04-20T10:59:50.499172+0000","last_peered":"2024-04-20T10:59:50.499172+0000","last_clean":"2024-04-20T10:59:50.499172+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:59:50.499172+0000","last_undegraded":"2024-04-20T10:59:50.499172+0000","last_fullsized":"2024-04-20T10:59:50.499172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T10:59:50.499090+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T10:59:50.499090+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.499090+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:04:26.944875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48634,"num_write":394,"num_write_kb":56270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"37'391","reported_seq":521,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.386768+0000","last_change":"2024-04-20T10:50:40.591016+0000","last_active":"2024-04-20T10:59:20.386768+0000","last_peered":"2024-04-20T10:59:20.386768+0000","last_clean":"2024-04-20T10:59:20.386768+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:59:20.386768+0000","last_undegraded":"2024-04-20T10:59:20.386768+0000","last_fullsized":"2024-04-20T10:59:20.386768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:14:40.053696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":67210,"num_write":369,"num_write_kb":63933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"38'365","reported_seq":475,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405357+0000","last_change":"2024-04-20T10:50:49.638520+0000","last_active":"2024-04-20T10:59:30.405357+0000","last_peered":"2024-04-20T10:59:30.405357+0000","last_clean":"2024-04-20T10:59:30.405357+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:59:30.405357+0000","last_undegraded":"2024-04-20T10:59:30.405357+0000","last_fullsized":"2024-04-20T10:59:30.405357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:21:53.304985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":38197,"num_write":324,"num_write_kb":43133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'436","reported_seq":575,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390339+0000","last_change":"2024-04-20T10:50:40.590442+0000","last_active":"2024-04-20T10:59:20.390339+0000","last_peered":"2024-04-20T10:59:20.390339+0000","last_clean":"2024-04-20T10:59:20.390339+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:59:20.390339+0000","last_undegraded":"2024-04-20T10:59:20.390339+0000","last_fullsized":"2024-04-20T10:59:20.390339+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":82231,"num_write":413,"num_write_kb":104966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"38'435","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.648841+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:59:28.648841+0000","last_peered":"2024-04-20T10:59:28.648841+0000","last_clean":"2024-04-20T10:59:28.648841+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:59:28.648841+0000","last_undegraded":"2024-04-20T10:59:28.648841+0000","last_fullsized":"2024-04-20T10:59:28.648841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:37:55.600436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78016,"num_write":409,"num_write_kb":101239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"37'379","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.392424+0000","last_change":"2024-04-20T10:50:40.597976+0000","last_active":"2024-04-20T10:59:20.392424+0000","last_peered":"2024-04-20T10:59:20.392424+0000","last_clean":"2024-04-20T10:59:20.392424+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:59:20.392424+0000","last_undegraded":"2024-04-20T10:59:20.392424+0000","last_fullsized":"2024-04-20T10:59:20.392424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:46:52.198206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":25535,"num_write":356,"num_write_kb":38136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4810,"num_read_kb":3595152,"num_write":24379,"num_write_kb":4256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26481,"ondisk_log_size":26481,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":149799849,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":809,"num_read_kb":507129,"num_write":8087,"num_write_kb":153177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299663360,"data_stored":299599698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9485,"ondisk_log_size":9485,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5724,"num_read_kb":3353332,"num_write":24442,"num_write_kb":4400565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26386,"ondisk_log_size":26386,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151049924,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":699,"num_read_kb":394566,"num_write":7753,"num_write_kb":153910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302161920,"data_stored":302099848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9160,"ondisk_log_size":9160,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574964,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126660,"kb_used_data":77436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94245180,"statfs":{"total":96636764160,"available":96507064320,"internally_reserved":0,"allocated":79294464,"data_stored":79053723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130184,"kb_used_data":80960,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94241656,"statfs":{"total":96636764160,"available":96503455744,"internally_reserved":0,"allocated":82903040,"data_stored":82658275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574963,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123880,"kb_used_data":52512,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94247960,"statfs":{"total":96636764160,"available":96509911040,"internally_reserved":0,"allocated":53772288,"data_stored":53529724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574965,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177172,"kb_used_data":96076,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94194668,"statfs":{"total":96636764160,"available":96455340032,"internally_reserved":0,"allocated":98381824,"data_stored":98133898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185380,"kb_used_data":104284,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94186460,"statfs":{"total":96636764160,"available":96446935040,"internally_reserved":0,"allocated":106786816,"data_stored":106540719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574965,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71508,"kb_used_data":26444,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94300332,"statfs":{"total":96636764160,"available":96563539968,"internally_reserved":0,"allocated":27078656,"data_stored":26847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189528,"kb_used_data":108432,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94182312,"statfs":{"total":96636764160,"available":96442687488,"internally_reserved":0,"allocated":111034368,"data_stored":110784971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95288,"kb_used_data":46064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94276552,"statfs":{"total":96636764160,"available":96539189248,"internally_reserved":0,"allocated":47169536,"data_stored":46927925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14065664,"data_stored":14065090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35045376,"data_stored":35037282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48914432,"data_stored":48903652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57298944,"data_stored":57292170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":68657152,"data_stored":68642196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51796853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23982080,"data_stored":23969931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T10:59:52.496 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.496 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.496 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.496 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.496 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.496 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.496 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.497 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.498 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.499 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.500 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.501 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-20T10:50:28.509710+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=28, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.502 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.503 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.503 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.503 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.503 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.503 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.503 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.503 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.504 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.505 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.506 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.507 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.508 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-20T10:50:47.611814+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-20T10:50:38.554880+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=38, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.509 INFO:tasks.ceph:pgid 5.26 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 5.27 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 5.22 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.510 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 5.23 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 5.21 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.511 INFO:tasks.ceph:pgid 5.2c last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 5.2a last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 5.2b last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.512 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 5.36 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.513 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 5.33 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 5.31 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.514 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 5.3f last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.515 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.516 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.516 INFO:tasks.ceph:pgid 5.38 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.516 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.516 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.516 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T10:59:52.516 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-20T11:00:12.517 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T11:00:12.640 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.640+0000 7fb3d8b85640 1 Processor -- start 2024-04-20T11:00:12.641 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.640+0000 7fb3d8b85640 1 -- start start 2024-04-20T11:00:12.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.641+0000 7fb3d8b85640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 0x7fb3d4154480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.641+0000 7fb3d8b85640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fb3d40aba60 0x7fb3d40abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.641+0000 7fb3d8b85640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3d4073ba0 con 0x7fb3d4157a70 2024-04-20T11:00:12.643 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.641+0000 7fb3d8b85640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fb3d4157ed0 con 0x7fb3d40aba60 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.641+0000 7fb3d8b85640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d4151ef0 con 0x7fb3d4151b10 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.641+0000 7fb3d1d9b640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fb3d4157a70 0x7fb3d40725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:56812/0 (socket says 172.21.15.90:56812) 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.641+0000 7fb3d1d9b640 1 -- 172.21.15.90:0/2827014748 learned_addr learned my addr 172.21.15.90:0/2827014748 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d2d9d640 1 --2- 172.21.15.90:0/2827014748 >> v2:172.21.15.175:3300/0 conn(0x7fb3d40aba60 0x7fb3d40abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d259c640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 0x7fb3d4154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 893244449 0 0) 0x7fb3d4073ba0 con 0x7fb3d4157a70 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3bc003520 con 0x7fb3d4157a70 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 748953016 0 0) 0x7fb3bc003520 con 0x7fb3d4157a70 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 msgr2=0x7fb3d4154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 0x7fb3d4154480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 >> v2:172.21.15.175:3300/0 conn(0x7fb3d40aba60 msgr2=0x7fb3d40abef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 --2- 172.21.15.90:0/2827014748 >> v2:172.21.15.175:3300/0 conn(0x7fb3d40aba60 0x7fb3d40abef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.644 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d41589a0 con 0x7fb3d4157a70 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fb3c8001670 con 0x7fb3d4157a70 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d2d9d640 1 --2- 172.21.15.90:0/2827014748 >> v2:172.21.15.175:3300/0 conn(0x7fb3d40aba60 0x7fb3d40abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 >> v1:172.21.15.90:6789/0 conn(0x7fb3d4157a70 legacy=0x7fb3d40725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc0039b0 0x7fb3bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc004800 0x7fb3bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 0x7fb3bc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d4151ef0 con 0x7fb3bc0039b0 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb3bc00b9c0 con 0x7fb3bc004800 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb3bc00bb40 con 0x7fb3d4151b10 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d259c640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc0039b0 0x7fb3bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d1d9b640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc004800 0x7fb3bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d2d9d640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 0x7fb3bc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d259c640 1 -- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 msgr2=0x7fb3bc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:12.645 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d259c640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d4151b10 0x7fb3bc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d259c640 1 -- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc004800 msgr2=0x7fb3bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d259c640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc004800 0x7fb3bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.642+0000 7fb3d259c640 1 -- 172.21.15.90:0/2827014748 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3bc003520 con 0x7fb3bc0039b0 2024-04-20T11:00:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.643+0000 7fb3d259c640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc0039b0 0x7fb3bc003dd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009af0 tx=0x7fb3bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a71f3e1b4e8b7e server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.643+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc039070 con 0x7fb3bc0039b0 2024-04-20T11:00:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.643+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3cc02c6b0 con 0x7fb3bc0039b0 2024-04-20T11:00:12.646 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.643+0000 7fb3d159a640 1 -- 172.21.15.90:0/2827014748 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3cc009690 con 0x7fb3bc0039b0 2024-04-20T11:00:12.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.644+0000 7fb3d8b85640 1 -- 172.21.15.90:0/2827014748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc0039b0 msgr2=0x7fb3bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:12.649 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.644+0000 7fb3d8b85640 1 --2- 172.21.15.90:0/2827014748 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3bc0039b0 0x7fb3bc003dd0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc009af0 tx=0x7fb3bc005830 comp rx=0 tx=0).stop 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.644+0000 7fb3d2d9d640 1 -- 172.21.15.90:0/2827014748 reap_dead start 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.644+0000 7fb3d8b85640 1 -- 172.21.15.90:0/2827014748 shutdown_connections 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.644+0000 7fb3d8b85640 1 -- 172.21.15.90:0/2827014748 >> 172.21.15.90:0/2827014748 conn(0x7fb3d40ca0a0 msgr2=0x7fb3d40ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.644+0000 7fb3d8b85640 1 -- 172.21.15.90:0/2827014748 shutdown_connections 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.644+0000 7fb3d8b85640 1 -- 172.21.15.90:0/2827014748 wait complete. 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.645+0000 7fb3d8b85640 1 Processor -- start 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.645+0000 7fb3d8b85640 1 -- start start 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d8b85640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc0039b0 0x7fb3d414ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d8b85640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3d41ee300 0x7fb3d413cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d8b85640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d40ae4e0 0x7fb3d40ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d8b85640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41586c0 con 0x7fb3d41ee300 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d8b85640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fb3d41583e0 con 0x7fb3bc0039b0 2024-04-20T11:00:12.650 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d8b85640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fb3d40ab540 con 0x7fb3d40ae4e0 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3d41ee300 0x7fb3d413cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d1d9b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3d41ee300 0x7fb3d413cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:50316/0 (socket says 172.21.15.90:50316) 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d1d9b640 1 -- 172.21.15.90:0/479776646 learned_addr learned my addr 172.21.15.90:0/479776646 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d2d9d640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d40ae4e0 0x7fb3d40ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.646+0000 7fb3d259c640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc0039b0 0x7fb3d414ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d1d9b640 1 -- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d40ae4e0 msgr2=0x7fb3d40ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d1d9b640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d40ae4e0 0x7fb3d40ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d1d9b640 1 -- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc0039b0 msgr2=0x7fb3d414ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d1d9b640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc0039b0 0x7fb3d414ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d1d9b640 1 -- 172.21.15.90:0/479776646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3d4154a80 con 0x7fb3d41ee300 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d259c640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc0039b0 0x7fb3d414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d1d9b640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3d41ee300 0x7fb3d413cc30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8007340 tx=0x7fb3c8007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/479776646 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c801a070 con 0x7fb3d41ee300 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/479776646 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3c800f8e0 con 0x7fb3d41ee300 2024-04-20T11:00:12.651 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3d41544c0 con 0x7fb3d41ee300 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/479776646 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3c800fcb0 con 0x7fb3d41ee300 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.647+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3d413d170 con 0x7fb3d41ee300 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.648+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3d4073ed0 con 0x7fb3d41ee300 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.649+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/479776646 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb3c801e3f0 con 0x7fb3d41ee300 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.649+0000 7fb3c2ffd640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb3b406c920 0x7fb3b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.649+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/479776646 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fb3c808ba00 con 0x7fb3d41ee300 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.649+0000 7fb3d259c640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb3b406c920 0x7fb3b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:12.652 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.650+0000 7fb3d259c640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb3b406c920 0x7fb3b406ede0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc036000 tx=0x7fb3cc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:12.653 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.653+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/479776646 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fb3d4073ed0 con 0x7fb3d41ee300 2024-04-20T11:00:12.830 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.830+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb3d4076150 con 0x7fb3b406c920 2024-04-20T11:00:12.840 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.840+0000 7fb3c2ffd640 1 -- 172.21.15.90:0/479776646 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+494060 (secure 0 0 0) 0x7fb3d4076150 con 0x7fb3b406c920 2024-04-20T11:00:12.846 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:12.849 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T11:00:12.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb3b406c920 msgr2=0x7fb3b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:12.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb3b406c920 0x7fb3b406ede0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc036000 tx=0x7fb3cc030000 comp rx=0 tx=0).stop 2024-04-20T11:00:12.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3d41ee300 msgr2=0x7fb3d413cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:12.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3d41ee300 0x7fb3d413cc30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fb3c8007340 tx=0x7fb3c8007800 comp rx=0 tx=0).stop 2024-04-20T11:00:12.851 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 shutdown_connections 2024-04-20T11:00:12.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fb3b406c920 0x7fb3b406ede0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fb3d40ae4e0 0x7fb3d40ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fb3d41ee300 0x7fb3d413cc30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 --2- 172.21.15.90:0/479776646 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fb3bc0039b0 0x7fb3d414ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:12.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 >> 172.21.15.90:0/479776646 conn(0x7fb3d40ca0a0 msgr2=0x7fb3d40c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:12.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.844+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 shutdown_connections 2024-04-20T11:00:12.852 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:12.845+0000 7fb3d8b85640 1 -- 172.21.15.90:0/479776646 wait complete. 2024-04-20T11:00:12.856 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":324,"stamp":"2024-04-20T11:00:11.814039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":301440141,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":12158,"num_read_kb":7850279,"num_write":64820,"num_write_kb":8966796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71729,"ondisk_log_size":71729,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1103760,"kb_used_data":592208,"kb_used_omap":12,"kb_used_meta":511475,"kb_avail":753870960,"statfs":{"total":773094113280,"available":771963863040,"internally_reserved":0,"allocated":606420992,"data_stored":604476882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":523750960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004063"},"pg_stats":[{"pgid":"5.18","version":"38'433","reported_seq":554,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.218061+0000","last_change":"2024-04-20T11:00:07.218087+0000","last_active":"2024-04-20T11:00:07.218061+0000","last_peered":"2024-04-20T11:00:07.218061+0000","last_clean":"2024-04-20T11:00:07.218061+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T11:00:07.218061+0000","last_undegraded":"2024-04-20T11:00:07.218061+0000","last_fullsized":"2024-04-20T11:00:07.218061+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'433","last_scrub_stamp":"2024-04-20T11:00:07.217973+0000","last_deep_scrub":"38'433","last_deep_scrub_stamp":"2024-04-20T11:00:07.217973+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.217973+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:07:54.082349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":22795,"num_write":399,"num_write_kb":54919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"38'88","reported_seq":164,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.287547+0000","last_change":"2024-04-20T10:59:55.287587+0000","last_active":"2024-04-20T10:59:55.287547+0000","last_peered":"2024-04-20T10:59:55.287547+0000","last_clean":"2024-04-20T10:59:55.287547+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:59:55.287547+0000","last_undegraded":"2024-04-20T10:59:55.287547+0000","last_fullsized":"2024-04-20T10:59:55.287547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'88","last_scrub_stamp":"2024-04-20T10:59:55.287453+0000","last_deep_scrub":"38'88","last_deep_scrub_stamp":"2024-04-20T10:59:55.287453+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.287453+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:15.631906+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":13987,"num_write":27,"num_write_kb":4118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"38'408","reported_seq":564,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.756053+0000","last_change":"2024-04-20T11:00:03.756078+0000","last_active":"2024-04-20T11:00:03.756053+0000","last_peered":"2024-04-20T11:00:03.756053+0000","last_clean":"2024-04-20T11:00:03.756053+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T11:00:03.756053+0000","last_undegraded":"2024-04-20T11:00:03.756053+0000","last_fullsized":"2024-04-20T11:00:03.756053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'408","last_scrub_stamp":"2024-04-20T11:00:03.755958+0000","last_deep_scrub":"38'408","last_deep_scrub_stamp":"2024-04-20T11:00:03.755958+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.755958+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:03:42.435032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":85574,"num_write":384,"num_write_kb":89655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"38'169","reported_seq":223,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.774806+0000","last_change":"2024-04-20T10:59:53.774851+0000","last_active":"2024-04-20T10:59:53.774806+0000","last_peered":"2024-04-20T10:59:53.774806+0000","last_clean":"2024-04-20T10:59:53.774806+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:59:53.774806+0000","last_undegraded":"2024-04-20T10:59:53.774806+0000","last_fullsized":"2024-04-20T10:59:53.774806+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'169","last_scrub_stamp":"2024-04-20T10:59:53.774697+0000","last_deep_scrub":"38'169","last_deep_scrub_stamp":"2024-04-20T10:59:53.774697+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.774697+0000","objects_scrubbed":1,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:57:37.863234+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"38'459","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.454928+0000","last_change":"2024-04-20T11:00:09.454957+0000","last_active":"2024-04-20T11:00:09.454928+0000","last_peered":"2024-04-20T11:00:09.454928+0000","last_clean":"2024-04-20T11:00:09.454928+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T11:00:09.454928+0000","last_undegraded":"2024-04-20T11:00:09.454928+0000","last_fullsized":"2024-04-20T11:00:09.454928+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'459","last_scrub_stamp":"2024-04-20T11:00:09.454826+0000","last_deep_scrub":"38'459","last_deep_scrub_stamp":"2024-04-20T11:00:09.454826+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.454826+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:49.769924+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":79973,"num_write":429,"num_write_kb":121385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"38'194","reported_seq":258,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.772588+0000","last_change":"2024-04-20T11:00:05.772622+0000","last_active":"2024-04-20T11:00:05.772588+0000","last_peered":"2024-04-20T11:00:05.772588+0000","last_clean":"2024-04-20T11:00:05.772588+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T11:00:05.772588+0000","last_undegraded":"2024-04-20T11:00:05.772588+0000","last_fullsized":"2024-04-20T11:00:05.772588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'194","last_scrub_stamp":"2024-04-20T11:00:05.772495+0000","last_deep_scrub":"38'194","last_deep_scrub_stamp":"2024-04-20T11:00:05.772495+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.772495+0000","objects_scrubbed":1,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:01:39.715885+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":130,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"37'359","reported_seq":485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.338790+0000","last_change":"2024-04-20T10:59:50.338832+0000","last_active":"2024-04-20T10:59:50.338790+0000","last_peered":"2024-04-20T10:59:50.338790+0000","last_clean":"2024-04-20T10:59:50.338790+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:59:50.338790+0000","last_undegraded":"2024-04-20T10:59:50.338790+0000","last_fullsized":"2024-04-20T10:59:50.338790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'359","last_scrub_stamp":"2024-04-20T10:59:50.338704+0000","last_deep_scrub":"37'359","last_deep_scrub_stamp":"2024-04-20T10:59:50.338704+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.338704+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:27:04.796609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":24250,"num_write":339,"num_write_kb":58188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"38'924","reported_seq":984,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.093594+0000","last_change":"2024-04-20T10:59:57.093652+0000","last_active":"2024-04-20T10:59:57.093594+0000","last_peered":"2024-04-20T10:59:57.093594+0000","last_clean":"2024-04-20T10:59:57.093594+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:59:57.093594+0000","last_undegraded":"2024-04-20T10:59:57.093594+0000","last_fullsized":"2024-04-20T10:59:57.093594+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'924","last_scrub_stamp":"2024-04-20T10:59:57.093480+0000","last_deep_scrub":"38'924","last_deep_scrub_stamp":"2024-04-20T10:59:57.093480+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.093480+0000","objects_scrubbed":2,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:06:55.311625+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":852,"num_write_kb":8691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"38'405","reported_seq":507,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.649055+0000","last_change":"2024-04-20T10:50:49.646860+0000","last_active":"2024-04-20T10:59:28.649055+0000","last_peered":"2024-04-20T10:59:28.649055+0000","last_clean":"2024-04-20T10:59:28.649055+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T10:59:28.649055+0000","last_undegraded":"2024-04-20T10:59:28.649055+0000","last_fullsized":"2024-04-20T10:59:28.649055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":43507,"num_write":372,"num_write_kb":54374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"38'375","reported_seq":453,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.846679+0000","last_change":"2024-04-20T11:00:05.846838+0000","last_active":"2024-04-20T11:00:05.846679+0000","last_peered":"2024-04-20T11:00:05.846679+0000","last_clean":"2024-04-20T11:00:05.846679+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T11:00:05.846679+0000","last_undegraded":"2024-04-20T11:00:05.846679+0000","last_fullsized":"2024-04-20T11:00:05.846679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T11:00:05.846582+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T11:00:05.846582+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.846582+0000","objects_scrubbed":4,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:28:53.576712+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":45077,"num_write":302,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'401","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.109337+0000","last_change":"2024-04-20T11:00:11.109373+0000","last_active":"2024-04-20T11:00:11.109337+0000","last_peered":"2024-04-20T11:00:11.109337+0000","last_clean":"2024-04-20T11:00:11.109337+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T11:00:11.109337+0000","last_undegraded":"2024-04-20T11:00:11.109337+0000","last_fullsized":"2024-04-20T11:00:11.109337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'401","last_scrub_stamp":"2024-04-20T11:00:11.109244+0000","last_deep_scrub":"37'401","last_deep_scrub_stamp":"2024-04-20T11:00:11.109244+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.109244+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:32:19.637911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":103995,"num_write":369,"num_write_kb":100717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"38'160","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.110605+0000","last_change":"2024-04-20T10:59:54.110645+0000","last_active":"2024-04-20T10:59:54.110605+0000","last_peered":"2024-04-20T10:59:54.110605+0000","last_clean":"2024-04-20T10:59:54.110605+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:59:54.110605+0000","last_undegraded":"2024-04-20T10:59:54.110605+0000","last_fullsized":"2024-04-20T10:59:54.110605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'160","last_scrub_stamp":"2024-04-20T10:59:54.110508+0000","last_deep_scrub":"38'160","last_deep_scrub_stamp":"2024-04-20T10:59:54.110508+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.110508+0000","objects_scrubbed":1,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:59:23.527874+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":20490,"num_write":105,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"38'368","reported_seq":475,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.401304+0000","last_change":"2024-04-20T10:50:49.649998+0000","last_active":"2024-04-20T10:59:30.401304+0000","last_peered":"2024-04-20T10:59:30.401304+0000","last_clean":"2024-04-20T10:59:30.401304+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T10:59:30.401304+0000","last_undegraded":"2024-04-20T10:59:30.401304+0000","last_fullsized":"2024-04-20T10:59:30.401304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":53969,"num_write":336,"num_write_kb":42442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"38'69","reported_seq":140,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.894813+0000","last_change":"2024-04-20T11:00:10.894850+0000","last_active":"2024-04-20T11:00:10.894813+0000","last_peered":"2024-04-20T11:00:10.894813+0000","last_clean":"2024-04-20T11:00:10.894813+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T11:00:10.894813+0000","last_undegraded":"2024-04-20T11:00:10.894813+0000","last_fullsized":"2024-04-20T11:00:10.894813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'69","last_scrub_stamp":"2024-04-20T11:00:10.894709+0000","last_deep_scrub":"38'69","last_deep_scrub_stamp":"2024-04-20T11:00:10.894709+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.894709+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:52:24.141490+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":8317,"num_write":19,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'375","reported_seq":510,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.117573+0000","last_change":"2024-04-20T11:00:10.117597+0000","last_active":"2024-04-20T11:00:10.117573+0000","last_peered":"2024-04-20T11:00:10.117573+0000","last_clean":"2024-04-20T11:00:10.117573+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T11:00:10.117573+0000","last_undegraded":"2024-04-20T11:00:10.117573+0000","last_fullsized":"2024-04-20T11:00:10.117573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T11:00:10.117479+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T11:00:10.117479+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.117479+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:54.717660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":27688,"num_write":341,"num_write_kb":72358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"38'662","reported_seq":724,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.113400+0000","last_change":"2024-04-20T10:59:51.113432+0000","last_active":"2024-04-20T10:59:51.113400+0000","last_peered":"2024-04-20T10:59:51.113400+0000","last_clean":"2024-04-20T10:59:51.113400+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:59:51.113400+0000","last_undegraded":"2024-04-20T10:59:51.113400+0000","last_fullsized":"2024-04-20T10:59:51.113400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'662","last_scrub_stamp":"2024-04-20T10:59:51.113312+0000","last_deep_scrub":"38'662","last_deep_scrub_stamp":"2024-04-20T10:59:51.113312+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.113312+0000","objects_scrubbed":3,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:48:48.384673+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36433,"num_write":605,"num_write_kb":12615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"38'446","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.414053+0000","last_change":"2024-04-20T11:00:10.414092+0000","last_active":"2024-04-20T11:00:10.414053+0000","last_peered":"2024-04-20T11:00:10.414053+0000","last_clean":"2024-04-20T11:00:10.414053+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T11:00:10.414053+0000","last_undegraded":"2024-04-20T11:00:10.414053+0000","last_fullsized":"2024-04-20T11:00:10.414053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'446","last_scrub_stamp":"2024-04-20T11:00:10.413966+0000","last_deep_scrub":"38'446","last_deep_scrub_stamp":"2024-04-20T11:00:10.413966+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.413966+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:11.720903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":68359,"num_write":412,"num_write_kb":83650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"38'451","reported_seq":610,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.100054+0000","last_change":"2024-04-20T10:59:55.100079+0000","last_active":"2024-04-20T10:59:55.100054+0000","last_peered":"2024-04-20T10:59:55.100054+0000","last_clean":"2024-04-20T10:59:55.100054+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:59:55.100054+0000","last_undegraded":"2024-04-20T10:59:55.100054+0000","last_fullsized":"2024-04-20T10:59:55.100054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T10:59:55.099962+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T10:59:55.099962+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.099962+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:58:11.379415+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":83011,"num_write":424,"num_write_kb":112568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"38'188","reported_seq":263,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.842689+0000","last_change":"2024-04-20T11:00:07.842726+0000","last_active":"2024-04-20T11:00:07.842689+0000","last_peered":"2024-04-20T11:00:07.842689+0000","last_clean":"2024-04-20T11:00:07.842689+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T11:00:07.842689+0000","last_undegraded":"2024-04-20T11:00:07.842689+0000","last_fullsized":"2024-04-20T11:00:07.842689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'188","last_scrub_stamp":"2024-04-20T11:00:07.842598+0000","last_deep_scrub":"38'188","last_deep_scrub_stamp":"2024-04-20T11:00:07.842598+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.842598+0000","objects_scrubbed":3,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:39:39.556733+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32778,"num_write":122,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"38'535","reported_seq":600,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.190163+0000","last_change":"2024-04-20T11:00:05.190195+0000","last_active":"2024-04-20T11:00:05.190163+0000","last_peered":"2024-04-20T11:00:05.190163+0000","last_clean":"2024-04-20T11:00:05.190163+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T11:00:05.190163+0000","last_undegraded":"2024-04-20T11:00:05.190163+0000","last_fullsized":"2024-04-20T11:00:05.190163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'535","last_scrub_stamp":"2024-04-20T11:00:05.190064+0000","last_deep_scrub":"38'535","last_deep_scrub_stamp":"2024-04-20T11:00:05.190064+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.190064+0000","objects_scrubbed":2,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:38:45.270222+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16463,"num_write":485,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'400","reported_seq":504,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.546523+0000","last_change":"2024-04-20T11:00:01.546550+0000","last_active":"2024-04-20T11:00:01.546523+0000","last_peered":"2024-04-20T11:00:01.546523+0000","last_clean":"2024-04-20T11:00:01.546523+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T11:00:01.546523+0000","last_undegraded":"2024-04-20T11:00:01.546523+0000","last_fullsized":"2024-04-20T11:00:01.546523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'400","last_scrub_stamp":"2024-04-20T11:00:01.546410+0000","last_deep_scrub":"36'400","last_deep_scrub_stamp":"2024-04-20T11:00:01.546410+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.546410+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:47:29.517681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":15248,"num_write":372,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"36'439","reported_seq":581,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:20.390816+0000","last_change":"2024-04-20T10:51:20.874303+0000","last_active":"2024-04-20T10:59:20.390816+0000","last_peered":"2024-04-20T10:59:20.390816+0000","last_clean":"2024-04-20T10:59:20.390816+0000","last_became_active":"2024-04-20T10:51:20.873593+0000","last_became_peered":"2024-04-20T10:51:20.873593+0000","last_unstale":"2024-04-20T10:59:20.390816+0000","last_undegraded":"2024-04-20T10:59:20.390816+0000","last_fullsized":"2024-04-20T10:59:20.390816+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":68460,"num_write":408,"num_write_kb":88214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"38'472","reported_seq":535,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.364470+0000","last_change":"2024-04-20T11:00:00.364502+0000","last_active":"2024-04-20T11:00:00.364470+0000","last_peered":"2024-04-20T11:00:00.364470+0000","last_clean":"2024-04-20T11:00:00.364470+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T11:00:00.364470+0000","last_undegraded":"2024-04-20T11:00:00.364470+0000","last_fullsized":"2024-04-20T11:00:00.364470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'472","last_scrub_stamp":"2024-04-20T11:00:00.364364+0000","last_deep_scrub":"38'472","last_deep_scrub_stamp":"2024-04-20T11:00:00.364364+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.364364+0000","objects_scrubbed":1,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:55:08.033565+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":415,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'54","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.103003+0000","last_change":"2024-04-20T10:59:52.103059+0000","last_active":"2024-04-20T10:59:52.103003+0000","last_peered":"2024-04-20T10:59:52.103003+0000","last_clean":"2024-04-20T10:59:52.103003+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:59:52.103003+0000","last_undegraded":"2024-04-20T10:59:52.103003+0000","last_fullsized":"2024-04-20T10:59:52.103003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'54","last_scrub_stamp":"2024-04-20T10:59:52.102894+0000","last_deep_scrub":"38'54","last_deep_scrub_stamp":"2024-04-20T10:59:52.102894+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.102894+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:53.820701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"38'386","reported_seq":495,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.844534+0000","last_change":"2024-04-20T10:50:49.650317+0000","last_active":"2024-04-20T10:59:50.844534+0000","last_peered":"2024-04-20T10:59:50.844534+0000","last_clean":"2024-04-20T10:59:50.844534+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T10:59:50.844534+0000","last_undegraded":"2024-04-20T10:59:50.844534+0000","last_fullsized":"2024-04-20T10:59:50.844534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":51447,"num_write":355,"num_write_kb":79846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'408","reported_seq":545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.796003+0000","last_change":"2024-04-20T11:00:10.796028+0000","last_active":"2024-04-20T11:00:10.796003+0000","last_peered":"2024-04-20T11:00:10.796003+0000","last_clean":"2024-04-20T11:00:10.796003+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T11:00:10.796003+0000","last_undegraded":"2024-04-20T11:00:10.796003+0000","last_fullsized":"2024-04-20T11:00:10.796003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'408","last_scrub_stamp":"2024-04-20T11:00:10.795884+0000","last_deep_scrub":"36'408","last_deep_scrub_stamp":"2024-04-20T11:00:10.795884+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.795884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:17:30.862108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":28672,"num_write":368,"num_write_kb":66779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"38'261","reported_seq":323,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.354442+0000","last_change":"2024-04-20T10:59:59.354478+0000","last_active":"2024-04-20T10:59:59.354442+0000","last_peered":"2024-04-20T10:59:59.354442+0000","last_clean":"2024-04-20T10:59:59.354442+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:59:59.354442+0000","last_undegraded":"2024-04-20T10:59:59.354442+0000","last_fullsized":"2024-04-20T10:59:59.354442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'261","last_scrub_stamp":"2024-04-20T10:59:59.354351+0000","last_deep_scrub":"38'261","last_deep_scrub_stamp":"2024-04-20T10:59:59.354351+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.354351+0000","objects_scrubbed":1,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:31.725896+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":207,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"38'294","reported_seq":356,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.579856+0000","last_change":"2024-04-20T10:59:51.579856+0000","last_active":"2024-04-20T10:59:51.579856+0000","last_peered":"2024-04-20T10:59:51.579856+0000","last_clean":"2024-04-20T10:59:51.579856+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:59:51.579856+0000","last_undegraded":"2024-04-20T10:59:51.579856+0000","last_fullsized":"2024-04-20T10:59:51.579856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'294","last_scrub_stamp":"2024-04-20T10:59:51.579708+0000","last_deep_scrub":"38'294","last_deep_scrub_stamp":"2024-04-20T10:59:51.579708+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.579708+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:58.562988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":243,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"38'417","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.277864+0000","last_change":"2024-04-20T10:50:49.650731+0000","last_active":"2024-04-20T10:59:51.277864+0000","last_peered":"2024-04-20T10:59:51.277864+0000","last_clean":"2024-04-20T10:59:51.277864+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T10:59:51.277864+0000","last_undegraded":"2024-04-20T10:59:51.277864+0000","last_fullsized":"2024-04-20T10:59:51.277864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":59672,"num_write":383,"num_write_kb":87983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"38'464","reported_seq":627,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.065500+0000","last_change":"2024-04-20T11:00:01.065545+0000","last_active":"2024-04-20T11:00:01.065500+0000","last_peered":"2024-04-20T11:00:01.065500+0000","last_clean":"2024-04-20T11:00:01.065500+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T11:00:01.065500+0000","last_undegraded":"2024-04-20T11:00:01.065500+0000","last_fullsized":"2024-04-20T11:00:01.065500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'464","last_scrub_stamp":"2024-04-20T11:00:01.065375+0000","last_deep_scrub":"38'464","last_deep_scrub_stamp":"2024-04-20T11:00:01.065375+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.065375+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:36:39.658886+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":46635,"num_write":434,"num_write_kb":47131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"38'430","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.851600+0000","last_change":"2024-04-20T11:00:09.851631+0000","last_active":"2024-04-20T11:00:09.851600+0000","last_peered":"2024-04-20T11:00:09.851600+0000","last_clean":"2024-04-20T11:00:09.851600+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T11:00:09.851600+0000","last_undegraded":"2024-04-20T11:00:09.851600+0000","last_fullsized":"2024-04-20T11:00:09.851600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'430","last_scrub_stamp":"2024-04-20T11:00:09.851508+0000","last_deep_scrub":"38'430","last_deep_scrub_stamp":"2024-04-20T11:00:09.851508+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.851508+0000","objects_scrubbed":1,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:16:19.018811+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":373,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"38'507","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.136878+0000","last_change":"2024-04-20T10:59:53.136911+0000","last_active":"2024-04-20T10:59:53.136878+0000","last_peered":"2024-04-20T10:59:53.136878+0000","last_clean":"2024-04-20T10:59:53.136878+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:59:53.136878+0000","last_undegraded":"2024-04-20T10:59:53.136878+0000","last_fullsized":"2024-04-20T10:59:53.136878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'507","last_scrub_stamp":"2024-04-20T10:59:53.136772+0000","last_deep_scrub":"38'507","last_deep_scrub_stamp":"2024-04-20T10:59:53.136772+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.136772+0000","objects_scrubbed":2,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:27:59.138589+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":12324,"num_write":451,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"38'428","reported_seq":553,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.642427+0000","last_change":"2024-04-20T10:50:49.655493+0000","last_active":"2024-04-20T10:59:28.642427+0000","last_peered":"2024-04-20T10:59:28.642427+0000","last_clean":"2024-04-20T10:59:28.642427+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T10:59:28.642427+0000","last_undegraded":"2024-04-20T10:59:28.642427+0000","last_fullsized":"2024-04-20T10:59:28.642427+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70222,"num_write":390,"num_write_kb":75460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"38'430","reported_seq":581,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.270236+0000","last_change":"2024-04-20T10:59:57.270293+0000","last_active":"2024-04-20T10:59:57.270236+0000","last_peered":"2024-04-20T10:59:57.270236+0000","last_clean":"2024-04-20T10:59:57.270236+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:59:57.270236+0000","last_undegraded":"2024-04-20T10:59:57.270236+0000","last_fullsized":"2024-04-20T10:59:57.270236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'430","last_scrub_stamp":"2024-04-20T10:59:57.270130+0000","last_deep_scrub":"38'430","last_deep_scrub_stamp":"2024-04-20T10:59:57.270130+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.270130+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:55:26.189665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":26226,"num_write":396,"num_write_kb":42836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"38'179","reported_seq":249,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.101291+0000","last_change":"2024-04-20T10:59:56.101348+0000","last_active":"2024-04-20T10:59:56.101291+0000","last_peered":"2024-04-20T10:59:56.101291+0000","last_clean":"2024-04-20T10:59:56.101291+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:59:56.101291+0000","last_undegraded":"2024-04-20T10:59:56.101291+0000","last_fullsized":"2024-04-20T10:59:56.101291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'179","last_scrub_stamp":"2024-04-20T10:59:56.101173+0000","last_deep_scrub":"38'179","last_deep_scrub_stamp":"2024-04-20T10:59:56.101173+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.101173+0000","objects_scrubbed":2,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:27:10.598533+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2765636,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":2215,"num_write":122,"num_write_kb":2774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"38'354","reported_seq":690,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.134538+0000","last_change":"2024-04-20T11:00:04.134569+0000","last_active":"2024-04-20T11:00:04.134538+0000","last_peered":"2024-04-20T11:00:04.134538+0000","last_clean":"2024-04-20T11:00:04.134538+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T11:00:04.134538+0000","last_undegraded":"2024-04-20T11:00:04.134538+0000","last_fullsized":"2024-04-20T11:00:04.134538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'354","last_scrub_stamp":"2024-04-20T11:00:04.134439+0000","last_deep_scrub":"38'354","last_deep_scrub_stamp":"2024-04-20T11:00:04.134439+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.134439+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:19:15.768797+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465101,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":1621,"num_write":296,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'403","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.244820+0000","last_change":"2024-04-20T11:00:09.244861+0000","last_active":"2024-04-20T11:00:09.244820+0000","last_peered":"2024-04-20T11:00:09.244820+0000","last_clean":"2024-04-20T11:00:09.244820+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T11:00:09.244820+0000","last_undegraded":"2024-04-20T11:00:09.244820+0000","last_fullsized":"2024-04-20T11:00:09.244820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'403","last_scrub_stamp":"2024-04-20T11:00:09.244717+0000","last_deep_scrub":"38'403","last_deep_scrub_stamp":"2024-04-20T11:00:09.244717+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.244717+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:55.286313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":84919,"num_write":363,"num_write_kb":88226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"38'351","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.768921+0000","last_change":"2024-04-20T11:00:09.768950+0000","last_active":"2024-04-20T11:00:09.768921+0000","last_peered":"2024-04-20T11:00:09.768921+0000","last_clean":"2024-04-20T11:00:09.768921+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T11:00:09.768921+0000","last_undegraded":"2024-04-20T11:00:09.768921+0000","last_fullsized":"2024-04-20T11:00:09.768921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'351","last_scrub_stamp":"2024-04-20T11:00:09.768811+0000","last_deep_scrub":"38'351","last_deep_scrub_stamp":"2024-04-20T11:00:09.768811+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.768811+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:13.137846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":41830,"num_write":332,"num_write_kb":50578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"38'368","reported_seq":439,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.390788+0000","last_change":"2024-04-20T11:00:03.390816+0000","last_active":"2024-04-20T11:00:03.390788+0000","last_peered":"2024-04-20T11:00:03.390788+0000","last_clean":"2024-04-20T11:00:03.390788+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T11:00:03.390788+0000","last_undegraded":"2024-04-20T11:00:03.390788+0000","last_fullsized":"2024-04-20T11:00:03.390788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'368","last_scrub_stamp":"2024-04-20T11:00:03.390669+0000","last_deep_scrub":"38'368","last_deep_scrub_stamp":"2024-04-20T11:00:03.390669+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.390669+0000","objects_scrubbed":1,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:24.356772+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":432,"num_write":707,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"38'201","reported_seq":267,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.804909+0000","last_change":"2024-04-20T10:59:58.804975+0000","last_active":"2024-04-20T10:59:58.804909+0000","last_peered":"2024-04-20T10:59:58.804909+0000","last_clean":"2024-04-20T10:59:58.804909+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:59:58.804909+0000","last_undegraded":"2024-04-20T10:59:58.804909+0000","last_fullsized":"2024-04-20T10:59:58.804909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'201","last_scrub_stamp":"2024-04-20T10:59:58.804789+0000","last_deep_scrub":"38'201","last_deep_scrub_stamp":"2024-04-20T10:59:58.804789+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.804789+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:05:23.925821+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":41717,"num_write":141,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"38'382","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.012433+0000","last_change":"2024-04-20T11:00:09.012482+0000","last_active":"2024-04-20T11:00:09.012433+0000","last_peered":"2024-04-20T11:00:09.012433+0000","last_clean":"2024-04-20T11:00:09.012433+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T11:00:09.012433+0000","last_undegraded":"2024-04-20T11:00:09.012433+0000","last_fullsized":"2024-04-20T11:00:09.012433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'382","last_scrub_stamp":"2024-04-20T11:00:09.012307+0000","last_deep_scrub":"38'382","last_deep_scrub_stamp":"2024-04-20T11:00:09.012307+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.012307+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:54.619492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36954,"num_write":352,"num_write_kb":63166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"38'440","reported_seq":596,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.546265+0000","last_change":"2024-04-20T10:59:52.546310+0000","last_active":"2024-04-20T10:59:52.546265+0000","last_peered":"2024-04-20T10:59:52.546265+0000","last_clean":"2024-04-20T10:59:52.546265+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:59:52.546265+0000","last_undegraded":"2024-04-20T10:59:52.546265+0000","last_fullsized":"2024-04-20T10:59:52.546265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'440","last_scrub_stamp":"2024-04-20T10:59:52.546182+0000","last_deep_scrub":"38'440","last_deep_scrub_stamp":"2024-04-20T10:59:52.546182+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.546182+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:24:57.003888+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":92391,"num_write":411,"num_write_kb":121276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"38'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.854038+0000","last_change":"2024-04-20T11:00:06.854134+0000","last_active":"2024-04-20T11:00:06.854038+0000","last_peered":"2024-04-20T11:00:06.854038+0000","last_clean":"2024-04-20T11:00:06.854038+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T11:00:06.854038+0000","last_undegraded":"2024-04-20T11:00:06.854038+0000","last_fullsized":"2024-04-20T11:00:06.854038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'117","last_scrub_stamp":"2024-04-20T11:00:06.853945+0000","last_deep_scrub":"38'117","last_deep_scrub_stamp":"2024-04-20T11:00:06.853945+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.853945+0000","objects_scrubbed":1,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:04:34.697989+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":47,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"38'72","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.423948+0000","last_change":"2024-04-20T11:00:03.423973+0000","last_active":"2024-04-20T11:00:03.423948+0000","last_peered":"2024-04-20T11:00:03.423948+0000","last_clean":"2024-04-20T11:00:03.423948+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T11:00:03.423948+0000","last_undegraded":"2024-04-20T11:00:03.423948+0000","last_fullsized":"2024-04-20T11:00:03.423948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'72","last_scrub_stamp":"2024-04-20T11:00:03.423848+0000","last_deep_scrub":"38'72","last_deep_scrub_stamp":"2024-04-20T11:00:03.423848+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.423848+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:34:13.977628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"38'388","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.536750+0000","last_change":"2024-04-20T11:00:06.536773+0000","last_active":"2024-04-20T11:00:06.536750+0000","last_peered":"2024-04-20T11:00:06.536750+0000","last_clean":"2024-04-20T11:00:06.536750+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T11:00:06.536750+0000","last_undegraded":"2024-04-20T11:00:06.536750+0000","last_fullsized":"2024-04-20T11:00:06.536750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'388","last_scrub_stamp":"2024-04-20T11:00:06.536668+0000","last_deep_scrub":"38'388","last_deep_scrub_stamp":"2024-04-20T11:00:06.536668+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.536668+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:39.354243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":31459,"num_write":347,"num_write_kb":38414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"38'421","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.279733+0000","last_change":"2024-04-20T10:59:52.279779+0000","last_active":"2024-04-20T10:59:52.279733+0000","last_peered":"2024-04-20T10:59:52.279733+0000","last_clean":"2024-04-20T10:59:52.279733+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:59:52.279733+0000","last_undegraded":"2024-04-20T10:59:52.279733+0000","last_fullsized":"2024-04-20T10:59:52.279733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'421","last_scrub_stamp":"2024-04-20T10:59:52.279633+0000","last_deep_scrub":"38'421","last_deep_scrub_stamp":"2024-04-20T10:59:52.279633+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.279633+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:26:35.681741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":53960,"num_write":380,"num_write_kb":46448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"37'59","reported_seq":120,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.370033+0000","last_change":"2024-04-20T11:00:02.370061+0000","last_active":"2024-04-20T11:00:02.370033+0000","last_peered":"2024-04-20T11:00:02.370033+0000","last_clean":"2024-04-20T11:00:02.370033+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T11:00:02.370033+0000","last_undegraded":"2024-04-20T11:00:02.370033+0000","last_fullsized":"2024-04-20T11:00:02.370033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'59","last_scrub_stamp":"2024-04-20T11:00:02.369925+0000","last_deep_scrub":"37'59","last_deep_scrub_stamp":"2024-04-20T11:00:02.369925+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.369925+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:14:07.291337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"38'623","reported_seq":688,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.543990+0000","last_change":"2024-04-20T10:59:53.544025+0000","last_active":"2024-04-20T10:59:53.543990+0000","last_peered":"2024-04-20T10:59:53.543990+0000","last_clean":"2024-04-20T10:59:53.543990+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:59:53.543990+0000","last_undegraded":"2024-04-20T10:59:53.543990+0000","last_fullsized":"2024-04-20T10:59:53.543990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'623","last_scrub_stamp":"2024-04-20T10:59:53.543914+0000","last_deep_scrub":"38'623","last_deep_scrub_stamp":"2024-04-20T10:59:53.543914+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.543914+0000","objects_scrubbed":2,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:24.546082+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":37014,"num_write":557,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"38'440","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.411085+0000","last_change":"2024-04-20T10:50:49.650034+0000","last_active":"2024-04-20T10:59:30.411085+0000","last_peered":"2024-04-20T10:59:30.411085+0000","last_clean":"2024-04-20T10:59:30.411085+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T10:59:30.411085+0000","last_undegraded":"2024-04-20T10:59:30.411085+0000","last_fullsized":"2024-04-20T10:59:30.411085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":72557,"num_write":399,"num_write_kb":79896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"37'409","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.028184+0000","last_change":"2024-04-20T11:00:00.028210+0000","last_active":"2024-04-20T11:00:00.028184+0000","last_peered":"2024-04-20T11:00:00.028184+0000","last_clean":"2024-04-20T11:00:00.028184+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T11:00:00.028184+0000","last_undegraded":"2024-04-20T11:00:00.028184+0000","last_fullsized":"2024-04-20T11:00:00.028184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'409","last_scrub_stamp":"2024-04-20T11:00:00.028089+0000","last_deep_scrub":"37'409","last_deep_scrub_stamp":"2024-04-20T11:00:00.028089+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.028089+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:12.522341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69573,"num_write":375,"num_write_kb":88218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"38'603","reported_seq":670,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.279004+0000","last_change":"2024-04-20T11:00:05.279039+0000","last_active":"2024-04-20T11:00:05.279004+0000","last_peered":"2024-04-20T11:00:05.279004+0000","last_clean":"2024-04-20T11:00:05.279004+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T11:00:05.279004+0000","last_undegraded":"2024-04-20T11:00:05.279004+0000","last_fullsized":"2024-04-20T11:00:05.279004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'603","last_scrub_stamp":"2024-04-20T11:00:05.278916+0000","last_deep_scrub":"38'603","last_deep_scrub_stamp":"2024-04-20T11:00:05.278916+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.278916+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:16:31.426140+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":551,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"38'74","reported_seq":128,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.614200+0000","last_change":"2024-04-20T10:59:49.614221+0000","last_active":"2024-04-20T10:59:49.614200+0000","last_peered":"2024-04-20T10:59:49.614200+0000","last_clean":"2024-04-20T10:59:49.614200+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:59:49.614200+0000","last_undegraded":"2024-04-20T10:59:49.614200+0000","last_fullsized":"2024-04-20T10:59:49.614200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-04-20T10:59:49.614120+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-04-20T10:59:49.614120+0000","last_clean_scrub_stamp":"2024-04-20T10:59:49.614120+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:03.239494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"38'423","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.532569+0000","last_change":"2024-04-20T11:00:04.532615+0000","last_active":"2024-04-20T11:00:04.532569+0000","last_peered":"2024-04-20T11:00:04.532569+0000","last_clean":"2024-04-20T11:00:04.532569+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T11:00:04.532569+0000","last_undegraded":"2024-04-20T11:00:04.532569+0000","last_fullsized":"2024-04-20T11:00:04.532569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T11:00:04.532453+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T11:00:04.532453+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.532453+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:45:32.627311+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56610,"num_write":400,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'384","reported_seq":511,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.415527+0000","last_change":"2024-04-20T11:00:06.415569+0000","last_active":"2024-04-20T11:00:06.415527+0000","last_peered":"2024-04-20T11:00:06.415527+0000","last_clean":"2024-04-20T11:00:06.415527+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T11:00:06.415527+0000","last_undegraded":"2024-04-20T11:00:06.415527+0000","last_fullsized":"2024-04-20T11:00:06.415527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'384","last_scrub_stamp":"2024-04-20T11:00:06.415389+0000","last_deep_scrub":"37'384","last_deep_scrub_stamp":"2024-04-20T11:00:06.415389+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.415389+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:22.059474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":325,"num_write":350,"num_write_kb":17356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"38'354","reported_seq":708,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.506502+0000","last_change":"2024-04-20T10:59:51.506525+0000","last_active":"2024-04-20T10:59:51.506502+0000","last_peered":"2024-04-20T10:59:51.506502+0000","last_clean":"2024-04-20T10:59:51.506502+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:59:51.506502+0000","last_undegraded":"2024-04-20T10:59:51.506502+0000","last_fullsized":"2024-04-20T10:59:51.506502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'354","last_scrub_stamp":"2024-04-20T10:59:51.506417+0000","last_deep_scrub":"38'354","last_deep_scrub_stamp":"2024-04-20T10:59:51.506417+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.506417+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:26:01.369153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":293,"num_read_kb":1639,"num_write":299,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"38'137","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.498658+0000","last_change":"2024-04-20T10:59:55.498694+0000","last_active":"2024-04-20T10:59:55.498658+0000","last_peered":"2024-04-20T10:59:55.498658+0000","last_clean":"2024-04-20T10:59:55.498658+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:59:55.498658+0000","last_undegraded":"2024-04-20T10:59:55.498658+0000","last_fullsized":"2024-04-20T10:59:55.498658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'137","last_scrub_stamp":"2024-04-20T10:59:55.498552+0000","last_deep_scrub":"38'137","last_deep_scrub_stamp":"2024-04-20T10:59:55.498552+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.498552+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:56:11.346948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532638,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":994,"num_write":83,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'363","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.798010+0000","last_change":"2024-04-20T10:50:49.650511+0000","last_active":"2024-04-20T10:59:31.798010+0000","last_peered":"2024-04-20T10:59:31.798010+0000","last_clean":"2024-04-20T10:59:31.798010+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T10:59:31.798010+0000","last_undegraded":"2024-04-20T10:59:31.798010+0000","last_fullsized":"2024-04-20T10:59:31.798010+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56669,"num_write":337,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"38'414","reported_seq":569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.350004+0000","last_change":"2024-04-20T10:59:51.350026+0000","last_active":"2024-04-20T10:59:51.350004+0000","last_peered":"2024-04-20T10:59:51.350004+0000","last_clean":"2024-04-20T10:59:51.350004+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:59:51.350004+0000","last_undegraded":"2024-04-20T10:59:51.350004+0000","last_fullsized":"2024-04-20T10:59:51.350004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'414","last_scrub_stamp":"2024-04-20T10:59:51.349917+0000","last_deep_scrub":"38'414","last_deep_scrub_stamp":"2024-04-20T10:59:51.349917+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.349917+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:34.711226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":100333,"num_write":376,"num_write_kb":104385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"38'125","reported_seq":195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.814410+0000","last_change":"2024-04-20T11:00:08.814443+0000","last_active":"2024-04-20T11:00:08.814410+0000","last_peered":"2024-04-20T11:00:08.814410+0000","last_clean":"2024-04-20T11:00:08.814410+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T11:00:08.814410+0000","last_undegraded":"2024-04-20T11:00:08.814410+0000","last_fullsized":"2024-04-20T11:00:08.814410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'125","last_scrub_stamp":"2024-04-20T11:00:08.814318+0000","last_deep_scrub":"38'125","last_deep_scrub_stamp":"2024-04-20T11:00:08.814318+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.814318+0000","objects_scrubbed":2,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:01:37.055727+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":57,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"38'367","reported_seq":431,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.462612+0000","last_change":"2024-04-20T11:00:04.462677+0000","last_active":"2024-04-20T11:00:04.462612+0000","last_peered":"2024-04-20T11:00:04.462612+0000","last_clean":"2024-04-20T11:00:04.462612+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T11:00:04.462612+0000","last_undegraded":"2024-04-20T11:00:04.462612+0000","last_fullsized":"2024-04-20T11:00:04.462612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'367","last_scrub_stamp":"2024-04-20T11:00:04.462441+0000","last_deep_scrub":"38'367","last_deep_scrub_stamp":"2024-04-20T11:00:04.462441+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.462441+0000","objects_scrubbed":1,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:50:00.656343+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":373,"num_write":706,"num_write_kb":1825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"38'374","reported_seq":475,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.405516+0000","last_change":"2024-04-20T10:50:49.645618+0000","last_active":"2024-04-20T10:59:30.405516+0000","last_peered":"2024-04-20T10:59:30.405516+0000","last_clean":"2024-04-20T10:59:30.405516+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T10:59:30.405516+0000","last_undegraded":"2024-04-20T10:59:30.405516+0000","last_fullsized":"2024-04-20T10:59:30.405516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23979,"num_write":342,"num_write_kb":50629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"38'375","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.752971+0000","last_change":"2024-04-20T10:59:57.752999+0000","last_active":"2024-04-20T10:59:57.752971+0000","last_peered":"2024-04-20T10:59:57.752971+0000","last_clean":"2024-04-20T10:59:57.752971+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:59:57.752971+0000","last_undegraded":"2024-04-20T10:59:57.752971+0000","last_fullsized":"2024-04-20T10:59:57.752971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T10:59:57.752817+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T10:59:57.752817+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.752817+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:08:56.105568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32768,"num_write":345,"num_write_kb":58807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"38'72","reported_seq":133,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.187291+0000","last_change":"2024-04-20T11:00:07.187317+0000","last_active":"2024-04-20T11:00:07.187291+0000","last_peered":"2024-04-20T11:00:07.187291+0000","last_clean":"2024-04-20T11:00:07.187291+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T11:00:07.187291+0000","last_undegraded":"2024-04-20T11:00:07.187291+0000","last_fullsized":"2024-04-20T11:00:07.187291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'72","last_scrub_stamp":"2024-04-20T11:00:07.187185+0000","last_deep_scrub":"38'72","last_deep_scrub_stamp":"2024-04-20T11:00:07.187185+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.187185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:36.814690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"38'119","reported_seq":219,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.801830+0000","last_change":"2024-04-20T11:00:04.801897+0000","last_active":"2024-04-20T11:00:04.801830+0000","last_peered":"2024-04-20T11:00:04.801830+0000","last_clean":"2024-04-20T11:00:04.801830+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T11:00:04.801830+0000","last_undegraded":"2024-04-20T11:00:04.801830+0000","last_fullsized":"2024-04-20T11:00:04.801830+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2024-04-20T11:00:04.801680+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2024-04-20T11:00:04.801680+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.801680+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:25:14.875504+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"38'103","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.013346+0000","last_change":"2024-04-20T11:00:04.013419+0000","last_active":"2024-04-20T11:00:04.013346+0000","last_peered":"2024-04-20T11:00:04.013346+0000","last_clean":"2024-04-20T11:00:04.013346+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T11:00:04.013346+0000","last_undegraded":"2024-04-20T11:00:04.013346+0000","last_fullsized":"2024-04-20T11:00:04.013346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'103","last_scrub_stamp":"2024-04-20T11:00:04.013233+0000","last_deep_scrub":"38'103","last_deep_scrub_stamp":"2024-04-20T11:00:04.013233+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.013233+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:49:54.858203+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"38'445","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.557688+0000","last_change":"2024-04-20T11:00:03.557716+0000","last_active":"2024-04-20T11:00:03.557688+0000","last_peered":"2024-04-20T11:00:03.557688+0000","last_clean":"2024-04-20T11:00:03.557688+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T11:00:03.557688+0000","last_undegraded":"2024-04-20T11:00:03.557688+0000","last_fullsized":"2024-04-20T11:00:03.557688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'445","last_scrub_stamp":"2024-04-20T11:00:03.557591+0000","last_deep_scrub":"38'445","last_deep_scrub_stamp":"2024-04-20T11:00:03.557591+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.557591+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:32.598608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":88903,"num_write":409,"num_write_kb":92640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'412","reported_seq":568,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.869345+0000","last_change":"2024-04-20T10:59:55.869375+0000","last_active":"2024-04-20T10:59:55.869345+0000","last_peered":"2024-04-20T10:59:55.869345+0000","last_clean":"2024-04-20T10:59:55.869345+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:59:55.869345+0000","last_undegraded":"2024-04-20T10:59:55.869345+0000","last_fullsized":"2024-04-20T10:59:55.869345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'412","last_scrub_stamp":"2024-04-20T10:59:55.869244+0000","last_deep_scrub":"36'412","last_deep_scrub_stamp":"2024-04-20T10:59:55.869244+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.869244+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:57:06.366604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53899,"num_write":383,"num_write_kb":39701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"37'57","reported_seq":118,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.457513+0000","last_change":"2024-04-20T10:59:54.457562+0000","last_active":"2024-04-20T10:59:54.457513+0000","last_peered":"2024-04-20T10:59:54.457513+0000","last_clean":"2024-04-20T10:59:54.457513+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:59:54.457513+0000","last_undegraded":"2024-04-20T10:59:54.457513+0000","last_fullsized":"2024-04-20T10:59:54.457513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'57","last_scrub_stamp":"2024-04-20T10:59:54.457404+0000","last_deep_scrub":"37'57","last_deep_scrub_stamp":"2024-04-20T10:59:54.457404+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.457404+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:55:12.499789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"38'250","reported_seq":307,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.013456+0000","last_change":"2024-04-20T11:00:05.013502+0000","last_active":"2024-04-20T11:00:05.013456+0000","last_peered":"2024-04-20T11:00:05.013456+0000","last_clean":"2024-04-20T11:00:05.013456+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T11:00:05.013456+0000","last_undegraded":"2024-04-20T11:00:05.013456+0000","last_fullsized":"2024-04-20T11:00:05.013456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'250","last_scrub_stamp":"2024-04-20T11:00:05.013332+0000","last_deep_scrub":"38'250","last_deep_scrub_stamp":"2024-04-20T11:00:05.013332+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.013332+0000","objects_scrubbed":1,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:56:01.424402+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":11663,"num_write":185,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"38'444","reported_seq":582,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.523290+0000","last_change":"2024-04-20T10:59:58.523341+0000","last_active":"2024-04-20T10:59:58.523290+0000","last_peered":"2024-04-20T10:59:58.523290+0000","last_clean":"2024-04-20T10:59:58.523290+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:59:58.523290+0000","last_undegraded":"2024-04-20T10:59:58.523290+0000","last_fullsized":"2024-04-20T10:59:58.523290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'444","last_scrub_stamp":"2024-04-20T10:59:58.523190+0000","last_deep_scrub":"38'444","last_deep_scrub_stamp":"2024-04-20T10:59:58.523190+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.523190+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:21:23.245222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":74093,"num_write":415,"num_write_kb":112646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"38'451","reported_seq":592,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.295189+0000","last_change":"2024-04-20T10:59:53.295216+0000","last_active":"2024-04-20T10:59:53.295189+0000","last_peered":"2024-04-20T10:59:53.295189+0000","last_clean":"2024-04-20T10:59:53.295189+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:59:53.295189+0000","last_undegraded":"2024-04-20T10:59:53.295189+0000","last_fullsized":"2024-04-20T10:59:53.295189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T10:59:53.295100+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T10:59:53.295100+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.295100+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:56.335634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":13128,"num_write":408,"num_write_kb":42612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"38'468","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.358572+0000","last_change":"2024-04-20T11:00:01.358602+0000","last_active":"2024-04-20T11:00:01.358572+0000","last_peered":"2024-04-20T11:00:01.358572+0000","last_clean":"2024-04-20T11:00:01.358572+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T11:00:01.358572+0000","last_undegraded":"2024-04-20T11:00:01.358572+0000","last_fullsized":"2024-04-20T11:00:01.358572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'468","last_scrub_stamp":"2024-04-20T11:00:01.358458+0000","last_deep_scrub":"38'468","last_deep_scrub_stamp":"2024-04-20T11:00:01.358458+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.358458+0000","objects_scrubbed":2,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:10.128118+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12293,"num_write":417,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"38'257","reported_seq":324,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.370618+0000","last_change":"2024-04-20T10:59:52.370673+0000","last_active":"2024-04-20T10:59:52.370618+0000","last_peered":"2024-04-20T10:59:52.370618+0000","last_clean":"2024-04-20T10:59:52.370618+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:59:52.370618+0000","last_undegraded":"2024-04-20T10:59:52.370618+0000","last_fullsized":"2024-04-20T10:59:52.370618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'257","last_scrub_stamp":"2024-04-20T10:59:52.370514+0000","last_deep_scrub":"38'257","last_deep_scrub_stamp":"2024-04-20T10:59:52.370514+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.370514+0000","objects_scrubbed":3,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:06:22.716080+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":192,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"38'448","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.870357+0000","last_change":"2024-04-20T11:00:00.870401+0000","last_active":"2024-04-20T11:00:00.870357+0000","last_peered":"2024-04-20T11:00:00.870357+0000","last_clean":"2024-04-20T11:00:00.870357+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T11:00:00.870357+0000","last_undegraded":"2024-04-20T11:00:00.870357+0000","last_fullsized":"2024-04-20T11:00:00.870357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'448","last_scrub_stamp":"2024-04-20T11:00:00.870253+0000","last_deep_scrub":"38'448","last_deep_scrub_stamp":"2024-04-20T11:00:00.870253+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.870253+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:36:33.578828+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28672,"num_write":415,"num_write_kb":38311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"38'377","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.823510+0000","last_change":"2024-04-20T10:59:54.823535+0000","last_active":"2024-04-20T10:59:54.823510+0000","last_peered":"2024-04-20T10:59:54.823510+0000","last_clean":"2024-04-20T10:59:54.823510+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:59:54.823510+0000","last_undegraded":"2024-04-20T10:59:54.823510+0000","last_fullsized":"2024-04-20T10:59:54.823510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'377","last_scrub_stamp":"2024-04-20T10:59:54.823418+0000","last_deep_scrub":"38'377","last_deep_scrub_stamp":"2024-04-20T10:59:54.823418+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.823418+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:52:09.857154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":24736,"num_write":347,"num_write_kb":38102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"38'417","reported_seq":488,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.518151+0000","last_change":"2024-04-20T10:59:52.518178+0000","last_active":"2024-04-20T10:59:52.518151+0000","last_peered":"2024-04-20T10:59:52.518151+0000","last_clean":"2024-04-20T10:59:52.518151+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:59:52.518151+0000","last_undegraded":"2024-04-20T10:59:52.518151+0000","last_fullsized":"2024-04-20T10:59:52.518151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'417","last_scrub_stamp":"2024-04-20T10:59:52.518077+0000","last_deep_scrub":"38'417","last_deep_scrub_stamp":"2024-04-20T10:59:52.518077+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.518077+0000","objects_scrubbed":2,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:56.267575+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":12309,"num_write":370,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"38'500","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.349495+0000","last_change":"2024-04-20T10:59:58.349529+0000","last_active":"2024-04-20T10:59:58.349495+0000","last_peered":"2024-04-20T10:59:58.349495+0000","last_clean":"2024-04-20T10:59:58.349495+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:59:58.349495+0000","last_undegraded":"2024-04-20T10:59:58.349495+0000","last_fullsized":"2024-04-20T10:59:58.349495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'500","last_scrub_stamp":"2024-04-20T10:59:58.349410+0000","last_deep_scrub":"38'500","last_deep_scrub_stamp":"2024-04-20T10:59:58.349410+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.349410+0000","objects_scrubbed":1,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:25:48.273771+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":443,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"38'402","reported_seq":535,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.516385+0000","last_change":"2024-04-20T11:00:02.516412+0000","last_active":"2024-04-20T11:00:02.516385+0000","last_peered":"2024-04-20T11:00:02.516385+0000","last_clean":"2024-04-20T11:00:02.516385+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T11:00:02.516385+0000","last_undegraded":"2024-04-20T11:00:02.516385+0000","last_fullsized":"2024-04-20T11:00:02.516385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'402","last_scrub_stamp":"2024-04-20T11:00:02.516295+0000","last_deep_scrub":"38'402","last_deep_scrub_stamp":"2024-04-20T11:00:02.516295+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.516295+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:23.651667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56962,"num_write":365,"num_write_kb":46837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"38'375","reported_seq":514,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.877466+0000","last_change":"2024-04-20T10:59:56.877512+0000","last_active":"2024-04-20T10:59:56.877466+0000","last_peered":"2024-04-20T10:59:56.877466+0000","last_clean":"2024-04-20T10:59:56.877466+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:59:56.877466+0000","last_undegraded":"2024-04-20T10:59:56.877466+0000","last_fullsized":"2024-04-20T10:59:56.877466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T10:59:56.877333+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T10:59:56.877333+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.877333+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:53.660260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":12893,"num_write":338,"num_write_kb":54469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"38'680","reported_seq":748,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.060637+0000","last_change":"2024-04-20T10:59:58.060688+0000","last_active":"2024-04-20T10:59:58.060637+0000","last_peered":"2024-04-20T10:59:58.060637+0000","last_clean":"2024-04-20T10:59:58.060637+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:59:58.060637+0000","last_undegraded":"2024-04-20T10:59:58.060637+0000","last_fullsized":"2024-04-20T10:59:58.060637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'680","last_scrub_stamp":"2024-04-20T10:59:58.060467+0000","last_deep_scrub":"38'680","last_deep_scrub_stamp":"2024-04-20T10:59:58.060467+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.060467+0000","objects_scrubbed":2,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:24:11.137390+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":626,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"38'249","reported_seq":304,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.102161+0000","last_change":"2024-04-20T10:59:55.102190+0000","last_active":"2024-04-20T10:59:55.102161+0000","last_peered":"2024-04-20T10:59:55.102161+0000","last_clean":"2024-04-20T10:59:55.102161+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:59:55.102161+0000","last_undegraded":"2024-04-20T10:59:55.102161+0000","last_fullsized":"2024-04-20T10:59:55.102161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'249","last_scrub_stamp":"2024-04-20T10:59:55.102044+0000","last_deep_scrub":"38'249","last_deep_scrub_stamp":"2024-04-20T10:59:55.102044+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.102044+0000","objects_scrubbed":1,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:17:33.480154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":197,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"38'396","reported_seq":506,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.621421+0000","last_change":"2024-04-20T10:50:49.654992+0000","last_active":"2024-04-20T10:59:28.621421+0000","last_peered":"2024-04-20T10:59:28.621421+0000","last_clean":"2024-04-20T10:59:28.621421+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T10:59:28.621421+0000","last_undegraded":"2024-04-20T10:59:28.621421+0000","last_fullsized":"2024-04-20T10:59:28.621421+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27222,"num_write":365,"num_write_kb":63558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"38'485","reported_seq":649,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.901538+0000","last_change":"2024-04-20T10:59:57.901538+0000","last_active":"2024-04-20T10:59:57.901538+0000","last_peered":"2024-04-20T10:59:57.901538+0000","last_clean":"2024-04-20T10:59:57.901538+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:59:57.901538+0000","last_undegraded":"2024-04-20T10:59:57.901538+0000","last_fullsized":"2024-04-20T10:59:57.901538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'485","last_scrub_stamp":"2024-04-20T10:59:57.901373+0000","last_deep_scrub":"38'485","last_deep_scrub_stamp":"2024-04-20T10:59:57.901373+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.901373+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:07.844943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":79269,"num_write":451,"num_write_kb":100665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"38'423","reported_seq":514,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.481006+0000","last_change":"2024-04-20T10:59:53.481006+0000","last_active":"2024-04-20T10:59:53.481006+0000","last_peered":"2024-04-20T10:59:53.481006+0000","last_clean":"2024-04-20T10:59:53.481006+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:59:53.481006+0000","last_undegraded":"2024-04-20T10:59:53.481006+0000","last_fullsized":"2024-04-20T10:59:53.481006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T10:59:53.480885+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T10:59:53.480885+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.480885+0000","objects_scrubbed":6,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:43:08.266407+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":8276,"num_write":372,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"38'125","reported_seq":182,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.408384+0000","last_change":"2024-04-20T11:00:02.408414+0000","last_active":"2024-04-20T11:00:02.408384+0000","last_peered":"2024-04-20T11:00:02.408384+0000","last_clean":"2024-04-20T11:00:02.408384+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T11:00:02.408384+0000","last_undegraded":"2024-04-20T11:00:02.408384+0000","last_fullsized":"2024-04-20T11:00:02.408384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'125","last_scrub_stamp":"2024-04-20T11:00:02.408295+0000","last_deep_scrub":"38'125","last_deep_scrub_stamp":"2024-04-20T11:00:02.408295+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.408295+0000","objects_scrubbed":1,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:57:24.612803+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12306,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"38'439","reported_seq":571,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.300134+0000","last_change":"2024-04-20T11:00:02.300160+0000","last_active":"2024-04-20T11:00:02.300134+0000","last_peered":"2024-04-20T11:00:02.300134+0000","last_clean":"2024-04-20T11:00:02.300134+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T11:00:02.300134+0000","last_undegraded":"2024-04-20T11:00:02.300134+0000","last_fullsized":"2024-04-20T11:00:02.300134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'439","last_scrub_stamp":"2024-04-20T11:00:02.300043+0000","last_deep_scrub":"38'439","last_deep_scrub_stamp":"2024-04-20T11:00:02.300043+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.300043+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:51:03.853014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":73928,"num_write":402,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"38'444","reported_seq":619,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.020511+0000","last_change":"2024-04-20T11:00:02.020537+0000","last_active":"2024-04-20T11:00:02.020511+0000","last_peered":"2024-04-20T11:00:02.020511+0000","last_clean":"2024-04-20T11:00:02.020511+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T11:00:02.020511+0000","last_undegraded":"2024-04-20T11:00:02.020511+0000","last_fullsized":"2024-04-20T11:00:02.020511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'444","last_scrub_stamp":"2024-04-20T11:00:02.020414+0000","last_deep_scrub":"38'444","last_deep_scrub_stamp":"2024-04-20T11:00:02.020414+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.020414+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:38.838157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":47645,"num_write":412,"num_write_kb":63928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'71","reported_seq":132,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.080388+0000","last_change":"2024-04-20T10:59:57.080388+0000","last_active":"2024-04-20T10:59:57.080388+0000","last_peered":"2024-04-20T10:59:57.080388+0000","last_clean":"2024-04-20T10:59:57.080388+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:59:57.080388+0000","last_undegraded":"2024-04-20T10:59:57.080388+0000","last_fullsized":"2024-04-20T10:59:57.080388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'71","last_scrub_stamp":"2024-04-20T10:59:57.080261+0000","last_deep_scrub":"36'71","last_deep_scrub_stamp":"2024-04-20T10:59:57.080261+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.080261+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:45:11.562946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"38'64","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.748543+0000","last_change":"2024-04-20T10:59:56.748598+0000","last_active":"2024-04-20T10:59:56.748543+0000","last_peered":"2024-04-20T10:59:56.748543+0000","last_clean":"2024-04-20T10:59:56.748543+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:59:56.748543+0000","last_undegraded":"2024-04-20T10:59:56.748543+0000","last_fullsized":"2024-04-20T10:59:56.748543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'64","last_scrub_stamp":"2024-04-20T10:59:56.748401+0000","last_deep_scrub":"38'64","last_deep_scrub_stamp":"2024-04-20T10:59:56.748401+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.748401+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:38:12.007704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"38'417","reported_seq":543,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.408726+0000","last_change":"2024-04-20T10:50:49.654337+0000","last_active":"2024-04-20T10:59:30.408726+0000","last_peered":"2024-04-20T10:59:30.408726+0000","last_clean":"2024-04-20T10:59:30.408726+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T10:59:30.408726+0000","last_undegraded":"2024-04-20T10:59:30.408726+0000","last_fullsized":"2024-04-20T10:59:30.408726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":100636,"num_write":369,"num_write_kb":112428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"38'400","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.780680+0000","last_change":"2024-04-20T10:59:52.780680+0000","last_active":"2024-04-20T10:59:52.780680+0000","last_peered":"2024-04-20T10:59:52.780680+0000","last_clean":"2024-04-20T10:59:52.780680+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:59:52.780680+0000","last_undegraded":"2024-04-20T10:59:52.780680+0000","last_fullsized":"2024-04-20T10:59:52.780680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T10:59:52.780550+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T10:59:52.780550+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.780550+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:56.160715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":45758,"num_write":374,"num_write_kb":77972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"38'70","reported_seq":131,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.221021+0000","last_change":"2024-04-20T11:00:06.221046+0000","last_active":"2024-04-20T11:00:06.221021+0000","last_peered":"2024-04-20T11:00:06.221021+0000","last_clean":"2024-04-20T11:00:06.221021+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T11:00:06.221021+0000","last_undegraded":"2024-04-20T11:00:06.221021+0000","last_fullsized":"2024-04-20T11:00:06.221021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'70","last_scrub_stamp":"2024-04-20T11:00:06.220929+0000","last_deep_scrub":"38'70","last_deep_scrub_stamp":"2024-04-20T11:00:06.220929+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.220929+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:43:56.204888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"38'521","reported_seq":605,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.793249+0000","last_change":"2024-04-20T10:59:52.793249+0000","last_active":"2024-04-20T10:59:52.793249+0000","last_peered":"2024-04-20T10:59:52.793249+0000","last_clean":"2024-04-20T10:59:52.793249+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:59:52.793249+0000","last_undegraded":"2024-04-20T10:59:52.793249+0000","last_fullsized":"2024-04-20T10:59:52.793249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'521","last_scrub_stamp":"2024-04-20T10:59:52.793139+0000","last_deep_scrub":"38'521","last_deep_scrub_stamp":"2024-04-20T10:59:52.793139+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.793139+0000","objects_scrubbed":6,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:45:30.392812+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":32813,"num_write":466,"num_write_kb":12553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"38'400","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.789570+0000","last_change":"2024-04-20T11:00:02.789570+0000","last_active":"2024-04-20T11:00:02.789570+0000","last_peered":"2024-04-20T11:00:02.789570+0000","last_clean":"2024-04-20T11:00:02.789570+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T11:00:02.789570+0000","last_undegraded":"2024-04-20T11:00:02.789570+0000","last_fullsized":"2024-04-20T11:00:02.789570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T11:00:02.789446+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T11:00:02.789446+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.789446+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:02.040237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":57869,"num_write":367,"num_write_kb":80191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"38'424","reported_seq":573,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.354099+0000","last_change":"2024-04-20T10:59:59.354099+0000","last_active":"2024-04-20T10:59:59.354099+0000","last_peered":"2024-04-20T10:59:59.354099+0000","last_clean":"2024-04-20T10:59:59.354099+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:59:59.354099+0000","last_undegraded":"2024-04-20T10:59:59.354099+0000","last_fullsized":"2024-04-20T10:59:59.354099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'424","last_scrub_stamp":"2024-04-20T10:59:59.353972+0000","last_deep_scrub":"38'424","last_deep_scrub_stamp":"2024-04-20T10:59:59.353972+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.353972+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:57:41.960553+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62334,"num_write":402,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"38'170","reported_seq":247,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.326255+0000","last_change":"2024-04-20T10:59:54.326255+0000","last_active":"2024-04-20T10:59:54.326255+0000","last_peered":"2024-04-20T10:59:54.326255+0000","last_clean":"2024-04-20T10:59:54.326255+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:59:54.326255+0000","last_undegraded":"2024-04-20T10:59:54.326255+0000","last_fullsized":"2024-04-20T10:59:54.326255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'170","last_scrub_stamp":"2024-04-20T10:59:54.326137+0000","last_deep_scrub":"38'170","last_deep_scrub_stamp":"2024-04-20T10:59:54.326137+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.326137+0000","objects_scrubbed":4,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:32:59.588122+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":24616,"num_write":112,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"38'324","reported_seq":392,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.368544+0000","last_change":"2024-04-20T10:59:56.368613+0000","last_active":"2024-04-20T10:59:56.368544+0000","last_peered":"2024-04-20T10:59:56.368544+0000","last_clean":"2024-04-20T10:59:56.368544+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:59:56.368544+0000","last_undegraded":"2024-04-20T10:59:56.368544+0000","last_fullsized":"2024-04-20T10:59:56.368544+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'324","last_scrub_stamp":"2024-04-20T10:59:56.368430+0000","last_deep_scrub":"38'324","last_deep_scrub_stamp":"2024-04-20T10:59:56.368430+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.368430+0000","objects_scrubbed":3,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:11.457766+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":278,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"38'376","reported_seq":491,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.399880+0000","last_change":"2024-04-20T10:50:49.648192+0000","last_active":"2024-04-20T10:59:50.399880+0000","last_peered":"2024-04-20T10:59:50.399880+0000","last_clean":"2024-04-20T10:59:50.399880+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T10:59:50.399880+0000","last_undegraded":"2024-04-20T10:59:50.399880+0000","last_fullsized":"2024-04-20T10:59:50.399880+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":25860,"num_write":345,"num_write_kb":47542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"38'388","reported_seq":514,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.856542+0000","last_change":"2024-04-20T11:00:01.856583+0000","last_active":"2024-04-20T11:00:01.856542+0000","last_peered":"2024-04-20T11:00:01.856542+0000","last_clean":"2024-04-20T11:00:01.856542+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T11:00:01.856542+0000","last_undegraded":"2024-04-20T11:00:01.856542+0000","last_fullsized":"2024-04-20T11:00:01.856542+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'388","last_scrub_stamp":"2024-04-20T11:00:01.856424+0000","last_deep_scrub":"38'388","last_deep_scrub_stamp":"2024-04-20T11:00:01.856424+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.856424+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:59:55.110727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":29836,"num_write":343,"num_write_kb":67451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"38'581","reported_seq":671,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.098218+0000","last_change":"2024-04-20T10:59:59.098218+0000","last_active":"2024-04-20T10:59:59.098218+0000","last_peered":"2024-04-20T10:59:59.098218+0000","last_clean":"2024-04-20T10:59:59.098218+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:59:59.098218+0000","last_undegraded":"2024-04-20T10:59:59.098218+0000","last_fullsized":"2024-04-20T10:59:59.098218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'581","last_scrub_stamp":"2024-04-20T10:59:59.098045+0000","last_deep_scrub":"38'581","last_deep_scrub_stamp":"2024-04-20T10:59:59.098045+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.098045+0000","objects_scrubbed":6,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:31:06.619736+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35988,"num_write":517,"num_write_kb":12589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"38'65","reported_seq":118,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.575322+0000","last_change":"2024-04-20T10:59:50.575322+0000","last_active":"2024-04-20T10:59:50.575322+0000","last_peered":"2024-04-20T10:59:50.575322+0000","last_clean":"2024-04-20T10:59:50.575322+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:59:50.575322+0000","last_undegraded":"2024-04-20T10:59:50.575322+0000","last_fullsized":"2024-04-20T10:59:50.575322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'65","last_scrub_stamp":"2024-04-20T10:59:50.575224+0000","last_deep_scrub":"38'65","last_deep_scrub_stamp":"2024-04-20T10:59:50.575224+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.575224+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:52:41.164009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"38'406","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.366550+0000","last_change":"2024-04-20T11:00:11.366550+0000","last_active":"2024-04-20T11:00:11.366550+0000","last_peered":"2024-04-20T11:00:11.366550+0000","last_clean":"2024-04-20T11:00:11.366550+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T11:00:11.366550+0000","last_undegraded":"2024-04-20T11:00:11.366550+0000","last_fullsized":"2024-04-20T11:00:11.366550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'406","last_scrub_stamp":"2024-04-20T11:00:11.366367+0000","last_deep_scrub":"38'406","last_deep_scrub_stamp":"2024-04-20T11:00:11.366367+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.366367+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:06.890395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":74646,"num_write":381,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'380","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.115681+0000","last_change":"2024-04-20T11:00:03.115707+0000","last_active":"2024-04-20T11:00:03.115681+0000","last_peered":"2024-04-20T11:00:03.115681+0000","last_clean":"2024-04-20T11:00:03.115681+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T11:00:03.115681+0000","last_undegraded":"2024-04-20T11:00:03.115681+0000","last_fullsized":"2024-04-20T11:00:03.115681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'380","last_scrub_stamp":"2024-04-20T11:00:03.115586+0000","last_deep_scrub":"37'380","last_deep_scrub_stamp":"2024-04-20T11:00:03.115586+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.115586+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:48:43.177519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61041,"num_write":349,"num_write_kb":58639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"38'335","reported_seq":408,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.422830+0000","last_change":"2024-04-20T11:00:04.422871+0000","last_active":"2024-04-20T11:00:04.422830+0000","last_peered":"2024-04-20T11:00:04.422830+0000","last_clean":"2024-04-20T11:00:04.422830+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T11:00:04.422830+0000","last_undegraded":"2024-04-20T11:00:04.422830+0000","last_fullsized":"2024-04-20T11:00:04.422830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'335","last_scrub_stamp":"2024-04-20T11:00:04.422740+0000","last_deep_scrub":"38'335","last_deep_scrub_stamp":"2024-04-20T11:00:04.422740+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.422740+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:01:49.648542+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":4122,"num_write":282,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"38'153","reported_seq":232,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.117224+0000","last_change":"2024-04-20T10:59:56.117224+0000","last_active":"2024-04-20T10:59:56.117224+0000","last_peered":"2024-04-20T10:59:56.117224+0000","last_clean":"2024-04-20T10:59:56.117224+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:59:56.117224+0000","last_undegraded":"2024-04-20T10:59:56.117224+0000","last_fullsized":"2024-04-20T10:59:56.117224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'153","last_scrub_stamp":"2024-04-20T10:59:56.117098+0000","last_deep_scrub":"38'153","last_deep_scrub_stamp":"2024-04-20T10:59:56.117098+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.117098+0000","objects_scrubbed":4,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:47:42.076531+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":45111,"num_write":81,"num_write_kb":8263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"38'468","reported_seq":607,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.982142+0000","last_change":"2024-04-20T11:00:07.982142+0000","last_active":"2024-04-20T11:00:07.982142+0000","last_peered":"2024-04-20T11:00:07.982142+0000","last_clean":"2024-04-20T11:00:07.982142+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T11:00:07.982142+0000","last_undegraded":"2024-04-20T11:00:07.982142+0000","last_fullsized":"2024-04-20T11:00:07.982142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'468","last_scrub_stamp":"2024-04-20T11:00:07.982025+0000","last_deep_scrub":"38'468","last_deep_scrub_stamp":"2024-04-20T11:00:07.982025+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.982025+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:26:42.868192+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":50494,"num_write":431,"num_write_kb":38868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"37'379","reported_seq":511,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.328994+0000","last_change":"2024-04-20T10:59:53.329018+0000","last_active":"2024-04-20T10:59:53.328994+0000","last_peered":"2024-04-20T10:59:53.328994+0000","last_clean":"2024-04-20T10:59:53.328994+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:59:53.328994+0000","last_undegraded":"2024-04-20T10:59:53.328994+0000","last_fullsized":"2024-04-20T10:59:53.328994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'379","last_scrub_stamp":"2024-04-20T10:59:53.328907+0000","last_deep_scrub":"37'379","last_deep_scrub_stamp":"2024-04-20T10:59:53.328907+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.328907+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:12:00.355277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":58132,"num_write":347,"num_write_kb":59251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"38'175","reported_seq":236,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.159331+0000","last_change":"2024-04-20T11:00:08.159361+0000","last_active":"2024-04-20T11:00:08.159331+0000","last_peered":"2024-04-20T11:00:08.159331+0000","last_clean":"2024-04-20T11:00:08.159331+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T11:00:08.159331+0000","last_undegraded":"2024-04-20T11:00:08.159331+0000","last_fullsized":"2024-04-20T11:00:08.159331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'175","last_scrub_stamp":"2024-04-20T11:00:08.159240+0000","last_deep_scrub":"38'175","last_deep_scrub_stamp":"2024-04-20T11:00:08.159240+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.159240+0000","objects_scrubbed":1,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:15:05.589260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":116,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"38'458","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.769178+0000","last_change":"2024-04-20T10:59:51.769215+0000","last_active":"2024-04-20T10:59:51.769178+0000","last_peered":"2024-04-20T10:59:51.769178+0000","last_clean":"2024-04-20T10:59:51.769178+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:59:51.769178+0000","last_undegraded":"2024-04-20T10:59:51.769178+0000","last_fullsized":"2024-04-20T10:59:51.769178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'458","last_scrub_stamp":"2024-04-20T10:59:51.769099+0000","last_deep_scrub":"38'458","last_deep_scrub_stamp":"2024-04-20T10:59:51.769099+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.769099+0000","objects_scrubbed":6,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:26:22.465514+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":8291,"num_write":401,"num_write_kb":8399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'436","reported_seq":561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.161518+0000","last_change":"2024-04-20T10:50:49.647107+0000","last_active":"2024-04-20T10:59:52.161518+0000","last_peered":"2024-04-20T10:59:52.161518+0000","last_clean":"2024-04-20T10:59:52.161518+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T10:59:52.161518+0000","last_undegraded":"2024-04-20T10:59:52.161518+0000","last_fullsized":"2024-04-20T10:59:52.161518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":65641,"num_write":399,"num_write_kb":55375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"38'413","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.326645+0000","last_change":"2024-04-20T11:00:01.326673+0000","last_active":"2024-04-20T11:00:01.326645+0000","last_peered":"2024-04-20T11:00:01.326645+0000","last_clean":"2024-04-20T11:00:01.326645+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T11:00:01.326645+0000","last_undegraded":"2024-04-20T11:00:01.326645+0000","last_fullsized":"2024-04-20T11:00:01.326645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'413","last_scrub_stamp":"2024-04-20T11:00:01.326556+0000","last_deep_scrub":"38'413","last_deep_scrub_stamp":"2024-04-20T11:00:01.326556+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.326556+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:03:39.792170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":35937,"num_write":378,"num_write_kb":46521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"37'65","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.077936+0000","last_change":"2024-04-20T11:00:00.077961+0000","last_active":"2024-04-20T11:00:00.077936+0000","last_peered":"2024-04-20T11:00:00.077936+0000","last_clean":"2024-04-20T11:00:00.077936+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T11:00:00.077936+0000","last_undegraded":"2024-04-20T11:00:00.077936+0000","last_fullsized":"2024-04-20T11:00:00.077936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'65","last_scrub_stamp":"2024-04-20T11:00:00.077809+0000","last_deep_scrub":"37'65","last_deep_scrub_stamp":"2024-04-20T11:00:00.077809+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.077809+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:58:28.881881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'63","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.746717+0000","last_change":"2024-04-20T10:59:54.746717+0000","last_active":"2024-04-20T10:59:54.746717+0000","last_peered":"2024-04-20T10:59:54.746717+0000","last_clean":"2024-04-20T10:59:54.746717+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:59:54.746717+0000","last_undegraded":"2024-04-20T10:59:54.746717+0000","last_fullsized":"2024-04-20T10:59:54.746717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-04-20T10:59:54.746539+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-04-20T10:59:54.746539+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.746539+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:28:50.353446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"38'364","reported_seq":471,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.027772+0000","last_change":"2024-04-20T11:00:07.027798+0000","last_active":"2024-04-20T11:00:07.027772+0000","last_peered":"2024-04-20T11:00:07.027772+0000","last_clean":"2024-04-20T11:00:07.027772+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T11:00:07.027772+0000","last_undegraded":"2024-04-20T11:00:07.027772+0000","last_fullsized":"2024-04-20T11:00:07.027772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'364","last_scrub_stamp":"2024-04-20T11:00:07.027687+0000","last_deep_scrub":"38'364","last_deep_scrub_stamp":"2024-04-20T11:00:07.027687+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.027687+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:19:31.369392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25276,"num_write":334,"num_write_kb":46079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"38'74","reported_seq":133,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.500072+0000","last_change":"2024-04-20T11:00:05.500100+0000","last_active":"2024-04-20T11:00:05.500072+0000","last_peered":"2024-04-20T11:00:05.500072+0000","last_clean":"2024-04-20T11:00:05.500072+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T11:00:05.500072+0000","last_undegraded":"2024-04-20T11:00:05.500072+0000","last_fullsized":"2024-04-20T11:00:05.500072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-04-20T11:00:05.499988+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-04-20T11:00:05.499988+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.499988+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:41:31.477484+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":32,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"38'418","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.509615+0000","last_change":"2024-04-20T10:59:54.509663+0000","last_active":"2024-04-20T10:59:54.509615+0000","last_peered":"2024-04-20T10:59:54.509615+0000","last_clean":"2024-04-20T10:59:54.509615+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:59:54.509615+0000","last_undegraded":"2024-04-20T10:59:54.509615+0000","last_fullsized":"2024-04-20T10:59:54.509615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'418","last_scrub_stamp":"2024-04-20T10:59:54.509503+0000","last_deep_scrub":"38'418","last_deep_scrub_stamp":"2024-04-20T10:59:54.509503+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.509503+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:45.684536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":61851,"num_write":392,"num_write_kb":55373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"38'894","reported_seq":961,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.299807+0000","last_change":"2024-04-20T11:00:04.299874+0000","last_active":"2024-04-20T11:00:04.299807+0000","last_peered":"2024-04-20T11:00:04.299807+0000","last_clean":"2024-04-20T11:00:04.299807+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T11:00:04.299807+0000","last_undegraded":"2024-04-20T11:00:04.299807+0000","last_fullsized":"2024-04-20T11:00:04.299807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'894","last_scrub_stamp":"2024-04-20T11:00:04.299691+0000","last_deep_scrub":"38'894","last_deep_scrub_stamp":"2024-04-20T11:00:04.299691+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.299691+0000","objects_scrubbed":2,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:36:12.173293+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":834,"num_write_kb":8709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'413","reported_seq":531,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.409825+0000","last_change":"2024-04-20T10:50:49.645857+0000","last_active":"2024-04-20T10:59:30.409825+0000","last_peered":"2024-04-20T10:59:30.409825+0000","last_clean":"2024-04-20T10:59:30.409825+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T10:59:30.409825+0000","last_undegraded":"2024-04-20T10:59:30.409825+0000","last_fullsized":"2024-04-20T10:59:30.409825+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49569,"num_write":377,"num_write_kb":64815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"38'57","reported_seq":127,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.113394+0000","last_change":"2024-04-20T10:59:54.113432+0000","last_active":"2024-04-20T10:59:54.113394+0000","last_peered":"2024-04-20T10:59:54.113394+0000","last_clean":"2024-04-20T10:59:54.113394+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:59:54.113394+0000","last_undegraded":"2024-04-20T10:59:54.113394+0000","last_fullsized":"2024-04-20T10:59:54.113394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'57","last_scrub_stamp":"2024-04-20T10:59:54.113308+0000","last_deep_scrub":"38'57","last_deep_scrub_stamp":"2024-04-20T10:59:54.113308+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.113308+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:17:40.919175+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":8,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"38'435","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.784175+0000","last_change":"2024-04-20T11:00:08.784202+0000","last_active":"2024-04-20T11:00:08.784175+0000","last_peered":"2024-04-20T11:00:08.784175+0000","last_clean":"2024-04-20T11:00:08.784175+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T11:00:08.784175+0000","last_undegraded":"2024-04-20T11:00:08.784175+0000","last_fullsized":"2024-04-20T11:00:08.784175+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'435","last_scrub_stamp":"2024-04-20T11:00:08.784074+0000","last_deep_scrub":"38'435","last_deep_scrub_stamp":"2024-04-20T11:00:08.784074+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.784074+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:38:51.228279+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26261,"num_write":400,"num_write_kb":42830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"38'221","reported_seq":282,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.807574+0000","last_change":"2024-04-20T11:00:06.807604+0000","last_active":"2024-04-20T11:00:06.807574+0000","last_peered":"2024-04-20T11:00:06.807574+0000","last_clean":"2024-04-20T11:00:06.807574+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T11:00:06.807574+0000","last_undegraded":"2024-04-20T11:00:06.807574+0000","last_fullsized":"2024-04-20T11:00:06.807574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'221","last_scrub_stamp":"2024-04-20T11:00:06.807477+0000","last_deep_scrub":"38'221","last_deep_scrub_stamp":"2024-04-20T11:00:06.807477+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.807477+0000","objects_scrubbed":1,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:26:31.225366+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":166,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"38'369","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.391173+0000","last_change":"2024-04-20T11:00:07.391200+0000","last_active":"2024-04-20T11:00:07.391173+0000","last_peered":"2024-04-20T11:00:07.391173+0000","last_clean":"2024-04-20T11:00:07.391173+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T11:00:07.391173+0000","last_undegraded":"2024-04-20T11:00:07.391173+0000","last_fullsized":"2024-04-20T11:00:07.391173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'369","last_scrub_stamp":"2024-04-20T11:00:07.391076+0000","last_deep_scrub":"38'369","last_deep_scrub_stamp":"2024-04-20T11:00:07.391076+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.391076+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:44:35.885133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31197,"num_write":338,"num_write_kb":64191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"38'451","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.074749+0000","last_change":"2024-04-20T10:59:58.074811+0000","last_active":"2024-04-20T10:59:58.074749+0000","last_peered":"2024-04-20T10:59:58.074749+0000","last_clean":"2024-04-20T10:59:58.074749+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:59:58.074749+0000","last_undegraded":"2024-04-20T10:59:58.074749+0000","last_fullsized":"2024-04-20T10:59:58.074749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T10:59:58.074642+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T10:59:58.074642+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.074642+0000","objects_scrubbed":3,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:21:39.338176+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":384,"num_write_kb":12501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'379","reported_seq":524,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.300752+0000","last_change":"2024-04-20T10:59:49.300795+0000","last_active":"2024-04-20T10:59:49.300752+0000","last_peered":"2024-04-20T10:59:49.300752+0000","last_clean":"2024-04-20T10:59:49.300752+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:59:49.300752+0000","last_undegraded":"2024-04-20T10:59:49.300752+0000","last_fullsized":"2024-04-20T10:59:49.300752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'379","last_scrub_stamp":"2024-04-20T10:59:49.300624+0000","last_deep_scrub":"38'379","last_deep_scrub_stamp":"2024-04-20T10:59:49.300624+0000","last_clean_scrub_stamp":"2024-04-20T10:59:49.300624+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:02:43.989268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52177,"num_write":354,"num_write_kb":79739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"38'583","reported_seq":648,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.494614+0000","last_change":"2024-04-20T10:59:57.494669+0000","last_active":"2024-04-20T10:59:57.494614+0000","last_peered":"2024-04-20T10:59:57.494614+0000","last_clean":"2024-04-20T10:59:57.494614+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:59:57.494614+0000","last_undegraded":"2024-04-20T10:59:57.494614+0000","last_fullsized":"2024-04-20T10:59:57.494614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'583","last_scrub_stamp":"2024-04-20T10:59:57.494504+0000","last_deep_scrub":"38'583","last_deep_scrub_stamp":"2024-04-20T10:59:57.494504+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.494504+0000","objects_scrubbed":2,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:29.827360+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":12318,"num_write":526,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"38'403","reported_seq":541,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.198621+0000","last_change":"2024-04-20T11:00:10.198648+0000","last_active":"2024-04-20T11:00:10.198621+0000","last_peered":"2024-04-20T11:00:10.198621+0000","last_clean":"2024-04-20T11:00:10.198621+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T11:00:10.198621+0000","last_undegraded":"2024-04-20T11:00:10.198621+0000","last_fullsized":"2024-04-20T11:00:10.198621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'403","last_scrub_stamp":"2024-04-20T11:00:10.198517+0000","last_deep_scrub":"38'403","last_deep_scrub_stamp":"2024-04-20T11:00:10.198517+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.198517+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:15:01.092832+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":104331,"num_write":376,"num_write_kb":109020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"38'182","reported_seq":247,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.810125+0000","last_change":"2024-04-20T11:00:04.810154+0000","last_active":"2024-04-20T11:00:04.810125+0000","last_peered":"2024-04-20T11:00:04.810125+0000","last_clean":"2024-04-20T11:00:04.810125+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T11:00:04.810125+0000","last_undegraded":"2024-04-20T11:00:04.810125+0000","last_fullsized":"2024-04-20T11:00:04.810125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'182","last_scrub_stamp":"2024-04-20T11:00:04.810044+0000","last_deep_scrub":"38'182","last_deep_scrub_stamp":"2024-04-20T11:00:04.810044+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.810044+0000","objects_scrubbed":1,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:29:45.694276+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":124,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'410","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.005325+0000","last_change":"2024-04-20T10:59:59.005352+0000","last_active":"2024-04-20T10:59:59.005325+0000","last_peered":"2024-04-20T10:59:59.005325+0000","last_clean":"2024-04-20T10:59:59.005325+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:59:59.005325+0000","last_undegraded":"2024-04-20T10:59:59.005325+0000","last_fullsized":"2024-04-20T10:59:59.005325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'410","last_scrub_stamp":"2024-04-20T10:59:59.005237+0000","last_deep_scrub":"37'410","last_deep_scrub_stamp":"2024-04-20T10:59:59.005237+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.005237+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:01:04.836565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56637,"num_write":377,"num_write_kb":62852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"38'550","reported_seq":625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.798374+0000","last_change":"2024-04-20T10:59:50.798403+0000","last_active":"2024-04-20T10:59:50.798374+0000","last_peered":"2024-04-20T10:59:50.798374+0000","last_clean":"2024-04-20T10:59:50.798374+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:59:50.798374+0000","last_undegraded":"2024-04-20T10:59:50.798374+0000","last_fullsized":"2024-04-20T10:59:50.798374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'550","last_scrub_stamp":"2024-04-20T10:59:50.798302+0000","last_deep_scrub":"38'550","last_deep_scrub_stamp":"2024-04-20T10:59:50.798302+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.798302+0000","objects_scrubbed":4,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:38:58.664176+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":57371,"num_write":468,"num_write_kb":12517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"38'472","reported_seq":617,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.785327+0000","last_change":"2024-04-20T11:00:00.785358+0000","last_active":"2024-04-20T11:00:00.785327+0000","last_peered":"2024-04-20T11:00:00.785327+0000","last_clean":"2024-04-20T11:00:00.785327+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T11:00:00.785327+0000","last_undegraded":"2024-04-20T11:00:00.785327+0000","last_fullsized":"2024-04-20T11:00:00.785327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'472","last_scrub_stamp":"2024-04-20T11:00:00.785231+0000","last_deep_scrub":"38'472","last_deep_scrub_stamp":"2024-04-20T11:00:00.785231+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.785231+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:21:05.316393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":77683,"num_write":435,"num_write_kb":89005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"38'421","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.038157+0000","last_change":"2024-04-20T11:00:01.038199+0000","last_active":"2024-04-20T11:00:01.038157+0000","last_peered":"2024-04-20T11:00:01.038157+0000","last_clean":"2024-04-20T11:00:01.038157+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T11:00:01.038157+0000","last_undegraded":"2024-04-20T11:00:01.038157+0000","last_fullsized":"2024-04-20T11:00:01.038157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'421","last_scrub_stamp":"2024-04-20T11:00:01.038038+0000","last_deep_scrub":"38'421","last_deep_scrub_stamp":"2024-04-20T11:00:01.038038+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.038038+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:25:10.851965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":50143,"num_write":396,"num_write_kb":67741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"38'423","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.432279+0000","last_change":"2024-04-20T10:59:57.432306+0000","last_active":"2024-04-20T10:59:57.432279+0000","last_peered":"2024-04-20T10:59:57.432279+0000","last_clean":"2024-04-20T10:59:57.432279+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:59:57.432279+0000","last_undegraded":"2024-04-20T10:59:57.432279+0000","last_fullsized":"2024-04-20T10:59:57.432279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T10:59:57.432185+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T10:59:57.432185+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.432185+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:48:48.499918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66334,"num_write":397,"num_write_kb":71356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"38'448","reported_seq":611,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.451065+0000","last_change":"2024-04-20T10:59:56.451091+0000","last_active":"2024-04-20T10:59:56.451065+0000","last_peered":"2024-04-20T10:59:56.451065+0000","last_clean":"2024-04-20T10:59:56.451065+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:59:56.451065+0000","last_undegraded":"2024-04-20T10:59:56.451065+0000","last_fullsized":"2024-04-20T10:59:56.451065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'448","last_scrub_stamp":"2024-04-20T10:59:56.450972+0000","last_deep_scrub":"38'448","last_deep_scrub_stamp":"2024-04-20T10:59:56.450972+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.450972+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:42:55.365315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":105081,"num_write":414,"num_write_kb":80164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"38'397","reported_seq":522,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.797977+0000","last_change":"2024-04-20T10:50:49.649135+0000","last_active":"2024-04-20T10:59:31.797977+0000","last_peered":"2024-04-20T10:59:31.797977+0000","last_clean":"2024-04-20T10:59:31.797977+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T10:59:31.797977+0000","last_undegraded":"2024-04-20T10:59:31.797977+0000","last_fullsized":"2024-04-20T10:59:31.797977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":91923,"num_write":367,"num_write_kb":80227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"38'487","reported_seq":658,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.328200+0000","last_change":"2024-04-20T10:59:55.328228+0000","last_active":"2024-04-20T10:59:55.328200+0000","last_peered":"2024-04-20T10:59:55.328200+0000","last_clean":"2024-04-20T10:59:55.328200+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:59:55.328200+0000","last_undegraded":"2024-04-20T10:59:55.328200+0000","last_fullsized":"2024-04-20T10:59:55.328200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'487","last_scrub_stamp":"2024-04-20T10:59:55.328102+0000","last_deep_scrub":"38'487","last_deep_scrub_stamp":"2024-04-20T10:59:55.328102+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.328102+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:22:17.171374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":66889,"num_write":452,"num_write_kb":101085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"38'390","reported_seq":499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.732555+0000","last_change":"2024-04-20T10:50:49.655669+0000","last_active":"2024-04-20T10:59:31.732555+0000","last_peered":"2024-04-20T10:59:31.732555+0000","last_clean":"2024-04-20T10:59:31.732555+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T10:59:31.732555+0000","last_undegraded":"2024-04-20T10:59:31.732555+0000","last_fullsized":"2024-04-20T10:59:31.732555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":23315,"num_write":364,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"38'411","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.375209+0000","last_change":"2024-04-20T11:00:01.375232+0000","last_active":"2024-04-20T11:00:01.375209+0000","last_peered":"2024-04-20T11:00:01.375209+0000","last_clean":"2024-04-20T11:00:01.375209+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T11:00:01.375209+0000","last_undegraded":"2024-04-20T11:00:01.375209+0000","last_fullsized":"2024-04-20T11:00:01.375209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'411","last_scrub_stamp":"2024-04-20T11:00:01.375124+0000","last_deep_scrub":"38'411","last_deep_scrub_stamp":"2024-04-20T11:00:01.375124+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.375124+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:25.816707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":34858,"num_write":375,"num_write_kb":71279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"38'438","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.828239+0000","last_change":"2024-04-20T11:00:02.828281+0000","last_active":"2024-04-20T11:00:02.828239+0000","last_peered":"2024-04-20T11:00:02.828239+0000","last_clean":"2024-04-20T11:00:02.828239+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T11:00:02.828239+0000","last_undegraded":"2024-04-20T11:00:02.828239+0000","last_fullsized":"2024-04-20T11:00:02.828239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'438","last_scrub_stamp":"2024-04-20T11:00:02.828127+0000","last_deep_scrub":"38'438","last_deep_scrub_stamp":"2024-04-20T11:00:02.828127+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.828127+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:28.276542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":12465,"num_write":398,"num_write_kb":25863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"38'367","reported_seq":499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.778685+0000","last_change":"2024-04-20T10:59:59.778714+0000","last_active":"2024-04-20T10:59:59.778685+0000","last_peered":"2024-04-20T10:59:59.778685+0000","last_clean":"2024-04-20T10:59:59.778685+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:59:59.778685+0000","last_undegraded":"2024-04-20T10:59:59.778685+0000","last_fullsized":"2024-04-20T10:59:59.778685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'367","last_scrub_stamp":"2024-04-20T10:59:59.778480+0000","last_deep_scrub":"38'367","last_deep_scrub_stamp":"2024-04-20T10:59:59.778480+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.778480+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:18.719090+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40934,"num_write":339,"num_write_kb":54699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"38'400","reported_seq":514,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.225095+0000","last_change":"2024-04-20T11:00:06.225121+0000","last_active":"2024-04-20T11:00:06.225095+0000","last_peered":"2024-04-20T11:00:06.225095+0000","last_clean":"2024-04-20T11:00:06.225095+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T11:00:06.225095+0000","last_undegraded":"2024-04-20T11:00:06.225095+0000","last_fullsized":"2024-04-20T11:00:06.225095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T11:00:06.225014+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T11:00:06.225014+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.225014+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:51:04.665732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":17066,"num_write":365,"num_write_kb":46558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"37'404","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.387411+0000","last_change":"2024-04-20T10:59:58.387436+0000","last_active":"2024-04-20T10:59:58.387411+0000","last_peered":"2024-04-20T10:59:58.387411+0000","last_clean":"2024-04-20T10:59:58.387411+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:59:58.387411+0000","last_undegraded":"2024-04-20T10:59:58.387411+0000","last_fullsized":"2024-04-20T10:59:58.387411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'404","last_scrub_stamp":"2024-04-20T10:59:58.387314+0000","last_deep_scrub":"37'404","last_deep_scrub_stamp":"2024-04-20T10:59:58.387314+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.387314+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:27.391907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64800,"num_write":371,"num_write_kb":91764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"38'402","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.407022+0000","last_change":"2024-04-20T10:50:49.647948+0000","last_active":"2024-04-20T10:59:30.407022+0000","last_peered":"2024-04-20T10:59:30.407022+0000","last_clean":"2024-04-20T10:59:30.407022+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T10:59:30.407022+0000","last_undegraded":"2024-04-20T10:59:30.407022+0000","last_fullsized":"2024-04-20T10:59:30.407022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1607,"num_write":370,"num_write_kb":5819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"38'433","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.984958+0000","last_change":"2024-04-20T11:00:02.984995+0000","last_active":"2024-04-20T11:00:02.984958+0000","last_peered":"2024-04-20T11:00:02.984958+0000","last_clean":"2024-04-20T11:00:02.984958+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T11:00:02.984958+0000","last_undegraded":"2024-04-20T11:00:02.984958+0000","last_fullsized":"2024-04-20T11:00:02.984958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'433","last_scrub_stamp":"2024-04-20T11:00:02.984862+0000","last_deep_scrub":"38'433","last_deep_scrub_stamp":"2024-04-20T11:00:02.984862+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.984862+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:39.601457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":4096,"num_write":399,"num_write_kb":30569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"38'439","reported_seq":566,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.986169+0000","last_change":"2024-04-20T11:00:05.986200+0000","last_active":"2024-04-20T11:00:05.986169+0000","last_peered":"2024-04-20T11:00:05.986169+0000","last_clean":"2024-04-20T11:00:05.986169+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T11:00:05.986169+0000","last_undegraded":"2024-04-20T11:00:05.986169+0000","last_fullsized":"2024-04-20T11:00:05.986169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'439","last_scrub_stamp":"2024-04-20T11:00:05.986074+0000","last_deep_scrub":"38'439","last_deep_scrub_stamp":"2024-04-20T11:00:05.986074+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.986074+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:33:05.977567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":70131,"num_write":400,"num_write_kb":59168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"38'431","reported_seq":591,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.816442+0000","last_change":"2024-04-20T11:00:01.816467+0000","last_active":"2024-04-20T11:00:01.816442+0000","last_peered":"2024-04-20T11:00:01.816442+0000","last_clean":"2024-04-20T11:00:01.816442+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T11:00:01.816442+0000","last_undegraded":"2024-04-20T11:00:01.816442+0000","last_fullsized":"2024-04-20T11:00:01.816442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'431","last_scrub_stamp":"2024-04-20T11:00:01.816348+0000","last_deep_scrub":"38'431","last_deep_scrub_stamp":"2024-04-20T11:00:01.816348+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.816348+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:25:08.179421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":77347,"num_write":407,"num_write_kb":71895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"38'408","reported_seq":522,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.400029+0000","last_change":"2024-04-20T10:50:49.656884+0000","last_active":"2024-04-20T10:59:50.400029+0000","last_peered":"2024-04-20T10:59:50.400029+0000","last_clean":"2024-04-20T10:59:50.400029+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T10:59:50.400029+0000","last_undegraded":"2024-04-20T10:59:50.400029+0000","last_fullsized":"2024-04-20T10:59:50.400029+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":43744,"num_write":370,"num_write_kb":63188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"38'456","reported_seq":622,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.134543+0000","last_change":"2024-04-20T11:00:09.134596+0000","last_active":"2024-04-20T11:00:09.134543+0000","last_peered":"2024-04-20T11:00:09.134543+0000","last_clean":"2024-04-20T11:00:09.134543+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T11:00:09.134543+0000","last_undegraded":"2024-04-20T11:00:09.134543+0000","last_fullsized":"2024-04-20T11:00:09.134543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'456","last_scrub_stamp":"2024-04-20T11:00:09.134440+0000","last_deep_scrub":"38'456","last_deep_scrub_stamp":"2024-04-20T11:00:09.134440+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.134440+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:59:21.413961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63871,"num_write":428,"num_write_kb":100114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"38'419","reported_seq":538,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.161602+0000","last_change":"2024-04-20T10:50:49.650006+0000","last_active":"2024-04-20T10:59:52.161602+0000","last_peered":"2024-04-20T10:59:52.161602+0000","last_clean":"2024-04-20T10:59:52.161602+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T10:59:52.161602+0000","last_undegraded":"2024-04-20T10:59:52.161602+0000","last_fullsized":"2024-04-20T10:59:52.161602+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":38962,"num_write":387,"num_write_kb":79793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"38'398","reported_seq":538,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.824301+0000","last_change":"2024-04-20T11:00:07.824327+0000","last_active":"2024-04-20T11:00:07.824301+0000","last_peered":"2024-04-20T11:00:07.824301+0000","last_clean":"2024-04-20T11:00:07.824301+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T11:00:07.824301+0000","last_undegraded":"2024-04-20T11:00:07.824301+0000","last_fullsized":"2024-04-20T11:00:07.824301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'398","last_scrub_stamp":"2024-04-20T11:00:07.824172+0000","last_deep_scrub":"38'398","last_deep_scrub_stamp":"2024-04-20T11:00:07.824172+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.824172+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:58:11.309332+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":27738,"num_write":360,"num_write_kb":54944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"38'458","reported_seq":587,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.527022+0000","last_change":"2024-04-20T11:00:00.527046+0000","last_active":"2024-04-20T11:00:00.527022+0000","last_peered":"2024-04-20T11:00:00.527022+0000","last_clean":"2024-04-20T11:00:00.527022+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T11:00:00.527022+0000","last_undegraded":"2024-04-20T11:00:00.527022+0000","last_fullsized":"2024-04-20T11:00:00.527022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'458","last_scrub_stamp":"2024-04-20T11:00:00.526936+0000","last_deep_scrub":"38'458","last_deep_scrub_stamp":"2024-04-20T11:00:00.526936+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.526936+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:30:09.722198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":59920,"num_write":425,"num_write_kb":71046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"37'439","reported_seq":608,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.326684+0000","last_change":"2024-04-20T10:59:59.326736+0000","last_active":"2024-04-20T10:59:59.326684+0000","last_peered":"2024-04-20T10:59:59.326684+0000","last_clean":"2024-04-20T10:59:59.326684+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:59:59.326684+0000","last_undegraded":"2024-04-20T10:59:59.326684+0000","last_fullsized":"2024-04-20T10:59:59.326684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'439","last_scrub_stamp":"2024-04-20T10:59:59.326573+0000","last_deep_scrub":"37'439","last_deep_scrub_stamp":"2024-04-20T10:59:59.326573+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.326573+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:24.162729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":95905,"num_write":408,"num_write_kb":92283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"38'434","reported_seq":563,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.399990+0000","last_change":"2024-04-20T10:50:49.654339+0000","last_active":"2024-04-20T10:59:50.399990+0000","last_peered":"2024-04-20T10:59:50.399990+0000","last_clean":"2024-04-20T10:59:50.399990+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T10:59:50.399990+0000","last_undegraded":"2024-04-20T10:59:50.399990+0000","last_fullsized":"2024-04-20T10:59:50.399990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66507,"num_write":387,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"38'427","reported_seq":585,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.389493+0000","last_change":"2024-04-20T11:00:00.389519+0000","last_active":"2024-04-20T11:00:00.389493+0000","last_peered":"2024-04-20T11:00:00.389493+0000","last_clean":"2024-04-20T11:00:00.389493+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T11:00:00.389493+0000","last_undegraded":"2024-04-20T11:00:00.389493+0000","last_fullsized":"2024-04-20T11:00:00.389493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'427","last_scrub_stamp":"2024-04-20T11:00:00.389410+0000","last_deep_scrub":"38'427","last_deep_scrub_stamp":"2024-04-20T11:00:00.389410+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.389410+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:43:25.610664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":76500,"num_write":396,"num_write_kb":108707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"38'451","reported_seq":621,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.210856+0000","last_change":"2024-04-20T11:00:08.210884+0000","last_active":"2024-04-20T11:00:08.210856+0000","last_peered":"2024-04-20T11:00:08.210856+0000","last_clean":"2024-04-20T11:00:08.210856+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T11:00:08.210856+0000","last_undegraded":"2024-04-20T11:00:08.210856+0000","last_fullsized":"2024-04-20T11:00:08.210856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T11:00:08.210756+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T11:00:08.210756+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.210756+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:34:21.087340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":149375,"num_write":423,"num_write_kb":104932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"36'447","reported_seq":592,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.137262+0000","last_change":"2024-04-20T10:59:52.137290+0000","last_active":"2024-04-20T10:59:52.137262+0000","last_peered":"2024-04-20T10:59:52.137262+0000","last_clean":"2024-04-20T10:59:52.137262+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:59:52.137262+0000","last_undegraded":"2024-04-20T10:59:52.137262+0000","last_fullsized":"2024-04-20T10:59:52.137262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'447","last_scrub_stamp":"2024-04-20T10:59:52.137169+0000","last_deep_scrub":"36'447","last_deep_scrub_stamp":"2024-04-20T10:59:52.137169+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.137169+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:19.041397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":47044,"num_write":422,"num_write_kb":50901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"38'415","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.217205+0000","last_change":"2024-04-20T11:00:11.217262+0000","last_active":"2024-04-20T11:00:11.217205+0000","last_peered":"2024-04-20T11:00:11.217205+0000","last_clean":"2024-04-20T11:00:11.217205+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T11:00:11.217205+0000","last_undegraded":"2024-04-20T11:00:11.217205+0000","last_fullsized":"2024-04-20T11:00:11.217205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'415","last_scrub_stamp":"2024-04-20T11:00:11.217069+0000","last_deep_scrub":"38'415","last_deep_scrub_stamp":"2024-04-20T11:00:11.217069+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.217069+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:31.264778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":91214,"num_write":375,"num_write_kb":63780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"37'461","reported_seq":634,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.784171+0000","last_change":"2024-04-20T10:59:53.784241+0000","last_active":"2024-04-20T10:59:53.784171+0000","last_peered":"2024-04-20T10:59:53.784171+0000","last_clean":"2024-04-20T10:59:53.784171+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:59:53.784171+0000","last_undegraded":"2024-04-20T10:59:53.784171+0000","last_fullsized":"2024-04-20T10:59:53.784171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'461","last_scrub_stamp":"2024-04-20T10:59:53.784058+0000","last_deep_scrub":"37'461","last_deep_scrub_stamp":"2024-04-20T10:59:53.784058+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.784058+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:25:04.189321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":88844,"num_write":432,"num_write_kb":122405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"38'475","reported_seq":633,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:31.797922+0000","last_change":"2024-04-20T10:50:49.649775+0000","last_active":"2024-04-20T10:59:31.797922+0000","last_peered":"2024-04-20T10:59:31.797922+0000","last_clean":"2024-04-20T10:59:31.797922+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T10:59:31.797922+0000","last_undegraded":"2024-04-20T10:59:31.797922+0000","last_fullsized":"2024-04-20T10:59:31.797922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":92351,"num_write":448,"num_write_kb":96949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"38'395","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.497267+0000","last_change":"2024-04-20T10:59:55.497267+0000","last_active":"2024-04-20T10:59:55.497267+0000","last_peered":"2024-04-20T10:59:55.497267+0000","last_clean":"2024-04-20T10:59:55.497267+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:59:55.497267+0000","last_undegraded":"2024-04-20T10:59:55.497267+0000","last_fullsized":"2024-04-20T10:59:55.497267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'395","last_scrub_stamp":"2024-04-20T10:59:55.497141+0000","last_deep_scrub":"38'395","last_deep_scrub_stamp":"2024-04-20T10:59:55.497141+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.497141+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:26:40.782918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":19688,"num_write":355,"num_write_kb":13664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"38'415","reported_seq":531,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.098792+0000","last_change":"2024-04-20T10:50:49.645852+0000","last_active":"2024-04-20T10:59:49.098792+0000","last_peered":"2024-04-20T10:59:49.098792+0000","last_clean":"2024-04-20T10:59:49.098792+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T10:59:49.098792+0000","last_undegraded":"2024-04-20T10:59:49.098792+0000","last_fullsized":"2024-04-20T10:59:49.098792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":48111,"num_write":381,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"38'397","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.260060+0000","last_change":"2024-04-20T11:00:03.260087+0000","last_active":"2024-04-20T11:00:03.260060+0000","last_peered":"2024-04-20T11:00:03.260060+0000","last_clean":"2024-04-20T11:00:03.260060+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T11:00:03.260060+0000","last_undegraded":"2024-04-20T11:00:03.260060+0000","last_fullsized":"2024-04-20T11:00:03.260060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'397","last_scrub_stamp":"2024-04-20T11:00:03.259973+0000","last_deep_scrub":"38'397","last_deep_scrub_stamp":"2024-04-20T11:00:03.259973+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.259973+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:36.421274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":17103,"num_write":369,"num_write_kb":54677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"38'400","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.416916+0000","last_change":"2024-04-20T11:00:08.416960+0000","last_active":"2024-04-20T11:00:08.416916+0000","last_peered":"2024-04-20T11:00:08.416916+0000","last_clean":"2024-04-20T11:00:08.416916+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T11:00:08.416916+0000","last_undegraded":"2024-04-20T11:00:08.416916+0000","last_fullsized":"2024-04-20T11:00:08.416916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T11:00:08.416793+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T11:00:08.416793+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.416793+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:33.029833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":100212,"num_write":371,"num_write_kb":79700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"38'442","reported_seq":581,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.488056+0000","last_change":"2024-04-20T11:00:06.488111+0000","last_active":"2024-04-20T11:00:06.488056+0000","last_peered":"2024-04-20T11:00:06.488056+0000","last_clean":"2024-04-20T11:00:06.488056+0000","last_became_active":"2024-04-20T10:51:20.873636+0000","last_became_peered":"2024-04-20T10:51:20.873636+0000","last_unstale":"2024-04-20T11:00:06.488056+0000","last_undegraded":"2024-04-20T11:00:06.488056+0000","last_fullsized":"2024-04-20T11:00:06.488056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'442","last_scrub_stamp":"2024-04-20T11:00:06.487948+0000","last_deep_scrub":"38'442","last_deep_scrub_stamp":"2024-04-20T11:00:06.487948+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.487948+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:45:40.915418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42670,"num_write":410,"num_write_kb":59228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"38'412","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412265+0000","last_change":"2024-04-20T10:50:49.646614+0000","last_active":"2024-04-20T10:59:30.412265+0000","last_peered":"2024-04-20T10:59:30.412265+0000","last_clean":"2024-04-20T10:59:30.412265+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T10:59:30.412265+0000","last_undegraded":"2024-04-20T10:59:30.412265+0000","last_fullsized":"2024-04-20T10:59:30.412265+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":47914,"num_write":385,"num_write_kb":47165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"38'402","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.462276+0000","last_change":"2024-04-20T11:00:05.462303+0000","last_active":"2024-04-20T11:00:05.462276+0000","last_peered":"2024-04-20T11:00:05.462276+0000","last_clean":"2024-04-20T11:00:05.462276+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T11:00:05.462276+0000","last_undegraded":"2024-04-20T11:00:05.462276+0000","last_fullsized":"2024-04-20T11:00:05.462276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'402","last_scrub_stamp":"2024-04-20T11:00:05.462181+0000","last_deep_scrub":"38'402","last_deep_scrub_stamp":"2024-04-20T11:00:05.462181+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.462181+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:25.614690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":39185,"num_write":369,"num_write_kb":42800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"38'382","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.409030+0000","last_change":"2024-04-20T10:50:49.649683+0000","last_active":"2024-04-20T10:59:30.409030+0000","last_peered":"2024-04-20T10:59:30.409030+0000","last_clean":"2024-04-20T10:59:30.409030+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T10:59:30.409030+0000","last_undegraded":"2024-04-20T10:59:30.409030+0000","last_fullsized":"2024-04-20T10:59:30.409030+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":54933,"num_write":350,"num_write_kb":63813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"37'409","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.308564+0000","last_change":"2024-04-20T10:59:58.308564+0000","last_active":"2024-04-20T10:59:58.308564+0000","last_peered":"2024-04-20T10:59:58.308564+0000","last_clean":"2024-04-20T10:59:58.308564+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:59:58.308564+0000","last_undegraded":"2024-04-20T10:59:58.308564+0000","last_fullsized":"2024-04-20T10:59:58.308564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'409","last_scrub_stamp":"2024-04-20T10:59:58.308407+0000","last_deep_scrub":"37'409","last_deep_scrub_stamp":"2024-04-20T10:59:58.308407+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.308407+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:58:41.349321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":25358,"num_write":380,"num_write_kb":59236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"38'401","reported_seq":511,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.407178+0000","last_change":"2024-04-20T10:50:49.650739+0000","last_active":"2024-04-20T10:59:30.407178+0000","last_peered":"2024-04-20T10:59:30.407178+0000","last_clean":"2024-04-20T10:59:30.407178+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T10:59:30.407178+0000","last_undegraded":"2024-04-20T10:59:30.407178+0000","last_fullsized":"2024-04-20T10:59:30.407178+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":46490,"num_write":386,"num_write_kb":55187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"38'404","reported_seq":547,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.409480+0000","last_change":"2024-04-20T10:50:40.596800+0000","last_active":"2024-04-20T10:59:23.409480+0000","last_peered":"2024-04-20T10:59:23.409480+0000","last_clean":"2024-04-20T10:59:23.409480+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T10:59:23.409480+0000","last_undegraded":"2024-04-20T10:59:23.409480+0000","last_fullsized":"2024-04-20T10:59:23.409480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":60998,"num_write":371,"num_write_kb":104269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"38'390","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.399998+0000","last_change":"2024-04-20T10:50:49.650020+0000","last_active":"2024-04-20T10:59:50.399998+0000","last_peered":"2024-04-20T10:59:50.399998+0000","last_clean":"2024-04-20T10:59:50.399998+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T10:59:50.399998+0000","last_undegraded":"2024-04-20T10:59:50.399998+0000","last_fullsized":"2024-04-20T10:59:50.399998+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":9157,"num_write":355,"num_write_kb":25794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"38'351","reported_seq":489,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.087651+0000","last_change":"2024-04-20T11:00:02.087678+0000","last_active":"2024-04-20T11:00:02.087651+0000","last_peered":"2024-04-20T11:00:02.087651+0000","last_clean":"2024-04-20T11:00:02.087651+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T11:00:02.087651+0000","last_undegraded":"2024-04-20T11:00:02.087651+0000","last_fullsized":"2024-04-20T11:00:02.087651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'351","last_scrub_stamp":"2024-04-20T11:00:02.087560+0000","last_deep_scrub":"38'351","last_deep_scrub_stamp":"2024-04-20T11:00:02.087560+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.087560+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:11.009533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":63467,"num_write":328,"num_write_kb":42600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"38'381","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.492200+0000","last_change":"2024-04-20T10:59:59.492226+0000","last_active":"2024-04-20T10:59:59.492200+0000","last_peered":"2024-04-20T10:59:59.492200+0000","last_clean":"2024-04-20T10:59:59.492200+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:59:59.492200+0000","last_undegraded":"2024-04-20T10:59:59.492200+0000","last_fullsized":"2024-04-20T10:59:59.492200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'381","last_scrub_stamp":"2024-04-20T10:59:59.492101+0000","last_deep_scrub":"38'381","last_deep_scrub_stamp":"2024-04-20T10:59:59.492101+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.492101+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:45:00.353129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":28672,"num_write":342,"num_write_kb":50404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"38'364","reported_seq":493,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.118285+0000","last_change":"2024-04-20T10:59:53.118311+0000","last_active":"2024-04-20T10:59:53.118285+0000","last_peered":"2024-04-20T10:59:53.118285+0000","last_clean":"2024-04-20T10:59:53.118285+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:59:53.118285+0000","last_undegraded":"2024-04-20T10:59:53.118285+0000","last_fullsized":"2024-04-20T10:59:53.118285+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'364","last_scrub_stamp":"2024-04-20T10:59:53.118198+0000","last_deep_scrub":"38'364","last_deep_scrub_stamp":"2024-04-20T10:59:53.118198+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.118198+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:16:12.964786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":12730,"num_write":348,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"38'424","reported_seq":534,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.161644+0000","last_change":"2024-04-20T10:50:49.643723+0000","last_active":"2024-04-20T10:59:52.161644+0000","last_peered":"2024-04-20T10:59:52.161644+0000","last_clean":"2024-04-20T10:59:52.161644+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T10:59:52.161644+0000","last_undegraded":"2024-04-20T10:59:52.161644+0000","last_fullsized":"2024-04-20T10:59:52.161644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":7385,"num_write":393,"num_write_kb":42181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"38'399","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.012274+0000","last_change":"2024-04-20T11:00:11.012301+0000","last_active":"2024-04-20T11:00:11.012274+0000","last_peered":"2024-04-20T11:00:11.012274+0000","last_clean":"2024-04-20T11:00:11.012274+0000","last_became_active":"2024-04-20T10:51:20.769384+0000","last_became_peered":"2024-04-20T10:51:20.769384+0000","last_unstale":"2024-04-20T11:00:11.012274+0000","last_undegraded":"2024-04-20T11:00:11.012274+0000","last_fullsized":"2024-04-20T11:00:11.012274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'399","last_scrub_stamp":"2024-04-20T11:00:11.012168+0000","last_deep_scrub":"38'399","last_deep_scrub_stamp":"2024-04-20T11:00:11.012168+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.012168+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:13.834357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71394,"num_write":379,"num_write_kb":96385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"38'436","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.357439+0000","last_change":"2024-04-20T11:00:00.357439+0000","last_active":"2024-04-20T11:00:00.357439+0000","last_peered":"2024-04-20T11:00:00.357439+0000","last_clean":"2024-04-20T11:00:00.357439+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T11:00:00.357439+0000","last_undegraded":"2024-04-20T11:00:00.357439+0000","last_fullsized":"2024-04-20T11:00:00.357439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'436","last_scrub_stamp":"2024-04-20T11:00:00.357282+0000","last_deep_scrub":"38'436","last_deep_scrub_stamp":"2024-04-20T11:00:00.357282+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.357282+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:42:36.401293+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":70925,"num_write":402,"num_write_kb":100628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"38'423","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.518391+0000","last_change":"2024-04-20T11:00:05.518435+0000","last_active":"2024-04-20T11:00:05.518391+0000","last_peered":"2024-04-20T11:00:05.518391+0000","last_clean":"2024-04-20T11:00:05.518391+0000","last_became_active":"2024-04-20T10:51:20.841719+0000","last_became_peered":"2024-04-20T10:51:20.841719+0000","last_unstale":"2024-04-20T11:00:05.518391+0000","last_undegraded":"2024-04-20T11:00:05.518391+0000","last_fullsized":"2024-04-20T11:00:05.518391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T11:00:05.518287+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T11:00:05.518287+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.518287+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:01:11.628419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":49916,"num_write":398,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"38'473","reported_seq":606,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.636981+0000","last_change":"2024-04-20T10:50:49.649647+0000","last_active":"2024-04-20T10:59:28.636981+0000","last_peered":"2024-04-20T10:59:28.636981+0000","last_clean":"2024-04-20T10:59:28.636981+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T10:59:28.636981+0000","last_undegraded":"2024-04-20T10:59:28.636981+0000","last_fullsized":"2024-04-20T10:59:28.636981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":134201,"num_write":442,"num_write_kb":141769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"38'414","reported_seq":597,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.762373+0000","last_change":"2024-04-20T10:59:55.762419+0000","last_active":"2024-04-20T10:59:55.762373+0000","last_peered":"2024-04-20T10:59:55.762373+0000","last_clean":"2024-04-20T10:59:55.762373+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:59:55.762373+0000","last_undegraded":"2024-04-20T10:59:55.762373+0000","last_fullsized":"2024-04-20T10:59:55.762373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'414","last_scrub_stamp":"2024-04-20T10:59:55.762247+0000","last_deep_scrub":"38'414","last_deep_scrub_stamp":"2024-04-20T10:59:55.762247+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.762247+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:33:15.411877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":129245,"num_write":382,"num_write_kb":126738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"38'443","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.008739+0000","last_change":"2024-04-20T11:00:10.008766+0000","last_active":"2024-04-20T11:00:10.008739+0000","last_peered":"2024-04-20T11:00:10.008739+0000","last_clean":"2024-04-20T11:00:10.008739+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T11:00:10.008739+0000","last_undegraded":"2024-04-20T11:00:10.008739+0000","last_fullsized":"2024-04-20T11:00:10.008739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'443","last_scrub_stamp":"2024-04-20T11:00:10.008650+0000","last_deep_scrub":"38'443","last_deep_scrub_stamp":"2024-04-20T11:00:10.008650+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.008650+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:31:51.202975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":98132,"num_write":412,"num_write_kb":88980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"38'431","reported_seq":580,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:23.407981+0000","last_change":"2024-04-20T10:50:40.592077+0000","last_active":"2024-04-20T10:59:23.407981+0000","last_peered":"2024-04-20T10:59:23.407981+0000","last_clean":"2024-04-20T10:59:23.407981+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T10:59:23.407981+0000","last_undegraded":"2024-04-20T10:59:23.407981+0000","last_fullsized":"2024-04-20T10:59:23.407981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:39.558778+0000","last_clean_scrub_stamp":"2024-04-20T10:50:39.558778+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":82367,"num_write":405,"num_write_kb":88791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"38'369","reported_seq":470,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.412127+0000","last_change":"2024-04-20T10:50:49.655019+0000","last_active":"2024-04-20T10:59:30.412127+0000","last_peered":"2024-04-20T10:59:30.412127+0000","last_clean":"2024-04-20T10:59:30.412127+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T10:59:30.412127+0000","last_undegraded":"2024-04-20T10:59:30.412127+0000","last_fullsized":"2024-04-20T10:59:30.412127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":17428,"num_write":337,"num_write_kb":30562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"38'375","reported_seq":492,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.344474+0000","last_change":"2024-04-20T10:59:57.344503+0000","last_active":"2024-04-20T10:59:57.344474+0000","last_peered":"2024-04-20T10:59:57.344474+0000","last_clean":"2024-04-20T10:59:57.344474+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:59:57.344474+0000","last_undegraded":"2024-04-20T10:59:57.344474+0000","last_fullsized":"2024-04-20T10:59:57.344474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T10:59:57.344362+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T10:59:57.344362+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.344362+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:32.382346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":12288,"num_write":347,"num_write_kb":45028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"38'368","reported_seq":471,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:28.646963+0000","last_change":"2024-04-20T10:50:49.653574+0000","last_active":"2024-04-20T10:59:28.646963+0000","last_peered":"2024-04-20T10:59:28.646963+0000","last_clean":"2024-04-20T10:59:28.646963+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T10:59:28.646963+0000","last_undegraded":"2024-04-20T10:59:28.646963+0000","last_fullsized":"2024-04-20T10:59:28.646963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":42400,"num_write":337,"num_write_kb":50456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"38'435","reported_seq":594,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.805148+0000","last_change":"2024-04-20T11:00:03.805192+0000","last_active":"2024-04-20T11:00:03.805148+0000","last_peered":"2024-04-20T11:00:03.805148+0000","last_clean":"2024-04-20T11:00:03.805148+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T11:00:03.805148+0000","last_undegraded":"2024-04-20T11:00:03.805148+0000","last_fullsized":"2024-04-20T11:00:03.805148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'435","last_scrub_stamp":"2024-04-20T11:00:03.805023+0000","last_deep_scrub":"38'435","last_deep_scrub_stamp":"2024-04-20T11:00:03.805023+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.805023+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:26.033510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":60266,"num_write":401,"num_write_kb":64358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"38'402","reported_seq":520,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.410555+0000","last_change":"2024-04-20T10:50:49.653519+0000","last_active":"2024-04-20T10:59:30.410555+0000","last_peered":"2024-04-20T10:59:30.410555+0000","last_clean":"2024-04-20T10:59:30.410555+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T10:59:30.410555+0000","last_undegraded":"2024-04-20T10:59:30.410555+0000","last_fullsized":"2024-04-20T10:59:30.410555+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58110,"num_write":372,"num_write_kb":67566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"38'410","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.317036+0000","last_change":"2024-04-20T10:59:54.317060+0000","last_active":"2024-04-20T10:59:54.317036+0000","last_peered":"2024-04-20T10:59:54.317036+0000","last_clean":"2024-04-20T10:59:54.317036+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:59:54.317036+0000","last_undegraded":"2024-04-20T10:59:54.317036+0000","last_fullsized":"2024-04-20T10:59:54.317036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'410","last_scrub_stamp":"2024-04-20T10:59:54.316952+0000","last_deep_scrub":"38'410","last_deep_scrub_stamp":"2024-04-20T10:59:54.316952+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.316952+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:08:37.196593+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":40406,"num_write":376,"num_write_kb":72310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"38'423","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.499172+0000","last_change":"2024-04-20T10:59:50.499195+0000","last_active":"2024-04-20T10:59:50.499172+0000","last_peered":"2024-04-20T10:59:50.499172+0000","last_clean":"2024-04-20T10:59:50.499172+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:59:50.499172+0000","last_undegraded":"2024-04-20T10:59:50.499172+0000","last_fullsized":"2024-04-20T10:59:50.499172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T10:59:50.499090+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T10:59:50.499090+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.499090+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:04:26.944875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48634,"num_write":394,"num_write_kb":56270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"37'391","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.243094+0000","last_change":"2024-04-20T10:59:56.243120+0000","last_active":"2024-04-20T10:59:56.243094+0000","last_peered":"2024-04-20T10:59:56.243094+0000","last_clean":"2024-04-20T10:59:56.243094+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:59:56.243094+0000","last_undegraded":"2024-04-20T10:59:56.243094+0000","last_fullsized":"2024-04-20T10:59:56.243094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'391","last_scrub_stamp":"2024-04-20T10:59:56.242973+0000","last_deep_scrub":"37'391","last_deep_scrub_stamp":"2024-04-20T10:59:56.242973+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.242973+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:51:53.884083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":67210,"num_write":369,"num_write_kb":63933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"38'365","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.860648+0000","last_change":"2024-04-20T10:59:58.860685+0000","last_active":"2024-04-20T10:59:58.860648+0000","last_peered":"2024-04-20T10:59:58.860648+0000","last_clean":"2024-04-20T10:59:58.860648+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:59:58.860648+0000","last_undegraded":"2024-04-20T10:59:58.860648+0000","last_fullsized":"2024-04-20T10:59:58.860648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'365","last_scrub_stamp":"2024-04-20T10:59:58.860552+0000","last_deep_scrub":"38'365","last_deep_scrub_stamp":"2024-04-20T10:59:58.860552+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.860552+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:48.643172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":38197,"num_write":324,"num_write_kb":43133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'436","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.451416+0000","last_change":"2024-04-20T10:59:56.451442+0000","last_active":"2024-04-20T10:59:56.451416+0000","last_peered":"2024-04-20T10:59:56.451416+0000","last_clean":"2024-04-20T10:59:56.451416+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:59:56.451416+0000","last_undegraded":"2024-04-20T10:59:56.451416+0000","last_fullsized":"2024-04-20T10:59:56.451416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'436","last_scrub_stamp":"2024-04-20T10:59:56.451306+0000","last_deep_scrub":"37'436","last_deep_scrub_stamp":"2024-04-20T10:59:56.451306+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.451306+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:42.807674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":82231,"num_write":413,"num_write_kb":104966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"38'435","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:30.409316+0000","last_change":"2024-04-20T10:50:49.641941+0000","last_active":"2024-04-20T10:59:30.409316+0000","last_peered":"2024-04-20T10:59:30.409316+0000","last_clean":"2024-04-20T10:59:30.409316+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T10:59:30.409316+0000","last_undegraded":"2024-04-20T10:59:30.409316+0000","last_fullsized":"2024-04-20T10:59:30.409316+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-20T10:50:48.619068+0000","last_clean_scrub_stamp":"2024-04-20T10:50:48.619068+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78016,"num_write":409,"num_write_kb":101239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"37'379","reported_seq":507,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.865451+0000","last_change":"2024-04-20T10:59:59.865476+0000","last_active":"2024-04-20T10:59:59.865451+0000","last_peered":"2024-04-20T10:59:59.865451+0000","last_clean":"2024-04-20T10:59:59.865451+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:59:59.865451+0000","last_undegraded":"2024-04-20T10:59:59.865451+0000","last_fullsized":"2024-04-20T10:59:59.865451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'379","last_scrub_stamp":"2024-04-20T10:59:59.865351+0000","last_deep_scrub":"37'379","last_deep_scrub_stamp":"2024-04-20T10:59:59.865351+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.865351+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:00:41.399695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":25535,"num_write":356,"num_write_kb":38136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4810,"num_read_kb":3595152,"num_write":24379,"num_write_kb":4256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26481,"ondisk_log_size":26481,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":149799849,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":809,"num_read_kb":507129,"num_write":8087,"num_write_kb":153177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299663360,"data_stored":299599698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9529,"ondisk_log_size":9529,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5724,"num_read_kb":3353332,"num_write":24442,"num_write_kb":4400565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26386,"ondisk_log_size":26386,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151049924,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":699,"num_read_kb":394566,"num_write":7753,"num_write_kb":153910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302161920,"data_stored":302099848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9214,"ondisk_log_size":9214,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574968,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126660,"kb_used_data":77436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94245180,"statfs":{"total":96636764160,"available":96507064320,"internally_reserved":0,"allocated":79294464,"data_stored":79053723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574968,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130184,"kb_used_data":80960,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94241656,"statfs":{"total":96636764160,"available":96503455744,"internally_reserved":0,"allocated":82903040,"data_stored":82658275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123880,"kb_used_data":52512,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94247960,"statfs":{"total":96636764160,"available":96509911040,"internally_reserved":0,"allocated":53772288,"data_stored":53529724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574969,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177172,"kb_used_data":96076,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94194668,"statfs":{"total":96636764160,"available":96455340032,"internally_reserved":0,"allocated":98381824,"data_stored":98133898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574969,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185380,"kb_used_data":104284,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94186460,"statfs":{"total":96636764160,"available":96446935040,"internally_reserved":0,"allocated":106786816,"data_stored":106540719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574969,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71508,"kb_used_data":26444,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94300332,"statfs":{"total":96636764160,"available":96563539968,"internally_reserved":0,"allocated":27078656,"data_stored":26847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193688,"kb_used_data":108432,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94178152,"statfs":{"total":96636764160,"available":96438427648,"internally_reserved":0,"allocated":111034368,"data_stored":110784971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574968,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95288,"kb_used_data":46064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94276552,"statfs":{"total":96636764160,"available":96539189248,"internally_reserved":0,"allocated":47169536,"data_stored":46927925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14065664,"data_stored":14065090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35045376,"data_stored":35037282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48914432,"data_stored":48903652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57298944,"data_stored":57292170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":68657152,"data_stored":68642196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51796853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23982080,"data_stored":23969931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T11:00:12.908 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.909 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.909 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.909 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.909 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.909 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.910 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.910 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.910 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.910 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.911 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.911 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.911 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.911 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.912 INFO:tasks.ceph:pgid 5.24 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.912 INFO:tasks.ceph:pgid 5.25 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.912 INFO:tasks.ceph:pgid 5.20 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.912 INFO:tasks.ceph:pgid 5.2e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.912 INFO:tasks.ceph:pgid 5.2f last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.912 INFO:tasks.ceph:pgid 5.2d last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.913 INFO:tasks.ceph:pgid 5.28 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.913 INFO:tasks.ceph:pgid 5.29 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.913 INFO:tasks.ceph:pgid 5.37 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.913 INFO:tasks.ceph:pgid 5.34 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.913 INFO:tasks.ceph:pgid 5.35 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.913 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.913 INFO:tasks.ceph:pgid 5.32 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.914 INFO:tasks.ceph:pgid 5.30 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.914 INFO:tasks.ceph:pgid 5.3e last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.914 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-20T10:50:39.558778+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=39, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.914 INFO:tasks.ceph:pgid 5.3c last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.914 INFO:tasks.ceph:pgid 5.3d last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.918 INFO:tasks.ceph:pgid 5.3a last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.919 INFO:tasks.ceph:pgid 5.39 last_scrub_stamp 2024-04-20T10:50:48.619068+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=50, tm_sec=48, tm_wday=5, tm_yday=111, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=20, tm_hour=10, tm_min=59, tm_sec=47, tm_wday=5, tm_yday=111, tm_isdst=0) 2024-04-20T11:00:12.919 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-20T11:00:12.979 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:12.982 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:32.920 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-20T11:00:33.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.029+0000 7fe831e26640 1 Processor -- start 2024-04-20T11:00:33.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.029+0000 7fe831e26640 1 -- start start 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe831e26640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fe82c0c27a0 0x7fe82c1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe831e26640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 0x7fe82c0ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe831e26640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82c071690 con 0x7fe82c15a4e0 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe831e26640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c071970 con 0x7fe82c0c27a0 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe831e26640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c159ce0 con 0x7fe82c0c54d0 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe82bfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fe82c15a4e0 0x7fe82c153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:33574/0 (socket says 172.21.15.90:33574) 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe82bfff640 1 -- 172.21.15.90:0/2450025500 learned_addr learned my addr 172.21.15.90:0/2450025500 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe82affd640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 0x7fe82c0ad640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016579186 0 0) 0x7fe82c071690 con 0x7fe82c15a4e0 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/2450025500 >> v2:172.21.15.175:3300/0 conn(0x7fe82c0c27a0 0x7fe82c1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.030+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe814003520 con 0x7fe82c15a4e0 2024-04-20T11:00:33.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 441729582 0 0) 0x7fe814003520 con 0x7fe82c15a4e0 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 msgr2=0x7fe82c0ad640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 0x7fe82c0ad640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 >> v2:172.21.15.175:3300/0 conn(0x7fe82c0c27a0 msgr2=0x7fe82c1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 --2- 172.21.15.90:0/2450025500 >> v2:172.21.15.175:3300/0 conn(0x7fe82c0c27a0 0x7fe82c1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c159fc0 con 0x7fe82c15a4e0 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7fe8240019f0 con 0x7fe82c15a4e0 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 >> v1:172.21.15.90:6789/0 conn(0x7fe82c15a4e0 legacy=0x7fe82c153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe814003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe814004800 0x7fe814004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 0x7fe8140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c071970 con 0x7fe8140039b0 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c159ce0 con 0x7fe814004800 2024-04-20T11:00:33.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe81400b9c0 con 0x7fe82c0c54d0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe814003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82bfff640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 0x7fe8140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82affd640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe814004800 0x7fe814004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82b7fe640 1 -- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 msgr2=0x7fe8140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c0c54d0 0x7fe8140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82b7fe640 1 -- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe814004800 msgr2=0x7fe814004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe814004800 0x7fe814004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.031+0000 7fe82b7fe640 1 -- 172.21.15.90:0/2450025500 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe814003520 con 0x7fe8140039b0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe814003dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009ac0 tx=0x7fe814005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94cf055c7398466c server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c039070 con 0x7fe8140039b0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c02c710 con 0x7fe8140039b0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe82a7fc640 1 -- 172.21.15.90:0/2450025500 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c009690 con 0x7fe8140039b0 2024-04-20T11:00:33.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe831e26640 1 -- 172.21.15.90:0/2450025500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 msgr2=0x7fe814003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe831e26640 1 --2- 172.21.15.90:0/2450025500 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe814003dd0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fe81c009ac0 tx=0x7fe814005830 comp rx=0 tx=0).stop 2024-04-20T11:00:33.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe82bfff640 1 -- 172.21.15.90:0/2450025500 reap_dead start 2024-04-20T11:00:33.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe831e26640 1 -- 172.21.15.90:0/2450025500 shutdown_connections 2024-04-20T11:00:33.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe831e26640 1 -- 172.21.15.90:0/2450025500 >> 172.21.15.90:0/2450025500 conn(0x7fe82c0c9100 msgr2=0x7fe82c0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:33.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe831e26640 1 -- 172.21.15.90:0/2450025500 shutdown_connections 2024-04-20T11:00:33.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.032+0000 7fe831e26640 1 -- 172.21.15.90:0/2450025500 wait complete. 2024-04-20T11:00:33.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 Processor -- start 2024-04-20T11:00:33.038 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 -- start start 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe82c071c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82c152e40 0x7fe82c0c6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c13faa0 0x7fe82c151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0c2d00 con 0x7fe8140039b0 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0c2b80 con 0x7fe82c152e40 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.034+0000 7fe831e26640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c15a940 con 0x7fe82c13faa0 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe82c071c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe82c071c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47422/0 (socket says 172.21.15.90:47422) 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 -- 172.21.15.90:0/52205596 learned_addr learned my addr 172.21.15.90:0/52205596 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82affd640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82c152e40 0x7fe82c0c6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82bfff640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c13faa0 0x7fe82c151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 -- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c13faa0 msgr2=0x7fe82c151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c13faa0 0x7fe82c151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.039 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 -- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82c152e40 msgr2=0x7fe82c0c6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82c152e40 0x7fe82c0c6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 -- 172.21.15.90:0/52205596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c1eff50 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe82b7fe640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe82c071c30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c00 tx=0x7fe81c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe813fff640 1 -- 172.21.15.90:0/52205596 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c039050 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe813fff640 1 -- 172.21.15.90:0/52205596 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c045070 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c073810 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe813fff640 1 -- 172.21.15.90:0/52205596 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c0044e0 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.035+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c0c8730 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.036+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c073bf0 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.037+0000 7fe813fff640 1 -- 172.21.15.90:0/52205596 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe81c003a50 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.037+0000 7fe813fff640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe81806c920 0x7fe81806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.037+0000 7fe813fff640 1 -- 172.21.15.90:0/52205596 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fe81c0adc70 con 0x7fe8140039b0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.037+0000 7fe82affd640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe81806c920 0x7fe81806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.040 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.038+0000 7fe82affd640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe81806c920 0x7fe81806ede0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe82c14d2a0 tx=0x7fe820008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.042 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.042+0000 7fe813fff640 1 -- 172.21.15.90:0/52205596 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fe82c073bf0 con 0x7fe8140039b0 2024-04-20T11:00:33.216 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.216+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 --> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe82c073650 con 0x7fe81806c920 2024-04-20T11:00:33.226 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.227+0000 7fe813fff640 1 -- 172.21.15.90:0/52205596 <== mgr.4107 v2:172.21.15.90:6832/1738105048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+495522 (secure 0 0 0) 0x7fe820014a90 con 0x7fe81806c920 2024-04-20T11:00:33.232 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:33.235 INFO:teuthology.orchestra.run.smithi090.stderr:dumped all 2024-04-20T11:00:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe81806c920 msgr2=0x7fe81806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe81806c920 0x7fe81806ede0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fe82c14d2a0 tx=0x7fe820008040 comp rx=0 tx=0).stop 2024-04-20T11:00:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 msgr2=0x7fe82c071c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe82c071c30 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fe81c000c00 tx=0x7fe81c004730 comp rx=0 tx=0).stop 2024-04-20T11:00:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 shutdown_connections 2024-04-20T11:00:33.237 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fe81806c920 0x7fe81806ede0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fe82c13faa0 0x7fe82c151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fe82c152e40 0x7fe82c0c6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 --2- 172.21.15.90:0/52205596 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fe8140039b0 0x7fe82c071c30 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 >> 172.21.15.90:0/52205596 conn(0x7fe82c0c9100 msgr2=0x7fe82c14be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 shutdown_connections 2024-04-20T11:00:33.238 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.231+0000 7fe831e26640 1 -- 172.21.15.90:0/52205596 wait complete. 2024-04-20T11:00:33.243 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":334,"stamp":"2024-04-20T11:00:31.821071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":301440141,"num_objects":118,"num_object_clones":0,"num_object_copies":236,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":118,"num_whiteouts":0,"num_read":12158,"num_read_kb":7850279,"num_write":64820,"num_write_kb":8966796,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":10000,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":71729,"ondisk_log_size":71729,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1103760,"kb_used_data":592208,"kb_used_omap":12,"kb_used_meta":511475,"kb_avail":753870960,"statfs":{"total":773094113280,"available":771963863040,"internally_reserved":0,"allocated":606420992,"data_stored":604476882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":523750960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004081"},"pg_stats":[{"pgid":"5.18","version":"38'433","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.218087+0000","last_change":"2024-04-20T11:00:07.218087+0000","last_active":"2024-04-20T11:00:07.218087+0000","last_peered":"2024-04-20T11:00:07.218087+0000","last_clean":"2024-04-20T11:00:07.218087+0000","last_became_active":"2024-04-20T10:50:49.639398+0000","last_became_peered":"2024-04-20T10:50:49.639398+0000","last_unstale":"2024-04-20T11:00:07.218087+0000","last_undegraded":"2024-04-20T11:00:07.218087+0000","last_fullsized":"2024-04-20T11:00:07.218087+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'433","last_scrub_stamp":"2024-04-20T11:00:07.217973+0000","last_deep_scrub":"38'433","last_deep_scrub_stamp":"2024-04-20T11:00:07.217973+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.217973+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:07:54.082349+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":22795,"num_write":399,"num_write_kb":54919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"38'88","reported_seq":164,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.287547+0000","last_change":"2024-04-20T10:59:55.287587+0000","last_active":"2024-04-20T10:59:55.287547+0000","last_peered":"2024-04-20T10:59:55.287547+0000","last_clean":"2024-04-20T10:59:55.287547+0000","last_became_active":"2024-04-20T10:50:39.577633+0000","last_became_peered":"2024-04-20T10:50:39.577633+0000","last_unstale":"2024-04-20T10:59:55.287547+0000","last_undegraded":"2024-04-20T10:59:55.287547+0000","last_fullsized":"2024-04-20T10:59:55.287547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'88","last_scrub_stamp":"2024-04-20T10:59:55.287453+0000","last_deep_scrub":"38'88","last_deep_scrub_stamp":"2024-04-20T10:59:55.287453+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.287453+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:00:15.631906+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":25,"num_read_kb":13987,"num_write":27,"num_write_kb":4118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"38'408","reported_seq":564,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.756053+0000","last_change":"2024-04-20T11:00:03.756078+0000","last_active":"2024-04-20T11:00:03.756053+0000","last_peered":"2024-04-20T11:00:03.756053+0000","last_clean":"2024-04-20T11:00:03.756053+0000","last_became_active":"2024-04-20T10:50:40.596957+0000","last_became_peered":"2024-04-20T10:50:40.596957+0000","last_unstale":"2024-04-20T11:00:03.756053+0000","last_undegraded":"2024-04-20T11:00:03.756053+0000","last_fullsized":"2024-04-20T11:00:03.756053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'408","last_scrub_stamp":"2024-04-20T11:00:03.755958+0000","last_deep_scrub":"38'408","last_deep_scrub_stamp":"2024-04-20T11:00:03.755958+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.755958+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:03:42.435032+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":85574,"num_write":384,"num_write_kb":89655,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"38'169","reported_seq":224,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.774851+0000","last_change":"2024-04-20T10:59:53.774851+0000","last_active":"2024-04-20T10:59:53.774851+0000","last_peered":"2024-04-20T10:59:53.774851+0000","last_clean":"2024-04-20T10:59:53.774851+0000","last_became_active":"2024-04-20T10:50:48.633330+0000","last_became_peered":"2024-04-20T10:50:48.633330+0000","last_unstale":"2024-04-20T10:59:53.774851+0000","last_undegraded":"2024-04-20T10:59:53.774851+0000","last_fullsized":"2024-04-20T10:59:53.774851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'169","last_scrub_stamp":"2024-04-20T10:59:53.774697+0000","last_deep_scrub":"38'169","last_deep_scrub_stamp":"2024-04-20T10:59:53.774697+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.774697+0000","objects_scrubbed":1,"log_size":169,"log_dups_size":0,"ondisk_log_size":169,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:57:37.863234+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":115,"num_write_kb":4155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"38'459","reported_seq":584,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.454957+0000","last_change":"2024-04-20T11:00:09.454957+0000","last_active":"2024-04-20T11:00:09.454957+0000","last_peered":"2024-04-20T11:00:09.454957+0000","last_clean":"2024-04-20T11:00:09.454957+0000","last_became_active":"2024-04-20T10:50:49.653535+0000","last_became_peered":"2024-04-20T10:50:49.653535+0000","last_unstale":"2024-04-20T11:00:09.454957+0000","last_undegraded":"2024-04-20T11:00:09.454957+0000","last_fullsized":"2024-04-20T11:00:09.454957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'459","last_scrub_stamp":"2024-04-20T11:00:09.454826+0000","last_deep_scrub":"38'459","last_deep_scrub_stamp":"2024-04-20T11:00:09.454826+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.454826+0000","objects_scrubbed":0,"log_size":459,"log_dups_size":0,"ondisk_log_size":459,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:42:49.769924+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":79973,"num_write":429,"num_write_kb":121385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"38'194","reported_seq":258,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.772588+0000","last_change":"2024-04-20T11:00:05.772622+0000","last_active":"2024-04-20T11:00:05.772588+0000","last_peered":"2024-04-20T11:00:05.772588+0000","last_clean":"2024-04-20T11:00:05.772588+0000","last_became_active":"2024-04-20T10:50:39.579238+0000","last_became_peered":"2024-04-20T10:50:39.579238+0000","last_unstale":"2024-04-20T11:00:05.772588+0000","last_undegraded":"2024-04-20T11:00:05.772588+0000","last_fullsized":"2024-04-20T11:00:05.772588+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'194","last_scrub_stamp":"2024-04-20T11:00:05.772495+0000","last_deep_scrub":"38'194","last_deep_scrub_stamp":"2024-04-20T11:00:05.772495+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.772495+0000","objects_scrubbed":1,"log_size":194,"log_dups_size":0,"ondisk_log_size":194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:01:39.715885+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":130,"num_write_kb":4218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"37'359","reported_seq":485,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.338790+0000","last_change":"2024-04-20T10:59:50.338832+0000","last_active":"2024-04-20T10:59:50.338790+0000","last_peered":"2024-04-20T10:59:50.338790+0000","last_clean":"2024-04-20T10:59:50.338790+0000","last_became_active":"2024-04-20T10:50:40.604870+0000","last_became_peered":"2024-04-20T10:50:40.604870+0000","last_unstale":"2024-04-20T10:59:50.338790+0000","last_undegraded":"2024-04-20T10:59:50.338790+0000","last_fullsized":"2024-04-20T10:59:50.338790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'359","last_scrub_stamp":"2024-04-20T10:59:50.338704+0000","last_deep_scrub":"37'359","last_deep_scrub_stamp":"2024-04-20T10:59:50.338704+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.338704+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:27:04.796609+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":24250,"num_write":339,"num_write_kb":58188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"38'924","reported_seq":985,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.093652+0000","last_change":"2024-04-20T10:59:57.093652+0000","last_active":"2024-04-20T10:59:57.093652+0000","last_peered":"2024-04-20T10:59:57.093652+0000","last_clean":"2024-04-20T10:59:57.093652+0000","last_became_active":"2024-04-20T10:50:48.637418+0000","last_became_peered":"2024-04-20T10:50:48.637418+0000","last_unstale":"2024-04-20T10:59:57.093652+0000","last_undegraded":"2024-04-20T10:59:57.093652+0000","last_fullsized":"2024-04-20T10:59:57.093652+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'924","last_scrub_stamp":"2024-04-20T10:59:57.093480+0000","last_deep_scrub":"38'924","last_deep_scrub_stamp":"2024-04-20T10:59:57.093480+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.093480+0000","objects_scrubbed":2,"log_size":924,"log_dups_size":0,"ondisk_log_size":924,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:06:55.311625+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":28672,"num_write":852,"num_write_kb":8691,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"38'405","reported_seq":515,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:15.779343+0000","last_change":"2024-04-20T11:00:15.779370+0000","last_active":"2024-04-20T11:00:15.779343+0000","last_peered":"2024-04-20T11:00:15.779343+0000","last_clean":"2024-04-20T11:00:15.779343+0000","last_became_active":"2024-04-20T10:50:49.646587+0000","last_became_peered":"2024-04-20T10:50:49.646587+0000","last_unstale":"2024-04-20T11:00:15.779343+0000","last_undegraded":"2024-04-20T11:00:15.779343+0000","last_fullsized":"2024-04-20T11:00:15.779343+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'405","last_scrub_stamp":"2024-04-20T11:00:15.779242+0000","last_deep_scrub":"38'405","last_deep_scrub_stamp":"2024-04-20T11:00:15.779242+0000","last_clean_scrub_stamp":"2024-04-20T11:00:15.779242+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:56:52.662447+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":43507,"num_write":372,"num_write_kb":54374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"38'375","reported_seq":453,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.846679+0000","last_change":"2024-04-20T11:00:05.846838+0000","last_active":"2024-04-20T11:00:05.846679+0000","last_peered":"2024-04-20T11:00:05.846679+0000","last_clean":"2024-04-20T11:00:05.846679+0000","last_became_active":"2024-04-20T10:50:39.578015+0000","last_became_peered":"2024-04-20T10:50:39.578015+0000","last_unstale":"2024-04-20T11:00:05.846679+0000","last_undegraded":"2024-04-20T11:00:05.846679+0000","last_fullsized":"2024-04-20T11:00:05.846679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T11:00:05.846582+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T11:00:05.846582+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.846582+0000","objects_scrubbed":4,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:28:53.576712+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":32,"num_read_kb":45077,"num_write":302,"num_write_kb":12484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"37'401","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.109337+0000","last_change":"2024-04-20T11:00:11.109373+0000","last_active":"2024-04-20T11:00:11.109337+0000","last_peered":"2024-04-20T11:00:11.109337+0000","last_clean":"2024-04-20T11:00:11.109337+0000","last_became_active":"2024-04-20T10:50:40.598211+0000","last_became_peered":"2024-04-20T10:50:40.598211+0000","last_unstale":"2024-04-20T11:00:11.109337+0000","last_undegraded":"2024-04-20T11:00:11.109337+0000","last_fullsized":"2024-04-20T11:00:11.109337+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'401","last_scrub_stamp":"2024-04-20T11:00:11.109244+0000","last_deep_scrub":"37'401","last_deep_scrub_stamp":"2024-04-20T11:00:11.109244+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.109244+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:32:19.637911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":103995,"num_write":369,"num_write_kb":100717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"38'160","reported_seq":218,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.110605+0000","last_change":"2024-04-20T10:59:54.110645+0000","last_active":"2024-04-20T10:59:54.110605+0000","last_peered":"2024-04-20T10:59:54.110605+0000","last_clean":"2024-04-20T10:59:54.110605+0000","last_became_active":"2024-04-20T10:50:48.641670+0000","last_became_peered":"2024-04-20T10:50:48.641670+0000","last_unstale":"2024-04-20T10:59:54.110605+0000","last_undegraded":"2024-04-20T10:59:54.110605+0000","last_fullsized":"2024-04-20T10:59:54.110605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'160","last_scrub_stamp":"2024-04-20T10:59:54.110508+0000","last_deep_scrub":"38'160","last_deep_scrub_stamp":"2024-04-20T10:59:54.110508+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.110508+0000","objects_scrubbed":1,"log_size":160,"log_dups_size":0,"ondisk_log_size":160,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:59:23.527874+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":20490,"num_write":105,"num_write_kb":4178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"38'368","reported_seq":483,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:15.048255+0000","last_change":"2024-04-20T11:00:15.048277+0000","last_active":"2024-04-20T11:00:15.048255+0000","last_peered":"2024-04-20T11:00:15.048255+0000","last_clean":"2024-04-20T11:00:15.048255+0000","last_became_active":"2024-04-20T10:50:49.648975+0000","last_became_peered":"2024-04-20T10:50:49.648975+0000","last_unstale":"2024-04-20T11:00:15.048255+0000","last_undegraded":"2024-04-20T11:00:15.048255+0000","last_fullsized":"2024-04-20T11:00:15.048255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'368","last_scrub_stamp":"2024-04-20T11:00:15.048149+0000","last_deep_scrub":"38'368","last_deep_scrub_stamp":"2024-04-20T11:00:15.048149+0000","last_clean_scrub_stamp":"2024-04-20T11:00:15.048149+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:20:37.241907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":53969,"num_write":336,"num_write_kb":42442,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"38'69","reported_seq":140,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.894813+0000","last_change":"2024-04-20T11:00:10.894850+0000","last_active":"2024-04-20T11:00:10.894813+0000","last_peered":"2024-04-20T11:00:10.894813+0000","last_clean":"2024-04-20T11:00:10.894813+0000","last_became_active":"2024-04-20T10:50:39.586880+0000","last_became_peered":"2024-04-20T10:50:39.586880+0000","last_unstale":"2024-04-20T11:00:10.894813+0000","last_undegraded":"2024-04-20T11:00:10.894813+0000","last_fullsized":"2024-04-20T11:00:10.894813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'69","last_scrub_stamp":"2024-04-20T11:00:10.894709+0000","last_deep_scrub":"38'69","last_deep_scrub_stamp":"2024-04-20T11:00:10.894709+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.894709+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:52:24.141490+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":25,"num_read_kb":8317,"num_write":19,"num_write_kb":4128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"38'375","reported_seq":510,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.117573+0000","last_change":"2024-04-20T11:00:10.117597+0000","last_active":"2024-04-20T11:00:10.117573+0000","last_peered":"2024-04-20T11:00:10.117573+0000","last_clean":"2024-04-20T11:00:10.117573+0000","last_became_active":"2024-04-20T10:50:40.597604+0000","last_became_peered":"2024-04-20T10:50:40.597604+0000","last_unstale":"2024-04-20T11:00:10.117573+0000","last_undegraded":"2024-04-20T11:00:10.117573+0000","last_fullsized":"2024-04-20T11:00:10.117573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T11:00:10.117479+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T11:00:10.117479+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.117479+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:01:54.717660+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":27688,"num_write":341,"num_write_kb":72358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"38'662","reported_seq":724,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.113400+0000","last_change":"2024-04-20T10:59:51.113432+0000","last_active":"2024-04-20T10:59:51.113400+0000","last_peered":"2024-04-20T10:59:51.113400+0000","last_clean":"2024-04-20T10:59:51.113400+0000","last_became_active":"2024-04-20T10:50:48.640374+0000","last_became_peered":"2024-04-20T10:50:48.640374+0000","last_unstale":"2024-04-20T10:59:51.113400+0000","last_undegraded":"2024-04-20T10:59:51.113400+0000","last_fullsized":"2024-04-20T10:59:51.113400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'662","last_scrub_stamp":"2024-04-20T10:59:51.113312+0000","last_deep_scrub":"38'662","last_deep_scrub_stamp":"2024-04-20T10:59:51.113312+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.113312+0000","objects_scrubbed":3,"log_size":662,"log_dups_size":0,"ondisk_log_size":662,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:48:48.384673+0000","scrub_duration":25,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":10,"num_read_kb":36433,"num_write":605,"num_write_kb":12615,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"38'446","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.414053+0000","last_change":"2024-04-20T11:00:10.414092+0000","last_active":"2024-04-20T11:00:10.414053+0000","last_peered":"2024-04-20T11:00:10.414053+0000","last_clean":"2024-04-20T11:00:10.414053+0000","last_became_active":"2024-04-20T10:50:49.654272+0000","last_became_peered":"2024-04-20T10:50:49.654272+0000","last_unstale":"2024-04-20T11:00:10.414053+0000","last_undegraded":"2024-04-20T11:00:10.414053+0000","last_fullsized":"2024-04-20T11:00:10.414053+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'446","last_scrub_stamp":"2024-04-20T11:00:10.413966+0000","last_deep_scrub":"38'446","last_deep_scrub_stamp":"2024-04-20T11:00:10.413966+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.413966+0000","objects_scrubbed":0,"log_size":446,"log_dups_size":0,"ondisk_log_size":446,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:50:11.720903+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":68359,"num_write":412,"num_write_kb":83650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"38'451","reported_seq":610,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.100054+0000","last_change":"2024-04-20T10:59:55.100079+0000","last_active":"2024-04-20T10:59:55.100054+0000","last_peered":"2024-04-20T10:59:55.100054+0000","last_clean":"2024-04-20T10:59:55.100054+0000","last_became_active":"2024-04-20T10:50:40.603705+0000","last_became_peered":"2024-04-20T10:50:40.603705+0000","last_unstale":"2024-04-20T10:59:55.100054+0000","last_undegraded":"2024-04-20T10:59:55.100054+0000","last_fullsized":"2024-04-20T10:59:55.100054+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T10:59:55.099962+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T10:59:55.099962+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.099962+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:58:11.379415+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":83011,"num_write":424,"num_write_kb":112568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"38'188","reported_seq":263,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.842689+0000","last_change":"2024-04-20T11:00:07.842726+0000","last_active":"2024-04-20T11:00:07.842689+0000","last_peered":"2024-04-20T11:00:07.842689+0000","last_clean":"2024-04-20T11:00:07.842689+0000","last_became_active":"2024-04-20T10:50:39.579442+0000","last_became_peered":"2024-04-20T10:50:39.579442+0000","last_unstale":"2024-04-20T11:00:07.842689+0000","last_undegraded":"2024-04-20T11:00:07.842689+0000","last_fullsized":"2024-04-20T11:00:07.842689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'188","last_scrub_stamp":"2024-04-20T11:00:07.842598+0000","last_deep_scrub":"38'188","last_deep_scrub_stamp":"2024-04-20T11:00:07.842598+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.842598+0000","objects_scrubbed":3,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:39:39.556733+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":32778,"num_write":122,"num_write_kb":8259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"38'535","reported_seq":600,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.190163+0000","last_change":"2024-04-20T11:00:05.190195+0000","last_active":"2024-04-20T11:00:05.190163+0000","last_peered":"2024-04-20T11:00:05.190163+0000","last_clean":"2024-04-20T11:00:05.190163+0000","last_became_active":"2024-04-20T10:50:48.636402+0000","last_became_peered":"2024-04-20T10:50:48.636402+0000","last_unstale":"2024-04-20T11:00:05.190163+0000","last_undegraded":"2024-04-20T11:00:05.190163+0000","last_fullsized":"2024-04-20T11:00:05.190163+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'535","last_scrub_stamp":"2024-04-20T11:00:05.190064+0000","last_deep_scrub":"38'535","last_deep_scrub_stamp":"2024-04-20T11:00:05.190064+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.190064+0000","objects_scrubbed":2,"log_size":535,"log_dups_size":0,"ondisk_log_size":535,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:38:45.270222+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":16463,"num_write":485,"num_write_kb":4538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"36'400","reported_seq":504,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.546523+0000","last_change":"2024-04-20T11:00:01.546550+0000","last_active":"2024-04-20T11:00:01.546523+0000","last_peered":"2024-04-20T11:00:01.546523+0000","last_clean":"2024-04-20T11:00:01.546523+0000","last_became_active":"2024-04-20T10:50:49.643179+0000","last_became_peered":"2024-04-20T10:50:49.643179+0000","last_unstale":"2024-04-20T11:00:01.546523+0000","last_undegraded":"2024-04-20T11:00:01.546523+0000","last_fullsized":"2024-04-20T11:00:01.546523+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'400","last_scrub_stamp":"2024-04-20T11:00:01.546410+0000","last_deep_scrub":"36'400","last_deep_scrub_stamp":"2024-04-20T11:00:01.546410+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.546410+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:47:29.517681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":15248,"num_write":372,"num_write_kb":50493,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"36'439","reported_seq":590,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:14.347820+0000","last_change":"2024-04-20T11:00:14.347820+0000","last_active":"2024-04-20T11:00:14.347820+0000","last_peered":"2024-04-20T11:00:14.347820+0000","last_clean":"2024-04-20T11:00:14.347820+0000","last_became_active":"2024-04-20T10:51:20.873593+0000","last_became_peered":"2024-04-20T10:51:20.873593+0000","last_unstale":"2024-04-20T11:00:14.347820+0000","last_undegraded":"2024-04-20T11:00:14.347820+0000","last_fullsized":"2024-04-20T11:00:14.347820+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'439","last_scrub_stamp":"2024-04-20T11:00:14.347696+0000","last_deep_scrub":"36'439","last_deep_scrub_stamp":"2024-04-20T11:00:14.347696+0000","last_clean_scrub_stamp":"2024-04-20T11:00:14.347696+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:40:37.359635+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":68460,"num_write":408,"num_write_kb":88214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"38'472","reported_seq":535,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.364470+0000","last_change":"2024-04-20T11:00:00.364502+0000","last_active":"2024-04-20T11:00:00.364470+0000","last_peered":"2024-04-20T11:00:00.364470+0000","last_clean":"2024-04-20T11:00:00.364470+0000","last_became_active":"2024-04-20T10:50:39.580787+0000","last_became_peered":"2024-04-20T10:50:39.580787+0000","last_unstale":"2024-04-20T11:00:00.364470+0000","last_undegraded":"2024-04-20T11:00:00.364470+0000","last_fullsized":"2024-04-20T11:00:00.364470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'472","last_scrub_stamp":"2024-04-20T11:00:00.364364+0000","last_deep_scrub":"38'472","last_deep_scrub_stamp":"2024-04-20T11:00:00.364364+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.364364+0000","objects_scrubbed":1,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:55:08.033565+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":415,"num_write_kb":4282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"38'54","reported_seq":107,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.103003+0000","last_change":"2024-04-20T10:59:52.103059+0000","last_active":"2024-04-20T10:59:52.103003+0000","last_peered":"2024-04-20T10:59:52.103003+0000","last_clean":"2024-04-20T10:59:52.103003+0000","last_became_active":"2024-04-20T10:50:48.641001+0000","last_became_peered":"2024-04-20T10:50:48.641001+0000","last_unstale":"2024-04-20T10:59:52.103003+0000","last_undegraded":"2024-04-20T10:59:52.103003+0000","last_fullsized":"2024-04-20T10:59:52.103003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'54","last_scrub_stamp":"2024-04-20T10:59:52.102894+0000","last_deep_scrub":"38'54","last_deep_scrub_stamp":"2024-04-20T10:59:52.102894+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.102894+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:35:53.820701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"38'386","reported_seq":503,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:13.174766+0000","last_change":"2024-04-20T11:00:13.174794+0000","last_active":"2024-04-20T11:00:13.174766+0000","last_peered":"2024-04-20T11:00:13.174766+0000","last_clean":"2024-04-20T11:00:13.174766+0000","last_became_active":"2024-04-20T10:50:49.649860+0000","last_became_peered":"2024-04-20T10:50:49.649860+0000","last_unstale":"2024-04-20T11:00:13.174766+0000","last_undegraded":"2024-04-20T11:00:13.174766+0000","last_fullsized":"2024-04-20T11:00:13.174766+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'386","last_scrub_stamp":"2024-04-20T11:00:13.174673+0000","last_deep_scrub":"38'386","last_deep_scrub_stamp":"2024-04-20T11:00:13.174673+0000","last_clean_scrub_stamp":"2024-04-20T11:00:13.174673+0000","objects_scrubbed":0,"log_size":386,"log_dups_size":0,"ondisk_log_size":386,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:07:33.841636+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":51447,"num_write":355,"num_write_kb":79846,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"36'408","reported_seq":545,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.796003+0000","last_change":"2024-04-20T11:00:10.796028+0000","last_active":"2024-04-20T11:00:10.796003+0000","last_peered":"2024-04-20T11:00:10.796003+0000","last_clean":"2024-04-20T11:00:10.796003+0000","last_became_active":"2024-04-20T10:50:40.593886+0000","last_became_peered":"2024-04-20T10:50:40.593886+0000","last_unstale":"2024-04-20T11:00:10.796003+0000","last_undegraded":"2024-04-20T11:00:10.796003+0000","last_fullsized":"2024-04-20T11:00:10.796003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'408","last_scrub_stamp":"2024-04-20T11:00:10.795884+0000","last_deep_scrub":"36'408","last_deep_scrub_stamp":"2024-04-20T11:00:10.795884+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.795884+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:17:30.862108+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":28672,"num_write":368,"num_write_kb":66779,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"38'261","reported_seq":323,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.354442+0000","last_change":"2024-04-20T10:59:59.354478+0000","last_active":"2024-04-20T10:59:59.354442+0000","last_peered":"2024-04-20T10:59:59.354442+0000","last_clean":"2024-04-20T10:59:59.354442+0000","last_became_active":"2024-04-20T10:50:39.577600+0000","last_became_peered":"2024-04-20T10:50:39.577600+0000","last_unstale":"2024-04-20T10:59:59.354442+0000","last_undegraded":"2024-04-20T10:59:59.354442+0000","last_fullsized":"2024-04-20T10:59:59.354442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'261","last_scrub_stamp":"2024-04-20T10:59:59.354351+0000","last_deep_scrub":"38'261","last_deep_scrub_stamp":"2024-04-20T10:59:59.354351+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.354351+0000","objects_scrubbed":1,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:21:31.725896+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":207,"num_write_kb":4187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"38'294","reported_seq":356,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.579856+0000","last_change":"2024-04-20T10:59:51.579856+0000","last_active":"2024-04-20T10:59:51.579856+0000","last_peered":"2024-04-20T10:59:51.579856+0000","last_clean":"2024-04-20T10:59:51.579856+0000","last_became_active":"2024-04-20T10:50:48.643869+0000","last_became_peered":"2024-04-20T10:50:48.643869+0000","last_unstale":"2024-04-20T10:59:51.579856+0000","last_undegraded":"2024-04-20T10:59:51.579856+0000","last_fullsized":"2024-04-20T10:59:51.579856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'294","last_scrub_stamp":"2024-04-20T10:59:51.579708+0000","last_deep_scrub":"38'294","last_deep_scrub_stamp":"2024-04-20T10:59:51.579708+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.579708+0000","objects_scrubbed":2,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:59:58.562988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":12294,"num_write":243,"num_write_kb":4226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"38'417","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:17.016609+0000","last_change":"2024-04-20T11:00:17.016633+0000","last_active":"2024-04-20T11:00:17.016609+0000","last_peered":"2024-04-20T11:00:17.016609+0000","last_clean":"2024-04-20T11:00:17.016609+0000","last_became_active":"2024-04-20T10:50:49.650250+0000","last_became_peered":"2024-04-20T10:50:49.650250+0000","last_unstale":"2024-04-20T11:00:17.016609+0000","last_undegraded":"2024-04-20T11:00:17.016609+0000","last_fullsized":"2024-04-20T11:00:17.016609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'417","last_scrub_stamp":"2024-04-20T11:00:17.016517+0000","last_deep_scrub":"38'417","last_deep_scrub_stamp":"2024-04-20T11:00:17.016517+0000","last_clean_scrub_stamp":"2024-04-20T11:00:17.016517+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:12:03.701792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":59672,"num_write":383,"num_write_kb":87983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.9","version":"38'464","reported_seq":627,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.065500+0000","last_change":"2024-04-20T11:00:01.065545+0000","last_active":"2024-04-20T11:00:01.065500+0000","last_peered":"2024-04-20T11:00:01.065500+0000","last_clean":"2024-04-20T11:00:01.065500+0000","last_became_active":"2024-04-20T10:50:40.592742+0000","last_became_peered":"2024-04-20T10:50:40.592742+0000","last_unstale":"2024-04-20T11:00:01.065500+0000","last_undegraded":"2024-04-20T11:00:01.065500+0000","last_fullsized":"2024-04-20T11:00:01.065500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'464","last_scrub_stamp":"2024-04-20T11:00:01.065375+0000","last_deep_scrub":"38'464","last_deep_scrub_stamp":"2024-04-20T11:00:01.065375+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.065375+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:36:39.658886+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":46635,"num_write":434,"num_write_kb":47131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"38'430","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.851600+0000","last_change":"2024-04-20T11:00:09.851631+0000","last_active":"2024-04-20T11:00:09.851600+0000","last_peered":"2024-04-20T11:00:09.851600+0000","last_clean":"2024-04-20T11:00:09.851600+0000","last_became_active":"2024-04-20T10:50:39.581479+0000","last_became_peered":"2024-04-20T10:50:39.581479+0000","last_unstale":"2024-04-20T11:00:09.851600+0000","last_undegraded":"2024-04-20T11:00:09.851600+0000","last_fullsized":"2024-04-20T11:00:09.851600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'430","last_scrub_stamp":"2024-04-20T11:00:09.851508+0000","last_deep_scrub":"38'430","last_deep_scrub_stamp":"2024-04-20T11:00:09.851508+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.851508+0000","objects_scrubbed":1,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:16:19.018811+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":12288,"num_write":373,"num_write_kb":4430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"38'507","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.136878+0000","last_change":"2024-04-20T10:59:53.136911+0000","last_active":"2024-04-20T10:59:53.136878+0000","last_peered":"2024-04-20T10:59:53.136878+0000","last_clean":"2024-04-20T10:59:53.136878+0000","last_became_active":"2024-04-20T10:50:48.638795+0000","last_became_peered":"2024-04-20T10:50:48.638795+0000","last_unstale":"2024-04-20T10:59:53.136878+0000","last_undegraded":"2024-04-20T10:59:53.136878+0000","last_fullsized":"2024-04-20T10:59:53.136878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'507","last_scrub_stamp":"2024-04-20T10:59:53.136772+0000","last_deep_scrub":"38'507","last_deep_scrub_stamp":"2024-04-20T10:59:53.136772+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.136772+0000","objects_scrubbed":2,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:27:59.138589+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":12324,"num_write":451,"num_write_kb":4408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"38'428","reported_seq":561,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:18.760810+0000","last_change":"2024-04-20T11:00:18.760835+0000","last_active":"2024-04-20T11:00:18.760810+0000","last_peered":"2024-04-20T11:00:18.760810+0000","last_clean":"2024-04-20T11:00:18.760810+0000","last_became_active":"2024-04-20T10:50:49.655189+0000","last_became_peered":"2024-04-20T10:50:49.655189+0000","last_unstale":"2024-04-20T11:00:18.760810+0000","last_undegraded":"2024-04-20T11:00:18.760810+0000","last_fullsized":"2024-04-20T11:00:18.760810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'428","last_scrub_stamp":"2024-04-20T11:00:18.760712+0000","last_deep_scrub":"38'428","last_deep_scrub_stamp":"2024-04-20T11:00:18.760712+0000","last_clean_scrub_stamp":"2024-04-20T11:00:18.760712+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:11:30.930919+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":70222,"num_write":390,"num_write_kb":75460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"38'430","reported_seq":581,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.270236+0000","last_change":"2024-04-20T10:59:57.270293+0000","last_active":"2024-04-20T10:59:57.270236+0000","last_peered":"2024-04-20T10:59:57.270236+0000","last_clean":"2024-04-20T10:59:57.270236+0000","last_became_active":"2024-04-20T10:50:40.593790+0000","last_became_peered":"2024-04-20T10:50:40.593790+0000","last_unstale":"2024-04-20T10:59:57.270236+0000","last_undegraded":"2024-04-20T10:59:57.270236+0000","last_fullsized":"2024-04-20T10:59:57.270236+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'430","last_scrub_stamp":"2024-04-20T10:59:57.270130+0000","last_deep_scrub":"38'430","last_deep_scrub_stamp":"2024-04-20T10:59:57.270130+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.270130+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:55:26.189665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":26226,"num_write":396,"num_write_kb":42836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"38'179","reported_seq":249,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.101291+0000","last_change":"2024-04-20T10:59:56.101348+0000","last_active":"2024-04-20T10:59:56.101291+0000","last_peered":"2024-04-20T10:59:56.101291+0000","last_clean":"2024-04-20T10:59:56.101291+0000","last_became_active":"2024-04-20T10:50:39.577654+0000","last_became_peered":"2024-04-20T10:50:39.577654+0000","last_unstale":"2024-04-20T10:59:56.101291+0000","last_undegraded":"2024-04-20T10:59:56.101291+0000","last_fullsized":"2024-04-20T10:59:56.101291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'179","last_scrub_stamp":"2024-04-20T10:59:56.101173+0000","last_deep_scrub":"38'179","last_deep_scrub_stamp":"2024-04-20T10:59:56.101173+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.101173+0000","objects_scrubbed":2,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:27:10.598533+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2765636,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":2215,"num_write":122,"num_write_kb":2774,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"38'354","reported_seq":690,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.134538+0000","last_change":"2024-04-20T11:00:04.134569+0000","last_active":"2024-04-20T11:00:04.134538+0000","last_peered":"2024-04-20T11:00:04.134538+0000","last_clean":"2024-04-20T11:00:04.134538+0000","last_became_active":"2024-04-20T10:50:48.633411+0000","last_became_peered":"2024-04-20T10:50:48.633411+0000","last_unstale":"2024-04-20T11:00:04.134538+0000","last_undegraded":"2024-04-20T11:00:04.134538+0000","last_fullsized":"2024-04-20T11:00:04.134538+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'354","last_scrub_stamp":"2024-04-20T11:00:04.134439+0000","last_deep_scrub":"38'354","last_deep_scrub_stamp":"2024-04-20T11:00:04.134439+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.134439+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:19:15.768797+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1465101,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":1621,"num_write":296,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"38'403","reported_seq":536,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.244820+0000","last_change":"2024-04-20T11:00:09.244861+0000","last_active":"2024-04-20T11:00:09.244820+0000","last_peered":"2024-04-20T11:00:09.244820+0000","last_clean":"2024-04-20T11:00:09.244820+0000","last_became_active":"2024-04-20T10:50:49.642283+0000","last_became_peered":"2024-04-20T10:50:49.642283+0000","last_unstale":"2024-04-20T11:00:09.244820+0000","last_undegraded":"2024-04-20T11:00:09.244820+0000","last_fullsized":"2024-04-20T11:00:09.244820+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'403","last_scrub_stamp":"2024-04-20T11:00:09.244717+0000","last_deep_scrub":"38'403","last_deep_scrub_stamp":"2024-04-20T11:00:09.244717+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.244717+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:07:55.286313+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":84919,"num_write":363,"num_write_kb":88226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"38'351","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.768921+0000","last_change":"2024-04-20T11:00:09.768950+0000","last_active":"2024-04-20T11:00:09.768921+0000","last_peered":"2024-04-20T11:00:09.768921+0000","last_clean":"2024-04-20T11:00:09.768921+0000","last_became_active":"2024-04-20T10:50:40.593246+0000","last_became_peered":"2024-04-20T10:50:40.593246+0000","last_unstale":"2024-04-20T11:00:09.768921+0000","last_undegraded":"2024-04-20T11:00:09.768921+0000","last_fullsized":"2024-04-20T11:00:09.768921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'351","last_scrub_stamp":"2024-04-20T11:00:09.768811+0000","last_deep_scrub":"38'351","last_deep_scrub_stamp":"2024-04-20T11:00:09.768811+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.768811+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:13.137846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":41830,"num_write":332,"num_write_kb":50578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"38'368","reported_seq":439,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.390788+0000","last_change":"2024-04-20T11:00:03.390816+0000","last_active":"2024-04-20T11:00:03.390788+0000","last_peered":"2024-04-20T11:00:03.390788+0000","last_clean":"2024-04-20T11:00:03.390788+0000","last_became_active":"2024-04-20T10:50:39.585840+0000","last_became_peered":"2024-04-20T10:50:39.585840+0000","last_unstale":"2024-04-20T11:00:03.390788+0000","last_undegraded":"2024-04-20T11:00:03.390788+0000","last_fullsized":"2024-04-20T11:00:03.390788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'368","last_scrub_stamp":"2024-04-20T11:00:03.390669+0000","last_deep_scrub":"38'368","last_deep_scrub_stamp":"2024-04-20T11:00:03.390669+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.390669+0000","objects_scrubbed":1,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:21:24.356772+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":432,"num_write":707,"num_write_kb":1700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"38'201","reported_seq":267,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.804909+0000","last_change":"2024-04-20T10:59:58.804975+0000","last_active":"2024-04-20T10:59:58.804909+0000","last_peered":"2024-04-20T10:59:58.804909+0000","last_clean":"2024-04-20T10:59:58.804909+0000","last_became_active":"2024-04-20T10:50:48.644799+0000","last_became_peered":"2024-04-20T10:50:48.644799+0000","last_unstale":"2024-04-20T10:59:58.804909+0000","last_undegraded":"2024-04-20T10:59:58.804909+0000","last_fullsized":"2024-04-20T10:59:58.804909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'201","last_scrub_stamp":"2024-04-20T10:59:58.804789+0000","last_deep_scrub":"38'201","last_deep_scrub_stamp":"2024-04-20T10:59:58.804789+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.804789+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:05:23.925821+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":41717,"num_write":141,"num_write_kb":8292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"38'382","reported_seq":498,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.012433+0000","last_change":"2024-04-20T11:00:09.012482+0000","last_active":"2024-04-20T11:00:09.012433+0000","last_peered":"2024-04-20T11:00:09.012433+0000","last_clean":"2024-04-20T11:00:09.012433+0000","last_became_active":"2024-04-20T10:50:49.643741+0000","last_became_peered":"2024-04-20T10:50:49.643741+0000","last_unstale":"2024-04-20T11:00:09.012433+0000","last_undegraded":"2024-04-20T11:00:09.012433+0000","last_fullsized":"2024-04-20T11:00:09.012433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'382","last_scrub_stamp":"2024-04-20T11:00:09.012307+0000","last_deep_scrub":"38'382","last_deep_scrub_stamp":"2024-04-20T11:00:09.012307+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.012307+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:54.619492+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":36954,"num_write":352,"num_write_kb":63166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"38'440","reported_seq":596,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.546265+0000","last_change":"2024-04-20T10:59:52.546310+0000","last_active":"2024-04-20T10:59:52.546265+0000","last_peered":"2024-04-20T10:59:52.546265+0000","last_clean":"2024-04-20T10:59:52.546265+0000","last_became_active":"2024-04-20T10:50:40.592181+0000","last_became_peered":"2024-04-20T10:50:40.592181+0000","last_unstale":"2024-04-20T10:59:52.546265+0000","last_undegraded":"2024-04-20T10:59:52.546265+0000","last_fullsized":"2024-04-20T10:59:52.546265+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'440","last_scrub_stamp":"2024-04-20T10:59:52.546182+0000","last_deep_scrub":"38'440","last_deep_scrub_stamp":"2024-04-20T10:59:52.546182+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.546182+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:24:57.003888+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":92391,"num_write":411,"num_write_kb":121276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"38'117","reported_seq":179,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.854038+0000","last_change":"2024-04-20T11:00:06.854134+0000","last_active":"2024-04-20T11:00:06.854038+0000","last_peered":"2024-04-20T11:00:06.854038+0000","last_clean":"2024-04-20T11:00:06.854038+0000","last_became_active":"2024-04-20T10:50:39.579567+0000","last_became_peered":"2024-04-20T10:50:39.579567+0000","last_unstale":"2024-04-20T11:00:06.854038+0000","last_undegraded":"2024-04-20T11:00:06.854038+0000","last_fullsized":"2024-04-20T11:00:06.854038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'117","last_scrub_stamp":"2024-04-20T11:00:06.853945+0000","last_deep_scrub":"38'117","last_deep_scrub_stamp":"2024-04-20T11:00:06.853945+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.853945+0000","objects_scrubbed":1,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:04:34.697989+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":47,"num_write_kb":4119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"38'72","reported_seq":125,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.423948+0000","last_change":"2024-04-20T11:00:03.423973+0000","last_active":"2024-04-20T11:00:03.423948+0000","last_peered":"2024-04-20T11:00:03.423948+0000","last_clean":"2024-04-20T11:00:03.423948+0000","last_became_active":"2024-04-20T10:50:48.640574+0000","last_became_peered":"2024-04-20T10:50:48.640574+0000","last_unstale":"2024-04-20T11:00:03.423948+0000","last_undegraded":"2024-04-20T11:00:03.423948+0000","last_fullsized":"2024-04-20T11:00:03.423948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'72","last_scrub_stamp":"2024-04-20T11:00:03.423848+0000","last_deep_scrub":"38'72","last_deep_scrub_stamp":"2024-04-20T11:00:03.423848+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.423848+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:34:13.977628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"38'388","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.536750+0000","last_change":"2024-04-20T11:00:06.536773+0000","last_active":"2024-04-20T11:00:06.536750+0000","last_peered":"2024-04-20T11:00:06.536750+0000","last_clean":"2024-04-20T11:00:06.536750+0000","last_became_active":"2024-04-20T10:50:49.644383+0000","last_became_peered":"2024-04-20T10:50:49.644383+0000","last_unstale":"2024-04-20T11:00:06.536750+0000","last_undegraded":"2024-04-20T11:00:06.536750+0000","last_fullsized":"2024-04-20T11:00:06.536750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'388","last_scrub_stamp":"2024-04-20T11:00:06.536668+0000","last_deep_scrub":"38'388","last_deep_scrub_stamp":"2024-04-20T11:00:06.536668+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.536668+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:09:39.354243+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":31459,"num_write":347,"num_write_kb":38414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"38'421","reported_seq":567,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.279733+0000","last_change":"2024-04-20T10:59:52.279779+0000","last_active":"2024-04-20T10:59:52.279733+0000","last_peered":"2024-04-20T10:59:52.279733+0000","last_clean":"2024-04-20T10:59:52.279733+0000","last_became_active":"2024-04-20T10:50:40.612289+0000","last_became_peered":"2024-04-20T10:50:40.612289+0000","last_unstale":"2024-04-20T10:59:52.279733+0000","last_undegraded":"2024-04-20T10:59:52.279733+0000","last_fullsized":"2024-04-20T10:59:52.279733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'421","last_scrub_stamp":"2024-04-20T10:59:52.279633+0000","last_deep_scrub":"38'421","last_deep_scrub_stamp":"2024-04-20T10:59:52.279633+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.279633+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:26:35.681741+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":53960,"num_write":380,"num_write_kb":46448,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"37'59","reported_seq":120,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.370033+0000","last_change":"2024-04-20T11:00:02.370061+0000","last_active":"2024-04-20T11:00:02.370033+0000","last_peered":"2024-04-20T11:00:02.370033+0000","last_clean":"2024-04-20T11:00:02.370033+0000","last_became_active":"2024-04-20T10:50:39.581135+0000","last_became_peered":"2024-04-20T10:50:39.581135+0000","last_unstale":"2024-04-20T11:00:02.370033+0000","last_undegraded":"2024-04-20T11:00:02.370033+0000","last_fullsized":"2024-04-20T11:00:02.370033+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'59","last_scrub_stamp":"2024-04-20T11:00:02.369925+0000","last_deep_scrub":"37'59","last_deep_scrub_stamp":"2024-04-20T11:00:02.369925+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.369925+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:14:07.291337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"38'623","reported_seq":688,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.543990+0000","last_change":"2024-04-20T10:59:53.544025+0000","last_active":"2024-04-20T10:59:53.543990+0000","last_peered":"2024-04-20T10:59:53.543990+0000","last_clean":"2024-04-20T10:59:53.543990+0000","last_became_active":"2024-04-20T10:50:48.644256+0000","last_became_peered":"2024-04-20T10:50:48.644256+0000","last_unstale":"2024-04-20T10:59:53.543990+0000","last_undegraded":"2024-04-20T10:59:53.543990+0000","last_fullsized":"2024-04-20T10:59:53.543990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'623","last_scrub_stamp":"2024-04-20T10:59:53.543914+0000","last_deep_scrub":"38'623","last_deep_scrub_stamp":"2024-04-20T10:59:53.543914+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.543914+0000","objects_scrubbed":2,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:37:24.546082+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":37014,"num_write":557,"num_write_kb":8564,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"38'440","reported_seq":584,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.585803+0000","last_change":"2024-04-20T11:00:09.585829+0000","last_active":"2024-04-20T11:00:09.585803+0000","last_peered":"2024-04-20T11:00:09.585803+0000","last_clean":"2024-04-20T11:00:09.585803+0000","last_became_active":"2024-04-20T10:50:49.649747+0000","last_became_peered":"2024-04-20T10:50:49.649747+0000","last_unstale":"2024-04-20T11:00:09.585803+0000","last_undegraded":"2024-04-20T11:00:09.585803+0000","last_fullsized":"2024-04-20T11:00:09.585803+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'440","last_scrub_stamp":"2024-04-20T11:00:09.585711+0000","last_deep_scrub":"38'440","last_deep_scrub_stamp":"2024-04-20T11:00:09.585711+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.585711+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:22:04.291967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":72557,"num_write":399,"num_write_kb":79896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"37'409","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.028184+0000","last_change":"2024-04-20T11:00:00.028210+0000","last_active":"2024-04-20T11:00:00.028184+0000","last_peered":"2024-04-20T11:00:00.028184+0000","last_clean":"2024-04-20T11:00:00.028184+0000","last_became_active":"2024-04-20T10:50:40.590578+0000","last_became_peered":"2024-04-20T10:50:40.590578+0000","last_unstale":"2024-04-20T11:00:00.028184+0000","last_undegraded":"2024-04-20T11:00:00.028184+0000","last_fullsized":"2024-04-20T11:00:00.028184+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'409","last_scrub_stamp":"2024-04-20T11:00:00.028089+0000","last_deep_scrub":"37'409","last_deep_scrub_stamp":"2024-04-20T11:00:00.028089+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.028089+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:45:12.522341+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":69573,"num_write":375,"num_write_kb":88218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"38'603","reported_seq":670,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.279004+0000","last_change":"2024-04-20T11:00:05.279039+0000","last_active":"2024-04-20T11:00:05.279004+0000","last_peered":"2024-04-20T11:00:05.279004+0000","last_clean":"2024-04-20T11:00:05.279004+0000","last_became_active":"2024-04-20T10:50:39.584129+0000","last_became_peered":"2024-04-20T10:50:39.584129+0000","last_unstale":"2024-04-20T11:00:05.279004+0000","last_undegraded":"2024-04-20T11:00:05.279004+0000","last_fullsized":"2024-04-20T11:00:05.279004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'603","last_scrub_stamp":"2024-04-20T11:00:05.278916+0000","last_deep_scrub":"38'603","last_deep_scrub_stamp":"2024-04-20T11:00:05.278916+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.278916+0000","objects_scrubbed":2,"log_size":603,"log_dups_size":0,"ondisk_log_size":603,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:16:31.426140+0000","scrub_duration":18,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":551,"num_write_kb":8610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"38'74","reported_seq":128,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.614200+0000","last_change":"2024-04-20T10:59:49.614221+0000","last_active":"2024-04-20T10:59:49.614200+0000","last_peered":"2024-04-20T10:59:49.614200+0000","last_clean":"2024-04-20T10:59:49.614200+0000","last_became_active":"2024-04-20T10:50:48.642040+0000","last_became_peered":"2024-04-20T10:50:48.642040+0000","last_unstale":"2024-04-20T10:59:49.614200+0000","last_undegraded":"2024-04-20T10:59:49.614200+0000","last_fullsized":"2024-04-20T10:59:49.614200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-04-20T10:59:49.614120+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-04-20T10:59:49.614120+0000","last_clean_scrub_stamp":"2024-04-20T10:59:49.614120+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:22:03.239494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":8,"num_write":18,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"38'423","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.532569+0000","last_change":"2024-04-20T11:00:04.532615+0000","last_active":"2024-04-20T11:00:04.532569+0000","last_peered":"2024-04-20T11:00:04.532569+0000","last_clean":"2024-04-20T11:00:04.532569+0000","last_became_active":"2024-04-20T10:50:49.650530+0000","last_became_peered":"2024-04-20T10:50:49.650530+0000","last_unstale":"2024-04-20T11:00:04.532569+0000","last_undegraded":"2024-04-20T11:00:04.532569+0000","last_fullsized":"2024-04-20T11:00:04.532569+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T11:00:04.532453+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T11:00:04.532453+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.532453+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:45:32.627311+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56610,"num_write":400,"num_write_kb":83457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"37'384","reported_seq":511,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.415527+0000","last_change":"2024-04-20T11:00:06.415569+0000","last_active":"2024-04-20T11:00:06.415527+0000","last_peered":"2024-04-20T11:00:06.415527+0000","last_clean":"2024-04-20T11:00:06.415527+0000","last_became_active":"2024-04-20T10:50:40.589761+0000","last_became_peered":"2024-04-20T10:50:40.589761+0000","last_unstale":"2024-04-20T11:00:06.415527+0000","last_undegraded":"2024-04-20T11:00:06.415527+0000","last_fullsized":"2024-04-20T11:00:06.415527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'384","last_scrub_stamp":"2024-04-20T11:00:06.415389+0000","last_deep_scrub":"37'384","last_deep_scrub_stamp":"2024-04-20T11:00:06.415389+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.415389+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:22.059474+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":325,"num_write":350,"num_write_kb":17356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"38'354","reported_seq":708,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.506502+0000","last_change":"2024-04-20T10:59:51.506525+0000","last_active":"2024-04-20T10:59:51.506502+0000","last_peered":"2024-04-20T10:59:51.506502+0000","last_clean":"2024-04-20T10:59:51.506502+0000","last_became_active":"2024-04-20T10:50:39.573931+0000","last_became_peered":"2024-04-20T10:50:39.573931+0000","last_unstale":"2024-04-20T10:59:51.506502+0000","last_undegraded":"2024-04-20T10:59:51.506502+0000","last_fullsized":"2024-04-20T10:59:51.506502+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'354","last_scrub_stamp":"2024-04-20T10:59:51.506417+0000","last_deep_scrub":"38'354","last_deep_scrub_stamp":"2024-04-20T10:59:51.506417+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.506417+0000","objects_scrubbed":1,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:26:01.369153+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1482178,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":293,"num_read_kb":1639,"num_write":299,"num_write_kb":1656,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"38'137","reported_seq":201,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.498658+0000","last_change":"2024-04-20T10:59:55.498694+0000","last_active":"2024-04-20T10:59:55.498658+0000","last_peered":"2024-04-20T10:59:55.498658+0000","last_clean":"2024-04-20T10:59:55.498658+0000","last_became_active":"2024-04-20T10:50:48.645364+0000","last_became_peered":"2024-04-20T10:50:48.645364+0000","last_unstale":"2024-04-20T10:59:55.498658+0000","last_undegraded":"2024-04-20T10:59:55.498658+0000","last_fullsized":"2024-04-20T10:59:55.498658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'137","last_scrub_stamp":"2024-04-20T10:59:55.498552+0000","last_deep_scrub":"38'137","last_deep_scrub_stamp":"2024-04-20T10:59:55.498552+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.498552+0000","objects_scrubbed":2,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:56:11.346948+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1532638,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":28,"num_read_kb":994,"num_write":83,"num_write_kb":1559,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'363","reported_seq":482,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:16.016392+0000","last_change":"2024-04-20T11:00:16.016418+0000","last_active":"2024-04-20T11:00:16.016392+0000","last_peered":"2024-04-20T11:00:16.016392+0000","last_clean":"2024-04-20T11:00:16.016392+0000","last_became_active":"2024-04-20T10:50:49.649905+0000","last_became_peered":"2024-04-20T10:50:49.649905+0000","last_unstale":"2024-04-20T11:00:16.016392+0000","last_undegraded":"2024-04-20T11:00:16.016392+0000","last_fullsized":"2024-04-20T11:00:16.016392+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'363","last_scrub_stamp":"2024-04-20T11:00:16.016264+0000","last_deep_scrub":"38'363","last_deep_scrub_stamp":"2024-04-20T11:00:16.016264+0000","last_clean_scrub_stamp":"2024-04-20T11:00:16.016264+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:34:13.448957+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":56669,"num_write":337,"num_write_kb":38450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"38'414","reported_seq":569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.350004+0000","last_change":"2024-04-20T10:59:51.350026+0000","last_active":"2024-04-20T10:59:51.350004+0000","last_peered":"2024-04-20T10:59:51.350004+0000","last_clean":"2024-04-20T10:59:51.350004+0000","last_became_active":"2024-04-20T10:50:40.600033+0000","last_became_peered":"2024-04-20T10:50:40.600033+0000","last_unstale":"2024-04-20T10:59:51.350004+0000","last_undegraded":"2024-04-20T10:59:51.350004+0000","last_fullsized":"2024-04-20T10:59:51.350004+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'414","last_scrub_stamp":"2024-04-20T10:59:51.349917+0000","last_deep_scrub":"38'414","last_deep_scrub_stamp":"2024-04-20T10:59:51.349917+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.349917+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:50:34.711226+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":100333,"num_write":376,"num_write_kb":104385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"38'125","reported_seq":195,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.814410+0000","last_change":"2024-04-20T11:00:08.814443+0000","last_active":"2024-04-20T11:00:08.814410+0000","last_peered":"2024-04-20T11:00:08.814410+0000","last_clean":"2024-04-20T11:00:08.814410+0000","last_became_active":"2024-04-20T10:50:39.578196+0000","last_became_peered":"2024-04-20T10:50:39.578196+0000","last_unstale":"2024-04-20T11:00:08.814410+0000","last_undegraded":"2024-04-20T11:00:08.814410+0000","last_fullsized":"2024-04-20T11:00:08.814410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'125","last_scrub_stamp":"2024-04-20T11:00:08.814318+0000","last_deep_scrub":"38'125","last_deep_scrub_stamp":"2024-04-20T11:00:08.814318+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.814318+0000","objects_scrubbed":2,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:01:37.055727+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":36864,"num_write":57,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"38'367","reported_seq":431,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.462612+0000","last_change":"2024-04-20T11:00:04.462677+0000","last_active":"2024-04-20T11:00:04.462612+0000","last_peered":"2024-04-20T11:00:04.462612+0000","last_clean":"2024-04-20T11:00:04.462612+0000","last_became_active":"2024-04-20T10:50:48.641024+0000","last_became_peered":"2024-04-20T10:50:48.641024+0000","last_unstale":"2024-04-20T11:00:04.462612+0000","last_undegraded":"2024-04-20T11:00:04.462612+0000","last_fullsized":"2024-04-20T11:00:04.462612+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'367","last_scrub_stamp":"2024-04-20T11:00:04.462441+0000","last_deep_scrub":"38'367","last_deep_scrub_stamp":"2024-04-20T11:00:04.462441+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.462441+0000","objects_scrubbed":1,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:50:00.656343+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":373,"num_write":706,"num_write_kb":1825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"38'374","reported_seq":483,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:14.826154+0000","last_change":"2024-04-20T11:00:14.826176+0000","last_active":"2024-04-20T11:00:14.826154+0000","last_peered":"2024-04-20T11:00:14.826154+0000","last_clean":"2024-04-20T11:00:14.826154+0000","last_became_active":"2024-04-20T10:50:49.645177+0000","last_became_peered":"2024-04-20T10:50:49.645177+0000","last_unstale":"2024-04-20T11:00:14.826154+0000","last_undegraded":"2024-04-20T11:00:14.826154+0000","last_fullsized":"2024-04-20T11:00:14.826154+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'374","last_scrub_stamp":"2024-04-20T11:00:14.826060+0000","last_deep_scrub":"38'374","last_deep_scrub_stamp":"2024-04-20T11:00:14.826060+0000","last_clean_scrub_stamp":"2024-04-20T11:00:14.826060+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:38:50.002739+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":23979,"num_write":342,"num_write_kb":50629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"38'375","reported_seq":505,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.752971+0000","last_change":"2024-04-20T10:59:57.752999+0000","last_active":"2024-04-20T10:59:57.752971+0000","last_peered":"2024-04-20T10:59:57.752971+0000","last_clean":"2024-04-20T10:59:57.752971+0000","last_became_active":"2024-04-20T10:50:40.604999+0000","last_became_peered":"2024-04-20T10:50:40.604999+0000","last_unstale":"2024-04-20T10:59:57.752971+0000","last_undegraded":"2024-04-20T10:59:57.752971+0000","last_fullsized":"2024-04-20T10:59:57.752971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T10:59:57.752817+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T10:59:57.752817+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.752817+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:08:56.105568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":32768,"num_write":345,"num_write_kb":58807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"38'72","reported_seq":133,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.187291+0000","last_change":"2024-04-20T11:00:07.187317+0000","last_active":"2024-04-20T11:00:07.187291+0000","last_peered":"2024-04-20T11:00:07.187291+0000","last_clean":"2024-04-20T11:00:07.187291+0000","last_became_active":"2024-04-20T10:50:39.586222+0000","last_became_peered":"2024-04-20T10:50:39.586222+0000","last_unstale":"2024-04-20T11:00:07.187291+0000","last_undegraded":"2024-04-20T11:00:07.187291+0000","last_fullsized":"2024-04-20T11:00:07.187291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'72","last_scrub_stamp":"2024-04-20T11:00:07.187185+0000","last_deep_scrub":"38'72","last_deep_scrub_stamp":"2024-04-20T11:00:07.187185+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.187185+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:15:36.814690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"38'119","reported_seq":220,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.801897+0000","last_change":"2024-04-20T11:00:04.801897+0000","last_active":"2024-04-20T11:00:04.801897+0000","last_peered":"2024-04-20T11:00:04.801897+0000","last_clean":"2024-04-20T11:00:04.801897+0000","last_became_active":"2024-04-20T10:50:29.614822+0000","last_became_peered":"2024-04-20T10:50:29.614822+0000","last_unstale":"2024-04-20T11:00:04.801897+0000","last_undegraded":"2024-04-20T11:00:04.801897+0000","last_fullsized":"2024-04-20T11:00:04.801897+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2024-04-20T11:00:04.801680+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2024-04-20T11:00:04.801680+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.801680+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:25:14.875504+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"38'103","reported_seq":158,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.013346+0000","last_change":"2024-04-20T11:00:04.013419+0000","last_active":"2024-04-20T11:00:04.013346+0000","last_peered":"2024-04-20T11:00:04.013346+0000","last_clean":"2024-04-20T11:00:04.013346+0000","last_became_active":"2024-04-20T10:50:48.641525+0000","last_became_peered":"2024-04-20T10:50:48.641525+0000","last_unstale":"2024-04-20T11:00:04.013346+0000","last_undegraded":"2024-04-20T11:00:04.013346+0000","last_fullsized":"2024-04-20T11:00:04.013346+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'103","last_scrub_stamp":"2024-04-20T11:00:04.013233+0000","last_deep_scrub":"38'103","last_deep_scrub_stamp":"2024-04-20T11:00:04.013233+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.013233+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:49:54.858203+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":36,"num_write_kb":4113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"38'445","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.557688+0000","last_change":"2024-04-20T11:00:03.557716+0000","last_active":"2024-04-20T11:00:03.557688+0000","last_peered":"2024-04-20T11:00:03.557688+0000","last_clean":"2024-04-20T11:00:03.557688+0000","last_became_active":"2024-04-20T10:50:49.644150+0000","last_became_peered":"2024-04-20T10:50:49.644150+0000","last_unstale":"2024-04-20T11:00:03.557688+0000","last_undegraded":"2024-04-20T11:00:03.557688+0000","last_fullsized":"2024-04-20T11:00:03.557688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'445","last_scrub_stamp":"2024-04-20T11:00:03.557591+0000","last_deep_scrub":"38'445","last_deep_scrub_stamp":"2024-04-20T11:00:03.557591+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.557591+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:09:32.598608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":88903,"num_write":409,"num_write_kb":92640,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"36'412","reported_seq":568,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.869345+0000","last_change":"2024-04-20T10:59:55.869375+0000","last_active":"2024-04-20T10:59:55.869345+0000","last_peered":"2024-04-20T10:59:55.869345+0000","last_clean":"2024-04-20T10:59:55.869345+0000","last_became_active":"2024-04-20T10:50:40.606931+0000","last_became_peered":"2024-04-20T10:50:40.606931+0000","last_unstale":"2024-04-20T10:59:55.869345+0000","last_undegraded":"2024-04-20T10:59:55.869345+0000","last_fullsized":"2024-04-20T10:59:55.869345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'412","last_scrub_stamp":"2024-04-20T10:59:55.869244+0000","last_deep_scrub":"36'412","last_deep_scrub_stamp":"2024-04-20T10:59:55.869244+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.869244+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:57:06.366604+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53899,"num_write":383,"num_write_kb":39701,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"37'57","reported_seq":118,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.457513+0000","last_change":"2024-04-20T10:59:54.457562+0000","last_active":"2024-04-20T10:59:54.457513+0000","last_peered":"2024-04-20T10:59:54.457513+0000","last_clean":"2024-04-20T10:59:54.457513+0000","last_became_active":"2024-04-20T10:50:39.587667+0000","last_became_peered":"2024-04-20T10:50:39.587667+0000","last_unstale":"2024-04-20T10:59:54.457513+0000","last_undegraded":"2024-04-20T10:59:54.457513+0000","last_fullsized":"2024-04-20T10:59:54.457513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'57","last_scrub_stamp":"2024-04-20T10:59:54.457404+0000","last_deep_scrub":"37'57","last_deep_scrub_stamp":"2024-04-20T10:59:54.457404+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.457404+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:55:12.499789+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"38'250","reported_seq":307,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.013456+0000","last_change":"2024-04-20T11:00:05.013502+0000","last_active":"2024-04-20T11:00:05.013456+0000","last_peered":"2024-04-20T11:00:05.013456+0000","last_clean":"2024-04-20T11:00:05.013456+0000","last_became_active":"2024-04-20T10:50:48.642798+0000","last_became_peered":"2024-04-20T10:50:48.642798+0000","last_unstale":"2024-04-20T11:00:05.013456+0000","last_undegraded":"2024-04-20T11:00:05.013456+0000","last_fullsized":"2024-04-20T11:00:05.013456+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'250","last_scrub_stamp":"2024-04-20T11:00:05.013332+0000","last_deep_scrub":"38'250","last_deep_scrub_stamp":"2024-04-20T11:00:05.013332+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.013332+0000","objects_scrubbed":1,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:56:01.424402+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":11663,"num_write":185,"num_write_kb":4198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.a","version":"38'444","reported_seq":582,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.523290+0000","last_change":"2024-04-20T10:59:58.523341+0000","last_active":"2024-04-20T10:59:58.523290+0000","last_peered":"2024-04-20T10:59:58.523290+0000","last_clean":"2024-04-20T10:59:58.523290+0000","last_became_active":"2024-04-20T10:50:49.634560+0000","last_became_peered":"2024-04-20T10:50:49.634560+0000","last_unstale":"2024-04-20T10:59:58.523290+0000","last_undegraded":"2024-04-20T10:59:58.523290+0000","last_fullsized":"2024-04-20T10:59:58.523290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'444","last_scrub_stamp":"2024-04-20T10:59:58.523190+0000","last_deep_scrub":"38'444","last_deep_scrub_stamp":"2024-04-20T10:59:58.523190+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.523190+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:21:23.245222+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":74093,"num_write":415,"num_write_kb":112646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"38'451","reported_seq":592,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.295189+0000","last_change":"2024-04-20T10:59:53.295216+0000","last_active":"2024-04-20T10:59:53.295189+0000","last_peered":"2024-04-20T10:59:53.295189+0000","last_clean":"2024-04-20T10:59:53.295189+0000","last_became_active":"2024-04-20T10:50:40.612362+0000","last_became_peered":"2024-04-20T10:50:40.612362+0000","last_unstale":"2024-04-20T10:59:53.295189+0000","last_undegraded":"2024-04-20T10:59:53.295189+0000","last_fullsized":"2024-04-20T10:59:53.295189+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T10:59:53.295100+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T10:59:53.295100+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.295100+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:44:56.335634+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":13128,"num_write":408,"num_write_kb":42612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"38'468","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.358572+0000","last_change":"2024-04-20T11:00:01.358602+0000","last_active":"2024-04-20T11:00:01.358572+0000","last_peered":"2024-04-20T11:00:01.358572+0000","last_clean":"2024-04-20T11:00:01.358572+0000","last_became_active":"2024-04-20T10:50:39.581115+0000","last_became_peered":"2024-04-20T10:50:39.581115+0000","last_unstale":"2024-04-20T11:00:01.358572+0000","last_undegraded":"2024-04-20T11:00:01.358572+0000","last_fullsized":"2024-04-20T11:00:01.358572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'468","last_scrub_stamp":"2024-04-20T11:00:01.358458+0000","last_deep_scrub":"38'468","last_deep_scrub_stamp":"2024-04-20T11:00:01.358458+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.358458+0000","objects_scrubbed":2,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:24:10.128118+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":12293,"num_write":417,"num_write_kb":4361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"38'257","reported_seq":324,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.370618+0000","last_change":"2024-04-20T10:59:52.370673+0000","last_active":"2024-04-20T10:59:52.370618+0000","last_peered":"2024-04-20T10:59:52.370618+0000","last_clean":"2024-04-20T10:59:52.370618+0000","last_became_active":"2024-04-20T10:50:48.639921+0000","last_became_peered":"2024-04-20T10:50:48.639921+0000","last_unstale":"2024-04-20T10:59:52.370618+0000","last_undegraded":"2024-04-20T10:59:52.370618+0000","last_fullsized":"2024-04-20T10:59:52.370618+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'257","last_scrub_stamp":"2024-04-20T10:59:52.370514+0000","last_deep_scrub":"38'257","last_deep_scrub_stamp":"2024-04-20T10:59:52.370514+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.370514+0000","objects_scrubbed":3,"log_size":257,"log_dups_size":0,"ondisk_log_size":257,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:06:22.716080+0000","scrub_duration":17,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":20,"num_read_kb":32780,"num_write":192,"num_write_kb":8298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"38'448","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.870357+0000","last_change":"2024-04-20T11:00:00.870401+0000","last_active":"2024-04-20T11:00:00.870357+0000","last_peered":"2024-04-20T11:00:00.870357+0000","last_clean":"2024-04-20T11:00:00.870357+0000","last_became_active":"2024-04-20T10:50:49.641121+0000","last_became_peered":"2024-04-20T10:50:49.641121+0000","last_unstale":"2024-04-20T11:00:00.870357+0000","last_undegraded":"2024-04-20T11:00:00.870357+0000","last_fullsized":"2024-04-20T11:00:00.870357+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'448","last_scrub_stamp":"2024-04-20T11:00:00.870253+0000","last_deep_scrub":"38'448","last_deep_scrub_stamp":"2024-04-20T11:00:00.870253+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.870253+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:36:33.578828+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":28672,"num_write":415,"num_write_kb":38311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"38'377","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.823510+0000","last_change":"2024-04-20T10:59:54.823535+0000","last_active":"2024-04-20T10:59:54.823510+0000","last_peered":"2024-04-20T10:59:54.823510+0000","last_clean":"2024-04-20T10:59:54.823510+0000","last_became_active":"2024-04-20T10:50:40.607344+0000","last_became_peered":"2024-04-20T10:50:40.607344+0000","last_unstale":"2024-04-20T10:59:54.823510+0000","last_undegraded":"2024-04-20T10:59:54.823510+0000","last_fullsized":"2024-04-20T10:59:54.823510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'377","last_scrub_stamp":"2024-04-20T10:59:54.823418+0000","last_deep_scrub":"38'377","last_deep_scrub_stamp":"2024-04-20T10:59:54.823418+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.823418+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:52:09.857154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":24736,"num_write":347,"num_write_kb":38102,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"38'417","reported_seq":488,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.518151+0000","last_change":"2024-04-20T10:59:52.518178+0000","last_active":"2024-04-20T10:59:52.518151+0000","last_peered":"2024-04-20T10:59:52.518151+0000","last_clean":"2024-04-20T10:59:52.518151+0000","last_became_active":"2024-04-20T10:50:39.573989+0000","last_became_peered":"2024-04-20T10:50:39.573989+0000","last_unstale":"2024-04-20T10:59:52.518151+0000","last_undegraded":"2024-04-20T10:59:52.518151+0000","last_fullsized":"2024-04-20T10:59:52.518151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'417","last_scrub_stamp":"2024-04-20T10:59:52.518077+0000","last_deep_scrub":"38'417","last_deep_scrub_stamp":"2024-04-20T10:59:52.518077+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.518077+0000","objects_scrubbed":2,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:56:56.267575+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":24,"num_read_kb":12309,"num_write":370,"num_write_kb":4280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"38'500","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.349495+0000","last_change":"2024-04-20T10:59:58.349529+0000","last_active":"2024-04-20T10:59:58.349495+0000","last_peered":"2024-04-20T10:59:58.349495+0000","last_clean":"2024-04-20T10:59:58.349495+0000","last_became_active":"2024-04-20T10:50:48.645780+0000","last_became_peered":"2024-04-20T10:50:48.645780+0000","last_unstale":"2024-04-20T10:59:58.349495+0000","last_undegraded":"2024-04-20T10:59:58.349495+0000","last_fullsized":"2024-04-20T10:59:58.349495+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'500","last_scrub_stamp":"2024-04-20T10:59:58.349410+0000","last_deep_scrub":"38'500","last_deep_scrub_stamp":"2024-04-20T10:59:58.349410+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.349410+0000","objects_scrubbed":1,"log_size":500,"log_dups_size":0,"ondisk_log_size":500,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:25:48.273771+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":443,"num_write_kb":4462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.8","version":"38'402","reported_seq":535,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.516385+0000","last_change":"2024-04-20T11:00:02.516412+0000","last_active":"2024-04-20T11:00:02.516385+0000","last_peered":"2024-04-20T11:00:02.516385+0000","last_clean":"2024-04-20T11:00:02.516385+0000","last_became_active":"2024-04-20T10:50:49.643703+0000","last_became_peered":"2024-04-20T10:50:49.643703+0000","last_unstale":"2024-04-20T11:00:02.516385+0000","last_undegraded":"2024-04-20T11:00:02.516385+0000","last_fullsized":"2024-04-20T11:00:02.516385+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'402","last_scrub_stamp":"2024-04-20T11:00:02.516295+0000","last_deep_scrub":"38'402","last_deep_scrub_stamp":"2024-04-20T11:00:02.516295+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.516295+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:24:23.651667+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56962,"num_write":365,"num_write_kb":46837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"38'375","reported_seq":514,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.877466+0000","last_change":"2024-04-20T10:59:56.877512+0000","last_active":"2024-04-20T10:59:56.877466+0000","last_peered":"2024-04-20T10:59:56.877466+0000","last_clean":"2024-04-20T10:59:56.877466+0000","last_became_active":"2024-04-20T10:50:40.607284+0000","last_became_peered":"2024-04-20T10:50:40.607284+0000","last_unstale":"2024-04-20T10:59:56.877466+0000","last_undegraded":"2024-04-20T10:59:56.877466+0000","last_fullsized":"2024-04-20T10:59:56.877466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T10:59:56.877333+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T10:59:56.877333+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.877333+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:30:53.660260+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":12893,"num_write":338,"num_write_kb":54469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"38'680","reported_seq":748,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.060637+0000","last_change":"2024-04-20T10:59:58.060688+0000","last_active":"2024-04-20T10:59:58.060637+0000","last_peered":"2024-04-20T10:59:58.060637+0000","last_clean":"2024-04-20T10:59:58.060637+0000","last_became_active":"2024-04-20T10:50:39.575877+0000","last_became_peered":"2024-04-20T10:50:39.575877+0000","last_unstale":"2024-04-20T10:59:58.060637+0000","last_undegraded":"2024-04-20T10:59:58.060637+0000","last_fullsized":"2024-04-20T10:59:58.060637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'680","last_scrub_stamp":"2024-04-20T10:59:58.060467+0000","last_deep_scrub":"38'680","last_deep_scrub_stamp":"2024-04-20T10:59:58.060467+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.060467+0000","objects_scrubbed":2,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:24:11.137390+0000","scrub_duration":14,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":8197,"num_write":626,"num_write_kb":4509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"38'249","reported_seq":304,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.102161+0000","last_change":"2024-04-20T10:59:55.102190+0000","last_active":"2024-04-20T10:59:55.102161+0000","last_peered":"2024-04-20T10:59:55.102161+0000","last_clean":"2024-04-20T10:59:55.102161+0000","last_became_active":"2024-04-20T10:50:48.638199+0000","last_became_peered":"2024-04-20T10:50:48.638199+0000","last_unstale":"2024-04-20T10:59:55.102161+0000","last_undegraded":"2024-04-20T10:59:55.102161+0000","last_fullsized":"2024-04-20T10:59:55.102161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'249","last_scrub_stamp":"2024-04-20T10:59:55.102044+0000","last_deep_scrub":"38'249","last_deep_scrub_stamp":"2024-04-20T10:59:55.102044+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.102044+0000","objects_scrubbed":1,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:17:33.480154+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":197,"num_write_kb":4202,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"38'396","reported_seq":515,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:17.791341+0000","last_change":"2024-04-20T11:00:17.791341+0000","last_active":"2024-04-20T11:00:17.791341+0000","last_peered":"2024-04-20T11:00:17.791341+0000","last_clean":"2024-04-20T11:00:17.791341+0000","last_became_active":"2024-04-20T10:50:49.654656+0000","last_became_peered":"2024-04-20T10:50:49.654656+0000","last_unstale":"2024-04-20T11:00:17.791341+0000","last_undegraded":"2024-04-20T11:00:17.791341+0000","last_fullsized":"2024-04-20T11:00:17.791341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'396","last_scrub_stamp":"2024-04-20T11:00:17.791222+0000","last_deep_scrub":"38'396","last_deep_scrub_stamp":"2024-04-20T11:00:17.791222+0000","last_clean_scrub_stamp":"2024-04-20T11:00:17.791222+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:12:39.435082+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":27222,"num_write":365,"num_write_kb":63558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"38'485","reported_seq":649,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.901538+0000","last_change":"2024-04-20T10:59:57.901538+0000","last_active":"2024-04-20T10:59:57.901538+0000","last_peered":"2024-04-20T10:59:57.901538+0000","last_clean":"2024-04-20T10:59:57.901538+0000","last_became_active":"2024-04-20T10:50:40.606540+0000","last_became_peered":"2024-04-20T10:50:40.606540+0000","last_unstale":"2024-04-20T10:59:57.901538+0000","last_undegraded":"2024-04-20T10:59:57.901538+0000","last_fullsized":"2024-04-20T10:59:57.901538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'485","last_scrub_stamp":"2024-04-20T10:59:57.901373+0000","last_deep_scrub":"38'485","last_deep_scrub_stamp":"2024-04-20T10:59:57.901373+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.901373+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:37:07.844943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":79269,"num_write":451,"num_write_kb":100665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"38'423","reported_seq":514,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.481006+0000","last_change":"2024-04-20T10:59:53.481006+0000","last_active":"2024-04-20T10:59:53.481006+0000","last_peered":"2024-04-20T10:59:53.481006+0000","last_clean":"2024-04-20T10:59:53.481006+0000","last_became_active":"2024-04-20T10:50:39.577129+0000","last_became_peered":"2024-04-20T10:50:39.577129+0000","last_unstale":"2024-04-20T10:59:53.481006+0000","last_undegraded":"2024-04-20T10:59:53.481006+0000","last_fullsized":"2024-04-20T10:59:53.481006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T10:59:53.480885+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T10:59:53.480885+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.480885+0000","objects_scrubbed":6,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:43:08.266407+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":8276,"num_write":372,"num_write_kb":8400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"38'125","reported_seq":182,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.408384+0000","last_change":"2024-04-20T11:00:02.408414+0000","last_active":"2024-04-20T11:00:02.408384+0000","last_peered":"2024-04-20T11:00:02.408384+0000","last_clean":"2024-04-20T11:00:02.408384+0000","last_became_active":"2024-04-20T10:50:48.639907+0000","last_became_peered":"2024-04-20T10:50:48.639907+0000","last_unstale":"2024-04-20T11:00:02.408384+0000","last_undegraded":"2024-04-20T11:00:02.408384+0000","last_fullsized":"2024-04-20T11:00:02.408384+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'125","last_scrub_stamp":"2024-04-20T11:00:02.408295+0000","last_deep_scrub":"38'125","last_deep_scrub_stamp":"2024-04-20T11:00:02.408295+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.408295+0000","objects_scrubbed":1,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:57:24.612803+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":12306,"num_write":76,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.16","version":"38'439","reported_seq":572,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.300160+0000","last_change":"2024-04-20T11:00:02.300160+0000","last_active":"2024-04-20T11:00:02.300160+0000","last_peered":"2024-04-20T11:00:02.300160+0000","last_clean":"2024-04-20T11:00:02.300160+0000","last_became_active":"2024-04-20T10:50:49.648559+0000","last_became_peered":"2024-04-20T10:50:49.648559+0000","last_unstale":"2024-04-20T11:00:02.300160+0000","last_undegraded":"2024-04-20T11:00:02.300160+0000","last_fullsized":"2024-04-20T11:00:02.300160+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'439","last_scrub_stamp":"2024-04-20T11:00:02.300043+0000","last_deep_scrub":"38'439","last_deep_scrub_stamp":"2024-04-20T11:00:02.300043+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.300043+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:51:03.853014+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":73928,"num_write":402,"num_write_kb":55745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"38'444","reported_seq":619,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.020511+0000","last_change":"2024-04-20T11:00:02.020537+0000","last_active":"2024-04-20T11:00:02.020511+0000","last_peered":"2024-04-20T11:00:02.020511+0000","last_clean":"2024-04-20T11:00:02.020511+0000","last_became_active":"2024-04-20T10:50:40.593078+0000","last_became_peered":"2024-04-20T10:50:40.593078+0000","last_unstale":"2024-04-20T11:00:02.020511+0000","last_undegraded":"2024-04-20T11:00:02.020511+0000","last_fullsized":"2024-04-20T11:00:02.020511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'444","last_scrub_stamp":"2024-04-20T11:00:02.020414+0000","last_deep_scrub":"38'444","last_deep_scrub_stamp":"2024-04-20T11:00:02.020414+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.020414+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:38:38.838157+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":47645,"num_write":412,"num_write_kb":63928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"36'71","reported_seq":132,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.080388+0000","last_change":"2024-04-20T10:59:57.080388+0000","last_active":"2024-04-20T10:59:57.080388+0000","last_peered":"2024-04-20T10:59:57.080388+0000","last_clean":"2024-04-20T10:59:57.080388+0000","last_became_active":"2024-04-20T10:50:39.581147+0000","last_became_peered":"2024-04-20T10:50:39.581147+0000","last_unstale":"2024-04-20T10:59:57.080388+0000","last_undegraded":"2024-04-20T10:59:57.080388+0000","last_fullsized":"2024-04-20T10:59:57.080388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'71","last_scrub_stamp":"2024-04-20T10:59:57.080261+0000","last_deep_scrub":"36'71","last_deep_scrub_stamp":"2024-04-20T10:59:57.080261+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.080261+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:45:11.562946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"38'64","reported_seq":117,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.748598+0000","last_change":"2024-04-20T10:59:56.748598+0000","last_active":"2024-04-20T10:59:56.748598+0000","last_peered":"2024-04-20T10:59:56.748598+0000","last_clean":"2024-04-20T10:59:56.748598+0000","last_became_active":"2024-04-20T10:50:48.644639+0000","last_became_peered":"2024-04-20T10:50:48.644639+0000","last_unstale":"2024-04-20T10:59:56.748598+0000","last_undegraded":"2024-04-20T10:59:56.748598+0000","last_fullsized":"2024-04-20T10:59:56.748598+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'64","last_scrub_stamp":"2024-04-20T10:59:56.748401+0000","last_deep_scrub":"38'64","last_deep_scrub_stamp":"2024-04-20T10:59:56.748401+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.748401+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:38:12.007704+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"38'417","reported_seq":552,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:18.961330+0000","last_change":"2024-04-20T11:00:18.961330+0000","last_active":"2024-04-20T11:00:18.961330+0000","last_peered":"2024-04-20T11:00:18.961330+0000","last_clean":"2024-04-20T11:00:18.961330+0000","last_became_active":"2024-04-20T10:50:49.654056+0000","last_became_peered":"2024-04-20T10:50:49.654056+0000","last_unstale":"2024-04-20T11:00:18.961330+0000","last_undegraded":"2024-04-20T11:00:18.961330+0000","last_fullsized":"2024-04-20T11:00:18.961330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'417","last_scrub_stamp":"2024-04-20T11:00:18.961170+0000","last_deep_scrub":"38'417","last_deep_scrub_stamp":"2024-04-20T11:00:18.961170+0000","last_clean_scrub_stamp":"2024-04-20T11:00:18.961170+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:08:57.916771+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":84,"num_read_kb":100636,"num_write":369,"num_write_kb":112428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"38'400","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.780680+0000","last_change":"2024-04-20T10:59:52.780680+0000","last_active":"2024-04-20T10:59:52.780680+0000","last_peered":"2024-04-20T10:59:52.780680+0000","last_clean":"2024-04-20T10:59:52.780680+0000","last_became_active":"2024-04-20T10:50:40.607149+0000","last_became_peered":"2024-04-20T10:50:40.607149+0000","last_unstale":"2024-04-20T10:59:52.780680+0000","last_undegraded":"2024-04-20T10:59:52.780680+0000","last_fullsized":"2024-04-20T10:59:52.780680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T10:59:52.780550+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T10:59:52.780550+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.780550+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:34:56.160715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":45758,"num_write":374,"num_write_kb":77972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"38'70","reported_seq":131,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.221021+0000","last_change":"2024-04-20T11:00:06.221046+0000","last_active":"2024-04-20T11:00:06.221021+0000","last_peered":"2024-04-20T11:00:06.221021+0000","last_clean":"2024-04-20T11:00:06.221021+0000","last_became_active":"2024-04-20T10:50:39.586060+0000","last_became_peered":"2024-04-20T10:50:39.586060+0000","last_unstale":"2024-04-20T11:00:06.221021+0000","last_undegraded":"2024-04-20T11:00:06.221021+0000","last_fullsized":"2024-04-20T11:00:06.221021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'70","last_scrub_stamp":"2024-04-20T11:00:06.220929+0000","last_deep_scrub":"38'70","last_deep_scrub_stamp":"2024-04-20T11:00:06.220929+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.220929+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:43:56.204888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"38'521","reported_seq":605,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.793249+0000","last_change":"2024-04-20T10:59:52.793249+0000","last_active":"2024-04-20T10:59:52.793249+0000","last_peered":"2024-04-20T10:59:52.793249+0000","last_clean":"2024-04-20T10:59:52.793249+0000","last_became_active":"2024-04-20T10:50:48.641741+0000","last_became_peered":"2024-04-20T10:50:48.641741+0000","last_unstale":"2024-04-20T10:59:52.793249+0000","last_undegraded":"2024-04-20T10:59:52.793249+0000","last_fullsized":"2024-04-20T10:59:52.793249+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'521","last_scrub_stamp":"2024-04-20T10:59:52.793139+0000","last_deep_scrub":"38'521","last_deep_scrub_stamp":"2024-04-20T10:59:52.793139+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.793139+0000","objects_scrubbed":6,"log_size":521,"log_dups_size":0,"ondisk_log_size":521,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:45:30.392812+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":49,"num_read_kb":32813,"num_write":466,"num_write_kb":12553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.14","version":"38'400","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.789570+0000","last_change":"2024-04-20T11:00:02.789570+0000","last_active":"2024-04-20T11:00:02.789570+0000","last_peered":"2024-04-20T11:00:02.789570+0000","last_clean":"2024-04-20T11:00:02.789570+0000","last_became_active":"2024-04-20T10:50:49.647001+0000","last_became_peered":"2024-04-20T10:50:49.647001+0000","last_unstale":"2024-04-20T11:00:02.789570+0000","last_undegraded":"2024-04-20T11:00:02.789570+0000","last_fullsized":"2024-04-20T11:00:02.789570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T11:00:02.789446+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T11:00:02.789446+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.789446+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:40:02.040237+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":57869,"num_write":367,"num_write_kb":80191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"38'424","reported_seq":573,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.354099+0000","last_change":"2024-04-20T10:59:59.354099+0000","last_active":"2024-04-20T10:59:59.354099+0000","last_peered":"2024-04-20T10:59:59.354099+0000","last_clean":"2024-04-20T10:59:59.354099+0000","last_became_active":"2024-04-20T10:50:40.595703+0000","last_became_peered":"2024-04-20T10:50:40.595703+0000","last_unstale":"2024-04-20T10:59:59.354099+0000","last_undegraded":"2024-04-20T10:59:59.354099+0000","last_fullsized":"2024-04-20T10:59:59.354099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'424","last_scrub_stamp":"2024-04-20T10:59:59.353972+0000","last_deep_scrub":"38'424","last_deep_scrub_stamp":"2024-04-20T10:59:59.353972+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.353972+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:57:41.960553+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":62334,"num_write":402,"num_write_kb":88260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"38'170","reported_seq":247,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.326255+0000","last_change":"2024-04-20T10:59:54.326255+0000","last_active":"2024-04-20T10:59:54.326255+0000","last_peered":"2024-04-20T10:59:54.326255+0000","last_clean":"2024-04-20T10:59:54.326255+0000","last_became_active":"2024-04-20T10:50:39.575486+0000","last_became_peered":"2024-04-20T10:50:39.575486+0000","last_unstale":"2024-04-20T10:59:54.326255+0000","last_undegraded":"2024-04-20T10:59:54.326255+0000","last_fullsized":"2024-04-20T10:59:54.326255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'170","last_scrub_stamp":"2024-04-20T10:59:54.326137+0000","last_deep_scrub":"38'170","last_deep_scrub_stamp":"2024-04-20T10:59:54.326137+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.326137+0000","objects_scrubbed":4,"log_size":170,"log_dups_size":0,"ondisk_log_size":170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:32:59.588122+0000","scrub_duration":16,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":24616,"num_write":112,"num_write_kb":8273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"38'324","reported_seq":393,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.368613+0000","last_change":"2024-04-20T10:59:56.368613+0000","last_active":"2024-04-20T10:59:56.368613+0000","last_peered":"2024-04-20T10:59:56.368613+0000","last_clean":"2024-04-20T10:59:56.368613+0000","last_became_active":"2024-04-20T10:50:48.643494+0000","last_became_peered":"2024-04-20T10:50:48.643494+0000","last_unstale":"2024-04-20T10:59:56.368613+0000","last_undegraded":"2024-04-20T10:59:56.368613+0000","last_fullsized":"2024-04-20T10:59:56.368613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'324","last_scrub_stamp":"2024-04-20T10:59:56.368430+0000","last_deep_scrub":"38'324","last_deep_scrub_stamp":"2024-04-20T10:59:56.368430+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.368430+0000","objects_scrubbed":3,"log_size":324,"log_dups_size":0,"ondisk_log_size":324,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:48:11.457766+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":4129,"num_write":278,"num_write_kb":4348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.13","version":"38'376","reported_seq":499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:12.803171+0000","last_change":"2024-04-20T11:00:12.803193+0000","last_active":"2024-04-20T11:00:12.803171+0000","last_peered":"2024-04-20T11:00:12.803171+0000","last_clean":"2024-04-20T11:00:12.803171+0000","last_became_active":"2024-04-20T10:50:49.647930+0000","last_became_peered":"2024-04-20T10:50:49.647930+0000","last_unstale":"2024-04-20T11:00:12.803171+0000","last_undegraded":"2024-04-20T11:00:12.803171+0000","last_fullsized":"2024-04-20T11:00:12.803171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'376","last_scrub_stamp":"2024-04-20T11:00:12.803081+0000","last_deep_scrub":"38'376","last_deep_scrub_stamp":"2024-04-20T11:00:12.803081+0000","last_clean_scrub_stamp":"2024-04-20T11:00:12.803081+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:23:38.191744+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":25860,"num_write":345,"num_write_kb":47542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"38'388","reported_seq":515,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.856583+0000","last_change":"2024-04-20T11:00:01.856583+0000","last_active":"2024-04-20T11:00:01.856583+0000","last_peered":"2024-04-20T11:00:01.856583+0000","last_clean":"2024-04-20T11:00:01.856583+0000","last_became_active":"2024-04-20T10:50:40.594162+0000","last_became_peered":"2024-04-20T10:50:40.594162+0000","last_unstale":"2024-04-20T11:00:01.856583+0000","last_undegraded":"2024-04-20T11:00:01.856583+0000","last_fullsized":"2024-04-20T11:00:01.856583+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'388","last_scrub_stamp":"2024-04-20T11:00:01.856424+0000","last_deep_scrub":"38'388","last_deep_scrub_stamp":"2024-04-20T11:00:01.856424+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.856424+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:59:55.110727+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":29836,"num_write":343,"num_write_kb":67451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"38'581","reported_seq":671,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.098218+0000","last_change":"2024-04-20T10:59:59.098218+0000","last_active":"2024-04-20T10:59:59.098218+0000","last_peered":"2024-04-20T10:59:59.098218+0000","last_clean":"2024-04-20T10:59:59.098218+0000","last_became_active":"2024-04-20T10:50:39.583523+0000","last_became_peered":"2024-04-20T10:50:39.583523+0000","last_unstale":"2024-04-20T10:59:59.098218+0000","last_undegraded":"2024-04-20T10:59:59.098218+0000","last_fullsized":"2024-04-20T10:59:59.098218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'581","last_scrub_stamp":"2024-04-20T10:59:59.098045+0000","last_deep_scrub":"38'581","last_deep_scrub_stamp":"2024-04-20T10:59:59.098045+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.098045+0000","objects_scrubbed":6,"log_size":581,"log_dups_size":0,"ondisk_log_size":581,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:31:06.619736+0000","scrub_duration":28,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":43,"num_read_kb":35988,"num_write":517,"num_write_kb":12589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"38'65","reported_seq":118,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.575322+0000","last_change":"2024-04-20T10:59:50.575322+0000","last_active":"2024-04-20T10:59:50.575322+0000","last_peered":"2024-04-20T10:59:50.575322+0000","last_clean":"2024-04-20T10:59:50.575322+0000","last_became_active":"2024-04-20T10:50:48.641695+0000","last_became_peered":"2024-04-20T10:50:48.641695+0000","last_unstale":"2024-04-20T10:59:50.575322+0000","last_undegraded":"2024-04-20T10:59:50.575322+0000","last_fullsized":"2024-04-20T10:59:50.575322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'65","last_scrub_stamp":"2024-04-20T10:59:50.575224+0000","last_deep_scrub":"38'65","last_deep_scrub_stamp":"2024-04-20T10:59:50.575224+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.575224+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:52:41.164009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.12","version":"38'406","reported_seq":529,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.366550+0000","last_change":"2024-04-20T11:00:11.366550+0000","last_active":"2024-04-20T11:00:11.366550+0000","last_peered":"2024-04-20T11:00:11.366550+0000","last_clean":"2024-04-20T11:00:11.366550+0000","last_became_active":"2024-04-20T10:50:49.654498+0000","last_became_peered":"2024-04-20T10:50:49.654498+0000","last_unstale":"2024-04-20T11:00:11.366550+0000","last_undegraded":"2024-04-20T11:00:11.366550+0000","last_fullsized":"2024-04-20T11:00:11.366550+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'406","last_scrub_stamp":"2024-04-20T11:00:11.366367+0000","last_deep_scrub":"38'406","last_deep_scrub_stamp":"2024-04-20T11:00:11.366367+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.366367+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:06.890395+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":74646,"num_write":381,"num_write_kb":55457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"37'380","reported_seq":527,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.115681+0000","last_change":"2024-04-20T11:00:03.115707+0000","last_active":"2024-04-20T11:00:03.115681+0000","last_peered":"2024-04-20T11:00:03.115681+0000","last_clean":"2024-04-20T11:00:03.115681+0000","last_became_active":"2024-04-20T10:50:40.595592+0000","last_became_peered":"2024-04-20T10:50:40.595592+0000","last_unstale":"2024-04-20T11:00:03.115681+0000","last_undegraded":"2024-04-20T11:00:03.115681+0000","last_fullsized":"2024-04-20T11:00:03.115681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'380","last_scrub_stamp":"2024-04-20T11:00:03.115586+0000","last_deep_scrub":"37'380","last_deep_scrub_stamp":"2024-04-20T11:00:03.115586+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.115586+0000","objects_scrubbed":0,"log_size":380,"log_dups_size":0,"ondisk_log_size":380,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:48:43.177519+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":61041,"num_write":349,"num_write_kb":58639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"38'335","reported_seq":409,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.422871+0000","last_change":"2024-04-20T11:00:04.422871+0000","last_active":"2024-04-20T11:00:04.422871+0000","last_peered":"2024-04-20T11:00:04.422871+0000","last_clean":"2024-04-20T11:00:04.422871+0000","last_became_active":"2024-04-20T10:50:39.587066+0000","last_became_peered":"2024-04-20T10:50:39.587066+0000","last_unstale":"2024-04-20T11:00:04.422871+0000","last_undegraded":"2024-04-20T11:00:04.422871+0000","last_fullsized":"2024-04-20T11:00:04.422871+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'335","last_scrub_stamp":"2024-04-20T11:00:04.422740+0000","last_deep_scrub":"38'335","last_deep_scrub_stamp":"2024-04-20T11:00:04.422740+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.422740+0000","objects_scrubbed":3,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:01:49.648542+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194394,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":27,"num_read_kb":4122,"num_write":282,"num_write_kb":4319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"38'153","reported_seq":232,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.117224+0000","last_change":"2024-04-20T10:59:56.117224+0000","last_active":"2024-04-20T10:59:56.117224+0000","last_peered":"2024-04-20T10:59:56.117224+0000","last_clean":"2024-04-20T10:59:56.117224+0000","last_became_active":"2024-04-20T10:50:48.642434+0000","last_became_peered":"2024-04-20T10:50:48.642434+0000","last_unstale":"2024-04-20T10:59:56.117224+0000","last_undegraded":"2024-04-20T10:59:56.117224+0000","last_fullsized":"2024-04-20T10:59:56.117224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'153","last_scrub_stamp":"2024-04-20T10:59:56.117098+0000","last_deep_scrub":"38'153","last_deep_scrub_stamp":"2024-04-20T10:59:56.117098+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.117098+0000","objects_scrubbed":4,"log_size":153,"log_dups_size":0,"ondisk_log_size":153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:47:42.076531+0000","scrub_duration":21,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":40,"num_read_kb":45111,"num_write":81,"num_write_kb":8263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.11","version":"38'468","reported_seq":607,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.982142+0000","last_change":"2024-04-20T11:00:07.982142+0000","last_active":"2024-04-20T11:00:07.982142+0000","last_peered":"2024-04-20T11:00:07.982142+0000","last_clean":"2024-04-20T11:00:07.982142+0000","last_became_active":"2024-04-20T10:50:49.640414+0000","last_became_peered":"2024-04-20T10:50:49.640414+0000","last_unstale":"2024-04-20T11:00:07.982142+0000","last_undegraded":"2024-04-20T11:00:07.982142+0000","last_fullsized":"2024-04-20T11:00:07.982142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'468","last_scrub_stamp":"2024-04-20T11:00:07.982025+0000","last_deep_scrub":"38'468","last_deep_scrub_stamp":"2024-04-20T11:00:07.982025+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.982025+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:26:42.868192+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":50494,"num_write":431,"num_write_kb":38868,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"37'379","reported_seq":512,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.329018+0000","last_change":"2024-04-20T10:59:53.329018+0000","last_active":"2024-04-20T10:59:53.329018+0000","last_peered":"2024-04-20T10:59:53.329018+0000","last_clean":"2024-04-20T10:59:53.329018+0000","last_became_active":"2024-04-20T10:50:40.599022+0000","last_became_peered":"2024-04-20T10:50:40.599022+0000","last_unstale":"2024-04-20T10:59:53.329018+0000","last_undegraded":"2024-04-20T10:59:53.329018+0000","last_fullsized":"2024-04-20T10:59:53.329018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'379","last_scrub_stamp":"2024-04-20T10:59:53.328907+0000","last_deep_scrub":"37'379","last_deep_scrub_stamp":"2024-04-20T10:59:53.328907+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.328907+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:12:00.355277+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":58132,"num_write":347,"num_write_kb":59251,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"38'175","reported_seq":237,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.159361+0000","last_change":"2024-04-20T11:00:08.159361+0000","last_active":"2024-04-20T11:00:08.159361+0000","last_peered":"2024-04-20T11:00:08.159361+0000","last_clean":"2024-04-20T11:00:08.159361+0000","last_became_active":"2024-04-20T10:50:39.586528+0000","last_became_peered":"2024-04-20T10:50:39.586528+0000","last_unstale":"2024-04-20T11:00:08.159361+0000","last_undegraded":"2024-04-20T11:00:08.159361+0000","last_fullsized":"2024-04-20T11:00:08.159361+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'175","last_scrub_stamp":"2024-04-20T11:00:08.159240+0000","last_deep_scrub":"38'175","last_deep_scrub_stamp":"2024-04-20T11:00:08.159240+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.159240+0000","objects_scrubbed":1,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:15:05.589260+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":116,"num_write_kb":4177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"38'458","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:51.769178+0000","last_change":"2024-04-20T10:59:51.769215+0000","last_active":"2024-04-20T10:59:51.769178+0000","last_peered":"2024-04-20T10:59:51.769178+0000","last_clean":"2024-04-20T10:59:51.769178+0000","last_became_active":"2024-04-20T10:50:48.641094+0000","last_became_peered":"2024-04-20T10:50:48.641094+0000","last_unstale":"2024-04-20T10:59:51.769178+0000","last_undegraded":"2024-04-20T10:59:51.769178+0000","last_fullsized":"2024-04-20T10:59:51.769178+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'458","last_scrub_stamp":"2024-04-20T10:59:51.769099+0000","last_deep_scrub":"38'458","last_deep_scrub_stamp":"2024-04-20T10:59:51.769099+0000","last_clean_scrub_stamp":"2024-04-20T10:59:51.769099+0000","objects_scrubbed":6,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:26:22.465514+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":101,"num_read_kb":8291,"num_write":401,"num_write_kb":8399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'436","reported_seq":569,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:16.746251+0000","last_change":"2024-04-20T11:00:16.746279+0000","last_active":"2024-04-20T11:00:16.746251+0000","last_peered":"2024-04-20T11:00:16.746251+0000","last_clean":"2024-04-20T11:00:16.746251+0000","last_became_active":"2024-04-20T10:50:49.646509+0000","last_became_peered":"2024-04-20T10:50:49.646509+0000","last_unstale":"2024-04-20T11:00:16.746251+0000","last_undegraded":"2024-04-20T11:00:16.746251+0000","last_fullsized":"2024-04-20T11:00:16.746251+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'436","last_scrub_stamp":"2024-04-20T11:00:16.746154+0000","last_deep_scrub":"38'436","last_deep_scrub_stamp":"2024-04-20T11:00:16.746154+0000","last_clean_scrub_stamp":"2024-04-20T11:00:16.746154+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:22:49.055533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":65641,"num_write":399,"num_write_kb":55375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"38'413","reported_seq":559,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.326673+0000","last_change":"2024-04-20T11:00:01.326673+0000","last_active":"2024-04-20T11:00:01.326673+0000","last_peered":"2024-04-20T11:00:01.326673+0000","last_clean":"2024-04-20T11:00:01.326673+0000","last_became_active":"2024-04-20T10:50:40.601416+0000","last_became_peered":"2024-04-20T10:50:40.601416+0000","last_unstale":"2024-04-20T11:00:01.326673+0000","last_undegraded":"2024-04-20T11:00:01.326673+0000","last_fullsized":"2024-04-20T11:00:01.326673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'413","last_scrub_stamp":"2024-04-20T11:00:01.326556+0000","last_deep_scrub":"38'413","last_deep_scrub_stamp":"2024-04-20T11:00:01.326556+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.326556+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:03:39.792170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":35937,"num_write":378,"num_write_kb":46521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"37'65","reported_seq":126,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.077961+0000","last_change":"2024-04-20T11:00:00.077961+0000","last_active":"2024-04-20T11:00:00.077961+0000","last_peered":"2024-04-20T11:00:00.077961+0000","last_clean":"2024-04-20T11:00:00.077961+0000","last_became_active":"2024-04-20T10:50:39.585599+0000","last_became_peered":"2024-04-20T10:50:39.585599+0000","last_unstale":"2024-04-20T11:00:00.077961+0000","last_undegraded":"2024-04-20T11:00:00.077961+0000","last_fullsized":"2024-04-20T11:00:00.077961+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'65","last_scrub_stamp":"2024-04-20T11:00:00.077809+0000","last_deep_scrub":"37'65","last_deep_scrub_stamp":"2024-04-20T11:00:00.077809+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.077809+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:58:28.881881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"36'63","reported_seq":116,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.746717+0000","last_change":"2024-04-20T10:59:54.746717+0000","last_active":"2024-04-20T10:59:54.746717+0000","last_peered":"2024-04-20T10:59:54.746717+0000","last_clean":"2024-04-20T10:59:54.746717+0000","last_became_active":"2024-04-20T10:50:48.644605+0000","last_became_peered":"2024-04-20T10:50:48.644605+0000","last_unstale":"2024-04-20T10:59:54.746717+0000","last_undegraded":"2024-04-20T10:59:54.746717+0000","last_fullsized":"2024-04-20T10:59:54.746717+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'63","last_scrub_stamp":"2024-04-20T10:59:54.746539+0000","last_deep_scrub":"36'63","last_deep_scrub_stamp":"2024-04-20T10:59:54.746539+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.746539+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:28:50.353446+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1f","version":"38'364","reported_seq":471,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.027772+0000","last_change":"2024-04-20T11:00:07.027798+0000","last_active":"2024-04-20T11:00:07.027772+0000","last_peered":"2024-04-20T11:00:07.027772+0000","last_clean":"2024-04-20T11:00:07.027772+0000","last_became_active":"2024-04-20T10:50:49.640302+0000","last_became_peered":"2024-04-20T10:50:49.640302+0000","last_unstale":"2024-04-20T11:00:07.027772+0000","last_undegraded":"2024-04-20T11:00:07.027772+0000","last_fullsized":"2024-04-20T11:00:07.027772+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'364","last_scrub_stamp":"2024-04-20T11:00:07.027687+0000","last_deep_scrub":"38'364","last_deep_scrub_stamp":"2024-04-20T11:00:07.027687+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.027687+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:19:31.369392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":25276,"num_write":334,"num_write_kb":46079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"38'74","reported_seq":133,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.500072+0000","last_change":"2024-04-20T11:00:05.500100+0000","last_active":"2024-04-20T11:00:05.500072+0000","last_peered":"2024-04-20T11:00:05.500072+0000","last_clean":"2024-04-20T11:00:05.500072+0000","last_became_active":"2024-04-20T10:50:48.643533+0000","last_became_peered":"2024-04-20T10:50:48.643533+0000","last_unstale":"2024-04-20T11:00:05.500072+0000","last_undegraded":"2024-04-20T11:00:05.500072+0000","last_fullsized":"2024-04-20T11:00:05.500072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'74","last_scrub_stamp":"2024-04-20T11:00:05.499988+0000","last_deep_scrub":"38'74","last_deep_scrub_stamp":"2024-04-20T11:00:05.499988+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.499988+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:41:31.477484+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":24576,"num_write":32,"num_write_kb":4182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"38'418","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.509663+0000","last_change":"2024-04-20T10:59:54.509663+0000","last_active":"2024-04-20T10:59:54.509663+0000","last_peered":"2024-04-20T10:59:54.509663+0000","last_clean":"2024-04-20T10:59:54.509663+0000","last_became_active":"2024-04-20T10:50:40.592170+0000","last_became_peered":"2024-04-20T10:50:40.592170+0000","last_unstale":"2024-04-20T10:59:54.509663+0000","last_undegraded":"2024-04-20T10:59:54.509663+0000","last_fullsized":"2024-04-20T10:59:54.509663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'418","last_scrub_stamp":"2024-04-20T10:59:54.509503+0000","last_deep_scrub":"38'418","last_deep_scrub_stamp":"2024-04-20T10:59:54.509503+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.509503+0000","objects_scrubbed":0,"log_size":418,"log_dups_size":0,"ondisk_log_size":418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:32:45.684536+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":61851,"num_write":392,"num_write_kb":55373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"38'894","reported_seq":962,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.299874+0000","last_change":"2024-04-20T11:00:04.299874+0000","last_active":"2024-04-20T11:00:04.299874+0000","last_peered":"2024-04-20T11:00:04.299874+0000","last_clean":"2024-04-20T11:00:04.299874+0000","last_became_active":"2024-04-20T10:50:39.581957+0000","last_became_peered":"2024-04-20T10:50:39.581957+0000","last_unstale":"2024-04-20T11:00:04.299874+0000","last_undegraded":"2024-04-20T11:00:04.299874+0000","last_fullsized":"2024-04-20T11:00:04.299874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'894","last_scrub_stamp":"2024-04-20T11:00:04.299691+0000","last_deep_scrub":"38'894","last_deep_scrub_stamp":"2024-04-20T11:00:04.299691+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.299691+0000","objects_scrubbed":2,"log_size":894,"log_dups_size":0,"ondisk_log_size":894,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:36:12.173293+0000","scrub_duration":22,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":834,"num_write_kb":8709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"38'413","reported_seq":539,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.550505+0000","last_change":"2024-04-20T11:00:08.550557+0000","last_active":"2024-04-20T11:00:08.550505+0000","last_peered":"2024-04-20T11:00:08.550505+0000","last_clean":"2024-04-20T11:00:08.550505+0000","last_became_active":"2024-04-20T10:50:49.645556+0000","last_became_peered":"2024-04-20T10:50:49.645556+0000","last_unstale":"2024-04-20T11:00:08.550505+0000","last_undegraded":"2024-04-20T11:00:08.550505+0000","last_fullsized":"2024-04-20T11:00:08.550505+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'413","last_scrub_stamp":"2024-04-20T11:00:08.550400+0000","last_deep_scrub":"38'413","last_deep_scrub_stamp":"2024-04-20T11:00:08.550400+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.550400+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:30.624500+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":49569,"num_write":377,"num_write_kb":64815,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"38'57","reported_seq":127,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.113394+0000","last_change":"2024-04-20T10:59:54.113432+0000","last_active":"2024-04-20T10:59:54.113394+0000","last_peered":"2024-04-20T10:59:54.113394+0000","last_clean":"2024-04-20T10:59:54.113394+0000","last_became_active":"2024-04-20T10:50:48.636613+0000","last_became_peered":"2024-04-20T10:50:48.636613+0000","last_unstale":"2024-04-20T10:59:54.113394+0000","last_undegraded":"2024-04-20T10:59:54.113394+0000","last_fullsized":"2024-04-20T10:59:54.113394+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'57","last_scrub_stamp":"2024-04-20T10:59:54.113308+0000","last_deep_scrub":"38'57","last_deep_scrub_stamp":"2024-04-20T10:59:54.113308+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.113308+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:17:40.919175+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":29,"num_read_kb":20504,"num_write":8,"num_write_kb":4109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"38'435","reported_seq":564,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.784202+0000","last_change":"2024-04-20T11:00:08.784202+0000","last_active":"2024-04-20T11:00:08.784202+0000","last_peered":"2024-04-20T11:00:08.784202+0000","last_clean":"2024-04-20T11:00:08.784202+0000","last_became_active":"2024-04-20T10:50:40.591910+0000","last_became_peered":"2024-04-20T10:50:40.591910+0000","last_unstale":"2024-04-20T11:00:08.784202+0000","last_undegraded":"2024-04-20T11:00:08.784202+0000","last_fullsized":"2024-04-20T11:00:08.784202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'435","last_scrub_stamp":"2024-04-20T11:00:08.784074+0000","last_deep_scrub":"38'435","last_deep_scrub_stamp":"2024-04-20T11:00:08.784074+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.784074+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:38:51.228279+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":26261,"num_write":400,"num_write_kb":42830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"38'221","reported_seq":283,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.807604+0000","last_change":"2024-04-20T11:00:06.807604+0000","last_active":"2024-04-20T11:00:06.807604+0000","last_peered":"2024-04-20T11:00:06.807604+0000","last_clean":"2024-04-20T11:00:06.807604+0000","last_became_active":"2024-04-20T10:50:39.579876+0000","last_became_peered":"2024-04-20T10:50:39.579876+0000","last_unstale":"2024-04-20T11:00:06.807604+0000","last_undegraded":"2024-04-20T11:00:06.807604+0000","last_fullsized":"2024-04-20T11:00:06.807604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'221","last_scrub_stamp":"2024-04-20T11:00:06.807477+0000","last_deep_scrub":"38'221","last_deep_scrub_stamp":"2024-04-20T11:00:06.807477+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.807477+0000","objects_scrubbed":1,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:26:31.225366+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":166,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"38'369","reported_seq":474,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.391173+0000","last_change":"2024-04-20T11:00:07.391200+0000","last_active":"2024-04-20T11:00:07.391173+0000","last_peered":"2024-04-20T11:00:07.391173+0000","last_clean":"2024-04-20T11:00:07.391173+0000","last_became_active":"2024-04-20T10:50:49.651259+0000","last_became_peered":"2024-04-20T10:50:49.651259+0000","last_unstale":"2024-04-20T11:00:07.391173+0000","last_undegraded":"2024-04-20T11:00:07.391173+0000","last_fullsized":"2024-04-20T11:00:07.391173+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'369","last_scrub_stamp":"2024-04-20T11:00:07.391076+0000","last_deep_scrub":"38'369","last_deep_scrub_stamp":"2024-04-20T11:00:07.391076+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.391076+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:44:35.885133+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":31197,"num_write":338,"num_write_kb":64191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"38'451","reported_seq":518,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.074749+0000","last_change":"2024-04-20T10:59:58.074811+0000","last_active":"2024-04-20T10:59:58.074749+0000","last_peered":"2024-04-20T10:59:58.074749+0000","last_clean":"2024-04-20T10:59:58.074749+0000","last_became_active":"2024-04-20T10:50:39.581824+0000","last_became_peered":"2024-04-20T10:50:39.581824+0000","last_unstale":"2024-04-20T10:59:58.074749+0000","last_undegraded":"2024-04-20T10:59:58.074749+0000","last_fullsized":"2024-04-20T10:59:58.074749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T10:59:58.074642+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T10:59:58.074642+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.074642+0000","objects_scrubbed":3,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:21:39.338176+0000","scrub_duration":33,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":28672,"num_write":384,"num_write_kb":12501,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"38'379","reported_seq":524,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:49.300752+0000","last_change":"2024-04-20T10:59:49.300795+0000","last_active":"2024-04-20T10:59:49.300752+0000","last_peered":"2024-04-20T10:59:49.300752+0000","last_clean":"2024-04-20T10:59:49.300752+0000","last_became_active":"2024-04-20T10:50:40.600815+0000","last_became_peered":"2024-04-20T10:50:40.600815+0000","last_unstale":"2024-04-20T10:59:49.300752+0000","last_undegraded":"2024-04-20T10:59:49.300752+0000","last_fullsized":"2024-04-20T10:59:49.300752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'379","last_scrub_stamp":"2024-04-20T10:59:49.300624+0000","last_deep_scrub":"38'379","last_deep_scrub_stamp":"2024-04-20T10:59:49.300624+0000","last_clean_scrub_stamp":"2024-04-20T10:59:49.300624+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:02:43.989268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":52177,"num_write":354,"num_write_kb":79739,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"38'583","reported_seq":648,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.494614+0000","last_change":"2024-04-20T10:59:57.494669+0000","last_active":"2024-04-20T10:59:57.494614+0000","last_peered":"2024-04-20T10:59:57.494614+0000","last_clean":"2024-04-20T10:59:57.494614+0000","last_became_active":"2024-04-20T10:50:48.640862+0000","last_became_peered":"2024-04-20T10:50:48.640862+0000","last_unstale":"2024-04-20T10:59:57.494614+0000","last_undegraded":"2024-04-20T10:59:57.494614+0000","last_fullsized":"2024-04-20T10:59:57.494614+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'583","last_scrub_stamp":"2024-04-20T10:59:57.494504+0000","last_deep_scrub":"38'583","last_deep_scrub_stamp":"2024-04-20T10:59:57.494504+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.494504+0000","objects_scrubbed":2,"log_size":583,"log_dups_size":0,"ondisk_log_size":583,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:12:29.827360+0000","scrub_duration":13,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":33,"num_read_kb":12318,"num_write":526,"num_write_kb":4395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1c","version":"38'403","reported_seq":541,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.198621+0000","last_change":"2024-04-20T11:00:10.198648+0000","last_active":"2024-04-20T11:00:10.198621+0000","last_peered":"2024-04-20T11:00:10.198621+0000","last_clean":"2024-04-20T11:00:10.198621+0000","last_became_active":"2024-04-20T10:50:49.640460+0000","last_became_peered":"2024-04-20T10:50:49.640460+0000","last_unstale":"2024-04-20T11:00:10.198621+0000","last_undegraded":"2024-04-20T11:00:10.198621+0000","last_fullsized":"2024-04-20T11:00:10.198621+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'403","last_scrub_stamp":"2024-04-20T11:00:10.198517+0000","last_deep_scrub":"38'403","last_deep_scrub_stamp":"2024-04-20T11:00:10.198517+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.198517+0000","objects_scrubbed":0,"log_size":403,"log_dups_size":0,"ondisk_log_size":403,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:15:01.092832+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":104331,"num_write":376,"num_write_kb":109020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"38'182","reported_seq":247,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:04.810125+0000","last_change":"2024-04-20T11:00:04.810154+0000","last_active":"2024-04-20T11:00:04.810125+0000","last_peered":"2024-04-20T11:00:04.810125+0000","last_clean":"2024-04-20T11:00:04.810125+0000","last_became_active":"2024-04-20T10:50:39.578635+0000","last_became_peered":"2024-04-20T10:50:39.578635+0000","last_unstale":"2024-04-20T11:00:04.810125+0000","last_undegraded":"2024-04-20T11:00:04.810125+0000","last_fullsized":"2024-04-20T11:00:04.810125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'182","last_scrub_stamp":"2024-04-20T11:00:04.810044+0000","last_deep_scrub":"38'182","last_deep_scrub_stamp":"2024-04-20T11:00:04.810044+0000","last_clean_scrub_stamp":"2024-04-20T11:00:04.810044+0000","objects_scrubbed":1,"log_size":182,"log_dups_size":0,"ondisk_log_size":182,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:29:45.694276+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":16384,"num_write":124,"num_write_kb":4168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'410","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.005325+0000","last_change":"2024-04-20T10:59:59.005352+0000","last_active":"2024-04-20T10:59:59.005325+0000","last_peered":"2024-04-20T10:59:59.005325+0000","last_clean":"2024-04-20T10:59:59.005325+0000","last_became_active":"2024-04-20T10:50:40.584307+0000","last_became_peered":"2024-04-20T10:50:40.584307+0000","last_unstale":"2024-04-20T10:59:59.005325+0000","last_undegraded":"2024-04-20T10:59:59.005325+0000","last_fullsized":"2024-04-20T10:59:59.005325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'410","last_scrub_stamp":"2024-04-20T10:59:59.005237+0000","last_deep_scrub":"37'410","last_deep_scrub_stamp":"2024-04-20T10:59:59.005237+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.005237+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:01:04.836565+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":56637,"num_write":377,"num_write_kb":62852,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"38'550","reported_seq":625,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.798374+0000","last_change":"2024-04-20T10:59:50.798403+0000","last_active":"2024-04-20T10:59:50.798374+0000","last_peered":"2024-04-20T10:59:50.798374+0000","last_clean":"2024-04-20T10:59:50.798374+0000","last_became_active":"2024-04-20T10:50:48.641797+0000","last_became_peered":"2024-04-20T10:50:48.641797+0000","last_unstale":"2024-04-20T10:59:50.798374+0000","last_undegraded":"2024-04-20T10:59:50.798374+0000","last_fullsized":"2024-04-20T10:59:50.798374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'550","last_scrub_stamp":"2024-04-20T10:59:50.798302+0000","last_deep_scrub":"38'550","last_deep_scrub_stamp":"2024-04-20T10:59:50.798302+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.798302+0000","objects_scrubbed":4,"log_size":550,"log_dups_size":0,"ondisk_log_size":550,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T22:38:58.664176+0000","scrub_duration":26,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":41,"num_read_kb":57371,"num_write":468,"num_write_kb":12517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.26","version":"38'472","reported_seq":617,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.785327+0000","last_change":"2024-04-20T11:00:00.785358+0000","last_active":"2024-04-20T11:00:00.785327+0000","last_peered":"2024-04-20T11:00:00.785327+0000","last_clean":"2024-04-20T11:00:00.785327+0000","last_became_active":"2024-04-20T10:50:49.645818+0000","last_became_peered":"2024-04-20T10:50:49.645818+0000","last_unstale":"2024-04-20T11:00:00.785327+0000","last_undegraded":"2024-04-20T11:00:00.785327+0000","last_fullsized":"2024-04-20T11:00:00.785327+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'472","last_scrub_stamp":"2024-04-20T11:00:00.785231+0000","last_deep_scrub":"38'472","last_deep_scrub_stamp":"2024-04-20T11:00:00.785231+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.785231+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:21:05.316393+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":77683,"num_write":435,"num_write_kb":89005,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"38'421","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.038157+0000","last_change":"2024-04-20T11:00:01.038199+0000","last_active":"2024-04-20T11:00:01.038157+0000","last_peered":"2024-04-20T11:00:01.038157+0000","last_clean":"2024-04-20T11:00:01.038157+0000","last_became_active":"2024-04-20T10:50:40.592719+0000","last_became_peered":"2024-04-20T10:50:40.592719+0000","last_unstale":"2024-04-20T11:00:01.038157+0000","last_undegraded":"2024-04-20T11:00:01.038157+0000","last_fullsized":"2024-04-20T11:00:01.038157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'421","last_scrub_stamp":"2024-04-20T11:00:01.038038+0000","last_deep_scrub":"38'421","last_deep_scrub_stamp":"2024-04-20T11:00:01.038038+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.038038+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:25:10.851965+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":96,"num_read_kb":50143,"num_write":396,"num_write_kb":67741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.27","version":"38'423","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.432279+0000","last_change":"2024-04-20T10:59:57.432306+0000","last_active":"2024-04-20T10:59:57.432279+0000","last_peered":"2024-04-20T10:59:57.432279+0000","last_clean":"2024-04-20T10:59:57.432279+0000","last_became_active":"2024-04-20T10:50:49.645713+0000","last_became_peered":"2024-04-20T10:50:49.645713+0000","last_unstale":"2024-04-20T10:59:57.432279+0000","last_undegraded":"2024-04-20T10:59:57.432279+0000","last_fullsized":"2024-04-20T10:59:57.432279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T10:59:57.432185+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T10:59:57.432185+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.432185+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:48:48.499918+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66334,"num_write":397,"num_write_kb":71356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"38'448","reported_seq":611,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.451065+0000","last_change":"2024-04-20T10:59:56.451091+0000","last_active":"2024-04-20T10:59:56.451065+0000","last_peered":"2024-04-20T10:59:56.451065+0000","last_clean":"2024-04-20T10:59:56.451065+0000","last_became_active":"2024-04-20T10:50:40.605082+0000","last_became_peered":"2024-04-20T10:50:40.605082+0000","last_unstale":"2024-04-20T10:59:56.451065+0000","last_undegraded":"2024-04-20T10:59:56.451065+0000","last_fullsized":"2024-04-20T10:59:56.451065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'448","last_scrub_stamp":"2024-04-20T10:59:56.450972+0000","last_deep_scrub":"38'448","last_deep_scrub_stamp":"2024-04-20T10:59:56.450972+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.450972+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:42:55.365315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":105081,"num_write":414,"num_write_kb":80164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"38'397","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:12.085391+0000","last_change":"2024-04-20T11:00:12.085438+0000","last_active":"2024-04-20T11:00:12.085391+0000","last_peered":"2024-04-20T11:00:12.085391+0000","last_clean":"2024-04-20T11:00:12.085391+0000","last_became_active":"2024-04-20T10:50:49.648697+0000","last_became_peered":"2024-04-20T10:50:49.648697+0000","last_unstale":"2024-04-20T11:00:12.085391+0000","last_undegraded":"2024-04-20T11:00:12.085391+0000","last_fullsized":"2024-04-20T11:00:12.085391+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'397","last_scrub_stamp":"2024-04-20T11:00:12.085290+0000","last_deep_scrub":"38'397","last_deep_scrub_stamp":"2024-04-20T11:00:12.085290+0000","last_clean_scrub_stamp":"2024-04-20T11:00:12.085290+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:01:01.114795+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":91923,"num_write":367,"num_write_kb":80227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"38'487","reported_seq":658,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.328200+0000","last_change":"2024-04-20T10:59:55.328228+0000","last_active":"2024-04-20T10:59:55.328200+0000","last_peered":"2024-04-20T10:59:55.328200+0000","last_clean":"2024-04-20T10:59:55.328200+0000","last_became_active":"2024-04-20T10:50:40.612308+0000","last_became_peered":"2024-04-20T10:50:40.612308+0000","last_unstale":"2024-04-20T10:59:55.328200+0000","last_undegraded":"2024-04-20T10:59:55.328200+0000","last_fullsized":"2024-04-20T10:59:55.328200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'487","last_scrub_stamp":"2024-04-20T10:59:55.328102+0000","last_deep_scrub":"38'487","last_deep_scrub_stamp":"2024-04-20T10:59:55.328102+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.328102+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:22:17.171374+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":66889,"num_write":452,"num_write_kb":101085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.25","version":"38'390","reported_seq":507,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:13.338992+0000","last_change":"2024-04-20T11:00:13.339016+0000","last_active":"2024-04-20T11:00:13.338992+0000","last_peered":"2024-04-20T11:00:13.338992+0000","last_clean":"2024-04-20T11:00:13.338992+0000","last_became_active":"2024-04-20T10:50:49.655329+0000","last_became_peered":"2024-04-20T10:50:49.655329+0000","last_unstale":"2024-04-20T11:00:13.338992+0000","last_undegraded":"2024-04-20T11:00:13.338992+0000","last_fullsized":"2024-04-20T11:00:13.338992+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'390","last_scrub_stamp":"2024-04-20T11:00:13.338864+0000","last_deep_scrub":"38'390","last_deep_scrub_stamp":"2024-04-20T11:00:13.338864+0000","last_clean_scrub_stamp":"2024-04-20T11:00:13.338864+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:42:48.793344+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":66,"num_read_kb":23315,"num_write":364,"num_write_kb":66964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"38'411","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.375209+0000","last_change":"2024-04-20T11:00:01.375232+0000","last_active":"2024-04-20T11:00:01.375209+0000","last_peered":"2024-04-20T11:00:01.375209+0000","last_clean":"2024-04-20T11:00:01.375209+0000","last_became_active":"2024-04-20T10:50:40.599088+0000","last_became_peered":"2024-04-20T10:50:40.599088+0000","last_unstale":"2024-04-20T11:00:01.375209+0000","last_undegraded":"2024-04-20T11:00:01.375209+0000","last_fullsized":"2024-04-20T11:00:01.375209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'411","last_scrub_stamp":"2024-04-20T11:00:01.375124+0000","last_deep_scrub":"38'411","last_deep_scrub_stamp":"2024-04-20T11:00:01.375124+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.375124+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:01:25.816707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":34858,"num_write":375,"num_write_kb":71279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.22","version":"38'438","reported_seq":551,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.828239+0000","last_change":"2024-04-20T11:00:02.828281+0000","last_active":"2024-04-20T11:00:02.828239+0000","last_peered":"2024-04-20T11:00:02.828239+0000","last_clean":"2024-04-20T11:00:02.828239+0000","last_became_active":"2024-04-20T10:50:49.641200+0000","last_became_peered":"2024-04-20T10:50:49.641200+0000","last_unstale":"2024-04-20T11:00:02.828239+0000","last_undegraded":"2024-04-20T11:00:02.828239+0000","last_fullsized":"2024-04-20T11:00:02.828239+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'438","last_scrub_stamp":"2024-04-20T11:00:02.828127+0000","last_deep_scrub":"38'438","last_deep_scrub_stamp":"2024-04-20T11:00:02.828127+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.828127+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:46:28.276542+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":12465,"num_write":398,"num_write_kb":25863,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.24","version":"38'367","reported_seq":499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.778685+0000","last_change":"2024-04-20T10:59:59.778714+0000","last_active":"2024-04-20T10:59:59.778685+0000","last_peered":"2024-04-20T10:59:59.778685+0000","last_clean":"2024-04-20T10:59:59.778685+0000","last_became_active":"2024-04-20T10:50:40.603507+0000","last_became_peered":"2024-04-20T10:50:40.603507+0000","last_unstale":"2024-04-20T10:59:59.778685+0000","last_undegraded":"2024-04-20T10:59:59.778685+0000","last_fullsized":"2024-04-20T10:59:59.778685+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'367","last_scrub_stamp":"2024-04-20T10:59:59.778480+0000","last_deep_scrub":"38'367","last_deep_scrub_stamp":"2024-04-20T10:59:59.778480+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.778480+0000","objects_scrubbed":0,"log_size":367,"log_dups_size":0,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:19:18.719090+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40934,"num_write":339,"num_write_kb":54699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"38'400","reported_seq":514,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.225095+0000","last_change":"2024-04-20T11:00:06.225121+0000","last_active":"2024-04-20T11:00:06.225095+0000","last_peered":"2024-04-20T11:00:06.225095+0000","last_clean":"2024-04-20T11:00:06.225095+0000","last_became_active":"2024-04-20T10:50:49.639350+0000","last_became_peered":"2024-04-20T10:50:49.639350+0000","last_unstale":"2024-04-20T11:00:06.225095+0000","last_undegraded":"2024-04-20T11:00:06.225095+0000","last_fullsized":"2024-04-20T11:00:06.225095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T11:00:06.225014+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T11:00:06.225014+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.225014+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:51:04.665732+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":17066,"num_write":365,"num_write_kb":46558,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"37'404","reported_seq":560,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.387411+0000","last_change":"2024-04-20T10:59:58.387436+0000","last_active":"2024-04-20T10:59:58.387411+0000","last_peered":"2024-04-20T10:59:58.387411+0000","last_clean":"2024-04-20T10:59:58.387411+0000","last_became_active":"2024-04-20T10:50:40.590065+0000","last_became_peered":"2024-04-20T10:50:40.590065+0000","last_unstale":"2024-04-20T10:59:58.387411+0000","last_undegraded":"2024-04-20T10:59:58.387411+0000","last_fullsized":"2024-04-20T10:59:58.387411+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'404","last_scrub_stamp":"2024-04-20T10:59:58.387314+0000","last_deep_scrub":"37'404","last_deep_scrub_stamp":"2024-04-20T10:59:58.387314+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.387314+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:54:27.391907+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":64800,"num_write":371,"num_write_kb":91764,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.20","version":"38'402","reported_seq":510,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:17.742724+0000","last_change":"2024-04-20T11:00:17.742748+0000","last_active":"2024-04-20T11:00:17.742724+0000","last_peered":"2024-04-20T11:00:17.742724+0000","last_clean":"2024-04-20T11:00:17.742724+0000","last_became_active":"2024-04-20T10:50:49.646853+0000","last_became_peered":"2024-04-20T10:50:49.646853+0000","last_unstale":"2024-04-20T11:00:17.742724+0000","last_undegraded":"2024-04-20T11:00:17.742724+0000","last_fullsized":"2024-04-20T11:00:17.742724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'402","last_scrub_stamp":"2024-04-20T11:00:17.742626+0000","last_deep_scrub":"38'402","last_deep_scrub_stamp":"2024-04-20T11:00:17.742626+0000","last_clean_scrub_stamp":"2024-04-20T11:00:17.742626+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:57:40.159217+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":1607,"num_write":370,"num_write_kb":5819,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.26","version":"38'433","reported_seq":579,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.984958+0000","last_change":"2024-04-20T11:00:02.984995+0000","last_active":"2024-04-20T11:00:02.984958+0000","last_peered":"2024-04-20T11:00:02.984958+0000","last_clean":"2024-04-20T11:00:02.984958+0000","last_became_active":"2024-04-20T10:50:40.593753+0000","last_became_peered":"2024-04-20T10:50:40.593753+0000","last_unstale":"2024-04-20T11:00:02.984958+0000","last_undegraded":"2024-04-20T11:00:02.984958+0000","last_fullsized":"2024-04-20T11:00:02.984958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'433","last_scrub_stamp":"2024-04-20T11:00:02.984862+0000","last_deep_scrub":"38'433","last_deep_scrub_stamp":"2024-04-20T11:00:02.984862+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.984862+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:14:39.601457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":4096,"num_write":399,"num_write_kb":30569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"38'439","reported_seq":566,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.986169+0000","last_change":"2024-04-20T11:00:05.986200+0000","last_active":"2024-04-20T11:00:05.986169+0000","last_peered":"2024-04-20T11:00:05.986169+0000","last_clean":"2024-04-20T11:00:05.986169+0000","last_became_active":"2024-04-20T10:50:49.636857+0000","last_became_peered":"2024-04-20T10:50:49.636857+0000","last_unstale":"2024-04-20T11:00:05.986169+0000","last_undegraded":"2024-04-20T11:00:05.986169+0000","last_fullsized":"2024-04-20T11:00:05.986169+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'439","last_scrub_stamp":"2024-04-20T11:00:05.986074+0000","last_deep_scrub":"38'439","last_deep_scrub_stamp":"2024-04-20T11:00:05.986074+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.986074+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:33:05.977567+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":70131,"num_write":400,"num_write_kb":59168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"38'431","reported_seq":591,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:01.816442+0000","last_change":"2024-04-20T11:00:01.816467+0000","last_active":"2024-04-20T11:00:01.816442+0000","last_peered":"2024-04-20T11:00:01.816442+0000","last_clean":"2024-04-20T11:00:01.816442+0000","last_became_active":"2024-04-20T10:50:40.603511+0000","last_became_peered":"2024-04-20T10:50:40.603511+0000","last_unstale":"2024-04-20T11:00:01.816442+0000","last_undegraded":"2024-04-20T11:00:01.816442+0000","last_fullsized":"2024-04-20T11:00:01.816442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'431","last_scrub_stamp":"2024-04-20T11:00:01.816348+0000","last_deep_scrub":"38'431","last_deep_scrub_stamp":"2024-04-20T11:00:01.816348+0000","last_clean_scrub_stamp":"2024-04-20T11:00:01.816348+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:25:08.179421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":77347,"num_write":407,"num_write_kb":71895,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2e","version":"38'408","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:19.796536+0000","last_change":"2024-04-20T11:00:19.796561+0000","last_active":"2024-04-20T11:00:19.796536+0000","last_peered":"2024-04-20T11:00:19.796536+0000","last_clean":"2024-04-20T11:00:19.796536+0000","last_became_active":"2024-04-20T10:50:49.655613+0000","last_became_peered":"2024-04-20T10:50:49.655613+0000","last_unstale":"2024-04-20T11:00:19.796536+0000","last_undegraded":"2024-04-20T11:00:19.796536+0000","last_fullsized":"2024-04-20T11:00:19.796536+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'408","last_scrub_stamp":"2024-04-20T11:00:19.796441+0000","last_deep_scrub":"38'408","last_deep_scrub_stamp":"2024-04-20T11:00:19.796441+0000","last_clean_scrub_stamp":"2024-04-20T11:00:19.796441+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:59:11.803881+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":43744,"num_write":370,"num_write_kb":63188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"38'456","reported_seq":622,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:09.134543+0000","last_change":"2024-04-20T11:00:09.134596+0000","last_active":"2024-04-20T11:00:09.134543+0000","last_peered":"2024-04-20T11:00:09.134543+0000","last_clean":"2024-04-20T11:00:09.134543+0000","last_became_active":"2024-04-20T10:50:40.596946+0000","last_became_peered":"2024-04-20T10:50:40.596946+0000","last_unstale":"2024-04-20T11:00:09.134543+0000","last_undegraded":"2024-04-20T11:00:09.134543+0000","last_fullsized":"2024-04-20T11:00:09.134543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'456","last_scrub_stamp":"2024-04-20T11:00:09.134440+0000","last_deep_scrub":"38'456","last_deep_scrub_stamp":"2024-04-20T11:00:09.134440+0000","last_clean_scrub_stamp":"2024-04-20T11:00:09.134440+0000","objects_scrubbed":0,"log_size":456,"log_dups_size":0,"ondisk_log_size":456,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:59:21.413961+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":107,"num_read_kb":63871,"num_write":428,"num_write_kb":100114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2f","version":"38'419","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:18.725984+0000","last_change":"2024-04-20T11:00:18.726031+0000","last_active":"2024-04-20T11:00:18.725984+0000","last_peered":"2024-04-20T11:00:18.725984+0000","last_clean":"2024-04-20T11:00:18.725984+0000","last_became_active":"2024-04-20T10:50:49.649715+0000","last_became_peered":"2024-04-20T10:50:49.649715+0000","last_unstale":"2024-04-20T11:00:18.725984+0000","last_undegraded":"2024-04-20T11:00:18.725984+0000","last_fullsized":"2024-04-20T11:00:18.725984+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'419","last_scrub_stamp":"2024-04-20T11:00:18.725856+0000","last_deep_scrub":"38'419","last_deep_scrub_stamp":"2024-04-20T11:00:18.725856+0000","last_clean_scrub_stamp":"2024-04-20T11:00:18.725856+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:08:45.682485+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":38962,"num_write":387,"num_write_kb":79793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"38'398","reported_seq":538,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.824301+0000","last_change":"2024-04-20T11:00:07.824327+0000","last_active":"2024-04-20T11:00:07.824301+0000","last_peered":"2024-04-20T11:00:07.824301+0000","last_clean":"2024-04-20T11:00:07.824301+0000","last_became_active":"2024-04-20T10:50:40.591286+0000","last_became_peered":"2024-04-20T10:50:40.591286+0000","last_unstale":"2024-04-20T11:00:07.824301+0000","last_undegraded":"2024-04-20T11:00:07.824301+0000","last_fullsized":"2024-04-20T11:00:07.824301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'398","last_scrub_stamp":"2024-04-20T11:00:07.824172+0000","last_deep_scrub":"38'398","last_deep_scrub_stamp":"2024-04-20T11:00:07.824172+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.824172+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:58:11.309332+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":27738,"num_write":360,"num_write_kb":54944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"38'458","reported_seq":587,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.527022+0000","last_change":"2024-04-20T11:00:00.527046+0000","last_active":"2024-04-20T11:00:00.527022+0000","last_peered":"2024-04-20T11:00:00.527022+0000","last_clean":"2024-04-20T11:00:00.527022+0000","last_became_active":"2024-04-20T10:50:49.642036+0000","last_became_peered":"2024-04-20T10:50:49.642036+0000","last_unstale":"2024-04-20T11:00:00.527022+0000","last_undegraded":"2024-04-20T11:00:00.527022+0000","last_fullsized":"2024-04-20T11:00:00.527022+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'458","last_scrub_stamp":"2024-04-20T11:00:00.526936+0000","last_deep_scrub":"38'458","last_deep_scrub_stamp":"2024-04-20T11:00:00.526936+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.526936+0000","objects_scrubbed":0,"log_size":458,"log_dups_size":0,"ondisk_log_size":458,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:30:09.722198+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":59920,"num_write":425,"num_write_kb":71046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"37'439","reported_seq":608,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.326684+0000","last_change":"2024-04-20T10:59:59.326736+0000","last_active":"2024-04-20T10:59:59.326684+0000","last_peered":"2024-04-20T10:59:59.326684+0000","last_clean":"2024-04-20T10:59:59.326684+0000","last_became_active":"2024-04-20T10:50:40.602264+0000","last_became_peered":"2024-04-20T10:50:40.602264+0000","last_unstale":"2024-04-20T10:59:59.326684+0000","last_undegraded":"2024-04-20T10:59:59.326684+0000","last_fullsized":"2024-04-20T10:59:59.326684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'439","last_scrub_stamp":"2024-04-20T10:59:59.326573+0000","last_deep_scrub":"37'439","last_deep_scrub_stamp":"2024-04-20T10:59:59.326573+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.326573+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:20:24.162729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":95905,"num_write":408,"num_write_kb":92283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.2d","version":"38'434","reported_seq":571,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:16.825702+0000","last_change":"2024-04-20T11:00:16.825747+0000","last_active":"2024-04-20T11:00:16.825702+0000","last_peered":"2024-04-20T11:00:16.825702+0000","last_clean":"2024-04-20T11:00:16.825702+0000","last_became_active":"2024-04-20T10:50:49.654001+0000","last_became_peered":"2024-04-20T10:50:49.654001+0000","last_unstale":"2024-04-20T11:00:16.825702+0000","last_undegraded":"2024-04-20T11:00:16.825702+0000","last_fullsized":"2024-04-20T11:00:16.825702+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'434","last_scrub_stamp":"2024-04-20T11:00:16.825584+0000","last_deep_scrub":"38'434","last_deep_scrub_stamp":"2024-04-20T11:00:16.825584+0000","last_clean_scrub_stamp":"2024-04-20T11:00:16.825584+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:38:25.591715+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":66507,"num_write":387,"num_write_kb":63383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2b","version":"38'427","reported_seq":585,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.389493+0000","last_change":"2024-04-20T11:00:00.389519+0000","last_active":"2024-04-20T11:00:00.389493+0000","last_peered":"2024-04-20T11:00:00.389493+0000","last_clean":"2024-04-20T11:00:00.389493+0000","last_became_active":"2024-04-20T10:50:40.598840+0000","last_became_peered":"2024-04-20T10:50:40.598840+0000","last_unstale":"2024-04-20T11:00:00.389493+0000","last_undegraded":"2024-04-20T11:00:00.389493+0000","last_fullsized":"2024-04-20T11:00:00.389493+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'427","last_scrub_stamp":"2024-04-20T11:00:00.389410+0000","last_deep_scrub":"38'427","last_deep_scrub_stamp":"2024-04-20T11:00:00.389410+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.389410+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:43:25.610664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":76500,"num_write":396,"num_write_kb":108707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2a","version":"38'451","reported_seq":621,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.210856+0000","last_change":"2024-04-20T11:00:08.210884+0000","last_active":"2024-04-20T11:00:08.210856+0000","last_peered":"2024-04-20T11:00:08.210856+0000","last_clean":"2024-04-20T11:00:08.210856+0000","last_became_active":"2024-04-20T10:50:49.640147+0000","last_became_peered":"2024-04-20T10:50:49.640147+0000","last_unstale":"2024-04-20T11:00:08.210856+0000","last_undegraded":"2024-04-20T11:00:08.210856+0000","last_fullsized":"2024-04-20T11:00:08.210856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'451","last_scrub_stamp":"2024-04-20T11:00:08.210756+0000","last_deep_scrub":"38'451","last_deep_scrub_stamp":"2024-04-20T11:00:08.210756+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.210756+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:34:21.087340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":149375,"num_write":423,"num_write_kb":104932,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"36'447","reported_seq":592,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:52.137262+0000","last_change":"2024-04-20T10:59:52.137290+0000","last_active":"2024-04-20T10:59:52.137262+0000","last_peered":"2024-04-20T10:59:52.137262+0000","last_clean":"2024-04-20T10:59:52.137262+0000","last_became_active":"2024-04-20T10:50:40.604895+0000","last_became_peered":"2024-04-20T10:50:40.604895+0000","last_unstale":"2024-04-20T10:59:52.137262+0000","last_undegraded":"2024-04-20T10:59:52.137262+0000","last_fullsized":"2024-04-20T10:59:52.137262+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"36'447","last_scrub_stamp":"2024-04-20T10:59:52.137169+0000","last_deep_scrub":"36'447","last_deep_scrub_stamp":"2024-04-20T10:59:52.137169+0000","last_clean_scrub_stamp":"2024-04-20T10:59:52.137169+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:21:19.041397+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":47044,"num_write":422,"num_write_kb":50901,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"38'415","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.217205+0000","last_change":"2024-04-20T11:00:11.217262+0000","last_active":"2024-04-20T11:00:11.217205+0000","last_peered":"2024-04-20T11:00:11.217205+0000","last_clean":"2024-04-20T11:00:11.217205+0000","last_became_active":"2024-04-20T10:50:49.644592+0000","last_became_peered":"2024-04-20T10:50:49.644592+0000","last_unstale":"2024-04-20T11:00:11.217205+0000","last_undegraded":"2024-04-20T11:00:11.217205+0000","last_fullsized":"2024-04-20T11:00:11.217205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'415","last_scrub_stamp":"2024-04-20T11:00:11.217069+0000","last_deep_scrub":"38'415","last_deep_scrub_stamp":"2024-04-20T11:00:11.217069+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.217069+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:47:31.264778+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":91214,"num_write":375,"num_write_kb":63780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2d","version":"37'461","reported_seq":634,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.784171+0000","last_change":"2024-04-20T10:59:53.784241+0000","last_active":"2024-04-20T10:59:53.784171+0000","last_peered":"2024-04-20T10:59:53.784171+0000","last_clean":"2024-04-20T10:59:53.784171+0000","last_became_active":"2024-04-20T10:50:40.603381+0000","last_became_peered":"2024-04-20T10:50:40.603381+0000","last_unstale":"2024-04-20T10:59:53.784171+0000","last_undegraded":"2024-04-20T10:59:53.784171+0000","last_fullsized":"2024-04-20T10:59:53.784171+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'461","last_scrub_stamp":"2024-04-20T10:59:53.784058+0000","last_deep_scrub":"37'461","last_deep_scrub_stamp":"2024-04-20T10:59:53.784058+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.784058+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:25:04.189321+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":114,"num_read_kb":88844,"num_write":432,"num_write_kb":122405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.28","version":"38'475","reported_seq":641,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:14.078974+0000","last_change":"2024-04-20T11:00:14.078995+0000","last_active":"2024-04-20T11:00:14.078974+0000","last_peered":"2024-04-20T11:00:14.078974+0000","last_clean":"2024-04-20T11:00:14.078974+0000","last_became_active":"2024-04-20T10:50:49.649490+0000","last_became_peered":"2024-04-20T10:50:49.649490+0000","last_unstale":"2024-04-20T11:00:14.078974+0000","last_undegraded":"2024-04-20T11:00:14.078974+0000","last_fullsized":"2024-04-20T11:00:14.078974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'475","last_scrub_stamp":"2024-04-20T11:00:14.078892+0000","last_deep_scrub":"38'475","last_deep_scrub_stamp":"2024-04-20T11:00:14.078892+0000","last_clean_scrub_stamp":"2024-04-20T11:00:14.078892+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:02:19.814212+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":92351,"num_write":448,"num_write_kb":96949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"38'395","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.497267+0000","last_change":"2024-04-20T10:59:55.497267+0000","last_active":"2024-04-20T10:59:55.497267+0000","last_peered":"2024-04-20T10:59:55.497267+0000","last_clean":"2024-04-20T10:59:55.497267+0000","last_became_active":"2024-04-20T10:50:40.597047+0000","last_became_peered":"2024-04-20T10:50:40.597047+0000","last_unstale":"2024-04-20T10:59:55.497267+0000","last_undegraded":"2024-04-20T10:59:55.497267+0000","last_fullsized":"2024-04-20T10:59:55.497267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'395","last_scrub_stamp":"2024-04-20T10:59:55.497141+0000","last_deep_scrub":"38'395","last_deep_scrub_stamp":"2024-04-20T10:59:55.497141+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.497141+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:26:40.782918+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":19688,"num_write":355,"num_write_kb":13664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.29","version":"38'415","reported_seq":539,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:07.551359+0000","last_change":"2024-04-20T11:00:07.551415+0000","last_active":"2024-04-20T11:00:07.551359+0000","last_peered":"2024-04-20T11:00:07.551359+0000","last_clean":"2024-04-20T11:00:07.551359+0000","last_became_active":"2024-04-20T10:50:49.645540+0000","last_became_peered":"2024-04-20T10:50:49.645540+0000","last_unstale":"2024-04-20T11:00:07.551359+0000","last_undegraded":"2024-04-20T11:00:07.551359+0000","last_fullsized":"2024-04-20T11:00:07.551359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'415","last_scrub_stamp":"2024-04-20T11:00:07.551245+0000","last_deep_scrub":"38'415","last_deep_scrub_stamp":"2024-04-20T11:00:07.551245+0000","last_clean_scrub_stamp":"2024-04-20T11:00:07.551245+0000","objects_scrubbed":0,"log_size":415,"log_dups_size":0,"ondisk_log_size":415,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:45:45.368120+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":48111,"num_write":381,"num_write_kb":47357,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2f","version":"38'397","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.260060+0000","last_change":"2024-04-20T11:00:03.260087+0000","last_active":"2024-04-20T11:00:03.260060+0000","last_peered":"2024-04-20T11:00:03.260060+0000","last_clean":"2024-04-20T11:00:03.260060+0000","last_became_active":"2024-04-20T10:50:40.601432+0000","last_became_peered":"2024-04-20T10:50:40.601432+0000","last_unstale":"2024-04-20T11:00:03.260060+0000","last_undegraded":"2024-04-20T11:00:03.260060+0000","last_fullsized":"2024-04-20T11:00:03.260060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'397","last_scrub_stamp":"2024-04-20T11:00:03.259973+0000","last_deep_scrub":"38'397","last_deep_scrub_stamp":"2024-04-20T11:00:03.259973+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.259973+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:54:36.421274+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":17103,"num_write":369,"num_write_kb":54677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"38'400","reported_seq":538,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:08.416960+0000","last_change":"2024-04-20T11:00:08.416960+0000","last_active":"2024-04-20T11:00:08.416960+0000","last_peered":"2024-04-20T11:00:08.416960+0000","last_clean":"2024-04-20T11:00:08.416960+0000","last_became_active":"2024-04-20T10:50:49.653031+0000","last_became_peered":"2024-04-20T10:50:49.653031+0000","last_unstale":"2024-04-20T11:00:08.416960+0000","last_undegraded":"2024-04-20T11:00:08.416960+0000","last_fullsized":"2024-04-20T11:00:08.416960+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'400","last_scrub_stamp":"2024-04-20T11:00:08.416793+0000","last_deep_scrub":"38'400","last_deep_scrub_stamp":"2024-04-20T11:00:08.416793+0000","last_clean_scrub_stamp":"2024-04-20T11:00:08.416793+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:29:33.029833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":100212,"num_write":371,"num_write_kb":79700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"38'442","reported_seq":581,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:06.488056+0000","last_change":"2024-04-20T11:00:06.488111+0000","last_active":"2024-04-20T11:00:06.488056+0000","last_peered":"2024-04-20T11:00:06.488056+0000","last_clean":"2024-04-20T11:00:06.488056+0000","last_became_active":"2024-04-20T10:51:20.873636+0000","last_became_peered":"2024-04-20T10:51:20.873636+0000","last_unstale":"2024-04-20T11:00:06.488056+0000","last_undegraded":"2024-04-20T11:00:06.488056+0000","last_fullsized":"2024-04-20T11:00:06.488056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'442","last_scrub_stamp":"2024-04-20T11:00:06.487948+0000","last_deep_scrub":"38'442","last_deep_scrub_stamp":"2024-04-20T11:00:06.487948+0000","last_clean_scrub_stamp":"2024-04-20T11:00:06.487948+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T20:45:40.915418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":95,"num_read_kb":42670,"num_write":410,"num_write_kb":59228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.37","version":"38'412","reported_seq":537,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:12.218598+0000","last_change":"2024-04-20T11:00:12.218598+0000","last_active":"2024-04-20T11:00:12.218598+0000","last_peered":"2024-04-20T11:00:12.218598+0000","last_clean":"2024-04-20T11:00:12.218598+0000","last_became_active":"2024-04-20T10:50:49.646337+0000","last_became_peered":"2024-04-20T10:50:49.646337+0000","last_unstale":"2024-04-20T11:00:12.218598+0000","last_undegraded":"2024-04-20T11:00:12.218598+0000","last_fullsized":"2024-04-20T11:00:12.218598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'412","last_scrub_stamp":"2024-04-20T11:00:12.218433+0000","last_deep_scrub":"38'412","last_deep_scrub_stamp":"2024-04-20T11:00:12.218433+0000","last_clean_scrub_stamp":"2024-04-20T11:00:12.218433+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:20:06.646162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":47914,"num_write":385,"num_write_kb":47165,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"38'402","reported_seq":546,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.462276+0000","last_change":"2024-04-20T11:00:05.462303+0000","last_active":"2024-04-20T11:00:05.462276+0000","last_peered":"2024-04-20T11:00:05.462276+0000","last_clean":"2024-04-20T11:00:05.462276+0000","last_became_active":"2024-04-20T10:50:40.582215+0000","last_became_peered":"2024-04-20T10:50:40.582215+0000","last_unstale":"2024-04-20T11:00:05.462276+0000","last_undegraded":"2024-04-20T11:00:05.462276+0000","last_fullsized":"2024-04-20T11:00:05.462276+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'402","last_scrub_stamp":"2024-04-20T11:00:05.462181+0000","last_deep_scrub":"38'402","last_deep_scrub_stamp":"2024-04-20T11:00:05.462181+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.462181+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:00:25.614690+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":39185,"num_write":369,"num_write_kb":42800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.34","version":"38'382","reported_seq":511,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:13.047889+0000","last_change":"2024-04-20T11:00:13.047889+0000","last_active":"2024-04-20T11:00:13.047889+0000","last_peered":"2024-04-20T11:00:13.047889+0000","last_clean":"2024-04-20T11:00:13.047889+0000","last_became_active":"2024-04-20T10:50:49.649360+0000","last_became_peered":"2024-04-20T10:50:49.649360+0000","last_unstale":"2024-04-20T11:00:13.047889+0000","last_undegraded":"2024-04-20T11:00:13.047889+0000","last_fullsized":"2024-04-20T11:00:13.047889+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'382","last_scrub_stamp":"2024-04-20T11:00:13.047746+0000","last_deep_scrub":"38'382","last_deep_scrub_stamp":"2024-04-20T11:00:13.047746+0000","last_clean_scrub_stamp":"2024-04-20T11:00:13.047746+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:24:49.624191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":78,"num_read_kb":54933,"num_write":350,"num_write_kb":63813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"37'409","reported_seq":558,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.308564+0000","last_change":"2024-04-20T10:59:58.308564+0000","last_active":"2024-04-20T10:59:58.308564+0000","last_peered":"2024-04-20T10:59:58.308564+0000","last_clean":"2024-04-20T10:59:58.308564+0000","last_became_active":"2024-04-20T10:50:40.594500+0000","last_became_peered":"2024-04-20T10:50:40.594500+0000","last_unstale":"2024-04-20T10:59:58.308564+0000","last_undegraded":"2024-04-20T10:59:58.308564+0000","last_fullsized":"2024-04-20T10:59:58.308564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'409","last_scrub_stamp":"2024-04-20T10:59:58.308407+0000","last_deep_scrub":"37'409","last_deep_scrub_stamp":"2024-04-20T10:59:58.308407+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.308407+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T15:58:41.349321+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":25358,"num_write":380,"num_write_kb":59236,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"38'401","reported_seq":520,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:19.680136+0000","last_change":"2024-04-20T11:00:19.680136+0000","last_active":"2024-04-20T11:00:19.680136+0000","last_peered":"2024-04-20T11:00:19.680136+0000","last_clean":"2024-04-20T11:00:19.680136+0000","last_became_active":"2024-04-20T10:50:49.650455+0000","last_became_peered":"2024-04-20T10:50:49.650455+0000","last_unstale":"2024-04-20T11:00:19.680136+0000","last_undegraded":"2024-04-20T11:00:19.680136+0000","last_fullsized":"2024-04-20T11:00:19.680136+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'401","last_scrub_stamp":"2024-04-20T11:00:19.680005+0000","last_deep_scrub":"38'401","last_deep_scrub_stamp":"2024-04-20T11:00:19.680005+0000","last_clean_scrub_stamp":"2024-04-20T11:00:19.680005+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:56:37.662350+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":46490,"num_write":386,"num_write_kb":55187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.33","version":"38'404","reported_seq":556,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.763850+0000","last_change":"2024-04-20T11:00:11.763850+0000","last_active":"2024-04-20T11:00:11.763850+0000","last_peered":"2024-04-20T11:00:11.763850+0000","last_clean":"2024-04-20T11:00:11.763850+0000","last_became_active":"2024-04-20T10:50:40.596459+0000","last_became_peered":"2024-04-20T10:50:40.596459+0000","last_unstale":"2024-04-20T11:00:11.763850+0000","last_undegraded":"2024-04-20T11:00:11.763850+0000","last_fullsized":"2024-04-20T11:00:11.763850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'404","last_scrub_stamp":"2024-04-20T11:00:11.763688+0000","last_deep_scrub":"38'404","last_deep_scrub_stamp":"2024-04-20T11:00:11.763688+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.763688+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:36:16.623707+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":60998,"num_write":371,"num_write_kb":104269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.32","version":"38'390","reported_seq":502,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:14.813704+0000","last_change":"2024-04-20T11:00:14.813730+0000","last_active":"2024-04-20T11:00:14.813704+0000","last_peered":"2024-04-20T11:00:14.813704+0000","last_clean":"2024-04-20T11:00:14.813704+0000","last_became_active":"2024-04-20T10:50:49.649746+0000","last_became_peered":"2024-04-20T10:50:49.649746+0000","last_unstale":"2024-04-20T11:00:14.813704+0000","last_undegraded":"2024-04-20T11:00:14.813704+0000","last_fullsized":"2024-04-20T11:00:14.813704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'390","last_scrub_stamp":"2024-04-20T11:00:14.813607+0000","last_deep_scrub":"38'390","last_deep_scrub_stamp":"2024-04-20T11:00:14.813607+0000","last_clean_scrub_stamp":"2024-04-20T11:00:14.813607+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:31:05.953193+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":61,"num_read_kb":9157,"num_write":355,"num_write_kb":25794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"38'351","reported_seq":490,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:02.087678+0000","last_change":"2024-04-20T11:00:02.087678+0000","last_active":"2024-04-20T11:00:02.087678+0000","last_peered":"2024-04-20T11:00:02.087678+0000","last_clean":"2024-04-20T11:00:02.087678+0000","last_became_active":"2024-04-20T10:50:40.595261+0000","last_became_peered":"2024-04-20T10:50:40.595261+0000","last_unstale":"2024-04-20T11:00:02.087678+0000","last_undegraded":"2024-04-20T11:00:02.087678+0000","last_fullsized":"2024-04-20T11:00:02.087678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'351","last_scrub_stamp":"2024-04-20T11:00:02.087560+0000","last_deep_scrub":"38'351","last_deep_scrub_stamp":"2024-04-20T11:00:02.087560+0000","last_clean_scrub_stamp":"2024-04-20T11:00:02.087560+0000","objects_scrubbed":0,"log_size":351,"log_dups_size":0,"ondisk_log_size":351,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:35:11.009533+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":63467,"num_write":328,"num_write_kb":42600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.33","version":"38'381","reported_seq":499,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.492226+0000","last_change":"2024-04-20T10:59:59.492226+0000","last_active":"2024-04-20T10:59:59.492226+0000","last_peered":"2024-04-20T10:59:59.492226+0000","last_clean":"2024-04-20T10:59:59.492226+0000","last_became_active":"2024-04-20T10:50:49.641972+0000","last_became_peered":"2024-04-20T10:50:49.641972+0000","last_unstale":"2024-04-20T10:59:59.492226+0000","last_undegraded":"2024-04-20T10:59:59.492226+0000","last_fullsized":"2024-04-20T10:59:59.492226+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'381","last_scrub_stamp":"2024-04-20T10:59:59.492101+0000","last_deep_scrub":"38'381","last_deep_scrub_stamp":"2024-04-20T10:59:59.492101+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.492101+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T13:45:00.353129+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":28672,"num_write":342,"num_write_kb":50404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"38'364","reported_seq":494,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:53.118311+0000","last_change":"2024-04-20T10:59:53.118311+0000","last_active":"2024-04-20T10:59:53.118311+0000","last_peered":"2024-04-20T10:59:53.118311+0000","last_clean":"2024-04-20T10:59:53.118311+0000","last_became_active":"2024-04-20T10:50:40.604676+0000","last_became_peered":"2024-04-20T10:50:40.604676+0000","last_unstale":"2024-04-20T10:59:53.118311+0000","last_undegraded":"2024-04-20T10:59:53.118311+0000","last_fullsized":"2024-04-20T10:59:53.118311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'364","last_scrub_stamp":"2024-04-20T10:59:53.118198+0000","last_deep_scrub":"38'364","last_deep_scrub_stamp":"2024-04-20T10:59:53.118198+0000","last_clean_scrub_stamp":"2024-04-20T10:59:53.118198+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:16:12.964786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":12730,"num_write":348,"num_write_kb":25700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.30","version":"38'424","reported_seq":542,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:13.852428+0000","last_change":"2024-04-20T11:00:13.852467+0000","last_active":"2024-04-20T11:00:13.852428+0000","last_peered":"2024-04-20T11:00:13.852428+0000","last_clean":"2024-04-20T11:00:13.852428+0000","last_became_active":"2024-04-20T10:50:49.643444+0000","last_became_peered":"2024-04-20T10:50:49.643444+0000","last_unstale":"2024-04-20T11:00:13.852428+0000","last_undegraded":"2024-04-20T11:00:13.852428+0000","last_fullsized":"2024-04-20T11:00:13.852428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'424","last_scrub_stamp":"2024-04-20T11:00:13.852320+0000","last_deep_scrub":"38'424","last_deep_scrub_stamp":"2024-04-20T11:00:13.852320+0000","last_clean_scrub_stamp":"2024-04-20T11:00:13.852320+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T11:46:22.226664+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":7385,"num_write":393,"num_write_kb":42181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"38'399","reported_seq":550,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.012301+0000","last_change":"2024-04-20T11:00:11.012301+0000","last_active":"2024-04-20T11:00:11.012301+0000","last_peered":"2024-04-20T11:00:11.012301+0000","last_clean":"2024-04-20T11:00:11.012301+0000","last_became_active":"2024-04-20T10:51:20.769384+0000","last_became_peered":"2024-04-20T10:51:20.769384+0000","last_unstale":"2024-04-20T11:00:11.012301+0000","last_undegraded":"2024-04-20T11:00:11.012301+0000","last_fullsized":"2024-04-20T11:00:11.012301+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'399","last_scrub_stamp":"2024-04-20T11:00:11.012168+0000","last_deep_scrub":"38'399","last_deep_scrub_stamp":"2024-04-20T11:00:11.012168+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.012168+0000","objects_scrubbed":0,"log_size":399,"log_dups_size":0,"ondisk_log_size":399,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:38:13.834357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":87,"num_read_kb":71394,"num_write":379,"num_write_kb":96385,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.31","version":"38'436","reported_seq":562,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:00.357439+0000","last_change":"2024-04-20T11:00:00.357439+0000","last_active":"2024-04-20T11:00:00.357439+0000","last_peered":"2024-04-20T11:00:00.357439+0000","last_clean":"2024-04-20T11:00:00.357439+0000","last_became_active":"2024-04-20T10:50:49.646428+0000","last_became_peered":"2024-04-20T10:50:49.646428+0000","last_unstale":"2024-04-20T11:00:00.357439+0000","last_undegraded":"2024-04-20T11:00:00.357439+0000","last_fullsized":"2024-04-20T11:00:00.357439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'436","last_scrub_stamp":"2024-04-20T11:00:00.357282+0000","last_deep_scrub":"38'436","last_deep_scrub_stamp":"2024-04-20T11:00:00.357282+0000","last_clean_scrub_stamp":"2024-04-20T11:00:00.357282+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:42:36.401293+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":70925,"num_write":402,"num_write_kb":100628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.37","version":"38'423","reported_seq":557,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:05.518391+0000","last_change":"2024-04-20T11:00:05.518435+0000","last_active":"2024-04-20T11:00:05.518391+0000","last_peered":"2024-04-20T11:00:05.518391+0000","last_clean":"2024-04-20T11:00:05.518391+0000","last_became_active":"2024-04-20T10:51:20.841719+0000","last_became_peered":"2024-04-20T10:51:20.841719+0000","last_unstale":"2024-04-20T11:00:05.518391+0000","last_undegraded":"2024-04-20T11:00:05.518391+0000","last_fullsized":"2024-04-20T11:00:05.518391+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T11:00:05.518287+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T11:00:05.518287+0000","last_clean_scrub_stamp":"2024-04-20T11:00:05.518287+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:01:11.628419+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":49916,"num_write":398,"num_write_kb":55317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3e","version":"38'473","reported_seq":614,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:13.825359+0000","last_change":"2024-04-20T11:00:13.825407+0000","last_active":"2024-04-20T11:00:13.825359+0000","last_peered":"2024-04-20T11:00:13.825359+0000","last_clean":"2024-04-20T11:00:13.825359+0000","last_became_active":"2024-04-20T10:50:49.649011+0000","last_became_peered":"2024-04-20T10:50:49.649011+0000","last_unstale":"2024-04-20T11:00:13.825359+0000","last_undegraded":"2024-04-20T11:00:13.825359+0000","last_fullsized":"2024-04-20T11:00:13.825359+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'473","last_scrub_stamp":"2024-04-20T11:00:13.825234+0000","last_deep_scrub":"38'473","last_deep_scrub_stamp":"2024-04-20T11:00:13.825234+0000","last_clean_scrub_stamp":"2024-04-20T11:00:13.825234+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:55:01.563699+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":134201,"num_write":442,"num_write_kb":141769,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.38","version":"38'414","reported_seq":597,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:55.762373+0000","last_change":"2024-04-20T10:59:55.762419+0000","last_active":"2024-04-20T10:59:55.762373+0000","last_peered":"2024-04-20T10:59:55.762373+0000","last_clean":"2024-04-20T10:59:55.762373+0000","last_became_active":"2024-04-20T10:50:40.605015+0000","last_became_peered":"2024-04-20T10:50:40.605015+0000","last_unstale":"2024-04-20T10:59:55.762373+0000","last_undegraded":"2024-04-20T10:59:55.762373+0000","last_fullsized":"2024-04-20T10:59:55.762373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'414","last_scrub_stamp":"2024-04-20T10:59:55.762247+0000","last_deep_scrub":"38'414","last_deep_scrub_stamp":"2024-04-20T10:59:55.762247+0000","last_clean_scrub_stamp":"2024-04-20T10:59:55.762247+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:33:15.411877+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":125,"num_read_kb":129245,"num_write":382,"num_write_kb":126738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3f","version":"38'443","reported_seq":576,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:10.008739+0000","last_change":"2024-04-20T11:00:10.008766+0000","last_active":"2024-04-20T11:00:10.008739+0000","last_peered":"2024-04-20T11:00:10.008739+0000","last_clean":"2024-04-20T11:00:10.008739+0000","last_became_active":"2024-04-20T10:50:49.652761+0000","last_became_peered":"2024-04-20T10:50:49.652761+0000","last_unstale":"2024-04-20T11:00:10.008739+0000","last_undegraded":"2024-04-20T11:00:10.008739+0000","last_fullsized":"2024-04-20T11:00:10.008739+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'443","last_scrub_stamp":"2024-04-20T11:00:10.008650+0000","last_deep_scrub":"38'443","last_deep_scrub_stamp":"2024-04-20T11:00:10.008650+0000","last_clean_scrub_stamp":"2024-04-20T11:00:10.008650+0000","objects_scrubbed":0,"log_size":443,"log_dups_size":0,"ondisk_log_size":443,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:31:51.202975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":98132,"num_write":412,"num_write_kb":88980,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.39","version":"38'431","reported_seq":588,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:11.860869+0000","last_change":"2024-04-20T11:00:11.860914+0000","last_active":"2024-04-20T11:00:11.860869+0000","last_peered":"2024-04-20T11:00:11.860869+0000","last_clean":"2024-04-20T11:00:11.860869+0000","last_became_active":"2024-04-20T10:50:40.591731+0000","last_became_peered":"2024-04-20T10:50:40.591731+0000","last_unstale":"2024-04-20T11:00:11.860869+0000","last_undegraded":"2024-04-20T11:00:11.860869+0000","last_fullsized":"2024-04-20T11:00:11.860869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'431","last_scrub_stamp":"2024-04-20T11:00:11.860756+0000","last_deep_scrub":"38'431","last_deep_scrub_stamp":"2024-04-20T11:00:11.860756+0000","last_clean_scrub_stamp":"2024-04-20T11:00:11.860756+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:04:22.846752+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":99,"num_read_kb":82367,"num_write":405,"num_write_kb":88791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3c","version":"38'369","reported_seq":478,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:12.367631+0000","last_change":"2024-04-20T11:00:12.367665+0000","last_active":"2024-04-20T11:00:12.367631+0000","last_peered":"2024-04-20T11:00:12.367631+0000","last_clean":"2024-04-20T11:00:12.367631+0000","last_became_active":"2024-04-20T10:50:49.654579+0000","last_became_peered":"2024-04-20T10:50:49.654579+0000","last_unstale":"2024-04-20T11:00:12.367631+0000","last_undegraded":"2024-04-20T11:00:12.367631+0000","last_fullsized":"2024-04-20T11:00:12.367631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'369","last_scrub_stamp":"2024-04-20T11:00:12.367543+0000","last_deep_scrub":"38'369","last_deep_scrub_stamp":"2024-04-20T11:00:12.367543+0000","last_clean_scrub_stamp":"2024-04-20T11:00:12.367543+0000","objects_scrubbed":0,"log_size":369,"log_dups_size":0,"ondisk_log_size":369,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T21:56:35.441413+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":17428,"num_write":337,"num_write_kb":30562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"38'375","reported_seq":492,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:57.344474+0000","last_change":"2024-04-20T10:59:57.344503+0000","last_active":"2024-04-20T10:59:57.344474+0000","last_peered":"2024-04-20T10:59:57.344474+0000","last_clean":"2024-04-20T10:59:57.344474+0000","last_became_active":"2024-04-20T10:50:40.604096+0000","last_became_peered":"2024-04-20T10:50:40.604096+0000","last_unstale":"2024-04-20T10:59:57.344474+0000","last_undegraded":"2024-04-20T10:59:57.344474+0000","last_fullsized":"2024-04-20T10:59:57.344474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'375","last_scrub_stamp":"2024-04-20T10:59:57.344362+0000","last_deep_scrub":"38'375","last_deep_scrub_stamp":"2024-04-20T10:59:57.344362+0000","last_clean_scrub_stamp":"2024-04-20T10:59:57.344362+0000","objects_scrubbed":0,"log_size":375,"log_dups_size":0,"ondisk_log_size":375,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:56:32.382346+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":59,"num_read_kb":12288,"num_write":347,"num_write_kb":45028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3d","version":"38'368","reported_seq":479,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:17.973304+0000","last_change":"2024-04-20T11:00:17.973366+0000","last_active":"2024-04-20T11:00:17.973304+0000","last_peered":"2024-04-20T11:00:17.973304+0000","last_clean":"2024-04-20T11:00:17.973304+0000","last_became_active":"2024-04-20T10:50:49.653245+0000","last_became_peered":"2024-04-20T10:50:49.653245+0000","last_unstale":"2024-04-20T11:00:17.973304+0000","last_undegraded":"2024-04-20T11:00:17.973304+0000","last_fullsized":"2024-04-20T11:00:17.973304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'368","last_scrub_stamp":"2024-04-20T11:00:17.973195+0000","last_deep_scrub":"38'368","last_deep_scrub_stamp":"2024-04-20T11:00:17.973195+0000","last_clean_scrub_stamp":"2024-04-20T11:00:17.973195+0000","objects_scrubbed":0,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:20:42.126127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":60,"num_read_kb":42400,"num_write":337,"num_write_kb":50456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"38'435","reported_seq":594,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:03.805148+0000","last_change":"2024-04-20T11:00:03.805192+0000","last_active":"2024-04-20T11:00:03.805148+0000","last_peered":"2024-04-20T11:00:03.805148+0000","last_clean":"2024-04-20T11:00:03.805148+0000","last_became_active":"2024-04-20T10:50:40.592953+0000","last_became_peered":"2024-04-20T10:50:40.592953+0000","last_unstale":"2024-04-20T11:00:03.805148+0000","last_undegraded":"2024-04-20T11:00:03.805148+0000","last_fullsized":"2024-04-20T11:00:03.805148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'435","last_scrub_stamp":"2024-04-20T11:00:03.805023+0000","last_deep_scrub":"38'435","last_deep_scrub_stamp":"2024-04-20T11:00:03.805023+0000","last_clean_scrub_stamp":"2024-04-20T11:00:03.805023+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:30:26.033510+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":60266,"num_write":401,"num_write_kb":64358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3a","version":"38'402","reported_seq":528,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:15.829302+0000","last_change":"2024-04-20T11:00:15.829325+0000","last_active":"2024-04-20T11:00:15.829302+0000","last_peered":"2024-04-20T11:00:15.829302+0000","last_clean":"2024-04-20T11:00:15.829302+0000","last_became_active":"2024-04-20T10:50:49.653071+0000","last_became_peered":"2024-04-20T10:50:49.653071+0000","last_unstale":"2024-04-20T11:00:15.829302+0000","last_undegraded":"2024-04-20T11:00:15.829302+0000","last_fullsized":"2024-04-20T11:00:15.829302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'402","last_scrub_stamp":"2024-04-20T11:00:15.829192+0000","last_deep_scrub":"38'402","last_deep_scrub_stamp":"2024-04-20T11:00:15.829192+0000","last_clean_scrub_stamp":"2024-04-20T11:00:15.829192+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:22:41.527165+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58110,"num_write":372,"num_write_kb":67566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"38'410","reported_seq":555,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:54.317036+0000","last_change":"2024-04-20T10:59:54.317060+0000","last_active":"2024-04-20T10:59:54.317036+0000","last_peered":"2024-04-20T10:59:54.317036+0000","last_clean":"2024-04-20T10:59:54.317036+0000","last_became_active":"2024-04-20T10:50:40.612779+0000","last_became_peered":"2024-04-20T10:50:40.612779+0000","last_unstale":"2024-04-20T10:59:54.317036+0000","last_undegraded":"2024-04-20T10:59:54.317036+0000","last_fullsized":"2024-04-20T10:59:54.317036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'410","last_scrub_stamp":"2024-04-20T10:59:54.316952+0000","last_deep_scrub":"38'410","last_deep_scrub_stamp":"2024-04-20T10:59:54.316952+0000","last_clean_scrub_stamp":"2024-04-20T10:59:54.316952+0000","objects_scrubbed":0,"log_size":410,"log_dups_size":0,"ondisk_log_size":410,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T18:08:37.196593+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":40406,"num_write":376,"num_write_kb":72310,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3b","version":"38'423","reported_seq":549,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:50.499172+0000","last_change":"2024-04-20T10:59:50.499195+0000","last_active":"2024-04-20T10:59:50.499172+0000","last_peered":"2024-04-20T10:59:50.499172+0000","last_clean":"2024-04-20T10:59:50.499172+0000","last_became_active":"2024-04-20T10:50:49.640572+0000","last_became_peered":"2024-04-20T10:50:49.640572+0000","last_unstale":"2024-04-20T10:59:50.499172+0000","last_undegraded":"2024-04-20T10:59:50.499172+0000","last_fullsized":"2024-04-20T10:59:50.499172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'423","last_scrub_stamp":"2024-04-20T10:59:50.499090+0000","last_deep_scrub":"38'423","last_deep_scrub_stamp":"2024-04-20T10:59:50.499090+0000","last_clean_scrub_stamp":"2024-04-20T10:59:50.499090+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T17:04:26.944875+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":48634,"num_write":394,"num_write_kb":56270,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"37'391","reported_seq":530,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.243094+0000","last_change":"2024-04-20T10:59:56.243120+0000","last_active":"2024-04-20T10:59:56.243094+0000","last_peered":"2024-04-20T10:59:56.243094+0000","last_clean":"2024-04-20T10:59:56.243094+0000","last_became_active":"2024-04-20T10:50:40.590744+0000","last_became_peered":"2024-04-20T10:50:40.590744+0000","last_unstale":"2024-04-20T10:59:56.243094+0000","last_undegraded":"2024-04-20T10:59:56.243094+0000","last_fullsized":"2024-04-20T10:59:56.243094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'391","last_scrub_stamp":"2024-04-20T10:59:56.242973+0000","last_deep_scrub":"37'391","last_deep_scrub_stamp":"2024-04-20T10:59:56.242973+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.242973+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:51:53.884083+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":67210,"num_write":369,"num_write_kb":63933,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.38","version":"38'365","reported_seq":484,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:58.860648+0000","last_change":"2024-04-20T10:59:58.860685+0000","last_active":"2024-04-20T10:59:58.860648+0000","last_peered":"2024-04-20T10:59:58.860648+0000","last_clean":"2024-04-20T10:59:58.860648+0000","last_became_active":"2024-04-20T10:50:49.638264+0000","last_became_peered":"2024-04-20T10:50:49.638264+0000","last_unstale":"2024-04-20T10:59:58.860648+0000","last_undegraded":"2024-04-20T10:59:58.860648+0000","last_fullsized":"2024-04-20T10:59:58.860648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'365","last_scrub_stamp":"2024-04-20T10:59:58.860552+0000","last_deep_scrub":"38'365","last_deep_scrub_stamp":"2024-04-20T10:59:58.860552+0000","last_clean_scrub_stamp":"2024-04-20T10:59:58.860552+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T19:56:48.643172+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":38197,"num_write":324,"num_write_kb":43133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"37'436","reported_seq":583,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:56.451416+0000","last_change":"2024-04-20T10:59:56.451442+0000","last_active":"2024-04-20T10:59:56.451416+0000","last_peered":"2024-04-20T10:59:56.451416+0000","last_clean":"2024-04-20T10:59:56.451416+0000","last_became_active":"2024-04-20T10:50:40.590181+0000","last_became_peered":"2024-04-20T10:50:40.590181+0000","last_unstale":"2024-04-20T10:59:56.451416+0000","last_undegraded":"2024-04-20T10:59:56.451416+0000","last_fullsized":"2024-04-20T10:59:56.451416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'436","last_scrub_stamp":"2024-04-20T10:59:56.451306+0000","last_deep_scrub":"37'436","last_deep_scrub_stamp":"2024-04-20T10:59:56.451306+0000","last_clean_scrub_stamp":"2024-04-20T10:59:56.451306+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T16:54:42.807674+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":88,"num_read_kb":82231,"num_write":413,"num_write_kb":104966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.39","version":"38'435","reported_seq":565,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T11:00:12.831858+0000","last_change":"2024-04-20T11:00:12.831888+0000","last_active":"2024-04-20T11:00:12.831858+0000","last_peered":"2024-04-20T11:00:12.831858+0000","last_clean":"2024-04-20T11:00:12.831858+0000","last_became_active":"2024-04-20T10:50:49.641486+0000","last_became_peered":"2024-04-20T10:50:49.641486+0000","last_unstale":"2024-04-20T11:00:12.831858+0000","last_undegraded":"2024-04-20T11:00:12.831858+0000","last_fullsized":"2024-04-20T11:00:12.831858+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'435","last_scrub_stamp":"2024-04-20T11:00:12.831719+0000","last_deep_scrub":"38'435","last_deep_scrub_stamp":"2024-04-20T11:00:12.831719+0000","last_clean_scrub_stamp":"2024-04-20T11:00:12.831719+0000","objects_scrubbed":0,"log_size":435,"log_dups_size":0,"ondisk_log_size":435,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T14:38:22.509268+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":78016,"num_write":409,"num_write_kb":101239,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"37'379","reported_seq":507,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-20T10:59:59.865451+0000","last_change":"2024-04-20T10:59:59.865476+0000","last_active":"2024-04-20T10:59:59.865451+0000","last_peered":"2024-04-20T10:59:59.865451+0000","last_clean":"2024-04-20T10:59:59.865451+0000","last_became_active":"2024-04-20T10:50:40.595043+0000","last_became_peered":"2024-04-20T10:50:40.595043+0000","last_unstale":"2024-04-20T10:59:59.865451+0000","last_undegraded":"2024-04-20T10:59:59.865451+0000","last_fullsized":"2024-04-20T10:59:59.865451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'379","last_scrub_stamp":"2024-04-20T10:59:59.865351+0000","last_deep_scrub":"37'379","last_deep_scrub_stamp":"2024-04-20T10:59:59.865351+0000","last_clean_scrub_stamp":"2024-04-20T10:59:59.865351+0000","objects_scrubbed":0,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-21T12:00:41.399695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":25535,"num_write":356,"num_write_kb":38136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4810,"num_read_kb":3595152,"num_write":24379,"num_write_kb":4256728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26481,"ondisk_log_size":26481,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":149799849,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":809,"num_read_kb":507129,"num_write":8087,"num_write_kb":153177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299663360,"data_stored":299599698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9529,"ondisk_log_size":9529,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5724,"num_read_kb":3353332,"num_write":24442,"num_write_kb":4400565,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26386,"ondisk_log_size":26386,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":151049924,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":699,"num_read_kb":394566,"num_write":7753,"num_write_kb":153910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":302161920,"data_stored":302099848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9214,"ondisk_log_size":9214,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574972,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126660,"kb_used_data":77436,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94245180,"statfs":{"total":96636764160,"available":96507064320,"internally_reserved":0,"allocated":79294464,"data_stored":79053723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574972,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":130184,"kb_used_data":80960,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94241656,"statfs":{"total":96636764160,"available":96503455744,"internally_reserved":0,"allocated":82903040,"data_stored":82658275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574971,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123880,"kb_used_data":52512,"kb_used_omap":1,"kb_used_meta":71358,"kb_avail":94247960,"statfs":{"total":96636764160,"available":96509911040,"internally_reserved":0,"allocated":53772288,"data_stored":53529724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73071045},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574973,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":177172,"kb_used_data":96076,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94194668,"statfs":{"total":96636764160,"available":96455340032,"internally_reserved":0,"allocated":98381824,"data_stored":98133898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574973,"num_pgs":58,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":185380,"kb_used_data":104284,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94186460,"statfs":{"total":96636764160,"available":96446935040,"internally_reserved":0,"allocated":106786816,"data_stored":106540719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":83032519},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574973,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":71508,"kb_used_data":26444,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94300332,"statfs":{"total":96636764160,"available":96563539968,"internally_reserved":0,"allocated":27078656,"data_stored":26847647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":193688,"kb_used_data":108432,"kb_used_omap":1,"kb_used_meta":85246,"kb_avail":94178152,"statfs":{"total":96636764160,"available":96438427648,"internally_reserved":0,"allocated":111034368,"data_stored":110784971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":87292357},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574972,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":95288,"kb_used_data":46064,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94276552,"statfs":{"total":96636764160,"available":96539189248,"internally_reserved":0,"allocated":47169536,"data_stored":46927925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29372416,"data_stored":29360766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":41951232,"data_stored":41943200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":14065664,"data_stored":14065090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35045376,"data_stored":35037282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46149632,"data_stored":46137470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":29364224,"data_stored":29360218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":48914432,"data_stored":48903652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57298944,"data_stored":57292170,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":68657152,"data_stored":68642196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12587008,"data_stored":12582982,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":71315456,"data_stored":71303862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":51806208,"data_stored":51796853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":23982080,"data_stored":23969931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":33562624,"data_stored":33555048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":20975616,"data_stored":20971610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-20T11:00:33.252 DEBUG:teuthology.orchestra.run.smithi090:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-20T11:00:33.380 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.380+0000 7fcb89bb2640 1 Processor -- start 2024-04-20T11:00:33.381 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.380+0000 7fcb89bb2640 1 -- start start 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb89bb2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb840c27a0 0x7fcb841570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb89bb2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb840adab0 con 0x7fcb840c54d0 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb89bb2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb84071690 con 0x7fcb840ad640 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb89bb2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fcb84071970 con 0x7fcb840c27a0 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb837fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fcb840c27a0 0x7fcb841570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb82ffd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7fcb840c54d0 0x7fcb8415a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:33584/0 (socket says 172.21.15.90:33584) 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb82ffd640 1 -- 172.21.15.90:0/822692713 learned_addr learned my addr 172.21.15.90:0/822692713 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb837fe640 1 -- 172.21.15.90:0/822692713 >> v1:172.21.15.175:6789/0 conn(0x7fcb840ad640 legacy=0x7fcb84153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb837fe640 1 -- 172.21.15.90:0/822692713 >> v1:172.21.15.90:6789/0 conn(0x7fcb840c54d0 legacy=0x7fcb8415a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.382 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb837fe640 1 -- 172.21.15.90:0/822692713 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb84159ce0 con 0x7fcb840c27a0 2024-04-20T11:00:33.383 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.381+0000 7fcb827fc640 1 -- 172.21.15.90:0/822692713 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755383775 0 0) 0x7fcb840adab0 con 0x7fcb840c54d0 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.382+0000 7fcb837fe640 1 --2- 172.21.15.90:0/822692713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb841570d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcb740097a0 tx=0x7fcb7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7aa43d437f02283 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.382+0000 7fcb827fc640 1 -- 172.21.15.90:0/822692713 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74035020 con 0x7fcb840c27a0 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.382+0000 7fcb827fc640 1 -- 172.21.15.90:0/822692713 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb74031830 con 0x7fcb840c27a0 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.382+0000 7fcb827fc640 1 -- 172.21.15.90:0/822692713 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74031c00 con 0x7fcb840c27a0 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.383+0000 7fcb89bb2640 1 -- 172.21.15.90:0/822692713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 msgr2=0x7fcb841570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.383+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/822692713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb841570d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fcb740097a0 tx=0x7fcb7402b8d0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.383+0000 7fcb89bb2640 1 -- 172.21.15.90:0/822692713 shutdown_connections 2024-04-20T11:00:33.384 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.383+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/822692713 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb841570d0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.383+0000 7fcb89bb2640 1 -- 172.21.15.90:0/822692713 >> 172.21.15.90:0/822692713 conn(0x7fcb840c9100 msgr2=0x7fcb840c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.383+0000 7fcb89bb2640 1 -- 172.21.15.90:0/822692713 shutdown_connections 2024-04-20T11:00:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.383+0000 7fcb89bb2640 1 -- 172.21.15.90:0/822692713 wait complete. 2024-04-20T11:00:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.384+0000 7fcb89bb2640 1 Processor -- start 2024-04-20T11:00:33.385 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.384+0000 7fcb89bb2640 1 -- start start 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb89bb2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb840ad640 0x7fcb8414e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb89bb2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb84159400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb89bb2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb840c54d0 0x7fcb8414ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb89bb2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fcb840c2b80 con 0x7fcb840c27a0 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb89bb2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8406f510 con 0x7fcb840ad640 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb89bb2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fcb840c2d00 con 0x7fcb840c54d0 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb84159400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb84159400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47432/0 (socket says 172.21.15.90:47432) 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 -- 172.21.15.90:0/348348600 learned_addr learned my addr 172.21.15.90:0/348348600 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 -- 172.21.15.90:0/348348600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb840c54d0 msgr2=0x7fcb8414ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.387 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb840c54d0 0x7fcb8414ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 -- 172.21.15.90:0/348348600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb840ad640 msgr2=0x7fcb8414e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb837fe640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb840ad640 0x7fcb8414e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb840ad640 0x7fcb8414e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 -- 172.21.15.90:0/348348600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb84159940 con 0x7fcb840c27a0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb82ffd640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb84159400 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800c4d0 tx=0x7fcb7800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78018070 con 0x7fcb840c27a0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.385+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb78007500 con 0x7fcb840c27a0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.386+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb84155f20 con 0x7fcb840c27a0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.386+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb78004a20 con 0x7fcb840c27a0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.386+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8414dfa0 con 0x7fcb840c27a0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.387+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb84076150 con 0x7fcb840c27a0 2024-04-20T11:00:33.388 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.387+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb7801b070 con 0x7fcb840c27a0 2024-04-20T11:00:33.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.387+0000 7fcb6bfff640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb7006c920 0x7fcb7006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.387+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fcb7808b540 con 0x7fcb840c27a0 2024-04-20T11:00:33.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.387+0000 7fcb837fe640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb7006c920 0x7fcb7006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.389 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.388+0000 7fcb837fe640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb7006c920 0x7fcb7006ede0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcb74036000 tx=0x7fcb7403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.391 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.392+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fcb78059220 con 0x7fcb840c27a0 2024-04-20T11:00:33.567 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.567+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fcb8414e170 con 0x7fcb840c27a0 2024-04-20T11:00:33.570 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.570+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fcb78058b20 con 0x7fcb840c27a0 2024-04-20T11:00:33.571 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.571+0000 7fcb6bfff640 1 -- 172.21.15.90:0/348348600 <== mon.0 v2:172.21.15.90:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fcb7805ced0 con 0x7fcb840c27a0 2024-04-20T11:00:33.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb7006c920 msgr2=0x7fcb7006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb7006c920 0x7fcb7006ede0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcb74036000 tx=0x7fcb7403c040 comp rx=0 tx=0).stop 2024-04-20T11:00:33.573 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 msgr2=0x7fcb84159400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb84159400 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fcb7800c4d0 tx=0x7fcb7800c990 comp rx=0 tx=0).stop 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 shutdown_connections 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fcb7006c920 0x7fcb7006ede0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fcb840c54d0 0x7fcb8414ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fcb840c27a0 0x7fcb84159400 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 --2- 172.21.15.90:0/348348600 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fcb840ad640 0x7fcb8414e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 >> 172.21.15.90:0/348348600 conn(0x7fcb840c9100 msgr2=0x7fcb84150b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 shutdown_connections 2024-04-20T11:00:33.574 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.573+0000 7fcb89bb2640 1 -- 172.21.15.90:0/348348600 wait complete. 2024-04-20T11:00:33.585 INFO:tasks.cephfs.filesystem:Destroying file system a and related pools 2024-04-20T11:00:33.585 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T11:00:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.683+0000 7f87fef96640 1 Processor -- start 2024-04-20T11:00:33.684 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fef96640 1 -- start start 2024-04-20T11:00:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fef96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 0x7f87f81551b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fef96640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f87f8073120 0x7f87f8151840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.687 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fef96640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87f8158780 con 0x7f87f8072860 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fef96640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f87f80ad010 con 0x7f87f8073120 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fef96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f87f8158530 con 0x7f87f80c45c0 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fcd32640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f87f8072860 0x7f87f80ab4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:33592/0 (socket says 172.21.15.90:33592) 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.684+0000 7f87fcd32640 1 -- 172.21.15.90:0/2431098075 learned_addr learned my addr 172.21.15.90:0/2431098075 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fd533640 1 --2- 172.21.15.90:0/2431098075 >> v2:172.21.15.175:3300/0 conn(0x7f87f8073120 0x7f87f8151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87effff640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 0x7f87f81551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996749926 0 0) 0x7f87f8158780 con 0x7f87f8072860 2024-04-20T11:00:33.688 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e0003520 con 0x7f87f8072860 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2010056169 0 0) 0x7f87e0003520 con 0x7f87f8072860 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 msgr2=0x7f87f81551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 0x7f87f81551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 >> v2:172.21.15.175:3300/0 conn(0x7f87f8073120 msgr2=0x7f87f8151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 --2- 172.21.15.90:0/2431098075 >> v2:172.21.15.175:3300/0 conn(0x7f87f8073120 0x7f87f8151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f81546d0 con 0x7f87f8072860 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f87f4001670 con 0x7f87f8072860 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 >> v1:172.21.15.90:6789/0 conn(0x7f87f8072860 legacy=0x7f87f80ab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e00039b0 0x7f87e0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87e0004800 0x7f87e0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.689 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 0x7f87e00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87f80ad010 con 0x7f87e00039b0 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f87f8158530 con 0x7f87e0004800 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f87e000b9c0 con 0x7f87f80c45c0 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fcd32640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e00039b0 0x7f87e0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87effff640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87e0004800 0x7f87e0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fd533640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 0x7f87e00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fcd32640 1 -- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 msgr2=0x7f87e00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fcd32640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87f80c45c0 0x7f87e00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fcd32640 1 -- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87e0004800 msgr2=0x7f87e0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fcd32640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87e0004800 0x7f87e0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87fcd32640 1 -- 172.21.15.90:0/2431098075 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e0003520 con 0x7f87e00039b0 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.685+0000 7f87effff640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87e0004800 0x7f87e0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T11:00:33.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.686+0000 7f87fcd32640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e00039b0 0x7f87e0003dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c270 tx=0x7f87e0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6158d42c984249d server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.686+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f4007d30 con 0x7f87e00039b0 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.686+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f87f4030070 con 0x7f87e00039b0 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.686+0000 7f87ef7fe640 1 -- 172.21.15.90:0/2431098075 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87f402cd80 con 0x7f87e00039b0 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.687+0000 7f87fef96640 1 -- 172.21.15.90:0/2431098075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e00039b0 msgr2=0x7f87e0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.687+0000 7f87fef96640 1 --2- 172.21.15.90:0/2431098075 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87e00039b0 0x7f87e0003dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c270 tx=0x7f87e0005830 comp rx=0 tx=0).stop 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.687+0000 7f87fd533640 1 -- 172.21.15.90:0/2431098075 reap_dead start 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.687+0000 7f87fef96640 1 -- 172.21.15.90:0/2431098075 shutdown_connections 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.687+0000 7f87fef96640 1 -- 172.21.15.90:0/2431098075 >> 172.21.15.90:0/2431098075 conn(0x7f87f8067de0 msgr2=0x7f87f80ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:33.691 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.687+0000 7f87fef96640 1 -- 172.21.15.90:0/2431098075 shutdown_connections 2024-04-20T11:00:33.692 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.687+0000 7f87fef96640 1 -- 172.21.15.90:0/2431098075 wait complete. 2024-04-20T11:00:33.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.688+0000 7f87fef96640 1 Processor -- start 2024-04-20T11:00:33.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.688+0000 7f87fef96640 1 -- start start 2024-04-20T11:00:33.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87e00039b0 0x7f87f81ebdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87f80c3850 0x7f87f806d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f814e100 0x7f87f814e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f87f8154c90 con 0x7f87f80c3850 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f87f8158a60 con 0x7f87f814e100 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f87f80abbb0 con 0x7f87e00039b0 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87f80c3850 0x7f87f806d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87f80c3850 0x7f87f806d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47438/0 (socket says 172.21.15.90:47438) 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 -- 172.21.15.90:0/1534308607 learned_addr learned my addr 172.21.15.90:0/1534308607 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fcd32640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87e00039b0 0x7f87f81ebdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fd533640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f814e100 0x7f87f814e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 -- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87e00039b0 msgr2=0x7f87f81ebdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87e00039b0 0x7f87f81ebdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 -- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f814e100 msgr2=0x7f87f814e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f814e100 0x7f87f814e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 -- 172.21.15.90:0/1534308607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87f81ec300 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fcd32640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87e00039b0 0x7f87f81ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fd533640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f814e100 0x7f87f814e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87effff640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87f80c3850 0x7f87f806d150 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f87e8011540 tx=0x7f87e8011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87ed7fa640 1 -- 172.21.15.90:0/1534308607 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8015870 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87ed7fa640 1 -- 172.21.15.90:0/1534308607 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f87e8015a10 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87ed7fa640 1 -- 172.21.15.90:0/1534308607 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e8015dc0 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87f81efe40 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.689+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87f806e540 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.690+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87f8076150 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.691+0000 7f87ed7fa640 1 -- 172.21.15.90:0/1534308607 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f87e801d400 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.691+0000 7f87ed7fa640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f87e406c920 0x7f87e406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.692+0000 7f87ed7fa640 1 -- 172.21.15.90:0/1534308607 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f87e808cb70 con 0x7f87f80c3850 2024-04-20T11:00:33.697 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.692+0000 7f87fcd32640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f87e406c920 0x7f87e406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:33.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.692+0000 7f87fcd32640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f87e406c920 0x7f87e406ede0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87f4034000 tx=0x7f87f4007000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:33.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.696+0000 7f87ed7fa640 1 -- 172.21.15.90:0/1534308607 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f87e8019030 con 0x7f87f80c3850 2024-04-20T11:00:33.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.910+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f87f80694b0 con 0x7f87f80c3850 2024-04-20T11:00:33.910 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.910+0000 7f87ed7fa640 1 -- 172.21.15.90:0/1534308607 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+6534 (secure 0 0 0) 0x7f87e805a830 con 0x7f87f80c3850 2024-04-20T11:00:33.911 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:33.911 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":73,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2387787206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2387787206},{"type":"v1","addr":"172.21.15.90:6835","nonce":2387787206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:29.552819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":103,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4769,"qdb_cluster":[4769]},"id":2}]} 2024-04-20T11:00:33.911 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 73 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f87e406c920 msgr2=0x7f87e406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f87e406c920 0x7f87e406ede0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f87f4034000 tx=0x7f87f4007000 comp rx=0 tx=0).stop 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87f80c3850 msgr2=0x7f87f806d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87f80c3850 0x7f87f806d150 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f87e8011540 tx=0x7f87e8011a00 comp rx=0 tx=0).stop 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 shutdown_connections 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f87e406c920 0x7f87e406ede0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f87f814e100 0x7f87f814e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f87f80c3850 0x7f87f806d150 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 --2- 172.21.15.90:0/1534308607 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f87e00039b0 0x7f87f81ebdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 >> 172.21.15.90:0/1534308607 conn(0x7f87f8067de0 msgr2=0x7f87f8152210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 shutdown_connections 2024-04-20T11:00:33.913 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:33.912+0000 7f87fef96640 1 -- 172.21.15.90:0/1534308607 wait complete. 2024-04-20T11:00:33.924 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T11:00:34.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.019+0000 7f6debb4b640 1 Processor -- start 2024-04-20T11:00:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.019+0000 7f6debb4b640 1 -- start start 2024-04-20T11:00:34.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6debb4b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6de4153ef0 0x7f6de40c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6debb4b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40c9ee0 0x7f6de4156fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6debb4b640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de415a720 con 0x7f6de40ab730 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6debb4b640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6de415ac80 con 0x7f6de4153ef0 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6debb4b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6de415a9a0 con 0x7f6de40c9ee0 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6de98e7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6de4153ef0 0x7f6de40c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6de98e7640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6de4153ef0 0x7f6de40c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47450/0 (socket says 172.21.15.90:47450) 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.020+0000 7f6de98e7640 1 -- 172.21.15.90:0/1219931072 learned_addr learned my addr 172.21.15.90:0/1219931072 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de98e7640 1 -- 172.21.15.90:0/1219931072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40c9ee0 msgr2=0x7f6de4156fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de98e7640 1 --2- 172.21.15.90:0/1219931072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40c9ee0 0x7f6de4156fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de98e7640 1 -- 172.21.15.90:0/1219931072 >> v1:172.21.15.175:6789/0 conn(0x7f6de40ab730 legacy=0x7f6de41568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:34.021 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de98e7640 1 -- 172.21.15.90:0/1219931072 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de40c6a90 con 0x7f6de4153ef0 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de98e7640 1 --2- 172.21.15.90:0/1219931072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40c89f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6de40aec60 tx=0x7f6ddc02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28024d94be5f5f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de88e5640 1 -- 172.21.15.90:0/1219931072 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc038070 con 0x7f6de4153ef0 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de88e5640 1 -- 172.21.15.90:0/1219931072 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6ddc031520 con 0x7f6de4153ef0 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.021+0000 7f6de88e5640 1 -- 172.21.15.90:0/1219931072 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc031910 con 0x7f6de4153ef0 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 -- 172.21.15.90:0/1219931072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 msgr2=0x7f6de40c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 --2- 172.21.15.90:0/1219931072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40c89f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f6de40aec60 tx=0x7f6ddc02b7c0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 -- 172.21.15.90:0/1219931072 shutdown_connections 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 --2- 172.21.15.90:0/1219931072 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40c9ee0 0x7f6de4156fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 --2- 172.21.15.90:0/1219931072 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40c89f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 -- 172.21.15.90:0/1219931072 >> 172.21.15.90:0/1219931072 conn(0x7f6de40cbfe0 msgr2=0x7f6de40cc3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:34.023 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 -- 172.21.15.90:0/1219931072 shutdown_connections 2024-04-20T11:00:34.024 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.022+0000 7f6debb4b640 1 -- 172.21.15.90:0/1219931072 wait complete. 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.023+0000 7f6debb4b640 1 Processor -- start 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.023+0000 7f6debb4b640 1 -- start start 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6debb4b640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40ab730 0x7f6de4158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6debb4b640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6de40c9ee0 0x7f6de4157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6debb4b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6debb4b640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6de40bf800 con 0x7f6de4153ef0 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6debb4b640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6de4157510 con 0x7f6de40c9ee0 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6debb4b640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6de41e0290 con 0x7f6de40ab730 2024-04-20T11:00:34.026 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40aa600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47458/0 (socket says 172.21.15.90:47458) 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 -- 172.21.15.90:0/291666435 learned_addr learned my addr 172.21.15.90:0/291666435 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6de98e7640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40ab730 0x7f6de4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 -- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40ab730 msgr2=0x7f6de4158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6de90e6640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6de40c9ee0 0x7f6de4157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40ab730 0x7f6de4158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 -- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6de40c9ee0 msgr2=0x7f6de4157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6de40c9ee0 0x7f6de4157b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 -- 172.21.15.90:0/291666435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de4159120 con 0x7f6de4153ef0 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6de98e7640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40ab730 0x7f6de4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.024+0000 7f6dea0e8640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40aa600 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b9a0 tx=0x7f6dd400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.025+0000 7f6de27fc640 1 -- 172.21.15.90:0/291666435 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4019070 con 0x7f6de4153ef0 2024-04-20T11:00:34.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.025+0000 7f6de27fc640 1 -- 172.21.15.90:0/291666435 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6dd400cbc0 con 0x7f6de4153ef0 2024-04-20T11:00:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.025+0000 7f6de27fc640 1 -- 172.21.15.90:0/291666435 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd4014440 con 0x7f6de4153ef0 2024-04-20T11:00:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.025+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de41588a0 con 0x7f6de4153ef0 2024-04-20T11:00:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.025+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de4158e40 con 0x7f6de4153ef0 2024-04-20T11:00:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.026+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de4076150 con 0x7f6de4153ef0 2024-04-20T11:00:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.026+0000 7f6de27fc640 1 -- 172.21.15.90:0/291666435 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6dd401c070 con 0x7f6de4153ef0 2024-04-20T11:00:34.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.027+0000 7f6de27fc640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6dd006c8f0 0x7f6dd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.027+0000 7f6de98e7640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6dd006c8f0 0x7f6dd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.027+0000 7f6de27fc640 1 -- 172.21.15.90:0/291666435 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f6dd408c0c0 con 0x7f6de4153ef0 2024-04-20T11:00:34.029 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.027+0000 7f6de98e7640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6dd006c8f0 0x7f6dd006edb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc035000 tx=0x7f6ddc030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.031+0000 7f6de27fc640 1 -- 172.21.15.90:0/291666435 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6dd4059d10 con 0x7f6de4153ef0 2024-04-20T11:00:34.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.242+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6de41546c0 con 0x7f6de4153ef0 2024-04-20T11:00:34.242 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.242+0000 7f6de27fc640 1 -- 172.21.15.90:0/291666435 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) ==== 94+0+6534 (secure 0 0 0) 0x7f6dd4059610 con 0x7f6de4153ef0 2024-04-20T11:00:34.242 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:34.243 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":73,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2387787206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2387787206},{"type":"v1","addr":"172.21.15.90:6835","nonce":2387787206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:39.915256+0000","modified":"2024-04-20T10:59:18.505405+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":37,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5964},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5964":{"gid":5964,"name":"c","rank":0,"incarnation":63,"state":"up:active","state_seq":22,"addr":"172.21.15.90:6837/1253561572","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":1253561572},{"type":"v1","addr":"172.21.15.90:6837","nonce":1253561572}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"a","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5964,"qdb_cluster":[5964]},"id":1},{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:29.552819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":103,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4769,"qdb_cluster":[4769]},"id":2}]} 2024-04-20T11:00:34.243 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 73 2024-04-20T11:00:34.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6dd006c8f0 msgr2=0x7f6dd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6dd006c8f0 0x7f6dd006edb0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc035000 tx=0x7f6ddc030000 comp rx=0 tx=0).stop 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 msgr2=0x7f6de40aa600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40aa600 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400b9a0 tx=0x7f6dd400be60 comp rx=0 tx=0).stop 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 shutdown_connections 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6dd006c8f0 0x7f6dd006edb0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6de4153ef0 0x7f6de40aa600 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6de40c9ee0 0x7f6de4157b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 --2- 172.21.15.90:0/291666435 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6de40ab730 0x7f6de4158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 >> 172.21.15.90:0/291666435 conn(0x7f6de40cbfe0 msgr2=0x7f6de41568c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 shutdown_connections 2024-04-20T11:00:34.245 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.244+0000 7f6debb4b640 1 -- 172.21.15.90:0/291666435 wait complete. 2024-04-20T11:00:34.255 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T11:00:34.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.352+0000 7f6fa41d0640 1 Processor -- start 2024-04-20T11:00:34.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.352+0000 7f6fa41d0640 1 -- start start 2024-04-20T11:00:34.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa41d0640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6f9c153460 0x7f6f9c0c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa41d0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c0c4e20 0x7f6f9c0c6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa41d0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9c1539b0 con 0x7f6f9c150300 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa41d0640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9c0c7230 con 0x7f6f9c153460 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa41d0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c1506e0 con 0x7f6f9c0c4e20 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa176b640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f6f9c153460 0x7f6f9c0c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa1f6c640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f6f9c150300 0x7f6f9c06d440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:33602/0 (socket says 172.21.15.90:33602) 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa1f6c640 1 -- 172.21.15.90:0/1017616786 learned_addr learned my addr 172.21.15.90:0/1017616786 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa276d640 1 --2- 172.21.15.90:0/1017616786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c0c4e20 0x7f6f9c0c6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa176b640 1 -- 172.21.15.90:0/1017616786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c0c4e20 msgr2=0x7f6f9c0c6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa176b640 1 --2- 172.21.15.90:0/1017616786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c0c4e20 0x7f6f9c0c6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa176b640 1 -- 172.21.15.90:0/1017616786 >> v1:172.21.15.90:6789/0 conn(0x7f6f9c150300 legacy=0x7f6f9c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa176b640 1 -- 172.21.15.90:0/1017616786 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c1560a0 con 0x7f6f9c153460 2024-04-20T11:00:34.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.353+0000 7f6fa0f6a640 1 -- 172.21.15.90:0/1017616786 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3337168539 0 0) 0x7f6f9c1539b0 con 0x7f6f9c150300 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa176b640 1 --2- 172.21.15.90:0/1017616786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c0c67b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6f900097d0 tx=0x7f6f9002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45ac4cf94f6df43 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa0f6a640 1 -- 172.21.15.90:0/1017616786 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90035020 con 0x7f6f9c153460 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa0f6a640 1 -- 172.21.15.90:0/1017616786 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f90031800 con 0x7f6f9c153460 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa0f6a640 1 -- 172.21.15.90:0/1017616786 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f90031bf0 con 0x7f6f9c153460 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1017616786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 msgr2=0x7f6f9c0c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1017616786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c0c67b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f6f900097d0 tx=0x7f6f9002b8a0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1017616786 shutdown_connections 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1017616786 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c0c4e20 0x7f6f9c0c6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1017616786 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c0c67b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.354+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1017616786 >> 172.21.15.90:0/1017616786 conn(0x7f6f9c0aa660 msgr2=0x7f6f9c0aaa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.355+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1017616786 shutdown_connections 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.355+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1017616786 wait complete. 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 Processor -- start 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 -- start start 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f9c0c4e20 0x7f6f9c1ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c150300 0x7f6f9c13e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c1411b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c156940 con 0x7f6f9c153460 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c156660 con 0x7f6f9c0c4e20 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa41d0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c156e60 con 0x7f6f9c150300 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa276d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c1411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa276d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c1411b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47482/0 (socket says 172.21.15.90:47482) 2024-04-20T11:00:34.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.356+0000 7f6fa276d640 1 -- 172.21.15.90:0/1623360468 learned_addr learned my addr 172.21.15.90:0/1623360468 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa1f6c640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f9c0c4e20 0x7f6f9c1ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa176b640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c150300 0x7f6f9c13e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa276d640 1 -- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c150300 msgr2=0x7f6f9c13e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa276d640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c150300 0x7f6f9c13e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa276d640 1 -- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f9c0c4e20 msgr2=0x7f6f9c1ee4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa276d640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f9c0c4e20 0x7f6f9c1ee4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa276d640 1 -- 172.21.15.90:0/1623360468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c153e80 con 0x7f6f9c153460 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa176b640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c150300 0x7f6f9c13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa276d640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c1411b0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400e930 tx=0x7f6f9400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6f9a7fc640 1 -- 172.21.15.90:0/1623360468 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94017070 con 0x7f6f9c153460 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6f9a7fc640 1 -- 172.21.15.90:0/1623360468 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f6f9400c980 con 0x7f6f9c153460 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c155b30 con 0x7f6f9c153460 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6f9a7fc640 1 -- 172.21.15.90:0/1623360468 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f9400cd90 con 0x7f6f9c153460 2024-04-20T11:00:34.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.357+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c155df0 con 0x7f6f9c153460 2024-04-20T11:00:34.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.358+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c076150 con 0x7f6f9c153460 2024-04-20T11:00:34.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.358+0000 7f6f9a7fc640 1 -- 172.21.15.90:0/1623360468 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f9401a070 con 0x7f6f9c153460 2024-04-20T11:00:34.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.359+0000 7f6f9a7fc640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6f8806c920 0x7f6f8806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.359+0000 7f6f9a7fc640 1 -- 172.21.15.90:0/1623360468 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7f6f9408c130 con 0x7f6f9c153460 2024-04-20T11:00:34.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.359+0000 7f6fa1f6c640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6f8806c920 0x7f6f8806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.362 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.359+0000 7f6fa1f6c640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6f8806c920 0x7f6f8806ede0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0012e0 tx=0x7f6f8c001700 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.363+0000 7f6f9a7fc640 1 -- 172.21.15.90:0/1623360468 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f6f94059910 con 0x7f6f9c153460 2024-04-20T11:00:34.541 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.541+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6f9c0c7c90 con 0x7f6f9c153460 2024-04-20T11:00:34.543 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.543+0000 7f6f9a7fc640 1 -- 172.21.15.90:0/1623360468 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+22023 (secure 0 0 0) 0x7f6f9405dc10 con 0x7f6f9c153460 2024-04-20T11:00:34.543 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:34.543 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":38,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T10:59:20.376229+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"a_metadata","create_time":"2024-04-20T10:50:37.606387+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"a_data","create_time":"2024-04-20T10:50:38.877596+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"a"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.b","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6834/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6833/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.175:6833/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.90:6835/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6834/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6837/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.90:6837/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.90:6835/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.175:6835/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6836/1538296646":"2024-04-21T10:55:30.341595+0000","172.21.15.90:6836/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.175:6832/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6836/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.175:6832/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.175:6833/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6834/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.175:6832/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.90:6834/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.90:6834/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.90:6837/1538296646":"2024-04-21T10:55:30.341595+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T11:00:34.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6f8806c920 msgr2=0x7f6f8806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6f8806c920 0x7f6f8806ede0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c0012e0 tx=0x7f6f8c001700 comp rx=0 tx=0).stop 2024-04-20T11:00:34.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 msgr2=0x7f6f9c1411b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c1411b0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f6f9400e930 tx=0x7f6f9400edf0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 shutdown_connections 2024-04-20T11:00:34.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f6f8806c920 0x7f6f8806ede0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.545 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f6f9c153460 0x7f6f9c1411b0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f6f9c150300 0x7f6f9c13e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 --2- 172.21.15.90:0/1623360468 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f6f9c0c4e20 0x7f6f9c1ee4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 >> 172.21.15.90:0/1623360468 conn(0x7f6f9c0aa660 msgr2=0x7f6f9c06d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:34.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 shutdown_connections 2024-04-20T11:00:34.546 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.545+0000 7f6fa41d0640 1 -- 172.21.15.90:0/1623360468 wait complete. 2024-04-20T11:00:34.556 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail a 2024-04-20T11:00:34.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.654+0000 7fc2e3dd5640 1 Processor -- start 2024-04-20T11:00:34.655 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e3dd5640 1 -- start start 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e3dd5640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2dc153d60 0x7fc2dc0ab4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e3dd5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0c4600 0x7fc2dc0c35e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e3dd5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc0acaa0 con 0x7fc2dc0ac2b0 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e3dd5640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fc2dc0acdf0 con 0x7fc2dc153d60 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e3dd5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc15a750 con 0x7fc2dc0c4600 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e1b71640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2dc153d60 0x7fc2dc0ab4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e1b71640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fc2dc153d60 0x7fc2dc0ab4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47498/0 (socket says 172.21.15.90:47498) 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.655+0000 7fc2e1b71640 1 -- 172.21.15.90:0/1470833290 learned_addr learned my addr 172.21.15.90:0/1470833290 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:34.656 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.656+0000 7fc2e2372640 1 --2- 172.21.15.90:0/1470833290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0c4600 0x7fc2dc0c35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.656+0000 7fc2e1b71640 1 -- 172.21.15.90:0/1470833290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0c4600 msgr2=0x7fc2dc0c35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:34.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.656+0000 7fc2e1b71640 1 --2- 172.21.15.90:0/1470833290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0c4600 0x7fc2dc0c35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.656+0000 7fc2e1b71640 1 -- 172.21.15.90:0/1470833290 >> v1:172.21.15.175:6789/0 conn(0x7fc2dc0ac2b0 legacy=0x7fc2dc0c4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.657 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.656+0000 7fc2e1b71640 1 -- 172.21.15.90:0/1470833290 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc15aa30 con 0x7fc2dc153d60 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e1b71640 1 --2- 172.21.15.90:0/1470833290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc0ab4a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009e50 tx=0x7fc2d402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593499a8b3d747f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e0b6f640 1 -- 172.21.15.90:0/1470833290 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d402c9e0 con 0x7fc2dc153d60 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e0b6f640 1 -- 172.21.15.90:0/1470833290 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc2d402cb80 con 0x7fc2dc153d60 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e0b6f640 1 -- 172.21.15.90:0/1470833290 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d40343f0 con 0x7fc2dc153d60 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/1470833290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 msgr2=0x7fc2dc0ab4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/1470833290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc0ab4a0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4009e50 tx=0x7fc2d402be40 comp rx=0 tx=0).stop 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/1470833290 shutdown_connections 2024-04-20T11:00:34.658 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/1470833290 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0c4600 0x7fc2dc0c35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/1470833290 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc0ab4a0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/1470833290 >> 172.21.15.90:0/1470833290 conn(0x7fc2dc067de0 msgr2=0x7fc2dc0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:34.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/1470833290 shutdown_connections 2024-04-20T11:00:34.659 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.657+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/1470833290 wait complete. 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.658+0000 7fc2e3dd5640 1 Processor -- start 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.658+0000 7fc2e3dd5640 1 -- start start 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e3dd5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0ac2b0 0x7fc2dc154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e3dd5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc0c4600 0x7fc2dc155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e3dd5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e3dd5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc070fa0 con 0x7fc2dc153d60 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e3dd5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fc2dc070e20 con 0x7fc2dc0c4600 2024-04-20T11:00:34.661 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e3dd5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fc2dc0c3b20 con 0x7fc2dc0ac2b0 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e2372640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e2372640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47500/0 (socket says 172.21.15.90:47500) 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e2372640 1 -- 172.21.15.90:0/445826481 learned_addr learned my addr 172.21.15.90:0/445826481 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e1b71640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0ac2b0 0x7fc2dc154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e1370640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc0c4600 0x7fc2dc155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e2372640 1 -- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0ac2b0 msgr2=0x7fc2dc154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e2372640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0ac2b0 0x7fc2dc154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e2372640 1 -- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc0c4600 msgr2=0x7fc2dc155830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.659+0000 7fc2e2372640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc0c4600 0x7fc2dc155830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.660+0000 7fc2e2372640 1 -- 172.21.15.90:0/445826481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc1f07a0 con 0x7fc2dc153d60 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.660+0000 7fc2e2372640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc155d70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800e930 tx=0x7fc2d800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.660+0000 7fc2d27fc640 1 -- 172.21.15.90:0/445826481 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8017070 con 0x7fc2dc153d60 2024-04-20T11:00:34.662 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.660+0000 7fc2d27fc640 1 -- 172.21.15.90:0/445826481 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fc2d800c980 con 0x7fc2dc153d60 2024-04-20T11:00:34.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.660+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc158550 con 0x7fc2dc153d60 2024-04-20T11:00:34.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.660+0000 7fc2d27fc640 1 -- 172.21.15.90:0/445826481 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d800cd90 con 0x7fc2dc153d60 2024-04-20T11:00:34.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.660+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2dc158b10 con 0x7fc2dc153d60 2024-04-20T11:00:34.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.661+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2dc076150 con 0x7fc2dc153d60 2024-04-20T11:00:34.663 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.661+0000 7fc2d27fc640 1 -- 172.21.15.90:0/445826481 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2d801a070 con 0x7fc2dc153d60 2024-04-20T11:00:34.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.662+0000 7fc2d27fc640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc2c006c8f0 0x7fc2c006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.662+0000 7fc2d27fc640 1 -- 172.21.15.90:0/445826481 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 7583+0+0 (secure 0 0 0) 0x7fc2d808c590 con 0x7fc2dc153d60 2024-04-20T11:00:34.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.662+0000 7fc2e1b71640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc2c006c8f0 0x7fc2c006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:34.664 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.662+0000 7fc2e1b71640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc2c006c8f0 0x7fc2c006edb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4035000 tx=0x7fc2d4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:34.666 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.666+0000 7fc2d27fc640 1 -- 172.21.15.90:0/445826481 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fc2d805a3c0 con 0x7fc2dc153d60 2024-04-20T11:00:34.877 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.876+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "a"} v 0) -- 0x7fc2dc0abd30 con 0x7fc2dc153d60 2024-04-20T11:00:34.880 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.880+0000 7fc2d27fc640 1 -- 172.21.15.90:0/445826481 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "a"}]=0 a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) ==== 151+0+0 (secure 0 0 0) 0x7fc2d8059cc0 con 0x7fc2dc153d60 2024-04-20T11:00:34.881 INFO:teuthology.orchestra.run.smithi090.stderr:a marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-20T11:00:34.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc2c006c8f0 msgr2=0x7fc2c006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc2c006c8f0 0x7fc2c006edb0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2d4035000 tx=0x7fc2d4030000 comp rx=0 tx=0).stop 2024-04-20T11:00:34.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 msgr2=0x7fc2dc155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:34.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc155d70 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc2d800e930 tx=0x7fc2d800edf0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 shutdown_connections 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fc2c006c8f0 0x7fc2c006edb0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fc2dc153d60 0x7fc2dc155d70 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fc2dc0c4600 0x7fc2dc155830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 --2- 172.21.15.90:0/445826481 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fc2dc0ac2b0 0x7fc2dc154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 >> 172.21.15.90:0/445826481 conn(0x7fc2dc067de0 msgr2=0x7fc2dc0ad4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 shutdown_connections 2024-04-20T11:00:34.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.883+0000 7fc2e3dd5640 1 -- 172.21.15.90:0/445826481 wait complete. 2024-04-20T11:00:34.888 INFO:tasks.ceph.mds.c.smithi090.stderr: -8503> 2024-04-20T10:59:21.845+0000 7f3d20cfa640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T11:00:34.897 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm a --yes-i-really-mean-it 2024-04-20T11:00:34.922 INFO:tasks.ceph.mds.c.smithi090.stdout:starting mds.c at 2024-04-20T11:00:34.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.997+0000 7fef52d7e640 1 Processor -- start 2024-04-20T11:00:34.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.997+0000 7fef52d7e640 1 -- start start 2024-04-20T11:00:34.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef52d7e640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fef4c153ee0 0x7fef4c157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef52d7e640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fef4c0ab710 0x7fef4c0c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:34.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef52d7e640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c0adce0 con 0x7fef4c0c6f20 2024-04-20T11:00:34.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef52d7e640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fef4c0adfc0 con 0x7fef4c0ab710 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef52d7e640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fef4c0ae2a0 con 0x7fef4c153ee0 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef4bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fef4c0ab710 0x7fef4c0c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef4bfff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fef4c0ab710 0x7fef4c0c69e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47526/0 (socket says 172.21.15.90:47526) 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef4bfff640 1 -- 172.21.15.90:0/2219648984 learned_addr learned my addr 172.21.15.90:0/2219648984 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef50b1a640 1 --2- 172.21.15.90:0/2219648984 >> v2:172.21.15.175:3300/0 conn(0x7fef4c153ee0 0x7fef4c157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef4bfff640 1 -- 172.21.15.90:0/2219648984 >> v2:172.21.15.175:3300/0 conn(0x7fef4c153ee0 msgr2=0x7fef4c157190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef4bfff640 1 --2- 172.21.15.90:0/2219648984 >> v2:172.21.15.175:3300/0 conn(0x7fef4c153ee0 0x7fef4c157190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef4bfff640 1 -- 172.21.15.90:0/2219648984 >> v1:172.21.15.175:6789/0 conn(0x7fef4c0c6f20 legacy=0x7fef4c06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.998+0000 7fef4bfff640 1 -- 172.21.15.90:0/2219648984 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c0bf7d0 con 0x7fef4c0ab710 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.999+0000 7fef4bfff640 1 --2- 172.21.15.90:0/2219648984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c69e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0c9b20 tx=0x7fef4002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77c9430a9db671a server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.999+0000 7fef4b7fe640 1 -- 172.21.15.90:0/2219648984 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4002e070 con 0x7fef4c0ab710 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.999+0000 7fef4b7fe640 1 -- 172.21.15.90:0/2219648984 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef40037070 con 0x7fef4c0ab710 2024-04-20T11:00:35.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:34.999+0000 7fef4b7fe640 1 -- 172.21.15.90:0/2219648984 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef40031a20 con 0x7fef4c0ab710 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 -- 172.21.15.90:0/2219648984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c0ab710 msgr2=0x7fef4c0c69e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 --2- 172.21.15.90:0/2219648984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c69e0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fef4c0c9b20 tx=0x7fef4002b880 comp rx=0 tx=0).stop 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 -- 172.21.15.90:0/2219648984 shutdown_connections 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 --2- 172.21.15.90:0/2219648984 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c69e0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 --2- 172.21.15.90:0/2219648984 >> v2:172.21.15.175:3300/0 conn(0x7fef4c153ee0 0x7fef4c157190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 -- 172.21.15.90:0/2219648984 >> 172.21.15.90:0/2219648984 conn(0x7fef4c0cc060 msgr2=0x7fef4c0cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 -- 172.21.15.90:0/2219648984 shutdown_connections 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.000+0000 7fef52d7e640 1 -- 172.21.15.90:0/2219648984 wait complete. 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.001+0000 7fef52d7e640 1 Processor -- start 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.001+0000 7fef52d7e640 1 -- start start 2024-04-20T11:00:35.004 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef52d7e640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef52d7e640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef4c0c6f20 0x7fef4c1523a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef52d7e640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c153ee0 0x7fef4c0c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef52d7e640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c06cfb0 con 0x7fef4c153ee0 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef52d7e640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c06ce30 con 0x7fef4c0ab710 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef52d7e640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c06d130 con 0x7fef4c0c6f20 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c153ee0 0x7fef4c0c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c153ee0 0x7fef4c0c5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:47532/0 (socket says 172.21.15.90:47532) 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 -- 172.21.15.90:0/293611794 learned_addr learned my addr 172.21.15.90:0/293611794 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef50b1a640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 -- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef4c0c6f20 msgr2=0x7fef4c1523a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef4bfff640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef4c0c6f20 0x7fef4c1523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef4c0c6f20 0x7fef4c1523a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 -- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef4c0ab710 msgr2=0x7fef4c0c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:35.005 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 -- 172.21.15.90:0/293611794 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c152da0 con 0x7fef4c153ee0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef4bfff640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef4c0c6f20 0x7fef4c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef50b1a640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef5131b640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c153ee0 0x7fef4c0c5270 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c6b0 tx=0x7fef4400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef497fa640 1 -- 172.21.15.90:0/293611794 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44003b70 con 0x7fef4c153ee0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef497fa640 1 -- 172.21.15.90:0/293611794 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef44003d30 con 0x7fef4c153ee0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c159e60 con 0x7fef4c153ee0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.002+0000 7fef497fa640 1 -- 172.21.15.90:0/293611794 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44005330 con 0x7fef4c153ee0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.003+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c157370 con 0x7fef4c153ee0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.003+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c076150 con 0x7fef4c153ee0 2024-04-20T11:00:35.006 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.004+0000 7fef497fa640 1 -- 172.21.15.90:0/293611794 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fef440054d0 con 0x7fef4c153ee0 2024-04-20T11:00:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.004+0000 7fef497fa640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fef3806c8f0 0x7fef3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.005+0000 7fef50b1a640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fef3806c8f0 0x7fef3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.005+0000 7fef497fa640 1 -- 172.21.15.90:0/293611794 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 7669+0+0 (secure 0 0 0) 0x7fef4408c160 con 0x7fef4c153ee0 2024-04-20T11:00:35.007 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.005+0000 7fef50b1a640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fef3806c8f0 0x7fef3806edb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fef3c006fd0 tx=0x7fef3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:35.009 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.009+0000 7fef497fa640 1 -- 172.21.15.90:0/293611794 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fef44059de0 con 0x7fef4c153ee0 2024-04-20T11:00:35.223 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.223+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true} v 0) -- 0x7fef4c06d910 con 0x7fef4c153ee0 2024-04-20T11:00:35.884 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.884+0000 7fef497fa640 1 -- 172.21.15.90:0/293611794 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "a", "yes_i_really_mean_it": true}]=0 v75) ==== 99+0+0 (secure 0 0 0) 0x7fef440596e0 con 0x7fef4c153ee0 2024-04-20T11:00:35.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fef3806c8f0 msgr2=0x7fef3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fef3806c8f0 0x7fef3806edb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fef3c006fd0 tx=0x7fef3c008040 comp rx=0 tx=0).stop 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c153ee0 msgr2=0x7fef4c0c5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c153ee0 0x7fef4c0c5270 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fef4400c6b0 tx=0x7fef4400cb70 comp rx=0 tx=0).stop 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 shutdown_connections 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fef3806c8f0 0x7fef3806edb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fef4c153ee0 0x7fef4c0c5270 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fef4c0c6f20 0x7fef4c1523a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 --2- 172.21.15.90:0/293611794 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fef4c0ab710 0x7fef4c0c1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 >> 172.21.15.90:0/293611794 conn(0x7fef4c0cc060 msgr2=0x7fef4c0ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:35.888 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 shutdown_connections 2024-04-20T11:00:35.889 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:35.887+0000 7fef52d7e640 1 -- 172.21.15.90:0/293611794 wait complete. 2024-04-20T11:00:35.901 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_metadata a_metadata --yes-i-really-really-mean-it 2024-04-20T11:00:36.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.048+0000 7f0a326e0640 1 Processor -- start 2024-04-20T11:00:36.048 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.048+0000 7f0a326e0640 1 -- start start 2024-04-20T11:00:36.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.048+0000 7f0a326e0640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f0a2c15a680 0x7f0a2c156680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.048+0000 7f0a326e0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 0x7f0a2c156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.051 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.048+0000 7f0a326e0640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a2c0c2f40 con 0x7f0a2c153d50 2024-04-20T11:00:36.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.048+0000 7f0a326e0640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f0a2c154130 con 0x7f0a2c15a680 2024-04-20T11:00:36.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.048+0000 7f0a326e0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2c0c3b90 con 0x7f0a2c0c4020 2024-04-20T11:00:36.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2bfff640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f0a2c153d50 0x7f0a2c0c5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54124/0 (socket says 172.21.15.90:54124) 2024-04-20T11:00:36.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2bfff640 1 -- 172.21.15.90:0/2801409514 learned_addr learned my addr 172.21.15.90:0/2801409514 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:36.052 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680050572 0 0) 0x7f0a2c0c2f40 con 0x7f0a2c153d50 2024-04-20T11:00:36.053 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/2801409514 >> v2:172.21.15.175:3300/0 conn(0x7f0a2c15a680 0x7f0a2c156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a14003520 con 0x7f0a2c153d50 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a30c7d640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 0x7f0a2c156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 786739753 0 0) 0x7f0a14003520 con 0x7f0a2c153d50 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 msgr2=0x7f0a2c156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 0x7f0a2c156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 >> v2:172.21.15.175:3300/0 conn(0x7f0a2c15a680 msgr2=0x7f0a2c156680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 --2- 172.21.15.90:0/2801409514 >> v2:172.21.15.175:3300/0 conn(0x7f0a2c15a680 0x7f0a2c156680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c0c31b0 con 0x7f0a2c153d50 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f0a1c001670 con 0x7f0a2c153d50 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 >> v1:172.21.15.90:6789/0 conn(0x7f0a2c153d50 legacy=0x7f0a2c0c5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:36.054 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a140039b0 0x7f0a14003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a14004800 0x7f0a14004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 0x7f0a140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c0c3b90 con 0x7f0a14004800 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1400b9c0 con 0x7f0a140039b0 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1400bb40 con 0x7f0a2c0c4020 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a14004800 0x7f0a14004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a2bfff640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a140039b0 0x7f0a14003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.049+0000 7f0a30c7d640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 0x7f0a140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.055 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.050+0000 7f0a2b7fe640 1 -- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 msgr2=0x7f0a140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:36.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.050+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a2c0c4020 0x7f0a140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.050+0000 7f0a2b7fe640 1 -- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a140039b0 msgr2=0x7f0a14003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:36.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.050+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a140039b0 0x7f0a14003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.050+0000 7f0a2b7fe640 1 -- 172.21.15.90:0/2801409514 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a14003520 con 0x7f0a14004800 2024-04-20T11:00:36.056 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.050+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a14004800 0x7f0a14004c80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009af0 tx=0x7f0a14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d49bb04120577a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.050+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20039070 con 0x7f0a14004800 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0a2002c710 con 0x7f0a14004800 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a2affd640 1 -- 172.21.15.90:0/2801409514 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20009690 con 0x7f0a14004800 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a326e0640 1 -- 172.21.15.90:0/2801409514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a14004800 msgr2=0x7f0a14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a326e0640 1 --2- 172.21.15.90:0/2801409514 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a14004800 0x7f0a14004c80 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009af0 tx=0x7f0a14005830 comp rx=0 tx=0).stop 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a30c7d640 1 -- 172.21.15.90:0/2801409514 reap_dead start 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a326e0640 1 -- 172.21.15.90:0/2801409514 shutdown_connections 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a326e0640 1 -- 172.21.15.90:0/2801409514 >> 172.21.15.90:0/2801409514 conn(0x7f0a2c06ca40 msgr2=0x7f0a2c06ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a326e0640 1 -- 172.21.15.90:0/2801409514 shutdown_connections 2024-04-20T11:00:36.057 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.051+0000 7f0a326e0640 1 -- 172.21.15.90:0/2801409514 wait complete. 2024-04-20T11:00:36.059 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.052+0000 7f0a326e0640 1 Processor -- start 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.052+0000 7f0a326e0640 1 -- start start 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a326e0640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a14004800 0x7f0a2c0ac1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a326e0640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a2c159bd0 0x7f0a2c1efbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a326e0640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c0c81c0 0x7f0a2c1ec4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a326e0640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c0c62a0 con 0x7f0a2c159bd0 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a326e0640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f0a2c15ab10 con 0x7f0a2c0c81c0 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a326e0640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f0a2c0c6420 con 0x7f0a14004800 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a2c159bd0 0x7f0a2c1efbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a2c159bd0 0x7f0a2c1efbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57444/0 (socket says 172.21.15.90:57444) 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 -- 172.21.15.90:0/1942564171 learned_addr learned my addr 172.21.15.90:0/1942564171 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a30c7d640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c0c81c0 0x7f0a2c1ec4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2bfff640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a14004800 0x7f0a2c0ac1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.060 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 -- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a14004800 msgr2=0x7f0a2c0ac1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a14004800 0x7f0a2c0ac1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 -- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c0c81c0 msgr2=0x7f0a2c1ec4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c0c81c0 0x7f0a2c1ec4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.053+0000 7f0a2b7fe640 1 -- 172.21.15.90:0/1942564171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a2c158d60 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.054+0000 7f0a2b7fe640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a2c159bd0 0x7f0a2c1efbf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009af0 tx=0x7f0a20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.054+0000 7f0a28ff9640 1 -- 172.21.15.90:0/1942564171 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20042020 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.054+0000 7f0a28ff9640 1 -- 172.21.15.90:0/1942564171 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f0a2003a040 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.054+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a2c159040 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.054+0000 7f0a28ff9640 1 -- 172.21.15.90:0/1942564171 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20039070 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.054+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a2c0aebb0 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.055+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a2c0761f0 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.055+0000 7f0a28ff9640 1 -- 172.21.15.90:0/1942564171 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0a20045020 con 0x7f0a2c159bd0 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.055+0000 7f0a28ff9640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0a1806c920 0x7f0a1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:36.061 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.056+0000 7f0a2bfff640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0a1806c920 0x7f0a1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:36.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.056+0000 7f0a28ff9640 1 -- 172.21.15.90:0/1942564171 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 7669+0+0 (secure 0 0 0) 0x7f0a200ad850 con 0x7f0a2c159bd0 2024-04-20T11:00:36.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.056+0000 7f0a2bfff640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0a1806c920 0x7f0a1806ede0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c001050 tx=0x7f0a1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:36.062 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.060+0000 7f0a28ff9640 1 -- 172.21.15.90:0/1942564171 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f0a2004c070 con 0x7f0a2c159bd0 2024-04-20T11:00:36.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.234+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0a2c0c2c80 con 0x7f0a2c159bd0 2024-04-20T11:00:36.887 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.887+0000 7f0a28ff9640 1 -- 172.21.15.90:0/1942564171 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_metadata", "pool2": "a_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'a_metadata' removed v40) ==== 166+0+0 (secure 0 0 0) 0x7f0a2007b4d0 con 0x7f0a2c159bd0 2024-04-20T11:00:36.887 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_metadata' removed 2024-04-20T11:00:36.891 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0a1806c920 msgr2=0x7f0a1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:36.892 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0a1806c920 0x7f0a1806ede0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c001050 tx=0x7f0a1c009040 comp rx=0 tx=0).stop 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a2c159bd0 msgr2=0x7f0a2c1efbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a2c159bd0 0x7f0a2c1efbf0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009af0 tx=0x7f0a20004730 comp rx=0 tx=0).stop 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 shutdown_connections 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f0a1806c920 0x7f0a1806ede0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f0a2c0c81c0 0x7f0a2c1ec4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f0a2c159bd0 0x7f0a2c1efbf0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 --2- 172.21.15.90:0/1942564171 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f0a14004800 0x7f0a2c0ac1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 >> 172.21.15.90:0/1942564171 conn(0x7f0a2c06ca40 msgr2=0x7f0a2c14fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 shutdown_connections 2024-04-20T11:00:36.893 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:36.891+0000 7f0a326e0640 1 -- 172.21.15.90:0/1942564171 wait complete. 2024-04-20T11:00:36.908 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm a_data a_data --yes-i-really-really-mean-it 2024-04-20T11:00:37.010 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.010+0000 7f29636e4640 1 Processor -- start 2024-04-20T11:00:37.011 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.010+0000 7f29636e4640 1 -- start start 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f29636e4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f295c0ae9f0 0x7f295c157240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f29636e4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c06c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f29636e4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295c0c6c10 con 0x7f295c1540c0 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f29636e4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f295c1544a0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f29636e4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f295c0c6ef0 con 0x7f295c06c310 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f2960c7f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f295c0ae9f0 0x7f295c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f2960c7f640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f295c0ae9f0 0x7f295c157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57446/0 (socket says 172.21.15.90:57446) 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f2960c7f640 1 -- 172.21.15.90:0/2031246042 learned_addr learned my addr 172.21.15.90:0/2031246042 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f2961c81640 1 --2- 172.21.15.90:0/2031246042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c06c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f2960c7f640 1 -- 172.21.15.90:0/2031246042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 msgr2=0x7f295c06c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:37.012 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f2960c7f640 1 --2- 172.21.15.90:0/2031246042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c06c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.011+0000 7f2960c7f640 1 -- 172.21.15.90:0/2031246042 >> v1:172.21.15.175:6789/0 conn(0x7f295c1540c0 legacy=0x7f295c0ae2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:37.013 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.012+0000 7f2960c7f640 1 -- 172.21.15.90:0/2031246042 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c0c71d0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.012+0000 7f2960c7f640 1 --2- 172.21.15.90:0/2031246042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c157240 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f294c009870 tx=0x7f294c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2cba9756699e7a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.012+0000 7f2953fff640 1 -- 172.21.15.90:0/2031246042 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c0317c0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.012+0000 7f2953fff640 1 -- 172.21.15.90:0/2031246042 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f294c037070 con 0x7f295c0ae9f0 2024-04-20T11:00:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.012+0000 7f2953fff640 1 -- 172.21.15.90:0/2031246042 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c031ba0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 -- 172.21.15.90:0/2031246042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 msgr2=0x7f295c157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:37.014 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 --2- 172.21.15.90:0/2031246042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c157240 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f294c009870 tx=0x7f294c02b860 comp rx=0 tx=0).stop 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 -- 172.21.15.90:0/2031246042 shutdown_connections 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 --2- 172.21.15.90:0/2031246042 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c06c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 --2- 172.21.15.90:0/2031246042 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c157240 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 -- 172.21.15.90:0/2031246042 >> 172.21.15.90:0/2031246042 conn(0x7f295c0cc0f0 msgr2=0x7f295c0cc4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 -- 172.21.15.90:0/2031246042 shutdown_connections 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.013+0000 7f29636e4640 1 -- 172.21.15.90:0/2031246042 wait complete. 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.014+0000 7f29636e4640 1 Processor -- start 2024-04-20T11:00:37.015 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.014+0000 7f29636e4640 1 -- start start 2024-04-20T11:00:37.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f29636e4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c1efa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:37.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f29636e4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:37.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f29636e4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c1540c0 0x7f295c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:37.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f29636e4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0cab20 con 0x7f295c0ae9f0 2024-04-20T11:00:37.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f29636e4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f295c0ca9a0 con 0x7f295c1540c0 2024-04-20T11:00:37.017 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f29636e4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f295c06cca0 con 0x7f295c06c310 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57454/0 (socket says 172.21.15.90:57454) 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 -- 172.21.15.90:0/1808184953 learned_addr learned my addr 172.21.15.90:0/1808184953 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2961c81640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c1540c0 0x7f295c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2961480640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c1efa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 -- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 msgr2=0x7f295c1efa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c1efa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 -- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c1540c0 msgr2=0x7f295c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c1540c0 0x7f295c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 -- 172.21.15.90:0/1808184953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295c14fff0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.015+0000 7f2960c7f640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c156370 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f294c000c00 tx=0x7f294c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:37.018 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.016+0000 7f2951ffb640 1 -- 172.21.15.90:0/1808184953 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c032860 con 0x7f295c0ae9f0 2024-04-20T11:00:37.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.016+0000 7f2951ffb640 1 -- 172.21.15.90:0/1808184953 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f294c032a00 con 0x7f295c0ae9f0 2024-04-20T11:00:37.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.016+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295c153680 con 0x7f295c0ae9f0 2024-04-20T11:00:37.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.016+0000 7f2951ffb640 1 -- 172.21.15.90:0/1808184953 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294c032e10 con 0x7f295c0ae9f0 2024-04-20T11:00:37.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.016+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295c0af040 con 0x7f295c0ae9f0 2024-04-20T11:00:37.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.017+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f295c0761f0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.019 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.017+0000 7f2951ffb640 1 -- 172.21.15.90:0/1808184953 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f294c04c060 con 0x7f295c0ae9f0 2024-04-20T11:00:37.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.018+0000 7f2951ffb640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f294006c8f0 0x7f294006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:37.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.018+0000 7f2951ffb640 1 -- 172.21.15.90:0/1808184953 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 7241+0+0 (secure 0 0 0) 0x7f294c0adce0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.018+0000 7f2961480640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f294006c8f0 0x7f294006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:37.020 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.018+0000 7f2961480640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f294006c8f0 0x7f294006edb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f295c06dc00 tx=0x7f2958009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:37.022 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.022+0000 7f2951ffb640 1 -- 172.21.15.90:0/1808184953 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f294c040070 con 0x7f295c0ae9f0 2024-04-20T11:00:37.210 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.210+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f295c06dc70 con 0x7f295c0ae9f0 2024-04-20T11:00:37.899 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.899+0000 7f2951ffb640 1 -- 172.21.15.90:0/1808184953 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "a_data", "pool2": "a_data", "yes_i_really_really_mean_it": true}]=0 pool 'a_data' removed v41) ==== 154+0+0 (secure 0 0 0) 0x7f294c07bba0 con 0x7f295c0ae9f0 2024-04-20T11:00:37.900 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'a_data' removed 2024-04-20T11:00:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.903+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f294006c8f0 msgr2=0x7f294006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.903+0000 7f29636e4640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f294006c8f0 0x7f294006edb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f295c06dc00 tx=0x7f2958009040 comp rx=0 tx=0).stop 2024-04-20T11:00:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.903+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 msgr2=0x7f295c156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:37.903 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.903+0000 7f29636e4640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c156370 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f294c000c00 tx=0x7f294c0046c0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 shutdown_connections 2024-04-20T11:00:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f294006c8f0 0x7f294006edb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f295c1540c0 0x7f295c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f295c0ae9f0 0x7f295c156370 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 --2- 172.21.15.90:0/1808184953 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f295c06c310 0x7f295c1efa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 >> 172.21.15.90:0/1808184953 conn(0x7f295c0cc0f0 msgr2=0x7f295c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:37.905 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 shutdown_connections 2024-04-20T11:00:37.906 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:37.905+0000 7f29636e4640 1 -- 172.21.15.90:0/1808184953 wait complete. 2024-04-20T11:00:37.923 INFO:tasks.cephfs.filesystem:Destroying file system b and related pools 2024-04-20T11:00:37.923 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T11:00:38.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.025+0000 7f9d960f2640 1 Processor -- start 2024-04-20T11:00:38.025 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.025+0000 7f9d960f2640 1 -- start start 2024-04-20T11:00:38.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d960f2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9d90073810 0x7f9d90154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d960f2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f9d900ad0c0 0x7f9d900ad570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d960f2640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d900c4370 con 0x7f9d90157710 2024-04-20T11:00:38.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d960f2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f9d901569e0 con 0x7f9d90073810 2024-04-20T11:00:38.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d960f2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f9d90157280 con 0x7f9d900ad0c0 2024-04-20T11:00:38.027 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8f7fe640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f9d90073810 0x7f9d90154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8effd640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f9d90157710 0x7f9d900c3b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54140/0 (socket says 172.21.15.90:54140) 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8effd640 1 -- 172.21.15.90:0/1855658332 learned_addr learned my addr 172.21.15.90:0/1855658332 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8ffff640 1 --2- 172.21.15.90:0/1855658332 >> v2:172.21.15.175:3300/0 conn(0x7f9d900ad0c0 0x7f9d900ad570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8f7fe640 1 -- 172.21.15.90:0/1855658332 >> v2:172.21.15.175:3300/0 conn(0x7f9d900ad0c0 msgr2=0x7f9d900ad570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8f7fe640 1 --2- 172.21.15.90:0/1855658332 >> v2:172.21.15.175:3300/0 conn(0x7f9d900ad0c0 0x7f9d900ad570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8f7fe640 1 -- 172.21.15.90:0/1855658332 >> v1:172.21.15.90:6789/0 conn(0x7f9d90157710 legacy=0x7f9d900c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8e7fc640 1 -- 172.21.15.90:0/1855658332 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1372697329 0 0) 0x7f9d900c4370 con 0x7f9d90157710 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8f7fe640 1 -- 172.21.15.90:0/1855658332 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d90156c30 con 0x7f9d90073810 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.026+0000 7f9d8ffff640 1 --2- 172.21.15.90:0/1855658332 >> v2:172.21.15.175:3300/0 conn(0x7f9d900ad0c0 0x7f9d900ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.027+0000 7f9d8f7fe640 1 --2- 172.21.15.90:0/1855658332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90154000 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9d900c42a0 tx=0x7f9d8002e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2772ac5b955950b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.027+0000 7f9d8e7fc640 1 -- 172.21.15.90:0/1855658332 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8003b070 con 0x7f9d90073810 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.027+0000 7f9d8e7fc640 1 -- 172.21.15.90:0/1855658332 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d8002edc0 con 0x7f9d90073810 2024-04-20T11:00:38.028 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.027+0000 7f9d8e7fc640 1 -- 172.21.15.90:0/1855658332 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80036680 con 0x7f9d90073810 2024-04-20T11:00:38.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 -- 172.21.15.90:0/1855658332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 msgr2=0x7f9d90154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 --2- 172.21.15.90:0/1855658332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90154000 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f9d900c42a0 tx=0x7f9d8002e010 comp rx=0 tx=0).stop 2024-04-20T11:00:38.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 -- 172.21.15.90:0/1855658332 shutdown_connections 2024-04-20T11:00:38.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 --2- 172.21.15.90:0/1855658332 >> v2:172.21.15.175:3300/0 conn(0x7f9d900ad0c0 0x7f9d900ad570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.031 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 --2- 172.21.15.90:0/1855658332 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90154000 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 -- 172.21.15.90:0/1855658332 >> 172.21.15.90:0/1855658332 conn(0x7f9d900c8080 msgr2=0x7f9d900c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 -- 172.21.15.90:0/1855658332 shutdown_connections 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.028+0000 7f9d960f2640 1 -- 172.21.15.90:0/1855658332 wait complete. 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.029+0000 7f9d960f2640 1 Processor -- start 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.029+0000 7f9d960f2640 1 -- start start 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900ad0c0 0x7f9d90071390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90157710 0x7f9d901e7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f9d900abbb0 con 0x7f9d90073810 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f9d90073bf0 con 0x7f9d900ad0c0 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f9d900abd30 con 0x7f9d90157710 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90072f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57478/0 (socket says 172.21.15.90:57478) 2024-04-20T11:00:38.032 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 -- 172.21.15.90:0/2697848128 learned_addr learned my addr 172.21.15.90:0/2697848128 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8ffff640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90157710 0x7f9d901e7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8effd640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900ad0c0 0x7f9d90071390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 -- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90157710 msgr2=0x7f9d901e7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90157710 0x7f9d901e7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 -- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900ad0c0 msgr2=0x7f9d90071390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900ad0c0 0x7f9d90071390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 -- 172.21.15.90:0/2697848128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d900c57d0 con 0x7f9d90073810 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8effd640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900ad0c0 0x7f9d90071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d8f7fe640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90072f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9d80039040 tx=0x7f9d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d77fff640 1 -- 172.21.15.90:0/2697848128 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d8003b050 con 0x7f9d90073810 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d77fff640 1 -- 172.21.15.90:0/2697848128 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d8003c040 con 0x7f9d90073810 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d901eb790 con 0x7f9d90073810 2024-04-20T11:00:38.033 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d77fff640 1 -- 172.21.15.90:0/2697848128 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d80004470 con 0x7f9d90073810 2024-04-20T11:00:38.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.030+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d900718d0 con 0x7f9d90073810 2024-04-20T11:00:38.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.031+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d90076150 con 0x7f9d90073810 2024-04-20T11:00:38.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.032+0000 7f9d77fff640 1 -- 172.21.15.90:0/2697848128 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d8002ec80 con 0x7f9d90073810 2024-04-20T11:00:38.034 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.032+0000 7f9d77fff640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d7c06c8f0 0x7f9d7c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.032+0000 7f9d77fff640 1 -- 172.21.15.90:0/2697848128 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6721+0+0 (secure 0 0 0) 0x7f9d800b0a30 con 0x7f9d90073810 2024-04-20T11:00:38.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.032+0000 7f9d8effd640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d7c06c8f0 0x7f9d7c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.035 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.033+0000 7f9d8effd640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d7c06c8f0 0x7f9d7c06edb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9d90152190 tx=0x7f9d84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.036 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.036+0000 7f9d77fff640 1 -- 172.21.15.90:0/2697848128 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f9d8007ea60 con 0x7f9d90073810 2024-04-20T11:00:38.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.247+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d900c8c40 con 0x7f9d90073810 2024-04-20T11:00:38.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.248+0000 7f9d77fff640 1 -- 172.21.15.90:0/2697848128 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5202 (secure 0 0 0) 0x7f9d8007e360 con 0x7f9d90073810 2024-04-20T11:00:38.248 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:38.249 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2387787206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2387787206},{"type":"v1","addr":"172.21.15.90:6835","nonce":2387787206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6486,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/912163374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":912163374},{"type":"v1","addr":"172.21.15.90:6837","nonce":912163374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:29.552819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":103,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4769,"qdb_cluster":[4769]},"id":2}]} 2024-04-20T11:00:38.249 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 75 2024-04-20T11:00:38.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d7c06c8f0 msgr2=0x7f9d7c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.250 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d7c06c8f0 0x7f9d7c06edb0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f9d90152190 tx=0x7f9d84009040 comp rx=0 tx=0).stop 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 msgr2=0x7f9d90072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90072f90 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f9d80039040 tx=0x7f9d800046c0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 shutdown_connections 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f9d7c06c8f0 0x7f9d7c06edb0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f9d90157710 0x7f9d901e7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f9d900ad0c0 0x7f9d90071390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 --2- 172.21.15.90:0/2697848128 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f9d90073810 0x7f9d90072f90 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 >> 172.21.15.90:0/2697848128 conn(0x7f9d900c8080 msgr2=0x7f9d901517b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 shutdown_connections 2024-04-20T11:00:38.251 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.250+0000 7f9d960f2640 1 -- 172.21.15.90:0/2697848128 wait complete. 2024-04-20T11:00:38.261 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T11:00:38.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.358+0000 7fde1b670640 1 Processor -- start 2024-04-20T11:00:38.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.358+0000 7fde1b670640 1 -- start start 2024-04-20T11:00:38.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1b670640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde14153ee0 0x7fde14157190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1b670640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde1406c4d0 0x7fde1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1b670640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde140adce0 con 0x7fde140ab710 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1b670640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7fde140adfc0 con 0x7fde1406c4d0 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1b670640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fde140ae2a0 con 0x7fde14153ee0 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1940c640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde14153ee0 0x7fde14157190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde19c0d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7fde1406c4d0 0x7fde1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde18c0b640 1 --1- >> v1:172.21.15.175:6789/0 conn(0x7fde140ab710 0x7fde140c69e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.175:6789/0 says I am v1:172.21.15.90:38732/0 (socket says 172.21.15.90:38732) 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde18c0b640 1 -- 172.21.15.90:0/1209387460 learned_addr learned my addr 172.21.15.90:0/1209387460 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1940c640 1 -- 172.21.15.90:0/1209387460 >> v2:172.21.15.175:3300/0 conn(0x7fde1406c4d0 msgr2=0x7fde1406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1940c640 1 --2- 172.21.15.90:0/1209387460 >> v2:172.21.15.175:3300/0 conn(0x7fde1406c4d0 0x7fde1406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1940c640 1 -- 172.21.15.90:0/1209387460 >> v1:172.21.15.175:6789/0 conn(0x7fde140ab710 legacy=0x7fde140c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde1940c640 1 -- 172.21.15.90:0/1209387460 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde140c70f0 con 0x7fde14153ee0 2024-04-20T11:00:38.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.359+0000 7fde19c0d640 1 --2- 172.21.15.90:0/1209387460 >> v2:172.21.15.175:3300/0 conn(0x7fde1406c4d0 0x7fde1406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-20T11:00:38.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.360+0000 7fde1940c640 1 --2- 172.21.15.90:0/1209387460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde14153ee0 0x7fde14157190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde100097a0 tx=0x7fde1002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452789df38fc44fe server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde0bfff640 1 -- 172.21.15.90:0/1209387460 <== mon.2 v2:172.21.15.175:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10039070 con 0x7fde14153ee0 2024-04-20T11:00:38.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde0bfff640 1 -- 172.21.15.90:0/1209387460 <== mon.2 v2:172.21.15.175:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fde100316f0 con 0x7fde14153ee0 2024-04-20T11:00:38.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde0bfff640 1 -- 172.21.15.90:0/1209387460 <== mon.2 v2:172.21.15.175:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde10031ae0 con 0x7fde14153ee0 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde1b670640 1 -- 172.21.15.90:0/1209387460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde14153ee0 msgr2=0x7fde14157190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde1b670640 1 --2- 172.21.15.90:0/1209387460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde14153ee0 0x7fde14157190 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fde100097a0 tx=0x7fde1002b790 comp rx=0 tx=0).stop 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde1b670640 1 -- 172.21.15.90:0/1209387460 shutdown_connections 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde1b670640 1 --2- 172.21.15.90:0/1209387460 >> v2:172.21.15.175:3300/0 conn(0x7fde1406c4d0 0x7fde1406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde1b670640 1 --2- 172.21.15.90:0/1209387460 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde14153ee0 0x7fde14157190 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.361+0000 7fde1b670640 1 -- 172.21.15.90:0/1209387460 >> 172.21.15.90:0/1209387460 conn(0x7fde140cc060 msgr2=0x7fde140cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.362+0000 7fde1b670640 1 -- 172.21.15.90:0/1209387460 shutdown_connections 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.362+0000 7fde1b670640 1 -- 172.21.15.90:0/1209387460 wait complete. 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 Processor -- start 2024-04-20T11:00:38.363 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 -- start start 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde1406c4d0 0x7fde14157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde140ab710 0x7fde14159e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde14153ee0 0x7fde140c0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fde1406cfe0 con 0x7fde14153ee0 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fde1406ce60 con 0x7fde140ab710 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde1b670640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fde1406d160 con 0x7fde1406c4d0 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde19c0d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde14153ee0 0x7fde140c0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde19c0d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde14153ee0 0x7fde140c0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57484/0 (socket says 172.21.15.90:57484) 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.363+0000 7fde19c0d640 1 -- 172.21.15.90:0/1848386891 learned_addr learned my addr 172.21.15.90:0/1848386891 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde18c0b640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde140ab710 0x7fde14159e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde19c0d640 1 -- 172.21.15.90:0/1848386891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde1406c4d0 msgr2=0x7fde14157a50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde19c0d640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde1406c4d0 0x7fde14157a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde19c0d640 1 -- 172.21.15.90:0/1848386891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde140ab710 msgr2=0x7fde14159e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde19c0d640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde140ab710 0x7fde14159e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde19c0d640 1 -- 172.21.15.90:0/1848386891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde140c5ac0 con 0x7fde14153ee0 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde19c0d640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde14153ee0 0x7fde140c0590 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00efc0 tx=0x7fde0c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde09ffb640 1 -- 172.21.15.90:0/1848386891 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c018030 con 0x7fde14153ee0 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde09ffb640 1 -- 172.21.15.90:0/1848386891 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fde0c00cdf0 con 0x7fde14153ee0 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde140c5da0 con 0x7fde14153ee0 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde09ffb640 1 -- 172.21.15.90:0/1848386891 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c003bd0 con 0x7fde14153ee0 2024-04-20T11:00:38.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.364+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde140bfd90 con 0x7fde14153ee0 2024-04-20T11:00:38.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.365+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde14076150 con 0x7fde14153ee0 2024-04-20T11:00:38.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.365+0000 7fde09ffb640 1 -- 172.21.15.90:0/1848386891 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde0c01b070 con 0x7fde14153ee0 2024-04-20T11:00:38.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.366+0000 7fde09ffb640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fddf806c8f0 0x7fddf806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.366+0000 7fde09ffb640 1 -- 172.21.15.90:0/1848386891 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6721+0+0 (secure 0 0 0) 0x7fde0c08c8c0 con 0x7fde14153ee0 2024-04-20T11:00:38.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.366+0000 7fde1940c640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fddf806c8f0 0x7fddf806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.366+0000 7fde1940c640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fddf806c8f0 0x7fddf806edb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fde10036000 tx=0x7fde10008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.370 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.370+0000 7fde09ffb640 1 -- 172.21.15.90:0/1848386891 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fde0c010040 con 0x7fde14153ee0 2024-04-20T11:00:38.579 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.579+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde1406d910 con 0x7fde14153ee0 2024-04-20T11:00:38.580 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.580+0000 7fde09ffb640 1 -- 172.21.15.90:0/1848386891 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) ==== 94+0+5202 (secure 0 0 0) 0x7fde0c05a8f0 con 0x7fde14153ee0 2024-04-20T11:00:38.580 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:38.580 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5794,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.175:6833/1233070057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6832","nonce":1233070057},{"type":"v1","addr":"172.21.15.175:6833","nonce":1233070057}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71},{"gid":6174,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6835/2387787206","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6834","nonce":2387787206},{"type":"v1","addr":"172.21.15.90:6835","nonce":2387787206}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6486,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.90:6837/912163374","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6836","nonce":912163374},{"type":"v1","addr":"172.21.15.90:6837","nonce":912163374}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":75}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-20T10:50:48.982985+0000","modified":"2024-04-20T10:59:29.552819+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":38,"snap_rstat":true,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4769},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4769":{"gid":4769,"name":"d","rank":0,"incarnation":68,"state":"up:active","state_seq":103,"addr":"172.21.15.175:6835/3644701296","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6834","nonce":3644701296},{"type":"v1","addr":"172.21.15.175:6835","nonce":3644701296}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"b","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4769,"qdb_cluster":[4769]},"id":2}]} 2024-04-20T11:00:38.580 INFO:teuthology.orchestra.run.smithi090.stderr:dumped fsmap epoch 75 2024-04-20T11:00:38.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fddf806c8f0 msgr2=0x7fddf806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fddf806c8f0 0x7fddf806edb0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fde10036000 tx=0x7fde10008030 comp rx=0 tx=0).stop 2024-04-20T11:00:38.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde14153ee0 msgr2=0x7fde140c0590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.582 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde14153ee0 0x7fde140c0590 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00efc0 tx=0x7fde0c00c490 comp rx=0 tx=0).stop 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 shutdown_connections 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fddf806c8f0 0x7fddf806edb0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fde14153ee0 0x7fde140c0590 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fde140ab710 0x7fde14159e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 --2- 172.21.15.90:0/1848386891 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fde1406c4d0 0x7fde14157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 >> 172.21.15.90:0/1848386891 conn(0x7fde140cc060 msgr2=0x7fde140ac3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 shutdown_connections 2024-04-20T11:00:38.583 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.582+0000 7fde1b670640 1 -- 172.21.15.90:0/1848386891 wait complete. 2024-04-20T11:00:38.593 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-20T11:00:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.689+0000 7f7ed356d640 1 Processor -- start 2024-04-20T11:00:38.690 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.690+0000 7f7ed356d640 1 -- start start 2024-04-20T11:00:38.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.690+0000 7f7ed356d640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f7ecc0c54d0 0x7f7ecc1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.690+0000 7f7ed356d640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ecc0adab0 con 0x7f7ecc0ad640 2024-04-20T11:00:38.693 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.690+0000 7f7ed356d640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ecc071690 con 0x7f7ecc0c27a0 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.690+0000 7f7ed356d640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f7ecc071970 con 0x7f7ecc0c54d0 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.690+0000 7f7ed1b0a640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f7ecc0ad640 0x7f7ecc153730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54144/0 (socket says 172.21.15.90:54144) 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1b0a640 1 -- 172.21.15.90:0/1866121066 learned_addr learned my addr 172.21.15.90:0/1866121066 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed0b08640 1 --2- 172.21.15.90:0/1866121066 >> v2:172.21.15.175:3300/0 conn(0x7f7ecc0c54d0 0x7f7ecc1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3421487779 0 0) 0x7f7ecc0adab0 con 0x7f7ecc0ad640 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7eb8003520 con 0x7f7ecc0ad640 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2559616168 0 0) 0x7f7eb8003520 con 0x7f7ecc0ad640 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 >> v2:172.21.15.175:3300/0 conn(0x7f7ecc0c54d0 msgr2=0x7f7ecc1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 --2- 172.21.15.90:0/1866121066 >> v2:172.21.15.175:3300/0 conn(0x7f7ecc0c54d0 0x7f7ecc1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 >> v1:172.21.15.175:6789/0 conn(0x7f7ecc0c27a0 legacy=0x7f7ecc15a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc159ce0 con 0x7f7ecc0ad640 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f7ec8001670 con 0x7f7ecc0ad640 2024-04-20T11:00:38.694 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 >> v1:172.21.15.90:6789/0 conn(0x7f7ecc0ad640 legacy=0x7f7ecc153730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb80039b0 0x7f7eb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb8004800 0x7f7eb8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7eb80051c0 0x7f7eb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc071970 con 0x7f7eb80039b0 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7eb800c060 con 0x7f7eb8004800 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7eb800c260 con 0x7f7eb80051c0 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1309640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb80039b0 0x7f7eb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1b0a640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7eb80051c0 0x7f7eb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed0b08640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb8004800 0x7f7eb8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1309640 1 -- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7eb80051c0 msgr2=0x7f7eb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1309640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7eb80051c0 0x7f7eb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1309640 1 -- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb8004800 msgr2=0x7f7eb8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:38.695 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1309640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb8004800 0x7f7eb8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1309640 1 -- 172.21.15.90:0/1866121066 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7eb8003520 con 0x7f7eb80039b0 2024-04-20T11:00:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed1b0a640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7eb80051c0 0x7f7eb800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T11:00:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.691+0000 7f7ed0b08640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb8004800 0x7f7eb8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T11:00:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.692+0000 7f7ed1b0a640 1 -- 172.21.15.90:0/1866121066 reap_dead start 2024-04-20T11:00:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.692+0000 7f7ed1309640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb80039b0 0x7f7eb8003dd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4001e50 tx=0x7f7eb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c378dc295ba31 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.696 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.692+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec4001a70 con 0x7f7eb80039b0 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.692+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7ec4003b70 con 0x7f7eb80039b0 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.692+0000 7f7ec3fff640 1 -- 172.21.15.90:0/1866121066 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec40050d0 con 0x7f7eb80039b0 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.693+0000 7f7ed356d640 1 -- 172.21.15.90:0/1866121066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb80039b0 msgr2=0x7f7eb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.693+0000 7f7ed356d640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb80039b0 0x7f7eb8003dd0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4001e50 tx=0x7f7eb8005830 comp rx=0 tx=0).stop 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.693+0000 7f7ed356d640 1 -- 172.21.15.90:0/1866121066 shutdown_connections 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.693+0000 7f7ed356d640 1 --2- 172.21.15.90:0/1866121066 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7eb80039b0 0x7f7eb8003dd0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.693+0000 7f7ed356d640 1 -- 172.21.15.90:0/1866121066 >> 172.21.15.90:0/1866121066 conn(0x7f7ecc0c9100 msgr2=0x7f7ecc0c94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.693+0000 7f7ed356d640 1 -- 172.21.15.90:0/1866121066 shutdown_connections 2024-04-20T11:00:38.698 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.693+0000 7f7ed356d640 1 -- 172.21.15.90:0/1866121066 wait complete. 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.694+0000 7f7ed356d640 1 Processor -- start 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.694+0000 7f7ed356d640 1 -- start start 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed356d640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb80039b0 0x7f7ecc157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed356d640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ecc151dd0 0x7f7ecc1efb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed356d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ecc1f0070 0x7f7ecc0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed356d640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc0c2b80 con 0x7f7ecc1f0070 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed356d640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f7ecc06f510 con 0x7f7eb80039b0 2024-04-20T11:00:38.701 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed356d640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f7ecc0c2d00 con 0x7f7ecc151dd0 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ecc1f0070 0x7f7ecc0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ecc1f0070 0x7f7ecc0c37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57506/0 (socket says 172.21.15.90:57506) 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 -- 172.21.15.90:0/2027091061 learned_addr learned my addr 172.21.15.90:0/2027091061 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 -- 172.21.15.90:0/2027091061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ecc151dd0 msgr2=0x7f7ecc1efb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ecc151dd0 0x7f7ecc1efb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 -- 172.21.15.90:0/2027091061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb80039b0 msgr2=0x7f7ecc157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb80039b0 0x7f7ecc157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 -- 172.21.15.90:0/2027091061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ecc152ac0 con 0x7f7ecc1f0070 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed1b0a640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ecc1f0070 0x7f7ecc0c37f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8000c00 tx=0x7f7ec800e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ec1ffb640 1 -- 172.21.15.90:0/2027091061 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8019070 con 0x7f7ecc1f0070 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ec1ffb640 1 -- 172.21.15.90:0/2027091061 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7ec80105d0 con 0x7f7ecc1f0070 2024-04-20T11:00:38.702 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ecc152da0 con 0x7f7ecc1f0070 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.695+0000 7f7ec1ffb640 1 -- 172.21.15.90:0/2027091061 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec80109e0 con 0x7f7ecc1f0070 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.696+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ecc151180 con 0x7f7ecc1f0070 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.697+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ecc076150 con 0x7f7ecc1f0070 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.697+0000 7f7ec1ffb640 1 -- 172.21.15.90:0/2027091061 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ec801c070 con 0x7f7ecc1f0070 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.697+0000 7f7ec1ffb640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7eb006c8f0 0x7f7eb006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.698+0000 7f7ec1ffb640 1 -- 172.21.15.90:0/2027091061 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6721+0+0 (secure 0 0 0) 0x7f7ec808b390 con 0x7f7ecc1f0070 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.698+0000 7f7ed1309640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7eb006c8f0 0x7f7eb006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.698+0000 7f7ed1309640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7eb006c8f0 0x7f7eb006edb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4034000 tx=0x7f7ec4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.703 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.702+0000 7f7ec1ffb640 1 -- 172.21.15.90:0/2027091061 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f7ec80593c0 con 0x7f7ecc1f0070 2024-04-20T11:00:38.878 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.878+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7ecc0c52b0 con 0x7f7ecc1f0070 2024-04-20T11:00:38.879 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.879+0000 7f7ec1ffb640 1 -- 172.21.15.90:0/2027091061 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) ==== 74+0+18210 (secure 0 0 0) 0x7f7ec8082e20 con 0x7f7ecc1f0070 2024-04-20T11:00:38.880 INFO:teuthology.orchestra.run.smithi090.stdout: 2024-04-20T11:00:38.880 INFO:teuthology.orchestra.run.smithi090.stdout:{"epoch":41,"fsid":"83e3b3ee-e6e4-4f45-b43d-6f394df1aa3c","created":"2024-04-20T10:50:15.512973+0000","modified":"2024-04-20T11:00:37.895430+0000","last_up_change":"2024-04-20T10:50:26.505979+0000","last_in_change":"2024-04-20T10:50:17.657215+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-20T10:50:27.678230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"b_metadata","create_time":"2024-04-20T10:50:46.703661+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"b_data","create_time":"2024-04-20T10:50:47.935403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"b"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a07588d6-ff96-4dbd-8b92-3610a5577245","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6800","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6801","nonce":1699315385}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6802","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6803","nonce":1699315385}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6806","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6807","nonce":1699315385}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6804","nonce":1699315385},{"type":"v1","addr":"172.21.15.90:6805","nonce":1699315385}]},"public_addr":"172.21.15.90:6801/1699315385","cluster_addr":"172.21.15.90:6803/1699315385","heartbeat_back_addr":"172.21.15.90:6807/1699315385","heartbeat_front_addr":"172.21.15.90:6805/1699315385","state":["exists","up"]},{"osd":1,"uuid":"42a8c936-eb5c-49d3-867f-e693d91be8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6824","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6825","nonce":1234006559}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6826","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6827","nonce":1234006559}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6830","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6831","nonce":1234006559}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6828","nonce":1234006559},{"type":"v1","addr":"172.21.15.90:6829","nonce":1234006559}]},"public_addr":"172.21.15.90:6825/1234006559","cluster_addr":"172.21.15.90:6827/1234006559","heartbeat_back_addr":"172.21.15.90:6831/1234006559","heartbeat_front_addr":"172.21.15.90:6829/1234006559","state":["exists","up"]},{"osd":2,"uuid":"1e9b2774-f6ee-468d-82ea-d8a62711c355","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6816","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6817","nonce":460939980}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6818","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6819","nonce":460939980}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6822","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6823","nonce":460939980}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6820","nonce":460939980},{"type":"v1","addr":"172.21.15.90:6821","nonce":460939980}]},"public_addr":"172.21.15.90:6817/460939980","cluster_addr":"172.21.15.90:6819/460939980","heartbeat_back_addr":"172.21.15.90:6823/460939980","heartbeat_front_addr":"172.21.15.90:6821/460939980","state":["exists","up"]},{"osd":3,"uuid":"1dc528a5-b13b-4300-8ca4-8bc6af207152","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6808","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6809","nonce":3826442785}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6810","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6811","nonce":3826442785}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6814","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6815","nonce":3826442785}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.90:6812","nonce":3826442785},{"type":"v1","addr":"172.21.15.90:6813","nonce":3826442785}]},"public_addr":"172.21.15.90:6809/3826442785","cluster_addr":"172.21.15.90:6811/3826442785","heartbeat_back_addr":"172.21.15.90:6815/3826442785","heartbeat_front_addr":"172.21.15.90:6813/3826442785","state":["exists","up"]},{"osd":4,"uuid":"6acb3675-3d74-4153-974e-346ad3ab5b8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6800","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6801","nonce":1431656962}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6802","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6803","nonce":1431656962}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6806","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6807","nonce":1431656962}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6804","nonce":1431656962},{"type":"v1","addr":"172.21.15.175:6805","nonce":1431656962}]},"public_addr":"172.21.15.175:6801/1431656962","cluster_addr":"172.21.15.175:6803/1431656962","heartbeat_back_addr":"172.21.15.175:6807/1431656962","heartbeat_front_addr":"172.21.15.175:6805/1431656962","state":["exists","up"]},{"osd":5,"uuid":"35d2c8ae-cec8-4953-944c-85613e117aac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6824","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6825","nonce":1056337988}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6826","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6827","nonce":1056337988}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6830","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6831","nonce":1056337988}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6828","nonce":1056337988},{"type":"v1","addr":"172.21.15.175:6829","nonce":1056337988}]},"public_addr":"172.21.15.175:6825/1056337988","cluster_addr":"172.21.15.175:6827/1056337988","heartbeat_back_addr":"172.21.15.175:6831/1056337988","heartbeat_front_addr":"172.21.15.175:6829/1056337988","state":["exists","up"]},{"osd":6,"uuid":"49788201-a1e7-4a1b-830c-2f68b8d70636","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6816","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6817","nonce":3312370671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6818","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6819","nonce":3312370671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6822","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6823","nonce":3312370671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6820","nonce":3312370671},{"type":"v1","addr":"172.21.15.175:6821","nonce":3312370671}]},"public_addr":"172.21.15.175:6817/3312370671","cluster_addr":"172.21.15.175:6819/3312370671","heartbeat_back_addr":"172.21.15.175:6823/3312370671","heartbeat_front_addr":"172.21.15.175:6821/3312370671","state":["exists","up"]},{"osd":7,"uuid":"8e6f132c-266c-43ef-890e-c25373f724e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6808","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6809","nonce":2312344703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6810","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6811","nonce":2312344703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6814","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6815","nonce":2312344703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.175:6812","nonce":2312344703},{"type":"v1","addr":"172.21.15.175:6813","nonce":2312344703}]},"public_addr":"172.21.15.175:6809/2312344703","cluster_addr":"172.21.15.175:6811/2312344703","heartbeat_back_addr":"172.21.15.175:6815/2312344703","heartbeat_front_addr":"172.21.15.175:6813/2312344703","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.770127+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.799135+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.858283+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.823306+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.837433+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.788615+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.781292+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-20T10:50:22.747881+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.90:6837/1253561572":"2024-04-21T11:00:34.878181+0000","172.21.15.90:6834/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6833/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6836/1253561572":"2024-04-21T11:00:34.878181+0000","172.21.15.90:6835/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.175:6833/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.90:6835/3994531378":"2024-04-21T10:59:20.376156+0000","172.21.15.175:6834/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6837/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.90:6837/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.90:6835/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.175:6835/2994051895":"2024-04-21T10:52:40.317797+0000","172.21.15.90:6836/1538296646":"2024-04-21T10:55:30.341595+0000","172.21.15.90:6836/3822230008":"2024-04-21T10:52:41.327372+0000","172.21.15.175:6832/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6836/597803483":"2024-04-21T10:57:50.361461+0000","172.21.15.175:6832/133567489":"2024-04-21T10:56:05.346704+0000","172.21.15.175:6833/1855171726":"2024-04-21T10:54:15.330938+0000","172.21.15.90:6834/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.175:6832/3798454731":"2024-04-21T10:59:10.374554+0000","172.21.15.90:6835/4126797977":"2024-04-21T10:54:50.335879+0000","172.21.15.90:6834/732131803":"2024-04-21T10:56:45.352698+0000","172.21.15.90:6834/1834995897":"2024-04-21T10:53:35.325514+0000","172.21.15.90:6837/1538296646":"2024-04-21T10:55:30.341595+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-20T11:00:38.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.881+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7eb006c8f0 msgr2=0x7f7eb006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.881+0000 7f7ed356d640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7eb006c8f0 0x7f7eb006edb0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4034000 tx=0x7f7ec4030000 comp rx=0 tx=0).stop 2024-04-20T11:00:38.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.881+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ecc1f0070 msgr2=0x7f7ecc0c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.881+0000 7f7ed356d640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ecc1f0070 0x7f7ecc0c37f0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8000c00 tx=0x7f7ec800e960 comp rx=0 tx=0).stop 2024-04-20T11:00:38.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 shutdown_connections 2024-04-20T11:00:38.882 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f7eb006c8f0 0x7f7eb006edb0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f7ecc1f0070 0x7f7ecc0c37f0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f7ecc151dd0 0x7f7ecc1efb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 --2- 172.21.15.90:0/2027091061 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f7eb80039b0 0x7f7ecc157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 >> 172.21.15.90:0/2027091061 conn(0x7f7ecc0c9100 msgr2=0x7f7ecc14cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:38.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 shutdown_connections 2024-04-20T11:00:38.883 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.882+0000 7f7ed356d640 1 -- 172.21.15.90:0/2027091061 wait complete. 2024-04-20T11:00:38.893 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail b 2024-04-20T11:00:38.990 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.990+0000 7f97d54b2640 1 Processor -- start 2024-04-20T11:00:38.991 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.990+0000 7f97d54b2640 1 -- start start 2024-04-20T11:00:38.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97d54b2640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f97d006d120 0x7f97d0156a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97d54b2640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7f97d00c8c90 0x7f97d0150460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97d54b2640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97d00c9410 con 0x7f97d00c6e70 2024-04-20T11:00:38.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97d54b2640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7f97d006c580 con 0x7f97d006d120 2024-04-20T11:00:38.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97d54b2640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7f97d00c9c30 con 0x7f97d00c8c90 2024-04-20T11:00:38.992 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97ce7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f97d006d120 0x7f97d0156a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97ce7fc640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7f97d006d120 0x7f97d0156a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57522/0 (socket says 172.21.15.90:57522) 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97ce7fc640 1 -- 172.21.15.90:0/3397118320 learned_addr learned my addr 172.21.15.90:0/3397118320 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97cf7fe640 1 --2- 172.21.15.90:0/3397118320 >> v2:172.21.15.175:3300/0 conn(0x7f97d00c8c90 0x7f97d0150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97ce7fc640 1 -- 172.21.15.90:0/3397118320 >> v2:172.21.15.175:3300/0 conn(0x7f97d00c8c90 msgr2=0x7f97d0150460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97ce7fc640 1 --2- 172.21.15.90:0/3397118320 >> v2:172.21.15.175:3300/0 conn(0x7f97d00c8c90 0x7f97d0150460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97ce7fc640 1 -- 172.21.15.90:0/3397118320 >> v1:172.21.15.175:6789/0 conn(0x7f97d00c6e70 legacy=0x7f97d006ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.991+0000 7f97ce7fc640 1 -- 172.21.15.90:0/3397118320 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d00c96b0 con 0x7f97d006d120 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.992+0000 7f97ce7fc640 1 --2- 172.21.15.90:0/3397118320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d006d120 0x7f97d0156a50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f97d006c700 tx=0x7f97c402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65833f0d8135d2c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.992+0000 7f97cdffb640 1 -- 172.21.15.90:0/3397118320 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c402e070 con 0x7f97d006d120 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.992+0000 7f97cdffb640 1 -- 172.21.15.90:0/3397118320 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f97c4037070 con 0x7f97d006d120 2024-04-20T11:00:38.993 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.992+0000 7f97cdffb640 1 -- 172.21.15.90:0/3397118320 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4031a20 con 0x7f97d006d120 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 -- 172.21.15.90:0/3397118320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d006d120 msgr2=0x7f97d0156a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 --2- 172.21.15.90:0/3397118320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d006d120 0x7f97d0156a50 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f97d006c700 tx=0x7f97c402b880 comp rx=0 tx=0).stop 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 -- 172.21.15.90:0/3397118320 shutdown_connections 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 --2- 172.21.15.90:0/3397118320 >> v2:172.21.15.175:3300/0 conn(0x7f97d00c8c90 0x7f97d0150460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 --2- 172.21.15.90:0/3397118320 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d006d120 0x7f97d0156a50 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 -- 172.21.15.90:0/3397118320 >> 172.21.15.90:0/3397118320 conn(0x7f97d00addb0 msgr2=0x7f97d00ae1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 -- 172.21.15.90:0/3397118320 shutdown_connections 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.993+0000 7f97d54b2640 1 -- 172.21.15.90:0/3397118320 wait complete. 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.994+0000 7f97d54b2640 1 Processor -- start 2024-04-20T11:00:38.996 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.994+0000 7f97d54b2640 1 -- start start 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97d006d120 0x7f97d01593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00c6e70 0x7f97d0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97d00c8c90 0x7f97d01e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f97d00ca3a0 con 0x7f97d00c6e70 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f97d00c9100 con 0x7f97d00c8c90 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f97d00ca520 con 0x7f97d006d120 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00c6e70 0x7f97d0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00c6e70 0x7f97d0157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57538/0 (socket says 172.21.15.90:57538) 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 -- 172.21.15.90:0/1494280758 learned_addr learned my addr 172.21.15.90:0/1494280758 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 -- 172.21.15.90:0/1494280758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97d006d120 msgr2=0x7f97d01593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97d006d120 0x7f97d01593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 -- 172.21.15.90:0/1494280758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97d00c8c90 msgr2=0x7f97d01e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:38.997 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97d00c8c90 0x7f97d01e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:38.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 -- 172.21.15.90:0/1494280758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97d01584c0 con 0x7f97d00c6e70 2024-04-20T11:00:38.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97ce7fc640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00c6e70 0x7f97d0157c70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f97c402b8c0 tx=0x7f97c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:38.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97b77fe640 1 -- 172.21.15.90:0/1494280758 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4032880 con 0x7f97d00c6e70 2024-04-20T11:00:38.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97b77fe640 1 -- 172.21.15.90:0/1494280758 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f97c4032a40 con 0x7f97d00c6e70 2024-04-20T11:00:38.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97d01587a0 con 0x7f97d00c6e70 2024-04-20T11:00:38.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97b77fe640 1 -- 172.21.15.90:0/1494280758 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4032e50 con 0x7f97d00c6e70 2024-04-20T11:00:38.998 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.995+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97d0158d60 con 0x7f97d00c6e70 2024-04-20T11:00:38.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.996+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97d0076150 con 0x7f97d00c6e70 2024-04-20T11:00:38.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.997+0000 7f97b77fe640 1 -- 172.21.15.90:0/1494280758 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f97c404c060 con 0x7f97d00c6e70 2024-04-20T11:00:38.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.997+0000 7f97b77fe640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97bc06ca90 0x7f97bc06ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:38.999 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.997+0000 7f97b77fe640 1 -- 172.21.15.90:0/1494280758 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 6721+0+0 (secure 0 0 0) 0x7f97c40adac0 con 0x7f97d00c6e70 2024-04-20T11:00:39.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.997+0000 7f97ceffd640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97bc06ca90 0x7f97bc06ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:39.000 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:38.998+0000 7f97ceffd640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97bc06ca90 0x7f97bc06ef50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f97c00043c0 tx=0x7f97c0007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:39.001 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.001+0000 7f97b77fe640 1 -- 172.21.15.90:0/1494280758 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f97c4040070 con 0x7f97d00c6e70 2024-04-20T11:00:39.214 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.214+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "b"} v 0) -- 0x7f97d00ca180 con 0x7f97d00c6e70 2024-04-20T11:00:39.221 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.221+0000 7f97b77fe640 1 -- 172.21.15.90:0/1494280758 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "b"}]=0 b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v76) ==== 151+0+0 (secure 0 0 0) 0x7f97c407baf0 con 0x7f97d00c6e70 2024-04-20T11:00:39.223 INFO:teuthology.orchestra.run.smithi090.stderr:b marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-20T11:00:39.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97bc06ca90 msgr2=0x7f97bc06ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97bc06ca90 0x7f97bc06ef50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f97c00043c0 tx=0x7f97c0007d30 comp rx=0 tx=0).stop 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00c6e70 msgr2=0x7f97d0157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00c6e70 0x7f97d0157c70 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f97c402b8c0 tx=0x7f97c40046c0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 shutdown_connections 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f97bc06ca90 0x7f97bc06ef50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f97d00c8c90 0x7f97d01e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f97d00c6e70 0x7f97d0157c70 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 --2- 172.21.15.90:0/1494280758 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f97d006d120 0x7f97d01593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.229+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 >> 172.21.15.90:0/1494280758 conn(0x7f97d00addb0 msgr2=0x7f97d00cbb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.230+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 shutdown_connections 2024-04-20T11:00:39.230 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.230+0000 7f97d54b2640 1 -- 172.21.15.90:0/1494280758 wait complete. 2024-04-20T11:00:39.238 INFO:tasks.ceph.mds.d.smithi175.stderr: -3755> 2024-04-20T10:59:30.928+0000 7f8691dbd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-20T11:00:39.244 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm b --yes-i-really-mean-it 2024-04-20T11:00:39.270 INFO:tasks.ceph.mds.d.smithi175.stdout:starting mds.d at 2024-04-20T11:00:39.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.343+0000 7ff332bb6640 1 Processor -- start 2024-04-20T11:00:39.343 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.343+0000 7ff332bb6640 1 -- start start 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff332bb6640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff32c157710 0x7ff32c154000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff332bb6640 1 --2- >> v2:172.21.15.175:3300/0 conn(0x7ff32c0ad0c0 0x7ff32c0ad550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff332bb6640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff32c0c4370 con 0x7ff32c073810 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff332bb6640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c1569e0 con 0x7ff32c157710 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff332bb6640 1 -- --> v2:172.21.15.175:3300/0 -- mon_getmap magic: 0 -- 0x7ff32c157280 con 0x7ff32c0ad0c0 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff323fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff32c157710 0x7ff32c154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff323fff640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7ff32c157710 0x7ff32c154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57546/0 (socket says 172.21.15.90:57546) 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff323fff640 1 -- 172.21.15.90:0/46691164 learned_addr learned my addr 172.21.15.90:0/46691164 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff331153640 1 --2- 172.21.15.90:0/46691164 >> v2:172.21.15.175:3300/0 conn(0x7ff32c0ad0c0 0x7ff32c0ad550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:39.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff323fff640 1 -- 172.21.15.90:0/46691164 >> v2:172.21.15.175:3300/0 conn(0x7ff32c0ad0c0 msgr2=0x7ff32c0ad550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff323fff640 1 --2- 172.21.15.90:0/46691164 >> v2:172.21.15.175:3300/0 conn(0x7ff32c0ad0c0 0x7ff32c0ad550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff323fff640 1 -- 172.21.15.90:0/46691164 >> v1:172.21.15.175:6789/0 conn(0x7ff32c073810 legacy=0x7ff32c0c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff323fff640 1 -- 172.21.15.90:0/46691164 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c156c30 con 0x7ff32c157710 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.344+0000 7ff331153640 1 --2- 172.21.15.90:0/46691164 >> v2:172.21.15.175:3300/0 conn(0x7ff32c0ad0c0 0x7ff32c0ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff323fff640 1 --2- 172.21.15.90:0/46691164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c157710 0x7ff32c154000 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff32c070a90 tx=0x7ff31c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58985b9b12ec2d47 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff3237fe640 1 -- 172.21.15.90:0/46691164 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c035020 con 0x7ff32c157710 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff3237fe640 1 -- 172.21.15.90:0/46691164 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff31c031870 con 0x7ff32c157710 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff3237fe640 1 -- 172.21.15.90:0/46691164 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff31c031c60 con 0x7ff32c157710 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff332bb6640 1 -- 172.21.15.90:0/46691164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c157710 msgr2=0x7ff32c154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff332bb6640 1 --2- 172.21.15.90:0/46691164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c157710 0x7ff32c154000 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7ff32c070a90 tx=0x7ff31c02b910 comp rx=0 tx=0).stop 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff332bb6640 1 -- 172.21.15.90:0/46691164 shutdown_connections 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff332bb6640 1 --2- 172.21.15.90:0/46691164 >> v2:172.21.15.175:3300/0 conn(0x7ff32c0ad0c0 0x7ff32c0ad550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff332bb6640 1 --2- 172.21.15.90:0/46691164 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c157710 0x7ff32c154000 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.345+0000 7ff332bb6640 1 -- 172.21.15.90:0/46691164 >> 172.21.15.90:0/46691164 conn(0x7ff32c0c8080 msgr2=0x7ff32c0c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:39.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.346+0000 7ff332bb6640 1 -- 172.21.15.90:0/46691164 shutdown_connections 2024-04-20T11:00:39.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.346+0000 7ff332bb6640 1 -- 172.21.15.90:0/46691164 wait complete. 2024-04-20T11:00:39.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 Processor -- start 2024-04-20T11:00:39.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 -- start start 2024-04-20T11:00:39.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c073810 0x7ff32c1f0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:39.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff32c0ad0c0 0x7ff32c0c1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:39.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c157710 0x7ff32c0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:39.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c0abbb0 con 0x7ff32c073810 2024-04-20T11:00:39.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7ff32c073bf0 con 0x7ff32c157710 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff332bb6640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7ff32c0abd30 con 0x7ff32c0ad0c0 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.347+0000 7ff330952640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c073810 0x7ff32c1f0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c073810 0x7ff32c1f0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57556/0 (socket says 172.21.15.90:57556) 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 -- 172.21.15.90:0/2662567329 learned_addr learned my addr 172.21.15.90:0/2662567329 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff323fff640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff32c0ad0c0 0x7ff32c0c1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff331153640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c157710 0x7ff32c0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 -- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff32c0ad0c0 msgr2=0x7ff32c0c1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff32c0ad0c0 0x7ff32c0c1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 -- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c157710 msgr2=0x7ff32c0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c157710 0x7ff32c0717e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 -- 172.21.15.90:0/2662567329 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32c1f07c0 con 0x7ff32c073810 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff330952640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c073810 0x7ff32c1f0280 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c430 tx=0x7ff32800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff3217fa640 1 -- 172.21.15.90:0/2662567329 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3280052d0 con 0x7ff32c073810 2024-04-20T11:00:39.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff3217fa640 1 -- 172.21.15.90:0/2662567329 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff328005490 con 0x7ff32c073810 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff3217fa640 1 -- 172.21.15.90:0/2662567329 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff328007280 con 0x7ff32c073810 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff32c072930 con 0x7ff32c073810 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.348+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff32c072ef0 con 0x7ff32c073810 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.349+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32c076150 con 0x7ff32c073810 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.349+0000 7ff3217fa640 1 -- 172.21.15.90:0/2662567329 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff328007420 con 0x7ff32c073810 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.350+0000 7ff3217fa640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff31806c920 0x7ff31806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.350+0000 7ff3217fa640 1 -- 172.21.15.90:0/2662567329 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6807+0+0 (secure 0 0 0) 0x7ff32808b470 con 0x7ff32c073810 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.350+0000 7ff323fff640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff31806c920 0x7ff31806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:39.352 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.350+0000 7ff323fff640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff31806c920 0x7ff31806ede0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff31c036000 tx=0x7ff31c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:39.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.354+0000 7ff3217fa640 1 -- 172.21.15.90:0/2662567329 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7ff32c1f07c0 con 0x7ff32c073810 2024-04-20T11:00:39.564 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:39.564+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true} v 0) -- 0x7ff32c150cc0 con 0x7ff32c073810 2024-04-20T11:00:40.229 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.229+0000 7ff3217fa640 1 -- 172.21.15.90:0/2662567329 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "b", "yes_i_really_mean_it": true}]=0 v77) ==== 99+0+0 (secure 0 0 0) 0x7ff3280594e0 con 0x7ff32c073810 2024-04-20T11:00:40.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff31806c920 msgr2=0x7ff31806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:40.232 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff31806c920 0x7ff31806ede0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7ff31c036000 tx=0x7ff31c03c040 comp rx=0 tx=0).stop 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c073810 msgr2=0x7ff32c1f0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c073810 0x7ff32c1f0280 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c430 tx=0x7ff32800c8f0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 shutdown_connections 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7ff31806c920 0x7ff31806ede0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7ff32c157710 0x7ff32c0717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7ff32c0ad0c0 0x7ff32c0c1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 --2- 172.21.15.90:0/2662567329 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7ff32c073810 0x7ff32c1f0280 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 >> 172.21.15.90:0/2662567329 conn(0x7ff32c0c8080 msgr2=0x7ff32c1561c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 shutdown_connections 2024-04-20T11:00:40.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.232+0000 7ff332bb6640 1 -- 172.21.15.90:0/2662567329 wait complete. 2024-04-20T11:00:40.245 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_metadata b_metadata --yes-i-really-really-mean-it 2024-04-20T11:00:40.346 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.346+0000 7fa10cfa4640 1 Processor -- start 2024-04-20T11:00:40.347 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.346+0000 7fa10cfa4640 1 -- start start 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10cfa4640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa108153ed0 0x7fa1081567f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10cfa4640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa108157760 con 0x7fa1080c2770 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10cfa4640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1080c8920 con 0x7fa1080c1ef0 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10cfa4640 1 -- --> v2:172.21.15.90:3300/0 -- mon_getmap magic: 0 -- 0x7fa1081542b0 con 0x7fa108153ed0 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa108153ed0 0x7fa1081567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10659c640 1 --2- >> v2:172.21.15.90:3300/0 conn(0x7fa108153ed0 0x7fa1081567f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57566/0 (socket says 172.21.15.90:57566) 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10659c640 1 -- 172.21.15.90:0/193185553 learned_addr learned my addr 172.21.15.90:0/193185553 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10659c640 1 -- 172.21.15.90:0/193185553 >> v1:172.21.15.175:6789/0 conn(0x7fa1080c1ef0 legacy=0x7fa108161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10659c640 1 -- 172.21.15.90:0/193185553 >> v1:172.21.15.90:6789/0 conn(0x7fa1080c2770 legacy=0x7fa10806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10659c640 1 -- 172.21.15.90:0/193185553 --> v2:172.21.15.90:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa108157480 con 0x7fa108153ed0 2024-04-20T11:00:40.348 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.347+0000 7fa10559a640 1 -- 172.21.15.90:0/193185553 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372057714 0 0) 0x7fa108157760 con 0x7fa1080c2770 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.348+0000 7fa10659c640 1 --2- 172.21.15.90:0/193185553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa1081567f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009870 tx=0x7fa0f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c390e935af61ced server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.348+0000 7fa10559a640 1 -- 172.21.15.90:0/193185553 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f802e070 con 0x7fa108153ed0 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.348+0000 7fa10559a640 1 -- 172.21.15.90:0/193185553 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa0f8037070 con 0x7fa108153ed0 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.348+0000 7fa10559a640 1 -- 172.21.15.90:0/193185553 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0f8031a20 con 0x7fa108153ed0 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.349+0000 7fa10cfa4640 1 -- 172.21.15.90:0/193185553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 msgr2=0x7fa1081567f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.349+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/193185553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa1081567f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009870 tx=0x7fa0f802b880 comp rx=0 tx=0).stop 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.349+0000 7fa10cfa4640 1 -- 172.21.15.90:0/193185553 shutdown_connections 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.349+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/193185553 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa1081567f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.350 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.349+0000 7fa10cfa4640 1 -- 172.21.15.90:0/193185553 >> 172.21.15.90:0/193185553 conn(0x7fa10806b930 msgr2=0x7fa10806bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:40.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.349+0000 7fa10cfa4640 1 -- 172.21.15.90:0/193185553 shutdown_connections 2024-04-20T11:00:40.351 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.349+0000 7fa10cfa4640 1 -- 172.21.15.90:0/193185553 wait complete. 2024-04-20T11:00:40.353 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.350+0000 7fa10cfa4640 1 Processor -- start 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.350+0000 7fa10cfa4640 1 -- start start 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa10cfa4640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1080c1ef0 0x7fa1080731a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa10cfa4640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1080c2770 0x7fa108155920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa10cfa4640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa10814bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa10cfa4640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7fa108156d30 con 0x7fa108153ed0 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa10cfa4640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7fa1080c8c50 con 0x7fa1080c2770 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa10cfa4640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7fa108156eb0 con 0x7fa1080c1ef0 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa10814bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa10814bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57578/0 (socket says 172.21.15.90:57578) 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 -- 172.21.15.90:0/2259324232 learned_addr learned my addr 172.21.15.90:0/2259324232 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa10659c640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1080c1ef0 0x7fa1080731a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:40.354 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 -- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1080c1ef0 msgr2=0x7fa1080731a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1080c1ef0 0x7fa1080731a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa105d9b640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1080c2770 0x7fa108155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 -- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1080c2770 msgr2=0x7fa108155920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1080c2770 0x7fa108155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.351+0000 7fa106d9d640 1 -- 172.21.15.90:0/2259324232 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa108073780 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.352+0000 7fa106d9d640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa10814bcc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c780 tx=0x7fa10000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.352+0000 7fa0f6ffd640 1 -- 172.21.15.90:0/2259324232 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa100017070 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.352+0000 7fa0f6ffd640 1 -- 172.21.15.90:0/2259324232 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fa100003da0 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.352+0000 7fa0f6ffd640 1 -- 172.21.15.90:0/2259324232 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1000052d0 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.352+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa108157ce0 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.352+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1081582a0 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.353+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1080761f0 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.353+0000 7fa0f6ffd640 1 -- 172.21.15.90:0/2259324232 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa10001a070 con 0x7fa108153ed0 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.353+0000 7fa0f6ffd640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa0e806c920 0x7fa0e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:40.355 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.354+0000 7fa0f6ffd640 1 -- 172.21.15.90:0/2259324232 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 6807+0+0 (secure 0 0 0) 0x7fa10008b540 con 0x7fa108153ed0 2024-04-20T11:00:40.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.354+0000 7fa10659c640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa0e806c920 0x7fa0e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:40.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.354+0000 7fa10659c640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa0e806c920 0x7fa0e806ede0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8036000 tx=0x7fa0f8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:40.358 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.358+0000 7fa0f6ffd640 1 -- 172.21.15.90:0/2259324232 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7fa1000595b0 con 0x7fa108153ed0 2024-04-20T11:00:40.532 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:40.532+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa1081534b0 con 0x7fa108153ed0 2024-04-20T11:00:41.231 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.230+0000 7fa0f6ffd640 1 -- 172.21.15.90:0/2259324232 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_metadata", "pool2": "b_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'b_metadata' removed v43) ==== 166+0+0 (secure 0 0 0) 0x7fa100058eb0 con 0x7fa108153ed0 2024-04-20T11:00:41.231 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_metadata' removed 2024-04-20T11:00:41.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa0e806c920 msgr2=0x7fa0e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:41.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa0e806c920 0x7fa0e806ede0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8036000 tx=0x7fa0f8008030 comp rx=0 tx=0).stop 2024-04-20T11:00:41.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 msgr2=0x7fa10814bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:41.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa10814bcc0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fa10000c780 tx=0x7fa10000cc40 comp rx=0 tx=0).stop 2024-04-20T11:00:41.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 shutdown_connections 2024-04-20T11:00:41.233 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7fa0e806c920 0x7fa0e806ede0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7fa108153ed0 0x7fa10814bcc0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7fa1080c2770 0x7fa108155920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 --2- 172.21.15.90:0/2259324232 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7fa1080c1ef0 0x7fa1080731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 >> 172.21.15.90:0/2259324232 conn(0x7fa10806b930 msgr2=0x7fa10806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:41.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 shutdown_connections 2024-04-20T11:00:41.234 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.233+0000 7fa10cfa4640 1 -- 172.21.15.90:0/2259324232 wait complete. 2024-04-20T11:00:41.251 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm b_data b_data --yes-i-really-really-mean-it 2024-04-20T11:00:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.356+0000 7f5987bd5640 1 Processor -- start 2024-04-20T11:00:41.356 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.356+0000 7f5987bd5640 1 -- start start 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f5987bd5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 0x7f598015eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f5987bd5640 1 -- --> v1:172.21.15.90:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59800ac2b0 con 0x7f5980150a20 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f5987bd5640 1 -- --> v1:172.21.15.175:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5980153e90 con 0x7f59800ab680 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f5987bd5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f5980154450 con 0x7f59800c2910 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f5985971640 1 --1- >> v1:172.21.15.90:6789/0 conn(0x7f5980150a20 0x7f59800aca70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.90:6789/0 says I am v1:172.21.15.90:54170/0 (socket says 172.21.15.90:54170) 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f5985971640 1 -- 172.21.15.90:0/672242203 learned_addr learned my addr 172.21.15.90:0/672242203 (peer_addr_for_me v1:172.21.15.90:0/0) 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 <== mon.0 v1:172.21.15.90:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102733984 0 0) 0x7f59800ac2b0 con 0x7f5980150a20 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f5986172640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 0x7f598015eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.359 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 --> v1:172.21.15.90:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5968003520 con 0x7f5980150a20 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 <== mon.0 v1:172.21.15.90:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2726310229 0 0) 0x7f5968003520 con 0x7f5980150a20 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 msgr2=0x7f598015eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 0x7f598015eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 >> v1:172.21.15.175:6789/0 conn(0x7f59800ab680 legacy=0x7f59800ad4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 --> v1:172.21.15.90:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5980154170 con 0x7f5980150a20 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.357+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 <== mon.0 v1:172.21.15.90:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3986443833 0 0) 0x7f59780019f0 con 0x7f5980150a20 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 >> v1:172.21.15.90:6789/0 conn(0x7f5980150a20 legacy=0x7f59800aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f598496f640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59680039e0 0x7f5968003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f598496f640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5968004800 0x7f5968004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f598496f640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 0x7f5968005200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f5980154450 con 0x7f59680039e0 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f596800baf0 con 0x7f5968004800 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f596800bcf0 con 0x7f59800c2910 2024-04-20T11:00:41.360 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985971640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59680039e0 0x7f5968003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985170640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5968004800 0x7f5968004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5986172640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 0x7f5968005200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985971640 1 -- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 msgr2=0x7f5968005200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985971640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f59800c2910 0x7f5968005200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985971640 1 -- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5968004800 msgr2=0x7f5968004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985971640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5968004800 0x7f5968004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985971640 1 -- 172.21.15.90:0/672242203 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5968003520 con 0x7f59680039e0 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.358+0000 7f5985170640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f5968004800 0x7f5968004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5985971640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59680039e0 0x7f5968003e00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f597800a860 tx=0x7f5968005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea85c8d640880af server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f597800a480 con 0x7f59680039e0 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5978034630 con 0x7f59680039e0 2024-04-20T11:00:41.361 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f598496f640 1 -- 172.21.15.90:0/672242203 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5978034a80 con 0x7f59680039e0 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5987bd5640 1 -- 172.21.15.90:0/672242203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59680039e0 msgr2=0x7f5968003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5987bd5640 1 --2- 172.21.15.90:0/672242203 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59680039e0 0x7f5968003e00 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f597800a860 tx=0x7f5968005830 comp rx=0 tx=0).stop 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5986172640 1 -- 172.21.15.90:0/672242203 reap_dead start 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5987bd5640 1 -- 172.21.15.90:0/672242203 shutdown_connections 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5987bd5640 1 -- 172.21.15.90:0/672242203 >> 172.21.15.90:0/672242203 conn(0x7f59800c7f10 msgr2=0x7f59800c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5987bd5640 1 -- 172.21.15.90:0/672242203 shutdown_connections 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.359+0000 7f5987bd5640 1 -- 172.21.15.90:0/672242203 wait complete. 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.360+0000 7f5987bd5640 1 Processor -- start 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5987bd5640 1 -- start start 2024-04-20T11:00:41.365 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5987bd5640 1 --2- >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59680039e0 0x7f5980156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5987bd5640 1 --2- >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5980149960 0x7f5980072890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5987bd5640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59801ef9c0 0x7f59801efe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5987bd5640 1 -- --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_getmap magic: 0 -- 0x7f59800c2da0 con 0x7f59801ef9c0 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5987bd5640 1 -- --> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] -- mon_getmap magic: 0 -- 0x7f59800ac5e0 con 0x7f59680039e0 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5987bd5640 1 -- --> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] -- mon_getmap magic: 0 -- 0x7f59800ae0f0 con 0x7f5980149960 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5986172640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59801ef9c0 0x7f59801efe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5986172640 1 --2- >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59801ef9c0 0x7f59801efe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.90:3300/0 says I am v2:172.21.15.90:57606/0 (socket says 172.21.15.90:57606) 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5986172640 1 -- 172.21.15.90:0/3415499799 learned_addr learned my addr 172.21.15.90:0/3415499799 (peer_addr_for_me v2:172.21.15.90:0/0) 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5985170640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5980149960 0x7f5980072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5985971640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59680039e0 0x7f5980156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5986172640 1 -- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5980149960 msgr2=0x7f5980072890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5986172640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5980149960 0x7f5980072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.366 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.361+0000 7f5986172640 1 -- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59680039e0 msgr2=0x7f5980156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f5986172640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59680039e0 0x7f5980156ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f5986172640 1 -- 172.21.15.90:0/3415499799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59800c5ba0 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f5986172640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59801ef9c0 0x7f59801efe40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5970011490 tx=0x7f5970011950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f597e7fc640 1 -- 172.21.15.90:0/3415499799 <== mon.0 v2:172.21.15.90:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970019020 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f597e7fc640 1 -- 172.21.15.90:0/3415499799 <== mon.0 v2:172.21.15.90:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5970003610 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59801572d0 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f597e7fc640 1 -- 172.21.15.90:0/3415499799 <== mon.0 v2:172.21.15.90:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5970003a20 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.362+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59801f0380 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.363+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59800761f0 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.363+0000 7f597e7fc640 1 -- 172.21.15.90:0/3415499799 <== mon.0 v2:172.21.15.90:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f597001c020 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.364+0000 7f597e7fc640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f596c06c8f0 0x7f596c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.364+0000 7f597e7fc640 1 -- 172.21.15.90:0/3415499799 <== mon.0 v2:172.21.15.90:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6379+0+0 (secure 0 0 0) 0x7f597008bef0 con 0x7f59801ef9c0 2024-04-20T11:00:41.367 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.364+0000 7f5985971640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f596c06c8f0 0x7f596c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-20T11:00:41.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.364+0000 7f5985971640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f596c06c8f0 0x7f596c06edb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5978034000 tx=0x7f5978036040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-20T11:00:41.368 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.368+0000 7f597e7fc640 1 -- 172.21.15.90:0/3415499799 <== mon.0 v2:172.21.15.90:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187257 (secure 0 0 0) 0x7f5970023030 con 0x7f59801ef9c0 2024-04-20T11:00:41.553 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:41.553+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 --> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f598006cdc0 con 0x7f59801ef9c0 2024-04-20T11:00:42.244 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.244+0000 7f597e7fc640 1 -- 172.21.15.90:0/3415499799 <== mon.0 v2:172.21.15.90:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "b_data", "pool2": "b_data", "yes_i_really_really_mean_it": true}]=0 pool 'b_data' removed v44) ==== 154+0+0 (secure 0 0 0) 0x7f597005a110 con 0x7f59801ef9c0 2024-04-20T11:00:42.244 INFO:teuthology.orchestra.run.smithi090.stderr:pool 'b_data' removed 2024-04-20T11:00:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.247+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f596c06c8f0 msgr2=0x7f596c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.247+0000 7f5987bd5640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f596c06c8f0 0x7f596c06edb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5978034000 tx=0x7f5978036040 comp rx=0 tx=0).stop 2024-04-20T11:00:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.247+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59801ef9c0 msgr2=0x7f59801efe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-20T11:00:42.247 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.247+0000 7f5987bd5640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59801ef9c0 0x7f59801efe40 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f5970011490 tx=0x7f5970011950 comp rx=0 tx=0).stop 2024-04-20T11:00:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 shutdown_connections 2024-04-20T11:00:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:6832/1738105048,v1:172.21.15.90:6833/1738105048] conn(0x7f596c06c8f0 0x7f596c06edb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.90:3300/0,v1:172.21.15.90:6789/0] conn(0x7f59801ef9c0 0x7f59801efe40 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3301/0,v1:172.21.15.175:6790/0] conn(0x7f5980149960 0x7f5980072890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 --2- 172.21.15.90:0/3415499799 >> [v2:172.21.15.175:3300/0,v1:172.21.15.175:6789/0] conn(0x7f59680039e0 0x7f5980156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-20T11:00:42.248 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 >> 172.21.15.90:0/3415499799 conn(0x7f59800c7f10 msgr2=0x7f59800c82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-20T11:00:42.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 shutdown_connections 2024-04-20T11:00:42.249 INFO:teuthology.orchestra.run.smithi090.stderr:2024-04-20T11:00:42.248+0000 7f5987bd5640 1 -- 172.21.15.90:0/3415499799 wait complete. 2024-04-20T11:00:42.264 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-20T11:00:42.264 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-20T11:00:42.264 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.273 INFO:tasks.ceph.mds.a:Stopped 2024-04-20T11:00:42.273 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-20T11:00:42.273 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.322 INFO:tasks.ceph.mds.c:Stopped 2024-04-20T11:00:42.323 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-20T11:00:42.323 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.333 INFO:tasks.ceph.mds.b:Stopped 2024-04-20T11:00:42.333 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-20T11:00:42.333 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.387 INFO:tasks.ceph.mds.d:Stopped 2024-04-20T11:00:42.387 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-20T11:00:42.388 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-20T11:00:42.388 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.422 INFO:tasks.ceph.osd.0:Stopped 2024-04-20T11:00:42.423 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-20T11:00:42.423 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.501 INFO:tasks.ceph.osd.1:Stopped 2024-04-20T11:00:42.501 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-20T11:00:42.501 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.584 INFO:tasks.ceph.osd.2:Stopped 2024-04-20T11:00:42.584 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-20T11:00:42.584 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.590 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-20T11:00:42.632 INFO:tasks.ceph.osd.3:Stopped 2024-04-20T11:00:42.633 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-20T11:00:42.633 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.676 INFO:tasks.ceph.osd.4:Stopped 2024-04-20T11:00:42.676 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-20T11:00:42.676 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.724 INFO:tasks.ceph.osd.5:Stopped 2024-04-20T11:00:42.724 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-20T11:00:42.724 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.764 INFO:tasks.ceph.osd.6:Stopped 2024-04-20T11:00:42.764 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-20T11:00:42.764 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.841 INFO:tasks.ceph.osd.7:Stopped 2024-04-20T11:00:42.841 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-20T11:00:42.841 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-20T11:00:42.841 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.882 INFO:tasks.ceph.mgr.y:Stopped 2024-04-20T11:00:42.882 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-20T11:00:42.882 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.908 INFO:tasks.ceph.mgr.x:Stopped 2024-04-20T11:00:42.908 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-20T11:00:42.908 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-20T11:00:42.909 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.933 INFO:tasks.ceph.mon.a:Stopped 2024-04-20T11:00:42.933 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-20T11:00:42.933 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:42.961 INFO:tasks.ceph.mon.b:Stopped 2024-04-20T11:00:42.962 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-20T11:00:42.962 INFO:teuthology.orchestra.run:waiting for 300 2024-04-20T11:00:43.014 INFO:tasks.ceph.mon.c:Stopped 2024-04-20T11:00:43.014 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-20T11:00:43.014 DEBUG:teuthology.orchestra.run.smithi090:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v 'Replacing daemon mds' | head -n 1 2024-04-20T11:00:43.051 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:43.057 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T11:00:43.058 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-20T11:00:43.100 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:43.520 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T11:00:43.520 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-20T11:00:43.663 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T11:00:43.663 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-20T11:00:43.734 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T11:00:43.734 DEBUG:teuthology.orchestra.run.smithi090:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-20T11:00:43.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T11:00:43.803 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-20T11:00:44.003 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T11:00:44.003 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-20T11:00:44.131 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T11:00:44.131 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-20T11:00:44.189 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T11:00:44.189 DEBUG:teuthology.orchestra.run.smithi175:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-20T11:00:44.246 INFO:tasks.ceph:Archiving mon data... 2024-04-20T11:00:44.247 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/data/mon.a.tgz 2024-04-20T11:00:44.247 DEBUG:teuthology.orchestra.run.smithi090:> mktemp 2024-04-20T11:00:44.263 INFO:teuthology.orchestra.run.smithi090.stdout:/tmp/tmp.B4NSdejBay 2024-04-20T11:00:44.263 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.B4NSdejBay 2024-04-20T11:00:44.395 DEBUG:teuthology.orchestra.run.smithi090:> sudo chmod 0666 /tmp/tmp.B4NSdejBay 2024-04-20T11:00:44.476 DEBUG:teuthology.orchestra.remote:smithi090:/tmp/tmp.B4NSdejBay is 377KB 2024-04-20T11:00:44.544 DEBUG:teuthology.orchestra.run.smithi090:> rm -fr /tmp/tmp.B4NSdejBay 2024-04-20T11:00:44.558 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/data/mon.b.tgz 2024-04-20T11:00:44.558 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-20T11:00:44.576 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.LX34T9yCb4 2024-04-20T11:00:44.577 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.LX34T9yCb4 2024-04-20T11:00:44.718 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.LX34T9yCb4 2024-04-20T11:00:44.801 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.LX34T9yCb4 is 392KB 2024-04-20T11:00:44.898 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.LX34T9yCb4 2024-04-20T11:00:44.913 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/data/mon.c.tgz 2024-04-20T11:00:44.913 DEBUG:teuthology.orchestra.run.smithi175:> mktemp 2024-04-20T11:00:44.968 INFO:teuthology.orchestra.run.smithi175.stdout:/tmp/tmp.uZfBrRhVKK 2024-04-20T11:00:44.968 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uZfBrRhVKK 2024-04-20T11:00:45.105 DEBUG:teuthology.orchestra.run.smithi175:> sudo chmod 0666 /tmp/tmp.uZfBrRhVKK 2024-04-20T11:00:45.187 DEBUG:teuthology.orchestra.remote:smithi175:/tmp/tmp.uZfBrRhVKK is 392KB 2024-04-20T11:00:45.287 DEBUG:teuthology.orchestra.run.smithi175:> rm -fr /tmp/tmp.uZfBrRhVKK 2024-04-20T11:00:45.301 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-20T11:00:45.301 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-20T11:00:45.304 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-20T11:00:45.381 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-20T11:00:45.418 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-20T11:00:45.418 INFO:tasks.ceph:Archiving crash dumps... 2024-04-20T11:00:45.420 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/remote/smithi090/crash 2024-04-20T11:00:45.421 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-20T11:00:45.446 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/remote/smithi175/crash 2024-04-20T11:00:45.447 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-20T11:00:45.481 INFO:tasks.ceph:Shutting down logrotate 2024-04-20T11:00:45.481 DEBUG:teuthology.orchestra.run.smithi090:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:45.490 DEBUG:teuthology.orchestra.run.smithi175:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:45.565 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:45.588 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-20T11:00:45.628 INFO:tasks.ceph:Compressing logs... 2024-04-20T11:00:45.628 DEBUG:teuthology.orchestra.run.smithi090:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-20T11:00:45.631 DEBUG:teuthology.orchestra.run.smithi175:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-20T11:00:45.713 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23989.log 2024-04-20T11:00:45.713 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23909.log 2024-04-20T11:00:45.713 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.23989.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-20T11:00:45.713 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.23909.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23989.log.gz 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23869.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.23909.log.gz 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.23869.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.23869.log.gz 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23778.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23738.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.23778.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2%/var/log/ceph/ceph-client.admin.23738.log: -- replaced with /var/log/ceph/ceph-client.admin.23778.log.gz 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.23738.log.gz 2024-04-20T11:00:45.714 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.29641.log 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23949.log 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.1.29641.log: 92.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.29641.log.gz 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.23949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24029.log 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-osd.6.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.23949.log.gz 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23818.log 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.24029.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.24029.log.gz 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-client.admin.23818.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.23818.log.gz 2024-04-20T11:00:45.715 INFO:teuthology.orchestra.run.smithi175.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-20T11:00:45.716 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mds.d.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40965.log 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34230.log 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30013.log 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34230.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40965.log.gz 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30013.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34230.log.gz 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30656.log 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42834.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30013.log.gz 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2024-04-20T11:00:45.734 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36893.log 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23741.log 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45045.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30656.log.gz 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35798.log 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36893.log.gz 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.23741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31889.log 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35798.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.23741.log.gz 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37900.log 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35798.log.gz 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42051.log 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31213.log 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31889.log.gz 2024-04-20T11:00:45.735 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35238.log 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37900.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31213.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42051.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39561.log 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35238.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31213.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40695.log 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39561.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35238.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40032.log 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5%/var/log/ceph/ceph-client.admin.40695.log: -- replaced with /var/log/ceph/ceph-client.admin.39561.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36477.log 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40032.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.41686.log -- replaced with /var/log/ceph/ceph-client.admin.40695.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36477.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40032.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44293.log 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41686.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36477.log.gz 2024-04-20T11:00:45.736 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29444.log 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41686.log.gz 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35840.log 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44293.log: /var/log/ceph/ceph-client.admin.29444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41186.log 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44293.log.gz 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35840.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29444.log.gz 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32340.log 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35840.log.gz 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33246.log 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36414.log 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41186.log.gz 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31554.log 88.1% 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32340.log.gz 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36414.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33246.log.gz 2024-04-20T11:00:45.737 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44919.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31554.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.36414.log.gz 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38170.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29971.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31554.log.gz 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38170.log: gzip 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44919.log.gz -5 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37796.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29971.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38170.log.gz 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40386.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37796.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29971.log.gz 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35966.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37796.log.gz 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29887.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39948.log 2024-04-20T11:00:45.738 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40386.log.gz 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30391.log 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29887.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35966.log.gz 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29571.log 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29887.log.gz 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30391.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39948.log.gz 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42325.log 88.9% 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30391.log.gz 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29571.log.gz 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34188.log 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38026.log 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34188.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42325.log.gz -5 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32886.log 2024-04-20T11:00:45.739 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38026.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34188.log.gz 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30744.log 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38026.log.gz 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36251.log 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44251.log 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36251.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30744.log.gz 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.32886.log.gz 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36851.log 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36251.log.gz 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43873.log 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44251.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39393.log 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44251.log.gz 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30181.log 2024-04-20T11:00:45.740 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36851.log.gz 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39393.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43873.log.gz 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30181.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.39393.log.gz -5 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.42177.log 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.2.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30181.log.gz 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31548.log 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40615.log 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42177.log.gz 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30996.log 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31790.log 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31548.log.gz 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30996.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40615.log.gz 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2024-04-20T11:00:45.741 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31790.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30996.log.gz 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44125.log 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31790.log.gz 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42367.log 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36581.log 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42367.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31888.log 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42367.log.gz 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38338.log 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36581.log: /var/log/ceph/ceph-client.admin.31888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30307.log 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36581.log.gz 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30223.log 2024-04-20T11:00:45.742 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31888.log.gz 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30307.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38338.log.gz 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29845.log 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30307.log.gz 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31792.log 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29845.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30223.log.gzgzip 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.40344.log 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31792.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29845.log.gz 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29613.log 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33800.log 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31792.log.gz 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40344.log.gz 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30097.log 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29613.log.gz 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.0.33800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32424.log 2024-04-20T11:00:45.743 INFO:teuthology.orchestra.run.smithi090.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.33800.log.gz 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34314.log 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32424.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30097.log.gz 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23396.log 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34314.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32424.log.gz 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37469.log 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.23396.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34314.log.gz 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.23396.log.gz 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41433.log 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.37385.log 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37469.log.gz 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39477.log 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41433.log.gz 2024-04-20T11:00:45.744 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41232.log 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36121.log 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37385.log.gz 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39477.log: /var/log/ceph/ceph-client.admin.41232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44167.log 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39477.log.gz 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.41232.log.gz 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr: 89.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40158.log 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44167.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36121.log.gz 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39663.log 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40158.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44167.log.gz 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39309.log 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40158.log.gz 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43224.log 2024-04-20T11:00:45.745 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39663.log.gz 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42637.log 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43224.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.39309.log.gz -5 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38993.log 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42637.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43224.log.gz 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30828.log 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42637.log.gz 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39187.log 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38993.log.gz 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37571.log 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39187.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30828.log.gz 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41144.log 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37571.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.39187.log.gz 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42679.log 2024-04-20T11:00:45.746 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37571.log.gz 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35672.log 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42679.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41144.log.gz 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42451.log 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35672.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42679.log.gz 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36538.log 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35672.log.gz 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29486.log 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42451.log.gz 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34272.log 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29486.log: gzip -5 88.8% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.36538.log.gz 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-client.admin.35714.log 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34272.log: gzip -5 88.9% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.29486.log.gz 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr: /var/log/ceph/ceph-osd.3.log 2024-04-20T11:00:45.747 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34272.log.gz 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35714.log.gz 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36725.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34944.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36725.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43392.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36725.log.gz 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40428.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34944.log: /var/log/ceph/ceph-client.admin.43392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37708.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34944.log.gz 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43392.log.gz 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35756.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29655.log 2024-04-20T11:00:45.748 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37708.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40428.log.gz 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33204.log 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37708.log.gz 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35756.log.gz 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32256.log 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35028.log 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29655.log.gz 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32256.log: gzip 89.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.33204.log.gz --verbose 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr: -- /var/log/ceph/ceph-client.admin.41770.log 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32256.log.gz 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41770.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35028.log.gz 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34776.log 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41770.log.gz 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34902.log 2024-04-20T11:00:45.749 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44482.log: /var/log/ceph/ceph-client.admin.34776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29697.log 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34776.log.gz 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23637.log 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37613.log 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29697.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34902.log.gz 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.23637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38545.log 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29697.log.gz 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.23637.log.gz 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43789.log 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37613.log: /var/log/ceph/ceph-client.admin.38545.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37613.log.gz 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43789.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38545.log.gz 2024-04-20T11:00:45.750 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40242.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1%/var/log/ceph/ceph-mds.c.log: -- replaced with /var/log/ceph/ceph-client.admin.43789.log.gz 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32382.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31891.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40242.log: /var/log/ceph/ceph-client.admin.32382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40779.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40242.log.gz 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32382.log.gz 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33288.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36209.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40779.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31891.log.gz 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40779.log.gz 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33288.log.gz 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43182.log 2024-04-20T11:00:45.751 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38068.log 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37301.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36209.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43182.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38068.log: gzip -5 --verbose 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43182.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr: -- /var/log/ceph/ceph-client.admin.29529.log 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44648.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38068.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30702.log 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36977.log 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29529.log: /var/log/ceph/ceph-client.admin.30702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31892.log 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29529.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37427.log 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30702.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31892.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36977.log.gz 2024-04-20T11:00:45.752 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31892.log.gz 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32172.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37427.log.gz 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31555.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mgr.y.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32172.log.gz 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41560.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35504.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31555.log: /var/log/ceph/ceph-client.admin.41560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42918.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35504.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31555.log.gz 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41560.log.gz 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35504.log.gz 2024-04-20T11:00:45.753 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38254.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42918.log: /var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31216.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38254.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42918.log.gz 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43747.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38254.log.gz 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44377.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43747.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31216.log.gz 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43747.log.gz 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34104.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44377.log: /var/log/ceph/ceph-client.admin.44564.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44377.log.gz 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37343.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40116.log 2024-04-20T11:00:45.754 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37343.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34104.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37343.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32214.log 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36163.log 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40116.log: /var/log/ceph/ceph-client.admin.32214.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40116.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34566.log 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32214.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34818.log 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34566.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36163.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34566.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40821.log 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34524.log 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34818.log: /var/log/ceph/ceph-client.admin.40821.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34818.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40821.log.gz 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29363.log 2024-04-20T11:00:45.755 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38128.log 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29363.log: /var/log/ceph/ceph-client.admin.34524.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34524.log.gz 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29363.log.gz 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43957.log 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38128.log: /var/log/ceph/ceph-client.admin.43957.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38128.log.gz 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43957.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37750.log 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34398.log 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36767.log: /var/log/ceph/ceph-client.admin.37750.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35196.log 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37750.log.gz 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29785.log 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35196.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34398.log.gz 2024-04-20T11:00:45.756 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35196.log.gz 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32634.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41102.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29785.log: /var/log/ceph/ceph-client.admin.32634.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29785.log.gz 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32634.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39906.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42960.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41102.log: /var/log/ceph/ceph-client.admin.39906.log: 89.3% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39906.log.gz 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41102.log.gz 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39351.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31546.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42960.log.gz 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41991.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31546.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39351.log.gz 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32592.log 2024-04-20T11:00:45.757 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31546.log.gz 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38422.log 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32592.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41991.log.gz 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32592.log.gz 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36935.log 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35070.log 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38422.log: /var/log/ceph/ceph-client.admin.36935.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.38422.log.gz 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42876.log 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36935.log.gz 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42876.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35070.log.gz 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42876.log.gz 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41049.log 2024-04-20T11:00:45.758 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44835.log: /var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39435.log 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41049.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41049.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32088.log 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39435.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39435.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31210.log 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32088.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32088.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43266.log 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31210.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31210.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43266.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.43266.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44041.log 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44961.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34608.log 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44041.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44041.log.gz 2024-04-20T11:00:45.759 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44690.log 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34608.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34608.log.gz 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31556.log 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44690.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44690.log.gz 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35420.log 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31556.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31556.log.gz 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37197.log 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35420.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35420.log.gz 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43537.log 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37197.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37197.log.gz 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35924.log 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43537.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43537.log.gz 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35588.log 2024-04-20T11:00:45.760 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35924.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35924.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38943.log 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35588.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35588.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31218.log 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38943.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38943.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31218.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31218.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42409.log 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34356.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34356.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43621.log 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42409.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42409.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33162.log 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43621.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43621.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32508.log 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33162.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33162.log.gz 2024-04-20T11:00:45.761 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41355.log 2024-04-20T11:00:45.762 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32508.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32508.log.gz 2024-04-20T11:00:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35154.log 2024-04-20T11:00:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41355.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41355.log.gz 2024-04-20T11:00:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37072.log 2024-04-20T11:00:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35154.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35154.log.gz 2024-04-20T11:00:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43831.log 2024-04-20T11:00:45.777 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37072.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37072.log.gz 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35462.log 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43831.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43831.log.gz 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39758.log 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35462.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35462.log.gz 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34650.log 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39758.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39758.log.gz 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44522.log 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34650.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34650.log.gz 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34440.log 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44522.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44522.log.gz 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42577.log 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34440.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34440.log.gz 2024-04-20T11:00:45.778 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40923.log 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42577.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42577.log.gz 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41007.log 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40923.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40923.log.gz 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42135.log 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41007.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41007.log.gz 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29929.log 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42135.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42135.log.gz 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39716.log 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29929.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29929.log.gz 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31553.log 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39716.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39716.log.gz 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43002.log 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31553.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31553.log.gz 2024-04-20T11:00:45.779 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43002.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43002.log.gz 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30265.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38589.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34860.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30265.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30265.log.gz 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32298.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34860.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34860.log.gz 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30477.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32298.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32298.log.gz 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34692.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30477.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30477.log.gz 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40512.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34692.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34692.log.gz 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33978.log 2024-04-20T11:00:45.780 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40512.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40512.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39038.log 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33978.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33978.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39038.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39038.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39519.log 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45129.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32802.log 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39519.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39519.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40737.log 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32802.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32802.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40737.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40737.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43999.log 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37259.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-04-20T11:00:45.781 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34146.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43999.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43999.log.gz 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43350.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34146.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34146.log.gz 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36079.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43350.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43350.log.gz 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38380.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36079.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36079.log.gz 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43308.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38380.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38380.log.gz 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30912.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43308.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43308.log.gz 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41728.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30912.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30912.log.gz 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40200.log 2024-04-20T11:00:45.782 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41728.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41728.log.gz 2024-04-20T11:00:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44793.log 2024-04-20T11:00:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40200.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40200.log.gz 2024-04-20T11:00:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30349.log 2024-04-20T11:00:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44793.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44793.log.gz 2024-04-20T11:00:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31215.log 2024-04-20T11:00:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30349.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30349.log.gz 2024-04-20T11:00:45.783 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43663.log 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31215.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31215.log.gz 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30572.log 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43663.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43663.log.gz 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39860.log 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30572.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30572.log.gz 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41518.log 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39860.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39860.log.gz 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39122.log 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41518.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41518.log.gz 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33936.log 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39122.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39122.log.gz 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-04-20T11:00:45.787 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33936.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33936.log.gz 2024-04-20T11:00:45.788 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32994.log 2024-04-20T11:00:45.788 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44877.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-04-20T11:00:45.788 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45087.log 2024-04-20T11:00:45.788 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32994.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32994.log.gz 2024-04-20T11:00:45.788 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35280.log 2024-04-20T11:00:45.788 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45087.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45087.log.gz 2024-04-20T11:00:45.789 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34062.log 2024-04-20T11:00:45.789 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35280.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35280.log.gz 2024-04-20T11:00:45.789 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41644.log 2024-04-20T11:00:45.789 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34062.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34062.log.gz 2024-04-20T11:00:45.789 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42493.log 2024-04-20T11:00:45.790 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41644.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41644.log.gz 2024-04-20T11:00:45.790 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33120.log 2024-04-20T11:00:45.791 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42493.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42493.log.gz 2024-04-20T11:00:45.791 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2024-04-20T11:00:45.792 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33120.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33120.log.gz 2024-04-20T11:00:45.792 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36683.log 2024-04-20T11:00:45.793 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43044.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2024-04-20T11:00:45.793 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43434.log 2024-04-20T11:00:45.794 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36683.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36683.log.gz 2024-04-20T11:00:45.794 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39800.log 2024-04-20T11:00:45.795 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43434.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43434.log.gz 2024-04-20T11:00:45.795 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33330.log 2024-04-20T11:00:45.796 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39800.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39800.log.gz 2024-04-20T11:00:45.796 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37838.log 2024-04-20T11:00:45.797 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33330.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33330.log.gz 2024-04-20T11:00:45.798 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.17427.log 2024-04-20T11:00:45.798 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37838.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37838.log.gz 2024-04-20T11:00:45.799 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43579.log 2024-04-20T11:00:45.799 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph.tmp-client.admin.17427.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.17427.log.gz 2024-04-20T11:00:45.800 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30786.log 2024-04-20T11:00:45.800 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43579.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43579.log.gz 2024-04-20T11:00:45.800 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-04-20T11:00:45.801 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30786.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30786.log.gz 2024-04-20T11:00:45.802 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-04-20T11:00:45.802 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32676.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-04-20T11:00:45.802 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34986.log 2024-04-20T11:00:45.803 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.45003.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-04-20T11:00:45.804 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41293.log 2024-04-20T11:00:45.804 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34986.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34986.log.gz 2024-04-20T11:00:45.805 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30614.log 2024-04-20T11:00:45.805 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41293.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41293.log.gz 2024-04-20T11:00:45.806 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40470.log 2024-04-20T11:00:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30614.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30614.log.gz 2024-04-20T11:00:45.807 INFO:teuthology.orchestra.run.smithi090.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-20T11:00:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37511.log 2024-04-20T11:00:45.807 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30139.log 2024-04-20T11:00:45.808 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40470.log: /var/log/ceph/ceph-client.admin.37511.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40470.log.gz 2024-04-20T11:00:45.808 INFO:teuthology.orchestra.run.smithi090.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37511.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31552.log 2024-04-20T11:00:45.808 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-20T11:00:45.808 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30139.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30139.log.gz 2024-04-20T11:00:45.809 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38212.log 2024-04-20T11:00:45.809 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41812.log 2024-04-20T11:00:45.809 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31552.log: /var/log/ceph/ceph-client.admin.38212.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31552.log.gz 2024-04-20T11:00:45.810 INFO:teuthology.orchestra.run.smithi090.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38212.log.gz 2024-04-20T11:00:45.810 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37666.log 2024-04-20T11:00:45.811 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41812.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41812.log.gz 2024-04-20T11:00:45.811 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44740.log 2024-04-20T11:00:45.811 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35112.log 2024-04-20T11:00:45.812 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37666.log: /var/log/ceph/ceph-client.admin.44740.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37666.log.gz 2024-04-20T11:00:45.812 INFO:teuthology.orchestra.run.smithi090.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44740.log.gz 2024-04-20T11:00:45.813 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30954.log 2024-04-20T11:00:45.813 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35112.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35112.log.gz 2024-04-20T11:00:45.813 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37942.log 2024-04-20T11:00:45.816 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30954.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30954.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30433.log 2024-04-20T11:00:45.816 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-20T11:00:45.816 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31038.log 2024-04-20T11:00:45.816 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37942.log: /var/log/ceph/ceph-client.admin.30433.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30433.log.gz 2024-04-20T11:00:45.816 INFO:teuthology.orchestra.run.smithi090.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37942.log.gz 2024-04-20T11:00:45.817 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31204.log 2024-04-20T11:00:45.817 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35630.log 2024-04-20T11:00:45.817 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31038.log.gz 2024-04-20T11:00:45.817 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31204.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31204.log.gz 2024-04-20T11:00:45.818 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29267.log 2024-04-20T11:00:45.818 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44083.log 2024-04-20T11:00:45.818 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35630.log: /var/log/ceph/ceph-client.admin.29267.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35630.log.gz 2024-04-20T11:00:45.818 INFO:teuthology.orchestra.run.smithi090.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29267.log.gz 2024-04-20T11:00:45.818 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36037.log 2024-04-20T11:00:45.819 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44083.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44083.log.gz 2024-04-20T11:00:45.819 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42219.log 2024-04-20T11:00:45.820 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42283.log 2024-04-20T11:00:45.820 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36037.log: /var/log/ceph/ceph-client.admin.42219.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36037.log.gz 2024-04-20T11:00:45.820 INFO:teuthology.orchestra.run.smithi090.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42219.log.gz 2024-04-20T11:00:45.821 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38775.log 2024-04-20T11:00:45.821 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42283.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42283.log.gz 2024-04-20T11:00:45.821 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2024-04-20T11:00:45.822 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38901.log 2024-04-20T11:00:45.822 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38775.log: /var/log/ceph/ceph-client.admin.44606.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38775.log.gz 2024-04-20T11:00:45.822 INFO:teuthology.orchestra.run.smithi090.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz 2024-04-20T11:00:45.823 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38733.log 2024-04-20T11:00:45.823 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38901.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38901.log.gz 2024-04-20T11:00:45.823 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31542.log 2024-04-20T11:00:45.824 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43104.log 2024-04-20T11:00:45.824 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38733.log: /var/log/ceph/ceph-client.admin.31542.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38733.log.gz 2024-04-20T11:00:45.825 INFO:teuthology.orchestra.run.smithi090.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31220.log 2024-04-20T11:00:45.825 INFO:teuthology.orchestra.run.smithi090.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31542.log.gz 2024-04-20T11:00:45.825 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43104.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43104.log.gz 2024-04-20T11:00:45.825 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32952.log 2024-04-20T11:00:45.825 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37030.log 2024-04-20T11:00:45.827 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31220.log: /var/log/ceph/ceph-client.admin.32952.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31220.log.gz 2024-04-20T11:00:45.827 INFO:teuthology.orchestra.run.smithi090.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32952.log.gz 2024-04-20T11:00:45.827 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42740.log 2024-04-20T11:00:45.827 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37030.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37030.log.gz 2024-04-20T11:00:45.828 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2024-04-20T11:00:45.828 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33036.log 2024-04-20T11:00:45.829 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42740.log: /var/log/ceph/ceph-client.admin.38691.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42740.log.gz 2024-04-20T11:00:45.829 INFO:teuthology.orchestra.run.smithi090.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2024-04-20T11:00:45.829 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44422.log 2024-04-20T11:00:45.830 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33036.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33036.log.gz 2024-04-20T11:00:45.830 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2024-04-20T11:00:45.830 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-04-20T11:00:45.831 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44422.log: /var/log/ceph/ceph-client.admin.32844.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44422.log.gz 2024-04-20T11:00:45.831 INFO:teuthology.orchestra.run.smithi090.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2024-04-20T11:00:45.831 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-20T11:00:45.832 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36809.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-04-20T11:00:45.832 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31791.log 2024-04-20T11:00:45.832 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39267.log 2024-04-20T11:00:45.833 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.31791.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31791.log.gz 2024-04-20T11:00:45.835 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40863.log 2024-04-20T11:00:45.835 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39267.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39267.log.gz 2024-04-20T11:00:45.837 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37118.log 2024-04-20T11:00:45.838 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40863.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40863.log.gz 2024-04-20T11:00:45.838 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43705.log 2024-04-20T11:00:45.838 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37118.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37118.log.gz 2024-04-20T11:00:45.841 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35882.log 2024-04-20T11:00:45.841 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43705.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2024-04-20T11:00:45.841 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39621.log 2024-04-20T11:00:45.841 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35882.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35882.log.gz 2024-04-20T11:00:45.841 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38296.log 2024-04-20T11:00:45.841 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39621.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39621.log.gz 2024-04-20T11:00:45.844 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44209.log 2024-04-20T11:00:45.844 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38296.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38296.log.gz 2024-04-20T11:00:45.844 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38859.log 2024-04-20T11:00:45.844 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44209.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44209.log.gz 2024-04-20T11:00:45.844 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35546.log 2024-04-20T11:00:45.844 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38859.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38859.log.gz 2024-04-20T11:00:45.847 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36641.log 2024-04-20T11:00:45.847 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.35546.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35546.log.gz 2024-04-20T11:00:45.847 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43915.log 2024-04-20T11:00:45.847 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.36641.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36641.log.gz 2024-04-20T11:00:45.847 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39990.log 2024-04-20T11:00:45.848 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.43915.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43915.log.gz 2024-04-20T11:00:45.848 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44335.log 2024-04-20T11:00:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39990.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39990.log.gz 2024-04-20T11:00:45.850 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30521.log 2024-04-20T11:00:45.851 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.44335.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44335.log.gz 2024-04-20T11:00:45.851 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41475.log 2024-04-20T11:00:45.852 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30521.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30521.log.gz 2024-04-20T11:00:45.852 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33078.log 2024-04-20T11:00:45.853 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41475.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41475.log.gz 2024-04-20T11:00:45.853 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38817.log 2024-04-20T11:00:45.867 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33078.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33078.log.gz 2024-04-20T11:00:45.867 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30055.log 2024-04-20T11:00:45.867 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38817.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38817.log.gz 2024-04-20T11:00:45.867 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29741.log 2024-04-20T11:00:45.867 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30055.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30055.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33432.log 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29741.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29741.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32550.log 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.33432.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33432.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29175.log 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32550.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32550.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42535.log 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.29175.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29175.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42535.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42535.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30870.log 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38483.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34482.log 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.30870.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30870.log.gz 2024-04-20T11:00:45.868 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32760.log 2024-04-20T11:00:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34482.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34482.log.gz 2024-04-20T11:00:45.869 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32130.log 2024-04-20T11:00:45.872 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32760.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32760.log.gz 2024-04-20T11:00:45.872 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34020.log 2024-04-20T11:00:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32130.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32130.log.gz 2024-04-20T11:00:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37984.log 2024-04-20T11:00:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34020.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34020.log.gz 2024-04-20T11:00:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40284.log 2024-04-20T11:00:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.37984.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37984.log.gz 2024-04-20T11:00:45.873 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32466.log 2024-04-20T11:00:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40284.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40284.log.gz 2024-04-20T11:00:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41602.log 2024-04-20T11:00:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32466.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32466.log.gz 2024-04-20T11:00:45.875 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40554.log 2024-04-20T11:00:45.876 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41602.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41602.log.gz 2024-04-20T11:00:45.876 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40074.log 2024-04-20T11:00:45.877 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40554.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40554.log.gz 2024-04-20T11:00:45.878 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32718.log 2024-04-20T11:00:45.879 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.40074.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40074.log.gz 2024-04-20T11:00:45.879 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34734.log 2024-04-20T11:00:45.880 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.32718.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32718.log.gz 2024-04-20T11:00:45.880 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41949.log 2024-04-20T11:00:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.34734.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34734.log.gz 2024-04-20T11:00:45.881 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41854.log 2024-04-20T11:00:45.883 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41949.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41949.log.gz 2024-04-20T11:00:45.883 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-04-20T11:00:45.884 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.41854.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41854.log.gz 2024-04-20T11:00:45.884 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38649.log 2024-04-20T11:00:45.885 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.31890.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-04-20T11:00:45.885 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42093.log 2024-04-20T11:00:45.886 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.38649.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38649.log.gz 2024-04-20T11:00:45.886 INFO:teuthology.orchestra.run.smithi090.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39080.log 2024-04-20T11:00:45.887 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.42093.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42093.log.gz 2024-04-20T11:00:45.888 INFO:teuthology.orchestra.run.smithi090.stderr:/var/log/ceph/ceph-client.admin.39080.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39080.log.gz 2024-04-20T11:00:45.922 INFO:teuthology.orchestra.run.smithi175.stderr:/var/log/ceph/ceph-mon.b.log: 91.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-20T11:00:45.967 INFO:teuthology.orchestra.run.smithi175.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-20T11:00:46.386 INFO:teuthology.orchestra.run.smithi090.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-20T11:00:47.591 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-20T11:00:48.147 INFO:teuthology.orchestra.run.smithi175.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-20T11:00:48.945 INFO:teuthology.orchestra.run.smithi090.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-20T11:00:49.097 INFO:teuthology.orchestra.run.smithi090.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-20T11:00:49.419 INFO:teuthology.orchestra.run.smithi090.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-20T11:00:49.553 INFO:teuthology.orchestra.run.smithi090.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-20T11:00:49.577 INFO:teuthology.orchestra.run.smithi175.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-20T11:00:49.798 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-20T11:00:49.868 INFO:teuthology.orchestra.run.smithi175.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-20T11:00:50.597 INFO:teuthology.orchestra.run.smithi175.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-20T11:01:18.333 INFO:teuthology.orchestra.run.smithi090.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-20T11:01:20.674 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-20T11:01:20.767 INFO:teuthology.orchestra.run.smithi090.stderr:Error initializing cluster client: ObjectNotFound('RADOS object not found (error calling conf_read_file)') 2024-04-20T11:01:20.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T11:01:20.771 ERROR:tasks.mds_thrash.fs.[a]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/mds_thrash.py", line 124, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/mds_thrash.py", line 247, in do_thrash status = self.fs.status() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/filesystem.py", line 407, in status return FSStatus(self.mon_manager, epoch) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/cephfs/filesystem.py", line 88, in __init__ self.map = json.loads(self.get_ceph_cmd_stdout(*cmd)) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout return self.run_ceph_cmd(**kwargs).stdout.getvalue().strip() File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd return self.mon_manager.run_cluster_cmd(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_a8c84f5997950fd7d008204839253291d52e6eda/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi090 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json' 2024-04-20T11:01:22.349 INFO:teuthology.orchestra.run.smithi090.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-20T11:01:22.351 INFO:teuthology.orchestra.run.smithi090.stderr: 2024-04-20T11:01:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:real 0m36.709s 2024-04-20T11:01:22.351 INFO:teuthology.orchestra.run.smithi090.stderr:user 1m21.641s 2024-04-20T11:01:22.352 INFO:teuthology.orchestra.run.smithi090.stderr:sys 0m2.786s 2024-04-20T11:01:22.596 INFO:tasks.daemonwatchdog.daemon_watchdog:thrasher.fs.[a] failed 2024-04-20T11:01:22.596 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-04-20T11:01:22.597 DEBUG:teuthology.orchestra.run.smithi090:> set -ex 2024-04-20T11:01:22.597 DEBUG:teuthology.orchestra.run.smithi090:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T11:01:22.613 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056093,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18730 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248832k,nr_inodes=812208,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497668k,nr_inodes=819200,mode=755,inode64 0 0 2024-04-20T11:01:22.613 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T11:01:22.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T11:01:22.614 DEBUG:teuthology.orchestra.run.smithi090:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-20T11:01:22.668 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T11:01:22.669 INFO:teuthology.orchestra.run.smithi090.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-20T11:01:22.669 DEBUG:teuthology.orchestra.run.smithi175:> set -ex 2024-04-20T11:01:22.669 DEBUG:teuthology.orchestra.run.smithi175:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-20T11:01:22.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056097,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=17522 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysusers.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248836k,nr_inodes=812209,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497676k,nr_inodes=819200,mode=755,inode64 0 0 2024-04-20T11:01:22.686 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T11:01:22.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-20T11:01:22.686 DEBUG:teuthology.orchestra.run.smithi175:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-20T11:01:22.740 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T11:01:22.741 INFO:teuthology.orchestra.run.smithi175.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-20T11:01:28.865 INFO:teuthology.orchestra.run.smithi175.stderr: 93.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-20T11:01:28.867 INFO:teuthology.orchestra.run.smithi175.stderr: 2024-04-20T11:01:28.867 INFO:teuthology.orchestra.run.smithi175.stderr:real 0m43.182s 2024-04-20T11:01:28.868 INFO:teuthology.orchestra.run.smithi175.stderr:user 1m1.011s 2024-04-20T11:01:28.868 INFO:teuthology.orchestra.run.smithi175.stderr:sys 0m2.010s 2024-04-20T11:01:28.868 INFO:tasks.ceph:Archiving logs... 2024-04-20T11:01:28.868 DEBUG:teuthology.misc:Transferring archived files from smithi090:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/remote/smithi090/log 2024-04-20T11:01:28.869 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T11:01:40.757 DEBUG:teuthology.misc:Transferring archived files from smithi175:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/remote/smithi175/log 2024-04-20T11:01:40.758 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-20T11:01:49.501 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-20T11:01:49.512 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-20T11:01:49.512 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T11:01:49.515 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-20T11:01:49.592 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-20T11:01:49.601 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-20T11:01:49.601 DEBUG:teuthology.orchestra.run.smithi090:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T11:01:49.604 DEBUG:teuthology.orchestra.run.smithi175:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-20T11:01:49.618 INFO:teuthology.orchestra.run.smithi090.stderr:bash: line 1: ntpq: command not found 2024-04-20T11:01:49.621 INFO:teuthology.orchestra.run.smithi175.stderr:bash: line 1: ntpq: command not found 2024-04-20T11:01:49.624 INFO:teuthology.orchestra.run.smithi090.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T11:01:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:=============================================================================== 2024-04-20T11:01:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +537us[ +537us] +/- 71ms 2024-04-20T11:01:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 -24us[ -17us] +/- 75ms 2024-04-20T11:01:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -593us[ -593us] +/- 88ms 2024-04-20T11:01:49.625 INFO:teuthology.orchestra.run.smithi090.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T11:01:49.626 INFO:teuthology.orchestra.run.smithi175.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-20T11:01:49.626 INFO:teuthology.orchestra.run.smithi175.stdout:=============================================================================== 2024-04-20T11:01:49.626 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 54 +536us[ +533us] +/- 70ms 2024-04-20T11:01:49.627 INFO:teuthology.orchestra.run.smithi175.stdout:^* hv02.front.sepia.ceph.com 3 6 377 53 -17us[ -20us] +/- 75ms 2024-04-20T11:01:49.627 INFO:teuthology.orchestra.run.smithi175.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -595us[ -595us] +/- 88ms 2024-04-20T11:01:49.627 INFO:teuthology.orchestra.run.smithi175.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-20T11:01:49.628 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-20T11:01:49.637 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-20T11:01:49.639 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-20T11:01:49.649 DEBUG:teuthology.orchestra.run.smithi090:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T11:01:49.729 DEBUG:teuthology.orchestra.run.smithi175:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-20T11:01:49.782 DEBUG:teuthology.orchestra.run.smithi090:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T11:01:49.811 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T11:01:49.811 DEBUG:teuthology.orchestra.run.smithi175:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-20T11:01:49.839 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T11:01:49.839 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-20T11:01:49.849 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-20T11:01:49.878 INFO:teuthology.task.internal:Duration was 938.250382 seconds 2024-04-20T11:01:49.878 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-20T11:01:49.888 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-20T11:01:49.888 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T11:01:49.891 DEBUG:teuthology.orchestra.run.smithi175:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-20T11:01:49.927 INFO:teuthology.orchestra.run.smithi090.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T11:01:49.930 INFO:teuthology.orchestra.run.smithi175.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-20T11:01:50.120 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-20T11:01:50.120 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi090.front.sepia.ceph.com 2024-04-20T11:01:50.120 DEBUG:teuthology.orchestra.run.smithi090:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T11:01:50.180 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi175.front.sepia.ceph.com 2024-04-20T11:01:50.180 DEBUG:teuthology.orchestra.run.smithi175:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-20T11:01:50.208 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-20T11:01:50.208 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T11:01:50.222 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-20T11:01:50.274 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-20T11:01:50.274 DEBUG:teuthology.orchestra.run.smithi090:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T11:01:50.290 DEBUG:teuthology.orchestra.run.smithi175:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-20T11:01:50.387 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-20T11:01:50.398 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-20T11:01:50.398 DEBUG:teuthology.orchestra.run.smithi090:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T11:01:50.421 DEBUG:teuthology.orchestra.run.smithi175:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-20T11:01:50.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-20T11:01:50.454 DEBUG:teuthology.orchestra.run.smithi090:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T11:01:50.463 DEBUG:teuthology.orchestra.run.smithi175:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-20T11:01:50.482 INFO:teuthology.orchestra.run.smithi090.stdout:kernel.core_pattern = core 2024-04-20T11:01:50.506 INFO:teuthology.orchestra.run.smithi175.stdout:kernel.core_pattern = core 2024-04-20T11:01:50.519 DEBUG:teuthology.orchestra.run.smithi090:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T11:01:50.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T11:01:50.549 DEBUG:teuthology.orchestra.run.smithi175:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-20T11:01:50.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-20T11:01:50.573 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-20T11:01:50.582 INFO:teuthology.task.internal:Transferring archived files... 2024-04-20T11:01:50.583 DEBUG:teuthology.misc:Transferring archived files from smithi090:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/remote/smithi090 2024-04-20T11:01:50.583 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T11:01:50.619 DEBUG:teuthology.misc:Transferring archived files from smithi175:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-04-20_09:50:15-fs-wip-rishabh-testing-20240416.193735-testing-default-smithi/7664489/remote/smithi175 2024-04-20T11:01:50.619 DEBUG:teuthology.orchestra.run.smithi175:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-20T11:01:50.648 INFO:teuthology.task.internal:Removing archive directory... 2024-04-20T11:01:50.648 DEBUG:teuthology.orchestra.run.smithi090:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T11:01:50.656 DEBUG:teuthology.orchestra.run.smithi175:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-20T11:01:50.698 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-20T11:01:50.710 INFO:teuthology.task.internal:Not uploading archives. 2024-04-20T11:01:50.710 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-20T11:01:50.726 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-20T11:01:50.726 DEBUG:teuthology.orchestra.run.smithi090:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T11:01:50.729 DEBUG:teuthology.orchestra.run.smithi175:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-20T11:01:50.740 INFO:teuthology.orchestra.run.smithi090.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 20 11:01 /home/ubuntu/cephtest 2024-04-20T11:01:50.752 INFO:teuthology.orchestra.run.smithi175.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 20 11:01 /home/ubuntu/cephtest 2024-04-20T11:01:50.754 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-20T11:01:50.764 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-20T11:01:50.871 INFO:teuthology.run:Summary data: description: fs/thrash/multifs/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-2c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore/bluestore-bitmap overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down multifs pg_health session_timeout thrashosds-health} tasks/{1-thrash/mds 2-workunit/cfuse_workunit_suites_fsstress}} duration: 938.2503819465637 flavor: default owner: scheduled_rishabh@teuthology success: true 2024-04-20T11:01:50.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-20T11:01:50.950 INFO:teuthology.run:pass